2023-12-24T18:19:18.098 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-24T18:19:18.098 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --archive /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316 -- /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/orig.config.yaml 2023-12-24T18:19:18.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-24T18:19:18.240 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316 branch: wip-yuri4-testing-2023-12-21-0917-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7500316' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-12-21-0917-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-12-21-0917-quincy sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9956 sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f sleep_before_teardown: 0 subset: 908/1024 suite: fs suite_branch: wip-yuri4-testing-2023-12-21-0917-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-24_15:41:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-24T18:19:18.240 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa; will attempt to use it 2023-12-24T18:19:18.241 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa/tasks 2023-12-24T18:19:18.241 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-24T18:19:18.243 INFO:teuthology.task.internal:Checking packages... 2023-12-24T18:19:18.267 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f' 2023-12-24T18:19:18.267 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-24T18:19:18.267 INFO:teuthology.packaging:ref: None 2023-12-24T18:19:18.267 INFO:teuthology.packaging:tag: None 2023-12-24T18:19:18.267 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-12-21-0917-quincy 2023-12-24T18:19:18.267 INFO:teuthology.packaging:sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T18:19:18.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-12-21-0917-quincy 2023-12-24T18:19:18.479 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-168-g5e7ce129-1focal 2023-12-24T18:19:18.481 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-24T18:19:18.487 INFO:teuthology.task.internal:no buildpackages task found 2023-12-24T18:19:18.487 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-24T18:19:18.492 INFO:teuthology.task.internal:Saving configuration 2023-12-24T18:19:18.512 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-24T18:19:18.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T18:19:18.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 18:13:25.657275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-24T18:19:18.566 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 18:13:25.658782', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-24T18:19:18.566 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-24T18:19:18.572 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-24T18:19:18.573 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-24T18:19:18.573 INFO:teuthology.run_tasks:Running task console_log... 2023-12-24T18:19:18.644 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82b34d5ca0>, signals=[15]) 2023-12-24T18:19:18.645 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-24T18:19:18.651 INFO:teuthology.task.internal:Opening connections... 2023-12-24T18:19:18.651 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:19:18.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:19:18.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:19:18.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:19:18.747 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-24T18:19:18.754 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-12-24T18:19:18.782 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-12-24T18:19:18.782 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-12-24T18:19:18.829 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="20.04" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=focal 2023-12-24T18:19:18.830 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=focal 2023-12-24T18:19:18.831 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-12-24T18:19:18.879 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-12-24T18:19:18.886 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-12-24T18:19:18.886 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-24T18:19:18.891 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-24T18:19:18.892 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-24T18:19:18.892 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2023-12-24T18:19:18.892 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2023-12-24T18:19:18.892 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-12-24T18:19:18.911 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-24T18:19:18.921 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-24T18:19:18.926 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-24T18:19:18.927 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-12-24T18:19:18.929 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-12-24T18:19:18.940 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-24T18:19:18.946 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-24T18:19:18.946 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-12-24T18:19:18.948 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-12-24T18:19:18.961 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-24T18:19:19.020 INFO:teuthology.run_tasks:Running task kernel... 2023-12-24T18:19:19.034 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-24T18:19:19.034 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-24T18:19:19.034 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-24T18:19:19.035 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-24T18:19:19.035 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-24T18:19:19.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:19:19.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-12-24T18:19:19.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:19:19.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-12-24T18:19:19.208 DEBUG:teuthology.task.kernel:sha1 for client.1 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:19:19.208 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-24T18:19:19.208 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-12-24T18:19:19.215 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-124-generic 2023-12-24T18:19:19.215 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:19:19.216 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-24T18:19:19.216 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-24T18:19:19.216 DEBUG:teuthology.orchestra.run.smithi082:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-24T18:19:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-24T18:19:19.302 DEBUG:teuthology.task.kernel:sha1 for client.0 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:19:19.302 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-24T18:19:19.302 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-24T18:19:19.309 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-124-generic 2023-12-24T18:19:19.309 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:19:19.309 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-24T18:19:19.309 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-24T18:19:19.309 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-24T18:19:19.371 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-24T18:19:19.400 INFO:teuthology.orchestra.run.smithi082.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-24T18:19:19.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-24T18:19:19.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-24T18:19:19.454 DEBUG:teuthology.orchestra.run.smithi082:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-24T18:19:19.504 INFO:teuthology.orchestra.run.smithi050.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-24T18:19:19.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-24T18:19:19.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-24T18:19:19.552 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-24T18:21:03.120 INFO:teuthology.orchestra.run.smithi082.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-24T18:21:03.120 INFO:teuthology.orchestra.run.smithi082.stderr: * [new branch] main -> origin/main 2023-12-24T18:21:03.181 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190312 -> 20190312 2023-12-24T18:21:03.181 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190416 -> 20190416 2023-12-24T18:21:03.181 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190514 -> 20190514 2023-12-24T18:21:03.181 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190618 -> 20190618 2023-12-24T18:21:03.182 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190717 -> 20190717 2023-12-24T18:21:03.182 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190815 -> 20190815 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190923 -> 20190923 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20191022 -> 20191022 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20191215 -> 20191215 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200122 -> 20200122 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200316 -> 20200316 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200421 -> 20200421 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200519 -> 20200519 2023-12-24T18:21:03.183 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200619 -> 20200619 2023-12-24T18:21:03.184 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200721 -> 20200721 2023-12-24T18:21:03.184 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200817 -> 20200817 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200918 -> 20200918 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201022 -> 20201022 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201118 -> 20201118 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201218 -> 20201218 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210208 -> 20210208 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210315 -> 20210315 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210511 -> 20210511 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210716 -> 20210716 2023-12-24T18:21:03.185 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210818 -> 20210818 2023-12-24T18:21:03.187 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210919 -> 20210919 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20211027 -> 20211027 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20211216 -> 20211216 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220209 -> 20220209 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220310 -> 20220310 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220411 -> 20220411 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220509 -> 20220509 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220610 -> 20220610 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220708 -> 20220708 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220815 -> 20220815 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220913 -> 20220913 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221012 -> 20221012 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221109 -> 20221109 2023-12-24T18:21:03.188 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221214 -> 20221214 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230117 -> 20230117 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230210 -> 20230210 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230310 -> 20230310 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230404 -> 20230404 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230515 -> 20230515 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230625 -> 20230625 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230804 -> 20230804 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230919 -> 20230919 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20231030 -> 20231030 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20231111 -> 20231111 2023-12-24T18:21:03.189 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20231211 -> 20231211 2023-12-24T18:21:04.560 INFO:teuthology.orchestra.run.smithi050.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-24T18:21:04.560 INFO:teuthology.orchestra.run.smithi050.stderr: * [new branch] main -> origin/main 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190312 -> 20190312 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190416 -> 20190416 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190514 -> 20190514 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190618 -> 20190618 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190717 -> 20190717 2023-12-24T18:21:04.623 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190815 -> 20190815 2023-12-24T18:21:04.624 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190923 -> 20190923 2023-12-24T18:21:04.624 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191022 -> 20191022 2023-12-24T18:21:04.624 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191215 -> 20191215 2023-12-24T18:21:04.624 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200122 -> 20200122 2023-12-24T18:21:04.627 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200316 -> 20200316 2023-12-24T18:21:04.627 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200421 -> 20200421 2023-12-24T18:21:04.627 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200519 -> 20200519 2023-12-24T18:21:04.627 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200619 -> 20200619 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200721 -> 20200721 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200817 -> 20200817 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200918 -> 20200918 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201022 -> 20201022 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201118 -> 20201118 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201218 -> 20201218 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210208 -> 20210208 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210315 -> 20210315 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210511 -> 20210511 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210716 -> 20210716 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210818 -> 20210818 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210919 -> 20210919 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211027 -> 20211027 2023-12-24T18:21:04.628 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211216 -> 20211216 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220209 -> 20220209 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220310 -> 20220310 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220411 -> 20220411 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220509 -> 20220509 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220610 -> 20220610 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220708 -> 20220708 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220815 -> 20220815 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220913 -> 20220913 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221012 -> 20221012 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221109 -> 20221109 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221214 -> 20221214 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230117 -> 20230117 2023-12-24T18:21:04.629 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230210 -> 20230210 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230310 -> 20230310 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230404 -> 20230404 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230515 -> 20230515 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230625 -> 20230625 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230804 -> 20230804 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230919 -> 20230919 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231030 -> 20231030 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231111 -> 20231111 2023-12-24T18:21:04.631 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231211 -> 20231211 2023-12-24T18:21:07.214 INFO:teuthology.orchestra.run.smithi082.stderr:Updating files: 49% (1667/3346) Updating files: 50% (1673/3346) Updating files: 51% (1707/3346) Updating files: 52% (1740/3346) Updating files: 53% (1774/3346) Updating files: 54% (1807/3346) Updating files: 55% (1841/3346) Updating files: 56% (1874/3346) Updating files: 57% (1908/3346) Updating files: 58% (1941/3346) Updating files: 59% (1975/3346) Updating files: 60% (2008/3346) Updating files: 61% (2042/3346) Updating files: 62% (2075/3346) Updating files: 63% (2108/3346) Updating files: 64% (2142/3346) Updating files: 65% (2175/3346) Updating files: 65% (2182/3346) Updating files: 66% (2209/3346) Updating files: 67% (2242/3346) Updating files: 68% (2276/3346) Updating files: 69% (2309/3346) Updating files: 70% (2343/3346) Updating files: 71% (2376/3346) Updating files: 72% (2410/3346) Updating files: 73% (2443/3346) Updating files: 74% (2477/3346) Updating files: 75% (2510/3346) Updating files: 76% (2543/3346) Updating files: 77% (2577/3346) Updating files: 78% (2610/3346) Updating files: 79% (2644/3346) Updating files: 80% (2677/3346) Updating files: 81% (2711/3346) Updating files: 81% (2740/3346) Updating files: 82% (2744/3346) Updating files: 83% (2778/3346) Updating files: 84% (2811/3346) Updating files: 85% (2845/3346) Updating files: 86% (2878/3346) Updating files: 87% (2912/3346) Updating files: 88% (2945/3346) Updating files: 89% (2978/3346) Updating files: 90% (3012/3346) Updating files: 91% (3045/3346) Updating files: 92% (3079/3346) Updating files: 93% (3112/3346) Updating files: 94% (3146/3346) Updating files: 95% (3179/3346) Updating files: 96% (3213/3346) Updating files: 97% (3246/3346) Updating files: 98% (3280/3346) Updating files: 99% (3313/3346) Updating files: 99% (3321/3346) Updating files: 100% (3346/3346) Updating files: 100% (3346/3346), done. 2023-12-24T18:21:07.219 INFO:teuthology.orchestra.run.smithi082.stdout:HEAD is now at a7dee43d Merge branch 'robot/pr-0-1702919157' into 'main' 2023-12-24T18:21:07.236 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-24T18:21:07.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:21:07.459 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ 2023-12-24T18:21:07.459 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ --input-file=- 2023-12-24T18:21:07.462 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2023-12-24T18:21:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:Updating files: 48% (1628/3346) Updating files: 49% (1640/3346) Updating files: 50% (1673/3346) Updating files: 51% (1707/3346) Updating files: 52% (1740/3346) Updating files: 53% (1774/3346) Updating files: 54% (1807/3346) Updating files: 55% (1841/3346) Updating files: 56% (1874/3346) Updating files: 57% (1908/3346) Updating files: 58% (1941/3346) Updating files: 59% (1975/3346) Updating files: 60% (2008/3346) Updating files: 61% (2042/3346) Updating files: 62% (2075/3346) Updating files: 63% (2108/3346) Updating files: 63% (2140/3346) Updating files: 64% (2142/3346) Updating files: 65% (2175/3346) Updating files: 66% (2209/3346) Updating files: 67% (2242/3346) Updating files: 68% (2276/3346) Updating files: 69% (2309/3346) Updating files: 70% (2343/3346) Updating files: 71% (2376/3346) Updating files: 72% (2410/3346) Updating files: 73% (2443/3346) Updating files: 74% (2477/3346) Updating files: 75% (2510/3346) Updating files: 76% (2543/3346) Updating files: 77% (2577/3346) Updating files: 77% (2583/3346) Updating files: 78% (2610/3346) Updating files: 79% (2644/3346) Updating files: 80% (2677/3346) Updating files: 81% (2711/3346) Updating files: 82% (2744/3346) Updating files: 83% (2778/3346) Updating files: 84% (2811/3346) Updating files: 84% (2822/3346) Updating files: 85% (2845/3346) Updating files: 86% (2878/3346) Updating files: 87% (2912/3346) Updating files: 88% (2945/3346) Updating files: 89% (2978/3346) Updating files: 90% (3012/3346) Updating files: 91% (3045/3346) Updating files: 92% (3079/3346) Updating files: 93% (3112/3346) Updating files: 94% (3146/3346) Updating files: 95% (3179/3346) Updating files: 96% (3213/3346) Updating files: 97% (3246/3346) Updating files: 98% (3280/3346) Updating files: 99% (3313/3346) Updating files: 100% (3346/3346) Updating files: 100% (3346/3346), done. 2023-12-24T18:21:08.874 INFO:teuthology.orchestra.run.smithi050.stdout:HEAD is now at a7dee43d Merge branch 'robot/pr-0-1702919157' into 'main' 2023-12-24T18:21:08.892 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-24T18:21:08.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-24T18:21:09.109 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ 2023-12-24T18:21:09.109 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ --input-file=- 2023-12-24T18:21:09.112 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2023-12-24T18:21:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24 18:21:09 URL:https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb [38936568/38936568] -> "/tmp/linux-image.deb" [1] 2023-12-24T18:21:09.320 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2023-12-24 18:21:09-- 2023-12-24T18:21:09.320 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 1.8s 2023-12-24T18:21:09.320 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 37M in 1.6s (23.4 MB/s) 2023-12-24T18:21:09.322 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-24T18:21:09.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo dpkg -i /tmp/linux-image.deb 2023-12-24T18:21:09.659 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-image-6.6.0-g623393c9d50c. 2023-12-24T18:21:10.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24 18:21:10 URL:https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb [38936568/38936568] -> "/tmp/linux-image.deb" [1] 2023-12-24T18:21:10.691 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2023-12-24 18:21:10-- 2023-12-24T18:21:10.691 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 1.5s 2023-12-24T18:21:10.691 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 37M in 1.3s (27.6 MB/s) 2023-12-24T18:21:10.694 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-24T18:21:10.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo dpkg -i /tmp/linux-image.deb 2023-12-24T18:21:11.010 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-6.6.0-g623393c9d50c. 2023-12-24T18:21:11.383 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-24T18:21:11.388 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-24T18:21:11.532 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-24T18:21:12.800 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-24T18:21:12.806 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-24T18:21:13.025 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-24T18:21:14.535 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-24T18:21:14.655 INFO:teuthology.orchestra.run.smithi082.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:16.379 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-24T18:21:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:40.853 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2023-12-24T18:21:40.861 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-24T18:21:40.896 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-12-24T18:21:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:41.306 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:41.711 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-24T18:21:41.724 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-24T18:21:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2023-12-24T18:21:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-24T18:21:43.594 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-12-24T18:21:43.929 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-12-24T18:21:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:44.096 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-deb -c /tmp/linux-image.deb 2023-12-24T18:21:44.105 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./ 2023-12-24T18:21:44.106 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./boot/ 2023-12-24T18:21:44.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 4415617 2023-12-21 02:06 ./boot/System.map-6.6.0-g623393c9d50c 2023-12-24T18:21:44.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 169214 2023-12-21 02:06 ./boot/config-6.6.0-g623393c9d50c 2023-12-24T18:21:44.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11352864 2023-12-21 02:06 ./boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postinst.d/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postrm.d/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/preinst.d/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/prerm.d/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/ 2023-12-24T18:21:44.142 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/ 2023-12-24T18:21:44.143 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/ 2023-12-24T18:21:44.143 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/ 2023-12-24T18:21:44.143 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/ 2023-12-24T18:21:44.143 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ 2023-12-24T18:21:44.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 490233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-24T18:21:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-24T18:21:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-24T18:21:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-24T18:21:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 93113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 152241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-24T18:21:44.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/ 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/ 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/ 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpuid.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/msr.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/ 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 354433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-24T18:21:44.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 881625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-24T18:21:44.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2275865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/af_alg.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_hash.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_skcipher.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-24T18:21:44.224 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/ 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/ 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-24T18:21:44.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cryptd.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_simd.ko 2023-12-24T18:21:44.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lrw.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-24T18:21:44.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 149193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-24T18:21:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xts.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_extlog.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/ 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/einj.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-24T18:21:44.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 88865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 88289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-24T18:21:44.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-24T18:21:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_legacy.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-24T18:21:44.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_radisys.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rz1000.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-24T18:21:44.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/ 2023-12-24T18:21:44.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/ 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/ 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/ 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 965585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 173225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/ 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/ 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 110385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 98193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 263769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-24T18:21:44.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/ 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 98145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/ 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/applicom.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/ 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 148601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-24T18:21:44.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 139313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/ 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/nvram.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/ 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-24T18:21:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/ 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/ 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-palmas.ko 2023-12-24T18:21:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-si5351.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-twl6040.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-wm831x.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 243025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-24T18:21:44.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 438761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ 2023-12-24T18:21:44.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 79953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-24T18:21:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/ 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-gpio.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max14577.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max77693.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max8997.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-palmas.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/ 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/ 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-24T18:21:44.242 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/ 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-arizona.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9052.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9055.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-dln2.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-generic.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-kempld.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-24T18:21:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max7300.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max730x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max732x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-24T18:21:44.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-vx855.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/ 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-a4tech.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-apple.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-belkin.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cherry.ko 2023-12-24T18:21:44.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-chicony.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cp2112.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cypress.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ezkey.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-generic.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-24T18:21:44.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kensington.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lg-g15.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-24T18:21:44.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-magicmouse.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-microsoft.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-monterey.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ntrig.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-24T18:21:44.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-24T18:21:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-24T18:21:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 267825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/ 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-24T18:21:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 217873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/ 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 305465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-24T18:21:44.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-24T18:21:44.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 99601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-24T18:21:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc2103.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-24T18:21:44.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hih6130.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 130449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/jc42.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-24T18:21:44.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-24T18:21:44.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-24T18:21:44.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-24T18:21:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-24T18:21:44.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-24T18:21:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-24T18:21:44.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/ 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/ 2023-12-24T18:21:44.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/ 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-24T18:21:44.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-24T18:21:44.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-24T18:21:44.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/ 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 273609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 879969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 324217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-24T18:21:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 282273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 493073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 419737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 739025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 296625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-24T18:21:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 153697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 168969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 263081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 111425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 128753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-24T18:21:44.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/evbug.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ff-memless.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/ 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/ 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-24T18:21:44.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8323.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8333.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-24T18:21:44.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt1070.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt2160.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/stowaway.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/matrix-keymap.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/ 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-24T18:21:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 335929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/psmouse.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/ 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ct82c710.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-24T18:21:44.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/parkbd.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/pcips2.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ps2mult.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serport.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/ 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/ 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/ 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-88pm860x.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-adp5520.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-bd2802.ko 2023-12-24T18:21:44.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da903x.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da9052.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-gpio.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3533.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm355x.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3642.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp8788.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-max8997.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-mc13783.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-24T18:21:44.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca9532.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca955x.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca963x.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-tca6507.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm8350.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-24T18:21:44.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/ 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/ 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 654969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bufio.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 156009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-era.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log.ko 2023-12-24T18:21:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-mirror.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-region-hash.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-snapshot.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 181865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-zero.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-24T18:21:44.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/ 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 199937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 158681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 395721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/ 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/ 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 178137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-24T18:21:44.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 79041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm800.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm805.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm80x.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona-i2c.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/bcm590xx.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/dln2.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/janz-cmodio.ko 2023-12-24T18:21:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/kempld-core.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-core.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lp3943.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/max8907.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/menf21bmc.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633.ko 2023-12-24T18:21:44.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/retu-mfd.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/si476x-core.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps65010.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps6507x.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wm8994.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot.ko 2023-12-24T18:21:44.282 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/ 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/ 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/core.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/ 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ds1682.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/dummy-irq.ko 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/ 2023-12-24T18:21:44.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/echo.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/ 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/ 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 152201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hmc6352.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ics932s401.ko 2023-12-24T18:21:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/ 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/ 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 310113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/phantom.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/ 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-24T18:21:44.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 183609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 490129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 453737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-24T18:21:44.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/ 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 130553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 99049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/ 2023-12-24T18:21:44.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-24T18:21:44.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 104673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 90257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/ 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 176761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1421497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 128569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 132089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 312081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-24T18:21:44.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 323513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 193497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 347417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-24T18:21:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1044497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 166193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/ 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 204345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-24T18:21:44.354 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/ 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 141225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/ 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-24T18:21:44.355 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 281137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 90465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 295577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 584497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 246209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-24T18:21:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 925825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 302937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 514641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 93593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 734305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 151769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 86921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-24T18:21:44.357 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 727601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 278937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1113681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-24T18:21:44.358 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 95665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/ 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/ 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 150905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-24T18:21:44.359 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 136721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 227897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 672049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/ 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-24T18:21:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/ 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 189801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/ 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 104241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/ 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1052497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/ 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-24T18:21:44.361 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/ 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/ 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/ 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-24T18:21:44.362 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 487025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/ 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 166097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/ 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/ 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 86529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/ 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-24T18:21:44.363 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/defxx.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 216985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 235521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/ 2023-12-24T18:21:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/ 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-24T18:21:44.365 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/ 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-24T18:21:44.366 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 76113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/ 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/plip.ko 2023-12-24T18:21:44.367 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sb1000.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/ 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-24T18:21:44.368 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/ 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/ 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 144297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/ 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 297329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-24T18:21:44.369 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/ 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 144585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/ 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/ 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 265121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/ 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 133841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-24T18:21:44.370 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/ 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/ 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pci-stub.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/ 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 145809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-24T18:21:44.371 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 112889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/ 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-24T18:21:44.372 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 127441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-24T18:21:44.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/ 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-24T18:21:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/ 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-24T18:21:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9030_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9052-battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/gpio-charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max14577_charger.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17040_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17042_battery.ko 2023-12-24T18:21:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8903_charger.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8925_power.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/sbs-battery.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/test_power.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_power.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm8350_power.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/ 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-24T18:21:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/ 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/ 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/ 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-24T18:21:44.378 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9052.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9055.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9063.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-24T18:21:44.379 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8907.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8925.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8997.ko 2023-12-24T18:21:44.380 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8998.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-palmas.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-24T18:21:44.381 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ 2023-12-24T18:21:44.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 135185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/ 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 272305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/ 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 356201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 295801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/ 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 189185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-24T18:21:44.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 246985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1171945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 237273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/ 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 308921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-24T18:21:44.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/ 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 76145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 146689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/ 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 212425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/ 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-24T18:21:44.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 158505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fdomain.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/ 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 263489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 201817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/imm.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 266537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/ 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 317153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-24T18:21:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/ 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 314865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 145585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/ 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 216665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/ 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2197249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/ 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 310617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-24T18:21:44.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/ 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 659825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/ 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/ 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/ 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 364105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ppa.ko 2023-12-24T18:21:44.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/ 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1876689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/ 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 559033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qlogicfas408.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 238761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 173937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 279313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-24T18:21:44.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 162121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/xen-scsifront.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/ 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/ 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 736601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/ 2023-12-24T18:21:44.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 930257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/ 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/ 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/ 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-24T18:21:44.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ 2023-12-24T18:21:44.392 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/moxa.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/mxser.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/ 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/ 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_uart.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-24T18:21:44.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/ 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/rp2.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/ 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 531265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/ 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-24T18:21:44.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_mf624.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_netx.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/ 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/ 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 144377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-24T18:21:44.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/ 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ulpi.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/ 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/ 2023-12-24T18:21:44.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 448505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/ 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/ 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 92489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-24T18:21:44.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/ 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-24T18:21:44.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 161225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/ 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 157681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-24T18:21:44.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 76057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 65809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 156073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-24T18:21:44.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811_cs.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/ 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cytherm.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ehset.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-24T18:21:44.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/lvstest.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/ 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbtest.ko 2023-12-24T18:21:44.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/ 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/usbmon.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/ 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 301697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/ 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-24T18:21:44.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/f81232.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 175137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 137081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-24T18:21:44.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/metro-usb.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mxuport.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-24T18:21:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 191137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-24T18:21:44.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usbserial.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-24T18:21:44.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 179969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/ 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/ 2023-12-24T18:21:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/ 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 154297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/ 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/ 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/ 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-24T18:21:44.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/bd6107.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-24T18:21:44.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/ 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/ 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-24T18:21:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/acquirewdt.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/advantechwdt.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-24T18:21:44.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/dw_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-24T18:21:44.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/retu_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-24T18:21:44.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-24T18:21:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/ 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/ 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 176377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-scsiback.ko 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/ 2023-12-24T18:21:44.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 166425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/adfs.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 163593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 932817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/kafs.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/autofs4.ko 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/ 2023-12-24T18:21:44.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/bfs.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 3402729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 306009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1331857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/ 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/configfs.ko 2023-12-24T18:21:44.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 642513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/efs.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1505025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/freevxfs.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 226481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/ 2023-12-24T18:21:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1231529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 141209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 222817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 192329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/hpfs.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 419497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/ 2023-12-24T18:21:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 280313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/ 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 117465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1055721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-24T18:21:44.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv2.ko 2023-12-24T18:21:44.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 120177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-24T18:21:44.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2042137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-24T18:21:44.461 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/ 2023-12-24T18:21:44.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/ 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1516873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/ 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 592833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/ 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-24T18:21:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ascii.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-24T18:21:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 142673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 165745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 118121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-24T18:21:44.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-24T18:21:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 219417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ntfs.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 244409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 440737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ 2023-12-24T18:21:44.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2592433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/ 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/omfs.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/ 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 352161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/ 2023-12-24T18:21:44.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/qnx4.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/qnx6.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_tree.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v1.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v2.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 532673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/ 2023-12-24T18:21:44.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2668401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/ 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/ 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 134641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/ 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 90721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/ 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 247737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 162497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-24T18:21:44.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 4011017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/locktorture.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/test_udelay.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc7.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/ 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-24T18:21:44.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/interval_tree_test.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/ 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/ 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/memory-notifier-error-inject.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/notifier-error-inject.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/percpu_test.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/pm-notifier-error-inject.ko 2023-12-24T18:21:44.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/ 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/rbtree_test.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/ 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-kstrtox.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-string_helpers.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 4760425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_bpf.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_firmware.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_module.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_user_copy.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-24T18:21:44.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/ 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/xz_dec_test.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/ 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/ 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-24T18:21:44.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/ 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/ 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/ 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 198337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-24T18:21:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/ 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 649297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/ 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 777689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-24T18:21:44.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-24T18:21:44.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/ 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1046897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/ 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/ 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 194209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-24T18:21:44.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/ 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 390473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/ 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 99729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/hsr.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 254625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-24T18:21:44.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-24T18:21:44.479 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-24T18:21:44.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-24T18:21:44.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-24T18:21:44.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_gre.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 93577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/mip6.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-24T18:21:44.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-24T18:21:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/ 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-24T18:21:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/ 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/ 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/lapb.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/ 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 267913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc2.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/ 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 290417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-24T18:21:44.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/ 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 112849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-24T18:21:44.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 112585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 111585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 114465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 411729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-24T18:21:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 408257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 118145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-24T18:21:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 95353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-24T18:21:44.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 615649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-24T18:21:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_osf.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-24T18:21:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_synproxy.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tproxy.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/x_tables.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-24T18:21:44.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-24T18:21:44.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-24T18:21:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-24T18:21:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-24T18:21:44.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpudp.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/ 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/ 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/ 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 380033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-24T18:21:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/ 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/ 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 110201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/phonet.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/pn_pep.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/ 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 251481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 164937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/ 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 819657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/rxrpc.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/ 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-24T18:21:44.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_cgroup.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-24T18:21:44.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq_codel.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-24T18:21:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/ 2023-12-24T18:21:44.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 929745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 336529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1520097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 707657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 862665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/ 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-24T18:21:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 96193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/ 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/x25.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/ 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_algo.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_user.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/ 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/ 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 640081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 624107 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-24T18:21:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7663 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23428 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9821 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70004 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 146313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 232548 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 210 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72606 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 879 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 254438 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 309363 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/ 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/ 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/ 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/ 2023-12-24T18:21:44.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 170 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/changelog.Debian.gz 2023-12-24T18:21:44.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 691 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/copyright 2023-12-24T18:21:44.506 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-24T18:21:44.506 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g623393c9d50c 2023-12-24T18:21:44.507 DEBUG:teuthology.orchestra.run.smithi082:> egrep '(submenu|menuentry.*6.6.0-g623393c9d50c).*{' /boot/grub/grub.cfg 2023-12-24T18:21:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:44.516 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-24T18:21:44.516 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g623393c9d50c 2023-12-24T18:21:44.516 DEBUG:teuthology.orchestra.run.smithi082:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-24T18:21:44.518 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi082.front.sepia.ceph.com to complete... 2023-12-24T18:21:44.553 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-24T18:21:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-24T18:21:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2023-12-24T18:21:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-24T18:21:45.203 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-12-24T18:21:45.478 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:45.490 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:45.843 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-24T18:21:45.855 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-24T18:21:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-12-24T18:21:46.776 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-deb -c /tmp/linux-image.deb 2023-12-24T18:21:46.785 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./ 2023-12-24T18:21:46.786 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./boot/ 2023-12-24T18:21:46.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4415617 2023-12-21 02:06 ./boot/System.map-6.6.0-g623393c9d50c 2023-12-24T18:21:46.799 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 169214 2023-12-21 02:06 ./boot/config-6.6.0-g623393c9d50c 2023-12-24T18:21:46.799 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11352864 2023-12-21 02:06 ./boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postinst.d/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postrm.d/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/preinst.d/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/prerm.d/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/ 2023-12-24T18:21:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/ 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/ 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/ 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 490233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-24T18:21:46.825 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/ 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/ 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/ 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-24T18:21:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpuid.ko 2023-12-24T18:21:46.827 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/msr.ko 2023-12-24T18:21:46.827 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/ 2023-12-24T18:21:46.827 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 354433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-24T18:21:46.827 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 881625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-24T18:21:46.827 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2275865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-24T18:21:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/af_alg.ko 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_hash.ko 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_skcipher.ko 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-24T18:21:46.903 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/ 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/ 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-24T18:21:46.904 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cryptd.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_simd.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-24T18:21:46.905 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lrw.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-24T18:21:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 149193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xts.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_extlog.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-24T18:21:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/ 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/einj.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-24T18:21:46.908 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-24T18:21:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_legacy.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-24T18:21:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_radisys.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rz1000.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-24T18:21:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/ 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/ 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/ 2023-12-24T18:21:46.912 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/ 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 965585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 173225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/ 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/ 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/ 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/ 2023-12-24T18:21:46.913 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/applicom.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/ 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 148601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 139313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-24T18:21:46.914 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/ 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/nvram.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/ 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-24T18:21:46.915 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/ 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/ 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-palmas.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-si5351.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-twl6040.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-wm831x.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/ 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-24T18:21:46.916 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 243025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 438761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ 2023-12-24T18:21:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/ 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-24T18:21:46.918 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/ 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-gpio.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max14577.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max77693.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max8997.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-palmas.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/ 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/ 2023-12-24T18:21:46.919 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/ 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-arizona.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9052.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9055.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-dln2.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-generic.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-kempld.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-24T18:21:46.920 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max7300.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max730x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max732x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-vx855.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-24T18:21:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/ 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-a4tech.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-apple.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-belkin.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cherry.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-chicony.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cp2112.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cypress.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-24T18:21:46.922 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ezkey.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-generic.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kensington.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-24T18:21:46.923 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lg-g15.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-magicmouse.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-microsoft.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-monterey.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ntrig.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-24T18:21:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-24T18:21:46.925 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-24T18:21:46.926 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 143473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 267825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/ 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-24T18:21:46.927 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 217873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/ 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 305465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-24T18:21:46.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-24T18:21:46.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc2103.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-24T18:21:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hih6130.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-24T18:21:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 130449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/jc42.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-24T18:21:46.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-24T18:21:46.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ 2023-12-24T18:21:46.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-24T18:21:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-24T18:21:46.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-24T18:21:46.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/ 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/ 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/ 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-24T18:21:46.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-24T18:21:46.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-24T18:21:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/ 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 273609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 879969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 324217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 282273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-24T18:21:46.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 493073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 419737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 739025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 296625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 153697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 168969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ 2023-12-24T18:21:46.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 111425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/evbug.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ff-memless.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/ 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-24T18:21:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/ 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8323.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8333.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-24T18:21:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt1070.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt2160.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/stowaway.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-24T18:21:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/matrix-keymap.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/ 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 335929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/psmouse.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/ 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ 2023-12-24T18:21:46.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ct82c710.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/parkbd.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/pcips2.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ps2mult.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serport.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/ 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/ 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/ 2023-12-24T18:21:46.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-88pm860x.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-adp5520.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-bd2802.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da903x.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da9052.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-gpio.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3533.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm355x.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3642.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp8788.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-max8997.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-mc13783.ko 2023-12-24T18:21:46.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca9532.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca955x.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca963x.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-tca6507.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm8350.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-24T18:21:46.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/ 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/ 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 654969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bufio.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 156009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-era.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-24T18:21:46.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-mirror.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-region-hash.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-snapshot.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 181865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-zero.ko 2023-12-24T18:21:46.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/ 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 199937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 395721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/ 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/ 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 178137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-24T18:21:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm800.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm805.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm80x.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona-i2c.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/bcm590xx.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/dln2.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/janz-cmodio.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/kempld-core.ko 2023-12-24T18:21:46.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-core.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lp3943.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/max8907.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/menf21bmc.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/retu-mfd.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/si476x-core.ko 2023-12-24T18:21:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps65010.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps6507x.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wm8994.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/ 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-24T18:21:46.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/ 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/core.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/ 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ds1682.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/dummy-irq.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/ 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/echo.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/ 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-24T18:21:46.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/ 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hmc6352.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ics932s401.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/ 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/ 2023-12-24T18:21:46.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 310113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/phantom.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/ 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/ 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 183609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/ 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 490129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-24T18:21:46.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/ 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/ 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 453737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/ 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 130553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-24T18:21:46.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/ 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-24T18:21:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/ 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-24T18:21:46.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 176761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-24T18:21:46.962 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-24T18:21:46.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1421497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-24T18:21:47.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-24T18:21:47.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-24T18:21:47.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 132089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-24T18:21:47.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 312081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 323513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 193497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 347417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1044497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-24T18:21:47.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/ 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 204345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/ 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/ 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-24T18:21:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 281137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 295577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 584497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-24T18:21:47.040 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 246209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 925825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 302937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 514641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 734305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-24T18:21:47.041 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 151769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 727601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 278937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1113681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ 2023-12-24T18:21:47.042 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/ 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/ 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 150905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/ 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 136721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-24T18:21:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 227897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 672049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/ 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 189801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-24T18:21:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1052497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/ 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-24T18:21:47.045 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/ 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 487025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/ 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/ 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/ 2023-12-24T18:21:47.046 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/defxx.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 216985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/ 2023-12-24T18:21:47.047 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 235521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/ 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/ 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-24T18:21:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/ 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-24T18:21:47.049 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/ 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/plip.ko 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ 2023-12-24T18:21:47.050 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sb1000.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/ 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/ 2023-12-24T18:21:47.051 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/ 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/ 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 297329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/ 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ 2023-12-24T18:21:47.052 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/ 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/ 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 265121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/ 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 133841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/ 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/ 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-24T18:21:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pci-stub.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/ 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 145809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/ 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/ 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/ 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-24T18:21:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/ 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/ 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/ 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/ 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-24T18:21:47.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 127441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/ 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-24T18:21:47.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/ 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-24T18:21:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9030_battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9052-battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/gpio-charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-24T18:21:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max14577_charger.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17040_battery.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17042_battery.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8903_charger.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8925_power.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/sbs-battery.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/test_power.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_power.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm8350_power.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/ 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-24T18:21:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/ 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/ 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/ 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9052.ko 2023-12-24T18:21:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9055.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9063.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-24T18:21:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8907.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8925.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8997.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8998.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-palmas.ko 2023-12-24T18:21:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-24T18:21:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-24T18:21:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 135185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/ 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 272305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/ 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 356201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 295801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/ 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 189185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/ 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-24T18:21:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 246985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1171945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 237273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 308921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-24T18:21:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 146689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/ 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 212425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/ 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fdomain.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/ 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-24T18:21:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 201817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/imm.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 266537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/ 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 317153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/ 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 314865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 145585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-24T18:21:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/ 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 216665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/ 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2197249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/ 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 310617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/ 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 659825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/ 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-24T18:21:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/ 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/ 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 364105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ppa.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/ 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1876689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/ 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 559033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-24T18:21:47.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qlogicfas408.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 238761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 173937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 279313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 162121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-24T18:21:47.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/xen-scsifront.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/ 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/ 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 736601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/ 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 930257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/ 2023-12-24T18:21:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/ 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/ 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-24T18:21:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/moxa.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/mxser.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/ 2023-12-24T18:21:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/ 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_uart.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/ 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/rp2.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/ 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 531265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ 2023-12-24T18:21:47.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/ 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_mf624.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_netx.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/ 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/ 2023-12-24T18:21:47.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/ 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ulpi.ko 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/ 2023-12-24T18:21:47.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/ 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 448505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/ 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/ 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 92489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-24T18:21:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/ 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-24T18:21:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 161225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/ 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-24T18:21:47.081 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 157681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 156073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ 2023-12-24T18:21:47.082 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811_cs.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/ 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-24T18:21:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cytherm.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ehset.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/lvstest.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/ 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-24T18:21:47.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbtest.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/ 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/usbmon.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/ 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 301697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/ 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-24T18:21:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/f81232.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 175137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-24T18:21:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/metro-usb.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mxuport.ko 2023-12-24T18:21:47.087 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 191137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-24T18:21:47.088 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usbserial.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-24T18:21:47.089 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 179969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/ 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/ 2023-12-24T18:21:47.090 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/ 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 154297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/ 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/ 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/ 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-24T18:21:47.091 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/bd6107.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-24T18:21:47.092 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/ 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/ 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-24T18:21:47.093 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/acquirewdt.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/advantechwdt.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-24T18:21:47.094 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/dw_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-24T18:21:47.095 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/retu_wdt.ko 2023-12-24T18:21:47.096 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-24T18:21:47.097 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/ 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/ 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 176377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-scsiback.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/ 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-24T18:21:47.098 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/adfs.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 163593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 932817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/kafs.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/autofs4.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/ 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/bfs.ko 2023-12-24T18:21:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 3402729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 306009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1331857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/configfs.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/ 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 642513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-24T18:21:47.100 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/efs.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1505025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/freevxfs.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 226481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/ 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1231529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-24T18:21:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 222817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 192329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/hpfs.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 419497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 280313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/ 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-24T18:21:47.102 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1055721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv2.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2042137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/ 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-24T18:21:47.103 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/ 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1516873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/ 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 592833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/ 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-24T18:21:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ascii.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-24T18:21:47.105 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 142673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 165745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-24T18:21:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ 2023-12-24T18:21:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 219417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ntfs.ko 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 244409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 440737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-24T18:21:47.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2592433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/ 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/omfs.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/ 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 352161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/ 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/qnx4.ko 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/ 2023-12-24T18:21:47.144 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/qnx6.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_tree.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v1.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v2.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 532673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2668401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/ 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-24T18:21:47.145 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 247737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 162497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4011017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/locktorture.ko 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/ 2023-12-24T18:21:47.146 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/test_udelay.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc7.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/ 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/interval_tree_test.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/ 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-24T18:21:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/ 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/memory-notifier-error-inject.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/notifier-error-inject.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/percpu_test.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/pm-notifier-error-inject.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/ 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 143433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/rbtree_test.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/ 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-kstrtox.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-string_helpers.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4760425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_bpf.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_firmware.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_module.ko 2023-12-24T18:21:47.148 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_user_copy.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/ 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/xz_dec_test.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/ 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/ 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-24T18:21:47.149 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/ 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/ 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/ 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 198337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-24T18:21:47.150 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/ 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 649297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/ 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 777689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-24T18:21:47.151 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-24T18:21:47.152 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/ 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1046897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/ 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/ 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 194209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/ 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 390473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-24T18:21:47.153 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/ 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/hsr.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 254625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-24T18:21:47.154 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-24T18:21:47.155 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-24T18:21:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-24T18:21:47.157 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_gre.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/mip6.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-24T18:21:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-24T18:21:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/ 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/ 2023-12-24T18:21:47.160 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/ 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/lapb.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/ 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 267913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc2.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/ 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 290417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/ 2023-12-24T18:21:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-24T18:21:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 111585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 114465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 411729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-24T18:21:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 408257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-24T18:21:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-24T18:21:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 615649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-24T18:21:47.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_osf.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_synproxy.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tproxy.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/x_tables.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-24T18:21:47.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-24T18:21:47.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-24T18:21:47.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-24T18:21:47.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-24T18:21:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpudp.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/ 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/ 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/ 2023-12-24T18:21:47.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 380033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/ 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/ 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/phonet.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/pn_pep.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/ 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 251481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/ 2023-12-24T18:21:47.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 819657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/rxrpc.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/ 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-24T18:21:47.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_cgroup.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-24T18:21:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq_codel.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-24T18:21:47.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/ 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 929745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/ 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/ 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 336529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1520097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/ 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 707657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-24T18:21:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/ 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 862665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/ 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/ 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/ 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/x25.ko 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/ 2023-12-24T18:21:47.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_algo.ko 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_user.ko 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/ 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/ 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 640081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 624107 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7663 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23428 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9821 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70004 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 146313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 232548 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 210 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-24T18:21:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72606 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 879 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 254438 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 309363 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/ 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/ 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/ 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/ 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 170 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/changelog.Debian.gz 2023-12-24T18:21:47.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 691 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/copyright 2023-12-24T18:21:47.181 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-24T18:21:47.181 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g623393c9d50c 2023-12-24T18:21:47.181 DEBUG:teuthology.orchestra.run.smithi050:> egrep '(submenu|menuentry.*6.6.0-g623393c9d50c).*{' /boot/grub/grub.cfg 2023-12-24T18:21:47.189 INFO:teuthology.orchestra.run.smithi050.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-24T18:21:47.190 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-24T18:21:47.190 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g623393c9d50c 2023-12-24T18:21:47.190 DEBUG:teuthology.orchestra.run.smithi050:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-24T18:21:47.192 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi050.front.sepia.ceph.com to complete... 2023-12-24T18:21:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2023-12-24T18:21:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-24T18:21:47.893 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-12-24T18:21:48.257 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-24T18:21:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-24T18:21:48.726 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-24T18:21:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-24T18:21:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-12-24T18:22:18.020 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-24T18:22:18.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-24T18:22:18.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:22:20.569 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-24T18:22:20.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:22:20.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:23:18.078 DEBUG:teuthology.orchestra.remote:timed out 2023-12-24T18:23:20.574 DEBUG:teuthology.orchestra.remote:timed out 2023-12-24T18:23:27.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-24T18:23:27.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:23:27.509 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-12-24T18:23:28.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-24T18:23:28.739 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g623393c9d50c"... 2023-12-24T18:23:28.739 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-12-24T18:23:28.805 INFO:teuthology.orchestra.run.smithi082.stdout:6.6.0-g623393c9d50c 2023-12-24T18:23:28.805 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-24T18:23:28.805 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-24T18:23:28.805 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-24T18:23:29.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:23:29.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:23:29.808 DEBUG:teuthology.parallel:result is None 2023-12-24T18:23:30.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-24T18:23:42.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:23:42.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:23:42.832 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-24T18:23:43.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:23:43.515 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g623393c9d50c"... 2023-12-24T18:23:43.515 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-24T18:23:43.575 INFO:teuthology.orchestra.run.smithi050.stdout:6.6.0-g623393c9d50c 2023-12-24T18:23:43.575 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-24T18:23:43.575 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-24T18:23:43.575 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-24T18:23:44.576 DEBUG:teuthology.parallel:result is None 2023-12-24T18:23:44.577 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-24T18:23:44.583 INFO:teuthology.task.internal:Creating test directory... 2023-12-24T18:23:44.584 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-24T18:23:44.591 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-24T18:23:44.612 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-24T18:23:44.618 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-24T18:23:44.627 INFO:teuthology.task.internal:Creating archive directory... 2023-12-24T18:23:44.628 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-24T18:23:44.652 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-24T18:23:44.694 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-24T18:23:44.702 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-24T18:23:44.702 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-24T18:23:44.724 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-24T18:23:44.825 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T18:23:44.846 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T18:23:44.865 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T18:23:44.871 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T18:23:44.877 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-24T18:23:44.884 INFO:teuthology.task.internal:Configuring sudo... 2023-12-24T18:23:44.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-24T18:23:44.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-24T18:23:44.929 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-24T18:23:44.938 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-24T18:23:44.938 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-24T18:23:44.972 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-24T18:23:44.992 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T18:23:45.054 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T18:23:45.118 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:23:45.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-24T18:23:45.206 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T18:23:45.225 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T18:23:45.290 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:23:45.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-24T18:23:45.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-12-24T18:23:45.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-12-24T18:23:45.551 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-24T18:23:45.558 INFO:teuthology.task.internal:Starting timer... 2023-12-24T18:23:45.558 INFO:teuthology.run_tasks:Running task pcp... 2023-12-24T18:23:45.568 INFO:teuthology.run_tasks:Running task selinux... 2023-12-24T18:23:45.577 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2023-12-24T18:23:45.577 DEBUG:teuthology.task.selinux:Excluding smithi082: OS 'ubuntu' does not support SELinux 2023-12-24T18:23:45.577 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-24T18:23:45.578 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-24T18:23:45.578 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-24T18:23:45.578 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-24T18:23:45.586 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-24T18:23:45.592 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2023-12-24T18:23:45.723 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-24T18:23:45.739 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-24T18:23:45.741 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-24T18:32:02.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2023-12-24T18:32:02.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:32:02.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:32:03.085 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-24T18:32:03.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-24T18:32:03.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-24T18:32:03.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T18:32:03.422 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-12-24T18:32:03.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-24T18:32:03.646 INFO:teuthology.run_tasks:Running task clock... 2023-12-24T18:32:03.658 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-24T18:32:03.658 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-24T18:32:03.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T18:32:03.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-24T18:32:03.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T18:32:03.741 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-24T18:32:03.742 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Command line: ntpd -gq 2023-12-24T18:32:03.742 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: proto: precision = 0.053 usec (-24) 2023-12-24T18:32:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-24T18:32:03.743 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-24T18:32:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-24T18:32:03.744 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: restrict ::: KOD does nothing without LIMITED. 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen and drop on 0 v6wildcard [::]:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen normally on 2 lo 127.0.0.1:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen normally on 3 ens1f0 172.21.15.50:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen normally on 4 lo [::1]:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2023-12-24T18:32:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:03 ntpd[23422]: Listening on routing socket on fd #22 for interface updates 2023-12-24T18:32:03.766 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-24T18:32:03.767 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Command line: ntpd -gq 2023-12-24T18:32:03.768 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: proto: precision = 0.041 usec (-24) 2023-12-24T18:32:03.768 INFO:teuthology.orchestra.run.smithi082.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-24T18:32:03.768 INFO:teuthology.orchestra.run.smithi082.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: restrict ::: KOD does nothing without LIMITED. 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen and drop on 0 v6wildcard [::]:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen normally on 2 lo 127.0.0.1:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen normally on 3 enp3s0f1 172.21.15.82:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen normally on 4 lo [::1]:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3ff%5]:123 2023-12-24T18:32:03.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:03 ntpd[23432]: Listening on routing socket on fd #22 for interface updates 2023-12-24T18:32:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:04 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:04.767 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.767 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:04.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:04.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:04.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:04 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:06 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:06.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:06.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:06.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:06.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:06 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:07.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:07 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:08 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:08.770 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.772 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.772 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:08 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:09.767 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:09 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:10.743 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:10.744 INFO:teuthology.orchestra.run.smithi050.stdout:24 Dec 18:32:10 ntpd[23422]: ntpd: time slew +0.002277 s 2023-12-24T18:32:10.744 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew +0.002277s 2023-12-24T18:32:10.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-24T18:32:10.744 INFO:teuthology.orchestra.run.smithi050.stderr:24 Dec 18:32:10 ntpd[23422]: can't open /var/log/ntpstats/loopstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/rawstats.20231224: Permission denied 2023-12-24T18:32:10.768 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-24T18:32:10.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/peerstats.20231224: Permission denied 2023-12-24T18:32:10.769 INFO:teuthology.orchestra.run.smithi082.stdout:24 Dec 18:32:10 ntpd[23432]: ntpd: time slew -0.000959 s 2023-12-24T18:32:10.769 INFO:teuthology.orchestra.run.smithi082.stdout:ntpd: time slew -0.000959s 2023-12-24T18:32:10.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-24T18:32:10.769 INFO:teuthology.orchestra.run.smithi082.stderr:24 Dec 18:32:10 ntpd[23432]: can't open /var/log/ntpstats/loopstats.20231224: Permission denied 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.900 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-24T18:32:10.902 INFO:teuthology.run_tasks:Running task install... 2023-12-24T18:32:10.910 DEBUG:teuthology.task.install:project ceph 2023-12-24T18:32:10.911 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}} 2023-12-24T18:32:10.911 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'} 2023-12-24T18:32:10.911 INFO:teuthology.task.install:Using flavor: default 2023-12-24T18:32:10.917 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-24T18:32:10.917 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-24T18:32:10.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2023-12-24T18:32:10.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-key list | grep Ceph 2023-12-24T18:32:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-24T18:32:11.159 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-24T18:32:11.306 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-24T18:32:11.306 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph.com (release key) 2023-12-24T18:32:11.308 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-24T18:32:11.308 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-12-24T18:32:11.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T18:32:11.314 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-24T18:32:11.314 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2023-12-24T18:32:11.316 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-24T18:32:11.316 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-12-24T18:32:11.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T18:32:11.465 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default/ 2023-12-24T18:32:11.465 INFO:teuthology.task.install.deb:Package version is 17.2.7-168-g5e7ce129-1focal 2023-12-24T18:32:11.522 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default/ 2023-12-24T18:32:11.523 INFO:teuthology.task.install.deb:Package version is 17.2.7-168-g5e7ce129-1focal 2023-12-24T18:32:11.572 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:32:11.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-24T18:32:11.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-12-24T18:32:11.690 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:32:11.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-24T18:32:11.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2023-12-24T18:32:11.906 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-24T18:32:11.906 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-24T18:32:11.917 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-24T18:32:12.005 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-24T18:32:12.009 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal InRelease 2023-12-24T18:32:12.009 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-24T18:32:12.009 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-24T18:32:12.010 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-24T18:32:12.020 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-24T18:32:12.043 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-24T18:32:12.082 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal Release.gpg 2023-12-24T18:32:12.104 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal InRelease 2023-12-24T18:32:12.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main i386 Packages [3,370 B] 2023-12-24T18:32:12.141 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-24T18:32:12.177 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-12-24T18:32:12.179 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal Release.gpg 2023-12-24T18:32:12.218 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-12-24T18:32:12.276 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main i386 Packages [3,370 B] 2023-12-24T18:32:13.351 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.4 kB in 1s (20.5 kB/s) 2023-12-24T18:32:13.410 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 28.4 kB in 1s (21.2 kB/s) 2023-12-24T18:32:14.639 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-12-24T18:32:14.643 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-12-24T18:32:14.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-168-g5e7ce129-1focal cephadm=17.2.7-168-g5e7ce129-1focal ceph-mds=17.2.7-168-g5e7ce129-1focal ceph-mgr=17.2.7-168-g5e7ce129-1focal ceph-common=17.2.7-168-g5e7ce129-1focal ceph-fuse=17.2.7-168-g5e7ce129-1focal ceph-test=17.2.7-168-g5e7ce129-1focal ceph-volume=17.2.7-168-g5e7ce129-1focal radosgw=17.2.7-168-g5e7ce129-1focal python3-rados=17.2.7-168-g5e7ce129-1focal python3-rgw=17.2.7-168-g5e7ce129-1focal python3-cephfs=17.2.7-168-g5e7ce129-1focal python3-rbd=17.2.7-168-g5e7ce129-1focal libcephfs2=17.2.7-168-g5e7ce129-1focal libcephfs-dev=17.2.7-168-g5e7ce129-1focal librados2=17.2.7-168-g5e7ce129-1focal librbd1=17.2.7-168-g5e7ce129-1focal rbd-fuse=17.2.7-168-g5e7ce129-1focal python3-cephfs=17.2.7-168-g5e7ce129-1focal cephfs-shell=17.2.7-168-g5e7ce129-1focal cephfs-top=17.2.7-168-g5e7ce129-1focal cephfs-mirror=17.2.7-168-g5e7ce129-1focal 2023-12-24T18:32:14.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-168-g5e7ce129-1focal cephadm=17.2.7-168-g5e7ce129-1focal ceph-mds=17.2.7-168-g5e7ce129-1focal ceph-mgr=17.2.7-168-g5e7ce129-1focal ceph-common=17.2.7-168-g5e7ce129-1focal ceph-fuse=17.2.7-168-g5e7ce129-1focal ceph-test=17.2.7-168-g5e7ce129-1focal ceph-volume=17.2.7-168-g5e7ce129-1focal radosgw=17.2.7-168-g5e7ce129-1focal python3-rados=17.2.7-168-g5e7ce129-1focal python3-rgw=17.2.7-168-g5e7ce129-1focal python3-cephfs=17.2.7-168-g5e7ce129-1focal python3-rbd=17.2.7-168-g5e7ce129-1focal libcephfs2=17.2.7-168-g5e7ce129-1focal libcephfs-dev=17.2.7-168-g5e7ce129-1focal librados2=17.2.7-168-g5e7ce129-1focal librbd1=17.2.7-168-g5e7ce129-1focal rbd-fuse=17.2.7-168-g5e7ce129-1focal python3-cephfs=17.2.7-168-g5e7ce129-1focal cephfs-shell=17.2.7-168-g5e7ce129-1focal cephfs-top=17.2.7-168-g5e7ce129-1focal cephfs-mirror=17.2.7-168-g5e7ce129-1focal 2023-12-24T18:32:14.804 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-12-24T18:32:14.821 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-12-24T18:32:14.989 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-12-24T18:32:14.990 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-12-24T18:32:15.035 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-12-24T18:32:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-12-24T18:32:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-24T18:32:15.166 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-24T18:32:15.167 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-24T18:32:15.168 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2023-12-24T18:32:15.169 INFO:teuthology.orchestra.run.smithi082.stdout: btrfs-tools 2023-12-24T18:32:15.241 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-12-24T18:32:15.242 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-24T18:32:15.242 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-24T18:32:15.242 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-12-24T18:32:15.242 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-24T18:32:15.243 INFO:teuthology.orchestra.run.smithi050.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-24T18:32:15.244 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-24T18:32:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-24T18:32:15.246 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-12-24T18:32:15.246 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-24T18:32:15.247 INFO:teuthology.orchestra.run.smithi050.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-24T18:32:15.248 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-24T18:32:15.248 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-24T18:32:15.248 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2023-12-24T18:32:15.248 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-24T18:32:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-12-24T18:32:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-12-24T18:32:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-12-24T18:32:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-12-24T18:32:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-12-24T18:32:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-24T18:32:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-12-24T18:32:15.373 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-12-24T18:32:15.373 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 librbd1 2023-12-24T18:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-12-24T18:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-24T18:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-24T18:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-12-24T18:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-12-24T18:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 librbd1 2023-12-24T18:32:15.588 INFO:teuthology.orchestra.run.smithi082.stdout:2 upgraded, 114 newly installed, 0 to remove and 262 not upgraded. 2023-12-24T18:32:15.588 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 210 MB of archives. 2023-12-24T18:32:15.588 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 982 MB of additional disk space will be used. 2023-12-24T18:32:15.588 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-24T18:32:15.628 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-168-g5e7ce129-1focal [3,501 kB] 2023-12-24T18:32:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-24T18:32:15.675 INFO:teuthology.orchestra.run.smithi050.stdout:2 upgraded, 114 newly installed, 0 to remove and 262 not upgraded. 2023-12-24T18:32:15.675 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 210 MB of archives. 2023-12-24T18:32:15.676 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 982 MB of additional disk space will be used. 2023-12-24T18:32:15.676 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-24T18:32:15.707 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-24T18:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-168-g5e7ce129-1focal [3,501 kB] 2023-12-24T18:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-24T18:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-24T18:32:15.847 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-24T18:32:15.938 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-24T18:32:15.983 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-24T18:32:15.993 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-24T18:32:16.009 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-168-g5e7ce129-1focal [3,552 kB] 2023-12-24T18:32:16.038 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-24T18:32:16.049 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-24T18:32:16.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-24T18:32:16.081 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-24T18:32:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-168-g5e7ce129-1focal [3,552 kB] 2023-12-24T18:32:16.125 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-24T18:32:16.133 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-24T18:32:16.136 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-24T18:32:16.138 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-24T18:32:16.161 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-24T18:32:16.200 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-168-g5e7ce129-1focal [759 kB] 2023-12-24T18:32:16.220 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-24T18:32:16.222 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-168-g5e7ce129-1focal [413 kB] 2023-12-24T18:32:16.224 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-24T18:32:16.247 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-24T18:32:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-168-g5e7ce129-1focal [22.6 kB] 2023-12-24T18:32:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-168-g5e7ce129-1focal [200 kB] 2023-12-24T18:32:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-168-g5e7ce129-1focal [47.2 kB] 2023-12-24T18:32:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-168-g5e7ce129-1focal [386 kB] 2023-12-24T18:32:16.297 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-168-g5e7ce129-1focal [5,580 kB] 2023-12-24T18:32:16.359 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-168-g5e7ce129-1focal [759 kB] 2023-12-24T18:32:16.419 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-168-g5e7ce129-1focal [413 kB] 2023-12-24T18:32:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-168-g5e7ce129-1focal [22.6 kB] 2023-12-24T18:32:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-168-g5e7ce129-1focal [200 kB] 2023-12-24T18:32:16.443 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-168-g5e7ce129-1focal [47.2 kB] 2023-12-24T18:32:16.444 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-168-g5e7ce129-1focal [386 kB] 2023-12-24T18:32:16.452 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-24T18:32:16.491 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-168-g5e7ce129-1focal [5,580 kB] 2023-12-24T18:32:16.538 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-24T18:32:16.625 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-168-g5e7ce129-1focal [116 kB] 2023-12-24T18:32:16.626 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-168-g5e7ce129-1focal [479 kB] 2023-12-24T18:32:16.677 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-168-g5e7ce129-1focal [27.8 MB] 2023-12-24T18:32:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-168-g5e7ce129-1focal [116 kB] 2023-12-24T18:32:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-168-g5e7ce129-1focal [479 kB] 2023-12-24T18:32:16.901 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-24T18:32:16.916 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-168-g5e7ce129-1focal [27.8 MB] 2023-12-24T18:32:16.990 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-24T18:32:17.085 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-24T18:32:17.117 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-24T18:32:17.122 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-24T18:32:17.148 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-24T18:32:17.152 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-24T18:32:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-24T18:32:17.168 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-24T18:32:17.170 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-24T18:32:17.171 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-24T18:32:17.174 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-24T18:32:17.205 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-24T18:32:17.210 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-24T18:32:17.236 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-24T18:32:17.240 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-24T18:32:17.243 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-24T18:32:17.256 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-24T18:32:17.258 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-24T18:32:17.259 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-24T18:32:17.337 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-24T18:32:17.425 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-24T18:32:17.502 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-24T18:32:17.591 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-24T18:32:17.642 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-24T18:32:17.659 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-24T18:32:17.670 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-24T18:32:17.748 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-24T18:32:17.758 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-24T18:32:17.763 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-24T18:32:17.768 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-24T18:32:17.770 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-24T18:32:17.808 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-24T18:32:17.837 INFO:teuthology.orchestra.run.smithi082.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-24T18:32:17.842 INFO:teuthology.orchestra.run.smithi082.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-24T18:32:17.850 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-24T18:32:17.869 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-24T18:32:17.911 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-24T18:32:17.936 INFO:teuthology.orchestra.run.smithi082.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-24T18:32:17.938 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-24T18:32:17.943 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-24T18:32:18.038 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-24T18:32:18.101 INFO:teuthology.orchestra.run.smithi082.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-24T18:32:18.203 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-24T18:32:18.299 INFO:teuthology.orchestra.run.smithi082.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-24T18:32:18.354 INFO:teuthology.orchestra.run.smithi082.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-24T18:32:18.390 INFO:teuthology.orchestra.run.smithi082.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-168-g5e7ce129-1focal [6,454 kB] 2023-12-24T18:32:18.392 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-24T18:32:18.438 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-24T18:32:18.512 INFO:teuthology.orchestra.run.smithi082.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-24T18:32:18.602 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-24T18:32:18.631 INFO:teuthology.orchestra.run.smithi082.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-24T18:32:18.661 INFO:teuthology.orchestra.run.smithi082.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-24T18:32:18.665 INFO:teuthology.orchestra.run.smithi082.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-24T18:32:18.693 INFO:teuthology.orchestra.run.smithi082.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-24T18:32:18.715 INFO:teuthology.orchestra.run.smithi082.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-24T18:32:18.720 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-24T18:32:18.730 INFO:teuthology.orchestra.run.smithi082.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-24T18:32:18.732 INFO:teuthology.orchestra.run.smithi082.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-24T18:32:18.750 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-24T18:32:18.754 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-24T18:32:18.755 INFO:teuthology.orchestra.run.smithi082.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-168-g5e7ce129-1focal [221 kB] 2023-12-24T18:32:18.779 INFO:teuthology.orchestra.run.smithi082.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-168-g5e7ce129-1focal [152 kB] 2023-12-24T18:32:18.781 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-24T18:32:18.783 INFO:teuthology.orchestra.run.smithi082.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-168-g5e7ce129-1focal [1,590 kB] 2023-12-24T18:32:18.804 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-24T18:32:18.820 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-24T18:32:18.822 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-24T18:32:18.875 INFO:teuthology.orchestra.run.smithi082.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-168-g5e7ce129-1focal [7,851 kB] 2023-12-24T18:32:18.900 INFO:teuthology.orchestra.run.smithi082.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-24T18:32:18.923 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-168-g5e7ce129-1focal [6,454 kB] 2023-12-24T18:32:18.993 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-24T18:32:19.354 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-168-g5e7ce129-1focal [221 kB] 2023-12-24T18:32:19.358 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-168-g5e7ce129-1focal [152 kB] 2023-12-24T18:32:19.370 INFO:teuthology.orchestra.run.smithi082.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-168-g5e7ce129-1focal [28.7 MB] 2023-12-24T18:32:19.406 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-168-g5e7ce129-1focal [1,590 kB] 2023-12-24T18:32:19.509 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-168-g5e7ce129-1focal [7,851 kB] 2023-12-24T18:32:19.898 INFO:teuthology.orchestra.run.smithi082.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-24T18:32:19.927 INFO:teuthology.orchestra.run.smithi082.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-24T18:32:19.929 INFO:teuthology.orchestra.run.smithi082.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-24T18:32:19.978 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-24T18:32:19.993 INFO:teuthology.orchestra.run.smithi082.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-24T18:32:19.994 INFO:teuthology.orchestra.run.smithi082.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-24T18:32:19.994 INFO:teuthology.orchestra.run.smithi082.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-24T18:32:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-24T18:32:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-24T18:32:19.996 INFO:teuthology.orchestra.run.smithi082.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-24T18:32:19.996 INFO:teuthology.orchestra.run.smithi082.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-24T18:32:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-24T18:32:20.012 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-24T18:32:20.053 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-168-g5e7ce129-1focal [28.7 MB] 2023-12-24T18:32:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-24T18:32:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-24T18:32:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-24T18:32:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-24T18:32:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-24T18:32:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-24T18:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-24T18:32:20.162 INFO:teuthology.orchestra.run.smithi082.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-24T18:32:20.246 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-24T18:32:20.329 INFO:teuthology.orchestra.run.smithi082.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-24T18:32:20.411 INFO:teuthology.orchestra.run.smithi082.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-24T18:32:20.415 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-24T18:32:20.496 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-24T18:32:20.659 INFO:teuthology.orchestra.run.smithi082.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-24T18:32:20.702 INFO:teuthology.orchestra.run.smithi082.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-24T18:32:20.732 INFO:teuthology.orchestra.run.smithi082.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-24T18:32:20.743 INFO:teuthology.orchestra.run.smithi082.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-24T18:32:20.746 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-24T18:32:20.789 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-24T18:32:20.790 INFO:teuthology.orchestra.run.smithi082.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-24T18:32:20.819 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-24T18:32:20.820 INFO:teuthology.orchestra.run.smithi082.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-24T18:32:20.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-24T18:32:20.829 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-24T18:32:20.878 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-24T18:32:20.906 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-24T18:32:20.909 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-24T18:32:20.943 INFO:teuthology.orchestra.run.smithi082.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-24T18:32:21.030 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-24T18:32:21.106 INFO:teuthology.orchestra.run.smithi082.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-168-g5e7ce129-1focal [3,936 B] 2023-12-24T18:32:21.106 INFO:teuthology.orchestra.run.smithi082.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-168-g5e7ce129-1focal [868 kB] 2023-12-24T18:32:21.117 INFO:teuthology.orchestra.run.smithi082.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-24T18:32:21.166 INFO:teuthology.orchestra.run.smithi082.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-168-g5e7ce129-1focal [2,407 kB] 2023-12-24T18:32:21.203 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-24T18:32:21.288 INFO:teuthology.orchestra.run.smithi082.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-168-g5e7ce129-1focal [79.2 kB] 2023-12-24T18:32:21.289 INFO:teuthology.orchestra.run.smithi082.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-168-g5e7ce129-1focal [117 kB] 2023-12-24T18:32:21.293 INFO:teuthology.orchestra.run.smithi082.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-168-g5e7ce129-1focal [1,760 kB] 2023-12-24T18:32:21.412 INFO:teuthology.orchestra.run.smithi082.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-168-g5e7ce129-1focal [7,892 kB] 2023-12-24T18:32:21.853 INFO:teuthology.orchestra.run.smithi082.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-168-g5e7ce129-1focal [4,056 B] 2023-12-24T18:32:21.861 INFO:teuthology.orchestra.run.smithi082.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-168-g5e7ce129-1focal [56.4 MB] 2023-12-24T18:32:21.964 INFO:teuthology.orchestra.run.smithi082.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-24T18:32:21.967 INFO:teuthology.orchestra.run.smithi082.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-24T18:32:21.968 INFO:teuthology.orchestra.run.smithi082.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-24T18:32:21.970 INFO:teuthology.orchestra.run.smithi082.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-24T18:32:21.971 INFO:teuthology.orchestra.run.smithi082.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-24T18:32:21.975 INFO:teuthology.orchestra.run.smithi082.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-24T18:32:21.991 INFO:teuthology.orchestra.run.smithi082.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-24T18:32:21.992 INFO:teuthology.orchestra.run.smithi082.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-24T18:32:21.992 INFO:teuthology.orchestra.run.smithi082.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-24T18:32:22.045 INFO:teuthology.orchestra.run.smithi082.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-24T18:32:22.058 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-24T18:32:22.063 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-24T18:32:22.065 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-24T18:32:22.067 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-24T18:32:22.068 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-24T18:32:22.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-24T18:32:22.087 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-24T18:32:22.087 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-24T18:32:22.088 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-24T18:32:22.140 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-24T18:32:22.213 INFO:teuthology.orchestra.run.smithi082.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-24T18:32:22.213 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-168-g5e7ce129-1focal [3,936 B] 2023-12-24T18:32:22.214 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-168-g5e7ce129-1focal [868 kB] 2023-12-24T18:32:22.282 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-168-g5e7ce129-1focal [2,407 kB] 2023-12-24T18:32:22.307 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-24T18:32:22.498 INFO:teuthology.orchestra.run.smithi082.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-24T18:32:22.514 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-168-g5e7ce129-1focal [79.2 kB] 2023-12-24T18:32:22.516 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-168-g5e7ce129-1focal [117 kB] 2023-12-24T18:32:22.521 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-168-g5e7ce129-1focal [1,760 kB] 2023-12-24T18:32:22.522 INFO:teuthology.orchestra.run.smithi082.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-24T18:32:22.593 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-24T18:32:22.616 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-24T18:32:22.674 INFO:teuthology.orchestra.run.smithi082.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-24T18:32:22.681 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-168-g5e7ce129-1focal [7,892 kB] 2023-12-24T18:32:22.692 INFO:teuthology.orchestra.run.smithi082.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-24T18:32:22.774 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-24T18:32:22.795 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-24T18:32:23.330 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-168-g5e7ce129-1focal [4,056 B] 2023-12-24T18:32:23.330 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-168-g5e7ce129-1focal [56.4 MB] 2023-12-24T18:32:24.938 INFO:teuthology.orchestra.run.smithi082.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-168-g5e7ce129-1focal [229 kB] 2023-12-24T18:32:24.941 INFO:teuthology.orchestra.run.smithi082.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-168-g5e7ce129-1focal [240 kB] 2023-12-24T18:32:24.943 INFO:teuthology.orchestra.run.smithi082.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-168-g5e7ce129-1focal [22.0 kB] 2023-12-24T18:32:24.944 INFO:teuthology.orchestra.run.smithi082.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-168-g5e7ce129-1focal [13.1 kB] 2023-12-24T18:32:24.944 INFO:teuthology.orchestra.run.smithi082.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-168-g5e7ce129-1focal [21.9 kB] 2023-12-24T18:32:24.945 INFO:teuthology.orchestra.run.smithi082.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-168-g5e7ce129-1focal [17.1 MB] 2023-12-24T18:32:25.857 INFO:teuthology.orchestra.run.smithi082.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-168-g5e7ce129-1focal [79.6 kB] 2023-12-24T18:32:26.723 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-168-g5e7ce129-1focal [229 kB] 2023-12-24T18:32:26.725 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-168-g5e7ce129-1focal [240 kB] 2023-12-24T18:32:26.728 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-168-g5e7ce129-1focal [22.0 kB] 2023-12-24T18:32:26.728 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-168-g5e7ce129-1focal [13.1 kB] 2023-12-24T18:32:26.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-168-g5e7ce129-1focal [21.9 kB] 2023-12-24T18:32:26.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-168-g5e7ce129-1focal [17.1 MB] 2023-12-24T18:32:26.777 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 210 MB in 10s (20.1 MB/s) 2023-12-24T18:32:26.913 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-24T18:32:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-24T18:32:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-24T18:32:27.018 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-24T18:32:27.298 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-168-g5e7ce129-1focal [79.6 kB] 2023-12-24T18:32:27.338 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-24T18:32:27.355 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-24T18:32:27.395 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-24T18:32:27.732 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cmd2. 2023-12-24T18:32:27.750 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-24T18:32:27.790 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-24T18:32:28.126 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-24T18:32:28.146 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-24T18:32:28.209 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-24T18:32:28.264 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 210 MB in 12s (17.8 MB/s) 2023-12-24T18:32:28.446 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-24T18:32:28.520 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-24T18:32:28.523 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-24T18:32:28.567 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-24T18:32:28.599 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../004-librbd1_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:28.722 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librbd1 (17.2.7-168-g5e7ce129-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-24T18:32:28.954 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-24T18:32:28.974 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-24T18:32:29.011 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-24T18:32:29.381 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2023-12-24T18:32:29.399 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-24T18:32:29.431 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-24T18:32:29.463 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../005-librados2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librados2 (17.2.7-168-g5e7ce129-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-24T18:32:29.777 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-24T18:32:29.796 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-24T18:32:29.875 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-24T18:32:30.390 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-librbd1_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:30.565 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs2. 2023-12-24T18:32:30.585 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:30.631 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:30.780 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (17.2.7-168-g5e7ce129-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-24T18:32:30.975 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rados. 2023-12-24T18:32:30.996 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../007-python3-rados_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:31.033 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rados (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:31.428 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-24T18:32:31.448 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:31.486 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-argparse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:31.530 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-librados2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:31.660 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (17.2.7-168-g5e7ce129-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-24T18:32:31.805 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cephfs. 2023-12-24T18:32:31.825 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:31.863 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cephfs (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:32.233 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-24T18:32:32.253 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:32.291 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2023-12-24T18:32:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:32.446 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:32.686 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-prettytable. 2023-12-24T18:32:32.709 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-12-24T18:32:32.752 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-24T18:32:32.974 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2023-12-24T18:32:32.992 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-python3-rados_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:33.032 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:33.063 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rbd. 2023-12-24T18:32:33.076 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:33.121 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rbd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:33.418 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-24T18:32:33.431 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:33.460 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:33.500 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-24T18:32:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-24T18:32:33.566 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-24T18:32:33.746 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2023-12-24T18:32:33.767 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:33.804 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:33.961 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-24T18:32:33.978 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-24T18:32:34.019 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-24T18:32:34.199 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-24T18:32:34.220 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:34.422 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-24T18:32:34.445 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-24T18:32:34.488 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-24T18:32:34.660 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2023-12-24T18:32:34.681 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-12-24T18:32:34.710 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-24T18:32:34.883 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-24T18:32:34.902 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-24T18:32:34.962 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2023-12-24T18:32:34.975 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-24T18:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:35.062 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:35.319 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-24T18:32:35.340 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-24T18:32:35.377 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-24T18:32:35.423 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-24T18:32:35.446 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-24T18:32:35.506 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-24T18:32:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-24T18:32:35.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-24T18:32:35.903 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:35.905 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-24T18:32:35.959 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-24T18:32:35.972 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:36.262 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-24T18:32:36.284 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-24T18:32:36.320 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-24T18:32:36.526 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-24T18:32:36.546 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:36.584 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:36.740 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-24T18:32:36.762 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-24T18:32:36.832 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-24T18:32:37.012 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-24T18:32:37.032 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:37.070 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:37.201 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-24T18:32:37.221 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-24T18:32:37.261 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-24T18:32:37.457 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-24T18:32:37.475 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-24T18:32:37.548 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-24T18:32:37.740 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-24T18:32:37.759 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:37.818 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librgw2. 2023-12-24T18:32:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../022-librgw2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:37.959 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librgw2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:38.384 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-24T18:32:38.404 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:38.441 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:38.804 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rgw. 2023-12-24T18:32:38.822 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-24T18:32:38.861 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-24T18:32:38.902 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:32:39.189 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liboath0. 2023-12-24T18:32:39.208 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-24T18:32:39.239 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-24T18:32:39.280 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-24T18:32:39.302 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-24T18:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-24T18:32:39.592 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libradosstriper1. 2023-12-24T18:32:39.613 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:39.650 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libradosstriper1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:39.750 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2023-12-24T18:32:39.770 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-librgw2_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:39.808 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:40.187 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-common. 2023-12-24T18:32:40.207 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../026-ceph-common_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:40.245 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:40.660 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2023-12-24T18:32:40.678 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:40.710 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:41.122 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0. 2023-12-24T18:32:41.140 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-24T18:32:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-24T18:32:41.557 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2023-12-24T18:32:41.579 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:41.624 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:42.153 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2023-12-24T18:32:42.173 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-ceph-common_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:42.244 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:42.892 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-base. 2023-12-24T18:32:42.912 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../027-ceph-base_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:42.969 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-base (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:43.971 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cryptography. 2023-12-24T18:32:43.992 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-24T18:32:44.021 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-24T18:32:44.408 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-openssl. 2023-12-24T18:32:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-24T18:32:44.474 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-24T18:32:44.802 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-24T18:32:44.825 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-modules-core (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:45.008 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2023-12-24T18:32:45.026 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-ceph-base_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:45.086 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:45.316 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-24T18:32:45.336 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-24T18:32:45.382 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-24T18:32:46.369 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-24T18:32:46.386 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-24T18:32:46.418 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-24T18:32:46.762 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cryptography. 2023-12-24T18:32:46.783 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-24T18:32:46.805 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-natsort. 2023-12-24T18:32:46.820 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-24T18:32:46.822 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-12-24T18:32:46.863 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-24T18:32:47.216 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jwt. 2023-12-24T18:32:47.236 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-24T18:32:47.266 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2023-12-24T18:32:47.276 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-24T18:32:47.283 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-24T18:32:47.324 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-24T18:32:47.668 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-24T18:32:47.678 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-logutils. 2023-12-24T18:32:47.692 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:32:47.698 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-12-24T18:32:47.735 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:47.744 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-24T18:32:48.114 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-24T18:32:48.134 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-24T18:32:48.171 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-24T18:32:48.198 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-24T18:32:48.215 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-24T18:32:48.256 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-24T18:32:48.508 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-mako. 2023-12-24T18:32:48.530 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-24T18:32:48.574 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-24T18:32:48.609 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-24T18:32:48.629 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-24T18:32:48.667 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-24T18:32:48.954 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-24T18:32:48.971 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-24T18:32:49.011 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-24T18:32:49.037 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2023-12-24T18:32:49.058 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-12-24T18:32:49.095 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-24T18:32:49.364 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-24T18:32:49.382 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-24T18:32:49.422 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-24T18:32:49.482 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jwt. 2023-12-24T18:32:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-24T18:32:49.548 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-24T18:32:49.750 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webob. 2023-12-24T18:32:49.768 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-24T18:32:49.808 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-24T18:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2023-12-24T18:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-12-24T18:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-24T18:32:50.195 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-24T18:32:50.214 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-24T18:32:50.252 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-24T18:32:50.354 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-24T18:32:50.376 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-24T18:32:50.420 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-24T18:32:50.614 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bs4. 2023-12-24T18:32:50.632 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-12-24T18:32:50.663 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-24T18:32:50.791 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2023-12-24T18:32:50.811 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-24T18:32:50.848 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-24T18:32:51.009 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-waitress. 2023-12-24T18:32:51.026 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-24T18:32:51.071 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-24T18:32:51.227 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-24T18:32:51.249 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-24T18:32:51.293 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-24T18:32:51.487 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempita. 2023-12-24T18:32:51.509 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-12-24T18:32:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-24T18:32:51.655 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-24T18:32:51.676 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-24T18:32:51.721 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-24T18:32:51.916 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-paste. 2023-12-24T18:32:51.934 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-24T18:32:51.974 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-24T18:32:52.016 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2023-12-24T18:32:52.038 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-24T18:32:52.107 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-24T18:32:52.319 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-24T18:32:52.341 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-24T18:32:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-24T18:32:52.460 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-24T18:32:52.482 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-24T18:32:52.551 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-24T18:32:52.739 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-24T18:32:52.761 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-24T18:32:52.805 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-24T18:32:52.871 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bs4. 2023-12-24T18:32:52.892 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-12-24T18:32:52.937 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-24T18:32:53.192 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webtest. 2023-12-24T18:32:53.213 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-12-24T18:32:53.258 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-24T18:32:53.265 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2023-12-24T18:32:53.283 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-24T18:32:53.330 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-24T18:32:53.603 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pecan. 2023-12-24T18:32:53.625 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-24T18:32:53.669 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-24T18:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2023-12-24T18:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-12-24T18:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-24T18:32:54.099 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-24T18:32:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-24T18:32:54.138 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2023-12-24T18:32:54.157 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-24T18:32:54.158 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-24T18:32:54.196 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-24T18:32:54.536 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-24T18:32:54.556 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:54.574 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-24T18:32:54.593 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:54.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-24T18:32:54.641 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-24T18:32:54.947 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr. 2023-12-24T18:32:54.966 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../052-ceph-mgr_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:55.002 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-24T18:32:55.004 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:55.023 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-24T18:32:55.060 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-24T18:32:55.430 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2023-12-24T18:32:55.451 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-12-24T18:32:55.488 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-24T18:32:55.516 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mon. 2023-12-24T18:32:55.534 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../053-ceph-mon_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mon (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:55.850 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2023-12-24T18:32:55.871 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-24T18:32:55.915 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-24T18:32:56.363 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-24T18:32:56.383 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-24T18:32:56.420 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-24T18:32:56.745 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-osd. 2023-12-24T18:32:56.762 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../054-ceph-osd_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:56.802 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-osd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:56.832 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-24T18:32:56.853 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:56.898 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:57.302 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2023-12-24T18:32:57.322 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-ceph-mgr_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:57.359 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:57.838 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2023-12-24T18:32:57.859 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-ceph-mon_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:57.912 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:59.058 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2023-12-24T18:32:59.072 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-ceph-osd_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:59.115 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:59.314 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph. 2023-12-24T18:32:59.333 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../055-ceph_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:59.371 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:32:59.733 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-fuse. 2023-12-24T18:32:59.750 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../056-ceph-fuse_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:32:59.791 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mds. 2023-12-24T18:33:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../057-ceph-mds_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mds (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:00.897 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephadm. 2023-12-24T18:33:00.917 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../058-cephadm_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:00.954 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:01.292 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jinja2. 2023-12-24T18:33:01.310 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-12-24T18:33:01.349 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-24T18:33:01.628 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2023-12-24T18:33:01.650 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-ceph_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:01.694 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:02.036 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-24T18:33:02.056 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:02.093 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:02.338 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2023-12-24T18:33:02.358 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-ceph-fuse_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:02.396 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:02.480 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-24T18:33:02.500 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-12-24T18:33:02.538 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-24T18:33:02.833 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-underscore. 2023-12-24T18:33:02.850 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2023-12-24T18:33:02.854 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-24T18:33:02.872 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-ceph-mds_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:02.899 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-24T18:33:02.916 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:03.202 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-24T18:33:03.221 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-24T18:33:03.259 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-24T18:33:03.528 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2023-12-24T18:33:03.549 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-cephadm_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:03.594 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:03.629 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-routes. 2023-12-24T18:33:03.650 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-12-24T18:33:03.695 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-24T18:33:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2023-12-24T18:33:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-12-24T18:33:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-24T18:33:04.074 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-24T18:33:04.090 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:04.131 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-dashboard (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:04.425 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-24T18:33:04.442 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:04.708 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-decorator. 2023-12-24T18:33:04.726 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-24T18:33:04.774 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-24T18:33:04.852 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-24T18:33:04.873 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-12-24T18:33:04.927 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-24T18:33:05.103 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-24T18:33:05.124 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-24T18:33:05.169 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-24T18:33:05.247 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-underscore. 2023-12-24T18:33:05.268 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-24T18:33:05.313 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-24T18:33:05.547 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-scipy. 2023-12-24T18:33:05.568 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-24T18:33:05.605 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-24T18:33:05.640 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-24T18:33:05.661 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-24T18:33:05.698 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-24T18:33:06.076 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2023-12-24T18:33:06.097 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-12-24T18:33:06.134 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-24T18:33:06.537 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-24T18:33:06.558 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:06.603 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:07.097 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-24T18:33:07.118 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-24T18:33:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-decorator. 2023-12-24T18:33:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-24T18:33:07.155 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:07.212 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-24T18:33:07.551 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-24T18:33:07.572 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-24T18:33:07.617 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-24T18:33:07.718 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-joblib. 2023-12-24T18:33:07.738 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-12-24T18:33:07.776 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-24T18:33:07.978 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-scipy. 2023-12-24T18:33:08.000 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-24T18:33:08.045 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-24T18:33:08.205 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn. 2023-12-24T18:33:08.226 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-24T18:33:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:09.108 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-24T18:33:09.129 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:09.199 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:09.487 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-24T18:33:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-24T18:33:09.586 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:10.176 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2023-12-24T18:33:10.198 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-12-24T18:33:10.242 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-24T18:33:10.502 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cachetools. 2023-12-24T18:33:10.522 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-12-24T18:33:10.559 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-24T18:33:10.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2023-12-24T18:33:10.707 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-24T18:33:10.747 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:10.904 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-24T18:33:10.925 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-24T18:33:10.970 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-24T18:33:11.365 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-24T18:33:11.383 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-24T18:33:11.423 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-24T18:33:11.613 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-24T18:33:11.634 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:11.679 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:11.793 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rsa. 2023-12-24T18:33:11.814 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-12-24T18:33:11.859 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-24T18:33:12.222 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-google-auth. 2023-12-24T18:33:12.242 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-12-24T18:33:12.279 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-24T18:33:12.666 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-blinker. 2023-12-24T18:33:12.684 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-24T18:33:12.732 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-24T18:33:12.957 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2023-12-24T18:33:12.976 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-12-24T18:33:13.015 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-24T18:33:13.110 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-24T18:33:13.129 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-24T18:33:13.168 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-24T18:33:13.376 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-24T18:33:13.398 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-24T18:33:13.442 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-24T18:33:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-24T18:33:13.586 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-24T18:33:13.663 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-24T18:33:13.847 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-24T18:33:13.865 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-24T18:33:13.905 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-24T18:33:14.077 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-websocket. 2023-12-24T18:33:14.093 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-24T18:33:14.135 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-24T18:33:14.299 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2023-12-24T18:33:14.321 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-12-24T18:33:14.365 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-24T18:33:14.522 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-24T18:33:14.536 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-24T18:33:14.571 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-24T18:33:14.685 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2023-12-24T18:33:14.701 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-12-24T18:33:14.744 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-24T18:33:15.122 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-blinker. 2023-12-24T18:33:15.140 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-24T18:33:15.179 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-24T18:33:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-24T18:33:15.208 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:15.252 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:15.550 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-24T18:33:15.570 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-24T18:33:15.608 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-24T18:33:15.622 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-24T18:33:15.640 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-12-24T18:33:15.679 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-24T18:33:16.019 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-24T18:33:16.041 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-24T18:33:16.066 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-24T18:33:16.085 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-24T18:33:16.086 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:33:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:33:16.444 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package jq. 2023-12-24T18:33:16.466 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:33:16.510 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:33:16.583 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2023-12-24T18:33:16.601 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-24T18:33:16.640 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-24T18:33:16.781 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package socat. 2023-12-24T18:33:16.803 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-12-24T18:33:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-24T18:33:17.036 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-24T18:33:17.058 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-24T18:33:17.102 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-24T18:33:17.193 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package xmlstarlet. 2023-12-24T18:33:17.215 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-24T18:33:17.259 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-24T18:33:17.680 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-test. 2023-12-24T18:33:17.701 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../089-ceph-test_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:17.746 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-test (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:17.792 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-24T18:33:17.815 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:17.858 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:18.252 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-24T18:33:18.274 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-12-24T18:33:18.320 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-24T18:33:18.740 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-24T18:33:18.762 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:33:18.806 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:33:19.209 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2023-12-24T18:33:19.230 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:33:19.259 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:33:19.570 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2023-12-24T18:33:19.591 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-12-24T18:33:19.628 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-24T18:33:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2023-12-24T18:33:20.054 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-24T18:33:20.098 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-24T18:33:20.529 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2023-12-24T18:33:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-ceph-test_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:20.593 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:22.385 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-volume. 2023-12-24T18:33:22.404 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../090-ceph-volume_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:22.434 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-volume (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:22.906 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-24T18:33:22.926 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:22.963 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-mirror (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:23.367 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-colorama. 2023-12-24T18:33:23.389 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-24T18:33:23.425 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-24T18:33:23.703 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-shell. 2023-12-24T18:33:23.724 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../093-cephfs-shell_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:23.769 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-shell (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-top. 2023-12-24T18:33:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../094-cephfs-top_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:24.155 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-top (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:24.458 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-24T18:33:24.476 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-24T18:33:24.515 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:25.028 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-24T18:33:25.050 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:25.094 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs-dev (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:25.448 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2023-12-24T18:33:25.466 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-ceph-volume_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:25.497 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package nvme-cli. 2023-12-24T18:33:25.514 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:25.518 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-24T18:33:25.585 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-24T18:33:25.961 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-24T18:33:25.969 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-24T18:33:25.983 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-24T18:33:25.990 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:26.027 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:26.035 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:26.413 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2023-12-24T18:33:26.432 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-24T18:33:26.471 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-24T18:33:26.799 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2023-12-24T18:33:26.821 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-cephfs-shell_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:26.865 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:27.143 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2023-12-24T18:33:27.165 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-cephfs-top_17.2.7-168-g5e7ce129-1focal_all.deb ... 2023-12-24T18:33:27.243 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:27.521 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-24T18:33:27.542 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-24T18:33:27.586 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:28.158 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-24T18:33:28.158 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-24T18:33:28.179 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:28.182 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-24T18:33:28.223 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:28.224 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-24T18:33:28.611 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-24T18:33:28.632 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-24T18:33:28.677 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-24T18:33:28.677 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2023-12-24T18:33:28.700 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-24T18:33:28.778 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-24T18:33:29.022 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-attr. 2023-12-24T18:33:29.040 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-12-24T18:33:29.104 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-24T18:33:29.199 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-24T18:33:29.221 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-24T18:33:29.265 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:29.475 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webencodings. 2023-12-24T18:33:29.496 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-24T18:33:29.540 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-24T18:33:29.903 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-html5lib. 2023-12-24T18:33:29.927 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-12-24T18:33:29.970 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-24T18:33:30.396 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-24T18:33:30.411 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-24T18:33:30.456 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-24T18:33:30.951 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-packaging. 2023-12-24T18:33:30.966 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-12-24T18:33:31.043 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-24T18:33:31.329 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-24T18:33:31.353 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-24T18:33:31.374 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastescript. 2023-12-24T18:33:31.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-24T18:33:31.397 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-12-24T18:33:31.440 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-24T18:33:31.773 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-24T18:33:31.799 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-24T18:33:31.827 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pluggy. 2023-12-24T18:33:31.839 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-24T18:33:31.846 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-12-24T18:33:31.884 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-24T18:33:32.162 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-attr. 2023-12-24T18:33:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-12-24T18:33:32.221 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-psutil. 2023-12-24T18:33:32.245 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-24T18:33:32.246 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-24T18:33:32.312 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-24T18:33:32.875 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webencodings. 2023-12-24T18:33:32.896 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-24T18:33:33.016 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-24T18:33:33.026 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-py. 2023-12-24T18:33:33.048 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-24T18:33:33.092 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-24T18:33:33.378 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-html5lib. 2023-12-24T18:33:33.399 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-12-24T18:33:33.452 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-24T18:33:33.470 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-24T18:33:33.492 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-24T18:33:33.536 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-24T18:33:33.832 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-24T18:33:33.852 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-24T18:33:33.898 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pytest. 2023-12-24T18:33:33.900 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-24T18:33:33.920 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-12-24T18:33:33.980 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-24T18:33:34.368 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplejson. 2023-12-24T18:33:34.387 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-24T18:33:34.404 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-packaging. 2023-12-24T18:33:34.425 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-24T18:33:34.428 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-12-24T18:33:34.487 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-24T18:33:34.736 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-24T18:33:34.759 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-24T18:33:34.802 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-24T18:33:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2023-12-24T18:33:34.843 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-12-24T18:33:34.915 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-24T18:33:35.271 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2023-12-24T18:33:35.292 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-12-24T18:33:35.370 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-24T18:33:35.699 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package radosgw. 2023-12-24T18:33:35.715 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2023-12-24T18:33:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../114-radosgw_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:35.739 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-24T18:33:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking radosgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:35.815 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-24T18:33:36.185 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2023-12-24T18:33:36.207 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-24T18:33:36.292 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-24T18:33:36.705 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-24T18:33:36.728 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-24T18:33:36.770 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-24T18:33:37.146 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2023-12-24T18:33:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-12-24T18:33:37.215 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-24T18:33:37.501 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-fuse. 2023-12-24T18:33:37.524 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:37.575 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2023-12-24T18:33:37.619 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-24T18:33:37.660 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-24T18:33:37.927 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-24T18:33:37.997 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-24T18:33:38.024 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-24T18:33:38.071 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-24T18:33:38.313 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-24T18:33:38.440 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-24T18:33:38.574 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-24T18:33:38.817 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2023-12-24T18:33:38.834 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:38.836 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-radosgw_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:38.875 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:39.509 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user cephadm....done 2023-12-24T18:33:39.689 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:39.815 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-24T18:33:40.242 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-24T18:33:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:40.654 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2023-12-24T18:33:40.677 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-168-g5e7ce129-1focal_amd64.deb ... 2023-12-24T18:33:40.720 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:40.744 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-24T18:33:40.870 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-24T18:33:41.108 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-24T18:33:41.288 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-24T18:33:41.483 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-24T18:33:41.610 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-24T18:33:41.778 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-24T18:33:41.782 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-24T18:33:42.012 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:42.142 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-24T18:33:42.500 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-24T18:33:42.703 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2023-12-24T18:33:42.885 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:42.910 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-24T18:33:43.011 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-24T18:33:43.253 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-24T18:33:43.471 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-24T18:33:43.612 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-argparse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:43.881 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-24T18:33:43.980 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:44.041 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-24T18:33:44.106 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-24T18:33:44.166 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-24T18:33:44.498 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-24T18:33:44.576 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-24T18:33:44.849 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-24T18:33:45.081 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-24T18:33:45.208 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-24T18:33:45.335 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-24T18:33:45.430 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-24T18:33:45.811 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-24T18:33:45.814 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-24T18:33:46.174 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-24T18:33:46.178 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-24T18:33:46.529 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-24T18:33:46.542 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-24T18:33:46.909 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:46.947 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-24T18:33:47.277 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-24T18:33:47.315 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-24T18:33:47.403 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-24T18:33:47.715 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-24T18:33:47.771 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-24T18:33:48.058 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-24T18:33:48.122 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-24T18:33:48.418 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-24T18:33:48.507 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-24T18:33:48.545 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-24T18:33:48.633 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-24T18:33:48.686 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-24T18:33:49.046 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-24T18:33:49.109 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-24T18:33:49.477 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-24T18:33:49.530 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-24T18:33:49.853 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-24T18:33:49.931 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-24T18:33:50.304 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-24T18:33:50.366 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-24T18:33:50.656 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-24T18:33:50.826 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-24T18:33:50.978 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:51.098 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-24T18:33:51.381 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:33:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-24T18:33:51.540 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-24T18:33:51.900 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-24T18:33:51.983 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-24T18:33:52.042 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-24T18:33:52.109 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-24T18:33:52.169 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-24T18:33:52.252 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-24T18:33:52.530 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-24T18:33:52.603 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-24T18:33:52.987 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:33:53.039 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-24T18:33:53.113 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-24T18:33:53.239 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-24T18:33:53.427 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-24T18:33:53.649 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-24T18:33:53.886 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-24T18:33:54.008 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-24T18:33:54.355 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-24T18:33:54.418 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-24T18:33:54.481 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:54.536 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-24T18:33:54.888 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-24T18:33:54.890 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:33:55.033 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-24T18:33:55.248 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-24T18:33:55.485 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-24T18:33:55.640 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-24T18:33:55.644 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-24T18:33:55.770 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-24T18:33:56.045 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-24T18:33:56.138 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-24T18:33:56.393 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-24T18:33:56.519 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-24T18:33:56.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:33:56.682 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-24T18:33:56.801 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-24T18:33:56.937 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-24T18:33:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-24T18:33:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-24T18:33:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-24T18:33:57.589 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-24T18:33:57.690 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-24T18:33:57.964 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-24T18:33:58.082 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-24T18:33:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-24T18:33:58.433 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-24T18:33:58.460 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librados2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:33:58.611 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-24T18:33:58.818 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-24T18:33:59.194 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-24T18:33:59.647 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-24T18:33:59.997 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-24T18:34:00.157 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-24T18:34:00.416 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libsqlite3-mod-ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:00.567 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:34:00.605 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-24T18:34:00.693 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-24T18:34:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-24T18:34:01.144 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-24T18:34:01.211 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-24T18:34:01.337 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-24T18:34:01.520 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-24T18:34:01.747 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-24T18:34:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:34:01.997 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-24T18:34:02.108 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:02.232 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-24T18:34:02.432 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:02.574 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-24T18:34:02.968 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libradosstriper1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:03.110 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-24T18:34:03.796 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-24T18:34:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:04.247 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:34:04.374 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-24T18:34:04.833 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-24T18:34:05.025 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librbd1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:05.151 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-24T18:34:05.218 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-24T18:34:05.277 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-24T18:34:05.403 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:34:05.529 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-24T18:34:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-24T18:34:05.704 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-24T18:34:05.938 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-24T18:34:06.080 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-24T18:34:06.122 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-24T18:34:06.575 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-modules-core (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:06.658 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:06.693 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:06.784 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-24T18:34:06.945 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-24T18:34:06.945 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-24T18:34:07.227 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-24T18:34:07.794 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs-dev (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:07.920 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-24T18:34:08.305 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-24T18:34:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:08.706 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-24T18:34:08.717 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-24T18:34:08.843 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-24T18:34:08.969 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-24T18:34:09.128 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-24T18:34:09.176 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rados (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:09.310 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librgw2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:09.486 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-top (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-24T18:34:09.611 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rbd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:09.656 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-24T18:34:09.746 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:09.871 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-24T18:34:10.151 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-24T18:34:10.277 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:10.550 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-24T18:34:10.550 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-24T18:34:10.608 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:10.767 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cephfs (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:10.893 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-shell (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:11.019 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-24T18:34:11.428 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:11.554 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-24T18:34:11.914 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-24T18:34:12.138 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:12.307 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-24T18:34:12.738 INFO:teuthology.orchestra.run.smithi082.stdout:Adding group ceph....done 2023-12-24T18:34:12.777 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:12.911 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:13.037 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:13.186 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user ceph....done 2023-12-24T18:34:13.197 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:13.323 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:13.449 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-24T18:34:13.608 INFO:teuthology.orchestra.run.smithi082.stdout:Setting system user ceph properties....done 2023-12-24T18:34:13.647 INFO:teuthology.orchestra.run.smithi082.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-24T18:34:13.817 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-24T18:34:13.836 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-24T18:34:14.344 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:14.398 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-24T18:34:14.503 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:14.629 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:14.755 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-24T18:34:15.310 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-mirror (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:15.571 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-24T18:34:15.571 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-24T18:34:15.959 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:16.378 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-test (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up radosgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:16.585 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2023-12-24T18:34:16.851 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-24T18:34:16.851 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-24T18:34:17.055 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2023-12-24T18:34:17.312 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2023-12-24T18:34:17.351 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-24T18:34:17.552 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-24T18:34:18.097 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-base (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:18.113 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-24T18:34:18.591 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-24T18:34:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:19.344 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-24T18:34:19.344 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-24T18:34:19.474 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mds (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:19.754 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-24T18:34:19.755 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-24T18:34:20.238 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:20.397 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:20.584 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:20.723 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-24T18:34:20.723 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-24T18:34:20.864 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-24T18:34:20.864 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-24T18:34:21.710 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-osd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:21.974 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:22.489 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-24T18:34:22.489 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-24T18:34:22.521 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-24T18:34:23.320 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-k8sevents (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:23.446 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:23.467 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:23.622 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mon (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:23.753 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-24T18:34:23.754 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-24T18:34:23.953 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-24T18:34:23.953 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-24T18:34:24.703 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:24.791 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:24.942 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:25.002 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-24T18:34:25.002 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-24T18:34:25.068 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-dashboard (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:25.218 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-volume (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:25.346 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-24T18:34:25.522 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-24T18:34:25.888 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:26.015 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-24T18:34:26.708 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-24T18:34:26.708 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-24T18:34:27.672 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:27.799 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:27.966 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:28.225 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-24T18:34:28.225 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-24T18:34:29.109 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:29.319 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:29.445 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:29.588 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (17.2.7-168-g5e7ce129-1focal) ... 2023-12-24T18:34:29.740 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-24T18:34:29.908 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-24T18:34:30.418 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-24T18:34:31.142 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-24T18:34:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-24T18:34:31.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-12-24T18:34:32.008 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-12-24T18:34:32.213 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-12-24T18:34:32.213 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-24T18:34:32.418 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-12-24T18:34:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-24T18:34:32.419 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-24T18:34:32.419 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-12-24T18:34:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-24T18:34:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-12-24T18:34:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-12-24T18:34:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: usb-modeswitch-data wpasupplicant 2023-12-24T18:34:32.425 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-12-24T18:34:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-12-24T18:34:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-12-24T18:34:32.504 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-12-24T18:34:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-24T18:34:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-12-24T18:34:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-24T18:34:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-24T18:34:32.506 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-12-24T18:34:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-24T18:34:32.580 INFO:teuthology.orchestra.run.smithi082.stdout:6 upgraded, 23 newly installed, 0 to remove and 256 not upgraded. 2023-12-24T18:34:32.580 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 10.4 MB of archives. 2023-12-24T18:34:32.580 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-12-24T18:34:32.580 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-24T18:34:32.745 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-24T18:34:32.747 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-24T18:34:32.748 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-24T18:34:32.754 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-24T18:34:32.755 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-24T18:34:32.779 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-24T18:34:32.779 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-24T18:34:32.781 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-24T18:34:32.783 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-24T18:34:32.784 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-24T18:34:32.785 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-24T18:34:32.786 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-24T18:34:32.788 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-24T18:34:32.788 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-24T18:34:32.806 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-24T18:34:32.807 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-24T18:34:32.817 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-24T18:34:32.826 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-24T18:34:32.826 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-24T18:34:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-24T18:34:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-24T18:34:32.856 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-24T18:34:32.869 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-24T18:34:32.888 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-24T18:34:32.891 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-24T18:34:32.892 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-24T18:34:32.892 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-24T18:34:32.893 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-24T18:34:33.328 INFO:teuthology.orchestra.run.smithi082.stdout:Preconfiguring packages ... 2023-12-24T18:34:33.495 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 10.4 MB in 0s (27.6 MB/s) 2023-12-24T18:34:33.847 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:33.852 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:34.530 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:35.838 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-24T18:34:36.074 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-24T18:34:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-24T18:34:36.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-12-24T18:34:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-12-24T18:34:37.007 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-12-24T18:34:37.008 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-24T18:34:37.220 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-12-24T18:34:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-24T18:34:37.221 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-24T18:34:37.221 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-12-24T18:34:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-24T18:34:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-12-24T18:34:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-12-24T18:34:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch-data wpasupplicant 2023-12-24T18:34:37.223 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-12-24T18:34:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-12-24T18:34:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-12-24T18:34:37.314 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-12-24T18:34:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-24T18:34:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-12-24T18:34:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-24T18:34:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-24T18:34:37.316 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-12-24T18:34:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-24T18:34:37.513 INFO:teuthology.orchestra.run.smithi050.stdout:6 upgraded, 23 newly installed, 0 to remove and 256 not upgraded. 2023-12-24T18:34:37.513 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 10.4 MB of archives. 2023-12-24T18:34:37.513 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-12-24T18:34:37.513 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-24T18:34:38.057 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:38.061 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:38.152 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-24T18:34:38.153 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-24T18:34:38.155 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-24T18:34:38.167 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-24T18:34:38.170 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-24T18:34:38.184 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:38.269 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-24T18:34:38.271 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-24T18:34:38.278 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-24T18:34:38.283 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-24T18:34:38.284 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-24T18:34:38.452 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-24T18:34:38.643 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:38.733 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-24T18:34:38.815 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-24T18:34:38.873 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-24T18:34:38.972 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-24T18:34:38.975 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-24T18:34:39.057 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-24T18:34:39.132 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-24T18:34:39.132 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-24T18:34:39.202 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-24T18:34:39.222 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-24T18:34:39.222 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-24T18:34:39.416 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-24T18:34:39.824 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:39.828 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:39.966 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-24T18:34:40.075 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-24T18:34:40.189 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-24T18:34:40.204 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-24T18:34:40.205 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-24T18:34:40.206 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-24T18:34:40.208 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-24T18:34:40.526 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:40.663 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-24T18:34:40.688 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2023-12-24T18:34:41.041 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 10.4 MB in 3s (3,618 kB/s) 2023-12-24T18:34:41.223 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-24T18:34:41.351 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-24T18:34:41.380 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:41.383 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:41.562 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:41.872 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-24T18:34:41.894 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-24T18:34:41.947 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-24T18:34:42.342 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package dump. 2023-12-24T18:34:42.363 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-24T18:34:42.408 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking dump (0.4b46-6) ... 2023-12-24T18:34:42.762 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package indent. 2023-12-24T18:34:42.784 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:34:42.828 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-24T18:34:43.165 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-24T18:34:43.187 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-24T18:34:43.231 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-24T18:34:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-24T18:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-24T18:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-24T18:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-24T18:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-24T18:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-24T18:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:34:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-24T18:34:45.191 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:45.235 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:34:45.345 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:45.348 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:45.501 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:45.613 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-24T18:34:45.635 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:45.679 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:34:45.976 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-24T18:34:46.108 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-24T18:34:46.129 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-24T18:34:46.140 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-24T18:34:46.174 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-24T18:34:46.519 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-24T18:34:46.538 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-24T18:34:46.539 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-24T18:34:46.585 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:46.988 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-24T18:34:47.010 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:47.054 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:34:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118685 files and directories currently installed.) 2023-12-24T18:34:47.083 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:47.256 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-24T18:34:47.424 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-24T18:34:47.446 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:47.490 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:34:47.768 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-24T18:34:47.775 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:47.790 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-24T18:34:47.834 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:34:47.919 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-24T18:34:48.388 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-24T18:34:48.410 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-12-24T18:34:48.454 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-24T18:34:48.466 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-24T18:34:48.632 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-24T18:34:48.883 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package modemmanager. 2023-12-24T18:34:48.906 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:34:49.187 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-24T18:34:49.207 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-24T18:34:49.245 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-24T18:34:49.648 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2023-12-24T18:34:49.670 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-24T18:34:49.681 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package wpasupplicant. 2023-12-24T18:34:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-24T18:34:49.714 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b46-6) ... 2023-12-24T18:34:49.756 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-24T18:34:50.294 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager. 2023-12-24T18:34:50.317 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-24T18:34:50.386 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2023-12-24T18:34:50.405 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-24T18:34:50.410 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:50.444 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-24T18:34:50.814 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-24T18:34:50.837 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-24T18:34:50.880 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-24T18:34:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ppp. 2023-12-24T18:34:51.222 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-24T18:34:51.276 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-24T18:34:51.295 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-24T18:34:51.333 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-24T18:34:51.674 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-24T18:34:51.683 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-24T18:34:51.704 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-24T18:34:51.753 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:34:52.089 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package pptp-linux. 2023-12-24T18:34:52.112 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-24T18:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-24T18:34:52.181 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-24T18:34:52.206 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:52.247 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:34:52.543 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-24T18:34:52.561 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-24T18:34:52.584 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-24T18:34:52.604 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-24T18:34:52.642 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:34:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-24T18:34:52.941 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-24T18:34:52.986 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-24T18:34:53.036 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-24T18:34:53.051 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:53.094 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:34:53.432 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-24T18:34:53.454 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-24T18:34:53.514 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-24T18:34:53.518 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-24T18:34:53.534 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-24T18:34:53.572 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-24T18:34:53.888 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:34:53.967 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-24T18:34:53.990 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-24T18:34:54.033 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:54.278 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-24T18:34:54.430 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-24T18:34:54.470 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-24T18:34:54.492 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:54.536 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:34:54.565 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-24T18:34:54.931 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-24T18:34:54.958 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:54.992 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-24T18:34:54.992 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-24T18:34:54.997 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:34:55.300 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-24T18:34:55.319 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-24T18:34:55.374 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:34:55.867 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-24T18:34:55.911 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-24T18:34:55.936 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-12-24T18:34:55.978 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-24T18:34:55.993 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-24T18:34:56.119 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:34:56.270 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-24T18:34:56.396 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2023-12-24T18:34:56.439 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-24T18:34:56.505 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:34:56.522 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-24T18:34:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2023-12-24T18:34:57.234 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-24T18:34:57.287 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-24T18:34:57.747 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-24T18:34:57.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2023-12-24T18:34:57.906 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-24T18:34:58.018 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:58.186 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up dump (0.4b46-6) ... 2023-12-24T18:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-24T18:34:58.363 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:34:58.489 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-24T18:34:58.615 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-24T18:34:58.741 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-24T18:34:58.858 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2023-12-24T18:34:58.877 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-24T18:34:58.951 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-24T18:34:59.077 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:34:59.203 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:34:59.329 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-24T18:34:59.373 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-24T18:34:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:34:59.657 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-24T18:34:59.805 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2023-12-24T18:34:59.827 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-24T18:34:59.871 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-24T18:35:00.283 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-24T18:35:00.305 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-24T18:35:00.388 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-24T18:35:00.727 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-24T18:35:00.750 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-24T18:35:00.793 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-24T18:35:00.827 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:00.827 INFO:teuthology.orchestra.run.smithi082.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-24T18:35:00.827 INFO:teuthology.orchestra.run.smithi082.stdout:which means they are currently configured by ifupdown: 2023-12-24T18:35:00.828 INFO:teuthology.orchestra.run.smithi082.stdout:- enp3s0f1 2023-12-24T18:35:00.828 INFO:teuthology.orchestra.run.smithi082.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-24T18:35:00.828 INFO:teuthology.orchestra.run.smithi082.stdout:remove their configuration from /etc/network/interfaces. 2023-12-24T18:35:00.828 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-24T18:35:01.247 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-24T18:35:01.269 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-24T18:35:01.338 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-24T18:35:01.579 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-24T18:35:01.709 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:35:02.086 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-24T18:35:02.195 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-24T18:35:02.321 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-24T18:35:02.507 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-24T18:35:02.810 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-24T18:35:02.811 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-24T18:35:03.418 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:35:03.560 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-24T18:35:03.720 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:35:03.771 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-24T18:35:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:35:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-24T18:35:03.989 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:35:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-24T18:35:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:35:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-24T18:35:04.311 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-24T18:35:04.430 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-24T18:35:04.430 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-24T18:35:04.445 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-24T18:35:05.706 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-24T18:35:05.959 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-24T18:35:06.077 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-24T18:35:06.143 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b46-6) ... 2023-12-24T18:35:06.211 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-24T18:35:06.250 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-24T18:35:06.320 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:35:06.379 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-24T18:35:06.480 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-24T18:35:06.606 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-24T18:35:06.740 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-24T18:35:06.831 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-24T18:35:06.950 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-24T18:35:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:35:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:35:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-24T18:35:07.546 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:35:07.672 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2023-12-24T18:35:08.920 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:09.168 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-24T18:35:09.770 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-24T18:35:10.701 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-24T18:35:11.700 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-24T18:35:11.860 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-24T18:35:12.019 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-24T18:35:12.154 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:35:12.305 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-24T18:35:12.481 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-24T18:35:12.808 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-24T18:35:12.808 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-24T18:35:13.800 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-24T18:35:13.910 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-24T18:35:13.957 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-24T18:35:14.074 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-24T18:35:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-24T18:35:14.237 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-24T18:35:14.747 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-24T18:35:15.345 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-24T18:35:15.352 DEBUG:teuthology.parallel:result is None 2023-12-24T18:35:21.758 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-24T18:35:21.866 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-24T18:35:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-24T18:35:23.126 DEBUG:teuthology.parallel:result is None 2023-12-24T18:35:23.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T18:35:23.405 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2023-12-24T18:35:23.444 INFO:teuthology.orchestra.run.smithi050.stdout:17.2.7-168-g5e7ce129-1focal 2023-12-24T18:35:23.445 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-168-g5e7ce129-1focal 2023-12-24T18:35:23.445 INFO:teuthology.task.install:The correct ceph version 17.2.7-168-g5e7ce129-1focal is installed. 2023-12-24T18:35:23.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T18:35:23.774 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-query -W -f '${Version}' ceph 2023-12-24T18:35:23.812 INFO:teuthology.orchestra.run.smithi082.stdout:17.2.7-168-g5e7ce129-1focal 2023-12-24T18:35:23.813 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-168-g5e7ce129-1focal 2023-12-24T18:35:23.813 INFO:teuthology.task.install:The correct ceph version 17.2.7-168-g5e7ce129-1focal is installed. 2023-12-24T18:35:23.815 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-24T18:35:23.815 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:23.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-24T18:35:23.852 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:23.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-24T18:35:23.890 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-24T18:35:23.890 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:23.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-12-24T18:35:23.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-24T18:35:24.003 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:24.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-12-24T18:35:24.038 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-24T18:35:24.118 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-24T18:35:24.118 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:24.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-24T18:35:24.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-24T18:35:24.236 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:24.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-24T18:35:24.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-24T18:35:24.350 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-24T18:35:24.351 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:24.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-12-24T18:35:24.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-24T18:35:24.472 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:24.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2023-12-24T18:35:24.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-24T18:35:24.579 INFO:teuthology.run_tasks:Running task ceph... 2023-12-24T18:35:24.653 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-24T18:35:24.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-12-24T18:35:24.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2023-12-24T18:35:24.695 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-24T18:35:24.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-24T18:35:24.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-24T18:35:24.772 INFO:tasks.ceph:Creating extra log directories... 2023-12-24T18:35:24.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-24T18:35:24.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-24T18:35:24.856 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-24T18:35:24.857 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-24T18:35:24.857 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-24T18:35:24.857 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:24.857 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-24T18:35:24.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-24T18:35:25.039 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:25.039 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-24T18:35:25.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-24T18:35:25.199 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-24T18:35:25.199 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-24T18:35:25.199 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316', 'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7500316', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9956, 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'sleep_before_teardown': 0, 'subset': '908/1024', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-24_15:41:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-24T18:35:25.200 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-24T18:35:25.207 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-24T18:35:25.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-12-24T18:35:25.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2023-12-24T18:35:25.310 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:25.311 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-12-24T18:35:25.364 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-24T18:35:25.364 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-12-24T18:35:25.424 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-24 18:30:05.488165297 +0000 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-24 18:30:05.484165389 +0000 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-24 18:30:05.484165389 +0000 2023-12-24T18:35:25.425 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-12-24T18:35:25.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-24T18:35:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-24T18:35:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-24T18:35:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000595851 s, 859 kB/s 2023-12-24T18:35:25.505 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-24T18:35:25.572 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-12-24T18:35:25.632 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-24T18:35:25.632 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:25.632 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-12-24T18:35:25.633 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:25.633 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-24 18:30:06.752136148 +0000 2023-12-24T18:35:25.633 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-24 18:30:06.248147771 +0000 2023-12-24T18:35:25.633 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-24 18:30:06.248147771 +0000 2023-12-24T18:35:25.633 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-12-24T18:35:25.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-24T18:35:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-24T18:35:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-24T18:35:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000588697 s, 870 kB/s 2023-12-24T18:35:25.711 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-24T18:35:25.779 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-12-24T18:35:25.842 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-24 18:30:07.524118344 +0000 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-24 18:30:07.020129967 +0000 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-24 18:30:07.020129967 +0000 2023-12-24T18:35:25.843 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-12-24T18:35:25.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-24T18:35:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-24T18:35:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-24T18:35:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000584283 s, 876 kB/s 2023-12-24T18:35:25.923 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-24T18:35:25.989 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-24 18:30:08.436097312 +0000 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-24 18:30:07.948108566 +0000 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-24 18:30:07.948108566 +0000 2023-12-24T18:35:26.051 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-12-24T18:35:26.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-24T18:35:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-24T18:35:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-24T18:35:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000601981 s, 851 kB/s 2023-12-24T18:35:26.130 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-24T18:35:26.199 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:26.199 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:26.199 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-12-24T18:35:26.220 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-24T18:35:26.221 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-12-24 18:30:01.233170835 +0000 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-12-24 18:30:01.229170568 +0000 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-12-24 18:30:01.229170568 +0000 2023-12-24T18:35:26.283 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-12-24T18:35:26.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-24T18:35:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-12-24T18:35:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-12-24T18:35:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000683508 s, 749 kB/s 2023-12-24T18:35:26.365 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-24T18:35:26.433 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-12-24T18:35:26.496 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-24T18:35:26.496 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-12-24 18:30:02.489252959 +0000 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-12-24 18:30:02.017223252 +0000 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-12-24 18:30:02.017223252 +0000 2023-12-24T18:35:26.497 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-12-24T18:35:26.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-24T18:35:26.570 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-12-24T18:35:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-12-24T18:35:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000700445 s, 731 kB/s 2023-12-24T18:35:26.573 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-24T18:35:26.647 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-12-24 18:30:03.261301027 +0000 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-12-24 18:30:02.781271338 +0000 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-12-24 18:30:02.781271338 +0000 2023-12-24T18:35:26.707 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-12-24T18:35:26.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-24T18:35:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-12-24T18:35:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-12-24T18:35:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000696985 s, 735 kB/s 2023-12-24T18:35:26.783 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-24T18:35:26.852 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 518 Links: 1 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-12-24 18:30:04.025346941 +0000 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-12-24 18:30:03.557319065 +0000 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-12-24 18:30:03.557319065 +0000 2023-12-24T18:35:26.911 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-12-24T18:35:26.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-24T18:35:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-12-24T18:35:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-12-24T18:35:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000667729 s, 767 kB/s 2023-12-24T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-24T18:35:27.056 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:27.056 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-24T18:35:27.056 INFO:tasks.ceph:Generating config... 2023-12-24T18:35:27.057 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-24T18:35:27.057 INFO:tasks.ceph:[client] debug client = 20 2023-12-24T18:35:27.058 INFO:tasks.ceph:[client] debug ms = 1 2023-12-24T18:35:27.058 INFO:tasks.ceph:[client] pid file = 2023-12-24T18:35:27.058 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-24T18:35:27.058 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-24T18:35:27.058 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-24T18:35:27.058 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mgr] debug client = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-24T18:35:27.059 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-24T18:35:27.060 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-24T18:35:27.060 INFO:tasks.ceph:Setting up mon.a... 2023-12-24T18:35:27.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-24T18:35:27.116 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-12-24T18:35:27.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-24T18:35:27.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T18:35:27.226 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.82'), ('mon.c', '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]')] 2023-12-24T18:35:27.226 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-24T18:35:27.227 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:27.227 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-24T18:35:27.287 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.82 --addv c '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:27.391 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 9cd325ac-a2d2-4a61-9c13-57b4146a16d9 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = octopus 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 9cd325ac-a2d2-4a61-9c13-57b4146a16d9 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-12-24T18:35:27.394809+0000 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-12-24T18:35:27.394809+0000 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 15 (octopus) 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-12-24T18:35:27.392 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2023-12-24T18:35:27.393 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] mon.c 2023-12-24T18:35:27.393 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-24T18:35:27.394 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-24T18:35:27.412 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9cd325ac-a2d2-4a61-9c13-57b4146a16d9... 2023-12-24T18:35:27.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-24T18:35:27.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.533 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.535 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 9cd325ac-a2d2-4a61-9c13-57b4146a16d9 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-12-24T18:35:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.537 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-24T18:35:27.538 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-24T18:35:27.539 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug finisher = 20 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-12-24T18:35:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-12-24T18:35:27.541 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-12-24T18:35:27.542 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-12-24T18:35:27.543 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.544 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2023-12-24T18:35:27.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.546 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.50,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 9cd325ac-a2d2-4a61-9c13-57b4146a16d9 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2023-12-24T18:35:27.547 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.548 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-12-24T18:35:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-12-24T18:35:27.550 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug finisher = 20 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-12-24T18:35:27.551 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2023-12-24T18:35:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-12-24T18:35:27.553 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2023-12-24T18:35:27.554 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2023-12-24T18:35:27.555 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2023-12-24T18:35:27.555 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-12-24T18:35:27.555 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-12-24T18:35:27.555 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-12-24T18:35:27.568 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-24T18:35:27.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-24T18:35:27.653 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-24T18:35:27.654 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:27.654 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-24T18:35:27.670 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:27.670 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-24T18:35:27.735 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:35:27.735 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:27.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-24T18:35:27.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T18:35:27.840 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:27.841 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:27.903 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:35:27.903 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:27.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-24T18:35:27.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T18:35:27.964 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:35:27.964 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:28.023 INFO:tasks.ceph:Setting up mon nodes... 2023-12-24T18:35:28.023 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-24T18:35:28.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-24T18:35:28.115 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-24T18:35:28.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-24T18:35:28.212 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-24T18:35:28.220 INFO:tasks.ceph:Setting up mds nodes... 2023-12-24T18:35:28.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-24T18:35:28.311 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-24T18:35:28.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-24T18:35:28.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-24T18:35:28.487 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-24T18:35:28.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-24T18:35:28.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-24T18:35:28.617 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-24T18:35:28.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-24T18:35:28.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-24T18:35:28.796 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-24T18:35:28.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-24T18:35:28.834 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-24T18:35:28.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-24T18:35:28.902 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-24T18:35:28.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-24T18:35:28.999 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-24T18:35:29.029 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-24T18:35:29.096 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-24T18:35:29.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-24T18:35:29.189 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-24T18:35:29.217 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-24T18:35:29.217 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-24T18:35:29.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-24T18:35:29.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:29.256 INFO:tasks.ceph:role: osd.0 2023-12-24T18:35:29.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:35:29.256 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-24T18:35:29.363 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:29.364 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:29.365 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:29.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-24T18:35:29.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-24T18:35:29.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-24T18:35:29.483 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:29.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:29.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-24T18:35:29.565 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:29.566 INFO:tasks.ceph:role: osd.1 2023-12-24T18:35:29.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:35:29.566 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-24T18:35:29.679 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:29.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-24T18:35:29.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-24T18:35:29.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-24T18:35:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:29.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:29.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-24T18:35:29.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:29.877 INFO:tasks.ceph:role: osd.2 2023-12-24T18:35:29.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:35:29.877 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:29.997 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:29.998 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:29.998 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:29.998 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:29.998 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:30.002 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-24T18:35:30.002 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-24T18:35:30.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-24T18:35:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:30.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:30.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-24T18:35:30.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:30.189 INFO:tasks.ceph:role: osd.3 2023-12-24T18:35:30.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:35:30.190 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-24T18:35:30.303 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:30.304 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:30.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-24T18:35:30.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-24T18:35:30.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-24T18:35:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:30.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:30.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.575+0000 7fb1c09473c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-24T18:35:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.575+0000 7fb1c09473c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-24T18:35:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.575+0000 7fb1c09473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-24T18:35:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.575+0000 7fb1c09473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-24T18:35:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.575+0000 7fb1c09473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-24T18:35:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:30.579+0000 7fb1c09473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-24T18:35:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:31.151+0000 7fb1c09473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:31.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:31.943+0000 7fb1c09473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:32.735+0000 7fb1c09473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:33.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-24T18:35:33.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:33.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.799+0000 7fe0a98633c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-24T18:35:33.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.803+0000 7fe0a98633c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-24T18:35:33.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.803+0000 7fe0a98633c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-24T18:35:33.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.803+0000 7fe0a98633c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-24T18:35:33.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.803+0000 7fe0a98633c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-24T18:35:33.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:33.803+0000 7fe0a98633c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-24T18:35:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:34.395+0000 7fe0a98633c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:35.179+0000 7fe0a98633c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:35.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:35.967+0000 7fe0a98633c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:36.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-24T18:35:36.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.019+0000 7f0296f1b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-24T18:35:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.023+0000 7f0296f1b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-24T18:35:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.023+0000 7f0296f1b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-24T18:35:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.023+0000 7f0296f1b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-24T18:35:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.023+0000 7f0296f1b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-24T18:35:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.023+0000 7f0296f1b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-24T18:35:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:37.598+0000 7f0296f1b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:38.390+0000 7f0296f1b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:39.190+0000 7f0296f1b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:40.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-24T18:35:40.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:40.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.238+0000 7f4b71f4f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-24T18:35:40.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.238+0000 7f4b71f4f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-24T18:35:40.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.238+0000 7f4b71f4f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-24T18:35:40.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.238+0000 7f4b71f4f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-24T18:35:40.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.238+0000 7f4b71f4f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-24T18:35:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.242+0000 7f4b71f4f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-24T18:35:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:40.810+0000 7f4b71f4f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:41.602+0000 7f4b71f4f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:42.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:35:42.390+0000 7f4b71f4f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:43.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-24T18:35:43.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-24T18:35:43.361 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:43.362 INFO:tasks.ceph:role: osd.4 2023-12-24T18:35:43.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:35:43.362 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-24T18:35:43.960 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:43.961 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:43.962 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:43.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-12-24T18:35:43.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-24T18:35:44.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-24T18:35:44.122 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:44.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:44.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-24T18:35:44.209 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:44.209 INFO:tasks.ceph:role: osd.5 2023-12-24T18:35:44.209 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:35:44.209 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-24T18:35:44.723 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:44.724 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:44.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-12-24T18:35:44.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-24T18:35:44.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-24T18:35:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:44.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:44.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-24T18:35:44.895 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:44.895 INFO:tasks.ceph:role: osd.6 2023-12-24T18:35:44.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:35:44.895 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-24T18:35:45.452 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:45.453 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:45.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-12-24T18:35:45.458 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-24T18:35:45.637 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-24T18:35:45.659 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:45.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:45.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-24T18:35:45.740 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T18:35:45.741 INFO:tasks.ceph:role: osd.7 2023-12-24T18:35:45.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:35:45.741 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-24T18:35:46.335 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T18:35:46.336 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T18:35:46.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-12-24T18:35:46.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-24T18:35:46.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-24T18:35:46.488 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-12-24T18:35:46.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:35:46.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:46.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.718+0000 7f26e24e73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-24T18:35:46.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.722+0000 7f26e24e73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-24T18:35:46.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.722+0000 7f26e24e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-24T18:35:46.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.722+0000 7f26e24e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-24T18:35:46.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.722+0000 7f26e24e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-24T18:35:46.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:46.722+0000 7f26e24e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-24T18:35:47.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:47.298+0000 7f26e24e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:48.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:48.086+0000 7f26e24e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:48.882+0000 7f26e24e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:49.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-24T18:35:49.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:49.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.922+0000 7ff2e4b933c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-24T18:35:49.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.926+0000 7ff2e4b933c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-24T18:35:49.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.926+0000 7ff2e4b933c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-24T18:35:49.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.926+0000 7ff2e4b933c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-24T18:35:49.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.926+0000 7ff2e4b933c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-24T18:35:49.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:49.926+0000 7ff2e4b933c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-24T18:35:50.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:50.498+0000 7ff2e4b933c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:51.290+0000 7ff2e4b933c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:52.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:52.082+0000 7ff2e4b933c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:52.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-24T18:35:53.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:53.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.134+0000 7f899b4da3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-24T18:35:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.134+0000 7f899b4da3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-24T18:35:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.134+0000 7f899b4da3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-24T18:35:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.134+0000 7f899b4da3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-24T18:35:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.134+0000 7f899b4da3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-24T18:35:53.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.138+0000 7f899b4da3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-24T18:35:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:53.706+0000 7f899b4da3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:54.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:54.514+0000 7f899b4da3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:55.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:35:55.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:35:55.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:55.326+0000 7f899b4da3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:56.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-24T18:35:56.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:35:56.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.406+0000 7f0c3ccef3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-24T18:35:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.410+0000 7f0c3ccef3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-24T18:35:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.410+0000 7f0c3ccef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-24T18:35:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.410+0000 7f0c3ccef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-24T18:35:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.410+0000 7f0c3ccef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-24T18:35:56.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.410+0000 7f0c3ccef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-24T18:35:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:56.982+0000 7f0c3ccef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:57.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:57.770+0000 7f0c3ccef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:58.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:35:58.562+0000 7f0c3ccef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-12-24T18:35:59.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-24T18:35:59.505 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-24T18:35:59.506 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-24T18:35:59.547 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-24T18:35:59.625 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-24T18:35:59.704 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-24T18:35:59.782 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-24T18:35:59.861 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-24T18:35:59.942 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:35:59.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-24T18:36:00.021 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-24T18:36:00.056 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-24T18:36:00.138 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-24T18:36:00.214 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-24T18:36:00.294 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-24T18:36:00.372 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-24T18:36:00.446 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-24T18:36:00.525 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:00.525 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-24T18:36:00.538 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:00.539 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-24T18:36:00.604 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.604 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-24T18:36:00.624 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:00.624 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-24T18:36:00.682 INFO:tasks.ceph:Adding keys to all mons... 2023-12-24T18:36:00.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-24T18:36:00.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw== 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ== 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ== 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ== 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ== 2023-12-24T18:36:00.733 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg== 2023-12-24T18:36:00.734 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ== 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g== 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg== 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw== 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA== 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-12-24T18:36:00.735 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw== 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw== 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ== 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ== 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2023-12-24T18:36:00.759 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw== 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2023-12-24T18:36:00.760 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA== 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2023-12-24T18:36:00.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw== 2023-12-24T18:36:00.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T18:36:00.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T18:36:00.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:00.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:00.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:00.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:01.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T18:36:01.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T18:36:01.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:01.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:01.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:01.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T18:36:01.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T18:36:01.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:01.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.053 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T18:36:02.297 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-24T18:36:02.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-24T18:36:02.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T18:36:02.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-24T18:36:02.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-24T18:36:02.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T18:36:02.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-24T18:36:02.718 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-24T18:36:02.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T18:36:02.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-24T18:36:02.969 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:36:02.974 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-24T18:36:03.031 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-24T18:36:03.031 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-24T18:36:03.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-24T18:36:03.039 INFO:tasks.ceph.mon.a:Started 2023-12-24T18:36:03.039 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-24T18:36:03.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-24T18:36:03.080 INFO:tasks.ceph.mon.b:Started 2023-12-24T18:36:03.080 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-24T18:36:03.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-24T18:36:03.085 INFO:tasks.ceph.mon.c:Started 2023-12-24T18:36:03.085 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-24T18:36:03.085 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-24T18:36:03.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-24T18:36:03.093 INFO:tasks.ceph.mgr.y:Started 2023-12-24T18:36:03.093 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-24T18:36:03.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-24T18:36:03.099 INFO:tasks.ceph.mgr.x:Started 2023-12-24T18:36:03.099 INFO:tasks.ceph:Setting crush tunables to default 2023-12-24T18:36:03.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-12-24T18:36:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.249+0000 7f2fc0eae700 1 Processor -- start 2023-12-24T18:36:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.249+0000 7f2fc0eae700 1 -- start start 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc15d5b0 con 0x7f2fbc15d180 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0cbee0 con 0x7f2fbc159080 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fc0eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc06cb50 con 0x7f2fbc06dbf0 2023-12-24T18:36:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57310/0 (socket says 172.21.15.50:57310) 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 learned_addr learned my addr 172.21.15.50:0/2831038796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fba59c700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 msgr2=0x7f2fbc067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 msgr2=0x7f2fbc067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T18:36:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 msgr2=0x7f2fbc15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 msgr2=0x7f2fbc15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fba59c700 1 -- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 msgr2=0x7f2fbc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fba59c700 1 -- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 msgr2=0x7f2fbc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fba59c700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T18:36:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.253+0000 7f2fba59c700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.50:3300/0 conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fba59c700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 msgr2=0x7f2fbc15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 msgr2=0x7f2fbc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 -- 172.21.15.50:0/2831038796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc06ce30 con 0x7f2fbc15d180 2023-12-24T18:36:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fba59c700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc15d180 0x7f2fbc067440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06bd70 tx=0x7f2fb40091c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e923b284aa6736 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fb959a700 1 -- 172.21.15.50:0/2831038796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4007ba0 con 0x7f2fbc15d180 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fb959a700 1 -- 172.21.15.50:0/2831038796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400f040 con 0x7f2fbc15d180 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.457+0000 7f2fb959a700 1 -- 172.21.15.50:0/2831038796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4013430 con 0x7f2fbc15d180 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2831038796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc15d180 msgr2=0x7f2fbc067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc15d180 0x7f2fbc067440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06bd70 tx=0x7f2fb40091c0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2831038796 shutdown_connections 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc15d180 0x7f2fbc067440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2831038796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc06dbf0 0x7f2fbc15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2831038796 >> v2:172.21.15.82:3300/0 conn(0x7f2fbc159080 0x7f2fbc0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2831038796 >> 172.21.15.50:0/2831038796 conn(0x7f2fbc0cddd0 msgr2=0x7f2fbc0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2831038796 shutdown_connections 2023-12-24T18:36:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.461+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2831038796 wait complete. 2023-12-24T18:36:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 Processor -- start 2023-12-24T18:36:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 -- start start 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc06dbf0 0x7f2fbc150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc15d180 0x7f2fbc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc154810 con 0x7f2fbc159080 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc154af0 con 0x7f2fbc06dbf0 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.465+0000 7f2fc0eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc154dd0 con 0x7f2fbc15d180 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fba59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc06dbf0 0x7f2fbc150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57342/0 (socket says 172.21.15.50:57342) 2023-12-24T18:36:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2238033849 learned_addr learned my addr 172.21.15.50:0/2238033849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fbad9d700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc15d180 0x7f2fbc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc15d180 msgr2=0x7f2fbc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc15d180 0x7f2fbc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc06dbf0 msgr2=0x7f2fbc150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc06dbf0 0x7f2fbc150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 -- 172.21.15.50:0/2238033849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4009760 con 0x7f2fbc159080 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fb9d9b700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0010ab0 tx=0x7f2fb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000e8d0 con 0x7f2fbc159080 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000ea50 con 0x7f2fbc159080 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000ee10 con 0x7f2fbc159080 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc1550b0 con 0x7f2fbc159080 2023-12-24T18:36:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0b0d50 con 0x7f2fbc159080 2023-12-24T18:36:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2fb0014640 con 0x7f2fbc159080 2023-12-24T18:36:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.469+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2fb001d7e0 con 0x7f2fbc159080 2023-12-24T18:36:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.473+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc0b0fd0 con 0x7f2fbc159080 2023-12-24T18:36:03.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.473+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2fb0022060 con 0x7f2fbc159080 2023-12-24T18:36:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.561+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2fbc0652e0 con 0x7f2fbc159080 2023-12-24T18:36:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.565+0000 7f2faa7fc700 1 -- 172.21.15.50:0/2238033849 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2fb0018070 con 0x7f2fbc159080 2023-12-24T18:36:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 msgr2=0x7f2fbc153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0010ab0 tx=0x7f2fb0008040 comp rx=0 tx=0).stop 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 shutdown_connections 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2fbc15d180 0x7f2fbc15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fbc159080 0x7f2fbc153fe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 --2- 172.21.15.50:0/2238033849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc06dbf0 0x7f2fbc150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 >> 172.21.15.50:0/2238033849 conn(0x7f2fbc0cddd0 msgr2=0x7f2fbc0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 shutdown_connections 2023-12-24T18:36:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:03.569+0000 7f2fc0eae700 1 -- 172.21.15.50:0/2238033849 wait complete. 2023-12-24T18:36:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-12-24T18:36:03.590 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-24T18:36:03.590 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:03.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-24T18:36:03.621 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:03.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-24T18:36:03.667 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:03.662+0000 7f5f47ce8000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:36:03.671 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:03.665+0000 7f11f92e2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:36:03.694 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:03.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-24T18:36:03.772 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-24T18:36:03.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-24T18:36:03.848 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:03.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-24T18:36:03.881 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:03.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-24T18:36:03.957 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:03.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-24T18:36:04.036 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-12-24T18:36:04.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-24T18:36:04.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 4b1f4737-ad2e-425a-acb5-50b6e3888baf 0 2023-12-24T18:36:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.302+0000 7f6e474f0700 1 Processor -- start 2023-12-24T18:36:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.302+0000 7f6e474f0700 1 -- start start 2023-12-24T18:36:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e474f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e474f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e400cbff0 0x7f6e4015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e474f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e400cd290 con 0x7f6e400acf70 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e474f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e400cc470 con 0x7f6e400cbff0 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e474f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400cc680 con 0x7f6e400ad340 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e44a8b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e4528c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e400acf70 0x7f6e400c8f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:55930/0 (socket says 172.21.15.82:55930) 2023-12-24T18:36:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e44a8b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42540/0 (socket says 172.21.15.82:42540) 2023-12-24T18:36:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e4528c700 1 -- 172.21.15.82:0/657886422 learned_addr learned my addr 172.21.15.82:0/657886422 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-12-24T18:36:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.306+0000 7f6e45a8d700 1 --2- 172.21.15.82:0/657886422 >> v2:172.21.15.82:3300/0 conn(0x7f6e400cbff0 0x7f6e4015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e37fff700 1 -- 172.21.15.82:0/657886422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178028542 0 0) 0x7f6e400cd290 con 0x7f6e400acf70 2023-12-24T18:36:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e44a8b700 1 -- 172.21.15.82:0/657886422 >> v2:172.21.15.82:3300/0 conn(0x7f6e400cbff0 msgr2=0x7f6e4015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e44a8b700 1 --2- 172.21.15.82:0/657886422 >> v2:172.21.15.82:3300/0 conn(0x7f6e400cbff0 0x7f6e4015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e44a8b700 1 -- 172.21.15.82:0/657886422 >> v1:172.21.15.50:6789/0 conn(0x7f6e400acf70 legacy=0x7f6e400c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e44a8b700 1 -- 172.21.15.82:0/657886422 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400cc960 con 0x7f6e400ad340 2023-12-24T18:36:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e44a8b700 1 --2- 172.21.15.82:0/657886422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098e0 tx=0x7f6e300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2f58a37e0e1b0f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e37fff700 1 -- 172.21.15.82:0/657886422 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000b640 con 0x7f6e400ad340 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e37fff700 1 -- 172.21.15.82:0/657886422 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000b7a0 con 0x7f6e400ad340 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e37fff700 1 -- 172.21.15.82:0/657886422 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000bb40 con 0x7f6e400ad340 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 -- 172.21.15.82:0/657886422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 msgr2=0x7f6e400cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 --2- 172.21.15.82:0/657886422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098e0 tx=0x7f6e300091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 -- 172.21.15.82:0/657886422 shutdown_connections 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 --2- 172.21.15.82:0/657886422 >> v2:172.21.15.82:3300/0 conn(0x7f6e400cbff0 0x7f6e4015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 --2- 172.21.15.82:0/657886422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400ad340 0x7f6e400cd720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 -- 172.21.15.82:0/657886422 >> 172.21.15.82:0/657886422 conn(0x7f6e400cddd0 msgr2=0x7f6e400ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 -- 172.21.15.82:0/657886422 shutdown_connections 2023-12-24T18:36:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.310+0000 7f6e474f0700 1 -- 172.21.15.82:0/657886422 wait complete. 2023-12-24T18:36:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.314+0000 7f6e474f0700 1 Processor -- start 2023-12-24T18:36:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.314+0000 7f6e474f0700 1 -- start start 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 0x7f6e400b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 0x7f6e40157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b38d0 con 0x7f6e400cbff0 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b2a10 con 0x7f6e400ad340 2023-12-24T18:36:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b2cc0 con 0x7f6e400acf70 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e4528c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 0x7f6e400b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55920/0 (socket says 172.21.15.82:55920) 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 -- 172.21.15.82:0/2330064832 learned_addr learned my addr 172.21.15.82:0/2330064832 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e45a8d700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 0x7f6e40157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 -- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 msgr2=0x7f6e400b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 0x7f6e400b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 -- 172.21.15.82:0/2330064832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 msgr2=0x7f6e40157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 0x7f6e40157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 -- 172.21.15.82:0/2330064832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009420 con 0x7f6e400ad340 2023-12-24T18:36:04.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e45a8d700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 0x7f6e40157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:04.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e4528c700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 0x7f6e400b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e44a8b700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e4006b920 tx=0x7f6e30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30000d10 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000bb20 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400b2fa0 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011670 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400b3560 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6e30011ca0 con 0x7f6e400ad340 2023-12-24T18:36:04.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.318+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6e30025c90 con 0x7f6e400ad340 2023-12-24T18:36:04.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.322+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400b3a40 con 0x7f6e400ad340 2023-12-24T18:36:04.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.326+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6e30029070 con 0x7f6e400ad340 2023-12-24T18:36:04.390 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:04.385+0000 7f11f92e2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:36:04.410 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:04.406+0000 7f5f47ce8000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:36:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.406+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4b1f4737-ad2e-425a-acb5-50b6e3888baf", "id": 0} v 0) v1 -- 0x7f6e400652e0 con 0x7f6e400ad340 2023-12-24T18:36:04.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e357fa700 1 -- 172.21.15.82:0/2330064832 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b1f4737-ad2e-425a-acb5-50b6e3888baf", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e30015020 con 0x7f6e400ad340 2023-12-24T18:36:04.419 INFO:teuthology.orchestra.run.smithi082.stdout:0 2023-12-24T18:36:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 msgr2=0x7f6e400b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e4006b920 tx=0x7f6e30017000 comp rx=0 tx=0).stop 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 shutdown_connections 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e400cbff0 0x7f6e40157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e400ad340 0x7f6e400b24d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 --2- 172.21.15.82:0/2330064832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e400acf70 0x7f6e400b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 >> 172.21.15.82:0/2330064832 conn(0x7f6e400cddd0 msgr2=0x7f6e400afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 shutdown_connections 2023-12-24T18:36:04.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.414+0000 7f6e474f0700 1 -- 172.21.15.82:0/2330064832 wait complete. 2023-12-24T18:36:04.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 324c1fe4-655d-4221-9b97-22c510207efc 1 2023-12-24T18:36:04.472 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:04.469+0000 7f11f92e2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:36:04.493 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:04.490+0000 7f5f47ce8000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:36:04.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.582+0000 7f3a5e4e3700 1 Processor -- start 2023-12-24T18:36:04.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.582+0000 7f3a5e4e3700 1 -- start start 2023-12-24T18:36:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5e4e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a58153780 0x7f3a58156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5e4e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a580ae6b0 0x7f3a580af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5e4e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a580afaa0 con 0x7f3a580af640 2023-12-24T18:36:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5e4e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b1530 con 0x7f3a580ae6b0 2023-12-24T18:36:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5e4e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b19c0 con 0x7f3a58153780 2023-12-24T18:36:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5cce0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a580ae6b0 0x7f3a580af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5cce0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a580ae6b0 0x7f3a580af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55924/0 (socket says 172.21.15.82:55924) 2023-12-24T18:36:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3099960535 learned_addr learned my addr 172.21.15.82:0/3099960535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.586+0000 7f3a5d4e1700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a58153780 0x7f3a58156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a58153780 msgr2=0x7f3a58156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5cce0700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a58153780 0x7f3a58156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3099960535 >> v1:172.21.15.50:6789/0 conn(0x7f3a580af640 legacy=0x7f3a5806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3099960535 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58153b50 con 0x7f3a580ae6b0 2023-12-24T18:36:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5cce0700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a580ae6b0 0x7f3a580af100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800bc50 tx=0x7f3a4800b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bbc4c0cff5a5983 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a4ffff700 1 -- 172.21.15.82:0/3099960535 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800dbf0 con 0x7f3a580ae6b0 2023-12-24T18:36:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a4ffff700 1 -- 172.21.15.82:0/3099960535 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4800dd50 con 0x7f3a580ae6b0 2023-12-24T18:36:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a4ffff700 1 -- 172.21.15.82:0/3099960535 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480196b0 con 0x7f3a580ae6b0 2023-12-24T18:36:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a580ae6b0 msgr2=0x7f3a580af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a580ae6b0 0x7f3a580af100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800bc50 tx=0x7f3a4800b4f0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3099960535 shutdown_connections 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a580ae6b0 0x7f3a580af100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3099960535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a58153780 0x7f3a58156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3099960535 >> 172.21.15.82:0/3099960535 conn(0x7f3a58068510 msgr2=0x7f3a580add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3099960535 shutdown_connections 2023-12-24T18:36:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.590+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3099960535 wait complete. 2023-12-24T18:36:04.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.594+0000 7f3a5e4e3700 1 Processor -- start 2023-12-24T18:36:04.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.594+0000 7f3a5e4e3700 1 -- start start 2023-12-24T18:36:04.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.594+0000 7f3a5e4e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a580ae6b0 0x7f3a5815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.594+0000 7f3a5e4e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a58153780 0x7f3a58169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815be80 con 0x7f3a580ae6b0 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a58169c80 con 0x7f3a58153780 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815dd00 con 0x7f3a580af640 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42572/0 (socket says 172.21.15.82:42572) 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3283296413 learned_addr learned my addr 172.21.15.82:0/3283296413 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5d4e1700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a580ae6b0 0x7f3a5815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5dce2700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a58153780 0x7f3a58169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a58153780 msgr2=0x7f3a58169740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a58153780 0x7f3a58169740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3283296413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a580ae6b0 msgr2=0x7f3a5815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a580ae6b0 0x7f3a5815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 -- 172.21.15.82:0/3283296413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4800b790 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5cce0700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a5806a440 tx=0x7f3a4801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48010680 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a480107e0 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48010b80 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5815df70 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5815e530 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3a4802c3f0 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f3a48014070 con 0x7f3a580af640 2023-12-24T18:36:04.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.598+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58156930 con 0x7f3a580af640 2023-12-24T18:36:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.606+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3a58156930 con 0x7f3a580af640 2023-12-24T18:36:04.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:04.613+0000 7f11f92e2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:36:04.641 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:04.634+0000 7f5f47ce8000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:36:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.682+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "324c1fe4-655d-4221-9b97-22c510207efc", "id": 1} v 0) v1 -- 0x7f3a5804be40 con 0x7f3a580af640 2023-12-24T18:36:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.690+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3283296413 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "324c1fe4-655d-4221-9b97-22c510207efc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a4802c7e0 con 0x7f3a580af640 2023-12-24T18:36:04.697 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-12-24T18:36:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 msgr2=0x7f3a58169200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a5806a440 tx=0x7f3a4801b000 comp rx=0 tx=0).stop 2023-12-24T18:36:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 shutdown_connections 2023-12-24T18:36:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a58153780 0x7f3a58169740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a580af640 0x7f3a58169200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 --2- 172.21.15.82:0/3283296413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a580ae6b0 0x7f3a5815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 >> 172.21.15.82:0/3283296413 conn(0x7f3a58068510 msgr2=0x7f3a58152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 shutdown_connections 2023-12-24T18:36:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.694+0000 7f3a5e4e3700 1 -- 172.21.15.82:0/3283296413 wait complete. 2023-12-24T18:36:04.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 9e50909b-304b-4677-971e-3a2ba622178e 2 2023-12-24T18:36:04.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 Processor -- start 2023-12-24T18:36:04.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 -- start start 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5554158c50 0x7f5554159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55540cc790 0x7f55540ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55540af430 con 0x7f55540cc790 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55540cd150 con 0x7f5554158c50 2023-12-24T18:36:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540caa60 con 0x7f55540caef0 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42588/0 (socket says 172.21.15.82:42588) 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 -- 172.21.15.82:0/2524436593 learned_addr learned my addr 172.21.15.82:0/2524436593 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f555259c700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.82:3300/0 conn(0x7f5554158c50 0x7f5554159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5552d9d700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.50:3300/0 conn(0x7f55540cc790 0x7f55540ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 -- 172.21.15.82:0/2524436593 >> v2:172.21.15.82:3300/0 conn(0x7f5554158c50 msgr2=0x7f5554159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.82:3300/0 conn(0x7f5554158c50 0x7f5554159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 -- 172.21.15.82:0/2524436593 >> v2:172.21.15.50:3300/0 conn(0x7f55540cc790 msgr2=0x7f55540ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.50:3300/0 conn(0x7f55540cc790 0x7f55540ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.882+0000 7f5551d9b700 1 -- 172.21.15.82:0/2524436593 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540cee80 con 0x7f55540caef0 2023-12-24T18:36:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f5551d9b700 1 --2- 172.21.15.82:0/2524436593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f555406dcf0 tx=0x7f5548009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95d4467eef74952 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555159a700 1 -- 172.21.15.82:0/2524436593 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800b860 con 0x7f55540caef0 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555159a700 1 -- 172.21.15.82:0/2524436593 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800b9c0 con 0x7f55540caef0 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555159a700 1 -- 172.21.15.82:0/2524436593 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800bd60 con 0x7f55540caef0 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 -- 172.21.15.82:0/2524436593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 msgr2=0x7f55540cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 --2- 172.21.15.82:0/2524436593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f555406dcf0 tx=0x7f5548009250 comp rx=0 tx=0).stop 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 -- 172.21.15.82:0/2524436593 shutdown_connections 2023-12-24T18:36:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.50:3300/0 conn(0x7f55540cc790 0x7f55540ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 --2- 172.21.15.82:0/2524436593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540caef0 0x7f55540cb320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 --2- 172.21.15.82:0/2524436593 >> v2:172.21.15.82:3300/0 conn(0x7f5554158c50 0x7f5554159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 -- 172.21.15.82:0/2524436593 >> 172.21.15.82:0/2524436593 conn(0x7f55540670b0 msgr2=0x7f55540674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 -- 172.21.15.82:0/2524436593 shutdown_connections 2023-12-24T18:36:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.886+0000 7f555359e700 1 -- 172.21.15.82:0/2524436593 wait complete. 2023-12-24T18:36:04.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 Processor -- start 2023-12-24T18:36:04.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 -- start start 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55540caef0 0x7f55540b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 0x7f5554155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555415b5a0 con 0x7f55540caef0 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555415aad0 con 0x7f5554158c50 2023-12-24T18:36:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c7d30 con 0x7f55540cc790 2023-12-24T18:36:04.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f5551d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f5552d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 0x7f5554155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f5551d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42598/0 (socket says 172.21.15.82:42598) 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f5551d9b700 1 -- 172.21.15.82:0/1939260249 learned_addr learned my addr 172.21.15.82:0/1939260249 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.890+0000 7f555259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55540caef0 0x7f55540b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 -- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 msgr2=0x7f5554155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 0x7f5554155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 -- 172.21.15.82:0/1939260249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55540caef0 msgr2=0x7f55540b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55540caef0 0x7f55540b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 -- 172.21.15.82:0/1939260249 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480094f0 con 0x7f55540cc790 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5552d9d700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 0x7f5554155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f5551d9b700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55540caba0 tx=0x7f5548017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:04.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548011e70 con 0x7f55540cc790 2023-12-24T18:36:04.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548024440 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540c7a00 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548024800 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555415adb0 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f554801a6a0 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f5548023810 con 0x7f55540cc790 2023-12-24T18:36:04.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.894+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555404be40 con 0x7f55540cc790 2023-12-24T18:36:04.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.898+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5548015020 con 0x7f55540cc790 2023-12-24T18:36:04.910 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:04.905+0000 7f11f92e2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:36:04.982 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:04.977+0000 7f11f92e2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:36:04.983 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:04.978+0000 7f5f47ce8000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:36:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.978+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9e50909b-304b-4677-971e-3a2ba622178e", "id": 2} v 0) v1 -- 0x7f55540c7e70 con 0x7f55540cc790 2023-12-24T18:36:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f55427fc700 1 -- 172.21.15.82:0/1939260249 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e50909b-304b-4677-971e-3a2ba622178e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55480233e0 con 0x7f55540cc790 2023-12-24T18:36:04.993 INFO:teuthology.orchestra.run.smithi082.stdout:2 2023-12-24T18:36:04.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 msgr2=0x7f555415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:04.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55540caba0 tx=0x7f5548017000 comp rx=0 tx=0).stop 2023-12-24T18:36:04.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 shutdown_connections 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5554158c50 0x7f5554155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55540cc790 0x7f555415a590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 --2- 172.21.15.82:0/1939260249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55540caef0 0x7f55540b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 >> 172.21.15.82:0/1939260249 conn(0x7f55540670b0 msgr2=0x7f55540ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 shutdown_connections 2023-12-24T18:36:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:04.990+0000 7f555359e700 1 -- 172.21.15.82:0/1939260249 wait complete. 2023-12-24T18:36:05.016 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new d774b59e-89d3-4b1c-8915-43dce49eb238 3 2023-12-24T18:36:05.059 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:05.054+0000 7f5f47ce8000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:36:05.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.158+0000 7f41c7523700 1 Processor -- start 2023-12-24T18:36:05.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.158+0000 7f41c7523700 1 -- start start 2023-12-24T18:36:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c7523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c7523700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 0x7f41c00af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c7523700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c0156ab0 con 0x7f41c00b1670 2023-12-24T18:36:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c7523700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00b1fe0 con 0x7f41c0069730 2023-12-24T18:36:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c7523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0156460 con 0x7f41c00abff0 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6d22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 0x7f41c00af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42608/0 (socket says 172.21.15.82:42608) 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6d22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 0x7f41c00af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55940/0 (socket says 172.21.15.82:55940) 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 -- 172.21.15.82:0/3040188628 learned_addr learned my addr 172.21.15.82:0/3040188628 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c5d20700 1 --1- 172.21.15.82:0/3040188628 >> v1:172.21.15.50:6789/0 conn(0x7f41c00b1670 0x7f41c0069020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.82:55948/0 (socket says 172.21.15.82:55948) 2023-12-24T18:36:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 -- 172.21.15.82:0/3040188628 >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 msgr2=0x7f41c00af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 --2- 172.21.15.82:0/3040188628 >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 0x7f41c00af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 -- 172.21.15.82:0/3040188628 >> v1:172.21.15.50:6789/0 conn(0x7f41c00b1670 legacy=0x7f41c0069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c551f700 1 -- 172.21.15.82:0/3040188628 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225033413 0 0) 0x7f41c0156ab0 con 0x7f41c00b1670 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 -- 172.21.15.82:0/3040188628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0156740 con 0x7f41c00abff0 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c6521700 1 --2- 172.21.15.82:0/3040188628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0099b0 tx=0x7f41bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b260b4050dbc7d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c551f700 1 -- 172.21.15.82:0/3040188628 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc009ea0 con 0x7f41c00abff0 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c551f700 1 -- 172.21.15.82:0/3040188628 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00b860 con 0x7f41c00abff0 2023-12-24T18:36:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.162+0000 7f41c551f700 1 -- 172.21.15.82:0/3040188628 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00bc00 con 0x7f41c00abff0 2023-12-24T18:36:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- 172.21.15.82:0/3040188628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 msgr2=0x7f41c0156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 --2- 172.21.15.82:0/3040188628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0099b0 tx=0x7f41bc009250 comp rx=0 tx=0).stop 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- 172.21.15.82:0/3040188628 shutdown_connections 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 --2- 172.21.15.82:0/3040188628 >> v2:172.21.15.82:3300/0 conn(0x7f41c0069730 0x7f41c00af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 --2- 172.21.15.82:0/3040188628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00abff0 0x7f41c0156f40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- 172.21.15.82:0/3040188628 >> 172.21.15.82:0/3040188628 conn(0x7f41c00ccb30 msgr2=0x7f41c00ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- 172.21.15.82:0/3040188628 shutdown_connections 2023-12-24T18:36:05.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- 172.21.15.82:0/3040188628 wait complete. 2023-12-24T18:36:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 Processor -- start 2023-12-24T18:36:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.166+0000 7f41c7523700 1 -- start start 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 0x7f41c00ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00b1670 0x7f41c014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00ad720 con 0x7f41c00abff0 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0142120 con 0x7f41c0069730 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00ace80 con 0x7f41c00b1670 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55946/0 (socket says 172.21.15.82:55946) 2023-12-24T18:36:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 -- 172.21.15.82:0/462012876 learned_addr learned my addr 172.21.15.82:0/462012876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6d22700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00b1670 0x7f41c014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 -- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00b1670 msgr2=0x7f41c014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c5d20700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 0x7f41c00ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00b1670 0x7f41c014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 -- 172.21.15.82:0/462012876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 msgr2=0x7f41c00ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 0x7f41c00ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 -- 172.21.15.82:0/462012876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0094f0 con 0x7f41c0069730 2023-12-24T18:36:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c5d20700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 0x7f41c00ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c6521700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41bc006fd0 tx=0x7f41bc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00b9d0 con 0x7f41c0069730 2023-12-24T18:36:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00bb50 con 0x7f41c0069730 2023-12-24T18:36:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc025670 con 0x7f41c0069730 2023-12-24T18:36:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00ad160 con 0x7f41c0069730 2023-12-24T18:36:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c014b890 con 0x7f41c0069730 2023-12-24T18:36:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f41bc023070 con 0x7f41c0069730 2023-12-24T18:36:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f41bc025ca0 con 0x7f41c0069730 2023-12-24T18:36:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.170+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c014b6f0 con 0x7f41c0069730 2023-12-24T18:36:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.174+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f41c014b6f0 con 0x7f41c0069730 2023-12-24T18:36:05.222 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:05.217+0000 7f11f92e2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:36:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.254+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d774b59e-89d3-4b1c-8915-43dce49eb238", "id": 3} v 0) v1 -- 0x7f41c0069e70 con 0x7f41c0069730 2023-12-24T18:36:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41b67fc700 1 -- 172.21.15.82:0/462012876 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d774b59e-89d3-4b1c-8915-43dce49eb238", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f41c0069e70 con 0x7f41c0069730 2023-12-24T18:36:05.267 INFO:teuthology.orchestra.run.smithi082.stdout:3 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 msgr2=0x7f41c0141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41bc006fd0 tx=0x7f41bc017000 comp rx=0 tx=0).stop 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 shutdown_connections 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c00b1670 0x7f41c014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c00abff0 0x7f41c00ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.262+0000 7f41c7523700 1 --2- 172.21.15.82:0/462012876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0069730 0x7f41c0141be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.266+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 >> 172.21.15.82:0/462012876 conn(0x7f41c00ccb30 msgr2=0x7f41c006c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.266+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 shutdown_connections 2023-12-24T18:36:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.266+0000 7f41c7523700 1 -- 172.21.15.82:0/462012876 wait complete. 2023-12-24T18:36:05.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 2f7f64e5-4dc9-4764-807c-ab73414af3fb 4 2023-12-24T18:36:05.303 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:05.301+0000 7f11f92e2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:36:05.313 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:05.306+0000 7f5f47ce8000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:36:05.397 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:05.390+0000 7f5f47ce8000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:36:05.399 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:05.393+0000 7f11f92e2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:36:05.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.450+0000 7f1022a8e700 1 Processor -- start 2023-12-24T18:36:05.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.450+0000 7f1022a8e700 1 -- start start 2023-12-24T18:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1022a8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f101c0ae6b0 0x7f101c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1022a8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f101c0aea80 0x7f101c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1022a8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c15add0 con 0x7f101c0b1bf0 2023-12-24T18:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1022a8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c06cc00 con 0x7f101c0aea80 2023-12-24T18:36:05.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1022a8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c06cee0 con 0x7f101c0ae6b0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f102228d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f101c0b1bf0 0x7f101c0c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35770/0 (socket says 172.21.15.82:35770) 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f102228d700 1 -- 172.21.15.82:0/2106662033 learned_addr learned my addr 172.21.15.82:0/2106662033 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 --2- 172.21.15.82:0/2106662033 >> v2:172.21.15.82:3300/0 conn(0x7f101c0ae6b0 0x7f101c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f102128b700 1 --2- 172.21.15.82:0/2106662033 >> v2:172.21.15.50:3300/0 conn(0x7f101c0aea80 0x7f101c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28953671 0 0) 0x7f101c15add0 con 0x7f101c0b1bf0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1008003570 con 0x7f101c0b1bf0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 -- 172.21.15.82:0/2106662033 >> v2:172.21.15.50:3300/0 conn(0x7f101c0aea80 msgr2=0x7f101c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 --2- 172.21.15.82:0/2106662033 >> v2:172.21.15.50:3300/0 conn(0x7f101c0aea80 0x7f101c0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 -- 172.21.15.82:0/2106662033 >> v1:172.21.15.82:6789/0 conn(0x7f101c0b1bf0 legacy=0x7f101c0c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766216246 0 0) 0x7f1008003570 con 0x7f101c0b1bf0 2023-12-24T18:36:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 -- 172.21.15.82:0/2106662033 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c06d1c0 con 0x7f101c0ae6b0 2023-12-24T18:36:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1021a8c700 1 --2- 172.21.15.82:0/2106662033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0ae6b0 0x7f101c15a890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f101c06a840 tx=0x7f10180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e309a76791781570 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.454+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10140017f0 con 0x7f101c0ae6b0 2023-12-24T18:36:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018011420 con 0x7f101c0ae6b0 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1020a8a700 1 -- 172.21.15.82:0/2106662033 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180117c0 con 0x7f101c0ae6b0 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- 172.21.15.82:0/2106662033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0ae6b0 msgr2=0x7f101c15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 --2- 172.21.15.82:0/2106662033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0ae6b0 0x7f101c15a890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f101c06a840 tx=0x7f10180091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- 172.21.15.82:0/2106662033 shutdown_connections 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 --2- 172.21.15.82:0/2106662033 >> v2:172.21.15.50:3300/0 conn(0x7f101c0aea80 0x7f101c0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 --2- 172.21.15.82:0/2106662033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0ae6b0 0x7f101c15a890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- 172.21.15.82:0/2106662033 >> 172.21.15.82:0/2106662033 conn(0x7f101c068510 msgr2=0x7f101c0add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- 172.21.15.82:0/2106662033 shutdown_connections 2023-12-24T18:36:05.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- 172.21.15.82:0/2106662033 wait complete. 2023-12-24T18:36:05.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 Processor -- start 2023-12-24T18:36:05.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.458+0000 7f1022a8e700 1 -- start start 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101c0ae6b0 0x7f101c14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0aea80 0x7f101c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c14ded0 con 0x7f101c0ae6b0 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0add30 con 0x7f101c0aea80 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c14d2c0 con 0x7f101c0b1bf0 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102128b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0aea80 0x7f101c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42634/0 (socket says 172.21.15.82:42634) 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 -- 172.21.15.82:0/3484365699 learned_addr learned my addr 172.21.15.82:0/3484365699 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1021a8c700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101c0ae6b0 0x7f101c14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 -- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0aea80 msgr2=0x7f101c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0aea80 0x7f101c14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 -- 172.21.15.82:0/3484365699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101c0ae6b0 msgr2=0x7f101c14cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101c0ae6b0 0x7f101c14cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 -- 172.21.15.82:0/3484365699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018009420 con 0x7f101c0b1bf0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f102228d700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f101400cc10 tx=0x7f1014001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014004e90 con 0x7f101c0b1bf0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1014007150 con 0x7f101c0b1bf0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014007510 con 0x7f101c0b1bf0 2023-12-24T18:36:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c14d5a0 con 0x7f101c0b1bf0 2023-12-24T18:36:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f101400a570 con 0x7f101c0b1bf0 2023-12-24T18:36:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c14db60 con 0x7f101c0b1bf0 2023-12-24T18:36:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.462+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f101400aa50 con 0x7f101c0b1bf0 2023-12-24T18:36:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.466+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c14e040 con 0x7f101c0b1bf0 2023-12-24T18:36:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.470+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1014018070 con 0x7f101c0b1bf0 2023-12-24T18:36:05.485 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:05.478+0000 7f5f47ce8000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:36:05.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.546+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2f7f64e5-4dc9-4764-807c-ab73414af3fb", "id": 4} v 0) v1 -- 0x7f101c04be40 con 0x7f101c0b1bf0 2023-12-24T18:36:05.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.554+0000 7f1011ffb700 1 -- 172.21.15.82:0/3484365699 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f7f64e5-4dc9-4764-807c-ab73414af3fb", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f101400ac10 con 0x7f101c0b1bf0 2023-12-24T18:36:05.560 INFO:teuthology.orchestra.run.smithi082.stdout:4 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 msgr2=0x7f101c0ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f101400cc10 tx=0x7f1014001640 comp rx=0 tx=0).stop 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 shutdown_connections 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f101c0b1bf0 0x7f101c0ad7f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f101c0aea80 0x7f101c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 --2- 172.21.15.82:0/3484365699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101c0ae6b0 0x7f101c14cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 >> 172.21.15.82:0/3484365699 conn(0x7f101c068510 msgr2=0x7f101c157670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 shutdown_connections 2023-12-24T18:36:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.558+0000 7f1022a8e700 1 -- 172.21.15.82:0/3484365699 wait complete. 2023-12-24T18:36:05.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new e1ba7d3c-4b11-4a9c-bf71-2e40ef723547 5 2023-12-24T18:36:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 Processor -- start 2023-12-24T18:36:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 -- start start 2023-12-24T18:36:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa29c158c40 0x7fa29c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c06a580 con 0x7fa29c0cc780 2023-12-24T18:36:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c06a7d0 con 0x7fa29c06d450 2023-12-24T18:36:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c06aab0 con 0x7fa29c158c40 2023-12-24T18:36:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.734+0000 7fa29ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa29c06d450 0x7fa29c159010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35784/0 (socket says 172.21.15.82:35784) 2023-12-24T18:36:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29ad9d700 1 -- 172.21.15.82:0/1622537782 learned_addr learned my addr 172.21.15.82:0/1622537782 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-12-24T18:36:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29a59c700 1 --2- 172.21.15.82:0/1622537782 >> v2:172.21.15.82:3300/0 conn(0x7fa29c158c40 0x7fa29c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760463123 0 0) 0x7fa29c06a7d0 con 0x7fa29c06d450 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa288003570 con 0x7fa29c06d450 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034000596 0 0) 0x7fa29c06a580 con 0x7fa29c0cc780 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa29c06a7d0 con 0x7fa29c0cc780 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29a59c700 1 -- 172.21.15.82:0/1622537782 >> v1:172.21.15.82:6789/0 conn(0x7fa29c06d450 legacy=0x7fa29c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29a59c700 1 -- 172.21.15.82:0/1622537782 >> v1:172.21.15.50:6789/0 conn(0x7fa29c0cc780 legacy=0x7fa29c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29a59c700 1 -- 172.21.15.82:0/1622537782 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c06ad90 con 0x7fa29c158c40 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29a59c700 1 --2- 172.21.15.82:0/1622537782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c158c40 0x7fa29c0cf500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0098e0 tx=0x7fa28c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb782d1a8fd55cd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011630 con 0x7fa29c158c40 2023-12-24T18:36:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c011790 con 0x7fa29c158c40 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa299d9b700 1 -- 172.21.15.82:0/1622537782 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011b30 con 0x7fa29c158c40 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 -- 172.21.15.82:0/1622537782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c158c40 msgr2=0x7fa29c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 --2- 172.21.15.82:0/1622537782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c158c40 0x7fa29c0cf500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0098e0 tx=0x7fa28c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 -- 172.21.15.82:0/1622537782 shutdown_connections 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 --2- 172.21.15.82:0/1622537782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c158c40 0x7fa29c0cf500 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 -- 172.21.15.82:0/1622537782 >> 172.21.15.82:0/1622537782 conn(0x7fa29c0d0800 msgr2=0x7fa29c0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 -- 172.21.15.82:0/1622537782 shutdown_connections 2023-12-24T18:36:05.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.738+0000 7fa29b59e700 1 -- 172.21.15.82:0/1622537782 wait complete. 2023-12-24T18:36:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 Processor -- start 2023-12-24T18:36:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 -- start start 2023-12-24T18:36:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0cc780 0x7fa29c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 0x7fa29c15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c150d80 con 0x7fa29c158c40 2023-12-24T18:36:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c150170 con 0x7fa29c0cc780 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c150450 con 0x7fa29c06d450 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29a59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29a59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42638/0 (socket says 172.21.15.82:42638) 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa293fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0cc780 0x7fa29c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29a59c700 1 -- 172.21.15.82:0/2593397356 learned_addr learned my addr 172.21.15.82:0/2593397356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.742+0000 7fa29ad9d700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 0x7fa29c15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 -- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0cc780 msgr2=0x7fa29c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0cc780 0x7fa29c15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 -- 172.21.15.82:0/2593397356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 msgr2=0x7fa29c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 0x7fa29c15cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 -- 172.21.15.82:0/2593397356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009420 con 0x7fa29c06d450 2023-12-24T18:36:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29ad9d700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 0x7fa29c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:05.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29a59c700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa29c069860 tx=0x7fa28c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01f070 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c000bc0 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c025420 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c150730 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c14e4b0 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa28c023070 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fa28c02e930 con 0x7fa29c06d450 2023-12-24T18:36:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.746+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c1540b0 con 0x7fa29c06d450 2023-12-24T18:36:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.750+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa29c1540b0 con 0x7fa29c06d450 2023-12-24T18:36:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.830+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1ba7d3c-4b11-4a9c-bf71-2e40ef723547", "id": 5} v 0) v1 -- 0x7fa29c0b5270 con 0x7fa29c06d450 2023-12-24T18:36:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.838+0000 7fa2927fc700 1 -- 172.21.15.82:0/2593397356 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1ba7d3c-4b11-4a9c-bf71-2e40ef723547", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa29c0b5270 con 0x7fa29c06d450 2023-12-24T18:36:05.844 INFO:teuthology.orchestra.run.smithi082.stdout:5 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 msgr2=0x7fa29c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa29c069860 tx=0x7fa28c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 shutdown_connections 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29c158c40 0x7fa29c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0cc780 0x7fa29c15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 --2- 172.21.15.82:0/2593397356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa29c06d450 0x7fa29c151210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 >> 172.21.15.82:0/2593397356 conn(0x7fa29c0d0800 msgr2=0x7fa29c0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 shutdown_connections 2023-12-24T18:36:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:05.842+0000 7fa29b59e700 1 -- 172.21.15.82:0/2593397356 wait complete. 2023-12-24T18:36:05.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new adff6ffd-ba9a-44b0-b1b1-736104a3101c 6 2023-12-24T18:36:05.873 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:05.869+0000 7f11f92e2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:36:05.997 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:05.990+0000 7f5f47ce8000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:36:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.010+0000 7ff25ace3700 1 Processor -- start 2023-12-24T18:36:06.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 -- start start 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2540c8340 0x7ff2540c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540c7240 con 0x7ff254068ff0 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540c7520 con 0x7ff2540c8340 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff25ace3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540c7800 con 0x7ff2541427c0 2023-12-24T18:36:06.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff259ce1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff254068ff0 0x7ff2541420b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35800/0 (socket says 172.21.15.82:35800) 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.014+0000 7ff259ce1700 1 -- 172.21.15.82:0/2650726063 learned_addr learned my addr 172.21.15.82:0/2650726063 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/2650726063 >> v2:172.21.15.82:3300/0 conn(0x7ff2540c8340 0x7ff2540c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff2594e0700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff258cdf700 1 -- 172.21.15.82:0/2650726063 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991584159 0 0) 0x7ff2540c7240 con 0x7ff254068ff0 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff258cdf700 1 -- 172.21.15.82:0/2650726063 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff240003570 con 0x7ff254068ff0 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 -- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 msgr2=0x7ff2540693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 -- 172.21.15.82:0/2650726063 >> v1:172.21.15.82:6789/0 conn(0x7ff254068ff0 legacy=0x7ff2541420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 -- 172.21.15.82:0/2650726063 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540c7ae0 con 0x7ff2540c8340 2023-12-24T18:36:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff2540c8780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009e60 tx=0x7ff24c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3ce489888ed706 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff258cdf700 1 -- 172.21.15.82:0/2650726063 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00e070 con 0x7ff2540c8340 2023-12-24T18:36:06.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff258cdf700 1 -- 172.21.15.82:0/2650726063 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c00bab0 con 0x7ff2540c8340 2023-12-24T18:36:06.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff258cdf700 1 -- 172.21.15.82:0/2650726063 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00be50 con 0x7ff2540c8340 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 -- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 msgr2=0x7ff2540c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff2540c8780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009e60 tx=0x7ff24c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 -- 172.21.15.82:0/2650726063 shutdown_connections 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff2540c8780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 --2- 172.21.15.82:0/2650726063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 -- 172.21.15.82:0/2650726063 >> 172.21.15.82:0/2650726063 conn(0x7ff2540ccad0 msgr2=0x7ff2540cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 -- 172.21.15.82:0/2650726063 shutdown_connections 2023-12-24T18:36:06.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.018+0000 7ff25ace3700 1 -- 172.21.15.82:0/2650726063 wait complete. 2023-12-24T18:36:06.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 Processor -- start 2023-12-24T18:36:06.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 -- start start 2023-12-24T18:36:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 0x7ff25415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff25413a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540ac640 con 0x7ff254068ff0 2023-12-24T18:36:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25413aa60 con 0x7ff2540c8340 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25ace3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540ad010 con 0x7ff2541427c0 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff2594e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff25413a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42658/0 (socket says 172.21.15.82:42658) 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 -- 172.21.15.82:0/563079461 learned_addr learned my addr 172.21.15.82:0/563079461 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff259ce1700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 0x7ff25415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 -- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 msgr2=0x7ff25413a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff25413a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 -- 172.21.15.82:0/563079461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 msgr2=0x7ff25415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 0x7ff25415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff25a4e2700 1 -- 172.21.15.82:0/563079461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c009a20 con 0x7ff2541427c0 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.022+0000 7ff259ce1700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 0x7ff25415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff25a4e2700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00b610 tx=0x7ff24c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c007000 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c012e30 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2540abd10 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c026640 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2540ac2d0 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff24c0269f0 con 0x7ff2541427c0 2023-12-24T18:36:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7ff24c026ca0 con 0x7ff2541427c0 2023-12-24T18:36:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.026+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2540ac7b0 con 0x7ff2541427c0 2023-12-24T18:36:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.030+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff24c01b3f0 con 0x7ff2541427c0 2023-12-24T18:36:06.037 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.033+0000 7f11f92e2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:36:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.110+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "adff6ffd-ba9a-44b0-b1b1-736104a3101c", "id": 6} v 0) v1 -- 0x7ff25404be40 con 0x7ff2541427c0 2023-12-24T18:36:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.118+0000 7ff249ffb700 1 -- 172.21.15.82:0/563079461 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "adff6ffd-ba9a-44b0-b1b1-736104a3101c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff24c02f670 con 0x7ff2541427c0 2023-12-24T18:36:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:6 2023-12-24T18:36:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 msgr2=0x7ff2540acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00b610 tx=0x7ff24c019000 comp rx=0 tx=0).stop 2023-12-24T18:36:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 shutdown_connections 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2541427c0 0x7ff2540acad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2540c8340 0x7ff25413a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 --2- 172.21.15.82:0/563079461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff254068ff0 0x7ff25415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 >> 172.21.15.82:0/563079461 conn(0x7ff2540ccad0 msgr2=0x7ff2540c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 shutdown_connections 2023-12-24T18:36:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.122+0000 7ff25ace3700 1 -- 172.21.15.82:0/563079461 wait complete. 2023-12-24T18:36:06.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new d670455f-a126-48b7-b6cf-5119fbf5ac34 7 2023-12-24T18:36:06.168 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:06.162+0000 7f5f47ce8000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:36:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.298+0000 7f0ddf66e700 1 Processor -- start 2023-12-24T18:36:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.298+0000 7f0ddf66e700 1 -- start start 2023-12-24T18:36:06.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dd8158e00 0x7f0dd80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0dd806c820 0x7f0dd80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd80b3fd0 con 0x7f0dd806a710 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80b33c0 con 0x7f0dd8158e00 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80b36a0 con 0x7f0dd806c820 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0dd806c820 0x7f0dd80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0dddc0b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0dd806a710 0x7f0dd806ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35814/0 (socket says 172.21.15.82:35814) 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0dddc0b700 1 -- 172.21.15.82:0/1522574981 learned_addr learned my addr 172.21.15.82:0/1522574981 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-12-24T18:36:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddd40a700 1 --2- 172.21.15.82:0/1522574981 >> v2:172.21.15.50:3300/0 conn(0x7f0dd8158e00 0x7f0dd80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 -- 172.21.15.82:0/1522574981 >> v2:172.21.15.50:3300/0 conn(0x7f0dd8158e00 msgr2=0x7f0dd80b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 --2- 172.21.15.82:0/1522574981 >> v2:172.21.15.50:3300/0 conn(0x7f0dd8158e00 0x7f0dd80b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 -- 172.21.15.82:0/1522574981 >> v1:172.21.15.82:6789/0 conn(0x7f0dd806a710 legacy=0x7f0dd806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 -- 172.21.15.82:0/1522574981 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80b3980 con 0x7f0dd806c820 2023-12-24T18:36:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddcc09700 1 --2- 172.21.15.82:0/1522574981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806c820 0x7f0dd80b4460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80692a0 tx=0x7f0dc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7341a47fe86301b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0dcffff700 1 -- 172.21.15.82:0/1522574981 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800b6b0 con 0x7f0dd806c820 2023-12-24T18:36:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0dcffff700 1 -- 172.21.15.82:0/1522574981 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800b810 con 0x7f0dd806c820 2023-12-24T18:36:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0dcffff700 1 -- 172.21.15.82:0/1522574981 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800bbb0 con 0x7f0dd806c820 2023-12-24T18:36:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1522574981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806c820 msgr2=0x7f0dd80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1522574981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806c820 0x7f0dd80b4460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80692a0 tx=0x7f0dc80091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1522574981 shutdown_connections 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1522574981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806c820 0x7f0dd80b4460 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1522574981 >> v2:172.21.15.50:3300/0 conn(0x7f0dd8158e00 0x7f0dd80b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.302+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1522574981 >> 172.21.15.82:0/1522574981 conn(0x7f0dd8067b80 msgr2=0x7f0dd80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1522574981 shutdown_connections 2023-12-24T18:36:06.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1522574981 wait complete. 2023-12-24T18:36:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 Processor -- start 2023-12-24T18:36:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- start start 2023-12-24T18:36:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd806c820 0x7f0dd813c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dd8158e00 0x7f0dd8150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd816a3a0 con 0x7f0dd806c820 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8155680 con 0x7f0dd806a710 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddf66e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd814d0f0 con 0x7f0dd8158e00 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddd40a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddd40a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56008/0 (socket says 172.21.15.82:56008) 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddd40a700 1 -- 172.21.15.82:0/1183198347 learned_addr learned my addr 172.21.15.82:0/1183198347 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0ddcc09700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd806c820 0x7f0dd813c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.306+0000 7f0dddc0b700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dd8158e00 0x7f0dd8150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 -- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dd8158e00 msgr2=0x7f0dd8150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dd8158e00 0x7f0dd8150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 -- 172.21.15.82:0/1183198347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd806c820 msgr2=0x7f0dd813c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd806c820 0x7f0dd813c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 -- 172.21.15.82:0/1183198347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8009420 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddd40a700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d890 tx=0x7f0dd4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40125f0 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4012750 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd816a0c0 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4012af0 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd8155310 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0dd401e460 con 0x7f0dd806a710 2023-12-24T18:36:06.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f0dd401e710 con 0x7f0dd806a710 2023-12-24T18:36:06.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.310+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd80652e0 con 0x7f0dd806a710 2023-12-24T18:36:06.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.314+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0dd4012e60 con 0x7f0dd806a710 2023-12-24T18:36:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.390+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d670455f-a126-48b7-b6cf-5119fbf5ac34", "id": 7} v 0) v1 -- 0x7f0dd815c420 con 0x7f0dd806a710 2023-12-24T18:36:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.398+0000 7f0dcd7fa700 1 -- 172.21.15.82:0/1183198347 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d670455f-a126-48b7-b6cf-5119fbf5ac34", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0dd402d0b0 con 0x7f0dd806a710 2023-12-24T18:36:06.404 INFO:teuthology.orchestra.run.smithi082.stdout:7 2023-12-24T18:36:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 msgr2=0x7f0dd814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d890 tx=0x7f0dd4008040 comp rx=0 tx=0).stop 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 shutdown_connections 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dd8158e00 0x7f0dd8150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd806c820 0x7f0dd813c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 --2- 172.21.15.82:0/1183198347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dd806a710 0x7f0dd814e3e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 >> 172.21.15.82:0/1183198347 conn(0x7f0dd8067b80 msgr2=0x7f0dd815a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 shutdown_connections 2023-12-24T18:36:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-12-24T18:36:06.402+0000 7f0ddf66e700 1 -- 172.21.15.82:0/1183198347 wait complete. 2023-12-24T18:36:06.426 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-24T18:36:06.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-24T18:36:06.434 INFO:tasks.ceph.osd.0:Started 2023-12-24T18:36:06.434 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-24T18:36:06.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-24T18:36:06.440 INFO:tasks.ceph.osd.1:Started 2023-12-24T18:36:06.440 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-24T18:36:06.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-24T18:36:06.445 INFO:tasks.ceph.osd.2:Started 2023-12-24T18:36:06.445 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-24T18:36:06.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-24T18:36:06.451 INFO:tasks.ceph.osd.3:Started 2023-12-24T18:36:06.452 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-24T18:36:06.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-24T18:36:06.455 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.453+0000 7f11f92e2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:36:06.475 INFO:tasks.ceph.osd.4:Started 2023-12-24T18:36:06.475 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-24T18:36:06.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-24T18:36:06.480 INFO:tasks.ceph.osd.5:Started 2023-12-24T18:36:06.480 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-24T18:36:06.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-24T18:36:06.485 INFO:tasks.ceph.osd.6:Started 2023-12-24T18:36:06.485 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-24T18:36:06.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-24T18:36:06.491 INFO:tasks.ceph.osd.7:Started 2023-12-24T18:36:06.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:06.589 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:06.582+0000 7f5f47ce8000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:36:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.685+0000 7fa5ee6ae700 1 Processor -- start 2023-12-24T18:36:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.685+0000 7fa5ee6ae700 1 -- start start 2023-12-24T18:36:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5e806ab80 0x7fa5e806b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5e8159cf0 0x7fa5e815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e806cd10 con 0x7fa5e806a7b0 2023-12-24T18:36:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80ad4e0 con 0x7fa5e8159cf0 2023-12-24T18:36:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e815a690 con 0x7fa5e806ab80 2023-12-24T18:36:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5e8159cf0 0x7fa5e815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5e806a7b0 0x7fa5e80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33678/0 (socket says 172.21.15.50:33678) 2023-12-24T18:36:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5e8159cf0 0x7fa5e815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57390/0 (socket says 172.21.15.50:57390) 2023-12-24T18:36:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e7fff700 1 -- 172.21.15.50:0/3040663239 learned_addr learned my addr 172.21.15.50:0/3040663239 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5df7fe700 1 --2- 172.21.15.50:0/3040663239 >> v2:172.21.15.82:3300/0 conn(0x7fa5e806ab80 0x7fa5e806b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/3040663239 >> v2:172.21.15.82:3300/0 conn(0x7fa5e806ab80 msgr2=0x7fa5e806b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 --2- 172.21.15.50:0/3040663239 >> v2:172.21.15.82:3300/0 conn(0x7fa5e806ab80 0x7fa5e806b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/3040663239 >> v1:172.21.15.50:6789/0 conn(0x7fa5e806a7b0 legacy=0x7fa5e80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/3040663239 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e806e1b0 con 0x7fa5e8159cf0 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e77fe700 1 -- 172.21.15.50:0/3040663239 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103944958 0 0) 0x7fa5e806cd10 con 0x7fa5e806a7b0 2023-12-24T18:36:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ecc4b700 1 --2- 172.21.15.50:0/3040663239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e815a150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5e806a510 tx=0x7fa5e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab9dad1f4b365d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e77fe700 1 -- 172.21.15.50:0/3040663239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000e070 con 0x7fa5e8159cf0 2023-12-24T18:36:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e77fe700 1 -- 172.21.15.50:0/3040663239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000bb60 con 0x7fa5e8159cf0 2023-12-24T18:36:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5e77fe700 1 -- 172.21.15.50:0/3040663239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0012430 con 0x7fa5e8159cf0 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/3040663239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 msgr2=0x7fa5e815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/3040663239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e815a150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5e806a510 tx=0x7fa5e0009780 comp rx=0 tx=0).stop 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/3040663239 shutdown_connections 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/3040663239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e815a150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/3040663239 >> v2:172.21.15.82:3300/0 conn(0x7fa5e806ab80 0x7fa5e806b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.689+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/3040663239 >> 172.21.15.50:0/3040663239 conn(0x7fa5e8067b40 msgr2=0x7fa5e80cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.693+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/3040663239 shutdown_connections 2023-12-24T18:36:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.693+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/3040663239 wait complete. 2023-12-24T18:36:06.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.693+0000 7fa5ee6ae700 1 Processor -- start 2023-12-24T18:36:06.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.693+0000 7fa5ee6ae700 1 -- start start 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5e806a7b0 0x7fa5e81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e806ab80 0x7fa5e80b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80a4660 con 0x7fa5e8159cf0 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8156560 con 0x7fa5e806ab80 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80c6d70 con 0x7fa5e806a7b0 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57400/0 (socket says 172.21.15.50:57400) 2023-12-24T18:36:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/4042270389 learned_addr learned my addr 172.21.15.50:0/4042270389 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:06.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5df7fe700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e806ab80 0x7fa5e80b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5e7fff700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5e806a7b0 0x7fa5e81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5e806a7b0 msgr2=0x7fa5e81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5e806a7b0 0x7fa5e81544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e806ab80 msgr2=0x7fa5e80b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e806ab80 0x7fa5e80b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 -- 172.21.15.50:0/4042270389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009a20 con 0x7fa5e8159cf0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ecc4b700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8063c40 tx=0x7fa5e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0027470 con 0x7fa5e8159cf0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00275d0 con 0x7fa5e8159cf0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0027990 con 0x7fa5e8159cf0 2023-12-24T18:36:06.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.697+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e80c7050 con 0x7fa5e8159cf0 2023-12-24T18:36:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.701+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e81549e0 con 0x7fa5e8159cf0 2023-12-24T18:36:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.701+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa5e0024070 con 0x7fa5e8159cf0 2023-12-24T18:36:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.701+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa5e001eb00 con 0x7fa5e8159cf0 2023-12-24T18:36:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.701+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e8156330 con 0x7fa5e8159cf0 2023-12-24T18:36:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.705+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa5e8156330 con 0x7fa5e8159cf0 2023-12-24T18:36:06.746 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.741+0000 7f11f92e2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:36:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.781+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5e80c7550 con 0x7fa5e8159cf0 2023-12-24T18:36:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.781+0000 7fa5e4ff9700 1 -- 172.21.15.50:0/4042270389 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa5e002c020 con 0x7fa5e8159cf0 2023-12-24T18:36:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:06.786 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:06.398337+0000","last_up_change":"0.000000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 msgr2=0x7fa5e80b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8063c40 tx=0x7fa5e0019000 comp rx=0 tx=0).stop 2023-12-24T18:36:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 shutdown_connections 2023-12-24T18:36:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5e8159cf0 0x7fa5e80b0b00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e806ab80 0x7fa5e80b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 --2- 172.21.15.50:0/4042270389 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5e806a7b0 0x7fa5e81544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 >> 172.21.15.50:0/4042270389 conn(0x7fa5e8067b40 msgr2=0x7fa5e80ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 shutdown_connections 2023-12-24T18:36:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:06.785+0000 7fa5ee6ae700 1 -- 172.21.15.50:0/4042270389 wait complete. 2023-12-24T18:36:06.808 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-24T18:36:06.809 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-24T18:36:06.828 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:06.822+0000 7f5f47ce8000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:36:06.839 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.833+0000 7f11f92e2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:36:06.919 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.917+0000 7f11f92e2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:36:06.926 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:06.922+0000 7f5f47ce8000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:36:06.999 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:06.997+0000 7f11f92e2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:36:07.011 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.006+0000 7f5f47ce8000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:36:07.102 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.098+0000 7f5f47ce8000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:36:07.118 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-24T18:36:07.113+0000 7f6ba356e3c0 -1 Falling back to public interface 2023-12-24T18:36:07.118 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-24T18:36:07.113+0000 7f3a086f33c0 -1 Falling back to public interface 2023-12-24T18:36:07.124 INFO:tasks.ceph.osd.4.smithi082.stderr:2023-12-24T18:36:07.118+0000 7f983e8eb3c0 -1 Falling back to public interface 2023-12-24T18:36:07.143 INFO:tasks.ceph.osd.6.smithi082.stderr:2023-12-24T18:36:07.138+0000 7fe7caae43c0 -1 Falling back to public interface 2023-12-24T18:36:07.144 INFO:tasks.ceph.osd.7.smithi082.stderr:2023-12-24T18:36:07.138+0000 7f26734e03c0 -1 Falling back to public interface 2023-12-24T18:36:07.148 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-24T18:36:07.145+0000 7fd49b9d73c0 -1 Falling back to public interface 2023-12-24T18:36:07.151 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-24T18:36:07.149+0000 7f907558d3c0 -1 Falling back to public interface 2023-12-24T18:36:07.170 INFO:tasks.ceph.osd.5.smithi082.stderr:2023-12-24T18:36:07.166+0000 7f12832ea3c0 -1 Falling back to public interface 2023-12-24T18:36:07.323 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:07.321+0000 7f11f92e2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:36:07.403 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:07.397+0000 7f11f92e2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:36:07.449 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.446+0000 7f5f47ce8000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:36:07.492 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:07.489+0000 7f11f92e2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:36:07.530 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.526+0000 7f5f47ce8000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:36:07.614 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:07.627 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.622+0000 7f5f47ce8000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:36:07.708 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:07.705+0000 7f11f92e2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:36:07.750 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.745+0000 7f3235ce3700 1 Processor -- start 2023-12-24T18:36:07.750 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.745+0000 7f3235ce3700 1 -- start start 2023-12-24T18:36:07.752 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32301609f0 0x7f323006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f32300c9590 0x7f32300c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323006b580 con 0x7f3230160620 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323006a970 con 0x7f32301609f0 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323006ac50 con 0x7f32300c9590 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32301609f0 0x7f323006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32301609f0 0x7f323006cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57410/0 (socket says 172.21.15.50:57410) 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 -- 172.21.15.50:0/237596228 learned_addr learned my addr 172.21.15.50:0/237596228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 -- 172.21.15.50:0/237596228 >> v2:172.21.15.82:3300/0 conn(0x7f32300c9590 msgr2=0x7f32300c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 --2- 172.21.15.50:0/237596228 >> v2:172.21.15.82:3300/0 conn(0x7f32300c9590 0x7f32300c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 -- 172.21.15.50:0/237596228 >> v1:172.21.15.50:6789/0 conn(0x7f3230160620 legacy=0x7f323006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:07.753 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 -- 172.21.15.50:0/237596228 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323006af30 con 0x7f32301609f0 2023-12-24T18:36:07.754 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3227fff700 1 --2- 172.21.15.50:0/237596228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323006cf10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32300c8400 tx=0x7f3220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfc7ffa6c7df21c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:07.754 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f32277fe700 1 -- 172.21.15.50:0/237596228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000b820 con 0x7f32301609f0 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f32277fe700 1 -- 172.21.15.50:0/237596228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000b980 con 0x7f32301609f0 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f32277fe700 1 -- 172.21.15.50:0/237596228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000bd20 con 0x7f32301609f0 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- 172.21.15.50:0/237596228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 msgr2=0x7f323006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 --2- 172.21.15.50:0/237596228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323006cf10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32300c8400 tx=0x7f3220009250 comp rx=0 tx=0).stop 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- 172.21.15.50:0/237596228 shutdown_connections 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 --2- 172.21.15.50:0/237596228 >> v2:172.21.15.82:3300/0 conn(0x7f32300c9590 0x7f32300c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 --2- 172.21.15.50:0/237596228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323006cf10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- 172.21.15.50:0/237596228 >> 172.21.15.50:0/237596228 conn(0x7f32300cc490 msgr2=0x7f32300c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- 172.21.15.50:0/237596228 shutdown_connections 2023-12-24T18:36:07.755 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.749+0000 7f3235ce3700 1 -- 172.21.15.50:0/237596228 wait complete. 2023-12-24T18:36:07.757 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.753+0000 7f3235ce3700 1 Processor -- start 2023-12-24T18:36:07.757 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.753+0000 7f3235ce3700 1 -- start start 2023-12-24T18:36:07.761 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 0x7f32300c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:07.765 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3230160620 0x7f3230149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:07.765 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:07.765 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323015e780 con 0x7f32301609f0 2023-12-24T18:36:07.765 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32300c44d0 con 0x7f3230160620 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323016e340 con 0x7f32300c9590 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57426/0 (socket says 172.21.15.50:57426) 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 -- 172.21.15.50:0/1467675191 learned_addr learned my addr 172.21.15.50:0/1467675191 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3227fff700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3230160620 0x7f3230149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3234ce1700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 0x7f32300c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 -- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 msgr2=0x7f32300c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 0x7f32300c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 -- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3230160620 msgr2=0x7f3230149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3230160620 0x7f3230149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 -- 172.21.15.50:0/1467675191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094f0 con 0x7f32301609f0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3234ce1700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 0x7f32300c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f32354e2700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f322800bc30 tx=0x7f3228009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280092e0 con 0x7f32301609f0 2023-12-24T18:36:07.766 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800c7a0 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323016e620 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800cb80 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323015ece0 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3228012070 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3228015470 con 0x7f32301609f0 2023-12-24T18:36:07.767 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.757+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323016e860 con 0x7f32301609f0 2023-12-24T18:36:07.768 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.761+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f323016e860 con 0x7f32301609f0 2023-12-24T18:36:07.807 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:07.805+0000 7f11f92e2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:36:07.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.833+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323015eed0 con 0x7f32301609f0 2023-12-24T18:36:07.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.833+0000 7f3224ff9700 1 -- 172.21.15.50:0/1467675191 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f322801a020 con 0x7f32301609f0 2023-12-24T18:36:07.838 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-24T18:36:07.838 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:06.398337+0000","last_up_change":"0.000000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:07.839 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 msgr2=0x7f323016d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f322800bc30 tx=0x7f3228009840 comp rx=0 tx=0).stop 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 shutdown_connections 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32301609f0 0x7f323016d820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3230160620 0x7f3230149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 --2- 172.21.15.50:0/1467675191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32300c9590 0x7f32300c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 >> 172.21.15.50:0/1467675191 conn(0x7f32300cc490 msgr2=0x7f323015af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 shutdown_connections 2023-12-24T18:36:07.840 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:07.837+0000 7f3235ce3700 1 -- 172.21.15.50:0/1467675191 wait complete. 2023-12-24T18:36:07.850 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.846+0000 7f5f47ce8000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:36:07.857 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-24T18:36:07.951 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:07.946+0000 7f5f47ce8000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:36:08.705 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:08.701+0000 7f11f92e2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:36:08.818 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:36:08.814+0000 7f5f47ce8000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:36:09.744 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:09.740+0000 7f11e212e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-24T18:36:09.744 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:36:09.740+0000 7f11e212e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-24T18:36:10.980 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-24T18:36:10.976+0000 7f3a086f33c0 -1 osd.3 0 log_to_monitors true 2023-12-24T18:36:11.005 INFO:tasks.ceph.osd.6.smithi082.stderr:2023-12-24T18:36:11.002+0000 7fe7caae43c0 -1 osd.6 0 log_to_monitors true 2023-12-24T18:36:11.119 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-24T18:36:11.112+0000 7f907558d3c0 -1 osd.2 0 log_to_monitors true 2023-12-24T18:36:11.123 INFO:tasks.ceph.osd.7.smithi082.stderr:2023-12-24T18:36:11.118+0000 7f26734e03c0 -1 osd.7 0 log_to_monitors true 2023-12-24T18:36:11.140 INFO:tasks.ceph.osd.5.smithi082.stderr:2023-12-24T18:36:11.134+0000 7f12832ea3c0 -1 osd.5 0 log_to_monitors true 2023-12-24T18:36:11.142 INFO:tasks.ceph.osd.4.smithi082.stderr:2023-12-24T18:36:11.138+0000 7f983e8eb3c0 -1 osd.4 0 log_to_monitors true 2023-12-24T18:36:11.373 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-24T18:36:11.368+0000 7f6ba356e3c0 -1 osd.1 0 log_to_monitors true 2023-12-24T18:36:11.402 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-24T18:36:11.396+0000 7fd49b9d73c0 -1 osd.0 0 log_to_monitors true 2023-12-24T18:36:14.665 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:14.701 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-24T18:36:14.696+0000 7f6b9ed0e700 -1 osd.1 0 waiting for initial osdmap 2023-12-24T18:36:14.711 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-24T18:36:14.708+0000 7f6b97ab2700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:14.717 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-24T18:36:14.712+0000 7fd49899c700 -1 osd.0 0 waiting for initial osdmap 2023-12-24T18:36:14.729 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-24T18:36:14.724+0000 7fd48ff1b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:14.760 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-24T18:36:14.756+0000 7f3a03603700 -1 osd.3 0 waiting for initial osdmap 2023-12-24T18:36:14.768 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-24T18:36:14.764+0000 7f39fc3a7700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:14.776 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-24T18:36:14.772+0000 7f9070d2d700 -1 osd.2 0 waiting for initial osdmap 2023-12-24T18:36:14.787 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-24T18:36:14.780+0000 7f9069ad1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:14.824 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 Processor -- start 2023-12-24T18:36:14.824 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 -- start start 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1a01609f0 0x7ff1a006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a006b580 con 0x7ff1a00c9590 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a006a970 con 0x7ff1a0160620 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a600c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a006ac50 con 0x7ff1a01609f0 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a580b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1a00c9590 0x7ff1a00c65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41644/0 (socket says 172.21.15.50:41644) 2023-12-24T18:36:14.826 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a580b700 1 -- 172.21.15.50:0/3623604409 learned_addr learned my addr 172.21.15.50:0/3623604409 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:14.827 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.820+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3623604409 >> v2:172.21.15.82:3300/0 conn(0x7ff1a01609f0 0x7ff1a006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.828 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178795686 0 0) 0x7ff1a006b580 con 0x7ff1a00c9590 2023-12-24T18:36:14.828 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff18c003570 con 0x7ff1a00c9590 2023-12-24T18:36:14.828 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340783089 0 0) 0x7ff1a006a970 con 0x7ff1a0160620 2023-12-24T18:36:14.828 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a006b580 con 0x7ff1a0160620 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243045787 0 0) 0x7ff18c003570 con 0x7ff1a00c9590 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 >> v2:172.21.15.82:3300/0 conn(0x7ff1a01609f0 msgr2=0x7ff1a006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 --2- 172.21.15.50:0/3623604409 >> v2:172.21.15.82:3300/0 conn(0x7ff1a01609f0 0x7ff1a006cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 >> v1:172.21.15.82:6789/0 conn(0x7ff1a0160620 legacy=0x7ff1a006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a006af30 con 0x7ff1a00c9590 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7ff1980017f0 con 0x7ff1a00c9590 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 >> v1:172.21.15.50:6789/0 conn(0x7ff1a00c9590 legacy=0x7ff1a00c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff18c003bf0 0x7ff18c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.830 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff18c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff18c0051c0 0x7ff18c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a006ac50 con 0x7ff18c004810 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c00c0e0 con 0x7ff18c003bf0 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c00c2a0 con 0x7ff18c0051c0 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff18c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a580b700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff18c0051c0 0x7ff18c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a500a700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff18c003bf0 0x7ff18c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 -- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff18c0051c0 msgr2=0x7ff18c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff18c0051c0 0x7ff18c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 -- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff18c003bf0 msgr2=0x7ff18c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff18c003bf0 0x7ff18c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 -- 172.21.15.50:0/3623604409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c003570 con 0x7ff18c004810 2023-12-24T18:36:14.831 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a500a700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff18c003bf0 0x7ff18c003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:14.832 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a580b700 1 -- 172.21.15.50:0/3623604409 reap_dead start 2023-12-24T18:36:14.832 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff18c004c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff190009c00 tx=0x7ff1900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7a578aca2bccdf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000e710 con 0x7ff18c004810 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000e870 con 0x7ff18c004810 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.824+0000 7ff197fff700 1 -- 172.21.15.50:0/3623604409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000ec30 con 0x7ff18c004810 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 msgr2=0x7ff18c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff18c004c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff190009c00 tx=0x7ff1900091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- 172.21.15.50:0/3623604409 shutdown_connections 2023-12-24T18:36:14.834 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3623604409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff18c004c80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.835 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- 172.21.15.50:0/3623604409 >> 172.21.15.50:0/3623604409 conn(0x7ff1a00cc490 msgr2=0x7ff1a00c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:14.835 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- 172.21.15.50:0/3623604409 shutdown_connections 2023-12-24T18:36:14.835 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- 172.21.15.50:0/3623604409 wait complete. 2023-12-24T18:36:14.835 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 Processor -- start 2023-12-24T18:36:14.835 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.828+0000 7ff1a600c700 1 -- start start 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 0x7ff1a015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1a016d850 0x7ff1a016dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a015fdd0 con 0x7ff18c004810 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a016e720 con 0x7ff1a015e550 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a600c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a015ef00 con 0x7ff1a016d850 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46758/0 (socket says 172.21.15.50:46758) 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a580b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1a016d850 0x7ff1a016dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 -- 172.21.15.50:0/3084121585 learned_addr learned my addr 172.21.15.50:0/3084121585 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:14.836 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 0x7ff1a015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 -- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1a016d850 msgr2=0x7ff1a016dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1a016d850 0x7ff1a016dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 -- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 msgr2=0x7ff1a015e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 0x7ff1a015e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 -- 172.21.15.50:0/3084121585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a015f1c0 con 0x7ff18c004810 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 0x7ff1a015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:14.837 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.832+0000 7ff1a500a700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00d800 tx=0x7ff19c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:14.843 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.836+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c006820 con 0x7ff18c004810 2023-12-24T18:36:14.843 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.836+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a015f4a0 con 0x7ff18c004810 2023-12-24T18:36:14.843 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.836+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c006b90 con 0x7ff18c004810 2023-12-24T18:36:14.844 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.836+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c006d00 con 0x7ff18c004810 2023-12-24T18:36:14.844 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.836+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a015fa60 con 0x7ff18c004810 2023-12-24T18:36:14.845 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.840+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a00652f0 con 0x7ff18c004810 2023-12-24T18:36:14.845 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.840+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 79905+0+0 (secure 0 0 0) 0x7ff19c007240 con 0x7ff18c004810 2023-12-24T18:36:14.846 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.840+0000 7ff1957fa700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 0x7ff1840629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:14.847 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.840+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7ff19c07b900 con 0x7ff18c004810 2023-12-24T18:36:14.847 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.840+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 0x7ff1840629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:14.848 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.844+0000 7ff1a4809700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 0x7ff1840629f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1900091e0 tx=0x7ff19001a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:14.855 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:14.848+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff19c04ccc0 con 0x7ff18c004810 2023-12-24T18:36:15.025 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.020+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a00c8d60 con 0x7ff18c004810 2023-12-24T18:36:15.026 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.020+0000 7ff1957fa700 1 -- 172.21.15.50:0/3084121585 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff19c0502e0 con 0x7ff18c004810 2023-12-24T18:36:15.027 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-24T18:36:15.027 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":12,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:12.763284+0000","last_up_change":"0.000000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:15.032 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 msgr2=0x7ff1840629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:15.032 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 0x7ff1840629f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1900091e0 tx=0x7ff19001a000 comp rx=0 tx=0).stop 2023-12-24T18:36:15.032 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 msgr2=0x7ff1a014cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:15.032 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00d800 tx=0x7ff19c009040 comp rx=0 tx=0).stop 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 shutdown_connections 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff184060540 0x7ff1840629f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1a016d850 0x7ff1a016dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a015e550 0x7ff1a015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 --2- 172.21.15.50:0/3084121585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff18c004810 0x7ff1a014cb30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 >> 172.21.15.50:0/3084121585 conn(0x7ff1a00cc490 msgr2=0x7ff1a015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 shutdown_connections 2023-12-24T18:36:15.033 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:15.028+0000 7ff1a600c700 1 -- 172.21.15.50:0/3084121585 wait complete. 2023-12-24T18:36:15.049 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-24T18:36:15.243 INFO:tasks.ceph.osd.4.smithi082.stderr:2023-12-24T18:36:15.237+0000 7f983980d700 -1 osd.4 0 waiting for initial osdmap 2023-12-24T18:36:15.257 INFO:tasks.ceph.osd.4.smithi082.stderr:2023-12-24T18:36:15.253+0000 7f98325b1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:15.265 INFO:tasks.ceph.osd.5.smithi082.stderr:2023-12-24T18:36:15.261+0000 7f127e25c700 -1 osd.5 0 waiting for initial osdmap 2023-12-24T18:36:15.273 INFO:tasks.ceph.osd.5.smithi082.stderr:2023-12-24T18:36:15.265+0000 7f1277000700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:15.305 INFO:tasks.ceph.osd.7.smithi082.stderr:2023-12-24T18:36:15.301+0000 7f266e2fb700 -1 osd.7 0 waiting for initial osdmap 2023-12-24T18:36:15.317 INFO:tasks.ceph.osd.6.smithi082.stderr:2023-12-24T18:36:15.309+0000 7fe7c5a5c700 -1 osd.6 0 waiting for initial osdmap 2023-12-24T18:36:15.318 INFO:tasks.ceph.osd.7.smithi082.stderr:2023-12-24T18:36:15.313+0000 7f266709f700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:15.327 INFO:tasks.ceph.osd.6.smithi082.stderr:2023-12-24T18:36:15.321+0000 7fe7be800700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T18:36:21.857 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:22.009 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 Processor -- start 2023-12-24T18:36:22.009 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- start start 2023-12-24T18:36:22.011 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f10158d80 0x7f2f10159150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.011 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f1006da20 0x7f2f1006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.011 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1015db10 con 0x7f2f1015d6c0 2023-12-24T18:36:22.011 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1006aff0 con 0x7f2f1006da20 2023-12-24T18:36:22.011 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1006bb90 con 0x7f2f10158d80 2023-12-24T18:36:22.012 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f14b22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f1006da20 0x7f2f1006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.012 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f10158d80 0x7f2f10159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.012 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f10158d80 0x7f2f10159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56626/0 (socket says 172.21.15.50:56626) 2023-12-24T18:36:22.012 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 -- 172.21.15.50:0/3078946388 learned_addr learned my addr 172.21.15.50:0/3078946388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:22.012 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 -- 172.21.15.50:0/3078946388 >> v2:172.21.15.50:3300/0 conn(0x7f2f1006da20 msgr2=0x7f2f1006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:22.013 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 --2- 172.21.15.50:0/3078946388 >> v2:172.21.15.50:3300/0 conn(0x7f2f1006da20 0x7f2f1006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.013 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 -- 172.21.15.50:0/3078946388 >> v1:172.21.15.50:6789/0 conn(0x7f2f1015d6c0 legacy=0x7f2f1006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.013 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 -- 172.21.15.50:0/3078946388 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1006e190 con 0x7f2f10158d80 2023-12-24T18:36:22.013 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0ffff700 1 --2- 172.21.15.50:0/3078946388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f10158d80 0x7f2f10159150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f10065120 tx=0x7f2f00009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ad8844aee57062 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.013 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0effd700 1 -- 172.21.15.50:0/3078946388 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00009e70 con 0x7f2f10158d80 2023-12-24T18:36:22.014 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0effd700 1 -- 172.21.15.50:0/3078946388 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000b8f0 con 0x7f2f10158d80 2023-12-24T18:36:22.014 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f0effd700 1 -- 172.21.15.50:0/3078946388 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bc90 con 0x7f2f10158d80 2023-12-24T18:36:22.014 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- 172.21.15.50:0/3078946388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f10158d80 msgr2=0x7f2f10159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.014 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 --2- 172.21.15.50:0/3078946388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f10158d80 0x7f2f10159150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f10065120 tx=0x7f2f00009250 comp rx=0 tx=0).stop 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- 172.21.15.50:0/3078946388 shutdown_connections 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 --2- 172.21.15.50:0/3078946388 >> v2:172.21.15.50:3300/0 conn(0x7f2f1006da20 0x7f2f1006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 --2- 172.21.15.50:0/3078946388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f10158d80 0x7f2f10159150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- 172.21.15.50:0/3078946388 >> 172.21.15.50:0/3078946388 conn(0x7f2f100d0890 msgr2=0x7f2f100cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- 172.21.15.50:0/3078946388 shutdown_connections 2023-12-24T18:36:22.015 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.008+0000 7f2f15323700 1 -- 172.21.15.50:0/3078946388 wait complete. 2023-12-24T18:36:22.016 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 Processor -- start 2023-12-24T18:36:22.016 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 -- start start 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1006da20 0x7f2f100b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1015d6c0 0x7f2f100c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015a510 con 0x7f2f10158d80 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10159890 con 0x7f2f1006da20 2023-12-24T18:36:22.018 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f15323700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10159b70 con 0x7f2f1015d6c0 2023-12-24T18:36:22.019 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.019 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40514/0 (socket says 172.21.15.50:40514) 2023-12-24T18:36:22.019 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f0f7fe700 1 -- 172.21.15.50:0/3084406364 learned_addr learned my addr 172.21.15.50:0/3084406364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:22.019 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f0ffff700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1006da20 0x7f2f100b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.012+0000 7f2f14b22700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1015d6c0 0x7f2f100c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 -- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1015d6c0 msgr2=0x7f2f100c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1015d6c0 0x7f2f100c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 -- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1006da20 msgr2=0x7f2f100b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1006da20 0x7f2f100b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.020 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 -- 172.21.15.50:0/3084406364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000094f0 con 0x7f2f10158d80 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f0f7fe700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400c4e0 tx=0x7f2f0400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04011590 con 0x7f2f10158d80 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04011710 con 0x7f2f10158d80 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04011ad0 con 0x7f2f10158d80 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10159e50 con 0x7f2f10158d80 2023-12-24T18:36:22.021 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100b58c0 con 0x7f2f10158d80 2023-12-24T18:36:22.022 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.016+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1015a650 con 0x7f2f10158d80 2023-12-24T18:36:22.024 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.024+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2f0401b3b0 con 0x7f2f10158d80 2023-12-24T18:36:22.026 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.024+0000 7f2ef7fff700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.026 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.024+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f0407b8b0 con 0x7f2f10158d80 2023-12-24T18:36:22.026 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.024+0000 7f2f0ffff700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.027 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.024+0000 7f2f0ffff700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f10065120 tx=0x7f2f00017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.036 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.032+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f1015a650 con 0x7f2f10158d80 2023-12-24T18:36:22.218 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.212+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f1015db10 con 0x7f2f10158d80 2023-12-24T18:36:22.220 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2ef7fff700 1 -- 172.21.15.50:0/3084406364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f2f1015db10 con 0x7f2f10158d80 2023-12-24T18:36:22.221 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-24T18:36:22.221 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":16,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:19.184167+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 msgr2=0x7f2efc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f10065120 tx=0x7f2f00017000 comp rx=0 tx=0).stop 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 msgr2=0x7f2f1015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400c4e0 tx=0x7f2f0400c7f0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 shutdown_connections 2023-12-24T18:36:22.223 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1015d6c0 0x7f2f100c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f10158d80 0x7f2f1015a930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.216+0000 7f2f15323700 1 --2- 172.21.15.50:0/3084406364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1006da20 0x7f2f100b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.220+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 >> 172.21.15.50:0/3084406364 conn(0x7f2f100d0890 msgr2=0x7f2f100cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.220+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 shutdown_connections 2023-12-24T18:36:22.224 INFO:teuthology.misc.health.smithi050.stderr:2023-12-24T18:36:22.220+0000 7f2f15323700 1 -- 172.21.15.50:0/3084406364 wait complete. 2023-12-24T18:36:22.241 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-24T18:36:22.241 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-24T18:36:22.242 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:36:22.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:36:22.249 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:36:22.249 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:36:22.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:36:22.256 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:36:22.256 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:36:22.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:36:22.263 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:36:22.264 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:36:22.264 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:36:22.268 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:36:22.269 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-24T18:36:22.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:22.360 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:36:22.365 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:36:22.371 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:36:22.371 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:36:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 Processor -- start 2023-12-24T18:36:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 -- start start 2023-12-24T18:36:22.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5940cb310 0x7fb59406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb594156690 0x7fb594156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59415a4d0 con 0x7fb5940caf40 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb594157050 con 0x7fb5940cb310 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.420+0000 7fb59359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594159610 con 0x7fb594156690 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb5940caf40 0x7fb5940ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:43324/0 (socket says 172.21.15.50:43324) 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5940cb310 0x7fb59406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59259c700 1 -- 172.21.15.50:0/3602575872 learned_addr learned my addr 172.21.15.50:0/3602575872 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:22.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb592d9d700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb594156690 0x7fb594156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59159a700 1 -- 172.21.15.50:0/3602575872 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231370473 0 0) 0x7fb59415a4d0 con 0x7fb5940caf40 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59159a700 1 -- 172.21.15.50:0/3602575872 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57c003570 con 0x7fb5940caf40 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 -- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb594156690 msgr2=0x7fb594156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb594156690 0x7fb594156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 -- 172.21.15.50:0/3602575872 >> v1:172.21.15.82:6789/0 conn(0x7fb5940caf40 legacy=0x7fb5940ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 -- 172.21.15.50:0/3602575872 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940cd2a0 con 0x7fb5940cb310 2023-12-24T18:36:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb591d9b700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940cb310 0x7fb59406cd30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb5880098e0 tx=0x7fb5880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3190bce764ac9ae server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59159a700 1 -- 172.21.15.50:0/3602575872 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588011630 con 0x7fb5940cb310 2023-12-24T18:36:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59159a700 1 -- 172.21.15.50:0/3602575872 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588011790 con 0x7fb5940cb310 2023-12-24T18:36:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59159a700 1 -- 172.21.15.50:0/3602575872 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588011b30 con 0x7fb5940cb310 2023-12-24T18:36:22.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 -- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940cb310 msgr2=0x7fb59406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940cb310 0x7fb59406cd30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb5880098e0 tx=0x7fb5880091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 -- 172.21.15.50:0/3602575872 shutdown_connections 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb594156690 0x7fb594156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 --2- 172.21.15.50:0/3602575872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940cb310 0x7fb59406cd30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 -- 172.21.15.50:0/3602575872 >> 172.21.15.50:0/3602575872 conn(0x7fb5940670b0 msgr2=0x7fb5940674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 -- 172.21.15.50:0/3602575872 shutdown_connections 2023-12-24T18:36:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.424+0000 7fb59359e700 1 -- 172.21.15.50:0/3602575872 wait complete. 2023-12-24T18:36:22.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.428+0000 7fb59359e700 1 Processor -- start 2023-12-24T18:36:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.428+0000 7fb59359e700 1 -- start start 2023-12-24T18:36:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 0x7fb594148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5940cb310 0x7fb59406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940b3d40 con 0x7fb594156690 2023-12-24T18:36:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940b48c0 con 0x7fb5940caf40 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940b3f90 con 0x7fb5940cb310 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40554/0 (socket says 172.21.15.50:40554) 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 -- 172.21.15.50:0/489189946 learned_addr learned my addr 172.21.15.50:0/489189946 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb591d9b700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5940cb310 0x7fb59406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59259c700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 0x7fb594148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 -- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5940cb310 msgr2=0x7fb59406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5940cb310 0x7fb59406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 -- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 msgr2=0x7fb594148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 0x7fb594148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 -- 172.21.15.50:0/489189946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009420 con 0x7fb594156690 2023-12-24T18:36:22.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59259c700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 0x7fb594148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:22.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb592d9d700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e900 tx=0x7fb58c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c013680 con 0x7fb594156690 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c0137e0 con 0x7fb594156690 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c013be0 con 0x7fb594156690 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5940b4270 con 0x7fb594156690 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.432+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594148c80 con 0x7fb594156690 2023-12-24T18:36:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.436+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59404be40 con 0x7fb594156690 2023-12-24T18:36:22.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.436+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb58c013d40 con 0x7fb594156690 2023-12-24T18:36:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.436+0000 7fb5827fc700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.436+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb58c07c680 con 0x7fb594156690 2023-12-24T18:36:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.440+0000 7fb59259c700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.440+0000 7fb59259c700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 0x7fb574062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb584005c50 tx=0x7fb584009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.444+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb58c04cf20 con 0x7fb594156690 2023-12-24T18:36:22.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.624+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5940ca850 con 0x7fb594156690 2023-12-24T18:36:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.624+0000 7fb5827fc700 1 -- 172.21.15.50:0/489189946 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fb58c050540 con 0x7fb594156690 2023-12-24T18:36:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:22.627 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:19.184167+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 msgr2=0x7fb574062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 0x7fb574062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb584005c50 tx=0x7fb584009040 comp rx=0 tx=0).stop 2023-12-24T18:36:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 msgr2=0x7fb59406aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e900 tx=0x7fb58c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 shutdown_connections 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb594156690 0x7fb59406aaf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5940cb310 0x7fb59406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 --2- 172.21.15.50:0/489189946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5940caf40 0x7fb594148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 >> 172.21.15.50:0/489189946 conn(0x7fb5940670b0 msgr2=0x7fb594155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 shutdown_connections 2023-12-24T18:36:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.628+0000 7fb59359e700 1 -- 172.21.15.50:0/489189946 wait complete. 2023-12-24T18:36:22.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:36:22.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:36:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.816+0000 7fc799585700 1 Processor -- start 2023-12-24T18:36:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.816+0000 7fc799585700 1 -- start start 2023-12-24T18:36:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc799585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc794159080 0x7fc7940cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc799585700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc79406dbf0 0x7fc79415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc799585700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79415d5b0 con 0x7fc79415d180 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc799585700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7940cbee0 con 0x7fc794159080 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc799585700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79406cb50 con 0x7fc79406dbf0 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc794159080 0x7fc7940cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc794159080 0x7fc7940cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40558/0 (socket says 172.21.15.50:40558) 2023-12-24T18:36:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 -- 172.21.15.50:0/1183306008 learned_addr learned my addr 172.21.15.50:0/1183306008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc7927fc700 1 --2- 172.21.15.50:0/1183306008 >> v2:172.21.15.82:3300/0 conn(0x7fc79406dbf0 0x7fc79415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 -- 172.21.15.50:0/1183306008 >> v2:172.21.15.82:3300/0 conn(0x7fc79406dbf0 msgr2=0x7fc79415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 --2- 172.21.15.50:0/1183306008 >> v2:172.21.15.82:3300/0 conn(0x7fc79406dbf0 0x7fc79415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 -- 172.21.15.50:0/1183306008 >> v1:172.21.15.82:6789/0 conn(0x7fc79415d180 legacy=0x7fc794067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 -- 172.21.15.50:0/1183306008 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79406ce30 con 0x7fc794159080 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc791ffb700 1 -- 172.21.15.50:0/1183306008 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851593589 0 0) 0x7fc79415d5b0 con 0x7fc79415d180 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.820+0000 7fc792ffd700 1 --2- 172.21.15.50:0/1183306008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc7940cb9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc79406c330 tx=0x7fc784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc40adf4c3cd979 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc791ffb700 1 -- 172.21.15.50:0/1183306008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784009e70 con 0x7fc794159080 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc791ffb700 1 -- 172.21.15.50:0/1183306008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400b860 con 0x7fc794159080 2023-12-24T18:36:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc791ffb700 1 -- 172.21.15.50:0/1183306008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400bc00 con 0x7fc794159080 2023-12-24T18:36:22.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- 172.21.15.50:0/1183306008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 msgr2=0x7fc7940cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 --2- 172.21.15.50:0/1183306008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc7940cb9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc79406c330 tx=0x7fc784009250 comp rx=0 tx=0).stop 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- 172.21.15.50:0/1183306008 shutdown_connections 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 --2- 172.21.15.50:0/1183306008 >> v2:172.21.15.82:3300/0 conn(0x7fc79406dbf0 0x7fc79415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 --2- 172.21.15.50:0/1183306008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc7940cb9a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- 172.21.15.50:0/1183306008 >> 172.21.15.50:0/1183306008 conn(0x7fc7940cddd0 msgr2=0x7fc7940ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- 172.21.15.50:0/1183306008 shutdown_connections 2023-12-24T18:36:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- 172.21.15.50:0/1183306008 wait complete. 2023-12-24T18:36:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 Processor -- start 2023-12-24T18:36:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.824+0000 7fc799585700 1 -- start start 2023-12-24T18:36:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79406dbf0 0x7fc79416a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc79415d180 0x7fc794169410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79416a3e0 con 0x7fc794159080 2023-12-24T18:36:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79416d960 con 0x7fc79406dbf0 2023-12-24T18:36:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79416aab0 con 0x7fc79415d180 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40572/0 (socket says 172.21.15.50:40572) 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 -- 172.21.15.50:0/2401960520 learned_addr learned my addr 172.21.15.50:0/2401960520 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7937fe700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc79415d180 0x7fc794169410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc792ffd700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79406dbf0 0x7fc79416a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 -- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc79415d180 msgr2=0x7fc794169410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc79415d180 0x7fc794169410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 -- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79406dbf0 msgr2=0x7fc79416a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79406dbf0 0x7fc79416a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 -- 172.21.15.50:0/2401960520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094f0 con 0x7fc794159080 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc7927fc700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc78800e930 tx=0x7fc7880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788013680 con 0x7fc794159080 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7880137e0 con 0x7fc794159080 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940b1ec0 con 0x7fc794159080 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788013b80 con 0x7fc794159080 2023-12-24T18:36:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.828+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794169bc0 con 0x7fc794159080 2023-12-24T18:36:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.832+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7940b2050 con 0x7fc794159080 2023-12-24T18:36:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.832+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc78800c3e0 con 0x7fc794159080 2023-12-24T18:36:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.836+0000 7fc77affd700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 0x7fc780062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.836+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc78807c540 con 0x7fc794159080 2023-12-24T18:36:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.836+0000 7fc792ffd700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 0x7fc780062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.836+0000 7fc792ffd700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 0x7fc780062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc79406c330 tx=0x7fc784017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:22.836+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc78804cde0 con 0x7fc794159080 2023-12-24T18:36:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.012+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7940652e0 con 0x7fc794159080 2023-12-24T18:36:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.012+0000 7fc77affd700 1 -- 172.21.15.50:0/2401960520 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc788050400 con 0x7fc794159080 2023-12-24T18:36:23.015 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 msgr2=0x7fc780062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 0x7fc780062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc79406c330 tx=0x7fc784017000 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 msgr2=0x7fc79416d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc78800e930 tx=0x7fc7880091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 shutdown_connections 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc780060580 0x7fc780062a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc79415d180 0x7fc794169410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc794159080 0x7fc79416d420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 --2- 172.21.15.50:0/2401960520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79406dbf0 0x7fc79416a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 >> 172.21.15.50:0/2401960520 conn(0x7fc7940cddd0 msgr2=0x7fc7941560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 shutdown_connections 2023-12-24T18:36:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.016+0000 7fc799585700 1 -- 172.21.15.50:0/2401960520 wait complete. 2023-12-24T18:36:23.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.196+0000 7f8f83416700 1 Processor -- start 2023-12-24T18:36:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.196+0000 7f8f83416700 1 -- start start 2023-12-24T18:36:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 0x7f8f7c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c0a9c80 con 0x7f8f7c158cd0 2023-12-24T18:36:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c0a9070 con 0x7f8f7c06c0c0 2023-12-24T18:36:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c06c520 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f82414700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f7c158cd0 0x7f8f7c06afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53398/0 (socket says 172.21.15.50:53398) 2023-12-24T18:36:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f82414700 1 -- 172.21.15.50:0/3257009686 learned_addr learned my addr 172.21.15.50:0/3257009686 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81c13700 1 --2- 172.21.15.50:0/3257009686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 0x7f8f7c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81412700 1 -- 172.21.15.50:0/3257009686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481216465 0 0) 0x7f8f7c0a9c80 con 0x7f8f7c158cd0 2023-12-24T18:36:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81412700 1 -- 172.21.15.50:0/3257009686 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f68003570 con 0x7f8f7c158cd0 2023-12-24T18:36:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81c13700 1 -- 172.21.15.50:0/3257009686 >> v1:172.21.15.82:6789/0 conn(0x7f8f7c06c0c0 legacy=0x7f8f7c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81c13700 1 -- 172.21.15.50:0/3257009686 >> v1:172.21.15.50:6789/0 conn(0x7f8f7c158cd0 legacy=0x7f8f7c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81c13700 1 -- 172.21.15.50:0/3257009686 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0a9350 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81c13700 1 --2- 172.21.15.50:0/3257009686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 0x7f8f7c1590a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009910 tx=0x7f8f6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b546f0bbb3cb229 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81412700 1 -- 172.21.15.50:0/3257009686 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00b680 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81412700 1 -- 172.21.15.50:0/3257009686 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00b7e0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f81412700 1 -- 172.21.15.50:0/3257009686 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00bba0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- 172.21.15.50:0/3257009686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 msgr2=0x7f8f7c1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 --2- 172.21.15.50:0/3257009686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 0x7f8f7c1590a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009910 tx=0x7f8f6c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- 172.21.15.50:0/3257009686 shutdown_connections 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 --2- 172.21.15.50:0/3257009686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c06b6c0 0x7f8f7c1590a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- 172.21.15.50:0/3257009686 >> 172.21.15.50:0/3257009686 conn(0x7f8f7c067b80 msgr2=0x7f8f7c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- 172.21.15.50:0/3257009686 shutdown_connections 2023-12-24T18:36:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.200+0000 7f8f83416700 1 -- 172.21.15.50:0/3257009686 wait complete. 2023-12-24T18:36:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 Processor -- start 2023-12-24T18:36:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 -- start start 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f7c06c0c0 0x7f8f7c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c158cd0 0x7f8f7c0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c15bd10 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c15b100 con 0x7f8f7c06c0c0 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f83416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c15b3e0 con 0x7f8f7c158cd0 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f82414700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f82414700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40574/0 (socket says 172.21.15.50:40574) 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f82414700 1 -- 172.21.15.50:0/247197136 learned_addr learned my addr 172.21.15.50:0/247197136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f81c13700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f7c06c0c0 0x7f8f7c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.204+0000 7f8f82c15700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c158cd0 0x7f8f7c0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 -- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c158cd0 msgr2=0x7f8f7c0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c158cd0 0x7f8f7c0ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 -- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f7c06c0c0 msgr2=0x7f8f7c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f7c06c0c0 0x7f8f7c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 -- 172.21.15.50:0/247197136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009420 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f82414700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800c7c0 tx=0x7f8f78007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78005cd0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78005e30 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78007320 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c15b6c0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c140300 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.208+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c04be40 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.212+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8f7801b3b0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.212+0000 7f8f727fc700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 0x7f8f60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.212+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8f7807bbb0 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.212+0000 7f8f81c13700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 0x7f8f60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.212+0000 7f8f81c13700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 0x7f8f60062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0093f0 tx=0x7f8f6c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.216+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8f7804c450 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.432+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f7c06a840 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f727fc700 1 -- 172.21.15.50:0/247197136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f8f78017020 con 0x7f8f7c06b6c0 2023-12-24T18:36:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:23.436 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 msgr2=0x7f8f60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 0x7f8f60062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0093f0 tx=0x7f8f6c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 msgr2=0x7f8f7c13fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800c7c0 tx=0x7f8f78007e00 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 shutdown_connections 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8f60060550 0x7f8f60062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f7c158cd0 0x7f8f7c0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f7c06c0c0 0x7f8f7c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 --2- 172.21.15.50:0/247197136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c06b6c0 0x7f8f7c13fdc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 >> 172.21.15.50:0/247197136 conn(0x7f8f7c067b80 msgr2=0x7f8f7c15daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 shutdown_connections 2023-12-24T18:36:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.436+0000 7f8f83416700 1 -- 172.21.15.50:0/247197136 wait complete. 2023-12-24T18:36:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-12-24T18:36:23.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.608+0000 7f8814345700 1 Processor -- start 2023-12-24T18:36:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.608+0000 7f8814345700 1 -- start start 2023-12-24T18:36:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f8814345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 0x7f880c0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f8814345700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f8814345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c06c090 con 0x7f880c13f920 2023-12-24T18:36:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f8814345700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c06a6a0 con 0x7f880c0cb3c0 2023-12-24T18:36:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f8814345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0cb8a0 con 0x7f880c13f550 2023-12-24T18:36:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88128e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 0x7f880c0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88128e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40576/0 (socket says 172.21.15.50:40576) 2023-12-24T18:36:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88128e2700 1 -- 172.21.15.50:0/2513762917 learned_addr learned my addr 172.21.15.50:0/2513762917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88110df700 1 -- 172.21.15.50:0/2513762917 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055076711 0 0) 0x7f880c06c090 con 0x7f880c13f920 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88110df700 1 -- 172.21.15.50:0/2513762917 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003570 con 0x7f880c13f920 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 -- 172.21.15.50:0/2513762917 >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 msgr2=0x7f880c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 --2- 172.21.15.50:0/2513762917 >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 -- 172.21.15.50:0/2513762917 >> v1:172.21.15.82:6789/0 conn(0x7f880c13f920 legacy=0x7f880c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 -- 172.21.15.50:0/2513762917 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c06a960 con 0x7f880c13f550 2023-12-24T18:36:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88128e2700 1 --2- 172.21.15.50:0/2513762917 >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.612+0000 7f88120e1700 1 --2- 172.21.15.50:0/2513762917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 0x7f880c0ab5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f88080098e0 tx=0x7f88080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6caf1b55081c72 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f88110df700 1 -- 172.21.15.50:0/2513762917 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011630 con 0x7f880c13f550 2023-12-24T18:36:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f88110df700 1 -- 172.21.15.50:0/2513762917 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808011790 con 0x7f880c13f550 2023-12-24T18:36:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f88110df700 1 -- 172.21.15.50:0/2513762917 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011b30 con 0x7f880c13f550 2023-12-24T18:36:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 -- 172.21.15.50:0/2513762917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 msgr2=0x7f880c0ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 --2- 172.21.15.50:0/2513762917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 0x7f880c0ab5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f88080098e0 tx=0x7f88080091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 -- 172.21.15.50:0/2513762917 shutdown_connections 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 --2- 172.21.15.50:0/2513762917 >> v2:172.21.15.50:3300/0 conn(0x7f880c0cb3c0 0x7f880c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 --2- 172.21.15.50:0/2513762917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c13f550 0x7f880c0ab5e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 -- 172.21.15.50:0/2513762917 >> 172.21.15.50:0/2513762917 conn(0x7f880c0cbba0 msgr2=0x7f880c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 -- 172.21.15.50:0/2513762917 shutdown_connections 2023-12-24T18:36:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.616+0000 7f8814345700 1 -- 172.21.15.50:0/2513762917 wait complete. 2023-12-24T18:36:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 Processor -- start 2023-12-24T18:36:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 -- start start 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 0x7f880c138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 0x7f880c139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c16d910 con 0x7f880c13f550 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c16e470 con 0x7f880c13f920 2023-12-24T18:36:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f8814345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c16e900 con 0x7f880c0cb3c0 2023-12-24T18:36:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40584/0 (socket says 172.21.15.50:40584) 2023-12-24T18:36:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 -- 172.21.15.50:0/1095330533 learned_addr learned my addr 172.21.15.50:0/1095330533 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 -- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 msgr2=0x7f880c138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88120e1700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 0x7f880c138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88128e2700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 0x7f880c139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 0x7f880c138830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 -- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 msgr2=0x7f880c139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 0x7f880c139750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88118e0700 1 -- 172.21.15.50:0/1095330533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009ae0 con 0x7f880c13f550 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88120e1700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 0x7f880c138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.620+0000 7f88128e2700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 0x7f880c139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f88118e0700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c790 tx=0x7f87fc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc010510 con 0x7f880c13f550 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc010670 con 0x7f880c13f550 2023-12-24T18:36:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc010a10 con 0x7f880c13f550 2023-12-24T18:36:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808009420 con 0x7f880c13f550 2023-12-24T18:36:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c16de20 con 0x7f880c13f550 2023-12-24T18:36:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c16e5e0 con 0x7f880c13f550 2023-12-24T18:36:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.624+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f87fc01b400 con 0x7f880c13f550 2023-12-24T18:36:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.628+0000 7f88027fc700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 0x7f87f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.628+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f87fc07c290 con 0x7f880c13f550 2023-12-24T18:36:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.628+0000 7f88120e1700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 0x7f87f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:23.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.628+0000 7f88120e1700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 0x7f87f0062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f880c14dfd0 tx=0x7f8808017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.636+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f87fc04cb30 con 0x7f880c13f550 2023-12-24T18:36:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.820+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f880c0652e0 con 0x7f880c13f550 2023-12-24T18:36:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.824+0000 7f88027fc700 1 -- 172.21.15.50:0/1095330533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f87fc065e60 con 0x7f880c13f550 2023-12-24T18:36:23.825 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:23.826 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:19.184167+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 msgr2=0x7f87f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 0x7f87f0062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f880c14dfd0 tx=0x7f8808017000 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 msgr2=0x7f880c139210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c790 tx=0x7f87fc007e10 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 shutdown_connections 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f87f0060550 0x7f87f0062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c13f920 0x7f880c139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f880c13f550 0x7f880c139210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 --2- 172.21.15.50:0/1095330533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880c0cb3c0 0x7f880c138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 >> 172.21.15.50:0/1095330533 conn(0x7f880c0cbba0 msgr2=0x7f880c0c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 shutdown_connections 2023-12-24T18:36:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:23.828+0000 7f8814345700 1 -- 172.21.15.50:0/1095330533 wait complete. 2023-12-24T18:36:23.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:36:23.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:36:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.016+0000 7f78e8843700 1 Processor -- start 2023-12-24T18:36:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.016+0000 7f78e8843700 1 -- start start 2023-12-24T18:36:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e8843700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4155ab0 0x7f78e40c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e8843700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e40c6090 con 0x7f78e4155e80 2023-12-24T18:36:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e8843700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e40adab0 con 0x7f78e40ad450 2023-12-24T18:36:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e8843700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40ad8b0 con 0x7f78e4155ab0 2023-12-24T18:36:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4155ab0 0x7f78e40c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4155ab0 0x7f78e40c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56700/0 (socket says 172.21.15.50:56700) 2023-12-24T18:36:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 -- 172.21.15.50:0/1332334524 learned_addr learned my addr 172.21.15.50:0/1332334524 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e2ffd700 1 --1- 172.21.15.50:0/1332334524 >> v1:172.21.15.50:6789/0 conn(0x7f78e4155e80 0x7f78e40acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53406/0 (socket says 172.21.15.50:53406) 2023-12-24T18:36:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 -- 172.21.15.50:0/1332334524 >> v1:172.21.15.82:6789/0 conn(0x7f78e40ad450 legacy=0x7f78e40c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 -- 172.21.15.50:0/1332334524 >> v1:172.21.15.50:6789/0 conn(0x7f78e4155e80 legacy=0x7f78e40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.020+0000 7f78e37fe700 1 -- 172.21.15.50:0/1332334524 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40add90 con 0x7f78e4155ab0 2023-12-24T18:36:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e37fe700 1 --2- 172.21.15.50:0/1332334524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4155ab0 0x7f78e40c87d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78d40099b0 tx=0x7f78d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ebda141ec80979 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e27fc700 1 -- 172.21.15.50:0/1332334524 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400b860 con 0x7f78e4155ab0 2023-12-24T18:36:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e27fc700 1 -- 172.21.15.50:0/1332334524 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d400b9c0 con 0x7f78e4155ab0 2023-12-24T18:36:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e27fc700 1 -- 172.21.15.50:0/1332334524 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400bd60 con 0x7f78e4155ab0 2023-12-24T18:36:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- 172.21.15.50:0/1332334524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4155ab0 msgr2=0x7f78e40c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 --2- 172.21.15.50:0/1332334524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4155ab0 0x7f78e40c87d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78d40099b0 tx=0x7f78d4009250 comp rx=0 tx=0).stop 2023-12-24T18:36:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- 172.21.15.50:0/1332334524 shutdown_connections 2023-12-24T18:36:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 --2- 172.21.15.50:0/1332334524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4155ab0 0x7f78e40c87d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- 172.21.15.50:0/1332334524 >> 172.21.15.50:0/1332334524 conn(0x7f78e4067250 msgr2=0x7f78e4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- 172.21.15.50:0/1332334524 shutdown_connections 2023-12-24T18:36:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- 172.21.15.50:0/1332334524 wait complete. 2023-12-24T18:36:24.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 Processor -- start 2023-12-24T18:36:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.024+0000 7f78e8843700 1 -- start start 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 0x7f78e4168ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78e4155ab0 0x7f78e40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4169530 con 0x7f78e4155e80 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40c7e40 con 0x7f78e40ad450 2023-12-24T18:36:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e414be90 con 0x7f78e4155ab0 2023-12-24T18:36:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40592/0 (socket says 172.21.15.50:40592) 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e3fff700 1 -- 172.21.15.50:0/3650962126 learned_addr learned my addr 172.21.15.50:0/3650962126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 0x7f78e4168ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e2ffd700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78e4155ab0 0x7f78e40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 -- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78e4155ab0 msgr2=0x7f78e40c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78e4155ab0 0x7f78e40c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 -- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 msgr2=0x7f78e414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 -- 172.21.15.50:0/3650962126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40094f0 con 0x7f78e40ad450 2023-12-24T18:36:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e3fff700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e37fe700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 0x7f78e4168ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a5a0 tx=0x7f78d4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4022070 con 0x7f78e40ad450 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4011630 con 0x7f78e40ad450 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e40c41a0 con 0x7f78e40ad450 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d40119d0 con 0x7f78e40ad450 2023-12-24T18:36:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.028+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e4165360 con 0x7f78e40ad450 2023-12-24T18:36:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.032+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e404be40 con 0x7f78e40ad450 2023-12-24T18:36:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.032+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f78d402f3b0 con 0x7f78e40ad450 2023-12-24T18:36:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.036+0000 7f78cb7fe700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 0x7f78d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.036+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f78d4081a20 con 0x7f78e40ad450 2023-12-24T18:36:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.036+0000 7f78e2ffd700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 0x7f78d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.036+0000 7f78e2ffd700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 0x7f78d0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78e406d860 tx=0x7f78d8007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.044+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f78d4052340 con 0x7f78e40ad450 2023-12-24T18:36:24.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.224+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78e40ae070 con 0x7f78e40ad450 2023-12-24T18:36:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.224+0000 7f78cb7fe700 1 -- 172.21.15.50:0/3650962126 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78d402b020 con 0x7f78e40ad450 2023-12-24T18:36:24.225 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 msgr2=0x7f78d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 0x7f78d0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78e406d860 tx=0x7f78d8007eb0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 msgr2=0x7f78e4168ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 0x7f78e4168ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a5a0 tx=0x7f78d4017000 comp rx=0 tx=0).stop 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 shutdown_connections 2023-12-24T18:36:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f78d0060550 0x7f78d0062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e4155e80 0x7f78e414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78e4155ab0 0x7f78e40c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 --2- 172.21.15.50:0/3650962126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40ad450 0x7f78e4168ff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 >> 172.21.15.50:0/3650962126 conn(0x7f78e4067250 msgr2=0x7f78e406a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 shutdown_connections 2023-12-24T18:36:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.228+0000 7f78e8843700 1 -- 172.21.15.50:0/3650962126 wait complete. 2023-12-24T18:36:24.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:36:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.412+0000 7fb37cf23700 1 Processor -- start 2023-12-24T18:36:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb37cf23700 1 -- start start 2023-12-24T18:36:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb37cf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 0x7fb3781591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb37cf23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37806b640 con 0x7fb37806d8c0 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb37cf23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780b5e10 con 0x7fb378158e00 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb37cf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb378159710 con 0x7fb3780b41e0 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb377fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb37806d8c0 0x7fb378159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53416/0 (socket says 172.21.15.50:53416) 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb377fff700 1 -- 172.21.15.50:0/3364501250 learned_addr learned my addr 172.21.15.50:0/3364501250 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb376ffd700 1 --2- 172.21.15.50:0/3364501250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 0x7fb3781591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb3767fc700 1 -- 172.21.15.50:0/3364501250 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773846903 0 0) 0x7fb37806b640 con 0x7fb37806d8c0 2023-12-24T18:36:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.416+0000 7fb3767fc700 1 -- 172.21.15.50:0/3364501250 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb360003570 con 0x7fb37806d8c0 2023-12-24T18:36:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb376ffd700 1 -- 172.21.15.50:0/3364501250 >> v1:172.21.15.82:6789/0 conn(0x7fb378158e00 legacy=0x7fb3780b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb376ffd700 1 -- 172.21.15.50:0/3364501250 >> v1:172.21.15.50:6789/0 conn(0x7fb37806d8c0 legacy=0x7fb378159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb376ffd700 1 -- 172.21.15.50:0/3364501250 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37806b8e0 con 0x7fb3780b41e0 2023-12-24T18:36:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb376ffd700 1 --2- 172.21.15.50:0/3364501250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 0x7fb3781591d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009890 tx=0x7fb36c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a88d95a52c99789 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb3767fc700 1 -- 172.21.15.50:0/3364501250 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011630 con 0x7fb3780b41e0 2023-12-24T18:36:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb3767fc700 1 -- 172.21.15.50:0/3364501250 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c011790 con 0x7fb3780b41e0 2023-12-24T18:36:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb3767fc700 1 -- 172.21.15.50:0/3364501250 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011b50 con 0x7fb3780b41e0 2023-12-24T18:36:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 -- 172.21.15.50:0/3364501250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 msgr2=0x7fb3781591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 --2- 172.21.15.50:0/3364501250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 0x7fb3781591d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009890 tx=0x7fb36c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 -- 172.21.15.50:0/3364501250 shutdown_connections 2023-12-24T18:36:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 --2- 172.21.15.50:0/3364501250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3780b41e0 0x7fb3781591d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 -- 172.21.15.50:0/3364501250 >> 172.21.15.50:0/3364501250 conn(0x7fb378067b80 msgr2=0x7fb3780b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 -- 172.21.15.50:0/3364501250 shutdown_connections 2023-12-24T18:36:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.420+0000 7fb37cf23700 1 -- 172.21.15.50:0/3364501250 wait complete. 2023-12-24T18:36:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 Processor -- start 2023-12-24T18:36:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 -- start start 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3780b41e0 0x7fb3780ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb378158e00 0x7fb3780ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37815eee0 con 0x7fb37806d8c0 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37815e2d0 con 0x7fb3780b41e0 2023-12-24T18:36:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb37cf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37815e5b0 con 0x7fb378158e00 2023-12-24T18:36:24.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40594/0 (socket says 172.21.15.50:40594) 2023-12-24T18:36:24.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 -- 172.21.15.50:0/2167714564 learned_addr learned my addr 172.21.15.50:0/2167714564 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:24.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb376ffd700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3780b41e0 0x7fb3780ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb377fff700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb378158e00 0x7fb3780ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 -- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb378158e00 msgr2=0x7fb3780ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb378158e00 0x7fb3780ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 -- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3780b41e0 msgr2=0x7fb3780ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3780b41e0 0x7fb3780ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 -- 172.21.15.50:0/2167714564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009420 con 0x7fb37806d8c0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.424+0000 7fb3777fe700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c810 tx=0x7fb368007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011590 con 0x7fb37806d8c0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3680116f0 con 0x7fb37806d8c0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37815e890 con 0x7fb37806d8c0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011ab0 con 0x7fb37806d8c0 2023-12-24T18:36:24.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3780b0680 con 0x7fb37806d8c0 2023-12-24T18:36:24.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37804be40 con 0x7fb37806d8c0 2023-12-24T18:36:24.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.428+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb36801b3b0 con 0x7fb37806d8c0 2023-12-24T18:36:24.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.432+0000 7fb35f7fe700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 0x7fb364062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.432+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb36807baa0 con 0x7fb37806d8c0 2023-12-24T18:36:24.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.432+0000 7fb376ffd700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 0x7fb364062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.432+0000 7fb376ffd700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 0x7fb364062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009890 tx=0x7fb36c016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.436+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb36804c340 con 0x7fb37806d8c0 2023-12-24T18:36:24.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.612+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb37806bbc0 con 0x7fb37806d8c0 2023-12-24T18:36:24.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.616+0000 7fb35f7fe700 1 -- 172.21.15.50:0/2167714564 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb368017020 con 0x7fb37806d8c0 2023-12-24T18:36:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:36:24.616 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 msgr2=0x7fb364062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 0x7fb364062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009890 tx=0x7fb36c016000 comp rx=0 tx=0).stop 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 msgr2=0x7fb37815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c810 tx=0x7fb368007ee0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 shutdown_connections 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb364060550 0x7fb364062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb378158e00 0x7fb3780ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3780b41e0 0x7fb3780ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 --2- 172.21.15.50:0/2167714564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb37806d8c0 0x7fb37815f370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 >> 172.21.15.50:0/2167714564 conn(0x7fb378067b80 msgr2=0x7fb3780a9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:24.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 shutdown_connections 2023-12-24T18:36:24.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.620+0000 7fb37cf23700 1 -- 172.21.15.50:0/2167714564 wait complete. 2023-12-24T18:36:24.640 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:36:24.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:36:24.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 Processor -- start 2023-12-24T18:36:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 -- start start 2023-12-24T18:36:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0280159080 0x7f028006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 0x7f02800cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028006b5b0 con 0x7f028006a4a0 2023-12-24T18:36:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028015dbd0 con 0x7f0280159080 2023-12-24T18:36:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f02872e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028006df80 con 0x7f02800c5c90 2023-12-24T18:36:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f0285ae0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f028006a4a0 0x7f02800c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53426/0 (socket says 172.21.15.50:53426) 2023-12-24T18:36:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.812+0000 7f0285ae0700 1 -- 172.21.15.50:0/2617754716 learned_addr learned my addr 172.21.15.50:0/2617754716 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 --2- 172.21.15.50:0/2617754716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 0x7f02800cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02862e1700 1 --2- 172.21.15.50:0/2617754716 >> v2:172.21.15.82:3300/0 conn(0x7f0280159080 0x7f028006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02852df700 1 -- 172.21.15.50:0/2617754716 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724311772 0 0) 0x7f028006b5b0 con 0x7f028006a4a0 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02852df700 1 -- 172.21.15.50:0/2617754716 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c003570 con 0x7f028006a4a0 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 -- 172.21.15.50:0/2617754716 >> v2:172.21.15.82:3300/0 conn(0x7f0280159080 msgr2=0x7f028006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 --2- 172.21.15.50:0/2617754716 >> v2:172.21.15.82:3300/0 conn(0x7f0280159080 0x7f028006da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 -- 172.21.15.50:0/2617754716 >> v1:172.21.15.50:6789/0 conn(0x7f028006a4a0 legacy=0x7f02800c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 -- 172.21.15.50:0/2617754716 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028006a9a0 con 0x7f02800c5c90 2023-12-24T18:36:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f0286ae2700 1 --2- 172.21.15.50:0/2617754716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 0x7f02800cab30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0278009e60 tx=0x7f0278009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425ad526295559a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02852df700 1 -- 172.21.15.50:0/2617754716 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800e070 con 0x7f02800c5c90 2023-12-24T18:36:24.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02852df700 1 -- 172.21.15.50:0/2617754716 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800bab0 con 0x7f02800c5c90 2023-12-24T18:36:24.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02852df700 1 -- 172.21.15.50:0/2617754716 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800be70 con 0x7f02800c5c90 2023-12-24T18:36:24.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02872e3700 1 -- 172.21.15.50:0/2617754716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 msgr2=0x7f02800cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.816+0000 7f02872e3700 1 --2- 172.21.15.50:0/2617754716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 0x7f02800cab30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0278009e60 tx=0x7f0278009780 comp rx=0 tx=0).stop 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 -- 172.21.15.50:0/2617754716 shutdown_connections 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 --2- 172.21.15.50:0/2617754716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02800c5c90 0x7f02800cab30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 --2- 172.21.15.50:0/2617754716 >> v2:172.21.15.82:3300/0 conn(0x7f0280159080 0x7f028006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 -- 172.21.15.50:0/2617754716 >> 172.21.15.50:0/2617754716 conn(0x7f0280067b80 msgr2=0x7f02800cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 -- 172.21.15.50:0/2617754716 shutdown_connections 2023-12-24T18:36:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 -- 172.21.15.50:0/2617754716 wait complete. 2023-12-24T18:36:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.820+0000 7f02872e3700 1 Processor -- start 2023-12-24T18:36:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 -- start start 2023-12-24T18:36:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 0x7f028014c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 0x7f02800b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02800b5210 con 0x7f02800c5c90 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280159ee0 con 0x7f028006a4a0 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02872e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02800c8880 con 0x7f0280159080 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40596/0 (socket says 172.21.15.50:40596) 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 -- 172.21.15.50:0/213754205 learned_addr learned my addr 172.21.15.50:0/213754205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02862e1700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 0x7f028014c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0286ae2700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 0x7f02800b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 -- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 msgr2=0x7f02800b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 0x7f02800b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 -- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 msgr2=0x7f028014c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 0x7f028014c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 -- 172.21.15.50:0/213754205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009a20 con 0x7f02800c5c90 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02862e1700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 0x7f028014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0286ae2700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 0x7f02800b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f0285ae0700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f027000c590 tx=0x7f0270007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.824+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270005c00 con 0x7f02800c5c90 2023-12-24T18:36:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.828+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0270005d60 con 0x7f02800c5c90 2023-12-24T18:36:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.828+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270007300 con 0x7f02800c5c90 2023-12-24T18:36:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.828+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801595f0 con 0x7f02800c5c90 2023-12-24T18:36:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.828+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0280159b70 con 0x7f02800c5c90 2023-12-24T18:36:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.828+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028015a070 con 0x7f02800c5c90 2023-12-24T18:36:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.832+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f02700076b0 con 0x7f02800c5c90 2023-12-24T18:36:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.832+0000 7f02767fc700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 0x7f0264062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.832+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f027007b8f0 con 0x7f02800c5c90 2023-12-24T18:36:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.832+0000 7f02862e1700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 0x7f0264062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.832+0000 7f02862e1700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 0x7f0264062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f027c009d80 tx=0x7f027c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:24.840+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f027004c230 con 0x7f02800c5c90 2023-12-24T18:36:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:25.012+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f028004be40 con 0x7f02800c5c90 2023-12-24T18:36:25.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:36:25.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:36:26.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.020+0000 7f02767fc700 1 -- 172.21.15.50:0/213754205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02700170b0 con 0x7f02800c5c90 2023-12-24T18:36:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 msgr2=0x7f0264062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 0x7f0264062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f027c009d80 tx=0x7f027c008040 comp rx=0 tx=0).stop 2023-12-24T18:36:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 msgr2=0x7f02800b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f027000c590 tx=0x7f0270007dd0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 shutdown_connections 2023-12-24T18:36:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0264060580 0x7f0264062a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0280159080 0x7f02800b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02800c5c90 0x7f02800b4640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 --2- 172.21.15.50:0/213754205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f028006a4a0 0x7f028014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 >> 172.21.15.50:0/213754205 conn(0x7f0280067b80 msgr2=0x7f02800c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:26.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.028+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 shutdown_connections 2023-12-24T18:36:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.032+0000 7f02872e3700 1 -- 172.21.15.50:0/213754205 wait complete. 2023-12-24T18:36:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:36:26.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-24T18:36:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 Processor -- start 2023-12-24T18:36:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 -- start start 2023-12-24T18:36:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb0159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2bb006ae10 0x7f2bb00a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb006cca0 con 0x7f2bb00a9290 2023-12-24T18:36:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb00a9cc0 con 0x7f2bb006ae10 2023-12-24T18:36:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb7145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00a9fa0 con 0x7f2bb0158db0 2023-12-24T18:36:26.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2ba7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2bb00a9290 0x7f2bb006a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53436/0 (socket says 172.21.15.50:53436) 2023-12-24T18:36:26.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2ba7fff700 1 -- 172.21.15.50:0/106762955 learned_addr learned my addr 172.21.15.50:0/106762955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:26.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb4ee1700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb56e2700 1 --2- 172.21.15.50:0/106762955 >> v2:172.21.15.82:3300/0 conn(0x7f2bb006ae10 0x7f2bb00a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb56e2700 1 -- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 msgr2=0x7f2bb0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb56e2700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb56e2700 1 -- 172.21.15.50:0/106762955 >> v1:172.21.15.50:6789/0 conn(0x7f2bb00a9290 legacy=0x7f2bb006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.232+0000 7f2bb56e2700 1 -- 172.21.15.50:0/106762955 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb006c930 con 0x7f2bb006ae10 2023-12-24T18:36:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb56e2700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb006ae10 0x7f2bb00a96e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e90 tx=0x7f2ba8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70b65ce9e66d1ba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2ba77fe700 1 -- 172.21.15.50:0/106762955 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800e070 con 0x7f2bb006ae10 2023-12-24T18:36:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2ba77fe700 1 -- 172.21.15.50:0/106762955 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba800bb30 con 0x7f2bb006ae10 2023-12-24T18:36:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2ba77fe700 1 -- 172.21.15.50:0/106762955 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8012430 con 0x7f2bb006ae10 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 -- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb006ae10 msgr2=0x7f2bb00a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb006ae10 0x7f2bb00a96e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e90 tx=0x7f2ba8009780 comp rx=0 tx=0).stop 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 -- 172.21.15.50:0/106762955 shutdown_connections 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb006ae10 0x7f2bb00a96e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 --2- 172.21.15.50:0/106762955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 -- 172.21.15.50:0/106762955 >> 172.21.15.50:0/106762955 conn(0x7f2bb0067b80 msgr2=0x7f2bb00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 -- 172.21.15.50:0/106762955 shutdown_connections 2023-12-24T18:36:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 -- 172.21.15.50:0/106762955 wait complete. 2023-12-24T18:36:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.236+0000 7f2bb7145700 1 Processor -- start 2023-12-24T18:36:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 -- start start 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb00a9290 0x7f2bb0146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0154600 con 0x7f2bb006ae10 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01548e0 con 0x7f2bb00a9290 2023-12-24T18:36:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0154bc0 con 0x7f2bb0158db0 2023-12-24T18:36:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40598/0 (socket says 172.21.15.50:40598) 2023-12-24T18:36:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 -- 172.21.15.50:0/500883861 learned_addr learned my addr 172.21.15.50:0/500883861 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2ba7fff700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb00a9290 0x7f2bb0146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb56e2700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 -- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 msgr2=0x7f2bb015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 -- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb00a9290 msgr2=0x7f2bb0146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb00a9290 0x7f2bb0146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 -- 172.21.15.50:0/500883861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8009a20 con 0x7f2bb006ae10 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb4ee1700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00ec80 tx=0x7f2bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00c9d0 con 0x7f2bb006ae10 2023-12-24T18:36:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00cb30 con 0x7f2bb006ae10 2023-12-24T18:36:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac013470 con 0x7f2bb006ae10 2023-12-24T18:36:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.240+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb0154ea0 con 0x7f2bb006ae10 2023-12-24T18:36:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.244+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb01696d0 con 0x7f2bb006ae10 2023-12-24T18:36:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.244+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb00652e0 con 0x7f2bb006ae10 2023-12-24T18:36:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.248+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2bac013820 con 0x7f2bb006ae10 2023-12-24T18:36:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.248+0000 7f2ba4ff9700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 0x7f2b9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.248+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2bac07c930 con 0x7f2bb006ae10 2023-12-24T18:36:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.248+0000 7f2ba7fff700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 0x7f2b9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.248+0000 7f2ba7fff700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 0x7f2b9c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0158710 tx=0x7f2ba0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:26.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.252+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2bac04d100 con 0x7f2bb006ae10 2023-12-24T18:36:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:26.420+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f2bb00aa280 con 0x7f2bb006ae10 2023-12-24T18:36:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.032+0000 7f2ba4ff9700 1 -- 172.21.15.50:0/500883861 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f2bac050720 con 0x7f2bb006ae10 2023-12-24T18:36:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 msgr2=0x7f2b9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 0x7f2b9c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0158710 tx=0x7f2ba0009040 comp rx=0 tx=0).stop 2023-12-24T18:36:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 msgr2=0x7f2bb0169190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00ec80 tx=0x7f2bac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 shutdown_connections 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2b9c060550 0x7f2b9c062a00 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0158710 tx=0x7f2ba0009040 comp rx=0 tx=0).stop 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb0158db0 0x7f2bb015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb00a9290 0x7f2bb0146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 --2- 172.21.15.50:0/500883861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb006ae10 0x7f2bb0169190 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00ec80 tx=0x7f2bac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.040+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 >> 172.21.15.50:0/500883861 conn(0x7f2bb0067b80 msgr2=0x7f2bb006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.044+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 shutdown_connections 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.044+0000 7f2bb7145700 1 -- 172.21.15.50:0/500883861 wait complete. 2023-12-24T18:36:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:36:27.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:36:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.288+0000 7faa85e8e700 1 Processor -- start 2023-12-24T18:36:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.288+0000 7faa85e8e700 1 -- start start 2023-12-24T18:36:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa85e8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 0x7faa800cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa85e8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa800cc780 0x7faa800ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa85e8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8006a580 con 0x7faa8006cd40 2023-12-24T18:36:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa85e8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800cd110 con 0x7faa800cc780 2023-12-24T18:36:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa85e8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8006a7d0 con 0x7faa80158c40 2023-12-24T18:36:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa800cc780 0x7faa800ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa800cc780 0x7faa800ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40602/0 (socket says 172.21.15.50:40602) 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 -- 172.21.15.50:0/4067601568 learned_addr learned my addr 172.21.15.50:0/4067601568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa84e8c700 1 --2- 172.21.15.50:0/4067601568 >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 0x7faa800cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 -- 172.21.15.50:0/4067601568 >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 msgr2=0x7faa800cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 --2- 172.21.15.50:0/4067601568 >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 0x7faa800cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 -- 172.21.15.50:0/4067601568 >> v1:172.21.15.82:6789/0 conn(0x7faa8006cd40 legacy=0x7faa8006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 -- 172.21.15.50:0/4067601568 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8006aab0 con 0x7faa800cc780 2023-12-24T18:36:27.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa84e8c700 1 --2- 172.21.15.50:0/4067601568 >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 0x7faa800cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:27.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.292+0000 7faa7ffff700 1 --2- 172.21.15.50:0/4067601568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa800ccbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa80069f90 tx=0x7faa6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a425a575368f6862 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa7f7fe700 1 -- 172.21.15.50:0/4067601568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00b860 con 0x7faa800cc780 2023-12-24T18:36:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa7f7fe700 1 -- 172.21.15.50:0/4067601568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00b9c0 con 0x7faa800cc780 2023-12-24T18:36:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa7f7fe700 1 -- 172.21.15.50:0/4067601568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00bd60 con 0x7faa800cc780 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 -- 172.21.15.50:0/4067601568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 msgr2=0x7faa800ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 --2- 172.21.15.50:0/4067601568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa800ccbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa80069f90 tx=0x7faa6c009250 comp rx=0 tx=0).stop 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 -- 172.21.15.50:0/4067601568 shutdown_connections 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 --2- 172.21.15.50:0/4067601568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa800ccbd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 --2- 172.21.15.50:0/4067601568 >> v2:172.21.15.82:3300/0 conn(0x7faa80158c40 0x7faa800cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 -- 172.21.15.50:0/4067601568 >> 172.21.15.50:0/4067601568 conn(0x7faa800d0800 msgr2=0x7faa800b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 -- 172.21.15.50:0/4067601568 shutdown_connections 2023-12-24T18:36:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 -- 172.21.15.50:0/4067601568 wait complete. 2023-12-24T18:36:27.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.296+0000 7faa85e8e700 1 Processor -- start 2023-12-24T18:36:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- start start 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8006cd40 0x7faa8013e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 0x7faa801691c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8014d230 con 0x7faa800cc780 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8013ed20 con 0x7faa80158c40 2023-12-24T18:36:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8014fae0 con 0x7faa8006cd40 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40612/0 (socket says 172.21.15.50:40612) 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 -- 172.21.15.50:0/1800561352 learned_addr learned my addr 172.21.15.50:0/1800561352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa84e8c700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8006cd40 0x7faa8013e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa8568d700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 0x7faa801691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 -- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8006cd40 msgr2=0x7faa8013e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8006cd40 0x7faa8013e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 -- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 msgr2=0x7faa801691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 0x7faa801691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 -- 172.21.15.50:0/1800561352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0094f0 con 0x7faa800cc780 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa8568d700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 0x7faa801691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7ffff700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0090b0 tx=0x7faa6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c011e20 con 0x7faa800cc780 2023-12-24T18:36:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c01f070 con 0x7faa800cc780 2023-12-24T18:36:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c01a890 con 0x7faa800cc780 2023-12-24T18:36:27.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa80150380 con 0x7faa800cc780 2023-12-24T18:36:27.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.300+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8014fd30 con 0x7faa800cc780 2023-12-24T18:36:27.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.304+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80150510 con 0x7faa800cc780 2023-12-24T18:36:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.304+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faa6c01ac00 con 0x7faa800cc780 2023-12-24T18:36:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.304+0000 7faa7cff9700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 0x7faa64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.308+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7faa6c021070 con 0x7faa800cc780 2023-12-24T18:36:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.308+0000 7faa84e8c700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 0x7faa64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.308+0000 7faa84e8c700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 0x7faa64062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa74006f00 tx=0x7faa74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.312+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa6c04ece0 con 0x7faa800cc780 2023-12-24T18:36:27.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:27.524+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faa8004be40 con 0x7faa800cc780 2023-12-24T18:36:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.116+0000 7faa7cff9700 1 -- 172.21.15.50:0/1800561352 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7faa6c0150c0 con 0x7faa800cc780 2023-12-24T18:36:28.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.124+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 msgr2=0x7faa64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.124+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 0x7faa64062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa74006f00 tx=0x7faa74008040 comp rx=0 tx=0).stop 2023-12-24T18:36:28.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.124+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 msgr2=0x7faa8014c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.124+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0090b0 tx=0x7faa6c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 shutdown_connections 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa64060550 0x7faa64062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa80158c40 0x7faa801691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa800cc780 0x7faa8014c600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 --2- 172.21.15.50:0/1800561352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8006cd40 0x7faa8013e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 >> 172.21.15.50:0/1800561352 conn(0x7faa800d0800 msgr2=0x7faa8006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.128+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 shutdown_connections 2023-12-24T18:36:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.132+0000 7faa85e8e700 1 -- 172.21.15.50:0/1800561352 wait complete. 2023-12-24T18:36:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2023-12-24T18:36:28.156 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-24T18:36:28.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-24T18:36:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.320+0000 7f983af85700 1 Processor -- start 2023-12-24T18:36:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.324+0000 7f983af85700 1 -- start start 2023-12-24T18:36:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f983af85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9834157df0 0x7f98340c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f983af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 0x7f98340c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f983af85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983406ca30 con 0x7f98341581c0 2023-12-24T18:36:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f983af85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9834069150 con 0x7f9834157df0 2023-12-24T18:36:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f983af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834069430 con 0x7f9834068bc0 2023-12-24T18:36:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9833fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98341581c0 0x7f98340684b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53444/0 (socket says 172.21.15.50:53444) 2023-12-24T18:36:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9833fff700 1 -- 172.21.15.50:0/1972264958 learned_addr learned my addr 172.21.15.50:0/1972264958 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 --2- 172.21.15.50:0/1972264958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 0x7f98340c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9838d21700 1 --2- 172.21.15.50:0/1972264958 >> v2:172.21.15.82:3300/0 conn(0x7f9834157df0 0x7f98340c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f98337fe700 1 -- 172.21.15.50:0/1972264958 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450314675 0 0) 0x7f983406ca30 con 0x7f98341581c0 2023-12-24T18:36:28.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f98337fe700 1 -- 172.21.15.50:0/1972264958 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003570 con 0x7f98341581c0 2023-12-24T18:36:28.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 -- 172.21.15.50:0/1972264958 >> v2:172.21.15.82:3300/0 conn(0x7f9834157df0 msgr2=0x7f98340c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 --2- 172.21.15.50:0/1972264958 >> v2:172.21.15.82:3300/0 conn(0x7f9834157df0 0x7f98340c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 -- 172.21.15.50:0/1972264958 >> v1:172.21.15.50:6789/0 conn(0x7f98341581c0 legacy=0x7f98340684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 -- 172.21.15.50:0/1972264958 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834069710 con 0x7f9834068bc0 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f9839522700 1 --2- 172.21.15.50:0/1972264958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 0x7f98340c7a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f982c009e60 tx=0x7f982c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de7d2f955f8cb66c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f98337fe700 1 -- 172.21.15.50:0/1972264958 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00e070 con 0x7f9834068bc0 2023-12-24T18:36:28.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f98337fe700 1 -- 172.21.15.50:0/1972264958 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00bab0 con 0x7f9834068bc0 2023-12-24T18:36:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.328+0000 7f98337fe700 1 -- 172.21.15.50:0/1972264958 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00be50 con 0x7f9834068bc0 2023-12-24T18:36:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- 172.21.15.50:0/1972264958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 msgr2=0x7f98340c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- 172.21.15.50:0/1972264958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 0x7f98340c7a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f982c009e60 tx=0x7f982c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- 172.21.15.50:0/1972264958 shutdown_connections 2023-12-24T18:36:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- 172.21.15.50:0/1972264958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834068bc0 0x7f98340c7a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- 172.21.15.50:0/1972264958 >> v2:172.21.15.82:3300/0 conn(0x7f9834157df0 0x7f98340c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- 172.21.15.50:0/1972264958 >> 172.21.15.50:0/1972264958 conn(0x7f98340ccf90 msgr2=0x7f98340c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- 172.21.15.50:0/1972264958 shutdown_connections 2023-12-24T18:36:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- 172.21.15.50:0/1972264958 wait complete. 2023-12-24T18:36:28.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 Processor -- start 2023-12-24T18:36:28.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- start start 2023-12-24T18:36:28.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834157df0 0x7f9834150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 0x7f98341531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c3cb0 con 0x7f9834068bc0 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341546b0 con 0x7f98341581c0 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.332+0000 7f983af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834156aa0 con 0x7f9834157df0 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40622/0 (socket says 172.21.15.50:40622) 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9839522700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 0x7f98341531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 -- 172.21.15.50:0/1095070085 learned_addr learned my addr 172.21.15.50:0/1095070085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9833fff700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834157df0 0x7f9834150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 -- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834157df0 msgr2=0x7f9834150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834157df0 0x7f9834150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 -- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 msgr2=0x7f98341531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 0x7f98341531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 -- 172.21.15.50:0/1095070085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c009a20 con 0x7f9834068bc0 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9839522700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 0x7f98341531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:28.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9838d21700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f982800ec80 tx=0x7f98280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800c850 con 0x7f9834068bc0 2023-12-24T18:36:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800c9b0 con 0x7f9834068bc0 2023-12-24T18:36:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340c36a0 con 0x7f9834068bc0 2023-12-24T18:36:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800cd50 con 0x7f9834068bc0 2023-12-24T18:36:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.336+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340c3940 con 0x7f9834068bc0 2023-12-24T18:36:28.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.340+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98340c1970 con 0x7f9834068bc0 2023-12-24T18:36:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.340+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9828013680 con 0x7f9834068bc0 2023-12-24T18:36:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.340+0000 7f9830ff9700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 0x7f9818062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.340+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f982807cd30 con 0x7f9834068bc0 2023-12-24T18:36:28.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.340+0000 7f9833fff700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 0x7f9818062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.344+0000 7f9833fff700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 0x7f9818062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98340abcd0 tx=0x7f9820009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.348+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f98340c1970 con 0x7f9834068bc0 2023-12-24T18:36:28.410 INFO:tasks.ceph.mds.d.smithi082.stderr:2023-12-24T18:36:28.405+0000 7f1184c86700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:36:28.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:28.536+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f98340c1970 con 0x7f9834068bc0 2023-12-24T18:36:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.112+0000 7f9830ff9700 1 -- 172.21.15.50:0/1095070085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f98340c1970 con 0x7f9834068bc0 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 msgr2=0x7f9818062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 0x7f9818062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98340abcd0 tx=0x7f9820009040 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 msgr2=0x7f9834154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f982800ec80 tx=0x7f98280091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 shutdown_connections 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9818060580 0x7f9818062a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98341581c0 0x7f98341531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9834157df0 0x7f9834150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 --2- 172.21.15.50:0/1095070085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9834068bc0 0x7f9834154170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 >> 172.21.15.50:0/1095070085 conn(0x7f98340ccf90 msgr2=0x7f98340c1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 shutdown_connections 2023-12-24T18:36:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.116+0000 7f983af85700 1 -- 172.21.15.50:0/1095070085 wait complete. 2023-12-24T18:36:29.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:36:29.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.324+0000 7fd5f7fff700 1 Processor -- start 2023-12-24T18:36:29.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.324+0000 7fd5f7fff700 1 -- start start 2023-12-24T18:36:29.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd5f8158ef0 0x7fd5f806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f81592c0 0x7fd5f8159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f7fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f806b620 con 0x7fd5f80cc4f0 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80ca5b0 con 0x7fd5f81592c0 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f7fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f8159e10 con 0x7fd5f8158ef0 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f81592c0 0x7fd5f8159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f81592c0 0x7fd5f8159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40630/0 (socket says 172.21.15.50:40630) 2023-12-24T18:36:29.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 -- 172.21.15.50:0/1649128902 learned_addr learned my addr 172.21.15.50:0/1649128902 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:29.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f6ffd700 1 --2- 172.21.15.50:0/1649128902 >> v2:172.21.15.82:3300/0 conn(0x7fd5f8158ef0 0x7fd5f806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 -- 172.21.15.50:0/1649128902 >> v2:172.21.15.82:3300/0 conn(0x7fd5f8158ef0 msgr2=0x7fd5f806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:29.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/1649128902 >> v2:172.21.15.82:3300/0 conn(0x7fd5f8158ef0 0x7fd5f806b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 -- 172.21.15.50:0/1649128902 >> v1:172.21.15.82:6789/0 conn(0x7fd5f80cc4f0 legacy=0x7fd5f80cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 -- 172.21.15.50:0/1649128902 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f815a0f0 con 0x7fd5f81592c0 2023-12-24T18:36:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.328+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/1649128902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f81592c0 0x7fd5f8159760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806a380 tx=0x7fd5ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f575c0e635dc225 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f5ffb700 1 -- 172.21.15.50:0/1649128902 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec009e70 con 0x7fd5f81592c0 2023-12-24T18:36:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f5ffb700 1 -- 172.21.15.50:0/1649128902 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00b860 con 0x7fd5f81592c0 2023-12-24T18:36:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f5ffb700 1 -- 172.21.15.50:0/1649128902 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00bc00 con 0x7fd5f81592c0 2023-12-24T18:36:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- 172.21.15.50:0/1649128902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f81592c0 msgr2=0x7fd5f8159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/1649128902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f81592c0 0x7fd5f8159760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806a380 tx=0x7fd5ec009250 comp rx=0 tx=0).stop 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- 172.21.15.50:0/1649128902 shutdown_connections 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/1649128902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f81592c0 0x7fd5f8159760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/1649128902 >> v2:172.21.15.82:3300/0 conn(0x7fd5f8158ef0 0x7fd5f806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- 172.21.15.50:0/1649128902 >> 172.21.15.50:0/1649128902 conn(0x7fd5f80670b0 msgr2=0x7fd5f80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- 172.21.15.50:0/1649128902 shutdown_connections 2023-12-24T18:36:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- 172.21.15.50:0/1649128902 wait complete. 2023-12-24T18:36:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 Processor -- start 2023-12-24T18:36:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.332+0000 7fd5f7fff700 1 -- start start 2023-12-24T18:36:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f80cc4f0 0x7fd5f816dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f81592c0 0x7fd5f8169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81452f0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f816ac80 con 0x7fd5f80cc4f0 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f816a400 con 0x7fd5f81592c0 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39768/0 (socket says 172.21.15.50:39768) 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 -- 172.21.15.50:0/150399897 learned_addr learned my addr 172.21.15.50:0/150399897 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f6ffd700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f80cc4f0 0x7fd5f816dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f77fe700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f81592c0 0x7fd5f8169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 -- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f81592c0 msgr2=0x7fd5f8169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f81592c0 0x7fd5f8169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 -- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f80cc4f0 msgr2=0x7fd5f816dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:29.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f80cc4f0 0x7fd5f816dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 -- 172.21.15.50:0/150399897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0094f0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80cfb10 tx=0x7fd5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00b9d0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00bb30 con 0x7fd5f8158ef0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f816a6e0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec011670 con 0x7fd5f8158ef0 2023-12-24T18:36:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.336+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80b3d60 con 0x7fd5f8158ef0 2023-12-24T18:36:29.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.340+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f806bcd0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.340+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd5ec011a60 con 0x7fd5f8158ef0 2023-12-24T18:36:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.344+0000 7fd5deffd700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 0x7fd5e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.344+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5931+0+0 (secure 0 0 0) 0x7fd5ec07e130 con 0x7fd5f8158ef0 2023-12-24T18:36:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.344+0000 7fd5f6ffd700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 0x7fd5e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:29.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.344+0000 7fd5f6ffd700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 0x7fd5e4062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009da0 tx=0x7fd5e8009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:29.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.352+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd5f806bcd0 con 0x7fd5f8158ef0 2023-12-24T18:36:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:29.528+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd5f806bcd0 con 0x7fd5f8158ef0 2023-12-24T18:36:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.216+0000 7fd5deffd700 1 -- 172.21.15.50:0/150399897 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fd5f806bcd0 con 0x7fd5f8158ef0 2023-12-24T18:36:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.220+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 msgr2=0x7fd5e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.220+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 0x7fd5e4062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009da0 tx=0x7fd5e8009120 comp rx=0 tx=0).stop 2023-12-24T18:36:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.220+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 msgr2=0x7fd5f8144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.220+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80cfb10 tx=0x7fd5ec017000 comp rx=0 tx=0).stop 2023-12-24T18:36:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 shutdown_connections 2023-12-24T18:36:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5e4060550 0x7fd5e4062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f81592c0 0x7fd5f8169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8158ef0 0x7fd5f8144db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 --2- 172.21.15.50:0/150399897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f80cc4f0 0x7fd5f816dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 >> 172.21.15.50:0/150399897 conn(0x7fd5f80670b0 msgr2=0x7fd5f80ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 shutdown_connections 2023-12-24T18:36:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.228+0000 7fd5f7fff700 1 -- 172.21.15.50:0/150399897 wait complete. 2023-12-24T18:36:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2023-12-24T18:36:31.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-24T18:36:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 Processor -- start 2023-12-24T18:36:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 -- start start 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e8159080 0x7ff0e806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 0x7ff0e80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 0x7ff0e806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e815dbd0 con 0x7ff0e8159080 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80c5f20 con 0x7ff0e80c5ac0 2023-12-24T18:36:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.420+0000 7ff0eee0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e806b5b0 con 0x7ff0e806a4a0 2023-12-24T18:36:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e8159080 0x7ff0e806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e8159080 0x7ff0e806da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39784/0 (socket says 172.21.15.50:39784) 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 -- 172.21.15.50:0/3434256561 learned_addr learned my addr 172.21.15.50:0/3434256561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ee60b700 1 --2- 172.21.15.50:0/3434256561 >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 0x7ff0e806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ed609700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 0x7ff0e80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 -- 172.21.15.50:0/3434256561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 msgr2=0x7ff0e80c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 0x7ff0e80c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 -- 172.21.15.50:0/3434256561 >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 msgr2=0x7ff0e806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/3434256561 >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 0x7ff0e806c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 -- 172.21.15.50:0/3434256561 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e806df80 con 0x7ff0e8159080 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ed609700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 0x7ff0e80c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ee60b700 1 --2- 172.21.15.50:0/3434256561 >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 0x7ff0e806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8159080 0x7ff0e806da40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8068460 tx=0x7ff0e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b401604e3cb0c806 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ece08700 1 -- 172.21.15.50:0/3434256561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400b860 con 0x7ff0e8159080 2023-12-24T18:36:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ece08700 1 -- 172.21.15.50:0/3434256561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400b9c0 con 0x7ff0e8159080 2023-12-24T18:36:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0ece08700 1 -- 172.21.15.50:0/3434256561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400bd60 con 0x7ff0e8159080 2023-12-24T18:36:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 -- 172.21.15.50:0/3434256561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8159080 msgr2=0x7ff0e806da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8159080 0x7ff0e806da40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8068460 tx=0x7ff0e4009250 comp rx=0 tx=0).stop 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 -- 172.21.15.50:0/3434256561 shutdown_connections 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/3434256561 >> v2:172.21.15.82:3300/0 conn(0x7ff0e80c5ac0 0x7ff0e806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e806a4a0 0x7ff0e80c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/3434256561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8159080 0x7ff0e806da40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 -- 172.21.15.50:0/3434256561 >> 172.21.15.50:0/3434256561 conn(0x7ff0e8067b80 msgr2=0x7ff0e80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 -- 172.21.15.50:0/3434256561 shutdown_connections 2023-12-24T18:36:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.424+0000 7ff0eee0c700 1 -- 172.21.15.50:0/3434256561 wait complete. 2023-12-24T18:36:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 Processor -- start 2023-12-24T18:36:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 -- start start 2023-12-24T18:36:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e80c5ac0 0x7ff0e80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e8159080 0x7ff0e8151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815b860 con 0x7ff0e806a4a0 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815bcf0 con 0x7ff0e8159080 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0eee0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815ac50 con 0x7ff0e80c5ac0 2023-12-24T18:36:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39790/0 (socket says 172.21.15.50:39790) 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 -- 172.21.15.50:0/1802202958 learned_addr learned my addr 172.21.15.50:0/1802202958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ee60b700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e8159080 0x7ff0e8151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ed609700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e80c5ac0 0x7ff0e80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 -- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e80c5ac0 msgr2=0x7ff0e80c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e80c5ac0 0x7ff0e80c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 -- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e8159080 msgr2=0x7ff0e8151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.428+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e8159080 0x7ff0e8151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0ede0a700 1 -- 172.21.15.50:0/1802202958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094f0 con 0x7ff0e806a4a0 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0ede0a700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8064390 tx=0x7ff0e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011dc0 con 0x7ff0e806a4a0 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4024440 con 0x7ff0e806a4a0 2023-12-24T18:36:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e815af30 con 0x7ff0e806a4a0 2023-12-24T18:36:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4024800 con 0x7ff0e806a4a0 2023-12-24T18:36:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e815b4f0 con 0x7ff0e806a4a0 2023-12-24T18:36:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.432+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e804be40 con 0x7ff0e806a4a0 2023-12-24T18:36:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.436+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff0e401a420 con 0x7ff0e806a4a0 2023-12-24T18:36:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.436+0000 7ff0ddffb700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 0x7ff0cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.436+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff0e407e910 con 0x7ff0e806a4a0 2023-12-24T18:36:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.436+0000 7ff0ed609700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 0x7ff0cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.436+0000 7ff0ed609700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 0x7ff0cc062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80c8480 tx=0x7ff0d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:31.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.444+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff0e404ec30 con 0x7ff0e806a4a0 2023-12-24T18:36:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:31.616+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff0e806e1c0 con 0x7ff0e806a4a0 2023-12-24T18:36:32.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.220+0000 7ff0ddffb700 1 -- 172.21.15.50:0/1802202958 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0e4052250 con 0x7ff0e806a4a0 2023-12-24T18:36:32.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.228+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 msgr2=0x7ff0cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.228+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 0x7ff0cc062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80c8480 tx=0x7ff0d8008040 comp rx=0 tx=0).stop 2023-12-24T18:36:32.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.228+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 msgr2=0x7ff0e815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.228+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8064390 tx=0x7ff0e4017000 comp rx=0 tx=0).stop 2023-12-24T18:36:32.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 shutdown_connections 2023-12-24T18:36:32.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff0cc060550 0x7ff0cc062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e8159080 0x7ff0e8151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0e80c5ac0 0x7ff0e80c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 --2- 172.21.15.50:0/1802202958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e806a4a0 0x7ff0e815a670 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.232+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 >> 172.21.15.50:0/1802202958 conn(0x7ff0e8067b80 msgr2=0x7ff0e80cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.236+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 shutdown_connections 2023-12-24T18:36:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.240+0000 7ff0eee0c700 1 -- 172.21.15.50:0/1802202958 wait complete. 2023-12-24T18:36:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2023-12-24T18:36:32.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-24T18:36:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.432+0000 7fdb378ae700 1 Processor -- start 2023-12-24T18:36:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.432+0000 7fdb378ae700 1 -- start start 2023-12-24T18:36:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb378ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 0x7fdb300aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb378ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 0x7fdb301571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb378ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3006a670 con 0x7fdb300aaf60 2023-12-24T18:36:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb378ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3006af10 con 0x7fdb3015b430 2023-12-24T18:36:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb378ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300ab3b0 con 0x7fdb30156df0 2023-12-24T18:36:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb35e4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 0x7fdb301571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb35e4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 0x7fdb301571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39798/0 (socket says 172.21.15.50:39798) 2023-12-24T18:36:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb35e4b700 1 -- 172.21.15.50:0/3692571413 learned_addr learned my addr 172.21.15.50:0/3692571413 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 --2- 172.21.15.50:0/3692571413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 0x7fdb300aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 -- 172.21.15.50:0/3692571413 >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 msgr2=0x7fdb301571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 --2- 172.21.15.50:0/3692571413 >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 0x7fdb301571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 -- 172.21.15.50:0/3692571413 >> v1:172.21.15.82:6789/0 conn(0x7fdb300aaf60 legacy=0x7fdb3015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 -- 172.21.15.50:0/3692571413 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3015ba50 con 0x7fdb30156df0 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb27fff700 1 -- 172.21.15.50:0/3692571413 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947561615 0 0) 0x7fdb3006a670 con 0x7fdb300aaf60 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb3564a700 1 --2- 172.21.15.50:0/3692571413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 0x7fdb300aaa20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0098e0 tx=0x7fdb2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca211694dc2225e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb27fff700 1 -- 172.21.15.50:0/3692571413 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00b640 con 0x7fdb30156df0 2023-12-24T18:36:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb27fff700 1 -- 172.21.15.50:0/3692571413 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00b7a0 con 0x7fdb30156df0 2023-12-24T18:36:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.436+0000 7fdb27fff700 1 -- 172.21.15.50:0/3692571413 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00bb40 con 0x7fdb30156df0 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- 172.21.15.50:0/3692571413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 msgr2=0x7fdb300aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 --2- 172.21.15.50:0/3692571413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 0x7fdb300aaa20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0098e0 tx=0x7fdb2c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- 172.21.15.50:0/3692571413 shutdown_connections 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 --2- 172.21.15.50:0/3692571413 >> v2:172.21.15.50:3300/0 conn(0x7fdb3015b430 0x7fdb301571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 --2- 172.21.15.50:0/3692571413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb30156df0 0x7fdb300aaa20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- 172.21.15.50:0/3692571413 >> 172.21.15.50:0/3692571413 conn(0x7fdb300cbb10 msgr2=0x7fdb300cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- 172.21.15.50:0/3692571413 shutdown_connections 2023-12-24T18:36:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- 172.21.15.50:0/3692571413 wait complete. 2023-12-24T18:36:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 Processor -- start 2023-12-24T18:36:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.440+0000 7fdb378ae700 1 -- start start 2023-12-24T18:36:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 0x7fdb30152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb3015b430 0x7fdb300c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300b15c0 con 0x7fdb30156df0 2023-12-24T18:36:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300b0c90 con 0x7fdb300aaf60 2023-12-24T18:36:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300b0f70 con 0x7fdb3015b430 2023-12-24T18:36:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39802/0 (socket says 172.21.15.50:39802) 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 -- 172.21.15.50:0/4158334856 learned_addr learned my addr 172.21.15.50:0/4158334856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb3564a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 0x7fdb30152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb35e4b700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb3015b430 0x7fdb300c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 -- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb3015b430 msgr2=0x7fdb300c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb3015b430 0x7fdb300c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 -- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 msgr2=0x7fdb30152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 0x7fdb30152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 -- 172.21.15.50:0/4158334856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009420 con 0x7fdb30156df0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb3564a700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 0x7fdb30152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb34e49700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c530 tx=0x7fdb2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20011590 con 0x7fdb30156df0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200116f0 con 0x7fdb30156df0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb300b1250 con 0x7fdb30156df0 2023-12-24T18:36:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20011ab0 con 0x7fdb30156df0 2023-12-24T18:36:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.444+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30153390 con 0x7fdb30156df0 2023-12-24T18:36:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.448+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb300b1770 con 0x7fdb30156df0 2023-12-24T18:36:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.448+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdb2001b3b0 con 0x7fdb30156df0 2023-12-24T18:36:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.452+0000 7fdb257fa700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 0x7fdb14062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.452+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fdb2007c090 con 0x7fdb30156df0 2023-12-24T18:36:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.452+0000 7fdb3564a700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 0x7fdb14062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.452+0000 7fdb3564a700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 0x7fdb14062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0093f0 tx=0x7fdb2c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:32.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.460+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb2004c310 con 0x7fdb30156df0 2023-12-24T18:36:32.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:32.676+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fdb300652e0 con 0x7fdb30156df0 2023-12-24T18:36:33.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.244+0000 7fdb257fa700 1 -- 172.21.15.50:0/4158334856 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdb2004f930 con 0x7fdb30156df0 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 msgr2=0x7fdb14062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 0x7fdb14062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0093f0 tx=0x7fdb2c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 msgr2=0x7fdb30153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c530 tx=0x7fdb2000c8f0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 shutdown_connections 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdb14060580 0x7fdb14062a30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb3015b430 0x7fdb300c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb30156df0 0x7fdb30153c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 --2- 172.21.15.50:0/4158334856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb300aaf60 0x7fdb30152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 >> 172.21.15.50:0/4158334856 conn(0x7fdb300cbb10 msgr2=0x7fdb300670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 shutdown_connections 2023-12-24T18:36:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.248+0000 7fdb378ae700 1 -- 172.21.15.50:0/4158334856 wait complete. 2023-12-24T18:36:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2023-12-24T18:36:33.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.444+0000 7f1003878700 1 Processor -- start 2023-12-24T18:36:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.444+0000 7f1003878700 1 -- start start 2023-12-24T18:36:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1003878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc158e10 0x7f0ffc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1003878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ffc0b1ba0 0x7f0ffc0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1003878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc06d5c0 con 0x7f0ffc0b3c90 2023-12-24T18:36:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1003878700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b49c0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1003878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc06d040 con 0x7f0ffc158e10 2023-12-24T18:36:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1000e13700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0ffc0b3c90 0x7f0ffc06da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45266/0 (socket says 172.21.15.50:45266) 2023-12-24T18:36:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1000e13700 1 -- 172.21.15.50:0/3910330559 learned_addr learned my addr 172.21.15.50:0/3910330559 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 --2- 172.21.15.50:0/3910330559 >> v2:172.21.15.50:3300/0 conn(0x7f0ffc0b1ba0 0x7f0ffc0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001614700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc158e10 0x7f0ffc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f0ff3fff700 1 -- 172.21.15.50:0/3910330559 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379666330 0 0) 0x7f0ffc06d5c0 con 0x7f0ffc0b3c90 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 -- 172.21.15.50:0/3910330559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc158e10 msgr2=0x7f0ffc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc158e10 0x7f0ffc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 -- 172.21.15.50:0/3910330559 >> v1:172.21.15.50:6789/0 conn(0x7f0ffc0b3c90 legacy=0x7f0ffc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 -- 172.21.15.50:0/3910330559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc15a1f0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f1001e15700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0b2020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009e60 tx=0x7f0ff4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b87ca4715aaa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f0ff3fff700 1 -- 172.21.15.50:0/3910330559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400e070 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f0ff3fff700 1 -- 172.21.15.50:0/3910330559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400bb60 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.448+0000 7f0ff3fff700 1 -- 172.21.15.50:0/3910330559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4012430 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 -- 172.21.15.50:0/3910330559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 msgr2=0x7f0ffc0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0b2020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009e60 tx=0x7f0ff4009780 comp rx=0 tx=0).stop 2023-12-24T18:36:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 -- 172.21.15.50:0/3910330559 shutdown_connections 2023-12-24T18:36:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0b2020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 --2- 172.21.15.50:0/3910330559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc158e10 0x7f0ffc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 -- 172.21.15.50:0/3910330559 >> 172.21.15.50:0/3910330559 conn(0x7f0ffc0670b0 msgr2=0x7f0ffc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 -- 172.21.15.50:0/3910330559 shutdown_connections 2023-12-24T18:36:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 -- 172.21.15.50:0/3910330559 wait complete. 2023-12-24T18:36:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.452+0000 7f1003878700 1 Processor -- start 2023-12-24T18:36:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 -- start start 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc0b3c90 0x7f0ffc15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 0x7f0ffc156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc169170 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc15d600 con 0x7f0ffc158e10 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1003878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0cfcc0 con 0x7f0ffc0b3c90 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39824/0 (socket says 172.21.15.50:39824) 2023-12-24T18:36:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 -- 172.21.15.50:0/1932430559 learned_addr learned my addr 172.21.15.50:0/1932430559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001e15700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 0x7f0ffc156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1000e13700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc0b3c90 0x7f0ffc15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 -- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc0b3c90 msgr2=0x7f0ffc15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc0b3c90 0x7f0ffc15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 -- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 msgr2=0x7f0ffc156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 0x7f0ffc156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001614700 1 -- 172.21.15.50:0/1932430559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009a20 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.456+0000 7f1001e15700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 0x7f0ffc156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f1001614700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800e930 tx=0x7f0ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800eed0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff800c850 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800cbf0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc1693e0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc15d040 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.460+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc0652e0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.464+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0ff8013470 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.464+0000 7f0ff17fa700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 0x7f0fe0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.464+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f0ff807ccb0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.464+0000 7f1000e13700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 0x7f0fe0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.464+0000 7f1000e13700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 0x7f0fe0062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0d1000 tx=0x7f0fec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.468+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ff804cfb0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.676+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ffc06ca20 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.676+0000 7f0ff17fa700 1 -- 172.21.15.50:0/1932430559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f0ff80505d0 con 0x7f0ffc0b1ba0 2023-12-24T18:36:33.677 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:33.678 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:33.230028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-24T18:36:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 msgr2=0x7f0fe0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 0x7f0fe0062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0d1000 tx=0x7f0fec009040 comp rx=0 tx=0).stop 2023-12-24T18:36:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 msgr2=0x7f0ffc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800e930 tx=0x7f0ff80091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 shutdown_connections 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0fe0060550 0x7f0fe0062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ffc158e10 0x7f0ffc156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ffc0b3c90 0x7f0ffc15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 --2- 172.21.15.50:0/1932430559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc0b1ba0 0x7f0ffc0cf780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 >> 172.21.15.50:0/1932430559 conn(0x7f0ffc0670b0 msgr2=0x7f0ffc067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 shutdown_connections 2023-12-24T18:36:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.680+0000 7f1003878700 1 -- 172.21.15.50:0/1932430559 wait complete. 2023-12-24T18:36:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2023-12-24T18:36:33.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.860+0000 7f1d793c3700 1 Processor -- start 2023-12-24T18:36:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.860+0000 7f1d793c3700 1 -- start start 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d793c3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d74156da0 0x7f1d7406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d793c3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7415a4d0 con 0x7f1d740caf40 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d793c3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d74159610 con 0x7f1d740cb310 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d793c3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740cd2a0 con 0x7f1d74156da0 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d73fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1d740caf40 0x7f1d740ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45270/0 (socket says 172.21.15.50:45270) 2023-12-24T18:36:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d73fff700 1 -- 172.21.15.50:0/4005204733 learned_addr learned my addr 172.21.15.50:0/4005204733 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d78bc2700 1 --2- 172.21.15.50:0/4005204733 >> v2:172.21.15.82:3300/0 conn(0x7f1d74156da0 0x7f1d7406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430935460 0 0) 0x7f1d7415a4d0 con 0x7f1d740caf40 2023-12-24T18:36:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.864+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5c003570 con 0x7f1d740caf40 2023-12-24T18:36:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d78bc2700 1 -- 172.21.15.50:0/4005204733 >> v1:172.21.15.82:6789/0 conn(0x7f1d740cb310 legacy=0x7f1d74156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739961961 0 0) 0x7f1d74159610 con 0x7f1d740cb310 2023-12-24T18:36:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d78bc2700 1 -- 172.21.15.50:0/4005204733 >> v1:172.21.15.50:6789/0 conn(0x7f1d740caf40 legacy=0x7f1d740ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d78bc2700 1 -- 172.21.15.50:0/4005204733 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740cc8e0 con 0x7f1d74156da0 2023-12-24T18:36:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d78bc2700 1 --2- 172.21.15.50:0/4005204733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d74156da0 0x7f1d7406cd30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009e60 tx=0x7f1d6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f26be36748992eb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00e070 con 0x7f1d74156da0 2023-12-24T18:36:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00b850 con 0x7f1d74156da0 2023-12-24T18:36:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d72ffd700 1 -- 172.21.15.50:0/4005204733 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64001470 con 0x7f1d74156da0 2023-12-24T18:36:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 -- 172.21.15.50:0/4005204733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d74156da0 msgr2=0x7f1d7406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 --2- 172.21.15.50:0/4005204733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d74156da0 0x7f1d7406cd30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009e60 tx=0x7f1d6c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 -- 172.21.15.50:0/4005204733 shutdown_connections 2023-12-24T18:36:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 --2- 172.21.15.50:0/4005204733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d74156da0 0x7f1d7406cd30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 -- 172.21.15.50:0/4005204733 >> 172.21.15.50:0/4005204733 conn(0x7f1d740670b0 msgr2=0x7f1d740674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 -- 172.21.15.50:0/4005204733 shutdown_connections 2023-12-24T18:36:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.868+0000 7f1d793c3700 1 -- 172.21.15.50:0/4005204733 wait complete. 2023-12-24T18:36:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.872+0000 7f1d793c3700 1 Processor -- start 2023-12-24T18:36:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.872+0000 7f1d793c3700 1 -- start start 2023-12-24T18:36:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 0x7f1d740c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 0x7f1d741441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740b3710 con 0x7f1d740cb310 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740b39f0 con 0x7f1d740caf40 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740b3cd0 con 0x7f1d74156da0 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39834/0 (socket says 172.21.15.50:39834) 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 -- 172.21.15.50:0/958421480 learned_addr learned my addr 172.21.15.50:0/958421480 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d78bc2700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 0x7f1d741441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d73fff700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 0x7f1d740c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 -- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 msgr2=0x7f1d741441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 0x7f1d741441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 -- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 msgr2=0x7f1d740c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 0x7f1d740c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 -- 172.21.15.50:0/958421480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009a20 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d78bc2700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 0x7f1d741441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d73fff700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 0x7f1d740c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d737fe700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c7e0 tx=0x7f1d68007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68012700 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68012880 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68012c40 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740b3fb0 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.876+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d74144b80 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.880+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7404be40 con 0x7f1d740cb310 2023-12-24T18:36:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.880+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1d6801b400 con 0x7f1d740cb310 2023-12-24T18:36:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.880+0000 7f1d5bfff700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 0x7f1d60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.880+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f1d6807c690 con 0x7f1d740cb310 2023-12-24T18:36:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.880+0000 7f1d73fff700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 0x7f1d60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.884+0000 7f1d73fff700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 0x7f1d60062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001ed0 tx=0x7f1d64000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:33.888+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1d6804c990 con 0x7f1d740cb310 2023-12-24T18:36:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.076+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d740aee00 con 0x7f1d740cb310 2023-12-24T18:36:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d5bfff700 1 -- 172.21.15.50:0/958421480 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17156 (secure 0 0 0) 0x7f1d6804ffb0 con 0x7f1d740cb310 2023-12-24T18:36:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:34.081 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:32.677424+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 msgr2=0x7f1d60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 0x7f1d60062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001ed0 tx=0x7f1d64000bc0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 msgr2=0x7f1d740b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c7e0 tx=0x7f1d68007df0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 shutdown_connections 2023-12-24T18:36:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1d60060550 0x7f1d60062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d74156da0 0x7f1d741441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cb310 0x7f1d740b3010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.080+0000 7f1d793c3700 1 --2- 172.21.15.50:0/958421480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d740caf40 0x7f1d740c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.084+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 >> 172.21.15.50:0/958421480 conn(0x7f1d740670b0 msgr2=0x7f1d740af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.084+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 shutdown_connections 2023-12-24T18:36:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.084+0000 7f1d793c3700 1 -- 172.21.15.50:0/958421480 wait complete. 2023-12-24T18:36:34.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:34.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 Processor -- start 2023-12-24T18:36:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 -- start start 2023-12-24T18:36:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6200c6d00 0x7fc6200c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 0x7fc62006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62006c820 con 0x7fc620154450 2023-12-24T18:36:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62006b960 con 0x7fc6200c6d00 2023-12-24T18:36:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc627185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62006bc40 con 0x7fc62006aca0 2023-12-24T18:36:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc61ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc620154450 0x7fc6201548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45276/0 (socket says 172.21.15.50:45276) 2023-12-24T18:36:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc61ffff700 1 -- 172.21.15.50:0/1799896274 learned_addr learned my addr 172.21.15.50:0/1799896274 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc625722700 1 --2- 172.21.15.50:0/1799896274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 0x7fc62006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.272+0000 7fc624f21700 1 --2- 172.21.15.50:0/1799896274 >> v2:172.21.15.82:3300/0 conn(0x7fc6200c6d00 0x7fc6200c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc61f7fe700 1 -- 172.21.15.50:0/1799896274 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877982683 0 0) 0x7fc62006c820 con 0x7fc620154450 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc61f7fe700 1 -- 172.21.15.50:0/1799896274 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003570 con 0x7fc620154450 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc625722700 1 -- 172.21.15.50:0/1799896274 >> v2:172.21.15.82:3300/0 conn(0x7fc6200c6d00 msgr2=0x7fc6200c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc625722700 1 --2- 172.21.15.50:0/1799896274 >> v2:172.21.15.82:3300/0 conn(0x7fc6200c6d00 0x7fc6200c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc625722700 1 -- 172.21.15.50:0/1799896274 >> v1:172.21.15.50:6789/0 conn(0x7fc620154450 legacy=0x7fc6201548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc625722700 1 -- 172.21.15.50:0/1799896274 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62006bf20 con 0x7fc62006aca0 2023-12-24T18:36:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc625722700 1 --2- 172.21.15.50:0/1799896274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 0x7fc62006b140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e60 tx=0x7fc618009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446677afb4deb3fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc61f7fe700 1 -- 172.21.15.50:0/1799896274 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800e070 con 0x7fc62006aca0 2023-12-24T18:36:34.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc61f7fe700 1 -- 172.21.15.50:0/1799896274 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61800bab0 con 0x7fc62006aca0 2023-12-24T18:36:34.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc61f7fe700 1 -- 172.21.15.50:0/1799896274 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800be70 con 0x7fc62006aca0 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 -- 172.21.15.50:0/1799896274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 msgr2=0x7fc62006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 --2- 172.21.15.50:0/1799896274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 0x7fc62006b140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e60 tx=0x7fc618009780 comp rx=0 tx=0).stop 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 -- 172.21.15.50:0/1799896274 shutdown_connections 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 --2- 172.21.15.50:0/1799896274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc62006aca0 0x7fc62006b140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 --2- 172.21.15.50:0/1799896274 >> v2:172.21.15.82:3300/0 conn(0x7fc6200c6d00 0x7fc6200c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 -- 172.21.15.50:0/1799896274 >> 172.21.15.50:0/1799896274 conn(0x7fc6200cbba0 msgr2=0x7fc6200cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 -- 172.21.15.50:0/1799896274 shutdown_connections 2023-12-24T18:36:34.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.276+0000 7fc627185700 1 -- 172.21.15.50:0/1799896274 wait complete. 2023-12-24T18:36:34.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 Processor -- start 2023-12-24T18:36:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 -- start start 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6200c6d00 0x7fc6200aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc620154450 0x7fc6201456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62016b5d0 con 0x7fc62006aca0 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6201672d0 con 0x7fc6200c6d00 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc627185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62016ad30 con 0x7fc620154450 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc624f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc624f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39850/0 (socket says 172.21.15.50:39850) 2023-12-24T18:36:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc624f21700 1 -- 172.21.15.50:0/1121414164 learned_addr learned my addr 172.21.15.50:0/1121414164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc625722700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc620154450 0x7fc6201456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.280+0000 7fc61ffff700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6200c6d00 0x7fc6200aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 -- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc620154450 msgr2=0x7fc6201456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc620154450 0x7fc6201456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 -- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6200c6d00 msgr2=0x7fc6200aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6200c6d00 0x7fc6200aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 -- 172.21.15.50:0/1121414164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618009a20 con 0x7fc62006aca0 2023-12-24T18:36:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc624f21700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc61400ecb0 tx=0x7fc6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400c7f0 con 0x7fc62006aca0 2023-12-24T18:36:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400c950 con 0x7fc62006aca0 2023-12-24T18:36:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62016b010 con 0x7fc62006aca0 2023-12-24T18:36:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400ccf0 con 0x7fc62006aca0 2023-12-24T18:36:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc620145c10 con 0x7fc62006aca0 2023-12-24T18:36:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.284+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6201670a0 con 0x7fc62006aca0 2023-12-24T18:36:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.288+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc614013680 con 0x7fc62006aca0 2023-12-24T18:36:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.288+0000 7fc61cff9700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 0x7fc604062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.288+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fc61407cd00 con 0x7fc62006aca0 2023-12-24T18:36:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.288+0000 7fc61ffff700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 0x7fc604062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.292+0000 7fc61ffff700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 0x7fc604062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6201579b0 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.296+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6201670a0 con 0x7fc62006aca0 2023-12-24T18:36:34.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.467+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6201670a0 con 0x7fc62006aca0 2023-12-24T18:36:34.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.471+0000 7fc61cff9700 1 -- 172.21.15.50:0/1121414164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fc6201670a0 con 0x7fc62006aca0 2023-12-24T18:36:34.474 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:34.474 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 msgr2=0x7fc604062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 0x7fc604062a30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6201579b0 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 msgr2=0x7fc62016a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc61400ecb0 tx=0x7fc6140091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 shutdown_connections 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc604060580 0x7fc604062a30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc620154450 0x7fc6201456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6200c6d00 0x7fc6200aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 --2- 172.21.15.50:0/1121414164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc62006aca0 0x7fc62016a6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 >> 172.21.15.50:0/1121414164 conn(0x7fc6200cbba0 msgr2=0x7fc620062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 shutdown_connections 2023-12-24T18:36:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.475+0000 7fc627185700 1 -- 172.21.15.50:0/1121414164 wait complete. 2023-12-24T18:36:34.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:34.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 Processor -- start 2023-12-24T18:36:34.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 -- start start 2023-12-24T18:36:34.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faec006b6b0 0x7faec00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec006e110 con 0x7faec00ad220 2023-12-24T18:36:34.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec006bb40 con 0x7faec0155710 2023-12-24T18:36:34.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec540c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec006be20 con 0x7faec006b6b0 2023-12-24T18:36:34.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec4c0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec4c0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39862/0 (socket says 172.21.15.50:39862) 2023-12-24T18:36:34.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faec4c0b700 1 -- 172.21.15.50:0/1224123308 learned_addr learned my addr 172.21.15.50:0/1224123308 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:34.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.687+0000 7faebf7fe700 1 --2- 172.21.15.50:0/1224123308 >> v2:172.21.15.82:3300/0 conn(0x7faec006b6b0 0x7faec00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebf7fe700 1 -- 172.21.15.50:0/1224123308 >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 msgr2=0x7faec0155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebf7fe700 1 --2- 172.21.15.50:0/1224123308 >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebf7fe700 1 -- 172.21.15.50:0/1224123308 >> v1:172.21.15.82:6789/0 conn(0x7faec00ad220 legacy=0x7faec006afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebf7fe700 1 -- 172.21.15.50:0/1224123308 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00af740 con 0x7faec006b6b0 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec4c0b700 1 --2- 172.21.15.50:0/1224123308 >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebf7fe700 1 --2- 172.21.15.50:0/1224123308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec006b6b0 0x7faec00ad5f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faec006a3c0 tx=0x7faeb400b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd8633a5b53c53b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebeffd700 1 -- 172.21.15.50:0/1224123308 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400db40 con 0x7faec006b6b0 2023-12-24T18:36:34.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebeffd700 1 -- 172.21.15.50:0/1224123308 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400dca0 con 0x7faec006b6b0 2023-12-24T18:36:34.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faebeffd700 1 -- 172.21.15.50:0/1224123308 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40196b0 con 0x7faec006b6b0 2023-12-24T18:36:34.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 -- 172.21.15.50:0/1224123308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec006b6b0 msgr2=0x7faec00ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 --2- 172.21.15.50:0/1224123308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec006b6b0 0x7faec00ad5f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faec006a3c0 tx=0x7faeb400b430 comp rx=0 tx=0).stop 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 -- 172.21.15.50:0/1224123308 shutdown_connections 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 --2- 172.21.15.50:0/1224123308 >> v2:172.21.15.50:3300/0 conn(0x7faec0155710 0x7faec0155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 --2- 172.21.15.50:0/1224123308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec006b6b0 0x7faec00ad5f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 -- 172.21.15.50:0/1224123308 >> 172.21.15.50:0/1224123308 conn(0x7faec0067b80 msgr2=0x7faec00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 -- 172.21.15.50:0/1224123308 shutdown_connections 2023-12-24T18:36:34.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.691+0000 7faec540c700 1 -- 172.21.15.50:0/1224123308 wait complete. 2023-12-24T18:36:34.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.695+0000 7faec540c700 1 Processor -- start 2023-12-24T18:36:34.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.695+0000 7faec540c700 1 -- start start 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006b6b0 0x7faec0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 0x7faec014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec016d990 con 0x7faec00ad220 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0151d30 con 0x7faec0155710 2023-12-24T18:36:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec0148b70 con 0x7faec006b6b0 2023-12-24T18:36:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39878/0 (socket says 172.21.15.50:39878) 2023-12-24T18:36:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 -- 172.21.15.50:0/30404006 learned_addr learned my addr 172.21.15.50:0/30404006 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec4c0b700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 0x7faec014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebffff700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006b6b0 0x7faec0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 -- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006b6b0 msgr2=0x7faec0152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006b6b0 0x7faec0152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 -- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 msgr2=0x7faec014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 0x7faec014ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 -- 172.21.15.50:0/30404006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009ae0 con 0x7faec00ad220 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec4c0b700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 0x7faec014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faebf7fe700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b470 tx=0x7faeb401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4019640 con 0x7faec00ad220 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4010470 con 0x7faec00ad220 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4010810 con 0x7faec00ad220 2023-12-24T18:36:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.699+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb400b6d0 con 0x7faec00ad220 2023-12-24T18:36:34.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.703+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec0152000 con 0x7faec00ad220 2023-12-24T18:36:34.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.703+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec004be40 con 0x7faec00ad220 2023-12-24T18:36:34.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.703+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faeb4024420 con 0x7faec00ad220 2023-12-24T18:36:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.703+0000 7faea7fff700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 0x7faeac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.703+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7faeb4020070 con 0x7faec00ad220 2023-12-24T18:36:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.707+0000 7faebffff700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 0x7faeac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:34.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.707+0000 7faebffff700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 0x7faeac062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faeb00039f0 tx=0x7faeb0007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.711+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faeb404eb00 con 0x7faec00ad220 2023-12-24T18:36:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.919+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec0156130 con 0x7faec00ad220 2023-12-24T18:36:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.919+0000 7faea7fff700 1 -- 172.21.15.50:0/30404006 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4587 (secure 0 0 0) 0x7faeb4052120 con 0x7faec00ad220 2023-12-24T18:36:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:34.921 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:33.230028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 msgr2=0x7faeac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 0x7faeac062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faeb00039f0 tx=0x7faeb0007ec0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 msgr2=0x7faec0148630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b470 tx=0x7faeb401b000 comp rx=0 tx=0).stop 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 shutdown_connections 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faeac060550 0x7faeac062a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec0155710 0x7faec014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec00ad220 0x7faec0148630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 --2- 172.21.15.50:0/30404006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006b6b0 0x7faec0152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 >> 172.21.15.50:0/30404006 conn(0x7faec0067b80 msgr2=0x7faec00c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 shutdown_connections 2023-12-24T18:36:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:34.923+0000 7faec540c700 1 -- 172.21.15.50:0/30404006 wait complete. 2023-12-24T18:36:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2023-12-24T18:36:34.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:35.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.107+0000 7f5c8966e700 1 Processor -- start 2023-12-24T18:36:35.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 -- start start 2023-12-24T18:36:35.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 0x7f5c8406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 0x7f5c8406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c84155fe0 con 0x7f5c841551f0 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c84155a10 con 0x7f5c8406abe0 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c8966e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8406b0f0 con 0x7f5c841555c0 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c82ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5c841551f0 0x7f5c84156470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60348/0 (socket says 172.21.15.50:60348) 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c827fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 0x7f5c8406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.111+0000 7f5c82ffd700 1 -- 172.21.15.50:0/2880464139 learned_addr learned my addr 172.21.15.50:0/2880464139 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c837fe700 1 --2- 172.21.15.50:0/2880464139 >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 0x7f5c8406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c81ffb700 1 -- 172.21.15.50:0/2880464139 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355837301 0 0) 0x7f5c84155fe0 con 0x7f5c841551f0 2023-12-24T18:36:35.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c81ffb700 1 -- 172.21.15.50:0/2880464139 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c003570 con 0x7f5c841551f0 2023-12-24T18:36:35.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c827fc700 1 -- 172.21.15.50:0/2880464139 >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 msgr2=0x7f5c8406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c827fc700 1 --2- 172.21.15.50:0/2880464139 >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 0x7f5c8406d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c827fc700 1 -- 172.21.15.50:0/2880464139 >> v1:172.21.15.82:6789/0 conn(0x7f5c841551f0 legacy=0x7f5c84156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c827fc700 1 -- 172.21.15.50:0/2880464139 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8406b3d0 con 0x7f5c841555c0 2023-12-24T18:36:35.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c837fe700 1 --2- 172.21.15.50:0/2880464139 >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 0x7f5c8406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:35.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c827fc700 1 --2- 172.21.15.50:0/2880464139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 0x7f5c8406a6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098e0 tx=0x7f5c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152c4a43c8d066a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c81ffb700 1 -- 172.21.15.50:0/2880464139 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78011630 con 0x7f5c841555c0 2023-12-24T18:36:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c81ffb700 1 -- 172.21.15.50:0/2880464139 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78011790 con 0x7f5c841555c0 2023-12-24T18:36:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c81ffb700 1 -- 172.21.15.50:0/2880464139 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78011b30 con 0x7f5c841555c0 2023-12-24T18:36:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 -- 172.21.15.50:0/2880464139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 msgr2=0x7f5c8406a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 --2- 172.21.15.50:0/2880464139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 0x7f5c8406a6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098e0 tx=0x7f5c780091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 -- 172.21.15.50:0/2880464139 shutdown_connections 2023-12-24T18:36:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 --2- 172.21.15.50:0/2880464139 >> v2:172.21.15.82:3300/0 conn(0x7f5c8406abe0 0x7f5c8406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 --2- 172.21.15.50:0/2880464139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841555c0 0x7f5c8406a6a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.115+0000 7f5c8966e700 1 -- 172.21.15.50:0/2880464139 >> 172.21.15.50:0/2880464139 conn(0x7f5c840cbba0 msgr2=0x7f5c840cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.119+0000 7f5c8966e700 1 -- 172.21.15.50:0/2880464139 shutdown_connections 2023-12-24T18:36:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.119+0000 7f5c8966e700 1 -- 172.21.15.50:0/2880464139 wait complete. 2023-12-24T18:36:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.119+0000 7f5c8966e700 1 Processor -- start 2023-12-24T18:36:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.119+0000 7f5c8966e700 1 -- start start 2023-12-24T18:36:35.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c8406abe0 0x7f5c840c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841551f0 0x7f5c840c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84147790 con 0x7f5c841555c0 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c841468e0 con 0x7f5c8406abe0 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84146b80 con 0x7f5c841551f0 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39890/0 (socket says 172.21.15.50:39890) 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 -- 172.21.15.50:0/1735905624 learned_addr learned my addr 172.21.15.50:0/1735905624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c82ffd700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c8406abe0 0x7f5c840c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c827fc700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841551f0 0x7f5c840c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 -- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841551f0 msgr2=0x7f5c840c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841551f0 0x7f5c840c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 -- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c8406abe0 msgr2=0x7f5c840c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c8406abe0 0x7f5c840c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 -- 172.21.15.50:0/1735905624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009a20 con 0x7f5c841555c0 2023-12-24T18:36:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c837fe700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009ec0 tx=0x7f5c7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00cb70 con 0x7f5c841555c0 2023-12-24T18:36:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c00f040 con 0x7f5c841555c0 2023-12-24T18:36:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c78009420 con 0x7f5c841555c0 2023-12-24T18:36:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c014480 con 0x7f5c841555c0 2023-12-24T18:36:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.123+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c84147140 con 0x7f5c841555c0 2023-12-24T18:36:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.127+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c840652e0 con 0x7f5c841555c0 2023-12-24T18:36:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.127+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5c7c0147f0 con 0x7f5c841555c0 2023-12-24T18:36:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.131+0000 7f5c6affd700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 0x7f5c70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.131+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f5c7c07d7e0 con 0x7f5c841555c0 2023-12-24T18:36:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.131+0000 7f5c82ffd700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 0x7f5c70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.131+0000 7f5c82ffd700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 0x7f5c70062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c74007fd0 tx=0x7f5c74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.135+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c7c04da40 con 0x7f5c841555c0 2023-12-24T18:36:35.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.307+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c840c6330 con 0x7f5c841555c0 2023-12-24T18:36:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c6affd700 1 -- 172.21.15.50:0/1735905624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f5c7c051060 con 0x7f5c841555c0 2023-12-24T18:36:35.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:35.312 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 msgr2=0x7f5c70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 0x7f5c70062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c74007fd0 tx=0x7f5c74009040 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 msgr2=0x7f5c840c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009ec0 tx=0x7f5c7c00b040 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 shutdown_connections 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5c70060550 0x7f5c70062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c841555c0 0x7f5c840c7a80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5c841551f0 0x7f5c840c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 --2- 172.21.15.50:0/1735905624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c8406abe0 0x7f5c840c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 >> 172.21.15.50:0/1735905624 conn(0x7f5c840cbba0 msgr2=0x7f5c840cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 shutdown_connections 2023-12-24T18:36:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.311+0000 7f5c8966e700 1 -- 172.21.15.50:0/1735905624 wait complete. 2023-12-24T18:36:35.740 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:36:27.528972+0000', 'modified': '2023-12-24T18:36:33.230028+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6834/2517814635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 2517814635}, {'type': 'v1', 'addr': '172.21.15.82:6834', 'nonce': 2517814635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-12-24T18:36:35.740 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:36:35.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-24T18:36:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.911+0000 7f438346e700 1 Processor -- start 2023-12-24T18:36:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.911+0000 7f438346e700 1 -- start start 2023-12-24T18:36:35.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.911+0000 7f438346e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f437c06b540 0x7f437c0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f438346e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c06ba80 con 0x7f437c0ce750 2023-12-24T18:36:35.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f438346e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c06bd60 con 0x7f437c159a20 2023-12-24T18:36:35.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f438346e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c15a5d0 con 0x7f437c06b540 2023-12-24T18:36:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f438120a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f437c0ce750 0x7f437c06ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45288/0 (socket says 172.21.15.50:45288) 2023-12-24T18:36:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f438120a700 1 -- 172.21.15.50:0/3668400860 learned_addr learned my addr 172.21.15.50:0/3668400860 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4380a09700 1 --2- 172.21.15.50:0/3668400860 >> v2:172.21.15.82:3300/0 conn(0x7f437c06b540 0x7f437c0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258762763 0 0) 0x7f437c06ba80 con 0x7f437c0ce750 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4368003570 con 0x7f437c0ce750 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730497249 0 0) 0x7f437c06bd60 con 0x7f437c159a20 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f437c06ba80 con 0x7f437c159a20 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4380a09700 1 -- 172.21.15.50:0/3668400860 >> v1:172.21.15.82:6789/0 conn(0x7f437c159a20 legacy=0x7f437c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4380a09700 1 -- 172.21.15.50:0/3668400860 >> v1:172.21.15.50:6789/0 conn(0x7f437c0ce750 legacy=0x7f437c06ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582804197 0 0) 0x7f4368003570 con 0x7f437c0ce750 2023-12-24T18:36:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4380a09700 1 -- 172.21.15.50:0/3668400860 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c06c040 con 0x7f437c06b540 2023-12-24T18:36:35.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.915+0000 7f4380a09700 1 --2- 172.21.15.50:0/3668400860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c0ceb20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f436c0098e0 tx=0x7f436c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ec1e39d5b92353 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378001470 con 0x7f437c06b540 2023-12-24T18:36:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c011420 con 0x7f437c06b540 2023-12-24T18:36:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f4373fff700 1 -- 172.21.15.50:0/3668400860 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0117c0 con 0x7f437c06b540 2023-12-24T18:36:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 -- 172.21.15.50:0/3668400860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 msgr2=0x7f437c0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 --2- 172.21.15.50:0/3668400860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c0ceb20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f436c0098e0 tx=0x7f436c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 -- 172.21.15.50:0/3668400860 shutdown_connections 2023-12-24T18:36:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 --2- 172.21.15.50:0/3668400860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c0ceb20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 -- 172.21.15.50:0/3668400860 >> 172.21.15.50:0/3668400860 conn(0x7f437c0cffb0 msgr2=0x7f437c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 -- 172.21.15.50:0/3668400860 shutdown_connections 2023-12-24T18:36:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 -- 172.21.15.50:0/3668400860 wait complete. 2023-12-24T18:36:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.919+0000 7f438346e700 1 Processor -- start 2023-12-24T18:36:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 -- start start 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 0x7f437c143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f437c159a20 0x7f437c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c156310 con 0x7f437c159a20 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c155700 con 0x7f437c06b540 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438346e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1559e0 con 0x7f437c0ce750 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4381a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f437c159a20 0x7f437c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438120a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 0x7f437c143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438120a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:40284/0 (socket says 172.21.15.50:40284) 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f438120a700 1 -- 172.21.15.50:0/1234702968 learned_addr learned my addr 172.21.15.50:0/1234702968 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 -- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 msgr2=0x7f437c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 -- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f437c159a20 msgr2=0x7f437c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f437c159a20 0x7f437c0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.923+0000 7f4380a09700 1 -- 172.21.15.50:0/1234702968 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009420 con 0x7f437c0ce750 2023-12-24T18:36:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f4380a09700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 0x7f437c143af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f436c015000 tx=0x7f436c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f43717fa700 1 -- 172.21.15.50:0/1234702968 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c01cb30 con 0x7f437c0ce750 2023-12-24T18:36:35.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f43717fa700 1 -- 172.21.15.50:0/1234702968 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c01ccb0 con 0x7f437c0ce750 2023-12-24T18:36:35.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c155cc0 con 0x7f437c0ce750 2023-12-24T18:36:35.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f43717fa700 1 -- 172.21.15.50:0/1234702968 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c01a6a0 con 0x7f437c0ce750 2023-12-24T18:36:35.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.927+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c153dc0 con 0x7f437c0ce750 2023-12-24T18:36:35.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.931+0000 7f43717fa700 1 -- 172.21.15.50:0/1234702968 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f436c01aa50 con 0x7f437c0ce750 2023-12-24T18:36:35.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.931+0000 7f43717fa700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 0x7f4360062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.931+0000 7f43717fa700 1 -- 172.21.15.50:0/1234702968 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f436c07df50 con 0x7f437c0ce750 2023-12-24T18:36:35.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.931+0000 7f438120a700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 0x7f4360062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f438120a700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 0x7f4360062b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4378001ed0 tx=0x7f4378001b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 Processor -- start 2023-12-24T18:36:35.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 -- start start 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8ae0 0x167e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 0x167f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x15a3f30 con 0x13f8710 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x159fed0 con 0x1443790 2023-12-24T18:36:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x15660b0 con 0x13f8ae0 2023-12-24T18:36:35.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39916/0 (socket says 172.21.15.50:39916) 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 -- 172.21.15.50:0/2548140620 learned_addr learned my addr 172.21.15.50:0/2548140620 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f438120a700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8ae0 0x167e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 0x167f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 -- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8ae0 msgr2=0x167e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8ae0 0x167e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 -- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 msgr2=0x167f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 0x167f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.935+0000 7f4380a09700 1 -- 172.21.15.50:0/2548140620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14449e0 con 0x13f8710 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 0x167f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4380a09700 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f436c051bf0 tx=0x7f436c07c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2089141b8de074 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f43667fc700 1 -- 172.21.15.50:0/2548140620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c01ce20 con 0x13f8710 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f43667fc700 1 -- 172.21.15.50:0/2548140620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c055180 con 0x13f8710 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f43667fc700 1 -- 172.21.15.50:0/2548140620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c058ed0 con 0x13f8710 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- 172.21.15.50:0/2548140620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 msgr2=0x167ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f436c051bf0 tx=0x7f436c07c040 comp rx=0 tx=0).stop 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- 172.21.15.50:0/2548140620 shutdown_connections 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1443790 0x167f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x167ec90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 --2- 172.21.15.50:0/2548140620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8ae0 0x167e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- 172.21.15.50:0/2548140620 >> 172.21.15.50:0/2548140620 conn(0x13f8eb0 msgr2=0x1632930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- 172.21.15.50:0/2548140620 shutdown_connections 2023-12-24T18:36:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- 172.21.15.50:0/2548140620 wait complete. 2023-12-24T18:36:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.939+0000 7f4385719740 1 -- start start 2023-12-24T18:36:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 Processor -- start 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x1632860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x163ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 0x163d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1565d50 con 0x13f8710 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x153e970 con 0x13f8ae0 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x15a0770 con 0x1443790 2023-12-24T18:36:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4385719740 10 client.0 _ll_register_callbacks cb 0x15e96a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:36:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f438120a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x1632860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f438120a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x1632860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39924/0 (socket says 172.21.15.50:39924) 2023-12-24T18:36:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 0x163d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f438120a700 1 -- 172.21.15.50:0/2375305599 learned_addr learned my addr 172.21.15.50:0/2375305599 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4380a09700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x163ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 -- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 msgr2=0x163ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x163ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 -- 172.21.15.50:0/2375305599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 msgr2=0x1632860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x1632860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4381a0b700 1 -- 172.21.15.50:0/2375305599 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c153dc0 con 0x1443790 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.943+0000 7f4380a09700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x163ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 0x163d370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43740105e0 tx=0x7f4374009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bc4db87a33f1ffc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3301/0 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374002ba0 con 0x1443790 2023-12-24T18:36:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x153ecc0 con 0x1443790 2023-12-24T18:36:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mon.2 v2:172.21.15.82:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f4374002d00 con 0x1443790 2023-12-24T18:36:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4374003240 con 0x1443790 2023-12-24T18:36:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 10 client.4337 fetch_fsmap learned FSMap version 6 2023-12-24T18:36:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x156e370 con 0x1443790 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mon.2 v2:172.21.15.82:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x153ecc0 con 0x1443790 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mon.2 v2:172.21.15.82:3301/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f43740033a0 con 0x1443790 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 10 client.4337 fetch_fsmap finished waiting for FSMap version 6 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 10 client.4337 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 20 client.4337 populate_metadata read hostname 'smithi050' 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x168afb0 0x168d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 4 client.4337 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:36:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 --> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15423e0 con 0x168afb0 2023-12-24T18:36:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.947+0000 7f438120a700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x168afb0 0x168d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f435b7fe700 10 client.4337 ms_handle_connect on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:35.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f438120a700 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x168afb0 0x168d390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cb82aca6b2459ec server_cookie=74db4c397f67353b in_seq=0 out_seq=0 2023-12-24T18:36:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f435b7fe700 1 -- 172.21.15.50:0/2375305599 <== mds.0 v2:172.21.15.82:6832/2517814635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x15423e0 con 0x168afb0 2023-12-24T18:36:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f435b7fe700 10 client.4337 handle_command_reply: tid=0 2023-12-24T18:36:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 client.4337 shutdown 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 msgr2=0x163d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 0x163d370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43740105e0 tx=0x7f4374009040 comp rx=0 tx=0).stop 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 shutdown_connections 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x168afb0 0x168d390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1443790 0x163d370 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x163ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f435b7fe700 0 client.4337 ms_handle_reset on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 --2- 172.21.15.50:0/2375305599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8710 0x1632860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 >> 172.21.15.50:0/2375305599 conn(0x13f8eb0 msgr2=0x162e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 shutdown_connections 2023-12-24T18:36:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.951+0000 7f4385719740 1 -- 172.21.15.50:0/2375305599 wait complete. 2023-12-24T18:36:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.955+0000 7f4385719740 20 client.4337 trim_cache size 0 max 16384 2023-12-24T18:36:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 Processor -- start 2023-12-24T18:36:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 -- start start 2023-12-24T18:36:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8710 0x168d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x168de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1475650 con 0x13f8eb0 2023-12-24T18:36:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x16882b0 con 0x13f8ae0 2023-12-24T18:36:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1569400 con 0x13f8710 2023-12-24T18:36:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f438120a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f438120a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39926/0 (socket says 172.21.15.50:39926) 2023-12-24T18:36:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f438120a700 1 -- 172.21.15.50:0/2528115313 learned_addr learned my addr 172.21.15.50:0/2528115313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4380a09700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8710 0x168d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.975+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x168de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 -- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8710 msgr2=0x168d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8710 0x168d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 -- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 msgr2=0x168de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x168de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 -- 172.21.15.50:0/2528115313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1554d80 con 0x13f8eb0 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4381a0b700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x168de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f438120a700 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x1559430 tx=0x7f4378013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8af7177ab824e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4366ffd700 1 -- 172.21.15.50:0/2528115313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437802a030 con 0x13f8eb0 2023-12-24T18:36:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4366ffd700 1 -- 172.21.15.50:0/2528115313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378026c20 con 0x13f8eb0 2023-12-24T18:36:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4366ffd700 1 -- 172.21.15.50:0/2528115313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378023400 con 0x13f8eb0 2023-12-24T18:36:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 -- 172.21.15.50:0/2528115313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 msgr2=0x168d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x1559430 tx=0x7f4378013000 comp rx=0 tx=0).stop 2023-12-24T18:36:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 -- 172.21.15.50:0/2528115313 shutdown_connections 2023-12-24T18:36:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8ae0 0x168de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8710 0x168d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 --2- 172.21.15.50:0/2528115313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8eb0 0x168d390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 -- 172.21.15.50:0/2528115313 >> 172.21.15.50:0/2528115313 conn(0x16883f0 msgr2=0x163c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 -- 172.21.15.50:0/2528115313 shutdown_connections 2023-12-24T18:36:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.979+0000 7f4385719740 1 -- 172.21.15.50:0/2528115313 wait complete. 2023-12-24T18:36:35.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 -- start start 2023-12-24T18:36:35.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 Processor -- start 2023-12-24T18:36:35.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 0x167eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8eb0 0x167c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x15a2590 con 0x13f8ae0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x15a4ef0 con 0x13f8710 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1575550 con 0x13f8eb0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4385719740 10 client.0 _ll_register_callbacks cb 0x13c49d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4380a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4380a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39940/0 (socket says 172.21.15.50:39940) 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f438120a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 0x167eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4381a0b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8eb0 0x167c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.983+0000 7f4380a09700 1 -- 172.21.15.50:0/1247086054 learned_addr learned my addr 172.21.15.50:0/1247086054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:35.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 -- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8eb0 msgr2=0x167c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8eb0 0x167c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 -- 172.21.15.50:0/1247086054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 msgr2=0x167bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 -- 172.21.15.50:0/1247086054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4378026600 con 0x13f8710 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4380a09700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f438120a700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 0x167eee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4378024000 tx=0x7f4378015070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e84eb92a6f860636 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378023770 con 0x13f8710 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f437802b070 con 0x13f8710 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f436c055180 con 0x13f8710 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43780238d0 con 0x13f8710 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 10 client.4429 fetch_fsmap learned FSMap version 6 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1549130 con 0x13f8710 2023-12-24T18:36:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c055180 con 0x13f8710 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f4378023a30 con 0x13f8710 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 10 client.4429 fetch_fsmap finished waiting for FSMap version 6 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 10 client.4429 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 20 client.4429 populate_metadata read hostname 'smithi050' 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x1443790 0x167c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 4 client.4429 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.987+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 --> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1574410 con 0x1443790 2023-12-24T18:36:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4380a09700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x1443790 0x167c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f435b7fe700 10 client.4429 ms_handle_connect on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4380a09700 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x1443790 0x167c830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e4b37ee7f5df9a3 server_cookie=e0997e6cf813c961 in_seq=0 out_seq=0 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f435b7fe700 1 -- 172.21.15.50:0/1247086054 <== mds.0 v2:172.21.15.82:6832/2517814635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1574410 con 0x1443790 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f435b7fe700 10 client.4429 handle_command_reply: tid=0 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 client.4429 shutdown 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 msgr2=0x167eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 0x167eee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4378024000 tx=0x7f4378015070 comp rx=0 tx=0).stop 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 shutdown_connections 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0x1443790 0x167c830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x13f8eb0 0x167c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x13f8ae0 0x167bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 --2- 172.21.15.50:0/1247086054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x13f8710 0x167eee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 >> 172.21.15.50:0/1247086054 conn(0x16883f0 msgr2=0x162d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f435b7fe700 0 client.4429 ms_handle_reset on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 shutdown_connections 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 1 -- 172.21.15.50:0/1247086054 wait complete. 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.991+0000 7f4385719740 20 client.4429 trim_cache size 0 max 16384 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:36:35.996 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4288, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.8792584889999997, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 6, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 24, 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.618167252999999 2023-12-24T18:36:35.997 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 msgr2=0x7f4360062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 0x7f4360062b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4378001ed0 tx=0x7f4378001b80 comp rx=0 tx=0).stop 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 msgr2=0x7f437c143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 0x7f437c143af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f436c015000 tx=0x7f436c016000 comp rx=0 tx=0).stop 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 shutdown_connections 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4360060650 0x7f4360062b00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f437c159a20 0x7f437c0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f437c0ce750 0x7f437c143af0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 --2- 172.21.15.50:0/1234702968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f437c06b540 0x7f437c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 >> 172.21.15.50:0/1234702968 conn(0x7f437c0cffb0 msgr2=0x7f437c0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 shutdown_connections 2023-12-24T18:36:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:35.995+0000 7f438346e700 1 -- 172.21.15.50:0/1234702968 wait complete. 2023-12-24T18:36:36.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:36:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.187+0000 7f9d9ddcc700 1 Processor -- start 2023-12-24T18:36:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.187+0000 7f9d9ddcc700 1 -- start start 2023-12-24T18:36:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9ddcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d980ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9ddcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d980adc90 0x7f9d98160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9ddcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980b0460 con 0x7f9d9815a2d0 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9ddcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9806d8c0 con 0x7f9d980adc90 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9ddcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980afc60 con 0x7f9d9806c820 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9cdca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d9815a2d0 0x7f9d980ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45292/0 (socket says 172.21.15.50:45292) 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9cdca700 1 -- 172.21.15.50:0/2207180386 learned_addr learned my addr 172.21.15.50:0/2207180386 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/2207180386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d980ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d9d5cb700 1 --2- 172.21.15.50:0/2207180386 >> v2:172.21.15.82:3300/0 conn(0x7f9d980adc90 0x7f9d98160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8f7fe700 1 -- 172.21.15.50:0/2207180386 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795455229 0 0) 0x7f9d980b0460 con 0x7f9d9815a2d0 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8f7fe700 1 -- 172.21.15.50:0/2207180386 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d80003570 con 0x7f9d9815a2d0 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 -- 172.21.15.50:0/2207180386 >> v2:172.21.15.82:3300/0 conn(0x7f9d980adc90 msgr2=0x7f9d98160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/2207180386 >> v2:172.21.15.82:3300/0 conn(0x7f9d980adc90 0x7f9d98160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 -- 172.21.15.50:0/2207180386 >> v1:172.21.15.50:6789/0 conn(0x7f9d9815a2d0 legacy=0x7f9d980ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 -- 172.21.15.50:0/2207180386 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980ae100 con 0x7f9d9806c820 2023-12-24T18:36:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.191+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/2207180386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d980ad750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d880098e0 tx=0x7f9d880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c70a9b89f6abf08c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d8f7fe700 1 -- 172.21.15.50:0/2207180386 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88011630 con 0x7f9d9806c820 2023-12-24T18:36:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d8f7fe700 1 -- 172.21.15.50:0/2207180386 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88011790 con 0x7f9d9806c820 2023-12-24T18:36:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d8f7fe700 1 -- 172.21.15.50:0/2207180386 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88011b30 con 0x7f9d9806c820 2023-12-24T18:36:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/2207180386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 msgr2=0x7f9d980ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/2207180386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d980ad750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d880098e0 tx=0x7f9d880091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/2207180386 shutdown_connections 2023-12-24T18:36:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/2207180386 >> v2:172.21.15.82:3300/0 conn(0x7f9d980adc90 0x7f9d98160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/2207180386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d980ad750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/2207180386 >> 172.21.15.50:0/2207180386 conn(0x7f9d98067b80 msgr2=0x7f9d980cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/2207180386 shutdown_connections 2023-12-24T18:36:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.195+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/2207180386 wait complete. 2023-12-24T18:36:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 Processor -- start 2023-12-24T18:36:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 -- start start 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d98153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9815a2d0 0x7f9d981586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980ca640 con 0x7f9d980adc90 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c9a30 con 0x7f9d9815a2d0 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9ddcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c9d10 con 0x7f9d9806c820 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39942/0 (socket says 172.21.15.50:39942) 2023-12-24T18:36:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 -- 172.21.15.50:0/418495527 learned_addr learned my addr 172.21.15.50:0/418495527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9d5cb700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9815a2d0 0x7f9d981586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d9cdca700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d98153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 -- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 msgr2=0x7f9d98153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d98153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 -- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9815a2d0 msgr2=0x7f9d981586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9815a2d0 0x7f9d981586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.199+0000 7f9d8ffff700 1 -- 172.21.15.50:0/418495527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009420 con 0x7f9d980adc90 2023-12-24T18:36:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d8ffff700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d9806d870 tx=0x7f9d88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88000d10 con 0x7f9d980adc90 2023-12-24T18:36:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88011b10 con 0x7f9d980adc90 2023-12-24T18:36:36.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d980c9ff0 con 0x7f9d980adc90 2023-12-24T18:36:36.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88025620 con 0x7f9d980adc90 2023-12-24T18:36:36.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d98154030 con 0x7f9d980adc90 2023-12-24T18:36:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.203+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d980ca7b0 con 0x7f9d980adc90 2023-12-24T18:36:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.207+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9d880259d0 con 0x7f9d980adc90 2023-12-24T18:36:36.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.207+0000 7f9d8cff9700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 0x7f9d84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:36.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.207+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f9d8807e180 con 0x7f9d980adc90 2023-12-24T18:36:36.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.207+0000 7f9d9cdca700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 0x7f9d84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:36.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.207+0000 7f9d9cdca700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 0x7f9d84062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d94005c50 tx=0x7f9d94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:36.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.215+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9d8804e3e0 con 0x7f9d980adc90 2023-12-24T18:36:36.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.427+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d9804be40 con 0x7f9d980adc90 2023-12-24T18:36:36.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.427+0000 7f9d8cff9700 1 -- 172.21.15.50:0/418495527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9d88051a00 con 0x7f9d980adc90 2023-12-24T18:36:36.429 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-24T18:36:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 msgr2=0x7f9d84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 0x7f9d84062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d94005c50 tx=0x7f9d94009040 comp rx=0 tx=0).stop 2023-12-24T18:36:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 msgr2=0x7f9d980caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d9806d870 tx=0x7f9d88017000 comp rx=0 tx=0).stop 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 shutdown_connections 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9d84060550 0x7f9d84062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9815a2d0 0x7f9d981586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d980adc90 0x7f9d980caad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 --2- 172.21.15.50:0/418495527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9806c820 0x7f9d98153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 >> 172.21.15.50:0/418495527 conn(0x7f9d98067b80 msgr2=0x7f9d98155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 shutdown_connections 2023-12-24T18:36:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:36.431+0000 7f9d9ddcc700 1 -- 172.21.15.50:0/418495527 wait complete. 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:36:36.455 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-24T18:36:36.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.456 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42414sec preferred_lft 42414sec 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:36:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:36.475 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-24T18:36:36.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-24T18:36:36.475 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:36.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.634 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:36:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:36:36.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.669 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:36:36.760 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:36:36.760 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:36:36.761 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:36:36.761 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:36:36.761 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:36:36.761 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:36:36.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.761 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:36.761 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:36.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:36:36.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:36:36.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:36:36.762 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:36.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.859 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:36:36.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.880 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-24T18:36:36.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:36.942 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:36.942 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:36.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-24T18:36:36.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-24T18:36:36.942 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:37.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-24T18:36:37.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-24T18:36:37.061 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:37.238 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:37.238 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:37.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:36:37.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-12-24T18:36:37.238 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:37.314 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-24T18:36:37.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:36:37.314 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:37.332 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-24T18:36:37.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:36:37.333 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:37.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-24T18:36:37.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T18:36:37.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T18:36:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T18:36:37.563 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T18:36:37.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:37.563 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-24T18:36:37.626 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T18:36:37.626 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-24T18:36:37.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-24T18:36:37.717 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T18:36:37.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T18:36:37.793 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T18:36:37.797 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T18:36:37.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:37.797 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-24T18:36:37.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2023-12-24T18:36:37.815+0000 7fa7893aa380 -1 init, newargv = 0x55d08d6b25a0 newargc=15 2023-12-24T18:36:37.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[38725]: starting ceph client 2023-12-24T18:36:37.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[38725]: starting fuse 2023-12-24T18:36:38.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-24T18:36:38.976 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T18:36:38.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T18:36:39.053 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T18:36:39.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T18:36:39.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:39.057 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-24T18:36:39.120 INFO:teuthology.orchestra.run.smithi050.stdout:49 2023-12-24T18:36:39.120 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-24T18:36:39.121 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T18:36:39.122 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-24T18:36:39.123 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2023-12-24T18:36:39.123 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-24T18:36:39.287 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.38725.asok 2023-12-24T18:36:39.470 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.38725.asok 2023-12-24T18:36:39.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:39.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.38725.asok status 2023-12-24T18:36:39.658 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:36:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-24T18:36:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "38725", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4413, 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-24T18:36:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4413 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1053784862 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1053784862 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4413 192.168.0.1:0/1053784862", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1053784862", 2023-12-24T18:36:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 6, 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-24T18:36:39.661 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:36:39.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:39.672 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-24T18:36:39.672 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:39.691 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-24T18:36:39.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:39.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:39.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:39.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:36:39.773 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-24T18:36:39.884 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2023-12-24T18:36:39.885 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-24T18:36:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:39.886 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-24T18:36:39.886 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:36:39.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-24T18:36:39.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[38725]: fuse finished with error 0 and tester_r 0 2023-12-24T18:36:39.927 INFO:teuthology.orchestra.run:waiting for 900 2023-12-24T18:36:40.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:36:40.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:40.011 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-24T18:36:40.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 Processor -- start 2023-12-24T18:36:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 -- start start 2023-12-24T18:36:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8d815a2d0 0x7fc8d80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8d80ade60 0x7fc8d8160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80b0460 con 0x7fc8d806c820 2023-12-24T18:36:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d806d8c0 con 0x7fc8d80ade60 2023-12-24T18:36:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.251+0000 7fc8dddcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d80afc60 con 0x7fc8d815a2d0 2023-12-24T18:36:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8d80ade60 0x7fc8d8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dcdca700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8d815a2d0 0x7fc8d80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8d80ade60 0x7fc8d8160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60554/0 (socket says 172.21.15.50:60554) 2023-12-24T18:36:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2266315651 learned_addr learned my addr 172.21.15.50:0/2266315651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8d7fff700 1 --1- 172.21.15.50:0/2266315651 >> v1:172.21.15.82:6789/0 conn(0x7fc8d806c820 0x7fc8d80ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38168/0 (socket says 172.21.15.50:38168) 2023-12-24T18:36:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2266315651 >> v2:172.21.15.82:3300/0 conn(0x7fc8d815a2d0 msgr2=0x7fc8d80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 --2- 172.21.15.50:0/2266315651 >> v2:172.21.15.82:3300/0 conn(0x7fc8d815a2d0 0x7fc8d80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2266315651 >> v1:172.21.15.82:6789/0 conn(0x7fc8d806c820 legacy=0x7fc8d80ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2266315651 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d806a5c0 con 0x7fc8d80ade60 2023-12-24T18:36:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dd5cb700 1 --2- 172.21.15.50:0/2266315651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d80ade60 0x7fc8d8160990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8069730 tx=0x7fc8d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec40d26b76a3744 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8d77fe700 1 -- 172.21.15.50:0/2266315651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0009e70 con 0x7fc8d80ade60 2023-12-24T18:36:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8d77fe700 1 -- 172.21.15.50:0/2266315651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000b860 con 0x7fc8d80ade60 2023-12-24T18:36:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8d77fe700 1 -- 172.21.15.50:0/2266315651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000bc20 con 0x7fc8d80ade60 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2266315651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d80ade60 msgr2=0x7fc8d8160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2266315651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d80ade60 0x7fc8d8160990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8069730 tx=0x7fc8d0009250 comp rx=0 tx=0).stop 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2266315651 shutdown_connections 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2266315651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d80ade60 0x7fc8d8160990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2266315651 >> v2:172.21.15.82:3300/0 conn(0x7fc8d815a2d0 0x7fc8d80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2266315651 >> 172.21.15.50:0/2266315651 conn(0x7fc8d8067b80 msgr2=0x7fc8d80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:40.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2266315651 shutdown_connections 2023-12-24T18:36:40.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.255+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2266315651 wait complete. 2023-12-24T18:36:40.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.259+0000 7fc8dddcc700 1 Processor -- start 2023-12-24T18:36:40.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.259+0000 7fc8dddcc700 1 -- start start 2023-12-24T18:36:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d806c820 0x7fc8d8144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d80ade60 0x7fc8d8158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815e700 con 0x7fc8d815a2d0 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815e140 con 0x7fc8d80ade60 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815e420 con 0x7fc8d806c820 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60568/0 (socket says 172.21.15.50:60568) 2023-12-24T18:36:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2342962576 learned_addr learned my addr 172.21.15.50:0/2342962576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8d7fff700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d80ade60 0x7fc8d8158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dcdca700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d806c820 0x7fc8d8144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d806c820 msgr2=0x7fc8d8144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d806c820 0x7fc8d8144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d80ade60 msgr2=0x7fc8d8158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d80ade60 0x7fc8d8158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 -- 172.21.15.50:0/2342962576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00094f0 con 0x7fc8d815a2d0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dd5cb700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0006fd0 tx=0x7fc8d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d001f070 con 0x7fc8d815a2d0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000b9d0 con 0x7fc8d815a2d0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0011420 con 0x7fc8d815a2d0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80abc70 con 0x7fc8d815a2d0 2023-12-24T18:36:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.263+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d815d3d0 con 0x7fc8d815a2d0 2023-12-24T18:36:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d804be40 con 0x7fc8d815a2d0 2023-12-24T18:36:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc8d0011790 con 0x7fc8d815a2d0 2023-12-24T18:36:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8d4ff9700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 0x7fc8bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8dcdca700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 0x7fc8bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8dcdca700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 0x7fc8bc062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00f570 tx=0x7fc8cc00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.267+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fc8d00526e0 con 0x7fc8d815a2d0 2023-12-24T18:36:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.275+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc8d004e2e0 con 0x7fc8d815a2d0 2023-12-24T18:36:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.451+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8d8154340 con 0x7fc8d815a2d0 2023-12-24T18:36:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.451+0000 7fc8d4ff9700 1 -- 172.21.15.50:0/2342962576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fc8d0015090 con 0x7fc8d815a2d0 2023-12-24T18:36:40.454 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:40.455 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 msgr2=0x7fc8bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 0x7fc8bc062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00f570 tx=0x7fc8cc00b040 comp rx=0 tx=0).stop 2023-12-24T18:36:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 msgr2=0x7fc8d8159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0006fd0 tx=0x7fc8d0017000 comp rx=0 tx=0).stop 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 shutdown_connections 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc8bc060550 0x7fc8bc062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8d815a2d0 0x7fc8d8159130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d80ade60 0x7fc8d8158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 --2- 172.21.15.50:0/2342962576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d806c820 0x7fc8d8144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 >> 172.21.15.50:0/2342962576 conn(0x7fc8d8067b80 msgr2=0x7fc8d806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 shutdown_connections 2023-12-24T18:36:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.455+0000 7fc8dddcc700 1 -- 172.21.15.50:0/2342962576 wait complete. 2023-12-24T18:36:40.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.635+0000 7efe75c8e700 1 Processor -- start 2023-12-24T18:36:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.635+0000 7efe75c8e700 1 -- start start 2023-12-24T18:36:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe75c8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 0x7efe700ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe75c8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe700ade60 0x7efe70160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe75c8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe700b0460 con 0x7efe7006c820 2023-12-24T18:36:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe75c8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7006d8c0 con 0x7efe700ade60 2023-12-24T18:36:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe75c8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700afc60 con 0x7efe7015a2d0 2023-12-24T18:36:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe700ade60 0x7efe70160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe700ade60 0x7efe70160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60580/0 (socket says 172.21.15.50:60580) 2023-12-24T18:36:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 -- 172.21.15.50:0/1236046509 learned_addr learned my addr 172.21.15.50:0/1236046509 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe74c8c700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 0x7efe700ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 -- 172.21.15.50:0/1236046509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 msgr2=0x7efe700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 0x7efe700ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 -- 172.21.15.50:0/1236046509 >> v1:172.21.15.82:6789/0 conn(0x7efe7006c820 legacy=0x7efe700ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe7548d700 1 -- 172.21.15.50:0/1236046509 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7006a5c0 con 0x7efe700ade60 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.639+0000 7efe74c8c700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 0x7efe700ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe7548d700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe70160990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f20 tx=0x7efe68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e13760b0726947 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe6f7fe700 1 -- 172.21.15.50:0/1236046509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800e070 con 0x7efe700ade60 2023-12-24T18:36:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe6f7fe700 1 -- 172.21.15.50:0/1236046509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800ba80 con 0x7efe700ade60 2023-12-24T18:36:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe6f7fe700 1 -- 172.21.15.50:0/1236046509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680092e0 con 0x7efe700ade60 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 -- 172.21.15.50:0/1236046509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 msgr2=0x7efe70160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe70160990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f20 tx=0x7efe68009840 comp rx=0 tx=0).stop 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 -- 172.21.15.50:0/1236046509 shutdown_connections 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe70160990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 --2- 172.21.15.50:0/1236046509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7015a2d0 0x7efe700ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 -- 172.21.15.50:0/1236046509 >> 172.21.15.50:0/1236046509 conn(0x7efe70067b80 msgr2=0x7efe700cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 -- 172.21.15.50:0/1236046509 shutdown_connections 2023-12-24T18:36:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.643+0000 7efe75c8e700 1 -- 172.21.15.50:0/1236046509 wait complete. 2023-12-24T18:36:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 Processor -- start 2023-12-24T18:36:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 -- start start 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7006c820 0x7efe70137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe7015a2d0 0x7efe700cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7015a6a0 con 0x7efe700ade60 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7015a980 con 0x7efe7015a2d0 2023-12-24T18:36:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe75c8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe70138050 con 0x7efe7006c820 2023-12-24T18:36:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.647+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60592/0 (socket says 172.21.15.50:60592) 2023-12-24T18:36:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 -- 172.21.15.50:0/4126126554 learned_addr learned my addr 172.21.15.50:0/4126126554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe7548d700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe7015a2d0 0x7efe700cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe74c8c700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7006c820 0x7efe70137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 -- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7006c820 msgr2=0x7efe70137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7006c820 0x7efe70137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 -- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe7015a2d0 msgr2=0x7efe700cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe7015a2d0 0x7efe700cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 -- 172.21.15.50:0/4126126554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009ae0 con 0x7efe700ade60 2023-12-24T18:36:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6ffff700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c5c0 tx=0x7efe5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c011590 con 0x7efe700ade60 2023-12-24T18:36:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c011710 con 0x7efe700ade60 2023-12-24T18:36:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7014ee40 con 0x7efe700ade60 2023-12-24T18:36:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c011ad0 con 0x7efe700ade60 2023-12-24T18:36:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.651+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7014f400 con 0x7efe700ade60 2023-12-24T18:36:40.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.655+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7004be40 con 0x7efe700ade60 2023-12-24T18:36:40.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.655+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efe5c01b3b0 con 0x7efe700ade60 2023-12-24T18:36:40.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.655+0000 7efe6cff9700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 0x7efe54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:40.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.655+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7efe5c07bee0 con 0x7efe700ade60 2023-12-24T18:36:40.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.655+0000 7efe74c8c700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 0x7efe54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:40.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.659+0000 7efe74c8c700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 0x7efe54062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe70154c00 tx=0x7efe64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:40.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.663+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe5c04c1e0 con 0x7efe700ade60 2023-12-24T18:36:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.839+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe7015aac0 con 0x7efe700ade60 2023-12-24T18:36:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.839+0000 7efe6cff9700 1 -- 172.21.15.50:0/4126126554 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7efe5c04f800 con 0x7efe700ade60 2023-12-24T18:36:40.843 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:40.843 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 msgr2=0x7efe54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 0x7efe54062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe70154c00 tx=0x7efe64008040 comp rx=0 tx=0).stop 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 msgr2=0x7efe7014e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c5c0 tx=0x7efe5c00c8d0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 shutdown_connections 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe54060550 0x7efe54062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe7015a2d0 0x7efe700cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe700ade60 0x7efe7014e360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 --2- 172.21.15.50:0/4126126554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe7006c820 0x7efe70137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 >> 172.21.15.50:0/4126126554 conn(0x7efe70067b80 msgr2=0x7efe700c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 shutdown_connections 2023-12-24T18:36:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:40.843+0000 7efe75c8e700 1 -- 172.21.15.50:0/4126126554 wait complete. 2023-12-24T18:36:40.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:36:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.035+0000 7fddf3385700 1 Processor -- start 2023-12-24T18:36:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.035+0000 7fddf3385700 1 -- start start 2023-12-24T18:36:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf3385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddec1554a0 0x7fddec0ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf3385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf3385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0adfb0 con 0x7fddec0afc10 2023-12-24T18:36:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf3385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec0ae960 con 0x7fddec1554a0 2023-12-24T18:36:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf3385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0b0180 con 0x7fddec0b0f20 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf0920700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddec0afc10 0x7fddec0b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37344/0 (socket says 172.21.15.50:37344) 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddec1554a0 0x7fddec0ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf0920700 1 -- 172.21.15.50:0/1278821225 learned_addr learned my addr 172.21.15.50:0/1278821225 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1922700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 -- 172.21.15.50:0/1278821225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 msgr2=0x7fddec15f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec15f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 -- 172.21.15.50:0/1278821225 >> v1:172.21.15.50:6789/0 conn(0x7fddec0afc10 legacy=0x7fddec0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 -- 172.21.15.50:0/1278821225 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0c93c0 con 0x7fddec1554a0 2023-12-24T18:36:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1922700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec15f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fddf1121700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ae420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdde80098e0 tx=0x7fdde80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81c532cf6c6940 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.039+0000 7fdde3fff700 1 -- 172.21.15.50:0/1278821225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8009e80 con 0x7fddec1554a0 2023-12-24T18:36:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fdde3fff700 1 -- 172.21.15.50:0/1278821225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde800b860 con 0x7fddec1554a0 2023-12-24T18:36:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fdde3fff700 1 -- 172.21.15.50:0/1278821225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800bbe0 con 0x7fddec1554a0 2023-12-24T18:36:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 -- 172.21.15.50:0/1278821225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 msgr2=0x7fddec0ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ae420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdde80098e0 tx=0x7fdde80091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 -- 172.21.15.50:0/1278821225 shutdown_connections 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec15f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 --2- 172.21.15.50:0/1278821225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ae420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 -- 172.21.15.50:0/1278821225 >> 172.21.15.50:0/1278821225 conn(0x7fddec06c820 msgr2=0x7fddec06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 -- 172.21.15.50:0/1278821225 shutdown_connections 2023-12-24T18:36:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.043+0000 7fddf3385700 1 -- 172.21.15.50:0/1278821225 wait complete. 2023-12-24T18:36:41.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 Processor -- start 2023-12-24T18:36:41.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 -- start start 2023-12-24T18:36:41.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec0afc10 0x7fddec142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec169220 con 0x7fddec1554a0 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1433f0 con 0x7fddec0afc10 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf3385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0c7400 con 0x7fddec0b0f20 2023-12-24T18:36:41.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf1922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf1922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60602/0 (socket says 172.21.15.50:60602) 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf1922700 1 -- 172.21.15.50:0/1846027849 learned_addr learned my addr 172.21.15.50:0/1846027849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.047+0000 7fddf1121700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec0afc10 0x7fddec142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf0920700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 -- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 msgr2=0x7fddec0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 -- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec0afc10 msgr2=0x7fddec142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec0afc10 0x7fddec142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 -- 172.21.15.50:0/1846027849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009420 con 0x7fddec1554a0 2023-12-24T18:36:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf1922700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdde400d150 tx=0x7fdde4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400dc30 con 0x7fddec1554a0 2023-12-24T18:36:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde400f040 con 0x7fddec1554a0 2023-12-24T18:36:41.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec0c76e0 con 0x7fddec1554a0 2023-12-24T18:36:41.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4015400 con 0x7fddec1554a0 2023-12-24T18:36:41.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0c7110 con 0x7fddec1554a0 2023-12-24T18:36:41.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.051+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec1693e0 con 0x7fddec1554a0 2023-12-24T18:36:41.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.055+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdde4015770 con 0x7fddec1554a0 2023-12-24T18:36:41.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.055+0000 7fdde17fa700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 0x7fddd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:41.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.055+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fdde407d350 con 0x7fddec1554a0 2023-12-24T18:36:41.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.055+0000 7fddf1121700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 0x7fddd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:41.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.059+0000 7fddf1121700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 0x7fddd0062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdde80091e0 tx=0x7fdde8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.063+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddec1693e0 con 0x7fddec1554a0 2023-12-24T18:36:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:41.279+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fddec0652e0 con 0x7fddec1554a0 2023-12-24T18:36:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.291+0000 7fdde17fa700 1 -- 172.21.15.50:0/1846027849 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdde404d5b0 con 0x7fddec1554a0 2023-12-24T18:36:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 msgr2=0x7fddd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 0x7fddd0062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdde80091e0 tx=0x7fdde8017000 comp rx=0 tx=0).stop 2023-12-24T18:36:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 msgr2=0x7fddec0ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdde400d150 tx=0x7fdde4009a50 comp rx=0 tx=0).stop 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 shutdown_connections 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fddd0060550 0x7fddd0062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddec1554a0 0x7fddec0ca3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddec0b0f20 0x7fddec0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 --2- 172.21.15.50:0/1846027849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec0afc10 0x7fddec142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 >> 172.21.15.50:0/1846027849 conn(0x7fddec06c820 msgr2=0x7fddec151020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 shutdown_connections 2023-12-24T18:36:42.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.295+0000 7fddf3385700 1 -- 172.21.15.50:0/1846027849 wait complete. 2023-12-24T18:36:42.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:36:42.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.503+0000 7faf1488e700 1 Processor -- start 2023-12-24T18:36:42.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.503+0000 7faf1488e700 1 -- start start 2023-12-24T18:36:42.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf1488e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf100c8dd0 0x7faf1014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf1488e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf1014fef0 0x7faf100c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf1488e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf100c71f0 con 0x7faf100c8a00 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf1488e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1015d790 con 0x7faf100c8dd0 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf1488e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10150350 con 0x7faf1014fef0 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf100c8a00 0x7faf100c6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37352/0 (socket says 172.21.15.50:37352) 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0f7fe700 1 -- 172.21.15.50:0/2941392167 learned_addr learned my addr 172.21.15.50:0/2941392167 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0effd700 1 --2- 172.21.15.50:0/2941392167 >> v2:172.21.15.50:3300/0 conn(0x7faf100c8dd0 0x7faf1014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0ffff700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf1014fef0 0x7faf100c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0e7fc700 1 -- 172.21.15.50:0/2941392167 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505797746 0 0) 0x7faf100c71f0 con 0x7faf100c8a00 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0e7fc700 1 -- 172.21.15.50:0/2941392167 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef8003570 con 0x7faf100c8a00 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0effd700 1 -- 172.21.15.50:0/2941392167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf1014fef0 msgr2=0x7faf100c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0effd700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf1014fef0 0x7faf100c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0effd700 1 -- 172.21.15.50:0/2941392167 >> v1:172.21.15.50:6789/0 conn(0x7faf100c8a00 legacy=0x7faf100c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.507+0000 7faf0effd700 1 -- 172.21.15.50:0/2941392167 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1015cb10 con 0x7faf100c8dd0 2023-12-24T18:36:42.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf0effd700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100c8dd0 0x7faf1014f9b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf040098e0 tx=0x7faf040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ea5f3cae7c2834 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:42.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf0e7fc700 1 -- 172.21.15.50:0/2941392167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011630 con 0x7faf100c8dd0 2023-12-24T18:36:42.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf0e7fc700 1 -- 172.21.15.50:0/2941392167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04011790 con 0x7faf100c8dd0 2023-12-24T18:36:42.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf0e7fc700 1 -- 172.21.15.50:0/2941392167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011b30 con 0x7faf100c8dd0 2023-12-24T18:36:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 -- 172.21.15.50:0/2941392167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100c8dd0 msgr2=0x7faf1014f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100c8dd0 0x7faf1014f9b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf040098e0 tx=0x7faf040091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 -- 172.21.15.50:0/2941392167 shutdown_connections 2023-12-24T18:36:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf1014fef0 0x7faf100c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 --2- 172.21.15.50:0/2941392167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100c8dd0 0x7faf1014f9b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 -- 172.21.15.50:0/2941392167 >> 172.21.15.50:0/2941392167 conn(0x7faf10067250 msgr2=0x7faf10067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 -- 172.21.15.50:0/2941392167 shutdown_connections 2023-12-24T18:36:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.511+0000 7faf1488e700 1 -- 172.21.15.50:0/2941392167 wait complete. 2023-12-24T18:36:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 Processor -- start 2023-12-24T18:36:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 -- start start 2023-12-24T18:36:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf100c8a00 0x7faf100b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf100c8dd0 0x7faf1015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10154c30 con 0x7faf1014fef0 2023-12-24T18:36:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10154020 con 0x7faf100c8a00 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf1488e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10154300 con 0x7faf100c8dd0 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60610/0 (socket says 172.21.15.50:60610) 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf0ffff700 1 -- 172.21.15.50:0/3155743265 learned_addr learned my addr 172.21.15.50:0/3155743265 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf0f7fe700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf100c8a00 0x7faf100b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.515+0000 7faf0effd700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf100c8dd0 0x7faf1015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 -- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf100c8dd0 msgr2=0x7faf1015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf100c8dd0 0x7faf1015dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 -- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf100c8a00 msgr2=0x7faf100b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf100c8a00 0x7faf100b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 -- 172.21.15.50:0/3155743265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009420 con 0x7faf1014fef0 2023-12-24T18:36:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf0ffff700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf08009df0 tx=0x7faf0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800caa0 con 0x7faf1014fef0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800f040 con 0x7faf1014fef0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf101545e0 con 0x7faf1014fef0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ce70 con 0x7faf1014fef0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf100afdd0 con 0x7faf1014fef0 2023-12-24T18:36:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.519+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf10154da0 con 0x7faf1014fef0 2023-12-24T18:36:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.523+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faf08014690 con 0x7faf1014fef0 2023-12-24T18:36:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.523+0000 7faef77fe700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 0x7faefc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.523+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7faf0807d350 con 0x7faf1014fef0 2023-12-24T18:36:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.523+0000 7faf0f7fe700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 0x7faefc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.523+0000 7faf0f7fe700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 0x7faefc062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf00007fd0 tx=0x7faf00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.531+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf08051040 con 0x7faf1014fef0 2023-12-24T18:36:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:42.743+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf1004be40 con 0x7faf1014fef0 2023-12-24T18:36:43.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.303+0000 7faef77fe700 1 -- 172.21.15.50:0/3155743265 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf08050bd0 con 0x7faf1014fef0 2023-12-24T18:36:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 msgr2=0x7faefc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 0x7faefc062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf00007fd0 tx=0x7faf00009040 comp rx=0 tx=0).stop 2023-12-24T18:36:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 msgr2=0x7faf100a8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf08009df0 tx=0x7faf0800b040 comp rx=0 tx=0).stop 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 shutdown_connections 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faefc060550 0x7faefc062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf1014fef0 0x7faf100a8d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf100c8dd0 0x7faf1015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 --2- 172.21.15.50:0/3155743265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf100c8a00 0x7faf100b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 >> 172.21.15.50:0/3155743265 conn(0x7faf10067250 msgr2=0x7faf1006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 shutdown_connections 2023-12-24T18:36:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.307+0000 7faf1488e700 1 -- 172.21.15.50:0/3155743265 wait complete. 2023-12-24T18:36:43.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:43.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.503+0000 7fbe5c86e700 1 Processor -- start 2023-12-24T18:36:43.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 -- start start 2023-12-24T18:36:43.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe5806bce0 0x7fbe580aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe580ab040 0x7fbe580ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5806b850 con 0x7fbe58159bc0 2023-12-24T18:36:43.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5806ac40 con 0x7fbe5806bce0 2023-12-24T18:36:43.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5c86e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806af20 con 0x7fbe580ab040 2023-12-24T18:36:43.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe55d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe5806bce0 0x7fbe580aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe58159bc0 0x7fbe58159f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37368/0 (socket says 172.21.15.50:37368) 2023-12-24T18:36:43.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe5659c700 1 -- 172.21.15.50:0/2033460929 learned_addr learned my addr 172.21.15.50:0/2033460929 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:43.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.507+0000 7fbe56d9d700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe580ab040 0x7fbe580ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2033460929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe580ab040 msgr2=0x7fbe580ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe55d9b700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe580ab040 0x7fbe580ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2033460929 >> v1:172.21.15.50:6789/0 conn(0x7fbe58159bc0 legacy=0x7fbe58159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2033460929 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5806b200 con 0x7fbe5806bce0 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5559a700 1 -- 172.21.15.50:0/2033460929 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095462413 0 0) 0x7fbe5806b850 con 0x7fbe58159bc0 2023-12-24T18:36:43.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe55d9b700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5806bce0 0x7fbe580aab00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0098e0 tx=0x7fbe4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e479e76c6cac20d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5559a700 1 -- 172.21.15.50:0/2033460929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00b640 con 0x7fbe5806bce0 2023-12-24T18:36:43.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5559a700 1 -- 172.21.15.50:0/2033460929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00b7a0 con 0x7fbe5806bce0 2023-12-24T18:36:43.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5559a700 1 -- 172.21.15.50:0/2033460929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00bb40 con 0x7fbe5806bce0 2023-12-24T18:36:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2033460929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5806bce0 msgr2=0x7fbe580aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5806bce0 0x7fbe580aab00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0098e0 tx=0x7fbe4c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2033460929 shutdown_connections 2023-12-24T18:36:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe580ab040 0x7fbe580ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2033460929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5806bce0 0x7fbe580aab00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2033460929 >> 172.21.15.50:0/2033460929 conn(0x7fbe580cbba0 msgr2=0x7fbe580cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2033460929 shutdown_connections 2023-12-24T18:36:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.511+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2033460929 wait complete. 2023-12-24T18:36:43.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.515+0000 7fbe5c86e700 1 Processor -- start 2023-12-24T18:36:43.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.515+0000 7fbe5c86e700 1 -- start start 2023-12-24T18:36:43.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.515+0000 7fbe5c86e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe5806bce0 0x7fbe581532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe58159bc0 0x7fbe580c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580aeab0 con 0x7fbe580ab040 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580b0a00 con 0x7fbe5806bce0 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5816a6f0 con 0x7fbe58159bc0 2023-12-24T18:36:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60634/0 (socket says 172.21.15.50:60634) 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2349297197 learned_addr learned my addr 172.21.15.50:0/2349297197 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5659c700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe5806bce0 0x7fbe581532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe56d9d700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe58159bc0 0x7fbe580c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe58159bc0 msgr2=0x7fbe580c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe58159bc0 0x7fbe580c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe5806bce0 msgr2=0x7fbe581532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe5806bce0 0x7fbe581532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 -- 172.21.15.50:0/2349297197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009420 con 0x7fbe580ab040 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe55d9b700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009f80 tx=0x7fbe4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00bb20 con 0x7fbe580ab040 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c000c90 con 0x7fbe580ab040 2023-12-24T18:36:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c011650 con 0x7fbe580ab040 2023-12-24T18:36:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe580b1820 con 0x7fbe580ab040 2023-12-24T18:36:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.519+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe58169c10 con 0x7fbe580ab040 2023-12-24T18:36:43.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.523+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe580652e0 con 0x7fbe580ab040 2023-12-24T18:36:43.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.523+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbe4c011a40 con 0x7fbe580ab040 2023-12-24T18:36:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.523+0000 7fbe467fc700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 0x7fbe38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.523+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fbe4c07e4b0 con 0x7fbe580ab040 2023-12-24T18:36:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.523+0000 7fbe5659c700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 0x7fbe38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.527+0000 7fbe5659c700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 0x7fbe38062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007fd0 tx=0x7fbe48007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.531+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe4c04e710 con 0x7fbe580ab040 2023-12-24T18:36:43.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.739+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe5806b4e0 con 0x7fbe580ab040 2023-12-24T18:36:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.739+0000 7fbe467fc700 1 -- 172.21.15.50:0/2349297197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7fbe4c051d30 con 0x7fbe580ab040 2023-12-24T18:36:43.743 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:43.743 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 msgr2=0x7fbe38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 0x7fbe38062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007fd0 tx=0x7fbe48007d30 comp rx=0 tx=0).stop 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 msgr2=0x7fbe580b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009f80 tx=0x7fbe4c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 shutdown_connections 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe38060550 0x7fbe38062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe58159bc0 0x7fbe580c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe580ab040 0x7fbe580b0e40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 --2- 172.21.15.50:0/2349297197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe5806bce0 0x7fbe581532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 >> 172.21.15.50:0/2349297197 conn(0x7fbe580cbba0 msgr2=0x7fbe58156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 shutdown_connections 2023-12-24T18:36:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.743+0000 7fbe5c86e700 1 -- 172.21.15.50:0/2349297197 wait complete. 2023-12-24T18:36:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:36:43.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:43.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 Processor -- start 2023-12-24T18:36:43.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 -- start start 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f896006b540 0x7f89600ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8960159a20 0x7f8960159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896006ba80 con 0x7f89600ce750 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896006bd60 con 0x7f896006b540 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f896822e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896006c040 con 0x7f8960159a20 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f8965fca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89600ce750 0x7f896006ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37380/0 (socket says 172.21.15.50:37380) 2023-12-24T18:36:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f8965fca700 1 -- 172.21.15.50:0/1226032975 learned_addr learned my addr 172.21.15.50:0/1226032975 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:43.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.931+0000 7f89657c9700 1 --2- 172.21.15.50:0/1226032975 >> v2:172.21.15.50:3300/0 conn(0x7f896006b540 0x7f89600ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89667cb700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8960159a20 0x7f8960159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f8964fc8700 1 -- 172.21.15.50:0/1226032975 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352763395 0 0) 0x7f896006ba80 con 0x7f89600ce750 2023-12-24T18:36:43.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f8964fc8700 1 -- 172.21.15.50:0/1226032975 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f894c003570 con 0x7f89600ce750 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89657c9700 1 -- 172.21.15.50:0/1226032975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8960159a20 msgr2=0x7f8960159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89657c9700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8960159a20 0x7f8960159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89657c9700 1 -- 172.21.15.50:0/1226032975 >> v1:172.21.15.50:6789/0 conn(0x7f89600ce750 legacy=0x7f896006ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89657c9700 1 -- 172.21.15.50:0/1226032975 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896006c320 con 0x7f896006b540 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f89657c9700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f89600ceb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f89500098e0 tx=0x7f89500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f966bec5ab702fb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f8964fc8700 1 -- 172.21.15.50:0/1226032975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011630 con 0x7f896006b540 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f8964fc8700 1 -- 172.21.15.50:0/1226032975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950011790 con 0x7f896006b540 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f8964fc8700 1 -- 172.21.15.50:0/1226032975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011b30 con 0x7f896006b540 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 -- 172.21.15.50:0/1226032975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 msgr2=0x7f89600ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f89600ceb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f89500098e0 tx=0x7f89500091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 -- 172.21.15.50:0/1226032975 shutdown_connections 2023-12-24T18:36:43.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8960159a20 0x7f8960159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 --2- 172.21.15.50:0/1226032975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f89600ceb20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 -- 172.21.15.50:0/1226032975 >> 172.21.15.50:0/1226032975 conn(0x7f89600cffb0 msgr2=0x7f89600d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:43.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 -- 172.21.15.50:0/1226032975 shutdown_connections 2023-12-24T18:36:43.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.935+0000 7f896822e700 1 -- 172.21.15.50:0/1226032975 wait complete. 2023-12-24T18:36:43.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.939+0000 7f896822e700 1 Processor -- start 2023-12-24T18:36:43.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.939+0000 7f896822e700 1 -- start start 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89600ce750 0x7f8960156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8960159a20 0x7f8960151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960154dc0 con 0x7f896006b540 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960155060 con 0x7f8960159a20 2023-12-24T18:36:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960155340 con 0x7f89600ce750 2023-12-24T18:36:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60666/0 (socket says 172.21.15.50:60666) 2023-12-24T18:36:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 -- 172.21.15.50:0/587854182 learned_addr learned my addr 172.21.15.50:0/587854182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f89657c9700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89600ce750 0x7f8960156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f89667cb700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8960159a20 0x7f8960151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 -- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89600ce750 msgr2=0x7f8960156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89600ce750 0x7f8960156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 -- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8960159a20 msgr2=0x7f8960151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8960159a20 0x7f8960151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 -- 172.21.15.50:0/587854182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950009420 con 0x7f896006b540 2023-12-24T18:36:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8965fca700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c7c0 tx=0x7f895c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c005cd0 con 0x7f896006b540 2023-12-24T18:36:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c005e30 con 0x7f896006b540 2023-12-24T18:36:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960155620 con 0x7f896006b540 2023-12-24T18:36:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c007320 con 0x7f896006b540 2023-12-24T18:36:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.943+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8960154840 con 0x7f896006b540 2023-12-24T18:36:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.947+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8960155aa0 con 0x7f896006b540 2023-12-24T18:36:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.947+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f895c01b3b0 con 0x7f896006b540 2023-12-24T18:36:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.947+0000 7f8955ffb700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 0x7f8944062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.951+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f895c07c1f0 con 0x7f896006b540 2023-12-24T18:36:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.951+0000 7f89657c9700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 0x7f8944062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.951+0000 7f89657c9700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 0x7f8944062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89500098e0 tx=0x7f8950017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:43.955+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f895c04c450 con 0x7f896006b540 2023-12-24T18:36:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.131+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89600652e0 con 0x7f896006b540 2023-12-24T18:36:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.131+0000 7f8955ffb700 1 -- 172.21.15.50:0/587854182 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f895c04fa70 con 0x7f896006b540 2023-12-24T18:36:44.134 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:44.134 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 msgr2=0x7f8944062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 0x7f8944062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89500098e0 tx=0x7f8950017000 comp rx=0 tx=0).stop 2023-12-24T18:36:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 msgr2=0x7f8960154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c7c0 tx=0x7f895c007e00 comp rx=0 tx=0).stop 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 shutdown_connections 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8944060550 0x7f8944062a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8960159a20 0x7f8960151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89600ce750 0x7f8960156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 --2- 172.21.15.50:0/587854182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f896006b540 0x7f8960154300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 >> 172.21.15.50:0/587854182 conn(0x7f89600cffb0 msgr2=0x7f896006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 shutdown_connections 2023-12-24T18:36:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.135+0000 7f896822e700 1 -- 172.21.15.50:0/587854182 wait complete. 2023-12-24T18:36:44.158 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:36:44.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:36:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 Processor -- start 2023-12-24T18:36:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 -- start start 2023-12-24T18:36:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe2c06d8c0 0x7efe2c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c06b640 con 0x7efe2c06a580 2023-12-24T18:36:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c159710 con 0x7efe2c06d8c0 2023-12-24T18:36:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe31c6b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b5e10 con 0x7efe2c158e00 2023-12-24T18:36:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44780/0 (socket says 172.21.15.50:44780) 2023-12-24T18:36:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 -- 172.21.15.50:0/2305335826 learned_addr learned my addr 172.21.15.50:0/2305335826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe2bfff700 1 --2- 172.21.15.50:0/2305335826 >> v2:172.21.15.82:3300/0 conn(0x7efe2c06d8c0 0x7efe2c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 -- 172.21.15.50:0/2305335826 >> v2:172.21.15.82:3300/0 conn(0x7efe2c06d8c0 msgr2=0x7efe2c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 --2- 172.21.15.50:0/2305335826 >> v2:172.21.15.82:3300/0 conn(0x7efe2c06d8c0 0x7efe2c0b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 -- 172.21.15.50:0/2305335826 >> v1:172.21.15.82:6789/0 conn(0x7efe2c06a580 legacy=0x7efe2c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.307+0000 7efe30c69700 1 -- 172.21.15.50:0/2305335826 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c06b8e0 con 0x7efe2c158e00 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe30c69700 1 --2- 172.21.15.50:0/2305335826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe200099b0 tx=0x7efe20009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3299d2eed767fd4a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe2b7fe700 1 -- 172.21.15.50:0/2305335826 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000b860 con 0x7efe2c158e00 2023-12-24T18:36:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe2b7fe700 1 -- 172.21.15.50:0/2305335826 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000b9c0 con 0x7efe2c158e00 2023-12-24T18:36:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe2b7fe700 1 -- 172.21.15.50:0/2305335826 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000bd60 con 0x7efe2c158e00 2023-12-24T18:36:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- 172.21.15.50:0/2305335826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 msgr2=0x7efe2c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 --2- 172.21.15.50:0/2305335826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe200099b0 tx=0x7efe20009250 comp rx=0 tx=0).stop 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- 172.21.15.50:0/2305335826 shutdown_connections 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 --2- 172.21.15.50:0/2305335826 >> v2:172.21.15.82:3300/0 conn(0x7efe2c06d8c0 0x7efe2c0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 --2- 172.21.15.50:0/2305335826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c1591d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- 172.21.15.50:0/2305335826 >> 172.21.15.50:0/2305335826 conn(0x7efe2c067b80 msgr2=0x7efe2c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- 172.21.15.50:0/2305335826 shutdown_connections 2023-12-24T18:36:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- 172.21.15.50:0/2305335826 wait complete. 2023-12-24T18:36:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 Processor -- start 2023-12-24T18:36:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.311+0000 7efe31c6b700 1 -- start start 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c06d8c0 0x7efe2c15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c16d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c15f330 con 0x7efe2c06a580 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c15f8c0 con 0x7efe2c06d8c0 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c15f5e0 con 0x7efe2c158e00 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60672/0 (socket says 172.21.15.50:60672) 2023-12-24T18:36:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 -- 172.21.15.50:0/83432160 learned_addr learned my addr 172.21.15.50:0/83432160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe2bfff700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c06d8c0 0x7efe2c15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe3146a700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c16d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 -- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 msgr2=0x7efe2c16d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c16d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 -- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c06d8c0 msgr2=0x7efe2c15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c06d8c0 0x7efe2c15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 -- 172.21.15.50:0/83432160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200094f0 con 0x7efe2c06a580 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe30c69700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0b5f50 tx=0x7efe20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20024440 con 0x7efe2c06a580 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200245c0 con 0x7efe2c06a580 2023-12-24T18:36:44.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c088fe0 con 0x7efe2c06a580 2023-12-24T18:36:44.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20024980 con 0x7efe2c06a580 2023-12-24T18:36:44.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.315+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0895a0 con 0x7efe2c06a580 2023-12-24T18:36:44.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c04be40 con 0x7efe2c06a580 2023-12-24T18:36:44.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efe2001a420 con 0x7efe2c06a580 2023-12-24T18:36:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe28ff9700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 0x7efe10062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7efe2007e830 con 0x7efe2c06a580 2023-12-24T18:36:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe2bfff700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 0x7efe10062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.319+0000 7efe2bfff700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 0x7efe10062a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe2c08b3d0 tx=0x7efe18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.327+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe2004ea90 con 0x7efe2c06a580 2023-12-24T18:36:44.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.499+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe2c0a9660 con 0x7efe100605d0 2023-12-24T18:36:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.523+0000 7efe28ff9700 1 -- 172.21.15.50:0/83432160 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345085 (secure 0 0 0) 0x7efe2c0a9660 con 0x7efe100605d0 2023-12-24T18:36:44.532 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 msgr2=0x7efe10062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 0x7efe10062a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe2c08b3d0 tx=0x7efe18008040 comp rx=0 tx=0).stop 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 msgr2=0x7efe2c15e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0b5f50 tx=0x7efe20017000 comp rx=0 tx=0).stop 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 shutdown_connections 2023-12-24T18:36:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe100605d0 0x7efe10062a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2c158e00 0x7efe2c16d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c06d8c0 0x7efe2c15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 --2- 172.21.15.50:0/83432160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2c06a580 0x7efe2c15e8b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 >> 172.21.15.50:0/83432160 conn(0x7efe2c067b80 msgr2=0x7efe2c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 shutdown_connections 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.531+0000 7efe31c6b700 1 -- 172.21.15.50:0/83432160 wait complete. 2023-12-24T18:36:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:36:44.555 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-12-24T18:36:42.740596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594851,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389800,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752584920,"statfs":{"total":773094113280,"available":770646958080,"internally_reserved":0,"allocated":3383296,"data_stored":2041889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.548069"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241897+0000","last_change":"2023-12-24T18:36:27.067874+0000","last_active":"2023-12-24T18:36:33.241897+0000","last_peered":"2023-12-24T18:36:33.241897+0000","last_clean":"2023-12-24T18:36:33.241897+0000","last_became_active":"2023-12-24T18:36:27.067357+0000","last_became_peered":"2023-12-24T18:36:27.067357+0000","last_unstale":"2023-12-24T18:36:33.241897+0000","last_undegraded":"2023-12-24T18:36:33.241897+0000","last_fullsized":"2023-12-24T18:36:33.241897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:32.763268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242535+0000","last_change":"2023-12-24T18:36:28.119303+0000","last_active":"2023-12-24T18:36:33.242535+0000","last_peered":"2023-12-24T18:36:33.242535+0000","last_clean":"2023-12-24T18:36:33.242535+0000","last_became_active":"2023-12-24T18:36:28.118209+0000","last_became_peered":"2023-12-24T18:36:28.118209+0000","last_unstale":"2023-12-24T18:36:33.242535+0000","last_undegraded":"2023-12-24T18:36:33.242535+0000","last_fullsized":"2023-12-24T18:36:33.242535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239078+0000","last_change":"2023-12-24T18:36:33.070625+0000","last_active":"2023-12-24T18:36:33.239078+0000","last_peered":"2023-12-24T18:36:33.239078+0000","last_clean":"2023-12-24T18:36:33.239078+0000","last_became_active":"2023-12-24T18:36:33.070191+0000","last_became_peered":"2023-12-24T18:36:33.070191+0000","last_unstale":"2023-12-24T18:36:33.239078+0000","last_undegraded":"2023-12-24T18:36:33.239078+0000","last_fullsized":"2023-12-24T18:36:33.239078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:48.436853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242441+0000","last_change":"2023-12-24T18:36:27.060014+0000","last_active":"2023-12-24T18:36:33.242441+0000","last_peered":"2023-12-24T18:36:33.242441+0000","last_clean":"2023-12-24T18:36:33.242441+0000","last_became_active":"2023-12-24T18:36:27.059722+0000","last_became_peered":"2023-12-24T18:36:27.059722+0000","last_unstale":"2023-12-24T18:36:33.242441+0000","last_undegraded":"2023-12-24T18:36:33.242441+0000","last_fullsized":"2023-12-24T18:36:33.242441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241708+0000","last_change":"2023-12-24T18:36:28.131047+0000","last_active":"2023-12-24T18:36:33.241708+0000","last_peered":"2023-12-24T18:36:33.241708+0000","last_clean":"2023-12-24T18:36:33.241708+0000","last_became_active":"2023-12-24T18:36:28.130191+0000","last_became_peered":"2023-12-24T18:36:28.130191+0000","last_unstale":"2023-12-24T18:36:33.241708+0000","last_undegraded":"2023-12-24T18:36:33.241708+0000","last_fullsized":"2023-12-24T18:36:33.241708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199190+0000","last_change":"2023-12-24T18:36:32.246048+0000","last_active":"2023-12-24T18:36:33.199190+0000","last_peered":"2023-12-24T18:36:33.199190+0000","last_clean":"2023-12-24T18:36:33.199190+0000","last_became_active":"2023-12-24T18:36:32.245486+0000","last_became_peered":"2023-12-24T18:36:32.245486+0000","last_unstale":"2023-12-24T18:36:33.199190+0000","last_undegraded":"2023-12-24T18:36:33.199190+0000","last_fullsized":"2023-12-24T18:36:33.199190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.571591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243552+0000","last_change":"2023-12-24T18:36:27.066546+0000","last_active":"2023-12-24T18:36:33.243552+0000","last_peered":"2023-12-24T18:36:33.243552+0000","last_clean":"2023-12-24T18:36:33.243552+0000","last_became_active":"2023-12-24T18:36:27.066019+0000","last_became_peered":"2023-12-24T18:36:27.066019+0000","last_unstale":"2023-12-24T18:36:33.243552+0000","last_undegraded":"2023-12-24T18:36:33.243552+0000","last_fullsized":"2023-12-24T18:36:33.243552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242331+0000","last_change":"2023-12-24T18:36:28.123809+0000","last_active":"2023-12-24T18:36:33.242331+0000","last_peered":"2023-12-24T18:36:33.242331+0000","last_clean":"2023-12-24T18:36:33.242331+0000","last_became_active":"2023-12-24T18:36:28.123245+0000","last_became_peered":"2023-12-24T18:36:28.123245+0000","last_unstale":"2023-12-24T18:36:33.242331+0000","last_undegraded":"2023-12-24T18:36:33.242331+0000","last_fullsized":"2023-12-24T18:36:33.242331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199447+0000","last_change":"2023-12-24T18:36:32.252818+0000","last_active":"2023-12-24T18:36:33.199447+0000","last_peered":"2023-12-24T18:36:33.199447+0000","last_clean":"2023-12-24T18:36:33.199447+0000","last_became_active":"2023-12-24T18:36:32.252148+0000","last_became_peered":"2023-12-24T18:36:32.252148+0000","last_unstale":"2023-12-24T18:36:33.199447+0000","last_undegraded":"2023-12-24T18:36:33.199447+0000","last_fullsized":"2023-12-24T18:36:33.199447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243368+0000","last_change":"2023-12-24T18:36:27.066329+0000","last_active":"2023-12-24T18:36:33.243368+0000","last_peered":"2023-12-24T18:36:33.243368+0000","last_clean":"2023-12-24T18:36:33.243368+0000","last_became_active":"2023-12-24T18:36:27.065986+0000","last_became_peered":"2023-12-24T18:36:27.065986+0000","last_unstale":"2023-12-24T18:36:33.243368+0000","last_undegraded":"2023-12-24T18:36:33.243368+0000","last_fullsized":"2023-12-24T18:36:33.243368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:52.372517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242678+0000","last_change":"2023-12-24T18:36:28.140301+0000","last_active":"2023-12-24T18:36:33.242678+0000","last_peered":"2023-12-24T18:36:33.242678+0000","last_clean":"2023-12-24T18:36:33.242678+0000","last_became_active":"2023-12-24T18:36:28.139952+0000","last_became_peered":"2023-12-24T18:36:28.139952+0000","last_unstale":"2023-12-24T18:36:33.242678+0000","last_undegraded":"2023-12-24T18:36:33.242678+0000","last_fullsized":"2023-12-24T18:36:33.242678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199244+0000","last_change":"2023-12-24T18:36:32.251947+0000","last_active":"2023-12-24T18:36:33.199244+0000","last_peered":"2023-12-24T18:36:33.199244+0000","last_clean":"2023-12-24T18:36:33.199244+0000","last_became_active":"2023-12-24T18:36:32.251493+0000","last_became_peered":"2023-12-24T18:36:32.251493+0000","last_unstale":"2023-12-24T18:36:33.199244+0000","last_undegraded":"2023-12-24T18:36:33.199244+0000","last_fullsized":"2023-12-24T18:36:33.199244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.373046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200254+0000","last_change":"2023-12-24T18:36:28.112650+0000","last_active":"2023-12-24T18:36:33.200254+0000","last_peered":"2023-12-24T18:36:33.200254+0000","last_clean":"2023-12-24T18:36:33.200254+0000","last_became_active":"2023-12-24T18:36:28.112348+0000","last_became_peered":"2023-12-24T18:36:28.112348+0000","last_unstale":"2023-12-24T18:36:33.200254+0000","last_undegraded":"2023-12-24T18:36:33.200254+0000","last_fullsized":"2023-12-24T18:36:33.200254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243195+0000","last_change":"2023-12-24T18:36:27.064104+0000","last_active":"2023-12-24T18:36:33.243195+0000","last_peered":"2023-12-24T18:36:33.243195+0000","last_clean":"2023-12-24T18:36:33.243195+0000","last_became_active":"2023-12-24T18:36:27.063768+0000","last_became_peered":"2023-12-24T18:36:27.063768+0000","last_unstale":"2023-12-24T18:36:33.243195+0000","last_undegraded":"2023-12-24T18:36:33.243195+0000","last_fullsized":"2023-12-24T18:36:33.243195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200486+0000","last_change":"2023-12-24T18:36:32.260683+0000","last_active":"2023-12-24T18:36:33.200486+0000","last_peered":"2023-12-24T18:36:33.200486+0000","last_clean":"2023-12-24T18:36:33.200486+0000","last_became_active":"2023-12-24T18:36:32.259717+0000","last_became_peered":"2023-12-24T18:36:32.259717+0000","last_unstale":"2023-12-24T18:36:33.200486+0000","last_undegraded":"2023-12-24T18:36:33.200486+0000","last_fullsized":"2023-12-24T18:36:33.200486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239484+0000","last_change":"2023-12-24T18:36:28.130197+0000","last_active":"2023-12-24T18:36:33.239484+0000","last_peered":"2023-12-24T18:36:33.239484+0000","last_clean":"2023-12-24T18:36:33.239484+0000","last_became_active":"2023-12-24T18:36:28.129812+0000","last_became_peered":"2023-12-24T18:36:28.129812+0000","last_unstale":"2023-12-24T18:36:33.239484+0000","last_undegraded":"2023-12-24T18:36:33.239484+0000","last_fullsized":"2023-12-24T18:36:33.239484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243815+0000","last_change":"2023-12-24T18:36:27.063829+0000","last_active":"2023-12-24T18:36:33.243815+0000","last_peered":"2023-12-24T18:36:33.243815+0000","last_clean":"2023-12-24T18:36:33.243815+0000","last_became_active":"2023-12-24T18:36:27.062587+0000","last_became_peered":"2023-12-24T18:36:27.062587+0000","last_unstale":"2023-12-24T18:36:33.243815+0000","last_undegraded":"2023-12-24T18:36:33.243815+0000","last_fullsized":"2023-12-24T18:36:33.243815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200123+0000","last_change":"2023-12-24T18:36:32.251112+0000","last_active":"2023-12-24T18:36:33.200123+0000","last_peered":"2023-12-24T18:36:33.200123+0000","last_clean":"2023-12-24T18:36:33.200123+0000","last_became_active":"2023-12-24T18:36:32.250532+0000","last_became_peered":"2023-12-24T18:36:32.250532+0000","last_unstale":"2023-12-24T18:36:33.200123+0000","last_undegraded":"2023-12-24T18:36:33.200123+0000","last_fullsized":"2023-12-24T18:36:33.200123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:03.439593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239627+0000","last_change":"2023-12-24T18:36:28.127286+0000","last_active":"2023-12-24T18:36:33.239627+0000","last_peered":"2023-12-24T18:36:33.239627+0000","last_clean":"2023-12-24T18:36:33.239627+0000","last_became_active":"2023-12-24T18:36:28.124689+0000","last_became_peered":"2023-12-24T18:36:28.124689+0000","last_unstale":"2023-12-24T18:36:33.239627+0000","last_undegraded":"2023-12-24T18:36:33.239627+0000","last_fullsized":"2023-12-24T18:36:33.239627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243454+0000","last_change":"2023-12-24T18:36:27.064165+0000","last_active":"2023-12-24T18:36:33.243454+0000","last_peered":"2023-12-24T18:36:33.243454+0000","last_clean":"2023-12-24T18:36:33.243454+0000","last_became_active":"2023-12-24T18:36:27.063434+0000","last_became_peered":"2023-12-24T18:36:27.063434+0000","last_unstale":"2023-12-24T18:36:33.243454+0000","last_undegraded":"2023-12-24T18:36:33.243454+0000","last_fullsized":"2023-12-24T18:36:33.243454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:33.062973+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:33.061726+0000","last_became_peered":"2023-12-24T18:36:33.061726+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199485+0000","last_change":"2023-12-24T18:36:28.105114+0000","last_active":"2023-12-24T18:36:33.199485+0000","last_peered":"2023-12-24T18:36:33.199485+0000","last_clean":"2023-12-24T18:36:33.199485+0000","last_became_active":"2023-12-24T18:36:28.104834+0000","last_became_peered":"2023-12-24T18:36:28.104834+0000","last_unstale":"2023-12-24T18:36:33.199485+0000","last_undegraded":"2023-12-24T18:36:33.199485+0000","last_fullsized":"2023-12-24T18:36:33.199485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:26.768161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242012+0000","last_change":"2023-12-24T18:36:27.060303+0000","last_active":"2023-12-24T18:36:33.242012+0000","last_peered":"2023-12-24T18:36:33.242012+0000","last_clean":"2023-12-24T18:36:33.242012+0000","last_became_active":"2023-12-24T18:36:27.059902+0000","last_became_peered":"2023-12-24T18:36:27.059902+0000","last_unstale":"2023-12-24T18:36:33.242012+0000","last_undegraded":"2023-12-24T18:36:33.242012+0000","last_fullsized":"2023-12-24T18:36:33.242012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200312+0000","last_change":"2023-12-24T18:36:32.253987+0000","last_active":"2023-12-24T18:36:33.200312+0000","last_peered":"2023-12-24T18:36:33.200312+0000","last_clean":"2023-12-24T18:36:33.200312+0000","last_became_active":"2023-12-24T18:36:32.253471+0000","last_became_peered":"2023-12-24T18:36:32.253471+0000","last_unstale":"2023-12-24T18:36:33.200312+0000","last_undegraded":"2023-12-24T18:36:33.200312+0000","last_fullsized":"2023-12-24T18:36:33.200312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:35:45.397934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241468+0000","last_change":"2023-12-24T18:36:28.126747+0000","last_active":"2023-12-24T18:36:33.241468+0000","last_peered":"2023-12-24T18:36:33.241468+0000","last_clean":"2023-12-24T18:36:33.241468+0000","last_became_active":"2023-12-24T18:36:28.126438+0000","last_became_peered":"2023-12-24T18:36:28.126438+0000","last_unstale":"2023-12-24T18:36:33.241468+0000","last_undegraded":"2023-12-24T18:36:33.241468+0000","last_fullsized":"2023-12-24T18:36:33.241468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201595+0000","last_change":"2023-12-24T18:36:27.057217+0000","last_active":"2023-12-24T18:36:33.201595+0000","last_peered":"2023-12-24T18:36:33.201595+0000","last_clean":"2023-12-24T18:36:33.201595+0000","last_became_active":"2023-12-24T18:36:27.056927+0000","last_became_peered":"2023-12-24T18:36:27.056927+0000","last_unstale":"2023-12-24T18:36:33.201595+0000","last_undegraded":"2023-12-24T18:36:33.201595+0000","last_fullsized":"2023-12-24T18:36:33.201595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.198620+0000","last_change":"2023-12-24T18:36:33.060205+0000","last_active":"2023-12-24T18:36:33.198620+0000","last_peered":"2023-12-24T18:36:33.198620+0000","last_clean":"2023-12-24T18:36:33.198620+0000","last_became_active":"2023-12-24T18:36:33.059701+0000","last_became_peered":"2023-12-24T18:36:33.059701+0000","last_unstale":"2023-12-24T18:36:33.198620+0000","last_undegraded":"2023-12-24T18:36:33.198620+0000","last_fullsized":"2023-12-24T18:36:33.198620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.334113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242412+0000","last_change":"2023-12-24T18:36:28.129033+0000","last_active":"2023-12-24T18:36:33.242412+0000","last_peered":"2023-12-24T18:36:33.242412+0000","last_clean":"2023-12-24T18:36:33.242412+0000","last_became_active":"2023-12-24T18:36:28.128733+0000","last_became_peered":"2023-12-24T18:36:28.128733+0000","last_unstale":"2023-12-24T18:36:33.242412+0000","last_undegraded":"2023-12-24T18:36:33.242412+0000","last_fullsized":"2023-12-24T18:36:33.242412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244611+0000","last_change":"2023-12-24T18:36:27.057152+0000","last_active":"2023-12-24T18:36:33.244611+0000","last_peered":"2023-12-24T18:36:33.244611+0000","last_clean":"2023-12-24T18:36:33.244611+0000","last_became_active":"2023-12-24T18:36:27.056715+0000","last_became_peered":"2023-12-24T18:36:27.056715+0000","last_unstale":"2023-12-24T18:36:33.244611+0000","last_undegraded":"2023-12-24T18:36:33.244611+0000","last_fullsized":"2023-12-24T18:36:33.244611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238838+0000","last_change":"2023-12-24T18:36:33.067986+0000","last_active":"2023-12-24T18:36:33.238838+0000","last_peered":"2023-12-24T18:36:33.238838+0000","last_clean":"2023-12-24T18:36:33.238838+0000","last_became_active":"2023-12-24T18:36:33.066990+0000","last_became_peered":"2023-12-24T18:36:33.066990+0000","last_unstale":"2023-12-24T18:36:33.238838+0000","last_undegraded":"2023-12-24T18:36:33.238838+0000","last_fullsized":"2023-12-24T18:36:33.238838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:35:52.743174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244319+0000","last_change":"2023-12-24T18:36:28.119947+0000","last_active":"2023-12-24T18:36:33.244319+0000","last_peered":"2023-12-24T18:36:33.244319+0000","last_clean":"2023-12-24T18:36:33.244319+0000","last_became_active":"2023-12-24T18:36:28.119615+0000","last_became_peered":"2023-12-24T18:36:28.119615+0000","last_unstale":"2023-12-24T18:36:33.244319+0000","last_undegraded":"2023-12-24T18:36:33.244319+0000","last_fullsized":"2023-12-24T18:36:33.244319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243706+0000","last_change":"2023-12-24T18:36:27.062308+0000","last_active":"2023-12-24T18:36:33.243706+0000","last_peered":"2023-12-24T18:36:33.243706+0000","last_clean":"2023-12-24T18:36:33.243706+0000","last_became_active":"2023-12-24T18:36:27.061932+0000","last_became_peered":"2023-12-24T18:36:27.061932+0000","last_unstale":"2023-12-24T18:36:33.243706+0000","last_undegraded":"2023-12-24T18:36:33.243706+0000","last_fullsized":"2023-12-24T18:36:33.243706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240201+0000","last_change":"2023-12-24T18:36:33.063574+0000","last_active":"2023-12-24T18:36:33.240201+0000","last_peered":"2023-12-24T18:36:33.240201+0000","last_clean":"2023-12-24T18:36:33.240201+0000","last_became_active":"2023-12-24T18:36:33.062383+0000","last_became_peered":"2023-12-24T18:36:33.062383+0000","last_unstale":"2023-12-24T18:36:33.240201+0000","last_undegraded":"2023-12-24T18:36:33.240201+0000","last_fullsized":"2023-12-24T18:36:33.240201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242767+0000","last_change":"2023-12-24T18:36:28.123563+0000","last_active":"2023-12-24T18:36:33.242767+0000","last_peered":"2023-12-24T18:36:33.242767+0000","last_clean":"2023-12-24T18:36:33.242767+0000","last_became_active":"2023-12-24T18:36:28.123262+0000","last_became_peered":"2023-12-24T18:36:28.123262+0000","last_unstale":"2023-12-24T18:36:33.242767+0000","last_undegraded":"2023-12-24T18:36:33.242767+0000","last_fullsized":"2023-12-24T18:36:33.242767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244465+0000","last_change":"2023-12-24T18:36:27.059665+0000","last_active":"2023-12-24T18:36:33.244465+0000","last_peered":"2023-12-24T18:36:33.244465+0000","last_clean":"2023-12-24T18:36:33.244465+0000","last_became_active":"2023-12-24T18:36:27.059247+0000","last_became_peered":"2023-12-24T18:36:27.059247+0000","last_unstale":"2023-12-24T18:36:33.244465+0000","last_undegraded":"2023-12-24T18:36:33.244465+0000","last_fullsized":"2023-12-24T18:36:33.244465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243546+0000","last_change":"2023-12-24T18:36:32.265642+0000","last_active":"2023-12-24T18:36:33.243546+0000","last_peered":"2023-12-24T18:36:33.243546+0000","last_clean":"2023-12-24T18:36:33.243546+0000","last_became_active":"2023-12-24T18:36:32.263802+0000","last_became_peered":"2023-12-24T18:36:32.263802+0000","last_unstale":"2023-12-24T18:36:33.243546+0000","last_undegraded":"2023-12-24T18:36:33.243546+0000","last_fullsized":"2023-12-24T18:36:33.243546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199889+0000","last_change":"2023-12-24T18:36:28.132237+0000","last_active":"2023-12-24T18:36:33.199889+0000","last_peered":"2023-12-24T18:36:33.199889+0000","last_clean":"2023-12-24T18:36:33.199889+0000","last_became_active":"2023-12-24T18:36:28.131848+0000","last_became_peered":"2023-12-24T18:36:28.131848+0000","last_unstale":"2023-12-24T18:36:33.199889+0000","last_undegraded":"2023-12-24T18:36:33.199889+0000","last_fullsized":"2023-12-24T18:36:33.199889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:13.673004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:27.062395+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:27.058997+0000","last_became_peered":"2023-12-24T18:36:27.058997+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244195+0000","last_change":"2023-12-24T18:36:32.250289+0000","last_active":"2023-12-24T18:36:33.244195+0000","last_peered":"2023-12-24T18:36:33.244195+0000","last_clean":"2023-12-24T18:36:33.244195+0000","last_became_active":"2023-12-24T18:36:32.248948+0000","last_became_peered":"2023-12-24T18:36:32.248948+0000","last_unstale":"2023-12-24T18:36:33.244195+0000","last_undegraded":"2023-12-24T18:36:33.244195+0000","last_fullsized":"2023-12-24T18:36:33.244195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243453+0000","last_change":"2023-12-24T18:36:28.119555+0000","last_active":"2023-12-24T18:36:33.243453+0000","last_peered":"2023-12-24T18:36:33.243453+0000","last_clean":"2023-12-24T18:36:33.243453+0000","last_became_active":"2023-12-24T18:36:28.119221+0000","last_became_peered":"2023-12-24T18:36:28.119221+0000","last_unstale":"2023-12-24T18:36:33.243453+0000","last_undegraded":"2023-12-24T18:36:33.243453+0000","last_fullsized":"2023-12-24T18:36:33.243453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196052+0000","last_change":"2023-12-24T18:36:27.069466+0000","last_active":"2023-12-24T18:36:33.196052+0000","last_peered":"2023-12-24T18:36:33.196052+0000","last_clean":"2023-12-24T18:36:33.196052+0000","last_became_active":"2023-12-24T18:36:27.069134+0000","last_became_peered":"2023-12-24T18:36:27.069134+0000","last_unstale":"2023-12-24T18:36:33.196052+0000","last_undegraded":"2023-12-24T18:36:33.196052+0000","last_fullsized":"2023-12-24T18:36:33.196052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244716+0000","last_change":"2023-12-24T18:36:32.261732+0000","last_active":"2023-12-24T18:36:33.244716+0000","last_peered":"2023-12-24T18:36:33.244716+0000","last_clean":"2023-12-24T18:36:33.244716+0000","last_became_active":"2023-12-24T18:36:32.261227+0000","last_became_peered":"2023-12-24T18:36:32.261227+0000","last_unstale":"2023-12-24T18:36:33.244716+0000","last_undegraded":"2023-12-24T18:36:33.244716+0000","last_fullsized":"2023-12-24T18:36:33.244716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240648+0000","last_change":"2023-12-24T18:36:28.132818+0000","last_active":"2023-12-24T18:36:33.240648+0000","last_peered":"2023-12-24T18:36:33.240648+0000","last_clean":"2023-12-24T18:36:33.240648+0000","last_became_active":"2023-12-24T18:36:28.132494+0000","last_became_peered":"2023-12-24T18:36:28.132494+0000","last_unstale":"2023-12-24T18:36:33.240648+0000","last_undegraded":"2023-12-24T18:36:33.240648+0000","last_fullsized":"2023-12-24T18:36:33.240648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242017+0000","last_change":"2023-12-24T18:36:27.064640+0000","last_active":"2023-12-24T18:36:33.242017+0000","last_peered":"2023-12-24T18:36:33.242017+0000","last_clean":"2023-12-24T18:36:33.242017+0000","last_became_active":"2023-12-24T18:36:27.064337+0000","last_became_peered":"2023-12-24T18:36:27.064337+0000","last_unstale":"2023-12-24T18:36:33.242017+0000","last_undegraded":"2023-12-24T18:36:33.242017+0000","last_fullsized":"2023-12-24T18:36:33.242017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240189+0000","last_change":"2023-12-24T18:36:33.065960+0000","last_active":"2023-12-24T18:36:33.240189+0000","last_peered":"2023-12-24T18:36:33.240189+0000","last_clean":"2023-12-24T18:36:33.240189+0000","last_became_active":"2023-12-24T18:36:33.064424+0000","last_became_peered":"2023-12-24T18:36:33.064424+0000","last_unstale":"2023-12-24T18:36:33.240189+0000","last_undegraded":"2023-12-24T18:36:33.240189+0000","last_fullsized":"2023-12-24T18:36:33.240189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239524+0000","last_change":"2023-12-24T18:36:28.125586+0000","last_active":"2023-12-24T18:36:33.239524+0000","last_peered":"2023-12-24T18:36:33.239524+0000","last_clean":"2023-12-24T18:36:33.239524+0000","last_became_active":"2023-12-24T18:36:28.125304+0000","last_became_peered":"2023-12-24T18:36:28.125304+0000","last_unstale":"2023-12-24T18:36:33.239524+0000","last_undegraded":"2023-12-24T18:36:33.239524+0000","last_fullsized":"2023-12-24T18:36:33.239524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242083+0000","last_change":"2023-12-24T18:36:27.059141+0000","last_active":"2023-12-24T18:36:33.242083+0000","last_peered":"2023-12-24T18:36:33.242083+0000","last_clean":"2023-12-24T18:36:33.242083+0000","last_became_active":"2023-12-24T18:36:27.058810+0000","last_became_peered":"2023-12-24T18:36:27.058810+0000","last_unstale":"2023-12-24T18:36:33.242083+0000","last_undegraded":"2023-12-24T18:36:33.242083+0000","last_fullsized":"2023-12-24T18:36:33.242083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242137+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:36:33.242137+0000","last_peered":"2023-12-24T18:36:33.242137+0000","last_clean":"2023-12-24T18:36:33.242137+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:36:33.242137+0000","last_undegraded":"2023-12-24T18:36:33.242137+0000","last_fullsized":"2023-12-24T18:36:33.242137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200983+0000","last_change":"2023-12-24T18:36:33.064479+0000","last_active":"2023-12-24T18:36:33.200983+0000","last_peered":"2023-12-24T18:36:33.200983+0000","last_clean":"2023-12-24T18:36:33.200983+0000","last_became_active":"2023-12-24T18:36:33.063934+0000","last_became_peered":"2023-12-24T18:36:33.063934+0000","last_unstale":"2023-12-24T18:36:33.200983+0000","last_undegraded":"2023-12-24T18:36:33.200983+0000","last_fullsized":"2023-12-24T18:36:33.200983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:51.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243499+0000","last_change":"2023-12-24T18:36:28.134054+0000","last_active":"2023-12-24T18:36:33.243499+0000","last_peered":"2023-12-24T18:36:33.243499+0000","last_clean":"2023-12-24T18:36:33.243499+0000","last_became_active":"2023-12-24T18:36:28.133272+0000","last_became_peered":"2023-12-24T18:36:28.133272+0000","last_unstale":"2023-12-24T18:36:33.243499+0000","last_undegraded":"2023-12-24T18:36:33.243499+0000","last_fullsized":"2023-12-24T18:36:33.243499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196949+0000","last_change":"2023-12-24T18:36:27.065885+0000","last_active":"2023-12-24T18:36:33.196949+0000","last_peered":"2023-12-24T18:36:33.196949+0000","last_clean":"2023-12-24T18:36:33.196949+0000","last_became_active":"2023-12-24T18:36:27.065497+0000","last_became_peered":"2023-12-24T18:36:27.065497+0000","last_unstale":"2023-12-24T18:36:33.196949+0000","last_undegraded":"2023-12-24T18:36:33.196949+0000","last_fullsized":"2023-12-24T18:36:33.196949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200105+0000","last_change":"2023-12-24T18:36:33.060407+0000","last_active":"2023-12-24T18:36:33.200105+0000","last_peered":"2023-12-24T18:36:33.200105+0000","last_clean":"2023-12-24T18:36:33.200105+0000","last_became_active":"2023-12-24T18:36:33.059656+0000","last_became_peered":"2023-12-24T18:36:33.059656+0000","last_unstale":"2023-12-24T18:36:33.200105+0000","last_undegraded":"2023-12-24T18:36:33.200105+0000","last_fullsized":"2023-12-24T18:36:33.200105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:16.143703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242382+0000","last_change":"2023-12-24T18:36:28.123920+0000","last_active":"2023-12-24T18:36:33.242382+0000","last_peered":"2023-12-24T18:36:33.242382+0000","last_clean":"2023-12-24T18:36:33.242382+0000","last_became_active":"2023-12-24T18:36:28.123641+0000","last_became_peered":"2023-12-24T18:36:28.123641+0000","last_unstale":"2023-12-24T18:36:33.242382+0000","last_undegraded":"2023-12-24T18:36:33.242382+0000","last_fullsized":"2023-12-24T18:36:33.242382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244368+0000","last_change":"2023-12-24T18:36:27.063621+0000","last_active":"2023-12-24T18:36:33.244368+0000","last_peered":"2023-12-24T18:36:33.244368+0000","last_clean":"2023-12-24T18:36:33.244368+0000","last_became_active":"2023-12-24T18:36:27.063049+0000","last_became_peered":"2023-12-24T18:36:27.063049+0000","last_unstale":"2023-12-24T18:36:33.244368+0000","last_undegraded":"2023-12-24T18:36:33.244368+0000","last_fullsized":"2023-12-24T18:36:33.244368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241302+0000","last_change":"2023-12-24T18:36:32.259376+0000","last_active":"2023-12-24T18:36:33.241302+0000","last_peered":"2023-12-24T18:36:33.241302+0000","last_clean":"2023-12-24T18:36:33.241302+0000","last_became_active":"2023-12-24T18:36:32.258898+0000","last_became_peered":"2023-12-24T18:36:32.258898+0000","last_unstale":"2023-12-24T18:36:33.241302+0000","last_undegraded":"2023-12-24T18:36:33.241302+0000","last_fullsized":"2023-12-24T18:36:33.241302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244486+0000","last_change":"2023-12-24T18:36:28.141826+0000","last_active":"2023-12-24T18:36:33.244486+0000","last_peered":"2023-12-24T18:36:33.244486+0000","last_clean":"2023-12-24T18:36:33.244486+0000","last_became_active":"2023-12-24T18:36:28.141592+0000","last_became_peered":"2023-12-24T18:36:28.141592+0000","last_unstale":"2023-12-24T18:36:33.244486+0000","last_undegraded":"2023-12-24T18:36:33.244486+0000","last_fullsized":"2023-12-24T18:36:33.244486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196802+0000","last_change":"2023-12-24T18:36:27.056563+0000","last_active":"2023-12-24T18:36:33.196802+0000","last_peered":"2023-12-24T18:36:33.196802+0000","last_clean":"2023-12-24T18:36:33.196802+0000","last_became_active":"2023-12-24T18:36:27.056162+0000","last_became_peered":"2023-12-24T18:36:27.056162+0000","last_unstale":"2023-12-24T18:36:33.196802+0000","last_undegraded":"2023-12-24T18:36:33.196802+0000","last_fullsized":"2023-12-24T18:36:33.196802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241573+0000","last_change":"2023-12-24T18:36:33.061190+0000","last_active":"2023-12-24T18:36:33.241573+0000","last_peered":"2023-12-24T18:36:33.241573+0000","last_clean":"2023-12-24T18:36:33.241573+0000","last_became_active":"2023-12-24T18:36:33.060776+0000","last_became_peered":"2023-12-24T18:36:33.060776+0000","last_unstale":"2023-12-24T18:36:33.241573+0000","last_undegraded":"2023-12-24T18:36:33.241573+0000","last_fullsized":"2023-12-24T18:36:33.241573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244050+0000","last_change":"2023-12-24T18:36:28.140877+0000","last_active":"2023-12-24T18:36:33.244050+0000","last_peered":"2023-12-24T18:36:33.244050+0000","last_clean":"2023-12-24T18:36:33.244050+0000","last_became_active":"2023-12-24T18:36:28.140557+0000","last_became_peered":"2023-12-24T18:36:28.140557+0000","last_unstale":"2023-12-24T18:36:33.244050+0000","last_undegraded":"2023-12-24T18:36:33.244050+0000","last_fullsized":"2023-12-24T18:36:33.244050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200942+0000","last_change":"2023-12-24T18:36:27.055292+0000","last_active":"2023-12-24T18:36:33.200942+0000","last_peered":"2023-12-24T18:36:33.200942+0000","last_clean":"2023-12-24T18:36:33.200942+0000","last_became_active":"2023-12-24T18:36:27.054059+0000","last_became_peered":"2023-12-24T18:36:27.054059+0000","last_unstale":"2023-12-24T18:36:33.200942+0000","last_undegraded":"2023-12-24T18:36:33.200942+0000","last_fullsized":"2023-12-24T18:36:33.200942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199154+0000","last_change":"2023-12-24T18:36:32.242682+0000","last_active":"2023-12-24T18:36:33.199154+0000","last_peered":"2023-12-24T18:36:33.199154+0000","last_clean":"2023-12-24T18:36:33.199154+0000","last_became_active":"2023-12-24T18:36:32.242104+0000","last_became_peered":"2023-12-24T18:36:32.242104+0000","last_unstale":"2023-12-24T18:36:33.199154+0000","last_undegraded":"2023-12-24T18:36:33.199154+0000","last_fullsized":"2023-12-24T18:36:33.199154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242508+0000","last_change":"2023-12-24T18:36:28.141979+0000","last_active":"2023-12-24T18:36:33.242508+0000","last_peered":"2023-12-24T18:36:33.242508+0000","last_clean":"2023-12-24T18:36:33.242508+0000","last_became_active":"2023-12-24T18:36:28.141662+0000","last_became_peered":"2023-12-24T18:36:28.141662+0000","last_unstale":"2023-12-24T18:36:33.242508+0000","last_undegraded":"2023-12-24T18:36:33.242508+0000","last_fullsized":"2023-12-24T18:36:33.242508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195913+0000","last_change":"2023-12-24T18:36:27.057902+0000","last_active":"2023-12-24T18:36:33.195913+0000","last_peered":"2023-12-24T18:36:33.195913+0000","last_clean":"2023-12-24T18:36:33.195913+0000","last_became_active":"2023-12-24T18:36:27.057601+0000","last_became_peered":"2023-12-24T18:36:27.057601+0000","last_unstale":"2023-12-24T18:36:33.195913+0000","last_undegraded":"2023-12-24T18:36:33.195913+0000","last_fullsized":"2023-12-24T18:36:33.195913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241297+0000","last_change":"2023-12-24T18:36:32.258321+0000","last_active":"2023-12-24T18:36:33.241297+0000","last_peered":"2023-12-24T18:36:33.241297+0000","last_clean":"2023-12-24T18:36:33.241297+0000","last_became_active":"2023-12-24T18:36:32.257975+0000","last_became_peered":"2023-12-24T18:36:32.257975+0000","last_unstale":"2023-12-24T18:36:33.241297+0000","last_undegraded":"2023-12-24T18:36:33.241297+0000","last_fullsized":"2023-12-24T18:36:33.241297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199956+0000","last_change":"2023-12-24T18:36:28.120873+0000","last_active":"2023-12-24T18:36:33.199956+0000","last_peered":"2023-12-24T18:36:33.199956+0000","last_clean":"2023-12-24T18:36:33.199956+0000","last_became_active":"2023-12-24T18:36:28.120575+0000","last_became_peered":"2023-12-24T18:36:28.120575+0000","last_unstale":"2023-12-24T18:36:33.199956+0000","last_undegraded":"2023-12-24T18:36:33.199956+0000","last_fullsized":"2023-12-24T18:36:33.199956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200186+0000","last_change":"2023-12-24T18:36:27.056392+0000","last_active":"2023-12-24T18:36:33.200186+0000","last_peered":"2023-12-24T18:36:33.200186+0000","last_clean":"2023-12-24T18:36:33.200186+0000","last_became_active":"2023-12-24T18:36:27.055923+0000","last_became_peered":"2023-12-24T18:36:27.055923+0000","last_unstale":"2023-12-24T18:36:33.200186+0000","last_undegraded":"2023-12-24T18:36:33.200186+0000","last_fullsized":"2023-12-24T18:36:33.200186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239172+0000","last_change":"2023-12-24T18:36:33.070180+0000","last_active":"2023-12-24T18:36:33.239172+0000","last_peered":"2023-12-24T18:36:33.239172+0000","last_clean":"2023-12-24T18:36:33.239172+0000","last_became_active":"2023-12-24T18:36:33.069205+0000","last_became_peered":"2023-12-24T18:36:33.069205+0000","last_unstale":"2023-12-24T18:36:33.239172+0000","last_undegraded":"2023-12-24T18:36:33.239172+0000","last_fullsized":"2023-12-24T18:36:33.239172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:32.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243039+0000","last_change":"2023-12-24T18:36:28.127186+0000","last_active":"2023-12-24T18:36:33.243039+0000","last_peered":"2023-12-24T18:36:33.243039+0000","last_clean":"2023-12-24T18:36:33.243039+0000","last_became_active":"2023-12-24T18:36:28.126357+0000","last_became_peered":"2023-12-24T18:36:28.126357+0000","last_unstale":"2023-12-24T18:36:33.243039+0000","last_undegraded":"2023-12-24T18:36:33.243039+0000","last_fullsized":"2023-12-24T18:36:33.243039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:43.975991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242848+0000","last_change":"2023-12-24T18:36:27.070926+0000","last_active":"2023-12-24T18:36:33.242848+0000","last_peered":"2023-12-24T18:36:33.242848+0000","last_clean":"2023-12-24T18:36:33.242848+0000","last_became_active":"2023-12-24T18:36:27.070569+0000","last_became_peered":"2023-12-24T18:36:27.070569+0000","last_unstale":"2023-12-24T18:36:33.242848+0000","last_undegraded":"2023-12-24T18:36:33.242848+0000","last_fullsized":"2023-12-24T18:36:33.242848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239108+0000","last_change":"2023-12-24T18:36:33.062857+0000","last_active":"2023-12-24T18:36:33.239108+0000","last_peered":"2023-12-24T18:36:33.239108+0000","last_clean":"2023-12-24T18:36:33.239108+0000","last_became_active":"2023-12-24T18:36:33.061451+0000","last_became_peered":"2023-12-24T18:36:33.061451+0000","last_unstale":"2023-12-24T18:36:33.239108+0000","last_undegraded":"2023-12-24T18:36:33.239108+0000","last_fullsized":"2023-12-24T18:36:33.239108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:00.421630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241031+0000","last_change":"2023-12-24T18:36:28.123632+0000","last_active":"2023-12-24T18:36:33.241031+0000","last_peered":"2023-12-24T18:36:33.241031+0000","last_clean":"2023-12-24T18:36:33.241031+0000","last_became_active":"2023-12-24T18:36:28.122094+0000","last_became_peered":"2023-12-24T18:36:28.122094+0000","last_unstale":"2023-12-24T18:36:33.241031+0000","last_undegraded":"2023-12-24T18:36:33.241031+0000","last_fullsized":"2023-12-24T18:36:33.241031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241638+0000","last_change":"2023-12-24T18:36:27.055652+0000","last_active":"2023-12-24T18:36:33.241638+0000","last_peered":"2023-12-24T18:36:33.241638+0000","last_clean":"2023-12-24T18:36:33.241638+0000","last_became_active":"2023-12-24T18:36:27.055325+0000","last_became_peered":"2023-12-24T18:36:27.055325+0000","last_unstale":"2023-12-24T18:36:33.241638+0000","last_undegraded":"2023-12-24T18:36:33.241638+0000","last_fullsized":"2023-12-24T18:36:33.241638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241611+0000","last_change":"2023-12-24T18:36:33.060160+0000","last_active":"2023-12-24T18:36:33.241611+0000","last_peered":"2023-12-24T18:36:33.241611+0000","last_clean":"2023-12-24T18:36:33.241611+0000","last_became_active":"2023-12-24T18:36:33.059695+0000","last_became_peered":"2023-12-24T18:36:33.059695+0000","last_unstale":"2023-12-24T18:36:33.241611+0000","last_undegraded":"2023-12-24T18:36:33.241611+0000","last_fullsized":"2023-12-24T18:36:33.241611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243445+0000","last_change":"2023-12-24T18:36:28.136247+0000","last_active":"2023-12-24T18:36:33.243445+0000","last_peered":"2023-12-24T18:36:33.243445+0000","last_clean":"2023-12-24T18:36:33.243445+0000","last_became_active":"2023-12-24T18:36:28.136021+0000","last_became_peered":"2023-12-24T18:36:28.136021+0000","last_unstale":"2023-12-24T18:36:33.243445+0000","last_undegraded":"2023-12-24T18:36:33.243445+0000","last_fullsized":"2023-12-24T18:36:33.243445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-24T18:36:39.871742+0000","last_change":"2023-12-24T18:36:27.050997+0000","last_active":"2023-12-24T18:36:39.871742+0000","last_peered":"2023-12-24T18:36:39.871742+0000","last_clean":"2023-12-24T18:36:39.871742+0000","last_became_active":"2023-12-24T18:36:27.050699+0000","last_became_peered":"2023-12-24T18:36:27.050699+0000","last_unstale":"2023-12-24T18:36:39.871742+0000","last_undegraded":"2023-12-24T18:36:39.871742+0000","last_fullsized":"2023-12-24T18:36:39.871742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243594+0000","last_change":"2023-12-24T18:36:32.265338+0000","last_active":"2023-12-24T18:36:33.243594+0000","last_peered":"2023-12-24T18:36:33.243594+0000","last_clean":"2023-12-24T18:36:33.243594+0000","last_became_active":"2023-12-24T18:36:32.262433+0000","last_became_peered":"2023-12-24T18:36:32.262433+0000","last_unstale":"2023-12-24T18:36:33.243594+0000","last_undegraded":"2023-12-24T18:36:33.243594+0000","last_fullsized":"2023-12-24T18:36:33.243594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200245+0000","last_change":"2023-12-24T18:36:28.130092+0000","last_active":"2023-12-24T18:36:33.200245+0000","last_peered":"2023-12-24T18:36:33.200245+0000","last_clean":"2023-12-24T18:36:33.200245+0000","last_became_active":"2023-12-24T18:36:28.129800+0000","last_became_peered":"2023-12-24T18:36:28.129800+0000","last_unstale":"2023-12-24T18:36:33.200245+0000","last_undegraded":"2023-12-24T18:36:33.200245+0000","last_fullsized":"2023-12-24T18:36:33.200245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:07.827336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244364+0000","last_change":"2023-12-24T18:36:27.064647+0000","last_active":"2023-12-24T18:36:33.244364+0000","last_peered":"2023-12-24T18:36:33.244364+0000","last_clean":"2023-12-24T18:36:33.244364+0000","last_became_active":"2023-12-24T18:36:27.064351+0000","last_became_peered":"2023-12-24T18:36:27.064351+0000","last_unstale":"2023-12-24T18:36:33.244364+0000","last_undegraded":"2023-12-24T18:36:33.244364+0000","last_fullsized":"2023-12-24T18:36:33.244364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199629+0000","last_change":"2023-12-24T18:36:32.249074+0000","last_active":"2023-12-24T18:36:33.199629+0000","last_peered":"2023-12-24T18:36:33.199629+0000","last_clean":"2023-12-24T18:36:33.199629+0000","last_became_active":"2023-12-24T18:36:32.248543+0000","last_became_peered":"2023-12-24T18:36:32.248543+0000","last_unstale":"2023-12-24T18:36:33.199629+0000","last_undegraded":"2023-12-24T18:36:33.199629+0000","last_fullsized":"2023-12-24T18:36:33.199629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241822+0000","last_change":"2023-12-24T18:36:28.131246+0000","last_active":"2023-12-24T18:36:33.241822+0000","last_peered":"2023-12-24T18:36:33.241822+0000","last_clean":"2023-12-24T18:36:33.241822+0000","last_became_active":"2023-12-24T18:36:28.130746+0000","last_became_peered":"2023-12-24T18:36:28.130746+0000","last_unstale":"2023-12-24T18:36:33.241822+0000","last_undegraded":"2023-12-24T18:36:33.241822+0000","last_fullsized":"2023-12-24T18:36:33.241822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242891+0000","last_change":"2023-12-24T18:36:27.068097+0000","last_active":"2023-12-24T18:36:33.242891+0000","last_peered":"2023-12-24T18:36:33.242891+0000","last_clean":"2023-12-24T18:36:33.242891+0000","last_became_active":"2023-12-24T18:36:27.067789+0000","last_became_peered":"2023-12-24T18:36:27.067789+0000","last_unstale":"2023-12-24T18:36:33.242891+0000","last_undegraded":"2023-12-24T18:36:33.242891+0000","last_fullsized":"2023-12-24T18:36:33.242891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239664+0000","last_change":"2023-12-24T18:36:32.244698+0000","last_active":"2023-12-24T18:36:33.239664+0000","last_peered":"2023-12-24T18:36:33.239664+0000","last_clean":"2023-12-24T18:36:33.239664+0000","last_became_active":"2023-12-24T18:36:32.241614+0000","last_became_peered":"2023-12-24T18:36:32.241614+0000","last_unstale":"2023-12-24T18:36:33.239664+0000","last_undegraded":"2023-12-24T18:36:33.239664+0000","last_fullsized":"2023-12-24T18:36:33.239664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:10.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242816+0000","last_change":"2023-12-24T18:36:28.121758+0000","last_active":"2023-12-24T18:36:33.242816+0000","last_peered":"2023-12-24T18:36:33.242816+0000","last_clean":"2023-12-24T18:36:33.242816+0000","last_became_active":"2023-12-24T18:36:28.121401+0000","last_became_peered":"2023-12-24T18:36:28.121401+0000","last_unstale":"2023-12-24T18:36:33.242816+0000","last_undegraded":"2023-12-24T18:36:33.242816+0000","last_fullsized":"2023-12-24T18:36:33.242816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201431+0000","last_change":"2023-12-24T18:36:27.060571+0000","last_active":"2023-12-24T18:36:33.201431+0000","last_peered":"2023-12-24T18:36:33.201431+0000","last_clean":"2023-12-24T18:36:33.201431+0000","last_became_active":"2023-12-24T18:36:27.060196+0000","last_became_peered":"2023-12-24T18:36:27.060196+0000","last_unstale":"2023-12-24T18:36:33.201431+0000","last_undegraded":"2023-12-24T18:36:33.201431+0000","last_fullsized":"2023-12-24T18:36:33.201431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238883+0000","last_change":"2023-12-24T18:36:33.074044+0000","last_active":"2023-12-24T18:36:33.238883+0000","last_peered":"2023-12-24T18:36:33.238883+0000","last_clean":"2023-12-24T18:36:33.238883+0000","last_became_active":"2023-12-24T18:36:33.072749+0000","last_became_peered":"2023-12-24T18:36:33.072749+0000","last_unstale":"2023-12-24T18:36:33.238883+0000","last_undegraded":"2023-12-24T18:36:33.238883+0000","last_fullsized":"2023-12-24T18:36:33.238883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240216+0000","last_change":"2023-12-24T18:36:33.069415+0000","last_active":"2023-12-24T18:36:33.240216+0000","last_peered":"2023-12-24T18:36:33.240216+0000","last_clean":"2023-12-24T18:36:33.240216+0000","last_became_active":"2023-12-24T18:36:33.068823+0000","last_became_peered":"2023-12-24T18:36:33.068823+0000","last_unstale":"2023-12-24T18:36:33.240216+0000","last_undegraded":"2023-12-24T18:36:33.240216+0000","last_fullsized":"2023-12-24T18:36:33.240216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243302+0000","last_change":"2023-12-24T18:36:28.131660+0000","last_active":"2023-12-24T18:36:33.243302+0000","last_peered":"2023-12-24T18:36:33.243302+0000","last_clean":"2023-12-24T18:36:33.243302+0000","last_became_active":"2023-12-24T18:36:28.128366+0000","last_became_peered":"2023-12-24T18:36:28.128366+0000","last_unstale":"2023-12-24T18:36:33.243302+0000","last_undegraded":"2023-12-24T18:36:33.243302+0000","last_fullsized":"2023-12-24T18:36:33.243302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241935+0000","last_change":"2023-12-24T18:36:27.068197+0000","last_active":"2023-12-24T18:36:33.241935+0000","last_peered":"2023-12-24T18:36:33.241935+0000","last_clean":"2023-12-24T18:36:33.241935+0000","last_became_active":"2023-12-24T18:36:27.067904+0000","last_became_peered":"2023-12-24T18:36:27.067904+0000","last_unstale":"2023-12-24T18:36:33.241935+0000","last_undegraded":"2023-12-24T18:36:33.241935+0000","last_fullsized":"2023-12-24T18:36:33.241935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201359+0000","last_change":"2023-12-24T18:36:32.260906+0000","last_active":"2023-12-24T18:36:33.201359+0000","last_peered":"2023-12-24T18:36:33.201359+0000","last_clean":"2023-12-24T18:36:33.201359+0000","last_became_active":"2023-12-24T18:36:32.260087+0000","last_became_peered":"2023-12-24T18:36:32.260087+0000","last_unstale":"2023-12-24T18:36:33.201359+0000","last_undegraded":"2023-12-24T18:36:33.201359+0000","last_fullsized":"2023-12-24T18:36:33.201359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:55.104503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239457+0000","last_change":"2023-12-24T18:36:28.124021+0000","last_active":"2023-12-24T18:36:33.239457+0000","last_peered":"2023-12-24T18:36:33.239457+0000","last_clean":"2023-12-24T18:36:33.239457+0000","last_became_active":"2023-12-24T18:36:28.121017+0000","last_became_peered":"2023-12-24T18:36:28.121017+0000","last_unstale":"2023-12-24T18:36:33.239457+0000","last_undegraded":"2023-12-24T18:36:33.239457+0000","last_fullsized":"2023-12-24T18:36:33.239457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239994+0000","last_change":"2023-12-24T18:36:27.068350+0000","last_active":"2023-12-24T18:36:33.239994+0000","last_peered":"2023-12-24T18:36:33.239994+0000","last_clean":"2023-12-24T18:36:33.239994+0000","last_became_active":"2023-12-24T18:36:27.053418+0000","last_became_peered":"2023-12-24T18:36:27.053418+0000","last_unstale":"2023-12-24T18:36:33.239994+0000","last_undegraded":"2023-12-24T18:36:33.239994+0000","last_fullsized":"2023-12-24T18:36:33.239994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200423+0000","last_change":"2023-12-24T18:36:27.054736+0000","last_active":"2023-12-24T18:36:33.200423+0000","last_peered":"2023-12-24T18:36:33.200423+0000","last_clean":"2023-12-24T18:36:33.200423+0000","last_became_active":"2023-12-24T18:36:27.054412+0000","last_became_peered":"2023-12-24T18:36:27.054412+0000","last_unstale":"2023-12-24T18:36:33.200423+0000","last_undegraded":"2023-12-24T18:36:33.200423+0000","last_fullsized":"2023-12-24T18:36:33.200423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241564+0000","last_change":"2023-12-24T18:36:28.129965+0000","last_active":"2023-12-24T18:36:33.241564+0000","last_peered":"2023-12-24T18:36:33.241564+0000","last_clean":"2023-12-24T18:36:33.241564+0000","last_became_active":"2023-12-24T18:36:28.129603+0000","last_became_peered":"2023-12-24T18:36:28.129603+0000","last_unstale":"2023-12-24T18:36:33.241564+0000","last_undegraded":"2023-12-24T18:36:33.241564+0000","last_fullsized":"2023-12-24T18:36:33.241564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196390+0000","last_change":"2023-12-24T18:36:32.255501+0000","last_active":"2023-12-24T18:36:33.196390+0000","last_peered":"2023-12-24T18:36:33.196390+0000","last_clean":"2023-12-24T18:36:33.196390+0000","last_became_active":"2023-12-24T18:36:32.254933+0000","last_became_peered":"2023-12-24T18:36:32.254933+0000","last_unstale":"2023-12-24T18:36:33.196390+0000","last_undegraded":"2023-12-24T18:36:33.196390+0000","last_fullsized":"2023-12-24T18:36:33.196390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:17.070830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239657+0000","last_change":"2023-12-24T18:36:27.057513+0000","last_active":"2023-12-24T18:36:33.239657+0000","last_peered":"2023-12-24T18:36:33.239657+0000","last_clean":"2023-12-24T18:36:33.239657+0000","last_became_active":"2023-12-24T18:36:27.057214+0000","last_became_peered":"2023-12-24T18:36:27.057214+0000","last_unstale":"2023-12-24T18:36:33.239657+0000","last_undegraded":"2023-12-24T18:36:33.239657+0000","last_fullsized":"2023-12-24T18:36:33.239657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:45:26.084715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199367+0000","last_change":"2023-12-24T18:36:28.135278+0000","last_active":"2023-12-24T18:36:33.199367+0000","last_peered":"2023-12-24T18:36:33.199367+0000","last_clean":"2023-12-24T18:36:33.199367+0000","last_became_active":"2023-12-24T18:36:28.134930+0000","last_became_peered":"2023-12-24T18:36:28.134930+0000","last_unstale":"2023-12-24T18:36:33.199367+0000","last_undegraded":"2023-12-24T18:36:33.199367+0000","last_fullsized":"2023-12-24T18:36:33.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241829+0000","last_change":"2023-12-24T18:36:32.249712+0000","last_active":"2023-12-24T18:36:33.241829+0000","last_peered":"2023-12-24T18:36:33.241829+0000","last_clean":"2023-12-24T18:36:33.241829+0000","last_became_active":"2023-12-24T18:36:32.249212+0000","last_became_peered":"2023-12-24T18:36:32.249212+0000","last_unstale":"2023-12-24T18:36:33.241829+0000","last_undegraded":"2023-12-24T18:36:33.241829+0000","last_fullsized":"2023-12-24T18:36:33.241829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:16.688462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199863+0000","last_change":"2023-12-24T18:36:28.127955+0000","last_active":"2023-12-24T18:36:33.199863+0000","last_peered":"2023-12-24T18:36:33.199863+0000","last_clean":"2023-12-24T18:36:33.199863+0000","last_became_active":"2023-12-24T18:36:28.127567+0000","last_became_peered":"2023-12-24T18:36:28.127567+0000","last_unstale":"2023-12-24T18:36:33.199863+0000","last_undegraded":"2023-12-24T18:36:33.199863+0000","last_fullsized":"2023-12-24T18:36:33.199863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195895+0000","last_change":"2023-12-24T18:36:28.122309+0000","last_active":"2023-12-24T18:36:33.195895+0000","last_peered":"2023-12-24T18:36:33.195895+0000","last_clean":"2023-12-24T18:36:33.195895+0000","last_became_active":"2023-12-24T18:36:28.121952+0000","last_became_peered":"2023-12-24T18:36:28.121952+0000","last_unstale":"2023-12-24T18:36:33.195895+0000","last_undegraded":"2023-12-24T18:36:33.195895+0000","last_fullsized":"2023-12-24T18:36:33.195895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:10:51.295826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242736+0000","last_change":"2023-12-24T18:36:28.127237+0000","last_active":"2023-12-24T18:36:33.242736+0000","last_peered":"2023-12-24T18:36:33.242736+0000","last_clean":"2023-12-24T18:36:33.242736+0000","last_became_active":"2023-12-24T18:36:28.126847+0000","last_became_peered":"2023-12-24T18:36:28.126847+0000","last_unstale":"2023-12-24T18:36:33.242736+0000","last_undegraded":"2023-12-24T18:36:33.242736+0000","last_fullsized":"2023-12-24T18:36:33.242736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241422+0000","last_change":"2023-12-24T18:36:28.131645+0000","last_active":"2023-12-24T18:36:33.241422+0000","last_peered":"2023-12-24T18:36:33.241422+0000","last_clean":"2023-12-24T18:36:33.241422+0000","last_became_active":"2023-12-24T18:36:28.131357+0000","last_became_peered":"2023-12-24T18:36:28.131357+0000","last_unstale":"2023-12-24T18:36:33.241422+0000","last_undegraded":"2023-12-24T18:36:33.241422+0000","last_fullsized":"2023-12-24T18:36:33.241422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240828+0000","last_change":"2023-12-24T18:36:28.117729+0000","last_active":"2023-12-24T18:36:33.240828+0000","last_peered":"2023-12-24T18:36:33.240828+0000","last_clean":"2023-12-24T18:36:33.240828+0000","last_became_active":"2023-12-24T18:36:28.117032+0000","last_became_peered":"2023-12-24T18:36:28.117032+0000","last_unstale":"2023-12-24T18:36:33.240828+0000","last_undegraded":"2023-12-24T18:36:33.240828+0000","last_fullsized":"2023-12-24T18:36:33.240828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244218+0000","last_change":"2023-12-24T18:36:28.122731+0000","last_active":"2023-12-24T18:36:33.244218+0000","last_peered":"2023-12-24T18:36:33.244218+0000","last_clean":"2023-12-24T18:36:33.244218+0000","last_became_active":"2023-12-24T18:36:28.122381+0000","last_became_peered":"2023-12-24T18:36:28.122381+0000","last_unstale":"2023-12-24T18:36:33.244218+0000","last_undegraded":"2023-12-24T18:36:33.244218+0000","last_fullsized":"2023-12-24T18:36:33.244218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201413+0000","last_change":"2023-12-24T18:36:28.110419+0000","last_active":"2023-12-24T18:36:33.201413+0000","last_peered":"2023-12-24T18:36:33.201413+0000","last_clean":"2023-12-24T18:36:33.201413+0000","last_became_active":"2023-12-24T18:36:28.110104+0000","last_became_peered":"2023-12-24T18:36:28.110104+0000","last_unstale":"2023-12-24T18:36:33.201413+0000","last_undegraded":"2023-12-24T18:36:33.201413+0000","last_fullsized":"2023-12-24T18:36:33.201413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242401+0000","last_change":"2023-12-24T18:36:28.112938+0000","last_active":"2023-12-24T18:36:33.242401+0000","last_peered":"2023-12-24T18:36:33.242401+0000","last_clean":"2023-12-24T18:36:33.242401+0000","last_became_active":"2023-12-24T18:36:28.112607+0000","last_became_peered":"2023-12-24T18:36:28.112607+0000","last_unstale":"2023-12-24T18:36:33.242401+0000","last_undegraded":"2023-12-24T18:36:33.242401+0000","last_fullsized":"2023-12-24T18:36:33.242401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241820+0000","last_change":"2023-12-24T18:36:28.124839+0000","last_active":"2023-12-24T18:36:33.241820+0000","last_peered":"2023-12-24T18:36:33.241820+0000","last_clean":"2023-12-24T18:36:33.241820+0000","last_became_active":"2023-12-24T18:36:28.124475+0000","last_became_peered":"2023-12-24T18:36:28.124475+0000","last_unstale":"2023-12-24T18:36:33.241820+0000","last_undegraded":"2023-12-24T18:36:33.241820+0000","last_fullsized":"2023-12-24T18:36:33.241820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239644+0000","last_change":"2023-12-24T18:36:28.121764+0000","last_active":"2023-12-24T18:36:33.239644+0000","last_peered":"2023-12-24T18:36:33.239644+0000","last_clean":"2023-12-24T18:36:33.239644+0000","last_became_active":"2023-12-24T18:36:28.119184+0000","last_became_peered":"2023-12-24T18:36:28.119184+0000","last_unstale":"2023-12-24T18:36:33.239644+0000","last_undegraded":"2023-12-24T18:36:33.239644+0000","last_fullsized":"2023-12-24T18:36:33.239644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242614+0000","last_change":"2023-12-24T18:36:28.122598+0000","last_active":"2023-12-24T18:36:33.242614+0000","last_peered":"2023-12-24T18:36:33.242614+0000","last_clean":"2023-12-24T18:36:33.242614+0000","last_became_active":"2023-12-24T18:36:28.122261+0000","last_became_peered":"2023-12-24T18:36:28.122261+0000","last_unstale":"2023-12-24T18:36:33.242614+0000","last_undegraded":"2023-12-24T18:36:33.242614+0000","last_fullsized":"2023-12-24T18:36:33.242614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241191+0000","last_change":"2023-12-24T18:36:28.123426+0000","last_active":"2023-12-24T18:36:33.241191+0000","last_peered":"2023-12-24T18:36:33.241191+0000","last_clean":"2023-12-24T18:36:33.241191+0000","last_became_active":"2023-12-24T18:36:28.122912+0000","last_became_peered":"2023-12-24T18:36:28.122912+0000","last_unstale":"2023-12-24T18:36:33.241191+0000","last_undegraded":"2023-12-24T18:36:33.241191+0000","last_fullsized":"2023-12-24T18:36:33.241191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:32.309502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200862+0000","last_change":"2023-12-24T18:36:28.111862+0000","last_active":"2023-12-24T18:36:33.200862+0000","last_peered":"2023-12-24T18:36:33.200862+0000","last_clean":"2023-12-24T18:36:33.200862+0000","last_became_active":"2023-12-24T18:36:28.111275+0000","last_became_peered":"2023-12-24T18:36:28.111275+0000","last_unstale":"2023-12-24T18:36:33.200862+0000","last_undegraded":"2023-12-24T18:36:33.200862+0000","last_fullsized":"2023-12-24T18:36:33.200862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243601+0000","last_change":"2023-12-24T18:36:28.129777+0000","last_active":"2023-12-24T18:36:33.243601+0000","last_peered":"2023-12-24T18:36:33.243601+0000","last_clean":"2023-12-24T18:36:33.243601+0000","last_became_active":"2023-12-24T18:36:28.129505+0000","last_became_peered":"2023-12-24T18:36:28.129505+0000","last_unstale":"2023-12-24T18:36:33.243601+0000","last_undegraded":"2023-12-24T18:36:33.243601+0000","last_fullsized":"2023-12-24T18:36:33.243601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196463+0000","last_change":"2023-12-24T18:36:28.108366+0000","last_active":"2023-12-24T18:36:33.196463+0000","last_peered":"2023-12-24T18:36:33.196463+0000","last_clean":"2023-12-24T18:36:33.196463+0000","last_became_active":"2023-12-24T18:36:28.107349+0000","last_became_peered":"2023-12-24T18:36:28.107349+0000","last_unstale":"2023-12-24T18:36:33.196463+0000","last_undegraded":"2023-12-24T18:36:33.196463+0000","last_fullsized":"2023-12-24T18:36:33.196463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243215+0000","last_change":"2023-12-24T18:36:28.126189+0000","last_active":"2023-12-24T18:36:33.243215+0000","last_peered":"2023-12-24T18:36:33.243215+0000","last_clean":"2023-12-24T18:36:33.243215+0000","last_became_active":"2023-12-24T18:36:28.125898+0000","last_became_peered":"2023-12-24T18:36:28.125898+0000","last_unstale":"2023-12-24T18:36:33.243215+0000","last_undegraded":"2023-12-24T18:36:33.243215+0000","last_fullsized":"2023-12-24T18:36:33.243215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241791+0000","last_change":"2023-12-24T18:36:28.132625+0000","last_active":"2023-12-24T18:36:33.241791+0000","last_peered":"2023-12-24T18:36:33.241791+0000","last_clean":"2023-12-24T18:36:33.241791+0000","last_became_active":"2023-12-24T18:36:28.132212+0000","last_became_peered":"2023-12-24T18:36:28.132212+0000","last_unstale":"2023-12-24T18:36:33.241791+0000","last_undegraded":"2023-12-24T18:36:33.241791+0000","last_fullsized":"2023-12-24T18:36:33.241791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243456+0000","last_change":"2023-12-24T18:36:28.117097+0000","last_active":"2023-12-24T18:36:33.243456+0000","last_peered":"2023-12-24T18:36:33.243456+0000","last_clean":"2023-12-24T18:36:33.243456+0000","last_became_active":"2023-12-24T18:36:28.116619+0000","last_became_peered":"2023-12-24T18:36:28.116619+0000","last_unstale":"2023-12-24T18:36:33.243456+0000","last_undegraded":"2023-12-24T18:36:33.243456+0000","last_fullsized":"2023-12-24T18:36:33.243456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240881+0000","last_change":"2023-12-24T18:36:28.126681+0000","last_active":"2023-12-24T18:36:33.240881+0000","last_peered":"2023-12-24T18:36:33.240881+0000","last_clean":"2023-12-24T18:36:33.240881+0000","last_became_active":"2023-12-24T18:36:28.126405+0000","last_became_peered":"2023-12-24T18:36:28.126405+0000","last_unstale":"2023-12-24T18:36:33.240881+0000","last_undegraded":"2023-12-24T18:36:33.240881+0000","last_fullsized":"2023-12-24T18:36:33.240881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:13:51.708720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239479+0000","last_change":"2023-12-24T18:36:28.120536+0000","last_active":"2023-12-24T18:36:33.239479+0000","last_peered":"2023-12-24T18:36:33.239479+0000","last_clean":"2023-12-24T18:36:33.239479+0000","last_became_active":"2023-12-24T18:36:28.117933+0000","last_became_peered":"2023-12-24T18:36:28.117933+0000","last_unstale":"2023-12-24T18:36:33.239479+0000","last_undegraded":"2023-12-24T18:36:33.239479+0000","last_fullsized":"2023-12-24T18:36:33.239479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200207+0000","last_change":"2023-12-24T18:36:28.107648+0000","last_active":"2023-12-24T18:36:33.200207+0000","last_peered":"2023-12-24T18:36:33.200207+0000","last_clean":"2023-12-24T18:36:33.200207+0000","last_became_active":"2023-12-24T18:36:28.107371+0000","last_became_peered":"2023-12-24T18:36:28.107371+0000","last_unstale":"2023-12-24T18:36:33.200207+0000","last_undegraded":"2023-12-24T18:36:33.200207+0000","last_fullsized":"2023-12-24T18:36:33.200207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:00.325029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201052+0000","last_change":"2023-12-24T18:36:28.124649+0000","last_active":"2023-12-24T18:36:33.201052+0000","last_peered":"2023-12-24T18:36:33.201052+0000","last_clean":"2023-12-24T18:36:33.201052+0000","last_became_active":"2023-12-24T18:36:28.124391+0000","last_became_peered":"2023-12-24T18:36:28.124391+0000","last_unstale":"2023-12-24T18:36:33.201052+0000","last_undegraded":"2023-12-24T18:36:33.201052+0000","last_fullsized":"2023-12-24T18:36:33.201052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201303+0000","last_change":"2023-12-24T18:36:28.125440+0000","last_active":"2023-12-24T18:36:33.201303+0000","last_peered":"2023-12-24T18:36:33.201303+0000","last_clean":"2023-12-24T18:36:33.201303+0000","last_became_active":"2023-12-24T18:36:28.124997+0000","last_became_peered":"2023-12-24T18:36:28.124997+0000","last_unstale":"2023-12-24T18:36:33.201303+0000","last_undegraded":"2023-12-24T18:36:33.201303+0000","last_fullsized":"2023-12-24T18:36:33.201303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244397+0000","last_change":"2023-12-24T18:36:28.135114+0000","last_active":"2023-12-24T18:36:33.244397+0000","last_peered":"2023-12-24T18:36:33.244397+0000","last_clean":"2023-12-24T18:36:33.244397+0000","last_became_active":"2023-12-24T18:36:28.134791+0000","last_became_peered":"2023-12-24T18:36:28.134791+0000","last_unstale":"2023-12-24T18:36:33.244397+0000","last_undegraded":"2023-12-24T18:36:33.244397+0000","last_fullsized":"2023-12-24T18:36:33.244397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239249+0000","last_change":"2023-12-24T18:36:28.128424+0000","last_active":"2023-12-24T18:36:33.239249+0000","last_peered":"2023-12-24T18:36:33.239249+0000","last_clean":"2023-12-24T18:36:33.239249+0000","last_became_active":"2023-12-24T18:36:28.126648+0000","last_became_peered":"2023-12-24T18:36:28.126648+0000","last_unstale":"2023-12-24T18:36:33.239249+0000","last_undegraded":"2023-12-24T18:36:33.239249+0000","last_fullsized":"2023-12-24T18:36:33.239249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242477+0000","last_change":"2023-12-24T18:36:28.133462+0000","last_active":"2023-12-24T18:36:33.242477+0000","last_peered":"2023-12-24T18:36:33.242477+0000","last_clean":"2023-12-24T18:36:33.242477+0000","last_became_active":"2023-12-24T18:36:28.132743+0000","last_became_peered":"2023-12-24T18:36:28.132743+0000","last_unstale":"2023-12-24T18:36:33.242477+0000","last_undegraded":"2023-12-24T18:36:33.242477+0000","last_fullsized":"2023-12-24T18:36:33.242477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242433+0000","last_change":"2023-12-24T18:36:28.123802+0000","last_active":"2023-12-24T18:36:33.242433+0000","last_peered":"2023-12-24T18:36:33.242433+0000","last_clean":"2023-12-24T18:36:33.242433+0000","last_became_active":"2023-12-24T18:36:28.123485+0000","last_became_peered":"2023-12-24T18:36:28.123485+0000","last_unstale":"2023-12-24T18:36:33.242433+0000","last_undegraded":"2023-12-24T18:36:33.242433+0000","last_fullsized":"2023-12-24T18:36:33.242433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242781+0000","last_change":"2023-12-24T18:36:28.127375+0000","last_active":"2023-12-24T18:36:33.242781+0000","last_peered":"2023-12-24T18:36:33.242781+0000","last_clean":"2023-12-24T18:36:33.242781+0000","last_became_active":"2023-12-24T18:36:28.126911+0000","last_became_peered":"2023-12-24T18:36:28.126911+0000","last_unstale":"2023-12-24T18:36:33.242781+0000","last_undegraded":"2023-12-24T18:36:33.242781+0000","last_fullsized":"2023-12-24T18:36:33.242781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242304+0000","last_change":"2023-12-24T18:36:28.137460+0000","last_active":"2023-12-24T18:36:33.242304+0000","last_peered":"2023-12-24T18:36:33.242304+0000","last_clean":"2023-12-24T18:36:33.242304+0000","last_became_active":"2023-12-24T18:36:28.134762+0000","last_became_peered":"2023-12-24T18:36:28.134762+0000","last_unstale":"2023-12-24T18:36:33.242304+0000","last_undegraded":"2023-12-24T18:36:33.242304+0000","last_fullsized":"2023-12-24T18:36:33.242304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241490+0000","last_change":"2023-12-24T18:36:28.122281+0000","last_active":"2023-12-24T18:36:33.241490+0000","last_peered":"2023-12-24T18:36:33.241490+0000","last_clean":"2023-12-24T18:36:33.241490+0000","last_became_active":"2023-12-24T18:36:28.121977+0000","last_became_peered":"2023-12-24T18:36:28.121977+0000","last_unstale":"2023-12-24T18:36:33.241490+0000","last_undegraded":"2023-12-24T18:36:33.241490+0000","last_fullsized":"2023-12-24T18:36:33.241490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:40.546379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244610+0000","last_change":"2023-12-24T18:36:28.121068+0000","last_active":"2023-12-24T18:36:33.244610+0000","last_peered":"2023-12-24T18:36:33.244610+0000","last_clean":"2023-12-24T18:36:33.244610+0000","last_became_active":"2023-12-24T18:36:28.120763+0000","last_became_peered":"2023-12-24T18:36:28.120763+0000","last_unstale":"2023-12-24T18:36:33.244610+0000","last_undegraded":"2023-12-24T18:36:33.244610+0000","last_fullsized":"2023-12-24T18:36:33.244610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244306+0000","last_change":"2023-12-24T18:36:28.137961+0000","last_active":"2023-12-24T18:36:33.244306+0000","last_peered":"2023-12-24T18:36:33.244306+0000","last_clean":"2023-12-24T18:36:33.244306+0000","last_became_active":"2023-12-24T18:36:28.137711+0000","last_became_peered":"2023-12-24T18:36:28.137711+0000","last_unstale":"2023-12-24T18:36:33.244306+0000","last_undegraded":"2023-12-24T18:36:33.244306+0000","last_fullsized":"2023-12-24T18:36:33.244306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:47.085985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4483,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":697463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":106631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":106667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":106541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3050000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3730000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.653}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":872448,"data_stored":697519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:36:44.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:36:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.763+0000 7f671d2e3700 1 Processor -- start 2023-12-24T18:36:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.763+0000 7f671d2e3700 1 -- start start 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671806c0c0 0x7f67180a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806afb0 0x7f671806b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671806c510 con 0x7f6718158cd0 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180a9c80 con 0x7f671806c0c0 2023-12-24T18:36:44.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671d2e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180a8e10 con 0x7f671806afb0 2023-12-24T18:36:44.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f6717fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671806c0c0 0x7f67180a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f6717fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60688/0 (socket says 172.21.15.50:60688) 2023-12-24T18:36:44.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f6717fff700 1 -- 172.21.15.50:0/1180422496 learned_addr learned my addr 172.21.15.50:0/1180422496 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:44.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f671cae2700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806afb0 0x7f671806b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 -- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806afb0 msgr2=0x7f671806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806afb0 0x7f671806b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 -- 172.21.15.50:0/1180422496 >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 msgr2=0x7f67181590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 --2- 172.21.15.50:0/1180422496 >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 -- 172.21.15.50:0/1180422496 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671806b900 con 0x7f671806c0c0 2023-12-24T18:36:44.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f6717fff700 1 --2- 172.21.15.50:0/1180422496 >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f670f7fe700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671806c0c0 0x7f67180a88d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67180b1b40 tx=0x7f67000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c08c6c7b8423ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f67177fe700 1 -- 172.21.15.50:0/1180422496 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700011630 con 0x7f671806c0c0 2023-12-24T18:36:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f67177fe700 1 -- 172.21.15.50:0/1180422496 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000117b0 con 0x7f671806c0c0 2023-12-24T18:36:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.767+0000 7f67177fe700 1 -- 172.21.15.50:0/1180422496 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700011b70 con 0x7f671806c0c0 2023-12-24T18:36:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671806c0c0 msgr2=0x7f67180a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671806c0c0 0x7f67180a88d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67180b1b40 tx=0x7f67000091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- 172.21.15.50:0/1180422496 shutdown_connections 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671806c0c0 0x7f67180a88d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 --2- 172.21.15.50:0/1180422496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806afb0 0x7f671806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 --2- 172.21.15.50:0/1180422496 >> v2:172.21.15.50:3300/0 conn(0x7f6718158cd0 0x7f67181590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- 172.21.15.50:0/1180422496 >> 172.21.15.50:0/1180422496 conn(0x7f6718067b80 msgr2=0x7f67180cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- 172.21.15.50:0/1180422496 shutdown_connections 2023-12-24T18:36:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- 172.21.15.50:0/1180422496 wait complete. 2023-12-24T18:36:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 Processor -- start 2023-12-24T18:36:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.771+0000 7f671d2e3700 1 -- start start 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 0x7f671815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 0x7f671815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671815bd00 con 0x7f671806afb0 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671815cb20 con 0x7f6718158cd0 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671815cfb0 con 0x7f671806c0c0 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60698/0 (socket says 172.21.15.50:60698) 2023-12-24T18:36:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 -- 172.21.15.50:0/4091245574 learned_addr learned my addr 172.21.15.50:0/4091245574 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:44.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f670f7fe700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 0x7f671815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671cae2700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 0x7f671815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 -- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 msgr2=0x7f671815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 0x7f671815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 -- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 msgr2=0x7f671815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 0x7f671815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 -- 172.21.15.50:0/4091245574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009ae0 con 0x7f671806afb0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671cae2700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 0x7f671815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f670f7fe700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 0x7f671815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6717fff700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f670800c170 tx=0x7f670800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800cc00 con 0x7f671806afb0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800f040 con 0x7f671806afb0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6700009420 con 0x7f671806afb0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708014480 con 0x7f671806afb0 2023-12-24T18:36:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.775+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671815c1f0 con 0x7f671806afb0 2023-12-24T18:36:44.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.779+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180c7a70 con 0x7f671806afb0 2023-12-24T18:36:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.779+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f67080147f0 con 0x7f671806afb0 2023-12-24T18:36:44.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.779+0000 7f6714ff9700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 0x7f66f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:44.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.779+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f670807d280 con 0x7f671806afb0 2023-12-24T18:36:44.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.783+0000 7f670f7fe700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 0x7f66f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:44.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.783+0000 7f670f7fe700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 0x7f66f8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67000093f0 tx=0x7f6700017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:44.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.787+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f67180c7a70 con 0x7f671806afb0 2023-12-24T18:36:44.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.955+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f671815cc60 con 0x7f66f8060550 2023-12-24T18:36:44.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.967+0000 7f6714ff9700 1 -- 172.21.15.50:0/4091245574 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345086 (secure 0 0 0) 0x7f6700000c50 con 0x7f66f8060550 2023-12-24T18:36:44.976 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 msgr2=0x7f66f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 0x7f66f8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67000093f0 tx=0x7f6700017000 comp rx=0 tx=0).stop 2023-12-24T18:36:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 msgr2=0x7f671816e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f670800c170 tx=0x7f670800b040 comp rx=0 tx=0).stop 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 shutdown_connections 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f66f8060550 0x7f66f8062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6718158cd0 0x7f671815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671806c0c0 0x7f671815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 --2- 172.21.15.50:0/4091245574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f671806afb0 0x7f671816e400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 >> 172.21.15.50:0/4091245574 conn(0x7f6718067b80 msgr2=0x7f6718157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 shutdown_connections 2023-12-24T18:36:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:44.975+0000 7f671d2e3700 1 -- 172.21.15.50:0/4091245574 wait complete. 2023-12-24T18:36:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:36:45.002 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-12-24T18:36:44.741689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594851,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389800,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752584920,"statfs":{"total":773094113280,"available":770646958080,"internally_reserved":0,"allocated":3383296,"data_stored":2041889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.545455"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241897+0000","last_change":"2023-12-24T18:36:27.067874+0000","last_active":"2023-12-24T18:36:33.241897+0000","last_peered":"2023-12-24T18:36:33.241897+0000","last_clean":"2023-12-24T18:36:33.241897+0000","last_became_active":"2023-12-24T18:36:27.067357+0000","last_became_peered":"2023-12-24T18:36:27.067357+0000","last_unstale":"2023-12-24T18:36:33.241897+0000","last_undegraded":"2023-12-24T18:36:33.241897+0000","last_fullsized":"2023-12-24T18:36:33.241897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:32.763268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242535+0000","last_change":"2023-12-24T18:36:28.119303+0000","last_active":"2023-12-24T18:36:33.242535+0000","last_peered":"2023-12-24T18:36:33.242535+0000","last_clean":"2023-12-24T18:36:33.242535+0000","last_became_active":"2023-12-24T18:36:28.118209+0000","last_became_peered":"2023-12-24T18:36:28.118209+0000","last_unstale":"2023-12-24T18:36:33.242535+0000","last_undegraded":"2023-12-24T18:36:33.242535+0000","last_fullsized":"2023-12-24T18:36:33.242535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239078+0000","last_change":"2023-12-24T18:36:33.070625+0000","last_active":"2023-12-24T18:36:33.239078+0000","last_peered":"2023-12-24T18:36:33.239078+0000","last_clean":"2023-12-24T18:36:33.239078+0000","last_became_active":"2023-12-24T18:36:33.070191+0000","last_became_peered":"2023-12-24T18:36:33.070191+0000","last_unstale":"2023-12-24T18:36:33.239078+0000","last_undegraded":"2023-12-24T18:36:33.239078+0000","last_fullsized":"2023-12-24T18:36:33.239078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:48.436853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242441+0000","last_change":"2023-12-24T18:36:27.060014+0000","last_active":"2023-12-24T18:36:33.242441+0000","last_peered":"2023-12-24T18:36:33.242441+0000","last_clean":"2023-12-24T18:36:33.242441+0000","last_became_active":"2023-12-24T18:36:27.059722+0000","last_became_peered":"2023-12-24T18:36:27.059722+0000","last_unstale":"2023-12-24T18:36:33.242441+0000","last_undegraded":"2023-12-24T18:36:33.242441+0000","last_fullsized":"2023-12-24T18:36:33.242441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241708+0000","last_change":"2023-12-24T18:36:28.131047+0000","last_active":"2023-12-24T18:36:33.241708+0000","last_peered":"2023-12-24T18:36:33.241708+0000","last_clean":"2023-12-24T18:36:33.241708+0000","last_became_active":"2023-12-24T18:36:28.130191+0000","last_became_peered":"2023-12-24T18:36:28.130191+0000","last_unstale":"2023-12-24T18:36:33.241708+0000","last_undegraded":"2023-12-24T18:36:33.241708+0000","last_fullsized":"2023-12-24T18:36:33.241708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199190+0000","last_change":"2023-12-24T18:36:32.246048+0000","last_active":"2023-12-24T18:36:33.199190+0000","last_peered":"2023-12-24T18:36:33.199190+0000","last_clean":"2023-12-24T18:36:33.199190+0000","last_became_active":"2023-12-24T18:36:32.245486+0000","last_became_peered":"2023-12-24T18:36:32.245486+0000","last_unstale":"2023-12-24T18:36:33.199190+0000","last_undegraded":"2023-12-24T18:36:33.199190+0000","last_fullsized":"2023-12-24T18:36:33.199190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.571591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243552+0000","last_change":"2023-12-24T18:36:27.066546+0000","last_active":"2023-12-24T18:36:33.243552+0000","last_peered":"2023-12-24T18:36:33.243552+0000","last_clean":"2023-12-24T18:36:33.243552+0000","last_became_active":"2023-12-24T18:36:27.066019+0000","last_became_peered":"2023-12-24T18:36:27.066019+0000","last_unstale":"2023-12-24T18:36:33.243552+0000","last_undegraded":"2023-12-24T18:36:33.243552+0000","last_fullsized":"2023-12-24T18:36:33.243552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242331+0000","last_change":"2023-12-24T18:36:28.123809+0000","last_active":"2023-12-24T18:36:33.242331+0000","last_peered":"2023-12-24T18:36:33.242331+0000","last_clean":"2023-12-24T18:36:33.242331+0000","last_became_active":"2023-12-24T18:36:28.123245+0000","last_became_peered":"2023-12-24T18:36:28.123245+0000","last_unstale":"2023-12-24T18:36:33.242331+0000","last_undegraded":"2023-12-24T18:36:33.242331+0000","last_fullsized":"2023-12-24T18:36:33.242331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199447+0000","last_change":"2023-12-24T18:36:32.252818+0000","last_active":"2023-12-24T18:36:33.199447+0000","last_peered":"2023-12-24T18:36:33.199447+0000","last_clean":"2023-12-24T18:36:33.199447+0000","last_became_active":"2023-12-24T18:36:32.252148+0000","last_became_peered":"2023-12-24T18:36:32.252148+0000","last_unstale":"2023-12-24T18:36:33.199447+0000","last_undegraded":"2023-12-24T18:36:33.199447+0000","last_fullsized":"2023-12-24T18:36:33.199447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243368+0000","last_change":"2023-12-24T18:36:27.066329+0000","last_active":"2023-12-24T18:36:33.243368+0000","last_peered":"2023-12-24T18:36:33.243368+0000","last_clean":"2023-12-24T18:36:33.243368+0000","last_became_active":"2023-12-24T18:36:27.065986+0000","last_became_peered":"2023-12-24T18:36:27.065986+0000","last_unstale":"2023-12-24T18:36:33.243368+0000","last_undegraded":"2023-12-24T18:36:33.243368+0000","last_fullsized":"2023-12-24T18:36:33.243368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:52.372517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242678+0000","last_change":"2023-12-24T18:36:28.140301+0000","last_active":"2023-12-24T18:36:33.242678+0000","last_peered":"2023-12-24T18:36:33.242678+0000","last_clean":"2023-12-24T18:36:33.242678+0000","last_became_active":"2023-12-24T18:36:28.139952+0000","last_became_peered":"2023-12-24T18:36:28.139952+0000","last_unstale":"2023-12-24T18:36:33.242678+0000","last_undegraded":"2023-12-24T18:36:33.242678+0000","last_fullsized":"2023-12-24T18:36:33.242678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199244+0000","last_change":"2023-12-24T18:36:32.251947+0000","last_active":"2023-12-24T18:36:33.199244+0000","last_peered":"2023-12-24T18:36:33.199244+0000","last_clean":"2023-12-24T18:36:33.199244+0000","last_became_active":"2023-12-24T18:36:32.251493+0000","last_became_peered":"2023-12-24T18:36:32.251493+0000","last_unstale":"2023-12-24T18:36:33.199244+0000","last_undegraded":"2023-12-24T18:36:33.199244+0000","last_fullsized":"2023-12-24T18:36:33.199244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.373046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200254+0000","last_change":"2023-12-24T18:36:28.112650+0000","last_active":"2023-12-24T18:36:33.200254+0000","last_peered":"2023-12-24T18:36:33.200254+0000","last_clean":"2023-12-24T18:36:33.200254+0000","last_became_active":"2023-12-24T18:36:28.112348+0000","last_became_peered":"2023-12-24T18:36:28.112348+0000","last_unstale":"2023-12-24T18:36:33.200254+0000","last_undegraded":"2023-12-24T18:36:33.200254+0000","last_fullsized":"2023-12-24T18:36:33.200254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243195+0000","last_change":"2023-12-24T18:36:27.064104+0000","last_active":"2023-12-24T18:36:33.243195+0000","last_peered":"2023-12-24T18:36:33.243195+0000","last_clean":"2023-12-24T18:36:33.243195+0000","last_became_active":"2023-12-24T18:36:27.063768+0000","last_became_peered":"2023-12-24T18:36:27.063768+0000","last_unstale":"2023-12-24T18:36:33.243195+0000","last_undegraded":"2023-12-24T18:36:33.243195+0000","last_fullsized":"2023-12-24T18:36:33.243195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200486+0000","last_change":"2023-12-24T18:36:32.260683+0000","last_active":"2023-12-24T18:36:33.200486+0000","last_peered":"2023-12-24T18:36:33.200486+0000","last_clean":"2023-12-24T18:36:33.200486+0000","last_became_active":"2023-12-24T18:36:32.259717+0000","last_became_peered":"2023-12-24T18:36:32.259717+0000","last_unstale":"2023-12-24T18:36:33.200486+0000","last_undegraded":"2023-12-24T18:36:33.200486+0000","last_fullsized":"2023-12-24T18:36:33.200486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239484+0000","last_change":"2023-12-24T18:36:28.130197+0000","last_active":"2023-12-24T18:36:33.239484+0000","last_peered":"2023-12-24T18:36:33.239484+0000","last_clean":"2023-12-24T18:36:33.239484+0000","last_became_active":"2023-12-24T18:36:28.129812+0000","last_became_peered":"2023-12-24T18:36:28.129812+0000","last_unstale":"2023-12-24T18:36:33.239484+0000","last_undegraded":"2023-12-24T18:36:33.239484+0000","last_fullsized":"2023-12-24T18:36:33.239484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243815+0000","last_change":"2023-12-24T18:36:27.063829+0000","last_active":"2023-12-24T18:36:33.243815+0000","last_peered":"2023-12-24T18:36:33.243815+0000","last_clean":"2023-12-24T18:36:33.243815+0000","last_became_active":"2023-12-24T18:36:27.062587+0000","last_became_peered":"2023-12-24T18:36:27.062587+0000","last_unstale":"2023-12-24T18:36:33.243815+0000","last_undegraded":"2023-12-24T18:36:33.243815+0000","last_fullsized":"2023-12-24T18:36:33.243815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200123+0000","last_change":"2023-12-24T18:36:32.251112+0000","last_active":"2023-12-24T18:36:33.200123+0000","last_peered":"2023-12-24T18:36:33.200123+0000","last_clean":"2023-12-24T18:36:33.200123+0000","last_became_active":"2023-12-24T18:36:32.250532+0000","last_became_peered":"2023-12-24T18:36:32.250532+0000","last_unstale":"2023-12-24T18:36:33.200123+0000","last_undegraded":"2023-12-24T18:36:33.200123+0000","last_fullsized":"2023-12-24T18:36:33.200123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:03.439593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239627+0000","last_change":"2023-12-24T18:36:28.127286+0000","last_active":"2023-12-24T18:36:33.239627+0000","last_peered":"2023-12-24T18:36:33.239627+0000","last_clean":"2023-12-24T18:36:33.239627+0000","last_became_active":"2023-12-24T18:36:28.124689+0000","last_became_peered":"2023-12-24T18:36:28.124689+0000","last_unstale":"2023-12-24T18:36:33.239627+0000","last_undegraded":"2023-12-24T18:36:33.239627+0000","last_fullsized":"2023-12-24T18:36:33.239627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243454+0000","last_change":"2023-12-24T18:36:27.064165+0000","last_active":"2023-12-24T18:36:33.243454+0000","last_peered":"2023-12-24T18:36:33.243454+0000","last_clean":"2023-12-24T18:36:33.243454+0000","last_became_active":"2023-12-24T18:36:27.063434+0000","last_became_peered":"2023-12-24T18:36:27.063434+0000","last_unstale":"2023-12-24T18:36:33.243454+0000","last_undegraded":"2023-12-24T18:36:33.243454+0000","last_fullsized":"2023-12-24T18:36:33.243454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:33.062973+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:33.061726+0000","last_became_peered":"2023-12-24T18:36:33.061726+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199485+0000","last_change":"2023-12-24T18:36:28.105114+0000","last_active":"2023-12-24T18:36:33.199485+0000","last_peered":"2023-12-24T18:36:33.199485+0000","last_clean":"2023-12-24T18:36:33.199485+0000","last_became_active":"2023-12-24T18:36:28.104834+0000","last_became_peered":"2023-12-24T18:36:28.104834+0000","last_unstale":"2023-12-24T18:36:33.199485+0000","last_undegraded":"2023-12-24T18:36:33.199485+0000","last_fullsized":"2023-12-24T18:36:33.199485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:26.768161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242012+0000","last_change":"2023-12-24T18:36:27.060303+0000","last_active":"2023-12-24T18:36:33.242012+0000","last_peered":"2023-12-24T18:36:33.242012+0000","last_clean":"2023-12-24T18:36:33.242012+0000","last_became_active":"2023-12-24T18:36:27.059902+0000","last_became_peered":"2023-12-24T18:36:27.059902+0000","last_unstale":"2023-12-24T18:36:33.242012+0000","last_undegraded":"2023-12-24T18:36:33.242012+0000","last_fullsized":"2023-12-24T18:36:33.242012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200312+0000","last_change":"2023-12-24T18:36:32.253987+0000","last_active":"2023-12-24T18:36:33.200312+0000","last_peered":"2023-12-24T18:36:33.200312+0000","last_clean":"2023-12-24T18:36:33.200312+0000","last_became_active":"2023-12-24T18:36:32.253471+0000","last_became_peered":"2023-12-24T18:36:32.253471+0000","last_unstale":"2023-12-24T18:36:33.200312+0000","last_undegraded":"2023-12-24T18:36:33.200312+0000","last_fullsized":"2023-12-24T18:36:33.200312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:35:45.397934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241468+0000","last_change":"2023-12-24T18:36:28.126747+0000","last_active":"2023-12-24T18:36:33.241468+0000","last_peered":"2023-12-24T18:36:33.241468+0000","last_clean":"2023-12-24T18:36:33.241468+0000","last_became_active":"2023-12-24T18:36:28.126438+0000","last_became_peered":"2023-12-24T18:36:28.126438+0000","last_unstale":"2023-12-24T18:36:33.241468+0000","last_undegraded":"2023-12-24T18:36:33.241468+0000","last_fullsized":"2023-12-24T18:36:33.241468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201595+0000","last_change":"2023-12-24T18:36:27.057217+0000","last_active":"2023-12-24T18:36:33.201595+0000","last_peered":"2023-12-24T18:36:33.201595+0000","last_clean":"2023-12-24T18:36:33.201595+0000","last_became_active":"2023-12-24T18:36:27.056927+0000","last_became_peered":"2023-12-24T18:36:27.056927+0000","last_unstale":"2023-12-24T18:36:33.201595+0000","last_undegraded":"2023-12-24T18:36:33.201595+0000","last_fullsized":"2023-12-24T18:36:33.201595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.198620+0000","last_change":"2023-12-24T18:36:33.060205+0000","last_active":"2023-12-24T18:36:33.198620+0000","last_peered":"2023-12-24T18:36:33.198620+0000","last_clean":"2023-12-24T18:36:33.198620+0000","last_became_active":"2023-12-24T18:36:33.059701+0000","last_became_peered":"2023-12-24T18:36:33.059701+0000","last_unstale":"2023-12-24T18:36:33.198620+0000","last_undegraded":"2023-12-24T18:36:33.198620+0000","last_fullsized":"2023-12-24T18:36:33.198620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.334113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242412+0000","last_change":"2023-12-24T18:36:28.129033+0000","last_active":"2023-12-24T18:36:33.242412+0000","last_peered":"2023-12-24T18:36:33.242412+0000","last_clean":"2023-12-24T18:36:33.242412+0000","last_became_active":"2023-12-24T18:36:28.128733+0000","last_became_peered":"2023-12-24T18:36:28.128733+0000","last_unstale":"2023-12-24T18:36:33.242412+0000","last_undegraded":"2023-12-24T18:36:33.242412+0000","last_fullsized":"2023-12-24T18:36:33.242412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244611+0000","last_change":"2023-12-24T18:36:27.057152+0000","last_active":"2023-12-24T18:36:33.244611+0000","last_peered":"2023-12-24T18:36:33.244611+0000","last_clean":"2023-12-24T18:36:33.244611+0000","last_became_active":"2023-12-24T18:36:27.056715+0000","last_became_peered":"2023-12-24T18:36:27.056715+0000","last_unstale":"2023-12-24T18:36:33.244611+0000","last_undegraded":"2023-12-24T18:36:33.244611+0000","last_fullsized":"2023-12-24T18:36:33.244611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238838+0000","last_change":"2023-12-24T18:36:33.067986+0000","last_active":"2023-12-24T18:36:33.238838+0000","last_peered":"2023-12-24T18:36:33.238838+0000","last_clean":"2023-12-24T18:36:33.238838+0000","last_became_active":"2023-12-24T18:36:33.066990+0000","last_became_peered":"2023-12-24T18:36:33.066990+0000","last_unstale":"2023-12-24T18:36:33.238838+0000","last_undegraded":"2023-12-24T18:36:33.238838+0000","last_fullsized":"2023-12-24T18:36:33.238838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:35:52.743174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244319+0000","last_change":"2023-12-24T18:36:28.119947+0000","last_active":"2023-12-24T18:36:33.244319+0000","last_peered":"2023-12-24T18:36:33.244319+0000","last_clean":"2023-12-24T18:36:33.244319+0000","last_became_active":"2023-12-24T18:36:28.119615+0000","last_became_peered":"2023-12-24T18:36:28.119615+0000","last_unstale":"2023-12-24T18:36:33.244319+0000","last_undegraded":"2023-12-24T18:36:33.244319+0000","last_fullsized":"2023-12-24T18:36:33.244319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243706+0000","last_change":"2023-12-24T18:36:27.062308+0000","last_active":"2023-12-24T18:36:33.243706+0000","last_peered":"2023-12-24T18:36:33.243706+0000","last_clean":"2023-12-24T18:36:33.243706+0000","last_became_active":"2023-12-24T18:36:27.061932+0000","last_became_peered":"2023-12-24T18:36:27.061932+0000","last_unstale":"2023-12-24T18:36:33.243706+0000","last_undegraded":"2023-12-24T18:36:33.243706+0000","last_fullsized":"2023-12-24T18:36:33.243706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240201+0000","last_change":"2023-12-24T18:36:33.063574+0000","last_active":"2023-12-24T18:36:33.240201+0000","last_peered":"2023-12-24T18:36:33.240201+0000","last_clean":"2023-12-24T18:36:33.240201+0000","last_became_active":"2023-12-24T18:36:33.062383+0000","last_became_peered":"2023-12-24T18:36:33.062383+0000","last_unstale":"2023-12-24T18:36:33.240201+0000","last_undegraded":"2023-12-24T18:36:33.240201+0000","last_fullsized":"2023-12-24T18:36:33.240201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242767+0000","last_change":"2023-12-24T18:36:28.123563+0000","last_active":"2023-12-24T18:36:33.242767+0000","last_peered":"2023-12-24T18:36:33.242767+0000","last_clean":"2023-12-24T18:36:33.242767+0000","last_became_active":"2023-12-24T18:36:28.123262+0000","last_became_peered":"2023-12-24T18:36:28.123262+0000","last_unstale":"2023-12-24T18:36:33.242767+0000","last_undegraded":"2023-12-24T18:36:33.242767+0000","last_fullsized":"2023-12-24T18:36:33.242767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244465+0000","last_change":"2023-12-24T18:36:27.059665+0000","last_active":"2023-12-24T18:36:33.244465+0000","last_peered":"2023-12-24T18:36:33.244465+0000","last_clean":"2023-12-24T18:36:33.244465+0000","last_became_active":"2023-12-24T18:36:27.059247+0000","last_became_peered":"2023-12-24T18:36:27.059247+0000","last_unstale":"2023-12-24T18:36:33.244465+0000","last_undegraded":"2023-12-24T18:36:33.244465+0000","last_fullsized":"2023-12-24T18:36:33.244465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243546+0000","last_change":"2023-12-24T18:36:32.265642+0000","last_active":"2023-12-24T18:36:33.243546+0000","last_peered":"2023-12-24T18:36:33.243546+0000","last_clean":"2023-12-24T18:36:33.243546+0000","last_became_active":"2023-12-24T18:36:32.263802+0000","last_became_peered":"2023-12-24T18:36:32.263802+0000","last_unstale":"2023-12-24T18:36:33.243546+0000","last_undegraded":"2023-12-24T18:36:33.243546+0000","last_fullsized":"2023-12-24T18:36:33.243546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199889+0000","last_change":"2023-12-24T18:36:28.132237+0000","last_active":"2023-12-24T18:36:33.199889+0000","last_peered":"2023-12-24T18:36:33.199889+0000","last_clean":"2023-12-24T18:36:33.199889+0000","last_became_active":"2023-12-24T18:36:28.131848+0000","last_became_peered":"2023-12-24T18:36:28.131848+0000","last_unstale":"2023-12-24T18:36:33.199889+0000","last_undegraded":"2023-12-24T18:36:33.199889+0000","last_fullsized":"2023-12-24T18:36:33.199889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:13.673004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:27.062395+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:27.058997+0000","last_became_peered":"2023-12-24T18:36:27.058997+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244195+0000","last_change":"2023-12-24T18:36:32.250289+0000","last_active":"2023-12-24T18:36:33.244195+0000","last_peered":"2023-12-24T18:36:33.244195+0000","last_clean":"2023-12-24T18:36:33.244195+0000","last_became_active":"2023-12-24T18:36:32.248948+0000","last_became_peered":"2023-12-24T18:36:32.248948+0000","last_unstale":"2023-12-24T18:36:33.244195+0000","last_undegraded":"2023-12-24T18:36:33.244195+0000","last_fullsized":"2023-12-24T18:36:33.244195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243453+0000","last_change":"2023-12-24T18:36:28.119555+0000","last_active":"2023-12-24T18:36:33.243453+0000","last_peered":"2023-12-24T18:36:33.243453+0000","last_clean":"2023-12-24T18:36:33.243453+0000","last_became_active":"2023-12-24T18:36:28.119221+0000","last_became_peered":"2023-12-24T18:36:28.119221+0000","last_unstale":"2023-12-24T18:36:33.243453+0000","last_undegraded":"2023-12-24T18:36:33.243453+0000","last_fullsized":"2023-12-24T18:36:33.243453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196052+0000","last_change":"2023-12-24T18:36:27.069466+0000","last_active":"2023-12-24T18:36:33.196052+0000","last_peered":"2023-12-24T18:36:33.196052+0000","last_clean":"2023-12-24T18:36:33.196052+0000","last_became_active":"2023-12-24T18:36:27.069134+0000","last_became_peered":"2023-12-24T18:36:27.069134+0000","last_unstale":"2023-12-24T18:36:33.196052+0000","last_undegraded":"2023-12-24T18:36:33.196052+0000","last_fullsized":"2023-12-24T18:36:33.196052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244716+0000","last_change":"2023-12-24T18:36:32.261732+0000","last_active":"2023-12-24T18:36:33.244716+0000","last_peered":"2023-12-24T18:36:33.244716+0000","last_clean":"2023-12-24T18:36:33.244716+0000","last_became_active":"2023-12-24T18:36:32.261227+0000","last_became_peered":"2023-12-24T18:36:32.261227+0000","last_unstale":"2023-12-24T18:36:33.244716+0000","last_undegraded":"2023-12-24T18:36:33.244716+0000","last_fullsized":"2023-12-24T18:36:33.244716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240648+0000","last_change":"2023-12-24T18:36:28.132818+0000","last_active":"2023-12-24T18:36:33.240648+0000","last_peered":"2023-12-24T18:36:33.240648+0000","last_clean":"2023-12-24T18:36:33.240648+0000","last_became_active":"2023-12-24T18:36:28.132494+0000","last_became_peered":"2023-12-24T18:36:28.132494+0000","last_unstale":"2023-12-24T18:36:33.240648+0000","last_undegraded":"2023-12-24T18:36:33.240648+0000","last_fullsized":"2023-12-24T18:36:33.240648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242017+0000","last_change":"2023-12-24T18:36:27.064640+0000","last_active":"2023-12-24T18:36:33.242017+0000","last_peered":"2023-12-24T18:36:33.242017+0000","last_clean":"2023-12-24T18:36:33.242017+0000","last_became_active":"2023-12-24T18:36:27.064337+0000","last_became_peered":"2023-12-24T18:36:27.064337+0000","last_unstale":"2023-12-24T18:36:33.242017+0000","last_undegraded":"2023-12-24T18:36:33.242017+0000","last_fullsized":"2023-12-24T18:36:33.242017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240189+0000","last_change":"2023-12-24T18:36:33.065960+0000","last_active":"2023-12-24T18:36:33.240189+0000","last_peered":"2023-12-24T18:36:33.240189+0000","last_clean":"2023-12-24T18:36:33.240189+0000","last_became_active":"2023-12-24T18:36:33.064424+0000","last_became_peered":"2023-12-24T18:36:33.064424+0000","last_unstale":"2023-12-24T18:36:33.240189+0000","last_undegraded":"2023-12-24T18:36:33.240189+0000","last_fullsized":"2023-12-24T18:36:33.240189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239524+0000","last_change":"2023-12-24T18:36:28.125586+0000","last_active":"2023-12-24T18:36:33.239524+0000","last_peered":"2023-12-24T18:36:33.239524+0000","last_clean":"2023-12-24T18:36:33.239524+0000","last_became_active":"2023-12-24T18:36:28.125304+0000","last_became_peered":"2023-12-24T18:36:28.125304+0000","last_unstale":"2023-12-24T18:36:33.239524+0000","last_undegraded":"2023-12-24T18:36:33.239524+0000","last_fullsized":"2023-12-24T18:36:33.239524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242083+0000","last_change":"2023-12-24T18:36:27.059141+0000","last_active":"2023-12-24T18:36:33.242083+0000","last_peered":"2023-12-24T18:36:33.242083+0000","last_clean":"2023-12-24T18:36:33.242083+0000","last_became_active":"2023-12-24T18:36:27.058810+0000","last_became_peered":"2023-12-24T18:36:27.058810+0000","last_unstale":"2023-12-24T18:36:33.242083+0000","last_undegraded":"2023-12-24T18:36:33.242083+0000","last_fullsized":"2023-12-24T18:36:33.242083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242137+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:36:33.242137+0000","last_peered":"2023-12-24T18:36:33.242137+0000","last_clean":"2023-12-24T18:36:33.242137+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:36:33.242137+0000","last_undegraded":"2023-12-24T18:36:33.242137+0000","last_fullsized":"2023-12-24T18:36:33.242137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200983+0000","last_change":"2023-12-24T18:36:33.064479+0000","last_active":"2023-12-24T18:36:33.200983+0000","last_peered":"2023-12-24T18:36:33.200983+0000","last_clean":"2023-12-24T18:36:33.200983+0000","last_became_active":"2023-12-24T18:36:33.063934+0000","last_became_peered":"2023-12-24T18:36:33.063934+0000","last_unstale":"2023-12-24T18:36:33.200983+0000","last_undegraded":"2023-12-24T18:36:33.200983+0000","last_fullsized":"2023-12-24T18:36:33.200983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:51.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243499+0000","last_change":"2023-12-24T18:36:28.134054+0000","last_active":"2023-12-24T18:36:33.243499+0000","last_peered":"2023-12-24T18:36:33.243499+0000","last_clean":"2023-12-24T18:36:33.243499+0000","last_became_active":"2023-12-24T18:36:28.133272+0000","last_became_peered":"2023-12-24T18:36:28.133272+0000","last_unstale":"2023-12-24T18:36:33.243499+0000","last_undegraded":"2023-12-24T18:36:33.243499+0000","last_fullsized":"2023-12-24T18:36:33.243499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196949+0000","last_change":"2023-12-24T18:36:27.065885+0000","last_active":"2023-12-24T18:36:33.196949+0000","last_peered":"2023-12-24T18:36:33.196949+0000","last_clean":"2023-12-24T18:36:33.196949+0000","last_became_active":"2023-12-24T18:36:27.065497+0000","last_became_peered":"2023-12-24T18:36:27.065497+0000","last_unstale":"2023-12-24T18:36:33.196949+0000","last_undegraded":"2023-12-24T18:36:33.196949+0000","last_fullsized":"2023-12-24T18:36:33.196949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200105+0000","last_change":"2023-12-24T18:36:33.060407+0000","last_active":"2023-12-24T18:36:33.200105+0000","last_peered":"2023-12-24T18:36:33.200105+0000","last_clean":"2023-12-24T18:36:33.200105+0000","last_became_active":"2023-12-24T18:36:33.059656+0000","last_became_peered":"2023-12-24T18:36:33.059656+0000","last_unstale":"2023-12-24T18:36:33.200105+0000","last_undegraded":"2023-12-24T18:36:33.200105+0000","last_fullsized":"2023-12-24T18:36:33.200105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:16.143703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242382+0000","last_change":"2023-12-24T18:36:28.123920+0000","last_active":"2023-12-24T18:36:33.242382+0000","last_peered":"2023-12-24T18:36:33.242382+0000","last_clean":"2023-12-24T18:36:33.242382+0000","last_became_active":"2023-12-24T18:36:28.123641+0000","last_became_peered":"2023-12-24T18:36:28.123641+0000","last_unstale":"2023-12-24T18:36:33.242382+0000","last_undegraded":"2023-12-24T18:36:33.242382+0000","last_fullsized":"2023-12-24T18:36:33.242382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244368+0000","last_change":"2023-12-24T18:36:27.063621+0000","last_active":"2023-12-24T18:36:33.244368+0000","last_peered":"2023-12-24T18:36:33.244368+0000","last_clean":"2023-12-24T18:36:33.244368+0000","last_became_active":"2023-12-24T18:36:27.063049+0000","last_became_peered":"2023-12-24T18:36:27.063049+0000","last_unstale":"2023-12-24T18:36:33.244368+0000","last_undegraded":"2023-12-24T18:36:33.244368+0000","last_fullsized":"2023-12-24T18:36:33.244368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241302+0000","last_change":"2023-12-24T18:36:32.259376+0000","last_active":"2023-12-24T18:36:33.241302+0000","last_peered":"2023-12-24T18:36:33.241302+0000","last_clean":"2023-12-24T18:36:33.241302+0000","last_became_active":"2023-12-24T18:36:32.258898+0000","last_became_peered":"2023-12-24T18:36:32.258898+0000","last_unstale":"2023-12-24T18:36:33.241302+0000","last_undegraded":"2023-12-24T18:36:33.241302+0000","last_fullsized":"2023-12-24T18:36:33.241302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244486+0000","last_change":"2023-12-24T18:36:28.141826+0000","last_active":"2023-12-24T18:36:33.244486+0000","last_peered":"2023-12-24T18:36:33.244486+0000","last_clean":"2023-12-24T18:36:33.244486+0000","last_became_active":"2023-12-24T18:36:28.141592+0000","last_became_peered":"2023-12-24T18:36:28.141592+0000","last_unstale":"2023-12-24T18:36:33.244486+0000","last_undegraded":"2023-12-24T18:36:33.244486+0000","last_fullsized":"2023-12-24T18:36:33.244486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196802+0000","last_change":"2023-12-24T18:36:27.056563+0000","last_active":"2023-12-24T18:36:33.196802+0000","last_peered":"2023-12-24T18:36:33.196802+0000","last_clean":"2023-12-24T18:36:33.196802+0000","last_became_active":"2023-12-24T18:36:27.056162+0000","last_became_peered":"2023-12-24T18:36:27.056162+0000","last_unstale":"2023-12-24T18:36:33.196802+0000","last_undegraded":"2023-12-24T18:36:33.196802+0000","last_fullsized":"2023-12-24T18:36:33.196802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241573+0000","last_change":"2023-12-24T18:36:33.061190+0000","last_active":"2023-12-24T18:36:33.241573+0000","last_peered":"2023-12-24T18:36:33.241573+0000","last_clean":"2023-12-24T18:36:33.241573+0000","last_became_active":"2023-12-24T18:36:33.060776+0000","last_became_peered":"2023-12-24T18:36:33.060776+0000","last_unstale":"2023-12-24T18:36:33.241573+0000","last_undegraded":"2023-12-24T18:36:33.241573+0000","last_fullsized":"2023-12-24T18:36:33.241573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244050+0000","last_change":"2023-12-24T18:36:28.140877+0000","last_active":"2023-12-24T18:36:33.244050+0000","last_peered":"2023-12-24T18:36:33.244050+0000","last_clean":"2023-12-24T18:36:33.244050+0000","last_became_active":"2023-12-24T18:36:28.140557+0000","last_became_peered":"2023-12-24T18:36:28.140557+0000","last_unstale":"2023-12-24T18:36:33.244050+0000","last_undegraded":"2023-12-24T18:36:33.244050+0000","last_fullsized":"2023-12-24T18:36:33.244050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200942+0000","last_change":"2023-12-24T18:36:27.055292+0000","last_active":"2023-12-24T18:36:33.200942+0000","last_peered":"2023-12-24T18:36:33.200942+0000","last_clean":"2023-12-24T18:36:33.200942+0000","last_became_active":"2023-12-24T18:36:27.054059+0000","last_became_peered":"2023-12-24T18:36:27.054059+0000","last_unstale":"2023-12-24T18:36:33.200942+0000","last_undegraded":"2023-12-24T18:36:33.200942+0000","last_fullsized":"2023-12-24T18:36:33.200942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199154+0000","last_change":"2023-12-24T18:36:32.242682+0000","last_active":"2023-12-24T18:36:33.199154+0000","last_peered":"2023-12-24T18:36:33.199154+0000","last_clean":"2023-12-24T18:36:33.199154+0000","last_became_active":"2023-12-24T18:36:32.242104+0000","last_became_peered":"2023-12-24T18:36:32.242104+0000","last_unstale":"2023-12-24T18:36:33.199154+0000","last_undegraded":"2023-12-24T18:36:33.199154+0000","last_fullsized":"2023-12-24T18:36:33.199154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242508+0000","last_change":"2023-12-24T18:36:28.141979+0000","last_active":"2023-12-24T18:36:33.242508+0000","last_peered":"2023-12-24T18:36:33.242508+0000","last_clean":"2023-12-24T18:36:33.242508+0000","last_became_active":"2023-12-24T18:36:28.141662+0000","last_became_peered":"2023-12-24T18:36:28.141662+0000","last_unstale":"2023-12-24T18:36:33.242508+0000","last_undegraded":"2023-12-24T18:36:33.242508+0000","last_fullsized":"2023-12-24T18:36:33.242508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195913+0000","last_change":"2023-12-24T18:36:27.057902+0000","last_active":"2023-12-24T18:36:33.195913+0000","last_peered":"2023-12-24T18:36:33.195913+0000","last_clean":"2023-12-24T18:36:33.195913+0000","last_became_active":"2023-12-24T18:36:27.057601+0000","last_became_peered":"2023-12-24T18:36:27.057601+0000","last_unstale":"2023-12-24T18:36:33.195913+0000","last_undegraded":"2023-12-24T18:36:33.195913+0000","last_fullsized":"2023-12-24T18:36:33.195913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241297+0000","last_change":"2023-12-24T18:36:32.258321+0000","last_active":"2023-12-24T18:36:33.241297+0000","last_peered":"2023-12-24T18:36:33.241297+0000","last_clean":"2023-12-24T18:36:33.241297+0000","last_became_active":"2023-12-24T18:36:32.257975+0000","last_became_peered":"2023-12-24T18:36:32.257975+0000","last_unstale":"2023-12-24T18:36:33.241297+0000","last_undegraded":"2023-12-24T18:36:33.241297+0000","last_fullsized":"2023-12-24T18:36:33.241297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199956+0000","last_change":"2023-12-24T18:36:28.120873+0000","last_active":"2023-12-24T18:36:33.199956+0000","last_peered":"2023-12-24T18:36:33.199956+0000","last_clean":"2023-12-24T18:36:33.199956+0000","last_became_active":"2023-12-24T18:36:28.120575+0000","last_became_peered":"2023-12-24T18:36:28.120575+0000","last_unstale":"2023-12-24T18:36:33.199956+0000","last_undegraded":"2023-12-24T18:36:33.199956+0000","last_fullsized":"2023-12-24T18:36:33.199956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200186+0000","last_change":"2023-12-24T18:36:27.056392+0000","last_active":"2023-12-24T18:36:33.200186+0000","last_peered":"2023-12-24T18:36:33.200186+0000","last_clean":"2023-12-24T18:36:33.200186+0000","last_became_active":"2023-12-24T18:36:27.055923+0000","last_became_peered":"2023-12-24T18:36:27.055923+0000","last_unstale":"2023-12-24T18:36:33.200186+0000","last_undegraded":"2023-12-24T18:36:33.200186+0000","last_fullsized":"2023-12-24T18:36:33.200186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239172+0000","last_change":"2023-12-24T18:36:33.070180+0000","last_active":"2023-12-24T18:36:33.239172+0000","last_peered":"2023-12-24T18:36:33.239172+0000","last_clean":"2023-12-24T18:36:33.239172+0000","last_became_active":"2023-12-24T18:36:33.069205+0000","last_became_peered":"2023-12-24T18:36:33.069205+0000","last_unstale":"2023-12-24T18:36:33.239172+0000","last_undegraded":"2023-12-24T18:36:33.239172+0000","last_fullsized":"2023-12-24T18:36:33.239172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:32.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243039+0000","last_change":"2023-12-24T18:36:28.127186+0000","last_active":"2023-12-24T18:36:33.243039+0000","last_peered":"2023-12-24T18:36:33.243039+0000","last_clean":"2023-12-24T18:36:33.243039+0000","last_became_active":"2023-12-24T18:36:28.126357+0000","last_became_peered":"2023-12-24T18:36:28.126357+0000","last_unstale":"2023-12-24T18:36:33.243039+0000","last_undegraded":"2023-12-24T18:36:33.243039+0000","last_fullsized":"2023-12-24T18:36:33.243039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:43.975991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242848+0000","last_change":"2023-12-24T18:36:27.070926+0000","last_active":"2023-12-24T18:36:33.242848+0000","last_peered":"2023-12-24T18:36:33.242848+0000","last_clean":"2023-12-24T18:36:33.242848+0000","last_became_active":"2023-12-24T18:36:27.070569+0000","last_became_peered":"2023-12-24T18:36:27.070569+0000","last_unstale":"2023-12-24T18:36:33.242848+0000","last_undegraded":"2023-12-24T18:36:33.242848+0000","last_fullsized":"2023-12-24T18:36:33.242848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239108+0000","last_change":"2023-12-24T18:36:33.062857+0000","last_active":"2023-12-24T18:36:33.239108+0000","last_peered":"2023-12-24T18:36:33.239108+0000","last_clean":"2023-12-24T18:36:33.239108+0000","last_became_active":"2023-12-24T18:36:33.061451+0000","last_became_peered":"2023-12-24T18:36:33.061451+0000","last_unstale":"2023-12-24T18:36:33.239108+0000","last_undegraded":"2023-12-24T18:36:33.239108+0000","last_fullsized":"2023-12-24T18:36:33.239108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:00.421630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241031+0000","last_change":"2023-12-24T18:36:28.123632+0000","last_active":"2023-12-24T18:36:33.241031+0000","last_peered":"2023-12-24T18:36:33.241031+0000","last_clean":"2023-12-24T18:36:33.241031+0000","last_became_active":"2023-12-24T18:36:28.122094+0000","last_became_peered":"2023-12-24T18:36:28.122094+0000","last_unstale":"2023-12-24T18:36:33.241031+0000","last_undegraded":"2023-12-24T18:36:33.241031+0000","last_fullsized":"2023-12-24T18:36:33.241031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241638+0000","last_change":"2023-12-24T18:36:27.055652+0000","last_active":"2023-12-24T18:36:33.241638+0000","last_peered":"2023-12-24T18:36:33.241638+0000","last_clean":"2023-12-24T18:36:33.241638+0000","last_became_active":"2023-12-24T18:36:27.055325+0000","last_became_peered":"2023-12-24T18:36:27.055325+0000","last_unstale":"2023-12-24T18:36:33.241638+0000","last_undegraded":"2023-12-24T18:36:33.241638+0000","last_fullsized":"2023-12-24T18:36:33.241638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241611+0000","last_change":"2023-12-24T18:36:33.060160+0000","last_active":"2023-12-24T18:36:33.241611+0000","last_peered":"2023-12-24T18:36:33.241611+0000","last_clean":"2023-12-24T18:36:33.241611+0000","last_became_active":"2023-12-24T18:36:33.059695+0000","last_became_peered":"2023-12-24T18:36:33.059695+0000","last_unstale":"2023-12-24T18:36:33.241611+0000","last_undegraded":"2023-12-24T18:36:33.241611+0000","last_fullsized":"2023-12-24T18:36:33.241611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243445+0000","last_change":"2023-12-24T18:36:28.136247+0000","last_active":"2023-12-24T18:36:33.243445+0000","last_peered":"2023-12-24T18:36:33.243445+0000","last_clean":"2023-12-24T18:36:33.243445+0000","last_became_active":"2023-12-24T18:36:28.136021+0000","last_became_peered":"2023-12-24T18:36:28.136021+0000","last_unstale":"2023-12-24T18:36:33.243445+0000","last_undegraded":"2023-12-24T18:36:33.243445+0000","last_fullsized":"2023-12-24T18:36:33.243445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-24T18:36:39.871742+0000","last_change":"2023-12-24T18:36:27.050997+0000","last_active":"2023-12-24T18:36:39.871742+0000","last_peered":"2023-12-24T18:36:39.871742+0000","last_clean":"2023-12-24T18:36:39.871742+0000","last_became_active":"2023-12-24T18:36:27.050699+0000","last_became_peered":"2023-12-24T18:36:27.050699+0000","last_unstale":"2023-12-24T18:36:39.871742+0000","last_undegraded":"2023-12-24T18:36:39.871742+0000","last_fullsized":"2023-12-24T18:36:39.871742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243594+0000","last_change":"2023-12-24T18:36:32.265338+0000","last_active":"2023-12-24T18:36:33.243594+0000","last_peered":"2023-12-24T18:36:33.243594+0000","last_clean":"2023-12-24T18:36:33.243594+0000","last_became_active":"2023-12-24T18:36:32.262433+0000","last_became_peered":"2023-12-24T18:36:32.262433+0000","last_unstale":"2023-12-24T18:36:33.243594+0000","last_undegraded":"2023-12-24T18:36:33.243594+0000","last_fullsized":"2023-12-24T18:36:33.243594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200245+0000","last_change":"2023-12-24T18:36:28.130092+0000","last_active":"2023-12-24T18:36:33.200245+0000","last_peered":"2023-12-24T18:36:33.200245+0000","last_clean":"2023-12-24T18:36:33.200245+0000","last_became_active":"2023-12-24T18:36:28.129800+0000","last_became_peered":"2023-12-24T18:36:28.129800+0000","last_unstale":"2023-12-24T18:36:33.200245+0000","last_undegraded":"2023-12-24T18:36:33.200245+0000","last_fullsized":"2023-12-24T18:36:33.200245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:07.827336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244364+0000","last_change":"2023-12-24T18:36:27.064647+0000","last_active":"2023-12-24T18:36:33.244364+0000","last_peered":"2023-12-24T18:36:33.244364+0000","last_clean":"2023-12-24T18:36:33.244364+0000","last_became_active":"2023-12-24T18:36:27.064351+0000","last_became_peered":"2023-12-24T18:36:27.064351+0000","last_unstale":"2023-12-24T18:36:33.244364+0000","last_undegraded":"2023-12-24T18:36:33.244364+0000","last_fullsized":"2023-12-24T18:36:33.244364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199629+0000","last_change":"2023-12-24T18:36:32.249074+0000","last_active":"2023-12-24T18:36:33.199629+0000","last_peered":"2023-12-24T18:36:33.199629+0000","last_clean":"2023-12-24T18:36:33.199629+0000","last_became_active":"2023-12-24T18:36:32.248543+0000","last_became_peered":"2023-12-24T18:36:32.248543+0000","last_unstale":"2023-12-24T18:36:33.199629+0000","last_undegraded":"2023-12-24T18:36:33.199629+0000","last_fullsized":"2023-12-24T18:36:33.199629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241822+0000","last_change":"2023-12-24T18:36:28.131246+0000","last_active":"2023-12-24T18:36:33.241822+0000","last_peered":"2023-12-24T18:36:33.241822+0000","last_clean":"2023-12-24T18:36:33.241822+0000","last_became_active":"2023-12-24T18:36:28.130746+0000","last_became_peered":"2023-12-24T18:36:28.130746+0000","last_unstale":"2023-12-24T18:36:33.241822+0000","last_undegraded":"2023-12-24T18:36:33.241822+0000","last_fullsized":"2023-12-24T18:36:33.241822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242891+0000","last_change":"2023-12-24T18:36:27.068097+0000","last_active":"2023-12-24T18:36:33.242891+0000","last_peered":"2023-12-24T18:36:33.242891+0000","last_clean":"2023-12-24T18:36:33.242891+0000","last_became_active":"2023-12-24T18:36:27.067789+0000","last_became_peered":"2023-12-24T18:36:27.067789+0000","last_unstale":"2023-12-24T18:36:33.242891+0000","last_undegraded":"2023-12-24T18:36:33.242891+0000","last_fullsized":"2023-12-24T18:36:33.242891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239664+0000","last_change":"2023-12-24T18:36:32.244698+0000","last_active":"2023-12-24T18:36:33.239664+0000","last_peered":"2023-12-24T18:36:33.239664+0000","last_clean":"2023-12-24T18:36:33.239664+0000","last_became_active":"2023-12-24T18:36:32.241614+0000","last_became_peered":"2023-12-24T18:36:32.241614+0000","last_unstale":"2023-12-24T18:36:33.239664+0000","last_undegraded":"2023-12-24T18:36:33.239664+0000","last_fullsized":"2023-12-24T18:36:33.239664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:10.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242816+0000","last_change":"2023-12-24T18:36:28.121758+0000","last_active":"2023-12-24T18:36:33.242816+0000","last_peered":"2023-12-24T18:36:33.242816+0000","last_clean":"2023-12-24T18:36:33.242816+0000","last_became_active":"2023-12-24T18:36:28.121401+0000","last_became_peered":"2023-12-24T18:36:28.121401+0000","last_unstale":"2023-12-24T18:36:33.242816+0000","last_undegraded":"2023-12-24T18:36:33.242816+0000","last_fullsized":"2023-12-24T18:36:33.242816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201431+0000","last_change":"2023-12-24T18:36:27.060571+0000","last_active":"2023-12-24T18:36:33.201431+0000","last_peered":"2023-12-24T18:36:33.201431+0000","last_clean":"2023-12-24T18:36:33.201431+0000","last_became_active":"2023-12-24T18:36:27.060196+0000","last_became_peered":"2023-12-24T18:36:27.060196+0000","last_unstale":"2023-12-24T18:36:33.201431+0000","last_undegraded":"2023-12-24T18:36:33.201431+0000","last_fullsized":"2023-12-24T18:36:33.201431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238883+0000","last_change":"2023-12-24T18:36:33.074044+0000","last_active":"2023-12-24T18:36:33.238883+0000","last_peered":"2023-12-24T18:36:33.238883+0000","last_clean":"2023-12-24T18:36:33.238883+0000","last_became_active":"2023-12-24T18:36:33.072749+0000","last_became_peered":"2023-12-24T18:36:33.072749+0000","last_unstale":"2023-12-24T18:36:33.238883+0000","last_undegraded":"2023-12-24T18:36:33.238883+0000","last_fullsized":"2023-12-24T18:36:33.238883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240216+0000","last_change":"2023-12-24T18:36:33.069415+0000","last_active":"2023-12-24T18:36:33.240216+0000","last_peered":"2023-12-24T18:36:33.240216+0000","last_clean":"2023-12-24T18:36:33.240216+0000","last_became_active":"2023-12-24T18:36:33.068823+0000","last_became_peered":"2023-12-24T18:36:33.068823+0000","last_unstale":"2023-12-24T18:36:33.240216+0000","last_undegraded":"2023-12-24T18:36:33.240216+0000","last_fullsized":"2023-12-24T18:36:33.240216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243302+0000","last_change":"2023-12-24T18:36:28.131660+0000","last_active":"2023-12-24T18:36:33.243302+0000","last_peered":"2023-12-24T18:36:33.243302+0000","last_clean":"2023-12-24T18:36:33.243302+0000","last_became_active":"2023-12-24T18:36:28.128366+0000","last_became_peered":"2023-12-24T18:36:28.128366+0000","last_unstale":"2023-12-24T18:36:33.243302+0000","last_undegraded":"2023-12-24T18:36:33.243302+0000","last_fullsized":"2023-12-24T18:36:33.243302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241935+0000","last_change":"2023-12-24T18:36:27.068197+0000","last_active":"2023-12-24T18:36:33.241935+0000","last_peered":"2023-12-24T18:36:33.241935+0000","last_clean":"2023-12-24T18:36:33.241935+0000","last_became_active":"2023-12-24T18:36:27.067904+0000","last_became_peered":"2023-12-24T18:36:27.067904+0000","last_unstale":"2023-12-24T18:36:33.241935+0000","last_undegraded":"2023-12-24T18:36:33.241935+0000","last_fullsized":"2023-12-24T18:36:33.241935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201359+0000","last_change":"2023-12-24T18:36:32.260906+0000","last_active":"2023-12-24T18:36:33.201359+0000","last_peered":"2023-12-24T18:36:33.201359+0000","last_clean":"2023-12-24T18:36:33.201359+0000","last_became_active":"2023-12-24T18:36:32.260087+0000","last_became_peered":"2023-12-24T18:36:32.260087+0000","last_unstale":"2023-12-24T18:36:33.201359+0000","last_undegraded":"2023-12-24T18:36:33.201359+0000","last_fullsized":"2023-12-24T18:36:33.201359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:55.104503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239457+0000","last_change":"2023-12-24T18:36:28.124021+0000","last_active":"2023-12-24T18:36:33.239457+0000","last_peered":"2023-12-24T18:36:33.239457+0000","last_clean":"2023-12-24T18:36:33.239457+0000","last_became_active":"2023-12-24T18:36:28.121017+0000","last_became_peered":"2023-12-24T18:36:28.121017+0000","last_unstale":"2023-12-24T18:36:33.239457+0000","last_undegraded":"2023-12-24T18:36:33.239457+0000","last_fullsized":"2023-12-24T18:36:33.239457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239994+0000","last_change":"2023-12-24T18:36:27.068350+0000","last_active":"2023-12-24T18:36:33.239994+0000","last_peered":"2023-12-24T18:36:33.239994+0000","last_clean":"2023-12-24T18:36:33.239994+0000","last_became_active":"2023-12-24T18:36:27.053418+0000","last_became_peered":"2023-12-24T18:36:27.053418+0000","last_unstale":"2023-12-24T18:36:33.239994+0000","last_undegraded":"2023-12-24T18:36:33.239994+0000","last_fullsized":"2023-12-24T18:36:33.239994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200423+0000","last_change":"2023-12-24T18:36:27.054736+0000","last_active":"2023-12-24T18:36:33.200423+0000","last_peered":"2023-12-24T18:36:33.200423+0000","last_clean":"2023-12-24T18:36:33.200423+0000","last_became_active":"2023-12-24T18:36:27.054412+0000","last_became_peered":"2023-12-24T18:36:27.054412+0000","last_unstale":"2023-12-24T18:36:33.200423+0000","last_undegraded":"2023-12-24T18:36:33.200423+0000","last_fullsized":"2023-12-24T18:36:33.200423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241564+0000","last_change":"2023-12-24T18:36:28.129965+0000","last_active":"2023-12-24T18:36:33.241564+0000","last_peered":"2023-12-24T18:36:33.241564+0000","last_clean":"2023-12-24T18:36:33.241564+0000","last_became_active":"2023-12-24T18:36:28.129603+0000","last_became_peered":"2023-12-24T18:36:28.129603+0000","last_unstale":"2023-12-24T18:36:33.241564+0000","last_undegraded":"2023-12-24T18:36:33.241564+0000","last_fullsized":"2023-12-24T18:36:33.241564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196390+0000","last_change":"2023-12-24T18:36:32.255501+0000","last_active":"2023-12-24T18:36:33.196390+0000","last_peered":"2023-12-24T18:36:33.196390+0000","last_clean":"2023-12-24T18:36:33.196390+0000","last_became_active":"2023-12-24T18:36:32.254933+0000","last_became_peered":"2023-12-24T18:36:32.254933+0000","last_unstale":"2023-12-24T18:36:33.196390+0000","last_undegraded":"2023-12-24T18:36:33.196390+0000","last_fullsized":"2023-12-24T18:36:33.196390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:17.070830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239657+0000","last_change":"2023-12-24T18:36:27.057513+0000","last_active":"2023-12-24T18:36:33.239657+0000","last_peered":"2023-12-24T18:36:33.239657+0000","last_clean":"2023-12-24T18:36:33.239657+0000","last_became_active":"2023-12-24T18:36:27.057214+0000","last_became_peered":"2023-12-24T18:36:27.057214+0000","last_unstale":"2023-12-24T18:36:33.239657+0000","last_undegraded":"2023-12-24T18:36:33.239657+0000","last_fullsized":"2023-12-24T18:36:33.239657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:45:26.084715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199367+0000","last_change":"2023-12-24T18:36:28.135278+0000","last_active":"2023-12-24T18:36:33.199367+0000","last_peered":"2023-12-24T18:36:33.199367+0000","last_clean":"2023-12-24T18:36:33.199367+0000","last_became_active":"2023-12-24T18:36:28.134930+0000","last_became_peered":"2023-12-24T18:36:28.134930+0000","last_unstale":"2023-12-24T18:36:33.199367+0000","last_undegraded":"2023-12-24T18:36:33.199367+0000","last_fullsized":"2023-12-24T18:36:33.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241829+0000","last_change":"2023-12-24T18:36:32.249712+0000","last_active":"2023-12-24T18:36:33.241829+0000","last_peered":"2023-12-24T18:36:33.241829+0000","last_clean":"2023-12-24T18:36:33.241829+0000","last_became_active":"2023-12-24T18:36:32.249212+0000","last_became_peered":"2023-12-24T18:36:32.249212+0000","last_unstale":"2023-12-24T18:36:33.241829+0000","last_undegraded":"2023-12-24T18:36:33.241829+0000","last_fullsized":"2023-12-24T18:36:33.241829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:16.688462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199863+0000","last_change":"2023-12-24T18:36:28.127955+0000","last_active":"2023-12-24T18:36:33.199863+0000","last_peered":"2023-12-24T18:36:33.199863+0000","last_clean":"2023-12-24T18:36:33.199863+0000","last_became_active":"2023-12-24T18:36:28.127567+0000","last_became_peered":"2023-12-24T18:36:28.127567+0000","last_unstale":"2023-12-24T18:36:33.199863+0000","last_undegraded":"2023-12-24T18:36:33.199863+0000","last_fullsized":"2023-12-24T18:36:33.199863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195895+0000","last_change":"2023-12-24T18:36:28.122309+0000","last_active":"2023-12-24T18:36:33.195895+0000","last_peered":"2023-12-24T18:36:33.195895+0000","last_clean":"2023-12-24T18:36:33.195895+0000","last_became_active":"2023-12-24T18:36:28.121952+0000","last_became_peered":"2023-12-24T18:36:28.121952+0000","last_unstale":"2023-12-24T18:36:33.195895+0000","last_undegraded":"2023-12-24T18:36:33.195895+0000","last_fullsized":"2023-12-24T18:36:33.195895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:10:51.295826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242736+0000","last_change":"2023-12-24T18:36:28.127237+0000","last_active":"2023-12-24T18:36:33.242736+0000","last_peered":"2023-12-24T18:36:33.242736+0000","last_clean":"2023-12-24T18:36:33.242736+0000","last_became_active":"2023-12-24T18:36:28.126847+0000","last_became_peered":"2023-12-24T18:36:28.126847+0000","last_unstale":"2023-12-24T18:36:33.242736+0000","last_undegraded":"2023-12-24T18:36:33.242736+0000","last_fullsized":"2023-12-24T18:36:33.242736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241422+0000","last_change":"2023-12-24T18:36:28.131645+0000","last_active":"2023-12-24T18:36:33.241422+0000","last_peered":"2023-12-24T18:36:33.241422+0000","last_clean":"2023-12-24T18:36:33.241422+0000","last_became_active":"2023-12-24T18:36:28.131357+0000","last_became_peered":"2023-12-24T18:36:28.131357+0000","last_unstale":"2023-12-24T18:36:33.241422+0000","last_undegraded":"2023-12-24T18:36:33.241422+0000","last_fullsized":"2023-12-24T18:36:33.241422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240828+0000","last_change":"2023-12-24T18:36:28.117729+0000","last_active":"2023-12-24T18:36:33.240828+0000","last_peered":"2023-12-24T18:36:33.240828+0000","last_clean":"2023-12-24T18:36:33.240828+0000","last_became_active":"2023-12-24T18:36:28.117032+0000","last_became_peered":"2023-12-24T18:36:28.117032+0000","last_unstale":"2023-12-24T18:36:33.240828+0000","last_undegraded":"2023-12-24T18:36:33.240828+0000","last_fullsized":"2023-12-24T18:36:33.240828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244218+0000","last_change":"2023-12-24T18:36:28.122731+0000","last_active":"2023-12-24T18:36:33.244218+0000","last_peered":"2023-12-24T18:36:33.244218+0000","last_clean":"2023-12-24T18:36:33.244218+0000","last_became_active":"2023-12-24T18:36:28.122381+0000","last_became_peered":"2023-12-24T18:36:28.122381+0000","last_unstale":"2023-12-24T18:36:33.244218+0000","last_undegraded":"2023-12-24T18:36:33.244218+0000","last_fullsized":"2023-12-24T18:36:33.244218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201413+0000","last_change":"2023-12-24T18:36:28.110419+0000","last_active":"2023-12-24T18:36:33.201413+0000","last_peered":"2023-12-24T18:36:33.201413+0000","last_clean":"2023-12-24T18:36:33.201413+0000","last_became_active":"2023-12-24T18:36:28.110104+0000","last_became_peered":"2023-12-24T18:36:28.110104+0000","last_unstale":"2023-12-24T18:36:33.201413+0000","last_undegraded":"2023-12-24T18:36:33.201413+0000","last_fullsized":"2023-12-24T18:36:33.201413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242401+0000","last_change":"2023-12-24T18:36:28.112938+0000","last_active":"2023-12-24T18:36:33.242401+0000","last_peered":"2023-12-24T18:36:33.242401+0000","last_clean":"2023-12-24T18:36:33.242401+0000","last_became_active":"2023-12-24T18:36:28.112607+0000","last_became_peered":"2023-12-24T18:36:28.112607+0000","last_unstale":"2023-12-24T18:36:33.242401+0000","last_undegraded":"2023-12-24T18:36:33.242401+0000","last_fullsized":"2023-12-24T18:36:33.242401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241820+0000","last_change":"2023-12-24T18:36:28.124839+0000","last_active":"2023-12-24T18:36:33.241820+0000","last_peered":"2023-12-24T18:36:33.241820+0000","last_clean":"2023-12-24T18:36:33.241820+0000","last_became_active":"2023-12-24T18:36:28.124475+0000","last_became_peered":"2023-12-24T18:36:28.124475+0000","last_unstale":"2023-12-24T18:36:33.241820+0000","last_undegraded":"2023-12-24T18:36:33.241820+0000","last_fullsized":"2023-12-24T18:36:33.241820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239644+0000","last_change":"2023-12-24T18:36:28.121764+0000","last_active":"2023-12-24T18:36:33.239644+0000","last_peered":"2023-12-24T18:36:33.239644+0000","last_clean":"2023-12-24T18:36:33.239644+0000","last_became_active":"2023-12-24T18:36:28.119184+0000","last_became_peered":"2023-12-24T18:36:28.119184+0000","last_unstale":"2023-12-24T18:36:33.239644+0000","last_undegraded":"2023-12-24T18:36:33.239644+0000","last_fullsized":"2023-12-24T18:36:33.239644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242614+0000","last_change":"2023-12-24T18:36:28.122598+0000","last_active":"2023-12-24T18:36:33.242614+0000","last_peered":"2023-12-24T18:36:33.242614+0000","last_clean":"2023-12-24T18:36:33.242614+0000","last_became_active":"2023-12-24T18:36:28.122261+0000","last_became_peered":"2023-12-24T18:36:28.122261+0000","last_unstale":"2023-12-24T18:36:33.242614+0000","last_undegraded":"2023-12-24T18:36:33.242614+0000","last_fullsized":"2023-12-24T18:36:33.242614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241191+0000","last_change":"2023-12-24T18:36:28.123426+0000","last_active":"2023-12-24T18:36:33.241191+0000","last_peered":"2023-12-24T18:36:33.241191+0000","last_clean":"2023-12-24T18:36:33.241191+0000","last_became_active":"2023-12-24T18:36:28.122912+0000","last_became_peered":"2023-12-24T18:36:28.122912+0000","last_unstale":"2023-12-24T18:36:33.241191+0000","last_undegraded":"2023-12-24T18:36:33.241191+0000","last_fullsized":"2023-12-24T18:36:33.241191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:32.309502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200862+0000","last_change":"2023-12-24T18:36:28.111862+0000","last_active":"2023-12-24T18:36:33.200862+0000","last_peered":"2023-12-24T18:36:33.200862+0000","last_clean":"2023-12-24T18:36:33.200862+0000","last_became_active":"2023-12-24T18:36:28.111275+0000","last_became_peered":"2023-12-24T18:36:28.111275+0000","last_unstale":"2023-12-24T18:36:33.200862+0000","last_undegraded":"2023-12-24T18:36:33.200862+0000","last_fullsized":"2023-12-24T18:36:33.200862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243601+0000","last_change":"2023-12-24T18:36:28.129777+0000","last_active":"2023-12-24T18:36:33.243601+0000","last_peered":"2023-12-24T18:36:33.243601+0000","last_clean":"2023-12-24T18:36:33.243601+0000","last_became_active":"2023-12-24T18:36:28.129505+0000","last_became_peered":"2023-12-24T18:36:28.129505+0000","last_unstale":"2023-12-24T18:36:33.243601+0000","last_undegraded":"2023-12-24T18:36:33.243601+0000","last_fullsized":"2023-12-24T18:36:33.243601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196463+0000","last_change":"2023-12-24T18:36:28.108366+0000","last_active":"2023-12-24T18:36:33.196463+0000","last_peered":"2023-12-24T18:36:33.196463+0000","last_clean":"2023-12-24T18:36:33.196463+0000","last_became_active":"2023-12-24T18:36:28.107349+0000","last_became_peered":"2023-12-24T18:36:28.107349+0000","last_unstale":"2023-12-24T18:36:33.196463+0000","last_undegraded":"2023-12-24T18:36:33.196463+0000","last_fullsized":"2023-12-24T18:36:33.196463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243215+0000","last_change":"2023-12-24T18:36:28.126189+0000","last_active":"2023-12-24T18:36:33.243215+0000","last_peered":"2023-12-24T18:36:33.243215+0000","last_clean":"2023-12-24T18:36:33.243215+0000","last_became_active":"2023-12-24T18:36:28.125898+0000","last_became_peered":"2023-12-24T18:36:28.125898+0000","last_unstale":"2023-12-24T18:36:33.243215+0000","last_undegraded":"2023-12-24T18:36:33.243215+0000","last_fullsized":"2023-12-24T18:36:33.243215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241791+0000","last_change":"2023-12-24T18:36:28.132625+0000","last_active":"2023-12-24T18:36:33.241791+0000","last_peered":"2023-12-24T18:36:33.241791+0000","last_clean":"2023-12-24T18:36:33.241791+0000","last_became_active":"2023-12-24T18:36:28.132212+0000","last_became_peered":"2023-12-24T18:36:28.132212+0000","last_unstale":"2023-12-24T18:36:33.241791+0000","last_undegraded":"2023-12-24T18:36:33.241791+0000","last_fullsized":"2023-12-24T18:36:33.241791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243456+0000","last_change":"2023-12-24T18:36:28.117097+0000","last_active":"2023-12-24T18:36:33.243456+0000","last_peered":"2023-12-24T18:36:33.243456+0000","last_clean":"2023-12-24T18:36:33.243456+0000","last_became_active":"2023-12-24T18:36:28.116619+0000","last_became_peered":"2023-12-24T18:36:28.116619+0000","last_unstale":"2023-12-24T18:36:33.243456+0000","last_undegraded":"2023-12-24T18:36:33.243456+0000","last_fullsized":"2023-12-24T18:36:33.243456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240881+0000","last_change":"2023-12-24T18:36:28.126681+0000","last_active":"2023-12-24T18:36:33.240881+0000","last_peered":"2023-12-24T18:36:33.240881+0000","last_clean":"2023-12-24T18:36:33.240881+0000","last_became_active":"2023-12-24T18:36:28.126405+0000","last_became_peered":"2023-12-24T18:36:28.126405+0000","last_unstale":"2023-12-24T18:36:33.240881+0000","last_undegraded":"2023-12-24T18:36:33.240881+0000","last_fullsized":"2023-12-24T18:36:33.240881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:13:51.708720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239479+0000","last_change":"2023-12-24T18:36:28.120536+0000","last_active":"2023-12-24T18:36:33.239479+0000","last_peered":"2023-12-24T18:36:33.239479+0000","last_clean":"2023-12-24T18:36:33.239479+0000","last_became_active":"2023-12-24T18:36:28.117933+0000","last_became_peered":"2023-12-24T18:36:28.117933+0000","last_unstale":"2023-12-24T18:36:33.239479+0000","last_undegraded":"2023-12-24T18:36:33.239479+0000","last_fullsized":"2023-12-24T18:36:33.239479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200207+0000","last_change":"2023-12-24T18:36:28.107648+0000","last_active":"2023-12-24T18:36:33.200207+0000","last_peered":"2023-12-24T18:36:33.200207+0000","last_clean":"2023-12-24T18:36:33.200207+0000","last_became_active":"2023-12-24T18:36:28.107371+0000","last_became_peered":"2023-12-24T18:36:28.107371+0000","last_unstale":"2023-12-24T18:36:33.200207+0000","last_undegraded":"2023-12-24T18:36:33.200207+0000","last_fullsized":"2023-12-24T18:36:33.200207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:00.325029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201052+0000","last_change":"2023-12-24T18:36:28.124649+0000","last_active":"2023-12-24T18:36:33.201052+0000","last_peered":"2023-12-24T18:36:33.201052+0000","last_clean":"2023-12-24T18:36:33.201052+0000","last_became_active":"2023-12-24T18:36:28.124391+0000","last_became_peered":"2023-12-24T18:36:28.124391+0000","last_unstale":"2023-12-24T18:36:33.201052+0000","last_undegraded":"2023-12-24T18:36:33.201052+0000","last_fullsized":"2023-12-24T18:36:33.201052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201303+0000","last_change":"2023-12-24T18:36:28.125440+0000","last_active":"2023-12-24T18:36:33.201303+0000","last_peered":"2023-12-24T18:36:33.201303+0000","last_clean":"2023-12-24T18:36:33.201303+0000","last_became_active":"2023-12-24T18:36:28.124997+0000","last_became_peered":"2023-12-24T18:36:28.124997+0000","last_unstale":"2023-12-24T18:36:33.201303+0000","last_undegraded":"2023-12-24T18:36:33.201303+0000","last_fullsized":"2023-12-24T18:36:33.201303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244397+0000","last_change":"2023-12-24T18:36:28.135114+0000","last_active":"2023-12-24T18:36:33.244397+0000","last_peered":"2023-12-24T18:36:33.244397+0000","last_clean":"2023-12-24T18:36:33.244397+0000","last_became_active":"2023-12-24T18:36:28.134791+0000","last_became_peered":"2023-12-24T18:36:28.134791+0000","last_unstale":"2023-12-24T18:36:33.244397+0000","last_undegraded":"2023-12-24T18:36:33.244397+0000","last_fullsized":"2023-12-24T18:36:33.244397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239249+0000","last_change":"2023-12-24T18:36:28.128424+0000","last_active":"2023-12-24T18:36:33.239249+0000","last_peered":"2023-12-24T18:36:33.239249+0000","last_clean":"2023-12-24T18:36:33.239249+0000","last_became_active":"2023-12-24T18:36:28.126648+0000","last_became_peered":"2023-12-24T18:36:28.126648+0000","last_unstale":"2023-12-24T18:36:33.239249+0000","last_undegraded":"2023-12-24T18:36:33.239249+0000","last_fullsized":"2023-12-24T18:36:33.239249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242477+0000","last_change":"2023-12-24T18:36:28.133462+0000","last_active":"2023-12-24T18:36:33.242477+0000","last_peered":"2023-12-24T18:36:33.242477+0000","last_clean":"2023-12-24T18:36:33.242477+0000","last_became_active":"2023-12-24T18:36:28.132743+0000","last_became_peered":"2023-12-24T18:36:28.132743+0000","last_unstale":"2023-12-24T18:36:33.242477+0000","last_undegraded":"2023-12-24T18:36:33.242477+0000","last_fullsized":"2023-12-24T18:36:33.242477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242433+0000","last_change":"2023-12-24T18:36:28.123802+0000","last_active":"2023-12-24T18:36:33.242433+0000","last_peered":"2023-12-24T18:36:33.242433+0000","last_clean":"2023-12-24T18:36:33.242433+0000","last_became_active":"2023-12-24T18:36:28.123485+0000","last_became_peered":"2023-12-24T18:36:28.123485+0000","last_unstale":"2023-12-24T18:36:33.242433+0000","last_undegraded":"2023-12-24T18:36:33.242433+0000","last_fullsized":"2023-12-24T18:36:33.242433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242781+0000","last_change":"2023-12-24T18:36:28.127375+0000","last_active":"2023-12-24T18:36:33.242781+0000","last_peered":"2023-12-24T18:36:33.242781+0000","last_clean":"2023-12-24T18:36:33.242781+0000","last_became_active":"2023-12-24T18:36:28.126911+0000","last_became_peered":"2023-12-24T18:36:28.126911+0000","last_unstale":"2023-12-24T18:36:33.242781+0000","last_undegraded":"2023-12-24T18:36:33.242781+0000","last_fullsized":"2023-12-24T18:36:33.242781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242304+0000","last_change":"2023-12-24T18:36:28.137460+0000","last_active":"2023-12-24T18:36:33.242304+0000","last_peered":"2023-12-24T18:36:33.242304+0000","last_clean":"2023-12-24T18:36:33.242304+0000","last_became_active":"2023-12-24T18:36:28.134762+0000","last_became_peered":"2023-12-24T18:36:28.134762+0000","last_unstale":"2023-12-24T18:36:33.242304+0000","last_undegraded":"2023-12-24T18:36:33.242304+0000","last_fullsized":"2023-12-24T18:36:33.242304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241490+0000","last_change":"2023-12-24T18:36:28.122281+0000","last_active":"2023-12-24T18:36:33.241490+0000","last_peered":"2023-12-24T18:36:33.241490+0000","last_clean":"2023-12-24T18:36:33.241490+0000","last_became_active":"2023-12-24T18:36:28.121977+0000","last_became_peered":"2023-12-24T18:36:28.121977+0000","last_unstale":"2023-12-24T18:36:33.241490+0000","last_undegraded":"2023-12-24T18:36:33.241490+0000","last_fullsized":"2023-12-24T18:36:33.241490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:40.546379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244610+0000","last_change":"2023-12-24T18:36:28.121068+0000","last_active":"2023-12-24T18:36:33.244610+0000","last_peered":"2023-12-24T18:36:33.244610+0000","last_clean":"2023-12-24T18:36:33.244610+0000","last_became_active":"2023-12-24T18:36:28.120763+0000","last_became_peered":"2023-12-24T18:36:28.120763+0000","last_unstale":"2023-12-24T18:36:33.244610+0000","last_undegraded":"2023-12-24T18:36:33.244610+0000","last_fullsized":"2023-12-24T18:36:33.244610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244306+0000","last_change":"2023-12-24T18:36:28.137961+0000","last_active":"2023-12-24T18:36:33.244306+0000","last_peered":"2023-12-24T18:36:33.244306+0000","last_clean":"2023-12-24T18:36:33.244306+0000","last_became_active":"2023-12-24T18:36:28.137711+0000","last_became_peered":"2023-12-24T18:36:28.137711+0000","last_unstale":"2023-12-24T18:36:33.244306+0000","last_undegraded":"2023-12-24T18:36:33.244306+0000","last_fullsized":"2023-12-24T18:36:33.244306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:47.085985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4483,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":697463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":106631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":106667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":106541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3050000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3730000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.653}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":872448,"data_stored":697519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:36:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:36:45.008 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-24T18:36:45.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-24T18:36:45.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-24T18:36:45.008 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-24T18:36:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.211+0000 7ff127f85700 1 Processor -- start 2023-12-24T18:36:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.211+0000 7ff127f85700 1 -- start start 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff127f85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1201592d0 0x7ff12006ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff127f85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200c54d0 0x7ff1200c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff127f85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12015d660 con 0x7ff12006a760 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff127f85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12015cda0 con 0x7ff1201592d0 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff127f85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12015d010 con 0x7ff1200c54d0 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff125d21700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff12006a760 0x7ff120158bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37396/0 (socket says 172.21.15.50:37396) 2023-12-24T18:36:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff125d21700 1 -- 172.21.15.50:0/2350054825 learned_addr learned my addr 172.21.15.50:0/2350054825 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff126522700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200c54d0 0x7ff1200c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff125520700 1 --2- 172.21.15.50:0/2350054825 >> v2:172.21.15.50:3300/0 conn(0x7ff1201592d0 0x7ff12006ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257098423 0 0) 0x7ff12015d660 con 0x7ff12006a760 2023-12-24T18:36:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff10c003570 con 0x7ff12006a760 2023-12-24T18:36:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463479309 0 0) 0x7ff10c003570 con 0x7ff12006a760 2023-12-24T18:36:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200c54d0 msgr2=0x7ff1200c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200c54d0 0x7ff1200c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 >> v2:172.21.15.50:3300/0 conn(0x7ff1201592d0 msgr2=0x7ff12006ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 --2- 172.21.15.50:0/2350054825 >> v2:172.21.15.50:3300/0 conn(0x7ff1201592d0 0x7ff12006ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12015d2f0 con 0x7ff12006a760 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7ff11c001470 con 0x7ff12006a760 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 >> v1:172.21.15.50:6789/0 conn(0x7ff12006a760 legacy=0x7ff120158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003a60 0x7ff10c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff10c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c0051c0 0x7ff10c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12015cda0 con 0x7ff10c004810 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12015d010 con 0x7ff10c0051c0 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c00bfa0 con 0x7ff10c003a60 2023-12-24T18:36:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.215+0000 7ff126522700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200c54d0 0x7ff1200c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff10c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125d21700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003a60 0x7ff10c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff126522700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c0051c0 0x7ff10c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 -- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003a60 msgr2=0x7ff10c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003a60 0x7ff10c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 -- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c0051c0 msgr2=0x7ff10c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c0051c0 0x7ff10c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 -- 172.21.15.50:0/2350054825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c003570 con 0x7ff10c004810 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff125520700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff10c004c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff110009c00 tx=0x7ff1100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eea5bb5fcd5179 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000e710 con 0x7ff10c004810 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11000e870 con 0x7ff10c004810 2023-12-24T18:36:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff124d1f700 1 -- 172.21.15.50:0/2350054825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000ec30 con 0x7ff10c004810 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 -- 172.21.15.50:0/2350054825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 msgr2=0x7ff10c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 --2- 172.21.15.50:0/2350054825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff10c004c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff110009c00 tx=0x7ff1100091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff126522700 1 -- 172.21.15.50:0/2350054825 reap_dead start 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 -- 172.21.15.50:0/2350054825 shutdown_connections 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 -- 172.21.15.50:0/2350054825 >> 172.21.15.50:0/2350054825 conn(0x7ff120067b80 msgr2=0x7ff1200cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 -- 172.21.15.50:0/2350054825 shutdown_connections 2023-12-24T18:36:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.219+0000 7ff127f85700 1 -- 172.21.15.50:0/2350054825 wait complete. 2023-12-24T18:36:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 Processor -- start 2023-12-24T18:36:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 -- start start 2023-12-24T18:36:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120152bd0 0x7ff12016c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200cca90 0x7ff1200ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200cd420 con 0x7ff10c004810 2023-12-24T18:36:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120154700 con 0x7ff120152bd0 2023-12-24T18:36:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.223+0000 7ff127f85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12015bb00 con 0x7ff1200cca90 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60738/0 (socket says 172.21.15.50:60738) 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 -- 172.21.15.50:0/3525401323 learned_addr learned my addr 172.21.15.50:0/3525401323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125520700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120152bd0 0x7ff12016c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff126522700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200cca90 0x7ff1200ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 -- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200cca90 msgr2=0x7ff1200ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200cca90 0x7ff1200ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 -- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120152bd0 msgr2=0x7ff12016c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120152bd0 0x7ff12016c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 -- 172.21.15.50:0/3525401323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12015bdc0 con 0x7ff10c004810 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff125d21700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001c40 tx=0x7ff12015d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c018030 con 0x7ff10c004810 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00f8d0 con 0x7ff10c004810 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12015c0a0 con 0x7ff10c004810 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00fc70 con 0x7ff10c004810 2023-12-24T18:36:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.227+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200c9fc0 con 0x7ff10c004810 2023-12-24T18:36:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.231+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12015c290 con 0x7ff10c004810 2023-12-24T18:36:45.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.231+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff11c01b070 con 0x7ff10c004810 2023-12-24T18:36:45.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.231+0000 7ff115ffb700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 0x7ff104062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.231+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7ff11c019070 con 0x7ff10c004810 2023-12-24T18:36:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.231+0000 7ff125520700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 0x7ff104062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.235+0000 7ff125520700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 0x7ff104062ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1100091e0 tx=0x7ff11001a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.239+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff11c04ccd0 con 0x7ff10c004810 2023-12-24T18:36:45.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.451+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff1200652e0 con 0x7ff10c004810 2023-12-24T18:36:45.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.459+0000 7ff115ffb700 1 -- 172.21.15.50:0/3525401323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154131 (secure 0 0 0) 0x7ff11c0502f0 con 0x7ff10c004810 2023-12-24T18:36:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 msgr2=0x7ff104062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 0x7ff104062ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1100091e0 tx=0x7ff11001a000 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 msgr2=0x7ff12016d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001c40 tx=0x7ff12015d5d0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 shutdown_connections 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff104060600 0x7ff104062ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff1200cca90 0x7ff1200ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120152bd0 0x7ff12016c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.463+0000 7ff127f85700 1 --2- 172.21.15.50:0/3525401323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10c004810 0x7ff12016d380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.467+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 >> 172.21.15.50:0/3525401323 conn(0x7ff120067b80 msgr2=0x7ff120153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.467+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 shutdown_connections 2023-12-24T18:36:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.467+0000 7ff127f85700 1 -- 172.21.15.50:0/3525401323 wait complete. 2023-12-24T18:36:45.489 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":33814},{"type":"v1","addr":"172.21.15.50:6833","nonce":33814}]},"active_addr":"172.21.15.50:6833/33814","active_change":"2023-12-24T18:36:08.711751+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1890246914}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1014312647}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":49267815}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1062942176}]}]} 2023-12-24T18:36:45.492 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-24T18:36:45.492 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-24T18:36:45.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:45.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.655+0000 7f5b97f45700 1 Processor -- start 2023-12-24T18:36:45.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.655+0000 7f5b97f45700 1 -- start start 2023-12-24T18:36:45.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b97f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b9015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b97f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b900b1ba0 0x7f5b900b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b97f45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9006d5c0 con 0x7f5b900b3c90 2023-12-24T18:36:45.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b97f45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b900b49c0 con 0x7f5b900b1ba0 2023-12-24T18:36:45.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b97f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9006d040 con 0x7f5b90158e10 2023-12-24T18:36:45.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b95ce1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b9015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b954e0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5b900b3c90 0x7f5b9006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38210/0 (socket says 172.21.15.50:38210) 2023-12-24T18:36:45.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b954e0700 1 -- 172.21.15.50:0/1821730870 learned_addr learned my addr 172.21.15.50:0/1821730870 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:45.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b964e2700 1 --2- 172.21.15.50:0/1821730870 >> v2:172.21.15.82:3300/0 conn(0x7f5b900b1ba0 0x7f5b900b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b94cdf700 1 -- 172.21.15.50:0/1821730870 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161595559 0 0) 0x7f5b9006d5c0 con 0x7f5b900b3c90 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b94cdf700 1 -- 172.21.15.50:0/1821730870 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b7c003570 con 0x7f5b900b3c90 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b95ce1700 1 -- 172.21.15.50:0/1821730870 >> v2:172.21.15.82:3300/0 conn(0x7f5b900b1ba0 msgr2=0x7f5b900b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b95ce1700 1 --2- 172.21.15.50:0/1821730870 >> v2:172.21.15.82:3300/0 conn(0x7f5b900b1ba0 0x7f5b900b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b95ce1700 1 -- 172.21.15.50:0/1821730870 >> v1:172.21.15.82:6789/0 conn(0x7f5b900b3c90 legacy=0x7f5b9006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.659+0000 7f5b95ce1700 1 -- 172.21.15.50:0/1821730870 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9015a1f0 con 0x7f5b90158e10 2023-12-24T18:36:45.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b95ce1700 1 --2- 172.21.15.50:0/1821730870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b9015d6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0098e0 tx=0x7f5b8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4085a1b688626b09 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b94cdf700 1 -- 172.21.15.50:0/1821730870 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c011630 con 0x7f5b90158e10 2023-12-24T18:36:45.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b94cdf700 1 -- 172.21.15.50:0/1821730870 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c011790 con 0x7f5b90158e10 2023-12-24T18:36:45.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b94cdf700 1 -- 172.21.15.50:0/1821730870 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c011b30 con 0x7f5b90158e10 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 -- 172.21.15.50:0/1821730870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 msgr2=0x7f5b9015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 --2- 172.21.15.50:0/1821730870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b9015d6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0098e0 tx=0x7f5b8c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 -- 172.21.15.50:0/1821730870 shutdown_connections 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 --2- 172.21.15.50:0/1821730870 >> v2:172.21.15.82:3300/0 conn(0x7f5b900b1ba0 0x7f5b900b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 --2- 172.21.15.50:0/1821730870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b9015d6d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 -- 172.21.15.50:0/1821730870 >> 172.21.15.50:0/1821730870 conn(0x7f5b900670b0 msgr2=0x7f5b900674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 -- 172.21.15.50:0/1821730870 shutdown_connections 2023-12-24T18:36:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.663+0000 7f5b97f45700 1 -- 172.21.15.50:0/1821730870 wait complete. 2023-12-24T18:36:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 Processor -- start 2023-12-24T18:36:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 -- start start 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b900b1ba0 0x7f5b90151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b901693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900a9860 con 0x7f5b900b3c90 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900a88d0 con 0x7f5b900b1ba0 2023-12-24T18:36:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b97f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900a8e90 con 0x7f5b90158e10 2023-12-24T18:36:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60744/0 (socket says 172.21.15.50:60744) 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 -- 172.21.15.50:0/3187076347 learned_addr learned my addr 172.21.15.50:0/3187076347 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b95ce1700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b900b1ba0 0x7f5b90151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b964e2700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b901693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 -- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 msgr2=0x7f5b901693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b901693a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 -- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b900b1ba0 msgr2=0x7f5b90151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.667+0000 7f5b954e0700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b900b1ba0 0x7f5b90151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b954e0700 1 -- 172.21.15.50:0/3187076347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c009420 con 0x7f5b900b3c90 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b954e0700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c7f0 tx=0x7f5b80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80005cd0 con 0x7f5b900b3c90 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80005e50 con 0x7f5b900b3c90 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80007320 con 0x7f5b900b3c90 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b90169e60 con 0x7f5b900b3c90 2023-12-24T18:36:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b900a8b20 con 0x7f5b900b3c90 2023-12-24T18:36:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.671+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b900652e0 con 0x7f5b900b3c90 2023-12-24T18:36:45.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.675+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5b80007690 con 0x7f5b900b3c90 2023-12-24T18:36:45.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.675+0000 7f5b85ffb700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 0x7f5b74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:45.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.675+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f5b8007c170 con 0x7f5b900b3c90 2023-12-24T18:36:45.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.675+0000 7f5b95ce1700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 0x7f5b74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:45.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.675+0000 7f5b95ce1700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 0x7f5b74062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0091e0 tx=0x7f5b8c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.683+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b8004c3d0 con 0x7f5b900b3c90 2023-12-24T18:36:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.855+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b900a8fd0 con 0x7f5b900b3c90 2023-12-24T18:36:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.859+0000 7f5b85ffb700 1 -- 172.21.15.50:0/3187076347 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f5b8004f9f0 con 0x7f5b900b3c90 2023-12-24T18:36:45.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:45.862 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 msgr2=0x7f5b74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 0x7f5b74062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0091e0 tx=0x7f5b8c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 msgr2=0x7f5b900a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c7f0 tx=0x7f5b80007e00 comp rx=0 tx=0).stop 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 shutdown_connections 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5b74060550 0x7f5b74062a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b90158e10 0x7f5b901693a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b900b3c90 0x7f5b900a9320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 --2- 172.21.15.50:0/3187076347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b900b1ba0 0x7f5b90151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 >> 172.21.15.50:0/3187076347 conn(0x7f5b900670b0 msgr2=0x7f5b90152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 shutdown_connections 2023-12-24T18:36:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:45.863+0000 7f5b97f45700 1 -- 172.21.15.50:0/3187076347 wait complete. 2023-12-24T18:36:45.886 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-24T18:36:45.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.055+0000 7efd69d63700 1 Processor -- start 2023-12-24T18:36:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.055+0000 7efd69d63700 1 -- start start 2023-12-24T18:36:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69d63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 0x7efd641591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69d63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6406b640 con 0x7efd64158e00 2023-12-24T18:36:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69d63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd640b5e10 con 0x7efd640b41e0 2023-12-24T18:36:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69d63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64159710 con 0x7efd6406d8c0 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd68d61700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd64158e00 0x7efd640b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37398/0 (socket says 172.21.15.50:37398) 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd68d61700 1 -- 172.21.15.50:0/1577986548 learned_addr learned my addr 172.21.15.50:0/1577986548 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69562700 1 --2- 172.21.15.50:0/1577986548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 0x7efd641591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215958546 0 0) 0x7efd6406b640 con 0x7efd64158e00 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd54003570 con 0x7efd64158e00 2023-12-24T18:36:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329994254 0 0) 0x7efd640b5e10 con 0x7efd640b41e0 2023-12-24T18:36:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6406b640 con 0x7efd640b41e0 2023-12-24T18:36:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69562700 1 -- 172.21.15.50:0/1577986548 >> v1:172.21.15.82:6789/0 conn(0x7efd640b41e0 legacy=0x7efd64159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69562700 1 -- 172.21.15.50:0/1577986548 >> v1:172.21.15.50:6789/0 conn(0x7efd64158e00 legacy=0x7efd640b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597399530 0 0) 0x7efd54003570 con 0x7efd64158e00 2023-12-24T18:36:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69562700 1 -- 172.21.15.50:0/1577986548 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6406b8e0 con 0x7efd6406d8c0 2023-12-24T18:36:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd69562700 1 --2- 172.21.15.50:0/1577986548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 0x7efd641591d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e90 tx=0x7efd5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649870ec95db594b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00e070 con 0x7efd6406d8c0 2023-12-24T18:36:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.059+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00b870 con 0x7efd6406d8c0 2023-12-24T18:36:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd637fe700 1 -- 172.21.15.50:0/1577986548 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58001470 con 0x7efd6406d8c0 2023-12-24T18:36:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- 172.21.15.50:0/1577986548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 msgr2=0x7efd641591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 --2- 172.21.15.50:0/1577986548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 0x7efd641591d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e90 tx=0x7efd5c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- 172.21.15.50:0/1577986548 shutdown_connections 2023-12-24T18:36:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 --2- 172.21.15.50:0/1577986548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6406d8c0 0x7efd641591d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- 172.21.15.50:0/1577986548 >> 172.21.15.50:0/1577986548 conn(0x7efd64067b80 msgr2=0x7efd640b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- 172.21.15.50:0/1577986548 shutdown_connections 2023-12-24T18:36:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- 172.21.15.50:0/1577986548 wait complete. 2023-12-24T18:36:46.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 Processor -- start 2023-12-24T18:36:46.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.063+0000 7efd69d63700 1 -- start start 2023-12-24T18:36:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd640b41e0 0x7efd641513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd64158e00 0x7efd640b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b07b0 con 0x7efd6406d8c0 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64151920 con 0x7efd640b41e0 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640afe80 con 0x7efd64158e00 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60752/0 (socket says 172.21.15.50:60752) 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 -- 172.21.15.50:0/950248103 learned_addr learned my addr 172.21.15.50:0/950248103 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69562700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd64158e00 0x7efd640b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd63fff700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd640b41e0 0x7efd641513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 -- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd64158e00 msgr2=0x7efd640b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd64158e00 0x7efd640b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 -- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd640b41e0 msgr2=0x7efd641513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd640b41e0 0x7efd641513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 -- 172.21.15.50:0/950248103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009a20 con 0x7efd6406d8c0 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd68d61700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd5800cb70 tx=0x7efd58001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58007150 con 0x7efd6406d8c0 2023-12-24T18:36:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd580072b0 con 0x7efd6406d8c0 2023-12-24T18:36:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd640b0160 con 0x7efd6406d8c0 2023-12-24T18:36:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58007670 con 0x7efd6406d8c0 2023-12-24T18:36:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.067+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd640b1d20 con 0x7efd6406d8c0 2023-12-24T18:36:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.071+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6404be40 con 0x7efd6406d8c0 2023-12-24T18:36:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.071+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efd58004a40 con 0x7efd6406d8c0 2023-12-24T18:36:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.075+0000 7efd60ff9700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 0x7efd48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.075+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7efd5807be40 con 0x7efd6406d8c0 2023-12-24T18:36:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.075+0000 7efd63fff700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 0x7efd48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.075+0000 7efd63fff700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 0x7efd48062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd640ad7a0 tx=0x7efd50007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.083+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd5804c0a0 con 0x7efd6406d8c0 2023-12-24T18:36:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.251+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd6406bbc0 con 0x7efd6406d8c0 2023-12-24T18:36:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.251+0000 7efd60ff9700 1 -- 172.21.15.50:0/950248103 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7efd58018090 con 0x7efd6406d8c0 2023-12-24T18:36:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:46.255 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 msgr2=0x7efd48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 0x7efd48062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd640ad7a0 tx=0x7efd50007d50 comp rx=0 tx=0).stop 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 msgr2=0x7efd64169780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd5800cb70 tx=0x7efd58001ab0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 shutdown_connections 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd48060550 0x7efd48062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd64158e00 0x7efd640b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd640b41e0 0x7efd641513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 --2- 172.21.15.50:0/950248103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6406d8c0 0x7efd64169780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 >> 172.21.15.50:0/950248103 conn(0x7efd64067b80 msgr2=0x7efd640a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 shutdown_connections 2023-12-24T18:36:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.255+0000 7efd69d63700 1 -- 172.21.15.50:0/950248103 wait complete. 2023-12-24T18:36:46.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-24T18:36:46.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-24T18:36:46.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-24T18:36:46.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-24T18:36:46.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-24T18:36:46.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-24T18:36:46.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-24T18:36:46.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-24T18:36:46.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.499+0000 7f6291f63700 1 Processor -- start 2023-12-24T18:36:46.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.499+0000 7f6291f63700 1 -- start start 2023-12-24T18:36:46.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291f63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f628c0cb310 0x7f628c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291f63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c156690 0x7f628c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291f63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c15a4d0 con 0x7f628c0caf40 2023-12-24T18:36:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291f63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c157050 con 0x7f628c0cb310 2023-12-24T18:36:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291f63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c159610 con 0x7f628c156690 2023-12-24T18:36:46.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f628c0cb310 0x7f628c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f628c0cb310 0x7f628c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60760/0 (socket says 172.21.15.50:60760) 2023-12-24T18:36:46.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 -- 172.21.15.50:0/1297641941 learned_addr learned my addr 172.21.15.50:0/1297641941 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f6291762700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c156690 0x7f628c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 -- 172.21.15.50:0/1297641941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c156690 msgr2=0x7f628c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c156690 0x7f628c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 -- 172.21.15.50:0/1297641941 >> v1:172.21.15.82:6789/0 conn(0x7f628c0caf40 legacy=0x7f628c0ccb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-24T18:36:46.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.503+0000 7f628bfff700 1 -- 172.21.15.50:0/1297641941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0cd2a0 con 0x7f628c0cb310 2023-12-24T18:36:46.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f628bfff700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c0cb310 0x7f628c06cd30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62780099b0 tx=0x7f6278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169f4b950db970ed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f162d2ae700 1 Processor -- start 2023-12-24T18:36:46.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f162d2ae700 1 -- start start 2023-12-24T18:36:46.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f628b7fe700 1 -- 172.21.15.50:0/1297641941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278009ea0 con 0x7f628c0cb310 2023-12-24T18:36:46.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f628b7fe700 1 -- 172.21.15.50:0/1297641941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800b820 con 0x7f628c0cb310 2023-12-24T18:36:46.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f628b7fe700 1 -- 172.21.15.50:0/1297641941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bba0 con 0x7f628c0cb310 2023-12-24T18:36:46.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f162d2ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 0x7f162815a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f162d2ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16280c6a10 0x7f16280c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f1626ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1628158d40 0x7f16280aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37412/0 (socket says 172.21.15.50:37412) 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.507+0000 7f1626ffd700 1 -- 172.21.15.50:0/2248018861 learned_addr learned my addr 172.21.15.50:0/2248018861 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162806b640 con 0x7f1628158d40 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162806ad50 con 0x7f16280c6a10 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162806aff0 con 0x7f162815d780 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 --2- 172.21.15.50:0/2248018861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 0x7f162815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 -- 172.21.15.50:0/1297641941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c0cb310 msgr2=0x7f628c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c0cb310 0x7f628c06cd30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62780099b0 tx=0x7f6278009250 comp rx=0 tx=0).stop 2023-12-24T18:36:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 -- 172.21.15.50:0/2248018861 >> v2:172.21.15.50:3300/0 conn(0x7f16280c6a10 msgr2=0x7f16280c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 --2- 172.21.15.50:0/2248018861 >> v2:172.21.15.50:3300/0 conn(0x7f16280c6a10 0x7f16280c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 -- 172.21.15.50:0/2248018861 >> v1:172.21.15.50:6789/0 conn(0x7f1628158d40 legacy=0x7f16280aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 -- 172.21.15.50:0/2248018861 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806b2d0 con 0x7f162815d780 2023-12-24T18:36:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f1625ffb700 1 -- 172.21.15.50:0/2248018861 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346379753 0 0) 0x7f162806b640 con 0x7f1628158d40 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 -- 172.21.15.50:0/1297641941 shutdown_connections 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c156690 0x7f628c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 --2- 172.21.15.50:0/1297641941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c0cb310 0x7f628c06cd30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 -- 172.21.15.50:0/1297641941 >> 172.21.15.50:0/1297641941 conn(0x7f628c0670b0 msgr2=0x7f628c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f16267fc700 1 --2- 172.21.15.50:0/2248018861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 0x7f162815a120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16180098e0 tx=0x7f16180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c78420c048f714a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 -- 172.21.15.50:0/1297641941 shutdown_connections 2023-12-24T18:36:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f6291f63700 1 -- 172.21.15.50:0/1297641941 wait complete. 2023-12-24T18:36:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f0c45b23700 1 Processor -- start 2023-12-24T18:36:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f8330c6b700 1 Processor -- start 2023-12-24T18:36:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f1625ffb700 1 -- 172.21.15.50:0/2248018861 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618009e80 con 0x7f162815d780 2023-12-24T18:36:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f1625ffb700 1 -- 172.21.15.50:0/2248018861 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800b860 con 0x7f162815d780 2023-12-24T18:36:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f1625ffb700 1 -- 172.21.15.50:0/2248018861 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800bbe0 con 0x7f162815d780 2023-12-24T18:36:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f0c45b23700 1 -- start start 2023-12-24T18:36:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 msgr2=0x7f162815a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f162d2ae700 1 --2- 172.21.15.50:0/2248018861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 0x7f162815a120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16180098e0 tx=0x7f16180091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 Processor -- start 2023-12-24T18:36:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45b23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c400b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 shutdown_connections 2023-12-24T18:36:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 --2- 172.21.15.50:0/2248018861 >> v2:172.21.15.50:3300/0 conn(0x7f16280c6a10 0x7f16280c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 --2- 172.21.15.50:0/2248018861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f162815d780 0x7f162815a120 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 >> 172.21.15.50:0/2248018861 conn(0x7f16280cbba0 msgr2=0x7f16280cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.511+0000 7f8330c6b700 1 -- start start 2023-12-24T18:36:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f8330c6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f8330c6b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f832c0b41e0 0x7f832c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f8330c6b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c06b640 con 0x7f832c06d8c0 2023-12-24T18:36:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f8330c6b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c159710 con 0x7f832c0b41e0 2023-12-24T18:36:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f8330c6b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b5e10 con 0x7f832c158e00 2023-12-24T18:36:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45b23700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c400cdac0 0x7f0c4006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c44b21700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c400b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c44b21700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c400b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44898/0 (socket says 172.21.15.50:44898) 2023-12-24T18:36:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c3ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0c400b42c0 0x7f0c4015cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38230/0 (socket says 172.21.15.50:38230) 2023-12-24T18:36:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45b23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4006bdf0 con 0x7f0c400b42c0 2023-12-24T18:36:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f832bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f832c0b41e0 0x7f832c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c44b21700 1 -- 172.21.15.50:0/199816502 learned_addr learned my addr 172.21.15.50:0/199816502 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 -- start start 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 0x7f628c16ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628c0cb310 0x7f628c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c156690 0x7f628c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0b2d70 con 0x7f628c156690 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0b3b90 con 0x7f628c0cb310 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45322700 1 --2- 172.21.15.50:0/199816502 >> v2:172.21.15.50:3300/0 conn(0x7f0c400cdac0 0x7f0c4006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291f63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0b2f80 con 0x7f628c0caf40 2023-12-24T18:36:46.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f832affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f832c06d8c0 0x7f832c0b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38236/0 (socket says 172.21.15.50:38236) 2023-12-24T18:36:46.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 shutdown_connections 2023-12-24T18:36:46.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 -- 172.21.15.50:0/2248018861 wait complete. 2023-12-24T18:36:46.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f832affd700 1 -- 172.21.15.50:0/41636469 learned_addr learned my addr 172.21.15.50:0/41636469 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4006af40 con 0x7f0c400cdac0 2023-12-24T18:36:46.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564159447 0 0) 0x7f0c4006bdf0 con 0x7f0c400b42c0 2023-12-24T18:36:46.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6291762700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c156690 0x7f628c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 Processor -- start 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4006b1e0 con 0x7f0c400b3940 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6290f61700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 0x7f628c16ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6290f61700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 0x7f628c16ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44904/0 (socket says 172.21.15.50:44904) 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f6290f61700 1 -- 172.21.15.50:0/2935696218 learned_addr learned my addr 172.21.15.50:0/2935696218 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f628bfff700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628c0cb310 0x7f628c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 -- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628c0cb310 msgr2=0x7f628c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628c0cb310 0x7f628c0cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 -- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c156690 msgr2=0x7f628c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f628c156690 0x7f628c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62780094f0 con 0x7f628c0caf40 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f162d2ae700 1 -- start start 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832bfff700 1 -- 172.21.15.50:0/41636469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 msgr2=0x7f832c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.515+0000 7f2a8a923700 1 Processor -- start 2023-12-24T18:36:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832bfff700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832bfff700 1 -- 172.21.15.50:0/41636469 >> v1:172.21.15.82:6789/0 conn(0x7f832c06d8c0 legacy=0x7f832c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832bfff700 1 -- 172.21.15.50:0/41636469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c06b8e0 con 0x7f832c0b41e0 2023-12-24T18:36:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6290f61700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 0x7f628c16ca70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f628000b600 tx=0x7f62800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c28003570 con 0x7f0c400b42c0 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 0x7f16280afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1628158d40 0x7f16281519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782126375 0 0) 0x7f0c28003570 con 0x7f0c400b42c0 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 msgr2=0x7f0c400b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c400b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 >> v2:172.21.15.50:3300/0 conn(0x7f0c400cdac0 msgr2=0x7f0c4006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 --2- 172.21.15.50:0/199816502 >> v2:172.21.15.50:3300/0 conn(0x7f0c400cdac0 0x7f0c4006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4006b4c0 con 0x7f0c400b42c0 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f0c34001470 con 0x7f0c400b42c0 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 >> v1:172.21.15.82:6789/0 conn(0x7f0c400b42c0 legacy=0x7f0c4015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c28004d50 0x7f0c280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4006af40 con 0x7f0c28003a60 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4006b1e0 con 0x7f0c28004d50 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2800ba60 con 0x7f0c400b3940 2023-12-24T18:36:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832b7fe700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c45322700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c28004d50 0x7f0c280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 0x7f16280afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 0x7f16280afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44920/0 (socket says 172.21.15.50:44920) 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f1626ffd700 1 -- 172.21.15.50:0/3212744161 learned_addr learned my addr 172.21.15.50:0/3212744161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832bfff700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c0b41e0 0x7f832c159e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f831c0098e0 tx=0x7f831c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aca4fef058f84e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f162815d780 0x7f162806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c4ec0 con 0x7f1628158d40 2023-12-24T18:36:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162816db20 con 0x7f162815d780 2023-12-24T18:36:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280aeab0 con 0x7f16280c6a10 2023-12-24T18:36:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000f510 con 0x7f628c0caf40 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000f690 con 0x7f628c0caf40 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000fa50 con 0x7f628c0caf40 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 -- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 msgr2=0x7f0c28004810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c400b3940 0x7f0c28004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 -- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c28004d50 msgr2=0x7f0c280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c28004d50 0x7f0c280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f0c44b21700 1 -- 172.21.15.50:0/199816502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28003570 con 0x7f0c28003a60 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 -- start start 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a840ac9e0 0x7f2a8406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8406c820 con 0x7f2a840b0e30 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8406c510 con 0x7f2a840ac9e0 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a923700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8406cde0 con 0x7f2a84154ce0 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c0b3260 con 0x7f628c0caf40 2023-12-24T18:36:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c0b3820 con 0x7f628c0caf40 2023-12-24T18:36:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a89921700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a89921700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44930/0 (socket says 172.21.15.50:44930) 2023-12-24T18:36:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a89921700 1 -- 172.21.15.50:0/1921749481 learned_addr learned my addr 172.21.15.50:0/1921749481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832a7fc700 1 -- 172.21.15.50:0/41636469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b640 con 0x7f832c0b41e0 2023-12-24T18:36:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f16267fc700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1628158d40 0x7f16281519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f16277fe700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f162815d780 0x7f162806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c44b21700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c28003e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006fd0 tx=0x7f0c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58af44ebd2f011c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832a7fc700 1 -- 172.21.15.50:0/41636469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00b7a0 con 0x7f832c0b41e0 2023-12-24T18:36:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f832a7fc700 1 -- 172.21.15.50:0/41636469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00bb20 con 0x7f832c0b41e0 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.519+0000 7f2a8a122700 1 --2- 172.21.15.50:0/1921749481 >> v2:172.21.15.50:3300/0 conn(0x7f2a840ac9e0 0x7f2a8406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 -- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f162815d780 msgr2=0x7f162806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f162815d780 0x7f162806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 -- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1628158d40 msgr2=0x7f16281519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1628158d40 0x7f16281519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009420 con 0x7f16280c6a10 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a89921700 1 -- 172.21.15.50:0/1921749481 >> v2:172.21.15.50:3300/0 conn(0x7f2a840ac9e0 msgr2=0x7f2a8406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a89921700 1 --2- 172.21.15.50:0/1921749481 >> v2:172.21.15.50:3300/0 conn(0x7f2a840ac9e0 0x7f2a8406bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a89921700 1 -- 172.21.15.50:0/1921749481 >> v1:172.21.15.82:6789/0 conn(0x7f2a840b0e30 legacy=0x7f2a840ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a89921700 1 -- 172.21.15.50:0/1921749481 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840b1280 con 0x7f2a84154ce0 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f16277fe700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f162815d780 0x7f162806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f628c04be40 con 0x7f628c0caf40 2023-12-24T18:36:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a89921700 1 --2- 172.21.15.50:0/1921749481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009f20 tx=0x7f2a7c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb19411741d3573 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 -- 172.21.15.50:0/41636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c0b41e0 msgr2=0x7f832c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c0b41e0 0x7f832c159e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f831c0098e0 tx=0x7f831c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000e6e0 con 0x7f0c28003a60 2023-12-24T18:36:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000e840 con 0x7f0c28003a60 2023-12-24T18:36:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c3f7fe700 1 -- 172.21.15.50:0/199816502 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000ec00 con 0x7f0c28003a60 2023-12-24T18:36:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 -- 172.21.15.50:0/41636469 shutdown_connections 2023-12-24T18:36:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c0b41e0 0x7f832c159e30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 --2- 172.21.15.50:0/41636469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 -- 172.21.15.50:0/41636469 >> 172.21.15.50:0/41636469 conn(0x7f832c067b80 msgr2=0x7f832c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8891f700 1 -- 172.21.15.50:0/1921749481 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00e070 con 0x7f2a84154ce0 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8891f700 1 -- 172.21.15.50:0/1921749481 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00ba40 con 0x7f2a84154ce0 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8891f700 1 -- 172.21.15.50:0/1921749481 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0092e0 con 0x7f2a84154ce0 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f1626ffd700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 0x7f16280afac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f162000cdb0 tx=0x7f1620001ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 msgr2=0x7f0c28003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 --2- 172.21.15.50:0/199816502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c28003e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006fd0 tx=0x7f0c30009250 comp rx=0 tx=0).stop 2023-12-24T18:36:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45322700 1 -- 172.21.15.50:0/199816502 reap_dead start 2023-12-24T18:36:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 -- 172.21.15.50:0/1921749481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 msgr2=0x7f2a841550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1921749481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009f20 tx=0x7f2a7c009840 comp rx=0 tx=0).stop 2023-12-24T18:36:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 shutdown_connections 2023-12-24T18:36:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 >> 172.21.15.50:0/199816502 conn(0x7f0c40067b80 msgr2=0x7f0c400b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 shutdown_connections 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 -- 172.21.15.50:0/1921749481 shutdown_connections 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1921749481 >> v2:172.21.15.50:3300/0 conn(0x7f2a840ac9e0 0x7f2a8406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1921749481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a84154ce0 0x7f2a841550b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f2a8a923700 1 -- 172.21.15.50:0/1921749481 >> 172.21.15.50:0/1921749481 conn(0x7f2a84067ae0 msgr2=0x7f2a840cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f0c45b23700 1 -- 172.21.15.50:0/199816502 wait complete. 2023-12-24T18:36:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 -- 172.21.15.50:0/41636469 shutdown_connections 2023-12-24T18:36:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f8330c6b700 1 -- 172.21.15.50:0/41636469 wait complete. 2023-12-24T18:36:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f8330c6b700 1 Processor -- start 2023-12-24T18:36:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000aad0 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000ac30 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200070f0 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280aed60 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280af5a0 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f162815d5e0 con 0x7f16280c6a10 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.523+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f628001a400 con 0x7f628c0caf40 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6288ff9700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f62700606a0 0x7f6270062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f628007c520 con 0x7f628c0caf40 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f628bfff700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f62700606a0 0x7f6270062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6288ff9700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f6270069c50 0x7f627006c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f627006c750 con 0x7f6270069c50 2023-12-24T18:36:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f628004c880 con 0x7f628c0caf40 2023-12-24T18:36:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f0c45b23700 1 Processor -- start 2023-12-24T18:36:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f0c45b23700 1 -- start start 2023-12-24T18:36:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f8330c6b700 1 -- start start 2023-12-24T18:36:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f2a8a923700 1 -- 172.21.15.50:0/1921749481 shutdown_connections 2023-12-24T18:36:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f2a8a923700 1 -- 172.21.15.50:0/1921749481 wait complete. 2023-12-24T18:36:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f6291762700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f6270069c50 0x7f627006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f2a8a923700 1 Processor -- start 2023-12-24T18:36:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f16200074e0 con 0x7f16280c6a10 2023-12-24T18:36:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f160effd700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16140606a0 0x7f1614062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7fbf1d563700 1 Processor -- start 2023-12-24T18:36:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f6291762700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f6270069c50 0x7f627006c080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f628bfff700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f62700606a0 0x7f6270062b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62780099b0 tx=0x7f6278016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f0c45b23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c4008aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f0c45b23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 0x7f0c40089b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c4015a8c0 0x7f0c4008a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4008a5d0 con 0x7f0c28003a60 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400873b0 con 0x7f0c4015a8c0 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40087690 con 0x7f0c4008af70 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 0x7f0c40089b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 0x7f0c40089b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44946/0 (socket says 172.21.15.50:44946) 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 -- 172.21.15.50:0/1327121669 learned_addr learned my addr 172.21.15.50:0/1327121669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45322700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c4015a8c0 0x7f0c4008a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 -- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c4015a8c0 msgr2=0x7f0c4008a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c4015a8c0 0x7f0c4008a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 -- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 msgr2=0x7f0c4008aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c28003a60 0x7f0c4008aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40087970 con 0x7f0c4008af70 2023-12-24T18:36:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3ffff700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 0x7f0c40089b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cb40 tx=0x7f0c34001ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f2a8a923700 1 -- start start 2023-12-24T18:36:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a840ac9e0 0x7f2a841556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f162007cf70 con 0x7f16280c6a10 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f8330c6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06d8c0 0x7f832c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7f8330c6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 0x7f832c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f8330c6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c0acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 0x7f832c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 0x7f832c155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51490/0 (socket says 172.21.15.50:51490) 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 -- 172.21.15.50:0/3856412276 learned_addr learned my addr 172.21.15.50:0/3856412276 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b1590 con 0x7f832c06d8c0 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b0980 con 0x7f832c0b41e0 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b0c60 con 0x7f832c158e00 2023-12-24T18:36:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832bfff700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c0acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06d8c0 0x7f832c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 -- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 msgr2=0x7f832c0acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832c158e00 0x7f832c0acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 -- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06d8c0 msgr2=0x7f832c0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34007430 con 0x7f0c4008af70 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06d8c0 0x7f832c0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009a20 con 0x7f832c0b41e0 2023-12-24T18:36:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c34007590 con 0x7f0c4008af70 2023-12-24T18:36:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004a80 con 0x7f0c4008af70 2023-12-24T18:36:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.527+0000 7fbf1d563700 1 -- start start 2023-12-24T18:36:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a840b0e30 0x7f2a8413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7fbf1d563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c40087c50 con 0x7f0c4008af70 2023-12-24T18:36:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7fbf1d563700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbf180b41e0 0x7fbf18159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== osd.1 v2:172.21.15.50:6800/33900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f627006c750 con 0x7f6270069c50 2023-12-24T18:36:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40086ff0 con 0x7f0c4008af70 2023-12-24T18:36:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44956/0 (socket says 172.21.15.50:44956) 2023-12-24T18:36:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a84154ce0 0x7f2a84151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a89921700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a840ac9e0 0x7f2a841556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a89921700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a840ac9e0 0x7f2a841556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44964/0 (socket says 172.21.15.50:44964) 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f37d5e4c700 1 Processor -- start 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a89921700 1 -- 172.21.15.50:0/1030589506 learned_addr learned my addr 172.21.15.50:0/1030589506 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84150500 con 0x7f2a840b0e30 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84155da0 con 0x7f2a84154ce0 2023-12-24T18:36:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f160effd700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f1614069cd0 0x7f161406c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84156080 con 0x7f2a840ac9e0 2023-12-24T18:36:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f16267fc700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16140606a0 0x7f1614062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f2a8a122700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a84154ce0 0x7f2a84151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f37d5e4c700 1 -- start start 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.531+0000 7f832affd700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 0x7f832c155600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f832000c7c0 tx=0x7f8320007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf1cd62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbf180b41e0 0x7fbf18159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 -- 172.21.15.50:0/3563862796 learned_addr learned my addr 172.21.15.50:0/3563862796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1806b640 con 0x7fbf1806d8c0 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf18159710 con 0x7fbf180b41e0 2023-12-24T18:36:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b5e10 con 0x7fbf18158e00 2023-12-24T18:36:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f82b9523700 1 Processor -- start 2023-12-24T18:36:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f82b9523700 1 -- start start 2023-12-24T18:36:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f161406c7d0 con 0x7f1614069cd0 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a89120700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a840b0e30 0x7f2a8413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 -- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a840ac9e0 msgr2=0x7f2a841556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a840ac9e0 0x7f2a841556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 -- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a840b0e30 msgr2=0x7f2a8413f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1620082480 con 0x7f16280c6a10 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f16267fc700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16140606a0 0x7f1614062b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16180091e0 tx=0x7f1618017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f16277fe700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f1614069cd0 0x7f161406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c4004be40 con 0x7f0c4008af70 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320005b30 con 0x7f832c0b41e0 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c009420 con 0x7f832c0b41e0 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320005c90 con 0x7f832c0b41e0 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320005b30 con 0x7f832c0b41e0 2023-12-24T18:36:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 -- 172.21.15.50:0/3563862796 >> v2:172.21.15.82:3300/0 conn(0x7fbf180b41e0 msgr2=0x7fbf18159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 --2- 172.21.15.50:0/3563862796 >> v2:172.21.15.82:3300/0 conn(0x7fbf180b41e0 0x7fbf18159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 -- 172.21.15.50:0/3563862796 >> v1:172.21.15.50:6789/0 conn(0x7fbf1806d8c0 legacy=0x7fbf180b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 -- 172.21.15.50:0/3563862796 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1806b8e0 con 0x7fbf18158e00 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf17fff700 1 --2- 172.21.15.50:0/3563862796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf080099b0 tx=0x7fbf08009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=578dc2c759a7c493 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a840b0e30 0x7f2a8413f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009ae0 con 0x7f2a84154ce0 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a89120700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a840b0e30 0x7f2a8413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a122700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a84154ce0 0x7f2a84151720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a8406cd90 tx=0x7f2a7400b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74010070 con 0x7f2a84154ce0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a84156360 con 0x7f2a84154ce0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a84156920 con 0x7f2a84154ce0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400a8e0 con 0x7f2a84154ce0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400ac80 con 0x7f2a84154ce0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f16277fe700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f1614069cd0 0x7f161406c100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0c3400a550 con 0x7f0c4008af70 2023-12-24T18:36:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c0b1220 con 0x7f832c0b41e0 2023-12-24T18:36:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3563862796 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08009ea0 con 0x7fbf18158e00 2023-12-24T18:36:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3563862796 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800b820 con 0x7fbf18158e00 2023-12-24T18:36:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3563862796 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800bbc0 con 0x7fbf18158e00 2023-12-24T18:36:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== osd.0 v2:172.21.15.50:6816/33902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f161406c7d0 con 0x7f1614069cd0 2023-12-24T18:36:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.535+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f832c0b1f60 con 0x7f832c0b41e0 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d5e4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37d0156c30 0x7f37d00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c3cff9700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c2c060620 0x7f0c2c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f0c3407c4e0 con 0x7f0c4008af70 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c3cff9700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f0c2c069c50 0x7f0c2c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c2c06c750 con 0x7f0c2c069c50 2023-12-24T18:36:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c3407ea40 con 0x7f0c4008af70 2023-12-24T18:36:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d5e4c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d006d2d0 con 0x7f37d00ade60 2023-12-24T18:36:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d5e4c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d006d760 con 0x7f37d006c0f0 2023-12-24T18:36:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d5e4c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d006c9a0 con 0x7f37d0156c30 2023-12-24T18:36:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f37d006c0f0 0x7f37d00ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38254/0 (socket says 172.21.15.50:38254) 2023-12-24T18:36:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c45322700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f0c2c069c50 0x7f0c2c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cffff700 1 -- 172.21.15.50:0/2407830325 learned_addr learned my addr 172.21.15.50:0/2407830325 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d4e4a700 1 --2- 172.21.15.50:0/2407830325 >> v2:172.21.15.50:3300/0 conn(0x7f37d0156c30 0x7f37d00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139059053 0 0) 0x7f37d006d760 con 0x7f37d006c0f0 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b8003570 con 0x7f37d006c0f0 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285897892 0 0) 0x7f37d006d2d0 con 0x7f37d00ade60 2023-12-24T18:36:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d006d760 con 0x7f37d00ade60 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 msgr2=0x7fbf181591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7fbf1d563700 1 --2- 172.21.15.50:0/3563862796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf080099b0 tx=0x7fbf08009250 comp rx=0 tx=0).stop 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b9523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 0x7f82b41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b9523700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f82b40adb10 0x7f82b40adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b9523700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b40a9d10 con 0x7f82b4158cd0 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839912682 0 0) 0x7f37d006d760 con 0x7f37d00ade60 2023-12-24T18:36:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 >> v2:172.21.15.50:3300/0 conn(0x7f37d0156c30 msgr2=0x7f37d00ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 --2- 172.21.15.50:0/2407830325 >> v2:172.21.15.50:3300/0 conn(0x7f37d0156c30 0x7f37d00ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 >> v1:172.21.15.82:6789/0 conn(0x7f37d006c0f0 legacy=0x7f37d00ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d006cc80 con 0x7f37d00ade60 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f2a6b7fe700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a64000fd0 con 0x7f2a84154ce0 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f82b4158cd0 0x7f82b40a88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38266/0 (socket says 172.21.15.50:38266) 2023-12-24T18:36:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b3fff700 1 -- 172.21.15.50:0/1447127319 learned_addr learned my addr 172.21.15.50:0/1447127319 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f37c0001470 con 0x7f37d00ade60 2023-12-24T18:36:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 >> v1:172.21.15.50:6789/0 conn(0x7f37d00ade60 legacy=0x7f37d0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b40a9100 con 0x7f82b40adb10 2023-12-24T18:36:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40a93e0 con 0x7f82b406af10 2023-12-24T18:36:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82ab7fe700 1 --2- 172.21.15.50:0/1447127319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 0x7f82b41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37b8003c20 0x7f37b8003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37b8005210 0x7f37b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4001230 con 0x7f37b8004810 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d006c9a0 con 0x7f37b8005210 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b800c230 con 0x7f37b8003c20 2023-12-24T18:36:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f0c45322700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f0c2c069c50 0x7f0c2c06c080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82b37fe700 1 -- 172.21.15.50:0/1447127319 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879920951 0 0) 0x7f82b40a9d10 con 0x7f82b4158cd0 2023-12-24T18:36:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37cffff700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f37d564b700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37b8005210 0x7f37b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82ab7fe700 1 -- 172.21.15.50:0/1447127319 >> v2:172.21.15.82:3300/0 conn(0x7f82b40adb10 msgr2=0x7f82b40adf90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-24T18:36:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82ab7fe700 1 --2- 172.21.15.50:0/1447127319 >> v2:172.21.15.82:3300/0 conn(0x7f82b40adb10 0x7f82b40adf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82ab7fe700 1 -- 172.21.15.50:0/1447127319 >> v1:172.21.15.82:6789/0 conn(0x7f82b4158cd0 legacy=0x7f82b40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f82ab7fe700 1 -- 172.21.15.50:0/1447127319 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40ae4d0 con 0x7f82b406af10 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.539+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8320004a40 con 0x7f832c0b41e0 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37d4e4a700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37b8003c20 0x7f37b8003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 -- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37b8003c20 msgr2=0x7f37b8003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37b8003c20 0x7f37b8003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 -- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37b8005210 msgr2=0x7f37b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37b8005210 0x7f37b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 -- 172.21.15.50:0/2407830325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d006d760 con 0x7f37b8004810 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== osd.2 v2:172.21.15.50:6818/33907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0c2c06c750 con 0x7f0c2c069c50 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37d564b700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37b8005210 0x7f37b800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37d564b700 1 -- 172.21.15.50:0/2407830325 reap_dead start 2023-12-24T18:36:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82ab7fe700 1 --2- 172.21.15.50:0/1447127319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 0x7f82b41590a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f829c0098e0 tx=0x7f829c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f293a76faf251f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f0c44b21700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c2c060620 0x7f0c2c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82b37fe700 1 -- 172.21.15.50:0/1447127319 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c009e80 con 0x7f82b406af10 2023-12-24T18:36:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82b37fe700 1 -- 172.21.15.50:0/1447127319 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00b860 con 0x7f82b406af10 2023-12-24T18:36:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82b37fe700 1 -- 172.21.15.50:0/1447127319 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00bc20 con 0x7f82b406af10 2023-12-24T18:36:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f83137fe700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83180605b0 0x7f8318062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cffff700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37b8004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c3e0 tx=0x7f37c4001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672d7c6b19d26a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c400cc30 con 0x7f37b8004810 2023-12-24T18:36:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c400cd90 con 0x7f37b8004810 2023-12-24T18:36:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 msgr2=0x7f82b41590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f82b9523700 1 --2- 172.21.15.50:0/1447127319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 0x7f82b41590a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f829c0098e0 tx=0x7f829c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37cf7fe700 1 -- 172.21.15.50:0/2407830325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4004b40 con 0x7f37b8004810 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2a74014410 con 0x7f2a84154ce0 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f832007b9a0 con 0x7f832c0b41e0 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f83137fe700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f8318069be0 0x7f831806c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f831806c6e0 con 0x7f8318069be0 2023-12-24T18:36:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f832007bc60 con 0x7f832c0b41e0 2023-12-24T18:36:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f0c44b21700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c2c060620 0x7f0c2c062ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006f70 tx=0x7f0c3001a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83180605b0 0x7f8318062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f2a81ffb700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2a70060550 0x7f2a70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f2a7407caf0 con 0x7f2a84154ce0 2023-12-24T18:36:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37d5e4c700 1 -- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 msgr2=0x7f37b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f37d5e4c700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37b8004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c3e0 tx=0x7f37c4001e20 comp rx=0 tx=0).stop 2023-12-24T18:36:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.543+0000 7f832bfff700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f8318069be0 0x7f831806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a81ffb700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7f2a70069b00 0x7f2a7006bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a7006c600 con 0x7f2a70069b00 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 -- 172.21.15.50:0/2407830325 shutdown_connections 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 --2- 172.21.15.50:0/2407830325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37b8004c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 -- 172.21.15.50:0/2407830325 >> 172.21.15.50:0/2407830325 conn(0x7f37d0067ae0 msgr2=0x7f37d00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a89921700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2a70060550 0x7f2a70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a7404cdf0 con 0x7f2a84154ce0 2023-12-24T18:36:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 shutdown_connections 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 --2- 172.21.15.50:0/1447127319 >> v2:172.21.15.82:3300/0 conn(0x7f82b40adb10 0x7f82b40adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 --2- 172.21.15.50:0/1447127319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b406af10 0x7f82b41590a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 >> 172.21.15.50:0/1447127319 conn(0x7f82b4067ae0 msgr2=0x7f82b40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 shutdown_connections 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 --2- 172.21.15.50:0/3563862796 >> v2:172.21.15.82:3300/0 conn(0x7fbf180b41e0 0x7fbf18159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 --2- 172.21.15.50:0/3563862796 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf18158e00 0x7fbf181591d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 >> 172.21.15.50:0/3563862796 conn(0x7fbf18067b80 msgr2=0x7fbf180b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83180605b0 0x7f8318062a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83240099f0 tx=0x7f832400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 -- 172.21.15.50:0/2407830325 shutdown_connections 2023-12-24T18:36:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 -- 172.21.15.50:0/2407830325 wait complete. 2023-12-24T18:36:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a89120700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7f2a70069b00 0x7f2a7006bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f832bfff700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f8318069be0 0x7f831806c010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a89921700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2a70060550 0x7f2a70062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009ab0 tx=0x7f2a7c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 shutdown_connections 2023-12-24T18:36:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 -- 172.21.15.50:0/1447127319 wait complete. 2023-12-24T18:36:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 shutdown_connections 2023-12-24T18:36:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f2a89120700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7f2a70069b00 0x7f2a7006bf30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7fbf1d563700 1 -- 172.21.15.50:0/3563862796 wait complete. 2023-12-24T18:36:46.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f37d5e4c700 1 Processor -- start 2023-12-24T18:36:46.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== osd.3 v2:172.21.15.50:6803/33905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f831806c6e0 con 0x7f8318069be0 2023-12-24T18:36:46.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== osd.5 v2:172.21.15.82:6824/34158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2a7006c600 con 0x7f2a70069b00 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.547+0000 7f82b9523700 1 Processor -- start 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 -- start start 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 -- start start 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37d01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37d016dd90 0x7f37d00a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d00a6310 0x7f37d00a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00a6cd0 con 0x7f37b8004810 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00a4e30 con 0x7f37d00a6310 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d5e4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00a5110 con 0x7f37d016dd90 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 0x7f82b4142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37d01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37d01538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60878/0 (socket says 172.21.15.50:60878) 2023-12-24T18:36:46.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 -- 172.21.15.50:0/4249794209 learned_addr learned my addr 172.21.15.50:0/4249794209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b40adb10 0x7f82b415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b4158cd0 0x7f82b415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 0x7f82b4142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 0x7f82b4142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51534/0 (socket says 172.21.15.50:51534) 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82ab7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b40adb10 0x7f82b415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4159ef0 con 0x7f82b4158cd0 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b3fff700 1 -- 172.21.15.50:0/1329333154 learned_addr learned my addr 172.21.15.50:0/1329333154 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415a1d0 con 0x7f82b406af10 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415a4b0 con 0x7f82b40adb10 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f82b8d22700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b4158cd0 0x7f82b415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 -- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b40adb10 msgr2=0x7f82b415c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82b40adb10 0x7f82b415c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 -- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b4158cd0 msgr2=0x7f82b415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b4158cd0 0x7f82b415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c009420 con 0x7f82b406af10 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b8d22700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b4158cd0 0x7f82b415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d564b700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d00a6310 0x7f37d00a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37cffff700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37d016dd90 0x7f37d00a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 -- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37d016dd90 msgr2=0x7f37d00a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37d016dd90 0x7f37d00a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 -- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d00a6310 msgr2=0x7f37d00a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d00a6310 0x7f37d00a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.551+0000 7f37d4e4a700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00a53f0 con 0x7f37b8004810 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 Processor -- start 2023-12-24T18:36:46.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b3fff700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 0x7f82b4142df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c7e0 tx=0x7f82a4007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 -- start start 2023-12-24T18:36:46.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4005b30 con 0x7f82b406af10 2023-12-24T18:36:46.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4005c90 con 0x7f82b406af10 2023-12-24T18:36:46.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4007320 con 0x7f82b406af10 2023-12-24T18:36:46.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f37d4e4a700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37d01538b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37c8007f70 tx=0x7f37c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf1806d8c0 0x7fbf1815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf180b41e0 0x7fbf180afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 0x7fbf180b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b0d90 con 0x7fbf18158e00 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181554d0 con 0x7fbf180b41e0 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1d563700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b07d0 con 0x7fbf1806d8c0 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b415a790 con 0x7f82b406af10 2023-12-24T18:36:46.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b40b0760 con 0x7f82b406af10 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800e030 con 0x7f37b8004810 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1cd62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 0x7fbf180b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1cd62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 0x7fbf180b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60888/0 (socket says 172.21.15.50:60888) 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf1cd62700 1 -- 172.21.15.50:0/2973870207 learned_addr learned my addr 172.21.15.50:0/2973870207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7fbf17fff700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf1806d8c0 0x7fbf1815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf177fe700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf180b41e0 0x7fbf180afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 -- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf1806d8c0 msgr2=0x7fbf1815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf1806d8c0 0x7fbf1815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 -- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf180b41e0 msgr2=0x7fbf180afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf180b41e0 0x7fbf180afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080094f0 con 0x7fbf18158e00 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf177fe700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf180b41e0 0x7fbf180afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1cd62700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 0x7fbf180b01b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e90 tx=0x7fbf1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000cc20 con 0x7fbf18158e00 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000f040 con 0x7fbf18158e00 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10014480 con 0x7fbf18158e00 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8298000fd0 con 0x7f82b406af10 2023-12-24T18:36:46.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180b0ab0 con 0x7fbf18158e00 2023-12-24T18:36:46.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f82a401b3b0 con 0x7f82b406af10 2023-12-24T18:36:46.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7f82b0ff9700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f82940605a0 0x7f8294062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.559+0000 7f82ab7fe700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f82940605a0 0x7f8294062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8011de0 con 0x7f37b8004810 2023-12-24T18:36:46.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.555+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80166c0 con 0x7f37b8004810 2023-12-24T18:36:46.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f82a407bff0 con 0x7f82b406af10 2023-12-24T18:36:46.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 --> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f628c06bca0 con 0x7f6270069c50 2023-12-24T18:36:46.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6288ff9700 1 -- 172.21.15.50:0/2935696218 <== osd.1 v2:172.21.15.50:6800/33900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f628c06bca0 con 0x7f6270069c50 2023-12-24T18:36:46.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbf100147f0 con 0x7fbf18158e00 2023-12-24T18:36:46.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1815b310 con 0x7fbf18158e00 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82b0ff9700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7f8294069bd0 0x7f829406c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f829406c6d0 con 0x7f8294069bd0 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82ab7fe700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f82940605a0 0x7f8294062a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f829c0098e0 tx=0x7f829c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a407e590 con 0x7f82b406af10 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f82b8d22700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7f8294069bd0 0x7f829406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d00a56d0 con 0x7f37b8004810 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d0170630 con 0x7f37b8004810 2023-12-24T18:36:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37d00a4c20 con 0x7f37b8004810 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f6270069c50 msgr2=0x7f627006c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f6270069c50 0x7f627006c080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f62700606a0 msgr2=0x7f6270062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f62700606a0 0x7f6270062b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62780099b0 tx=0x7f6278016000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 msgr2=0x7f628c16ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.563+0000 7f6291f63700 1 --2- 172.21.15.50:0/2935696218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f628c0caf40 0x7f628c16ca70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f628000b600 tx=0x7f62800091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f6291762700 1 -- 172.21.15.50:0/2935696218 reap_dead start 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf1804be40 con 0x7fbf18158e00 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbefffff700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf04060620 0x7fbf04062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fbf1007ca90 con 0x7fbf18158e00 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 shutdown_connections 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 >> 172.21.15.50:0/2935696218 conn(0x7f628c0670b0 msgr2=0x7f628c06b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbefffff700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7fbf04069bd0 0x7fbf0406c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf0406c6d0 con 0x7fbf04069bd0 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf1004ce10 con 0x7fbf18158e00 2023-12-24T18:36:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f82b8d22700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7f8294069bd0 0x7f829406c000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 shutdown_connections 2023-12-24T18:36:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f6291f63700 1 -- 172.21.15.50:0/2935696218 wait complete. 2023-12-24T18:36:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbf17fff700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf04060620 0x7fbf04062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbf177fe700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7fbf04069bd0 0x7fbf0406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f37c8003020 con 0x7f37b8004810 2023-12-24T18:36:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7fbf17fff700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf04060620 0x7fbf04062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf080099b0 tx=0x7fbf08016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.567+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== osd.6 v2:172.21.15.82:6808/34156 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f829406c6d0 con 0x7f8294069bd0 2023-12-24T18:36:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7fbf177fe700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7fbf04069bd0 0x7fbf0406c000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37ccff9700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37bc060620 0x7f37bc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f37c800f070 con 0x7f37b8004810 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37ccff9700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f37bc069c50 0x7f37bc06c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37bc06c750 con 0x7f37bc069c50 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37c807e010 con 0x7f37b8004810 2023-12-24T18:36:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37cffff700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37bc060620 0x7f37bc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37d564b700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f37bc069c50 0x7f37bc06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== osd.4 v2:172.21.15.82:6800/34155 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbf0406c6d0 con 0x7fbf04069bd0 2023-12-24T18:36:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f2a6b7fe700 1 -- 172.21.15.50:0/1030589506 --> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a64002d30 con 0x7f2a70069b00 2023-12-24T18:36:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37cffff700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37bc060620 0x7f37bc062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c4007cf0 tx=0x7f37c4015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f37d564b700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f37bc069c50 0x7f37bc06c080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.571+0000 7f2a81ffb700 1 -- 172.21.15.50:0/1030589506 <== osd.5 v2:172.21.15.82:6824/34158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a64002d30 con 0x7f2a70069b00 2023-12-24T18:36:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== osd.7 v2:172.21.15.82:6810/34157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f37bc06c750 con 0x7f37bc069c50 2023-12-24T18:36:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7f2a70069b00 msgr2=0x7f2a7006bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7f2a70069b00 0x7f2a7006bf30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2a70060550 msgr2=0x7f2a70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 --> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c400877d0 con 0x7f0c2c069c50 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2a70060550 0x7f2a70062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009ab0 tx=0x7f2a7c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a84154ce0 msgr2=0x7f2a84151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 --2- 172.21.15.50:0/1030589506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a84154ce0 0x7f2a84151720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a8406cd90 tx=0x7f2a7400b380 comp rx=0 tx=0).stop 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a122700 1 -- 172.21.15.50:0/1030589506 reap_dead start 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.575+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 shutdown_connections 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 >> 172.21.15.50:0/1030589506 conn(0x7f2a84067ae0 msgr2=0x7f2a8406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 shutdown_connections 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f2a8a923700 1 -- 172.21.15.50:0/1030589506 wait complete. 2023-12-24T18:36:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c3cff9700 1 -- 172.21.15.50:0/1327121669 <== osd.2 v2:172.21.15.50:6818/33907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c400877d0 con 0x7f0c2c069c50 2023-12-24T18:36:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 --> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16280652e0 con 0x7f1614069cd0 2023-12-24T18:36:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f160effd700 1 -- 172.21.15.50:0/3212744161 <== osd.0 v2:172.21.15.50:6816/33902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16280652e0 con 0x7f1614069cd0 2023-12-24T18:36:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f0c2c069c50 msgr2=0x7f0c2c06c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f0c2c069c50 0x7f0c2c06c080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c2c060620 msgr2=0x7f0c2c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c2c060620 0x7f0c2c062ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006f70 tx=0x7f0c3001a000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 msgr2=0x7f0c40089b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 --2- 172.21.15.50:0/1327121669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c4008af70 0x7f0c40089b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cb40 tx=0x7f0c34001ca0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45322700 1 -- 172.21.15.50:0/1327121669 reap_dead start 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f1614069cd0 msgr2=0x7f161406c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f1614069cd0 0x7f161406c100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16140606a0 msgr2=0x7f1614062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16140606a0 0x7f1614062b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16180091e0 tx=0x7f1618017000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 msgr2=0x7f16280afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 --2- 172.21.15.50:0/3212744161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16280c6a10 0x7f16280afac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f162000cdb0 tx=0x7f1620001ae0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 shutdown_connections 2023-12-24T18:36:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 >> 172.21.15.50:0/1327121669 conn(0x7f0c40067b80 msgr2=0x7f0c400cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f16277fe700 1 -- 172.21.15.50:0/3212744161 reap_dead start 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 shutdown_connections 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.579+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 >> 172.21.15.50:0/3212744161 conn(0x7f16280cbba0 msgr2=0x7f1628153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.583+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 shutdown_connections 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.583+0000 7f0c45b23700 1 -- 172.21.15.50:0/1327121669 wait complete. 2023-12-24T18:36:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.583+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 shutdown_connections 2023-12-24T18:36:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.583+0000 7f162d2ae700 1 -- 172.21.15.50:0/3212744161 wait complete. 2023-12-24T18:36:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.583+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 --> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f832c04be40 con 0x7f8318069be0 2023-12-24T18:36:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f83137fe700 1 -- 172.21.15.50:0/3856412276 <== osd.3 v2:172.21.15.50:6803/33905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f832c04be40 con 0x7f8318069be0 2023-12-24T18:36:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f8318069be0 msgr2=0x7f831806c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f8318069be0 0x7f831806c010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.611 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83180605b0 msgr2=0x7f8318062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83180605b0 0x7f8318062a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83240099f0 tx=0x7f832400b040 comp rx=0 tx=0).stop 2023-12-24T18:36:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 msgr2=0x7f832c155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f8330c6b700 1 --2- 172.21.15.50:0/3856412276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c0b41e0 0x7f832c155600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f832000c7c0 tx=0x7f8320007f70 comp rx=0 tx=0).stop 2023-12-24T18:36:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.587+0000 7f832bfff700 1 -- 172.21.15.50:0/3856412276 reap_dead start 2023-12-24T18:36:46.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-24T18:36:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.591+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 shutdown_connections 2023-12-24T18:36:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.591+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 >> 172.21.15.50:0/3856412276 conn(0x7f832c067b80 msgr2=0x7f832c087110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.591+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 shutdown_connections 2023-12-24T18:36:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.591+0000 7f8330c6b700 1 -- 172.21.15.50:0/3856412276 wait complete. 2023-12-24T18:36:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.595+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 --> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37d016e530 con 0x7f37bc069c50 2023-12-24T18:36:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.595+0000 7f37ccff9700 1 -- 172.21.15.50:0/4249794209 <== osd.7 v2:172.21.15.82:6810/34157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37d016e530 con 0x7f37bc069c50 2023-12-24T18:36:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.595+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f37bc069c50 msgr2=0x7f37bc06c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.595+0000 7f37d5e4c700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f37bc069c50 0x7f37bc06c080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37bc060620 msgr2=0x7f37bc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37bc060620 0x7f37bc062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c4007cf0 tx=0x7f37c4015000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 msgr2=0x7f37d01538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 --2- 172.21.15.50:0/4249794209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b8004810 0x7f37d01538b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37c8007f70 tx=0x7f37c800b040 comp rx=0 tx=0).stop 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d564b700 1 -- 172.21.15.50:0/4249794209 reap_dead start 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 shutdown_connections 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 >> 172.21.15.50:0/4249794209 conn(0x7f37d0067ae0 msgr2=0x7f37d00ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 --> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8298002d30 con 0x7f8294069bd0 2023-12-24T18:36:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 shutdown_connections 2023-12-24T18:36:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f37d5e4c700 1 -- 172.21.15.50:0/4249794209 wait complete. 2023-12-24T18:36:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b0ff9700 1 -- 172.21.15.50:0/1329333154 <== osd.6 v2:172.21.15.82:6808/34156 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8298002d30 con 0x7f8294069bd0 2023-12-24T18:36:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7f8294069bd0 msgr2=0x7f829406c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7f8294069bd0 0x7f829406c000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f82940605a0 msgr2=0x7f8294062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f82940605a0 0x7f8294062a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f829c0098e0 tx=0x7f829c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 msgr2=0x7f82b4142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 --2- 172.21.15.50:0/1329333154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b406af10 0x7f82b4142df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c7e0 tx=0x7f82a4007df0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.617 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-24T18:36:46.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b8d22700 1 -- 172.21.15.50:0/1329333154 reap_dead start 2023-12-24T18:36:46.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-24T18:36:46.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 shutdown_connections 2023-12-24T18:36:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 >> 172.21.15.50:0/1329333154 conn(0x7f82b4067ae0 msgr2=0x7f82b40caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 shutdown_connections 2023-12-24T18:36:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.599+0000 7f82b9523700 1 -- 172.21.15.50:0/1329333154 wait complete. 2023-12-24T18:36:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.603+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 --> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf1806bbc0 con 0x7fbf04069bd0 2023-12-24T18:36:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbefffff700 1 -- 172.21.15.50:0/2973870207 <== osd.4 v2:172.21.15.82:6800/34155 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf1806bbc0 con 0x7fbf04069bd0 2023-12-24T18:36:46.620 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-24T18:36:46.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-24T18:36:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7fbf04069bd0 msgr2=0x7fbf0406c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7fbf04069bd0 0x7fbf0406c000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf04060620 msgr2=0x7fbf04062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf04060620 0x7fbf04062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf080099b0 tx=0x7fbf08016000 comp rx=0 tx=0).stop 2023-12-24T18:36:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 msgr2=0x7fbf180b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 --2- 172.21.15.50:0/2973870207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf18158e00 0x7fbf180b01b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e90 tx=0x7fbf1000b040 comp rx=0 tx=0).stop 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1cd62700 1 -- 172.21.15.50:0/2973870207 reap_dead start 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 shutdown_connections 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 >> 172.21.15.50:0/2973870207 conn(0x7fbf18067b80 msgr2=0x7fbf180aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 shutdown_connections 2023-12-24T18:36:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.607+0000 7fbf1d563700 1 -- 172.21.15.50:0/2973870207 wait complete. 2023-12-24T18:36:46.623 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:46.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-24T18:36:46.623 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:46.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-24T18:36:46.624 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:46.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-24T18:36:46.626 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:46.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-24T18:36:46.642 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-24T18:36:46.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-24T18:36:46.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.811+0000 7fcecef45700 1 Processor -- start 2023-12-24T18:36:46.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.811+0000 7fcecef45700 1 -- start start 2023-12-24T18:36:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcecef45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 0x7fcec806b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcecef45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcec806bb70 0x7fcec806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcecef45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec8156660 con 0x7fcec806aac0 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fceccce1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 0x7fcec806b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcec806bb70 0x7fcec806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fceccce1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 0x7fcec806b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45024/0 (socket says 172.21.15.50:45024) 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fceccce1700 1 -- 172.21.15.50:0/2157961463 learned_addr learned my addr 172.21.15.50:0/2157961463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcecef45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec806af60 con 0x7fcec806bb70 2023-12-24T18:36:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81557e0 con 0x7fcec8152970 2023-12-24T18:36:46.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 -- 172.21.15.50:0/2157961463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 msgr2=0x7fcec806b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 --2- 172.21.15.50:0/2157961463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 0x7fcec806b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 -- 172.21.15.50:0/2157961463 >> v1:172.21.15.50:6789/0 conn(0x7fcec806aac0 legacy=0x7fcec806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 -- 172.21.15.50:0/2157961463 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8155ac0 con 0x7fcec806bb70 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.815+0000 7fcec7fff700 1 --2- 172.21.15.50:0/2157961463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806bb70 0x7fcec806a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009e60 tx=0x7fcec0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2334030cca98ee85 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcec77fe700 1 -- 172.21.15.50:0/2157961463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000e070 con 0x7fcec806bb70 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcec77fe700 1 -- 172.21.15.50:0/2157961463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec000bb60 con 0x7fcec806bb70 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcec77fe700 1 -- 172.21.15.50:0/2157961463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000e070 con 0x7fcec806bb70 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806bb70 msgr2=0x7fcec806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 --2- 172.21.15.50:0/2157961463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806bb70 0x7fcec806a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009e60 tx=0x7fcec0009780 comp rx=0 tx=0).stop 2023-12-24T18:36:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 shutdown_connections 2023-12-24T18:36:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 --2- 172.21.15.50:0/2157961463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806bb70 0x7fcec806a580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 --2- 172.21.15.50:0/2157961463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec8152970 0x7fcec806b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 >> 172.21.15.50:0/2157961463 conn(0x7fcec8067b80 msgr2=0x7fcec80cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 Processor -- start 2023-12-24T18:36:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 -- start start 2023-12-24T18:36:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 0x7fdc68033cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 shutdown_connections 2023-12-24T18:36:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fcecef45700 1 -- 172.21.15.50:0/2157961463 wait complete. 2023-12-24T18:36:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680530e0 con 0x7fdc680e7930 2023-12-24T18:36:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680533c0 con 0x7fdc680e3fa0 2023-12-24T18:36:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.819+0000 7fdc754f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680536a0 con 0x7fdc680e4370 2023-12-24T18:36:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6e7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc680e7930 0x7fdc68054180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38272/0 (socket says 172.21.15.50:38272) 2023-12-24T18:36:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45038/0 (socket says 172.21.15.50:45038) 2023-12-24T18:36:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 -- 172.21.15.50:0/3205979295 learned_addr learned my addr 172.21.15.50:0/3205979295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6effd700 1 --2- 172.21.15.50:0/3205979295 >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 0x7fdc68033cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 -- 172.21.15.50:0/3205979295 >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 msgr2=0x7fdc68033cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 --2- 172.21.15.50:0/3205979295 >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 0x7fdc68033cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 -- 172.21.15.50:0/3205979295 >> v1:172.21.15.82:6789/0 conn(0x7fdc680e7930 legacy=0x7fdc68054180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6effd700 1 --2- 172.21.15.50:0/3205979295 >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 0x7fdc68033cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 -- 172.21.15.50:0/3205979295 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc68053980 con 0x7fdc680e4370 2023-12-24T18:36:46.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fcecef45700 1 Processor -- start 2023-12-24T18:36:46.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fcecef45700 1 -- start start 2023-12-24T18:36:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6f7fe700 1 --2- 172.21.15.50:0/3205979295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc70063e00 tx=0x7fdc70066dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb4adeb5f3b93d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6dffb700 1 -- 172.21.15.50:0/3205979295 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700652e0 con 0x7fdc680e4370 2023-12-24T18:36:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6dffb700 1 -- 172.21.15.50:0/3205979295 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7006b040 con 0x7fdc680e4370 2023-12-24T18:36:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc6dffb700 1 -- 172.21.15.50:0/3205979295 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7006c480 con 0x7fdc680e4370 2023-12-24T18:36:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fcecef45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fcecef45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 0x7fcec814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fcecef45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 0x7fcec8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc754f0700 1 -- 172.21.15.50:0/3205979295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 msgr2=0x7fdc68005e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.823+0000 7fdc754f0700 1 --2- 172.21.15.50:0/3205979295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc70063e00 tx=0x7fdc70066dd0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 -- 172.21.15.50:0/3205979295 shutdown_connections 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 --2- 172.21.15.50:0/3205979295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e4370 0x7fdc68005e00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 --2- 172.21.15.50:0/3205979295 >> v2:172.21.15.50:3300/0 conn(0x7fdc680e3fa0 0x7fdc68033cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 -- 172.21.15.50:0/3205979295 >> 172.21.15.50:0/3205979295 conn(0x7fdc680516a0 msgr2=0x7fdc68051aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 -- 172.21.15.50:0/3205979295 shutdown_connections 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60920/0 (socket says 172.21.15.50:60920) 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 -- 172.21.15.50:0/2149520209 learned_addr learned my addr 172.21.15.50:0/2149520209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcec7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 0x7fcec814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec814c060 con 0x7fcec806aac0 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec814fda0 con 0x7fcec8152970 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8150080 con 0x7fcec806bb70 2023-12-24T18:36:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcecd4e2700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 0x7fcec8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 -- 172.21.15.50:0/3205979295 wait complete. 2023-12-24T18:36:46.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 -- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 msgr2=0x7fcec814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 0x7fcec814f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 -- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 msgr2=0x7fcec8150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 0x7fcec8150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0009a20 con 0x7fcec806aac0 2023-12-24T18:36:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fceccce1700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ea20 tx=0x7fceb8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7f31b1f85700 1 Processor -- start 2023-12-24T18:36:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7f31b1f85700 1 -- start start 2023-12-24T18:36:46.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fdc754f0700 1 Processor -- start 2023-12-24T18:36:46.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcec7fff700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 0x7fcec814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcecd4e2700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 0x7fcec8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800c850 con 0x7fcec806aac0 2023-12-24T18:36:46.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.827+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb800c9b0 con 0x7fcec806aac0 2023-12-24T18:36:46.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800cd30 con 0x7fcec806aac0 2023-12-24T18:36:46.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec8150360 con 0x7fcec806aac0 2023-12-24T18:36:46.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80c9890 con 0x7fcec806aac0 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31b1f85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31ac0cb4a0 0x7f31ac15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31b1f85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31ab7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f31ac15e240 0x7f31ac0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38284/0 (socket says 172.21.15.50:38284) 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31b1f85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac0ced30 con 0x7f31ac15e240 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31b1f85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac0cc540 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31b1f85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0cb930 con 0x7f31ac0ce390 2023-12-24T18:36:46.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31ab7fe700 1 -- 172.21.15.50:0/583216383 learned_addr learned my addr 172.21.15.50:0/583216383 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 -- start start 2023-12-24T18:36:46.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e3fa0 0x7fdc680e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 0x7fdc6804e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 0x7fdc680dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6804be00 con 0x7fdc680e7930 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31abfff700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31aaffd700 1 --2- 172.21.15.50:0/583216383 >> v2:172.21.15.82:3300/0 conn(0x7f31ac0cb4a0 0x7f31ac15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80c9a80 con 0x7fcec806aac0 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6803a790 con 0x7fdc680e4370 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc754f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6804c050 con 0x7fdc680e3fa0 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 0x7fdc680dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 0x7fdc680dbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60926/0 (socket says 172.21.15.50:60926) 2023-12-24T18:36:46.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6f7fe700 1 -- 172.21.15.50:0/4156725195 learned_addr learned my addr 172.21.15.50:0/4156725195 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31aa7fc700 1 -- 172.21.15.50:0/583216383 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034183079 0 0) 0x7f31a4001110 con 0x7f31ac15e240 2023-12-24T18:36:46.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31aa7fc700 1 -- 172.21.15.50:0/583216383 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3198003570 con 0x7f31ac15e240 2023-12-24T18:36:46.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7f31aaffd700 1 -- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 msgr2=0x7f31ac0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 0x7fdc6804e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6effd700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e3fa0 0x7fdc680e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 -- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e3fa0 msgr2=0x7fdc680e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e3fa0 0x7fdc680e4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 -- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 msgr2=0x7fdc680dbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 0x7fdc680dbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.831+0000 7fdc6e7fc700 1 -- 172.21.15.50:0/4156725195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6804c330 con 0x7fdc680e4370 2023-12-24T18:36:46.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aaffd700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aaffd700 1 -- 172.21.15.50:0/583216383 >> v1:172.21.15.82:6789/0 conn(0x7f31ac15e240 legacy=0x7f31ac0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aaffd700 1 -- 172.21.15.50:0/583216383 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0cbc10 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31abfff700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fdc6e7fc700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 0x7fdc6804e620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000c560 tx=0x7fdc60007e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aaffd700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15e610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e60 tx=0x7f319c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b37c758a947d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60005a70 con 0x7fdc680e4370 2023-12-24T18:36:46.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60005bd0 con 0x7fdc680e4370 2023-12-24T18:36:46.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aa7fc700 1 -- 172.21.15.50:0/583216383 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00e070 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aa7fc700 1 -- 172.21.15.50:0/583216383 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c00bb60 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31b1f85700 1 -- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 msgr2=0x7f31ac15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600070d0 con 0x7fdc680e4370 2023-12-24T18:36:46.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7f31aa7fc700 1 -- 172.21.15.50:0/583216383 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00e070 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15e610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e60 tx=0x7f319c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:46.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7fdc754f0700 1 -- 172.21.15.50:0/4156725195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6804c610 con 0x7fdc680e4370 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7fdc754f0700 1 -- 172.21.15.50:0/4156725195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc680dc2b0 con 0x7fdc680e4370 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 -- 172.21.15.50:0/583216383 shutdown_connections 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 --2- 172.21.15.50:0/583216383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15e610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 -- 172.21.15.50:0/583216383 >> 172.21.15.50:0/583216383 conn(0x7f31ac0cffb0 msgr2=0x7f31ac0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 -- 172.21.15.50:0/583216383 shutdown_connections 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7f31b1f85700 1 -- 172.21.15.50:0/583216383 wait complete. 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc480052b0 con 0x7fdc680e4370 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fceb8013680 con 0x7fcec806aac0 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fcec4ff9700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 0x7fceb4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.835+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fceb807d130 con 0x7fcec806aac0 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7fcec7fff700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 0x7fceb4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.839+0000 7fcec7fff700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 0x7fceb4062ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097c0 tx=0x7fcec001d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdc60007440 con 0x7fdc680e4370 2023-12-24T18:36:46.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7f31b1f85700 1 Processor -- start 2023-12-24T18:36:46.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7f31b1f85700 1 -- start start 2023-12-24T18:36:46.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fceb804d420 con 0x7fcec806aac0 2023-12-24T18:36:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7fdc56ffd700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 0x7fdc5c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.843+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fdc6007be00 con 0x7fdc680e4370 2023-12-24T18:36:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7fdc6effd700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 0x7fdc5c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 0x7f31ac0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1720c0 con 0x7f31ac15e240 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1714b0 con 0x7f31ac0cb4a0 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51586/0 (socket says 172.21.15.50:51586) 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31ab7fe700 1 -- 172.21.15.50:0/2498098392 learned_addr learned my addr 172.21.15.50:0/2498098392 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31abfff700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 0x7f31ac0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac171790 con 0x7f31ac0ce390 2023-12-24T18:36:46.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7fdc6effd700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 0x7fdc5c062b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009c20 tx=0x7fdc64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 -- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 msgr2=0x7f31ac15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 -- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 msgr2=0x7f31ac0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 0x7f31ac0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c009a20 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31abfff700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 0x7f31ac0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.847+0000 7f31aaffd700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0c9980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f319c016000 tx=0x7f319c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c012ce0 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c021070 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c026680 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac171a70 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac171160 con 0x7f31ac0ce390 2023-12-24T18:36:46.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.851+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac0b3f10 con 0x7f31ac0ce390 2023-12-24T18:36:46.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.855+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdc6004c0e0 con 0x7fdc680e4370 2023-12-24T18:36:46.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.855+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f319c023030 con 0x7f31ac0ce390 2023-12-24T18:36:46.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.855+0000 7f31a37fe700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 0x7f318c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.859+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f319c07e900 con 0x7f31ac0ce390 2023-12-24T18:36:46.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.859+0000 7f31ab7fe700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 0x7f318c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.859+0000 7f31ab7fe700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 0x7f318c062a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31ac1710c0 tx=0x7f31a4007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.867+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f31ac0b3f10 con 0x7f31ac0ce390 2023-12-24T18:36:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.895+0000 7fc32782e700 1 Processor -- start 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.895+0000 7fc32782e700 1 -- start start 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc32782e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc32006aa00 0x7fc3201601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc324dc9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc32006a580 0x7fc32015cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37446/0 (socket says 172.21.15.50:37446) 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc324dc9700 1 -- 172.21.15.50:0/1693474055 learned_addr learned my addr 172.21.15.50:0/1693474055 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc320156660 con 0x7fc32006a580 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3201557e0 con 0x7fc320152970 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc320155ac0 con 0x7fc32006aa00 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc325dcb700 1 --2- 172.21.15.50:0/1693474055 >> v2:172.21.15.82:3300/0 conn(0x7fc32006aa00 0x7fc3201601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.899+0000 7fc317fff700 1 -- 172.21.15.50:0/1693474055 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160446950 0 0) 0x7fc320156660 con 0x7fc32006a580 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc317fff700 1 -- 172.21.15.50:0/1693474055 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c004680 con 0x7fc32006a580 2023-12-24T18:36:46.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc325dcb700 1 -- 172.21.15.50:0/1693474055 >> v1:172.21.15.82:6789/0 conn(0x7fc320152970 legacy=0x7fc32006b630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-24T18:36:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc325dcb700 1 -- 172.21.15.50:0/1693474055 >> v1:172.21.15.50:6789/0 conn(0x7fc32006a580 legacy=0x7fc32015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc325dcb700 1 -- 172.21.15.50:0/1693474055 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320155da0 con 0x7fc32006aa00 2023-12-24T18:36:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc325dcb700 1 --2- 172.21.15.50:0/1693474055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc3201601e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0098e0 tx=0x7fc31c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f2a5a2b2e64c1e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc317fff700 1 -- 172.21.15.50:0/1693474055 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00f6b0 con 0x7fc32006aa00 2023-12-24T18:36:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc317fff700 1 -- 172.21.15.50:0/1693474055 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00f810 con 0x7fc32006aa00 2023-12-24T18:36:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 msgr2=0x7fc3201601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 --2- 172.21.15.50:0/1693474055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc3201601e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0098e0 tx=0x7fc31c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 shutdown_connections 2023-12-24T18:36:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 --2- 172.21.15.50:0/1693474055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc3201601e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 >> 172.21.15.50:0/1693474055 conn(0x7fc320067b80 msgr2=0x7fc3200cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.903+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 shutdown_connections 2023-12-24T18:36:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.907+0000 7fc32782e700 1 -- 172.21.15.50:0/1693474055 wait complete. 2023-12-24T18:36:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.907+0000 7f619cbcc700 1 Processor -- start 2023-12-24T18:36:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.907+0000 7fc32782e700 1 Processor -- start 2023-12-24T18:36:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.907+0000 7f619cbcc700 1 -- start start 2023-12-24T18:36:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.907+0000 7fc32782e700 1 -- start start 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f619cbcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6198158cd0 0x7f619806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f619cbcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f61980a9760 0x7f61981597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc32006a580 0x7fc320168a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc320169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320169080 con 0x7fc320152970 2023-12-24T18:36:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320169360 con 0x7fc32006aa00 2023-12-24T18:36:46.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc32782e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc320169640 con 0x7fc32006a580 2023-12-24T18:36:46.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f619cbcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619806b270 con 0x7f61980a92e0 2023-12-24T18:36:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60938/0 (socket says 172.21.15.50:60938) 2023-12-24T18:36:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 -- 172.21.15.50:0/3401316776 learned_addr learned my addr 172.21.15.50:0/3401316776 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc3255ca700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc32006a580 0x7fc320168a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 -- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc32006a580 msgr2=0x7fc320168a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc32006a580 0x7fc320168a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 -- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 msgr2=0x7fc320169c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc320169c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 -- 172.21.15.50:0/3401316776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009420 con 0x7fc320152970 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f619cbcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619815a5d0 con 0x7f6198158cd0 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f619cbcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619815a010 con 0x7f61980a9760 2023-12-24T18:36:46.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f61977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6198158cd0 0x7f619806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f61977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6198158cd0 0x7f619806c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60948/0 (socket says 172.21.15.50:60948) 2023-12-24T18:36:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7f61977fe700 1 -- 172.21.15.50:0/1118918350 learned_addr learned my addr 172.21.15.50:0/1118918350 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.911+0000 7fc325dcb700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097b0 tx=0x7fc31c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f6197fff700 1 --2- 172.21.15.50:0/1118918350 >> v2:172.21.15.82:3300/0 conn(0x7f61980a9760 0x7f61981597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61967fc700 1 -- 172.21.15.50:0/1118918350 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4607583 0 0) 0x7f619806b270 con 0x7f61980a92e0 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61967fc700 1 -- 172.21.15.50:0/1118918350 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6184003570 con 0x7f61980a92e0 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61977fe700 1 -- 172.21.15.50:0/1118918350 >> v2:172.21.15.82:3300/0 conn(0x7f61980a9760 msgr2=0x7f61981597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61977fe700 1 --2- 172.21.15.50:0/1118918350 >> v2:172.21.15.82:3300/0 conn(0x7f61980a9760 0x7f61981597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61977fe700 1 -- 172.21.15.50:0/1118918350 >> v1:172.21.15.82:6789/0 conn(0x7f61980a92e0 legacy=0x7f61981590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61977fe700 1 -- 172.21.15.50:0/1118918350 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619815a2f0 con 0x7f6198158cd0 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c01c040 con 0x7fc320152970 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c018630 con 0x7fc320152970 2023-12-24T18:36:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61977fe700 1 --2- 172.21.15.50:0/1118918350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6198158cd0 0x7f619806c820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f619806e340 tx=0x7f6180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153ecaeec5ff4d88 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0189f0 con 0x7fc320152970 2023-12-24T18:36:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61967fc700 1 -- 172.21.15.50:0/1118918350 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180009e70 con 0x7f6198158cd0 2023-12-24T18:36:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61967fc700 1 -- 172.21.15.50:0/1118918350 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000b860 con 0x7f6198158cd0 2023-12-24T18:36:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f61967fc700 1 -- 172.21.15.50:0/1118918350 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180009e70 con 0x7f6198158cd0 2023-12-24T18:36:46.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320169920 con 0x7fc320152970 2023-12-24T18:36:46.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32014d070 con 0x7fc320152970 2023-12-24T18:36:46.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f619cbcc700 1 -- 172.21.15.50:0/1118918350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6198158cd0 msgr2=0x7f619806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.915+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1118918350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6198158cd0 0x7f619806c820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f619806e340 tx=0x7f6180009250 comp rx=0 tx=0).stop 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 -- 172.21.15.50:0/1118918350 shutdown_connections 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1118918350 >> v2:172.21.15.82:3300/0 conn(0x7f61980a9760 0x7f61981597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1118918350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6198158cd0 0x7f619806c820 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 -- 172.21.15.50:0/1118918350 >> 172.21.15.50:0/1118918350 conn(0x7f6198067ae0 msgr2=0x7f61980cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200c85d0 con 0x7fc320152970 2023-12-24T18:36:46.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7fe4bdca3700 1 Processor -- start 2023-12-24T18:36:46.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 -- 172.21.15.50:0/1118918350 shutdown_connections 2023-12-24T18:36:46.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7f619cbcc700 1 -- 172.21.15.50:0/1118918350 wait complete. 2023-12-24T18:36:46.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7fe4bdca3700 1 -- start start 2023-12-24T18:36:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bdca3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe4b8154ce0 0x7fe4b81550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.919+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc31c02c3b0 con 0x7fc320152970 2023-12-24T18:36:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fc3157fa700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 0x7fc304062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bdca3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bdca3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b806c820 con 0x7fe4b80b0e30 2023-12-24T18:36:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bdca3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b806c510 con 0x7fe4b8154ce0 2023-12-24T18:36:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bdca3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b806cde0 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 Processor -- start 2023-12-24T18:36:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 -- start start 2023-12-24T18:36:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45080/0 (socket says 172.21.15.50:45080) 2023-12-24T18:36:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 -- 172.21.15.50:0/909448280 learned_addr learned my addr 172.21.15.50:0/909448280 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f942662e700 1 Processor -- start 2023-12-24T18:36:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4af7fe700 1 -- 172.21.15.50:0/909448280 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503636636 0 0) 0x7fe4b806c820 con 0x7fe4b80b0e30 2023-12-24T18:36:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4af7fe700 1 -- 172.21.15.50:0/909448280 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a0003570 con 0x7fe4b80b0e30 2023-12-24T18:36:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61980a9760 0x7f6198156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6198158cd0 0x7f61981571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 -- 172.21.15.50:0/909448280 >> v2:172.21.15.82:3300/0 conn(0x7fe4b8154ce0 msgr2=0x7fe4b81550b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-24T18:36:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 --2- 172.21.15.50:0/909448280 >> v2:172.21.15.82:3300/0 conn(0x7fe4b8154ce0 0x7fe4b81550b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 -- 172.21.15.50:0/909448280 >> v1:172.21.15.82:6789/0 conn(0x7fe4b80b0e30 legacy=0x7fe4b80ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fe4bd4a2700 1 -- 172.21.15.50:0/909448280 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80b12b0 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980ae440 con 0x7f61980a92e0 2023-12-24T18:36:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980ae160 con 0x7f61980a9760 2023-12-24T18:36:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7f619cbcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61981561b0 con 0x7f6198158cd0 2023-12-24T18:36:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f942662e700 1 -- start start 2023-12-24T18:36:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f6197fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6198158cd0 0x7f61981571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60954/0 (socket says 172.21.15.50:60954) 2023-12-24T18:36:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 -- 172.21.15.50:0/1730080986 learned_addr learned my addr 172.21.15.50:0/1730080986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.923+0000 7fc3255ca700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 0x7fc304062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f6196ffd700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61980a9760 0x7f6198156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bd4a2700 1 --2- 172.21.15.50:0/909448280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00099b0 tx=0x7fe4b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc1f4f4306c68ed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 -- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6198158cd0 msgr2=0x7f61981571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6198158cd0 0x7f61981571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 -- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61980a9760 msgr2=0x7f6198156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61980a9760 0x7f6198156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 -- 172.21.15.50:0/1730080986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800094f0 con 0x7f61980a92e0 2023-12-24T18:36:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f61977fe700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4af7fe700 1 -- 172.21.15.50:0/909448280 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0009e40 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4af7fe700 1 -- 172.21.15.50:0/909448280 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b000b860 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4af7fe700 1 -- 172.21.15.50:0/909448280 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000bc00 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fc31c081070 con 0x7fc320152970 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fc3255ca700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 0x7fc304062ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3180012d0 tx=0x7fc318009650 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 -- 172.21.15.50:0/909448280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 msgr2=0x7fe4b806bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f942662e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f941800e1e0 0x7f94180e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/909448280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00099b0 tx=0x7fe4b0009250 comp rx=0 tx=0).stop 2023-12-24T18:36:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 -- 172.21.15.50:0/909448280 shutdown_connections 2023-12-24T18:36:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/909448280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80ac9e0 0x7fe4b806bfd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f942662e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9418054b50 con 0x7f94180dfeb0 2023-12-24T18:36:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f942662e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94180553f0 con 0x7f94180e3cf0 2023-12-24T18:36:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f942662e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94180e4840 con 0x7f941800e1e0 2023-12-24T18:36:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/909448280 >> v2:172.21.15.82:3300/0 conn(0x7fe4b8154ce0 0x7fe4b81550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 -- 172.21.15.50:0/909448280 >> 172.21.15.50:0/909448280 conn(0x7fe4b8067ae0 msgr2=0x7fe4b80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f941f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f941800e1e0 0x7f94180e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f941ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94180dfeb0 0x7f941800dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37458/0 (socket says 172.21.15.50:37458) 2023-12-24T18:36:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7f941ffff700 1 -- 172.21.15.50:0/4044734977 learned_addr learned my addr 172.21.15.50:0/4044734977 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.927+0000 7fe4bdca3700 1 -- 172.21.15.50:0/909448280 shutdown_connections 2023-12-24T18:36:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7fe4bdca3700 1 -- 172.21.15.50:0/909448280 wait complete. 2023-12-24T18:36:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7f941f7fe700 1 -- 172.21.15.50:0/4044734977 >> v1:172.21.15.82:6789/0 conn(0x7f94180e3cf0 legacy=0x7f94180e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7f941f7fe700 1 -- 172.21.15.50:0/4044734977 >> v1:172.21.15.50:6789/0 conn(0x7f94180dfeb0 legacy=0x7f941800dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7f941f7fe700 1 -- 172.21.15.50:0/4044734977 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180e4a20 con 0x7f941800e1e0 2023-12-24T18:36:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7f941f7fe700 1 --2- 172.21.15.50:0/4044734977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f94180e0280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94140098d0 tx=0x7f9414009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf59d89de9d4dcda server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7fe4bdca3700 1 Processor -- start 2023-12-24T18:36:46.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.931+0000 7fe4bdca3700 1 -- start start 2023-12-24T18:36:46.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3200c85d0 con 0x7fc320152970 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618001f070 con 0x7f61980a92e0 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618001aca0 con 0x7f61980a92e0 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180011670 con 0x7f61980a92e0 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f941effd700 1 -- 172.21.15.50:0/4044734977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414009e70 con 0x7f941800e1e0 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f941effd700 1 -- 172.21.15.50:0/4044734977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414005c10 con 0x7f941800e1e0 2023-12-24T18:36:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f941effd700 1 -- 172.21.15.50:0/4044734977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400b650 con 0x7f941800e1e0 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80b0e30 0x7fe4b80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 0x7fe4b80c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80a9580 con 0x7fe4b8154ce0 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c0920 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bdca3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80a8ce0 con 0x7fe4b80b0e30 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198156490 con 0x7f61980a92e0 2023-12-24T18:36:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980addc0 con 0x7f61980a92e0 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bd4a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 0x7fe4b80c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51626/0 (socket says 172.21.15.50:51626) 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 -- 172.21.15.50:0/2400689479 learned_addr learned my addr 172.21.15.50:0/2400689479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 -- 172.21.15.50:0/4044734977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 msgr2=0x7f94180e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 --2- 172.21.15.50:0/4044734977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f94180e0280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94140098d0 tx=0x7f9414009120 comp rx=0 tx=0).stop 2023-12-24T18:36:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 -- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80b0e30 msgr2=0x7fe4b80c6f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-24T18:36:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80b0e30 0x7fe4b80c6f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 -- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 msgr2=0x7fe4b80c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 0x7fe4b80c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 -- 172.21.15.50:0/2400689479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00094f0 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bd4a2700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 0x7fe4b80c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:46.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 -- 172.21.15.50:0/4044734977 shutdown_connections 2023-12-24T18:36:46.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 --2- 172.21.15.50:0/4044734977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f94180e0280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4bcca1700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400b600 tx=0x7fe4b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 -- 172.21.15.50:0/4044734977 >> 172.21.15.50:0/4044734977 conn(0x7f9418057a50 msgr2=0x7f9418009ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6198156990 con 0x7f61980a92e0 2023-12-24T18:36:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 -- 172.21.15.50:0/4044734977 shutdown_connections 2023-12-24T18:36:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400f510 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b400f670 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400fa30 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.935+0000 7f942662e700 1 -- 172.21.15.50:0/4044734977 wait complete. 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b80a8fc0 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80a88f0 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6180011aa0 con 0x7f61980a92e0 2023-12-24T18:36:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7f618f7fe700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 0x7f6178062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7f6196ffd700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 0x7f6178062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7f942662e700 1 Processor -- start 2023-12-24T18:36:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7f942662e700 1 -- start start 2023-12-24T18:36:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f941803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.939+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b80c0b20 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94180e3cf0 0x7f94180e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f6196ffd700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 0x7f6178062a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61980cc950 tx=0x7f6188009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941804ebe0 con 0x7f941800e1e0 2023-12-24T18:36:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f6180052900 con 0x7f61980a92e0 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45104/0 (socket says 172.21.15.50:45104) 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 -- 172.21.15.50:0/1003270059 learned_addr learned my addr 172.21.15.50:0/1003270059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941804ee30 con 0x7f94180e3cf0 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941804f110 con 0x7f94180dfeb0 2023-12-24T18:36:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941ffff700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f941803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f9424bcb700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94180e3cf0 0x7f94180e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 -- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94180e3cf0 msgr2=0x7f94180e17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94180e3cf0 0x7f94180e17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 -- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 msgr2=0x7f941803a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f941803a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941f7fe700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140093c0 con 0x7f94180dfeb0 2023-12-24T18:36:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe4b401a400 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.943+0000 7f941ffff700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f941803a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:46.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f941f7fe700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9414009fd0 tx=0x7f9414016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140063e0 con 0x7f94180dfeb0 2023-12-24T18:36:46.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7fe4acff9700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 0x7fe4a4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414006560 con 0x7f94180dfeb0 2023-12-24T18:36:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414006920 con 0x7f94180dfeb0 2023-12-24T18:36:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fe4b407c340 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7fe4affff700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 0x7fe4a4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941804f610 con 0x7f94180dfeb0 2023-12-24T18:36:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941804fbd0 con 0x7f94180dfeb0 2023-12-24T18:36:46.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.947+0000 7fe4affff700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 0x7fe4a4062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8007fd0 tx=0x7fe4a8007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.951+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941804f460 con 0x7f94180dfeb0 2023-12-24T18:36:46.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.951+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f618004e500 con 0x7f61980a92e0 2023-12-24T18:36:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.951+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f941401b690 con 0x7f94180dfeb0 2023-12-24T18:36:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.951+0000 7f940bfff700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 0x7f9404062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.955+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f941407ec30 con 0x7f94180dfeb0 2023-12-24T18:36:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.955+0000 7f941ffff700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 0x7f9404062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.955+0000 7f941ffff700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 0x7f9404062b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f940c000c00 tx=0x7f940c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.959+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4b80c0b20 con 0x7fe4b80ac9e0 2023-12-24T18:36:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.967+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f941404ef10 con 0x7f94180dfeb0 2023-12-24T18:36:46.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.983+0000 7f1fe14f0700 1 Processor -- start 2023-12-24T18:36:46.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.983+0000 7f1fe14f0700 1 -- start start 2023-12-24T18:36:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fe14f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 0x7f1fdc16a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fe14f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0ca790 0x7f1fdc0866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fe14f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0c75e0 con 0x7f1fdc06c820 2023-12-24T18:36:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fe14f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c6a10 con 0x7f1fdc0862f0 2023-12-24T18:36:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fe14f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc086c00 con 0x7f1fdc0ca790 2023-12-24T18:36:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fdb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1fdc06c820 0x7f1fdc0c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37462/0 (socket says 172.21.15.50:37462) 2023-12-24T18:36:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fdb7fe700 1 -- 172.21.15.50:0/1442456960 learned_addr learned my addr 172.21.15.50:0/1442456960 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fdaffd700 1 --2- 172.21.15.50:0/1442456960 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 0x7f1fdc16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/1442456960 >> v2:172.21.15.82:3300/0 conn(0x7f1fdc0ca790 0x7f1fdc0866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fd9ffb700 1 -- 172.21.15.50:0/1442456960 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015636697 0 0) 0x7f1fdc0c75e0 con 0x7f1fdc06c820 2023-12-24T18:36:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.987+0000 7f1fd9ffb700 1 -- 172.21.15.50:0/1442456960 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc4003570 con 0x7f1fdc06c820 2023-12-24T18:36:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.991+0000 7f1fda7fc700 1 -- 172.21.15.50:0/1442456960 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 msgr2=0x7f1fdc16a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.991+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/1442456960 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 0x7f1fdc16a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.991+0000 7f1fda7fc700 1 -- 172.21.15.50:0/1442456960 >> v1:172.21.15.50:6789/0 conn(0x7f1fdc06c820 legacy=0x7f1fdc0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.991+0000 7f1fda7fc700 1 -- 172.21.15.50:0/1442456960 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0c6cb0 con 0x7f1fdc0ca790 2023-12-24T18:36:46.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.991+0000 7f1fdaffd700 1 --2- 172.21.15.50:0/1442456960 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 0x7f1fdc16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/1442456960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0ca790 0x7f1fdc0866c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0cbb00 tx=0x7f1fcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c43e5a64a25a8cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fd9ffb700 1 -- 172.21.15.50:0/1442456960 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc011630 con 0x7f1fdc0ca790 2023-12-24T18:36:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fd9ffb700 1 -- 172.21.15.50:0/1442456960 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc011790 con 0x7f1fdc0ca790 2023-12-24T18:36:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fd9ffb700 1 -- 172.21.15.50:0/1442456960 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc011b30 con 0x7f1fdc0ca790 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 -- 172.21.15.50:0/1442456960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0ca790 msgr2=0x7f1fdc0866c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 --2- 172.21.15.50:0/1442456960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0ca790 0x7f1fdc0866c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0cbb00 tx=0x7f1fcc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 -- 172.21.15.50:0/1442456960 shutdown_connections 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 --2- 172.21.15.50:0/1442456960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0ca790 0x7f1fdc0866c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 --2- 172.21.15.50:0/1442456960 >> v2:172.21.15.50:3300/0 conn(0x7f1fdc0862f0 0x7f1fdc16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 -- 172.21.15.50:0/1442456960 >> 172.21.15.50:0/1442456960 conn(0x7f1fdc0cbba0 msgr2=0x7f1fdc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 -- 172.21.15.50:0/1442456960 shutdown_connections 2023-12-24T18:36:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.995+0000 7f1fe14f0700 1 -- 172.21.15.50:0/1442456960 wait complete. 2023-12-24T18:36:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 Processor -- start 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 -- start start 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc06c820 0x7f1fdc0c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fdc0ca790 0x7f1fdc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc15e2d0 con 0x7f1fdc06c820 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc158cd0 con 0x7f1fdc0862f0 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:46.999+0000 7f1fe14f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc17a1c0 con 0x7f1fdc0ca790 2023-12-24T18:36:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51652/0 (socket says 172.21.15.50:51652) 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 -- 172.21.15.50:0/3081195905 learned_addr learned my addr 172.21.15.50:0/3081195905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fdb7fe700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fdc0ca790 0x7f1fdc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 -- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fdc0ca790 msgr2=0x7f1fdc0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fdc0ca790 0x7f1fdc0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 -- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc06c820 msgr2=0x7f1fdc0c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc06c820 0x7f1fdc0c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 -- 172.21.15.50:0/3081195905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009420 con 0x7f1fdc0862f0 2023-12-24T18:36:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fda7fc700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009f50 tx=0x7f1fcc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc011b10 con 0x7f1fdc0862f0 2023-12-24T18:36:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0233f0 con 0x7f1fdc0862f0 2023-12-24T18:36:47.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.003+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc023770 con 0x7f1fdc0862f0 2023-12-24T18:36:47.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.007+0000 7f1fe14f0700 1 -- 172.21.15.50:0/3081195905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc17a4a0 con 0x7f1fdc0862f0 2023-12-24T18:36:47.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.007+0000 7f1fe14f0700 1 -- 172.21.15.50:0/3081195905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc17aa60 con 0x7f1fdc0862f0 2023-12-24T18:36:47.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.007+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40052b0 con 0x7f1fdc0862f0 2023-12-24T18:36:47.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.007+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1fcc0193b0 con 0x7f1fdc0862f0 2023-12-24T18:36:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.011+0000 7f1fc2ffd700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.011+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f1fcc07e050 con 0x7f1fdc0862f0 2023-12-24T18:36:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.011+0000 7f1fdaffd700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.011+0000 7f1fdaffd700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 0x7f1fc8062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0006fd0 tx=0x7f1fd0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.023+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fcc04e350 con 0x7f1fdc0862f0 2023-12-24T18:36:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.183+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcec804be40 con 0x7fcec806aac0 2023-12-24T18:36:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.183+0000 7fcec4ff9700 1 -- 172.21.15.50:0/2149520209 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fceb8017020 con 0x7fcec806aac0 2023-12-24T18:36:47.185 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-12-24T18:36:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.183+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdc48005560 con 0x7fdc680e4370 2023-12-24T18:36:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.183+0000 7fdc56ffd700 1 -- 172.21.15.50:0/4156725195 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc6004f700 con 0x7fdc680e4370 2023-12-24T18:36:47.187 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-12-24T18:36:47.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 msgr2=0x7fceb4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 0x7fceb4062ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097c0 tx=0x7fcec001d000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 msgr2=0x7fcec80cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ea20 tx=0x7fceb8009220 comp rx=0 tx=0).stop 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 shutdown_connections 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fceb4060620 0x7fceb4062ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec8152970 0x7fcec8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcec806bb70 0x7fcec814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 --2- 172.21.15.50:0/2149520209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec806aac0 0x7fcec80cbba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 >> 172.21.15.50:0/2149520209 conn(0x7fcec8067b80 msgr2=0x7fcec80adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 shutdown_connections 2023-12-24T18:36:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.187+0000 7fcecef45700 1 -- 172.21.15.50:0/2149520209 wait complete. 2023-12-24T18:36:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 msgr2=0x7fdc5c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 0x7fdc5c062b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009c20 tx=0x7fdc64008040 comp rx=0 tx=0).stop 2023-12-24T18:36:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 msgr2=0x7fdc6804e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 0x7fdc6804e620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000c560 tx=0x7fdc60007e70 comp rx=0 tx=0).stop 2023-12-24T18:36:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 shutdown_connections 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdc5c0606a0 0x7fdc5c062b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc680e7930 0x7fdc680dbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc680e4370 0x7fdc6804e620 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 --2- 172.21.15.50:0/4156725195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdc680e3fa0 0x7fdc680e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 >> 172.21.15.50:0/4156725195 conn(0x7fdc680516a0 msgr2=0x7fdc6804a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.191+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 shutdown_connections 2023-12-24T18:36:47.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.195+0000 7fdc54ff9700 1 -- 172.21.15.50:0/4156725195 wait complete. 2023-12-24T18:36:47.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.211+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31ac0b3f10 con 0x7f31ac0ce390 2023-12-24T18:36:47.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-12-24T18:36:47.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31a37fe700 1 -- 172.21.15.50:0/2498098392 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31ac0b3f10 con 0x7f31ac0ce390 2023-12-24T18:36:47.217 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:47.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 msgr2=0x7f318c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 0x7f318c062a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31ac1710c0 tx=0x7f31a4007ea0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 msgr2=0x7f31ac0c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0c9980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f319c016000 tx=0x7f319c019000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 shutdown_connections 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.215+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f318c0605d0 0x7f318c062a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.219+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ac15e240 0x7f31ac0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.219+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31ac0ce390 0x7f31ac0c9980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.219+0000 7f31b1f85700 1 --2- 172.21.15.50:0/2498098392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31ac0cb4a0 0x7f31ac15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.219+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 >> 172.21.15.50:0/2498098392 conn(0x7f31ac0cffb0 msgr2=0x7f31ac155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.223+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 shutdown_connections 2023-12-24T18:36:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.223+0000 7f31b1f85700 1 -- 172.21.15.50:0/2498098392 wait complete. 2023-12-24T18:36:47.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-12-24T18:36:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.247+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3200c85d0 con 0x7fc320152970 2023-12-24T18:36:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.247+0000 7fc3157fa700 1 -- 172.21.15.50:0/3401316776 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3200c85d0 con 0x7fc320152970 2023-12-24T18:36:47.250 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-12-24T18:36:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 msgr2=0x7fc304062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 0x7fc304062ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3180012d0 tx=0x7fc318009650 comp rx=0 tx=0).stop 2023-12-24T18:36:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 msgr2=0x7fc3200b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097b0 tx=0x7fc31c018000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 shutdown_connections 2023-12-24T18:36:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc304060620 0x7fc304062ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc320152970 0x7fc3200b1280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc32006aa00 0x7fc320169c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 --2- 172.21.15.50:0/3401316776 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc32006a580 0x7fc320168a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 >> 172.21.15.50:0/3401316776 conn(0x7fc320067b80 msgr2=0x7fc32006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 shutdown_connections 2023-12-24T18:36:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.251+0000 7fc32782e700 1 -- 172.21.15.50:0/3401316776 wait complete. 2023-12-24T18:36:47.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-12-24T18:36:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.279+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f619804be40 con 0x7f61980a92e0 2023-12-24T18:36:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.279+0000 7f618f7fe700 1 -- 172.21.15.50:0/1730080986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6180015090 con 0x7f61980a92e0 2023-12-24T18:36:47.283 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-12-24T18:36:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 msgr2=0x7f6178062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 0x7f6178062a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61980cc950 tx=0x7f6188009040 comp rx=0 tx=0).stop 2023-12-24T18:36:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 msgr2=0x7f61981753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180017000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 shutdown_connections 2023-12-24T18:36:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6178060550 0x7f6178062a00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6198158cd0 0x7f61981571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61980a9760 0x7f6198156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 --2- 172.21.15.50:0/1730080986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61980a92e0 0x7f61981753d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 >> 172.21.15.50:0/1730080986 conn(0x7f6198067ae0 msgr2=0x7f61980c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 shutdown_connections 2023-12-24T18:36:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.283+0000 7f619cbcc700 1 -- 172.21.15.50:0/1730080986 wait complete. 2023-12-24T18:36:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.307+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f941804fdf0 con 0x7f94180dfeb0 2023-12-24T18:36:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.307+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe4b804be40 con 0x7fe4b80ac9e0 2023-12-24T18:36:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.307+0000 7f940bfff700 1 -- 172.21.15.50:0/1003270059 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9414052530 con 0x7f94180dfeb0 2023-12-24T18:36:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.307+0000 7fe4acff9700 1 -- 172.21.15.50:0/2400689479 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4b404c7a0 con 0x7fe4b80ac9e0 2023-12-24T18:36:47.310 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-12-24T18:36:47.310 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-12-24T18:36:47.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2023-12-24T18:36:47.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 msgr2=0x7f9404062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 0x7f9404062b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f940c000c00 tx=0x7f940c009040 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 msgr2=0x7f94180dbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9414009fd0 tx=0x7f9414016000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 shutdown_connections 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9404060650 0x7f9404062b00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94180e3cf0 0x7f94180e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94180dfeb0 0x7f94180dbad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 --2- 172.21.15.50:0/1003270059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f941800e1e0 0x7f941803a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 >> 172.21.15.50:0/1003270059 conn(0x7f9418057a50 msgr2=0x7f941804d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 shutdown_connections 2023-12-24T18:36:47.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7f942662e700 1 -- 172.21.15.50:0/1003270059 wait complete. 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 msgr2=0x7fe4a4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 0x7fe4a4062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8007fd0 tx=0x7fe4a8007d10 comp rx=0 tx=0).stop 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 msgr2=0x7fe4b80a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400b600 tx=0x7fe4b40091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 shutdown_connections 2023-12-24T18:36:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe4a4060620 0x7fe4a4062ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b8154ce0 0x7fe4b80c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b80b0e30 0x7fe4b80c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 --2- 172.21.15.50:0/2400689479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b80ac9e0 0x7fe4b80a83b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 >> 172.21.15.50:0/2400689479 conn(0x7fe4b8067ae0 msgr2=0x7fe4b806d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 shutdown_connections 2023-12-24T18:36:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.311+0000 7fe4bdca3700 1 -- 172.21.15.50:0/2400689479 wait complete. 2023-12-24T18:36:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.331+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1fb4005830 con 0x7f1fdc0862f0 2023-12-24T18:36:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.335+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3081195905 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fcc015090 con 0x7f1fdc0862f0 2023-12-24T18:36:47.337 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-24T18:36:47.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2023-12-24T18:36:47.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2023-12-24T18:36:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 msgr2=0x7f1fc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 0x7f1fc8062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0006fd0 tx=0x7f1fd0008040 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 msgr2=0x7f1fdc158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009f50 tx=0x7f1fcc017000 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 shutdown_connections 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fdc0ca790 0x7f1fdc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fdc0862f0 0x7f1fdc158790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 --2- 172.21.15.50:0/3081195905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc06c820 0x7f1fdc0c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 >> 172.21.15.50:0/3081195905 conn(0x7f1fdc0cbba0 msgr2=0x7f1fdc06cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 shutdown_connections 2023-12-24T18:36:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:47.339+0000 7f1fc0ff9700 1 -- 172.21.15.50:0/3081195905 wait complete. 2023-12-24T18:36:47.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-12-24T18:36:47.358 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-24T18:36:48.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-24T18:36:48.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-24T18:36:48.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-24T18:36:48.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-24T18:36:48.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-24T18:36:48.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-24T18:36:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.379+0000 7f5e3f1cc700 1 Processor -- start 2023-12-24T18:36:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.379+0000 7f5e3f1cc700 1 -- start start 2023-12-24T18:36:48.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3f1cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3f1cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e3806d8c0 0x7f5e380b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3f1cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3806b640 con 0x7f5e3806a580 2023-12-24T18:36:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3f1cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e38159710 con 0x7f5e3806d8c0 2023-12-24T18:36:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3f1cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b5e10 con 0x7f5e38158e00 2023-12-24T18:36:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3d9c9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e3806d8c0 0x7f5e380b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45116/0 (socket says 172.21.15.50:45116) 2023-12-24T18:36:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 -- 172.21.15.50:0/2305757611 learned_addr learned my addr 172.21.15.50:0/2305757611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 -- 172.21.15.50:0/2305757611 >> v2:172.21.15.82:3300/0 conn(0x7f5e3806d8c0 msgr2=0x7f5e380b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 --2- 172.21.15.50:0/2305757611 >> v2:172.21.15.82:3300/0 conn(0x7f5e3806d8c0 0x7f5e380b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 -- 172.21.15.50:0/2305757611 >> v1:172.21.15.82:6789/0 conn(0x7f5e3806a580 legacy=0x7f5e3806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.383+0000 7f5e3e1ca700 1 -- 172.21.15.50:0/2305757611 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3806b8e0 con 0x7f5e38158e00 2023-12-24T18:36:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3e1ca700 1 --2- 172.21.15.50:0/2305757611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e340099b0 tx=0x7f5e34009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9f93258c6fccbc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3d1c8700 1 -- 172.21.15.50:0/2305757611 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34009ea0 con 0x7f5e38158e00 2023-12-24T18:36:48.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3d1c8700 1 -- 172.21.15.50:0/2305757611 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400b860 con 0x7f5e38158e00 2023-12-24T18:36:48.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3d1c8700 1 -- 172.21.15.50:0/2305757611 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bc00 con 0x7f5e38158e00 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/2305757611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 msgr2=0x7f5e381591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/2305757611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e340099b0 tx=0x7f5e34009250 comp rx=0 tx=0).stop 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/2305757611 shutdown_connections 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/2305757611 >> v2:172.21.15.82:3300/0 conn(0x7f5e3806d8c0 0x7f5e380b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/2305757611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e38158e00 0x7f5e381591d0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e340099b0 tx=0x7f5e34009250 comp rx=0 tx=0).stop 2023-12-24T18:36:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/2305757611 >> 172.21.15.50:0/2305757611 conn(0x7f5e38067b80 msgr2=0x7f5e380b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/2305757611 shutdown_connections 2023-12-24T18:36:48.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.387+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/2305757611 wait complete. 2023-12-24T18:36:48.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 Processor -- start 2023-12-24T18:36:48.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 -- start start 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3806a580 0x7f5e38144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 0x7f5e380ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 0x7f5e38088310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cf680 con 0x7f5e3815e3a0 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cea70 con 0x7f5e3806a580 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.391+0000 7f5e3f1cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380ced50 con 0x7f5e3806d8c0 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 0x7f5e380ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3e1ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3806a580 0x7f5e38144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3e9cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 0x7f5e38088310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3e9cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 0x7f5e38088310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32790/0 (socket says 172.21.15.50:32790) 2023-12-24T18:36:48.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3e9cb700 1 -- 172.21.15.50:0/63722628 learned_addr learned my addr 172.21.15.50:0/63722628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 -- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3806a580 msgr2=0x7f5e38144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3806a580 0x7f5e38144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 -- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 msgr2=0x7f5e38088310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 0x7f5e38088310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 -- 172.21.15.50:0/63722628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340094f0 con 0x7f5e3806d8c0 2023-12-24T18:36:48.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3d9c9700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 0x7f5e380ce120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800ea50 tx=0x7f5e280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800c7f0 con 0x7f5e3806d8c0 2023-12-24T18:36:48.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2800c970 con 0x7f5e3806d8c0 2023-12-24T18:36:48.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800cd30 con 0x7f5e3806d8c0 2023-12-24T18:36:48.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380cf030 con 0x7f5e3806d8c0 2023-12-24T18:36:48.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.395+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e38145070 con 0x7f5e3806d8c0 2023-12-24T18:36:48.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.399+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e200052b0 con 0x7f5e3806d8c0 2023-12-24T18:36:48.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.399+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5e28013680 con 0x7f5e3806d8c0 2023-12-24T18:36:48.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.403+0000 7f5e2e7fc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 0x7f5e1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.403+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f5e2807cd10 con 0x7f5e3806d8c0 2023-12-24T18:36:48.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.403+0000 7f5e3e1ca700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 0x7f5e1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.403+0000 7f5e3e1ca700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 0x7f5e1c062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e340099b0 tx=0x7f5e34017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.411+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e28082020 con 0x7f5e3806d8c0 2023-12-24T18:36:48.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 Processor -- start 2023-12-24T18:36:48.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 -- start start 2023-12-24T18:36:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 0x7fb9cc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9cc06d8c0 0x7fb9cc0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc06b640 con 0x7fb9cc06a580 2023-12-24T18:36:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc159710 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.431+0000 7fb9d0ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0b5e10 con 0x7fb9cc158e00 2023-12-24T18:36:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 0x7fb9cc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb9cc06a580 0x7fb9cc06c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38334/0 (socket says 172.21.15.50:38334) 2023-12-24T18:36:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cbfff700 1 -- 172.21.15.50:0/773483178 learned_addr learned my addr 172.21.15.50:0/773483178 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9ca7fc700 1 -- 172.21.15.50:0/773483178 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507839449 0 0) 0x7fb9cc06b640 con 0x7fb9cc06a580 2023-12-24T18:36:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9ca7fc700 1 -- 172.21.15.50:0/773483178 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b4003570 con 0x7fb9cc06a580 2023-12-24T18:36:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 -- 172.21.15.50:0/773483178 >> v2:172.21.15.50:3300/0 conn(0x7fb9cc06d8c0 msgr2=0x7fb9cc0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 --2- 172.21.15.50:0/773483178 >> v2:172.21.15.50:3300/0 conn(0x7fb9cc06d8c0 0x7fb9cc0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 -- 172.21.15.50:0/773483178 >> v1:172.21.15.82:6789/0 conn(0x7fb9cc06a580 legacy=0x7fb9cc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 -- 172.21.15.50:0/773483178 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc06b8e0 con 0x7fb9cc158e00 2023-12-24T18:36:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9cb7fe700 1 --2- 172.21.15.50:0/773483178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 0x7fb9cc1591d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9d1cabf517b457 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9ca7fc700 1 -- 172.21.15.50:0/773483178 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc011630 con 0x7fb9cc158e00 2023-12-24T18:36:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9ca7fc700 1 -- 172.21.15.50:0/773483178 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc011790 con 0x7fb9cc158e00 2023-12-24T18:36:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.435+0000 7fb9ca7fc700 1 -- 172.21.15.50:0/773483178 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc011b30 con 0x7fb9cc158e00 2023-12-24T18:36:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 Processor -- start 2023-12-24T18:36:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/773483178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 msgr2=0x7fb9cc1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/773483178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 0x7fb9cc1591d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 -- start start 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/773483178 shutdown_connections 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/773483178 >> v2:172.21.15.50:3300/0 conn(0x7fb9cc06d8c0 0x7fb9cc0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/773483178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc158e00 0x7fb9cc1591d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/773483178 >> 172.21.15.50:0/773483178 conn(0x7fb9cc067b80 msgr2=0x7fb9cc0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/773483178 shutdown_connections 2023-12-24T18:36:48.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/773483178 wait complete. 2023-12-24T18:36:48.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f551c9c3700 1 Processor -- start 2023-12-24T18:36:48.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77340ce750 0x7f77340ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773406ae30 0x7f773406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 0x7f7734159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773406b7e0 con 0x7f773406ae30 2023-12-24T18:36:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773406ba80 con 0x7f77340ce750 2023-12-24T18:36:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7738cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773406bd60 con 0x7f7734159a20 2023-12-24T18:36:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 Processor -- start 2023-12-24T18:36:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7fb9d0ae3700 1 -- start start 2023-12-24T18:36:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f7731d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773406ae30 0x7f773406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773406ae30 0x7f773406b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32800/0 (socket says 172.21.15.50:32800) 2023-12-24T18:36:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 -- 172.21.15.50:0/3301270616 learned_addr learned my addr 172.21.15.50:0/3301270616 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7732d9d700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 0x7f7734159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f773259c700 1 --2- 172.21.15.50:0/3301270616 >> v2:172.21.15.82:3300/0 conn(0x7f77340ce750 0x7f77340ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 -- 172.21.15.50:0/3301270616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 msgr2=0x7f7734159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 0x7f7734159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 -- 172.21.15.50:0/3301270616 >> v2:172.21.15.82:3300/0 conn(0x7f77340ce750 msgr2=0x7f77340ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 --2- 172.21.15.50:0/3301270616 >> v2:172.21.15.82:3300/0 conn(0x7f77340ce750 0x7f77340ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 -- 172.21.15.50:0/3301270616 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773406c040 con 0x7f773406ae30 2023-12-24T18:36:48.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.439+0000 7f551c9c3700 1 -- start start 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f551c9c3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55180ae100 0x7f5518161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f551c9c3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551806c4d0 con 0x7f551806c820 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f551c9c3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551806c1f0 con 0x7f55181611b0 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f551c9c3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180ab5e0 con 0x7f55180ae100 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 0x7fb9cc15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc158e00 0x7fb9cc1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc169310 con 0x7fb9cc06a580 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15b380 con 0x7fb9cc158e00 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9d0ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15b5f0 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f7731d9b700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f773406b2a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f77340cda50 tx=0x7f7728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a99f7ca3a4eff72 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f55177fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f55181611b0 0x7f551806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38336/0 (socket says 172.21.15.50:38336) 2023-12-24T18:36:48.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f55177fe700 1 -- 172.21.15.50:0/3237417123 learned_addr learned my addr 172.21.15.50:0/3237417123 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:48.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9cb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9cb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32804/0 (socket says 172.21.15.50:32804) 2023-12-24T18:36:48.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9cb7fe700 1 -- 172.21.15.50:0/2367083286 learned_addr learned my addr 172.21.15.50:0/2367083286 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 0x7fb9cc15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f550effd700 1 --2- 172.21.15.50:0/3237417123 >> v2:172.21.15.82:3300/0 conn(0x7f55180ae100 0x7f5518161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9cbfff700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc158e00 0x7fb9cc1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f773159a700 1 -- 172.21.15.50:0/3301270616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800b640 con 0x7f773406ae30 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f773159a700 1 -- 172.21.15.50:0/3301270616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800b7a0 con 0x7f773406ae30 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f773159a700 1 -- 172.21.15.50:0/3301270616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bb60 con 0x7f773406ae30 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360251056 0 0) 0x7f551806c1f0 con 0x7f55181611b0 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 -- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc158e00 msgr2=0x7fb9cc1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc158e00 0x7fb9cc1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 -- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 msgr2=0x7fb9cc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9caffd700 1 -- 172.21.15.50:0/2367083286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009420 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7fb9cb7fe700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7732d9d700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 0x7f7734159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.443+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5504003570 con 0x7f55181611b0 2023-12-24T18:36:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969633013 0 0) 0x7f5510001490 con 0x7f551806c820 2023-12-24T18:36:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f550effd700 1 -- 172.21.15.50:0/3237417123 >> v1:172.21.15.82:6789/0 conn(0x7f55181611b0 legacy=0x7f551806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f550effd700 1 -- 172.21.15.50:0/3237417123 >> v1:172.21.15.50:6789/0 conn(0x7f551806c820 legacy=0x7f55180ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f550effd700 1 -- 172.21.15.50:0/3237417123 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55180ab8c0 con 0x7f55180ae100 2023-12-24T18:36:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 -- 172.21.15.50:0/3301270616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 msgr2=0x7f773406b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f773406b2a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f77340cda50 tx=0x7f7728009250 comp rx=0 tx=0).stop 2023-12-24T18:36:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f550effd700 1 --2- 172.21.15.50:0/3237417123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55180ae100 0x7f5518161580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55000098e0 tx=0x7f55000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f127434e4cce69b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9caffd700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 0x7fb9cc15ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b610 tx=0x7fb9c00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 -- 172.21.15.50:0/3301270616 shutdown_connections 2023-12-24T18:36:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7734159a20 0x7f7734159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 --2- 172.21.15.50:0/3301270616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f773406b2a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 --2- 172.21.15.50:0/3301270616 >> v2:172.21.15.82:3300/0 conn(0x7f77340ce750 0x7f77340ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000b640 con 0x7f55180ae100 2023-12-24T18:36:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000b7a0 con 0x7f55180ae100 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 -- 172.21.15.50:0/3301270616 >> 172.21.15.50:0/3301270616 conn(0x7f77340cffb0 msgr2=0x7f77340d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 -- 172.21.15.50:0/3301270616 shutdown_connections 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f7738cae700 1 -- 172.21.15.50:0/3301270616 wait complete. 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000f510 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000f670 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000fa30 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc15b8d0 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc15be90 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f5516ffd700 1 -- 172.21.15.50:0/3237417123 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bb40 con 0x7f55180ae100 2023-12-24T18:36:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f551c9c3700 1 -- 172.21.15.50:0/3237417123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55180ae100 msgr2=0x7f5518161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.447+0000 7f551c9c3700 1 --2- 172.21.15.50:0/3237417123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55180ae100 0x7f5518161580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55000098e0 tx=0x7f55000091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc169480 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 -- 172.21.15.50:0/3237417123 shutdown_connections 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 --2- 172.21.15.50:0/3237417123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55180ae100 0x7f5518161580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 -- 172.21.15.50:0/3237417123 >> 172.21.15.50:0/3237417123 conn(0x7f5518067b80 msgr2=0x7f55180cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 -- 172.21.15.50:0/3237417123 shutdown_connections 2023-12-24T18:36:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 Processor -- start 2023-12-24T18:36:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 -- start start 2023-12-24T18:36:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 -- 172.21.15.50:0/3237417123 wait complete. 2023-12-24T18:36:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f7734147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 0x7f773408a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 0x7f773408a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 Processor -- start 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734148430 con 0x7f773406ae30 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734089d20 con 0x7f7734159a20 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7738cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773413f170 con 0x7f77340ce750 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7731d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 0x7f773408a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7731d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 0x7f773408a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45146/0 (socket says 172.21.15.50:45146) 2023-12-24T18:36:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7731d9b700 1 -- 172.21.15.50:0/4031259108 learned_addr learned my addr 172.21.15.50:0/4031259108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f7732d9d700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 0x7f773408a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb9c001a400 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f551c9c3700 1 -- start start 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.451+0000 7f773259c700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f7734147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 -- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 msgr2=0x7f773408a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 0x7f773408a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 -- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 msgr2=0x7f7734147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f7734147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 -- 172.21.15.50:0/4031259108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009a20 con 0x7f7734159a20 2023-12-24T18:36:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7732d9d700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 0x7f773408a6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e70 tx=0x7f772c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7fb9b37fe700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 0x7fb9b8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fb9c007c330 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 0x7f55180a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7fb9cb7fe700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 0x7fb9b8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 0x7f55180affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00cb50 con 0x7f7734159a20 2023-12-24T18:36:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00f040 con 0x7f7734159a20 2023-12-24T18:36:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c014480 con 0x7f7734159a20 2023-12-24T18:36:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280094f0 con 0x7f7734159a20 2023-12-24T18:36:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77340896d0 con 0x7f7734159a20 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f55177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 0x7f55180a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f55177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 0x7f55180a51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51712/0 (socket says 172.21.15.50:51712) 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f550effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 0x7f55180affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f55177fe700 1 -- 172.21.15.50:0/2752453914 learned_addr learned my addr 172.21.15.50:0/2752453914 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 0x7f55181709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b12c0 con 0x7f55180ae100 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55181578f0 con 0x7f551806c820 2023-12-24T18:36:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f5517fff700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 0x7f55181709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7fb9cb7fe700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 0x7fb9b8062ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0093c0 tx=0x7fb9bc016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.455+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5518170ee0 con 0x7f55181611b0 2023-12-24T18:36:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7734089eb0 con 0x7f7734159a20 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 -- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 msgr2=0x7f55180a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 0x7f55180a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 -- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 msgr2=0x7f55180affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 0x7f55180affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009420 con 0x7f55181611b0 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f550effd700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 0x7f55180affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f5517fff700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 0x7f55181709a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f551000c7e0 tx=0x7f55100015f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f772c003020 con 0x7f7734159a20 2023-12-24T18:36:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f77227fc700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 0x7f7714062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.459+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f772c07d310 con 0x7f7734159a20 2023-12-24T18:36:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f773259c700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 0x7f7714062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f773259c700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 0x7f7714062b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d40 tx=0x7f7724008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510012630 con 0x7f55181611b0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55100127b0 con 0x7f55181611b0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510012b70 con 0x7f55181611b0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55180b06b0 con 0x7f55181611b0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9cc169480 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.463+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180b0c70 con 0x7f55181611b0 2023-12-24T18:36:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.467+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551804be40 con 0x7f55181611b0 2023-12-24T18:36:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.467+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5510011380 con 0x7f55181611b0 2023-12-24T18:36:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.471+0000 7f550ffff700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 0x7f54f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.471+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f551007ca20 con 0x7f55181611b0 2023-12-24T18:36:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.471+0000 7f55177fe700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 0x7f54f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.471+0000 7f55177fe700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 0x7f54f8062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5508001ad0 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.471+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f772c04d5f0 con 0x7f7734159a20 2023-12-24T18:36:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.479+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f551004cd20 con 0x7f55181611b0 2023-12-24T18:36:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 Processor -- start 2023-12-24T18:36:48.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 -- start start 2023-12-24T18:36:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd88158cd0 0x7efd8806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8806b270 con 0x7efd880a9760 2023-12-24T18:36:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8815a010 con 0x7efd880a92e0 2023-12-24T18:36:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.515+0000 7efd8ed63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8815a5d0 con 0x7efd88158cd0 2023-12-24T18:36:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8e562700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd880a9760 0x7efd881597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37492/0 (socket says 172.21.15.50:37492) 2023-12-24T18:36:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8e562700 1 -- 172.21.15.50:0/1881708513 learned_addr learned my addr 172.21.15.50:0/1881708513 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8dd61700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd88158cd0 0x7efd8806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8dd61700 1 -- 172.21.15.50:0/1881708513 >> v1:172.21.15.82:6789/0 conn(0x7efd880a92e0 legacy=0x7efd881590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8dd61700 1 -- 172.21.15.50:0/1881708513 >> v1:172.21.15.50:6789/0 conn(0x7efd880a9760 legacy=0x7efd881597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8dd61700 1 -- 172.21.15.50:0/1881708513 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8815a2f0 con 0x7efd88158cd0 2023-12-24T18:36:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8dd61700 1 --2- 172.21.15.50:0/1881708513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd88158cd0 0x7efd8806c820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd840098e0 tx=0x7efd840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990506e44dfd540e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8cd5f700 1 -- 172.21.15.50:0/1881708513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84009e80 con 0x7efd88158cd0 2023-12-24T18:36:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8cd5f700 1 -- 172.21.15.50:0/1881708513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400b860 con 0x7efd88158cd0 2023-12-24T18:36:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8cd5f700 1 -- 172.21.15.50:0/1881708513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400bbe0 con 0x7efd88158cd0 2023-12-24T18:36:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8ed63700 1 -- 172.21.15.50:0/1881708513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd88158cd0 msgr2=0x7efd8806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.519+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1881708513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd88158cd0 0x7efd8806c820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd840098e0 tx=0x7efd840091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 -- 172.21.15.50:0/1881708513 shutdown_connections 2023-12-24T18:36:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1881708513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd88158cd0 0x7efd8806c820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 -- 172.21.15.50:0/1881708513 >> 172.21.15.50:0/1881708513 conn(0x7efd88067ae0 msgr2=0x7efd880cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 -- 172.21.15.50:0/1881708513 shutdown_connections 2023-12-24T18:36:48.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 -- 172.21.15.50:0/1881708513 wait complete. 2023-12-24T18:36:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 Processor -- start 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.523+0000 7efd8ed63700 1 -- start start 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd880a92e0 0x7efd880ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd880a9760 0x7efd881552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8816a9b0 con 0x7efd880a9760 2023-12-24T18:36:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880ac340 con 0x7efd88158cd0 2023-12-24T18:36:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8ed63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8816a6d0 con 0x7efd880a92e0 2023-12-24T18:36:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51716/0 (socket says 172.21.15.50:51716) 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 -- 172.21.15.50:0/1425987906 learned_addr learned my addr 172.21.15.50:0/1425987906 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8d560700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd880a9760 0x7efd881552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 -- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd880a92e0 msgr2=0x7efd880ac7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd880a92e0 0x7efd880ac7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 -- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd880a9760 msgr2=0x7efd881552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd880a9760 0x7efd881552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 -- 172.21.15.50:0/1425987906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009420 con 0x7efd88158cd0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.527+0000 7efd8e562700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd8000cbc0 tx=0x7efd80001960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000a830 con 0x7efd88158cd0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8000a990 con 0x7efd88158cd0 2023-12-24T18:36:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000ad50 con 0x7efd88158cd0 2023-12-24T18:36:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880abcf0 con 0x7efd88158cd0 2023-12-24T18:36:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd880afe40 con 0x7efd88158cd0 2023-12-24T18:36:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.531+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd880abb50 con 0x7efd88158cd0 2023-12-24T18:36:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.535+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efd80035b50 con 0x7efd88158cd0 2023-12-24T18:36:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.535+0000 7efd7dffb700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 0x7efd6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.535+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7efd8007cea0 con 0x7efd88158cd0 2023-12-24T18:36:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.535+0000 7efd8dd61700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 0x7efd6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.539+0000 7efd8dd61700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 0x7efd6c062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd840091e0 tx=0x7efd84017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.543+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd8004d200 con 0x7efd88158cd0 2023-12-24T18:36:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 Processor -- start 2023-12-24T18:36:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 -- start start 2023-12-24T18:36:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7f0da082e700 1 Processor -- start 2023-12-24T18:36:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7f0da082e700 1 -- start start 2023-12-24T18:36:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd8415d6d0 0x7efd840b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840b41d0 con 0x7efd84158e10 2023-12-24T18:36:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8406d5c0 con 0x7efd840b1ba0 2023-12-24T18:36:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.559+0000 7efd88c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840b49c0 con 0x7efd8415d6d0 2023-12-24T18:36:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd82d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd840b1ba0 0x7efd841591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38342/0 (socket says 172.21.15.50:38342) 2023-12-24T18:36:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd82d9d700 1 -- 172.21.15.50:0/3500761513 learned_addr learned my addr 172.21.15.50:0/3500761513 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330960329 0 0) 0x7efd840b41d0 con 0x7efd84158e10 2023-12-24T18:36:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6c003570 con 0x7efd84158e10 2023-12-24T18:36:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600877215 0 0) 0x7efd8406d5c0 con 0x7efd840b1ba0 2023-12-24T18:36:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6c0048f0 con 0x7efd840b1ba0 2023-12-24T18:36:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd81d9b700 1 --2- 172.21.15.50:0/3500761513 >> v2:172.21.15.82:3300/0 conn(0x7efd8415d6d0 0x7efd840b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0da082e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d9c159030 0x7f0d9c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0d9a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d9c159030 0x7f0d9c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0d9a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d9c159030 0x7f0d9c06c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51734/0 (socket says 172.21.15.50:51734) 2023-12-24T18:36:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2973723532 0 0) 0x7efd6c0048f0 con 0x7efd840b1ba0 2023-12-24T18:36:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 >> v2:172.21.15.82:3300/0 conn(0x7efd8415d6d0 msgr2=0x7efd840b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 --2- 172.21.15.50:0/3500761513 >> v2:172.21.15.82:3300/0 conn(0x7efd8415d6d0 0x7efd840b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 >> v1:172.21.15.50:6789/0 conn(0x7efd84158e10 legacy=0x7efd8406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8415db20 con 0x7efd840b1ba0 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7efd7c0017f0 con 0x7efd840b1ba0 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 >> v1:172.21.15.82:6789/0 conn(0x7efd840b1ba0 legacy=0x7efd841591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6c004e50 0x7efd6c005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c003870 0x7efd6c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 0x7efd6c00baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840b49c0 con 0x7efd6c004350 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c00c2e0 con 0x7efd6c003870 2023-12-24T18:36:48.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c00c4a0 con 0x7efd6c004e50 2023-12-24T18:36:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0d9a59c700 1 -- 172.21.15.50:0/549615227 learned_addr learned my addr 172.21.15.50:0/549615227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0da082e700 1 --2- 172.21.15.50:0/549615227 >> v2:172.21.15.50:3300/0 conn(0x7f0d9c067ac0 0x7f0d9c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c067fc0 con 0x7f0d9c159400 2023-12-24T18:36:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c15dd20 con 0x7f0d9c067ac0 2023-12-24T18:36:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c0682a0 con 0x7f0d9c159030 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd82d9d700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 0x7efd6c00baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.563+0000 7efd8259c700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6c004e50 0x7efd6c005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 -- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6c004e50 msgr2=0x7efd6c005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd6c004e50 0x7efd6c005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 -- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c003870 msgr2=0x7efd6c003ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c003870 0x7efd6c003ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 -- 172.21.15.50:0/3500761513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0048f0 con 0x7efd6c004350 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9a59c700 1 -- 172.21.15.50:0/549615227 >> v2:172.21.15.50:3300/0 conn(0x7f0d9c067ac0 msgr2=0x7f0d9c0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9a59c700 1 --2- 172.21.15.50:0/549615227 >> v2:172.21.15.50:3300/0 conn(0x7f0d9c067ac0 0x7f0d9c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9a59c700 1 -- 172.21.15.50:0/549615227 >> v1:172.21.15.50:6789/0 conn(0x7f0d9c159400 legacy=0x7f0d9c06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9a59c700 1 -- 172.21.15.50:0/549615227 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c068580 con 0x7f0d9c159030 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 -- 172.21.15.50:0/3500761513 reap_dead start 2023-12-24T18:36:48.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd82d9d700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 0x7efd6c00baa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00a8a0 tx=0x7efd8406d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aad15df483a0e1f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9a59c700 1 --2- 172.21.15.50:0/549615227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c159030 0x7f0d9c06c820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06a920 tx=0x7f0d8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75c5cbc042722832 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0070f0 con 0x7efd6c004350 2023-12-24T18:36:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c007250 con 0x7efd6c004350 2023-12-24T18:36:48.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9959a700 1 -- 172.21.15.50:0/549615227 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00b860 con 0x7f0d9c159030 2023-12-24T18:36:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9959a700 1 -- 172.21.15.50:0/549615227 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00b9c0 con 0x7f0d9c159030 2023-12-24T18:36:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0d9959a700 1 -- 172.21.15.50:0/549615227 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00bd40 con 0x7f0d9c159030 2023-12-24T18:36:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd88c2e700 1 -- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 msgr2=0x7efd6c00baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c159030 msgr2=0x7f0d9c06c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 --2- 172.21.15.50:0/549615227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c159030 0x7f0d9c06c820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06a920 tx=0x7f0d8c009250 comp rx=0 tx=0).stop 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd8159a700 1 -- 172.21.15.50:0/3500761513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0070f0 con 0x7efd6c004350 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd88c2e700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 0x7efd6c00baa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00a8a0 tx=0x7efd8406d530 comp rx=0 tx=0).stop 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 shutdown_connections 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 --2- 172.21.15.50:0/549615227 >> v2:172.21.15.50:3300/0 conn(0x7f0d9c067ac0 0x7f0d9c0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 --2- 172.21.15.50:0/549615227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c159030 0x7f0d9c06c820 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 >> 172.21.15.50:0/549615227 conn(0x7f0d9c06ab20 msgr2=0x7f0d9c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 shutdown_connections 2023-12-24T18:36:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd88c2e700 1 -- 172.21.15.50:0/3500761513 shutdown_connections 2023-12-24T18:36:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd88c2e700 1 --2- 172.21.15.50:0/3500761513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004350 0x7efd6c00baa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7efd88c2e700 1 -- 172.21.15.50:0/3500761513 >> 172.21.15.50:0/3500761513 conn(0x7efd840670b0 msgr2=0x7efd840674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.567+0000 7f0da082e700 1 -- 172.21.15.50:0/549615227 wait complete. 2023-12-24T18:36:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7efd88c2e700 1 -- 172.21.15.50:0/3500761513 shutdown_connections 2023-12-24T18:36:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7efd88c2e700 1 -- 172.21.15.50:0/3500761513 wait complete. 2023-12-24T18:36:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7f0da082e700 1 Processor -- start 2023-12-24T18:36:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7efd88c2e700 1 Processor -- start 2023-12-24T18:36:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7f0da082e700 1 -- start start 2023-12-24T18:36:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.571+0000 7efd88c2e700 1 -- start start 2023-12-24T18:36:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 0x7f0d9c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 0x7f0d9c16a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c16a6a0 con 0x7f0d9c159030 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c1470f0 con 0x7f0d9c067ac0 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0da082e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c15ab10 con 0x7f0d9c159400 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 0x7efd84147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 0x7efd84151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd840cf090 0x7efd840cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 0x7f0d9c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45174/0 (socket says 172.21.15.50:45174) 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 0x7f0d9c159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51744/0 (socket says 172.21.15.50:51744) 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 -- 172.21.15.50:0/2511311804 learned_addr learned my addr 172.21.15.50:0/2511311804 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d99d9b700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 0x7f0d9c16a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 0x7efd84147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 0x7efd84147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51752/0 (socket says 172.21.15.50:51752) 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd8259c700 1 -- 172.21.15.50:0/1485030127 learned_addr learned my addr 172.21.15.50:0/1485030127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84152350 con 0x7efd841519a0 2023-12-24T18:36:48.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84170940 con 0x7efd6c004350 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd841714c0 con 0x7efd840cf090 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 0x7efd84151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 -- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 msgr2=0x7f0d9c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 0x7f0d9c159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 -- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 msgr2=0x7f0d9c16a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd82d9d700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd840cf090 0x7efd840cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 0x7f0d9c16a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 -- 172.21.15.50:0/2511311804 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0094f0 con 0x7f0d9c159400 2023-12-24T18:36:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d99d9b700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 0x7f0d9c16a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 -- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd840cf090 msgr2=0x7efd840cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd840cf090 0x7efd840cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 -- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 msgr2=0x7efd84147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 0x7efd84147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84170b90 con 0x7efd841519a0 2023-12-24T18:36:48.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7f0d9ad9d700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400bc60 tx=0x7f0d94009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d940092e0 con 0x7f0d9c159400 2023-12-24T18:36:48.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.575+0000 7efd81d9b700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 0x7efd84151e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd78009fd0 tx=0x7efd780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c159f00 con 0x7f0d9c159400 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c15a4c0 con 0x7f0d9c159400 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400c5d0 con 0x7f0d9c159400 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400c990 con 0x7f0d9c159400 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d800052b0 con 0x7f0d9c159400 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78013680 con 0x7efd841519a0 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78013800 con 0x7efd841519a0 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78013bc0 con 0x7efd841519a0 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84170e70 con 0x7efd841519a0 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd84148240 con 0x7efd841519a0 2023-12-24T18:36:48.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.579+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd841712f0 con 0x7efd841519a0 2023-12-24T18:36:48.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.583+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0d94012070 con 0x7f0d9c159400 2023-12-24T18:36:48.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.583+0000 7f0d8a7fc700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 0x7f0d7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.583+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f0d9407c530 con 0x7f0d9c159400 2023-12-24T18:36:48.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.587+0000 7f0d9a59c700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 0x7f0d7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.587+0000 7f0d9a59c700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 0x7f0d7c062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06a920 tx=0x7f0d8c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.587+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efd780253d0 con 0x7efd841519a0 2023-12-24T18:36:48.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.587+0000 7efd727fc700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 0x7efd64062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:48.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.587+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7efd7807d180 con 0x7efd841519a0 2023-12-24T18:36:48.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.591+0000 7efd8259c700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 0x7efd64062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:48.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.591+0000 7efd8259c700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 0x7efd64062b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd74009650 tx=0x7efd74010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:48.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.591+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d9404c790 con 0x7f0d9c159400 2023-12-24T18:36:48.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.591+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd7804d460 con 0x7efd841519a0 2023-12-24T18:36:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.691+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9cc169480 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.691+0000 7fb9b37fe700 1 -- 172.21.15.50:0/2367083286 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9cc169480 con 0x7fb9cc06d8c0 2023-12-24T18:36:48.694 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-24T18:36:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 msgr2=0x7fb9b8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 0x7fb9b8062ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0093c0 tx=0x7fb9bc016000 comp rx=0 tx=0).stop 2023-12-24T18:36:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 msgr2=0x7fb9cc15ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 0x7fb9cc15ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b610 tx=0x7fb9c00090f0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 shutdown_connections 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb9b8060620 0x7fb9b8062ad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc158e00 0x7fb9cc1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc06d8c0 0x7fb9cc15ae40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 --2- 172.21.15.50:0/2367083286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9cc06a580 0x7fb9cc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 >> 172.21.15.50:0/2367083286 conn(0x7fb9cc067b80 msgr2=0x7fb9cc0b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 shutdown_connections 2023-12-24T18:36:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.695+0000 7fb9d0ae3700 1 -- 172.21.15.50:0/2367083286 wait complete. 2023-12-24T18:36:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.699+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e20005560 con 0x7f5e3806d8c0 2023-12-24T18:36:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.703+0000 7f5e2e7fc700 1 -- 172.21.15.50:0/63722628 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e2804cf70 con 0x7f5e3806d8c0 2023-12-24T18:36:48.705 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 msgr2=0x7f5e1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 0x7f5e1c062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e340099b0 tx=0x7f5e34017000 comp rx=0 tx=0).stop 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 msgr2=0x7f5e380ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 0x7f5e380ce120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800ea50 tx=0x7f5e280091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 shutdown_connections 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5e1c060550 0x7f5e1c062a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815e3a0 0x7f5e38088310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e3806d8c0 0x7f5e380ce120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 --2- 172.21.15.50:0/63722628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3806a580 0x7f5e38144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 >> 172.21.15.50:0/63722628 conn(0x7f5e38067b80 msgr2=0x7f5e380b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 shutdown_connections 2023-12-24T18:36:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.707+0000 7f5e3f1cc700 1 -- 172.21.15.50:0/63722628 wait complete. 2023-12-24T18:36:48.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-12-24T18:36:48.715 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-24T18:36:48.735 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.763+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f551806c4d0 con 0x7f55181611b0 2023-12-24T18:36:48.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f550ffff700 1 -- 172.21.15.50:0/2752453914 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f551806c4d0 con 0x7f55181611b0 2023-12-24T18:36:48.768 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 msgr2=0x7f54f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 0x7f54f8062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5508001ad0 tx=0x7f5508009040 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 msgr2=0x7f55181709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 0x7f55181709a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f551000c7e0 tx=0x7f55100015f0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 shutdown_connections 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f54f8060550 0x7f54f8062a00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55181611b0 0x7f55181709a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180ae100 0x7f55180affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 --2- 172.21.15.50:0/2752453914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806c820 0x7f55180a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 >> 172.21.15.50:0/2752453914 conn(0x7f5518067b80 msgr2=0x7f551815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 shutdown_connections 2023-12-24T18:36:48.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.767+0000 7f551c9c3700 1 -- 172.21.15.50:0/2752453914 wait complete. 2023-12-24T18:36:48.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-12-24T18:36:48.789 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.807+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f77340652e0 con 0x7f7734159a20 2023-12-24T18:36:48.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.807+0000 7f77227fc700 1 -- 172.21.15.50:0/4031259108 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f772c050c10 con 0x7f7734159a20 2023-12-24T18:36:48.810 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-24T18:36:48.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 msgr2=0x7f7714062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 0x7f7714062b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d40 tx=0x7f7724008040 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 msgr2=0x7f773408a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 0x7f773408a6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e70 tx=0x7f772c00b040 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 shutdown_connections 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77140606a0 0x7f7714062b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7734159a20 0x7f773408a6f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77340ce750 0x7f773408a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 --2- 172.21.15.50:0/4031259108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773406ae30 0x7f7734147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 >> 172.21.15.50:0/4031259108 conn(0x7f77340cffb0 msgr2=0x7f77340b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 shutdown_connections 2023-12-24T18:36:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.811+0000 7f7738cae700 1 -- 172.21.15.50:0/4031259108 wait complete. 2023-12-24T18:36:48.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-12-24T18:36:48.837 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efd840652e0 con 0x7efd841519a0 2023-12-24T18:36:48.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd727fc700 1 -- 172.21.15.50:0/1485030127 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd78050a80 con 0x7efd841519a0 2023-12-24T18:36:48.881 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 msgr2=0x7efd64062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 0x7efd64062b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd74009650 tx=0x7efd74010040 comp rx=0 tx=0).stop 2023-12-24T18:36:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 msgr2=0x7efd84151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 0x7efd84151e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd78009fd0 tx=0x7efd780091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd880abb50 con 0x7efd88158cd0 2023-12-24T18:36:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 shutdown_connections 2023-12-24T18:36:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd640606a0 0x7efd64062b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd840cf090 0x7efd840cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841519a0 0x7efd84151e10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 --2- 172.21.15.50:0/1485030127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6c004350 0x7efd84147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.879+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 >> 172.21.15.50:0/1485030127 conn(0x7efd840670b0 msgr2=0x7efd84155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.883+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 shutdown_connections 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.883+0000 7efd88c2e700 1 -- 172.21.15.50:0/1485030127 wait complete. 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.883+0000 7efd7dffb700 1 -- 172.21.15.50:0/1425987906 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd880abb50 con 0x7efd88158cd0 2023-12-24T18:36:48.885 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:48.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 msgr2=0x7efd6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 0x7efd6c062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd840091e0 tx=0x7efd84017000 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 msgr2=0x7efd880af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd8000cbc0 tx=0x7efd80001960 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 shutdown_connections 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efd6c060550 0x7efd6c062a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88158cd0 0x7efd880af900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd880a9760 0x7efd881552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 --2- 172.21.15.50:0/1425987906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd880a92e0 0x7efd880ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 >> 172.21.15.50:0/1425987906 conn(0x7efd88067ae0 msgr2=0x7efd88157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 shutdown_connections 2023-12-24T18:36:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.887+0000 7efd8ed63700 1 -- 172.21.15.50:0/1425987906 wait complete. 2023-12-24T18:36:48.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-12-24T18:36:48.901 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-12-24T18:36:48.909 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.907+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0d80005560 con 0x7f0d9c159400 2023-12-24T18:36:48.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0d8a7fc700 1 -- 172.21.15.50:0/2511311804 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d9404fdb0 con 0x7f0d9c159400 2023-12-24T18:36:48.912 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 msgr2=0x7f0d7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 0x7f0d7c062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06a920 tx=0x7f0d8c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 msgr2=0x7f0d9c146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400bc60 tx=0x7f0d94009840 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 shutdown_connections 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0d7c060550 0x7f0d7c062a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d9c159400 0x7f0d9c146bb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d9c159030 0x7f0d9c16a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 --2- 172.21.15.50:0/2511311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d9c067ac0 0x7f0d9c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 >> 172.21.15.50:0/2511311804 conn(0x7f0d9c06ab20 msgr2=0x7f0d9c152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:48.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 shutdown_connections 2023-12-24T18:36:48.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:48.911+0000 7f0da082e700 1 -- 172.21.15.50:0/2511311804 wait complete. 2023-12-24T18:36:48.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-12-24T18:36:48.938 DEBUG:teuthology.parallel:result is None 2023-12-24T18:36:48.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-24T18:36:48.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:36:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.147+0000 7fca73985700 1 Processor -- start 2023-12-24T18:36:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.147+0000 7fca73985700 1 -- start start 2023-12-24T18:36:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca73985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c158e70 0x7fca6c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca73985700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca6c0cc6a0 0x7fca6c0679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca73985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c0ccaf0 con 0x7fca6c067ef0 2023-12-24T18:36:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca73985700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c0686e0 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca73985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0689c0 con 0x7fca6c158e70 2023-12-24T18:36:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca6c0cc6a0 0x7fca6c0679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca71f22700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca6c067ef0 0x7fca6c0c8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:38346/0 (socket says 172.21.15.50:38346) 2023-12-24T18:36:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca71f22700 1 -- 172.21.15.50:0/1418949094 learned_addr learned my addr 172.21.15.50:0/1418949094 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca71721700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c158e70 0x7fca6c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca63fff700 1 -- 172.21.15.50:0/1418949094 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407046720 0 0) 0x7fca6c0ccaf0 con 0x7fca6c067ef0 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca63fff700 1 -- 172.21.15.50:0/1418949094 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca58003570 con 0x7fca6c067ef0 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 -- 172.21.15.50:0/1418949094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c158e70 msgr2=0x7fca6c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c158e70 0x7fca6c0cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 -- 172.21.15.50:0/1418949094 >> v1:172.21.15.82:6789/0 conn(0x7fca6c067ef0 legacy=0x7fca6c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 -- 172.21.15.50:0/1418949094 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c068ca0 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.151+0000 7fca70f20700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c0cc6a0 0x7fca6c0679b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0098e0 tx=0x7fca5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2481c42474e208cc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca63fff700 1 -- 172.21.15.50:0/1418949094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c011630 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca63fff700 1 -- 172.21.15.50:0/1418949094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c011790 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca63fff700 1 -- 172.21.15.50:0/1418949094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c011b30 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 -- 172.21.15.50:0/1418949094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c0cc6a0 msgr2=0x7fca6c0679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c0cc6a0 0x7fca6c0679b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0098e0 tx=0x7fca5c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 -- 172.21.15.50:0/1418949094 shutdown_connections 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c0cc6a0 0x7fca6c0679b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 --2- 172.21.15.50:0/1418949094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c158e70 0x7fca6c0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 -- 172.21.15.50:0/1418949094 >> 172.21.15.50:0/1418949094 conn(0x7fca6c0cdd80 msgr2=0x7fca6c0ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 -- 172.21.15.50:0/1418949094 shutdown_connections 2023-12-24T18:36:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.155+0000 7fca73985700 1 -- 172.21.15.50:0/1418949094 wait complete. 2023-12-24T18:36:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 Processor -- start 2023-12-24T18:36:49.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 -- start start 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 0x7fca6c152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 0x7fca6c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0aedd0 con 0x7fca6c158e70 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0b2000 con 0x7fca6c067ef0 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca73985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0ae530 con 0x7fca6c0cc6a0 2023-12-24T18:36:49.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32878/0 (socket says 172.21.15.50:32878) 2023-12-24T18:36:49.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 -- 172.21.15.50:0/2230294800 learned_addr learned my addr 172.21.15.50:0/2230294800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:49.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca70f20700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 0x7fca6c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71721700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 0x7fca6c152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 -- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 msgr2=0x7fca6c0adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 0x7fca6c0adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 -- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 msgr2=0x7fca6c152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 0x7fca6c152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 -- 172.21.15.50:0/2230294800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009420 con 0x7fca6c158e70 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca70f20700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 0x7fca6c0adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71721700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 0x7fca6c152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.159+0000 7fca71f22700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca64001460 tx=0x7fca64001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400ce80 con 0x7fca6c158e70 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400ab70 con 0x7fca6c158e70 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c0ae810 con 0x7fca6c158e70 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640070f0 con 0x7fca6c158e70 2023-12-24T18:36:49.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c153370 con 0x7fca6c158e70 2023-12-24T18:36:49.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c0b2190 con 0x7fca6c158e70 2023-12-24T18:36:49.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.163+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fca640074e0 con 0x7fca6c158e70 2023-12-24T18:36:49.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.167+0000 7fca617fa700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 0x7fca50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.167+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fca6407cfb0 con 0x7fca6c158e70 2023-12-24T18:36:49.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.167+0000 7fca71721700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 0x7fca50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.167+0000 7fca71721700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 0x7fca50062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca68009ce0 tx=0x7fca68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.175+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca6404d290 con 0x7fca6c158e70 2023-12-24T18:36:49.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.343+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca6c0652e0 con 0x7fca50060550 2023-12-24T18:36:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.355+0000 7fca617fa700 1 -- 172.21.15.50:0/2230294800 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345064 (secure 0 0 0) 0x7fca6c0652e0 con 0x7fca50060550 2023-12-24T18:36:49.363 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 msgr2=0x7fca50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 0x7fca50062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca68009ce0 tx=0x7fca68008040 comp rx=0 tx=0).stop 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 msgr2=0x7fca6c156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca64001460 tx=0x7fca64001ae0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 shutdown_connections 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca50060550 0x7fca50062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6c158e70 0x7fca6c156ea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca6c0cc6a0 0x7fca6c0adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 --2- 172.21.15.50:0/2230294800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c067ef0 0x7fca6c152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 >> 172.21.15.50:0/2230294800 conn(0x7fca6c0cdd80 msgr2=0x7fca6c1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:49.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 shutdown_connections 2023-12-24T18:36:49.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.363+0000 7fca73985700 1 -- 172.21.15.50:0/2230294800 wait complete. 2023-12-24T18:36:49.367 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:36:49.385 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-24T18:36:48.745338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594851,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389800,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752584920,"statfs":{"total":773094113280,"available":770646958080,"internally_reserved":0,"allocated":3383296,"data_stored":2042030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2177,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006936"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241897+0000","last_change":"2023-12-24T18:36:27.067874+0000","last_active":"2023-12-24T18:36:33.241897+0000","last_peered":"2023-12-24T18:36:33.241897+0000","last_clean":"2023-12-24T18:36:33.241897+0000","last_became_active":"2023-12-24T18:36:27.067357+0000","last_became_peered":"2023-12-24T18:36:27.067357+0000","last_unstale":"2023-12-24T18:36:33.241897+0000","last_undegraded":"2023-12-24T18:36:33.241897+0000","last_fullsized":"2023-12-24T18:36:33.241897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:32.763268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242535+0000","last_change":"2023-12-24T18:36:28.119303+0000","last_active":"2023-12-24T18:36:33.242535+0000","last_peered":"2023-12-24T18:36:33.242535+0000","last_clean":"2023-12-24T18:36:33.242535+0000","last_became_active":"2023-12-24T18:36:28.118209+0000","last_became_peered":"2023-12-24T18:36:28.118209+0000","last_unstale":"2023-12-24T18:36:33.242535+0000","last_undegraded":"2023-12-24T18:36:33.242535+0000","last_fullsized":"2023-12-24T18:36:33.242535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239078+0000","last_change":"2023-12-24T18:36:33.070625+0000","last_active":"2023-12-24T18:36:33.239078+0000","last_peered":"2023-12-24T18:36:33.239078+0000","last_clean":"2023-12-24T18:36:33.239078+0000","last_became_active":"2023-12-24T18:36:33.070191+0000","last_became_peered":"2023-12-24T18:36:33.070191+0000","last_unstale":"2023-12-24T18:36:33.239078+0000","last_undegraded":"2023-12-24T18:36:33.239078+0000","last_fullsized":"2023-12-24T18:36:33.239078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:48.436853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242441+0000","last_change":"2023-12-24T18:36:27.060014+0000","last_active":"2023-12-24T18:36:33.242441+0000","last_peered":"2023-12-24T18:36:33.242441+0000","last_clean":"2023-12-24T18:36:33.242441+0000","last_became_active":"2023-12-24T18:36:27.059722+0000","last_became_peered":"2023-12-24T18:36:27.059722+0000","last_unstale":"2023-12-24T18:36:33.242441+0000","last_undegraded":"2023-12-24T18:36:33.242441+0000","last_fullsized":"2023-12-24T18:36:33.242441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241708+0000","last_change":"2023-12-24T18:36:28.131047+0000","last_active":"2023-12-24T18:36:33.241708+0000","last_peered":"2023-12-24T18:36:33.241708+0000","last_clean":"2023-12-24T18:36:33.241708+0000","last_became_active":"2023-12-24T18:36:28.130191+0000","last_became_peered":"2023-12-24T18:36:28.130191+0000","last_unstale":"2023-12-24T18:36:33.241708+0000","last_undegraded":"2023-12-24T18:36:33.241708+0000","last_fullsized":"2023-12-24T18:36:33.241708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199190+0000","last_change":"2023-12-24T18:36:32.246048+0000","last_active":"2023-12-24T18:36:33.199190+0000","last_peered":"2023-12-24T18:36:33.199190+0000","last_clean":"2023-12-24T18:36:33.199190+0000","last_became_active":"2023-12-24T18:36:32.245486+0000","last_became_peered":"2023-12-24T18:36:32.245486+0000","last_unstale":"2023-12-24T18:36:33.199190+0000","last_undegraded":"2023-12-24T18:36:33.199190+0000","last_fullsized":"2023-12-24T18:36:33.199190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.571591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243552+0000","last_change":"2023-12-24T18:36:27.066546+0000","last_active":"2023-12-24T18:36:33.243552+0000","last_peered":"2023-12-24T18:36:33.243552+0000","last_clean":"2023-12-24T18:36:33.243552+0000","last_became_active":"2023-12-24T18:36:27.066019+0000","last_became_peered":"2023-12-24T18:36:27.066019+0000","last_unstale":"2023-12-24T18:36:33.243552+0000","last_undegraded":"2023-12-24T18:36:33.243552+0000","last_fullsized":"2023-12-24T18:36:33.243552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242331+0000","last_change":"2023-12-24T18:36:28.123809+0000","last_active":"2023-12-24T18:36:33.242331+0000","last_peered":"2023-12-24T18:36:33.242331+0000","last_clean":"2023-12-24T18:36:33.242331+0000","last_became_active":"2023-12-24T18:36:28.123245+0000","last_became_peered":"2023-12-24T18:36:28.123245+0000","last_unstale":"2023-12-24T18:36:33.242331+0000","last_undegraded":"2023-12-24T18:36:33.242331+0000","last_fullsized":"2023-12-24T18:36:33.242331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199447+0000","last_change":"2023-12-24T18:36:32.252818+0000","last_active":"2023-12-24T18:36:33.199447+0000","last_peered":"2023-12-24T18:36:33.199447+0000","last_clean":"2023-12-24T18:36:33.199447+0000","last_became_active":"2023-12-24T18:36:32.252148+0000","last_became_peered":"2023-12-24T18:36:32.252148+0000","last_unstale":"2023-12-24T18:36:33.199447+0000","last_undegraded":"2023-12-24T18:36:33.199447+0000","last_fullsized":"2023-12-24T18:36:33.199447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243368+0000","last_change":"2023-12-24T18:36:27.066329+0000","last_active":"2023-12-24T18:36:33.243368+0000","last_peered":"2023-12-24T18:36:33.243368+0000","last_clean":"2023-12-24T18:36:33.243368+0000","last_became_active":"2023-12-24T18:36:27.065986+0000","last_became_peered":"2023-12-24T18:36:27.065986+0000","last_unstale":"2023-12-24T18:36:33.243368+0000","last_undegraded":"2023-12-24T18:36:33.243368+0000","last_fullsized":"2023-12-24T18:36:33.243368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:52.372517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242678+0000","last_change":"2023-12-24T18:36:28.140301+0000","last_active":"2023-12-24T18:36:33.242678+0000","last_peered":"2023-12-24T18:36:33.242678+0000","last_clean":"2023-12-24T18:36:33.242678+0000","last_became_active":"2023-12-24T18:36:28.139952+0000","last_became_peered":"2023-12-24T18:36:28.139952+0000","last_unstale":"2023-12-24T18:36:33.242678+0000","last_undegraded":"2023-12-24T18:36:33.242678+0000","last_fullsized":"2023-12-24T18:36:33.242678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199244+0000","last_change":"2023-12-24T18:36:32.251947+0000","last_active":"2023-12-24T18:36:33.199244+0000","last_peered":"2023-12-24T18:36:33.199244+0000","last_clean":"2023-12-24T18:36:33.199244+0000","last_became_active":"2023-12-24T18:36:32.251493+0000","last_became_peered":"2023-12-24T18:36:32.251493+0000","last_unstale":"2023-12-24T18:36:33.199244+0000","last_undegraded":"2023-12-24T18:36:33.199244+0000","last_fullsized":"2023-12-24T18:36:33.199244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.373046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200254+0000","last_change":"2023-12-24T18:36:28.112650+0000","last_active":"2023-12-24T18:36:33.200254+0000","last_peered":"2023-12-24T18:36:33.200254+0000","last_clean":"2023-12-24T18:36:33.200254+0000","last_became_active":"2023-12-24T18:36:28.112348+0000","last_became_peered":"2023-12-24T18:36:28.112348+0000","last_unstale":"2023-12-24T18:36:33.200254+0000","last_undegraded":"2023-12-24T18:36:33.200254+0000","last_fullsized":"2023-12-24T18:36:33.200254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243195+0000","last_change":"2023-12-24T18:36:27.064104+0000","last_active":"2023-12-24T18:36:33.243195+0000","last_peered":"2023-12-24T18:36:33.243195+0000","last_clean":"2023-12-24T18:36:33.243195+0000","last_became_active":"2023-12-24T18:36:27.063768+0000","last_became_peered":"2023-12-24T18:36:27.063768+0000","last_unstale":"2023-12-24T18:36:33.243195+0000","last_undegraded":"2023-12-24T18:36:33.243195+0000","last_fullsized":"2023-12-24T18:36:33.243195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200486+0000","last_change":"2023-12-24T18:36:32.260683+0000","last_active":"2023-12-24T18:36:33.200486+0000","last_peered":"2023-12-24T18:36:33.200486+0000","last_clean":"2023-12-24T18:36:33.200486+0000","last_became_active":"2023-12-24T18:36:32.259717+0000","last_became_peered":"2023-12-24T18:36:32.259717+0000","last_unstale":"2023-12-24T18:36:33.200486+0000","last_undegraded":"2023-12-24T18:36:33.200486+0000","last_fullsized":"2023-12-24T18:36:33.200486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239484+0000","last_change":"2023-12-24T18:36:28.130197+0000","last_active":"2023-12-24T18:36:33.239484+0000","last_peered":"2023-12-24T18:36:33.239484+0000","last_clean":"2023-12-24T18:36:33.239484+0000","last_became_active":"2023-12-24T18:36:28.129812+0000","last_became_peered":"2023-12-24T18:36:28.129812+0000","last_unstale":"2023-12-24T18:36:33.239484+0000","last_undegraded":"2023-12-24T18:36:33.239484+0000","last_fullsized":"2023-12-24T18:36:33.239484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243815+0000","last_change":"2023-12-24T18:36:27.063829+0000","last_active":"2023-12-24T18:36:33.243815+0000","last_peered":"2023-12-24T18:36:33.243815+0000","last_clean":"2023-12-24T18:36:33.243815+0000","last_became_active":"2023-12-24T18:36:27.062587+0000","last_became_peered":"2023-12-24T18:36:27.062587+0000","last_unstale":"2023-12-24T18:36:33.243815+0000","last_undegraded":"2023-12-24T18:36:33.243815+0000","last_fullsized":"2023-12-24T18:36:33.243815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200123+0000","last_change":"2023-12-24T18:36:32.251112+0000","last_active":"2023-12-24T18:36:33.200123+0000","last_peered":"2023-12-24T18:36:33.200123+0000","last_clean":"2023-12-24T18:36:33.200123+0000","last_became_active":"2023-12-24T18:36:32.250532+0000","last_became_peered":"2023-12-24T18:36:32.250532+0000","last_unstale":"2023-12-24T18:36:33.200123+0000","last_undegraded":"2023-12-24T18:36:33.200123+0000","last_fullsized":"2023-12-24T18:36:33.200123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:03.439593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239627+0000","last_change":"2023-12-24T18:36:28.127286+0000","last_active":"2023-12-24T18:36:33.239627+0000","last_peered":"2023-12-24T18:36:33.239627+0000","last_clean":"2023-12-24T18:36:33.239627+0000","last_became_active":"2023-12-24T18:36:28.124689+0000","last_became_peered":"2023-12-24T18:36:28.124689+0000","last_unstale":"2023-12-24T18:36:33.239627+0000","last_undegraded":"2023-12-24T18:36:33.239627+0000","last_fullsized":"2023-12-24T18:36:33.239627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243454+0000","last_change":"2023-12-24T18:36:27.064165+0000","last_active":"2023-12-24T18:36:33.243454+0000","last_peered":"2023-12-24T18:36:33.243454+0000","last_clean":"2023-12-24T18:36:33.243454+0000","last_became_active":"2023-12-24T18:36:27.063434+0000","last_became_peered":"2023-12-24T18:36:27.063434+0000","last_unstale":"2023-12-24T18:36:33.243454+0000","last_undegraded":"2023-12-24T18:36:33.243454+0000","last_fullsized":"2023-12-24T18:36:33.243454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:33.062973+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:33.061726+0000","last_became_peered":"2023-12-24T18:36:33.061726+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199485+0000","last_change":"2023-12-24T18:36:28.105114+0000","last_active":"2023-12-24T18:36:33.199485+0000","last_peered":"2023-12-24T18:36:33.199485+0000","last_clean":"2023-12-24T18:36:33.199485+0000","last_became_active":"2023-12-24T18:36:28.104834+0000","last_became_peered":"2023-12-24T18:36:28.104834+0000","last_unstale":"2023-12-24T18:36:33.199485+0000","last_undegraded":"2023-12-24T18:36:33.199485+0000","last_fullsized":"2023-12-24T18:36:33.199485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:26.768161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242012+0000","last_change":"2023-12-24T18:36:27.060303+0000","last_active":"2023-12-24T18:36:33.242012+0000","last_peered":"2023-12-24T18:36:33.242012+0000","last_clean":"2023-12-24T18:36:33.242012+0000","last_became_active":"2023-12-24T18:36:27.059902+0000","last_became_peered":"2023-12-24T18:36:27.059902+0000","last_unstale":"2023-12-24T18:36:33.242012+0000","last_undegraded":"2023-12-24T18:36:33.242012+0000","last_fullsized":"2023-12-24T18:36:33.242012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200312+0000","last_change":"2023-12-24T18:36:32.253987+0000","last_active":"2023-12-24T18:36:33.200312+0000","last_peered":"2023-12-24T18:36:33.200312+0000","last_clean":"2023-12-24T18:36:33.200312+0000","last_became_active":"2023-12-24T18:36:32.253471+0000","last_became_peered":"2023-12-24T18:36:32.253471+0000","last_unstale":"2023-12-24T18:36:33.200312+0000","last_undegraded":"2023-12-24T18:36:33.200312+0000","last_fullsized":"2023-12-24T18:36:33.200312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:35:45.397934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241468+0000","last_change":"2023-12-24T18:36:28.126747+0000","last_active":"2023-12-24T18:36:33.241468+0000","last_peered":"2023-12-24T18:36:33.241468+0000","last_clean":"2023-12-24T18:36:33.241468+0000","last_became_active":"2023-12-24T18:36:28.126438+0000","last_became_peered":"2023-12-24T18:36:28.126438+0000","last_unstale":"2023-12-24T18:36:33.241468+0000","last_undegraded":"2023-12-24T18:36:33.241468+0000","last_fullsized":"2023-12-24T18:36:33.241468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201595+0000","last_change":"2023-12-24T18:36:27.057217+0000","last_active":"2023-12-24T18:36:33.201595+0000","last_peered":"2023-12-24T18:36:33.201595+0000","last_clean":"2023-12-24T18:36:33.201595+0000","last_became_active":"2023-12-24T18:36:27.056927+0000","last_became_peered":"2023-12-24T18:36:27.056927+0000","last_unstale":"2023-12-24T18:36:33.201595+0000","last_undegraded":"2023-12-24T18:36:33.201595+0000","last_fullsized":"2023-12-24T18:36:33.201595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.198620+0000","last_change":"2023-12-24T18:36:33.060205+0000","last_active":"2023-12-24T18:36:33.198620+0000","last_peered":"2023-12-24T18:36:33.198620+0000","last_clean":"2023-12-24T18:36:33.198620+0000","last_became_active":"2023-12-24T18:36:33.059701+0000","last_became_peered":"2023-12-24T18:36:33.059701+0000","last_unstale":"2023-12-24T18:36:33.198620+0000","last_undegraded":"2023-12-24T18:36:33.198620+0000","last_fullsized":"2023-12-24T18:36:33.198620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.334113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242412+0000","last_change":"2023-12-24T18:36:28.129033+0000","last_active":"2023-12-24T18:36:33.242412+0000","last_peered":"2023-12-24T18:36:33.242412+0000","last_clean":"2023-12-24T18:36:33.242412+0000","last_became_active":"2023-12-24T18:36:28.128733+0000","last_became_peered":"2023-12-24T18:36:28.128733+0000","last_unstale":"2023-12-24T18:36:33.242412+0000","last_undegraded":"2023-12-24T18:36:33.242412+0000","last_fullsized":"2023-12-24T18:36:33.242412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244611+0000","last_change":"2023-12-24T18:36:27.057152+0000","last_active":"2023-12-24T18:36:33.244611+0000","last_peered":"2023-12-24T18:36:33.244611+0000","last_clean":"2023-12-24T18:36:33.244611+0000","last_became_active":"2023-12-24T18:36:27.056715+0000","last_became_peered":"2023-12-24T18:36:27.056715+0000","last_unstale":"2023-12-24T18:36:33.244611+0000","last_undegraded":"2023-12-24T18:36:33.244611+0000","last_fullsized":"2023-12-24T18:36:33.244611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238838+0000","last_change":"2023-12-24T18:36:33.067986+0000","last_active":"2023-12-24T18:36:33.238838+0000","last_peered":"2023-12-24T18:36:33.238838+0000","last_clean":"2023-12-24T18:36:33.238838+0000","last_became_active":"2023-12-24T18:36:33.066990+0000","last_became_peered":"2023-12-24T18:36:33.066990+0000","last_unstale":"2023-12-24T18:36:33.238838+0000","last_undegraded":"2023-12-24T18:36:33.238838+0000","last_fullsized":"2023-12-24T18:36:33.238838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:35:52.743174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244319+0000","last_change":"2023-12-24T18:36:28.119947+0000","last_active":"2023-12-24T18:36:33.244319+0000","last_peered":"2023-12-24T18:36:33.244319+0000","last_clean":"2023-12-24T18:36:33.244319+0000","last_became_active":"2023-12-24T18:36:28.119615+0000","last_became_peered":"2023-12-24T18:36:28.119615+0000","last_unstale":"2023-12-24T18:36:33.244319+0000","last_undegraded":"2023-12-24T18:36:33.244319+0000","last_fullsized":"2023-12-24T18:36:33.244319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243706+0000","last_change":"2023-12-24T18:36:27.062308+0000","last_active":"2023-12-24T18:36:33.243706+0000","last_peered":"2023-12-24T18:36:33.243706+0000","last_clean":"2023-12-24T18:36:33.243706+0000","last_became_active":"2023-12-24T18:36:27.061932+0000","last_became_peered":"2023-12-24T18:36:27.061932+0000","last_unstale":"2023-12-24T18:36:33.243706+0000","last_undegraded":"2023-12-24T18:36:33.243706+0000","last_fullsized":"2023-12-24T18:36:33.243706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240201+0000","last_change":"2023-12-24T18:36:33.063574+0000","last_active":"2023-12-24T18:36:33.240201+0000","last_peered":"2023-12-24T18:36:33.240201+0000","last_clean":"2023-12-24T18:36:33.240201+0000","last_became_active":"2023-12-24T18:36:33.062383+0000","last_became_peered":"2023-12-24T18:36:33.062383+0000","last_unstale":"2023-12-24T18:36:33.240201+0000","last_undegraded":"2023-12-24T18:36:33.240201+0000","last_fullsized":"2023-12-24T18:36:33.240201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242767+0000","last_change":"2023-12-24T18:36:28.123563+0000","last_active":"2023-12-24T18:36:33.242767+0000","last_peered":"2023-12-24T18:36:33.242767+0000","last_clean":"2023-12-24T18:36:33.242767+0000","last_became_active":"2023-12-24T18:36:28.123262+0000","last_became_peered":"2023-12-24T18:36:28.123262+0000","last_unstale":"2023-12-24T18:36:33.242767+0000","last_undegraded":"2023-12-24T18:36:33.242767+0000","last_fullsized":"2023-12-24T18:36:33.242767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244465+0000","last_change":"2023-12-24T18:36:27.059665+0000","last_active":"2023-12-24T18:36:33.244465+0000","last_peered":"2023-12-24T18:36:33.244465+0000","last_clean":"2023-12-24T18:36:33.244465+0000","last_became_active":"2023-12-24T18:36:27.059247+0000","last_became_peered":"2023-12-24T18:36:27.059247+0000","last_unstale":"2023-12-24T18:36:33.244465+0000","last_undegraded":"2023-12-24T18:36:33.244465+0000","last_fullsized":"2023-12-24T18:36:33.244465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243546+0000","last_change":"2023-12-24T18:36:32.265642+0000","last_active":"2023-12-24T18:36:33.243546+0000","last_peered":"2023-12-24T18:36:33.243546+0000","last_clean":"2023-12-24T18:36:33.243546+0000","last_became_active":"2023-12-24T18:36:32.263802+0000","last_became_peered":"2023-12-24T18:36:32.263802+0000","last_unstale":"2023-12-24T18:36:33.243546+0000","last_undegraded":"2023-12-24T18:36:33.243546+0000","last_fullsized":"2023-12-24T18:36:33.243546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199889+0000","last_change":"2023-12-24T18:36:28.132237+0000","last_active":"2023-12-24T18:36:33.199889+0000","last_peered":"2023-12-24T18:36:33.199889+0000","last_clean":"2023-12-24T18:36:33.199889+0000","last_became_active":"2023-12-24T18:36:28.131848+0000","last_became_peered":"2023-12-24T18:36:28.131848+0000","last_unstale":"2023-12-24T18:36:33.199889+0000","last_undegraded":"2023-12-24T18:36:33.199889+0000","last_fullsized":"2023-12-24T18:36:33.199889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:13.673004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:27.062395+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:27.058997+0000","last_became_peered":"2023-12-24T18:36:27.058997+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244195+0000","last_change":"2023-12-24T18:36:32.250289+0000","last_active":"2023-12-24T18:36:33.244195+0000","last_peered":"2023-12-24T18:36:33.244195+0000","last_clean":"2023-12-24T18:36:33.244195+0000","last_became_active":"2023-12-24T18:36:32.248948+0000","last_became_peered":"2023-12-24T18:36:32.248948+0000","last_unstale":"2023-12-24T18:36:33.244195+0000","last_undegraded":"2023-12-24T18:36:33.244195+0000","last_fullsized":"2023-12-24T18:36:33.244195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243453+0000","last_change":"2023-12-24T18:36:28.119555+0000","last_active":"2023-12-24T18:36:33.243453+0000","last_peered":"2023-12-24T18:36:33.243453+0000","last_clean":"2023-12-24T18:36:33.243453+0000","last_became_active":"2023-12-24T18:36:28.119221+0000","last_became_peered":"2023-12-24T18:36:28.119221+0000","last_unstale":"2023-12-24T18:36:33.243453+0000","last_undegraded":"2023-12-24T18:36:33.243453+0000","last_fullsized":"2023-12-24T18:36:33.243453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196052+0000","last_change":"2023-12-24T18:36:27.069466+0000","last_active":"2023-12-24T18:36:33.196052+0000","last_peered":"2023-12-24T18:36:33.196052+0000","last_clean":"2023-12-24T18:36:33.196052+0000","last_became_active":"2023-12-24T18:36:27.069134+0000","last_became_peered":"2023-12-24T18:36:27.069134+0000","last_unstale":"2023-12-24T18:36:33.196052+0000","last_undegraded":"2023-12-24T18:36:33.196052+0000","last_fullsized":"2023-12-24T18:36:33.196052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244716+0000","last_change":"2023-12-24T18:36:32.261732+0000","last_active":"2023-12-24T18:36:33.244716+0000","last_peered":"2023-12-24T18:36:33.244716+0000","last_clean":"2023-12-24T18:36:33.244716+0000","last_became_active":"2023-12-24T18:36:32.261227+0000","last_became_peered":"2023-12-24T18:36:32.261227+0000","last_unstale":"2023-12-24T18:36:33.244716+0000","last_undegraded":"2023-12-24T18:36:33.244716+0000","last_fullsized":"2023-12-24T18:36:33.244716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240648+0000","last_change":"2023-12-24T18:36:28.132818+0000","last_active":"2023-12-24T18:36:33.240648+0000","last_peered":"2023-12-24T18:36:33.240648+0000","last_clean":"2023-12-24T18:36:33.240648+0000","last_became_active":"2023-12-24T18:36:28.132494+0000","last_became_peered":"2023-12-24T18:36:28.132494+0000","last_unstale":"2023-12-24T18:36:33.240648+0000","last_undegraded":"2023-12-24T18:36:33.240648+0000","last_fullsized":"2023-12-24T18:36:33.240648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242017+0000","last_change":"2023-12-24T18:36:27.064640+0000","last_active":"2023-12-24T18:36:33.242017+0000","last_peered":"2023-12-24T18:36:33.242017+0000","last_clean":"2023-12-24T18:36:33.242017+0000","last_became_active":"2023-12-24T18:36:27.064337+0000","last_became_peered":"2023-12-24T18:36:27.064337+0000","last_unstale":"2023-12-24T18:36:33.242017+0000","last_undegraded":"2023-12-24T18:36:33.242017+0000","last_fullsized":"2023-12-24T18:36:33.242017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240189+0000","last_change":"2023-12-24T18:36:33.065960+0000","last_active":"2023-12-24T18:36:33.240189+0000","last_peered":"2023-12-24T18:36:33.240189+0000","last_clean":"2023-12-24T18:36:33.240189+0000","last_became_active":"2023-12-24T18:36:33.064424+0000","last_became_peered":"2023-12-24T18:36:33.064424+0000","last_unstale":"2023-12-24T18:36:33.240189+0000","last_undegraded":"2023-12-24T18:36:33.240189+0000","last_fullsized":"2023-12-24T18:36:33.240189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239524+0000","last_change":"2023-12-24T18:36:28.125586+0000","last_active":"2023-12-24T18:36:33.239524+0000","last_peered":"2023-12-24T18:36:33.239524+0000","last_clean":"2023-12-24T18:36:33.239524+0000","last_became_active":"2023-12-24T18:36:28.125304+0000","last_became_peered":"2023-12-24T18:36:28.125304+0000","last_unstale":"2023-12-24T18:36:33.239524+0000","last_undegraded":"2023-12-24T18:36:33.239524+0000","last_fullsized":"2023-12-24T18:36:33.239524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242083+0000","last_change":"2023-12-24T18:36:27.059141+0000","last_active":"2023-12-24T18:36:33.242083+0000","last_peered":"2023-12-24T18:36:33.242083+0000","last_clean":"2023-12-24T18:36:33.242083+0000","last_became_active":"2023-12-24T18:36:27.058810+0000","last_became_peered":"2023-12-24T18:36:27.058810+0000","last_unstale":"2023-12-24T18:36:33.242083+0000","last_undegraded":"2023-12-24T18:36:33.242083+0000","last_fullsized":"2023-12-24T18:36:33.242083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242137+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:36:33.242137+0000","last_peered":"2023-12-24T18:36:33.242137+0000","last_clean":"2023-12-24T18:36:33.242137+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:36:33.242137+0000","last_undegraded":"2023-12-24T18:36:33.242137+0000","last_fullsized":"2023-12-24T18:36:33.242137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200983+0000","last_change":"2023-12-24T18:36:33.064479+0000","last_active":"2023-12-24T18:36:33.200983+0000","last_peered":"2023-12-24T18:36:33.200983+0000","last_clean":"2023-12-24T18:36:33.200983+0000","last_became_active":"2023-12-24T18:36:33.063934+0000","last_became_peered":"2023-12-24T18:36:33.063934+0000","last_unstale":"2023-12-24T18:36:33.200983+0000","last_undegraded":"2023-12-24T18:36:33.200983+0000","last_fullsized":"2023-12-24T18:36:33.200983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:51.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243499+0000","last_change":"2023-12-24T18:36:28.134054+0000","last_active":"2023-12-24T18:36:33.243499+0000","last_peered":"2023-12-24T18:36:33.243499+0000","last_clean":"2023-12-24T18:36:33.243499+0000","last_became_active":"2023-12-24T18:36:28.133272+0000","last_became_peered":"2023-12-24T18:36:28.133272+0000","last_unstale":"2023-12-24T18:36:33.243499+0000","last_undegraded":"2023-12-24T18:36:33.243499+0000","last_fullsized":"2023-12-24T18:36:33.243499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196949+0000","last_change":"2023-12-24T18:36:27.065885+0000","last_active":"2023-12-24T18:36:33.196949+0000","last_peered":"2023-12-24T18:36:33.196949+0000","last_clean":"2023-12-24T18:36:33.196949+0000","last_became_active":"2023-12-24T18:36:27.065497+0000","last_became_peered":"2023-12-24T18:36:27.065497+0000","last_unstale":"2023-12-24T18:36:33.196949+0000","last_undegraded":"2023-12-24T18:36:33.196949+0000","last_fullsized":"2023-12-24T18:36:33.196949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200105+0000","last_change":"2023-12-24T18:36:33.060407+0000","last_active":"2023-12-24T18:36:33.200105+0000","last_peered":"2023-12-24T18:36:33.200105+0000","last_clean":"2023-12-24T18:36:33.200105+0000","last_became_active":"2023-12-24T18:36:33.059656+0000","last_became_peered":"2023-12-24T18:36:33.059656+0000","last_unstale":"2023-12-24T18:36:33.200105+0000","last_undegraded":"2023-12-24T18:36:33.200105+0000","last_fullsized":"2023-12-24T18:36:33.200105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:16.143703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242382+0000","last_change":"2023-12-24T18:36:28.123920+0000","last_active":"2023-12-24T18:36:33.242382+0000","last_peered":"2023-12-24T18:36:33.242382+0000","last_clean":"2023-12-24T18:36:33.242382+0000","last_became_active":"2023-12-24T18:36:28.123641+0000","last_became_peered":"2023-12-24T18:36:28.123641+0000","last_unstale":"2023-12-24T18:36:33.242382+0000","last_undegraded":"2023-12-24T18:36:33.242382+0000","last_fullsized":"2023-12-24T18:36:33.242382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244368+0000","last_change":"2023-12-24T18:36:27.063621+0000","last_active":"2023-12-24T18:36:33.244368+0000","last_peered":"2023-12-24T18:36:33.244368+0000","last_clean":"2023-12-24T18:36:33.244368+0000","last_became_active":"2023-12-24T18:36:27.063049+0000","last_became_peered":"2023-12-24T18:36:27.063049+0000","last_unstale":"2023-12-24T18:36:33.244368+0000","last_undegraded":"2023-12-24T18:36:33.244368+0000","last_fullsized":"2023-12-24T18:36:33.244368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241302+0000","last_change":"2023-12-24T18:36:32.259376+0000","last_active":"2023-12-24T18:36:33.241302+0000","last_peered":"2023-12-24T18:36:33.241302+0000","last_clean":"2023-12-24T18:36:33.241302+0000","last_became_active":"2023-12-24T18:36:32.258898+0000","last_became_peered":"2023-12-24T18:36:32.258898+0000","last_unstale":"2023-12-24T18:36:33.241302+0000","last_undegraded":"2023-12-24T18:36:33.241302+0000","last_fullsized":"2023-12-24T18:36:33.241302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244486+0000","last_change":"2023-12-24T18:36:28.141826+0000","last_active":"2023-12-24T18:36:33.244486+0000","last_peered":"2023-12-24T18:36:33.244486+0000","last_clean":"2023-12-24T18:36:33.244486+0000","last_became_active":"2023-12-24T18:36:28.141592+0000","last_became_peered":"2023-12-24T18:36:28.141592+0000","last_unstale":"2023-12-24T18:36:33.244486+0000","last_undegraded":"2023-12-24T18:36:33.244486+0000","last_fullsized":"2023-12-24T18:36:33.244486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196802+0000","last_change":"2023-12-24T18:36:27.056563+0000","last_active":"2023-12-24T18:36:33.196802+0000","last_peered":"2023-12-24T18:36:33.196802+0000","last_clean":"2023-12-24T18:36:33.196802+0000","last_became_active":"2023-12-24T18:36:27.056162+0000","last_became_peered":"2023-12-24T18:36:27.056162+0000","last_unstale":"2023-12-24T18:36:33.196802+0000","last_undegraded":"2023-12-24T18:36:33.196802+0000","last_fullsized":"2023-12-24T18:36:33.196802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241573+0000","last_change":"2023-12-24T18:36:33.061190+0000","last_active":"2023-12-24T18:36:33.241573+0000","last_peered":"2023-12-24T18:36:33.241573+0000","last_clean":"2023-12-24T18:36:33.241573+0000","last_became_active":"2023-12-24T18:36:33.060776+0000","last_became_peered":"2023-12-24T18:36:33.060776+0000","last_unstale":"2023-12-24T18:36:33.241573+0000","last_undegraded":"2023-12-24T18:36:33.241573+0000","last_fullsized":"2023-12-24T18:36:33.241573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244050+0000","last_change":"2023-12-24T18:36:28.140877+0000","last_active":"2023-12-24T18:36:33.244050+0000","last_peered":"2023-12-24T18:36:33.244050+0000","last_clean":"2023-12-24T18:36:33.244050+0000","last_became_active":"2023-12-24T18:36:28.140557+0000","last_became_peered":"2023-12-24T18:36:28.140557+0000","last_unstale":"2023-12-24T18:36:33.244050+0000","last_undegraded":"2023-12-24T18:36:33.244050+0000","last_fullsized":"2023-12-24T18:36:33.244050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200942+0000","last_change":"2023-12-24T18:36:27.055292+0000","last_active":"2023-12-24T18:36:33.200942+0000","last_peered":"2023-12-24T18:36:33.200942+0000","last_clean":"2023-12-24T18:36:33.200942+0000","last_became_active":"2023-12-24T18:36:27.054059+0000","last_became_peered":"2023-12-24T18:36:27.054059+0000","last_unstale":"2023-12-24T18:36:33.200942+0000","last_undegraded":"2023-12-24T18:36:33.200942+0000","last_fullsized":"2023-12-24T18:36:33.200942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199154+0000","last_change":"2023-12-24T18:36:32.242682+0000","last_active":"2023-12-24T18:36:33.199154+0000","last_peered":"2023-12-24T18:36:33.199154+0000","last_clean":"2023-12-24T18:36:33.199154+0000","last_became_active":"2023-12-24T18:36:32.242104+0000","last_became_peered":"2023-12-24T18:36:32.242104+0000","last_unstale":"2023-12-24T18:36:33.199154+0000","last_undegraded":"2023-12-24T18:36:33.199154+0000","last_fullsized":"2023-12-24T18:36:33.199154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242508+0000","last_change":"2023-12-24T18:36:28.141979+0000","last_active":"2023-12-24T18:36:33.242508+0000","last_peered":"2023-12-24T18:36:33.242508+0000","last_clean":"2023-12-24T18:36:33.242508+0000","last_became_active":"2023-12-24T18:36:28.141662+0000","last_became_peered":"2023-12-24T18:36:28.141662+0000","last_unstale":"2023-12-24T18:36:33.242508+0000","last_undegraded":"2023-12-24T18:36:33.242508+0000","last_fullsized":"2023-12-24T18:36:33.242508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195913+0000","last_change":"2023-12-24T18:36:27.057902+0000","last_active":"2023-12-24T18:36:33.195913+0000","last_peered":"2023-12-24T18:36:33.195913+0000","last_clean":"2023-12-24T18:36:33.195913+0000","last_became_active":"2023-12-24T18:36:27.057601+0000","last_became_peered":"2023-12-24T18:36:27.057601+0000","last_unstale":"2023-12-24T18:36:33.195913+0000","last_undegraded":"2023-12-24T18:36:33.195913+0000","last_fullsized":"2023-12-24T18:36:33.195913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241297+0000","last_change":"2023-12-24T18:36:32.258321+0000","last_active":"2023-12-24T18:36:33.241297+0000","last_peered":"2023-12-24T18:36:33.241297+0000","last_clean":"2023-12-24T18:36:33.241297+0000","last_became_active":"2023-12-24T18:36:32.257975+0000","last_became_peered":"2023-12-24T18:36:32.257975+0000","last_unstale":"2023-12-24T18:36:33.241297+0000","last_undegraded":"2023-12-24T18:36:33.241297+0000","last_fullsized":"2023-12-24T18:36:33.241297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199956+0000","last_change":"2023-12-24T18:36:28.120873+0000","last_active":"2023-12-24T18:36:33.199956+0000","last_peered":"2023-12-24T18:36:33.199956+0000","last_clean":"2023-12-24T18:36:33.199956+0000","last_became_active":"2023-12-24T18:36:28.120575+0000","last_became_peered":"2023-12-24T18:36:28.120575+0000","last_unstale":"2023-12-24T18:36:33.199956+0000","last_undegraded":"2023-12-24T18:36:33.199956+0000","last_fullsized":"2023-12-24T18:36:33.199956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200186+0000","last_change":"2023-12-24T18:36:27.056392+0000","last_active":"2023-12-24T18:36:33.200186+0000","last_peered":"2023-12-24T18:36:33.200186+0000","last_clean":"2023-12-24T18:36:33.200186+0000","last_became_active":"2023-12-24T18:36:27.055923+0000","last_became_peered":"2023-12-24T18:36:27.055923+0000","last_unstale":"2023-12-24T18:36:33.200186+0000","last_undegraded":"2023-12-24T18:36:33.200186+0000","last_fullsized":"2023-12-24T18:36:33.200186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239172+0000","last_change":"2023-12-24T18:36:33.070180+0000","last_active":"2023-12-24T18:36:33.239172+0000","last_peered":"2023-12-24T18:36:33.239172+0000","last_clean":"2023-12-24T18:36:33.239172+0000","last_became_active":"2023-12-24T18:36:33.069205+0000","last_became_peered":"2023-12-24T18:36:33.069205+0000","last_unstale":"2023-12-24T18:36:33.239172+0000","last_undegraded":"2023-12-24T18:36:33.239172+0000","last_fullsized":"2023-12-24T18:36:33.239172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:32.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243039+0000","last_change":"2023-12-24T18:36:28.127186+0000","last_active":"2023-12-24T18:36:33.243039+0000","last_peered":"2023-12-24T18:36:33.243039+0000","last_clean":"2023-12-24T18:36:33.243039+0000","last_became_active":"2023-12-24T18:36:28.126357+0000","last_became_peered":"2023-12-24T18:36:28.126357+0000","last_unstale":"2023-12-24T18:36:33.243039+0000","last_undegraded":"2023-12-24T18:36:33.243039+0000","last_fullsized":"2023-12-24T18:36:33.243039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:43.975991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242848+0000","last_change":"2023-12-24T18:36:27.070926+0000","last_active":"2023-12-24T18:36:33.242848+0000","last_peered":"2023-12-24T18:36:33.242848+0000","last_clean":"2023-12-24T18:36:33.242848+0000","last_became_active":"2023-12-24T18:36:27.070569+0000","last_became_peered":"2023-12-24T18:36:27.070569+0000","last_unstale":"2023-12-24T18:36:33.242848+0000","last_undegraded":"2023-12-24T18:36:33.242848+0000","last_fullsized":"2023-12-24T18:36:33.242848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239108+0000","last_change":"2023-12-24T18:36:33.062857+0000","last_active":"2023-12-24T18:36:33.239108+0000","last_peered":"2023-12-24T18:36:33.239108+0000","last_clean":"2023-12-24T18:36:33.239108+0000","last_became_active":"2023-12-24T18:36:33.061451+0000","last_became_peered":"2023-12-24T18:36:33.061451+0000","last_unstale":"2023-12-24T18:36:33.239108+0000","last_undegraded":"2023-12-24T18:36:33.239108+0000","last_fullsized":"2023-12-24T18:36:33.239108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:00.421630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241031+0000","last_change":"2023-12-24T18:36:28.123632+0000","last_active":"2023-12-24T18:36:33.241031+0000","last_peered":"2023-12-24T18:36:33.241031+0000","last_clean":"2023-12-24T18:36:33.241031+0000","last_became_active":"2023-12-24T18:36:28.122094+0000","last_became_peered":"2023-12-24T18:36:28.122094+0000","last_unstale":"2023-12-24T18:36:33.241031+0000","last_undegraded":"2023-12-24T18:36:33.241031+0000","last_fullsized":"2023-12-24T18:36:33.241031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241638+0000","last_change":"2023-12-24T18:36:27.055652+0000","last_active":"2023-12-24T18:36:33.241638+0000","last_peered":"2023-12-24T18:36:33.241638+0000","last_clean":"2023-12-24T18:36:33.241638+0000","last_became_active":"2023-12-24T18:36:27.055325+0000","last_became_peered":"2023-12-24T18:36:27.055325+0000","last_unstale":"2023-12-24T18:36:33.241638+0000","last_undegraded":"2023-12-24T18:36:33.241638+0000","last_fullsized":"2023-12-24T18:36:33.241638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241611+0000","last_change":"2023-12-24T18:36:33.060160+0000","last_active":"2023-12-24T18:36:33.241611+0000","last_peered":"2023-12-24T18:36:33.241611+0000","last_clean":"2023-12-24T18:36:33.241611+0000","last_became_active":"2023-12-24T18:36:33.059695+0000","last_became_peered":"2023-12-24T18:36:33.059695+0000","last_unstale":"2023-12-24T18:36:33.241611+0000","last_undegraded":"2023-12-24T18:36:33.241611+0000","last_fullsized":"2023-12-24T18:36:33.241611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243445+0000","last_change":"2023-12-24T18:36:28.136247+0000","last_active":"2023-12-24T18:36:33.243445+0000","last_peered":"2023-12-24T18:36:33.243445+0000","last_clean":"2023-12-24T18:36:33.243445+0000","last_became_active":"2023-12-24T18:36:28.136021+0000","last_became_peered":"2023-12-24T18:36:28.136021+0000","last_unstale":"2023-12-24T18:36:33.243445+0000","last_undegraded":"2023-12-24T18:36:33.243445+0000","last_fullsized":"2023-12-24T18:36:33.243445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-24T18:36:39.871742+0000","last_change":"2023-12-24T18:36:27.050997+0000","last_active":"2023-12-24T18:36:39.871742+0000","last_peered":"2023-12-24T18:36:39.871742+0000","last_clean":"2023-12-24T18:36:39.871742+0000","last_became_active":"2023-12-24T18:36:27.050699+0000","last_became_peered":"2023-12-24T18:36:27.050699+0000","last_unstale":"2023-12-24T18:36:39.871742+0000","last_undegraded":"2023-12-24T18:36:39.871742+0000","last_fullsized":"2023-12-24T18:36:39.871742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243594+0000","last_change":"2023-12-24T18:36:32.265338+0000","last_active":"2023-12-24T18:36:33.243594+0000","last_peered":"2023-12-24T18:36:33.243594+0000","last_clean":"2023-12-24T18:36:33.243594+0000","last_became_active":"2023-12-24T18:36:32.262433+0000","last_became_peered":"2023-12-24T18:36:32.262433+0000","last_unstale":"2023-12-24T18:36:33.243594+0000","last_undegraded":"2023-12-24T18:36:33.243594+0000","last_fullsized":"2023-12-24T18:36:33.243594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200245+0000","last_change":"2023-12-24T18:36:28.130092+0000","last_active":"2023-12-24T18:36:33.200245+0000","last_peered":"2023-12-24T18:36:33.200245+0000","last_clean":"2023-12-24T18:36:33.200245+0000","last_became_active":"2023-12-24T18:36:28.129800+0000","last_became_peered":"2023-12-24T18:36:28.129800+0000","last_unstale":"2023-12-24T18:36:33.200245+0000","last_undegraded":"2023-12-24T18:36:33.200245+0000","last_fullsized":"2023-12-24T18:36:33.200245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:07.827336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244364+0000","last_change":"2023-12-24T18:36:27.064647+0000","last_active":"2023-12-24T18:36:33.244364+0000","last_peered":"2023-12-24T18:36:33.244364+0000","last_clean":"2023-12-24T18:36:33.244364+0000","last_became_active":"2023-12-24T18:36:27.064351+0000","last_became_peered":"2023-12-24T18:36:27.064351+0000","last_unstale":"2023-12-24T18:36:33.244364+0000","last_undegraded":"2023-12-24T18:36:33.244364+0000","last_fullsized":"2023-12-24T18:36:33.244364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199629+0000","last_change":"2023-12-24T18:36:32.249074+0000","last_active":"2023-12-24T18:36:33.199629+0000","last_peered":"2023-12-24T18:36:33.199629+0000","last_clean":"2023-12-24T18:36:33.199629+0000","last_became_active":"2023-12-24T18:36:32.248543+0000","last_became_peered":"2023-12-24T18:36:32.248543+0000","last_unstale":"2023-12-24T18:36:33.199629+0000","last_undegraded":"2023-12-24T18:36:33.199629+0000","last_fullsized":"2023-12-24T18:36:33.199629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241822+0000","last_change":"2023-12-24T18:36:28.131246+0000","last_active":"2023-12-24T18:36:33.241822+0000","last_peered":"2023-12-24T18:36:33.241822+0000","last_clean":"2023-12-24T18:36:33.241822+0000","last_became_active":"2023-12-24T18:36:28.130746+0000","last_became_peered":"2023-12-24T18:36:28.130746+0000","last_unstale":"2023-12-24T18:36:33.241822+0000","last_undegraded":"2023-12-24T18:36:33.241822+0000","last_fullsized":"2023-12-24T18:36:33.241822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242891+0000","last_change":"2023-12-24T18:36:27.068097+0000","last_active":"2023-12-24T18:36:33.242891+0000","last_peered":"2023-12-24T18:36:33.242891+0000","last_clean":"2023-12-24T18:36:33.242891+0000","last_became_active":"2023-12-24T18:36:27.067789+0000","last_became_peered":"2023-12-24T18:36:27.067789+0000","last_unstale":"2023-12-24T18:36:33.242891+0000","last_undegraded":"2023-12-24T18:36:33.242891+0000","last_fullsized":"2023-12-24T18:36:33.242891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239664+0000","last_change":"2023-12-24T18:36:32.244698+0000","last_active":"2023-12-24T18:36:33.239664+0000","last_peered":"2023-12-24T18:36:33.239664+0000","last_clean":"2023-12-24T18:36:33.239664+0000","last_became_active":"2023-12-24T18:36:32.241614+0000","last_became_peered":"2023-12-24T18:36:32.241614+0000","last_unstale":"2023-12-24T18:36:33.239664+0000","last_undegraded":"2023-12-24T18:36:33.239664+0000","last_fullsized":"2023-12-24T18:36:33.239664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:10.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242816+0000","last_change":"2023-12-24T18:36:28.121758+0000","last_active":"2023-12-24T18:36:33.242816+0000","last_peered":"2023-12-24T18:36:33.242816+0000","last_clean":"2023-12-24T18:36:33.242816+0000","last_became_active":"2023-12-24T18:36:28.121401+0000","last_became_peered":"2023-12-24T18:36:28.121401+0000","last_unstale":"2023-12-24T18:36:33.242816+0000","last_undegraded":"2023-12-24T18:36:33.242816+0000","last_fullsized":"2023-12-24T18:36:33.242816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201431+0000","last_change":"2023-12-24T18:36:27.060571+0000","last_active":"2023-12-24T18:36:33.201431+0000","last_peered":"2023-12-24T18:36:33.201431+0000","last_clean":"2023-12-24T18:36:33.201431+0000","last_became_active":"2023-12-24T18:36:27.060196+0000","last_became_peered":"2023-12-24T18:36:27.060196+0000","last_unstale":"2023-12-24T18:36:33.201431+0000","last_undegraded":"2023-12-24T18:36:33.201431+0000","last_fullsized":"2023-12-24T18:36:33.201431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238883+0000","last_change":"2023-12-24T18:36:33.074044+0000","last_active":"2023-12-24T18:36:33.238883+0000","last_peered":"2023-12-24T18:36:33.238883+0000","last_clean":"2023-12-24T18:36:33.238883+0000","last_became_active":"2023-12-24T18:36:33.072749+0000","last_became_peered":"2023-12-24T18:36:33.072749+0000","last_unstale":"2023-12-24T18:36:33.238883+0000","last_undegraded":"2023-12-24T18:36:33.238883+0000","last_fullsized":"2023-12-24T18:36:33.238883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240216+0000","last_change":"2023-12-24T18:36:33.069415+0000","last_active":"2023-12-24T18:36:33.240216+0000","last_peered":"2023-12-24T18:36:33.240216+0000","last_clean":"2023-12-24T18:36:33.240216+0000","last_became_active":"2023-12-24T18:36:33.068823+0000","last_became_peered":"2023-12-24T18:36:33.068823+0000","last_unstale":"2023-12-24T18:36:33.240216+0000","last_undegraded":"2023-12-24T18:36:33.240216+0000","last_fullsized":"2023-12-24T18:36:33.240216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243302+0000","last_change":"2023-12-24T18:36:28.131660+0000","last_active":"2023-12-24T18:36:33.243302+0000","last_peered":"2023-12-24T18:36:33.243302+0000","last_clean":"2023-12-24T18:36:33.243302+0000","last_became_active":"2023-12-24T18:36:28.128366+0000","last_became_peered":"2023-12-24T18:36:28.128366+0000","last_unstale":"2023-12-24T18:36:33.243302+0000","last_undegraded":"2023-12-24T18:36:33.243302+0000","last_fullsized":"2023-12-24T18:36:33.243302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241935+0000","last_change":"2023-12-24T18:36:27.068197+0000","last_active":"2023-12-24T18:36:33.241935+0000","last_peered":"2023-12-24T18:36:33.241935+0000","last_clean":"2023-12-24T18:36:33.241935+0000","last_became_active":"2023-12-24T18:36:27.067904+0000","last_became_peered":"2023-12-24T18:36:27.067904+0000","last_unstale":"2023-12-24T18:36:33.241935+0000","last_undegraded":"2023-12-24T18:36:33.241935+0000","last_fullsized":"2023-12-24T18:36:33.241935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201359+0000","last_change":"2023-12-24T18:36:32.260906+0000","last_active":"2023-12-24T18:36:33.201359+0000","last_peered":"2023-12-24T18:36:33.201359+0000","last_clean":"2023-12-24T18:36:33.201359+0000","last_became_active":"2023-12-24T18:36:32.260087+0000","last_became_peered":"2023-12-24T18:36:32.260087+0000","last_unstale":"2023-12-24T18:36:33.201359+0000","last_undegraded":"2023-12-24T18:36:33.201359+0000","last_fullsized":"2023-12-24T18:36:33.201359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:55.104503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239457+0000","last_change":"2023-12-24T18:36:28.124021+0000","last_active":"2023-12-24T18:36:33.239457+0000","last_peered":"2023-12-24T18:36:33.239457+0000","last_clean":"2023-12-24T18:36:33.239457+0000","last_became_active":"2023-12-24T18:36:28.121017+0000","last_became_peered":"2023-12-24T18:36:28.121017+0000","last_unstale":"2023-12-24T18:36:33.239457+0000","last_undegraded":"2023-12-24T18:36:33.239457+0000","last_fullsized":"2023-12-24T18:36:33.239457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239994+0000","last_change":"2023-12-24T18:36:27.068350+0000","last_active":"2023-12-24T18:36:33.239994+0000","last_peered":"2023-12-24T18:36:33.239994+0000","last_clean":"2023-12-24T18:36:33.239994+0000","last_became_active":"2023-12-24T18:36:27.053418+0000","last_became_peered":"2023-12-24T18:36:27.053418+0000","last_unstale":"2023-12-24T18:36:33.239994+0000","last_undegraded":"2023-12-24T18:36:33.239994+0000","last_fullsized":"2023-12-24T18:36:33.239994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200423+0000","last_change":"2023-12-24T18:36:27.054736+0000","last_active":"2023-12-24T18:36:33.200423+0000","last_peered":"2023-12-24T18:36:33.200423+0000","last_clean":"2023-12-24T18:36:33.200423+0000","last_became_active":"2023-12-24T18:36:27.054412+0000","last_became_peered":"2023-12-24T18:36:27.054412+0000","last_unstale":"2023-12-24T18:36:33.200423+0000","last_undegraded":"2023-12-24T18:36:33.200423+0000","last_fullsized":"2023-12-24T18:36:33.200423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241564+0000","last_change":"2023-12-24T18:36:28.129965+0000","last_active":"2023-12-24T18:36:33.241564+0000","last_peered":"2023-12-24T18:36:33.241564+0000","last_clean":"2023-12-24T18:36:33.241564+0000","last_became_active":"2023-12-24T18:36:28.129603+0000","last_became_peered":"2023-12-24T18:36:28.129603+0000","last_unstale":"2023-12-24T18:36:33.241564+0000","last_undegraded":"2023-12-24T18:36:33.241564+0000","last_fullsized":"2023-12-24T18:36:33.241564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196390+0000","last_change":"2023-12-24T18:36:32.255501+0000","last_active":"2023-12-24T18:36:33.196390+0000","last_peered":"2023-12-24T18:36:33.196390+0000","last_clean":"2023-12-24T18:36:33.196390+0000","last_became_active":"2023-12-24T18:36:32.254933+0000","last_became_peered":"2023-12-24T18:36:32.254933+0000","last_unstale":"2023-12-24T18:36:33.196390+0000","last_undegraded":"2023-12-24T18:36:33.196390+0000","last_fullsized":"2023-12-24T18:36:33.196390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:17.070830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239657+0000","last_change":"2023-12-24T18:36:27.057513+0000","last_active":"2023-12-24T18:36:33.239657+0000","last_peered":"2023-12-24T18:36:33.239657+0000","last_clean":"2023-12-24T18:36:33.239657+0000","last_became_active":"2023-12-24T18:36:27.057214+0000","last_became_peered":"2023-12-24T18:36:27.057214+0000","last_unstale":"2023-12-24T18:36:33.239657+0000","last_undegraded":"2023-12-24T18:36:33.239657+0000","last_fullsized":"2023-12-24T18:36:33.239657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:45:26.084715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199367+0000","last_change":"2023-12-24T18:36:28.135278+0000","last_active":"2023-12-24T18:36:33.199367+0000","last_peered":"2023-12-24T18:36:33.199367+0000","last_clean":"2023-12-24T18:36:33.199367+0000","last_became_active":"2023-12-24T18:36:28.134930+0000","last_became_peered":"2023-12-24T18:36:28.134930+0000","last_unstale":"2023-12-24T18:36:33.199367+0000","last_undegraded":"2023-12-24T18:36:33.199367+0000","last_fullsized":"2023-12-24T18:36:33.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241829+0000","last_change":"2023-12-24T18:36:32.249712+0000","last_active":"2023-12-24T18:36:33.241829+0000","last_peered":"2023-12-24T18:36:33.241829+0000","last_clean":"2023-12-24T18:36:33.241829+0000","last_became_active":"2023-12-24T18:36:32.249212+0000","last_became_peered":"2023-12-24T18:36:32.249212+0000","last_unstale":"2023-12-24T18:36:33.241829+0000","last_undegraded":"2023-12-24T18:36:33.241829+0000","last_fullsized":"2023-12-24T18:36:33.241829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:16.688462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199863+0000","last_change":"2023-12-24T18:36:28.127955+0000","last_active":"2023-12-24T18:36:33.199863+0000","last_peered":"2023-12-24T18:36:33.199863+0000","last_clean":"2023-12-24T18:36:33.199863+0000","last_became_active":"2023-12-24T18:36:28.127567+0000","last_became_peered":"2023-12-24T18:36:28.127567+0000","last_unstale":"2023-12-24T18:36:33.199863+0000","last_undegraded":"2023-12-24T18:36:33.199863+0000","last_fullsized":"2023-12-24T18:36:33.199863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195895+0000","last_change":"2023-12-24T18:36:28.122309+0000","last_active":"2023-12-24T18:36:33.195895+0000","last_peered":"2023-12-24T18:36:33.195895+0000","last_clean":"2023-12-24T18:36:33.195895+0000","last_became_active":"2023-12-24T18:36:28.121952+0000","last_became_peered":"2023-12-24T18:36:28.121952+0000","last_unstale":"2023-12-24T18:36:33.195895+0000","last_undegraded":"2023-12-24T18:36:33.195895+0000","last_fullsized":"2023-12-24T18:36:33.195895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:10:51.295826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242736+0000","last_change":"2023-12-24T18:36:28.127237+0000","last_active":"2023-12-24T18:36:33.242736+0000","last_peered":"2023-12-24T18:36:33.242736+0000","last_clean":"2023-12-24T18:36:33.242736+0000","last_became_active":"2023-12-24T18:36:28.126847+0000","last_became_peered":"2023-12-24T18:36:28.126847+0000","last_unstale":"2023-12-24T18:36:33.242736+0000","last_undegraded":"2023-12-24T18:36:33.242736+0000","last_fullsized":"2023-12-24T18:36:33.242736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241422+0000","last_change":"2023-12-24T18:36:28.131645+0000","last_active":"2023-12-24T18:36:33.241422+0000","last_peered":"2023-12-24T18:36:33.241422+0000","last_clean":"2023-12-24T18:36:33.241422+0000","last_became_active":"2023-12-24T18:36:28.131357+0000","last_became_peered":"2023-12-24T18:36:28.131357+0000","last_unstale":"2023-12-24T18:36:33.241422+0000","last_undegraded":"2023-12-24T18:36:33.241422+0000","last_fullsized":"2023-12-24T18:36:33.241422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240828+0000","last_change":"2023-12-24T18:36:28.117729+0000","last_active":"2023-12-24T18:36:33.240828+0000","last_peered":"2023-12-24T18:36:33.240828+0000","last_clean":"2023-12-24T18:36:33.240828+0000","last_became_active":"2023-12-24T18:36:28.117032+0000","last_became_peered":"2023-12-24T18:36:28.117032+0000","last_unstale":"2023-12-24T18:36:33.240828+0000","last_undegraded":"2023-12-24T18:36:33.240828+0000","last_fullsized":"2023-12-24T18:36:33.240828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244218+0000","last_change":"2023-12-24T18:36:28.122731+0000","last_active":"2023-12-24T18:36:33.244218+0000","last_peered":"2023-12-24T18:36:33.244218+0000","last_clean":"2023-12-24T18:36:33.244218+0000","last_became_active":"2023-12-24T18:36:28.122381+0000","last_became_peered":"2023-12-24T18:36:28.122381+0000","last_unstale":"2023-12-24T18:36:33.244218+0000","last_undegraded":"2023-12-24T18:36:33.244218+0000","last_fullsized":"2023-12-24T18:36:33.244218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201413+0000","last_change":"2023-12-24T18:36:28.110419+0000","last_active":"2023-12-24T18:36:33.201413+0000","last_peered":"2023-12-24T18:36:33.201413+0000","last_clean":"2023-12-24T18:36:33.201413+0000","last_became_active":"2023-12-24T18:36:28.110104+0000","last_became_peered":"2023-12-24T18:36:28.110104+0000","last_unstale":"2023-12-24T18:36:33.201413+0000","last_undegraded":"2023-12-24T18:36:33.201413+0000","last_fullsized":"2023-12-24T18:36:33.201413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242401+0000","last_change":"2023-12-24T18:36:28.112938+0000","last_active":"2023-12-24T18:36:33.242401+0000","last_peered":"2023-12-24T18:36:33.242401+0000","last_clean":"2023-12-24T18:36:33.242401+0000","last_became_active":"2023-12-24T18:36:28.112607+0000","last_became_peered":"2023-12-24T18:36:28.112607+0000","last_unstale":"2023-12-24T18:36:33.242401+0000","last_undegraded":"2023-12-24T18:36:33.242401+0000","last_fullsized":"2023-12-24T18:36:33.242401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241820+0000","last_change":"2023-12-24T18:36:28.124839+0000","last_active":"2023-12-24T18:36:33.241820+0000","last_peered":"2023-12-24T18:36:33.241820+0000","last_clean":"2023-12-24T18:36:33.241820+0000","last_became_active":"2023-12-24T18:36:28.124475+0000","last_became_peered":"2023-12-24T18:36:28.124475+0000","last_unstale":"2023-12-24T18:36:33.241820+0000","last_undegraded":"2023-12-24T18:36:33.241820+0000","last_fullsized":"2023-12-24T18:36:33.241820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239644+0000","last_change":"2023-12-24T18:36:28.121764+0000","last_active":"2023-12-24T18:36:33.239644+0000","last_peered":"2023-12-24T18:36:33.239644+0000","last_clean":"2023-12-24T18:36:33.239644+0000","last_became_active":"2023-12-24T18:36:28.119184+0000","last_became_peered":"2023-12-24T18:36:28.119184+0000","last_unstale":"2023-12-24T18:36:33.239644+0000","last_undegraded":"2023-12-24T18:36:33.239644+0000","last_fullsized":"2023-12-24T18:36:33.239644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242614+0000","last_change":"2023-12-24T18:36:28.122598+0000","last_active":"2023-12-24T18:36:33.242614+0000","last_peered":"2023-12-24T18:36:33.242614+0000","last_clean":"2023-12-24T18:36:33.242614+0000","last_became_active":"2023-12-24T18:36:28.122261+0000","last_became_peered":"2023-12-24T18:36:28.122261+0000","last_unstale":"2023-12-24T18:36:33.242614+0000","last_undegraded":"2023-12-24T18:36:33.242614+0000","last_fullsized":"2023-12-24T18:36:33.242614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241191+0000","last_change":"2023-12-24T18:36:28.123426+0000","last_active":"2023-12-24T18:36:33.241191+0000","last_peered":"2023-12-24T18:36:33.241191+0000","last_clean":"2023-12-24T18:36:33.241191+0000","last_became_active":"2023-12-24T18:36:28.122912+0000","last_became_peered":"2023-12-24T18:36:28.122912+0000","last_unstale":"2023-12-24T18:36:33.241191+0000","last_undegraded":"2023-12-24T18:36:33.241191+0000","last_fullsized":"2023-12-24T18:36:33.241191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:32.309502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200862+0000","last_change":"2023-12-24T18:36:28.111862+0000","last_active":"2023-12-24T18:36:33.200862+0000","last_peered":"2023-12-24T18:36:33.200862+0000","last_clean":"2023-12-24T18:36:33.200862+0000","last_became_active":"2023-12-24T18:36:28.111275+0000","last_became_peered":"2023-12-24T18:36:28.111275+0000","last_unstale":"2023-12-24T18:36:33.200862+0000","last_undegraded":"2023-12-24T18:36:33.200862+0000","last_fullsized":"2023-12-24T18:36:33.200862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243601+0000","last_change":"2023-12-24T18:36:28.129777+0000","last_active":"2023-12-24T18:36:33.243601+0000","last_peered":"2023-12-24T18:36:33.243601+0000","last_clean":"2023-12-24T18:36:33.243601+0000","last_became_active":"2023-12-24T18:36:28.129505+0000","last_became_peered":"2023-12-24T18:36:28.129505+0000","last_unstale":"2023-12-24T18:36:33.243601+0000","last_undegraded":"2023-12-24T18:36:33.243601+0000","last_fullsized":"2023-12-24T18:36:33.243601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196463+0000","last_change":"2023-12-24T18:36:28.108366+0000","last_active":"2023-12-24T18:36:33.196463+0000","last_peered":"2023-12-24T18:36:33.196463+0000","last_clean":"2023-12-24T18:36:33.196463+0000","last_became_active":"2023-12-24T18:36:28.107349+0000","last_became_peered":"2023-12-24T18:36:28.107349+0000","last_unstale":"2023-12-24T18:36:33.196463+0000","last_undegraded":"2023-12-24T18:36:33.196463+0000","last_fullsized":"2023-12-24T18:36:33.196463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243215+0000","last_change":"2023-12-24T18:36:28.126189+0000","last_active":"2023-12-24T18:36:33.243215+0000","last_peered":"2023-12-24T18:36:33.243215+0000","last_clean":"2023-12-24T18:36:33.243215+0000","last_became_active":"2023-12-24T18:36:28.125898+0000","last_became_peered":"2023-12-24T18:36:28.125898+0000","last_unstale":"2023-12-24T18:36:33.243215+0000","last_undegraded":"2023-12-24T18:36:33.243215+0000","last_fullsized":"2023-12-24T18:36:33.243215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241791+0000","last_change":"2023-12-24T18:36:28.132625+0000","last_active":"2023-12-24T18:36:33.241791+0000","last_peered":"2023-12-24T18:36:33.241791+0000","last_clean":"2023-12-24T18:36:33.241791+0000","last_became_active":"2023-12-24T18:36:28.132212+0000","last_became_peered":"2023-12-24T18:36:28.132212+0000","last_unstale":"2023-12-24T18:36:33.241791+0000","last_undegraded":"2023-12-24T18:36:33.241791+0000","last_fullsized":"2023-12-24T18:36:33.241791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243456+0000","last_change":"2023-12-24T18:36:28.117097+0000","last_active":"2023-12-24T18:36:33.243456+0000","last_peered":"2023-12-24T18:36:33.243456+0000","last_clean":"2023-12-24T18:36:33.243456+0000","last_became_active":"2023-12-24T18:36:28.116619+0000","last_became_peered":"2023-12-24T18:36:28.116619+0000","last_unstale":"2023-12-24T18:36:33.243456+0000","last_undegraded":"2023-12-24T18:36:33.243456+0000","last_fullsized":"2023-12-24T18:36:33.243456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240881+0000","last_change":"2023-12-24T18:36:28.126681+0000","last_active":"2023-12-24T18:36:33.240881+0000","last_peered":"2023-12-24T18:36:33.240881+0000","last_clean":"2023-12-24T18:36:33.240881+0000","last_became_active":"2023-12-24T18:36:28.126405+0000","last_became_peered":"2023-12-24T18:36:28.126405+0000","last_unstale":"2023-12-24T18:36:33.240881+0000","last_undegraded":"2023-12-24T18:36:33.240881+0000","last_fullsized":"2023-12-24T18:36:33.240881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:13:51.708720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239479+0000","last_change":"2023-12-24T18:36:28.120536+0000","last_active":"2023-12-24T18:36:33.239479+0000","last_peered":"2023-12-24T18:36:33.239479+0000","last_clean":"2023-12-24T18:36:33.239479+0000","last_became_active":"2023-12-24T18:36:28.117933+0000","last_became_peered":"2023-12-24T18:36:28.117933+0000","last_unstale":"2023-12-24T18:36:33.239479+0000","last_undegraded":"2023-12-24T18:36:33.239479+0000","last_fullsized":"2023-12-24T18:36:33.239479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200207+0000","last_change":"2023-12-24T18:36:28.107648+0000","last_active":"2023-12-24T18:36:33.200207+0000","last_peered":"2023-12-24T18:36:33.200207+0000","last_clean":"2023-12-24T18:36:33.200207+0000","last_became_active":"2023-12-24T18:36:28.107371+0000","last_became_peered":"2023-12-24T18:36:28.107371+0000","last_unstale":"2023-12-24T18:36:33.200207+0000","last_undegraded":"2023-12-24T18:36:33.200207+0000","last_fullsized":"2023-12-24T18:36:33.200207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:00.325029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201052+0000","last_change":"2023-12-24T18:36:28.124649+0000","last_active":"2023-12-24T18:36:33.201052+0000","last_peered":"2023-12-24T18:36:33.201052+0000","last_clean":"2023-12-24T18:36:33.201052+0000","last_became_active":"2023-12-24T18:36:28.124391+0000","last_became_peered":"2023-12-24T18:36:28.124391+0000","last_unstale":"2023-12-24T18:36:33.201052+0000","last_undegraded":"2023-12-24T18:36:33.201052+0000","last_fullsized":"2023-12-24T18:36:33.201052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201303+0000","last_change":"2023-12-24T18:36:28.125440+0000","last_active":"2023-12-24T18:36:33.201303+0000","last_peered":"2023-12-24T18:36:33.201303+0000","last_clean":"2023-12-24T18:36:33.201303+0000","last_became_active":"2023-12-24T18:36:28.124997+0000","last_became_peered":"2023-12-24T18:36:28.124997+0000","last_unstale":"2023-12-24T18:36:33.201303+0000","last_undegraded":"2023-12-24T18:36:33.201303+0000","last_fullsized":"2023-12-24T18:36:33.201303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244397+0000","last_change":"2023-12-24T18:36:28.135114+0000","last_active":"2023-12-24T18:36:33.244397+0000","last_peered":"2023-12-24T18:36:33.244397+0000","last_clean":"2023-12-24T18:36:33.244397+0000","last_became_active":"2023-12-24T18:36:28.134791+0000","last_became_peered":"2023-12-24T18:36:28.134791+0000","last_unstale":"2023-12-24T18:36:33.244397+0000","last_undegraded":"2023-12-24T18:36:33.244397+0000","last_fullsized":"2023-12-24T18:36:33.244397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239249+0000","last_change":"2023-12-24T18:36:28.128424+0000","last_active":"2023-12-24T18:36:33.239249+0000","last_peered":"2023-12-24T18:36:33.239249+0000","last_clean":"2023-12-24T18:36:33.239249+0000","last_became_active":"2023-12-24T18:36:28.126648+0000","last_became_peered":"2023-12-24T18:36:28.126648+0000","last_unstale":"2023-12-24T18:36:33.239249+0000","last_undegraded":"2023-12-24T18:36:33.239249+0000","last_fullsized":"2023-12-24T18:36:33.239249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242477+0000","last_change":"2023-12-24T18:36:28.133462+0000","last_active":"2023-12-24T18:36:33.242477+0000","last_peered":"2023-12-24T18:36:33.242477+0000","last_clean":"2023-12-24T18:36:33.242477+0000","last_became_active":"2023-12-24T18:36:28.132743+0000","last_became_peered":"2023-12-24T18:36:28.132743+0000","last_unstale":"2023-12-24T18:36:33.242477+0000","last_undegraded":"2023-12-24T18:36:33.242477+0000","last_fullsized":"2023-12-24T18:36:33.242477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242433+0000","last_change":"2023-12-24T18:36:28.123802+0000","last_active":"2023-12-24T18:36:33.242433+0000","last_peered":"2023-12-24T18:36:33.242433+0000","last_clean":"2023-12-24T18:36:33.242433+0000","last_became_active":"2023-12-24T18:36:28.123485+0000","last_became_peered":"2023-12-24T18:36:28.123485+0000","last_unstale":"2023-12-24T18:36:33.242433+0000","last_undegraded":"2023-12-24T18:36:33.242433+0000","last_fullsized":"2023-12-24T18:36:33.242433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242781+0000","last_change":"2023-12-24T18:36:28.127375+0000","last_active":"2023-12-24T18:36:33.242781+0000","last_peered":"2023-12-24T18:36:33.242781+0000","last_clean":"2023-12-24T18:36:33.242781+0000","last_became_active":"2023-12-24T18:36:28.126911+0000","last_became_peered":"2023-12-24T18:36:28.126911+0000","last_unstale":"2023-12-24T18:36:33.242781+0000","last_undegraded":"2023-12-24T18:36:33.242781+0000","last_fullsized":"2023-12-24T18:36:33.242781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242304+0000","last_change":"2023-12-24T18:36:28.137460+0000","last_active":"2023-12-24T18:36:33.242304+0000","last_peered":"2023-12-24T18:36:33.242304+0000","last_clean":"2023-12-24T18:36:33.242304+0000","last_became_active":"2023-12-24T18:36:28.134762+0000","last_became_peered":"2023-12-24T18:36:28.134762+0000","last_unstale":"2023-12-24T18:36:33.242304+0000","last_undegraded":"2023-12-24T18:36:33.242304+0000","last_fullsized":"2023-12-24T18:36:33.242304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241490+0000","last_change":"2023-12-24T18:36:28.122281+0000","last_active":"2023-12-24T18:36:33.241490+0000","last_peered":"2023-12-24T18:36:33.241490+0000","last_clean":"2023-12-24T18:36:33.241490+0000","last_became_active":"2023-12-24T18:36:28.121977+0000","last_became_peered":"2023-12-24T18:36:28.121977+0000","last_unstale":"2023-12-24T18:36:33.241490+0000","last_undegraded":"2023-12-24T18:36:33.241490+0000","last_fullsized":"2023-12-24T18:36:33.241490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:40.546379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244610+0000","last_change":"2023-12-24T18:36:28.121068+0000","last_active":"2023-12-24T18:36:33.244610+0000","last_peered":"2023-12-24T18:36:33.244610+0000","last_clean":"2023-12-24T18:36:33.244610+0000","last_became_active":"2023-12-24T18:36:28.120763+0000","last_became_peered":"2023-12-24T18:36:28.120763+0000","last_unstale":"2023-12-24T18:36:33.244610+0000","last_undegraded":"2023-12-24T18:36:33.244610+0000","last_fullsized":"2023-12-24T18:36:33.244610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244306+0000","last_change":"2023-12-24T18:36:28.137961+0000","last_active":"2023-12-24T18:36:33.244306+0000","last_peered":"2023-12-24T18:36:33.244306+0000","last_clean":"2023-12-24T18:36:33.244306+0000","last_became_active":"2023-12-24T18:36:28.137711+0000","last_became_peered":"2023-12-24T18:36:28.137711+0000","last_unstale":"2023-12-24T18:36:33.244306+0000","last_undegraded":"2023-12-24T18:36:33.244306+0000","last_fullsized":"2023-12-24T18:36:33.244306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:47.085985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4483,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":697463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":106631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":106667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":106541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":872448,"data_stored":697519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.76}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:36:49.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:36:49.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 Processor -- start 2023-12-24T18:36:49.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 -- start start 2023-12-24T18:36:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2440ca770 0x7ff24415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24406ca50 con 0x7ff2440ca3a0 2023-12-24T18:36:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24415b410 con 0x7ff24415af90 2023-12-24T18:36:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff24beae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2440c6980 con 0x7ff2440ca770 2023-12-24T18:36:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff249449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2440ca770 0x7ff24415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff249449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2440ca770 0x7ff24415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49048/0 (socket says 172.21.15.50:49048) 2023-12-24T18:36:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff249449700 1 -- 172.21.15.50:0/2683543588 learned_addr learned my addr 172.21.15.50:0/2683543588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.587+0000 7ff249c4a700 1 --1- 172.21.15.50:0/2683543588 >> v1:172.21.15.50:6789/0 conn(0x7ff2440ca3a0 0x7ff24406ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57196/0 (socket says 172.21.15.50:57196) 2023-12-24T18:36:49.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff249449700 1 -- 172.21.15.50:0/2683543588 >> v1:172.21.15.82:6789/0 conn(0x7ff24415af90 legacy=0x7ff24406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff249449700 1 -- 172.21.15.50:0/2683543588 >> v1:172.21.15.50:6789/0 conn(0x7ff2440ca3a0 legacy=0x7ff24406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff249449700 1 -- 172.21.15.50:0/2683543588 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24406b520 con 0x7ff2440ca770 2023-12-24T18:36:49.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff249449700 1 --2- 172.21.15.50:0/2683543588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca770 0x7ff24415aa50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2340099b0 tx=0x7ff234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fe19dd38b34de8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff248c48700 1 -- 172.21.15.50:0/2683543588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400b860 con 0x7ff2440ca770 2023-12-24T18:36:49.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff248c48700 1 -- 172.21.15.50:0/2683543588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400b9c0 con 0x7ff2440ca770 2023-12-24T18:36:49.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff248c48700 1 -- 172.21.15.50:0/2683543588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400bd80 con 0x7ff2440ca770 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 -- 172.21.15.50:0/2683543588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca770 msgr2=0x7ff24415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 --2- 172.21.15.50:0/2683543588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca770 0x7ff24415aa50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2340099b0 tx=0x7ff234009250 comp rx=0 tx=0).stop 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 -- 172.21.15.50:0/2683543588 shutdown_connections 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 --2- 172.21.15.50:0/2683543588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca770 0x7ff24415aa50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 -- 172.21.15.50:0/2683543588 >> 172.21.15.50:0/2683543588 conn(0x7ff2440cbba0 msgr2=0x7ff2440cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 -- 172.21.15.50:0/2683543588 shutdown_connections 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.591+0000 7ff24beae700 1 -- 172.21.15.50:0/2683543588 wait complete. 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 Processor -- start 2023-12-24T18:36:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 -- start start 2023-12-24T18:36:49.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 0x7ff2440c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff24415af90 0x7ff2440b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440afb10 con 0x7ff2440ca3a0 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c5300 con 0x7ff2440ca770 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24beae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440b18b0 con 0x7ff24415af90 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff249c4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff249c4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49062/0 (socket says 172.21.15.50:49062) 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff249c4a700 1 -- 172.21.15.50:0/2364542008 learned_addr learned my addr 172.21.15.50:0/2364542008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff249449700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 0x7ff2440c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.595+0000 7ff24a44b700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff24415af90 0x7ff2440b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 -- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff24415af90 msgr2=0x7ff2440b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff24415af90 0x7ff2440b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 -- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 msgr2=0x7ff2440c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 0x7ff2440c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 -- 172.21.15.50:0/2364542008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340094f0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249449700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 0x7ff2440c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff249c4a700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c7c0 tx=0x7ff240007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240005a70 con 0x7ff2440ca3a0 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff240005bf0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24416deb0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2400070f0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24416e470 con 0x7ff2440ca3a0 2023-12-24T18:36:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.599+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2440652e0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.603+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff240007460 con 0x7ff2440ca3a0 2023-12-24T18:36:49.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.603+0000 7ff239ffb700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 0x7ff228062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:49.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.603+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7ff24007c5c0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.603+0000 7ff249449700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 0x7ff228062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:49.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.603+0000 7ff249449700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 0x7ff228062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2340099b0 tx=0x7ff234017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.611+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff24004c8a0 con 0x7ff2440ca3a0 2023-12-24T18:36:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.791+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2440afc50 con 0x7ff228060550 2023-12-24T18:36:49.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.811+0000 7ff239ffb700 1 -- 172.21.15.50:0/2364542008 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345064 (secure 0 0 0) 0x7ff234000c50 con 0x7ff228060550 2023-12-24T18:36:49.815 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 msgr2=0x7ff228062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 0x7ff228062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2340099b0 tx=0x7ff234017000 comp rx=0 tx=0).stop 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 msgr2=0x7ff24416d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c7c0 tx=0x7ff240007f70 comp rx=0 tx=0).stop 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 shutdown_connections 2023-12-24T18:36:49.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff228060550 0x7ff228062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff24415af90 0x7ff2440b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2440ca770 0x7ff2440c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 --2- 172.21.15.50:0/2364542008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2440ca3a0 0x7ff24416d840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.819+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 >> 172.21.15.50:0/2364542008 conn(0x7ff2440cbba0 msgr2=0x7ff2440c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.823+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 shutdown_connections 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:49.823+0000 7ff24beae700 1 -- 172.21.15.50:0/2364542008 wait complete. 2023-12-24T18:36:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:36:49.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-24T18:36:48.745338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594851,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389800,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752584920,"statfs":{"total":773094113280,"available":770646958080,"internally_reserved":0,"allocated":3383296,"data_stored":2042030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2177,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006936"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241897+0000","last_change":"2023-12-24T18:36:27.067874+0000","last_active":"2023-12-24T18:36:33.241897+0000","last_peered":"2023-12-24T18:36:33.241897+0000","last_clean":"2023-12-24T18:36:33.241897+0000","last_became_active":"2023-12-24T18:36:27.067357+0000","last_became_peered":"2023-12-24T18:36:27.067357+0000","last_unstale":"2023-12-24T18:36:33.241897+0000","last_undegraded":"2023-12-24T18:36:33.241897+0000","last_fullsized":"2023-12-24T18:36:33.241897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:32.763268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242535+0000","last_change":"2023-12-24T18:36:28.119303+0000","last_active":"2023-12-24T18:36:33.242535+0000","last_peered":"2023-12-24T18:36:33.242535+0000","last_clean":"2023-12-24T18:36:33.242535+0000","last_became_active":"2023-12-24T18:36:28.118209+0000","last_became_peered":"2023-12-24T18:36:28.118209+0000","last_unstale":"2023-12-24T18:36:33.242535+0000","last_undegraded":"2023-12-24T18:36:33.242535+0000","last_fullsized":"2023-12-24T18:36:33.242535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239078+0000","last_change":"2023-12-24T18:36:33.070625+0000","last_active":"2023-12-24T18:36:33.239078+0000","last_peered":"2023-12-24T18:36:33.239078+0000","last_clean":"2023-12-24T18:36:33.239078+0000","last_became_active":"2023-12-24T18:36:33.070191+0000","last_became_peered":"2023-12-24T18:36:33.070191+0000","last_unstale":"2023-12-24T18:36:33.239078+0000","last_undegraded":"2023-12-24T18:36:33.239078+0000","last_fullsized":"2023-12-24T18:36:33.239078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:48.436853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242441+0000","last_change":"2023-12-24T18:36:27.060014+0000","last_active":"2023-12-24T18:36:33.242441+0000","last_peered":"2023-12-24T18:36:33.242441+0000","last_clean":"2023-12-24T18:36:33.242441+0000","last_became_active":"2023-12-24T18:36:27.059722+0000","last_became_peered":"2023-12-24T18:36:27.059722+0000","last_unstale":"2023-12-24T18:36:33.242441+0000","last_undegraded":"2023-12-24T18:36:33.242441+0000","last_fullsized":"2023-12-24T18:36:33.242441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241708+0000","last_change":"2023-12-24T18:36:28.131047+0000","last_active":"2023-12-24T18:36:33.241708+0000","last_peered":"2023-12-24T18:36:33.241708+0000","last_clean":"2023-12-24T18:36:33.241708+0000","last_became_active":"2023-12-24T18:36:28.130191+0000","last_became_peered":"2023-12-24T18:36:28.130191+0000","last_unstale":"2023-12-24T18:36:33.241708+0000","last_undegraded":"2023-12-24T18:36:33.241708+0000","last_fullsized":"2023-12-24T18:36:33.241708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199190+0000","last_change":"2023-12-24T18:36:32.246048+0000","last_active":"2023-12-24T18:36:33.199190+0000","last_peered":"2023-12-24T18:36:33.199190+0000","last_clean":"2023-12-24T18:36:33.199190+0000","last_became_active":"2023-12-24T18:36:32.245486+0000","last_became_peered":"2023-12-24T18:36:32.245486+0000","last_unstale":"2023-12-24T18:36:33.199190+0000","last_undegraded":"2023-12-24T18:36:33.199190+0000","last_fullsized":"2023-12-24T18:36:33.199190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.571591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243552+0000","last_change":"2023-12-24T18:36:27.066546+0000","last_active":"2023-12-24T18:36:33.243552+0000","last_peered":"2023-12-24T18:36:33.243552+0000","last_clean":"2023-12-24T18:36:33.243552+0000","last_became_active":"2023-12-24T18:36:27.066019+0000","last_became_peered":"2023-12-24T18:36:27.066019+0000","last_unstale":"2023-12-24T18:36:33.243552+0000","last_undegraded":"2023-12-24T18:36:33.243552+0000","last_fullsized":"2023-12-24T18:36:33.243552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242331+0000","last_change":"2023-12-24T18:36:28.123809+0000","last_active":"2023-12-24T18:36:33.242331+0000","last_peered":"2023-12-24T18:36:33.242331+0000","last_clean":"2023-12-24T18:36:33.242331+0000","last_became_active":"2023-12-24T18:36:28.123245+0000","last_became_peered":"2023-12-24T18:36:28.123245+0000","last_unstale":"2023-12-24T18:36:33.242331+0000","last_undegraded":"2023-12-24T18:36:33.242331+0000","last_fullsized":"2023-12-24T18:36:33.242331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199447+0000","last_change":"2023-12-24T18:36:32.252818+0000","last_active":"2023-12-24T18:36:33.199447+0000","last_peered":"2023-12-24T18:36:33.199447+0000","last_clean":"2023-12-24T18:36:33.199447+0000","last_became_active":"2023-12-24T18:36:32.252148+0000","last_became_peered":"2023-12-24T18:36:32.252148+0000","last_unstale":"2023-12-24T18:36:33.199447+0000","last_undegraded":"2023-12-24T18:36:33.199447+0000","last_fullsized":"2023-12-24T18:36:33.199447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243368+0000","last_change":"2023-12-24T18:36:27.066329+0000","last_active":"2023-12-24T18:36:33.243368+0000","last_peered":"2023-12-24T18:36:33.243368+0000","last_clean":"2023-12-24T18:36:33.243368+0000","last_became_active":"2023-12-24T18:36:27.065986+0000","last_became_peered":"2023-12-24T18:36:27.065986+0000","last_unstale":"2023-12-24T18:36:33.243368+0000","last_undegraded":"2023-12-24T18:36:33.243368+0000","last_fullsized":"2023-12-24T18:36:33.243368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:52.372517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242678+0000","last_change":"2023-12-24T18:36:28.140301+0000","last_active":"2023-12-24T18:36:33.242678+0000","last_peered":"2023-12-24T18:36:33.242678+0000","last_clean":"2023-12-24T18:36:33.242678+0000","last_became_active":"2023-12-24T18:36:28.139952+0000","last_became_peered":"2023-12-24T18:36:28.139952+0000","last_unstale":"2023-12-24T18:36:33.242678+0000","last_undegraded":"2023-12-24T18:36:33.242678+0000","last_fullsized":"2023-12-24T18:36:33.242678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199244+0000","last_change":"2023-12-24T18:36:32.251947+0000","last_active":"2023-12-24T18:36:33.199244+0000","last_peered":"2023-12-24T18:36:33.199244+0000","last_clean":"2023-12-24T18:36:33.199244+0000","last_became_active":"2023-12-24T18:36:32.251493+0000","last_became_peered":"2023-12-24T18:36:32.251493+0000","last_unstale":"2023-12-24T18:36:33.199244+0000","last_undegraded":"2023-12-24T18:36:33.199244+0000","last_fullsized":"2023-12-24T18:36:33.199244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.373046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200254+0000","last_change":"2023-12-24T18:36:28.112650+0000","last_active":"2023-12-24T18:36:33.200254+0000","last_peered":"2023-12-24T18:36:33.200254+0000","last_clean":"2023-12-24T18:36:33.200254+0000","last_became_active":"2023-12-24T18:36:28.112348+0000","last_became_peered":"2023-12-24T18:36:28.112348+0000","last_unstale":"2023-12-24T18:36:33.200254+0000","last_undegraded":"2023-12-24T18:36:33.200254+0000","last_fullsized":"2023-12-24T18:36:33.200254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243195+0000","last_change":"2023-12-24T18:36:27.064104+0000","last_active":"2023-12-24T18:36:33.243195+0000","last_peered":"2023-12-24T18:36:33.243195+0000","last_clean":"2023-12-24T18:36:33.243195+0000","last_became_active":"2023-12-24T18:36:27.063768+0000","last_became_peered":"2023-12-24T18:36:27.063768+0000","last_unstale":"2023-12-24T18:36:33.243195+0000","last_undegraded":"2023-12-24T18:36:33.243195+0000","last_fullsized":"2023-12-24T18:36:33.243195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200486+0000","last_change":"2023-12-24T18:36:32.260683+0000","last_active":"2023-12-24T18:36:33.200486+0000","last_peered":"2023-12-24T18:36:33.200486+0000","last_clean":"2023-12-24T18:36:33.200486+0000","last_became_active":"2023-12-24T18:36:32.259717+0000","last_became_peered":"2023-12-24T18:36:32.259717+0000","last_unstale":"2023-12-24T18:36:33.200486+0000","last_undegraded":"2023-12-24T18:36:33.200486+0000","last_fullsized":"2023-12-24T18:36:33.200486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239484+0000","last_change":"2023-12-24T18:36:28.130197+0000","last_active":"2023-12-24T18:36:33.239484+0000","last_peered":"2023-12-24T18:36:33.239484+0000","last_clean":"2023-12-24T18:36:33.239484+0000","last_became_active":"2023-12-24T18:36:28.129812+0000","last_became_peered":"2023-12-24T18:36:28.129812+0000","last_unstale":"2023-12-24T18:36:33.239484+0000","last_undegraded":"2023-12-24T18:36:33.239484+0000","last_fullsized":"2023-12-24T18:36:33.239484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243815+0000","last_change":"2023-12-24T18:36:27.063829+0000","last_active":"2023-12-24T18:36:33.243815+0000","last_peered":"2023-12-24T18:36:33.243815+0000","last_clean":"2023-12-24T18:36:33.243815+0000","last_became_active":"2023-12-24T18:36:27.062587+0000","last_became_peered":"2023-12-24T18:36:27.062587+0000","last_unstale":"2023-12-24T18:36:33.243815+0000","last_undegraded":"2023-12-24T18:36:33.243815+0000","last_fullsized":"2023-12-24T18:36:33.243815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200123+0000","last_change":"2023-12-24T18:36:32.251112+0000","last_active":"2023-12-24T18:36:33.200123+0000","last_peered":"2023-12-24T18:36:33.200123+0000","last_clean":"2023-12-24T18:36:33.200123+0000","last_became_active":"2023-12-24T18:36:32.250532+0000","last_became_peered":"2023-12-24T18:36:32.250532+0000","last_unstale":"2023-12-24T18:36:33.200123+0000","last_undegraded":"2023-12-24T18:36:33.200123+0000","last_fullsized":"2023-12-24T18:36:33.200123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:03.439593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239627+0000","last_change":"2023-12-24T18:36:28.127286+0000","last_active":"2023-12-24T18:36:33.239627+0000","last_peered":"2023-12-24T18:36:33.239627+0000","last_clean":"2023-12-24T18:36:33.239627+0000","last_became_active":"2023-12-24T18:36:28.124689+0000","last_became_peered":"2023-12-24T18:36:28.124689+0000","last_unstale":"2023-12-24T18:36:33.239627+0000","last_undegraded":"2023-12-24T18:36:33.239627+0000","last_fullsized":"2023-12-24T18:36:33.239627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:19.989101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243454+0000","last_change":"2023-12-24T18:36:27.064165+0000","last_active":"2023-12-24T18:36:33.243454+0000","last_peered":"2023-12-24T18:36:33.243454+0000","last_clean":"2023-12-24T18:36:33.243454+0000","last_became_active":"2023-12-24T18:36:27.063434+0000","last_became_peered":"2023-12-24T18:36:27.063434+0000","last_unstale":"2023-12-24T18:36:33.243454+0000","last_undegraded":"2023-12-24T18:36:33.243454+0000","last_fullsized":"2023-12-24T18:36:33.243454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:33.062973+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:33.061726+0000","last_became_peered":"2023-12-24T18:36:33.061726+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199485+0000","last_change":"2023-12-24T18:36:28.105114+0000","last_active":"2023-12-24T18:36:33.199485+0000","last_peered":"2023-12-24T18:36:33.199485+0000","last_clean":"2023-12-24T18:36:33.199485+0000","last_became_active":"2023-12-24T18:36:28.104834+0000","last_became_peered":"2023-12-24T18:36:28.104834+0000","last_unstale":"2023-12-24T18:36:33.199485+0000","last_undegraded":"2023-12-24T18:36:33.199485+0000","last_fullsized":"2023-12-24T18:36:33.199485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:26.768161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242012+0000","last_change":"2023-12-24T18:36:27.060303+0000","last_active":"2023-12-24T18:36:33.242012+0000","last_peered":"2023-12-24T18:36:33.242012+0000","last_clean":"2023-12-24T18:36:33.242012+0000","last_became_active":"2023-12-24T18:36:27.059902+0000","last_became_peered":"2023-12-24T18:36:27.059902+0000","last_unstale":"2023-12-24T18:36:33.242012+0000","last_undegraded":"2023-12-24T18:36:33.242012+0000","last_fullsized":"2023-12-24T18:36:33.242012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200312+0000","last_change":"2023-12-24T18:36:32.253987+0000","last_active":"2023-12-24T18:36:33.200312+0000","last_peered":"2023-12-24T18:36:33.200312+0000","last_clean":"2023-12-24T18:36:33.200312+0000","last_became_active":"2023-12-24T18:36:32.253471+0000","last_became_peered":"2023-12-24T18:36:32.253471+0000","last_unstale":"2023-12-24T18:36:33.200312+0000","last_undegraded":"2023-12-24T18:36:33.200312+0000","last_fullsized":"2023-12-24T18:36:33.200312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:35:45.397934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241468+0000","last_change":"2023-12-24T18:36:28.126747+0000","last_active":"2023-12-24T18:36:33.241468+0000","last_peered":"2023-12-24T18:36:33.241468+0000","last_clean":"2023-12-24T18:36:33.241468+0000","last_became_active":"2023-12-24T18:36:28.126438+0000","last_became_peered":"2023-12-24T18:36:28.126438+0000","last_unstale":"2023-12-24T18:36:33.241468+0000","last_undegraded":"2023-12-24T18:36:33.241468+0000","last_fullsized":"2023-12-24T18:36:33.241468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:15:15.564568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201595+0000","last_change":"2023-12-24T18:36:27.057217+0000","last_active":"2023-12-24T18:36:33.201595+0000","last_peered":"2023-12-24T18:36:33.201595+0000","last_clean":"2023-12-24T18:36:33.201595+0000","last_became_active":"2023-12-24T18:36:27.056927+0000","last_became_peered":"2023-12-24T18:36:27.056927+0000","last_unstale":"2023-12-24T18:36:33.201595+0000","last_undegraded":"2023-12-24T18:36:33.201595+0000","last_fullsized":"2023-12-24T18:36:33.201595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.198620+0000","last_change":"2023-12-24T18:36:33.060205+0000","last_active":"2023-12-24T18:36:33.198620+0000","last_peered":"2023-12-24T18:36:33.198620+0000","last_clean":"2023-12-24T18:36:33.198620+0000","last_became_active":"2023-12-24T18:36:33.059701+0000","last_became_peered":"2023-12-24T18:36:33.059701+0000","last_unstale":"2023-12-24T18:36:33.198620+0000","last_undegraded":"2023-12-24T18:36:33.198620+0000","last_fullsized":"2023-12-24T18:36:33.198620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.334113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242412+0000","last_change":"2023-12-24T18:36:28.129033+0000","last_active":"2023-12-24T18:36:33.242412+0000","last_peered":"2023-12-24T18:36:33.242412+0000","last_clean":"2023-12-24T18:36:33.242412+0000","last_became_active":"2023-12-24T18:36:28.128733+0000","last_became_peered":"2023-12-24T18:36:28.128733+0000","last_unstale":"2023-12-24T18:36:33.242412+0000","last_undegraded":"2023-12-24T18:36:33.242412+0000","last_fullsized":"2023-12-24T18:36:33.242412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244611+0000","last_change":"2023-12-24T18:36:27.057152+0000","last_active":"2023-12-24T18:36:33.244611+0000","last_peered":"2023-12-24T18:36:33.244611+0000","last_clean":"2023-12-24T18:36:33.244611+0000","last_became_active":"2023-12-24T18:36:27.056715+0000","last_became_peered":"2023-12-24T18:36:27.056715+0000","last_unstale":"2023-12-24T18:36:33.244611+0000","last_undegraded":"2023-12-24T18:36:33.244611+0000","last_fullsized":"2023-12-24T18:36:33.244611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238838+0000","last_change":"2023-12-24T18:36:33.067986+0000","last_active":"2023-12-24T18:36:33.238838+0000","last_peered":"2023-12-24T18:36:33.238838+0000","last_clean":"2023-12-24T18:36:33.238838+0000","last_became_active":"2023-12-24T18:36:33.066990+0000","last_became_peered":"2023-12-24T18:36:33.066990+0000","last_unstale":"2023-12-24T18:36:33.238838+0000","last_undegraded":"2023-12-24T18:36:33.238838+0000","last_fullsized":"2023-12-24T18:36:33.238838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:35:52.743174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244319+0000","last_change":"2023-12-24T18:36:28.119947+0000","last_active":"2023-12-24T18:36:33.244319+0000","last_peered":"2023-12-24T18:36:33.244319+0000","last_clean":"2023-12-24T18:36:33.244319+0000","last_became_active":"2023-12-24T18:36:28.119615+0000","last_became_peered":"2023-12-24T18:36:28.119615+0000","last_unstale":"2023-12-24T18:36:33.244319+0000","last_undegraded":"2023-12-24T18:36:33.244319+0000","last_fullsized":"2023-12-24T18:36:33.244319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243706+0000","last_change":"2023-12-24T18:36:27.062308+0000","last_active":"2023-12-24T18:36:33.243706+0000","last_peered":"2023-12-24T18:36:33.243706+0000","last_clean":"2023-12-24T18:36:33.243706+0000","last_became_active":"2023-12-24T18:36:27.061932+0000","last_became_peered":"2023-12-24T18:36:27.061932+0000","last_unstale":"2023-12-24T18:36:33.243706+0000","last_undegraded":"2023-12-24T18:36:33.243706+0000","last_fullsized":"2023-12-24T18:36:33.243706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240201+0000","last_change":"2023-12-24T18:36:33.063574+0000","last_active":"2023-12-24T18:36:33.240201+0000","last_peered":"2023-12-24T18:36:33.240201+0000","last_clean":"2023-12-24T18:36:33.240201+0000","last_became_active":"2023-12-24T18:36:33.062383+0000","last_became_peered":"2023-12-24T18:36:33.062383+0000","last_unstale":"2023-12-24T18:36:33.240201+0000","last_undegraded":"2023-12-24T18:36:33.240201+0000","last_fullsized":"2023-12-24T18:36:33.240201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.497189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242767+0000","last_change":"2023-12-24T18:36:28.123563+0000","last_active":"2023-12-24T18:36:33.242767+0000","last_peered":"2023-12-24T18:36:33.242767+0000","last_clean":"2023-12-24T18:36:33.242767+0000","last_became_active":"2023-12-24T18:36:28.123262+0000","last_became_peered":"2023-12-24T18:36:28.123262+0000","last_unstale":"2023-12-24T18:36:33.242767+0000","last_undegraded":"2023-12-24T18:36:33.242767+0000","last_fullsized":"2023-12-24T18:36:33.242767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244465+0000","last_change":"2023-12-24T18:36:27.059665+0000","last_active":"2023-12-24T18:36:33.244465+0000","last_peered":"2023-12-24T18:36:33.244465+0000","last_clean":"2023-12-24T18:36:33.244465+0000","last_became_active":"2023-12-24T18:36:27.059247+0000","last_became_peered":"2023-12-24T18:36:27.059247+0000","last_unstale":"2023-12-24T18:36:33.244465+0000","last_undegraded":"2023-12-24T18:36:33.244465+0000","last_fullsized":"2023-12-24T18:36:33.244465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243546+0000","last_change":"2023-12-24T18:36:32.265642+0000","last_active":"2023-12-24T18:36:33.243546+0000","last_peered":"2023-12-24T18:36:33.243546+0000","last_clean":"2023-12-24T18:36:33.243546+0000","last_became_active":"2023-12-24T18:36:32.263802+0000","last_became_peered":"2023-12-24T18:36:32.263802+0000","last_unstale":"2023-12-24T18:36:33.243546+0000","last_undegraded":"2023-12-24T18:36:33.243546+0000","last_fullsized":"2023-12-24T18:36:33.243546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199889+0000","last_change":"2023-12-24T18:36:28.132237+0000","last_active":"2023-12-24T18:36:33.199889+0000","last_peered":"2023-12-24T18:36:33.199889+0000","last_clean":"2023-12-24T18:36:33.199889+0000","last_became_active":"2023-12-24T18:36:28.131848+0000","last_became_peered":"2023-12-24T18:36:28.131848+0000","last_unstale":"2023-12-24T18:36:33.199889+0000","last_undegraded":"2023-12-24T18:36:33.199889+0000","last_fullsized":"2023-12-24T18:36:33.199889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:13.673004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242989+0000","last_change":"2023-12-24T18:36:27.062395+0000","last_active":"2023-12-24T18:36:33.242989+0000","last_peered":"2023-12-24T18:36:33.242989+0000","last_clean":"2023-12-24T18:36:33.242989+0000","last_became_active":"2023-12-24T18:36:27.058997+0000","last_became_peered":"2023-12-24T18:36:27.058997+0000","last_unstale":"2023-12-24T18:36:33.242989+0000","last_undegraded":"2023-12-24T18:36:33.242989+0000","last_fullsized":"2023-12-24T18:36:33.242989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244195+0000","last_change":"2023-12-24T18:36:32.250289+0000","last_active":"2023-12-24T18:36:33.244195+0000","last_peered":"2023-12-24T18:36:33.244195+0000","last_clean":"2023-12-24T18:36:33.244195+0000","last_became_active":"2023-12-24T18:36:32.248948+0000","last_became_peered":"2023-12-24T18:36:32.248948+0000","last_unstale":"2023-12-24T18:36:33.244195+0000","last_undegraded":"2023-12-24T18:36:33.244195+0000","last_fullsized":"2023-12-24T18:36:33.244195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243453+0000","last_change":"2023-12-24T18:36:28.119555+0000","last_active":"2023-12-24T18:36:33.243453+0000","last_peered":"2023-12-24T18:36:33.243453+0000","last_clean":"2023-12-24T18:36:33.243453+0000","last_became_active":"2023-12-24T18:36:28.119221+0000","last_became_peered":"2023-12-24T18:36:28.119221+0000","last_unstale":"2023-12-24T18:36:33.243453+0000","last_undegraded":"2023-12-24T18:36:33.243453+0000","last_fullsized":"2023-12-24T18:36:33.243453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196052+0000","last_change":"2023-12-24T18:36:27.069466+0000","last_active":"2023-12-24T18:36:33.196052+0000","last_peered":"2023-12-24T18:36:33.196052+0000","last_clean":"2023-12-24T18:36:33.196052+0000","last_became_active":"2023-12-24T18:36:27.069134+0000","last_became_peered":"2023-12-24T18:36:27.069134+0000","last_unstale":"2023-12-24T18:36:33.196052+0000","last_undegraded":"2023-12-24T18:36:33.196052+0000","last_fullsized":"2023-12-24T18:36:33.196052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244716+0000","last_change":"2023-12-24T18:36:32.261732+0000","last_active":"2023-12-24T18:36:33.244716+0000","last_peered":"2023-12-24T18:36:33.244716+0000","last_clean":"2023-12-24T18:36:33.244716+0000","last_became_active":"2023-12-24T18:36:32.261227+0000","last_became_peered":"2023-12-24T18:36:32.261227+0000","last_unstale":"2023-12-24T18:36:33.244716+0000","last_undegraded":"2023-12-24T18:36:33.244716+0000","last_fullsized":"2023-12-24T18:36:33.244716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240648+0000","last_change":"2023-12-24T18:36:28.132818+0000","last_active":"2023-12-24T18:36:33.240648+0000","last_peered":"2023-12-24T18:36:33.240648+0000","last_clean":"2023-12-24T18:36:33.240648+0000","last_became_active":"2023-12-24T18:36:28.132494+0000","last_became_peered":"2023-12-24T18:36:28.132494+0000","last_unstale":"2023-12-24T18:36:33.240648+0000","last_undegraded":"2023-12-24T18:36:33.240648+0000","last_fullsized":"2023-12-24T18:36:33.240648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242017+0000","last_change":"2023-12-24T18:36:27.064640+0000","last_active":"2023-12-24T18:36:33.242017+0000","last_peered":"2023-12-24T18:36:33.242017+0000","last_clean":"2023-12-24T18:36:33.242017+0000","last_became_active":"2023-12-24T18:36:27.064337+0000","last_became_peered":"2023-12-24T18:36:27.064337+0000","last_unstale":"2023-12-24T18:36:33.242017+0000","last_undegraded":"2023-12-24T18:36:33.242017+0000","last_fullsized":"2023-12-24T18:36:33.242017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:12.667545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240189+0000","last_change":"2023-12-24T18:36:33.065960+0000","last_active":"2023-12-24T18:36:33.240189+0000","last_peered":"2023-12-24T18:36:33.240189+0000","last_clean":"2023-12-24T18:36:33.240189+0000","last_became_active":"2023-12-24T18:36:33.064424+0000","last_became_peered":"2023-12-24T18:36:33.064424+0000","last_unstale":"2023-12-24T18:36:33.240189+0000","last_undegraded":"2023-12-24T18:36:33.240189+0000","last_fullsized":"2023-12-24T18:36:33.240189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239524+0000","last_change":"2023-12-24T18:36:28.125586+0000","last_active":"2023-12-24T18:36:33.239524+0000","last_peered":"2023-12-24T18:36:33.239524+0000","last_clean":"2023-12-24T18:36:33.239524+0000","last_became_active":"2023-12-24T18:36:28.125304+0000","last_became_peered":"2023-12-24T18:36:28.125304+0000","last_unstale":"2023-12-24T18:36:33.239524+0000","last_undegraded":"2023-12-24T18:36:33.239524+0000","last_fullsized":"2023-12-24T18:36:33.239524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242083+0000","last_change":"2023-12-24T18:36:27.059141+0000","last_active":"2023-12-24T18:36:33.242083+0000","last_peered":"2023-12-24T18:36:33.242083+0000","last_clean":"2023-12-24T18:36:33.242083+0000","last_became_active":"2023-12-24T18:36:27.058810+0000","last_became_peered":"2023-12-24T18:36:27.058810+0000","last_unstale":"2023-12-24T18:36:33.242083+0000","last_undegraded":"2023-12-24T18:36:33.242083+0000","last_fullsized":"2023-12-24T18:36:33.242083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242137+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:36:33.242137+0000","last_peered":"2023-12-24T18:36:33.242137+0000","last_clean":"2023-12-24T18:36:33.242137+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:36:33.242137+0000","last_undegraded":"2023-12-24T18:36:33.242137+0000","last_fullsized":"2023-12-24T18:36:33.242137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200983+0000","last_change":"2023-12-24T18:36:33.064479+0000","last_active":"2023-12-24T18:36:33.200983+0000","last_peered":"2023-12-24T18:36:33.200983+0000","last_clean":"2023-12-24T18:36:33.200983+0000","last_became_active":"2023-12-24T18:36:33.063934+0000","last_became_peered":"2023-12-24T18:36:33.063934+0000","last_unstale":"2023-12-24T18:36:33.200983+0000","last_undegraded":"2023-12-24T18:36:33.200983+0000","last_fullsized":"2023-12-24T18:36:33.200983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:51.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243499+0000","last_change":"2023-12-24T18:36:28.134054+0000","last_active":"2023-12-24T18:36:33.243499+0000","last_peered":"2023-12-24T18:36:33.243499+0000","last_clean":"2023-12-24T18:36:33.243499+0000","last_became_active":"2023-12-24T18:36:28.133272+0000","last_became_peered":"2023-12-24T18:36:28.133272+0000","last_unstale":"2023-12-24T18:36:33.243499+0000","last_undegraded":"2023-12-24T18:36:33.243499+0000","last_fullsized":"2023-12-24T18:36:33.243499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196949+0000","last_change":"2023-12-24T18:36:27.065885+0000","last_active":"2023-12-24T18:36:33.196949+0000","last_peered":"2023-12-24T18:36:33.196949+0000","last_clean":"2023-12-24T18:36:33.196949+0000","last_became_active":"2023-12-24T18:36:27.065497+0000","last_became_peered":"2023-12-24T18:36:27.065497+0000","last_unstale":"2023-12-24T18:36:33.196949+0000","last_undegraded":"2023-12-24T18:36:33.196949+0000","last_fullsized":"2023-12-24T18:36:33.196949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200105+0000","last_change":"2023-12-24T18:36:33.060407+0000","last_active":"2023-12-24T18:36:33.200105+0000","last_peered":"2023-12-24T18:36:33.200105+0000","last_clean":"2023-12-24T18:36:33.200105+0000","last_became_active":"2023-12-24T18:36:33.059656+0000","last_became_peered":"2023-12-24T18:36:33.059656+0000","last_unstale":"2023-12-24T18:36:33.200105+0000","last_undegraded":"2023-12-24T18:36:33.200105+0000","last_fullsized":"2023-12-24T18:36:33.200105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:16.143703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242382+0000","last_change":"2023-12-24T18:36:28.123920+0000","last_active":"2023-12-24T18:36:33.242382+0000","last_peered":"2023-12-24T18:36:33.242382+0000","last_clean":"2023-12-24T18:36:33.242382+0000","last_became_active":"2023-12-24T18:36:28.123641+0000","last_became_peered":"2023-12-24T18:36:28.123641+0000","last_unstale":"2023-12-24T18:36:33.242382+0000","last_undegraded":"2023-12-24T18:36:33.242382+0000","last_fullsized":"2023-12-24T18:36:33.242382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244368+0000","last_change":"2023-12-24T18:36:27.063621+0000","last_active":"2023-12-24T18:36:33.244368+0000","last_peered":"2023-12-24T18:36:33.244368+0000","last_clean":"2023-12-24T18:36:33.244368+0000","last_became_active":"2023-12-24T18:36:27.063049+0000","last_became_peered":"2023-12-24T18:36:27.063049+0000","last_unstale":"2023-12-24T18:36:33.244368+0000","last_undegraded":"2023-12-24T18:36:33.244368+0000","last_fullsized":"2023-12-24T18:36:33.244368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241302+0000","last_change":"2023-12-24T18:36:32.259376+0000","last_active":"2023-12-24T18:36:33.241302+0000","last_peered":"2023-12-24T18:36:33.241302+0000","last_clean":"2023-12-24T18:36:33.241302+0000","last_became_active":"2023-12-24T18:36:32.258898+0000","last_became_peered":"2023-12-24T18:36:32.258898+0000","last_unstale":"2023-12-24T18:36:33.241302+0000","last_undegraded":"2023-12-24T18:36:33.241302+0000","last_fullsized":"2023-12-24T18:36:33.241302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:07.194947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244486+0000","last_change":"2023-12-24T18:36:28.141826+0000","last_active":"2023-12-24T18:36:33.244486+0000","last_peered":"2023-12-24T18:36:33.244486+0000","last_clean":"2023-12-24T18:36:33.244486+0000","last_became_active":"2023-12-24T18:36:28.141592+0000","last_became_peered":"2023-12-24T18:36:28.141592+0000","last_unstale":"2023-12-24T18:36:33.244486+0000","last_undegraded":"2023-12-24T18:36:33.244486+0000","last_fullsized":"2023-12-24T18:36:33.244486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196802+0000","last_change":"2023-12-24T18:36:27.056563+0000","last_active":"2023-12-24T18:36:33.196802+0000","last_peered":"2023-12-24T18:36:33.196802+0000","last_clean":"2023-12-24T18:36:33.196802+0000","last_became_active":"2023-12-24T18:36:27.056162+0000","last_became_peered":"2023-12-24T18:36:27.056162+0000","last_unstale":"2023-12-24T18:36:33.196802+0000","last_undegraded":"2023-12-24T18:36:33.196802+0000","last_fullsized":"2023-12-24T18:36:33.196802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241573+0000","last_change":"2023-12-24T18:36:33.061190+0000","last_active":"2023-12-24T18:36:33.241573+0000","last_peered":"2023-12-24T18:36:33.241573+0000","last_clean":"2023-12-24T18:36:33.241573+0000","last_became_active":"2023-12-24T18:36:33.060776+0000","last_became_peered":"2023-12-24T18:36:33.060776+0000","last_unstale":"2023-12-24T18:36:33.241573+0000","last_undegraded":"2023-12-24T18:36:33.241573+0000","last_fullsized":"2023-12-24T18:36:33.241573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244050+0000","last_change":"2023-12-24T18:36:28.140877+0000","last_active":"2023-12-24T18:36:33.244050+0000","last_peered":"2023-12-24T18:36:33.244050+0000","last_clean":"2023-12-24T18:36:33.244050+0000","last_became_active":"2023-12-24T18:36:28.140557+0000","last_became_peered":"2023-12-24T18:36:28.140557+0000","last_unstale":"2023-12-24T18:36:33.244050+0000","last_undegraded":"2023-12-24T18:36:33.244050+0000","last_fullsized":"2023-12-24T18:36:33.244050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200942+0000","last_change":"2023-12-24T18:36:27.055292+0000","last_active":"2023-12-24T18:36:33.200942+0000","last_peered":"2023-12-24T18:36:33.200942+0000","last_clean":"2023-12-24T18:36:33.200942+0000","last_became_active":"2023-12-24T18:36:27.054059+0000","last_became_peered":"2023-12-24T18:36:27.054059+0000","last_unstale":"2023-12-24T18:36:33.200942+0000","last_undegraded":"2023-12-24T18:36:33.200942+0000","last_fullsized":"2023-12-24T18:36:33.200942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199154+0000","last_change":"2023-12-24T18:36:32.242682+0000","last_active":"2023-12-24T18:36:33.199154+0000","last_peered":"2023-12-24T18:36:33.199154+0000","last_clean":"2023-12-24T18:36:33.199154+0000","last_became_active":"2023-12-24T18:36:32.242104+0000","last_became_peered":"2023-12-24T18:36:32.242104+0000","last_unstale":"2023-12-24T18:36:33.199154+0000","last_undegraded":"2023-12-24T18:36:33.199154+0000","last_fullsized":"2023-12-24T18:36:33.199154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242508+0000","last_change":"2023-12-24T18:36:28.141979+0000","last_active":"2023-12-24T18:36:33.242508+0000","last_peered":"2023-12-24T18:36:33.242508+0000","last_clean":"2023-12-24T18:36:33.242508+0000","last_became_active":"2023-12-24T18:36:28.141662+0000","last_became_peered":"2023-12-24T18:36:28.141662+0000","last_unstale":"2023-12-24T18:36:33.242508+0000","last_undegraded":"2023-12-24T18:36:33.242508+0000","last_fullsized":"2023-12-24T18:36:33.242508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195913+0000","last_change":"2023-12-24T18:36:27.057902+0000","last_active":"2023-12-24T18:36:33.195913+0000","last_peered":"2023-12-24T18:36:33.195913+0000","last_clean":"2023-12-24T18:36:33.195913+0000","last_became_active":"2023-12-24T18:36:27.057601+0000","last_became_peered":"2023-12-24T18:36:27.057601+0000","last_unstale":"2023-12-24T18:36:33.195913+0000","last_undegraded":"2023-12-24T18:36:33.195913+0000","last_fullsized":"2023-12-24T18:36:33.195913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:25.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241297+0000","last_change":"2023-12-24T18:36:32.258321+0000","last_active":"2023-12-24T18:36:33.241297+0000","last_peered":"2023-12-24T18:36:33.241297+0000","last_clean":"2023-12-24T18:36:33.241297+0000","last_became_active":"2023-12-24T18:36:32.257975+0000","last_became_peered":"2023-12-24T18:36:32.257975+0000","last_unstale":"2023-12-24T18:36:33.241297+0000","last_undegraded":"2023-12-24T18:36:33.241297+0000","last_fullsized":"2023-12-24T18:36:33.241297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199956+0000","last_change":"2023-12-24T18:36:28.120873+0000","last_active":"2023-12-24T18:36:33.199956+0000","last_peered":"2023-12-24T18:36:33.199956+0000","last_clean":"2023-12-24T18:36:33.199956+0000","last_became_active":"2023-12-24T18:36:28.120575+0000","last_became_peered":"2023-12-24T18:36:28.120575+0000","last_unstale":"2023-12-24T18:36:33.199956+0000","last_undegraded":"2023-12-24T18:36:33.199956+0000","last_fullsized":"2023-12-24T18:36:33.199956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200186+0000","last_change":"2023-12-24T18:36:27.056392+0000","last_active":"2023-12-24T18:36:33.200186+0000","last_peered":"2023-12-24T18:36:33.200186+0000","last_clean":"2023-12-24T18:36:33.200186+0000","last_became_active":"2023-12-24T18:36:27.055923+0000","last_became_peered":"2023-12-24T18:36:27.055923+0000","last_unstale":"2023-12-24T18:36:33.200186+0000","last_undegraded":"2023-12-24T18:36:33.200186+0000","last_fullsized":"2023-12-24T18:36:33.200186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239172+0000","last_change":"2023-12-24T18:36:33.070180+0000","last_active":"2023-12-24T18:36:33.239172+0000","last_peered":"2023-12-24T18:36:33.239172+0000","last_clean":"2023-12-24T18:36:33.239172+0000","last_became_active":"2023-12-24T18:36:33.069205+0000","last_became_peered":"2023-12-24T18:36:33.069205+0000","last_unstale":"2023-12-24T18:36:33.239172+0000","last_undegraded":"2023-12-24T18:36:33.239172+0000","last_fullsized":"2023-12-24T18:36:33.239172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:32.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243039+0000","last_change":"2023-12-24T18:36:28.127186+0000","last_active":"2023-12-24T18:36:33.243039+0000","last_peered":"2023-12-24T18:36:33.243039+0000","last_clean":"2023-12-24T18:36:33.243039+0000","last_became_active":"2023-12-24T18:36:28.126357+0000","last_became_peered":"2023-12-24T18:36:28.126357+0000","last_unstale":"2023-12-24T18:36:33.243039+0000","last_undegraded":"2023-12-24T18:36:33.243039+0000","last_fullsized":"2023-12-24T18:36:33.243039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:43.975991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242848+0000","last_change":"2023-12-24T18:36:27.070926+0000","last_active":"2023-12-24T18:36:33.242848+0000","last_peered":"2023-12-24T18:36:33.242848+0000","last_clean":"2023-12-24T18:36:33.242848+0000","last_became_active":"2023-12-24T18:36:27.070569+0000","last_became_peered":"2023-12-24T18:36:27.070569+0000","last_unstale":"2023-12-24T18:36:33.242848+0000","last_undegraded":"2023-12-24T18:36:33.242848+0000","last_fullsized":"2023-12-24T18:36:33.242848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:59.648394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239108+0000","last_change":"2023-12-24T18:36:33.062857+0000","last_active":"2023-12-24T18:36:33.239108+0000","last_peered":"2023-12-24T18:36:33.239108+0000","last_clean":"2023-12-24T18:36:33.239108+0000","last_became_active":"2023-12-24T18:36:33.061451+0000","last_became_peered":"2023-12-24T18:36:33.061451+0000","last_unstale":"2023-12-24T18:36:33.239108+0000","last_undegraded":"2023-12-24T18:36:33.239108+0000","last_fullsized":"2023-12-24T18:36:33.239108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:00.421630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241031+0000","last_change":"2023-12-24T18:36:28.123632+0000","last_active":"2023-12-24T18:36:33.241031+0000","last_peered":"2023-12-24T18:36:33.241031+0000","last_clean":"2023-12-24T18:36:33.241031+0000","last_became_active":"2023-12-24T18:36:28.122094+0000","last_became_peered":"2023-12-24T18:36:28.122094+0000","last_unstale":"2023-12-24T18:36:33.241031+0000","last_undegraded":"2023-12-24T18:36:33.241031+0000","last_fullsized":"2023-12-24T18:36:33.241031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241638+0000","last_change":"2023-12-24T18:36:27.055652+0000","last_active":"2023-12-24T18:36:33.241638+0000","last_peered":"2023-12-24T18:36:33.241638+0000","last_clean":"2023-12-24T18:36:33.241638+0000","last_became_active":"2023-12-24T18:36:27.055325+0000","last_became_peered":"2023-12-24T18:36:27.055325+0000","last_unstale":"2023-12-24T18:36:33.241638+0000","last_undegraded":"2023-12-24T18:36:33.241638+0000","last_fullsized":"2023-12-24T18:36:33.241638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:00:44.457795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241611+0000","last_change":"2023-12-24T18:36:33.060160+0000","last_active":"2023-12-24T18:36:33.241611+0000","last_peered":"2023-12-24T18:36:33.241611+0000","last_clean":"2023-12-24T18:36:33.241611+0000","last_became_active":"2023-12-24T18:36:33.059695+0000","last_became_peered":"2023-12-24T18:36:33.059695+0000","last_unstale":"2023-12-24T18:36:33.241611+0000","last_undegraded":"2023-12-24T18:36:33.241611+0000","last_fullsized":"2023-12-24T18:36:33.241611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:52.874253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243445+0000","last_change":"2023-12-24T18:36:28.136247+0000","last_active":"2023-12-24T18:36:33.243445+0000","last_peered":"2023-12-24T18:36:33.243445+0000","last_clean":"2023-12-24T18:36:33.243445+0000","last_became_active":"2023-12-24T18:36:28.136021+0000","last_became_peered":"2023-12-24T18:36:28.136021+0000","last_unstale":"2023-12-24T18:36:33.243445+0000","last_undegraded":"2023-12-24T18:36:33.243445+0000","last_fullsized":"2023-12-24T18:36:33.243445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:27.412884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-24T18:36:39.871742+0000","last_change":"2023-12-24T18:36:27.050997+0000","last_active":"2023-12-24T18:36:39.871742+0000","last_peered":"2023-12-24T18:36:39.871742+0000","last_clean":"2023-12-24T18:36:39.871742+0000","last_became_active":"2023-12-24T18:36:27.050699+0000","last_became_peered":"2023-12-24T18:36:27.050699+0000","last_unstale":"2023-12-24T18:36:39.871742+0000","last_undegraded":"2023-12-24T18:36:39.871742+0000","last_fullsized":"2023-12-24T18:36:39.871742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:20:54.941064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243594+0000","last_change":"2023-12-24T18:36:32.265338+0000","last_active":"2023-12-24T18:36:33.243594+0000","last_peered":"2023-12-24T18:36:33.243594+0000","last_clean":"2023-12-24T18:36:33.243594+0000","last_became_active":"2023-12-24T18:36:32.262433+0000","last_became_peered":"2023-12-24T18:36:32.262433+0000","last_unstale":"2023-12-24T18:36:33.243594+0000","last_undegraded":"2023-12-24T18:36:33.243594+0000","last_fullsized":"2023-12-24T18:36:33.243594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:51.205433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200245+0000","last_change":"2023-12-24T18:36:28.130092+0000","last_active":"2023-12-24T18:36:33.200245+0000","last_peered":"2023-12-24T18:36:33.200245+0000","last_clean":"2023-12-24T18:36:33.200245+0000","last_became_active":"2023-12-24T18:36:28.129800+0000","last_became_peered":"2023-12-24T18:36:28.129800+0000","last_unstale":"2023-12-24T18:36:33.200245+0000","last_undegraded":"2023-12-24T18:36:33.200245+0000","last_fullsized":"2023-12-24T18:36:33.200245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:07.827336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244364+0000","last_change":"2023-12-24T18:36:27.064647+0000","last_active":"2023-12-24T18:36:33.244364+0000","last_peered":"2023-12-24T18:36:33.244364+0000","last_clean":"2023-12-24T18:36:33.244364+0000","last_became_active":"2023-12-24T18:36:27.064351+0000","last_became_peered":"2023-12-24T18:36:27.064351+0000","last_unstale":"2023-12-24T18:36:33.244364+0000","last_undegraded":"2023-12-24T18:36:33.244364+0000","last_fullsized":"2023-12-24T18:36:33.244364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:59.319570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199629+0000","last_change":"2023-12-24T18:36:32.249074+0000","last_active":"2023-12-24T18:36:33.199629+0000","last_peered":"2023-12-24T18:36:33.199629+0000","last_clean":"2023-12-24T18:36:33.199629+0000","last_became_active":"2023-12-24T18:36:32.248543+0000","last_became_peered":"2023-12-24T18:36:32.248543+0000","last_unstale":"2023-12-24T18:36:33.199629+0000","last_undegraded":"2023-12-24T18:36:33.199629+0000","last_fullsized":"2023-12-24T18:36:33.199629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:20:19.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241822+0000","last_change":"2023-12-24T18:36:28.131246+0000","last_active":"2023-12-24T18:36:33.241822+0000","last_peered":"2023-12-24T18:36:33.241822+0000","last_clean":"2023-12-24T18:36:33.241822+0000","last_became_active":"2023-12-24T18:36:28.130746+0000","last_became_peered":"2023-12-24T18:36:28.130746+0000","last_unstale":"2023-12-24T18:36:33.241822+0000","last_undegraded":"2023-12-24T18:36:33.241822+0000","last_fullsized":"2023-12-24T18:36:33.241822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242891+0000","last_change":"2023-12-24T18:36:27.068097+0000","last_active":"2023-12-24T18:36:33.242891+0000","last_peered":"2023-12-24T18:36:33.242891+0000","last_clean":"2023-12-24T18:36:33.242891+0000","last_became_active":"2023-12-24T18:36:27.067789+0000","last_became_peered":"2023-12-24T18:36:27.067789+0000","last_unstale":"2023-12-24T18:36:33.242891+0000","last_undegraded":"2023-12-24T18:36:33.242891+0000","last_fullsized":"2023-12-24T18:36:33.242891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239664+0000","last_change":"2023-12-24T18:36:32.244698+0000","last_active":"2023-12-24T18:36:33.239664+0000","last_peered":"2023-12-24T18:36:33.239664+0000","last_clean":"2023-12-24T18:36:33.239664+0000","last_became_active":"2023-12-24T18:36:32.241614+0000","last_became_peered":"2023-12-24T18:36:32.241614+0000","last_unstale":"2023-12-24T18:36:33.239664+0000","last_undegraded":"2023-12-24T18:36:33.239664+0000","last_fullsized":"2023-12-24T18:36:33.239664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:10.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242816+0000","last_change":"2023-12-24T18:36:28.121758+0000","last_active":"2023-12-24T18:36:33.242816+0000","last_peered":"2023-12-24T18:36:33.242816+0000","last_clean":"2023-12-24T18:36:33.242816+0000","last_became_active":"2023-12-24T18:36:28.121401+0000","last_became_peered":"2023-12-24T18:36:28.121401+0000","last_unstale":"2023-12-24T18:36:33.242816+0000","last_undegraded":"2023-12-24T18:36:33.242816+0000","last_fullsized":"2023-12-24T18:36:33.242816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201431+0000","last_change":"2023-12-24T18:36:27.060571+0000","last_active":"2023-12-24T18:36:33.201431+0000","last_peered":"2023-12-24T18:36:33.201431+0000","last_clean":"2023-12-24T18:36:33.201431+0000","last_became_active":"2023-12-24T18:36:27.060196+0000","last_became_peered":"2023-12-24T18:36:27.060196+0000","last_unstale":"2023-12-24T18:36:33.201431+0000","last_undegraded":"2023-12-24T18:36:33.201431+0000","last_fullsized":"2023-12-24T18:36:33.201431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.238883+0000","last_change":"2023-12-24T18:36:33.074044+0000","last_active":"2023-12-24T18:36:33.238883+0000","last_peered":"2023-12-24T18:36:33.238883+0000","last_clean":"2023-12-24T18:36:33.238883+0000","last_became_active":"2023-12-24T18:36:33.072749+0000","last_became_peered":"2023-12-24T18:36:33.072749+0000","last_unstale":"2023-12-24T18:36:33.238883+0000","last_undegraded":"2023-12-24T18:36:33.238883+0000","last_fullsized":"2023-12-24T18:36:33.238883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:03.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240216+0000","last_change":"2023-12-24T18:36:33.069415+0000","last_active":"2023-12-24T18:36:33.240216+0000","last_peered":"2023-12-24T18:36:33.240216+0000","last_clean":"2023-12-24T18:36:33.240216+0000","last_became_active":"2023-12-24T18:36:33.068823+0000","last_became_peered":"2023-12-24T18:36:33.068823+0000","last_unstale":"2023-12-24T18:36:33.240216+0000","last_undegraded":"2023-12-24T18:36:33.240216+0000","last_fullsized":"2023-12-24T18:36:33.240216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:07.929406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243302+0000","last_change":"2023-12-24T18:36:28.131660+0000","last_active":"2023-12-24T18:36:33.243302+0000","last_peered":"2023-12-24T18:36:33.243302+0000","last_clean":"2023-12-24T18:36:33.243302+0000","last_became_active":"2023-12-24T18:36:28.128366+0000","last_became_peered":"2023-12-24T18:36:28.128366+0000","last_unstale":"2023-12-24T18:36:33.243302+0000","last_undegraded":"2023-12-24T18:36:33.243302+0000","last_fullsized":"2023-12-24T18:36:33.243302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241935+0000","last_change":"2023-12-24T18:36:27.068197+0000","last_active":"2023-12-24T18:36:33.241935+0000","last_peered":"2023-12-24T18:36:33.241935+0000","last_clean":"2023-12-24T18:36:33.241935+0000","last_became_active":"2023-12-24T18:36:27.067904+0000","last_became_peered":"2023-12-24T18:36:27.067904+0000","last_unstale":"2023-12-24T18:36:33.241935+0000","last_undegraded":"2023-12-24T18:36:33.241935+0000","last_fullsized":"2023-12-24T18:36:33.241935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:06.821876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201359+0000","last_change":"2023-12-24T18:36:32.260906+0000","last_active":"2023-12-24T18:36:33.201359+0000","last_peered":"2023-12-24T18:36:33.201359+0000","last_clean":"2023-12-24T18:36:33.201359+0000","last_became_active":"2023-12-24T18:36:32.260087+0000","last_became_peered":"2023-12-24T18:36:32.260087+0000","last_unstale":"2023-12-24T18:36:33.201359+0000","last_undegraded":"2023-12-24T18:36:33.201359+0000","last_fullsized":"2023-12-24T18:36:33.201359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:55.104503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239457+0000","last_change":"2023-12-24T18:36:28.124021+0000","last_active":"2023-12-24T18:36:33.239457+0000","last_peered":"2023-12-24T18:36:33.239457+0000","last_clean":"2023-12-24T18:36:33.239457+0000","last_became_active":"2023-12-24T18:36:28.121017+0000","last_became_peered":"2023-12-24T18:36:28.121017+0000","last_unstale":"2023-12-24T18:36:33.239457+0000","last_undegraded":"2023-12-24T18:36:33.239457+0000","last_fullsized":"2023-12-24T18:36:33.239457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239994+0000","last_change":"2023-12-24T18:36:27.068350+0000","last_active":"2023-12-24T18:36:33.239994+0000","last_peered":"2023-12-24T18:36:33.239994+0000","last_clean":"2023-12-24T18:36:33.239994+0000","last_became_active":"2023-12-24T18:36:27.053418+0000","last_became_peered":"2023-12-24T18:36:27.053418+0000","last_unstale":"2023-12-24T18:36:33.239994+0000","last_undegraded":"2023-12-24T18:36:33.239994+0000","last_fullsized":"2023-12-24T18:36:33.239994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:23.152172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200423+0000","last_change":"2023-12-24T18:36:27.054736+0000","last_active":"2023-12-24T18:36:33.200423+0000","last_peered":"2023-12-24T18:36:33.200423+0000","last_clean":"2023-12-24T18:36:33.200423+0000","last_became_active":"2023-12-24T18:36:27.054412+0000","last_became_peered":"2023-12-24T18:36:27.054412+0000","last_unstale":"2023-12-24T18:36:33.200423+0000","last_undegraded":"2023-12-24T18:36:33.200423+0000","last_fullsized":"2023-12-24T18:36:33.200423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:42.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241564+0000","last_change":"2023-12-24T18:36:28.129965+0000","last_active":"2023-12-24T18:36:33.241564+0000","last_peered":"2023-12-24T18:36:33.241564+0000","last_clean":"2023-12-24T18:36:33.241564+0000","last_became_active":"2023-12-24T18:36:28.129603+0000","last_became_peered":"2023-12-24T18:36:28.129603+0000","last_unstale":"2023-12-24T18:36:33.241564+0000","last_undegraded":"2023-12-24T18:36:33.241564+0000","last_fullsized":"2023-12-24T18:36:33.241564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196390+0000","last_change":"2023-12-24T18:36:32.255501+0000","last_active":"2023-12-24T18:36:33.196390+0000","last_peered":"2023-12-24T18:36:33.196390+0000","last_clean":"2023-12-24T18:36:33.196390+0000","last_became_active":"2023-12-24T18:36:32.254933+0000","last_became_peered":"2023-12-24T18:36:32.254933+0000","last_unstale":"2023-12-24T18:36:33.196390+0000","last_undegraded":"2023-12-24T18:36:33.196390+0000","last_fullsized":"2023-12-24T18:36:33.196390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:17.070830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239657+0000","last_change":"2023-12-24T18:36:27.057513+0000","last_active":"2023-12-24T18:36:33.239657+0000","last_peered":"2023-12-24T18:36:33.239657+0000","last_clean":"2023-12-24T18:36:33.239657+0000","last_became_active":"2023-12-24T18:36:27.057214+0000","last_became_peered":"2023-12-24T18:36:27.057214+0000","last_unstale":"2023-12-24T18:36:33.239657+0000","last_undegraded":"2023-12-24T18:36:33.239657+0000","last_fullsized":"2023-12-24T18:36:33.239657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:26.012267+0000","last_clean_scrub_stamp":"2023-12-24T18:36:26.012267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:45:26.084715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199367+0000","last_change":"2023-12-24T18:36:28.135278+0000","last_active":"2023-12-24T18:36:33.199367+0000","last_peered":"2023-12-24T18:36:33.199367+0000","last_clean":"2023-12-24T18:36:33.199367+0000","last_became_active":"2023-12-24T18:36:28.134930+0000","last_became_peered":"2023-12-24T18:36:28.134930+0000","last_unstale":"2023-12-24T18:36:33.199367+0000","last_undegraded":"2023-12-24T18:36:33.199367+0000","last_fullsized":"2023-12-24T18:36:33.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241829+0000","last_change":"2023-12-24T18:36:32.249712+0000","last_active":"2023-12-24T18:36:33.241829+0000","last_peered":"2023-12-24T18:36:33.241829+0000","last_clean":"2023-12-24T18:36:33.241829+0000","last_became_active":"2023-12-24T18:36:32.249212+0000","last_became_peered":"2023-12-24T18:36:32.249212+0000","last_unstale":"2023-12-24T18:36:33.241829+0000","last_undegraded":"2023-12-24T18:36:33.241829+0000","last_fullsized":"2023-12-24T18:36:33.241829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:31.202807+0000","last_clean_scrub_stamp":"2023-12-24T18:36:31.202807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:16.688462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.199863+0000","last_change":"2023-12-24T18:36:28.127955+0000","last_active":"2023-12-24T18:36:33.199863+0000","last_peered":"2023-12-24T18:36:33.199863+0000","last_clean":"2023-12-24T18:36:33.199863+0000","last_became_active":"2023-12-24T18:36:28.127567+0000","last_became_peered":"2023-12-24T18:36:28.127567+0000","last_unstale":"2023-12-24T18:36:33.199863+0000","last_undegraded":"2023-12-24T18:36:33.199863+0000","last_fullsized":"2023-12-24T18:36:33.199863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.195895+0000","last_change":"2023-12-24T18:36:28.122309+0000","last_active":"2023-12-24T18:36:33.195895+0000","last_peered":"2023-12-24T18:36:33.195895+0000","last_clean":"2023-12-24T18:36:33.195895+0000","last_became_active":"2023-12-24T18:36:28.121952+0000","last_became_peered":"2023-12-24T18:36:28.121952+0000","last_unstale":"2023-12-24T18:36:33.195895+0000","last_undegraded":"2023-12-24T18:36:33.195895+0000","last_fullsized":"2023-12-24T18:36:33.195895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:10:51.295826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242736+0000","last_change":"2023-12-24T18:36:28.127237+0000","last_active":"2023-12-24T18:36:33.242736+0000","last_peered":"2023-12-24T18:36:33.242736+0000","last_clean":"2023-12-24T18:36:33.242736+0000","last_became_active":"2023-12-24T18:36:28.126847+0000","last_became_peered":"2023-12-24T18:36:28.126847+0000","last_unstale":"2023-12-24T18:36:33.242736+0000","last_undegraded":"2023-12-24T18:36:33.242736+0000","last_fullsized":"2023-12-24T18:36:33.242736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241422+0000","last_change":"2023-12-24T18:36:28.131645+0000","last_active":"2023-12-24T18:36:33.241422+0000","last_peered":"2023-12-24T18:36:33.241422+0000","last_clean":"2023-12-24T18:36:33.241422+0000","last_became_active":"2023-12-24T18:36:28.131357+0000","last_became_peered":"2023-12-24T18:36:28.131357+0000","last_unstale":"2023-12-24T18:36:33.241422+0000","last_undegraded":"2023-12-24T18:36:33.241422+0000","last_fullsized":"2023-12-24T18:36:33.241422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:22.580347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240828+0000","last_change":"2023-12-24T18:36:28.117729+0000","last_active":"2023-12-24T18:36:33.240828+0000","last_peered":"2023-12-24T18:36:33.240828+0000","last_clean":"2023-12-24T18:36:33.240828+0000","last_became_active":"2023-12-24T18:36:28.117032+0000","last_became_peered":"2023-12-24T18:36:28.117032+0000","last_unstale":"2023-12-24T18:36:33.240828+0000","last_undegraded":"2023-12-24T18:36:33.240828+0000","last_fullsized":"2023-12-24T18:36:33.240828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244218+0000","last_change":"2023-12-24T18:36:28.122731+0000","last_active":"2023-12-24T18:36:33.244218+0000","last_peered":"2023-12-24T18:36:33.244218+0000","last_clean":"2023-12-24T18:36:33.244218+0000","last_became_active":"2023-12-24T18:36:28.122381+0000","last_became_peered":"2023-12-24T18:36:28.122381+0000","last_unstale":"2023-12-24T18:36:33.244218+0000","last_undegraded":"2023-12-24T18:36:33.244218+0000","last_fullsized":"2023-12-24T18:36:33.244218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201413+0000","last_change":"2023-12-24T18:36:28.110419+0000","last_active":"2023-12-24T18:36:33.201413+0000","last_peered":"2023-12-24T18:36:33.201413+0000","last_clean":"2023-12-24T18:36:33.201413+0000","last_became_active":"2023-12-24T18:36:28.110104+0000","last_became_peered":"2023-12-24T18:36:28.110104+0000","last_unstale":"2023-12-24T18:36:33.201413+0000","last_undegraded":"2023-12-24T18:36:33.201413+0000","last_fullsized":"2023-12-24T18:36:33.201413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:41:12.461366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242401+0000","last_change":"2023-12-24T18:36:28.112938+0000","last_active":"2023-12-24T18:36:33.242401+0000","last_peered":"2023-12-24T18:36:33.242401+0000","last_clean":"2023-12-24T18:36:33.242401+0000","last_became_active":"2023-12-24T18:36:28.112607+0000","last_became_peered":"2023-12-24T18:36:28.112607+0000","last_unstale":"2023-12-24T18:36:33.242401+0000","last_undegraded":"2023-12-24T18:36:33.242401+0000","last_fullsized":"2023-12-24T18:36:33.242401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241820+0000","last_change":"2023-12-24T18:36:28.124839+0000","last_active":"2023-12-24T18:36:33.241820+0000","last_peered":"2023-12-24T18:36:33.241820+0000","last_clean":"2023-12-24T18:36:33.241820+0000","last_became_active":"2023-12-24T18:36:28.124475+0000","last_became_peered":"2023-12-24T18:36:28.124475+0000","last_unstale":"2023-12-24T18:36:33.241820+0000","last_undegraded":"2023-12-24T18:36:33.241820+0000","last_fullsized":"2023-12-24T18:36:33.241820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:02.220254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239644+0000","last_change":"2023-12-24T18:36:28.121764+0000","last_active":"2023-12-24T18:36:33.239644+0000","last_peered":"2023-12-24T18:36:33.239644+0000","last_clean":"2023-12-24T18:36:33.239644+0000","last_became_active":"2023-12-24T18:36:28.119184+0000","last_became_peered":"2023-12-24T18:36:28.119184+0000","last_unstale":"2023-12-24T18:36:33.239644+0000","last_undegraded":"2023-12-24T18:36:33.239644+0000","last_fullsized":"2023-12-24T18:36:33.239644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:19.042614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242614+0000","last_change":"2023-12-24T18:36:28.122598+0000","last_active":"2023-12-24T18:36:33.242614+0000","last_peered":"2023-12-24T18:36:33.242614+0000","last_clean":"2023-12-24T18:36:33.242614+0000","last_became_active":"2023-12-24T18:36:28.122261+0000","last_became_peered":"2023-12-24T18:36:28.122261+0000","last_unstale":"2023-12-24T18:36:33.242614+0000","last_undegraded":"2023-12-24T18:36:33.242614+0000","last_fullsized":"2023-12-24T18:36:33.242614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241191+0000","last_change":"2023-12-24T18:36:28.123426+0000","last_active":"2023-12-24T18:36:33.241191+0000","last_peered":"2023-12-24T18:36:33.241191+0000","last_clean":"2023-12-24T18:36:33.241191+0000","last_became_active":"2023-12-24T18:36:28.122912+0000","last_became_peered":"2023-12-24T18:36:28.122912+0000","last_unstale":"2023-12-24T18:36:33.241191+0000","last_undegraded":"2023-12-24T18:36:33.241191+0000","last_fullsized":"2023-12-24T18:36:33.241191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:32.309502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200862+0000","last_change":"2023-12-24T18:36:28.111862+0000","last_active":"2023-12-24T18:36:33.200862+0000","last_peered":"2023-12-24T18:36:33.200862+0000","last_clean":"2023-12-24T18:36:33.200862+0000","last_became_active":"2023-12-24T18:36:28.111275+0000","last_became_peered":"2023-12-24T18:36:28.111275+0000","last_unstale":"2023-12-24T18:36:33.200862+0000","last_undegraded":"2023-12-24T18:36:33.200862+0000","last_fullsized":"2023-12-24T18:36:33.200862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:12.697051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243601+0000","last_change":"2023-12-24T18:36:28.129777+0000","last_active":"2023-12-24T18:36:33.243601+0000","last_peered":"2023-12-24T18:36:33.243601+0000","last_clean":"2023-12-24T18:36:33.243601+0000","last_became_active":"2023-12-24T18:36:28.129505+0000","last_became_peered":"2023-12-24T18:36:28.129505+0000","last_unstale":"2023-12-24T18:36:33.243601+0000","last_undegraded":"2023-12-24T18:36:33.243601+0000","last_fullsized":"2023-12-24T18:36:33.243601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:02.147806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.196463+0000","last_change":"2023-12-24T18:36:28.108366+0000","last_active":"2023-12-24T18:36:33.196463+0000","last_peered":"2023-12-24T18:36:33.196463+0000","last_clean":"2023-12-24T18:36:33.196463+0000","last_became_active":"2023-12-24T18:36:28.107349+0000","last_became_peered":"2023-12-24T18:36:28.107349+0000","last_unstale":"2023-12-24T18:36:33.196463+0000","last_undegraded":"2023-12-24T18:36:33.196463+0000","last_fullsized":"2023-12-24T18:36:33.196463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:53.377977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243215+0000","last_change":"2023-12-24T18:36:28.126189+0000","last_active":"2023-12-24T18:36:33.243215+0000","last_peered":"2023-12-24T18:36:33.243215+0000","last_clean":"2023-12-24T18:36:33.243215+0000","last_became_active":"2023-12-24T18:36:28.125898+0000","last_became_peered":"2023-12-24T18:36:28.125898+0000","last_unstale":"2023-12-24T18:36:33.243215+0000","last_undegraded":"2023-12-24T18:36:33.243215+0000","last_fullsized":"2023-12-24T18:36:33.243215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241791+0000","last_change":"2023-12-24T18:36:28.132625+0000","last_active":"2023-12-24T18:36:33.241791+0000","last_peered":"2023-12-24T18:36:33.241791+0000","last_clean":"2023-12-24T18:36:33.241791+0000","last_became_active":"2023-12-24T18:36:28.132212+0000","last_became_peered":"2023-12-24T18:36:28.132212+0000","last_unstale":"2023-12-24T18:36:33.241791+0000","last_undegraded":"2023-12-24T18:36:33.241791+0000","last_fullsized":"2023-12-24T18:36:33.241791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:49.070047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.243456+0000","last_change":"2023-12-24T18:36:28.117097+0000","last_active":"2023-12-24T18:36:33.243456+0000","last_peered":"2023-12-24T18:36:33.243456+0000","last_clean":"2023-12-24T18:36:33.243456+0000","last_became_active":"2023-12-24T18:36:28.116619+0000","last_became_peered":"2023-12-24T18:36:28.116619+0000","last_unstale":"2023-12-24T18:36:33.243456+0000","last_undegraded":"2023-12-24T18:36:33.243456+0000","last_fullsized":"2023-12-24T18:36:33.243456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.240881+0000","last_change":"2023-12-24T18:36:28.126681+0000","last_active":"2023-12-24T18:36:33.240881+0000","last_peered":"2023-12-24T18:36:33.240881+0000","last_clean":"2023-12-24T18:36:33.240881+0000","last_became_active":"2023-12-24T18:36:28.126405+0000","last_became_peered":"2023-12-24T18:36:28.126405+0000","last_unstale":"2023-12-24T18:36:33.240881+0000","last_undegraded":"2023-12-24T18:36:33.240881+0000","last_fullsized":"2023-12-24T18:36:33.240881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:13:51.708720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239479+0000","last_change":"2023-12-24T18:36:28.120536+0000","last_active":"2023-12-24T18:36:33.239479+0000","last_peered":"2023-12-24T18:36:33.239479+0000","last_clean":"2023-12-24T18:36:33.239479+0000","last_became_active":"2023-12-24T18:36:28.117933+0000","last_became_peered":"2023-12-24T18:36:28.117933+0000","last_unstale":"2023-12-24T18:36:33.239479+0000","last_undegraded":"2023-12-24T18:36:33.239479+0000","last_fullsized":"2023-12-24T18:36:33.239479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:39:34.371697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.200207+0000","last_change":"2023-12-24T18:36:28.107648+0000","last_active":"2023-12-24T18:36:33.200207+0000","last_peered":"2023-12-24T18:36:33.200207+0000","last_clean":"2023-12-24T18:36:33.200207+0000","last_became_active":"2023-12-24T18:36:28.107371+0000","last_became_peered":"2023-12-24T18:36:28.107371+0000","last_unstale":"2023-12-24T18:36:33.200207+0000","last_undegraded":"2023-12-24T18:36:33.200207+0000","last_fullsized":"2023-12-24T18:36:33.200207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:00.325029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201052+0000","last_change":"2023-12-24T18:36:28.124649+0000","last_active":"2023-12-24T18:36:33.201052+0000","last_peered":"2023-12-24T18:36:33.201052+0000","last_clean":"2023-12-24T18:36:33.201052+0000","last_became_active":"2023-12-24T18:36:28.124391+0000","last_became_peered":"2023-12-24T18:36:28.124391+0000","last_unstale":"2023-12-24T18:36:33.201052+0000","last_undegraded":"2023-12-24T18:36:33.201052+0000","last_fullsized":"2023-12-24T18:36:33.201052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.885748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.201303+0000","last_change":"2023-12-24T18:36:28.125440+0000","last_active":"2023-12-24T18:36:33.201303+0000","last_peered":"2023-12-24T18:36:33.201303+0000","last_clean":"2023-12-24T18:36:33.201303+0000","last_became_active":"2023-12-24T18:36:28.124997+0000","last_became_peered":"2023-12-24T18:36:28.124997+0000","last_unstale":"2023-12-24T18:36:33.201303+0000","last_undegraded":"2023-12-24T18:36:33.201303+0000","last_fullsized":"2023-12-24T18:36:33.201303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:42.109958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244397+0000","last_change":"2023-12-24T18:36:28.135114+0000","last_active":"2023-12-24T18:36:33.244397+0000","last_peered":"2023-12-24T18:36:33.244397+0000","last_clean":"2023-12-24T18:36:33.244397+0000","last_became_active":"2023-12-24T18:36:28.134791+0000","last_became_peered":"2023-12-24T18:36:28.134791+0000","last_unstale":"2023-12-24T18:36:33.244397+0000","last_undegraded":"2023-12-24T18:36:33.244397+0000","last_fullsized":"2023-12-24T18:36:33.244397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.239249+0000","last_change":"2023-12-24T18:36:28.128424+0000","last_active":"2023-12-24T18:36:33.239249+0000","last_peered":"2023-12-24T18:36:33.239249+0000","last_clean":"2023-12-24T18:36:33.239249+0000","last_became_active":"2023-12-24T18:36:28.126648+0000","last_became_peered":"2023-12-24T18:36:28.126648+0000","last_unstale":"2023-12-24T18:36:33.239249+0000","last_undegraded":"2023-12-24T18:36:33.239249+0000","last_fullsized":"2023-12-24T18:36:33.239249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:40.177122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242477+0000","last_change":"2023-12-24T18:36:28.133462+0000","last_active":"2023-12-24T18:36:33.242477+0000","last_peered":"2023-12-24T18:36:33.242477+0000","last_clean":"2023-12-24T18:36:33.242477+0000","last_became_active":"2023-12-24T18:36:28.132743+0000","last_became_peered":"2023-12-24T18:36:28.132743+0000","last_unstale":"2023-12-24T18:36:33.242477+0000","last_undegraded":"2023-12-24T18:36:33.242477+0000","last_fullsized":"2023-12-24T18:36:33.242477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:43.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242433+0000","last_change":"2023-12-24T18:36:28.123802+0000","last_active":"2023-12-24T18:36:33.242433+0000","last_peered":"2023-12-24T18:36:33.242433+0000","last_clean":"2023-12-24T18:36:33.242433+0000","last_became_active":"2023-12-24T18:36:28.123485+0000","last_became_peered":"2023-12-24T18:36:28.123485+0000","last_unstale":"2023-12-24T18:36:33.242433+0000","last_undegraded":"2023-12-24T18:36:33.242433+0000","last_fullsized":"2023-12-24T18:36:33.242433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:08.967355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242781+0000","last_change":"2023-12-24T18:36:28.127375+0000","last_active":"2023-12-24T18:36:33.242781+0000","last_peered":"2023-12-24T18:36:33.242781+0000","last_clean":"2023-12-24T18:36:33.242781+0000","last_became_active":"2023-12-24T18:36:28.126911+0000","last_became_peered":"2023-12-24T18:36:28.126911+0000","last_unstale":"2023-12-24T18:36:33.242781+0000","last_undegraded":"2023-12-24T18:36:33.242781+0000","last_fullsized":"2023-12-24T18:36:33.242781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.242304+0000","last_change":"2023-12-24T18:36:28.137460+0000","last_active":"2023-12-24T18:36:33.242304+0000","last_peered":"2023-12-24T18:36:33.242304+0000","last_clean":"2023-12-24T18:36:33.242304+0000","last_became_active":"2023-12-24T18:36:28.134762+0000","last_became_peered":"2023-12-24T18:36:28.134762+0000","last_unstale":"2023-12-24T18:36:33.242304+0000","last_undegraded":"2023-12-24T18:36:33.242304+0000","last_fullsized":"2023-12-24T18:36:33.242304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:49.946100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.241490+0000","last_change":"2023-12-24T18:36:28.122281+0000","last_active":"2023-12-24T18:36:33.241490+0000","last_peered":"2023-12-24T18:36:33.241490+0000","last_clean":"2023-12-24T18:36:33.241490+0000","last_became_active":"2023-12-24T18:36:28.121977+0000","last_became_peered":"2023-12-24T18:36:28.121977+0000","last_unstale":"2023-12-24T18:36:33.241490+0000","last_undegraded":"2023-12-24T18:36:33.241490+0000","last_fullsized":"2023-12-24T18:36:33.241490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:40.546379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244610+0000","last_change":"2023-12-24T18:36:28.121068+0000","last_active":"2023-12-24T18:36:33.244610+0000","last_peered":"2023-12-24T18:36:33.244610+0000","last_clean":"2023-12-24T18:36:33.244610+0000","last_became_active":"2023-12-24T18:36:28.120763+0000","last_became_peered":"2023-12-24T18:36:28.120763+0000","last_unstale":"2023-12-24T18:36:33.244610+0000","last_undegraded":"2023-12-24T18:36:33.244610+0000","last_fullsized":"2023-12-24T18:36:33.244610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:48.092128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-24T18:36:33.244306+0000","last_change":"2023-12-24T18:36:28.137961+0000","last_active":"2023-12-24T18:36:33.244306+0000","last_peered":"2023-12-24T18:36:33.244306+0000","last_clean":"2023-12-24T18:36:33.244306+0000","last_became_active":"2023-12-24T18:36:28.137711+0000","last_became_peered":"2023-12-24T18:36:28.137711+0000","last_unstale":"2023-12-24T18:36:33.244306+0000","last_undegraded":"2023-12-24T18:36:33.244306+0000","last_fullsized":"2023-12-24T18:36:33.244306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:27.017726+0000","last_clean_scrub_stamp":"2023-12-24T18:36:27.017726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:47.085985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4483,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":697463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":106631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":106667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":110254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":106541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":872448,"data_stored":697519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.76}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:36:49.852 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-24T18:36:49.852 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-24T18:36:49.852 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-24T18:36:49.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-24T18:36:50.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 Processor -- start 2023-12-24T18:36:50.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 -- start start 2023-12-24T18:36:50.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c4158e50 0x7f07c4159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07c40cb5d0 0x7f07c40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c40ca8a0 con 0x7f07c40ccdb0 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40cb140 con 0x7f07c40cb5d0 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.059+0000 7f07c8a78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c406dcf0 con 0x7f07c4158e50 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07c40cb5d0 0x7f07c40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f07c40ccdb0 0x7f07c406cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57212/0 (socket says 172.21.15.50:57212) 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07c40cb5d0 0x7f07c40cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49076/0 (socket says 172.21.15.50:49076) 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c2d9d700 1 -- 172.21.15.50:0/2212065962 learned_addr learned my addr 172.21.15.50:0/2212065962 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c259c700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c4158e50 0x7f07c4159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c1d9b700 1 -- 172.21.15.50:0/2212065962 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770437007 0 0) 0x7f07c40ca8a0 con 0x7f07c40ccdb0 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c1d9b700 1 -- 172.21.15.50:0/2212065962 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b0003570 con 0x7f07c40ccdb0 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 -- 172.21.15.50:0/2212065962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c4158e50 msgr2=0x7f07c4159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c4158e50 0x7f07c4159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 -- 172.21.15.50:0/2212065962 >> v1:172.21.15.50:6789/0 conn(0x7f07c40ccdb0 legacy=0x7f07c406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 -- 172.21.15.50:0/2212065962 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40caaf0 con 0x7f07c40cb5d0 2023-12-24T18:36:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07bbfff700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c40cb5d0 0x7f07c40cc870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0098e0 tx=0x7f07ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6bf16089ba81f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c1d9b700 1 -- 172.21.15.50:0/2212065962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011630 con 0x7f07c40cb5d0 2023-12-24T18:36:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c1d9b700 1 -- 172.21.15.50:0/2212065962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac011790 con 0x7f07c40cb5d0 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c1d9b700 1 -- 172.21.15.50:0/2212065962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011b30 con 0x7f07c40cb5d0 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 -- 172.21.15.50:0/2212065962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c40cb5d0 msgr2=0x7f07c40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c40cb5d0 0x7f07c40cc870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0098e0 tx=0x7f07ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 -- 172.21.15.50:0/2212065962 shutdown_connections 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c40cb5d0 0x7f07c40cc870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 --2- 172.21.15.50:0/2212065962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c4158e50 0x7f07c4159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 -- 172.21.15.50:0/2212065962 >> 172.21.15.50:0/2212065962 conn(0x7f07c40670b0 msgr2=0x7f07c40674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 -- 172.21.15.50:0/2212065962 shutdown_connections 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.063+0000 7f07c8a78700 1 -- 172.21.15.50:0/2212065962 wait complete. 2023-12-24T18:36:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 Processor -- start 2023-12-24T18:36:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 -- start start 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 0x7f07c40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 0x7f07c40b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b41d0 con 0x7f07c4158e50 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b35c0 con 0x7f07c40ccdb0 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c8a78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b38a0 con 0x7f07c40cb5d0 2023-12-24T18:36:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49088/0 (socket says 172.21.15.50:49088) 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c2d9d700 1 -- 172.21.15.50:0/859088379 learned_addr learned my addr 172.21.15.50:0/859088379 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07bbfff700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 0x7f07c40b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.067+0000 7f07c259c700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 0x7f07c40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 -- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 msgr2=0x7f07c40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 0x7f07c40ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 -- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 msgr2=0x7f07c40b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 0x7f07c40b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 -- 172.21.15.50:0/859088379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac009420 con 0x7f07c4158e50 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c259c700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 0x7f07c40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07bbfff700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 0x7f07c40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c2d9d700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07bc001460 tx=0x7f07bc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00ce80 con 0x7f07c4158e50 2023-12-24T18:36:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00ac00 con 0x7f07c4158e50 2023-12-24T18:36:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0070f0 con 0x7f07c4158e50 2023-12-24T18:36:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c40b3b80 con 0x7f07c4158e50 2023-12-24T18:36:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c414e640 con 0x7f07c4158e50 2023-12-24T18:36:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c40c5930 con 0x7f07c4158e50 2023-12-24T18:36:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.071+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f07bc007520 con 0x7f07c4158e50 2023-12-24T18:36:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.075+0000 7f07ba7fc700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 0x7f07a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.075+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f07bc07d180 con 0x7f07c4158e50 2023-12-24T18:36:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.075+0000 7f07c259c700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 0x7f07a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.075+0000 7f07c259c700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 0x7f07a4062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ce0 tx=0x7f07b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.079+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07c40c5930 con 0x7f07c4158e50 2023-12-24T18:36:50.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.287+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07c40c5930 con 0x7f07c4158e50 2023-12-24T18:36:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.287+0000 7f07ba7fc700 1 -- 172.21.15.50:0/859088379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f07c40c5930 con 0x7f07c4158e50 2023-12-24T18:36:50.289 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:50.289 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 msgr2=0x7f07a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 0x7f07a4062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ce0 tx=0x7f07b4008040 comp rx=0 tx=0).stop 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 msgr2=0x7f07c414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07bc001460 tx=0x7f07bc001ae0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 shutdown_connections 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f07a4060550 0x7f07a4062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c4158e50 0x7f07c414e100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c40ccdb0 0x7f07c40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 --2- 172.21.15.50:0/859088379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c40cb5d0 0x7f07c40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 >> 172.21.15.50:0/859088379 conn(0x7f07c40670b0 msgr2=0x7f07c40cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:50.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 shutdown_connections 2023-12-24T18:36:50.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.291+0000 7f07c8a78700 1 -- 172.21.15.50:0/859088379 wait complete. 2023-12-24T18:36:50.316 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-24T18:36:50.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.483+0000 7f8029a2e700 1 Processor -- start 2023-12-24T18:36:50.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.483+0000 7f8029a2e700 1 -- start start 2023-12-24T18:36:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f8029a2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80240cc310 0x7f80240ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f8029a2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802406ba80 con 0x7f802406b540 2023-12-24T18:36:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f8029a2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802406bd60 con 0x7f80240ce750 2023-12-24T18:36:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f8029a2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802406c040 con 0x7f80240cc310 2023-12-24T18:36:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f801a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f802406b540 0x7f8024159a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57228/0 (socket says 172.21.15.50:57228) 2023-12-24T18:36:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f801a7fc700 1 -- 172.21.15.50:0/4118998486 learned_addr learned my addr 172.21.15.50:0/4118998486 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80237fe700 1 --2- 172.21.15.50:0/4118998486 >> v2:172.21.15.82:3300/0 conn(0x7f80240cc310 0x7f80240ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750499654 0 0) 0x7f802406ba80 con 0x7f802406b540 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8004003570 con 0x7f802406b540 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696115781 0 0) 0x7f802406bd60 con 0x7f80240ce750 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802406ba80 con 0x7f80240ce750 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80237fe700 1 -- 172.21.15.50:0/4118998486 >> v1:172.21.15.82:6789/0 conn(0x7f80240ce750 legacy=0x7f802406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80237fe700 1 -- 172.21.15.50:0/4118998486 >> v1:172.21.15.50:6789/0 conn(0x7f802406b540 legacy=0x7f8024159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80237fe700 1 -- 172.21.15.50:0/4118998486 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802406c320 con 0x7f80240cc310 2023-12-24T18:36:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.487+0000 7f80237fe700 1 --2- 172.21.15.50:0/4118998486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240ceb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f801c009e60 tx=0x7f801c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3b68e083d98fd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00e070 con 0x7f80240cc310 2023-12-24T18:36:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c00bab0 con 0x7f80240cc310 2023-12-24T18:36:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f80227fc700 1 -- 172.21.15.50:0/4118998486 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00be70 con 0x7f80240cc310 2023-12-24T18:36:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 -- 172.21.15.50:0/4118998486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 msgr2=0x7f80240ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 --2- 172.21.15.50:0/4118998486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240ceb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f801c009e60 tx=0x7f801c009780 comp rx=0 tx=0).stop 2023-12-24T18:36:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 -- 172.21.15.50:0/4118998486 shutdown_connections 2023-12-24T18:36:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 --2- 172.21.15.50:0/4118998486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240ceb20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 -- 172.21.15.50:0/4118998486 >> 172.21.15.50:0/4118998486 conn(0x7f80240cffb0 msgr2=0x7f80240d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 -- 172.21.15.50:0/4118998486 shutdown_connections 2023-12-24T18:36:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.491+0000 7f8029a2e700 1 -- 172.21.15.50:0/4118998486 wait complete. 2023-12-24T18:36:50.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 Processor -- start 2023-12-24T18:36:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 -- start start 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f802406b540 0x7f8024144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024147a50 con 0x7f80240ce750 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024146ed0 con 0x7f80240cc310 2023-12-24T18:36:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8029a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241471b0 con 0x7f802406b540 2023-12-24T18:36:50.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f80237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f80237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49104/0 (socket says 172.21.15.50:49104) 2023-12-24T18:36:50.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f80237fe700 1 -- 172.21.15.50:0/2596749136 learned_addr learned my addr 172.21.15.50:0/2596749136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:50.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f801a7fc700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.495+0000 7f8022ffd700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f802406b540 0x7f8024144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 -- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f802406b540 msgr2=0x7f8024144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f802406b540 0x7f8024144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 -- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 msgr2=0x7f80240c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 -- 172.21.15.50:0/2596749136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009a20 con 0x7f80240ce750 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f801a7fc700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f80237fe700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801c009460 tx=0x7f801c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c012dd0 con 0x7f80240ce750 2023-12-24T18:36:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c026480 con 0x7f80240ce750 2023-12-24T18:36:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c026840 con 0x7f80240ce750 2023-12-24T18:36:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8024147490 con 0x7f80240ce750 2023-12-24T18:36:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024144670 con 0x7f80240ce750 2023-12-24T18:36:50.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.499+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80241480c0 con 0x7f80240ce750 2023-12-24T18:36:50.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.503+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f801c01c400 con 0x7f80240ce750 2023-12-24T18:36:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.503+0000 7f801b7fe700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 0x7f8008062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.503+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f801c07edf0 con 0x7f80240ce750 2023-12-24T18:36:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.503+0000 7f8022ffd700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 0x7f8008062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.507+0000 7f8022ffd700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 0x7f8008062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8014007fd0 tx=0x7f8014007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.511+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80241480c0 con 0x7f80240ce750 2023-12-24T18:36:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.679+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80241480c0 con 0x7f80240ce750 2023-12-24T18:36:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f801b7fe700 1 -- 172.21.15.50:0/2596749136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f80241480c0 con 0x7f80240ce750 2023-12-24T18:36:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:50.686 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 msgr2=0x7f8008062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 0x7f8008062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8014007fd0 tx=0x7f8014007d50 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 msgr2=0x7f80240c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801c009460 tx=0x7f801c019000 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 shutdown_connections 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8008060550 0x7f8008062a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80240ce750 0x7f80240c96f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80240cc310 0x7f80240c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 --2- 172.21.15.50:0/2596749136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f802406b540 0x7f8024144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.683+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 >> 172.21.15.50:0/2596749136 conn(0x7f80240cffb0 msgr2=0x7f8024159690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.687+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 shutdown_connections 2023-12-24T18:36:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.687+0000 7f8029a2e700 1 -- 172.21.15.50:0/2596749136 wait complete. 2023-12-24T18:36:50.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:36:50.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:36:50.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.879+0000 7f9b7646e700 1 Processor -- start 2023-12-24T18:36:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 -- start start 2023-12-24T18:36:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b70142b30 0x7f9b7006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b700c72d0 0x7f9b700c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70142f00 con 0x7f9b70068e40 2023-12-24T18:36:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b700c7800 con 0x7f9b70142b30 2023-12-24T18:36:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b7646e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700c7ae0 con 0x7f9b700c72d0 2023-12-24T18:36:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b74a0b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b70068e40 0x7f9b700c1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57244/0 (socket says 172.21.15.50:57244) 2023-12-24T18:36:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b74a0b700 1 -- 172.21.15.50:0/142526 learned_addr learned my addr 172.21.15.50:0/142526 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b677fe700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b700c72d0 0x7f9b700c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.883+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/142526 >> v2:172.21.15.82:3300/0 conn(0x7f9b70142b30 0x7f9b7006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6f7fe700 1 -- 172.21.15.50:0/142526 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769733676 0 0) 0x7f9b70142f00 con 0x7f9b70068e40 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6f7fe700 1 -- 172.21.15.50:0/142526 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003570 con 0x7f9b70068e40 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6ffff700 1 -- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b700c72d0 msgr2=0x7f9b700c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b700c72d0 0x7f9b700c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6ffff700 1 -- 172.21.15.50:0/142526 >> v1:172.21.15.50:6789/0 conn(0x7f9b70068e40 legacy=0x7f9b700c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6ffff700 1 -- 172.21.15.50:0/142526 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700c7dc0 con 0x7f9b70142b30 2023-12-24T18:36:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b70142b30 0x7f9b7006ec50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009e60 tx=0x7f9b60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e95cce21f269901 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6f7fe700 1 -- 172.21.15.50:0/142526 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000e070 con 0x7f9b70142b30 2023-12-24T18:36:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6f7fe700 1 -- 172.21.15.50:0/142526 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6000bab0 con 0x7f9b70142b30 2023-12-24T18:36:50.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b6f7fe700 1 -- 172.21.15.50:0/142526 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000be70 con 0x7f9b70142b30 2023-12-24T18:36:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 -- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b70142b30 msgr2=0x7f9b7006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b70142b30 0x7f9b7006ec50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009e60 tx=0x7f9b60009780 comp rx=0 tx=0).stop 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 -- 172.21.15.50:0/142526 shutdown_connections 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b700c72d0 0x7f9b700c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 --2- 172.21.15.50:0/142526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b70142b30 0x7f9b7006ec50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 -- 172.21.15.50:0/142526 >> 172.21.15.50:0/142526 conn(0x7f9b700c9700 msgr2=0x7f9b700c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 -- 172.21.15.50:0/142526 shutdown_connections 2023-12-24T18:36:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.887+0000 7f9b7646e700 1 -- 172.21.15.50:0/142526 wait complete. 2023-12-24T18:36:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.891+0000 7f9b7646e700 1 Processor -- start 2023-12-24T18:36:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.891+0000 7f9b7646e700 1 -- start start 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 0x7f9b701414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700c72d0 0x7f9b70140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70169bf0 con 0x7f9b70142b30 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70141250 con 0x7f9b700c72d0 2023-12-24T18:36:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700c6fe0 con 0x7f9b70068e40 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b6ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 0x7f9b701414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49108/0 (socket says 172.21.15.50:49108) 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 -- 172.21.15.50:0/1392741616 learned_addr learned my addr 172.21.15.50:0/1392741616 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b677fe700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700c72d0 0x7f9b70140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 -- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 msgr2=0x7f9b701414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 0x7f9b701414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 -- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700c72d0 msgr2=0x7f9b70140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700c72d0 0x7f9b70140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 -- 172.21.15.50:0/1392741616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60009a20 con 0x7f9b70142b30 2023-12-24T18:36:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 0x7f9b701414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b74a0b700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b680010e0 tx=0x7f9b68007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68005b30 con 0x7f9b70142b30 2023-12-24T18:36:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68005c90 con 0x7f9b70142b30 2023-12-24T18:36:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b701695a0 con 0x7f9b70142b30 2023-12-24T18:36:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680072e0 con 0x7f9b70142b30 2023-12-24T18:36:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.895+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b70169250 con 0x7f9b70142b30 2023-12-24T18:36:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.899+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b70169d60 con 0x7f9b70142b30 2023-12-24T18:36:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.899+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9b68012400 con 0x7f9b70142b30 2023-12-24T18:36:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.899+0000 7f9b6cff9700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 0x7f9b50062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.899+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f9b6807bdb0 con 0x7f9b70142b30 2023-12-24T18:36:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.899+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 0x7f9b50062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.903+0000 7f9b6ffff700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 0x7f9b50062a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b600097c0 tx=0x7f9b60019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:50.907+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9b68049be0 con 0x7f9b70142b30 2023-12-24T18:36:51.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.079+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b700652e0 con 0x7f9b70142b30 2023-12-24T18:36:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.079+0000 7f9b6cff9700 1 -- 172.21.15.50:0/1392741616 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b680170a0 con 0x7f9b70142b30 2023-12-24T18:36:51.083 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:36:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 msgr2=0x7f9b50062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 0x7f9b50062a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b600097c0 tx=0x7f9b60019000 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 msgr2=0x7f9b7015ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b680010e0 tx=0x7f9b68007dd0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 shutdown_connections 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9b50060580 0x7f9b50062a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b70142b30 0x7f9b7015ea10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700c72d0 0x7f9b70140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 --2- 172.21.15.50:0/1392741616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b70068e40 0x7f9b701414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 >> 172.21.15.50:0/1392741616 conn(0x7f9b700c9700 msgr2=0x7f9b700b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 shutdown_connections 2023-12-24T18:36:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.087+0000 7f9b7646e700 1 -- 172.21.15.50:0/1392741616 wait complete. 2023-12-24T18:36:51.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:36:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.279+0000 7f2367cf0700 1 Processor -- start 2023-12-24T18:36:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.279+0000 7f2367cf0700 1 -- start start 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 0x7f23600ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23600afc10 0x7f23600b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23600b0d50 0x7f23600ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600ae960 con 0x7f23600afc10 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600adfb0 con 0x7f23601554a0 2023-12-24T18:36:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2367cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c93c0 con 0x7f23600b0d50 2023-12-24T18:36:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23600afc10 0x7f23600b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23600afc10 0x7f23600b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49120/0 (socket says 172.21.15.50:49120) 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 -- 172.21.15.50:0/860253219 learned_addr learned my addr 172.21.15.50:0/860253219 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2365a8c700 1 --2- 172.21.15.50:0/860253219 >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 0x7f23600ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236628d700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23600b0d50 0x7f23600ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 -- 172.21.15.50:0/860253219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23600b0d50 msgr2=0x7f23600ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23600b0d50 0x7f23600ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 -- 172.21.15.50:0/860253219 >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 msgr2=0x7f23600ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 --2- 172.21.15.50:0/860253219 >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 0x7f23600ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 -- 172.21.15.50:0/860253219 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600b0180 con 0x7f23600afc10 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2365a8c700 1 --2- 172.21.15.50:0/860253219 >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 0x7f23600ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f236528b700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600afc10 0x7f23600b0810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f236006adc0 tx=0x7f2350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da4dce58eb3038d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2364a8a700 1 -- 172.21.15.50:0/860253219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000b860 con 0x7f23600afc10 2023-12-24T18:36:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2364a8a700 1 -- 172.21.15.50:0/860253219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000b9c0 con 0x7f23600afc10 2023-12-24T18:36:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.283+0000 7f2364a8a700 1 -- 172.21.15.50:0/860253219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000bd60 con 0x7f23600afc10 2023-12-24T18:36:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- 172.21.15.50:0/860253219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600afc10 msgr2=0x7f23600b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600afc10 0x7f23600b0810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f236006adc0 tx=0x7f2350009250 comp rx=0 tx=0).stop 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- 172.21.15.50:0/860253219 shutdown_connections 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23600b0d50 0x7f23600ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 --2- 172.21.15.50:0/860253219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600afc10 0x7f23600b0810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 --2- 172.21.15.50:0/860253219 >> v2:172.21.15.82:3300/0 conn(0x7f23601554a0 0x7f23600ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- 172.21.15.50:0/860253219 >> 172.21.15.50:0/860253219 conn(0x7f236006c820 msgr2=0x7f236006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- 172.21.15.50:0/860253219 shutdown_connections 2023-12-24T18:36:51.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- 172.21.15.50:0/860253219 wait complete. 2023-12-24T18:36:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 Processor -- start 2023-12-24T18:36:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.287+0000 7f2367cf0700 1 -- start start 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23600afc10 0x7f2360144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23601554a0 0x7f23600c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c8b80 con 0x7f23600b0d50 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c29b0 con 0x7f23600afc10 2023-12-24T18:36:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c1da0 con 0x7f23601554a0 2023-12-24T18:36:51.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49128/0 (socket says 172.21.15.50:49128) 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 -- 172.21.15.50:0/1642722731 learned_addr learned my addr 172.21.15.50:0/1642722731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2365a8c700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23600afc10 0x7f2360144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236628d700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23601554a0 0x7f23600c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 -- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23601554a0 msgr2=0x7f23600c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23601554a0 0x7f23600c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 -- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23600afc10 msgr2=0x7f2360144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23600afc10 0x7f2360144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 -- 172.21.15.50:0/1642722731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094f0 con 0x7f23600b0d50 2023-12-24T18:36:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f236528b700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2350009290 tx=0x7f2350017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350026480 con 0x7f23600b0d50 2023-12-24T18:36:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235001f070 con 0x7f23600b0d50 2023-12-24T18:36:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350026830 con 0x7f23600b0d50 2023-12-24T18:36:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.291+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23600c2080 con 0x7f23600b0d50 2023-12-24T18:36:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.295+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600c2640 con 0x7f23600b0d50 2023-12-24T18:36:51.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.295+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600c2b40 con 0x7f23600b0d50 2023-12-24T18:36:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.295+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f235001a430 con 0x7f23600b0d50 2023-12-24T18:36:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.299+0000 7f2355ffb700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 0x7f2344062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.299+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f2350021070 con 0x7f23600b0d50 2023-12-24T18:36:51.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.299+0000 7f2365a8c700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 0x7f2344062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.299+0000 7f2365a8c700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 0x7f2344062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f235c006f00 tx=0x7f235c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.307+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f235004eba0 con 0x7f23600b0d50 2023-12-24T18:36:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.483+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23600652e0 con 0x7f23600b0d50 2023-12-24T18:36:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.487+0000 7f2355ffb700 1 -- 172.21.15.50:0/1642722731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23500521c0 con 0x7f23600b0d50 2023-12-24T18:36:51.488 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:36:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 msgr2=0x7f2344062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 0x7f2344062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f235c006f00 tx=0x7f235c008040 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 msgr2=0x7f23600c11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2350009290 tx=0x7f2350017000 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 shutdown_connections 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2344060550 0x7f2344062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23601554a0 0x7f23600c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23600b0d50 0x7f23600c11e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 --2- 172.21.15.50:0/1642722731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23600afc10 0x7f2360144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 >> 172.21.15.50:0/1642722731 conn(0x7f236006c820 msgr2=0x7f23600686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 shutdown_connections 2023-12-24T18:36:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.491+0000 7f2367cf0700 1 -- 172.21.15.50:0/1642722731 wait complete. 2023-12-24T18:36:51.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:36:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.679+0000 7f47bc5c5700 1 Processor -- start 2023-12-24T18:36:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.679+0000 7f47bc5c5700 1 -- start start 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47b4160720 0x7f47b406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b4160af0 0x7f47b406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b4161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b406b0b0 con 0x7f47b4160720 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b415e960 con 0x7f47b4160af0 2023-12-24T18:36:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41600a0 con 0x7f47b406ac40 2023-12-24T18:36:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47b4160720 0x7f47b406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47b4160720 0x7f47b406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49138/0 (socket says 172.21.15.50:49138) 2023-12-24T18:36:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 -- 172.21.15.50:0/1794945159 learned_addr learned my addr 172.21.15.50:0/1794945159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47b9b60700 1 --2- 172.21.15.50:0/1794945159 >> v2:172.21.15.82:3300/0 conn(0x7f47b4160af0 0x7f47b406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bab62700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b4161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 -- 172.21.15.50:0/1794945159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 msgr2=0x7f47b4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b4161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 -- 172.21.15.50:0/1794945159 >> v2:172.21.15.82:3300/0 conn(0x7f47b4160af0 msgr2=0x7f47b406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 --2- 172.21.15.50:0/1794945159 >> v2:172.21.15.82:3300/0 conn(0x7f47b4160af0 0x7f47b406a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 -- 172.21.15.50:0/1794945159 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b415dd50 con 0x7f47b4160720 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47ba361700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b406d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47b4069b50 tx=0x7f47b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e311d84bc4eac9a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47b935f700 1 -- 172.21.15.50:0/1794945159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000e070 con 0x7f47b4160720 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47b935f700 1 -- 172.21.15.50:0/1794945159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000ba20 con 0x7f47b4160720 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47b935f700 1 -- 172.21.15.50:0/1794945159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00092e0 con 0x7f47b4160720 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- 172.21.15.50:0/1794945159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 msgr2=0x7f47b406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b406d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47b4069b50 tx=0x7f47b0009840 comp rx=0 tx=0).stop 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- 172.21.15.50:0/1794945159 shutdown_connections 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/1794945159 >> v2:172.21.15.82:3300/0 conn(0x7f47b4160af0 0x7f47b406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b4161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/1794945159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b406d1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.683+0000 7f47bc5c5700 1 -- 172.21.15.50:0/1794945159 >> 172.21.15.50:0/1794945159 conn(0x7f47b4067b80 msgr2=0x7f47b40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- 172.21.15.50:0/1794945159 shutdown_connections 2023-12-24T18:36:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- 172.21.15.50:0/1794945159 wait complete. 2023-12-24T18:36:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 Processor -- start 2023-12-24T18:36:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- start start 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160af0 0x7f47b4159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c4d30 con 0x7f47b4160720 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c9c20 con 0x7f47b4160af0 2023-12-24T18:36:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bc5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c9ec0 con 0x7f47b406ac40 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47b9b60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47ba361700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47b9b60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49146/0 (socket says 172.21.15.50:49146) 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47b9b60700 1 -- 172.21.15.50:0/4030722873 learned_addr learned my addr 172.21.15.50:0/4030722873 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.687+0000 7f47bab62700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160af0 0x7f47b4159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 -- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 msgr2=0x7f47b40cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b40cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 -- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160af0 msgr2=0x7f47b4159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160af0 0x7f47b4159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 -- 172.21.15.50:0/4030722873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009ae0 con 0x7f47b4160720 2023-12-24T18:36:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47b9b60700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47a400ec80 tx=0x7f47a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400c850 con 0x7f47b4160720 2023-12-24T18:36:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400c9b0 con 0x7f47b4160720 2023-12-24T18:36:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40ca1a0 con 0x7f47b4160720 2023-12-24T18:36:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400cd50 con 0x7f47b4160720 2023-12-24T18:36:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40ca760 con 0x7f47b4160720 2023-12-24T18:36:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.691+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b40c4ea0 con 0x7f47b4160720 2023-12-24T18:36:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.695+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f47a4013680 con 0x7f47b4160720 2023-12-24T18:36:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.695+0000 7f47aa7fc700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 0x7f4798062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.695+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f47a407cd50 con 0x7f47b4160720 2023-12-24T18:36:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.695+0000 7f47ba361700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 0x7f4798062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.699+0000 7f47ba361700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 0x7f4798062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009880 tx=0x7f47b0018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.703+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47b40c4ea0 con 0x7f47b4160720 2023-12-24T18:36:51.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.875+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47b40c4e70 con 0x7f47b4160720 2023-12-24T18:36:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.875+0000 7f47aa7fc700 1 -- 172.21.15.50:0/4030722873 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47a404cfb0 con 0x7f47b4160720 2023-12-24T18:36:51.877 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:36:51.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 msgr2=0x7f4798062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 0x7f4798062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009880 tx=0x7f47b0018000 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 msgr2=0x7f47b40c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47a400ec80 tx=0x7f47a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 shutdown_connections 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4798060550 0x7f4798062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160af0 0x7f47b4159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b4160720 0x7f47b40c96e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 --2- 172.21.15.50:0/4030722873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406ac40 0x7f47b40cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 >> 172.21.15.50:0/4030722873 conn(0x7f47b4067b80 msgr2=0x7f47b415b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 shutdown_connections 2023-12-24T18:36:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:51.879+0000 7f47bc5c5700 1 -- 172.21.15.50:0/4030722873 wait complete. 2023-12-24T18:36:51.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:36:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.067+0000 7f6148345700 1 Processor -- start 2023-12-24T18:36:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.067+0000 7f6148345700 1 -- start start 2023-12-24T18:36:52.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f6148345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f614006ae20 0x7f61400b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f6148345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f61400b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f6148345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61400b3fd0 con 0x7f6140158e00 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f6148345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61400b33c0 con 0x7f614006ae20 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f6148345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400b36a0 con 0x7f614006c820 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61460e1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6140158e00 0x7f614006a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34170/0 (socket says 172.21.15.50:34170) 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61460e1700 1 -- 172.21.15.50:0/834077347 learned_addr learned my addr 172.21.15.50:0/834077347 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61458e0700 1 --2- 172.21.15.50:0/834077347 >> v2:172.21.15.82:3300/0 conn(0x7f614006ae20 0x7f61400b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61468e2700 1 --2- 172.21.15.50:0/834077347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f61400b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61450df700 1 -- 172.21.15.50:0/834077347 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743693331 0 0) 0x7f61400b3fd0 con 0x7f6140158e00 2023-12-24T18:36:52.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61450df700 1 -- 172.21.15.50:0/834077347 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f612c003570 con 0x7f6140158e00 2023-12-24T18:36:52.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61468e2700 1 -- 172.21.15.50:0/834077347 >> v2:172.21.15.82:3300/0 conn(0x7f614006ae20 msgr2=0x7f61400b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:52.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61468e2700 1 --2- 172.21.15.50:0/834077347 >> v2:172.21.15.82:3300/0 conn(0x7f614006ae20 0x7f61400b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.071+0000 7f61468e2700 1 -- 172.21.15.50:0/834077347 >> v1:172.21.15.82:6789/0 conn(0x7f6140158e00 legacy=0x7f614006a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f61468e2700 1 -- 172.21.15.50:0/834077347 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400b3980 con 0x7f614006c820 2023-12-24T18:36:52.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f61468e2700 1 --2- 172.21.15.50:0/834077347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f61400b4460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e60 tx=0x7f6138009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6374ec3b94b069f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f61450df700 1 -- 172.21.15.50:0/834077347 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800e070 con 0x7f614006c820 2023-12-24T18:36:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f61450df700 1 -- 172.21.15.50:0/834077347 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800bab0 con 0x7f614006c820 2023-12-24T18:36:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f61450df700 1 -- 172.21.15.50:0/834077347 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800be70 con 0x7f614006c820 2023-12-24T18:36:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 -- 172.21.15.50:0/834077347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 msgr2=0x7f61400b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 --2- 172.21.15.50:0/834077347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f61400b4460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e60 tx=0x7f6138009780 comp rx=0 tx=0).stop 2023-12-24T18:36:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 -- 172.21.15.50:0/834077347 shutdown_connections 2023-12-24T18:36:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 --2- 172.21.15.50:0/834077347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f61400b4460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 --2- 172.21.15.50:0/834077347 >> v2:172.21.15.82:3300/0 conn(0x7f614006ae20 0x7f61400b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 -- 172.21.15.50:0/834077347 >> 172.21.15.50:0/834077347 conn(0x7f6140067b80 msgr2=0x7f61400cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 -- 172.21.15.50:0/834077347 shutdown_connections 2023-12-24T18:36:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.075+0000 7f6148345700 1 -- 172.21.15.50:0/834077347 wait complete. 2023-12-24T18:36:52.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 Processor -- start 2023-12-24T18:36:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 -- start start 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f614016d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 0x7f61400d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614016e1f0 con 0x7f614006ae20 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614014c160 con 0x7f6140158e00 2023-12-24T18:36:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f6148345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6140150d40 con 0x7f614006c820 2023-12-24T18:36:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f61460e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f61460e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49152/0 (socket says 172.21.15.50:49152) 2023-12-24T18:36:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f61460e1700 1 -- 172.21.15.50:0/4256058337 learned_addr learned my addr 172.21.15.50:0/4256058337 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f61468e2700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 0x7f61400d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.079+0000 7f61458e0700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f614016d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 -- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 msgr2=0x7f614016d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f614016d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 -- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 msgr2=0x7f61400d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 0x7f61400d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 -- 172.21.15.50:0/4256058337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138009a20 con 0x7f614006ae20 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61468e2700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 0x7f61400d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61460e1700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c7c0 tx=0x7f613c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c005b30 con 0x7f614006ae20 2023-12-24T18:36:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c005cb0 con 0x7f614006ae20 2023-12-24T18:36:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614016d6b0 con 0x7f614006ae20 2023-12-24T18:36:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c007320 con 0x7f614006ae20 2023-12-24T18:36:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614016dc30 con 0x7f614006ae20 2023-12-24T18:36:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.083+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614014bec0 con 0x7f614006ae20 2023-12-24T18:36:52.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.087+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f613c01b3b0 con 0x7f614006ae20 2023-12-24T18:36:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.087+0000 7f61367fc700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 0x7f6124062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.087+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f613c07c080 con 0x7f614006ae20 2023-12-24T18:36:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.087+0000 7f61458e0700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 0x7f6124062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.087+0000 7f61458e0700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 0x7f6124062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61400b1ef0 tx=0x7f61300091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.095+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f614014bec0 con 0x7f614006ae20 2023-12-24T18:36:52.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.267+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f614014bec0 con 0x7f614006ae20 2023-12-24T18:36:52.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f61367fc700 1 -- 172.21.15.50:0/4256058337 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f614014bec0 con 0x7f614006ae20 2023-12-24T18:36:52.272 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:36:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 msgr2=0x7f6124062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 0x7f6124062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61400b1ef0 tx=0x7f61300091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 msgr2=0x7f614014f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c7c0 tx=0x7f613c007e00 comp rx=0 tx=0).stop 2023-12-24T18:36:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 shutdown_connections 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6124060550 0x7f6124062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6140158e00 0x7f61400d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f614006c820 0x7f614016d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 --2- 172.21.15.50:0/4256058337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614006ae20 0x7f614014f0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 >> 172.21.15.50:0/4256058337 conn(0x7f6140067b80 msgr2=0x7f614015b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 shutdown_connections 2023-12-24T18:36:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.271+0000 7f6148345700 1 -- 172.21.15.50:0/4256058337 wait complete. 2023-12-24T18:36:52.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.459+0000 7ff7e34e3700 1 Processor -- start 2023-12-24T18:36:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.463+0000 7ff7e34e3700 1 -- start start 2023-12-24T18:36:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e34e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 0x7ff7dc161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e34e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc06c4d0 con 0x7ff7dc06c820 2023-12-24T18:36:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e34e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc06c1f0 con 0x7ff7dc1611b0 2023-12-24T18:36:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e34e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0ab5e0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e2ce2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7dc06c820 0x7ff7dc0ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57246/0 (socket says 172.21.15.50:57246) 2023-12-24T18:36:52.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e24e1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff7dc1611b0 0x7ff7dc06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34182/0 (socket says 172.21.15.50:34182) 2023-12-24T18:36:52.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e2ce2700 1 -- 172.21.15.50:0/2639105855 learned_addr learned my addr 172.21.15.50:0/2639105855 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:52.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e1ce0700 1 --2- 172.21.15.50:0/2639105855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 0x7ff7dc161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530482479 0 0) 0x7ff7dc06c1f0 con 0x7ff7dc1611b0 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003570 con 0x7ff7dc1611b0 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851680729 0 0) 0x7ff7d4001490 con 0x7ff7dc06c820 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/2639105855 >> v1:172.21.15.82:6789/0 conn(0x7ff7dc1611b0 legacy=0x7ff7dc06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/2639105855 >> v1:172.21.15.50:6789/0 conn(0x7ff7dc06c820 legacy=0x7ff7dc0ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/2639105855 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0ab8c0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e1ce0700 1 --2- 172.21.15.50:0/2639105855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 0x7ff7dc161580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009910 tx=0x7ff7cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c64b959c02c161 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00b680 con 0x7ff7dc0ae100 2023-12-24T18:36:52.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc00b7e0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.467+0000 7ff7e14df700 1 -- 172.21.15.50:0/2639105855 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00bba0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- 172.21.15.50:0/2639105855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 msgr2=0x7ff7dc161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/2639105855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 0x7ff7dc161580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009910 tx=0x7ff7cc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- 172.21.15.50:0/2639105855 shutdown_connections 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/2639105855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc0ae100 0x7ff7dc161580 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- 172.21.15.50:0/2639105855 >> 172.21.15.50:0/2639105855 conn(0x7ff7dc067b80 msgr2=0x7ff7dc0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- 172.21.15.50:0/2639105855 shutdown_connections 2023-12-24T18:36:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- 172.21.15.50:0/2639105855 wait complete. 2023-12-24T18:36:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 Processor -- start 2023-12-24T18:36:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.471+0000 7ff7e34e3700 1 -- start start 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc06c820 0x7ff7dc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc1611b0 0x7ff7dc1600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc15f9d0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc171110 con 0x7ff7dc06c820 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e34e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc15b6c0 con 0x7ff7dc1611b0 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49154/0 (socket says 172.21.15.50:49154) 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/731093013 learned_addr learned my addr 172.21.15.50:0/731093013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e24e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc06c820 0x7ff7dc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e2ce2700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc1611b0 0x7ff7dc1600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc1611b0 msgr2=0x7ff7dc1600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc1611b0 0x7ff7dc1600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc06c820 msgr2=0x7ff7dc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc06c820 0x7ff7dc15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 -- 172.21.15.50:0/731093013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009420 con 0x7ff7dc0ae100 2023-12-24T18:36:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.475+0000 7ff7e1ce0700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc002ff0 tx=0x7ff7cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00bb60 con 0x7ff7dc0ae100 2023-12-24T18:36:52.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc027450 con 0x7ff7dc0ae100 2023-12-24T18:36:52.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0277f0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc15f130 con 0x7ff7dc0ae100 2023-12-24T18:36:52.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc15f6f0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc04be40 con 0x7ff7dc0ae100 2023-12-24T18:36:52.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.479+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff7cc011420 con 0x7ff7dc0ae100 2023-12-24T18:36:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.483+0000 7ff7d27fc700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 0x7ff7c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.483+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7ff7cc07e9a0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.483+0000 7ff7e24e1700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 0x7ff7c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.483+0000 7ff7e24e1700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 0x7ff7c0062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8004fb0 tx=0x7ff7d8000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.491+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff7cc04eca0 con 0x7ff7dc0ae100 2023-12-24T18:36:52.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.695+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7dc06a840 con 0x7ff7dc0ae100 2023-12-24T18:36:52.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7d27fc700 1 -- 172.21.15.50:0/731093013 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7ff7cc015090 con 0x7ff7dc0ae100 2023-12-24T18:36:52.701 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:52.701 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:36:52.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 msgr2=0x7ff7c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 0x7ff7c0062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8004fb0 tx=0x7ff7d8000bc0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 msgr2=0x7ff7dc15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc002ff0 tx=0x7ff7cc017000 comp rx=0 tx=0).stop 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 shutdown_connections 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff7c0060550 0x7ff7c0062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7dc1611b0 0x7ff7dc1600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7dc0ae100 0x7ff7dc15b180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 --2- 172.21.15.50:0/731093013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc06c820 0x7ff7dc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.699+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 >> 172.21.15.50:0/731093013 conn(0x7ff7dc067b80 msgr2=0x7ff7dc151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:52.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.703+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 shutdown_connections 2023-12-24T18:36:52.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.703+0000 7ff7e34e3700 1 -- 172.21.15.50:0/731093013 wait complete. 2023-12-24T18:36:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:36:52.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 Processor -- start 2023-12-24T18:36:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 -- start start 2023-12-24T18:36:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 0x7fe7880c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7880cc370 0x7fe7880c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880ca120 con 0x7fe7880cbf10 2023-12-24T18:36:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880cc7d0 con 0x7fe7880cc370 2023-12-24T18:36:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d84c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880c9510 con 0x7fe7880c3160 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7880cc370 0x7fe7880c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7880cc370 0x7fe7880c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49170/0 (socket says 172.21.15.50:49170) 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 -- 172.21.15.50:0/4109024112 learned_addr learned my addr 172.21.15.50:0/4109024112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78c84a700 1 --2- 172.21.15.50:0/4109024112 >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 0x7fe7880c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 -- 172.21.15.50:0/4109024112 >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 msgr2=0x7fe7880c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 --2- 172.21.15.50:0/4109024112 >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 0x7fe7880c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 -- 172.21.15.50:0/4109024112 >> v1:172.21.15.82:6789/0 conn(0x7fe7880cbf10 legacy=0x7fe7880c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 -- 172.21.15.50:0/4109024112 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880c97f0 con 0x7fe7880cc370 2023-12-24T18:36:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78c84a700 1 --2- 172.21.15.50:0/4109024112 >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 0x7fe7880c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe78d04b700 1 --2- 172.21.15.50:0/4109024112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880cc370 0x7fe7880c1fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b2c00 tx=0x7fe780009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b74c8575262d01 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.887+0000 7fe77f7fe700 1 -- 172.21.15.50:0/4109024112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000e070 con 0x7fe7880cc370 2023-12-24T18:36:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe77f7fe700 1 -- 172.21.15.50:0/4109024112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000baa0 con 0x7fe7880cc370 2023-12-24T18:36:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe77f7fe700 1 -- 172.21.15.50:0/4109024112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800092e0 con 0x7fe7880cc370 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 -- 172.21.15.50:0/4109024112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880cc370 msgr2=0x7fe7880c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 --2- 172.21.15.50:0/4109024112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880cc370 0x7fe7880c1fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b2c00 tx=0x7fe780009840 comp rx=0 tx=0).stop 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 -- 172.21.15.50:0/4109024112 shutdown_connections 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 --2- 172.21.15.50:0/4109024112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880cc370 0x7fe7880c1fc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 --2- 172.21.15.50:0/4109024112 >> v2:172.21.15.82:3300/0 conn(0x7fe7880c3160 0x7fe7880c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 -- 172.21.15.50:0/4109024112 >> 172.21.15.50:0/4109024112 conn(0x7fe7880af9d0 msgr2=0x7fe7880afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 -- 172.21.15.50:0/4109024112 shutdown_connections 2023-12-24T18:36:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 -- 172.21.15.50:0/4109024112 wait complete. 2023-12-24T18:36:52.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.891+0000 7fe78d84c700 1 Processor -- start 2023-12-24T18:36:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 -- start start 2023-12-24T18:36:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7880cbf10 0x7fe78806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7880cc370 0x7fe788153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788152ea0 con 0x7fe7880c3160 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78806f3f0 con 0x7fe7880cc370 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d84c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe788168ff0 con 0x7fe7880cbf10 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49182/0 (socket says 172.21.15.50:49182) 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 -- 172.21.15.50:0/3791775461 learned_addr learned my addr 172.21.15.50:0/3791775461 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe77ffff700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7880cbf10 0x7fe78806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78d04b700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7880cc370 0x7fe788153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 -- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7880cbf10 msgr2=0x7fe78806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7880cbf10 0x7fe78806eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 -- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7880cc370 msgr2=0x7fe788153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7880cc370 0x7fe788153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.895+0000 7fe78c84a700 1 -- 172.21.15.50:0/3791775461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780009ae0 con 0x7fe7880c3160 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe78c84a700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c860 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784005a00 con 0x7fe7880c3160 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe784005b60 con 0x7fe7880c3160 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784011600 con 0x7fe7880c3160 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe788169b70 con 0x7fe7880c3160 2023-12-24T18:36:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe788169240 con 0x7fe7880c3160 2023-12-24T18:36:52.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.899+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78804be40 con 0x7fe7880c3160 2023-12-24T18:36:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.903+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe7840119b0 con 0x7fe7880c3160 2023-12-24T18:36:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.903+0000 7fe77cff9700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 0x7fe774062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.903+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fe78407c910 con 0x7fe7880c3160 2023-12-24T18:36:52.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.903+0000 7fe77ffff700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 0x7fe774062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:52.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.903+0000 7fe77ffff700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 0x7fe774062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe788159460 tx=0x7fe778007ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:52.911+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe78404cb70 con 0x7fe7880c3160 2023-12-24T18:36:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.083+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7880cda30 con 0x7fe7880c3160 2023-12-24T18:36:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe77cff9700 1 -- 172.21.15.50:0/3791775461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fe784050190 con 0x7fe7880c3160 2023-12-24T18:36:53.089 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:53.089 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 msgr2=0x7fe774062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 0x7fe774062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe788159460 tx=0x7fe778007ef0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 msgr2=0x7fe788158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c860 tx=0x7fe784008040 comp rx=0 tx=0).stop 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 shutdown_connections 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe774060550 0x7fe774062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7880cc370 0x7fe788153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7880cbf10 0x7fe78806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 --2- 172.21.15.50:0/3791775461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7880c3160 0x7fe788158f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 >> 172.21.15.50:0/3791775461 conn(0x7fe7880af9d0 msgr2=0x7fe7880b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 shutdown_connections 2023-12-24T18:36:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.087+0000 7fe78d84c700 1 -- 172.21.15.50:0/3791775461 wait complete. 2023-12-24T18:36:53.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:36:53.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:36:53.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.287+0000 7fd84166e700 1 Processor -- start 2023-12-24T18:36:53.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.287+0000 7fd84166e700 1 -- start start 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c158db0 0x7fd83c159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c0a9290 0x7fd83c0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd83c06a700 0x7fd83c06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06b0c0 con 0x7fd83c158db0 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06cca0 con 0x7fd83c06a700 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0a9cc0 con 0x7fd83c0a9290 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c158db0 0x7fd83c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c158db0 0x7fd83c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49188/0 (socket says 172.21.15.50:49188) 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 -- 172.21.15.50:0/3565461733 learned_addr learned my addr 172.21.15.50:0/3565461733 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83a7fc700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c0a9290 0x7fd83c0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83b7fe700 1 --2- 172.21.15.50:0/3565461733 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06a700 0x7fd83c06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 -- 172.21.15.50:0/3565461733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c0a9290 msgr2=0x7fd83c0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c0a9290 0x7fd83c0a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 -- 172.21.15.50:0/3565461733 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06a700 msgr2=0x7fd83c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 --2- 172.21.15.50:0/3565461733 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06a700 0x7fd83c06ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 -- 172.21.15.50:0/3565461733 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0a9fa0 con 0x7fd83c158db0 2023-12-24T18:36:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd83affd700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c158db0 0x7fd83c159180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06c820 tx=0x7fd82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f291b74eb073b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd839ffb700 1 -- 172.21.15.50:0/3565461733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00b860 con 0x7fd83c158db0 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd839ffb700 1 -- 172.21.15.50:0/3565461733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00b9c0 con 0x7fd83c158db0 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd839ffb700 1 -- 172.21.15.50:0/3565461733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bd60 con 0x7fd83c158db0 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- 172.21.15.50:0/3565461733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c158db0 msgr2=0x7fd83c159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c158db0 0x7fd83c159180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06c820 tx=0x7fd82c009250 comp rx=0 tx=0).stop 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- 172.21.15.50:0/3565461733 shutdown_connections 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- 172.21.15.50:0/3565461733 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06a700 0x7fd83c06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c0a9290 0x7fd83c0a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 --2- 172.21.15.50:0/3565461733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c158db0 0x7fd83c159180 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- 172.21.15.50:0/3565461733 >> 172.21.15.50:0/3565461733 conn(0x7fd83c067b80 msgr2=0x7fd83c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- 172.21.15.50:0/3565461733 shutdown_connections 2023-12-24T18:36:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.291+0000 7fd84166e700 1 -- 172.21.15.50:0/3565461733 wait complete. 2023-12-24T18:36:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.295+0000 7fd84166e700 1 Processor -- start 2023-12-24T18:36:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.295+0000 7fd84166e700 1 -- start start 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06a700 0x7fd83c0a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c158db0 0x7fd83c0a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1586e0 con 0x7fd83c0a9290 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0a44c0 con 0x7fd83c158db0 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c15b770 con 0x7fd83c06a700 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49196/0 (socket says 172.21.15.50:49196) 2023-12-24T18:36:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 -- 172.21.15.50:0/533197180 learned_addr learned my addr 172.21.15.50:0/533197180 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83b7fe700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c158db0 0x7fd83c0a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83affd700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06a700 0x7fd83c0a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 -- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06a700 msgr2=0x7fd83c0a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06a700 0x7fd83c0a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 -- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c158db0 msgr2=0x7fd83c0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c158db0 0x7fd83c0a7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 -- 172.21.15.50:0/533197180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0094f0 con 0x7fd83c0a9290 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd83a7fc700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d890 tx=0x7fd830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300125f0 con 0x7fd83c0a9290 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830012770 con 0x7fd83c0a9290 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c15ba50 con 0x7fd83c0a9290 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830012b30 con 0x7fd83c0a9290 2023-12-24T18:36:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.299+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c15c090 con 0x7fd83c0a9290 2023-12-24T18:36:53.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.303+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0a4670 con 0x7fd83c0a9290 2023-12-24T18:36:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.303+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd83001e460 con 0x7fd83c0a9290 2023-12-24T18:36:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.303+0000 7fd822ffd700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.303+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fd83007d130 con 0x7fd83c0a9290 2023-12-24T18:36:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.303+0000 7fd83affd700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.307+0000 7fd83affd700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 0x7fd828062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06c820 tx=0x7fd82c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.311+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd83c0a4670 con 0x7fd83c0a9290 2023-12-24T18:36:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.487+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd83c0a4630 con 0x7fd83c0a9290 2023-12-24T18:36:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd822ffd700 1 -- 172.21.15.50:0/533197180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd83004d430 con 0x7fd83c0a9290 2023-12-24T18:36:53.492 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 msgr2=0x7fd828062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 0x7fd828062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06c820 tx=0x7fd82c017000 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 msgr2=0x7fd83c0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d890 tx=0x7fd830008040 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 shutdown_connections 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c158db0 0x7fd83c0a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0a9290 0x7fd83c0ca720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 --2- 172.21.15.50:0/533197180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06a700 0x7fd83c0a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 >> 172.21.15.50:0/533197180 conn(0x7fd83c067b80 msgr2=0x7fd83c06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 shutdown_connections 2023-12-24T18:36:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.491+0000 7fd84166e700 1 -- 172.21.15.50:0/533197180 wait complete. 2023-12-24T18:36:53.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:36:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.699+0000 7feb18af0700 1 Processor -- start 2023-12-24T18:36:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.699+0000 7feb18af0700 1 -- start start 2023-12-24T18:36:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb18af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feb1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb18af0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140cd680 con 0x7feb1406ae10 2023-12-24T18:36:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb18af0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140cca70 con 0x7feb140cf8a0 2023-12-24T18:36:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb18af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb14159640 con 0x7feb140cf4d0 2023-12-24T18:36:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb12d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb1406ae10 0x7feb140cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57250/0 (socket says 172.21.15.50:57250) 2023-12-24T18:36:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb12d9d700 1 -- 172.21.15.50:0/1850934979 learned_addr learned my addr 172.21.15.50:0/1850934979 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb11d9b700 1 --1- 172.21.15.50:0/1850934979 >> v1:172.21.15.82:6789/0 conn(0x7feb140cf8a0 0x7feb1406a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34210/0 (socket says 172.21.15.50:34210) 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1259c700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feb1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852816398 0 0) 0x7feb140cd680 con 0x7feb1406ae10 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feafc003570 con 0x7feb1406ae10 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993943294 0 0) 0x7feafc003570 con 0x7feb1406ae10 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 msgr2=0x7feb1406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feb1406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 >> v1:172.21.15.82:6789/0 conn(0x7feb140cf8a0 legacy=0x7feb1406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140ccd50 con 0x7feb1406ae10 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7feb0c0017f0 con 0x7feb1406ae10 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.703+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 >> v1:172.21.15.50:6789/0 conn(0x7feb1406ae10 legacy=0x7feb140cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feafc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feafc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc004d50 0x7feafc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14159640 con 0x7feafc003a90 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc00bb10 con 0x7feafc004d50 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc00bcd0 con 0x7feb140cf4d0 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feafc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb11d9b700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feafc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb12d9d700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc004d50 0x7feafc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 -- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 msgr2=0x7feafc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb140cf4d0 0x7feafc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 -- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc004d50 msgr2=0x7feafc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc004d50 0x7feafc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 -- 172.21.15.50:0/1850934979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc003570 con 0x7feafc003a90 2023-12-24T18:36:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb12d9d700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc004d50 0x7feafc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1259c700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feafc003e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb04009c00 tx=0x7feb040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6891c7add3533428 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400e710 con 0x7feafc003a90 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400e870 con 0x7feafc003a90 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb1159a700 1 -- 172.21.15.50:0/1850934979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ec30 con 0x7feafc003a90 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb18af0700 1 -- 172.21.15.50:0/1850934979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 msgr2=0x7feafc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb18af0700 1 --2- 172.21.15.50:0/1850934979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feafc003e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb04009c00 tx=0x7feb040091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.707+0000 7feb12d9d700 1 -- 172.21.15.50:0/1850934979 reap_dead start 2023-12-24T18:36:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 -- 172.21.15.50:0/1850934979 shutdown_connections 2023-12-24T18:36:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 -- 172.21.15.50:0/1850934979 >> 172.21.15.50:0/1850934979 conn(0x7feb14067b30 msgr2=0x7feb140cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 -- 172.21.15.50:0/1850934979 shutdown_connections 2023-12-24T18:36:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 -- 172.21.15.50:0/1850934979 wait complete. 2023-12-24T18:36:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 Processor -- start 2023-12-24T18:36:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.711+0000 7feb18af0700 1 -- start start 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb140cc440 0x7feb1415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb1415d8f0 0x7feb1415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1416a870 con 0x7feafc003a90 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb141533f0 con 0x7feb140cc440 2023-12-24T18:36:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb141536d0 con 0x7feb1415d8f0 2023-12-24T18:36:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49216/0 (socket says 172.21.15.50:49216) 2023-12-24T18:36:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 -- 172.21.15.50:0/3560831590 learned_addr learned my addr 172.21.15.50:0/3560831590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb11d9b700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb140cc440 0x7feb1415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb12d9d700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb1415d8f0 0x7feb1415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 -- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb1415d8f0 msgr2=0x7feb1415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb1415d8f0 0x7feb1415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 -- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb140cc440 msgr2=0x7feb1415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb140cc440 0x7feb1415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 -- 172.21.15.50:0/3560831590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb141539b0 con 0x7feafc003a90 2023-12-24T18:36:53.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb1259c700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e4b0 tx=0x7feb0401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04022070 con 0x7feafc003a90 2023-12-24T18:36:53.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400e9e0 con 0x7feafc003a90 2023-12-24T18:36:53.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04027470 con 0x7feafc003a90 2023-12-24T18:36:53.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb14153c90 con 0x7feafc003a90 2023-12-24T18:36:53.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.715+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1415bff0 con 0x7feafc003a90 2023-12-24T18:36:53.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.719+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb14153e20 con 0x7feafc003a90 2023-12-24T18:36:53.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.719+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7feb0401c450 con 0x7feafc003a90 2023-12-24T18:36:53.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.719+0000 7feb027fc700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 0x7feaf4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:53.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.719+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7feb0407e520 con 0x7feafc003a90 2023-12-24T18:36:53.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.719+0000 7feb11d9b700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 0x7feaf4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:53.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.723+0000 7feb11d9b700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 0x7feaf4062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb080010e0 tx=0x7feb08005840 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.727+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feb0404e780 con 0x7feafc003a90 2023-12-24T18:36:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.903+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb1416a870 con 0x7feafc003a90 2023-12-24T18:36:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.903+0000 7feb027fc700 1 -- 172.21.15.50:0/3560831590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb04051da0 con 0x7feafc003a90 2023-12-24T18:36:53.909 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:36:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 msgr2=0x7feaf4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 0x7feaf4062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb080010e0 tx=0x7feb08005840 comp rx=0 tx=0).stop 2023-12-24T18:36:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 msgr2=0x7feb1416a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e4b0 tx=0x7feb0401a000 comp rx=0 tx=0).stop 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 shutdown_connections 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7feaf4060550 0x7feaf4062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb1415d8f0 0x7feb1415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb140cc440 0x7feb1415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 --2- 172.21.15.50:0/3560831590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feafc003a90 0x7feb1416a330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 >> 172.21.15.50:0/3560831590 conn(0x7feb14067b30 msgr2=0x7feb14151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 shutdown_connections 2023-12-24T18:36:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:53.907+0000 7feb18af0700 1 -- 172.21.15.50:0/3560831590 wait complete. 2023-12-24T18:36:53.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:36:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.095+0000 7f3b2080c700 1 Processor -- start 2023-12-24T18:36:54.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.095+0000 7f3b2080c700 1 -- start start 2023-12-24T18:36:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b2080c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b1c156ab0 0x7f3b1c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b2080c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b1c0c8ee0 0x7f3b1c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b2080c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c15b5a0 con 0x7f3b1c0adb50 2023-12-24T18:36:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b2080c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c15a990 con 0x7f3b1c156ab0 2023-12-24T18:36:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b2080c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c15ac70 con 0x7f3b1c0c8ee0 2023-12-24T18:36:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3b1c0adb50 0x7f3b1c0c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57256/0 (socket says 172.21.15.50:57256) 2023-12-24T18:36:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1affd700 1 -- 172.21.15.50:0/2433959356 learned_addr learned my addr 172.21.15.50:0/2433959356 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> v2:172.21.15.50:3300/0 conn(0x7f3b1c156ab0 0x7f3b1c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1bfff700 1 --2- 172.21.15.50:0/2433959356 >> v2:172.21.15.82:3300/0 conn(0x7f3b1c0c8ee0 0x7f3b1c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967993993 0 0) 0x7f3b1c15b5a0 con 0x7f3b1c0adb50 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04003570 con 0x7f3b1c0adb50 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197553747 0 0) 0x7f3b04003570 con 0x7f3b1c0adb50 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 >> v2:172.21.15.82:3300/0 conn(0x7f3b1c0c8ee0 msgr2=0x7f3b1c0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 --2- 172.21.15.50:0/2433959356 >> v2:172.21.15.82:3300/0 conn(0x7f3b1c0c8ee0 0x7f3b1c0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 >> v2:172.21.15.50:3300/0 conn(0x7f3b1c156ab0 msgr2=0x7f3b1c156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 --2- 172.21.15.50:0/2433959356 >> v2:172.21.15.50:3300/0 conn(0x7f3b1c156ab0 0x7f3b1c156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c15af50 con 0x7f3b1c0adb50 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f3b10001470 con 0x7f3b1c0adb50 2023-12-24T18:36:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> v2:172.21.15.50:3300/0 conn(0x7f3b1c156ab0 0x7f3b1c156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 >> v1:172.21.15.50:6789/0 conn(0x7f3b1c0adb50 legacy=0x7f3b1c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 0x7f3b04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040051c0 0x7f3b0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c15a990 con 0x7f3b04003a60 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c15ac70 con 0x7f3b040051c0 2023-12-24T18:36:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0400bfd0 con 0x7f3b04004810 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 0x7f3b04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1affd700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.099+0000 7f3b1bfff700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040051c0 0x7f3b0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 -- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04004810 msgr2=0x7f3b04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 -- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040051c0 msgr2=0x7f3b0400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040051c0 0x7f3b0400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 -- 172.21.15.50:0/2433959356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04003570 con 0x7f3b04003a60 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1bfff700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040051c0 0x7f3b0400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1bfff700 1 -- 172.21.15.50:0/2433959356 reap_dead start 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 0x7f3b04003e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006f00 tx=0x7f3b0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d27541e8da3be server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c009740 con 0x7f3b04003a60 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00e8c0 con 0x7f3b04003a60 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b1a7fc700 1 -- 172.21.15.50:0/2433959356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00ec80 con 0x7f3b04003a60 2023-12-24T18:36:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 msgr2=0x7f3b04003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 0x7f3b04003e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006f00 tx=0x7f3b0c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433959356 shutdown_connections 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433959356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b04003a60 0x7f3b04003e70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433959356 >> 172.21.15.50:0/2433959356 conn(0x7f3b1c067250 msgr2=0x7f3b1c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433959356 shutdown_connections 2023-12-24T18:36:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.103+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433959356 wait complete. 2023-12-24T18:36:54.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 Processor -- start 2023-12-24T18:36:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 -- start start 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04003a60 0x7f3b1c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 0x7f3b1c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c153590 con 0x7f3b1c0ca560 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0caf10 con 0x7f3b1c0afbb0 2023-12-24T18:36:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b2080c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c157d40 con 0x7f3b04003a60 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49254/0 (socket says 172.21.15.50:49254) 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 -- 172.21.15.50:0/2433484703 learned_addr learned my addr 172.21.15.50:0/2433484703 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1bfff700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 0x7f3b1c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04003a60 0x7f3b1c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 -- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04003a60 msgr2=0x7f3b1c153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04003a60 0x7f3b1c153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 -- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 msgr2=0x7f3b1c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 0x7f3b1c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 -- 172.21.15.50:0/2433484703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0b0560 con 0x7f3b1c0ca560 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1bfff700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 0x7f3b1c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.107+0000 7f3b1affd700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b100073f0 tx=0x7f3b10001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000f940 con 0x7f3b1c0ca560 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1000fae0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0b0810 con 0x7f3b1c0ca560 2023-12-24T18:36:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000fea0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c0b0dd0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c0b15d0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.111+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3b100135c0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.115+0000 7f3b037fe700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 0x7f3b08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.115+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f3b1007c5b0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.115+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 0x7f3b08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.115+0000 7f3b1b7fe700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 0x7f3b08062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0091e0 tx=0x7f3b0c01a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.119+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3b1c0b15d0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.291+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b1c04be40 con 0x7f3b1c0ca560 2023-12-24T18:36:54.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.291+0000 7f3b037fe700 1 -- 172.21.15.50:0/2433484703 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b100502a0 con 0x7f3b1c0ca560 2023-12-24T18:36:54.294 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 msgr2=0x7f3b08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 0x7f3b08062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0091e0 tx=0x7f3b0c01a000 comp rx=0 tx=0).stop 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 msgr2=0x7f3b1c0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b100073f0 tx=0x7f3b10001e90 comp rx=0 tx=0).stop 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 shutdown_connections 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3b08060550 0x7f3b08062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c0afbb0 0x7f3b1c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0ca560 0x7f3b1c0ca9d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 --2- 172.21.15.50:0/2433484703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b04003a60 0x7f3b1c153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 >> 172.21.15.50:0/2433484703 conn(0x7f3b1c067250 msgr2=0x7f3b1c0c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 shutdown_connections 2023-12-24T18:36:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.295+0000 7f3b2080c700 1 -- 172.21.15.50:0/2433484703 wait complete. 2023-12-24T18:36:54.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:36:54.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 Processor -- start 2023-12-24T18:36:54.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 -- start start 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e006ae10 0x7f41e01683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015e960 con 0x7f41e0160af0 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015fe00 con 0x7f41e0160720 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e6478700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e01600a0 con 0x7f41e006ae10 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e4a15700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e006ae10 0x7f41e01683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41df7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41e0160af0 0x7f41e006a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57260/0 (socket says 172.21.15.50:57260) 2023-12-24T18:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41e4a15700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e006ae10 0x7f41e01683a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49266/0 (socket says 172.21.15.50:49266) 2023-12-24T18:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.499+0000 7f41df7fe700 1 -- 172.21.15.50:0/1243110620 learned_addr learned my addr 172.21.15.50:0/1243110620 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e4a15700 1 -- 172.21.15.50:0/1243110620 >> v1:172.21.15.82:6789/0 conn(0x7f41e0160720 legacy=0x7f41e006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e4a15700 1 -- 172.21.15.50:0/1243110620 >> v1:172.21.15.50:6789/0 conn(0x7f41e0160af0 legacy=0x7f41e006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41deffd700 1 -- 172.21.15.50:0/1243110620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407207608 0 0) 0x7f41e015e960 con 0x7f41e0160af0 2023-12-24T18:36:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e4a15700 1 -- 172.21.15.50:0/1243110620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e015dd50 con 0x7f41e006ae10 2023-12-24T18:36:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e4a15700 1 --2- 172.21.15.50:0/1243110620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e01683a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009e60 tx=0x7f41d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03d26ee7c9cb288 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41deffd700 1 -- 172.21.15.50:0/1243110620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e070 con 0x7f41e006ae10 2023-12-24T18:36:54.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41deffd700 1 -- 172.21.15.50:0/1243110620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800bc30 con 0x7f41e006ae10 2023-12-24T18:36:54.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41deffd700 1 -- 172.21.15.50:0/1243110620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8012430 con 0x7f41e006ae10 2023-12-24T18:36:54.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 -- 172.21.15.50:0/1243110620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 msgr2=0x7f41e01683a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 --2- 172.21.15.50:0/1243110620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e01683a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009e60 tx=0x7f41d8009780 comp rx=0 tx=0).stop 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 -- 172.21.15.50:0/1243110620 shutdown_connections 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 --2- 172.21.15.50:0/1243110620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e01683a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 -- 172.21.15.50:0/1243110620 >> 172.21.15.50:0/1243110620 conn(0x7f41e0067b80 msgr2=0x7f41e00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 -- 172.21.15.50:0/1243110620 shutdown_connections 2023-12-24T18:36:54.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.503+0000 7f41e6478700 1 -- 172.21.15.50:0/1243110620 wait complete. 2023-12-24T18:36:54.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.507+0000 7f41e6478700 1 Processor -- start 2023-12-24T18:36:54.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- start start 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41e0160720 0x7f41e00a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e0160af0 0x7f41e00c0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0148b20 con 0x7f41e006ae10 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00a8e70 con 0x7f41e0160af0 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00a8260 con 0x7f41e0160720 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49278/0 (socket says 172.21.15.50:49278) 2023-12-24T18:36:54.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 -- 172.21.15.50:0/3707197439 learned_addr learned my addr 172.21.15.50:0/3707197439 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41df7fe700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41e0160720 0x7f41e00a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e4a15700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e0160af0 0x7f41e00c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 -- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41e0160720 msgr2=0x7f41e00a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41e0160720 0x7f41e00a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 -- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e0160af0 msgr2=0x7f41e00c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e0160af0 0x7f41e00c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 -- 172.21.15.50:0/3707197439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009a20 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41dffff700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c4e0 tx=0x7f41d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0011590 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0011710 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00a8540 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0011ad0 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.511+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00a8b00 con 0x7f41e006ae10 2023-12-24T18:36:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.515+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e00652e0 con 0x7f41e006ae10 2023-12-24T18:36:54.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.515+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f41d001b3b0 con 0x7f41e006ae10 2023-12-24T18:36:54.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.519+0000 7f41c7fff700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 0x7f41cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.519+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f41d007c060 con 0x7f41e006ae10 2023-12-24T18:36:54.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.519+0000 7f41df7fe700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 0x7f41cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.519+0000 7f41df7fe700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 0x7f41cc062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41e00aeec0 tx=0x7f41d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.523+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41d004c2c0 con 0x7f41e006ae10 2023-12-24T18:36:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.695+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41e006dd10 con 0x7f41e006ae10 2023-12-24T18:36:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.699+0000 7f41c7fff700 1 -- 172.21.15.50:0/3707197439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41d00170a0 con 0x7f41e006ae10 2023-12-24T18:36:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:36:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 msgr2=0x7f41cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 0x7f41cc062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41e00aeec0 tx=0x7f41d4009040 comp rx=0 tx=0).stop 2023-12-24T18:36:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 msgr2=0x7f41e0170440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c4e0 tx=0x7f41d000c8a0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 shutdown_connections 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f41cc060550 0x7f41cc062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e0160af0 0x7f41e00c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41e0160720 0x7f41e00a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 --2- 172.21.15.50:0/3707197439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006ae10 0x7f41e0170440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 >> 172.21.15.50:0/3707197439 conn(0x7f41e0067b80 msgr2=0x7f41e015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 shutdown_connections 2023-12-24T18:36:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.703+0000 7f41e6478700 1 -- 172.21.15.50:0/3707197439 wait complete. 2023-12-24T18:36:54.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.883+0000 7fe3362a5700 1 Processor -- start 2023-12-24T18:36:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 -- start start 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe33006ae10 0x7fe33015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe33006b260 0x7fe33015af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300c6980 con 0x7fe33006b260 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33006ca50 con 0x7fe33006ae10 2023-12-24T18:36:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe3362a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33006b7f0 con 0x7fe3300ca3a0 2023-12-24T18:36:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe334842700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe33006b260 0x7fe33015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:47946/0 (socket says 172.21.15.50:47946) 2023-12-24T18:36:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 -- 172.21.15.50:0/2365217616 learned_addr learned my addr 172.21.15.50:0/2365217616 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32f7fe700 1 --2- 172.21.15.50:0/2365217616 >> v2:172.21.15.82:3300/0 conn(0x7fe33006ae10 0x7fe33015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 -- 172.21.15.50:0/2365217616 >> v2:172.21.15.82:3300/0 conn(0x7fe33006ae10 msgr2=0x7fe33015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2365217616 >> v2:172.21.15.82:3300/0 conn(0x7fe33006ae10 0x7fe33015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 -- 172.21.15.50:0/2365217616 >> v2:172.21.15.50:3300/0 conn(0x7fe33006b260 msgr2=0x7fe33015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2365217616 >> v2:172.21.15.50:3300/0 conn(0x7fe33006b260 0x7fe33015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.887+0000 7fe32ffff700 1 -- 172.21.15.50:0/2365217616 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33006bad0 con 0x7fe3300ca3a0 2023-12-24T18:36:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2365217616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe330069bf0 tx=0x7fe320009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455363b9b6240dd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe32effd700 1 -- 172.21.15.50:0/2365217616 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000b640 con 0x7fe3300ca3a0 2023-12-24T18:36:54.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe32effd700 1 -- 172.21.15.50:0/2365217616 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000b7a0 con 0x7fe3300ca3a0 2023-12-24T18:36:54.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe32effd700 1 -- 172.21.15.50:0/2365217616 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000bb40 con 0x7fe3300ca3a0 2023-12-24T18:36:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 -- 172.21.15.50:0/2365217616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 msgr2=0x7fe3300ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2365217616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe330069bf0 tx=0x7fe320009250 comp rx=0 tx=0).stop 2023-12-24T18:36:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 -- 172.21.15.50:0/2365217616 shutdown_connections 2023-12-24T18:36:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2365217616 >> v2:172.21.15.82:3300/0 conn(0x7fe33006ae10 0x7fe33015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2365217616 >> v2:172.21.15.50:3300/0 conn(0x7fe33006b260 0x7fe33015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2365217616 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe3300ca770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 -- 172.21.15.50:0/2365217616 >> 172.21.15.50:0/2365217616 conn(0x7fe3300cbba0 msgr2=0x7fe3300cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 -- 172.21.15.50:0/2365217616 shutdown_connections 2023-12-24T18:36:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.891+0000 7fe3362a5700 1 -- 172.21.15.50:0/2365217616 wait complete. 2023-12-24T18:36:54.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 Processor -- start 2023-12-24T18:36:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 -- start start 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe33006ae10 0x7fe330146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe33015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300c5340 con 0x7fe33006b260 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300c5620 con 0x7fe33006ae10 2023-12-24T18:36:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe3362a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300c5900 con 0x7fe3300ca3a0 2023-12-24T18:36:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49294/0 (socket says 172.21.15.50:49294) 2023-12-24T18:36:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 -- 172.21.15.50:0/2621162429 learned_addr learned my addr 172.21.15.50:0/2621162429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe33006ae10 0x7fe330146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe334842700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe33015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 -- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 msgr2=0x7fe33015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe33015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 -- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe33006ae10 msgr2=0x7fe330146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe33006ae10 0x7fe330146750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe32f7fe700 1 -- 172.21.15.50:0/2621162429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200094f0 con 0x7fe33006b260 2023-12-24T18:36:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.895+0000 7fe334842700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe33015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe32f7fe700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e930 tx=0x7fe3240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324013680 con 0x7fe33006b260 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240137e0 con 0x7fe33006b260 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3300c5be0 con 0x7fe33006b260 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324013b80 con 0x7fe33006b260 2023-12-24T18:36:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe330146c90 con 0x7fe33006b260 2023-12-24T18:36:54.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.899+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3300652e0 con 0x7fe33006b260 2023-12-24T18:36:54.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.903+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe32400c460 con 0x7fe33006b260 2023-12-24T18:36:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.903+0000 7fe317fff700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 0x7fe31c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.903+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fe32407cc90 con 0x7fe33006b260 2023-12-24T18:36:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.903+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 0x7fe31c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.903+0000 7fe32ffff700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 0x7fe31c062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe330069bf0 tx=0x7fe320017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:54.907+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe32404cef0 con 0x7fe33006b260 2023-12-24T18:36:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.111+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe33006aa20 con 0x7fe33006b260 2023-12-24T18:36:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe317fff700 1 -- 172.21.15.50:0/2621162429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7fe324050510 con 0x7fe33006b260 2023-12-24T18:36:55.116 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:55.116 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:36:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 msgr2=0x7fe31c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 0x7fe31c062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe330069bf0 tx=0x7fe320017000 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 msgr2=0x7fe3300c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e930 tx=0x7fe3240091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 shutdown_connections 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe31c060550 0x7fe31c062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3300ca3a0 0x7fe33015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33006b260 0x7fe3300c48a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 --2- 172.21.15.50:0/2621162429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe33006ae10 0x7fe330146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 >> 172.21.15.50:0/2621162429 conn(0x7fe3300cbba0 msgr2=0x7fe33015c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 shutdown_connections 2023-12-24T18:36:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.115+0000 7fe3362a5700 1 -- 172.21.15.50:0/2621162429 wait complete. 2023-12-24T18:36:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:36:55.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:36:55.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.299+0000 7f9b1ce8e700 1 Processor -- start 2023-12-24T18:36:55.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.299+0000 7f9b1ce8e700 1 -- start start 2023-12-24T18:36:55.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b1ce8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b1806b6b0 0x7f9b180ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b1ce8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18155b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b1ce8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1806e110 con 0x7f9b180ad220 2023-12-24T18:36:55.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b1ce8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1806bb40 con 0x7f9b1806b6b0 2023-12-24T18:36:55.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b1ce8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1806be20 con 0x7f9b18155710 2023-12-24T18:36:55.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b1806b6b0 0x7f9b180ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b1806b6b0 0x7f9b180ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49300/0 (socket says 172.21.15.50:49300) 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 -- 172.21.15.50:0/679465351 learned_addr learned my addr 172.21.15.50:0/679465351 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b17fff700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 -- 172.21.15.50:0/679465351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 msgr2=0x7f9b18155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 -- 172.21.15.50:0/679465351 >> v1:172.21.15.82:6789/0 conn(0x7f9b180ad220 legacy=0x7f9b1806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.303+0000 7f9b0effd700 1 -- 172.21.15.50:0/679465351 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180af740 con 0x7f9b1806b6b0 2023-12-24T18:36:55.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b0effd700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b180ad5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b000099b0 tx=0x7f9b00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284d9791dafdf132 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b16ffd700 1 -- 172.21.15.50:0/679465351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00009ea0 con 0x7f9b1806b6b0 2023-12-24T18:36:55.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b16ffd700 1 -- 172.21.15.50:0/679465351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000b860 con 0x7f9b1806b6b0 2023-12-24T18:36:55.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b16ffd700 1 -- 172.21.15.50:0/679465351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000bc00 con 0x7f9b1806b6b0 2023-12-24T18:36:55.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/679465351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 msgr2=0x7f9b180ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b180ad5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b000099b0 tx=0x7f9b00009250 comp rx=0 tx=0).stop 2023-12-24T18:36:55.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/679465351 shutdown_connections 2023-12-24T18:36:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/679465351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b180ad5f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/679465351 >> 172.21.15.50:0/679465351 conn(0x7f9b18067b80 msgr2=0x7f9b180cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/679465351 shutdown_connections 2023-12-24T18:36:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/679465351 wait complete. 2023-12-24T18:36:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.307+0000 7f9b1ce8e700 1 Processor -- start 2023-12-24T18:36:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- start start 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b180ad220 0x7f9b18158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1814ff30 con 0x7f9b1806b6b0 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18156360 con 0x7f9b180ad220 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18156640 con 0x7f9b18155710 2023-12-24T18:36:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49306/0 (socket says 172.21.15.50:49306) 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 -- 172.21.15.50:0/2423728450 learned_addr learned my addr 172.21.15.50:0/2423728450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b0effd700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b180ad220 0x7f9b18158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b17fff700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 -- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 msgr2=0x7f9b18153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 -- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b180ad220 msgr2=0x7f9b18158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b180ad220 0x7f9b18158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 -- 172.21.15.50:0/2423728450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000094f0 con 0x7f9b1806b6b0 2023-12-24T18:36:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b177fe700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c590 tx=0x7f9b0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08011590 con 0x7f9b1806b6b0 2023-12-24T18:36:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08011710 con 0x7f9b1806b6b0 2023-12-24T18:36:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08011ad0 con 0x7f9b1806b6b0 2023-12-24T18:36:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18156920 con 0x7f9b1806b6b0 2023-12-24T18:36:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.311+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1814e6f0 con 0x7f9b1806b6b0 2023-12-24T18:36:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.315+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18156e20 con 0x7f9b1806b6b0 2023-12-24T18:36:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.315+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9b0801b3b0 con 0x7f9b1806b6b0 2023-12-24T18:36:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.315+0000 7f9b0ffff700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 0x7f9af8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.315+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f9b0807bf00 con 0x7f9b1806b6b0 2023-12-24T18:36:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.319+0000 7f9b0effd700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 0x7f9af8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.319+0000 7f9b0effd700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 0x7f9af8062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b000099b0 tx=0x7f9b00019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.323+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9b0804c200 con 0x7f9b1806b6b0 2023-12-24T18:36:55.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:36:55.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:36:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.499+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b1804be40 con 0x7f9b1806b6b0 2023-12-24T18:36:55.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.499+0000 7f9b0ffff700 1 -- 172.21.15.50:0/2423728450 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f9b0804f820 con 0x7f9b1806b6b0 2023-12-24T18:36:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:55.504 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 msgr2=0x7f9af8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 0x7f9af8062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b000099b0 tx=0x7f9b00019000 comp rx=0 tx=0).stop 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 msgr2=0x7f9b1814f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c590 tx=0x7f9b0800c8a0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 shutdown_connections 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9af8060550 0x7f9af8062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b18155710 0x7f9b18153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b180ad220 0x7f9b18158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 --2- 172.21.15.50:0/2423728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b1806b6b0 0x7f9b1814f920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 >> 172.21.15.50:0/2423728450 conn(0x7f9b18067b80 msgr2=0x7f9b180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:55.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 shutdown_connections 2023-12-24T18:36:55.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.503+0000 7f9b1ce8e700 1 -- 172.21.15.50:0/2423728450 wait complete. 2023-12-24T18:36:55.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:36:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.699+0000 7f17d9745700 1 Processor -- start 2023-12-24T18:36:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.699+0000 7f17d9745700 1 -- start start 2023-12-24T18:36:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d9745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 0x7f17d406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d9745700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40c8310 con 0x7f17d406d710 2023-12-24T18:36:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d9745700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d406dba0 con 0x7f17d4153660 2023-12-24T18:36:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d9745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c79e0 con 0x7f17d4153a30 2023-12-24T18:36:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17d406d710 0x7f17d415cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57272/0 (socket says 172.21.15.50:57272) 2023-12-24T18:36:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d3fff700 1 -- 172.21.15.50:0/3928582226 learned_addr learned my addr 172.21.15.50:0/3928582226 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d27fc700 1 --2- 172.21.15.50:0/3928582226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 0x7f17d406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868095051 0 0) 0x7f17d40c8310 con 0x7f17d406d710 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc003570 con 0x7f17d406d710 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347147616 0 0) 0x7f17d406dba0 con 0x7f17d4153660 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d40c8310 con 0x7f17d4153660 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d27fc700 1 -- 172.21.15.50:0/3928582226 >> v1:172.21.15.82:6789/0 conn(0x7f17d4153660 legacy=0x7f17d40c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d27fc700 1 -- 172.21.15.50:0/3928582226 >> v1:172.21.15.50:6789/0 conn(0x7f17d406d710 legacy=0x7f17d415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d27fc700 1 -- 172.21.15.50:0/3928582226 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40c7cc0 con 0x7f17d4153a30 2023-12-24T18:36:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d27fc700 1 --2- 172.21.15.50:0/3928582226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 0x7f17d406d1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009910 tx=0x7f17c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2884c3ada6830583 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011630 con 0x7f17d4153a30 2023-12-24T18:36:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8011790 con 0x7f17d4153a30 2023-12-24T18:36:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.703+0000 7f17d1ffb700 1 -- 172.21.15.50:0/3928582226 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011b30 con 0x7f17d4153a30 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- 172.21.15.50:0/3928582226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 msgr2=0x7f17d406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 --2- 172.21.15.50:0/3928582226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 0x7f17d406d1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009910 tx=0x7f17c80091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- 172.21.15.50:0/3928582226 shutdown_connections 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 --2- 172.21.15.50:0/3928582226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153a30 0x7f17d406d1d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- 172.21.15.50:0/3928582226 >> 172.21.15.50:0/3928582226 conn(0x7f17d40c9da0 msgr2=0x7f17d40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- 172.21.15.50:0/3928582226 shutdown_connections 2023-12-24T18:36:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- 172.21.15.50:0/3928582226 wait complete. 2023-12-24T18:36:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 Processor -- start 2023-12-24T18:36:55.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.707+0000 7f17d9745700 1 -- start start 2023-12-24T18:36:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 0x7f17d4143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 0x7f17d40c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c5660 con 0x7f17d4153a30 2023-12-24T18:36:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4143ed0 con 0x7f17d406d710 2023-12-24T18:36:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c5c00 con 0x7f17d4153660 2023-12-24T18:36:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49320/0 (socket says 172.21.15.50:49320) 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 -- 172.21.15.50:0/3088535954 learned_addr learned my addr 172.21.15.50:0/3088535954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d27fc700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 0x7f17d40c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d2ffd700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 0x7f17d4143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 -- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 msgr2=0x7f17d40c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 0x7f17d40c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 -- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 msgr2=0x7f17d4143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 0x7f17d4143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 -- 172.21.15.50:0/3088535954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8009420 con 0x7f17d4153a30 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d27fc700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 0x7f17d40c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d2ffd700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 0x7f17d4143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d3fff700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17cc002250 tx=0x7f17cc0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00a780 con 0x7f17d4153a30 2023-12-24T18:36:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00a8e0 con 0x7f17d4153a30 2023-12-24T18:36:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00aca0 con 0x7f17d4153a30 2023-12-24T18:36:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d40c26b0 con 0x7f17d4153a30 2023-12-24T18:36:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.711+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40c23d0 con 0x7f17d4153a30 2023-12-24T18:36:55.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.715+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d40c5d70 con 0x7f17d4153a30 2023-12-24T18:36:55.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.715+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f17cc007300 con 0x7f17d4153a30 2023-12-24T18:36:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.719+0000 7f17baffd700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.719+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f17cc07cd00 con 0x7f17d4153a30 2023-12-24T18:36:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.719+0000 7f17d2ffd700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.719+0000 7f17d2ffd700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 0x7f17c0062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17c4007fd0 tx=0x7f17c4007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.723+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f17cc04cfe0 con 0x7f17d4153a30 2023-12-24T18:36:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.930+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17d40652e0 con 0x7f17d4153a30 2023-12-24T18:36:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17baffd700 1 -- 172.21.15.50:0/3088535954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f17cc050600 con 0x7f17d4153a30 2023-12-24T18:36:55.936 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:36:55.936 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 msgr2=0x7f17c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 0x7f17c0062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17c4007fd0 tx=0x7f17c4007d50 comp rx=0 tx=0).stop 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 msgr2=0x7f17d40b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17cc002250 tx=0x7f17cc0019c0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 shutdown_connections 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17d4153a30 0x7f17d40b2360 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17d4153660 0x7f17d40c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 --2- 172.21.15.50:0/3088535954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d406d710 0x7f17d4143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 >> 172.21.15.50:0/3088535954 conn(0x7f17d40c9da0 msgr2=0x7f17d4067940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 shutdown_connections 2023-12-24T18:36:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:55.934+0000 7f17d9745700 1 -- 172.21.15.50:0/3088535954 wait complete. 2023-12-24T18:36:55.941 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:36:56.366 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:36:27.528972+0000', 'modified': '2023-12-24T18:36:43.291982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6834/2517814635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 2517814635}, {'type': 'v1', 'addr': '172.21.15.82:6834', 'nonce': 2517814635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:36:56.366 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:36:56.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-24T18:36:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.542+0000 7f446b0cd700 1 Processor -- start 2023-12-24T18:36:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.542+0000 7f446b0cd700 1 -- start start 2023-12-24T18:36:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446b0cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446b0cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446406ba80 con 0x7f4464159a20 2023-12-24T18:36:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446b0cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446406bd60 con 0x7f446406ae30 2023-12-24T18:36:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446b0cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446415a5d0 con 0x7f44640ce750 2023-12-24T18:36:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446966a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4464159a20 0x7f4464159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57288/0 (socket says 172.21.15.50:57288) 2023-12-24T18:36:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f446966a700 1 -- 172.21.15.50:0/1635486704 learned_addr learned my addr 172.21.15.50:0/1635486704 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f4468e69700 1 --2- 172.21.15.50:0/1635486704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708526551 0 0) 0x7f446406ba80 con 0x7f4464159a20 2023-12-24T18:36:56.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454003570 con 0x7f4464159a20 2023-12-24T18:36:56.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856674496 0 0) 0x7f446406bd60 con 0x7f446406ae30 2023-12-24T18:36:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446406ba80 con 0x7f446406ae30 2023-12-24T18:36:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f4468e69700 1 -- 172.21.15.50:0/1635486704 >> v1:172.21.15.82:6789/0 conn(0x7f446406ae30 legacy=0x7f446406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f4468e69700 1 -- 172.21.15.50:0/1635486704 >> v1:172.21.15.50:6789/0 conn(0x7f4464159a20 legacy=0x7f4464159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f4468e69700 1 -- 172.21.15.50:0/1635486704 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446406c040 con 0x7f44640ce750 2023-12-24T18:36:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.546+0000 7f4468e69700 1 --2- 172.21.15.50:0/1635486704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640ceb20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4458009910 tx=0x7f44580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e98889585fdb567 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458011630 con 0x7f44640ce750 2023-12-24T18:36:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458011790 con 0x7f44640ce750 2023-12-24T18:36:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f44637fe700 1 -- 172.21.15.50:0/1635486704 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458011b30 con 0x7f44640ce750 2023-12-24T18:36:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 -- 172.21.15.50:0/1635486704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 msgr2=0x7f44640ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 --2- 172.21.15.50:0/1635486704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640ceb20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4458009910 tx=0x7f44580091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 -- 172.21.15.50:0/1635486704 shutdown_connections 2023-12-24T18:36:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 --2- 172.21.15.50:0/1635486704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640ceb20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 -- 172.21.15.50:0/1635486704 >> 172.21.15.50:0/1635486704 conn(0x7f44640cffb0 msgr2=0x7f44640d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 -- 172.21.15.50:0/1635486704 shutdown_connections 2023-12-24T18:36:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 -- 172.21.15.50:0/1635486704 wait complete. 2023-12-24T18:36:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.550+0000 7f446b0cd700 1 Processor -- start 2023-12-24T18:36:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- start start 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 0x7f4464146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641559e0 con 0x7f4464159a20 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464147140 con 0x7f446406ae30 2023-12-24T18:36:56.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c9a00 con 0x7f44640ce750 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49322/0 (socket says 172.21.15.50:49322) 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 -- 172.21.15.50:0/3553649450 learned_addr learned my addr 172.21.15.50:0/3553649450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4468e69700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 0x7f4464146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4463fff700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 -- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 msgr2=0x7f44640c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 -- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 msgr2=0x7f4464146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 0x7f4464146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 -- 172.21.15.50:0/3553649450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009420 con 0x7f4464159a20 2023-12-24T18:36:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4468e69700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 0x7f4464146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446966a700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f445c00cc40 tx=0x7f445c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4460ff9700 1 -- 172.21.15.50:0/3553649450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00a960 con 0x7f4464159a20 2023-12-24T18:36:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4460ff9700 1 -- 172.21.15.50:0/3553649450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00aae0 con 0x7f4464159a20 2023-12-24T18:36:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44641550b0 con 0x7f4464159a20 2023-12-24T18:36:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f4460ff9700 1 -- 172.21.15.50:0/3553649450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00aea0 con 0x7f4464159a20 2023-12-24T18:36:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.554+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4464155670 con 0x7f4464159a20 2023-12-24T18:36:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.558+0000 7f4460ff9700 1 -- 172.21.15.50:0/3553649450 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f445c007300 con 0x7f4464159a20 2023-12-24T18:36:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.558+0000 7f4460ff9700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 0x7f4448062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.562+0000 7f4460ff9700 1 -- 172.21.15.50:0/3553649450 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f445c07cf50 con 0x7f4464159a20 2023-12-24T18:36:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.562+0000 7f4468e69700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 0x7f4448062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.562+0000 7f4468e69700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 0x7f4448062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4458009860 tx=0x7f4458017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.562+0000 7f446d398740 1 Processor -- start 2023-12-24T18:36:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.562+0000 7f446d398740 1 -- start start 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xfce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd93790 0xfcf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xef3f30 con 0xd48710 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xeefed0 con 0xd48ae0 2023-12-24T18:36:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xeb60b0 con 0xd93790 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49330/0 (socket says 172.21.15.50:49330) 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 -- 172.21.15.50:0/3023671211 learned_addr learned my addr 172.21.15.50:0/3023671211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446966a700 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd93790 0xfcf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4468e69700 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xfce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 -- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd93790 msgr2=0xfcf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd93790 0xfcf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 -- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 msgr2=0xfce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xfce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 -- 172.21.15.50:0/3023671211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd949e0 con 0xd48710 2023-12-24T18:36:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f4463fff700 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4450001200 tx=0x7f4450009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925546d66fe89f26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f444dffb700 1 -- 172.21.15.50:0/3023671211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450012590 con 0xd48710 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f444dffb700 1 -- 172.21.15.50:0/3023671211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500126f0 con 0xd48710 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f444dffb700 1 -- 172.21.15.50:0/3023671211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450012ab0 con 0xd48710 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- 172.21.15.50:0/3023671211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 msgr2=0xfcec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4450001200 tx=0x7f4450009040 comp rx=0 tx=0).stop 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- 172.21.15.50:0/3023671211 shutdown_connections 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd93790 0xfcf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0xfcec90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 --2- 172.21.15.50:0/3023671211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xfce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- 172.21.15.50:0/3023671211 >> 172.21.15.50:0/3023671211 conn(0xd48eb0 msgr2=0xf82930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- 172.21.15.50:0/3023671211 shutdown_connections 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.566+0000 7f446d398740 1 -- 172.21.15.50:0/3023671211 wait complete. 2023-12-24T18:36:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 -- start start 2023-12-24T18:36:56.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 Processor -- start 2023-12-24T18:36:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfaa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xf8ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xeb5d50 con 0xd93790 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xe8e970 con 0xd48ae0 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xf7e4f0 con 0xd48710 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446d398740 10 client.0 _ll_register_callbacks cb 0xf396a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446966a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446966a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49346/0 (socket says 172.21.15.50:49346) 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f446966a700 1 -- 172.21.15.50:0/2288937030 learned_addr learned my addr 172.21.15.50:0/2288937030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f4468e69700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfaa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.570+0000 7f4463fff700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xf8ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 -- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 msgr2=0xfaa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfaa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 -- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 msgr2=0xf8ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xf8ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 -- 172.21.15.50:0/2288937030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445000f040 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446966a700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f445c001cf0 tx=0x7f445c056040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aff5eb2fb7b232 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c04f290 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f445c066210 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe8ecc0 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f445c0513a0 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 10 client.4728 fetch_fsmap learned FSMap version 8 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xebe370 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe8ecc0 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f445c0503e0 con 0xd93790 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 10 client.4728 fetch_fsmap finished waiting for FSMap version 8 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:36:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 20 client.4728 populate_metadata read hostname 'smithi050' 2023-12-24T18:36:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xf8e100 0xfddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 4 client.4728 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:36:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 --> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe923e0 con 0xf8e100 2023-12-24T18:36:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.574+0000 7f4468e69700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xf8e100 0xfddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f4442ffd700 10 client.4728 ms_handle_connect on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f4468e69700 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xf8e100 0xfddae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74370c8fc3944de server_cookie=7e307c32c993c96d in_seq=0 out_seq=0 2023-12-24T18:36:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f4442ffd700 1 -- 172.21.15.50:0/2288937030 <== mds.0 v2:172.21.15.82:6832/2517814635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xe923e0 con 0xf8e100 2023-12-24T18:36:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f4442ffd700 10 client.4728 handle_command_reply: tid=0 2023-12-24T18:36:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 client.4728 shutdown 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 msgr2=0xf8d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f445c001cf0 tx=0x7f445c056040 comp rx=0 tx=0).stop 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 shutdown_connections 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xf8e100 0xfddae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd93790 0xf8d370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0xf8ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 --2- 172.21.15.50:0/2288937030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfaa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 >> 172.21.15.50:0/2288937030 conn(0xd48eb0 msgr2=0xf7af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f4442ffd700 0 client.4728 ms_handle_reset on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 shutdown_connections 2023-12-24T18:36:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 1 -- 172.21.15.50:0/2288937030 wait complete. 2023-12-24T18:36:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.578+0000 7f446d398740 20 client.4728 trim_cache size 0 max 16384 2023-12-24T18:36:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.598+0000 7f446d398740 1 Processor -- start 2023-12-24T18:36:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.598+0000 7f446d398740 1 -- start start 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48eb0 0x1023ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0x1024540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xec3040 con 0xd48710 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xec4610 con 0xd48ae0 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xdc5650 con 0xd48eb0 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49354/0 (socket says 172.21.15.50:49354) 2023-12-24T18:36:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 -- 172.21.15.50:0/3189472328 learned_addr learned my addr 172.21.15.50:0/3189472328 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446966a700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0x1024540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4468e69700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48eb0 0x1023ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 -- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48eb0 msgr2=0x1023ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48eb0 0x1023ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 -- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 msgr2=0x1024540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0x1024540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 -- 172.21.15.50:0/3189472328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xea4d80 con 0xd48710 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f446966a700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0x1024540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:36:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f4463fff700 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4450003340 tx=0x7f445001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a8e08ee3bd80f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f444e7fc700 1 -- 172.21.15.50:0/3189472328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450024070 con 0xd48710 2023-12-24T18:36:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f444e7fc700 1 -- 172.21.15.50:0/3189472328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450007bb0 con 0xd48710 2023-12-24T18:36:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.602+0000 7f444e7fc700 1 -- 172.21.15.50:0/3189472328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450012a90 con 0xd48710 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- 172.21.15.50:0/3189472328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 msgr2=0x1024000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4450003340 tx=0x7f445001a000 comp rx=0 tx=0).stop 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- 172.21.15.50:0/3189472328 shutdown_connections 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48ae0 0x1024540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48710 0x1024000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 --2- 172.21.15.50:0/3189472328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48eb0 0x1023ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- 172.21.15.50:0/3189472328 >> 172.21.15.50:0/3189472328 conn(0xf7dc80 msgr2=0xf8be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- 172.21.15.50:0/3189472328 shutdown_connections 2023-12-24T18:36:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- 172.21.15.50:0/3189472328 wait complete. 2023-12-24T18:36:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 -- start start 2023-12-24T18:36:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.606+0000 7f446d398740 1 Processor -- start 2023-12-24T18:36:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48eb0 0xfcae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xeebb50 con 0xd48ae0 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xec3f40 con 0xd48eb0 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xef0770 con 0xd48710 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 10 client.0 _ll_register_callbacks cb 0xd149d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49362/0 (socket says 172.21.15.50:49362) 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 -- 172.21.15.50:0/3787660213 learned_addr learned my addr 172.21.15.50:0/3787660213 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446966a700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48eb0 0xfcae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4468e69700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 -- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 msgr2=0xfca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 -- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48eb0 msgr2=0xfcae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:56.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48eb0 0xfcae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 -- 172.21.15.50:0/3787660213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd949e0 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4463fff700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0xe9c750 tx=0x7f4450024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be35ccfc8395d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450029660 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f44500297c0 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44500126f0 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4450029b90 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 10 client.4734 fetch_fsmap learned FSMap version 8 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xe99130 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500126f0 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f4450029cf0 con 0xd48ae0 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 10 client.4734 fetch_fsmap finished waiting for FSMap version 8 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:36:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 20 client.4734 populate_metadata read hostname 'smithi050' 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xd93790 0xfcb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 4 client.4734 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.610+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 --> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] -- command(tid 0: {"prefix": "status"}) v1 -- 0xec4410 con 0xd93790 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4468e69700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xd93790 0xfcb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4468e69700 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xd93790 0xfcb7c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a375711f58d844d1 server_cookie=4252c3ab860fe50 in_seq=0 out_seq=0 2023-12-24T18:36:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4442ffd700 10 client.4734 ms_handle_connect on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4442ffd700 1 -- 172.21.15.50:0/3787660213 <== mds.0 v2:172.21.15.82:6832/2517814635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xec4410 con 0xd93790 2023-12-24T18:36:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4442ffd700 10 client.4734 handle_command_reply: tid=0 2023-12-24T18:36:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 client.4734 shutdown 2023-12-24T18:36:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 msgr2=0xfca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0xe9c750 tx=0x7f4450024000 comp rx=0 tx=0).stop 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 shutdown_connections 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:6832/2517814635,v1:172.21.15.82:6834/2517814635] conn(0xd93790 0xfcb7c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd48eb0 0xfcae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd48ae0 0xfca8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 --2- 172.21.15.50:0/3787660213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd48710 0xfca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f4442ffd700 0 client.4734 ms_handle_reset on v2:172.21.15.82:6832/2517814635 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 >> 172.21.15.50:0/3787660213 conn(0xf7dc80 msgr2=0xf8c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 shutdown_connections 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 1 -- 172.21.15.50:0/3787660213 wait complete. 2023-12-24T18:36:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.614+0000 7f446d398740 20 client.4734 trim_cache size 0 max 16384 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4288, 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 28.504203208, 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 8, 2023-12-24T18:36:56.621 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-12-24T18:36:56.622 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2023-12-24T18:36:56.622 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 34.243105577999998 2023-12-24T18:36:56.622 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 msgr2=0x7f4448062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 0x7f4448062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4458009860 tx=0x7f4458017000 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 msgr2=0x7f44640c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f445c00cc40 tx=0x7f445c001a40 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 shutdown_connections 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4448060550 0x7f4448062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4464159a20 0x7f44640c91e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44640ce750 0x7f44640c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 --2- 172.21.15.50:0/3553649450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f446406ae30 0x7f4464146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 >> 172.21.15.50:0/3553649450 conn(0x7f44640cffb0 msgr2=0x7f44641533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 shutdown_connections 2023-12-24T18:36:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:56.618+0000 7f446b0cd700 1 -- 172.21.15.50:0/3553649450 wait complete. 2023-12-24T18:36:56.646 INFO:teuthology.run_tasks:Running task kclient... 2023-12-24T18:36:56.659 INFO:tasks.kclient:Mounting kernel clients... 2023-12-24T18:36:56.659 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-24T18:36:56.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:56.659 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:36:56.677 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-24T18:36:56.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:56.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-24T18:36:56.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:56.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-24T18:36:57.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.008 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:36:57.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-24T18:36:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-12-24T18:36:57.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:36:57.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.113 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T18:36:57.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-12-24T18:36:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-12-24T18:36:57.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:36:57.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.224 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T18:36:57.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-12-24T18:36:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-12-24T18:36:57.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T18:36:57.372 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-24T18:36:57.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:36:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.538+0000 7f19e2145700 1 Processor -- start 2023-12-24T18:36:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 -- start start 2023-12-24T18:36:57.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 0x7f19dc0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19dc13f920 0x7f19dc06b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc06c090 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc06a6a0 con 0x7f19dc13f920 2023-12-24T18:36:57.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.542+0000 7f19e2145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0cb8a0 con 0x7f19dc13f550 2023-12-24T18:36:57.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19daffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19dc13f920 0x7f19dc06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 0x7f19dc0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19dbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f19dc0cb3c0 0x7f19dc06b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34268/0 (socket says 172.21.15.50:34268) 2023-12-24T18:36:57.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19dbfff700 1 -- 172.21.15.50:0/3909438441 learned_addr learned my addr 172.21.15.50:0/3909438441 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:57.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 -- 172.21.15.50:0/3909438441 >> v2:172.21.15.82:3300/0 conn(0x7f19dc13f920 msgr2=0x7f19dc06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:57.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 --2- 172.21.15.50:0/3909438441 >> v2:172.21.15.82:3300/0 conn(0x7f19dc13f920 0x7f19dc06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 -- 172.21.15.50:0/3909438441 >> v1:172.21.15.82:6789/0 conn(0x7f19dc0cb3c0 legacy=0x7f19dc06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 -- 172.21.15.50:0/3909438441 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc06a960 con 0x7f19dc13f550 2023-12-24T18:36:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19db7fe700 1 --2- 172.21.15.50:0/3909438441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 0x7f19dc0ab5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2029e8b4c022ff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19da7fc700 1 -- 172.21.15.50:0/3909438441 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00b640 con 0x7f19dc13f550 2023-12-24T18:36:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19da7fc700 1 -- 172.21.15.50:0/3909438441 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00b7a0 con 0x7f19dc13f550 2023-12-24T18:36:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19da7fc700 1 -- 172.21.15.50:0/3909438441 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00bb40 con 0x7f19dc13f550 2023-12-24T18:36:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 -- 172.21.15.50:0/3909438441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 msgr2=0x7f19dc0ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 --2- 172.21.15.50:0/3909438441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 0x7f19dc0ab5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 -- 172.21.15.50:0/3909438441 shutdown_connections 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 --2- 172.21.15.50:0/3909438441 >> v2:172.21.15.82:3300/0 conn(0x7f19dc13f920 0x7f19dc06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 --2- 172.21.15.50:0/3909438441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc13f550 0x7f19dc0ab5e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.546+0000 7f19e2145700 1 -- 172.21.15.50:0/3909438441 >> 172.21.15.50:0/3909438441 conn(0x7f19dc0cbba0 msgr2=0x7f19dc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.550+0000 7f19e2145700 1 -- 172.21.15.50:0/3909438441 shutdown_connections 2023-12-24T18:36:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.550+0000 7f19e2145700 1 -- 172.21.15.50:0/3909438441 wait complete. 2023-12-24T18:36:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.550+0000 7f19e2145700 1 Processor -- start 2023-12-24T18:36:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.550+0000 7f19e2145700 1 -- start start 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 0x7f19dc0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19dc13f920 0x7f19dc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0a9f70 con 0x7f19dc13f550 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0aa250 con 0x7f19dc13f920 2023-12-24T18:36:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0a8e10 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 0x7f19dc0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:48068/0 (socket says 172.21.15.50:48068) 2023-12-24T18:36:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 -- 172.21.15.50:0/1173894955 learned_addr learned my addr 172.21.15.50:0/1173894955 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19dbfff700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19dc13f920 0x7f19dc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 -- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19dc13f920 msgr2=0x7f19dc155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19dc13f920 0x7f19dc155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 -- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 msgr2=0x7f19dc0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 0x7f19dc0a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 -- 172.21.15.50:0/1173894955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc009420 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19daffd700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 0x7f19dc0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19db7fe700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009f80 tx=0x7f19cc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc01bc30 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc01bdb0 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc011670 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc0a90b0 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.554+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc0a9670 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.558+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc0c2320 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.558+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f19cc011a20 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.558+0000 7f19c37fe700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.562+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f19cc07e060 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.562+0000 7f19daffd700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.562+0000 7f19daffd700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 0x7f19c8062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f19dc136fc0 tx=0x7f19d00091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.566+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19cc0adbe0 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.778+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19dc0652e0 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.778+0000 7f19c37fe700 1 -- 172.21.15.50:0/1173894955 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f19dc0c2320 con 0x7f19dc0cb3c0 2023-12-24T18:36:57.815 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-24T18:36:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 msgr2=0x7f19c8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 0x7f19c8062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f19dc136fc0 tx=0x7f19d00091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 msgr2=0x7f19dc0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009f80 tx=0x7f19cc017000 comp rx=0 tx=0).stop 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 shutdown_connections 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19dc13f920 0x7f19dc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc13f550 0x7f19dc0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 --2- 172.21.15.50:0/1173894955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19dc0cb3c0 0x7f19dc0aeef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 >> 172.21.15.50:0/1173894955 conn(0x7f19dc0cbba0 msgr2=0x7f19dc0c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 shutdown_connections 2023-12-24T18:36:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:57.782+0000 7f19e2145700 1 -- 172.21.15.50:0/1173894955 wait complete. 2023-12-24T18:36:57.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T18:36:57.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:36:57.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:36:57.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.818 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42392sec preferred_lft 42392sec 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:36:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:36:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:57.842 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-24T18:36:57.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-24T18:36:57.842 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:58.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.006 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:36:58.046 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:36:58.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.050 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:36:58.115 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:36:58.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:36:58.116 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:58.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.249 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:36:58.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.268 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-24T18:36:58.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.332 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:58.332 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:58.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:36:58.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-24T18:36:58.332 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:58.451 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-24T18:36:58.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.451 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:58.451 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:58.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-24T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-24T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-24T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-24T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-24T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:58.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:58.613 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:58.613 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:58.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:36:58.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-12-24T18:36:58.613 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:58.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:36:58.683 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:36:58.702 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:36:58.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:36:58.702 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:36:58.761 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:36:58.761 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:36:58.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:36:58.890 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:36:58.890 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:36:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:36:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:36:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:36:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:36:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:36:59.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:36:59.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:36:59.064 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-24T18:36:59.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:36:59.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.274+0000 7fdfef785700 1 Processor -- start 2023-12-24T18:36:59.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 -- start start 2023-12-24T18:36:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 0x7fdfe8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe806ba80 con 0x7fdfe80ce750 2023-12-24T18:36:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe806bd60 con 0x7fdfe8159a20 2023-12-24T18:36:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfef785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe806c040 con 0x7fdfe806b540 2023-12-24T18:36:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfedd22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 0x7fdfe8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfed521700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfe80ce750 0x7fdfe806ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34280/0 (socket says 172.21.15.50:34280) 2023-12-24T18:36:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfed521700 1 -- 172.21.15.50:0/302855593 learned_addr learned my addr 172.21.15.50:0/302855593 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:36:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.278+0000 7fdfecd20700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfdffff700 1 -- 172.21.15.50:0/302855593 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229853437 0 0) 0x7fdfe806ba80 con 0x7fdfe80ce750 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfdffff700 1 -- 172.21.15.50:0/302855593 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd4003570 con 0x7fdfe80ce750 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfecd20700 1 -- 172.21.15.50:0/302855593 >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 msgr2=0x7fdfe8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfecd20700 1 --2- 172.21.15.50:0/302855593 >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 0x7fdfe8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfecd20700 1 -- 172.21.15.50:0/302855593 >> v1:172.21.15.82:6789/0 conn(0x7fdfe80ce750 legacy=0x7fdfe806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfecd20700 1 -- 172.21.15.50:0/302855593 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe806c320 con 0x7fdfe806b540 2023-12-24T18:36:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfedd22700 1 --2- 172.21.15.50:0/302855593 >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 0x7fdfe8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:36:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfecd20700 1 --2- 172.21.15.50:0/302855593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe80ceb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de02dc69a3a168dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfdffff700 1 -- 172.21.15.50:0/302855593 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8011630 con 0x7fdfe806b540 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfdffff700 1 -- 172.21.15.50:0/302855593 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8011790 con 0x7fdfe806b540 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfdffff700 1 -- 172.21.15.50:0/302855593 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8011b30 con 0x7fdfe806b540 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 -- 172.21.15.50:0/302855593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 msgr2=0x7fdfe80ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 --2- 172.21.15.50:0/302855593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe80ceb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd80091a0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 -- 172.21.15.50:0/302855593 shutdown_connections 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 --2- 172.21.15.50:0/302855593 >> v2:172.21.15.82:3300/0 conn(0x7fdfe8159a20 0x7fdfe8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 --2- 172.21.15.50:0/302855593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe80ceb20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 -- 172.21.15.50:0/302855593 >> 172.21.15.50:0/302855593 conn(0x7fdfe80cffb0 msgr2=0x7fdfe80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 -- 172.21.15.50:0/302855593 shutdown_connections 2023-12-24T18:36:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.282+0000 7fdfef785700 1 -- 172.21.15.50:0/302855593 wait complete. 2023-12-24T18:36:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 Processor -- start 2023-12-24T18:36:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 -- start start 2023-12-24T18:36:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe80ce750 0x7fdfe80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe8159a20 0x7fdfe80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8153c30 con 0x7fdfe80ce750 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe81547b0 con 0x7fdfe8159a20 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfef785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8153e80 con 0x7fdfe806b540 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfed521700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfed521700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:48100/0 (socket says 172.21.15.50:48100) 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfed521700 1 -- 172.21.15.50:0/749167580 learned_addr learned my addr 172.21.15.50:0/749167580 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:36:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfecd20700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe80ce750 0x7fdfe80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfedd22700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe8159a20 0x7fdfe80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfed521700 1 -- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe8159a20 msgr2=0x7fdfe80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.286+0000 7fdfed521700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe8159a20 0x7fdfe80c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfed521700 1 -- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe80ce750 msgr2=0x7fdfe80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfed521700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe80ce750 0x7fdfe80c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfed521700 1 -- 172.21.15.50:0/749167580 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0009a20 con 0x7fdfe806b540 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfed521700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c790 tx=0x7fdfe4007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4005b30 con 0x7fdfe806b540 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4005c90 con 0x7fdfe806b540 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8009420 con 0x7fdfe806b540 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4007320 con 0x7fdfe806b540 2023-12-24T18:36:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe8154440 con 0x7fdfe806b540 2023-12-24T18:36:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe80652e0 con 0x7fdfe806b540 2023-12-24T18:36:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.290+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdfe4007690 con 0x7fdfe806b540 2023-12-24T18:36:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.294+0000 7fdfdd7fa700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 0x7fdfcc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:36:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.294+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fdfe407bf50 con 0x7fdfe806b540 2023-12-24T18:36:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.294+0000 7fdfecd20700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 0x7fdfcc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:36:59.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.294+0000 7fdfecd20700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 0x7fdfcc062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:36:59.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.302+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdfe404c270 con 0x7fdfe806b540 2023-12-24T18:36:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.514+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfe8153fc0 con 0x7fdfe806b540 2023-12-24T18:36:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.514+0000 7fdfdd7fa700 1 -- 172.21.15.50:0/749167580 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdfe8153fc0 con 0x7fdfe806b540 2023-12-24T18:36:59.518 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 msgr2=0x7fdfcc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 0x7fdfcc062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd8017000 comp rx=0 tx=0).stop 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 msgr2=0x7fdfe8151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c790 tx=0x7fdfe4007df0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 shutdown_connections 2023-12-24T18:36:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdfcc060580 0x7fdfcc062a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe8159a20 0x7fdfe80c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe80ce750 0x7fdfe80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 --2- 172.21.15.50:0/749167580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdfe806b540 0x7fdfe8151e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 >> 172.21.15.50:0/749167580 conn(0x7fdfe80cffb0 msgr2=0x7fdfe806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 shutdown_connections 2023-12-24T18:36:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:36:59.518+0000 7fdfef785700 1 -- 172.21.15.50:0/749167580 wait complete. 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:36:59.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-24T18:36:59.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.544 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:36:59.563 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link tentative 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link tentative 2023-12-24T18:36:59.564 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:36:59.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.565 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:36:59.646 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:36:59.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.649 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:36:59.714 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:36:59.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:36:59.715 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:36:59.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.853 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:36:59.869 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:36:59.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.871 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-24T18:36:59.933 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-24T18:36:59.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:36:59.934 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:36:59.934 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:36:59.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:36:59.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-24T18:36:59.934 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:37:00.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:00.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 1a:08:7c:bf:60:b3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T18:37:00.089 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.090 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::1808:7cff:febf:60b3/64 scope link tentative 2023-12-24T18:37:00.090 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:00.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-24T18:37:00.175 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 1a:08:7c:bf:60:b3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::1808:7cff:febf:60b3/64 scope link 2023-12-24T18:37:00.176 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:00.179 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-24T18:37:00.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-24T18:37:00.180 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:37:00.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:00.371 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:37:00.371 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:37:00.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-12-24T18:37:00.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-12-24T18:37:00.371 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:37:00.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:00.442 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-24T18:37:00.465 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-24T18:37:00.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:00.466 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-24T18:37:00.527 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-24T18:37:00.527 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:37:00.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:00.665 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:00.666 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:00.691 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:00.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:00.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:37:00.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 2@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:37:00.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:37:00.697 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:37:00.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:00.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-24T18:37:00.729 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-24T18:37:00.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:37:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 Processor -- start 2023-12-24T18:37:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 -- start start 2023-12-24T18:37:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57b406dcc0 0x7f57b40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b406c820 con 0x7f57b4154b60 2023-12-24T18:37:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b406b960 con 0x7f57b40c6d00 2023-12-24T18:37:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.946+0000 7f57b9e78700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b406bc40 con 0x7f57b406dcc0 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57abfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57b4154b60 0x7f57b406aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57266/0 (socket says 172.21.15.50:57266) 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57abfff700 1 -- 172.21.15.50:0/2852264925 learned_addr learned my addr 172.21.15.50:0/2852264925 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 --2- 172.21.15.50:0/2852264925 >> v2:172.21.15.82:3300/0 conn(0x7f57b406dcc0 0x7f57b40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262969535 0 0) 0x7f57b406c820 con 0x7f57b4154b60 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a0003570 con 0x7f57b4154b60 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2174104270 0 0) 0x7f57a0003570 con 0x7f57b4154b60 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 >> v2:172.21.15.82:3300/0 conn(0x7f57b406dcc0 msgr2=0x7f57b40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 --2- 172.21.15.50:0/2852264925 >> v2:172.21.15.82:3300/0 conn(0x7f57b406dcc0 0x7f57b40c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 >> v1:172.21.15.82:6789/0 conn(0x7f57b40c6d00 legacy=0x7f57b4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b406bf20 con 0x7f57b4154b60 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f579c001470 con 0x7f57b4154b60 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 >> v1:172.21.15.50:6789/0 conn(0x7f57b4154b60 legacy=0x7f57b406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57a0003a60 0x7f57a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57a0004810 0x7f57a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b406bc40 con 0x7f57a00051c0 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a000c0d0 con 0x7f57a0003a60 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a000c290 con 0x7f57a0004810 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57abfff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57a0004810 0x7f57a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 -- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57a0004810 msgr2=0x7f57a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57a0004810 0x7f57a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b37fe700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57a0003a60 0x7f57a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 -- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57a0003a60 msgr2=0x7f57a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57a0003a60 0x7f57a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 -- 172.21.15.50:0/2852264925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0003570 con 0x7f57a00051c0 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57abfff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57a0004810 0x7f57a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b37fe700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57a0003a60 0x7f57a0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:00.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 -- 172.21.15.50:0/2852264925 reap_dead start 2023-12-24T18:37:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b3fff700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57a000ba60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e210 tx=0x7f57ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770cd7e3fc31d644 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00eac0 con 0x7f57a00051c0 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00f040 con 0x7f57a00051c0 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.950+0000 7f57b2ffd700 1 -- 172.21.15.50:0/2852264925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00ee70 con 0x7f57a00051c0 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 msgr2=0x7f57a000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57a000ba60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e210 tx=0x7f57ac00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- 172.21.15.50:0/2852264925 shutdown_connections 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 --2- 172.21.15.50:0/2852264925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57a000ba60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- 172.21.15.50:0/2852264925 >> 172.21.15.50:0/2852264925 conn(0x7f57b40cbba0 msgr2=0x7f57b40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- 172.21.15.50:0/2852264925 shutdown_connections 2023-12-24T18:37:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- 172.21.15.50:0/2852264925 wait complete. 2023-12-24T18:37:00.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 Processor -- start 2023-12-24T18:37:00.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.954+0000 7f57b9e78700 1 -- start start 2023-12-24T18:37:00.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 0x7f57b41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57b40ca420 0x7f57b41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40c3a40 con 0x7f57a00051c0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b416a560 con 0x7f57b40c9fb0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40a8c90 con 0x7f57b40ca420 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37088/0 (socket says 172.21.15.50:37088) 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 -- 172.21.15.50:0/1005815802 learned_addr learned my addr 172.21.15.50:0/1005815802 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57abfff700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 0x7f57b41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b3fff700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57b40ca420 0x7f57b41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 -- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57b40ca420 msgr2=0x7f57b41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57b40ca420 0x7f57b41528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 -- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 msgr2=0x7f57b41523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 0x7f57b41523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 -- 172.21.15.50:0/1005815802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40a8f70 con 0x7f57a00051c0 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57abfff700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 0x7f57b41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:00.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b37fe700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57a400d5e0 tx=0x7f57a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4006820 con 0x7f57a00051c0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4006980 con 0x7f57a00051c0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4006d40 con 0x7f57a00051c0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40a9250 con 0x7f57a00051c0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.958+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40a88d0 con 0x7f57a00051c0 2023-12-24T18:37:00.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.962+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40652e0 con 0x7f57a00051c0 2023-12-24T18:37:00.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.962+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f57a4007230 con 0x7f57a00051c0 2023-12-24T18:37:00.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.962+0000 7f57ab7fe700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 0x7f5794062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.962+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f57a407c7f0 con 0x7f57a00051c0 2023-12-24T18:37:00.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.966+0000 7f57abfff700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 0x7f5794062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.966+0000 7f57abfff700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 0x7f5794062a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f579c0015a0 tx=0x7f579c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:00.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:00.970+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f57a404c9c0 con 0x7f57a00051c0 2023-12-24T18:37:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.178+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57b406c200 con 0x7f57a00051c0 2023-12-24T18:37:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.178+0000 7f57ab7fe700 1 -- 172.21.15.50:0/1005815802 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f57a404ffe0 con 0x7f57a00051c0 2023-12-24T18:37:01.183 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-24T18:37:01.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 msgr2=0x7f5794062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:01.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 0x7f5794062a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f579c0015a0 tx=0x7f579c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:01.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 msgr2=0x7f57b416a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57a400d5e0 tx=0x7f57a4009040 comp rx=0 tx=0).stop 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 shutdown_connections 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5794060580 0x7f5794062a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57b40ca420 0x7f57b41528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40c9fb0 0x7f57b41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 --2- 172.21.15.50:0/1005815802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00051c0 0x7f57b416a020 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:01.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 >> 172.21.15.50:0/1005815802 conn(0x7f57b40cbba0 msgr2=0x7f57b40c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:01.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 shutdown_connections 2023-12-24T18:37:01.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:01.182+0000 7f57b9e78700 1 -- 172.21.15.50:0/1005815802 wait complete. 2023-12-24T18:37:01.209 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T18:37:01.209 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:37:01.210 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T18:37:01.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.211 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-12-24T18:37:01.230 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:01.230 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:01.230 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:01.230 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:01.230 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:01.231 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-24T18:37:01.232 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-12-24T18:37:01.233 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-12-24T18:37:01.233 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:01.233 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:37:01.233 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:e6:41:70:f3 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:01.234 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:37:01.234 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:01.234 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-24T18:37:01.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.234 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-24T18:37:01.235 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:01.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.387 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:37:01.423 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-12-24T18:37:01.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.427 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:37:01.507 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-24T18:37:01.508 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-24T18:37:01.508 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:37:01.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T18:37:01.509 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:01.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.654 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T18:37:01.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.671 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-12-24T18:37:01.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.731 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:01.732 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:01.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T18:37:01.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-24T18:37:01.732 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:01.852 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-24T18:37:01.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-24T18:37:01.853 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:02.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:02.028 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:02.028 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:02.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-12-24T18:37:02.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2023-12-24T18:37:02.028 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:02.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:02.098 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T18:37:02.115 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T18:37:02.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:02.115 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T18:37:02.172 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-24T18:37:02.172 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:37:02.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:02.294 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:02.294 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:02.442 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:02.443 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:02.443 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:37:02.443 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with new device syntax: 1@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:37:02.443 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:37:02.448 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:37:02.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:02.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T18:37:02.482 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-24T18:37:02.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:37:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.650+0000 7f4976745700 1 Processor -- start 2023-12-24T18:37:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.650+0000 7f4976745700 1 -- start start 2023-12-24T18:37:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4976745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49700ca3a0 0x7f49700ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4976745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497006ae10 0x7f497015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4976745700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497006ca50 con 0x7f497006b290 2023-12-24T18:37:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4976745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49700c6980 con 0x7f497006ae10 2023-12-24T18:37:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4976745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497006b7f0 con 0x7f49700ca3a0 2023-12-24T18:37:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497006ae10 0x7f497015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4974ce2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f497006b290 0x7f4970160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57276/0 (socket says 172.21.15.50:57276) 2023-12-24T18:37:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497006ae10 0x7f497015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37092/0 (socket says 172.21.15.50:37092) 2023-12-24T18:37:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4974ce2700 1 -- 172.21.15.50:0/3108690606 learned_addr learned my addr 172.21.15.50:0/3108690606 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f496ffff700 1 --2- 172.21.15.50:0/3108690606 >> v2:172.21.15.82:3300/0 conn(0x7f49700ca3a0 0x7f49700ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 -- 172.21.15.50:0/3108690606 >> v2:172.21.15.82:3300/0 conn(0x7f49700ca3a0 msgr2=0x7f49700ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 --2- 172.21.15.50:0/3108690606 >> v2:172.21.15.82:3300/0 conn(0x7f49700ca3a0 0x7f49700ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 -- 172.21.15.50:0/3108690606 >> v1:172.21.15.50:6789/0 conn(0x7f497006b290 legacy=0x7f4970160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 -- 172.21.15.50:0/3108690606 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497006bad0 con 0x7f497006ae10 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f496f7fe700 1 -- 172.21.15.50:0/3108690606 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351477470 0 0) 0x7f497006ca50 con 0x7f497006b290 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f4967fff700 1 --2- 172.21.15.50:0/3108690606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006ae10 0x7f497015aa50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4970069ce0 tx=0x7f49580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9781624114887 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f496f7fe700 1 -- 172.21.15.50:0/3108690606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800b6b0 con 0x7f497006ae10 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f496f7fe700 1 -- 172.21.15.50:0/3108690606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800b810 con 0x7f497006ae10 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.654+0000 7f496f7fe700 1 -- 172.21.15.50:0/3108690606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800bbb0 con 0x7f497006ae10 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 -- 172.21.15.50:0/3108690606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006ae10 msgr2=0x7f497015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 --2- 172.21.15.50:0/3108690606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006ae10 0x7f497015aa50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4970069ce0 tx=0x7f49580091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 -- 172.21.15.50:0/3108690606 shutdown_connections 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 --2- 172.21.15.50:0/3108690606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006ae10 0x7f497015aa50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 --2- 172.21.15.50:0/3108690606 >> v2:172.21.15.82:3300/0 conn(0x7f49700ca3a0 0x7f49700ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 -- 172.21.15.50:0/3108690606 >> 172.21.15.50:0/3108690606 conn(0x7f49700cbba0 msgr2=0x7f49700cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 -- 172.21.15.50:0/3108690606 shutdown_connections 2023-12-24T18:37:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 -- 172.21.15.50:0/3108690606 wait complete. 2023-12-24T18:37:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.658+0000 7f4976745700 1 Processor -- start 2023-12-24T18:37:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 -- start start 2023-12-24T18:37:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f497006ae10 0x7f4970147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49700ca3a0 0x7f4970159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4970148440 con 0x7f497006b290 2023-12-24T18:37:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b04a0 con 0x7f497006ae10 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4976745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b0780 con 0x7f49700ca3a0 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37094/0 (socket says 172.21.15.50:37094) 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 -- 172.21.15.50:0/3569259218 learned_addr learned my addr 172.21.15.50:0/3569259218 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4974ce2700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49700ca3a0 0x7f4970159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f496ffff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f497006ae10 0x7f4970147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 -- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49700ca3a0 msgr2=0x7f4970159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49700ca3a0 0x7f4970159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 -- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f497006ae10 msgr2=0x7f4970147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f497006ae10 0x7f4970147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 -- 172.21.15.50:0/3569259218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009420 con 0x7f497006b290 2023-12-24T18:37:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.662+0000 7f4967fff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4970069fe0 tx=0x7f4958017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958000d10 con 0x7f497006b290 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800bb90 con 0x7f497006b290 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49700b0a60 con 0x7f497006b290 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011670 con 0x7f497006b290 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49700b1020 con 0x7f497006b290 2023-12-24T18:37:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49700b1210 con 0x7f497006b290 2023-12-24T18:37:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.666+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4958011aa0 con 0x7f497006b290 2023-12-24T18:37:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.670+0000 7f496cff9700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 0x7f4950062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.670+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f495807e2e0 con 0x7f497006b290 2023-12-24T18:37:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.670+0000 7f496ffff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 0x7f4950062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:02.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.670+0000 7f496ffff700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 0x7f4950062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4960006fd0 tx=0x7f4960008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.678+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f495804e540 con 0x7f497006b290 2023-12-24T18:37:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.886+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49700652e0 con 0x7f497006b290 2023-12-24T18:37:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.886+0000 7f496cff9700 1 -- 172.21.15.50:0/3569259218 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4958051b60 con 0x7f497006b290 2023-12-24T18:37:02.891 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-24T18:37:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 msgr2=0x7f4950062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 0x7f4950062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4960006fd0 tx=0x7f4960008040 comp rx=0 tx=0).stop 2023-12-24T18:37:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 msgr2=0x7f49700afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4970069fe0 tx=0x7f4958017000 comp rx=0 tx=0).stop 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 shutdown_connections 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4950060550 0x7f4950062a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49700ca3a0 0x7f4970159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497006b290 0x7f49700afc50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 --2- 172.21.15.50:0/3569259218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f497006ae10 0x7f4970147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 >> 172.21.15.50:0/3569259218 conn(0x7f49700cbba0 msgr2=0x7f49700cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 shutdown_connections 2023-12-24T18:37:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:02.890+0000 7f4976745700 1 -- 172.21.15.50:0/3569259218 wait complete. 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:37:02.915 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-24T18:37:02.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:02.916 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.934 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42379sec preferred_lft 42379sec 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:e6:41:70:f3 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.935 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 2e:1d:be:2f:4a:f4 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6444:95ff:fe4d:f514/64 scope link 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 2e:1d:be:2f:4a:f4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::2c1d:beff:fe2f:4af4/64 scope link tentative 2023-12-24T18:37:02.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:02.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:02.937 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:37:03.016 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-12-24T18:37:03.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.020 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-24T18:37:03.084 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-24T18:37:03.085 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:37:03.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T18:37:03.085 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:03.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.219 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T18:37:03.234 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T18:37:03.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.235 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-12-24T18:37:03.295 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-24T18:37:03.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.295 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:03.296 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:03.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T18:37:03.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-24T18:37:03.296 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:03.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-24T18:37:03.448 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:03.448 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 86:8f:6d:53:a4:34 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::848f:6dff:fe53:a434/64 scope link tentative 2023-12-24T18:37:03.449 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 86:8f:6d:53:a4:34 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T18:37:03.539 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T18:37:03.540 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.540 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::848f:6dff:fe53:a434/64 scope link tentative 2023-12-24T18:37:03.540 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:03.543 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-24T18:37:03.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-24T18:37:03.543 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:03.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:03.731 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-12-24T18:37:03.731 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-12-24T18:37:03.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2023-12-24T18:37:03.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2023-12-24T18:37:03.731 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-12-24T18:37:03.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:03.800 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-24T18:37:03.818 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-24T18:37:03.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:03.819 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-24T18:37:03.881 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-24T18:37:03.881 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:37:03.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:04.005 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:04.005 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:04.027 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:04.028 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:04.028 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:37:04.028 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with new device syntax: 3@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:37:04.028 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:37:04.036 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:37:04.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:04.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-24T18:37:04.068 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-24T18:37:04.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:04.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.250+0000 7fee8af85700 1 Processor -- start 2023-12-24T18:37:04.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.250+0000 7fee8af85700 1 -- start start 2023-12-24T18:37:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.250+0000 7fee8af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee840b1ba0 0x7fee840b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8406d5c0 con 0x7fee840b3c90 2023-12-24T18:37:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee840b49c0 con 0x7fee840b1ba0 2023-12-24T18:37:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8406d040 con 0x7fee84158e10 2023-12-24T18:37:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee89522700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee840b1ba0 0x7fee840b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59060/0 (socket says 172.21.15.50:59060) 2023-12-24T18:37:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 -- 172.21.15.50:0/2973690610 learned_addr learned my addr 172.21.15.50:0/2973690610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 -- 172.21.15.50:0/2973690610 >> v2:172.21.15.82:3300/0 conn(0x7fee840b1ba0 msgr2=0x7fee840b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 --2- 172.21.15.50:0/2973690610 >> v2:172.21.15.82:3300/0 conn(0x7fee840b1ba0 0x7fee840b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 -- 172.21.15.50:0/2973690610 >> v1:172.21.15.82:6789/0 conn(0x7fee840b3c90 legacy=0x7fee8406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 -- 172.21.15.50:0/2973690610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8415a1f0 con 0x7fee84158e10 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee88d21700 1 --2- 172.21.15.50:0/2973690610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee780099b0 tx=0x7fee78009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c7ee7544d1091d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee837fe700 1 -- 172.21.15.50:0/2973690610 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78009ea0 con 0x7fee84158e10 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee837fe700 1 -- 172.21.15.50:0/2973690610 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800b860 con 0x7fee84158e10 2023-12-24T18:37:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee837fe700 1 -- 172.21.15.50:0/2973690610 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800bc00 con 0x7fee84158e10 2023-12-24T18:37:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- 172.21.15.50:0/2973690610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 msgr2=0x7fee8415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 --2- 172.21.15.50:0/2973690610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee780099b0 tx=0x7fee78009250 comp rx=0 tx=0).stop 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- 172.21.15.50:0/2973690610 shutdown_connections 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 --2- 172.21.15.50:0/2973690610 >> v2:172.21.15.82:3300/0 conn(0x7fee840b1ba0 0x7fee840b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 --2- 172.21.15.50:0/2973690610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee84158e10 0x7fee8415d6d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.254+0000 7fee8af85700 1 -- 172.21.15.50:0/2973690610 >> 172.21.15.50:0/2973690610 conn(0x7fee840670b0 msgr2=0x7fee840674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.258+0000 7fee8af85700 1 -- 172.21.15.50:0/2973690610 shutdown_connections 2023-12-24T18:37:04.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.258+0000 7fee8af85700 1 -- 172.21.15.50:0/2973690610 wait complete. 2023-12-24T18:37:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.258+0000 7fee8af85700 1 Processor -- start 2023-12-24T18:37:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.258+0000 7fee8af85700 1 -- start start 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee840b3c90 0x7fee84171290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee84158e10 0x7fee841717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8408aef0 con 0x7fee840b1ba0 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8408a370 con 0x7fee84158e10 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8408a650 con 0x7fee840b3c90 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37108/0 (socket says 172.21.15.50:37108) 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 -- 172.21.15.50:0/1978566194 learned_addr learned my addr 172.21.15.50:0/1978566194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee89522700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee84158e10 0x7fee841717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee83fff700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee840b3c90 0x7fee84171290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 -- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee840b3c90 msgr2=0x7fee84171290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee840b3c90 0x7fee84171290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 -- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee84158e10 msgr2=0x7fee841717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee84158e10 0x7fee841717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 -- 172.21.15.50:0/1978566194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780094f0 con 0x7fee840b1ba0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee88d21700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee840b4b00 tx=0x7fee78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78000d10 con 0x7fee840b1ba0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800b9d0 con 0x7fee840b1ba0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8408a930 con 0x7fee840b1ba0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78025420 con 0x7fee840b1ba0 2023-12-24T18:37:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.262+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84152250 con 0x7fee840b1ba0 2023-12-24T18:37:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.266+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee840652e0 con 0x7fee840b1ba0 2023-12-24T18:37:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.266+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fee78023070 con 0x7fee840b1ba0 2023-12-24T18:37:04.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.266+0000 7fee80ff9700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 0x7fee68062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.266+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fee7807e0a0 con 0x7fee840b1ba0 2023-12-24T18:37:04.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.266+0000 7fee83fff700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 0x7fee68062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.270+0000 7fee83fff700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 0x7fee68062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee840b08d0 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.274+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fee7804e300 con 0x7fee840b1ba0 2023-12-24T18:37:04.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.450+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee840b2700 con 0x7fee840b1ba0 2023-12-24T18:37:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.450+0000 7fee80ff9700 1 -- 172.21.15.50:0/1978566194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fee78051920 con 0x7fee840b1ba0 2023-12-24T18:37:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:04.457 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 msgr2=0x7fee68062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 0x7fee68062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee840b08d0 tx=0x7fee70009040 comp rx=0 tx=0).stop 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 msgr2=0x7fee84151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee840b4b00 tx=0x7fee78017000 comp rx=0 tx=0).stop 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 shutdown_connections 2023-12-24T18:37:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fee68060550 0x7fee68062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee84158e10 0x7fee841717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee840b3c90 0x7fee84171290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 --2- 172.21.15.50:0/1978566194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee840b1ba0 0x7fee84151d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 >> 172.21.15.50:0/1978566194 conn(0x7fee840670b0 msgr2=0x7fee840b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 shutdown_connections 2023-12-24T18:37:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.454+0000 7fee8af85700 1 -- 172.21.15.50:0/1978566194 wait complete. 2023-12-24T18:37:04.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:37:04.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 Processor -- start 2023-12-24T18:37:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 -- start start 2023-12-24T18:37:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa40c8a00 0x7faaa40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 0x7faaa40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa415cb10 con 0x7faaa40c6ae0 2023-12-24T18:37:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa415d790 con 0x7faaa40c8a00 2023-12-24T18:37:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaab3cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa415cdf0 con 0x7faaa41500c0 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaaa3ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa40c8a00 0x7faaa40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaaabcb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 0x7faaa40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaaa3ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa40c8a00 0x7faaa40c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37112/0 (socket says 172.21.15.50:37112) 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.650+0000 7faaaa3ca700 1 -- 172.21.15.50:0/2551338444 learned_addr learned my addr 172.21.15.50:0/2551338444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaa3ca700 1 -- 172.21.15.50:0/2551338444 >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 msgr2=0x7faaa40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaa3ca700 1 --2- 172.21.15.50:0/2551338444 >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 0x7faaa40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaa3ca700 1 -- 172.21.15.50:0/2551338444 >> v1:172.21.15.82:6789/0 conn(0x7faaa40c6ae0 legacy=0x7faaa414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaa93c8700 1 -- 172.21.15.50:0/2551338444 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927613594 0 0) 0x7faaa415cb10 con 0x7faaa40c6ae0 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaa3ca700 1 -- 172.21.15.50:0/2551338444 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa415d0d0 con 0x7faaa40c8a00 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaabcb700 1 --2- 172.21.15.50:0/2551338444 >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 0x7faaa40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaaa3ca700 1 --2- 172.21.15.50:0/2551338444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa40c8dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faaa4153ab0 tx=0x7faaa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504c372e36563fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaa93c8700 1 -- 172.21.15.50:0/2551338444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0009e70 con 0x7faaa40c8a00 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaa93c8700 1 -- 172.21.15.50:0/2551338444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000b860 con 0x7faaa40c8a00 2023-12-24T18:37:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaa93c8700 1 -- 172.21.15.50:0/2551338444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000bc00 con 0x7faaa40c8a00 2023-12-24T18:37:04.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaab3cc700 1 -- 172.21.15.50:0/2551338444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 msgr2=0x7faaa40c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.654+0000 7faaab3cc700 1 --2- 172.21.15.50:0/2551338444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa40c8dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faaa4153ab0 tx=0x7faaa0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:04.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 -- 172.21.15.50:0/2551338444 shutdown_connections 2023-12-24T18:37:04.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 --2- 172.21.15.50:0/2551338444 >> v2:172.21.15.82:3300/0 conn(0x7faaa41500c0 0x7faaa40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 --2- 172.21.15.50:0/2551338444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa40c8dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 -- 172.21.15.50:0/2551338444 >> 172.21.15.50:0/2551338444 conn(0x7faaa4067250 msgr2=0x7faaa4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:04.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 -- 172.21.15.50:0/2551338444 shutdown_connections 2023-12-24T18:37:04.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 -- 172.21.15.50:0/2551338444 wait complete. 2023-12-24T18:37:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.658+0000 7faaab3cc700 1 Processor -- start 2023-12-24T18:37:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 -- start start 2023-12-24T18:37:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 0x7faaa414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa41500c0 0x7faaa4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415dab0 con 0x7faaa40c8a00 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa414f420 con 0x7faaa40c6ae0 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaab3cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415dd00 con 0x7faaa41500c0 2023-12-24T18:37:04.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaaa3ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 0x7faaa414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37128/0 (socket says 172.21.15.50:37128) 2023-12-24T18:37:04.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaaa3ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 0x7faaa414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:47046/0 (socket says 172.21.15.50:47046) 2023-12-24T18:37:04.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 -- 172.21.15.50:0/968819031 learned_addr learned my addr 172.21.15.50:0/968819031 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:04.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaaabcb700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa41500c0 0x7faaa4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 -- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa41500c0 msgr2=0x7faaa4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa41500c0 0x7faaa4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 -- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 msgr2=0x7faaa414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 0x7faaa414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 -- 172.21.15.50:0/968819031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009a20 con 0x7faaa40c8a00 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.662+0000 7faaa9bc9700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c810 tx=0x7faa94007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94011590 con 0x7faaa40c8a00 2023-12-24T18:37:04.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94011710 con 0x7faaa40c8a00 2023-12-24T18:37:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94011ad0 con 0x7faaa40c8a00 2023-12-24T18:37:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa00094f0 con 0x7faaa40c8a00 2023-12-24T18:37:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa415e2c0 con 0x7faaa40c8a00 2023-12-24T18:37:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa404be40 con 0x7faaa40c8a00 2023-12-24T18:37:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.666+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faa9401b3b0 con 0x7faaa40c8a00 2023-12-24T18:37:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.670+0000 7faa9a7fc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.670+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7faa9407bf70 con 0x7faaa40c8a00 2023-12-24T18:37:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.670+0000 7faaaa3ca700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:04.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.670+0000 7faaaa3ca700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 0x7faa88062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faaa4153ab0 tx=0x7faaa0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:04.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.678+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa9404c330 con 0x7faaa40c8a00 2023-12-24T18:37:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.846+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaa415d3b0 con 0x7faaa40c8a00 2023-12-24T18:37:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.846+0000 7faa9a7fc700 1 -- 172.21.15.50:0/968819031 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa94017020 con 0x7faaa40c8a00 2023-12-24T18:37:04.852 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 msgr2=0x7faa88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 0x7faa88062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faaa4153ab0 tx=0x7faaa0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 msgr2=0x7faaa4150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c810 tx=0x7faa94007df0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 shutdown_connections 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa41500c0 0x7faaa4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40c8a00 0x7faaa4150500 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 --2- 172.21.15.50:0/968819031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa40c6ae0 0x7faaa414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 >> 172.21.15.50:0/968819031 conn(0x7faaa4067250 msgr2=0x7faaa415bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 shutdown_connections 2023-12-24T18:37:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:04.850+0000 7faaab3cc700 1 -- 172.21.15.50:0/968819031 wait complete. 2023-12-24T18:37:04.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:37:05.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.038+0000 7f351ad23700 1 Processor -- start 2023-12-24T18:37:05.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.038+0000 7f351ad23700 1 -- start start 2023-12-24T18:37:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351ad23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3514158c40 0x7f35140cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351ad23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 0x7f35140ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351ad23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351406a580 con 0x7f35140cc780 2023-12-24T18:37:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351ad23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140cd110 con 0x7f3514158c40 2023-12-24T18:37:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351ad23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351406a7d0 con 0x7f351406d450 2023-12-24T18:37:05.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519520700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35140cc780 0x7f351406cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57282/0 (socket says 172.21.15.50:57282) 2023-12-24T18:37:05.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519520700 1 -- 172.21.15.50:0/1282936729 learned_addr learned my addr 172.21.15.50:0/1282936729 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:05.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 --2- 172.21.15.50:0/1282936729 >> v2:172.21.15.82:3300/0 conn(0x7f3514158c40 0x7f35140cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351a522700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 0x7f35140ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3518d1f700 1 -- 172.21.15.50:0/1282936729 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687196987 0 0) 0x7f351406a580 con 0x7f35140cc780 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3518d1f700 1 -- 172.21.15.50:0/1282936729 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3500003570 con 0x7f35140cc780 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 -- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 msgr2=0x7f35140ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 0x7f35140ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 -- 172.21.15.50:0/1282936729 >> v1:172.21.15.50:6789/0 conn(0x7f35140cc780 legacy=0x7f351406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 -- 172.21.15.50:0/1282936729 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351406aab0 con 0x7f3514158c40 2023-12-24T18:37:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f351a522700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 0x7f35140ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3519d21700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f35140cf500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35100098e0 tx=0x7f35100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abba95a11e8360e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.042+0000 7f3518d1f700 1 -- 172.21.15.50:0/1282936729 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011630 con 0x7f3514158c40 2023-12-24T18:37:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f3518d1f700 1 -- 172.21.15.50:0/1282936729 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510011790 con 0x7f3514158c40 2023-12-24T18:37:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f3518d1f700 1 -- 172.21.15.50:0/1282936729 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011b30 con 0x7f3514158c40 2023-12-24T18:37:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 msgr2=0x7f35140cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f35140cf500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35100098e0 tx=0x7f35100091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- 172.21.15.50:0/1282936729 shutdown_connections 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f351406d450 0x7f35140ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 --2- 172.21.15.50:0/1282936729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f35140cf500 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- 172.21.15.50:0/1282936729 >> 172.21.15.50:0/1282936729 conn(0x7f35140d0800 msgr2=0x7f35140b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- 172.21.15.50:0/1282936729 shutdown_connections 2023-12-24T18:37:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- 172.21.15.50:0/1282936729 wait complete. 2023-12-24T18:37:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 Processor -- start 2023-12-24T18:37:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.046+0000 7f351ad23700 1 -- start start 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35140cc780 0x7f35141415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f351415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514151890 con 0x7f351406d450 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514159f30 con 0x7f3514158c40 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514152360 con 0x7f35140cc780 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37134/0 (socket says 172.21.15.50:37134) 2023-12-24T18:37:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 -- 172.21.15.50:0/4162371129 learned_addr learned my addr 172.21.15.50:0/4162371129 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519520700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35140cc780 0x7f35141415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351a522700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f351415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 -- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35140cc780 msgr2=0x7f35141415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35140cc780 0x7f35141415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 -- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 msgr2=0x7f351415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f351415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 -- 172.21.15.50:0/4162371129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009a20 con 0x7f351406d450 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351a522700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f351415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3519d21700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3514069860 tx=0x7f3510017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011b10 con 0x7f351406d450 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35100253f0 con 0x7f351406d450 2023-12-24T18:37:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3510009420 con 0x7f351406d450 2023-12-24T18:37:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510025790 con 0x7f351406d450 2023-12-24T18:37:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.050+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3514151da0 con 0x7f351406d450 2023-12-24T18:37:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.054+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35140cdf90 con 0x7f351406d450 2023-12-24T18:37:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.054+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3510025b80 con 0x7f351406d450 2023-12-24T18:37:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.058+0000 7f3509ffb700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.058+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f351007e300 con 0x7f351406d450 2023-12-24T18:37:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.058+0000 7f3519520700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.062+0000 7f3519520700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 0x7f34f8062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f351416c760 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.066+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f35140cdf90 con 0x7f351406d450 2023-12-24T18:37:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.230+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35140cdf90 con 0x7f351406d450 2023-12-24T18:37:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.234+0000 7f3509ffb700 1 -- 172.21.15.50:0/4162371129 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35140cdf90 con 0x7f351406d450 2023-12-24T18:37:05.237 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 msgr2=0x7f34f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 0x7f34f8062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f351416c760 tx=0x7f3504009040 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 msgr2=0x7f3514151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3514069860 tx=0x7f3510017000 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 shutdown_connections 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3514158c40 0x7f351415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35140cc780 0x7f35141415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 --2- 172.21.15.50:0/4162371129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351406d450 0x7f3514151350 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 >> 172.21.15.50:0/4162371129 conn(0x7f35140d0800 msgr2=0x7f35140b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 shutdown_connections 2023-12-24T18:37:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.238+0000 7f351ad23700 1 -- 172.21.15.50:0/4162371129 wait complete. 2023-12-24T18:37:05.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:37:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.430+0000 7f3fe29cc700 1 Processor -- start 2023-12-24T18:37:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.430+0000 7f3fe29cc700 1 -- start start 2023-12-24T18:37:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe29cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fdc0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe29cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fdc06d450 0x7f3fdc0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe29cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc06a580 con 0x7f3fdc0cc780 2023-12-24T18:37:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe29cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0cd110 con 0x7f3fdc06d450 2023-12-24T18:37:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe29cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc06a7d0 con 0x7f3fdc158c40 2023-12-24T18:37:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3fdc0cc780 0x7f3fdc06cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57294/0 (socket says 172.21.15.50:57294) 2023-12-24T18:37:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 -- 172.21.15.50:0/3017990344 learned_addr learned my addr 172.21.15.50:0/3017990344 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe21cb700 1 --2- 172.21.15.50:0/3017990344 >> v2:172.21.15.82:3300/0 conn(0x7f3fdc06d450 0x7f3fdc0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe19ca700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fdc0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929388391 0 0) 0x7f3fdc06a580 con 0x7f3fdc0cc780 2023-12-24T18:37:05.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc8003570 con 0x7f3fdc0cc780 2023-12-24T18:37:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495113579 0 0) 0x7f3fc8003570 con 0x7f3fdc0cc780 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 msgr2=0x7f3fdc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fdc0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 >> v2:172.21.15.82:3300/0 conn(0x7f3fdc06d450 msgr2=0x7f3fdc0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 --2- 172.21.15.50:0/3017990344 >> v2:172.21.15.82:3300/0 conn(0x7f3fdc06d450 0x7f3fdc0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc06aab0 con 0x7f3fdc0cc780 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f3fcc001470 con 0x7f3fdc0cc780 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 >> v1:172.21.15.50:6789/0 conn(0x7f3fdc0cc780 legacy=0x7f3fdc06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fc8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc8004d50 0x7f3fc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0cd110 con 0x7f3fc8003fe0 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc06a7d0 con 0x7f3fc8004d50 2023-12-24T18:37:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc800ba90 con 0x7f3fdc158c40 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe19ca700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fc8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe21cb700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc8004d50 0x7f3fc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 -- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 msgr2=0x7f3fc8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc158c40 0x7f3fc8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 -- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc8004d50 msgr2=0x7f3fc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc8004d50 0x7f3fc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 -- 172.21.15.50:0/3017990344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8003570 con 0x7f3fc8003fe0 2023-12-24T18:37:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.434+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fc8004810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c3c0 tx=0x7f3fcc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5952277c5bf581b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00cc30 con 0x7f3fc8003fe0 2023-12-24T18:37:05.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00cdd0 con 0x7f3fc8003fe0 2023-12-24T18:37:05.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe09c8700 1 -- 172.21.15.50:0/3017990344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc005b70 con 0x7f3fc8003fe0 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 -- 172.21.15.50:0/3017990344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 msgr2=0x7f3fc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/3017990344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fc8004810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c3c0 tx=0x7f3fcc001e90 comp rx=0 tx=0).stop 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe21cb700 1 -- 172.21.15.50:0/3017990344 reap_dead start 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 -- 172.21.15.50:0/3017990344 shutdown_connections 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 -- 172.21.15.50:0/3017990344 >> 172.21.15.50:0/3017990344 conn(0x7f3fdc0d0800 msgr2=0x7f3fdc0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 -- 172.21.15.50:0/3017990344 shutdown_connections 2023-12-24T18:37:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.438+0000 7f3fe29cc700 1 -- 172.21.15.50:0/3017990344 wait complete. 2023-12-24T18:37:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 Processor -- start 2023-12-24T18:37:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 -- start start 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fdc0c8560 0x7f3fdc0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 0x7f3fdc1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0c89d0 con 0x7f3fc8003fe0 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0c8cb0 con 0x7f3fdc0c8560 2023-12-24T18:37:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0c8f90 con 0x7f3fdc0cac40 2023-12-24T18:37:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37144/0 (socket says 172.21.15.50:37144) 2023-12-24T18:37:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 -- 172.21.15.50:0/1510896363 learned_addr learned my addr 172.21.15.50:0/1510896363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe21cb700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 0x7f3fdc1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fdc0c8560 0x7f3fdc0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 -- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 msgr2=0x7f3fdc1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 0x7f3fdc1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 -- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fdc0c8560 msgr2=0x7f3fdc0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fdc0c8560 0x7f3fdc0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 -- 172.21.15.50:0/1510896363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0c9270 con 0x7f3fc8003fe0 2023-12-24T18:37:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe21cb700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 0x7f3fdc1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe19ca700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8011d40 tx=0x7f3fd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800fac0 con 0x7f3fc8003fe0 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800fc20 con 0x7f3fc8003fe0 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8014440 con 0x7f3fc8003fe0 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.442+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc153950 con 0x7f3fc8003fe0 2023-12-24T18:37:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc152f00 con 0x7f3fc8003fe0 2023-12-24T18:37:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc04be40 con 0x7f3fc8003fe0 2023-12-24T18:37:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3fd8014870 con 0x7f3fc8003fe0 2023-12-24T18:37:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fd1ffb700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 0x7f3fc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f3fd8018030 con 0x7f3fc8003fe0 2023-12-24T18:37:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.446+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 0x7f3fc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.450+0000 7f3fe11c9700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 0x7f3fc0062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c3c0 tx=0x7f3fcc015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.450+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3fd804d840 con 0x7f3fc8003fe0 2023-12-24T18:37:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.622+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fdc0c9400 con 0x7f3fc8003fe0 2023-12-24T18:37:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.622+0000 7f3fd1ffb700 1 -- 172.21.15.50:0/1510896363 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fdc0c9400 con 0x7f3fc8003fe0 2023-12-24T18:37:05.627 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 msgr2=0x7f3fc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 0x7f3fc0062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c3c0 tx=0x7f3fcc015000 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 msgr2=0x7f3fdc153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8011d40 tx=0x7f3fd80091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 shutdown_connections 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3fc0060550 0x7f3fc0062a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fdc0cac40 0x7f3fdc1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fdc0c8560 0x7f3fdc0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 --2- 172.21.15.50:0/1510896363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8003fe0 0x7f3fdc153340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 >> 172.21.15.50:0/1510896363 conn(0x7f3fdc0d0800 msgr2=0x7f3fdc0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 shutdown_connections 2023-12-24T18:37:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.630+0000 7f3fe29cc700 1 -- 172.21.15.50:0/1510896363 wait complete. 2023-12-24T18:37:05.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:37:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.826+0000 7fc60ad45700 1 Processor -- start 2023-12-24T18:37:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.826+0000 7fc60ad45700 1 -- start start 2023-12-24T18:37:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 0x7fc60406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 0x7fc60406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 0x7fc60415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc604159640 con 0x7fc60406ac40 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60406b0a0 con 0x7fc6040cf4d0 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc60ad45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cd680 con 0x7fc6040cf8a0 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc608ae1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 0x7fc60406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc6092e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 0x7fc60415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc608ae1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 0x7fc60406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:47084/0 (socket says 172.21.15.50:47084) 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 0x7fc60406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc608ae1700 1 -- 172.21.15.50:0/2747392750 learned_addr learned my addr 172.21.15.50:0/2747392750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 -- 172.21.15.50:0/2747392750 >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 msgr2=0x7fc60406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 --2- 172.21.15.50:0/2747392750 >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 0x7fc60406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 -- 172.21.15.50:0/2747392750 >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 msgr2=0x7fc60415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 --2- 172.21.15.50:0/2747392750 >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 0x7fc60415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc603fff700 1 -- 172.21.15.50:0/2747392750 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040cca70 con 0x7fc6040cf8a0 2023-12-24T18:37:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.830+0000 7fc6092e2700 1 --2- 172.21.15.50:0/2747392750 >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 0x7fc60415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc603fff700 1 --2- 172.21.15.50:0/2747392750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 0x7fc60406a700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc604063780 tx=0x7fc5f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=983cc320196c2ef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc6037fe700 1 -- 172.21.15.50:0/2747392750 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0011630 con 0x7fc6040cf8a0 2023-12-24T18:37:05.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc6037fe700 1 -- 172.21.15.50:0/2747392750 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00117b0 con 0x7fc6040cf8a0 2023-12-24T18:37:05.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc6037fe700 1 -- 172.21.15.50:0/2747392750 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0011b70 con 0x7fc6040cf8a0 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 -- 172.21.15.50:0/2747392750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 msgr2=0x7fc60406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 --2- 172.21.15.50:0/2747392750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 0x7fc60406a700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc604063780 tx=0x7fc5f00091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 -- 172.21.15.50:0/2747392750 shutdown_connections 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 --2- 172.21.15.50:0/2747392750 >> v2:172.21.15.50:3300/0 conn(0x7fc60406ac40 0x7fc60415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 --2- 172.21.15.50:0/2747392750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf8a0 0x7fc60406a700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 --2- 172.21.15.50:0/2747392750 >> v2:172.21.15.82:3300/0 conn(0x7fc6040cf4d0 0x7fc60406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 -- 172.21.15.50:0/2747392750 >> 172.21.15.50:0/2747392750 conn(0x7fc604067b30 msgr2=0x7fc6040cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 -- 172.21.15.50:0/2747392750 shutdown_connections 2023-12-24T18:37:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.834+0000 7fc60ad45700 1 -- 172.21.15.50:0/2747392750 wait complete. 2023-12-24T18:37:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 Processor -- start 2023-12-24T18:37:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 -- start start 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 0x7fc6040ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf4d0 0x7fc6040caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cb030 con 0x7fc6040cf8a0 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604156d50 con 0x7fc60406ac40 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc60ad45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cbe40 con 0x7fc6040cf4d0 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37166/0 (socket says 172.21.15.50:37166) 2023-12-24T18:37:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 -- 172.21.15.50:0/1655304279 learned_addr learned my addr 172.21.15.50:0/1655304279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc603fff700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf4d0 0x7fc6040caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc608ae1700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 0x7fc6040ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 -- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf4d0 msgr2=0x7fc6040caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf4d0 0x7fc6040caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 -- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 msgr2=0x7fc6040ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 0x7fc6040ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 -- 172.21.15.50:0/1655304279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009a20 con 0x7fc6040cf8a0 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc608ae1700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 0x7fc6040ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.838+0000 7fc6092e2700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c0f0 tx=0x7fc5fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00cce0 con 0x7fc6040cf8a0 2023-12-24T18:37:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00f040 con 0x7fc6040cf8a0 2023-12-24T18:37:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0146d0 con 0x7fc6040cf8a0 2023-12-24T18:37:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f0009420 con 0x7fc6040cf8a0 2023-12-24T18:37:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040cb510 con 0x7fc6040cf8a0 2023-12-24T18:37:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6040cbfb0 con 0x7fc6040cf8a0 2023-12-24T18:37:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.842+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc5fc003020 con 0x7fc6040cf8a0 2023-12-24T18:37:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.846+0000 7fc600ff9700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 0x7fc5e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.846+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fc5fc07d4d0 con 0x7fc6040cf8a0 2023-12-24T18:37:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.846+0000 7fc608ae1700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 0x7fc5e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:05.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.846+0000 7fc608ae1700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 0x7fc5e8062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006d40 tx=0x7fc5f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:05.850+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc5fc04d730 con 0x7fc6040cf8a0 2023-12-24T18:37:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.014+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc6040ccd50 con 0x7fc6040cf8a0 2023-12-24T18:37:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc600ff9700 1 -- 172.21.15.50:0/1655304279 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5fc050d50 con 0x7fc6040cf8a0 2023-12-24T18:37:06.021 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 msgr2=0x7fc5e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 0x7fc5e8062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006d40 tx=0x7fc5f8008040 comp rx=0 tx=0).stop 2023-12-24T18:37:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 msgr2=0x7fc60415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c0f0 tx=0x7fc5fc00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 shutdown_connections 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc5e8060550 0x7fc5e8062a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6040cf8a0 0x7fc60415cbf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6040cf4d0 0x7fc6040caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 --2- 172.21.15.50:0/1655304279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60406ac40 0x7fc6040ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 >> 172.21.15.50:0/1655304279 conn(0x7fc604067b30 msgr2=0x7fc6040b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 shutdown_connections 2023-12-24T18:37:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.018+0000 7fc60ad45700 1 -- 172.21.15.50:0/1655304279 wait complete. 2023-12-24T18:37:06.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:06.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.206+0000 7f0ab95cc700 1 Processor -- start 2023-12-24T18:37:06.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.206+0000 7f0ab95cc700 1 -- start start 2023-12-24T18:37:06.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.206+0000 7f0ab95cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab4158e00 0x7f0ab41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ab40b41e0 0x7f0ab4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab406b640 con 0x7f0ab406d8c0 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab4159710 con 0x7f0ab4158e00 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40b5e10 con 0x7f0ab40b41e0 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab4158e00 0x7f0ab41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab4158e00 0x7f0ab41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37170/0 (socket says 172.21.15.50:37170) 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 -- 172.21.15.50:0/313570544 learned_addr learned my addr 172.21.15.50:0/313570544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab8dcb700 1 --2- 172.21.15.50:0/313570544 >> v2:172.21.15.82:3300/0 conn(0x7f0ab40b41e0 0x7f0ab4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 -- 172.21.15.50:0/313570544 >> v2:172.21.15.82:3300/0 conn(0x7f0ab40b41e0 msgr2=0x7f0ab4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 --2- 172.21.15.50:0/313570544 >> v2:172.21.15.82:3300/0 conn(0x7f0ab40b41e0 0x7f0ab4159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 -- 172.21.15.50:0/313570544 >> v1:172.21.15.82:6789/0 conn(0x7f0ab406d8c0 legacy=0x7f0ab40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 -- 172.21.15.50:0/313570544 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab406b8e0 con 0x7f0ab4158e00 2023-12-24T18:37:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab3fff700 1 --2- 172.21.15.50:0/313570544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab4158e00 0x7f0ab41591d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4064350 tx=0x7f0aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e273588c7bbfbc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab37fe700 1 -- 172.21.15.50:0/313570544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4009e70 con 0x7f0ab4158e00 2023-12-24T18:37:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab37fe700 1 -- 172.21.15.50:0/313570544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400b860 con 0x7f0ab4158e00 2023-12-24T18:37:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab37fe700 1 -- 172.21.15.50:0/313570544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400bc00 con 0x7f0ab4158e00 2023-12-24T18:37:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- 172.21.15.50:0/313570544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab4158e00 msgr2=0x7f0ab41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/313570544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab4158e00 0x7f0ab41591d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4064350 tx=0x7f0aa4009250 comp rx=0 tx=0).stop 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- 172.21.15.50:0/313570544 shutdown_connections 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/313570544 >> v2:172.21.15.82:3300/0 conn(0x7f0ab40b41e0 0x7f0ab4159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/313570544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab4158e00 0x7f0ab41591d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- 172.21.15.50:0/313570544 >> 172.21.15.50:0/313570544 conn(0x7f0ab4067b80 msgr2=0x7f0ab40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- 172.21.15.50:0/313570544 shutdown_connections 2023-12-24T18:37:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.210+0000 7f0ab95cc700 1 -- 172.21.15.50:0/313570544 wait complete. 2023-12-24T18:37:06.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.214+0000 7f0ab95cc700 1 Processor -- start 2023-12-24T18:37:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.214+0000 7f0ab95cc700 1 -- start start 2023-12-24T18:37:06.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ab40b41e0 0x7f0ab4141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ab4158e00 0x7f0ab4142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4144dc0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41443f0 con 0x7f0ab40b41e0 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41437e0 con 0x7f0ab4158e00 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37176/0 (socket says 172.21.15.50:37176) 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 -- 172.21.15.50:0/2425677153 learned_addr learned my addr 172.21.15.50:0/2425677153 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0aab7fe700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ab40b41e0 0x7f0ab4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab8dcb700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ab4158e00 0x7f0ab4142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 -- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ab4158e00 msgr2=0x7f0ab4142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ab4158e00 0x7f0ab4142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 -- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ab40b41e0 msgr2=0x7f0ab4141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ab40b41e0 0x7f0ab4141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 -- 172.21.15.50:0/2425677153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40094f0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab3fff700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab406e730 tx=0x7f0aa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400bbe0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4011420 con 0x7f0ab406d8c0 2023-12-24T18:37:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4143ac0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40117c0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.218+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab4144080 con 0x7f0ab406d8c0 2023-12-24T18:37:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.222+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4155a10 con 0x7f0ab406d8c0 2023-12-24T18:37:06.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.222+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0aa4011bb0 con 0x7f0ab406d8c0 2023-12-24T18:37:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.226+0000 7f0ab0ff9700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 0x7f0a94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.226+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f0aa407de70 con 0x7f0ab406d8c0 2023-12-24T18:37:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.226+0000 7f0aab7fe700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 0x7f0a94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.226+0000 7f0aab7fe700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 0x7f0a94062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ab41559e0 tx=0x7f0a9c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.230+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ab4155a10 con 0x7f0ab406d8c0 2023-12-24T18:37:06.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.402+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ab4155a10 con 0x7f0ab406d8c0 2023-12-24T18:37:06.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.406+0000 7f0ab0ff9700 1 -- 172.21.15.50:0/2425677153 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f0ab4155a10 con 0x7f0ab406d8c0 2023-12-24T18:37:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:06.410 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 msgr2=0x7f0a94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 0x7f0a94062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ab41559e0 tx=0x7f0a9c007ec0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 msgr2=0x7f0ab4144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab406e730 tx=0x7f0aa4017000 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 shutdown_connections 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0a94060550 0x7f0a94062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ab4158e00 0x7f0ab4142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ab40b41e0 0x7f0ab4141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 --2- 172.21.15.50:0/2425677153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab406d8c0 0x7f0ab4144880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 >> 172.21.15.50:0/2425677153 conn(0x7f0ab4067b80 msgr2=0x7f0ab40a9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:06.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 shutdown_connections 2023-12-24T18:37:06.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.410+0000 7f0ab95cc700 1 -- 172.21.15.50:0/2425677153 wait complete. 2023-12-24T18:37:06.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:37:06.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:06.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.618+0000 7f0b9cdc5700 1 Processor -- start 2023-12-24T18:37:06.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.618+0000 7f0b9cdc5700 1 -- start start 2023-12-24T18:37:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b9cdc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf8a0 0x7f0b9806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b9cdc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b9806ac40 0x7f0b980cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b9cdc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9806b0a0 con 0x7f0b980cf4d0 2023-12-24T18:37:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b9cdc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b98159640 con 0x7f0b9806ac40 2023-12-24T18:37:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b9cdc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980cd680 con 0x7f0b980cf8a0 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b9806ac40 0x7f0b980cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b9806ac40 0x7f0b980cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37192/0 (socket says 172.21.15.50:37192) 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 -- 172.21.15.50:0/2853181628 learned_addr learned my addr 172.21.15.50:0/2853181628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b95d9b700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf8a0 0x7f0b9806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 -- 172.21.15.50:0/2853181628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf8a0 msgr2=0x7f0b9806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf8a0 0x7f0b9806a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 -- 172.21.15.50:0/2853181628 >> v1:172.21.15.50:6789/0 conn(0x7f0b980cf4d0 legacy=0x7f0b9806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 -- 172.21.15.50:0/2853181628 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9806d8f0 con 0x7f0b9806ac40 2023-12-24T18:37:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.622+0000 7f0b96d9d700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b980cdb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009f20 tx=0x7f0b90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b218cdda2c9c6a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9559a700 1 -- 172.21.15.50:0/2853181628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000e070 con 0x7f0b9806ac40 2023-12-24T18:37:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9559a700 1 -- 172.21.15.50:0/2853181628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9000ba80 con 0x7f0b9806ac40 2023-12-24T18:37:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9559a700 1 -- 172.21.15.50:0/2853181628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900092e0 con 0x7f0b9806ac40 2023-12-24T18:37:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2853181628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 msgr2=0x7f0b980cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b980cdb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009f20 tx=0x7f0b90009840 comp rx=0 tx=0).stop 2023-12-24T18:37:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2853181628 shutdown_connections 2023-12-24T18:37:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b980cdb10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2853181628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf8a0 0x7f0b9806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2853181628 >> 172.21.15.50:0/2853181628 conn(0x7f0b98067b30 msgr2=0x7f0b980cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:06.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2853181628 shutdown_connections 2023-12-24T18:37:06.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2853181628 wait complete. 2023-12-24T18:37:06.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.626+0000 7f0b9cdc5700 1 Processor -- start 2023-12-24T18:37:06.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 -- start start 2023-12-24T18:37:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf4d0 0x7f0b9815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b980cf8a0 0x7f0b980c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9815e7b0 con 0x7f0b9806ac40 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9815d710 con 0x7f0b980cf8a0 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9cdc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9815d9f0 con 0x7f0b980cf4d0 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37194/0 (socket says 172.21.15.50:37194) 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 -- 172.21.15.50:0/2183243945 learned_addr learned my addr 172.21.15.50:0/2183243945 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b95d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf4d0 0x7f0b9815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b96d9d700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b980cf8a0 0x7f0b980c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 -- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf4d0 msgr2=0x7f0b9815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf4d0 0x7f0b9815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 -- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b980cf8a0 msgr2=0x7f0b980c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b980cf8a0 0x7f0b980c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 -- 172.21.15.50:0/2183243945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009ae0 con 0x7f0b9806ac40 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.630+0000 7f0b9659c700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c590 tx=0x7f0b8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011590 con 0x7f0b9806ac40 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88011710 con 0x7f0b9806ac40 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9815dcd0 con 0x7f0b9806ac40 2023-12-24T18:37:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011ad0 con 0x7f0b9806ac40 2023-12-24T18:37:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9815e290 con 0x7f0b9806ac40 2023-12-24T18:37:06.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b980652e0 con 0x7f0b9806ac40 2023-12-24T18:37:06.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.634+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0b8801b3b0 con 0x7f0b9806ac40 2023-12-24T18:37:06.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.638+0000 7f0b867fc700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 0x7f0b78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:06.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.638+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f0b8807bde0 con 0x7f0b9806ac40 2023-12-24T18:37:06.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.638+0000 7f0b95d9b700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 0x7f0b78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:06.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.638+0000 7f0b95d9b700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 0x7f0b78062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b980c73e0 tx=0x7f0b8c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:06.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.642+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0b8804c040 con 0x7f0b9806ac40 2023-12-24T18:37:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b9806b0a0 con 0x7f0b9806ac40 2023-12-24T18:37:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b867fc700 1 -- 172.21.15.50:0/2183243945 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b88017020 con 0x7f0b9806ac40 2023-12-24T18:37:06.818 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 msgr2=0x7f0b78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 0x7f0b78062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b980c73e0 tx=0x7f0b8c008040 comp rx=0 tx=0).stop 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 msgr2=0x7f0b98156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.814+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c590 tx=0x7f0b8800c8a0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 shutdown_connections 2023-12-24T18:37:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0b78060550 0x7f0b78062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b980cf8a0 0x7f0b980c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b980cf4d0 0x7f0b9815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 --2- 172.21.15.50:0/2183243945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b9806ac40 0x7f0b98156470 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 >> 172.21.15.50:0/2183243945 conn(0x7f0b98067b30 msgr2=0x7f0b980b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 shutdown_connections 2023-12-24T18:37:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:06.818+0000 7f0b9cdc5700 1 -- 172.21.15.50:0/2183243945 wait complete. 2023-12-24T18:37:06.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:37:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.010+0000 7f721b59e700 1 Processor -- start 2023-12-24T18:37:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.010+0000 7f721b59e700 1 -- start start 2023-12-24T18:37:07.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f721c0cc770 0x7f721c0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0ce020 con 0x7f721c159020 2023-12-24T18:37:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0cb700 con 0x7f721c158c50 2023-12-24T18:37:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0b03b0 con 0x7f721c0cc770 2023-12-24T18:37:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f721c0cc770 0x7f721c0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f721c0cc770 0x7f721c0ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37196/0 (socket says 172.21.15.50:37196) 2023-12-24T18:37:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 -- 172.21.15.50:0/3666244489 learned_addr learned my addr 172.21.15.50:0/3666244489 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 -- 172.21.15.50:0/3666244489 >> v1:172.21.15.82:6789/0 conn(0x7f721c158c50 legacy=0x7f721c0afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 -- 172.21.15.50:0/3666244489 >> v1:172.21.15.50:6789/0 conn(0x7f721c159020 legacy=0x7f721c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 -- 172.21.15.50:0/3666244489 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0cd0c0 con 0x7f721c0cc770 2023-12-24T18:37:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.014+0000 7f721ad9d700 1 --2- 172.21.15.50:0/3666244489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c0cc770 0x7f721c0ccb80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7214009f20 tx=0x7f7214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1727396d43b9fb8e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f7219d9b700 1 -- 172.21.15.50:0/3666244489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e070 con 0x7f721c0cc770 2023-12-24T18:37:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f7219d9b700 1 -- 172.21.15.50:0/3666244489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400ba80 con 0x7f721c0cc770 2023-12-24T18:37:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f7219d9b700 1 -- 172.21.15.50:0/3666244489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140092e0 con 0x7f721c0cc770 2023-12-24T18:37:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 -- 172.21.15.50:0/3666244489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c0cc770 msgr2=0x7f721c0ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 --2- 172.21.15.50:0/3666244489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c0cc770 0x7f721c0ccb80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7214009f20 tx=0x7f7214009840 comp rx=0 tx=0).stop 2023-12-24T18:37:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 -- 172.21.15.50:0/3666244489 shutdown_connections 2023-12-24T18:37:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 --2- 172.21.15.50:0/3666244489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c0cc770 0x7f721c0ccb80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 -- 172.21.15.50:0/3666244489 >> 172.21.15.50:0/3666244489 conn(0x7f721c0670b0 msgr2=0x7f721c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 -- 172.21.15.50:0/3666244489 shutdown_connections 2023-12-24T18:37:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.018+0000 7f721b59e700 1 -- 172.21.15.50:0/3666244489 wait complete. 2023-12-24T18:37:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 Processor -- start 2023-12-24T18:37:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 -- start start 2023-12-24T18:37:07.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f721c0cc770 0x7f721c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f721c159020 0x7f721c15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15c1e0 con 0x7f721c158c50 2023-12-24T18:37:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c1557e0 con 0x7f721c159020 2023-12-24T18:37:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15a5c0 con 0x7f721c0cc770 2023-12-24T18:37:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37208/0 (socket says 172.21.15.50:37208) 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 -- 172.21.15.50:0/1802577523 learned_addr learned my addr 172.21.15.50:0/1802577523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721ad9d700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f721c159020 0x7f721c15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721a59c700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f721c0cc770 0x7f721c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 -- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f721c0cc770 msgr2=0x7f721c15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f721c0cc770 0x7f721c15aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 -- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f721c159020 msgr2=0x7f721c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f721c159020 0x7f721c15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 -- 172.21.15.50:0/1802577523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009ae0 con 0x7f721c158c50 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f7213fff700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f720400c4e0 tx=0x7f720400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204011590 con 0x7f721c158c50 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7204011710 con 0x7f721c158c50 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204011ad0 con 0x7f721c158c50 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.022+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c15b560 con 0x7f721c158c50 2023-12-24T18:37:07.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.026+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c15bb20 con 0x7f721c158c50 2023-12-24T18:37:07.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.026+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c15c320 con 0x7f721c158c50 2023-12-24T18:37:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.026+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f720401b3b0 con 0x7f721c158c50 2023-12-24T18:37:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.030+0000 7f72127fc700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 0x7f71fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.030+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f720407bff0 con 0x7f721c158c50 2023-12-24T18:37:07.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.030+0000 7f721a59c700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 0x7f71fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.030+0000 7f721a59c700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 0x7f71fc062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f720c003860 tx=0x7f720c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.034+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f720404c290 con 0x7f721c158c50 2023-12-24T18:37:07.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.210+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f721c04be40 con 0x7f721c158c50 2023-12-24T18:37:07.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.210+0000 7f72127fc700 1 -- 172.21.15.50:0/1802577523 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7204017020 con 0x7f721c158c50 2023-12-24T18:37:07.215 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 msgr2=0x7f71fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 0x7f71fc062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f720c003860 tx=0x7f720c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 msgr2=0x7f721c1552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f720400c4e0 tx=0x7f720400c8a0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 shutdown_connections 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71fc060550 0x7f71fc062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f721c159020 0x7f721c15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f721c158c50 0x7f721c1552a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 --2- 172.21.15.50:0/1802577523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f721c0cc770 0x7f721c15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 >> 172.21.15.50:0/1802577523 conn(0x7f721c0670b0 msgr2=0x7f721c158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.214+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 shutdown_connections 2023-12-24T18:37:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.218+0000 7f721b59e700 1 -- 172.21.15.50:0/1802577523 wait complete. 2023-12-24T18:37:07.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:37:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.406+0000 7f8fd762e700 1 Processor -- start 2023-12-24T18:37:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.406+0000 7f8fd762e700 1 -- start start 2023-12-24T18:37:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd762e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd762e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 0x7f8fd00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd762e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd006ccc0 con 0x7f8fd0140870 2023-12-24T18:37:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd762e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd015b990 con 0x7f8fd015af50 2023-12-24T18:37:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd762e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd015b3d0 con 0x7f8fd01404a0 2023-12-24T18:37:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59168/0 (socket says 172.21.15.50:59168) 2023-12-24T18:37:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 -- 172.21.15.50:0/2977891332 learned_addr learned my addr 172.21.15.50:0/2977891332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd4bc9700 1 --2- 172.21.15.50:0/2977891332 >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 0x7f8fd00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fc7fff700 1 -- 172.21.15.50:0/2977891332 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28705346 0 0) 0x7f8fd006ccc0 con 0x7f8fd0140870 2023-12-24T18:37:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fc7fff700 1 -- 172.21.15.50:0/2977891332 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fbc003570 con 0x7f8fd0140870 2023-12-24T18:37:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 -- 172.21.15.50:0/2977891332 >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 msgr2=0x7f8fd00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 --2- 172.21.15.50:0/2977891332 >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 0x7f8fd00ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 -- 172.21.15.50:0/2977891332 >> v1:172.21.15.82:6789/0 conn(0x7f8fd0140870 legacy=0x7f8fd006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd53ca700 1 -- 172.21.15.50:0/2977891332 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd015b6b0 con 0x7f8fd01404a0 2023-12-24T18:37:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.410+0000 7f8fd4bc9700 1 --2- 172.21.15.50:0/2977891332 >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 0x7f8fd00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd53ca700 1 --2- 172.21.15.50:0/2977891332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0099b0 tx=0x7f8fcc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979c678edc368365 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fc7fff700 1 -- 172.21.15.50:0/2977891332 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00b680 con 0x7f8fd01404a0 2023-12-24T18:37:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fc7fff700 1 -- 172.21.15.50:0/2977891332 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00b7e0 con 0x7f8fd01404a0 2023-12-24T18:37:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fc7fff700 1 -- 172.21.15.50:0/2977891332 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00bb80 con 0x7f8fd01404a0 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 -- 172.21.15.50:0/2977891332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 msgr2=0x7f8fd015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2977891332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0099b0 tx=0x7f8fcc009250 comp rx=0 tx=0).stop 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 -- 172.21.15.50:0/2977891332 shutdown_connections 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2977891332 >> v2:172.21.15.82:3300/0 conn(0x7f8fd015af50 0x7f8fd00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2977891332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd015aa10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 -- 172.21.15.50:0/2977891332 >> 172.21.15.50:0/2977891332 conn(0x7f8fd0067b80 msgr2=0x7f8fd00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 -- 172.21.15.50:0/2977891332 shutdown_connections 2023-12-24T18:37:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.414+0000 7f8fd762e700 1 -- 172.21.15.50:0/2977891332 wait complete. 2023-12-24T18:37:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 Processor -- start 2023-12-24T18:37:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 -- start start 2023-12-24T18:37:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd0139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 0x7f8fd0155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd015ea90 con 0x7f8fd0140870 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd015de80 con 0x7f8fd015d900 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd762e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd015e160 con 0x7f8fd01404a0 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37216/0 (socket says 172.21.15.50:37216) 2023-12-24T18:37:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 -- 172.21.15.50:0/2290680885 learned_addr learned my addr 172.21.15.50:0/2290680885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd53ca700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd0139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd5bcb700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 0x7f8fd0155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 -- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 msgr2=0x7f8fd0139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd0139700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 -- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 msgr2=0x7f8fd0155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 0x7f8fd0155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 -- 172.21.15.50:0/2290680885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0009420 con 0x7f8fd0140870 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd5bcb700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 0x7f8fd0155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.418+0000 7f8fd4bc9700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000ec80 tx=0x7f8fc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000c9d0 con 0x7f8fd0140870 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc000cb30 con 0x7f8fd0140870 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000ceb0 con 0x7f8fd0140870 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc0094f0 con 0x7f8fd0140870 2023-12-24T18:37:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd015e720 con 0x7f8fd0140870 2023-12-24T18:37:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd015ec00 con 0x7f8fd0140870 2023-12-24T18:37:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.422+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8fc0013680 con 0x7f8fd0140870 2023-12-24T18:37:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.426+0000 7f8fc57fa700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 0x7f8fb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.426+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f8fc007ce00 con 0x7f8fd0140870 2023-12-24T18:37:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.426+0000 7f8fd53ca700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 0x7f8fb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.426+0000 7f8fd53ca700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 0x7f8fb4062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0099b0 tx=0x7f8fcc017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.434+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8fc004d100 con 0x7f8fd0140870 2023-12-24T18:37:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.614+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fd00652e0 con 0x7f8fd0140870 2023-12-24T18:37:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.614+0000 7f8fc57fa700 1 -- 172.21.15.50:0/2290680885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fc0050720 con 0x7f8fd0140870 2023-12-24T18:37:07.618 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:37:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 msgr2=0x7f8fb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 0x7f8fb4062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0099b0 tx=0x7f8fcc017000 comp rx=0 tx=0).stop 2023-12-24T18:37:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 msgr2=0x7f8fd015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000ec80 tx=0x7f8fc00091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 shutdown_connections 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8fb4060550 0x7f8fb4062a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd015d900 0x7f8fd0155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fd0140870 0x7f8fd015d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 --2- 172.21.15.50:0/2290680885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fd01404a0 0x7f8fd0139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 >> 172.21.15.50:0/2290680885 conn(0x7f8fd0067b80 msgr2=0x7f8fd00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 shutdown_connections 2023-12-24T18:37:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.618+0000 7f8fd762e700 1 -- 172.21.15.50:0/2290680885 wait complete. 2023-12-24T18:37:07.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:37:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.814+0000 7fccf086e700 1 Processor -- start 2023-12-24T18:37:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.814+0000 7fccf086e700 1 -- start start 2023-12-24T18:37:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.814+0000 7fccf086e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccf086e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccec06ac40 0x7fccec15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccf086e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec15e960 con 0x7fccec160720 2023-12-24T18:37:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccf086e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec06b070 con 0x7fccec06ac40 2023-12-24T18:37:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccf086e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1600a0 con 0x7fccec160af0 2023-12-24T18:37:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59188/0 (socket says 172.21.15.50:59188) 2023-12-24T18:37:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 -- 172.21.15.50:0/3268059618 learned_addr learned my addr 172.21.15.50:0/3268059618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccea59c700 1 --1- 172.21.15.50:0/3268059618 >> v1:172.21.15.82:6789/0 conn(0x7fccec160720 0x7fccec06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:46074/0 (socket says 172.21.15.50:46074) 2023-12-24T18:37:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fccead9d700 1 --2- 172.21.15.50:0/3268059618 >> v2:172.21.15.82:3300/0 conn(0x7fccec06ac40 0x7fccec15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 -- 172.21.15.50:0/3268059618 >> v2:172.21.15.82:3300/0 conn(0x7fccec06ac40 msgr2=0x7fccec15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 --2- 172.21.15.50:0/3268059618 >> v2:172.21.15.82:3300/0 conn(0x7fccec06ac40 0x7fccec15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 -- 172.21.15.50:0/3268059618 >> v1:172.21.15.82:6789/0 conn(0x7fccec160720 legacy=0x7fccec06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 -- 172.21.15.50:0/3268059618 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec15dd50 con 0x7fccec160af0 2023-12-24T18:37:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce9d9b700 1 --2- 172.21.15.50:0/3268059618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcce00099b0 tx=0x7fcce0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d097e16e07104b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce959a700 1 -- 172.21.15.50:0/3268059618 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0009ea0 con 0x7fccec160af0 2023-12-24T18:37:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce959a700 1 -- 172.21.15.50:0/3268059618 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000b860 con 0x7fccec160af0 2023-12-24T18:37:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.818+0000 7fcce959a700 1 -- 172.21.15.50:0/3268059618 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000bc00 con 0x7fccec160af0 2023-12-24T18:37:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 -- 172.21.15.50:0/3268059618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 msgr2=0x7fccec06a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 --2- 172.21.15.50:0/3268059618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcce00099b0 tx=0x7fcce0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 -- 172.21.15.50:0/3268059618 shutdown_connections 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 --2- 172.21.15.50:0/3268059618 >> v2:172.21.15.82:3300/0 conn(0x7fccec06ac40 0x7fccec15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 --2- 172.21.15.50:0/3268059618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160af0 0x7fccec06a700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 -- 172.21.15.50:0/3268059618 >> 172.21.15.50:0/3268059618 conn(0x7fccec067b80 msgr2=0x7fccec0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 -- 172.21.15.50:0/3268059618 shutdown_connections 2023-12-24T18:37:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.822+0000 7fccf086e700 1 -- 172.21.15.50:0/3268059618 wait complete. 2023-12-24T18:37:07.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 Processor -- start 2023-12-24T18:37:07.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 -- start start 2023-12-24T18:37:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccec06ac40 0x7fccec14bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160720 0x7fccec0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0a47f0 con 0x7fccec160af0 2023-12-24T18:37:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c62b0 con 0x7fccec06ac40 2023-12-24T18:37:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccf086e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c6590 con 0x7fccec160720 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37232/0 (socket says 172.21.15.50:37232) 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 -- 172.21.15.50:0/595684858 learned_addr learned my addr 172.21.15.50:0/595684858 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccea59c700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccec06ac40 0x7fccec14bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fcce9d9b700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160720 0x7fccec0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 -- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160720 msgr2=0x7fccec0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160720 0x7fccec0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 -- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccec06ac40 msgr2=0x7fccec14bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccec06ac40 0x7fccec14bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 -- 172.21.15.50:0/595684858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00094f0 con 0x7fccec160af0 2023-12-24T18:37:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccead9d700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009df0 tx=0x7fcce400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.826+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400caa0 con 0x7fccec160af0 2023-12-24T18:37:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400f040 con 0x7fccec160af0 2023-12-24T18:37:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400ce70 con 0x7fccec160af0 2023-12-24T18:37:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0c6870 con 0x7fccec160af0 2023-12-24T18:37:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0c6e30 con 0x7fccec160af0 2023-12-24T18:37:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec0c7020 con 0x7fccec160af0 2023-12-24T18:37:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.830+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcce4014690 con 0x7fccec160af0 2023-12-24T18:37:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.834+0000 7fccda7fc700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 0x7fcccc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.834+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fcce407d330 con 0x7fccec160af0 2023-12-24T18:37:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.834+0000 7fccea59c700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 0x7fcccc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.834+0000 7fccea59c700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 0x7fcccc062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccdc004fd0 tx=0x7fccdc007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:07.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:07.838+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcce4051020 con 0x7fccec160af0 2023-12-24T18:37:08.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.018+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fccec0652e0 con 0x7fccec160af0 2023-12-24T18:37:08.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.018+0000 7fccda7fc700 1 -- 172.21.15.50:0/595684858 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcce4050bb0 con 0x7fccec160af0 2023-12-24T18:37:08.023 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:08.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 msgr2=0x7fcccc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 0x7fcccc062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccdc004fd0 tx=0x7fccdc007eb0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 msgr2=0x7fccec0c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009df0 tx=0x7fcce400b040 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 shutdown_connections 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcccc060550 0x7fcccc062a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccec160af0 0x7fccec0c56d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccec160720 0x7fccec0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 --2- 172.21.15.50:0/595684858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccec06ac40 0x7fccec14bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 >> 172.21.15.50:0/595684858 conn(0x7fccec067b80 msgr2=0x7fccec0c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 shutdown_connections 2023-12-24T18:37:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.022+0000 7fccf086e700 1 -- 172.21.15.50:0/595684858 wait complete. 2023-12-24T18:37:08.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:08.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.214+0000 7faa86585700 1 Processor -- start 2023-12-24T18:37:08.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.214+0000 7faa86585700 1 -- start start 2023-12-24T18:37:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa86585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8014df60 0x7faa8006af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa86585700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa800b1590 0x7faa800b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa86585700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa800cb240 con 0x7faa80158080 2023-12-24T18:37:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa86585700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800ca6b0 con 0x7faa800b1590 2023-12-24T18:37:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa86585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800c8e30 con 0x7faa8014df60 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa84b22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa800b1590 0x7faa800b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa84b22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa800b1590 0x7faa800b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:47170/0 (socket says 172.21.15.50:47170) 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa84b22700 1 -- 172.21.15.50:0/3904014939 learned_addr learned my addr 172.21.15.50:0/3904014939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa7ffff700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8014df60 0x7faa8006af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.218+0000 7faa77fff700 1 --1- 172.21.15.50:0/3904014939 >> v1:172.21.15.82:6789/0 conn(0x7faa80158080 0x7faa800c8720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:46090/0 (socket says 172.21.15.50:46090) 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa84b22700 1 -- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8014df60 msgr2=0x7faa8006af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa84b22700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8014df60 0x7faa8006af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa84b22700 1 -- 172.21.15.50:0/3904014939 >> v1:172.21.15.82:6789/0 conn(0x7faa80158080 legacy=0x7faa800c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa84b22700 1 -- 172.21.15.50:0/3904014939 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800b1f20 con 0x7faa800b1590 2023-12-24T18:37:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa84b22700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800b19e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa78009f50 tx=0x7faa78009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c3aa741cc8c94b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa7f7fe700 1 -- 172.21.15.50:0/3904014939 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800e070 con 0x7faa800b1590 2023-12-24T18:37:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa7f7fe700 1 -- 172.21.15.50:0/3904014939 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7800b9c0 con 0x7faa800b1590 2023-12-24T18:37:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa7f7fe700 1 -- 172.21.15.50:0/3904014939 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa780092e0 con 0x7faa800b1590 2023-12-24T18:37:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 -- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 msgr2=0x7faa800b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800b19e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa78009f50 tx=0x7faa78009840 comp rx=0 tx=0).stop 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 -- 172.21.15.50:0/3904014939 shutdown_connections 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800b19e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 --2- 172.21.15.50:0/3904014939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa8014df60 0x7faa8006af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 -- 172.21.15.50:0/3904014939 >> 172.21.15.50:0/3904014939 conn(0x7faa800670b0 msgr2=0x7faa80067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 -- 172.21.15.50:0/3904014939 shutdown_connections 2023-12-24T18:37:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.222+0000 7faa86585700 1 -- 172.21.15.50:0/3904014939 wait complete. 2023-12-24T18:37:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 Processor -- start 2023-12-24T18:37:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 -- start start 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 0x7faa8014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa80158080 0x7faa8014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa800b0c70 con 0x7faa8014df60 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8014f780 con 0x7faa800b1590 2023-12-24T18:37:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa86585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8014cbf0 con 0x7faa80158080 2023-12-24T18:37:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 0x7faa8014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:47172/0 (socket says 172.21.15.50:47172) 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa7ffff700 1 -- 172.21.15.50:0/3753012942 learned_addr learned my addr 172.21.15.50:0/3753012942 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa84b22700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa80158080 0x7faa8014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 -- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa80158080 msgr2=0x7faa8014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa80158080 0x7faa8014c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 -- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 msgr2=0x7faa800c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.226+0000 7faa77fff700 1 -- 172.21.15.50:0/3753012942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78009ae0 con 0x7faa8014df60 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa77fff700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 0x7faa8014f240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c590 tx=0x7faa68007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68005b40 con 0x7faa8014df60 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68005cc0 con 0x7faa8014df60 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68007320 con 0x7faa8014df60 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa800c5bd0 con 0x7faa8014df60 2023-12-24T18:37:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa800c6190 con 0x7faa8014df60 2023-12-24T18:37:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.230+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800652e0 con 0x7faa8014df60 2023-12-24T18:37:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.234+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faa6801c440 con 0x7faa8014df60 2023-12-24T18:37:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.234+0000 7faa7cff9700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 0x7faa60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.234+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7faa6807bff0 con 0x7faa8014df60 2023-12-24T18:37:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.234+0000 7faa7ffff700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 0x7faa60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.234+0000 7faa7ffff700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 0x7faa60062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e70 tx=0x7faa700091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.242+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa6804c250 con 0x7faa8014df60 2023-12-24T18:37:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.418+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8006b780 con 0x7faa8014df60 2023-12-24T18:37:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.418+0000 7faa7cff9700 1 -- 172.21.15.50:0/3753012942 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17143 (secure 0 0 0) 0x7faa68017090 con 0x7faa8014df60 2023-12-24T18:37:08.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:08.423 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:36:34.190879+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 msgr2=0x7faa60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 0x7faa60062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e70 tx=0x7faa700091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 msgr2=0x7faa8014f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 0x7faa8014f240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c590 tx=0x7faa68007eb0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 shutdown_connections 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faa60060550 0x7faa60062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa80158080 0x7faa8014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa8014df60 0x7faa8014f240 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 --2- 172.21.15.50:0/3753012942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa800b1590 0x7faa800c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 >> 172.21.15.50:0/3753012942 conn(0x7faa800670b0 msgr2=0x7faa80153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 shutdown_connections 2023-12-24T18:37:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.422+0000 7faa86585700 1 -- 172.21.15.50:0/3753012942 wait complete. 2023-12-24T18:37:08.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:37:08.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 Processor -- start 2023-12-24T18:37:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 -- start start 2023-12-24T18:37:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa7540cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7540cc780 0x7fa7540ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75406a580 con 0x7fa75406cd40 2023-12-24T18:37:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540cd110 con 0x7fa7540cc780 2023-12-24T18:37:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa75880c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75406a7d0 con 0x7fa754158c40 2023-12-24T18:37:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa752ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7540cc780 0x7fa7540ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa752ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7540cc780 0x7fa7540ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37250/0 (socket says 172.21.15.50:37250) 2023-12-24T18:37:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa752ffd700 1 -- 172.21.15.50:0/159181229 learned_addr learned my addr 172.21.15.50:0/159181229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.610+0000 7fa7537fe700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa7540cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa752ffd700 1 -- 172.21.15.50:0/159181229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 msgr2=0x7fa7540cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa752ffd700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa7540cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa752ffd700 1 -- 172.21.15.50:0/159181229 >> v1:172.21.15.82:6789/0 conn(0x7fa75406cd40 legacy=0x7fa75406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa752ffd700 1 -- 172.21.15.50:0/159181229 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75406aab0 con 0x7fa7540cc780 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa7537fe700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa7540cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa752ffd700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7540cc780 0x7fa7540ccbd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7480099b0 tx=0x7fa748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7ada7aa350daeb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa7527fc700 1 -- 172.21.15.50:0/159181229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748009ea0 con 0x7fa7540cc780 2023-12-24T18:37:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa7527fc700 1 -- 172.21.15.50:0/159181229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74800b860 con 0x7fa7540cc780 2023-12-24T18:37:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa7527fc700 1 -- 172.21.15.50:0/159181229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800bc00 con 0x7fa7540cc780 2023-12-24T18:37:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 -- 172.21.15.50:0/159181229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7540cc780 msgr2=0x7fa7540ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7540cc780 0x7fa7540ccbd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7480099b0 tx=0x7fa748009250 comp rx=0 tx=0).stop 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 -- 172.21.15.50:0/159181229 shutdown_connections 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7540cc780 0x7fa7540ccbd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 --2- 172.21.15.50:0/159181229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa7540cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 -- 172.21.15.50:0/159181229 >> 172.21.15.50:0/159181229 conn(0x7fa7540d0800 msgr2=0x7fa7540b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 -- 172.21.15.50:0/159181229 shutdown_connections 2023-12-24T18:37:08.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.614+0000 7fa75880c700 1 -- 172.21.15.50:0/159181229 wait complete. 2023-12-24T18:37:08.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.618+0000 7fa75880c700 1 Processor -- start 2023-12-24T18:37:08.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.618+0000 7fa75880c700 1 -- start start 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7540cc780 0x7fa75414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa75414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75414ade0 con 0x7fa75406cd40 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540b33b0 con 0x7fa7540cc780 2023-12-24T18:37:08.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa754150d50 con 0x7fa754158c40 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37266/0 (socket says 172.21.15.50:37266) 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 -- 172.21.15.50:0/531441773 learned_addr learned my addr 172.21.15.50:0/531441773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa752ffd700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7540cc780 0x7fa75414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa753fff700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa75414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 -- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 msgr2=0x7fa75414a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa75414a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 -- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7540cc780 msgr2=0x7fa75414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7540cc780 0x7fa75414d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 -- 172.21.15.50:0/531441773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009420 con 0x7fa75406cd40 2023-12-24T18:37:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa753fff700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa75414a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa7537fe700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa74400ecb0 tx=0x7fa7440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400c850 con 0x7fa75406cd40 2023-12-24T18:37:08.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400c9b0 con 0x7fa75406cd40 2023-12-24T18:37:08.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400cd30 con 0x7fa75406cd40 2023-12-24T18:37:08.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7480094f0 con 0x7fa75406cd40 2023-12-24T18:37:08.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.622+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75414e920 con 0x7fa75406cd40 2023-12-24T18:37:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.626+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75404be40 con 0x7fa75406cd40 2023-12-24T18:37:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.626+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa744013680 con 0x7fa75406cd40 2023-12-24T18:37:08.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.630+0000 7fa73b7fe700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 0x7fa740062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:08.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.630+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fa74407cd50 con 0x7fa75406cd40 2023-12-24T18:37:08.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.630+0000 7fa752ffd700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 0x7fa740062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:08.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.630+0000 7fa752ffd700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 0x7fa740062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7480099b0 tx=0x7fa748017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:08.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.634+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa744050a40 con 0x7fa75406cd40 2023-12-24T18:37:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.806+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa75406ad90 con 0x7fa75406cd40 2023-12-24T18:37:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.806+0000 7fa73b7fe700 1 -- 172.21.15.50:0/531441773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7440505d0 con 0x7fa75406cd40 2023-12-24T18:37:08.811 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 msgr2=0x7fa740062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 0x7fa740062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7480099b0 tx=0x7fa748017000 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 msgr2=0x7fa754151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa74400ecb0 tx=0x7fa7440091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 shutdown_connections 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa740060580 0x7fa740062a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa754158c40 0x7fa75414a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7540cc780 0x7fa75414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 --2- 172.21.15.50:0/531441773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75406cd40 0x7fa754151510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 >> 172.21.15.50:0/531441773 conn(0x7fa7540d0800 msgr2=0x7fa754062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 shutdown_connections 2023-12-24T18:37:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:08.810+0000 7fa75880c700 1 -- 172.21.15.50:0/531441773 wait complete. 2023-12-24T18:37:08.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:37:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 Processor -- start 2023-12-24T18:37:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 -- start start 2023-12-24T18:37:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d940ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d940caa40 0x7f6d9406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9406ccc0 con 0x7f6d941404a0 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9415b990 con 0x7f6d940caa40 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d99c65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940caea0 con 0x7f6d94140870 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d937fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d941404a0 0x7f6d9415aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57310/0 (socket says 172.21.15.50:57310) 2023-12-24T18:37:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.002+0000 7f6d937fe700 1 -- 172.21.15.50:0/4219922142 learned_addr learned my addr 172.21.15.50:0/4219922142 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 --2- 172.21.15.50:0/4219922142 >> v2:172.21.15.82:3300/0 conn(0x7f6d940caa40 0x7f6d9406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d940ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d927fc700 1 -- 172.21.15.50:0/4219922142 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394556372 0 0) 0x7f6d9406ccc0 con 0x7f6d941404a0 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d927fc700 1 -- 172.21.15.50:0/4219922142 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d7c003570 con 0x7f6d941404a0 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 -- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 msgr2=0x7f6d940ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d940ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 -- 172.21.15.50:0/4219922142 >> v1:172.21.15.50:6789/0 conn(0x7f6d941404a0 legacy=0x7f6d9415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 -- 172.21.15.50:0/4219922142 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9415b120 con 0x7f6d940caa40 2023-12-24T18:37:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d940ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d93fff700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d940caa40 0x7f6d9406d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ba2b68f60b0628 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d927fc700 1 -- 172.21.15.50:0/4219922142 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00b640 con 0x7f6d940caa40 2023-12-24T18:37:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d927fc700 1 -- 172.21.15.50:0/4219922142 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00b7a0 con 0x7f6d940caa40 2023-12-24T18:37:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d927fc700 1 -- 172.21.15.50:0/4219922142 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00bb40 con 0x7f6d940caa40 2023-12-24T18:37:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 -- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d940caa40 msgr2=0x7f6d9406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d940caa40 0x7f6d9406d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 -- 172.21.15.50:0/4219922142 shutdown_connections 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d940caa40 0x7f6d9406d150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 --2- 172.21.15.50:0/4219922142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d940ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 -- 172.21.15.50:0/4219922142 >> 172.21.15.50:0/4219922142 conn(0x7f6d94067b80 msgr2=0x7f6d940cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 -- 172.21.15.50:0/4219922142 shutdown_connections 2023-12-24T18:37:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.006+0000 7f6d99c65700 1 -- 172.21.15.50:0/4219922142 wait complete. 2023-12-24T18:37:09.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.010+0000 7f6d99c65700 1 Processor -- start 2023-12-24T18:37:09.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.010+0000 7f6d99c65700 1 -- start start 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 0x7f6d9413d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d9413d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9416eac0 con 0x7f6d940caa40 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9413dc50 con 0x7f6d941404a0 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94171440 con 0x7f6d94140870 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37280/0 (socket says 172.21.15.50:37280) 2023-12-24T18:37:09.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 -- 172.21.15.50:0/1501138711 learned_addr learned my addr 172.21.15.50:0/1501138711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 0x7f6d9413d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d93fff700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d9413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 -- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 msgr2=0x7f6d9413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d9413d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 -- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 msgr2=0x7f6d9413d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 0x7f6d9413d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 -- 172.21.15.50:0/1501138711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009420 con 0x7f6d940caa40 2023-12-24T18:37:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 0x7f6d9413d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d937fe700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cd60 tx=0x7f6d84001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400ab30 con 0x7f6d940caa40 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400acb0 con 0x7f6d940caa40 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9416e190 con 0x7f6d940caa40 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84007340 con 0x7f6d940caa40 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.014+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9416e750 con 0x7f6d940caa40 2023-12-24T18:37:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.018+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d940652e0 con 0x7f6d940caa40 2023-12-24T18:37:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.018+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6d84007770 con 0x7f6d940caa40 2023-12-24T18:37:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.018+0000 7f6d7b7fe700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 0x7f6d80062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.022+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f6d8407d060 con 0x7f6d940caa40 2023-12-24T18:37:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.022+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 0x7f6d80062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.022+0000 7f6d92ffd700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 0x7f6d80062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d88008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.026+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d8404d340 con 0x7f6d940caa40 2023-12-24T18:37:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.198+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d9415b3d0 con 0x7f6d940caa40 2023-12-24T18:37:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d7b7fe700 1 -- 172.21.15.50:0/1501138711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d84050960 con 0x7f6d940caa40 2023-12-24T18:37:09.204 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 msgr2=0x7f6d80062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 0x7f6d80062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d88008040 comp rx=0 tx=0).stop 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 msgr2=0x7f6d94159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cd60 tx=0x7f6d84001b10 comp rx=0 tx=0).stop 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 shutdown_connections 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d80060580 0x7f6d80062a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d94140870 0x7f6d9413d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d941404a0 0x7f6d9413d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 --2- 172.21.15.50:0/1501138711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d940caa40 0x7f6d94159c30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 >> 172.21.15.50:0/1501138711 conn(0x7f6d94067b80 msgr2=0x7f6d940af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 shutdown_connections 2023-12-24T18:37:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.202+0000 7f6d99c65700 1 -- 172.21.15.50:0/1501138711 wait complete. 2023-12-24T18:37:09.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:37:09.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.410+0000 7f9f3a945700 1 Processor -- start 2023-12-24T18:37:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.410+0000 7f9f3a945700 1 -- start start 2023-12-24T18:37:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f3a945700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f34158e00 0x7f9f340b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f3a945700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340b3fd0 con 0x7f9f3406c820 2023-12-24T18:37:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f3a945700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340b33c0 con 0x7f9f3406ae20 2023-12-24T18:37:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f3a945700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340b36a0 con 0x7f9f34158e00 2023-12-24T18:37:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f337fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f3406c820 0x7f9f3406a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50264/0 (socket says 172.21.15.50:50264) 2023-12-24T18:37:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f337fe700 1 -- 172.21.15.50:0/495210995 learned_addr learned my addr 172.21.15.50:0/495210995 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f33fff700 1 --2- 172.21.15.50:0/495210995 >> v2:172.21.15.50:3300/0 conn(0x7f9f34158e00 0x7f9f340b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f32ffd700 1 -- 172.21.15.50:0/495210995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023930422 0 0) 0x7f9f340b3fd0 con 0x7f9f3406c820 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f32ffd700 1 -- 172.21.15.50:0/495210995 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f1c003570 con 0x7f9f3406c820 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f33fff700 1 -- 172.21.15.50:0/495210995 >> v1:172.21.15.82:6789/0 conn(0x7f9f3406ae20 legacy=0x7f9f34162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f33fff700 1 -- 172.21.15.50:0/495210995 >> v1:172.21.15.50:6789/0 conn(0x7f9f3406c820 legacy=0x7f9f3406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f33fff700 1 -- 172.21.15.50:0/495210995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340b3980 con 0x7f9f34158e00 2023-12-24T18:37:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f33fff700 1 --2- 172.21.15.50:0/495210995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f34158e00 0x7f9f340b2de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f240098e0 tx=0x7f9f240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe33209124b27c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.414+0000 7f9f32ffd700 1 -- 172.21.15.50:0/495210995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400b640 con 0x7f9f34158e00 2023-12-24T18:37:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f32ffd700 1 -- 172.21.15.50:0/495210995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400b7a0 con 0x7f9f34158e00 2023-12-24T18:37:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f32ffd700 1 -- 172.21.15.50:0/495210995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400bb40 con 0x7f9f34158e00 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- 172.21.15.50:0/495210995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f34158e00 msgr2=0x7f9f340b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 --2- 172.21.15.50:0/495210995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f34158e00 0x7f9f340b2de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f240098e0 tx=0x7f9f240091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- 172.21.15.50:0/495210995 shutdown_connections 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 --2- 172.21.15.50:0/495210995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f34158e00 0x7f9f340b2de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- 172.21.15.50:0/495210995 >> 172.21.15.50:0/495210995 conn(0x7f9f34067b80 msgr2=0x7f9f340cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- 172.21.15.50:0/495210995 shutdown_connections 2023-12-24T18:37:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- 172.21.15.50:0/495210995 wait complete. 2023-12-24T18:37:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 Processor -- start 2023-12-24T18:37:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.418+0000 7f9f3a945700 1 -- start start 2023-12-24T18:37:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 0x7f9f3413cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 0x7f9f3415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3416dae0 con 0x7f9f3406c820 2023-12-24T18:37:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3414c200 con 0x7f9f3406ae20 2023-12-24T18:37:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3414c610 con 0x7f9f34158e00 2023-12-24T18:37:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34858/0 (socket says 172.21.15.50:34858) 2023-12-24T18:37:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 -- 172.21.15.50:0/2315943772 learned_addr learned my addr 172.21.15.50:0/2315943772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f33fff700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 0x7f9f3413cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f38ee2700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 0x7f9f3415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 -- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 msgr2=0x7f9f3415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 0x7f9f3415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 -- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 msgr2=0x7f9f3413cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 0x7f9f3413cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 -- 172.21.15.50:0/2315943772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24009420 con 0x7f9f3406c820 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f33fff700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 0x7f9f3413cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f38ee2700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 0x7f9f3415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f337fe700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c7c0 tx=0x7f9f28007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28005b30 con 0x7f9f3406c820 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28005c90 con 0x7f9f3406c820 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3416d240 con 0x7f9f3406c820 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28007340 con 0x7f9f3406c820 2023-12-24T18:37:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.422+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3416d800 con 0x7f9f3406c820 2023-12-24T18:37:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340652e0 con 0x7f9f3406c820 2023-12-24T18:37:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9f2801b400 con 0x7f9f3406c820 2023-12-24T18:37:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f1bfff700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 0x7f9f20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f9f2807c620 con 0x7f9f3406c820 2023-12-24T18:37:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f33fff700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 0x7f9f20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.426+0000 7f9f33fff700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 0x7f9f20062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f24003080 tx=0x7f9f24017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.434+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f2804c900 con 0x7f9f3406c820 2023-12-24T18:37:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.618+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f3414c3e0 con 0x7f9f3406c820 2023-12-24T18:37:09.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.622+0000 7f9f1bfff700 1 -- 172.21.15.50:0/2315943772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f2804ff20 con 0x7f9f3406c820 2023-12-24T18:37:09.624 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 msgr2=0x7f9f20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 0x7f9f20062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f24003080 tx=0x7f9f24017000 comp rx=0 tx=0).stop 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 msgr2=0x7f9f3416cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c7c0 tx=0x7f9f28007e00 comp rx=0 tx=0).stop 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 shutdown_connections 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f20060550 0x7f9f20062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34158e00 0x7f9f3415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3406c820 0x7f9f3416cb80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 --2- 172.21.15.50:0/2315943772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406ae20 0x7f9f3413cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 >> 172.21.15.50:0/2315943772 conn(0x7f9f34067b80 msgr2=0x7f9f34159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 shutdown_connections 2023-12-24T18:37:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.626+0000 7f9f3a945700 1 -- 172.21.15.50:0/2315943772 wait complete. 2023-12-24T18:37:09.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:37:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.830+0000 7f1cd080c700 1 Processor -- start 2023-12-24T18:37:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.830+0000 7f1cd080c700 1 -- start start 2023-12-24T18:37:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 0x7f1ccc0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ccc06cd40 0x7f1ccc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc06a580 con 0x7f1ccc06cd40 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0cd110 con 0x7f1ccc158c40 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1cd080c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc06d700 con 0x7f1ccc0cc780 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 0x7f1ccc0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ccc06cd40 0x7f1ccc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 0x7f1ccc0cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:42000/0 (socket says 172.21.15.50:42000) 2023-12-24T18:37:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccb7fe700 1 -- 172.21.15.50:0/1714239623 learned_addr learned my addr 172.21.15.50:0/1714239623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 -- 172.21.15.50:0/1714239623 >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 msgr2=0x7f1ccc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/1714239623 >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 0x7f1ccc0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 -- 172.21.15.50:0/1714239623 >> v2:172.21.15.50:3300/0 conn(0x7f1ccc06cd40 msgr2=0x7f1ccc06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/1714239623 >> v2:172.21.15.50:3300/0 conn(0x7f1ccc06cd40 0x7f1ccc06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.834+0000 7f1ccaffd700 1 -- 172.21.15.50:0/1714239623 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc06a7d0 con 0x7f1ccc0cc780 2023-12-24T18:37:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/1714239623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc0ccbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc069f90 tx=0x7f1cc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f76bfb6dc707f03 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cca7fc700 1 -- 172.21.15.50:0/1714239623 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0011630 con 0x7f1ccc0cc780 2023-12-24T18:37:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cca7fc700 1 -- 172.21.15.50:0/1714239623 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00117b0 con 0x7f1ccc0cc780 2023-12-24T18:37:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cca7fc700 1 -- 172.21.15.50:0/1714239623 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0011b70 con 0x7f1ccc0cc780 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 -- 172.21.15.50:0/1714239623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 msgr2=0x7f1ccc0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 --2- 172.21.15.50:0/1714239623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc0ccbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc069f90 tx=0x7f1cc00091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 -- 172.21.15.50:0/1714239623 shutdown_connections 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 --2- 172.21.15.50:0/1714239623 >> v2:172.21.15.50:3300/0 conn(0x7f1ccc06cd40 0x7f1ccc06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 --2- 172.21.15.50:0/1714239623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc0ccbd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 --2- 172.21.15.50:0/1714239623 >> v2:172.21.15.82:3300/0 conn(0x7f1ccc158c40 0x7f1ccc0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 -- 172.21.15.50:0/1714239623 >> 172.21.15.50:0/1714239623 conn(0x7f1ccc0d0800 msgr2=0x7f1ccc0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 -- 172.21.15.50:0/1714239623 shutdown_connections 2023-12-24T18:37:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.838+0000 7f1cd080c700 1 -- 172.21.15.50:0/1714239623 wait complete. 2023-12-24T18:37:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 Processor -- start 2023-12-24T18:37:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 -- start start 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 0x7f1ccc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc15b6a0 con 0x7f1ccc06cd40 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc153f80 con 0x7f1ccc158c40 2023-12-24T18:37:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1cd080c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc15b8b0 con 0x7f1ccc0cc780 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34876/0 (socket says 172.21.15.50:34876) 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 -- 172.21.15.50:0/740342309 learned_addr learned my addr 172.21.15.50:0/740342309 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccbfff700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 0x7f1ccc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 -- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 msgr2=0x7f1ccc15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 -- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 msgr2=0x7f1ccc153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 0x7f1ccc153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 -- 172.21.15.50:0/740342309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009420 con 0x7f1ccc06cd40 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccbfff700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 0x7f1ccc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.842+0000 7f1ccb7fe700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00e980 tx=0x7f1cbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00ee70 con 0x7f1ccc06cd40 2023-12-24T18:37:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00c7f0 con 0x7f1ccc06cd40 2023-12-24T18:37:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00cb70 con 0x7f1ccc06cd40 2023-12-24T18:37:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc15bb90 con 0x7f1ccc06cd40 2023-12-24T18:37:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc15c150 con 0x7f1ccc06cd40 2023-12-24T18:37:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc04be40 con 0x7f1ccc06cd40 2023-12-24T18:37:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.846+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1cbc013470 con 0x7f1ccc06cd40 2023-12-24T18:37:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.850+0000 7f1cb37fe700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 0x7f1cb8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.850+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f1cbc07cd50 con 0x7f1ccc06cd40 2023-12-24T18:37:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.850+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 0x7f1cb8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.850+0000 7f1ccaffd700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 0x7f1cb8062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc069f90 tx=0x7f1cc0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:09.854+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cbc04ceb0 con 0x7f1ccc06cd40 2023-12-24T18:37:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.026+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1ccc16a720 con 0x7f1ccc06cd40 2023-12-24T18:37:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.026+0000 7f1cb37fe700 1 -- 172.21.15.50:0/740342309 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1cbc0504d0 con 0x7f1ccc06cd40 2023-12-24T18:37:10.032 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 msgr2=0x7f1cb8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 0x7f1cb8062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc069f90 tx=0x7f1cc0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 msgr2=0x7f1ccc16a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00e980 tx=0x7f1cbc009250 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 shutdown_connections 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1cb8060580 0x7f1cb8062a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc158c40 0x7f1ccc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ccc0cc780 0x7f1ccc15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 --2- 172.21.15.50:0/740342309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc06cd40 0x7f1ccc16a0f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 >> 172.21.15.50:0/740342309 conn(0x7f1ccc0d0800 msgr2=0x7f1ccc0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 shutdown_connections 2023-12-24T18:37:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.034+0000 7f1cd080c700 1 -- 172.21.15.50:0/740342309 wait complete. 2023-12-24T18:37:10.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.214+0000 7f45125c5700 1 Processor -- start 2023-12-24T18:37:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.214+0000 7f45125c5700 1 -- start start 2023-12-24T18:37:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f45125c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 0x7f450c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f45125c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f450c154450 0x7f450c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f45125c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c06c820 con 0x7f450c06aca0 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f45125c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c154de0 con 0x7f450c154450 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f45125c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c06b960 con 0x7f450c0c6d00 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f4510b62700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f450c06aca0 0x7f450c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50272/0 (socket says 172.21.15.50:50272) 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f4510b62700 1 -- 172.21.15.50:0/4258558892 learned_addr learned my addr 172.21.15.50:0/4258558892 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f4503fff700 1 --2- 172.21.15.50:0/4258558892 >> v2:172.21.15.82:3300/0 conn(0x7f450c154450 0x7f450c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 --2- 172.21.15.50:0/4258558892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 0x7f450c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450b7fe700 1 -- 172.21.15.50:0/4258558892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400519764 0 0) 0x7f450c06c820 con 0x7f450c06aca0 2023-12-24T18:37:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450b7fe700 1 -- 172.21.15.50:0/4258558892 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f8003570 con 0x7f450c06aca0 2023-12-24T18:37:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 -- 172.21.15.50:0/4258558892 >> v2:172.21.15.82:3300/0 conn(0x7f450c154450 msgr2=0x7f450c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 --2- 172.21.15.50:0/4258558892 >> v2:172.21.15.82:3300/0 conn(0x7f450c154450 0x7f450c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 -- 172.21.15.50:0/4258558892 >> v1:172.21.15.50:6789/0 conn(0x7f450c06aca0 legacy=0x7f450c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 -- 172.21.15.50:0/4258558892 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c06bc40 con 0x7f450c0c6d00 2023-12-24T18:37:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450bfff700 1 --2- 172.21.15.50:0/4258558892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 0x7f450c0c70d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0098e0 tx=0x7f44fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bcaed9ba0414a52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450b7fe700 1 -- 172.21.15.50:0/4258558892 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc011630 con 0x7f450c0c6d00 2023-12-24T18:37:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.218+0000 7f450b7fe700 1 -- 172.21.15.50:0/4258558892 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc011790 con 0x7f450c0c6d00 2023-12-24T18:37:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f450b7fe700 1 -- 172.21.15.50:0/4258558892 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc011b30 con 0x7f450c0c6d00 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- 172.21.15.50:0/4258558892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 msgr2=0x7f450c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 --2- 172.21.15.50:0/4258558892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 0x7f450c0c70d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0098e0 tx=0x7f44fc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- 172.21.15.50:0/4258558892 shutdown_connections 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 --2- 172.21.15.50:0/4258558892 >> v2:172.21.15.82:3300/0 conn(0x7f450c154450 0x7f450c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 --2- 172.21.15.50:0/4258558892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c0c6d00 0x7f450c0c70d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- 172.21.15.50:0/4258558892 >> 172.21.15.50:0/4258558892 conn(0x7f450c0cbba0 msgr2=0x7f450c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- 172.21.15.50:0/4258558892 shutdown_connections 2023-12-24T18:37:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- 172.21.15.50:0/4258558892 wait complete. 2023-12-24T18:37:10.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 Processor -- start 2023-12-24T18:37:10.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.222+0000 7f45125c5700 1 -- start start 2023-12-24T18:37:10.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f450c0c6d00 0x7f450c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 0x7f450c0a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c9770 con 0x7f450c06aca0 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c16df70 con 0x7f450c0c6d00 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0cb6a0 con 0x7f450c154450 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34886/0 (socket says 172.21.15.50:34886) 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 -- 172.21.15.50:0/2116839925 learned_addr learned my addr 172.21.15.50:0/2116839925 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4503fff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f450c0c6d00 0x7f450c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4510b62700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 0x7f450c0a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 -- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 msgr2=0x7f450c0a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 0x7f450c0a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 -- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f450c0c6d00 msgr2=0x7f450c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f450c0c6d00 0x7f450c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 -- 172.21.15.50:0/2116839925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc009420 con 0x7f450c06aca0 2023-12-24T18:37:10.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4510b62700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 0x7f450c0a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:10.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f450bfff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f450c06baa0 tx=0x7f44fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc011b10 con 0x7f450c06aca0 2023-12-24T18:37:10.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c16d920 con 0x7f450c06aca0 2023-12-24T18:37:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc000cc0 con 0x7f450c06aca0 2023-12-24T18:37:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc025620 con 0x7f450c06aca0 2023-12-24T18:37:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.226+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c153120 con 0x7f450c06aca0 2023-12-24T18:37:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.230+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c0652e0 con 0x7f450c06aca0 2023-12-24T18:37:10.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.230+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f44fc025a10 con 0x7f450c06aca0 2023-12-24T18:37:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.234+0000 7f4508ff9700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 0x7f44ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.234+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f44fc07e470 con 0x7f450c06aca0 2023-12-24T18:37:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.234+0000 7f4503fff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 0x7f44ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.234+0000 7f4503fff700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 0x7f44ec062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f450c0ab4f0 tx=0x7f44f40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.242+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f44fc04e5d0 con 0x7f450c06aca0 2023-12-24T18:37:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.414+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f450c06bf20 con 0x7f450c06aca0 2023-12-24T18:37:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.418+0000 7f4508ff9700 1 -- 172.21.15.50:0/2116839925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17564 (secure 0 0 0) 0x7f44fc051bf0 con 0x7f450c06aca0 2023-12-24T18:37:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:10.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:09.482737+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 msgr2=0x7f44ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 0x7f44ec062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f450c0ab4f0 tx=0x7f44f40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 msgr2=0x7f450c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f450c06baa0 tx=0x7f44fc017000 comp rx=0 tx=0).stop 2023-12-24T18:37:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 shutdown_connections 2023-12-24T18:37:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f44ec060550 0x7f44ec062a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f450c154450 0x7f450c0a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f450c0c6d00 0x7f450c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 --2- 172.21.15.50:0/2116839925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450c06aca0 0x7f450c152be0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 >> 172.21.15.50:0/2116839925 conn(0x7f450c0cbba0 msgr2=0x7f450c159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 shutdown_connections 2023-12-24T18:37:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.422+0000 7f45125c5700 1 -- 172.21.15.50:0/2116839925 wait complete. 2023-12-24T18:37:10.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:37:10.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:10.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.618+0000 7fa13af85700 1 Processor -- start 2023-12-24T18:37:10.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.622+0000 7fa13af85700 1 -- start start 2023-12-24T18:37:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.622+0000 7fa13af85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa134142b30 0x7fa13406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa13af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa1340c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa13af85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa134142f00 con 0x7fa134068e40 2023-12-24T18:37:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa13af85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340c7800 con 0x7fa134142b30 2023-12-24T18:37:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa13af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340c7ae0 con 0x7fa1340c72d0 2023-12-24T18:37:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa134142b30 0x7fa13406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa133fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa1340c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa139522700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa134068e40 0x7fa1340c1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57014/0 (socket says 172.21.15.50:57014) 2023-12-24T18:37:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa139522700 1 -- 172.21.15.50:0/3923984688 learned_addr learned my addr 172.21.15.50:0/3923984688 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa1337fe700 1 -- 172.21.15.50:0/3923984688 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040331581 0 0) 0x7fa134142f00 con 0x7fa134068e40 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa1337fe700 1 -- 172.21.15.50:0/3923984688 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa124003570 con 0x7fa134068e40 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 -- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 msgr2=0x7fa1340c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa1340c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 -- 172.21.15.50:0/3923984688 >> v1:172.21.15.82:6789/0 conn(0x7fa134068e40 legacy=0x7fa1340c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 -- 172.21.15.50:0/3923984688 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340c7dc0 con 0x7fa134142b30 2023-12-24T18:37:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa133fff700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa1340c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.626+0000 7fa138d21700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134142b30 0x7fa13406ec50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1280098e0 tx=0x7fa1280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75cf70a8b49eccf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa1337fe700 1 -- 172.21.15.50:0/3923984688 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011630 con 0x7fa134142b30 2023-12-24T18:37:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa1337fe700 1 -- 172.21.15.50:0/3923984688 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128011790 con 0x7fa134142b30 2023-12-24T18:37:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa1337fe700 1 -- 172.21.15.50:0/3923984688 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011b30 con 0x7fa134142b30 2023-12-24T18:37:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134142b30 msgr2=0x7fa13406ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134142b30 0x7fa13406ec50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1280098e0 tx=0x7fa1280091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- 172.21.15.50:0/3923984688 shutdown_connections 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa1340c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 --2- 172.21.15.50:0/3923984688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134142b30 0x7fa13406ec50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- 172.21.15.50:0/3923984688 >> 172.21.15.50:0/3923984688 conn(0x7fa1340c9700 msgr2=0x7fa1340c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- 172.21.15.50:0/3923984688 shutdown_connections 2023-12-24T18:37:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- 172.21.15.50:0/3923984688 wait complete. 2023-12-24T18:37:10.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 Processor -- start 2023-12-24T18:37:10.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.630+0000 7fa13af85700 1 -- start start 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134068e40 0x7fa1341414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa134140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134169bf0 con 0x7fa134142b30 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134141250 con 0x7fa134068e40 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340c6fe0 con 0x7fa1340c72d0 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34896/0 (socket says 172.21.15.50:34896) 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 -- 172.21.15.50:0/1893874861 learned_addr learned my addr 172.21.15.50:0/1893874861 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa138d21700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134068e40 0x7fa1341414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa133fff700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa134140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 -- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 msgr2=0x7fa134140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa134140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 -- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134068e40 msgr2=0x7fa1341414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134068e40 0x7fa1341414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 -- 172.21.15.50:0/1893874861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120009420 con 0x7fa134142b30 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa139522700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001460 tx=0x7fa12c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00a870 con 0x7fa134142b30 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c00a9d0 con 0x7fa134142b30 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128009420 con 0x7fa134142b30 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00ad50 con 0x7fa134142b30 2023-12-24T18:37:10.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.634+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa134169250 con 0x7fa134142b30 2023-12-24T18:37:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.638+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1341694d0 con 0x7fa134142b30 2023-12-24T18:37:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.638+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa12c007300 con 0x7fa134142b30 2023-12-24T18:37:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.642+0000 7fa130ff9700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 0x7fa118062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.642+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fa12c07cf40 con 0x7fa134142b30 2023-12-24T18:37:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.642+0000 7fa138d21700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 0x7fa118062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.642+0000 7fa138d21700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 0x7fa118062a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1280091e0 tx=0x7fa128017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.646+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa12c04d120 con 0x7fa134142b30 2023-12-24T18:37:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.818+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1341696c0 con 0x7fa134142b30 2023-12-24T18:37:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa130ff9700 1 -- 172.21.15.50:0/1893874861 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa12c050740 con 0x7fa134142b30 2023-12-24T18:37:10.825 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 msgr2=0x7fa118062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 0x7fa118062a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1280091e0 tx=0x7fa128017000 comp rx=0 tx=0).stop 2023-12-24T18:37:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 msgr2=0x7fa13415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001460 tx=0x7fa12c001a40 comp rx=0 tx=0).stop 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 shutdown_connections 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa118060580 0x7fa118062a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa134142b30 0x7fa13415ea10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1340c72d0 0x7fa134140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 --2- 172.21.15.50:0/1893874861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa134068e40 0x7fa1341414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.822+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 >> 172.21.15.50:0/1893874861 conn(0x7fa1340c9700 msgr2=0x7fa1340b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.826+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 shutdown_connections 2023-12-24T18:37:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:10.826+0000 7fa13af85700 1 -- 172.21.15.50:0/1893874861 wait complete. 2023-12-24T18:37:10.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:37:11.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.022+0000 7f80ddfcc700 1 Processor -- start 2023-12-24T18:37:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.022+0000 7f80ddfcc700 1 -- start start 2023-12-24T18:37:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80ddfcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80d806c820 0x7f80d80cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80ddfcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80d80cc210 0x7f80d806cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80ddfcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80cd380 con 0x7f80d806d130 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80ddfcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80cc770 con 0x7f80d80cc210 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80ddfcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80cca50 con 0x7f80d806c820 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80d80cc210 0x7f80d806cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80d80cc210 0x7f80d806cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34912/0 (socket says 172.21.15.50:34912) 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 -- 172.21.15.50:0/2616116156 learned_addr learned my addr 172.21.15.50:0/2616116156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80dcfca700 1 --2- 172.21.15.50:0/2616116156 >> v2:172.21.15.82:3300/0 conn(0x7f80d806c820 0x7f80d80cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80dd7cb700 1 --1- 172.21.15.50:0/2616116156 >> v1:172.21.15.50:6789/0 conn(0x7f80d806d130 0x7f80d80ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50286/0 (socket says 172.21.15.50:50286) 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 -- 172.21.15.50:0/2616116156 >> v2:172.21.15.82:3300/0 conn(0x7f80d806c820 msgr2=0x7f80d80cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 --2- 172.21.15.50:0/2616116156 >> v2:172.21.15.82:3300/0 conn(0x7f80d806c820 0x7f80d80cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 -- 172.21.15.50:0/2616116156 >> v1:172.21.15.50:6789/0 conn(0x7f80d806d130 legacy=0x7f80d80ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 -- 172.21.15.50:0/2616116156 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80ccd30 con 0x7f80d80cc210 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d7fff700 1 --2- 172.21.15.50:0/2616116156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d80cc210 0x7f80d806cbf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80d80636c0 tx=0x7f80c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17098a688acaa8a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d77fe700 1 -- 172.21.15.50:0/2616116156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4009e70 con 0x7f80d80cc210 2023-12-24T18:37:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d77fe700 1 -- 172.21.15.50:0/2616116156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400b860 con 0x7f80d80cc210 2023-12-24T18:37:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.026+0000 7f80d77fe700 1 -- 172.21.15.50:0/2616116156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400bc00 con 0x7f80d80cc210 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2616116156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d80cc210 msgr2=0x7f80d806cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2616116156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d80cc210 0x7f80d806cbf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80d80636c0 tx=0x7f80c4009250 comp rx=0 tx=0).stop 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2616116156 shutdown_connections 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2616116156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d80cc210 0x7f80d806cbf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2616116156 >> v2:172.21.15.82:3300/0 conn(0x7f80d806c820 0x7f80d80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2616116156 >> 172.21.15.50:0/2616116156 conn(0x7f80d80ca600 msgr2=0x7f80d80caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2616116156 shutdown_connections 2023-12-24T18:37:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.030+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2616116156 wait complete. 2023-12-24T18:37:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 Processor -- start 2023-12-24T18:37:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 -- start start 2023-12-24T18:37:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80d806d130 0x7f80d814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d80cc210 0x7f80d80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d814dcf0 con 0x7f80d806c820 2023-12-24T18:37:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80b1000 con 0x7f80d80cc210 2023-12-24T18:37:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80ddfcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80672e0 con 0x7f80d806d130 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34920/0 (socket says 172.21.15.50:34920) 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 -- 172.21.15.50:0/2953943863 learned_addr learned my addr 172.21.15.50:0/2953943863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80d7fff700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80d806d130 0x7f80d814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dd7cb700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d80cc210 0x7f80d80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 -- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80d806d130 msgr2=0x7f80d814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80d806d130 0x7f80d814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 -- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d80cc210 msgr2=0x7f80d80c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d80cc210 0x7f80d80c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.034+0000 7f80dcfca700 1 -- 172.21.15.50:0/2953943863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40094f0 con 0x7f80d806c820 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80dcfca700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00ecb0 tx=0x7f80cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00c970 con 0x7f80d806c820 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d80b39c0 con 0x7f80d806c820 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc00cad0 con 0x7f80d806c820 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00ce70 con 0x7f80d806c820 2023-12-24T18:37:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80b0d20 con 0x7f80d806c820 2023-12-24T18:37:11.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.038+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80670b0 con 0x7f80d806c820 2023-12-24T18:37:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.042+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f80cc013680 con 0x7f80d806c820 2023-12-24T18:37:11.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.042+0000 7f80d4ff9700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 0x7f80bc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.042+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f80cc07cf80 con 0x7f80d806c820 2023-12-24T18:37:11.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.042+0000 7f80d7fff700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 0x7f80bc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.042+0000 7f80d7fff700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 0x7f80bc062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f80d80636c0 tx=0x7f80c4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.050+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80cc0acbe0 con 0x7f80d806c820 2023-12-24T18:37:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.230+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80d80cb210 con 0x7f80d806c820 2023-12-24T18:37:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.230+0000 7f80d4ff9700 1 -- 172.21.15.50:0/2953943863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80d80cb210 con 0x7f80d806c820 2023-12-24T18:37:11.234 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 msgr2=0x7f80bc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 0x7f80bc062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f80d80636c0 tx=0x7f80c4017000 comp rx=0 tx=0).stop 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 msgr2=0x7f80d8069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00ecb0 tx=0x7f80cc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 shutdown_connections 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f80bc060580 0x7f80bc062a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d80cc210 0x7f80d80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80d806d130 0x7f80d814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 --2- 172.21.15.50:0/2953943863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80d806c820 0x7f80d8069cf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 >> 172.21.15.50:0/2953943863 conn(0x7f80d80ca600 msgr2=0x7f80d814e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 shutdown_connections 2023-12-24T18:37:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.234+0000 7f80ddfcc700 1 -- 172.21.15.50:0/2953943863 wait complete. 2023-12-24T18:37:11.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:37:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.426+0000 7fcefc785700 1 Processor -- start 2023-12-24T18:37:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.426+0000 7fcefc785700 1 -- start start 2023-12-24T18:37:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefc785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcef406ae20 0x7fcef40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefc785700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 0x7fcef40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefc785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40b3fd0 con 0x7fcef4158e00 2023-12-24T18:37:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefc785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b33c0 con 0x7fcef406ae20 2023-12-24T18:37:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefc785700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b36a0 con 0x7fcef406c820 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcef9d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcef406ae20 0x7fcef40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefa521700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcef4158e00 0x7fcef406a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50298/0 (socket says 172.21.15.50:50298) 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefa521700 1 -- 172.21.15.50:0/2208709127 learned_addr learned my addr 172.21.15.50:0/2208709127 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcefad22700 1 --2- 172.21.15.50:0/2208709127 >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 0x7fcef40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.430+0000 7fcef951f700 1 -- 172.21.15.50:0/2208709127 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129517865 0 0) 0x7fcef40b3fd0 con 0x7fcef4158e00 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef951f700 1 -- 172.21.15.50:0/2208709127 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee0003570 con 0x7fcef4158e00 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef9d20700 1 -- 172.21.15.50:0/2208709127 >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 msgr2=0x7fcef40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef9d20700 1 --2- 172.21.15.50:0/2208709127 >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 0x7fcef40b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef9d20700 1 -- 172.21.15.50:0/2208709127 >> v1:172.21.15.50:6789/0 conn(0x7fcef4158e00 legacy=0x7fcef406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef9d20700 1 -- 172.21.15.50:0/2208709127 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40b3980 con 0x7fcef406ae20 2023-12-24T18:37:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefad22700 1 --2- 172.21.15.50:0/2208709127 >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 0x7fcef40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef9d20700 1 --2- 172.21.15.50:0/2208709127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef406ae20 0x7fcef40b2de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b60b0 tx=0x7fcee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af07552bd8b6e372 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef951f700 1 -- 172.21.15.50:0/2208709127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011630 con 0x7fcef406ae20 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef951f700 1 -- 172.21.15.50:0/2208709127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4011790 con 0x7fcef406ae20 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcef951f700 1 -- 172.21.15.50:0/2208709127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011b30 con 0x7fcef406ae20 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 -- 172.21.15.50:0/2208709127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef406ae20 msgr2=0x7fcef40b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 --2- 172.21.15.50:0/2208709127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef406ae20 0x7fcef40b2de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b60b0 tx=0x7fcee40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 -- 172.21.15.50:0/2208709127 shutdown_connections 2023-12-24T18:37:11.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 --2- 172.21.15.50:0/2208709127 >> v2:172.21.15.82:3300/0 conn(0x7fcef406c820 0x7fcef40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 --2- 172.21.15.50:0/2208709127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef406ae20 0x7fcef40b2de0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 -- 172.21.15.50:0/2208709127 >> 172.21.15.50:0/2208709127 conn(0x7fcef4067b80 msgr2=0x7fcef40cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:11.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 -- 172.21.15.50:0/2208709127 shutdown_connections 2023-12-24T18:37:11.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.434+0000 7fcefc785700 1 -- 172.21.15.50:0/2208709127 wait complete. 2023-12-24T18:37:11.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 Processor -- start 2023-12-24T18:37:11.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- start start 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcef406ae20 0x7fcef415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 0x7fcef4149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415e5f0 con 0x7fcef4158e00 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef414afd0 con 0x7fcef406c820 2023-12-24T18:37:11.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415dad0 con 0x7fcef406ae20 2023-12-24T18:37:11.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34932/0 (socket says 172.21.15.50:34932) 2023-12-24T18:37:11.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 -- 172.21.15.50:0/4264671330 learned_addr learned my addr 172.21.15.50:0/4264671330 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:11.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcef9d20700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 0x7fcef4149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefa521700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcef406ae20 0x7fcef415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 -- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcef406ae20 msgr2=0x7fcef415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcef406ae20 0x7fcef415d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 -- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 msgr2=0x7fcef4149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 0x7fcef4149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 -- 172.21.15.50:0/4264671330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009420 con 0x7fcef4158e00 2023-12-24T18:37:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcef9d20700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 0x7fcef4149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefad22700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d100 tx=0x7fceec0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00dda0 con 0x7fcef4158e00 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00f040 con 0x7fcef4158e00 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec015690 con 0x7fcef4158e00 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef415dd50 con 0x7fcef4158e00 2023-12-24T18:37:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.438+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef415e310 con 0x7fcef4158e00 2023-12-24T18:37:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.442+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef414b160 con 0x7fcef4158e00 2023-12-24T18:37:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.442+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fceec01e3b0 con 0x7fcef4158e00 2023-12-24T18:37:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.442+0000 7fceea7fc700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 0x7fced8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.446+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fceec07d180 con 0x7fcef4158e00 2023-12-24T18:37:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.446+0000 7fcefa521700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 0x7fced8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.446+0000 7fcefa521700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 0x7fced8062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcef00058d0 tx=0x7fcef0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.450+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fceec04d2e0 con 0x7fcef4158e00 2023-12-24T18:37:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.626+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcef40652e0 con 0x7fcef4158e00 2023-12-24T18:37:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.626+0000 7fceea7fc700 1 -- 172.21.15.50:0/4264671330 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceec050900 con 0x7fcef4158e00 2023-12-24T18:37:11.632 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 msgr2=0x7fced8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 0x7fced8062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcef00058d0 tx=0x7fcef0009040 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 msgr2=0x7fcef41695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d100 tx=0x7fceec0099b0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 shutdown_connections 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fced8060550 0x7fced8062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef4158e00 0x7fcef41695d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcef406c820 0x7fcef4149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 --2- 172.21.15.50:0/4264671330 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcef406ae20 0x7fcef415d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 >> 172.21.15.50:0/4264671330 conn(0x7fcef4067b80 msgr2=0x7fcef40d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 shutdown_connections 2023-12-24T18:37:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.630+0000 7fcefc785700 1 -- 172.21.15.50:0/4264671330 wait complete. 2023-12-24T18:37:11.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:37:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.818+0000 7f94a58cd700 1 Processor -- start 2023-12-24T18:37:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.822+0000 7f94a58cd700 1 -- start start 2023-12-24T18:37:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.822+0000 7f94a58cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94a0155c20 0x7f94a015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 0x7f94a00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00acf70 con 0x7f94a0156490 2023-12-24T18:37:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a015a890 con 0x7f94a0155c20 2023-12-24T18:37:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0156930 con 0x7f94a0155ff0 2023-12-24T18:37:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94a0155c20 0x7f94a015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94a0155c20 0x7f94a015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34944/0 (socket says 172.21.15.50:34944) 2023-12-24T18:37:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 -- 172.21.15.50:0/2521290026 learned_addr learned my addr 172.21.15.50:0/2521290026 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949e7fc700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 0x7f94a00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 -- 172.21.15.50:0/2521290026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 msgr2=0x7f94a00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 0x7f94a00b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 -- 172.21.15.50:0/2521290026 >> v1:172.21.15.82:6789/0 conn(0x7f94a0156490 legacy=0x7f94a00af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 -- 172.21.15.50:0/2521290026 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0156c10 con 0x7f94a0155c20 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949e7fc700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 0x7f94a00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949effd700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155c20 0x7f94a015a350 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94900099b0 tx=0x7f9490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f459f2acacc639 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949dffb700 1 -- 172.21.15.50:0/2521290026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000b860 con 0x7f94a0155c20 2023-12-24T18:37:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949dffb700 1 -- 172.21.15.50:0/2521290026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000b9c0 con 0x7f94a0155c20 2023-12-24T18:37:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f949dffb700 1 -- 172.21.15.50:0/2521290026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000bd60 con 0x7f94a0155c20 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 -- 172.21.15.50:0/2521290026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155c20 msgr2=0x7f94a015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.826+0000 7f94a58cd700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155c20 0x7f94a015a350 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94900099b0 tx=0x7f9490009250 comp rx=0 tx=0).stop 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 -- 172.21.15.50:0/2521290026 shutdown_connections 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155ff0 0x7f94a00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 --2- 172.21.15.50:0/2521290026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155c20 0x7f94a015a350 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 -- 172.21.15.50:0/2521290026 >> 172.21.15.50:0/2521290026 conn(0x7f94a006c820 msgr2=0x7f94a006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 -- 172.21.15.50:0/2521290026 shutdown_connections 2023-12-24T18:37:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 -- 172.21.15.50:0/2521290026 wait complete. 2023-12-24T18:37:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 Processor -- start 2023-12-24T18:37:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.830+0000 7f94a58cd700 1 -- start start 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155c20 0x7f94a013d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a0156490 0x7f94a01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a016c360 con 0x7f94a0155ff0 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a016b750 con 0x7f94a0156490 2023-12-24T18:37:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a016ba30 con 0x7f94a0155c20 2023-12-24T18:37:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34952/0 (socket says 172.21.15.50:34952) 2023-12-24T18:37:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 -- 172.21.15.50:0/378038172 learned_addr learned my addr 172.21.15.50:0/378038172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949effd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155c20 0x7f94a013d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949f7fe700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a0156490 0x7f94a01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 -- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155c20 msgr2=0x7f94a013d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155c20 0x7f94a013d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 -- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a0156490 msgr2=0x7f94a01550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a0156490 0x7f94a01550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 -- 172.21.15.50:0/378038172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900094f0 con 0x7f94a0155ff0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f949e7fc700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f949400e8d0 tx=0x7f9494008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013410 con 0x7f94a0155ff0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494013570 con 0x7f94a0155ff0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013910 con 0x7f94a0155ff0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a016bd10 con 0x7f94a0155ff0 2023-12-24T18:37:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.834+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a013d7c0 con 0x7f94a0155ff0 2023-12-24T18:37:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.838+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a016c510 con 0x7f94a0155ff0 2023-12-24T18:37:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.838+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9494013d00 con 0x7f94a0155ff0 2023-12-24T18:37:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.842+0000 7f9486ffd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 0x7f948c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.842+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f949407c970 con 0x7f94a0155ff0 2023-12-24T18:37:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.842+0000 7f949effd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 0x7f948c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.842+0000 7f949effd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 0x7f948c062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94900099b0 tx=0x7f9490017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:11.850+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94a016c510 con 0x7f94a0155ff0 2023-12-24T18:37:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.022+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f94a00652e0 con 0x7f94a0155ff0 2023-12-24T18:37:12.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.022+0000 7f9486ffd700 1 -- 172.21.15.50:0/378038172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f949404cad0 con 0x7f94a0155ff0 2023-12-24T18:37:12.028 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:12.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 msgr2=0x7f948c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 0x7f948c062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94900099b0 tx=0x7f9490017000 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 msgr2=0x7f94a0154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f949400e8d0 tx=0x7f9494008040 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 shutdown_connections 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f948c060550 0x7f948c062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a0156490 0x7f94a01550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a0155ff0 0x7f94a0154b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 --2- 172.21.15.50:0/378038172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94a0155c20 0x7f94a013d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 >> 172.21.15.50:0/378038172 conn(0x7f94a006c820 msgr2=0x7f94a0158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 shutdown_connections 2023-12-24T18:37:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.026+0000 7f94a58cd700 1 -- 172.21.15.50:0/378038172 wait complete. 2023-12-24T18:37:12.106 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-12-24T18:37:12.106 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:37:12.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-12-24T18:37:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.266+0000 7fe82184c700 1 Processor -- start 2023-12-24T18:37:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.266+0000 7fe82184c700 1 -- start start 2023-12-24T18:37:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82184c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe81c0b0f50 0x7fe81c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82184c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06e110 con 0x7fe81c06b6b0 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82184c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06bb40 con 0x7fe81c0ad220 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82184c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06be20 con 0x7fe81c0b0f50 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe81c06b6b0 0x7fe81c155710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50300/0 (socket says 172.21.15.50:50300) 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81bfff700 1 -- 172.21.15.50:0/3205936411 learned_addr learned my addr 172.21.15.50:0/3205936411 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82104b700 1 --2- 172.21.15.50:0/3205936411 >> v2:172.21.15.82:3300/0 conn(0x7fe81c0b0f50 0x7fe81c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282514563 0 0) 0x7fe81c06e110 con 0x7fe81c06b6b0 2023-12-24T18:37:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003570 con 0x7fe81c06b6b0 2023-12-24T18:37:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82104b700 1 -- 172.21.15.50:0/3205936411 >> v1:172.21.15.82:6789/0 conn(0x7fe81c0ad220 legacy=0x7fe81c06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82104b700 1 -- 172.21.15.50:0/3205936411 >> v1:172.21.15.50:6789/0 conn(0x7fe81c06b6b0 legacy=0x7fe81c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203463850 0 0) 0x7fe81c06bb40 con 0x7fe81c0ad220 2023-12-24T18:37:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82104b700 1 -- 172.21.15.50:0/3205936411 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0af740 con 0x7fe81c0b0f50 2023-12-24T18:37:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe82104b700 1 --2- 172.21.15.50:0/3205936411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c0b0f50 0x7fe81c0ad5f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe814009e60 tx=0x7fe814009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e4e75f9492845b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400e070 con 0x7fe81c0b0f50 2023-12-24T18:37:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400bb60 con 0x7fe81c0b0f50 2023-12-24T18:37:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.270+0000 7fe81b7fe700 1 -- 172.21.15.50:0/3205936411 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814012430 con 0x7fe81c0b0f50 2023-12-24T18:37:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- 172.21.15.50:0/3205936411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c0b0f50 msgr2=0x7fe81c0ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 --2- 172.21.15.50:0/3205936411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c0b0f50 0x7fe81c0ad5f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe814009e60 tx=0x7fe814009780 comp rx=0 tx=0).stop 2023-12-24T18:37:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- 172.21.15.50:0/3205936411 shutdown_connections 2023-12-24T18:37:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 --2- 172.21.15.50:0/3205936411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c0b0f50 0x7fe81c0ad5f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- 172.21.15.50:0/3205936411 >> 172.21.15.50:0/3205936411 conn(0x7fe81c067b80 msgr2=0x7fe81c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- 172.21.15.50:0/3205936411 shutdown_connections 2023-12-24T18:37:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- 172.21.15.50:0/3205936411 wait complete. 2023-12-24T18:37:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 Processor -- start 2023-12-24T18:37:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.274+0000 7fe82184c700 1 -- start start 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c06b6b0 0x7fe81c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe81c0b0f50 0x7fe81c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c15ba20 con 0x7fe81c0ad220 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c151ab0 con 0x7fe81c06b6b0 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1548d0 con 0x7fe81c0b0f50 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34964/0 (socket says 172.21.15.50:34964) 2023-12-24T18:37:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 -- 172.21.15.50:0/3753849045 learned_addr learned my addr 172.21.15.50:0/3753849045 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82104b700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe81c0b0f50 0x7fe81c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82084a700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c06b6b0 0x7fe81c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 -- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe81c0b0f50 msgr2=0x7fe81c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe81c0b0f50 0x7fe81c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 -- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c06b6b0 msgr2=0x7fe81c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c06b6b0 0x7fe81c151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 -- 172.21.15.50:0/3753849045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009a20 con 0x7fe81c0ad220 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe81bfff700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8080011e0 tx=0x7fe808007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808005b30 con 0x7fe81c0ad220 2023-12-24T18:37:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808005c90 con 0x7fe81c0ad220 2023-12-24T18:37:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808007320 con 0x7fe81c0ad220 2023-12-24T18:37:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c154bb0 con 0x7fe81c0ad220 2023-12-24T18:37:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.278+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c155170 con 0x7fe81c0ad220 2023-12-24T18:37:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.282+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c15b7f0 con 0x7fe81c0ad220 2023-12-24T18:37:12.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.282+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe808007690 con 0x7fe81c0ad220 2023-12-24T18:37:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.282+0000 7fe818ff9700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 0x7fe800062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.282+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fe80807c110 con 0x7fe81c0ad220 2023-12-24T18:37:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.286+0000 7fe82084a700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 0x7fe800062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.286+0000 7fe82084a700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 0x7fe800062ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe810007fd0 tx=0x7fe810007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:12.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.290+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe80804c2f0 con 0x7fe81c0ad220 2023-12-24T18:37:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:12.522+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fe81c15bb60 con 0x7fe81c0ad220 2023-12-24T18:37:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.534+0000 7fe818ff9700 1 -- 172.21.15.50:0/3753849045 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe80804f910 con 0x7fe81c0ad220 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 msgr2=0x7fe800062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 0x7fe800062ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe810007fd0 tx=0x7fe810007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 msgr2=0x7fe81c153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8080011e0 tx=0x7fe808007df0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 shutdown_connections 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe800060620 0x7fe800062ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe81c0b0f50 0x7fe81c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe81c0ad220 0x7fe81c153f30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 --2- 172.21.15.50:0/3753849045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c06b6b0 0x7fe81c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 >> 172.21.15.50:0/3753849045 conn(0x7fe81c067b80 msgr2=0x7fe81c06ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 shutdown_connections 2023-12-24T18:37:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.538+0000 7fe82184c700 1 -- 172.21.15.50:0/3753849045 wait complete. 2023-12-24T18:37:13.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:37:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 Processor -- start 2023-12-24T18:37:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 -- start start 2023-12-24T18:37:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c06a580 con 0x7f9c0c06cd40 2023-12-24T18:37:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0cd110 con 0x7f9c0c0cc780 2023-12-24T18:37:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.742+0000 7f9c10ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c06a7d0 con 0x7f9c0c158c40 2023-12-24T18:37:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:42088/0 (socket says 172.21.15.50:42088) 2023-12-24T18:37:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 -- 172.21.15.50:0/2195818724 learned_addr learned my addr 172.21.15.50:0/2195818724 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0bfff700 1 --1- 172.21.15.50:0/2195818724 >> v1:172.21.15.82:6789/0 conn(0x7f9c0c06cd40 0x7f9c0c06d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57050/0 (socket says 172.21.15.50:57050) 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 -- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 msgr2=0x7f9c0c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 -- 172.21.15.50:0/2195818724 >> v1:172.21.15.82:6789/0 conn(0x7f9c0c06cd40 legacy=0x7f9c0c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 -- 172.21.15.50:0/2195818724 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c06aab0 con 0x7f9c0c0cc780 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0a7fc700 1 -- 172.21.15.50:0/2195818724 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079002243 0 0) 0x7f9c0c06a580 con 0x7f9c0c06cd40 2023-12-24T18:37:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0b7fe700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0affd700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9c000099b0 tx=0x7f9c00009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49be7225c5778194 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.746+0000 7f9c0a7fc700 1 -- 172.21.15.50:0/2195818724 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00009ea0 con 0x7f9c0c0cc780 2023-12-24T18:37:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c0a7fc700 1 -- 172.21.15.50:0/2195818724 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000b860 con 0x7f9c0c0cc780 2023-12-24T18:37:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c0a7fc700 1 -- 172.21.15.50:0/2195818724 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000bc00 con 0x7f9c0c0cc780 2023-12-24T18:37:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 -- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 msgr2=0x7f9c0c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9c000099b0 tx=0x7f9c00009250 comp rx=0 tx=0).stop 2023-12-24T18:37:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 -- 172.21.15.50:0/2195818724 shutdown_connections 2023-12-24T18:37:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c0ccbd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/2195818724 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 -- 172.21.15.50:0/2195818724 >> 172.21.15.50:0/2195818724 conn(0x7f9c0c0d0800 msgr2=0x7f9c0c0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 -- 172.21.15.50:0/2195818724 shutdown_connections 2023-12-24T18:37:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.750+0000 7f9c10ee3700 1 -- 172.21.15.50:0/2195818724 wait complete. 2023-12-24T18:37:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 Processor -- start 2023-12-24T18:37:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 -- start start 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0cace0 con 0x7f9c0c06cd40 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c15c3a0 con 0x7f9c0c0cc780 2023-12-24T18:37:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c10ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0ca060 con 0x7f9c0c158c40 2023-12-24T18:37:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34972/0 (socket says 172.21.15.50:34972) 2023-12-24T18:37:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 -- 172.21.15.50:0/3399369702 learned_addr learned my addr 172.21.15.50:0/3399369702 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0bfff700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0affd700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 -- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 msgr2=0x7f9c0c153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 -- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 msgr2=0x7f9c0c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.754+0000 7f9c0b7fe700 1 -- 172.21.15.50:0/3399369702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009a20 con 0x7f9c0c06cd40 2023-12-24T18:37:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9c0b7fe700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c0c0 tx=0x7f9bfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00cc00 con 0x7f9c0c06cd40 2023-12-24T18:37:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00f040 con 0x7f9c0c06cd40 2023-12-24T18:37:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc014480 con 0x7f9c0c06cd40 2023-12-24T18:37:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c000094f0 con 0x7f9c0c06cd40 2023-12-24T18:37:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0ca900 con 0x7f9c0c06cd40 2023-12-24T18:37:13.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c04be40 con 0x7f9c0c06cd40 2023-12-24T18:37:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.758+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9bfc0147f0 con 0x7f9c0c06cd40 2023-12-24T18:37:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.762+0000 7f9bf37fe700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 0x7f9bf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.762+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f9bfc07d9a0 con 0x7f9c0c06cd40 2023-12-24T18:37:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.762+0000 7f9c0affd700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 0x7f9bf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:13.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.766+0000 7f9c0affd700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 0x7f9bf8062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c000099b0 tx=0x7f9c00017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:13.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.770+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9bfc04db00 con 0x7f9c0c06cd40 2023-12-24T18:37:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.946+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9c0c06ad90 con 0x7f9c0c06cd40 2023-12-24T18:37:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.958+0000 7f9bf37fe700 1 -- 172.21.15.50:0/3399369702 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9bfc051120 con 0x7f9c0c06cd40 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 msgr2=0x7f9bf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 0x7f9bf8062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c000099b0 tx=0x7f9c00017000 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 msgr2=0x7f9c0c0cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c0c0 tx=0x7f9bfc00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 shutdown_connections 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9bf8060550 0x7f9bf8062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c0c158c40 0x7f9c0c153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c0c0cc780 0x7f9c0c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 --2- 172.21.15.50:0/3399369702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c0c06cd40 0x7f9c0c0cb900 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 >> 172.21.15.50:0/3399369702 conn(0x7f9c0c0d0800 msgr2=0x7f9c0c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 shutdown_connections 2023-12-24T18:37:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:13.962+0000 7f9c10ee3700 1 -- 172.21.15.50:0/3399369702 wait complete. 2023-12-24T18:37:13.987 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:37:13.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:37:14.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:37:14.077 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:37:14.077 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:37:14.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:14.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-24T18:37:14.136 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:37:14.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:14.136 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:37:14.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-24T18:37:14.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:14.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-24T18:37:14.205 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:37:14.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:14.206 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T18:37:14.236 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-24T18:37:14.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:14.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-24T18:37:14.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:37:14.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:14.279 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T18:37:14.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-24T18:37:14.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:14.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-24T18:37:14.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T18:37:14.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:14.382 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T18:37:14.449 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:37:14.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 Processor -- start 2023-12-24T18:37:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 -- start start 2023-12-24T18:37:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc85c06def0 0x7fc85c168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c06ca50 con 0x7fc85c0ca770 2023-12-24T18:37:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c06b520 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.622+0000 7fc8620cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0c6980 con 0x7fc85c06def0 2023-12-24T18:37:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc853fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc85c0ca770 0x7fc85c15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50316/0 (socket says 172.21.15.50:50316) 2023-12-24T18:37:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc853fff700 1 -- 172.21.15.50:0/1540925528 learned_addr learned my addr 172.21.15.50:0/1540925528 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85bfff700 1 --2- 172.21.15.50:0/1540925528 >> v2:172.21.15.82:3300/0 conn(0x7fc85c06def0 0x7fc85c168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068603681 0 0) 0x7fc85c06ca50 con 0x7fc85c0ca770 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc848003570 con 0x7fc85c0ca770 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431114287 0 0) 0x7fc85c06b520 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c06ca50 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579183498 0 0) 0x7fc848003570 con 0x7fc85c0ca770 2023-12-24T18:37:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85bfff700 1 -- 172.21.15.50:0/1540925528 >> v1:172.21.15.82:6789/0 conn(0x7fc85c0ca3a0 legacy=0x7fc85c06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85bfff700 1 -- 172.21.15.50:0/1540925528 >> v1:172.21.15.50:6789/0 conn(0x7fc85c0ca770 legacy=0x7fc85c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85bfff700 1 -- 172.21.15.50:0/1540925528 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c06b7f0 con 0x7fc85c06def0 2023-12-24T18:37:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85bfff700 1 --2- 172.21.15.50:0/1540925528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c168380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e90 tx=0x7fc854009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d842918a93e1958 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400e070 con 0x7fc85c06def0 2023-12-24T18:37:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b870 con 0x7fc85c06def0 2023-12-24T18:37:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc85affd700 1 -- 172.21.15.50:0/1540925528 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844001470 con 0x7fc85c06def0 2023-12-24T18:37:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc8620cd700 1 -- 172.21.15.50:0/1540925528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 msgr2=0x7fc85c168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.626+0000 7fc8620cd700 1 --2- 172.21.15.50:0/1540925528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c168380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e90 tx=0x7fc854009780 comp rx=0 tx=0).stop 2023-12-24T18:37:14.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- 172.21.15.50:0/1540925528 shutdown_connections 2023-12-24T18:37:14.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 --2- 172.21.15.50:0/1540925528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c168380 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- 172.21.15.50:0/1540925528 >> 172.21.15.50:0/1540925528 conn(0x7fc85c0cbba0 msgr2=0x7fc85c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:14.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- 172.21.15.50:0/1540925528 shutdown_connections 2023-12-24T18:37:14.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- 172.21.15.50:0/1540925528 wait complete. 2023-12-24T18:37:14.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 Processor -- start 2023-12-24T18:37:14.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- start start 2023-12-24T18:37:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc85c0ca770 0x7fc85c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c15c390 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1547c0 con 0x7fc85c06def0 2023-12-24T18:37:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc8620cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0af970 con 0x7fc85c0ca770 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.630+0000 7fc853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34980/0 (socket says 172.21.15.50:34980) 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 -- 172.21.15.50:0/2711292159 learned_addr learned my addr 172.21.15.50:0/2711292159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc85b7fe700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc85bfff700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc85c0ca770 0x7fc85c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 -- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc85c0ca770 msgr2=0x7fc85c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc85c0ca770 0x7fc85c0cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 -- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 msgr2=0x7fc85c0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c0c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 -- 172.21.15.50:0/2711292159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009a20 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc85b7fe700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc853fff700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc84400cb60 tx=0x7fc844001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844007e90 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844007360 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844004830 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0afc50 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c15bcd0 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.634+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c0652e0 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.638+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc844004be0 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.638+0000 7fc8537fe700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 0x7fc83c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.638+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fc84407c4a0 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.638+0000 7fc85b7fe700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 0x7fc83c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.642+0000 7fc85b7fe700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 0x7fc83c062ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc84c003990 tx=0x7fc84c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.646+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc84404c700 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.850+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc85c06bad0 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8537fe700 1 -- 172.21.15.50:0/2711292159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7fc84404fd20 con 0x7fc85c0ca3a0 2023-12-24T18:37:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:37:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 msgr2=0x7fc83c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 0x7fc83c062ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc84c003990 tx=0x7fc84c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 msgr2=0x7fc85c154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc84400cb60 tx=0x7fc844001ae0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 shutdown_connections 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc83c060620 0x7fc83c062ad0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc85c0ca770 0x7fc85c0cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85c0ca3a0 0x7fc85c154280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 --2- 172.21.15.50:0/2711292159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c06def0 0x7fc85c0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 >> 172.21.15.50:0/2711292159 conn(0x7fc85c0cbba0 msgr2=0x7fc85c0c8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 shutdown_connections 2023-12-24T18:37:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:14.854+0000 7fc8620cd700 1 -- 172.21.15.50:0/2711292159 wait complete. 2023-12-24T18:37:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:37:14.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.042+0000 7f087af45700 1 Processor -- start 2023-12-24T18:37:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.042+0000 7f087af45700 1 -- start start 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f087af45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 0x7f08740c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f087af45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f087406aca0 0x7f087406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f087af45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087406c820 con 0x7f0874154450 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f087af45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087406b960 con 0x7f087406aca0 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f087af45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087406bc40 con 0x7f08740c6d00 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f0873fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0874154450 0x7f08741548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50322/0 (socket says 172.21.15.50:50322) 2023-12-24T18:37:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f0873fff700 1 -- 172.21.15.50:0/702617928 learned_addr learned my addr 172.21.15.50:0/702617928 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f0878ce1700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 0x7f08740c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.046+0000 7f08794e2700 1 --2- 172.21.15.50:0/702617928 >> v2:172.21.15.82:3300/0 conn(0x7f087406aca0 0x7f087406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08737fe700 1 -- 172.21.15.50:0/702617928 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043352673 0 0) 0x7f087406c820 con 0x7f0874154450 2023-12-24T18:37:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08737fe700 1 -- 172.21.15.50:0/702617928 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864003570 con 0x7f0874154450 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08794e2700 1 -- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 msgr2=0x7f08740c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08794e2700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 0x7f08740c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08794e2700 1 -- 172.21.15.50:0/702617928 >> v1:172.21.15.50:6789/0 conn(0x7f0874154450 legacy=0x7f08741548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08794e2700 1 -- 172.21.15.50:0/702617928 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087406bf20 con 0x7f087406aca0 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f0878ce1700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 0x7f08740c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08794e2700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087406aca0 0x7f087406b100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e60 tx=0x7f086c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4687f26ff486c1b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08737fe700 1 -- 172.21.15.50:0/702617928 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00e070 con 0x7f087406aca0 2023-12-24T18:37:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08737fe700 1 -- 172.21.15.50:0/702617928 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00bab0 con 0x7f087406aca0 2023-12-24T18:37:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f08737fe700 1 -- 172.21.15.50:0/702617928 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00be70 con 0x7f087406aca0 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 -- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087406aca0 msgr2=0x7f087406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087406aca0 0x7f087406b100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e60 tx=0x7f086c009780 comp rx=0 tx=0).stop 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 -- 172.21.15.50:0/702617928 shutdown_connections 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087406aca0 0x7f087406b100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 --2- 172.21.15.50:0/702617928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08740c6d00 0x7f08740c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 -- 172.21.15.50:0/702617928 >> 172.21.15.50:0/702617928 conn(0x7f08740cbba0 msgr2=0x7f08740cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 -- 172.21.15.50:0/702617928 shutdown_connections 2023-12-24T18:37:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.050+0000 7f087af45700 1 -- 172.21.15.50:0/702617928 wait complete. 2023-12-24T18:37:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 Processor -- start 2023-12-24T18:37:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 -- start start 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08740c6d00 0x7f08740aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0874154450 0x7f08740cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740a95c0 con 0x7f087406aca0 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740a98a0 con 0x7f08740c6d00 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.054+0000 7f087af45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740a9b80 con 0x7f0874154450 2023-12-24T18:37:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34988/0 (socket says 172.21.15.50:34988) 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 -- 172.21.15.50:0/2765899132 learned_addr learned my addr 172.21.15.50:0/2765899132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0873fff700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08740c6d00 0x7f08740aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f08794e2700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0874154450 0x7f08740cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 -- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0874154450 msgr2=0x7f08740cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0874154450 0x7f08740cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 -- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08740c6d00 msgr2=0x7f08740aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08740c6d00 0x7f08740aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 -- 172.21.15.50:0/2765899132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009420 con 0x7f087406aca0 2023-12-24T18:37:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0878ce1700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f086800ec80 tx=0x7f08680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800c8f0 con 0x7f087406aca0 2023-12-24T18:37:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800ca50 con 0x7f087406aca0 2023-12-24T18:37:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800cdd0 con 0x7f087406aca0 2023-12-24T18:37:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c009a20 con 0x7f087406aca0 2023-12-24T18:37:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.058+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08740aa140 con 0x7f087406aca0 2023-12-24T18:37:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.062+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08740652e0 con 0x7f087406aca0 2023-12-24T18:37:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.062+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0868013680 con 0x7f087406aca0 2023-12-24T18:37:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.062+0000 7f0870ff9700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 0x7f0858062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.062+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f086807cf50 con 0x7f087406aca0 2023-12-24T18:37:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.062+0000 7f0873fff700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 0x7f0858062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.066+0000 7f0873fff700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 0x7f0858062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08740ace50 tx=0x7f0860009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.066+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f086804d0b0 con 0x7f087406aca0 2023-12-24T18:37:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.238+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f087406c200 con 0x7f087406aca0 2023-12-24T18:37:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.242+0000 7f0870ff9700 1 -- 172.21.15.50:0/2765899132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+17564 (secure 0 0 0) 0x7f08680506d0 con 0x7f087406aca0 2023-12-24T18:37:15.246 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:15.247 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:10.496207+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 msgr2=0x7f0858062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 0x7f0858062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08740ace50 tx=0x7f0860009040 comp rx=0 tx=0).stop 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 msgr2=0x7f08740c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f086800ec80 tx=0x7f08680091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 shutdown_connections 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0858060550 0x7f0858062a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0874154450 0x7f08740cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08740c6d00 0x7f08740aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 --2- 172.21.15.50:0/2765899132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f087406aca0 0x7f08740c4d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 >> 172.21.15.50:0/2765899132 conn(0x7f08740cbba0 msgr2=0x7f087406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 shutdown_connections 2023-12-24T18:37:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.246+0000 7f087af45700 1 -- 172.21.15.50:0/2765899132 wait complete. 2023-12-24T18:37:15.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:36:25.074564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:36:26.486152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-24T18:36:30.267196+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:37:15.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.434+0000 7fcca90f0700 1 Processor -- start 2023-12-24T18:37:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.434+0000 7fcca90f0700 1 -- start start 2023-12-24T18:37:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca90f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcca406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca90f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca406ccc0 con 0x7fcca41404a0 2023-12-24T18:37:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca90f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca415b120 con 0x7fcca4140870 2023-12-24T18:37:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca90f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415b990 con 0x7fcca40cac10 2023-12-24T18:37:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcca41404a0 0x7fcca415aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50332/0 (socket says 172.21.15.50:50332) 2023-12-24T18:37:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca2d9d700 1 -- 172.21.15.50:0/1709757702 learned_addr learned my addr 172.21.15.50:0/1709757702 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcca406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850146577 0 0) 0x7fcca415b120 con 0x7fcca4140870 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc90003570 con 0x7fcca4140870 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973343323 0 0) 0x7fcca406ccc0 con 0x7fcca41404a0 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca415b120 con 0x7fcca41404a0 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2101356706 0 0) 0x7fcca415b120 con 0x7fcca41404a0 2023-12-24T18:37:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 msgr2=0x7fcca406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcca406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 >> v1:172.21.15.82:6789/0 conn(0x7fcca4140870 legacy=0x7fcca40ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca415b3d0 con 0x7fcca41404a0 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fcc94001470 con 0x7fcca41404a0 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcca406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 >> v1:172.21.15.50:6789/0 conn(0x7fcca41404a0 legacy=0x7fcca415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcc90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900051c0 0x7fcc900037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc90003cf0 0x7fcc90004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415b990 con 0x7fcc90003cf0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9000ffb0 con 0x7fcc900051c0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc90010170 con 0x7fcca40cac10 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc90003cf0 0x7fcc90004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcc9a59c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900051c0 0x7fcc900037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca2d9d700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcc90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 -- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 msgr2=0x7fcc90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcca40cac10 0x7fcc90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 -- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900051c0 msgr2=0x7fcc900037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900051c0 0x7fcc900037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcca359e700 1 -- 172.21.15.50:0/1709757702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009a20 con 0x7fcc90003cf0 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.438+0000 7fcc9a59c700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900051c0 0x7fcc900037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca359e700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc90003cf0 0x7fcc90004160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcca4158590 tx=0x7fcc9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ade7e98ff54f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c009c50 con 0x7fcc90003cf0 2023-12-24T18:37:15.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00f040 con 0x7fcc90003cf0 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca259c700 1 -- 172.21.15.50:0/1709757702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00ee70 con 0x7fcc90003cf0 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 -- 172.21.15.50:0/1709757702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc90003cf0 msgr2=0x7fcc90004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 --2- 172.21.15.50:0/1709757702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc90003cf0 0x7fcc90004160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcca4158590 tx=0x7fcc9c00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca359e700 1 -- 172.21.15.50:0/1709757702 reap_dead start 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 -- 172.21.15.50:0/1709757702 shutdown_connections 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 -- 172.21.15.50:0/1709757702 >> 172.21.15.50:0/1709757702 conn(0x7fcca4067b80 msgr2=0x7fcca40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 -- 172.21.15.50:0/1709757702 shutdown_connections 2023-12-24T18:37:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 -- 172.21.15.50:0/1709757702 wait complete. 2023-12-24T18:37:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.442+0000 7fcca90f0700 1 Processor -- start 2023-12-24T18:37:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- start start 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 0x7fcca41654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcca40c2dc0 0x7fcca40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca413deb0 con 0x7fcca413d500 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4165b50 con 0x7fcca40c2dc0 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4165e30 con 0x7fcc90003cf0 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34996/0 (socket says 172.21.15.50:34996) 2023-12-24T18:37:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 -- 172.21.15.50:0/60846029 learned_addr learned my addr 172.21.15.50:0/60846029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca2d9d700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 0x7fcca41654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcc9a59c700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcca40c2dc0 0x7fcca40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 -- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 msgr2=0x7fcca41654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 0x7fcca41654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 -- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcca40c2dc0 msgr2=0x7fcca40c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcca40c2dc0 0x7fcca40c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 -- 172.21.15.50:0/60846029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4166110 con 0x7fcca413d500 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca2d9d700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 0x7fcca41654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca359e700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c002230 tx=0x7fcc9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01f6f0 con 0x7fcca413d500 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c01f850 con 0x7fcca413d500 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca41663f0 con 0x7fcca413d500 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01fc10 con 0x7fcca413d500 2023-12-24T18:37:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.446+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca40c4e90 con 0x7fcca413d500 2023-12-24T18:37:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.450+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca41665e0 con 0x7fcca413d500 2023-12-24T18:37:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.450+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcc9c025070 con 0x7fcca413d500 2023-12-24T18:37:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.450+0000 7fcc9b7fe700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 0x7fcc84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.450+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fcc9c07f500 con 0x7fcca413d500 2023-12-24T18:37:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.450+0000 7fcca2d9d700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 0x7fcc84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.454+0000 7fcca2d9d700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 0x7fcc84062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc940011a0 tx=0x7fcc94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.458+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcc9c04f710 con 0x7fcca413d500 2023-12-24T18:37:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.630+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcca40652e0 con 0x7fcca413d500 2023-12-24T18:37:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.634+0000 7fcc9b7fe700 1 -- 172.21.15.50:0/60846029 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc9c052d30 con 0x7fcca413d500 2023-12-24T18:37:15.637 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 msgr2=0x7fcc84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 0x7fcc84062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc940011a0 tx=0x7fcc94009040 comp rx=0 tx=0).stop 2023-12-24T18:37:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 msgr2=0x7fcca413d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c002230 tx=0x7fcc9c019000 comp rx=0 tx=0).stop 2023-12-24T18:37:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 shutdown_connections 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc84060550 0x7fcc84062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca413d500 0x7fcca413d970 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcca40c2dc0 0x7fcca40c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 --2- 172.21.15.50:0/60846029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc90003cf0 0x7fcca41654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 >> 172.21.15.50:0/60846029 conn(0x7fcca4067b80 msgr2=0x7fcca40afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 shutdown_connections 2023-12-24T18:37:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.638+0000 7fcca90f0700 1 -- 172.21.15.50:0/60846029 wait complete. 2023-12-24T18:37:15.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:37:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.830+0000 7fe96bfff700 1 Processor -- start 2023-12-24T18:37:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.830+0000 7fe96bfff700 1 -- start start 2023-12-24T18:37:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c15b840 con 0x7fe96c156f10 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c06c9c0 con 0x7fe96c156b40 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96bfff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c069980 con 0x7fe96c0694d0 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe96c156f10 0x7fe96c068dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50344/0 (socket says 172.21.15.50:50344) 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96a7fc700 1 -- 172.21.15.50:0/2353093354 learned_addr learned my addr 172.21.15.50:0/2353093354 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.834+0000 7fe96b7fe700 1 --2- 172.21.15.50:0/2353093354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96b7fe700 1 -- 172.21.15.50:0/2353093354 >> v1:172.21.15.82:6789/0 conn(0x7fe96c156b40 legacy=0x7fe96c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96b7fe700 1 -- 172.21.15.50:0/2353093354 >> v1:172.21.15.50:6789/0 conn(0x7fe96c156f10 legacy=0x7fe96c068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96b7fe700 1 -- 172.21.15.50:0/2353093354 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c06cca0 con 0x7fe96c0694d0 2023-12-24T18:37:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe969ffb700 1 -- 172.21.15.50:0/2353093354 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978881804 0 0) 0x7fe96c15b840 con 0x7fe96c156f10 2023-12-24T18:37:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96b7fe700 1 --2- 172.21.15.50:0/2353093354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c0c8840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe964009e90 tx=0x7fe964009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6463a942046d624c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe969ffb700 1 -- 172.21.15.50:0/2353093354 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400e070 con 0x7fe96c0694d0 2023-12-24T18:37:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe969ffb700 1 -- 172.21.15.50:0/2353093354 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400bc30 con 0x7fe96c0694d0 2023-12-24T18:37:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe969ffb700 1 -- 172.21.15.50:0/2353093354 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964012430 con 0x7fe96c0694d0 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 -- 172.21.15.50:0/2353093354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 msgr2=0x7fe96c0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 --2- 172.21.15.50:0/2353093354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c0c8840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe964009e90 tx=0x7fe964009780 comp rx=0 tx=0).stop 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 -- 172.21.15.50:0/2353093354 shutdown_connections 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 --2- 172.21.15.50:0/2353093354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c0c8840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 -- 172.21.15.50:0/2353093354 >> 172.21.15.50:0/2353093354 conn(0x7fe96c0ccad0 msgr2=0x7fe96c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 -- 172.21.15.50:0/2353093354 shutdown_connections 2023-12-24T18:37:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.838+0000 7fe96bfff700 1 -- 172.21.15.50:0/2353093354 wait complete. 2023-12-24T18:37:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.842+0000 7fe96bfff700 1 Processor -- start 2023-12-24T18:37:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.842+0000 7fe96bfff700 1 -- start start 2023-12-24T18:37:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c167040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 0x7fe96c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c16e0d0 con 0x7fe96c156f10 2023-12-24T18:37:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0afa10 con 0x7fe96c156b40 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c157c10 con 0x7fe96c0694d0 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35008/0 (socket says 172.21.15.50:35008) 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96b7fe700 1 -- 172.21.15.50:0/1368688856 learned_addr learned my addr 172.21.15.50:0/1368688856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 0x7fe96c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 -- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 msgr2=0x7fe96c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 0x7fe96c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 -- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 msgr2=0x7fe96c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 -- 172.21.15.50:0/1368688856 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009a20 con 0x7fe96c0694d0 2023-12-24T18:37:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96b7fe700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 0x7fe96c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96affd700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c167040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c590 tx=0x7fe95c007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011590 con 0x7fe96c0694d0 2023-12-24T18:37:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c011710 con 0x7fe96c0694d0 2023-12-24T18:37:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c167580 con 0x7fe96c0694d0 2023-12-24T18:37:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011ad0 con 0x7fe96c0694d0 2023-12-24T18:37:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.846+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c16ddf0 con 0x7fe96c0694d0 2023-12-24T18:37:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.850+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c06ef40 con 0x7fe96c0694d0 2023-12-24T18:37:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.850+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe95c01b3b0 con 0x7fe96c0694d0 2023-12-24T18:37:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.854+0000 7fe952ffd700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 0x7fe958062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.854+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7fe95c07bfb0 con 0x7fe96c0694d0 2023-12-24T18:37:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.854+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 0x7fe958062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.854+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 0x7fe958062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe960000c00 tx=0x7fe960009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:15.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:15.858+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe96c06ef40 con 0x7fe96c0694d0 2023-12-24T18:37:16.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.030+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe96c06ef40 con 0x7fe96c0694d0 2023-12-24T18:37:16.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.030+0000 7fe952ffd700 1 -- 172.21.15.50:0/1368688856 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe96c06ef40 con 0x7fe96c0694d0 2023-12-24T18:37:16.034 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 msgr2=0x7fe958062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 0x7fe958062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe960000c00 tx=0x7fe960009040 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 msgr2=0x7fe96c167040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c167040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c590 tx=0x7fe95c007ec0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 shutdown_connections 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe958060550 0x7fe958062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c156f10 0x7fe96c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe96c156b40 0x7fe96c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 --2- 172.21.15.50:0/1368688856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe96c0694d0 0x7fe96c167040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 >> 172.21.15.50:0/1368688856 conn(0x7fe96c0ccad0 msgr2=0x7fe96c154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 shutdown_connections 2023-12-24T18:37:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.034+0000 7fe96bfff700 1 -- 172.21.15.50:0/1368688856 wait complete. 2023-12-24T18:37:16.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:37:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.234+0000 7f8211f45700 1 Processor -- start 2023-12-24T18:37:16.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.234+0000 7f8211f45700 1 -- start start 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f8211f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f820c06ae10 0x7f820c164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f8211f45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0cd680 con 0x7f820c0cf4d0 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f8211f45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c06d8f0 con 0x7f820c0cf8a0 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f8211f45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c159640 con 0x7f820c06ae10 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f820c0cf4d0 0x7f820c06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50350/0 (socket says 172.21.15.50:50350) 2023-12-24T18:37:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820b7fe700 1 -- 172.21.15.50:0/1340312679 learned_addr learned my addr 172.21.15.50:0/1340312679 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820bfff700 1 --2- 172.21.15.50:0/1340312679 >> v2:172.21.15.82:3300/0 conn(0x7f820c06ae10 0x7f820c164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114000810 0 0) 0x7f820c0cd680 con 0x7f820c0cf4d0 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f4003570 con 0x7f820c0cf4d0 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878434026 0 0) 0x7f820c06d8f0 con 0x7f820c0cf8a0 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c0cd680 con 0x7f820c0cf8a0 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820bfff700 1 -- 172.21.15.50:0/1340312679 >> v1:172.21.15.82:6789/0 conn(0x7f820c0cf8a0 legacy=0x7f820c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820bfff700 1 -- 172.21.15.50:0/1340312679 >> v1:172.21.15.50:6789/0 conn(0x7f820c0cf4d0 legacy=0x7f820c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2052925247 0 0) 0x7f81f4003570 con 0x7f820c0cf4d0 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820bfff700 1 -- 172.21.15.50:0/1340312679 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0cca70 con 0x7f820c06ae10 2023-12-24T18:37:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.238+0000 7f820bfff700 1 --2- 172.21.15.50:0/1340312679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c06ae10 0x7f820c164010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8204009e60 tx=0x7f8204009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1df0c83ade43fdd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400e070 con 0x7f820c06ae10 2023-12-24T18:37:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400b7a0 con 0x7f820c06ae10 2023-12-24T18:37:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f820a7fc700 1 -- 172.21.15.50:0/1340312679 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc001470 con 0x7f820c06ae10 2023-12-24T18:37:16.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 -- 172.21.15.50:0/1340312679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c06ae10 msgr2=0x7f820c164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 --2- 172.21.15.50:0/1340312679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c06ae10 0x7f820c164010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8204009e60 tx=0x7f8204009780 comp rx=0 tx=0).stop 2023-12-24T18:37:16.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 -- 172.21.15.50:0/1340312679 shutdown_connections 2023-12-24T18:37:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 --2- 172.21.15.50:0/1340312679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c06ae10 0x7f820c164010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 -- 172.21.15.50:0/1340312679 >> 172.21.15.50:0/1340312679 conn(0x7f820c067b30 msgr2=0x7f820c0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 -- 172.21.15.50:0/1340312679 shutdown_connections 2023-12-24T18:37:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 -- 172.21.15.50:0/1340312679 wait complete. 2023-12-24T18:37:16.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.242+0000 7f8211f45700 1 Processor -- start 2023-12-24T18:37:16.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 -- start start 2023-12-24T18:37:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f820c06ae10 0x7f820c16c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c0cf8a0 0x7f820c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16bb80 con 0x7f820c0cf4d0 2023-12-24T18:37:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16af70 con 0x7f820c0cf8a0 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16b250 con 0x7f820c06ae10 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35020/0 (socket says 172.21.15.50:35020) 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 -- 172.21.15.50:0/3866742379 learned_addr learned my addr 172.21.15.50:0/3866742379 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820b7fe700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f820c06ae10 0x7f820c16c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820bfff700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c0cf8a0 0x7f820c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 -- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f820c06ae10 msgr2=0x7f820c16c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f820c06ae10 0x7f820c16c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 -- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c0cf8a0 msgr2=0x7f820c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c0cf8a0 0x7f820c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 -- 172.21.15.50:0/3866742379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009a20 con 0x7f820c0cf4d0 2023-12-24T18:37:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f820affd700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f820000c590 tx=0x7f8200007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200010510 con 0x7f820c0cf4d0 2023-12-24T18:37:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8200010690 con 0x7f820c0cf4d0 2023-12-24T18:37:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c16b530 con 0x7f820c0cf4d0 2023-12-24T18:37:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.246+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200010a50 con 0x7f820c0cf4d0 2023-12-24T18:37:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.250+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c150f50 con 0x7f820c0cf4d0 2023-12-24T18:37:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.250+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c16bcf0 con 0x7f820c0cf4d0 2023-12-24T18:37:16.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.250+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f820001b3b0 con 0x7f820c0cf4d0 2023-12-24T18:37:16.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.254+0000 7f81f37fe700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 0x7f81f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.254+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f820007c2c0 con 0x7f820c0cf4d0 2023-12-24T18:37:16.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.254+0000 7f820b7fe700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 0x7f81f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.254+0000 7f820b7fe700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 0x7f81f8062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0011e0 tx=0x7f81fc000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.258+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f820004c420 con 0x7f820c0cf4d0 2023-12-24T18:37:16.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.430+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f820c0652e0 con 0x7f820c0cf4d0 2023-12-24T18:37:16.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.430+0000 7f81f37fe700 1 -- 172.21.15.50:0/3866742379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82000170a0 con 0x7f820c0cf4d0 2023-12-24T18:37:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 msgr2=0x7f81f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 0x7f81f8062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0011e0 tx=0x7f81fc000bc0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 msgr2=0x7f820c150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f820000c590 tx=0x7f8200007de0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 shutdown_connections 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f81f8060550 0x7f81f8062a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c0cf8a0 0x7f820c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820c0cf4d0 0x7f820c150a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 --2- 172.21.15.50:0/3866742379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f820c06ae10 0x7f820c16c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 >> 172.21.15.50:0/3866742379 conn(0x7f820c067b30 msgr2=0x7f820c0cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 shutdown_connections 2023-12-24T18:37:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.434+0000 7f8211f45700 1 -- 172.21.15.50:0/3866742379 wait complete. 2023-12-24T18:37:16.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-24T18:37:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.630+0000 7f4b4ec65700 1 Processor -- start 2023-12-24T18:37:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.630+0000 7f4b4ec65700 1 -- start start 2023-12-24T18:37:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ec65700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b4806ae20 0x7f4b480b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ec65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4b4806c820 0x7f4b480b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ec65700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480b3fd0 con 0x7f4b48158e00 2023-12-24T18:37:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ec65700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480b33c0 con 0x7f4b4806ae20 2023-12-24T18:37:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ec65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480b36a0 con 0x7f4b4806c820 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b4806ae20 0x7f4b480b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4d202700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4b4806c820 0x7f4b480b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ca01700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4b48158e00 0x7f4b4806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57100/0 (socket says 172.21.15.50:57100) 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4ca01700 1 -- 172.21.15.50:0/179472127 learned_addr learned my addr 172.21.15.50:0/179472127 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b477fe700 1 -- 172.21.15.50:0/179472127 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561048610 0 0) 0x7f4b480b3fd0 con 0x7f4b48158e00 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b477fe700 1 -- 172.21.15.50:0/179472127 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b38003570 con 0x7f4b48158e00 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4d202700 1 -- 172.21.15.50:0/179472127 >> v2:172.21.15.50:3300/0 conn(0x7f4b4806ae20 msgr2=0x7f4b480b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4d202700 1 --2- 172.21.15.50:0/179472127 >> v2:172.21.15.50:3300/0 conn(0x7f4b4806ae20 0x7f4b480b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4d202700 1 -- 172.21.15.50:0/179472127 >> v1:172.21.15.82:6789/0 conn(0x7f4b48158e00 legacy=0x7f4b4806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.634+0000 7f4b4d202700 1 -- 172.21.15.50:0/179472127 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480b3980 con 0x7f4b4806c820 2023-12-24T18:37:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4d202700 1 --2- 172.21.15.50:0/179472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480b4460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b60b0 tx=0x7f4b40009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a3f38d2906d8b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b477fe700 1 -- 172.21.15.50:0/179472127 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000e070 con 0x7f4b4806c820 2023-12-24T18:37:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b477fe700 1 -- 172.21.15.50:0/179472127 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4000bab0 con 0x7f4b4806c820 2023-12-24T18:37:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b477fe700 1 -- 172.21.15.50:0/179472127 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000be70 con 0x7f4b4806c820 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 -- 172.21.15.50:0/179472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 msgr2=0x7f4b480b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/179472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480b4460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b60b0 tx=0x7f4b40009780 comp rx=0 tx=0).stop 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 -- 172.21.15.50:0/179472127 shutdown_connections 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/179472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480b4460 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/179472127 >> v2:172.21.15.50:3300/0 conn(0x7f4b4806ae20 0x7f4b480b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 -- 172.21.15.50:0/179472127 >> 172.21.15.50:0/179472127 conn(0x7f4b48067b80 msgr2=0x7f4b480cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 -- 172.21.15.50:0/179472127 shutdown_connections 2023-12-24T18:37:16.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.638+0000 7f4b4ec65700 1 -- 172.21.15.50:0/179472127 wait complete. 2023-12-24T18:37:16.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.642+0000 7f4b4ec65700 1 Processor -- start 2023-12-24T18:37:16.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.642+0000 7f4b4ec65700 1 -- start start 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b4806ae20 0x7f4b480add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4816a030 con 0x7f4b48158e00 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48169d00 con 0x7f4b4806c820 2023-12-24T18:37:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480a9c50 con 0x7f4b4806ae20 2023-12-24T18:37:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35048/0 (socket says 172.21.15.50:35048) 2023-12-24T18:37:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 -- 172.21.15.50:0/1794549611 learned_addr learned my addr 172.21.15.50:0/1794549611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b47fff700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ca01700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b4806ae20 0x7f4b480add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 -- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b4806ae20 msgr2=0x7f4b480add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b4806ae20 0x7f4b480add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 -- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 msgr2=0x7f4b480a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 -- 172.21.15.50:0/1794549611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009a20 con 0x7f4b48158e00 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b47fff700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4d202700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b37e0 tx=0x7f4b40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40012dd0 con 0x7f4b48158e00 2023-12-24T18:37:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40027470 con 0x7f4b48158e00 2023-12-24T18:37:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480a9f30 con 0x7f4b48158e00 2023-12-24T18:37:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40027830 con 0x7f4b48158e00 2023-12-24T18:37:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.646+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480a9820 con 0x7f4b48158e00 2023-12-24T18:37:16.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.650+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4816a1e0 con 0x7f4b48158e00 2023-12-24T18:37:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.650+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4b40024070 con 0x7f4b48158e00 2023-12-24T18:37:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.650+0000 7f4b44ff9700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 0x7f4b2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.654+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f4b4007f5b0 con 0x7f4b48158e00 2023-12-24T18:37:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.654+0000 7f4b4ca01700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 0x7f4b2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.654+0000 7f4b4ca01700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 0x7f4b2c062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007fd0 tx=0x7f4b3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.658+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4b4816a1e0 con 0x7f4b48158e00 2023-12-24T18:37:16.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.826+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4b4816a1e0 con 0x7f4b48158e00 2023-12-24T18:37:16.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b44ff9700 1 -- 172.21.15.50:0/1794549611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4b4816a1e0 con 0x7f4b48158e00 2023-12-24T18:37:16.833 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:37:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 msgr2=0x7f4b2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 0x7f4b2c062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007fd0 tx=0x7f4b3c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 msgr2=0x7f4b4816c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b480b37e0 tx=0x7f4b40019000 comp rx=0 tx=0).stop 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 shutdown_connections 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4b2c060550 0x7f4b2c062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b48158e00 0x7f4b4816c090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4806c820 0x7f4b480a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 --2- 172.21.15.50:0/1794549611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b4806ae20 0x7f4b480add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.830+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 >> 172.21.15.50:0/1794549611 conn(0x7f4b48067b80 msgr2=0x7f4b4815b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:16.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.834+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 shutdown_connections 2023-12-24T18:37:16.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:16.834+0000 7f4b4ec65700 1 -- 172.21.15.50:0/1794549611 wait complete. 2023-12-24T18:37:16.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.022+0000 7f47b8b45700 1 Processor -- start 2023-12-24T18:37:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b8b45700 1 -- start start 2023-12-24T18:37:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b8b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47b4168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b8b45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b406ca50 con 0x7f47b40ca3a0 2023-12-24T18:37:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b8b45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b406b520 con 0x7f47b40ca770 2023-12-24T18:37:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b8b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c6980 con 0x7f47b406def0 2023-12-24T18:37:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f47b40ca3a0 0x7f47b406ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2023-12-24T18:37:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b259c700 1 -- 172.21.15.50:0/2935188969 learned_addr learned my addr 172.21.15.50:0/2935188969 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47b4168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273927831 0 0) 0x7f47b406b520 con 0x7f47b40ca770 2023-12-24T18:37:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a0003570 con 0x7f47b40ca770 2023-12-24T18:37:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697513380 0 0) 0x7f47b406ca50 con 0x7f47b40ca3a0 2023-12-24T18:37:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.026+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b406b520 con 0x7f47b40ca3a0 2023-12-24T18:37:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289837260 0 0) 0x7f47a0003570 con 0x7f47b40ca770 2023-12-24T18:37:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 msgr2=0x7f47b4168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47b4168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 >> v1:172.21.15.50:6789/0 conn(0x7f47b40ca3a0 legacy=0x7f47b406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b406b7f0 con 0x7f47b40ca770 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f479c001470 con 0x7f47b40ca770 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 >> v1:172.21.15.82:6789/0 conn(0x7f47b40ca770 legacy=0x7f47b415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0004c80 0x7f47a0005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a00037b0 0x7f47a0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47a0004210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4001230 con 0x7f47a0004c80 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a000bbf0 con 0x7f47a00037b0 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a000bdb0 con 0x7f47b406def0 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0004c80 0x7f47a0005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47a0004210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 -- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 msgr2=0x7f47a0004210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47a0004210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 -- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a00037b0 msgr2=0x7f47a0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a00037b0 0x7f47a0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 -- 172.21.15.50:0/2935188969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0003570 con 0x7f47a0004c80 2023-12-24T18:37:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b406def0 0x7f47a0004210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b259c700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0004c80 0x7f47a0005050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c210 tx=0x7f47a4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a0c2f8ba3e1dca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400cb00 con 0x7f47a0004c80 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400cc60 con 0x7f47a0004c80 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b1d9b700 1 -- 172.21.15.50:0/2935188969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40048f0 con 0x7f47a0004c80 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b8b45700 1 -- 172.21.15.50:0/2935188969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0004c80 msgr2=0x7f47a0005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.030+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2935188969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0004c80 0x7f47a0005050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c210 tx=0x7f47a4001cc0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b2d9d700 1 -- 172.21.15.50:0/2935188969 reap_dead start 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 -- 172.21.15.50:0/2935188969 shutdown_connections 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 -- 172.21.15.50:0/2935188969 >> 172.21.15.50:0/2935188969 conn(0x7f47b40cbba0 msgr2=0x7f47b40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 -- 172.21.15.50:0/2935188969 shutdown_connections 2023-12-24T18:37:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 -- 172.21.15.50:0/2935188969 wait complete. 2023-12-24T18:37:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 Processor -- start 2023-12-24T18:37:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.034+0000 7f47b8b45700 1 -- start start 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a0004c80 0x7f47b4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b40c4960 0x7f47b40c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c5310 con 0x7f47b40c75a0 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c2c50 con 0x7f47a0004c80 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c2f30 con 0x7f47b40c4960 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a0004c80 0x7f47b4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35060/0 (socket says 172.21.15.50:35060) 2023-12-24T18:37:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 -- 172.21.15.50:0/2867567428 learned_addr learned my addr 172.21.15.50:0/2867567428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47abfff700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b40c4960 0x7f47b40c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 -- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b40c4960 msgr2=0x7f47b40c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b40c4960 0x7f47b40c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 -- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a0004c80 msgr2=0x7f47b4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a0004c80 0x7f47b4156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 -- 172.21.15.50:0/2867567428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4162120 con 0x7f47b40c75a0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b2d9d700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47b406ca00 tx=0x7f47ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00e030 con 0x7f47b40c75a0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac011c80 con 0x7f47b40c75a0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac016470 con 0x7f47b40c75a0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40c94f0 con 0x7f47b40c75a0 2023-12-24T18:37:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.038+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40c84f0 con 0x7f47b40c75a0 2023-12-24T18:37:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.042+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b40c30c0 con 0x7f47b40c75a0 2023-12-24T18:37:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.042+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f47ac016820 con 0x7f47b40c75a0 2023-12-24T18:37:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.042+0000 7f47aa7fc700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 0x7f4794062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.042+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f47ac00f070 con 0x7f47b40c75a0 2023-12-24T18:37:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.042+0000 7f47b259c700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 0x7f4794062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.046+0000 7f47b259c700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 0x7f4794062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47a4008fd0 tx=0x7f47a4015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.046+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47ac04da50 con 0x7f47b40c75a0 2023-12-24T18:37:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.258+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47b40652e0 con 0x7f47b40c75a0 2023-12-24T18:37:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47aa7fc700 1 -- 172.21.15.50:0/2867567428 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f47ac051070 con 0x7f47b40c75a0 2023-12-24T18:37:17.264 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:17.264 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 msgr2=0x7f4794062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 0x7f4794062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47a4008fd0 tx=0x7f47a4015000 comp rx=0 tx=0).stop 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 msgr2=0x7f47b40c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47b406ca00 tx=0x7f47ac00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 shutdown_connections 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4794060550 0x7f4794062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47b40c75a0 0x7f47b40c79f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47b40c4960 0x7f47b40c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 --2- 172.21.15.50:0/2867567428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a0004c80 0x7f47b4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 >> 172.21.15.50:0/2867567428 conn(0x7f47b40cbba0 msgr2=0x7f47b40aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 shutdown_connections 2023-12-24T18:37:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.262+0000 7f47b8b45700 1 -- 172.21.15.50:0/2867567428 wait complete. 2023-12-24T18:37:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:37:17.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 Processor -- start 2023-12-24T18:37:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 -- start start 2023-12-24T18:37:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 0x7f6ed41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed406b640 con 0x7f6ed4158e00 2023-12-24T18:37:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed40b5e10 con 0x7f6ed40b41e0 2023-12-24T18:37:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed8877700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4159710 con 0x7f6ed406d8c0 2023-12-24T18:37:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ed4158e00 0x7f6ed40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50362/0 (socket says 172.21.15.50:50362) 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed2d9d700 1 -- 172.21.15.50:0/1000772679 learned_addr learned my addr 172.21.15.50:0/1000772679 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed359e700 1 --2- 172.21.15.50:0/1000772679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 0x7f6ed41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed259c700 1 -- 172.21.15.50:0/1000772679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862248005 0 0) 0x7f6ed406b640 con 0x7f6ed4158e00 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed259c700 1 -- 172.21.15.50:0/1000772679 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec0003570 con 0x7f6ed4158e00 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed359e700 1 -- 172.21.15.50:0/1000772679 >> v1:172.21.15.82:6789/0 conn(0x7f6ed40b41e0 legacy=0x7f6ed4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed359e700 1 -- 172.21.15.50:0/1000772679 >> v1:172.21.15.50:6789/0 conn(0x7f6ed4158e00 legacy=0x7f6ed40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.462+0000 7f6ed359e700 1 -- 172.21.15.50:0/1000772679 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed406b8e0 con 0x7f6ed406d8c0 2023-12-24T18:37:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed359e700 1 --2- 172.21.15.50:0/1000772679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 0x7f6ed41591d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009e90 tx=0x7f6ecc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b0db38f94da5e18 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed259c700 1 -- 172.21.15.50:0/1000772679 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00e070 con 0x7f6ed406d8c0 2023-12-24T18:37:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed259c700 1 -- 172.21.15.50:0/1000772679 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc00bc30 con 0x7f6ed406d8c0 2023-12-24T18:37:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed259c700 1 -- 172.21.15.50:0/1000772679 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc012430 con 0x7f6ed406d8c0 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 -- 172.21.15.50:0/1000772679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 msgr2=0x7f6ed41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 --2- 172.21.15.50:0/1000772679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 0x7f6ed41591d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009e90 tx=0x7f6ecc009780 comp rx=0 tx=0).stop 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 -- 172.21.15.50:0/1000772679 shutdown_connections 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 --2- 172.21.15.50:0/1000772679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed406d8c0 0x7f6ed41591d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 -- 172.21.15.50:0/1000772679 >> 172.21.15.50:0/1000772679 conn(0x7f6ed4067b80 msgr2=0x7f6ed40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 -- 172.21.15.50:0/1000772679 shutdown_connections 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.466+0000 7f6ed8877700 1 -- 172.21.15.50:0/1000772679 wait complete. 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 Processor -- start 2023-12-24T18:37:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 -- start start 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 0x7f6ed4140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed40b41e0 0x7f6ed40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4089a90 con 0x7f6ed4158e00 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40cea80 con 0x7f6ed406d8c0 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed8877700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40ced60 con 0x7f6ed40b41e0 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35068/0 (socket says 172.21.15.50:35068) 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 -- 172.21.15.50:0/8006561 learned_addr learned my addr 172.21.15.50:0/8006561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ecbfff700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed40b41e0 0x7f6ed40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed2d9d700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 0x7f6ed4140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 -- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed40b41e0 msgr2=0x7f6ed40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed40b41e0 0x7f6ed40cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 -- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 msgr2=0x7f6ed4140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 0x7f6ed4140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 -- 172.21.15.50:0/8006561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc009a20 con 0x7f6ed4158e00 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed2d9d700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 0x7f6ed4140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.470+0000 7f6ed359e700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0099f0 tx=0x7f6ecc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc027470 con 0x7f6ed4158e00 2023-12-24T18:37:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc027630 con 0x7f6ed4158e00 2023-12-24T18:37:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed4089720 con 0x7f6ed4158e00 2023-12-24T18:37:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0279f0 con 0x7f6ed4158e00 2023-12-24T18:37:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed40ce3f0 con 0x7f6ed4158e00 2023-12-24T18:37:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.474+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed4089570 con 0x7f6ed4158e00 2023-12-24T18:37:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.478+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6ecc024070 con 0x7f6ed4158e00 2023-12-24T18:37:17.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.478+0000 7f6ecaffd700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 0x7f6eb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.478+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f6ecc07f420 con 0x7f6ed4158e00 2023-12-24T18:37:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.478+0000 7f6ed2d9d700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 0x7f6eb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.478+0000 7f6ed2d9d700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 0x7f6eb4062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40058d0 tx=0x7f6ec4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.482+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ecc04f620 con 0x7f6ed4158e00 2023-12-24T18:37:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.662+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed40898b0 con 0x7f6ed4158e00 2023-12-24T18:37:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.666+0000 7f6ecaffd700 1 -- 172.21.15.50:0/8006561 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+17564 (secure 0 0 0) 0x7f6ecc052c40 con 0x7f6ed4158e00 2023-12-24T18:37:17.670 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:17.670 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:10.496207+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.666+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 msgr2=0x7f6eb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.666+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 0x7f6eb4062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40058d0 tx=0x7f6ec4009040 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.666+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 msgr2=0x7f6ed40cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0099f0 tx=0x7f6ecc019000 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 shutdown_connections 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6eb4060550 0x7f6eb4062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4158e00 0x7f6ed40cf270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ed40b41e0 0x7f6ed40cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 --2- 172.21.15.50:0/8006561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ed406d8c0 0x7f6ed4140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 >> 172.21.15.50:0/8006561 conn(0x7f6ed4067b80 msgr2=0x7f6ed406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 shutdown_connections 2023-12-24T18:37:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.670+0000 7f6ed8877700 1 -- 172.21.15.50:0/8006561 wait complete. 2023-12-24T18:37:17.693 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:37:17.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.850+0000 7f12a9385700 1 Processor -- start 2023-12-24T18:37:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.850+0000 7f12a9385700 1 -- start start 2023-12-24T18:37:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a9385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a4154b60 0x7f12a40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a9385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12a406aca0 0x7f12a406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a9385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a406c820 con 0x7f12a40c6d00 2023-12-24T18:37:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a9385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a406b960 con 0x7f12a406aca0 2023-12-24T18:37:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a9385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a406bc40 con 0x7f12a4154b60 2023-12-24T18:37:17.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12a406aca0 0x7f12a406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a2ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f12a40c6d00 0x7f12a4154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57126/0 (socket says 172.21.15.50:57126) 2023-12-24T18:37:17.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a2ffd700 1 -- 172.21.15.50:0/3839940656 learned_addr learned my addr 172.21.15.50:0/3839940656 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:17.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f129a7fc700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a4154b60 0x7f12a40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a37fe700 1 -- 172.21.15.50:0/3839940656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a4154b60 msgr2=0x7f12a40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a37fe700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a4154b60 0x7f12a40c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a37fe700 1 -- 172.21.15.50:0/3839940656 >> v1:172.21.15.82:6789/0 conn(0x7f12a40c6d00 legacy=0x7f12a4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a37fe700 1 -- 172.21.15.50:0/3839940656 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a406bf20 con 0x7f12a406aca0 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.854+0000 7f12a27fc700 1 -- 172.21.15.50:0/3839940656 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169430640 0 0) 0x7f12a406c820 con 0x7f12a40c6d00 2023-12-24T18:37:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a37fe700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a406aca0 0x7f12a406b100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f129c009e60 tx=0x7f129c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d49b21dcdab6fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a27fc700 1 -- 172.21.15.50:0/3839940656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00e070 con 0x7f12a406aca0 2023-12-24T18:37:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a27fc700 1 -- 172.21.15.50:0/3839940656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00bb60 con 0x7f12a406aca0 2023-12-24T18:37:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a27fc700 1 -- 172.21.15.50:0/3839940656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c012430 con 0x7f12a406aca0 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 -- 172.21.15.50:0/3839940656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a406aca0 msgr2=0x7f12a406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a406aca0 0x7f12a406b100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f129c009e60 tx=0x7f129c009780 comp rx=0 tx=0).stop 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 -- 172.21.15.50:0/3839940656 shutdown_connections 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a406aca0 0x7f12a406b100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 --2- 172.21.15.50:0/3839940656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a4154b60 0x7f12a40c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 -- 172.21.15.50:0/3839940656 >> 172.21.15.50:0/3839940656 conn(0x7f12a40cbba0 msgr2=0x7f12a40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 -- 172.21.15.50:0/3839940656 shutdown_connections 2023-12-24T18:37:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.858+0000 7f12a9385700 1 -- 172.21.15.50:0/3839940656 wait complete. 2023-12-24T18:37:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.862+0000 7f12a9385700 1 Processor -- start 2023-12-24T18:37:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.862+0000 7f12a9385700 1 -- start start 2023-12-24T18:37:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.862+0000 7f12a9385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a406aca0 0x7f12a40a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.862+0000 7f12a9385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.862+0000 7f12a9385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a4154b60 0x7f12a40abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4143700 con 0x7f12a40c6d00 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40a9930 con 0x7f12a4154b60 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40a8d20 con 0x7f12a406aca0 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35092/0 (socket says 172.21.15.50:35092) 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 -- 172.21.15.50:0/2689953948 learned_addr learned my addr 172.21.15.50:0/2689953948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a2ffd700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a406aca0 0x7f12a40a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a37fe700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a4154b60 0x7f12a40abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 -- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a406aca0 msgr2=0x7f12a40a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a406aca0 0x7f12a40a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 -- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a4154b60 msgr2=0x7f12a40abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a4154b60 0x7f12a40abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 -- 172.21.15.50:0/2689953948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009a20 con 0x7f12a40c6d00 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129a7fc700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e930 tx=0x7f128c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c013680 con 0x7f12a40c6d00 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0137e0 con 0x7f12a40c6d00 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40a9000 con 0x7f12a40c6d00 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c013b80 con 0x7f12a40c6d00 2023-12-24T18:37:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40a95c0 con 0x7f12a40c6d00 2023-12-24T18:37:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.866+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a4158150 con 0x7f12a40c6d00 2023-12-24T18:37:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.870+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f128c00c3e0 con 0x7f12a40c6d00 2023-12-24T18:37:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.870+0000 7f129b7fe700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 0x7f1284062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.870+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f128c07ccf0 con 0x7f12a40c6d00 2023-12-24T18:37:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.870+0000 7f12a2ffd700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 0x7f1284062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.870+0000 7f12a2ffd700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 0x7f1284062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12a40aad60 tx=0x7f1294007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:17.874+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f128c04ce50 con 0x7f12a40c6d00 2023-12-24T18:37:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.082+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12a40652e0 con 0x7f12a40c6d00 2023-12-24T18:37:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f129b7fe700 1 -- 172.21.15.50:0/2689953948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f128c017090 con 0x7f12a40c6d00 2023-12-24T18:37:18.088 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:18.089 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 msgr2=0x7f1284062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 0x7f1284062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12a40aad60 tx=0x7f1294007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 msgr2=0x7f12a41431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e930 tx=0x7f128c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 shutdown_connections 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1284060550 0x7f1284062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a4154b60 0x7f12a40abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a40c6d00 0x7f12a41431c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 --2- 172.21.15.50:0/2689953948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a406aca0 0x7f12a40a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 >> 172.21.15.50:0/2689953948 conn(0x7f12a40cbba0 msgr2=0x7f12a40aaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.086+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 shutdown_connections 2023-12-24T18:37:18.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.090+0000 7f12a9385700 1 -- 172.21.15.50:0/2689953948 wait complete. 2023-12-24T18:37:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:37:18.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.270+0000 7f16fb00c700 1 Processor -- start 2023-12-24T18:37:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.270+0000 7f16fb00c700 1 -- start start 2023-12-24T18:37:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fb00c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16f406d8c0 0x7f16f41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fb00c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f406b640 con 0x7f16f4158e00 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fb00c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40b5e10 con 0x7f16f40b41e0 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fb00c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f4159710 con 0x7f16f406d8c0 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa80b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16f406d8c0 0x7f16f41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa00a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16f4158e00 0x7f16f40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50370/0 (socket says 172.21.15.50:50370) 2023-12-24T18:37:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa00a700 1 -- 172.21.15.50:0/3749630911 learned_addr learned my addr 172.21.15.50:0/3749630911 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa80b700 1 -- 172.21.15.50:0/3749630911 >> v1:172.21.15.82:6789/0 conn(0x7f16f40b41e0 legacy=0x7f16f4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16f9008700 1 -- 172.21.15.50:0/3749630911 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538231035 0 0) 0x7f16f406b640 con 0x7f16f4158e00 2023-12-24T18:37:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa80b700 1 -- 172.21.15.50:0/3749630911 >> v1:172.21.15.50:6789/0 conn(0x7f16f4158e00 legacy=0x7f16f40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa80b700 1 -- 172.21.15.50:0/3749630911 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f406b8e0 con 0x7f16f406d8c0 2023-12-24T18:37:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16fa80b700 1 --2- 172.21.15.50:0/3749630911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f41591d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009e60 tx=0x7f16ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d438d4de6d81efe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16f9008700 1 -- 172.21.15.50:0/3749630911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00e070 con 0x7f16f406d8c0 2023-12-24T18:37:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16f9008700 1 -- 172.21.15.50:0/3749630911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00bc30 con 0x7f16f406d8c0 2023-12-24T18:37:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.274+0000 7f16f9008700 1 -- 172.21.15.50:0/3749630911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec012430 con 0x7f16f406d8c0 2023-12-24T18:37:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 -- 172.21.15.50:0/3749630911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 msgr2=0x7f16f41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 --2- 172.21.15.50:0/3749630911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f41591d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009e60 tx=0x7f16ec009780 comp rx=0 tx=0).stop 2023-12-24T18:37:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 -- 172.21.15.50:0/3749630911 shutdown_connections 2023-12-24T18:37:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 --2- 172.21.15.50:0/3749630911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f41591d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 -- 172.21.15.50:0/3749630911 >> 172.21.15.50:0/3749630911 conn(0x7f16f4067b80 msgr2=0x7f16f40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 -- 172.21.15.50:0/3749630911 shutdown_connections 2023-12-24T18:37:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.278+0000 7f16fb00c700 1 -- 172.21.15.50:0/3749630911 wait complete. 2023-12-24T18:37:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 Processor -- start 2023-12-24T18:37:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 -- start start 2023-12-24T18:37:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 0x7f16f415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16f4158e00 0x7f16f412dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f412e0e0 con 0x7f16f406d8c0 2023-12-24T18:37:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f412e2f0 con 0x7f16f40b41e0 2023-12-24T18:37:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f412e5d0 con 0x7f16f4158e00 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35112/0 (socket says 172.21.15.50:35112) 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 -- 172.21.15.50:0/611025950 learned_addr learned my addr 172.21.15.50:0/611025950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa80b700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16f4158e00 0x7f16f412dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16f9809700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 0x7f16f415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 -- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16f4158e00 msgr2=0x7f16f412dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16f4158e00 0x7f16f412dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 -- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 msgr2=0x7f16f415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 0x7f16f415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 -- 172.21.15.50:0/611025950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009a20 con 0x7f16f406d8c0 2023-12-24T18:37:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16f9809700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 0x7f16f415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fa00a700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c5b0 tx=0x7f16f0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0005b30 con 0x7f16f406d8c0 2023-12-24T18:37:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0005c90 con 0x7f16f406d8c0 2023-12-24T18:37:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f412e8b0 con 0x7f16f406d8c0 2023-12-24T18:37:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.282+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0007300 con 0x7f16f406d8c0 2023-12-24T18:37:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.286+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f412ee70 con 0x7f16f406d8c0 2023-12-24T18:37:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.286+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f404be40 con 0x7f16f406d8c0 2023-12-24T18:37:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.286+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f16f001b3b0 con 0x7f16f406d8c0 2023-12-24T18:37:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.290+0000 7f16ea7fc700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 0x7f16d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.290+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f16f007c140 con 0x7f16f406d8c0 2023-12-24T18:37:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.290+0000 7f16f9809700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 0x7f16d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.290+0000 7f16f9809700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 0x7f16d8062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007fd0 tx=0x7f16e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.294+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f16f004c2a0 con 0x7f16f406d8c0 2023-12-24T18:37:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.506+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16f406bbc0 con 0x7f16f406d8c0 2023-12-24T18:37:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.510+0000 7f16ea7fc700 1 -- 172.21.15.50:0/611025950 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f16f004f8c0 con 0x7f16f406d8c0 2023-12-24T18:37:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:18.513 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/876189530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":876189530},{"type":"v1","addr":"172.21.15.82:6835","nonce":876189530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/167121959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":167121959},{"type":"v1","addr":"172.21.15.50:6835","nonce":167121959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/4202646563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":4202646563},{"type":"v1","addr":"172.21.15.50:6837","nonce":4202646563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:36:27.528972+0000","modified":"2023-12-24T18:36:43.291982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/2517814635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2517814635},{"type":"v1","addr":"172.21.15.82:6834","nonce":2517814635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 msgr2=0x7f16d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 0x7f16d8062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007fd0 tx=0x7f16e4009040 comp rx=0 tx=0).stop 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 msgr2=0x7f16f4130690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c5b0 tx=0x7f16f0001070 comp rx=0 tx=0).stop 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 shutdown_connections 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16d8060550 0x7f16d8062a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16f4158e00 0x7f16f412dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f40b41e0 0x7f16f415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 --2- 172.21.15.50:0/611025950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f406d8c0 0x7f16f4130690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 >> 172.21.15.50:0/611025950 conn(0x7f16f4067b80 msgr2=0x7f16f40a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 shutdown_connections 2023-12-24T18:37:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.514+0000 7f16fb00c700 1 -- 172.21.15.50:0/611025950 wait complete. 2023-12-24T18:37:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-12-24T18:37:18.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.698+0000 7f1fbc385700 1 Processor -- start 2023-12-24T18:37:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.698+0000 7f1fbc385700 1 -- start start 2023-12-24T18:37:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fb4158e00 0x7f1fb40ab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 0x7f1fb41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb406d780 con 0x7f1fb40abc80 2023-12-24T18:37:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40ac100 con 0x7f1fb4158e00 2023-12-24T18:37:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb406c9c0 con 0x7f1fb40b0c50 2023-12-24T18:37:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fb4158e00 0x7f1fb40ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fb4158e00 0x7f1fb40ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35124/0 (socket says 172.21.15.50:35124) 2023-12-24T18:37:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 -- 172.21.15.50:0/929197309 learned_addr learned my addr 172.21.15.50:0/929197309 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb9920700 1 --1- 172.21.15.50:0/929197309 >> v1:172.21.15.50:6789/0 conn(0x7f1fb40abc80 0x7f1fb40b0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50378/0 (socket says 172.21.15.50:50378) 2023-12-24T18:37:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba922700 1 --2- 172.21.15.50:0/929197309 >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 0x7f1fb41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb911f700 1 -- 172.21.15.50:0/929197309 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487801581 0 0) 0x7f1fb406d780 con 0x7f1fb40abc80 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb911f700 1 -- 172.21.15.50:0/929197309 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa0003570 con 0x7f1fb40abc80 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 -- 172.21.15.50:0/929197309 >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 msgr2=0x7f1fb41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 --2- 172.21.15.50:0/929197309 >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 0x7f1fb41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 -- 172.21.15.50:0/929197309 >> v1:172.21.15.50:6789/0 conn(0x7f1fb40abc80 legacy=0x7f1fb40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 -- 172.21.15.50:0/929197309 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb406cca0 con 0x7f1fb4158e00 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba922700 1 --2- 172.21.15.50:0/929197309 >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 0x7f1fb41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fba121700 1 --2- 172.21.15.50:0/929197309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40ab740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069b30 tx=0x7f1fb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff562c40e791e5d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb911f700 1 -- 172.21.15.50:0/929197309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0009e70 con 0x7f1fb4158e00 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb911f700 1 -- 172.21.15.50:0/929197309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000b860 con 0x7f1fb4158e00 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fb911f700 1 -- 172.21.15.50:0/929197309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000bc00 con 0x7f1fb4158e00 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 -- 172.21.15.50:0/929197309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 msgr2=0x7f1fb40ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.702+0000 7f1fbc385700 1 --2- 172.21.15.50:0/929197309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40ab740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069b30 tx=0x7f1fb0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- 172.21.15.50:0/929197309 shutdown_connections 2023-12-24T18:37:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 --2- 172.21.15.50:0/929197309 >> v2:172.21.15.82:3300/0 conn(0x7f1fb40b0c50 0x7f1fb41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 --2- 172.21.15.50:0/929197309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40ab740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- 172.21.15.50:0/929197309 >> 172.21.15.50:0/929197309 conn(0x7f1fb40ccce0 msgr2=0x7f1fb40cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- 172.21.15.50:0/929197309 shutdown_connections 2023-12-24T18:37:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- 172.21.15.50:0/929197309 wait complete. 2023-12-24T18:37:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 Processor -- start 2023-12-24T18:37:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- start start 2023-12-24T18:37:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fb40abc80 0x7f1fb40cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b0c50 0x7f1fb4155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40cb3e0 con 0x7f1fb4158e00 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40cbdb0 con 0x7f1fb40b0c50 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.706+0000 7f1fbc385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40ca7d0 con 0x7f1fb40abc80 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fb9920700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b0c50 0x7f1fb4155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35126/0 (socket says 172.21.15.50:35126) 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 -- 172.21.15.50:0/535270935 learned_addr learned my addr 172.21.15.50:0/535270935 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba121700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fb40abc80 0x7f1fb40cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 -- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fb40abc80 msgr2=0x7f1fb40cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fb40abc80 0x7f1fb40cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 -- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b0c50 msgr2=0x7f1fb4155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b0c50 0x7f1fb4155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 -- 172.21.15.50:0/535270935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00094f0 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fba922700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d180 tx=0x7f1fac009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00dcc0 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00f040 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac015690 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40caab0 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40cb070 con 0x7f1fb4158e00 2023-12-24T18:37:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.710+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40cb590 con 0x7f1fb4158e00 2023-12-24T18:37:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.714+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1fac01e3b0 con 0x7f1fb4158e00 2023-12-24T18:37:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.714+0000 7f1faa7fc700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 0x7f1f98062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.714+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f1fac07d150 con 0x7f1fb4158e00 2023-12-24T18:37:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.714+0000 7f1fba121700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 0x7f1f98062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.718+0000 7f1fba121700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 0x7f1f98062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069b30 tx=0x7f1fb0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.722+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fb40cb590 con 0x7f1fb4158e00 2023-12-24T18:37:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.898+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb40652e0 con 0x7f1fb4158e00 2023-12-24T18:37:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.898+0000 7f1faa7fc700 1 -- 172.21.15.50:0/535270935 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+17564 (secure 0 0 0) 0x7f1fac04d2b0 con 0x7f1fb4158e00 2023-12-24T18:37:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:18.904 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:10.496207+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:36:25.074564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T18:36:26.486152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-24T18:36:30.267196+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 msgr2=0x7f1f98062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 0x7f1f98062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069b30 tx=0x7f1fb0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 msgr2=0x7f1fb40c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d180 tx=0x7f1fac009a50 comp rx=0 tx=0).stop 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 shutdown_connections 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1f98060550 0x7f1f98062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb4158e00 0x7f1fb40c82b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b0c50 0x7f1fb4155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 --2- 172.21.15.50:0/535270935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1fb40abc80 0x7f1fb40cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 >> 172.21.15.50:0/535270935 conn(0x7f1fb40ccce0 msgr2=0x7f1fb415ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 shutdown_connections 2023-12-24T18:37:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:18.902+0000 7f1fbc385700 1 -- 172.21.15.50:0/535270935 wait complete. 2023-12-24T18:37:18.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:37:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 Processor -- start 2023-12-24T18:37:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 -- start start 2023-12-24T18:37:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45640caf40 0x7f45640cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f456406cd30 0x7f45640ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456415a4d0 con 0x7f45640cd0d0 2023-12-24T18:37:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4564159610 con 0x7f456406cd30 2023-12-24T18:37:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640cc8e0 con 0x7f45640caf40 2023-12-24T18:37:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569615700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45640cd0d0 0x7f4564156690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50390/0 (socket says 172.21.15.50:50390) 2023-12-24T18:37:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4569615700 1 -- 172.21.15.50:0/2327736615 learned_addr learned my addr 172.21.15.50:0/2327736615 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.086+0000 7f4563fff700 1 --2- 172.21.15.50:0/2327736615 >> v2:172.21.15.82:3300/0 conn(0x7f456406cd30 0x7f45640ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4568e14700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45640caf40 0x7f45640cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356052453 0 0) 0x7f456415a4d0 con 0x7f45640cd0d0 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c003570 con 0x7f45640cd0d0 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4563fff700 1 -- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45640caf40 msgr2=0x7f45640cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4563fff700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45640caf40 0x7f45640cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4563fff700 1 -- 172.21.15.50:0/2327736615 >> v1:172.21.15.50:6789/0 conn(0x7f45640cd0d0 legacy=0x7f4564156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2928986139 0 0) 0x7f454c003570 con 0x7f45640cd0d0 2023-12-24T18:37:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4563fff700 1 -- 172.21.15.50:0/2327736615 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45641598c0 con 0x7f456406cd30 2023-12-24T18:37:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4563fff700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f456406cd30 0x7f45640ccb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4554009910 tx=0x7f45540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccad7d507149cd35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0017f0 con 0x7f456406cd30 2023-12-24T18:37:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554011420 con 0x7f456406cd30 2023-12-24T18:37:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f45637fe700 1 -- 172.21.15.50:0/2327736615 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540117c0 con 0x7f456406cd30 2023-12-24T18:37:19.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 -- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f456406cd30 msgr2=0x7f45640ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f456406cd30 0x7f45640ccb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4554009910 tx=0x7f45540091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 -- 172.21.15.50:0/2327736615 shutdown_connections 2023-12-24T18:37:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f456406cd30 0x7f45640ccb90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 --2- 172.21.15.50:0/2327736615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45640caf40 0x7f45640cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 -- 172.21.15.50:0/2327736615 >> 172.21.15.50:0/2327736615 conn(0x7f45640670b0 msgr2=0x7f45640674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 -- 172.21.15.50:0/2327736615 shutdown_connections 2023-12-24T18:37:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.090+0000 7f4569e16700 1 -- 172.21.15.50:0/2327736615 wait complete. 2023-12-24T18:37:19.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 Processor -- start 2023-12-24T18:37:19.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 -- start start 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f456406cd30 0x7f45641552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4564169400 0x7f456415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b4550 con 0x7f4564169400 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b27a0 con 0x7f45640caf40 2023-12-24T18:37:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4569e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b3c20 con 0x7f456406cd30 2023-12-24T18:37:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.094+0000 7f4563fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:42290/0 (socket says 172.21.15.50:42290) 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 -- 172.21.15.50:0/3019786769 learned_addr learned my addr 172.21.15.50:0/3019786769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4569615700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4564169400 0x7f456415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4568e14700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f456406cd30 0x7f45641552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 -- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f456406cd30 msgr2=0x7f45641552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f456406cd30 0x7f45641552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 -- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4564169400 msgr2=0x7f456415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4564169400 0x7f456415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 -- 172.21.15.50:0/3019786769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009420 con 0x7f45640caf40 2023-12-24T18:37:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4563fff700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45540093f0 tx=0x7f4554016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455401bbd0 con 0x7f45640caf40 2023-12-24T18:37:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455401bd30 con 0x7f45640caf40 2023-12-24T18:37:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455401bea0 con 0x7f45640caf40 2023-12-24T18:37:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45640b3f00 con 0x7f45640caf40 2023-12-24T18:37:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4564155800 con 0x7f45640caf40 2023-12-24T18:37:19.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.098+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640b46c0 con 0x7f45640caf40 2023-12-24T18:37:19.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.102+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f455401c930 con 0x7f45640caf40 2023-12-24T18:37:19.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.102+0000 7f4560ff9700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 0x7f4550062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.102+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6717+0+0 (secure 0 0 0) 0x7f455407e230 con 0x7f45640caf40 2023-12-24T18:37:19.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.102+0000 7f4568e14700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 0x7f4550062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.102+0000 7f4568e14700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 0x7f4550062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d40 tx=0x7f4558008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.106+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f455404e390 con 0x7f45640caf40 2023-12-24T18:37:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.314+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f456404be40 con 0x7f45640caf40 2023-12-24T18:37:19.319 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:37:19.314+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:37:19.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.326+0000 7f4560ff9700 1 -- 172.21.15.50:0/3019786769 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f45540519b0 con 0x7f45640caf40 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 msgr2=0x7f4550062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 0x7f4550062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d40 tx=0x7f4558008040 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 msgr2=0x7f456415d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45540093f0 tx=0x7f4554016000 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 shutdown_connections 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4550060550 0x7f4550062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4564169400 0x7f456415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45640caf40 0x7f456415d550 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 --2- 172.21.15.50:0/3019786769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f456406cd30 0x7f45641552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 >> 172.21.15.50:0/3019786769 conn(0x7f45640670b0 msgr2=0x7f456415a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 shutdown_connections 2023-12-24T18:37:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.330+0000 7f4569e16700 1 -- 172.21.15.50:0/3019786769 wait complete. 2023-12-24T18:37:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:37:19.341 INFO:tasks.ceph.mds.d.smithi082.stderr: -3219> 2023-12-24T18:36:28.405+0000 7f1184c86700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:37:19.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:37:19.396 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:37:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 Processor -- start 2023-12-24T18:37:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 -- start start 2023-12-24T18:37:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa870156e80 0x7fa8700c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87015b5a0 con 0x7fa8700c8d10 2023-12-24T18:37:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700c9100 con 0x7fa870156ab0 2023-12-24T18:37:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa8749cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87015a990 con 0x7fa870156e80 2023-12-24T18:37:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa866ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa870156e80 0x7fa8700c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa86f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa870156ab0 0x7fa8700adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35760/0 (socket says 172.21.15.50:35760) 2023-12-24T18:37:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa86ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8700c8d10 0x7fa8700c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60730/0 (socket says 172.21.15.50:60730) 2023-12-24T18:37:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa86f7fe700 1 -- 172.21.15.50:0/447897000 learned_addr learned my addr 172.21.15.50:0/447897000 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.534+0000 7fa866ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa870156e80 0x7fa8700c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37586/0 (socket says 172.21.15.50:37586) 2023-12-24T18:37:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa86effd700 1 -- 172.21.15.50:0/447897000 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448496814 0 0) 0x7fa87015b5a0 con 0x7fa8700c8d10 2023-12-24T18:37:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa866ffd700 1 -- 172.21.15.50:0/447897000 >> v1:172.21.15.82:6789/0 conn(0x7fa870156ab0 legacy=0x7fa8700adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa866ffd700 1 -- 172.21.15.50:0/447897000 >> v1:172.21.15.50:6789/0 conn(0x7fa8700c8d10 legacy=0x7fa8700c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa866ffd700 1 -- 172.21.15.50:0/447897000 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87015ac70 con 0x7fa870156e80 2023-12-24T18:37:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa866ffd700 1 --2- 172.21.15.50:0/447897000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa8700c87d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa858009860 tx=0x7fa8580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc451959c7fc5e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa86effd700 1 -- 172.21.15.50:0/447897000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858011630 con 0x7fa870156e80 2023-12-24T18:37:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa86effd700 1 -- 172.21.15.50:0/447897000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858011790 con 0x7fa870156e80 2023-12-24T18:37:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa86effd700 1 -- 172.21.15.50:0/447897000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858011b50 con 0x7fa870156e80 2023-12-24T18:37:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 -- 172.21.15.50:0/447897000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 msgr2=0x7fa8700c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 --2- 172.21.15.50:0/447897000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa8700c87d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa858009860 tx=0x7fa8580091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 -- 172.21.15.50:0/447897000 shutdown_connections 2023-12-24T18:37:19.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 --2- 172.21.15.50:0/447897000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa8700c87d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 -- 172.21.15.50:0/447897000 >> 172.21.15.50:0/447897000 conn(0x7fa870067250 msgr2=0x7fa870067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:19.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 -- 172.21.15.50:0/447897000 shutdown_connections 2023-12-24T18:37:19.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.538+0000 7fa8749cc700 1 -- 172.21.15.50:0/447897000 wait complete. 2023-12-24T18:37:19.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.542+0000 7fa8749cc700 1 Processor -- start 2023-12-24T18:37:19.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.542+0000 7fa8749cc700 1 -- start start 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8700c8d10 0x7fa870159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870156ab0 0x7fa8701573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c3440 con 0x7fa870156e80 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870157e30 con 0x7fa870156ab0 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa870158110 con 0x7fa8700c8d10 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37588/0 (socket says 172.21.15.50:37588) 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 -- 172.21.15.50:0/3138669467 learned_addr learned my addr 172.21.15.50:0/3138669467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86f7fe700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8700c8d10 0x7fa870159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa866ffd700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870156ab0 0x7fa8701573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 -- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8700c8d10 msgr2=0x7fa870159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8700c8d10 0x7fa870159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 -- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870156ab0 msgr2=0x7fa8701573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870156ab0 0x7fa8701573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 -- 172.21.15.50:0/3138669467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009420 con 0x7fa870156e80 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa86ffff700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa868001110 tx=0x7fa868007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868005a70 con 0x7fa870156e80 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868005bd0 con 0x7fa870156e80 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8701583f0 con 0x7fa870156e80 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680070d0 con 0x7fa870156e80 2023-12-24T18:37:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.546+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870159640 con 0x7fa870156e80 2023-12-24T18:37:19.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.550+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700c3210 con 0x7fa870156e80 2023-12-24T18:37:19.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.550+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa868007480 con 0x7fa870156e80 2023-12-24T18:37:19.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.554+0000 7fa867fff700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 0x7fa850062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:19.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.554+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fa86807c0f0 con 0x7fa870156e80 2023-12-24T18:37:19.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.554+0000 7fa86f7fe700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 0x7fa850062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.554+0000 7fa86f7fe700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 0x7fa850062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa860005c50 tx=0x7fa860009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.558+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8700c3210 con 0x7fa870156e80 2023-12-24T18:37:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:19.770+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa8700c3210 con 0x7fa870156e80 2023-12-24T18:37:20.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.330+0000 7fa867fff700 1 -- 172.21.15.50:0/3138669467 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8700c3210 con 0x7fa870156e80 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 msgr2=0x7fa850062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 0x7fa850062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa860005c50 tx=0x7fa860009040 comp rx=0 tx=0).stop 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 msgr2=0x7fa870153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa868001110 tx=0x7fa868007e10 comp rx=0 tx=0).stop 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 shutdown_connections 2023-12-24T18:37:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa850060550 0x7fa850062a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa870156e80 0x7fa870153230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870156ab0 0x7fa8701573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 --2- 172.21.15.50:0/3138669467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8700c8d10 0x7fa870159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 >> 172.21.15.50:0/3138669467 conn(0x7fa870067250 msgr2=0x7fa8700aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 shutdown_connections 2023-12-24T18:37:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.334+0000 7fa8749cc700 1 -- 172.21.15.50:0/3138669467 wait complete. 2023-12-24T18:37:20.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:37:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.534+0000 7f9f4e665700 1 Processor -- start 2023-12-24T18:37:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.534+0000 7f9f4e665700 1 -- start start 2023-12-24T18:37:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4e665700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4e665700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f480b0e80 0x7f9f4806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4e665700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480af450 con 0x7f9f480c8070 2023-12-24T18:37:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4e665700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480b1320 con 0x7f9f480b0e80 2023-12-24T18:37:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4e665700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480af730 con 0x7f9f480c8440 2023-12-24T18:37:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f47fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f480c8070 0x7f9f480aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60736/0 (socket says 172.21.15.50:60736) 2023-12-24T18:37:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f47fff700 1 -- 172.21.15.50:0/1519291534 learned_addr learned my addr 172.21.15.50:0/1519291534 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f4cc02700 1 --2- 172.21.15.50:0/1519291534 >> v2:172.21.15.50:3300/0 conn(0x7f9f480b0e80 0x7f9f4806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.538+0000 7f9f477fe700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4cc02700 1 -- 172.21.15.50:0/1519291534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 msgr2=0x7f9f480b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4cc02700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4cc02700 1 -- 172.21.15.50:0/1519291534 >> v1:172.21.15.50:6789/0 conn(0x7f9f480c8070 legacy=0x7f9f480aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4cc02700 1 -- 172.21.15.50:0/1519291534 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480afa10 con 0x7f9f480b0e80 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f46ffd700 1 -- 172.21.15.50:0/1519291534 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919319381 0 0) 0x7f9f480af450 con 0x7f9f480c8070 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4cc02700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480b0e80 0x7f9f4806cc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009e60 tx=0x7f9f40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840e4e3b7e2d62b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f46ffd700 1 -- 172.21.15.50:0/1519291534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000e070 con 0x7f9f480b0e80 2023-12-24T18:37:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f46ffd700 1 -- 172.21.15.50:0/1519291534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000bb60 con 0x7f9f480b0e80 2023-12-24T18:37:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f46ffd700 1 -- 172.21.15.50:0/1519291534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40012430 con 0x7f9f480b0e80 2023-12-24T18:37:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 -- 172.21.15.50:0/1519291534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480b0e80 msgr2=0x7f9f4806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480b0e80 0x7f9f4806cc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009e60 tx=0x7f9f40009780 comp rx=0 tx=0).stop 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 -- 172.21.15.50:0/1519291534 shutdown_connections 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480b0e80 0x7f9f4806cc00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1519291534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 -- 172.21.15.50:0/1519291534 >> 172.21.15.50:0/1519291534 conn(0x7f9f48067b80 msgr2=0x7f9f480ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 -- 172.21.15.50:0/1519291534 shutdown_connections 2023-12-24T18:37:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.542+0000 7f9f4e665700 1 -- 172.21.15.50:0/1519291534 wait complete. 2023-12-24T18:37:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 Processor -- start 2023-12-24T18:37:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 -- start start 2023-12-24T18:37:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f480b0e80 0x7f9f4813b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48153100 con 0x7f9f480c8070 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4814dd00 con 0x7f9f480b0e80 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4e665700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48156ce0 con 0x7f9f480c8440 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37608/0 (socket says 172.21.15.50:37608) 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f477fe700 1 -- 172.21.15.50:0/1550862115 learned_addr learned my addr 172.21.15.50:0/1550862115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f47fff700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f480b0e80 0x7f9f4813b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.546+0000 7f9f4cc02700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 -- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 msgr2=0x7f9f480ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 -- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f480b0e80 msgr2=0x7f9f4813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f480b0e80 0x7f9f4813b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 -- 172.21.15.50:0/1550862115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40009a20 con 0x7f9f480c8070 2023-12-24T18:37:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f477fe700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00e930 tx=0x7f9f3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c013680 con 0x7f9f480c8070 2023-12-24T18:37:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0137e0 con 0x7f9f480c8070 2023-12-24T18:37:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c013b80 con 0x7f9f480c8070 2023-12-24T18:37:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f481524f0 con 0x7f9f480c8070 2023-12-24T18:37:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f48152ab0 con 0x7f9f480c8070 2023-12-24T18:37:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.550+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f48153270 con 0x7f9f480c8070 2023-12-24T18:37:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.554+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9f3c00c3e0 con 0x7f9f480c8070 2023-12-24T18:37:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.554+0000 7f9f2ffff700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 0x7f9f34062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.554+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f9f3c07cca0 con 0x7f9f480c8070 2023-12-24T18:37:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.554+0000 7f9f47fff700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 0x7f9f34062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.558+0000 7f9f47fff700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 0x7f9f34062b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f48156f30 tx=0x7f9f38007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:20.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.558+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f3c04ce20 con 0x7f9f480c8070 2023-12-24T18:37:20.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:20.738+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9f48071060 con 0x7f9f480c8070 2023-12-24T18:37:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.594+0000 7f9f2ffff700 1 -- 172.21.15.50:0/1550862115 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9f3c0170d0 con 0x7f9f480c8070 2023-12-24T18:37:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 msgr2=0x7f9f34062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 0x7f9f34062b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f48156f30 tx=0x7f9f38007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 msgr2=0x7f9f481567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00e930 tx=0x7f9f3c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 shutdown_connections 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9f34060650 0x7f9f34062b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f480c8440 0x7f9f480ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f480c8070 0x7f9f481567a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 --2- 172.21.15.50:0/1550862115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f480b0e80 0x7f9f4813b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.598+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 >> 172.21.15.50:0/1550862115 conn(0x7f9f48067b80 msgr2=0x7f9f4814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.602+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 shutdown_connections 2023-12-24T18:37:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.602+0000 7f9f4e665700 1 -- 172.21.15.50:0/1550862115 wait complete. 2023-12-24T18:37:21.606 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:37:21.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:37:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.806+0000 7f55c62f0700 1 Processor -- start 2023-12-24T18:37:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.806+0000 7f55c62f0700 1 -- start start 2023-12-24T18:37:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c62f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55c006db90 0x7f55c015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c62f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c006d4d0 con 0x7f55c0156b50 2023-12-24T18:37:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c62f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c00b4960 con 0x7f55c00b4230 2023-12-24T18:37:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c62f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c015a620 con 0x7f55c006db90 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c488d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55c006db90 0x7f55c015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55bffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f55c0156b50 0x7f55c00b3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60746/0 (socket says 172.21.15.50:60746) 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55bffff700 1 -- 172.21.15.50:0/541037498 learned_addr learned my addr 172.21.15.50:0/541037498 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55bf7fe700 1 --1- 172.21.15.50:0/541037498 >> v1:172.21.15.82:6789/0 conn(0x7f55c00b4230 0x7f55c006a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35768/0 (socket says 172.21.15.50:35768) 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c488d700 1 -- 172.21.15.50:0/541037498 >> v1:172.21.15.82:6789/0 conn(0x7f55c00b4230 legacy=0x7f55c006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c488d700 1 -- 172.21.15.50:0/541037498 >> v1:172.21.15.50:6789/0 conn(0x7f55c0156b50 legacy=0x7f55c00b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c488d700 1 -- 172.21.15.50:0/541037498 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c006c8c0 con 0x7f55c006db90 2023-12-24T18:37:21.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.810+0000 7f55c488d700 1 --2- 172.21.15.50:0/541037498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c015a0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009e60 tx=0x7f55b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3699798051bf2df server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:21.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55beffd700 1 -- 172.21.15.50:0/541037498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800e070 con 0x7f55c006db90 2023-12-24T18:37:21.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55beffd700 1 -- 172.21.15.50:0/541037498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b800bc30 con 0x7f55c006db90 2023-12-24T18:37:21.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55beffd700 1 -- 172.21.15.50:0/541037498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8012430 con 0x7f55c006db90 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 -- 172.21.15.50:0/541037498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 msgr2=0x7f55c015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 --2- 172.21.15.50:0/541037498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c015a0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009e60 tx=0x7f55b8009780 comp rx=0 tx=0).stop 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 -- 172.21.15.50:0/541037498 shutdown_connections 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 --2- 172.21.15.50:0/541037498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c015a0e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 -- 172.21.15.50:0/541037498 >> 172.21.15.50:0/541037498 conn(0x7f55c0067b40 msgr2=0x7f55c00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:21.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 -- 172.21.15.50:0/541037498 shutdown_connections 2023-12-24T18:37:21.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.814+0000 7f55c62f0700 1 -- 172.21.15.50:0/541037498 wait complete. 2023-12-24T18:37:21.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 Processor -- start 2023-12-24T18:37:21.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 -- start start 2023-12-24T18:37:21.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:21.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c00b4230 0x7f55c015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55c0156b50 0x7f55c00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00c5080 con 0x7f55c006db90 2023-12-24T18:37:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0087ee0 con 0x7f55c00b4230 2023-12-24T18:37:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c62f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c016de00 con 0x7f55c0156b50 2023-12-24T18:37:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37630/0 (socket says 172.21.15.50:37630) 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 -- 172.21.15.50:0/1757027438 learned_addr learned my addr 172.21.15.50:0/1757027438 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bf7fe700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c00b4230 0x7f55c015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55c488d700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55c0156b50 0x7f55c00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 -- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55c0156b50 msgr2=0x7f55c00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55c0156b50 0x7f55c00cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 -- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c00b4230 msgr2=0x7f55c015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c00b4230 0x7f55c015bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.818+0000 7f55bffff700 1 -- 172.21.15.50:0/1757027438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8009a20 con 0x7f55c006db90 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55bffff700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c590 tx=0x7f55b0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0005b30 con 0x7f55c006db90 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0005cb0 con 0x7f55c006db90 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c016e0e0 con 0x7f55c006db90 2023-12-24T18:37:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0007320 con 0x7f55c006db90 2023-12-24T18:37:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c016e6a0 con 0x7f55c006db90 2023-12-24T18:37:21.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.822+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c016ebb0 con 0x7f55c006db90 2023-12-24T18:37:21.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.826+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f55b001b3b0 con 0x7f55c006db90 2023-12-24T18:37:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.826+0000 7f55a7fff700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 0x7f55ac062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.826+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f55b007bd40 con 0x7f55c006db90 2023-12-24T18:37:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.826+0000 7f55bf7fe700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 0x7f55ac062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.830+0000 7f55bf7fe700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 0x7f55ac062ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55c015c510 tx=0x7f55b4007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:21.834+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f55b004c080 con 0x7f55c006db90 2023-12-24T18:37:22.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.010+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55c01566d0 con 0x7f55c006db90 2023-12-24T18:37:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.598+0000 7f55a7fff700 1 -- 172.21.15.50:0/1757027438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55b004f6a0 con 0x7f55c006db90 2023-12-24T18:37:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 msgr2=0x7f55ac062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 0x7f55ac062ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55c015c510 tx=0x7f55b4007eb0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 msgr2=0x7f55c00879a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c590 tx=0x7f55b0007f90 comp rx=0 tx=0).stop 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 shutdown_connections 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f55ac060620 0x7f55ac062ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55c0156b50 0x7f55c00cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c00b4230 0x7f55c015bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 --2- 172.21.15.50:0/1757027438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55c006db90 0x7f55c00879a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 >> 172.21.15.50:0/1757027438 conn(0x7f55c0067b40 msgr2=0x7f55c0154970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 shutdown_connections 2023-12-24T18:37:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.602+0000 7f55c62f0700 1 -- 172.21.15.50:0/1757027438 wait complete. 2023-12-24T18:37:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:37:22.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-24T18:37:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.810+0000 7f2ef98cd700 1 Processor -- start 2023-12-24T18:37:22.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.810+0000 7f2ef98cd700 1 -- start start 2023-12-24T18:37:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef98cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 0x7f2ef40a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef98cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ef40a8fe0 0x7f2ef4162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef98cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef406a730 con 0x7f2ef40aa080 2023-12-24T18:37:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef98cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef406beb0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef98cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef406d760 con 0x7f2ef41591a0 2023-12-24T18:37:22.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 0x7f2ef40a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ef40a8fe0 0x7f2ef4162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ef40a8fe0 0x7f2ef4162d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:34622/0 (socket says 172.21.15.50:34622) 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef37fe700 1 -- 172.21.15.50:0/1917500019 learned_addr learned my addr 172.21.15.50:0/1917500019 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 0x7f2ef40a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59576/0 (socket says 172.21.15.50:59576) 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.814+0000 7f2eebfff700 1 --1- 172.21.15.50:0/1917500019 >> v1:172.21.15.82:6789/0 conn(0x7f2ef40aa080 0x7f2ef40a88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35774/0 (socket says 172.21.15.50:35774) 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef37fe700 1 -- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 msgr2=0x7f2ef40a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef37fe700 1 --2- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 0x7f2ef40a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef37fe700 1 -- 172.21.15.50:0/1917500019 >> v1:172.21.15.82:6789/0 conn(0x7f2ef40aa080 legacy=0x7f2ef40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef37fe700 1 -- 172.21.15.50:0/1917500019 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef406da40 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef37fe700 1 --2- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef4162d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009f20 tx=0x7f2eec009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724c5b449cc82cc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:22.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef27fc700 1 -- 172.21.15.50:0/1917500019 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00e070 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef27fc700 1 -- 172.21.15.50:0/1917500019 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00b9d0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef27fc700 1 -- 172.21.15.50:0/1917500019 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0092e0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 -- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef40a8fe0 msgr2=0x7f2ef4162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef4162d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009f20 tx=0x7f2eec009840 comp rx=0 tx=0).stop 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 -- 172.21.15.50:0/1917500019 shutdown_connections 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef4162d00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/1917500019 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef41591a0 0x7f2ef40a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 -- 172.21.15.50:0/1917500019 >> 172.21.15.50:0/1917500019 conn(0x7f2ef4067b80 msgr2=0x7f2ef40ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 -- 172.21.15.50:0/1917500019 shutdown_connections 2023-12-24T18:37:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.818+0000 7f2ef98cd700 1 -- 172.21.15.50:0/1917500019 wait complete. 2023-12-24T18:37:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 Processor -- start 2023-12-24T18:37:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 -- start start 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 0x7f2ef41548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 0x7f2ef4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40acc20 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40b0540 con 0x7f2ef41591a0 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef98cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef414bd10 con 0x7f2ef40aa080 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37638/0 (socket says 172.21.15.50:37638) 2023-12-24T18:37:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 -- 172.21.15.50:0/3010064852 learned_addr learned my addr 172.21.15.50:0/3010064852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2eebfff700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 0x7f2ef41548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef37fe700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 0x7f2ef4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 -- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 msgr2=0x7f2ef41548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 0x7f2ef41548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 -- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 msgr2=0x7f2ef4154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 0x7f2ef4154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef2ffd700 1 -- 172.21.15.50:0/3010064852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009ae0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2ef37fe700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 0x7f2ef4154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.822+0000 7f2eebfff700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 0x7f2ef41548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2ef2ffd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400e960 tx=0x7f2ee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400c850 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400c9b0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400cd50 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40af930 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40afef0 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.826+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4071060 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.830+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2ee4013680 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.830+0000 7f2eeaffd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 0x7f2ed4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.830+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5777+0+0 (secure 0 0 0) 0x7f2ee407ca60 con 0x7f2ef40a8fe0 2023-12-24T18:37:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.830+0000 7f2eebfff700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 0x7f2ed4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.830+0000 7f2eebfff700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 0x7f2ed4062a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2edc007fd0 tx=0x7f2edc007e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:22.838+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ee404cf60 con 0x7f2ef40a8fe0 2023-12-24T18:37:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.010+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ef406dd20 con 0x7f2ef40a8fe0 2023-12-24T18:37:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.626+0000 7f2eeaffd700 1 -- 172.21.15.50:0/3010064852 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f2ee4050580 con 0x7f2ef40a8fe0 2023-12-24T18:37:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 msgr2=0x7f2ed4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 0x7f2ed4062a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2edc007fd0 tx=0x7f2edc007e10 comp rx=0 tx=0).stop 2023-12-24T18:37:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 msgr2=0x7f2ef414b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400e960 tx=0x7f2ee40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 shutdown_connections 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2ed4060550 0x7f2ed4062a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41591a0 0x7f2ef4154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ef40aa080 0x7f2ef41548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 --2- 172.21.15.50:0/3010064852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ef40a8fe0 0x7f2ef414b7d0 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400e960 tx=0x7f2ee40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 >> 172.21.15.50:0/3010064852 conn(0x7f2ef4067b80 msgr2=0x7f2ef40cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.634+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 shutdown_connections 2023-12-24T18:37:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.638+0000 7f2ef98cd700 1 -- 172.21.15.50:0/3010064852 wait complete. 2023-12-24T18:37:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2023-12-24T18:37:23.664 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:37:23.664 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:37:23.664 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:37:23.665 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:37:23.665 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:37:23.665 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:37:23.665 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:37:23.665 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:37:23.665 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:37:23.665 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:37:23.666 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:37:23.666 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:37:23.666 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:37:23.666 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:37:23.666 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:37:23.666 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:37:23.681 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:37:23.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:37:23.682 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:37:23.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:37:23.688 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:37:23.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:37:23.688 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:37:23.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:37:23.735 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:37:23.735 DEBUG:teuthology.parallel:result is None 2023-12-24T18:37:23.738 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:37:23.738 DEBUG:teuthology.parallel:result is None 2023-12-24T18:37:23.739 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:37:23.740 DEBUG:teuthology.parallel:result is None 2023-12-24T18:37:23.742 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:37:23.742 DEBUG:teuthology.parallel:result is None 2023-12-24T18:37:23.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:37:23.842 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:37:23.850 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:37:23.850 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:37:23.855 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:37:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.898+0000 7f53611cc700 1 Processor -- start 2023-12-24T18:37:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 -- start start 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f535c0b41e0 0x7f535c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c06b640 con 0x7f535c06d8c0 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c159710 con 0x7f535c0b41e0 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.902+0000 7f53611cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0b5e10 con 0x7f535c158e00 2023-12-24T18:37:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f53609cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f535c0b41e0 0x7f535c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59618/0 (socket says 172.21.15.50:59618) 2023-12-24T18:37:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 -- 172.21.15.50:0/1621173002 learned_addr learned my addr 172.21.15.50:0/1621173002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f5353fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f535c06d8c0 0x7f535c0b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35802/0 (socket says 172.21.15.50:35802) 2023-12-24T18:37:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 -- 172.21.15.50:0/1621173002 >> v2:172.21.15.50:3300/0 conn(0x7f535c0b41e0 msgr2=0x7f535c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 --2- 172.21.15.50:0/1621173002 >> v2:172.21.15.50:3300/0 conn(0x7f535c0b41e0 0x7f535c159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 -- 172.21.15.50:0/1621173002 >> v1:172.21.15.82:6789/0 conn(0x7f535c06d8c0 legacy=0x7f535c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 -- 172.21.15.50:0/1621173002 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c06b8e0 con 0x7f535c158e00 2023-12-24T18:37:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535bfff700 1 --2- 172.21.15.50:0/1621173002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f534c0099b0 tx=0x7f534c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a5aac86e48046e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:23.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535b7fe700 1 -- 172.21.15.50:0/1621173002 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c009ea0 con 0x7f535c158e00 2023-12-24T18:37:23.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535b7fe700 1 -- 172.21.15.50:0/1621173002 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00b860 con 0x7f535c158e00 2023-12-24T18:37:23.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f535b7fe700 1 -- 172.21.15.50:0/1621173002 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00bc00 con 0x7f535c158e00 2023-12-24T18:37:23.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f53611cc700 1 -- 172.21.15.50:0/1621173002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 msgr2=0x7f535c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.906+0000 7f53611cc700 1 --2- 172.21.15.50:0/1621173002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f534c0099b0 tx=0x7f534c009250 comp rx=0 tx=0).stop 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- 172.21.15.50:0/1621173002 shutdown_connections 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 --2- 172.21.15.50:0/1621173002 >> v2:172.21.15.50:3300/0 conn(0x7f535c0b41e0 0x7f535c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 --2- 172.21.15.50:0/1621173002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c158e00 0x7f535c1591d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- 172.21.15.50:0/1621173002 >> 172.21.15.50:0/1621173002 conn(0x7f535c067b80 msgr2=0x7f535c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- 172.21.15.50:0/1621173002 shutdown_connections 2023-12-24T18:37:23.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- 172.21.15.50:0/1621173002 wait complete. 2023-12-24T18:37:23.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 Processor -- start 2023-12-24T18:37:23.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- start start 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 0x7f535c159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 0x7f535c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c15e9a0 con 0x7f535c06d8c0 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c15f790 con 0x7f535c158e00 2023-12-24T18:37:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f53611cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c15eb80 con 0x7f535c0b41e0 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f535bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f535bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37676/0 (socket says 172.21.15.50:37676) 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.910+0000 7f535bfff700 1 -- 172.21.15.50:0/958056159 learned_addr learned my addr 172.21.15.50:0/958056159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f5353fff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 0x7f535c159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 -- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 msgr2=0x7f535c159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f53609cb700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 0x7f535c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 0x7f535c159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 -- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 msgr2=0x7f535c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 0x7f535c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 -- 172.21.15.50:0/958056159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0094f0 con 0x7f535c06d8c0 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f53609cb700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 0x7f535c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:23.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f5353fff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 0x7f535c159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f535bfff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f535c0b5f50 tx=0x7f534c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00bbe0 con 0x7f535c06d8c0 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c011420 con 0x7f535c06d8c0 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c15ee60 con 0x7f535c06d8c0 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0117c0 con 0x7f535c06d8c0 2023-12-24T18:37:23.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c15f420 con 0x7f535c06d8c0 2023-12-24T18:37:23.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.914+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c15b000 con 0x7f535c06d8c0 2023-12-24T18:37:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.918+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f534c011bf0 con 0x7f535c06d8c0 2023-12-24T18:37:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.918+0000 7f5358ff9700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 0x7f533c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.918+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5259+0+0 (secure 0 0 0) 0x7f534c07df10 con 0x7f535c06d8c0 2023-12-24T18:37:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.918+0000 7f5353fff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 0x7f533c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.922+0000 7f5353fff700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 0x7f533c062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f535c15dce0 tx=0x7f5344009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:23.926+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f534c04e620 con 0x7f535c06d8c0 2023-12-24T18:37:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.130+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f535c04be40 con 0x7f535c06d8c0 2023-12-24T18:37:24.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.646+0000 7f5358ff9700 1 -- 172.21.15.50:0/958056159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f534c051c40 con 0x7f535c06d8c0 2023-12-24T18:37:24.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 msgr2=0x7f533c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 0x7f533c062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f535c15dce0 tx=0x7f5344009040 comp rx=0 tx=0).stop 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 msgr2=0x7f535c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f535c0b5f50 tx=0x7f534c017000 comp rx=0 tx=0).stop 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 shutdown_connections 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f533c060550 0x7f533c062a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f535c158e00 0x7f535c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f535c0b41e0 0x7f535c159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 --2- 172.21.15.50:0/958056159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f535c06d8c0 0x7f535c14df90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 >> 172.21.15.50:0/958056159 conn(0x7f535c067b80 msgr2=0x7f535c0a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 shutdown_connections 2023-12-24T18:37:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.650+0000 7f53611cc700 1 -- 172.21.15.50:0/958056159 wait complete. 2023-12-24T18:37:24.657 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:37:24.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:37:24.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.842+0000 7f1e69865700 1 Processor -- start 2023-12-24T18:37:24.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.842+0000 7f1e69865700 1 -- start start 2023-12-24T18:37:24.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.842+0000 7f1e69865700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e64159150 0x7f1e640cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.842+0000 7f1e69865700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e640d01b0 0x7f1e6406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e69865700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640cd6b0 con 0x7f1e6406cd60 2023-12-24T18:37:24.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e69865700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640cc850 con 0x7f1e64159150 2023-12-24T18:37:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e69865700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6406d1a0 con 0x7f1e640d01b0 2023-12-24T18:37:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e64159150 0x7f1e640cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e64159150 0x7f1e640cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37686/0 (socket says 172.21.15.50:37686) 2023-12-24T18:37:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 -- 172.21.15.50:0/286616629 learned_addr learned my addr 172.21.15.50:0/286616629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e627fc700 1 --2- 172.21.15.50:0/286616629 >> v2:172.21.15.82:3300/0 conn(0x7f1e640d01b0 0x7f1e6406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e61ffb700 1 -- 172.21.15.50:0/286616629 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498607226 0 0) 0x7f1e640cd6b0 con 0x7f1e6406cd60 2023-12-24T18:37:24.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 -- 172.21.15.50:0/286616629 >> v2:172.21.15.82:3300/0 conn(0x7f1e640d01b0 msgr2=0x7f1e6406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:24.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 --2- 172.21.15.50:0/286616629 >> v2:172.21.15.82:3300/0 conn(0x7f1e640d01b0 0x7f1e6406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 -- 172.21.15.50:0/286616629 >> v1:172.21.15.82:6789/0 conn(0x7f1e6406cd60 legacy=0x7f1e6415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 -- 172.21.15.50:0/286616629 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640ccaa0 con 0x7f1e64159150 2023-12-24T18:37:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e62ffd700 1 --2- 172.21.15.50:0/286616629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640cc310 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1e6415dea0 tx=0x7f1e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1abd58ac9f5a536 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e61ffb700 1 -- 172.21.15.50:0/286616629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54009e70 con 0x7f1e64159150 2023-12-24T18:37:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e61ffb700 1 -- 172.21.15.50:0/286616629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5400b860 con 0x7f1e64159150 2023-12-24T18:37:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.846+0000 7f1e61ffb700 1 -- 172.21.15.50:0/286616629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400bc00 con 0x7f1e64159150 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- 172.21.15.50:0/286616629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 msgr2=0x7f1e640cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 --2- 172.21.15.50:0/286616629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640cc310 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1e6415dea0 tx=0x7f1e54009250 comp rx=0 tx=0).stop 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- 172.21.15.50:0/286616629 shutdown_connections 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 --2- 172.21.15.50:0/286616629 >> v2:172.21.15.82:3300/0 conn(0x7f1e640d01b0 0x7f1e6406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 --2- 172.21.15.50:0/286616629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640cc310 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- 172.21.15.50:0/286616629 >> 172.21.15.50:0/286616629 conn(0x7f1e640ce1f0 msgr2=0x7f1e640ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- 172.21.15.50:0/286616629 shutdown_connections 2023-12-24T18:37:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- 172.21.15.50:0/286616629 wait complete. 2023-12-24T18:37:24.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 Processor -- start 2023-12-24T18:37:24.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.850+0000 7f1e69865700 1 -- start start 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e6406cd60 0x7f1e640cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 0x7f1e6415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6416a3e0 con 0x7f1e64159150 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6415c1b0 con 0x7f1e640d01b0 2023-12-24T18:37:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64169860 con 0x7f1e6406cd60 2023-12-24T18:37:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37696/0 (socket says 172.21.15.50:37696) 2023-12-24T18:37:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 -- 172.21.15.50:0/3701241316 learned_addr learned my addr 172.21.15.50:0/3701241316 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e62ffd700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e6406cd60 0x7f1e640cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e627fc700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 0x7f1e6415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 -- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e6406cd60 msgr2=0x7f1e640cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e6406cd60 0x7f1e640cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 -- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 msgr2=0x7f1e6415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 0x7f1e6415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 -- 172.21.15.50:0/3701241316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540094f0 con 0x7f1e64159150 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e627fc700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 0x7f1e6415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e63fff700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c001560 tx=0x7f1e5c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c004160 con 0x7f1e64159150 2023-12-24T18:37:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00a7e0 con 0x7f1e64159150 2023-12-24T18:37:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00aba0 con 0x7f1e64159150 2023-12-24T18:37:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e64169b40 con 0x7f1e64159150 2023-12-24T18:37:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.854+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6416a100 con 0x7f1e64159150 2023-12-24T18:37:24.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.858+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e640652e0 con 0x7f1e64159150 2023-12-24T18:37:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.858+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1e5c012420 con 0x7f1e64159150 2023-12-24T18:37:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.858+0000 7f1e4affd700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.862+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f1e5c07c400 con 0x7f1e64159150 2023-12-24T18:37:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.862+0000 7f1e62ffd700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:24.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.862+0000 7f1e62ffd700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 0x7f1e50062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e6415dea0 tx=0x7f1e54017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:24.866+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e5c04cb60 con 0x7f1e64159150 2023-12-24T18:37:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.098+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1e640ccd80 con 0x7f1e64159150 2023-12-24T18:37:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.098+0000 7f1e4affd700 1 -- 172.21.15.50:0/3701241316 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1e5c050180 con 0x7f1e64159150 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:37:25.102 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:37:25.106 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.109 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:37:25.110 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:37:25.111 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:37:25.112 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:37:25.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohl6XJQGBAAkrik9Lx7pcFERlqMhraSqw==", 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohlc4ZQGBAA5PBaiFA31VIE0qOifcziQw==", 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohldpRQGBAAQWn+367HC6elrlSFZKqSLA==", 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohl36JQGBAAXNV8VP/EYOdKQ7G8KBqOAA==", 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-24T18:37:25.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohlLK9QGBAAhtnu7AF5D8a9BRLUrYr63w==", 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATeohlhLtQGBAAvfcRMsbRuZQCKsCeT2Nx3w==", 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:37:25.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:37:25.118 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:37:25.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:25.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:37:25.118 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 msgr2=0x7f1e50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 0x7f1e50062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e6415dea0 tx=0x7f1e54017000 comp rx=0 tx=0).stop 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 msgr2=0x7f1e640b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c001560 tx=0x7f1e5c001770 comp rx=0 tx=0).stop 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 shutdown_connections 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e64159150 0x7f1e640b6a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e640d01b0 0x7f1e6415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 --2- 172.21.15.50:0/3701241316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e6406cd60 0x7f1e640cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 >> 172.21.15.50:0/3701241316 conn(0x7f1e640ce1f0 msgr2=0x7f1e64158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:25.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 shutdown_connections 2023-12-24T18:37:25.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.102+0000 7f1e69865700 1 -- 172.21.15.50:0/3701241316 wait complete. 2023-12-24T18:37:25.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-24T18:37:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.286+0000 7fbb08c6e700 1 Processor -- start 2023-12-24T18:37:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.286+0000 7fbb08c6e700 1 -- start start 2023-12-24T18:37:25.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb04156c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb040c7250 0x7fbb04157140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb0406d930 0x7fbb0406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb040ade60 con 0x7fbb040c7250 2023-12-24T18:37:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb040c8240 con 0x7fbb0406d930 2023-12-24T18:37:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb08c6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0406e280 con 0x7fbb04156830 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb040c7250 0x7fbb04157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb0259c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb04156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb02d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb0406d930 0x7fbb0406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb040c7250 0x7fbb04157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37708/0 (socket says 172.21.15.50:37708) 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbb0259c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb04156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59648/0 (socket says 172.21.15.50:59648) 2023-12-24T18:37:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 -- 172.21.15.50:0/2229508165 learned_addr learned my addr 172.21.15.50:0/2229508165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 -- 172.21.15.50:0/2229508165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 msgr2=0x7fbb04156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2229508165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb04156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 -- 172.21.15.50:0/2229508165 >> v2:172.21.15.82:3300/0 conn(0x7fbb0406d930 msgr2=0x7fbb0406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2229508165 >> v2:172.21.15.82:3300/0 conn(0x7fbb0406d930 0x7fbb0406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.290+0000 7fbafbfff700 1 -- 172.21.15.50:0/2229508165 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0406e710 con 0x7fbb040c7250 2023-12-24T18:37:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2229508165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb040c7250 0x7fbb04157140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb0406f500 tx=0x7fbaec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cd4f7329021c63 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb01d9b700 1 -- 172.21.15.50:0/2229508165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00b640 con 0x7fbb040c7250 2023-12-24T18:37:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb01d9b700 1 -- 172.21.15.50:0/2229508165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec00b7a0 con 0x7fbb040c7250 2023-12-24T18:37:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb01d9b700 1 -- 172.21.15.50:0/2229508165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00bb60 con 0x7fbb040c7250 2023-12-24T18:37:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2229508165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb040c7250 msgr2=0x7fbb04157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2229508165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb040c7250 0x7fbb04157140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb0406f500 tx=0x7fbaec009250 comp rx=0 tx=0).stop 2023-12-24T18:37:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2229508165 shutdown_connections 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2229508165 >> v2:172.21.15.82:3300/0 conn(0x7fbb0406d930 0x7fbb0406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2229508165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb040c7250 0x7fbb04157140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2229508165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb04156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2229508165 >> 172.21.15.50:0/2229508165 conn(0x7fbb0406c1f0 msgr2=0x7fbb04067850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2229508165 shutdown_connections 2023-12-24T18:37:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.294+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2229508165 wait complete. 2023-12-24T18:37:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 Processor -- start 2023-12-24T18:37:25.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 -- start start 2023-12-24T18:37:25.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb040c7250 0x7fbb040c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb040ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040c43b0 con 0x7fbb0406d930 2023-12-24T18:37:25.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040c69e0 con 0x7fbb040c7250 2023-12-24T18:37:25.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.298+0000 7fbb08c6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040c3d60 con 0x7fbb04156830 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37724/0 (socket says 172.21.15.50:37724) 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 -- 172.21.15.50:0/2328873737 learned_addr learned my addr 172.21.15.50:0/2328873737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb02d9d700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb040ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb040c7250 0x7fbb040c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 -- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 msgr2=0x7fbb040ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb040ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 -- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb040c7250 msgr2=0x7fbb040c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb040c7250 0x7fbb040c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 -- 172.21.15.50:0/2328873737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0094f0 con 0x7fbb0406d930 2023-12-24T18:37:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb0259c700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400ea00 tx=0x7fbaf4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400c850 con 0x7fbb0406d930 2023-12-24T18:37:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400c9b0 con 0x7fbb0406d930 2023-12-24T18:37:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb040c4040 con 0x7fbb0406d930 2023-12-24T18:37:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400cd30 con 0x7fbb0406d930 2023-12-24T18:37:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb04150570 con 0x7fbb0406d930 2023-12-24T18:37:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.302+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb040c41d0 con 0x7fbb0406d930 2023-12-24T18:37:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.306+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbaf4013680 con 0x7fbb0406d930 2023-12-24T18:37:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.306+0000 7fbafa7fc700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 0x7fbae4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.306+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7fbaf407cb50 con 0x7fbb0406d930 2023-12-24T18:37:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.306+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 0x7fbae4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.310+0000 7fbafbfff700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 0x7fbae4062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb0406f500 tx=0x7fbaec017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.314+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbaf404d350 con 0x7fbb0406d930 2023-12-24T18:37:25.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:37:25.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:37:25.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.549+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbb040652e0 con 0x7fbb0406d930 2023-12-24T18:37:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.553+0000 7fbafa7fc700 1 -- 172.21.15.50:0/2328873737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbaf40170a0 con 0x7fbb0406d930 2023-12-24T18:37:25.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 msgr2=0x7fbae4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 0x7fbae4062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb0406f500 tx=0x7fbaec017000 comp rx=0 tx=0).stop 2023-12-24T18:37:25.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 msgr2=0x7fbb04150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400ea00 tx=0x7fbaf4009120 comp rx=0 tx=0).stop 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 shutdown_connections 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbae4060550 0x7fbae4062a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb04156830 0x7fbb040ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb040c7250 0x7fbb040c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 --2- 172.21.15.50:0/2328873737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0406d930 0x7fbb04150030 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 >> 172.21.15.50:0/2328873737 conn(0x7fbb0406c1f0 msgr2=0x7fbb040c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 shutdown_connections 2023-12-24T18:37:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.557+0000 7fbb08c6e700 1 -- 172.21.15.50:0/2328873737 wait complete. 2023-12-24T18:37:25.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-24T18:37:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 Processor -- start 2023-12-24T18:37:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 -- start start 2023-12-24T18:37:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 0x7f282c0b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0cf980 con 0x7f282c0b4f50 2023-12-24T18:37:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0ccc00 con 0x7f282c0cc780 2023-12-24T18:37:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f28314f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c06aa10 con 0x7f282c06a510 2023-12-24T18:37:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f282affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f282c0b4f50 0x7f282c159f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60754/0 (socket says 172.21.15.50:60754) 2023-12-24T18:37:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f282affd700 1 -- 172.21.15.50:0/1608531285 learned_addr learned my addr 172.21.15.50:0/1608531285 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.729+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1608531285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 0x7f282c0b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703806586 0 0) 0x7f282c0cf980 con 0x7f282c0b4f50 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2814003570 con 0x7f282c0b4f50 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429361762 0 0) 0x7f282c0ccc00 con 0x7f282c0cc780 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f282c0cf980 con 0x7f282c0cc780 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f282a7fc700 1 -- 172.21.15.50:0/1608531285 >> v1:172.21.15.82:6789/0 conn(0x7f282c0cc780 legacy=0x7f282c1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f282a7fc700 1 -- 172.21.15.50:0/1608531285 >> v1:172.21.15.50:6789/0 conn(0x7f282c0b4f50 legacy=0x7f282c159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f282a7fc700 1 -- 172.21.15.50:0/1608531285 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c06acf0 con 0x7f282c06a510 2023-12-24T18:37:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1608531285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 0x7f282c0b5320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f28200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf152c71b21d9c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820011630 con 0x7f282c06a510 2023-12-24T18:37:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820011790 con 0x7f282c06a510 2023-12-24T18:37:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f2829ffb700 1 -- 172.21.15.50:0/1608531285 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820011b30 con 0x7f282c06a510 2023-12-24T18:37:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 -- 172.21.15.50:0/1608531285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 msgr2=0x7f282c0b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 --2- 172.21.15.50:0/1608531285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 0x7f282c0b5320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f28200091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 -- 172.21.15.50:0/1608531285 shutdown_connections 2023-12-24T18:37:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 --2- 172.21.15.50:0/1608531285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c06a510 0x7f282c0b5320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 -- 172.21.15.50:0/1608531285 >> 172.21.15.50:0/1608531285 conn(0x7f282c0670b0 msgr2=0x7f282c067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 -- 172.21.15.50:0/1608531285 shutdown_connections 2023-12-24T18:37:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.733+0000 7f28314f0700 1 -- 172.21.15.50:0/1608531285 wait complete. 2023-12-24T18:37:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.737+0000 7f28314f0700 1 Processor -- start 2023-12-24T18:37:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.737+0000 7f28314f0700 1 -- start start 2023-12-24T18:37:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 0x7f282c14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282c0cc780 0x7f282c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0c5930 con 0x7f282c06a510 2023-12-24T18:37:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0c6300 con 0x7f282c0cc780 2023-12-24T18:37:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0c4d20 con 0x7f282c0b4f50 2023-12-24T18:37:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37736/0 (socket says 172.21.15.50:37736) 2023-12-24T18:37:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 -- 172.21.15.50:0/1184460227 learned_addr learned my addr 172.21.15.50:0/1184460227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 0x7f282c14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282b7fe700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282c0cc780 0x7f282c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 -- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 msgr2=0x7f282c14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 0x7f282c14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 -- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282c0cc780 msgr2=0x7f282c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282c0cc780 0x7f282c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 -- 172.21.15.50:0/1184460227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009420 con 0x7f282c06a510 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 0x7f282c14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f282affd700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c790 tx=0x7f281c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c005b30 con 0x7f282c06a510 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c005c90 con 0x7f282c06a510 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c007300 con 0x7f282c06a510 2023-12-24T18:37:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0c5000 con 0x7f282c06a510 2023-12-24T18:37:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.741+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c0c55c0 con 0x7f282c06a510 2023-12-24T18:37:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.745+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c06c920 con 0x7f282c06a510 2023-12-24T18:37:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.745+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f281c01b3b0 con 0x7f282c06a510 2023-12-24T18:37:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.745+0000 7f2812ffd700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 0x7f2818062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.745+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f281c07bb70 con 0x7f282c06a510 2023-12-24T18:37:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.745+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 0x7f2818062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.749+0000 7f282a7fc700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 0x7f2818062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f2820017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.753+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f282c06c920 con 0x7f282c06a510 2023-12-24T18:37:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.985+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f282c06c920 con 0x7f282c06a510 2023-12-24T18:37:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.993+0000 7f2812ffd700 1 -- 172.21.15.50:0/1184460227 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f282c06c920 con 0x7f282c06a510 2023-12-24T18:37:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 msgr2=0x7f2818062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 0x7f2818062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f2820017000 comp rx=0 tx=0).stop 2023-12-24T18:37:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 msgr2=0x7f282c0c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c790 tx=0x7f281c007ea0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 shutdown_connections 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2818060550 0x7f2818062a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282c0cc780 0x7f282c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f282c0b4f50 0x7f282c14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 --2- 172.21.15.50:0/1184460227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c06a510 0x7f282c0c5dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 >> 172.21.15.50:0/1184460227 conn(0x7f282c0670b0 msgr2=0x7f282c0b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 shutdown_connections 2023-12-24T18:37:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:25.997+0000 7f28314f0700 1 -- 172.21.15.50:0/1184460227 wait complete. 2023-12-24T18:37:26.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-24T18:37:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 Processor -- start 2023-12-24T18:37:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 -- start start 2023-12-24T18:37:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd140b41e0 0x7fbd141591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1406b640 con 0x7fbd1406d8c0 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd140b5e10 con 0x7fbd14158e00 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.229+0000 7fbd19bcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd14159710 con 0x7fbd140b41e0 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd140b41e0 0x7fbd141591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd140b41e0 0x7fbd141591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37748/0 (socket says 172.21.15.50:37748) 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 -- 172.21.15.50:0/2818939238 learned_addr learned my addr 172.21.15.50:0/2818939238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd193cb700 1 --1- 172.21.15.50:0/2818939238 >> v1:172.21.15.50:6789/0 conn(0x7fbd1406d8c0 0x7fbd14159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60756/0 (socket says 172.21.15.50:60756) 2023-12-24T18:37:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 -- 172.21.15.50:0/2818939238 >> v1:172.21.15.82:6789/0 conn(0x7fbd14158e00 legacy=0x7fbd140b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 -- 172.21.15.50:0/2818939238 >> v1:172.21.15.50:6789/0 conn(0x7fbd1406d8c0 legacy=0x7fbd14159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 -- 172.21.15.50:0/2818939238 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1406b8e0 con 0x7fbd140b41e0 2023-12-24T18:37:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd13fff700 1 --2- 172.21.15.50:0/2818939238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd140b41e0 0x7fbd141591d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd040099b0 tx=0x7fbd04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4e5d6ca6783776 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd137fe700 1 -- 172.21.15.50:0/2818939238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400b860 con 0x7fbd140b41e0 2023-12-24T18:37:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd137fe700 1 -- 172.21.15.50:0/2818939238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400b9c0 con 0x7fbd140b41e0 2023-12-24T18:37:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd137fe700 1 -- 172.21.15.50:0/2818939238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400bd60 con 0x7fbd140b41e0 2023-12-24T18:37:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 -- 172.21.15.50:0/2818939238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd140b41e0 msgr2=0x7fbd141591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/2818939238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd140b41e0 0x7fbd141591d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd040099b0 tx=0x7fbd04009250 comp rx=0 tx=0).stop 2023-12-24T18:37:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 -- 172.21.15.50:0/2818939238 shutdown_connections 2023-12-24T18:37:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/2818939238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd140b41e0 0x7fbd141591d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 -- 172.21.15.50:0/2818939238 >> 172.21.15.50:0/2818939238 conn(0x7fbd14067b80 msgr2=0x7fbd140b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 -- 172.21.15.50:0/2818939238 shutdown_connections 2023-12-24T18:37:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.233+0000 7fbd19bcc700 1 -- 172.21.15.50:0/2818939238 wait complete. 2023-12-24T18:37:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 Processor -- start 2023-12-24T18:37:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 -- start start 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd1406d8c0 0x7fbd1414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd140b41e0 0x7fbd14151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14152a30 con 0x7fbd14158e00 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14152030 con 0x7fbd140b41e0 2023-12-24T18:37:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.237+0000 7fbd19bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1414fd30 con 0x7fbd1406d8c0 2023-12-24T18:37:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37754/0 (socket says 172.21.15.50:37754) 2023-12-24T18:37:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 -- 172.21.15.50:0/1955059426 learned_addr learned my addr 172.21.15.50:0/1955059426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd18bca700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd1406d8c0 0x7fbd1414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd13fff700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd140b41e0 0x7fbd14151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 -- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd1406d8c0 msgr2=0x7fbd1414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd1406d8c0 0x7fbd1414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 -- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd140b41e0 msgr2=0x7fbd14151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd140b41e0 0x7fbd14151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 -- 172.21.15.50:0/1955059426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040094f0 con 0x7fbd14158e00 2023-12-24T18:37:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd193cb700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00cd00 tx=0x7fbd0c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00ce60 con 0x7fbd14158e00 2023-12-24T18:37:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c005df0 con 0x7fbd14158e00 2023-12-24T18:37:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd141523e0 con 0x7fbd14158e00 2023-12-24T18:37:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00ab00 con 0x7fbd14158e00 2023-12-24T18:37:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.241+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd141492e0 con 0x7fbd14158e00 2023-12-24T18:37:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14152240 con 0x7fbd14158e00 2023-12-24T18:37:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbd0c0070f0 con 0x7fbd14158e00 2023-12-24T18:37:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd10ff9700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 0x7fbd00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7fbd0c07c6c0 con 0x7fbd14158e00 2023-12-24T18:37:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd18bca700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 0x7fbd00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.245+0000 7fbd18bca700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 0x7fbd00062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbd080039e0 tx=0x7fbd08007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.253+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd14152240 con 0x7fbd14158e00 2023-12-24T18:37:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.481+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fbd14152240 con 0x7fbd14158e00 2023-12-24T18:37:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.489+0000 7fbd10ff9700 1 -- 172.21.15.50:0/1955059426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbd14152240 con 0x7fbd14158e00 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 msgr2=0x7fbd00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 0x7fbd00062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbd080039e0 tx=0x7fbd08007ec0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 msgr2=0x7fbd14148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00cd00 tx=0x7fbd0c001b10 comp rx=0 tx=0).stop 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 shutdown_connections 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbd00060550 0x7fbd00062a00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd14158e00 0x7fbd14148da0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd140b41e0 0x7fbd14151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 --2- 172.21.15.50:0/1955059426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd1406d8c0 0x7fbd1414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 >> 172.21.15.50:0/1955059426 conn(0x7fbd14067b80 msgr2=0x7fbd14157ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 shutdown_connections 2023-12-24T18:37:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.493+0000 7fbd19bcc700 1 -- 172.21.15.50:0/1955059426 wait complete. 2023-12-24T18:37:26.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-24T18:37:26.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.681+0000 7f7e89443700 1 Processor -- start 2023-12-24T18:37:26.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 -- start start 2023-12-24T18:37:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7e8415a2d0 0x7f7e840ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e84160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840b0460 con 0x7f7e8406c820 2023-12-24T18:37:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8406d8c0 con 0x7f7e8415a2d0 2023-12-24T18:37:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e89443700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840afc60 con 0x7f7e840ade60 2023-12-24T18:37:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e7bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7e8406c820 0x7f7e840ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60772/0 (socket says 172.21.15.50:60772) 2023-12-24T18:37:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e7bfff700 1 -- 172.21.15.50:0/1219038761 learned_addr learned my addr 172.21.15.50:0/1219038761 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e83fff700 1 --2- 172.21.15.50:0/1219038761 >> v2:172.21.15.82:3300/0 conn(0x7f7e8415a2d0 0x7f7e840ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e88c42700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e84160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e83fff700 1 -- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 msgr2=0x7f7e84160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e83fff700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e84160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e83fff700 1 -- 172.21.15.50:0/1219038761 >> v1:172.21.15.50:6789/0 conn(0x7f7e8406c820 legacy=0x7f7e840ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e83fff700 1 -- 172.21.15.50:0/1219038761 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8406a5c0 con 0x7f7e8415a2d0 2023-12-24T18:37:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.685+0000 7f7e88c42700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e84160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e83fff700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8415a2d0 0x7f7e840ae8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e740098e0 tx=0x7f7e740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600fc077540c322d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e837fe700 1 -- 172.21.15.50:0/1219038761 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400b640 con 0x7f7e8415a2d0 2023-12-24T18:37:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e837fe700 1 -- 172.21.15.50:0/1219038761 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400b7a0 con 0x7f7e8415a2d0 2023-12-24T18:37:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e837fe700 1 -- 172.21.15.50:0/1219038761 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400bb40 con 0x7f7e8415a2d0 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 -- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8415a2d0 msgr2=0x7f7e840ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8415a2d0 0x7f7e840ae8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e740098e0 tx=0x7f7e740091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 -- 172.21.15.50:0/1219038761 shutdown_connections 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e84160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 --2- 172.21.15.50:0/1219038761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8415a2d0 0x7f7e840ae8b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 -- 172.21.15.50:0/1219038761 >> 172.21.15.50:0/1219038761 conn(0x7f7e84067b80 msgr2=0x7f7e840cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 -- 172.21.15.50:0/1219038761 shutdown_connections 2023-12-24T18:37:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.689+0000 7f7e89443700 1 -- 172.21.15.50:0/1219038761 wait complete. 2023-12-24T18:37:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 Processor -- start 2023-12-24T18:37:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 -- start start 2023-12-24T18:37:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8406c820 0x7f7e840acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e8414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84168f70 con 0x7f7e8415a2d0 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8414cba0 con 0x7f7e8406c820 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e89443700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840aa940 con 0x7f7e840ade60 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37760/0 (socket says 172.21.15.50:37760) 2023-12-24T18:37:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 -- 172.21.15.50:0/2662895140 learned_addr learned my addr 172.21.15.50:0/2662895140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e83fff700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8406c820 0x7f7e840acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e7bfff700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e8414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 -- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 msgr2=0x7f7e8414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e8414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 -- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8406c820 msgr2=0x7f7e840acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8406c820 0x7f7e840acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.693+0000 7f7e88c42700 1 -- 172.21.15.50:0/2662895140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c009a20 con 0x7f7e8415a2d0 2023-12-24T18:37:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e88c42700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00ef90 tx=0x7f7e7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00cc80 con 0x7f7e8415a2d0 2023-12-24T18:37:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00f040 con 0x7f7e8415a2d0 2023-12-24T18:37:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c014480 con 0x7f7e8415a2d0 2023-12-24T18:37:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e74009420 con 0x7f7e8415a2d0 2023-12-24T18:37:26.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840c1b90 con 0x7f7e8415a2d0 2023-12-24T18:37:26.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8404be40 con 0x7f7e8415a2d0 2023-12-24T18:37:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.697+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7e7c0148b0 con 0x7f7e8415a2d0 2023-12-24T18:37:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.701+0000 7f7e80ff9700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.701+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f7e7c07d410 con 0x7f7e8415a2d0 2023-12-24T18:37:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.701+0000 7f7e83fff700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.701+0000 7f7e83fff700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 0x7f7e64062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e740093f0 tx=0x7f7e74017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.705+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7e7c04dc10 con 0x7f7e8415a2d0 2023-12-24T18:37:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.941+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7e8406b9c0 con 0x7f7e8415a2d0 2023-12-24T18:37:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.949+0000 7f7e80ff9700 1 -- 172.21.15.50:0/2662895140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7e7c051230 con 0x7f7e8415a2d0 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 msgr2=0x7f7e64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 0x7f7e64062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e740093f0 tx=0x7f7e74017000 comp rx=0 tx=0).stop 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 msgr2=0x7f7e8414c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00ef90 tx=0x7f7e7c00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 shutdown_connections 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e8415a2d0 0x7f7e8414c660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e840ade60 0x7f7e8414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 --2- 172.21.15.50:0/2662895140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8406c820 0x7f7e840acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.953+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 >> 172.21.15.50:0/2662895140 conn(0x7f7e84067b80 msgr2=0x7f7e840a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.957+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 shutdown_connections 2023-12-24T18:37:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:26.957+0000 7f7e89443700 1 -- 172.21.15.50:0/2662895140 wait complete. 2023-12-24T18:37:26.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-24T18:37:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 Processor -- start 2023-12-24T18:37:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 -- start start 2023-12-24T18:37:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f40ad220 0x7fc6f40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6f406afa0 0x7fc6f406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f406e110 con 0x7fc6f4155710 2023-12-24T18:37:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f406b930 con 0x7fc6f406afa0 2023-12-24T18:37:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6f359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f406bb40 con 0x7fc6f40ad220 2023-12-24T18:37:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.137+0000 7fc6e9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6f406afa0 0x7fc6f406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6f406afa0 0x7fc6f406b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37762/0 (socket says 172.21.15.50:37762) 2023-12-24T18:37:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3302719328 learned_addr learned my addr 172.21.15.50:0/3302719328 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f259c700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f40ad220 0x7fc6f40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3302719328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f40ad220 msgr2=0x7fc6f40ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f40ad220 0x7fc6f40ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3302719328 >> v1:172.21.15.82:6789/0 conn(0x7fc6f4155710 legacy=0x7fc6f4155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3302719328 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f406be20 con 0x7fc6f406afa0 2023-12-24T18:37:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6e9d9b700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f406afa0 0x7fc6f406b3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009f20 tx=0x7fc6dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f408c4c50757e63 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f1d9b700 1 -- 172.21.15.50:0/3302719328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00e070 con 0x7fc6f406afa0 2023-12-24T18:37:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f1d9b700 1 -- 172.21.15.50:0/3302719328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00ba80 con 0x7fc6f406afa0 2023-12-24T18:37:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f1d9b700 1 -- 172.21.15.50:0/3302719328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0092e0 con 0x7fc6f406afa0 2023-12-24T18:37:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 -- 172.21.15.50:0/3302719328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f406afa0 msgr2=0x7fc6f406b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f406afa0 0x7fc6f406b3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009f20 tx=0x7fc6dc009840 comp rx=0 tx=0).stop 2023-12-24T18:37:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 -- 172.21.15.50:0/3302719328 shutdown_connections 2023-12-24T18:37:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f406afa0 0x7fc6f406b3f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3302719328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f40ad220 0x7fc6f40ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 -- 172.21.15.50:0/3302719328 >> 172.21.15.50:0/3302719328 conn(0x7fc6f4067b80 msgr2=0x7fc6f40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 -- 172.21.15.50:0/3302719328 shutdown_connections 2023-12-24T18:37:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.141+0000 7fc6f359e700 1 -- 172.21.15.50:0/3302719328 wait complete. 2023-12-24T18:37:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 Processor -- start 2023-12-24T18:37:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 -- start start 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 0x7fc6f415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f4155710 0x7fc6f414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.145+0000 7fc6f359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f40ca6d0 con 0x7fc6f40ad220 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f40cb250 con 0x7fc6f406afa0 2023-12-24T18:37:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f40ca920 con 0x7fc6f4155710 2023-12-24T18:37:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37768/0 (socket says 172.21.15.50:37768) 2023-12-24T18:37:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3096656359 learned_addr learned my addr 172.21.15.50:0/3096656359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f259c700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 0x7fc6f415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f2d9d700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f4155710 0x7fc6f414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f4155710 msgr2=0x7fc6f414a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f4155710 0x7fc6f414a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 msgr2=0x7fc6f415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 0x7fc6f415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 -- 172.21.15.50:0/3096656359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009ae0 con 0x7fc6f40ad220 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f259c700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 0x7fc6f415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6e9d9b700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009430 tx=0x7fc6dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc008aa0 con 0x7fc6f40ad220 2023-12-24T18:37:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc008c20 con 0x7fc6f40ad220 2023-12-24T18:37:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f40cac00 con 0x7fc6f40ad220 2023-12-24T18:37:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc025460 con 0x7fc6f40ad220 2023-12-24T18:37:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.149+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f415aec0 con 0x7fc6f40ad220 2023-12-24T18:37:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.153+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f404be40 con 0x7fc6f40ad220 2023-12-24T18:37:27.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.153+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc6dc003040 con 0x7fc6f40ad220 2023-12-24T18:37:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.153+0000 7fc6eaffd700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 0x7fc6d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.153+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7fc6dc07e140 con 0x7fc6f40ad220 2023-12-24T18:37:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.157+0000 7fc6f259c700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 0x7fc6d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.157+0000 7fc6f259c700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 0x7fc6d4062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4006fd0 tx=0x7fc6e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.161+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6dc04e950 con 0x7fc6f40ad220 2023-12-24T18:37:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.393+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc6f40cc840 con 0x7fc6f40ad220 2023-12-24T18:37:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.401+0000 7fc6eaffd700 1 -- 172.21.15.50:0/3096656359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc6dc051f70 con 0x7fc6f40ad220 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 msgr2=0x7fc6d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 0x7fc6d4062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4006fd0 tx=0x7fc6e4008040 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 msgr2=0x7fc6f406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009430 tx=0x7fc6dc018000 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 shutdown_connections 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6d4060550 0x7fc6d4062a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6f4155710 0x7fc6f414a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6f40ad220 0x7fc6f406cac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 --2- 172.21.15.50:0/3096656359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f406afa0 0x7fc6f415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 >> 172.21.15.50:0/3096656359 conn(0x7fc6f4067b80 msgr2=0x7fc6f40aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:27.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 shutdown_connections 2023-12-24T18:37:27.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.405+0000 7fc6f359e700 1 -- 172.21.15.50:0/3096656359 wait complete. 2023-12-24T18:37:27.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-24T18:37:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.593+0000 7fb284385700 1 Processor -- start 2023-12-24T18:37:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.593+0000 7fb284385700 1 -- start start 2023-12-24T18:37:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb284385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb27c154b60 0x7fb27c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb284385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb27c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb284385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c06c820 con 0x7fb27c0c6d00 2023-12-24T18:37:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb284385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c06b960 con 0x7fb27c154b60 2023-12-24T18:37:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb284385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c06bc40 con 0x7fb27c06aca0 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb282121700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb27c0c6d00 0x7fb27c154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60774/0 (socket says 172.21.15.50:60774) 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb282121700 1 -- 172.21.15.50:0/729820554 learned_addr learned my addr 172.21.15.50:0/729820554 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb281920700 1 --2- 172.21.15.50:0/729820554 >> v2:172.21.15.50:3300/0 conn(0x7fb27c154b60 0x7fb27c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb282922700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb27c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369858963 0 0) 0x7fb27c06c820 con 0x7fb27c0c6d00 2023-12-24T18:37:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb268003570 con 0x7fb27c0c6d00 2023-12-24T18:37:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130047542 0 0) 0x7fb268003570 con 0x7fb27c0c6d00 2023-12-24T18:37:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 msgr2=0x7fb27c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb27c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 >> v2:172.21.15.50:3300/0 conn(0x7fb27c154b60 msgr2=0x7fb27c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 --2- 172.21.15.50:0/729820554 >> v2:172.21.15.50:3300/0 conn(0x7fb27c154b60 0x7fb27c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c06bf20 con 0x7fb27c0c6d00 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fb278001470 con 0x7fb27c0c6d00 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 >> v1:172.21.15.50:6789/0 conn(0x7fb27c0c6d00 legacy=0x7fb27c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb268003a60 0x7fb268003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb268004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb268004d50 0x7fb2680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c06b960 con 0x7fb268003a60 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c06bc40 con 0x7fb268004d50 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.597+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26800fe70 con 0x7fb27c06aca0 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb268003a60 0x7fb268003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282922700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb268004d50 0x7fb2680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb281920700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb268004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 -- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 msgr2=0x7fb268004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27c06aca0 0x7fb268004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 -- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb268004d50 msgr2=0x7fb2680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb268004d50 0x7fb2680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 -- 172.21.15.50:0/729820554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268003570 con 0x7fb268003a60 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282121700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb268003a60 0x7fb268003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb278001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc9785454d0b831 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800cc30 con 0x7fb268003a60 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800cdd0 con 0x7fb268003a60 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb28111f700 1 -- 172.21.15.50:0/729820554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278005b70 con 0x7fb268003a60 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 -- 172.21.15.50:0/729820554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb268003a60 msgr2=0x7fb268003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 --2- 172.21.15.50:0/729820554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb268003a60 0x7fb268003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb278001e90 comp rx=0 tx=0).stop 2023-12-24T18:37:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb282922700 1 -- 172.21.15.50:0/729820554 reap_dead start 2023-12-24T18:37:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 -- 172.21.15.50:0/729820554 shutdown_connections 2023-12-24T18:37:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 -- 172.21.15.50:0/729820554 >> 172.21.15.50:0/729820554 conn(0x7fb27c0cbba0 msgr2=0x7fb27c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 -- 172.21.15.50:0/729820554 shutdown_connections 2023-12-24T18:37:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.601+0000 7fb284385700 1 -- 172.21.15.50:0/729820554 wait complete. 2023-12-24T18:37:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 Processor -- start 2023-12-24T18:37:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 -- start start 2023-12-24T18:37:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 0x7fb27c165f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 0x7fb27c151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c14efe0 con 0x7fb27c1664f0 2023-12-24T18:37:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c168730 con 0x7fb27c0ad050 2023-12-24T18:37:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb284385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0aecc0 con 0x7fb268003a60 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.605+0000 7fb281920700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37806/0 (socket says 172.21.15.50:37806) 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 -- 172.21.15.50:0/3254828904 learned_addr learned my addr 172.21.15.50:0/3254828904 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb282121700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 0x7fb27c165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb282922700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 0x7fb27c151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 -- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 msgr2=0x7fb27c165f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 0x7fb27c165f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 -- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 msgr2=0x7fb27c151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 0x7fb27c151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 -- 172.21.15.50:0/3254828904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0c92c0 con 0x7fb27c1664f0 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb282121700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 0x7fb27c165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb282922700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 0x7fb27c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb281920700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb26c011d70 tx=0x7fb26c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c009e20 con 0x7fb27c1664f0 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00fcd0 con 0x7fb27c1664f0 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c014650 con 0x7fb27c1664f0 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c166960 con 0x7fb27c1664f0 2023-12-24T18:37:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0c8a10 con 0x7fb27c1664f0 2023-12-24T18:37:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.609+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c0c9450 con 0x7fb27c1664f0 2023-12-24T18:37:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.613+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb26c014a80 con 0x7fb27c1664f0 2023-12-24T18:37:27.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.613+0000 7fb2727fc700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 0x7fb260062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.613+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7fb26c018030 con 0x7fb27c1664f0 2023-12-24T18:37:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.613+0000 7fb282121700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 0x7fb260062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.613+0000 7fb282121700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 0x7fb260062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb278015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.617+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb26c04d870 con 0x7fb27c1664f0 2023-12-24T18:37:27.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.849+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb27c06c200 con 0x7fb27c1664f0 2023-12-24T18:37:27.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.857+0000 7fb2727fc700 1 -- 172.21.15.50:0/3254828904 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb26c022020 con 0x7fb27c1664f0 2023-12-24T18:37:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 msgr2=0x7fb260062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 0x7fb260062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb278015000 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 msgr2=0x7fb27c1681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb26c011d70 tx=0x7fb26c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 shutdown_connections 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb260060550 0x7fb260062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27c0ad050 0x7fb27c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb27c1664f0 0x7fb27c1681f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 --2- 172.21.15.50:0/3254828904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb268003a60 0x7fb27c165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 >> 172.21.15.50:0/3254828904 conn(0x7fb27c0cbba0 msgr2=0x7fb27c0c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 shutdown_connections 2023-12-24T18:37:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:27.861+0000 7fb284385700 1 -- 172.21.15.50:0/3254828904 wait complete. 2023-12-24T18:37:27.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:28.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.049+0000 7f27d84ae700 1 Processor -- start 2023-12-24T18:37:28.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d84ae700 1 -- start start 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d84ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 0x7f27d00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d84ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006c820 con 0x7f27d006aca0 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d84ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006b960 con 0x7f27d0154450 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d84ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d006bc40 con 0x7f27d00c6d00 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d6a4b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27d006aca0 0x7f27d006b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60788/0 (socket says 172.21.15.50:60788) 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d6a4b700 1 -- 172.21.15.50:0/3958202049 learned_addr learned my addr 172.21.15.50:0/3958202049 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.053+0000 7f27d624a700 1 --2- 172.21.15.50:0/3958202049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 0x7f27d00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739230127 0 0) 0x7f27d006c820 con 0x7f27d006aca0 2023-12-24T18:37:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003570 con 0x7f27d006aca0 2023-12-24T18:37:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135139820 0 0) 0x7f27d006b960 con 0x7f27d0154450 2023-12-24T18:37:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d006c820 con 0x7f27d0154450 2023-12-24T18:37:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d624a700 1 -- 172.21.15.50:0/3958202049 >> v1:172.21.15.82:6789/0 conn(0x7f27d0154450 legacy=0x7f27d01548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2296980228 0 0) 0x7f27bc003570 con 0x7f27d006aca0 2023-12-24T18:37:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d624a700 1 -- 172.21.15.50:0/3958202049 >> v1:172.21.15.50:6789/0 conn(0x7f27d006aca0 legacy=0x7f27d006b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d624a700 1 -- 172.21.15.50:0/3958202049 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d006bf20 con 0x7f27d00c6d00 2023-12-24T18:37:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d624a700 1 --2- 172.21.15.50:0/3958202049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 0x7f27d00c70d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009910 tx=0x7f27cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80e3cc9dd3c6ee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80017f0 con 0x7f27d00c6d00 2023-12-24T18:37:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc011420 con 0x7f27d00c6d00 2023-12-24T18:37:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d5248700 1 -- 172.21.15.50:0/3958202049 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0117c0 con 0x7f27d00c6d00 2023-12-24T18:37:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 -- 172.21.15.50:0/3958202049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 msgr2=0x7f27d00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 --2- 172.21.15.50:0/3958202049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 0x7f27d00c70d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009910 tx=0x7f27cc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 -- 172.21.15.50:0/3958202049 shutdown_connections 2023-12-24T18:37:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 --2- 172.21.15.50:0/3958202049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d00c6d00 0x7f27d00c70d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 -- 172.21.15.50:0/3958202049 >> 172.21.15.50:0/3958202049 conn(0x7f27d00cbba0 msgr2=0x7f27d00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 -- 172.21.15.50:0/3958202049 shutdown_connections 2023-12-24T18:37:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.057+0000 7f27d84ae700 1 -- 172.21.15.50:0/3958202049 wait complete. 2023-12-24T18:37:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 Processor -- start 2023-12-24T18:37:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 -- start start 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27d00c6d00 0x7f27d0152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d0154450 0x7f27d00a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c4090 con 0x7f27d006aca0 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c4370 con 0x7f27d00c6d00 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d84ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c4650 con 0x7f27d0154450 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d624a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d624a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37814/0 (socket says 172.21.15.50:37814) 2023-12-24T18:37:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d624a700 1 -- 172.21.15.50:0/458715106 learned_addr learned my addr 172.21.15.50:0/458715106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d5a49700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27d00c6d00 0x7f27d0152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.061+0000 7f27d6a4b700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d0154450 0x7f27d00a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 -- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d0154450 msgr2=0x7f27d00a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d0154450 0x7f27d00a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 -- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27d00c6d00 msgr2=0x7f27d0152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27d00c6d00 0x7f27d0152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 -- 172.21.15.50:0/458715106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009420 con 0x7f27d006aca0 2023-12-24T18:37:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d624a700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0030c0 tx=0x7f27cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc01ccb0 con 0x7f27d006aca0 2023-12-24T18:37:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc01ce10 con 0x7f27d006aca0 2023-12-24T18:37:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00c4930 con 0x7f27d006aca0 2023-12-24T18:37:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc01a6a0 con 0x7f27d006aca0 2023-12-24T18:37:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0152c50 con 0x7f27d006aca0 2023-12-24T18:37:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.065+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d00652e0 con 0x7f27d006aca0 2023-12-24T18:37:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.069+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f27cc01aad0 con 0x7f27d006aca0 2023-12-24T18:37:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.069+0000 7f27c67fc700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 0x7f27b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.069+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f27cc07e490 con 0x7f27d006aca0 2023-12-24T18:37:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.069+0000 7f27d5a49700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 0x7f27b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.069+0000 7f27d5a49700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 0x7f27b4062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c5c50 tx=0x7f27c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.077+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27cc04ec90 con 0x7f27d006aca0 2023-12-24T18:37:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.245+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27d00abdc0 con 0x7f27d006aca0 2023-12-24T18:37:28.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27c67fc700 1 -- 172.21.15.50:0/458715106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12291 (secure 0 0 0) 0x7f27cc0522b0 con 0x7f27d006aca0 2023-12-24T18:37:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:28.253 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:24.659592+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 msgr2=0x7f27b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 0x7f27b4062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c5c50 tx=0x7f27c0009040 comp rx=0 tx=0).stop 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 msgr2=0x7f27d00c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0030c0 tx=0x7f27cc016000 comp rx=0 tx=0).stop 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 shutdown_connections 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f27b4060550 0x7f27b4062a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27d0154450 0x7f27d00a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27d00c6d00 0x7f27d0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 --2- 172.21.15.50:0/458715106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d006aca0 0x7f27d00c37d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.249+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 >> 172.21.15.50:0/458715106 conn(0x7f27d00cbba0 msgr2=0x7f27d00c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.253+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 shutdown_connections 2023-12-24T18:37:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.253+0000 7f27d84ae700 1 -- 172.21.15.50:0/458715106 wait complete. 2023-12-24T18:37:28.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:37:28.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:37:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.461+0000 7efe2728e700 1 Processor -- start 2023-12-24T18:37:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.461+0000 7efe2728e700 1 -- start start 2023-12-24T18:37:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2728e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe2006d450 0x7efe200ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2728e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2006a580 con 0x7efe20158c40 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2728e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe200cd110 con 0x7efe200cc780 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2728e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2006a7d0 con 0x7efe2006d450 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2628c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efe20158c40 0x7efe200cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60800/0 (socket says 172.21.15.50:60800) 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2628c700 1 -- 172.21.15.50:0/1375636807 learned_addr learned my addr 172.21.15.50:0/1375636807 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe26a8d700 1 --2- 172.21.15.50:0/1375636807 >> v2:172.21.15.50:3300/0 conn(0x7efe2006d450 0x7efe200ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085334975 0 0) 0x7efe200cd110 con 0x7efe200cc780 2023-12-24T18:37:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003570 con 0x7efe200cc780 2023-12-24T18:37:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe26a8d700 1 -- 172.21.15.50:0/1375636807 >> v1:172.21.15.82:6789/0 conn(0x7efe200cc780 legacy=0x7efe2006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe26a8d700 1 -- 172.21.15.50:0/1375636807 >> v1:172.21.15.50:6789/0 conn(0x7efe20158c40 legacy=0x7efe200cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174873544 0 0) 0x7efe2006a580 con 0x7efe20158c40 2023-12-24T18:37:28.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe26a8d700 1 -- 172.21.15.50:0/1375636807 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2006aab0 con 0x7efe2006d450 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe26a8d700 1 --2- 172.21.15.50:0/1375636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2006d450 0x7efe200ccbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe18009e60 tx=0x7efe18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5679ab1941ee6c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800e070 con 0x7efe2006d450 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800bb60 con 0x7efe2006d450 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.465+0000 7efe2528a700 1 -- 172.21.15.50:0/1375636807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18012430 con 0x7efe2006d450 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- 172.21.15.50:0/1375636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2006d450 msgr2=0x7efe200ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 --2- 172.21.15.50:0/1375636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2006d450 0x7efe200ccbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe18009e60 tx=0x7efe18009780 comp rx=0 tx=0).stop 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- 172.21.15.50:0/1375636807 shutdown_connections 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 --2- 172.21.15.50:0/1375636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe2006d450 0x7efe200ccbd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- 172.21.15.50:0/1375636807 >> 172.21.15.50:0/1375636807 conn(0x7efe200d0800 msgr2=0x7efe200b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- 172.21.15.50:0/1375636807 shutdown_connections 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- 172.21.15.50:0/1375636807 wait complete. 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 Processor -- start 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.469+0000 7efe2728e700 1 -- start start 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2006d450 0x7efe2016c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe20158c40 0x7efe20153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe20168ec0 con 0x7efe200cc780 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2016d370 con 0x7efe20158c40 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe20169130 con 0x7efe2006d450 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37834/0 (socket says 172.21.15.50:37834) 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 -- 172.21.15.50:0/2572915697 learned_addr learned my addr 172.21.15.50:0/2572915697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe26a8d700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe20158c40 0x7efe20153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2628c700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2006d450 0x7efe2016c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 -- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2006d450 msgr2=0x7efe2016c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2006d450 0x7efe2016c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 -- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe20158c40 msgr2=0x7efe20153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe20158c40 0x7efe20153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 -- 172.21.15.50:0/2572915697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18009a20 con 0x7efe200cc780 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe25a8b700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c790 tx=0x7efe10007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011590 con 0x7efe200cc780 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe10011710 con 0x7efe200cc780 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2016cad0 con 0x7efe200cc780 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011ad0 con 0x7efe200cc780 2023-12-24T18:37:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.473+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2016d090 con 0x7efe200cc780 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.477+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2004be40 con 0x7efe200cc780 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.477+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efe10012420 con 0x7efe200cc780 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.477+0000 7efe167fc700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 0x7efe04062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.477+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7efe1007bfb0 con 0x7efe200cc780 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.477+0000 7efe2628c700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 0x7efe04062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.481+0000 7efe2628c700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 0x7efe04062a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe1c007fd0 tx=0x7efe1c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.485+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe1004c7b0 con 0x7efe200cc780 2023-12-24T18:37:28.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.657+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe2006ad90 con 0x7efe200cc780 2023-12-24T18:37:28.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.657+0000 7efe167fc700 1 -- 172.21.15.50:0/2572915697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe1004fdd0 con 0x7efe200cc780 2023-12-24T18:37:28.662 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 msgr2=0x7efe04062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 0x7efe04062a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe1c007fd0 tx=0x7efe1c007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 msgr2=0x7efe20152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c790 tx=0x7efe10007ea0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 shutdown_connections 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efe04060580 0x7efe04062a30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe20158c40 0x7efe20153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe200cc780 0x7efe20152920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 --2- 172.21.15.50:0/2572915697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe2006d450 0x7efe2016c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 >> 172.21.15.50:0/2572915697 conn(0x7efe200d0800 msgr2=0x7efe200b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:28.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 shutdown_connections 2023-12-24T18:37:28.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.661+0000 7efe2728e700 1 -- 172.21.15.50:0/2572915697 wait complete. 2023-12-24T18:37:28.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:37:28.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.849+0000 7f431759e700 1 Processor -- start 2023-12-24T18:37:28.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.849+0000 7f431759e700 1 -- start start 2023-12-24T18:37:28.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f431806c820 0x7f43180ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43180adc90 0x7f4318160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180b0460 con 0x7f431815a2d0 2023-12-24T18:37:28.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431806d8c0 con 0x7f431806c820 2023-12-24T18:37:28.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180afc60 con 0x7f43180adc90 2023-12-24T18:37:28.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f431815a2d0 0x7f43180ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60814/0 (socket says 172.21.15.50:60814) 2023-12-24T18:37:28.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f431659c700 1 -- 172.21.15.50:0/649034071 learned_addr learned my addr 172.21.15.50:0/649034071 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:28.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 --2- 172.21.15.50:0/649034071 >> v2:172.21.15.50:3300/0 conn(0x7f431806c820 0x7f43180ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f4316d9d700 1 --2- 172.21.15.50:0/649034071 >> v2:172.21.15.82:3300/0 conn(0x7f43180adc90 0x7f4318160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f4315d9b700 1 -- 172.21.15.50:0/649034071 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155484638 0 0) 0x7f43180b0460 con 0x7f431815a2d0 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f4315d9b700 1 -- 172.21.15.50:0/649034071 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4304003570 con 0x7f431815a2d0 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 -- 172.21.15.50:0/649034071 >> v2:172.21.15.82:3300/0 conn(0x7f43180adc90 msgr2=0x7f4318160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 --2- 172.21.15.50:0/649034071 >> v2:172.21.15.82:3300/0 conn(0x7f43180adc90 0x7f4318160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 -- 172.21.15.50:0/649034071 >> v1:172.21.15.50:6789/0 conn(0x7f431815a2d0 legacy=0x7f43180ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 -- 172.21.15.50:0/649034071 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431806a5c0 con 0x7f431806c820 2023-12-24T18:37:28.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.853+0000 7f430ffff700 1 --2- 172.21.15.50:0/649034071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f431806c820 0x7f43180ad750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43180c8440 tx=0x7f43000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476958650cb08c0b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f4315d9b700 1 -- 172.21.15.50:0/649034071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300011630 con 0x7f431806c820 2023-12-24T18:37:28.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f4315d9b700 1 -- 172.21.15.50:0/649034071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000117b0 con 0x7f431806c820 2023-12-24T18:37:28.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f4315d9b700 1 -- 172.21.15.50:0/649034071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300011b70 con 0x7f431806c820 2023-12-24T18:37:28.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 -- 172.21.15.50:0/649034071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f431806c820 msgr2=0x7f43180ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 --2- 172.21.15.50:0/649034071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f431806c820 0x7f43180ad750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43180c8440 tx=0x7f43000091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 -- 172.21.15.50:0/649034071 shutdown_connections 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 --2- 172.21.15.50:0/649034071 >> v2:172.21.15.82:3300/0 conn(0x7f43180adc90 0x7f4318160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 --2- 172.21.15.50:0/649034071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f431806c820 0x7f43180ad750 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 -- 172.21.15.50:0/649034071 >> 172.21.15.50:0/649034071 conn(0x7f4318067b80 msgr2=0x7f43180cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 -- 172.21.15.50:0/649034071 shutdown_connections 2023-12-24T18:37:28.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.857+0000 7f431759e700 1 -- 172.21.15.50:0/649034071 wait complete. 2023-12-24T18:37:28.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 Processor -- start 2023-12-24T18:37:28.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 -- start start 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f431806c820 0x7f431815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 0x7f43181480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318169870 con 0x7f43180adc90 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318168f40 con 0x7f431806c820 2023-12-24T18:37:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4318169220 con 0x7f431815a2d0 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37854/0 (socket says 172.21.15.50:37854) 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 -- 172.21.15.50:0/3913356076 learned_addr learned my addr 172.21.15.50:0/3913356076 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f4316d9d700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 0x7f43181480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f431659c700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f431806c820 0x7f431815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 -- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 msgr2=0x7f43181480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 0x7f43181480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 -- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f431806c820 msgr2=0x7f431815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f431806c820 0x7f431815b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 -- 172.21.15.50:0/3913356076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009420 con 0x7f43180adc90 2023-12-24T18:37:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f4316d9d700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 0x7f43181480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:28.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.861+0000 7f430ffff700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4300013000 tx=0x7f4300017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430001f070 con 0x7f43180adc90 2023-12-24T18:37:28.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4300011920 con 0x7f43180adc90 2023-12-24T18:37:28.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300023410 con 0x7f43180adc90 2023-12-24T18:37:28.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4318169500 con 0x7f43180adc90 2023-12-24T18:37:28.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4318168bf0 con 0x7f43180adc90 2023-12-24T18:37:28.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4318169690 con 0x7f43180adc90 2023-12-24T18:37:28.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.865+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f430002c3b0 con 0x7f43180adc90 2023-12-24T18:37:28.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.869+0000 7f430e7fc700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 0x7f42f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:28.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.869+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f430007d940 con 0x7f43180adc90 2023-12-24T18:37:28.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.869+0000 7f431659c700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 0x7f42f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:28.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.869+0000 7f431659c700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 0x7f42f8062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad6a0 tx=0x7f4308009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:28.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:28.877+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f430004e1a0 con 0x7f43180adc90 2023-12-24T18:37:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.049+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f431804be40 con 0x7f43180adc90 2023-12-24T18:37:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.049+0000 7f430e7fc700 1 -- 172.21.15.50:0/3913356076 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4300015090 con 0x7f43180adc90 2023-12-24T18:37:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:29.056 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:37:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:37:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:37:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:29.057 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:37:29.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 msgr2=0x7f42f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 0x7f42f8062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad6a0 tx=0x7f4308009040 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 msgr2=0x7f4318157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4300013000 tx=0x7f4300017000 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 shutdown_connections 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f42f8060550 0x7f42f8062a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f431815a2d0 0x7f43181480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43180adc90 0x7f4318157050 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 --2- 172.21.15.50:0/3913356076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f431806c820 0x7f431815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 >> 172.21.15.50:0/3913356076 conn(0x7f4318067b80 msgr2=0x7f431806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:29.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 shutdown_connections 2023-12-24T18:37:29.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.057+0000 7f431759e700 1 -- 172.21.15.50:0/3913356076 wait complete. 2023-12-24T18:37:29.082 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:37:29.083 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:37:29.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.249+0000 7f4fbd385700 1 Processor -- start 2023-12-24T18:37:29.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.249+0000 7f4fbd385700 1 -- start start 2023-12-24T18:37:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 0x7f4fb80a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb806a730 con 0x7f4fb80aa080 2023-12-24T18:37:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb806beb0 con 0x7f4fb80a8fe0 2023-12-24T18:37:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb806d760 con 0x7f4fb81591a0 2023-12-24T18:37:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb67fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fb80aa080 0x7f4fb80a88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60822/0 (socket says 172.21.15.50:60822) 2023-12-24T18:37:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb67fc700 1 -- 172.21.15.50:0/3473510402 learned_addr learned my addr 172.21.15.50:0/3473510402 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3473510402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 0x7f4fb80a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb5ffb700 1 -- 172.21.15.50:0/3473510402 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419489479 0 0) 0x7f4fb806a730 con 0x7f4fb80aa080 2023-12-24T18:37:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb5ffb700 1 -- 172.21.15.50:0/3473510402 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa0003570 con 0x7f4fb80aa080 2023-12-24T18:37:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/3473510402 >> v1:172.21.15.82:6789/0 conn(0x7f4fb80a8fe0 legacy=0x7f4fb8162d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/3473510402 >> v1:172.21.15.50:6789/0 conn(0x7f4fb80aa080 legacy=0x7f4fb80a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/3473510402 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb806da40 con 0x7f4fb81591a0 2023-12-24T18:37:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3473510402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 0x7f4fb80a9b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009910 tx=0x7f4fa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c20ae3cbad3ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb5ffb700 1 -- 172.21.15.50:0/3473510402 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800b680 con 0x7f4fb81591a0 2023-12-24T18:37:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb5ffb700 1 -- 172.21.15.50:0/3473510402 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa800b7e0 con 0x7f4fb81591a0 2023-12-24T18:37:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fb5ffb700 1 -- 172.21.15.50:0/3473510402 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800bba0 con 0x7f4fb81591a0 2023-12-24T18:37:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 -- 172.21.15.50:0/3473510402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 msgr2=0x7f4fb80a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.253+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3473510402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 0x7f4fb80a9b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009910 tx=0x7f4fa80091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 -- 172.21.15.50:0/3473510402 shutdown_connections 2023-12-24T18:37:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3473510402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb81591a0 0x7f4fb80a9b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 -- 172.21.15.50:0/3473510402 >> 172.21.15.50:0/3473510402 conn(0x7f4fb8067b80 msgr2=0x7f4fb80ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 -- 172.21.15.50:0/3473510402 shutdown_connections 2023-12-24T18:37:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 -- 172.21.15.50:0/3473510402 wait complete. 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 Processor -- start 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.257+0000 7f4fbd385700 1 -- start start 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 0x7f4fb8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fb81591a0 0x7f4fb8169890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb816a920 con 0x7f4fb80aa080 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb815d540 con 0x7f4fb81591a0 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8169dd0 con 0x7f4fb80a8fe0 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37868/0 (socket says 172.21.15.50:37868) 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 -- 172.21.15.50:0/3067869587 learned_addr learned my addr 172.21.15.50:0/3067869587 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 0x7f4fb8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb77fe700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fb81591a0 0x7f4fb8169890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 -- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 msgr2=0x7f4fb8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 0x7f4fb8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 -- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fb81591a0 msgr2=0x7f4fb8169890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fb81591a0 0x7f4fb8169890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 -- 172.21.15.50:0/3067869587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009420 con 0x7f4fb80aa080 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 0x7f4fb8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fb67fc700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c7f0 tx=0x7f4fac007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac005c00 con 0x7f4fb80aa080 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac005d60 con 0x7f4fb80aa080 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb816a080 con 0x7f4fb80aa080 2023-12-24T18:37:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac007320 con 0x7f4fb80aa080 2023-12-24T18:37:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb816a640 con 0x7f4fb80aa080 2023-12-24T18:37:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.261+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb815d310 con 0x7f4fb80aa080 2023-12-24T18:37:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.265+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4fac01b400 con 0x7f4fb80aa080 2023-12-24T18:37:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.265+0000 7f4f9effd700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 0x7f4fa4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.265+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5173+0+0 (secure 0 0 0) 0x7f4fac07c110 con 0x7f4fb80aa080 2023-12-24T18:37:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.265+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 0x7f4fa4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.269+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 0x7f4fa4062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80093f0 tx=0x7f4fa8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.273+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4fb815d310 con 0x7f4fb80aa080 2023-12-24T18:37:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.445+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4fb815d310 con 0x7f4fb80aa080 2023-12-24T18:37:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.685+0000 7f4f9effd700 1 -- 172.21.15.50:0/3067869587 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4fac04c8f0 con 0x7f4fb80aa080 2023-12-24T18:37:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 msgr2=0x7f4fa4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 0x7f4fa4062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80093f0 tx=0x7f4fa8017000 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 msgr2=0x7f4fb81427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c7f0 tx=0x7f4fac007dd0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 shutdown_connections 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4fa4060550 0x7f4fa4062a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fb81591a0 0x7f4fb8169890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb80aa080 0x7f4fb81427b0 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c7f0 tx=0x7f4fac007dd0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 --2- 172.21.15.50:0/3067869587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fb80a8fe0 0x7f4fb8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 >> 172.21.15.50:0/3067869587 conn(0x7f4fb8067b80 msgr2=0x7f4fb8157eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 shutdown_connections 2023-12-24T18:37:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.693+0000 7f4fbd385700 1 -- 172.21.15.50:0/3067869587 wait complete. 2023-12-24T18:37:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:37:29.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:37:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.905+0000 7f22a8984700 1 Processor -- start 2023-12-24T18:37:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.905+0000 7f22a8984700 1 -- start start 2023-12-24T18:37:29.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a8984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22a4158c40 0x7f22a40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a8984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a8984700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a406a580 con 0x7f22a406cd40 2023-12-24T18:37:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a8984700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a40cd110 con 0x7f22a4158c40 2023-12-24T18:37:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a8984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406a7d0 con 0x7f22a40cc780 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a359e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f22a406cd40 0x7f22a406d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55898/0 (socket says 172.21.15.50:55898) 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a359e700 1 -- 172.21.15.50:0/878078912 learned_addr learned my addr 172.21.15.50:0/878078912 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/878078912 >> v2:172.21.15.82:3300/0 conn(0x7f22a4158c40 0x7f22a40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a259c700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a1d9b700 1 -- 172.21.15.50:0/878078912 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117969922 0 0) 0x7f22a406a580 con 0x7f22a406cd40 2023-12-24T18:37:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a1d9b700 1 -- 172.21.15.50:0/878078912 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f228c003570 con 0x7f22a406cd40 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 -- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 msgr2=0x7f22a40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 -- 172.21.15.50:0/878078912 >> v1:172.21.15.50:6789/0 conn(0x7f22a406cd40 legacy=0x7f22a406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 -- 172.21.15.50:0/878078912 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a406aab0 con 0x7f22a4158c40 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a40cf500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f22940098e0 tx=0x7f22940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea2bfb19b2386435 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a1d9b700 1 -- 172.21.15.50:0/878078912 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011630 con 0x7f22a4158c40 2023-12-24T18:37:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a1d9b700 1 -- 172.21.15.50:0/878078912 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294011790 con 0x7f22a4158c40 2023-12-24T18:37:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.909+0000 7f22a1d9b700 1 -- 172.21.15.50:0/878078912 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011b30 con 0x7f22a4158c40 2023-12-24T18:37:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 -- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 msgr2=0x7f22a40cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a40cf500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f22940098e0 tx=0x7f22940091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 -- 172.21.15.50:0/878078912 shutdown_connections 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 --2- 172.21.15.50:0/878078912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a40cf500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 -- 172.21.15.50:0/878078912 >> 172.21.15.50:0/878078912 conn(0x7f22a40d0800 msgr2=0x7f22a40b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 -- 172.21.15.50:0/878078912 shutdown_connections 2023-12-24T18:37:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 -- 172.21.15.50:0/878078912 wait complete. 2023-12-24T18:37:29.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.913+0000 7f22a8984700 1 Processor -- start 2023-12-24T18:37:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 -- start start 2023-12-24T18:37:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a41696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415ca50 con 0x7f22a406cd40 2023-12-24T18:37:29.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4169f10 con 0x7f22a4158c40 2023-12-24T18:37:29.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a8984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a416a1f0 con 0x7f22a40cc780 2023-12-24T18:37:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44478/0 (socket says 172.21.15.50:44478) 2023-12-24T18:37:29.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 -- 172.21.15.50:0/3132789758 learned_addr learned my addr 172.21.15.50:0/3132789758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a259c700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a41696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a359e700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 -- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 msgr2=0x7f22a41696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a41696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 -- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 msgr2=0x7f22a4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 -- 172.21.15.50:0/3132789758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009420 con 0x7f22a406cd40 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a259c700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a41696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a359e700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.917+0000 7f22a2d9d700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f22a4069860 tx=0x7f2294017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011b10 con 0x7f22a406cd40 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a416a4d0 con 0x7f22a406cd40 2023-12-24T18:37:29.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a4169c00 con 0x7f22a406cd40 2023-12-24T18:37:29.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294025600 con 0x7f22a406cd40 2023-12-24T18:37:29.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294025770 con 0x7f22a406cd40 2023-12-24T18:37:29.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.921+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a404be40 con 0x7f22a406cd40 2023-12-24T18:37:29.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.925+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2294025b60 con 0x7f22a406cd40 2023-12-24T18:37:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.925+0000 7f228affd700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 0x7f2290062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.929+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5543+0+0 (secure 0 0 0) 0x7f229407e9d0 con 0x7f22a406cd40 2023-12-24T18:37:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.929+0000 7f22a259c700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 0x7f2290062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.929+0000 7f22a259c700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 0x7f2290062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2298009cf0 tx=0x7f2298008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:29.929+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f229404f0e0 con 0x7f22a406cd40 2023-12-24T18:37:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.109+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22a406ad90 con 0x7f22a406cd40 2023-12-24T18:37:30.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.701+0000 7f228affd700 1 -- 172.21.15.50:0/3132789758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2294052700 con 0x7f22a406cd40 2023-12-24T18:37:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 msgr2=0x7f2290062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 0x7f2290062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2298009cf0 tx=0x7f2298008040 comp rx=0 tx=0).stop 2023-12-24T18:37:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 msgr2=0x7f22a415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f22a4069860 tx=0x7f2294017000 comp rx=0 tx=0).stop 2023-12-24T18:37:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 shutdown_connections 2023-12-24T18:37:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2290060550 0x7f2290062a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a4158c40 0x7f22a4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22a40cc780 0x7f22a41696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 --2- 172.21.15.50:0/3132789758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a406cd40 0x7f22a415df50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 >> 172.21.15.50:0/3132789758 conn(0x7f22a40d0800 msgr2=0x7f22a41532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.709+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 shutdown_connections 2023-12-24T18:37:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.713+0000 7f22a8984700 1 -- 172.21.15.50:0/3132789758 wait complete. 2023-12-24T18:37:30.724 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:37:30.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:37:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 Processor -- start 2023-12-24T18:37:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 -- start start 2023-12-24T18:37:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6040158c80 0x7f60400c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6040159050 0x7f604015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6040067440 con 0x7f60400cbb10 2023-12-24T18:37:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400cc8d0 con 0x7f6040158c80 2023-12-24T18:37:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6045ee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6040067fc0 con 0x7f6040159050 2023-12-24T18:37:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f60456e2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6040159050 0x7f604015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f603ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60400cbb10 0x7f60400cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55902/0 (socket says 172.21.15.50:55902) 2023-12-24T18:37:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f603ffff700 1 -- 172.21.15.50:0/1461989125 learned_addr learned my addr 172.21.15.50:0/1461989125 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.909+0000 7f6044ee1700 1 --2- 172.21.15.50:0/1461989125 >> v2:172.21.15.50:3300/0 conn(0x7f6040158c80 0x7f60400c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f603f7fe700 1 -- 172.21.15.50:0/1461989125 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041426365 0 0) 0x7f6040067440 con 0x7f60400cbb10 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f603f7fe700 1 -- 172.21.15.50:0/1461989125 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003570 con 0x7f60400cbb10 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f60456e2700 1 -- 172.21.15.50:0/1461989125 >> v2:172.21.15.50:3300/0 conn(0x7f6040158c80 msgr2=0x7f60400c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f60456e2700 1 --2- 172.21.15.50:0/1461989125 >> v2:172.21.15.50:3300/0 conn(0x7f6040158c80 0x7f60400c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f60456e2700 1 -- 172.21.15.50:0/1461989125 >> v1:172.21.15.50:6789/0 conn(0x7f60400cbb10 legacy=0x7f60400cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f60456e2700 1 -- 172.21.15.50:0/1461989125 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400c8a20 con 0x7f6040159050 2023-12-24T18:37:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f60456e2700 1 --2- 172.21.15.50:0/1461989125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040159050 0x7f604015cad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60400ce7c0 tx=0x7f6038009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f63f5d399b1a1ab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f603f7fe700 1 -- 172.21.15.50:0/1461989125 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800e070 con 0x7f6040159050 2023-12-24T18:37:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f603f7fe700 1 -- 172.21.15.50:0/1461989125 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800bab0 con 0x7f6040159050 2023-12-24T18:37:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f603f7fe700 1 -- 172.21.15.50:0/1461989125 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800be70 con 0x7f6040159050 2023-12-24T18:37:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 -- 172.21.15.50:0/1461989125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040159050 msgr2=0x7f604015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1461989125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040159050 0x7f604015cad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60400ce7c0 tx=0x7f6038009780 comp rx=0 tx=0).stop 2023-12-24T18:37:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 -- 172.21.15.50:0/1461989125 shutdown_connections 2023-12-24T18:37:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1461989125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040159050 0x7f604015cad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1461989125 >> v2:172.21.15.50:3300/0 conn(0x7f6040158c80 0x7f60400c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 -- 172.21.15.50:0/1461989125 >> 172.21.15.50:0/1461989125 conn(0x7f6040069d90 msgr2=0x7f60400cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:30.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 -- 172.21.15.50:0/1461989125 shutdown_connections 2023-12-24T18:37:30.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.913+0000 7f6045ee3700 1 -- 172.21.15.50:0/1461989125 wait complete. 2023-12-24T18:37:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 Processor -- start 2023-12-24T18:37:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 -- start start 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040158c80 0x7f60400b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6040159050 0x7f60400b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400b1610 con 0x7f60400cbb10 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c69d0 con 0x7f6040158c80 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.917+0000 7f6045ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c6c20 con 0x7f6040159050 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44502/0 (socket says 172.21.15.50:44502) 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 -- 172.21.15.50:0/1124237512 learned_addr learned my addr 172.21.15.50:0/1124237512 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f603ffff700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040158c80 0x7f60400b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f60456e2700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6040159050 0x7f60400b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 -- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6040159050 msgr2=0x7f60400b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6040159050 0x7f60400b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 -- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040158c80 msgr2=0x7f60400b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040158c80 0x7f60400b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 -- 172.21.15.50:0/1124237512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009a20 con 0x7f60400cbb10 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6044ee1700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f603400ec80 tx=0x7f60340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400c850 con 0x7f60400cbb10 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400c9b0 con 0x7f60400cbb10 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400c6f00 con 0x7f60400cbb10 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400cd50 con 0x7f60400cbb10 2023-12-24T18:37:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.921+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400c74c0 con 0x7f60400cbb10 2023-12-24T18:37:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.925+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604004be40 con 0x7f60400cbb10 2023-12-24T18:37:30.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.925+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6034013680 con 0x7f60400cbb10 2023-12-24T18:37:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.929+0000 7f603cff9700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.929+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f603407cb70 con 0x7f60400cbb10 2023-12-24T18:37:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.929+0000 7f603ffff700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.929+0000 7f603ffff700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 0x7f6024062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60400c6980 tx=0x7f602c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:30.933+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f603404cfe0 con 0x7f60400cbb10 2023-12-24T18:37:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.145+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6040067690 con 0x7f60400cbb10 2023-12-24T18:37:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.725+0000 7f603cff9700 1 -- 172.21.15.50:0/1124237512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6034050600 con 0x7f60400cbb10 2023-12-24T18:37:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.729+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 msgr2=0x7f6024062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.729+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 0x7f6024062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60400c6980 tx=0x7f602c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 msgr2=0x7f6040151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f603400ec80 tx=0x7f60340091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 shutdown_connections 2023-12-24T18:37:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6040159050 0x7f60400b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6040158c80 0x7f60400b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 --2- 172.21.15.50:0/1124237512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60400cbb10 0x7f6040151d10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.733+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 >> 172.21.15.50:0/1124237512 conn(0x7f6040069d90 msgr2=0x7f60400c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:31.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.737+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 shutdown_connections 2023-12-24T18:37:31.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.737+0000 7f6045ee3700 1 -- 172.21.15.50:0/1124237512 wait complete. 2023-12-24T18:37:31.745 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 5 and data pool 6 2023-12-24T18:37:31.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 Processor -- start 2023-12-24T18:37:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 -- start start 2023-12-24T18:37:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff88c158e00 0x7ff88c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 0x7ff88c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88c06b640 con 0x7ff88c06a580 2023-12-24T18:37:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88c159710 con 0x7ff88c158e00 2023-12-24T18:37:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.921+0000 7ff891c8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0b5e10 con 0x7ff88c06d8c0 2023-12-24T18:37:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 0x7ff88c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff890c8c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff88c158e00 0x7ff88c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff89148d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff88c06a580 0x7ff88c06c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36402/0 (socket says 172.21.15.50:36402) 2023-12-24T18:37:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff89148d700 1 -- 172.21.15.50:0/823989837 learned_addr learned my addr 172.21.15.50:0/823989837 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 -- 172.21.15.50:0/823989837 >> v2:172.21.15.50:3300/0 conn(0x7ff88c158e00 msgr2=0x7ff88c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 --2- 172.21.15.50:0/823989837 >> v2:172.21.15.50:3300/0 conn(0x7ff88c158e00 0x7ff88c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 -- 172.21.15.50:0/823989837 >> v1:172.21.15.82:6789/0 conn(0x7ff88c06a580 legacy=0x7ff88c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 -- 172.21.15.50:0/823989837 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c06b8e0 con 0x7ff88c06d8c0 2023-12-24T18:37:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88bfff700 1 --2- 172.21.15.50:0/823989837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 0x7ff88c0b3ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8780098e0 tx=0x7ff8780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e175bdc86dd1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88b7fe700 1 -- 172.21.15.50:0/823989837 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87800b640 con 0x7ff88c06d8c0 2023-12-24T18:37:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88b7fe700 1 -- 172.21.15.50:0/823989837 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87800b7a0 con 0x7ff88c06d8c0 2023-12-24T18:37:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff88b7fe700 1 -- 172.21.15.50:0/823989837 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87800bb40 con 0x7ff88c06d8c0 2023-12-24T18:37:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 -- 172.21.15.50:0/823989837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 msgr2=0x7ff88c0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 --2- 172.21.15.50:0/823989837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 0x7ff88c0b3ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8780098e0 tx=0x7ff8780091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 -- 172.21.15.50:0/823989837 shutdown_connections 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 --2- 172.21.15.50:0/823989837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c06d8c0 0x7ff88c0b3ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 --2- 172.21.15.50:0/823989837 >> v2:172.21.15.50:3300/0 conn(0x7ff88c158e00 0x7ff88c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.925+0000 7ff891c8e700 1 -- 172.21.15.50:0/823989837 >> 172.21.15.50:0/823989837 conn(0x7ff88c067b80 msgr2=0x7ff88c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.929+0000 7ff891c8e700 1 -- 172.21.15.50:0/823989837 shutdown_connections 2023-12-24T18:37:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.929+0000 7ff891c8e700 1 -- 172.21.15.50:0/823989837 wait complete. 2023-12-24T18:37:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.929+0000 7ff891c8e700 1 Processor -- start 2023-12-24T18:37:31.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- start start 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 0x7ff88c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 0x7ff88c15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0ac2f0 con 0x7ff88c06a580 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0ac590 con 0x7ff88c06d8c0 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0ac870 con 0x7ff88c158e00 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44528/0 (socket says 172.21.15.50:44528) 2023-12-24T18:37:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 -- 172.21.15.50:0/1060408744 learned_addr learned my addr 172.21.15.50:0/1060408744 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff89148d700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 0x7ff88c15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 -- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 msgr2=0x7ff88c15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff88bfff700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 0x7ff88c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 0x7ff88c15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 -- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 msgr2=0x7ff88c0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 0x7ff88c0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 -- 172.21.15.50:0/1060408744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009420 con 0x7ff88c06a580 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff89148d700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 0x7ff88c15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff88bfff700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 0x7ff88c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff890c8c700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff88000e930 tx=0x7ff8800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000eed0 con 0x7ff88c06a580 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000c850 con 0x7ff88c06a580 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000cbf0 con 0x7ff88c06a580 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c0acb50 con 0x7ff88c06a580 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.933+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c147e00 con 0x7ff88c06a580 2023-12-24T18:37:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.937+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c0acfd0 con 0x7ff88c06a580 2023-12-24T18:37:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.937+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff880013470 con 0x7ff88c06a580 2023-12-24T18:37:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.941+0000 7ff888ff9700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 0x7ff870062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.941+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6025+0+0 (secure 0 0 0) 0x7ff88007cba0 con 0x7ff88c06a580 2023-12-24T18:37:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.941+0000 7ff88bfff700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 0x7ff870062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.941+0000 7ff88bfff700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 0x7ff870062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b0950 tx=0x7ff878017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:31.949+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff88004cfb0 con 0x7ff88c06a580 2023-12-24T18:37:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.125+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff88c04be40 con 0x7ff88c06a580 2023-12-24T18:37:32.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff888ff9700 1 -- 172.21.15.50:0/1060408744 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+15520 (secure 0 0 0) 0x7ff8800505d0 con 0x7ff88c06a580 2023-12-24T18:37:32.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:32.133 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:31.149753+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 msgr2=0x7ff870062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 0x7ff870062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b0950 tx=0x7ff878017000 comp rx=0 tx=0).stop 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 msgr2=0x7ff88c1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff88000e930 tx=0x7ff8800091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 shutdown_connections 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff870060550 0x7ff870062a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff88c158e00 0x7ff88c15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c06d8c0 0x7ff88c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 --2- 172.21.15.50:0/1060408744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff88c06a580 0x7ff88c1478c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 >> 172.21.15.50:0/1060408744 conn(0x7ff88c067b80 msgr2=0x7ff88c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.129+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 shutdown_connections 2023-12-24T18:37:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.133+0000 7ff891c8e700 1 -- 172.21.15.50:0/1060408744 wait complete. 2023-12-24T18:37:32.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.317+0000 7ff4da9cc700 1 Processor -- start 2023-12-24T18:37:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.317+0000 7ff4da9cc700 1 -- start start 2023-12-24T18:37:32.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d4158e00 0x7ff4d41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406d8c0 0x7ff4d40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d406b640 con 0x7ff4d406a580 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d4159710 con 0x7ff4d4158e00 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b5e10 con 0x7ff4d406d8c0 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d4158e00 0x7ff4d41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d4158e00 0x7ff4d41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44542/0 (socket says 172.21.15.50:44542) 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 -- 172.21.15.50:0/435126972 learned_addr learned my addr 172.21.15.50:0/435126972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d91c9700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406d8c0 0x7ff4d40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 -- 172.21.15.50:0/435126972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406d8c0 msgr2=0x7ff4d40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406d8c0 0x7ff4d40b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 -- 172.21.15.50:0/435126972 >> v1:172.21.15.82:6789/0 conn(0x7ff4d406a580 legacy=0x7ff4d406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 -- 172.21.15.50:0/435126972 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d406b8e0 con 0x7ff4d4158e00 2023-12-24T18:37:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d4158e00 0x7ff4d41591d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00099b0 tx=0x7ff4d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f777afb2c78532b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d89c8700 1 -- 172.21.15.50:0/435126972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0009ea0 con 0x7ff4d4158e00 2023-12-24T18:37:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d89c8700 1 -- 172.21.15.50:0/435126972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000b860 con 0x7ff4d4158e00 2023-12-24T18:37:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4d89c8700 1 -- 172.21.15.50:0/435126972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000bc00 con 0x7ff4d4158e00 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- 172.21.15.50:0/435126972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d4158e00 msgr2=0x7ff4d41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d4158e00 0x7ff4d41591d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00099b0 tx=0x7ff4d0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- 172.21.15.50:0/435126972 shutdown_connections 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406d8c0 0x7ff4d40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/435126972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d4158e00 0x7ff4d41591d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.321+0000 7ff4da9cc700 1 -- 172.21.15.50:0/435126972 >> 172.21.15.50:0/435126972 conn(0x7ff4d4067b80 msgr2=0x7ff4d40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- 172.21.15.50:0/435126972 shutdown_connections 2023-12-24T18:37:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- 172.21.15.50:0/435126972 wait complete. 2023-12-24T18:37:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 Processor -- start 2023-12-24T18:37:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- start start 2023-12-24T18:37:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 0x7ff4d41697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4158e00 0x7ff4d415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40ac5b0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40ace50 con 0x7ff4d4158e00 2023-12-24T18:37:32.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4da9cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40abf50 con 0x7ff4d406a580 2023-12-24T18:37:32.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4d91c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4d91c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44550/0 (socket says 172.21.15.50:44550) 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.325+0000 7ff4d91c9700 1 -- 172.21.15.50:0/2305025853 learned_addr learned my addr 172.21.15.50:0/2305025853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 0x7ff4d41697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4da1cb700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4158e00 0x7ff4d415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 -- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 msgr2=0x7ff4d41697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 0x7ff4d41697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 -- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4158e00 msgr2=0x7ff4d415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4158e00 0x7ff4d415c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 -- 172.21.15.50:0/2305025853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00094f0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 0x7ff4d41697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4d91c9700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400ecb0 tx=0x7ff4c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400c9d0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400cb30 con 0x7ff4d406d8c0 2023-12-24T18:37:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40ac800 con 0x7ff4d406d8c0 2023-12-24T18:37:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400ced0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d4169d30 con 0x7ff4d406d8c0 2023-12-24T18:37:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.329+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40acfe0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.333+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff4c4013680 con 0x7ff4d406d8c0 2023-12-24T18:37:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.333+0000 7ff4c9ffb700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 0x7ff4b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.333+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6025+0+0 (secure 0 0 0) 0x7ff4c407cca0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.333+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 0x7ff4b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.337+0000 7ff4d99ca700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 0x7ff4b8062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00099b0 tx=0x7ff4d0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.341+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff4c404d0b0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.513+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d404be40 con 0x7ff4d406d8c0 2023-12-24T18:37:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.513+0000 7ff4c9ffb700 1 -- 172.21.15.50:0/2305025853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+15520 (secure 0 0 0) 0x7ff4c40506d0 con 0x7ff4d406d8c0 2023-12-24T18:37:32.520 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:32.520 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:31.149753+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 msgr2=0x7ff4b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 0x7ff4b8062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00099b0 tx=0x7ff4d0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 msgr2=0x7ff4d4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400ecb0 tx=0x7ff4c40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 shutdown_connections 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff4b8060550 0x7ff4b8062a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4158e00 0x7ff4d415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d406d8c0 0x7ff4d4154f60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 --2- 172.21.15.50:0/2305025853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4d406a580 0x7ff4d41697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 >> 172.21.15.50:0/2305025853 conn(0x7ff4d4067b80 msgr2=0x7ff4d40a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 shutdown_connections 2023-12-24T18:37:32.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.521+0000 7ff4da9cc700 1 -- 172.21.15.50:0/2305025853 wait complete. 2023-12-24T18:37:32.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:37:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.717+0000 7f5702b85700 1 Processor -- start 2023-12-24T18:37:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.717+0000 7f5702b85700 1 -- start start 2023-12-24T18:37:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56fc0cc190 0x7f56fc0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc1573b0 con 0x7f56fc156e60 2023-12-24T18:37:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0c1ba0 con 0x7f56fc0cc190 2023-12-24T18:37:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c1e80 con 0x7f56fc06d930 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56fc0cc190 0x7f56fc0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f56fbfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56fc0cc190 0x7f56fc0b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44562/0 (socket says 172.21.15.50:44562) 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 -- 172.21.15.50:0/1583444007 learned_addr learned my addr 172.21.15.50:0/1583444007 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5701122700 1 --1- 172.21.15.50:0/1583444007 >> v1:172.21.15.82:6789/0 conn(0x7f56fc156e60 0x7f56fc0ae800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36412/0 (socket says 172.21.15.50:36412) 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 -- 172.21.15.50:0/1583444007 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 msgr2=0x7f56fc1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 -- 172.21.15.50:0/1583444007 >> v1:172.21.15.82:6789/0 conn(0x7f56fc156e60 legacy=0x7f56fc0ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 -- 172.21.15.50:0/1583444007 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0c21f0 con 0x7f56fc0cc190 2023-12-24T18:37:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f56fbfff700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5700921700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc0cc190 0x7f56fc0b0620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009f20 tx=0x7f56f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f826a214001ee675 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f56fb7fe700 1 -- 172.21.15.50:0/1583444007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000e070 con 0x7f56fc0cc190 2023-12-24T18:37:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f56fb7fe700 1 -- 172.21.15.50:0/1583444007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f000b9d0 con 0x7f56fc0cc190 2023-12-24T18:37:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f56fb7fe700 1 -- 172.21.15.50:0/1583444007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00092e0 con 0x7f56fc0cc190 2023-12-24T18:37:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 -- 172.21.15.50:0/1583444007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc0cc190 msgr2=0x7f56fc0b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.721+0000 7f5702b85700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc0cc190 0x7f56fc0b0620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009f20 tx=0x7f56f0009840 comp rx=0 tx=0).stop 2023-12-24T18:37:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 -- 172.21.15.50:0/1583444007 shutdown_connections 2023-12-24T18:37:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 --2- 172.21.15.50:0/1583444007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc0cc190 0x7f56fc0b0620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 -- 172.21.15.50:0/1583444007 >> 172.21.15.50:0/1583444007 conn(0x7f56fc0afb40 msgr2=0x7f56fc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 -- 172.21.15.50:0/1583444007 shutdown_connections 2023-12-24T18:37:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 -- 172.21.15.50:0/1583444007 wait complete. 2023-12-24T18:37:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 Processor -- start 2023-12-24T18:37:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.725+0000 7f5702b85700 1 -- start start 2023-12-24T18:37:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 0x7f56fc1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc149110 con 0x7f56fc156e60 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc14d440 con 0x7f56fc0cc190 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc14d9a0 con 0x7f56fc06d930 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44568/0 (socket says 172.21.15.50:44568) 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 -- 172.21.15.50:0/1616947002 learned_addr learned my addr 172.21.15.50:0/1616947002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5700921700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f56fbfff700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 0x7f56fc1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 -- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 msgr2=0x7f56fc14f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc14f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 -- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 msgr2=0x7f56fc1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 0x7f56fc1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 -- 172.21.15.50:0/1616947002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8009420 con 0x7f56fc156e60 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5700921700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc14f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f56fbfff700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 0x7f56fc1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5701122700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c4e0 tx=0x7f56f4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4005b40 con 0x7f56fc156e60 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f4005ca0 con 0x7f56fc156e60 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4007300 con 0x7f56fc156e60 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0009ae0 con 0x7f56fc156e60 2023-12-24T18:37:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.729+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc06cd40 con 0x7f56fc156e60 2023-12-24T18:37:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.733+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc0652e0 con 0x7f56fc156e60 2023-12-24T18:37:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.733+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f56f401b3b0 con 0x7f56fc156e60 2023-12-24T18:37:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.737+0000 7f56f8ff9700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 0x7f56e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.737+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f56f407bec0 con 0x7f56fc156e60 2023-12-24T18:37:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.737+0000 7f5700921700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 0x7f56e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:32.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.737+0000 7f5700921700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 0x7f56e0062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56fc145f10 tx=0x7f56f0018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.741+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f56f404c2d0 con 0x7f56fc156e60 2023-12-24T18:37:32.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:32.945+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56fc14dae0 con 0x7f56fc156e60 2023-12-24T18:37:33.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.741+0000 7f56f8ff9700 1 -- 172.21.15.50:0/1616947002 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f56f40170b0 con 0x7f56fc156e60 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 msgr2=0x7f56e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 0x7f56e0062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56fc145f10 tx=0x7f56f0018000 comp rx=0 tx=0).stop 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 msgr2=0x7f56fc155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c4e0 tx=0x7f56f4007f50 comp rx=0 tx=0).stop 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 shutdown_connections 2023-12-24T18:37:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f56e0060550 0x7f56e0062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56fc156e60 0x7f56fc155a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56fc0cc190 0x7f56fc1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 --2- 172.21.15.50:0/1616947002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56fc06d930 0x7f56fc14f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 >> 172.21.15.50:0/1616947002 conn(0x7f56fc0afb40 msgr2=0x7f56fc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 shutdown_connections 2023-12-24T18:37:33.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.745+0000 7f5702b85700 1 -- 172.21.15.50:0/1616947002 wait complete. 2023-12-24T18:37:33.774 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:37:33.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 Processor -- start 2023-12-24T18:37:33.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 -- start start 2023-12-24T18:37:33.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda440b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 0x7fda440b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda440b3fd0 con 0x7fda44158e00 2023-12-24T18:37:33.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440b33c0 con 0x7fda4406c820 2023-12-24T18:37:33.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.945+0000 7fda4b878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda440b36a0 con 0x7fda4406ae20 2023-12-24T18:37:33.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda49614700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda44158e00 0x7fda4406a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55918/0 (socket says 172.21.15.50:55918) 2023-12-24T18:37:33.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda49614700 1 -- 172.21.15.50:0/1740086013 learned_addr learned my addr 172.21.15.50:0/1740086013 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:33.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 --2- 172.21.15.50:0/1740086013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda440b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda49e15700 1 --2- 172.21.15.50:0/1740086013 >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 0x7fda440b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda3bfff700 1 -- 172.21.15.50:0/1740086013 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722872286 0 0) 0x7fda440b3fd0 con 0x7fda44158e00 2023-12-24T18:37:33.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda3bfff700 1 -- 172.21.15.50:0/1740086013 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30003570 con 0x7fda44158e00 2023-12-24T18:37:33.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 -- 172.21.15.50:0/1740086013 >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 msgr2=0x7fda440b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:33.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 --2- 172.21.15.50:0/1740086013 >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 0x7fda440b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 -- 172.21.15.50:0/1740086013 >> v1:172.21.15.50:6789/0 conn(0x7fda44158e00 legacy=0x7fda4406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 -- 172.21.15.50:0/1740086013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440b3980 con 0x7fda4406ae20 2023-12-24T18:37:33.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda49e15700 1 --2- 172.21.15.50:0/1740086013 >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 0x7fda440b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:33.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda48e13700 1 --2- 172.21.15.50:0/1740086013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda440b2de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda340098e0 tx=0x7fda340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b863f6e475b642 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:33.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda3bfff700 1 -- 172.21.15.50:0/1740086013 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011630 con 0x7fda4406ae20 2023-12-24T18:37:33.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda3bfff700 1 -- 172.21.15.50:0/1740086013 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34011790 con 0x7fda4406ae20 2023-12-24T18:37:33.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda3bfff700 1 -- 172.21.15.50:0/1740086013 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011b30 con 0x7fda4406ae20 2023-12-24T18:37:33.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 -- 172.21.15.50:0/1740086013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 msgr2=0x7fda440b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 --2- 172.21.15.50:0/1740086013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda440b2de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda340098e0 tx=0x7fda340091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 -- 172.21.15.50:0/1740086013 shutdown_connections 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 --2- 172.21.15.50:0/1740086013 >> v2:172.21.15.82:3300/0 conn(0x7fda4406c820 0x7fda440b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 --2- 172.21.15.50:0/1740086013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda440b2de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.949+0000 7fda4b878700 1 -- 172.21.15.50:0/1740086013 >> 172.21.15.50:0/1740086013 conn(0x7fda44067b80 msgr2=0x7fda440cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.953+0000 7fda4b878700 1 -- 172.21.15.50:0/1740086013 shutdown_connections 2023-12-24T18:37:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.953+0000 7fda4b878700 1 -- 172.21.15.50:0/1740086013 wait complete. 2023-12-24T18:37:33.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.953+0000 7fda4b878700 1 Processor -- start 2023-12-24T18:37:33.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.953+0000 7fda4b878700 1 -- start start 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda44088b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44158e00 0x7fda44087030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44088700 con 0x7fda4406c820 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440890d0 con 0x7fda44158e00 2023-12-24T18:37:33.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44149ff0 con 0x7fda4406ae20 2023-12-24T18:37:33.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44580/0 (socket says 172.21.15.50:44580) 2023-12-24T18:37:33.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 -- 172.21.15.50:0/1502138786 learned_addr learned my addr 172.21.15.50:0/1502138786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:33.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda49614700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda44088b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda49e15700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44158e00 0x7fda44087030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 -- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 msgr2=0x7fda44088b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda44088b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 -- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44158e00 msgr2=0x7fda44087030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:33.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44158e00 0x7fda44087030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 -- 172.21.15.50:0/1502138786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009a20 con 0x7fda4406c820 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda48e13700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda440b37e0 tx=0x7fda34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011b10 con 0x7fda4406c820 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34000cc0 con 0x7fda4406c820 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda34009420 con 0x7fda4406c820 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34025620 con 0x7fda4406c820 2023-12-24T18:37:33.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.957+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44087dd0 con 0x7fda4406c820 2023-12-24T18:37:33.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.961+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda440888b0 con 0x7fda4406c820 2023-12-24T18:37:33.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.961+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fda34025a10 con 0x7fda4406c820 2023-12-24T18:37:33.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.961+0000 7fda397fa700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 0x7fda28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:33.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.965+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fda3407dfe0 con 0x7fda4406c820 2023-12-24T18:37:33.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.965+0000 7fda49614700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 0x7fda28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:33.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.965+0000 7fda49614700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 0x7fda28062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:33.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:33.969+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda440888b0 con 0x7fda4406c820 2023-12-24T18:37:34.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.177+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda440652e0 con 0x7fda4406c820 2023-12-24T18:37:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.741+0000 7fda397fa700 1 -- 172.21.15.50:0/1502138786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda3404e4b0 con 0x7fda4406c820 2023-12-24T18:37:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 msgr2=0x7fda28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 0x7fda28062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40009040 comp rx=0 tx=0).stop 2023-12-24T18:37:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 msgr2=0x7fda44149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda440b37e0 tx=0x7fda34017000 comp rx=0 tx=0).stop 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 shutdown_connections 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fda28060550 0x7fda28062a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44158e00 0x7fda44087030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.745+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4406c820 0x7fda44149ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.749+0000 7fda4b878700 1 --2- 172.21.15.50:0/1502138786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4406ae20 0x7fda44088b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.749+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 >> 172.21.15.50:0/1502138786 conn(0x7fda44067b80 msgr2=0x7fda4415b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.749+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 shutdown_connections 2023-12-24T18:37:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.749+0000 7fda4b878700 1 -- 172.21.15.50:0/1502138786 wait complete. 2023-12-24T18:37:34.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.941+0000 7fa365478700 1 Processor -- start 2023-12-24T18:37:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.941+0000 7fa365478700 1 -- start start 2023-12-24T18:37:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa365478700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 0x7fa3600ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa365478700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa365478700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36006ca50 con 0x7fa36006b260 2023-12-24T18:37:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa365478700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600c6980 con 0x7fa3600ca3a0 2023-12-24T18:37:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa365478700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36006b7f0 con 0x7fa36006ae10 2023-12-24T18:37:34.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:36316/0 (socket says 172.21.15.50:36316) 2023-12-24T18:37:34.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 -- 172.21.15.50:0/2531211929 learned_addr learned my addr 172.21.15.50:0/2531211929 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:34.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35effd700 1 --2- 172.21.15.50:0/2531211929 >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 0x7fa3600ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35dffb700 1 -- 172.21.15.50:0/2531211929 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398435699 0 0) 0x7fa36006ca50 con 0x7fa36006b260 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35dffb700 1 -- 172.21.15.50:0/2531211929 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa348003570 con 0x7fa36006b260 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 -- 172.21.15.50:0/2531211929 >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 msgr2=0x7fa3600ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 --2- 172.21.15.50:0/2531211929 >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 0x7fa3600ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 -- 172.21.15.50:0/2531211929 >> v1:172.21.15.82:6789/0 conn(0x7fa36006b260 legacy=0x7fa360160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35e7fc700 1 -- 172.21.15.50:0/2531211929 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36006bad0 con 0x7fa36006ae10 2023-12-24T18:37:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.945+0000 7fa35effd700 1 --2- 172.21.15.50:0/2531211929 >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 0x7fa3600ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa35e7fc700 1 --2- 172.21.15.50:0/2531211929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3540099b0 tx=0x7fa354009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de2ff26ac2fcb1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa35dffb700 1 -- 172.21.15.50:0/2531211929 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400b680 con 0x7fa36006ae10 2023-12-24T18:37:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa35dffb700 1 -- 172.21.15.50:0/2531211929 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400b7e0 con 0x7fa36006ae10 2023-12-24T18:37:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa35dffb700 1 -- 172.21.15.50:0/2531211929 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400bba0 con 0x7fa36006ae10 2023-12-24T18:37:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 -- 172.21.15.50:0/2531211929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 msgr2=0x7fa36015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 --2- 172.21.15.50:0/2531211929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3540099b0 tx=0x7fa354009250 comp rx=0 tx=0).stop 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 -- 172.21.15.50:0/2531211929 shutdown_connections 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 --2- 172.21.15.50:0/2531211929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa36006ae10 0x7fa36015aa50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 --2- 172.21.15.50:0/2531211929 >> v2:172.21.15.82:3300/0 conn(0x7fa3600ca3a0 0x7fa3600ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 -- 172.21.15.50:0/2531211929 >> 172.21.15.50:0/2531211929 conn(0x7fa3600cbba0 msgr2=0x7fa3600cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 -- 172.21.15.50:0/2531211929 shutdown_connections 2023-12-24T18:37:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.949+0000 7fa365478700 1 -- 172.21.15.50:0/2531211929 wait complete. 2023-12-24T18:37:34.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.953+0000 7fa365478700 1 Processor -- start 2023-12-24T18:37:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.953+0000 7fa365478700 1 -- start start 2023-12-24T18:37:34.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 0x7fa36016e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3600ca3a0 0x7fa360159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600c2d80 con 0x7fa36006b260 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600c49e0 con 0x7fa36006ae10 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36016d9e0 con 0x7fa3600ca3a0 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44582/0 (socket says 172.21.15.50:44582) 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35e7fc700 1 -- 172.21.15.50:0/3532064980 learned_addr learned my addr 172.21.15.50:0/3532064980 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 0x7fa36016e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35f7fe700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3600ca3a0 0x7fa360159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 -- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3600ca3a0 msgr2=0x7fa360159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3600ca3a0 0x7fa360159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 -- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 msgr2=0x7fa360159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 -- 172.21.15.50:0/3532064980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350009420 con 0x7fa36006ae10 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35e7fc700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa35effd700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 0x7fa36016e560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ea00 tx=0x7fa3500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000c6a0 con 0x7fa36006ae10 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000c800 con 0x7fa36006ae10 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3540094f0 con 0x7fa36006ae10 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000cba0 con 0x7fa36006ae10 2023-12-24T18:37:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.957+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36016dfa0 con 0x7fa36006ae10 2023-12-24T18:37:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.961+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3600652e0 con 0x7fa36006ae10 2023-12-24T18:37:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.961+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa350013470 con 0x7fa36006ae10 2023-12-24T18:37:34.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.965+0000 7fa346ffd700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 0x7fa34c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:34.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.965+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fa35007cb20 con 0x7fa36006ae10 2023-12-24T18:37:34.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.965+0000 7fa35e7fc700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 0x7fa34c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.965+0000 7fa35e7fc700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 0x7fa34c062b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa36015a490 tx=0x7fa354017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:34.973+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa35004cfb0 con 0x7fa36006ae10 2023-12-24T18:37:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.193+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa36006bdb0 con 0x7fa36006ae10 2023-12-24T18:37:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.193+0000 7fa346ffd700 1 -- 172.21.15.50:0/3532064980 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fa3500505d0 con 0x7fa36006ae10 2023-12-24T18:37:35.200 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:35.200 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:37:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 msgr2=0x7fa34c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 0x7fa34c062b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa36015a490 tx=0x7fa354017000 comp rx=0 tx=0).stop 2023-12-24T18:37:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 msgr2=0x7fa36016e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 0x7fa36016e560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ea00 tx=0x7fa3500091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 shutdown_connections 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa34c0606a0 0x7fa34c062b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3600ca3a0 0x7fa360159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa36006b260 0x7fa360159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 --2- 172.21.15.50:0/3532064980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa36006ae10 0x7fa36016e560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 >> 172.21.15.50:0/3532064980 conn(0x7fa3600cbba0 msgr2=0x7fa3600c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 shutdown_connections 2023-12-24T18:37:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.197+0000 7fa365478700 1 -- 172.21.15.50:0/3532064980 wait complete. 2023-12-24T18:37:35.205 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:37:35.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:37:35.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 Processor -- start 2023-12-24T18:37:35.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 -- start start 2023-12-24T18:37:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a00cd8e0 0x7fd0a00af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00b1b30 con 0x7fd0a0140980 2023-12-24T18:37:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00b0660 con 0x7fd0a00cd8e0 2023-12-24T18:37:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a7985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00b0f20 con 0x7fd0a0140d50 2023-12-24T18:37:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.393+0000 7fd0a5f22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a00cd8e0 0x7fd0a00af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:36332/0 (socket says 172.21.15.50:36332) 2023-12-24T18:37:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 -- 172.21.15.50:0/372866826 learned_addr learned my addr 172.21.15.50:0/372866826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a5721700 1 --1- 172.21.15.50:0/372866826 >> v1:172.21.15.82:6789/0 conn(0x7fd0a0140980 0x7fd0a00cd1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36420/0 (socket says 172.21.15.50:36420) 2023-12-24T18:37:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 -- 172.21.15.50:0/372866826 >> v2:172.21.15.50:3300/0 conn(0x7fd0a00cd8e0 msgr2=0x7fd0a00af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 --2- 172.21.15.50:0/372866826 >> v2:172.21.15.50:3300/0 conn(0x7fd0a00cd8e0 0x7fd0a00af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 -- 172.21.15.50:0/372866826 >> v1:172.21.15.82:6789/0 conn(0x7fd0a0140980 legacy=0x7fd0a00cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 -- 172.21.15.50:0/372866826 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00b1200 con 0x7fd0a0140d50 2023-12-24T18:37:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a4f20700 1 --2- 172.21.15.50:0/372866826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0900099b0 tx=0x7fd090009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2614b50b9bfe63 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd097fff700 1 -- 172.21.15.50:0/372866826 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090009ea0 con 0x7fd0a0140d50 2023-12-24T18:37:35.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd097fff700 1 -- 172.21.15.50:0/372866826 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000b860 con 0x7fd0a0140d50 2023-12-24T18:37:35.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd097fff700 1 -- 172.21.15.50:0/372866826 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09000bc00 con 0x7fd0a0140d50 2023-12-24T18:37:35.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 -- 172.21.15.50:0/372866826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 msgr2=0x7fd0a00af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 --2- 172.21.15.50:0/372866826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0900099b0 tx=0x7fd090009250 comp rx=0 tx=0).stop 2023-12-24T18:37:35.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 -- 172.21.15.50:0/372866826 shutdown_connections 2023-12-24T18:37:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 --2- 172.21.15.50:0/372866826 >> v2:172.21.15.50:3300/0 conn(0x7fd0a00cd8e0 0x7fd0a00af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 --2- 172.21.15.50:0/372866826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0140d50 0x7fd0a00af0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 -- 172.21.15.50:0/372866826 >> 172.21.15.50:0/372866826 conn(0x7fd0a006dd00 msgr2=0x7fd0a00ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 -- 172.21.15.50:0/372866826 shutdown_connections 2023-12-24T18:37:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.397+0000 7fd0a7985700 1 -- 172.21.15.50:0/372866826 wait complete. 2023-12-24T18:37:35.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.401+0000 7fd0a7985700 1 Processor -- start 2023-12-24T18:37:35.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.401+0000 7fd0a7985700 1 -- start start 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a00cd8e0 0x7fd0a01589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a0140d50 0x7fd0a013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0167940 con 0x7fd0a0140980 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00a99b0 con 0x7fd0a0140d50 2023-12-24T18:37:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00aa490 con 0x7fd0a00cd8e0 2023-12-24T18:37:35.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44588/0 (socket says 172.21.15.50:44588) 2023-12-24T18:37:35.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 -- 172.21.15.50:0/3092299301 learned_addr learned my addr 172.21.15.50:0/3092299301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a5f22700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a0140d50 0x7fd0a013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a5721700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a00cd8e0 0x7fd0a01589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 -- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a00cd8e0 msgr2=0x7fd0a01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a00cd8e0 0x7fd0a01589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 -- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a0140d50 msgr2=0x7fd0a013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a0140d50 0x7fd0a013eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 -- 172.21.15.50:0/3092299301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094f0 con 0x7fd0a0140980 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a4f20700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd090006fd0 tx=0x7fd090017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090000d10 con 0x7fd0a0140980 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000bbe0 con 0x7fd0a0140980 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090025670 con 0x7fd0a0140980 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a00a9bf0 con 0x7fd0a0140980 2023-12-24T18:37:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.405+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00aa1b0 con 0x7fd0a0140980 2023-12-24T18:37:35.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.409+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a006b130 con 0x7fd0a0140980 2023-12-24T18:37:35.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.409+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd09002e440 con 0x7fd0a0140980 2023-12-24T18:37:35.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.409+0000 7fd0957fa700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.413+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fd09007e5d0 con 0x7fd0a0140980 2023-12-24T18:37:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.413+0000 7fd0a5721700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.413+0000 7fd0a5721700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 0x7fd084062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd09c004f40 tx=0x7fd09c007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.417+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd0a006b130 con 0x7fd0a0140980 2023-12-24T18:37:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.593+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0a006b130 con 0x7fd0a0140980 2023-12-24T18:37:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.597+0000 7fd0957fa700 1 -- 172.21.15.50:0/3092299301 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15507 (secure 0 0 0) 0x7fd0a006b130 con 0x7fd0a0140980 2023-12-24T18:37:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:35.602 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:37:32.705081+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:37:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.597+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 msgr2=0x7fd084062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.597+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 0x7fd084062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd09c004f40 tx=0x7fd09c007eb0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.597+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 msgr2=0x7fd0a00a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.597+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd090006fd0 tx=0x7fd090017000 comp rx=0 tx=0).stop 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 shutdown_connections 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a0140d50 0x7fd0a013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0140980 0x7fd0a00a9470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 --2- 172.21.15.50:0/3092299301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a00cd8e0 0x7fd0a01589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 >> 172.21.15.50:0/3092299301 conn(0x7fd0a006dd00 msgr2=0x7fd0a00ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 shutdown_connections 2023-12-24T18:37:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.601+0000 7fd0a7985700 1 -- 172.21.15.50:0/3092299301 wait complete. 2023-12-24T18:37:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:37:35.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:37:35.665 INFO:tasks.ceph.mds.b.smithi082.stderr:2023-12-24T18:37:35.664+0000 7f543ad0c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:37:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.781+0000 7f89e8678700 1 Processor -- start 2023-12-24T18:37:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.781+0000 7f89e8678700 1 -- start start 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e8678700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89e00c6d00 0x7f89e00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e8678700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89e006aca0 0x7f89e006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e8678700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e006c820 con 0x7f89e0154450 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e8678700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e006b960 con 0x7f89e00c6d00 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e8678700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e006bc40 con 0x7f89e006aca0 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89e00c6d00 0x7f89e00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89e00c6d00 0x7f89e00c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44590/0 (socket says 172.21.15.50:44590) 2023-12-24T18:37:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 -- 172.21.15.50:0/3712510064 learned_addr learned my addr 172.21.15.50:0/3712510064 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6c15700 1 --2- 172.21.15.50:0/3712510064 >> v2:172.21.15.82:3300/0 conn(0x7f89e006aca0 0x7f89e006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 -- 172.21.15.50:0/3712510064 >> v2:172.21.15.82:3300/0 conn(0x7f89e006aca0 msgr2=0x7f89e006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 --2- 172.21.15.50:0/3712510064 >> v2:172.21.15.82:3300/0 conn(0x7f89e006aca0 0x7f89e006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 -- 172.21.15.50:0/3712510064 >> v1:172.21.15.50:6789/0 conn(0x7f89e0154450 legacy=0x7f89e01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.785+0000 7f89e6414700 1 -- 172.21.15.50:0/3712510064 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e006bf20 con 0x7f89e00c6d00 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e6414700 1 --2- 172.21.15.50:0/3712510064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00c6d00 0x7f89e00c70d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f89e0069f60 tx=0x7f89dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6aba9b4a5843b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e5412700 1 -- 172.21.15.50:0/3712510064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00b860 con 0x7f89e00c6d00 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e5412700 1 -- 172.21.15.50:0/3712510064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00b9c0 con 0x7f89e00c6d00 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e5412700 1 -- 172.21.15.50:0/3712510064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00bd60 con 0x7f89e00c6d00 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 -- 172.21.15.50:0/3712510064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00c6d00 msgr2=0x7f89e00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 --2- 172.21.15.50:0/3712510064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00c6d00 0x7f89e00c70d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f89e0069f60 tx=0x7f89dc009250 comp rx=0 tx=0).stop 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 -- 172.21.15.50:0/3712510064 shutdown_connections 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 --2- 172.21.15.50:0/3712510064 >> v2:172.21.15.82:3300/0 conn(0x7f89e006aca0 0x7f89e006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 --2- 172.21.15.50:0/3712510064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00c6d00 0x7f89e00c70d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 -- 172.21.15.50:0/3712510064 >> 172.21.15.50:0/3712510064 conn(0x7f89e00cbba0 msgr2=0x7f89e00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 -- 172.21.15.50:0/3712510064 shutdown_connections 2023-12-24T18:37:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.789+0000 7f89e8678700 1 -- 172.21.15.50:0/3712510064 wait complete. 2023-12-24T18:37:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 Processor -- start 2023-12-24T18:37:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 -- start start 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e00c6d00 0x7f89e00acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0154450 0x7f89e00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00affa0 con 0x7f89e006aca0 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01675e0 con 0x7f89e0154450 2023-12-24T18:37:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e8678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e0167830 con 0x7f89e00c6d00 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44598/0 (socket says 172.21.15.50:44598) 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 -- 172.21.15.50:0/82897470 learned_addr learned my addr 172.21.15.50:0/82897470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6c15700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0154450 0x7f89e00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e5c13700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e00c6d00 0x7f89e00acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 -- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e00c6d00 msgr2=0x7f89e00acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e00c6d00 0x7f89e00acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 -- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0154450 msgr2=0x7f89e00ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:35.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0154450 0x7f89e00ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:35.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 -- 172.21.15.50:0/82897470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0094f0 con 0x7f89e006aca0 2023-12-24T18:37:35.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.793+0000 7f89e6414700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006fd0 tx=0x7f89dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc024440 con 0x7f89e006aca0 2023-12-24T18:37:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc0245a0 con 0x7f89e006aca0 2023-12-24T18:37:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc024960 con 0x7f89e006aca0 2023-12-24T18:37:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e0167b10 con 0x7f89e006aca0 2023-12-24T18:37:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e01680d0 con 0x7f89e006aca0 2023-12-24T18:37:35.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e01682f0 con 0x7f89e006aca0 2023-12-24T18:37:35.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.797+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f89dc01a420 con 0x7f89e006aca0 2023-12-24T18:37:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.801+0000 7f89d67fc700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 0x7f89c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.801+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f89dc07e760 con 0x7f89e006aca0 2023-12-24T18:37:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.801+0000 7f89e5c13700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 0x7f89c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:35.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.801+0000 7f89e5c13700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 0x7f89c4062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89e00afb70 tx=0x7f89d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:35.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.805+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89dc04eb70 con 0x7f89e006aca0 2023-12-24T18:37:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.973+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89e00652e0 con 0x7f89c4060550 2023-12-24T18:37:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:35.993+0000 7f89d67fc700 1 -- 172.21.15.50:0/82897470 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282933 (secure 0 0 0) 0x7f89e00652e0 con 0x7f89c4060550 2023-12-24T18:37:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 msgr2=0x7f89c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 0x7f89c4062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89e00afb70 tx=0x7f89d0009040 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 msgr2=0x7f89e01487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006fd0 tx=0x7f89dc017000 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 shutdown_connections 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89c4060550 0x7f89c4062a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0154450 0x7f89e00ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e00c6d00 0x7f89e00acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 --2- 172.21.15.50:0/82897470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e006aca0 0x7f89e01487f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 >> 172.21.15.50:0/82897470 conn(0x7f89e00cbba0 msgr2=0x7f89e01578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 shutdown_connections 2023-12-24T18:37:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.005+0000 7f89e8678700 1 -- 172.21.15.50:0/82897470 wait complete. 2023-12-24T18:37:36.012 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:37:36.032 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-12-24T18:37:34.760525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399080,"kb_used_data":4392,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575640,"statfs":{"total":773094113280,"available":770637455360,"internally_reserved":0,"allocated":4497408,"data_stored":2581656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.075540"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.723703+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:46.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.721891+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:51.310550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716519+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711514+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708906+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716459+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.721381+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:45.981059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720612+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:45.981059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712872+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720962+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:16.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720760+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:42.486239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710555+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716653+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710651+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717207+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713459+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.473392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712972+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711447+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:53.643013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708235+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711760+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:59.159454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716077+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709345+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714424+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:50.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708535+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711708+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:22.694177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717479+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710036+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:37:44.772706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716908+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709929+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:18.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710420+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:20.270784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712605+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:39.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712024+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713743+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728730+0000","last_change":"2023-12-24T18:37:30.728730+0000","last_active":"2023-12-24T18:37:30.728730+0000","last_peered":"2023-12-24T18:37:30.728730+0000","last_clean":"2023-12-24T18:37:30.728730+0000","last_became_active":"2023-12-24T18:37:30.726464+0000","last_became_peered":"2023-12-24T18:37:30.726464+0000","last_unstale":"2023-12-24T18:37:30.728730+0000","last_undegraded":"2023-12-24T18:37:30.728730+0000","last_fullsized":"2023-12-24T18:37:30.728730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:52.325632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718468+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727612+0000","last_change":"2023-12-24T18:37:30.727612+0000","last_active":"2023-12-24T18:37:30.727612+0000","last_peered":"2023-12-24T18:37:30.727612+0000","last_clean":"2023-12-24T18:37:30.727612+0000","last_became_active":"2023-12-24T18:37:30.727347+0000","last_became_peered":"2023-12-24T18:37:30.727347+0000","last_unstale":"2023-12-24T18:37:30.727612+0000","last_undegraded":"2023-12-24T18:37:30.727612+0000","last_fullsized":"2023-12-24T18:37:30.727612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.707786+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727891+0000","last_change":"2023-12-24T18:37:30.727891+0000","last_active":"2023-12-24T18:37:30.727891+0000","last_peered":"2023-12-24T18:37:30.727891+0000","last_clean":"2023-12-24T18:37:30.727891+0000","last_became_active":"2023-12-24T18:37:30.727617+0000","last_became_peered":"2023-12-24T18:37:30.727617+0000","last_unstale":"2023-12-24T18:37:30.727891+0000","last_undegraded":"2023-12-24T18:37:30.727891+0000","last_fullsized":"2023-12-24T18:37:30.727891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717752+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:12:08.076035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731349+0000","last_change":"2023-12-24T18:37:30.731349+0000","last_active":"2023-12-24T18:37:30.731349+0000","last_peered":"2023-12-24T18:37:30.731349+0000","last_clean":"2023-12-24T18:37:30.731349+0000","last_became_active":"2023-12-24T18:37:30.731042+0000","last_became_peered":"2023-12-24T18:37:30.731042+0000","last_unstale":"2023-12-24T18:37:30.731349+0000","last_undegraded":"2023-12-24T18:37:30.731349+0000","last_fullsized":"2023-12-24T18:37:30.731349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:40.637898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714447+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728304+0000","last_change":"2023-12-24T18:37:30.728304+0000","last_active":"2023-12-24T18:37:30.728304+0000","last_peered":"2023-12-24T18:37:30.728304+0000","last_clean":"2023-12-24T18:37:30.728304+0000","last_became_active":"2023-12-24T18:37:30.728019+0000","last_became_peered":"2023-12-24T18:37:30.728019+0000","last_unstale":"2023-12-24T18:37:30.728304+0000","last_undegraded":"2023-12-24T18:37:30.728304+0000","last_fullsized":"2023-12-24T18:37:30.728304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:25.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716144+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728843+0000","last_change":"2023-12-24T18:37:30.728843+0000","last_active":"2023-12-24T18:37:30.728843+0000","last_peered":"2023-12-24T18:37:30.728843+0000","last_clean":"2023-12-24T18:37:30.728843+0000","last_became_active":"2023-12-24T18:37:30.726797+0000","last_became_peered":"2023-12-24T18:37:30.726797+0000","last_unstale":"2023-12-24T18:37:30.728843+0000","last_undegraded":"2023-12-24T18:37:30.728843+0000","last_fullsized":"2023-12-24T18:37:30.728843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:21.680537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708642+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735008+0000","last_change":"2023-12-24T18:37:30.735008+0000","last_active":"2023-12-24T18:37:30.735008+0000","last_peered":"2023-12-24T18:37:30.735008+0000","last_clean":"2023-12-24T18:37:30.735008+0000","last_became_active":"2023-12-24T18:37:30.734650+0000","last_became_peered":"2023-12-24T18:37:30.734650+0000","last_unstale":"2023-12-24T18:37:30.735008+0000","last_undegraded":"2023-12-24T18:37:30.735008+0000","last_fullsized":"2023-12-24T18:37:30.735008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718772+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:16.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.717189+0000","last_change":"2023-12-24T18:37:30.717189+0000","last_active":"2023-12-24T18:37:30.717189+0000","last_peered":"2023-12-24T18:37:30.717189+0000","last_clean":"2023-12-24T18:37:30.717189+0000","last_became_active":"2023-12-24T18:37:30.716878+0000","last_became_peered":"2023-12-24T18:37:30.716878+0000","last_unstale":"2023-12-24T18:37:30.717189+0000","last_undegraded":"2023-12-24T18:37:30.717189+0000","last_fullsized":"2023-12-24T18:37:30.717189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708235+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.473392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730839+0000","last_change":"2023-12-24T18:37:30.730839+0000","last_active":"2023-12-24T18:37:30.730839+0000","last_peered":"2023-12-24T18:37:30.730839+0000","last_clean":"2023-12-24T18:37:30.730839+0000","last_became_active":"2023-12-24T18:37:30.730545+0000","last_became_peered":"2023-12-24T18:37:30.730545+0000","last_unstale":"2023-12-24T18:37:30.730839+0000","last_undegraded":"2023-12-24T18:37:30.730839+0000","last_fullsized":"2023-12-24T18:37:30.730839+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:37.274253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714175+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730860+0000","last_change":"2023-12-24T18:37:30.730860+0000","last_active":"2023-12-24T18:37:30.730860+0000","last_peered":"2023-12-24T18:37:30.730860+0000","last_clean":"2023-12-24T18:37:30.730860+0000","last_became_active":"2023-12-24T18:37:30.730578+0000","last_became_peered":"2023-12-24T18:37:30.730578+0000","last_unstale":"2023-12-24T18:37:30.730860+0000","last_undegraded":"2023-12-24T18:37:30.730860+0000","last_fullsized":"2023-12-24T18:37:30.730860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:04.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712818+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.738678+0000","last_change":"2023-12-24T18:37:30.738678+0000","last_active":"2023-12-24T18:37:30.738678+0000","last_peered":"2023-12-24T18:37:30.738678+0000","last_clean":"2023-12-24T18:37:30.738678+0000","last_became_active":"2023-12-24T18:37:30.738355+0000","last_became_peered":"2023-12-24T18:37:30.738355+0000","last_unstale":"2023-12-24T18:37:30.738678+0000","last_undegraded":"2023-12-24T18:37:30.738678+0000","last_fullsized":"2023-12-24T18:37:30.738678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709029+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.729634+0000","last_change":"2023-12-24T18:37:30.729634+0000","last_active":"2023-12-24T18:37:30.729634+0000","last_peered":"2023-12-24T18:37:30.729634+0000","last_clean":"2023-12-24T18:37:30.729634+0000","last_became_active":"2023-12-24T18:37:30.729330+0000","last_became_peered":"2023-12-24T18:37:30.729330+0000","last_unstale":"2023-12-24T18:37:30.729634+0000","last_undegraded":"2023-12-24T18:37:30.729634+0000","last_fullsized":"2023-12-24T18:37:30.729634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:40.027111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713961+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.732547+0000","last_change":"2023-12-24T18:37:30.732547+0000","last_active":"2023-12-24T18:37:30.732547+0000","last_peered":"2023-12-24T18:37:30.732547+0000","last_clean":"2023-12-24T18:37:30.732547+0000","last_became_active":"2023-12-24T18:37:30.732184+0000","last_became_peered":"2023-12-24T18:37:30.732184+0000","last_unstale":"2023-12-24T18:37:30.732547+0000","last_undegraded":"2023-12-24T18:37:30.732547+0000","last_fullsized":"2023-12-24T18:37:30.732547+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.715220+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:50.477167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735620+0000","last_change":"2023-12-24T18:37:30.735620+0000","last_active":"2023-12-24T18:37:30.735620+0000","last_peered":"2023-12-24T18:37:30.735620+0000","last_clean":"2023-12-24T18:37:30.735620+0000","last_became_active":"2023-12-24T18:37:30.735451+0000","last_became_peered":"2023-12-24T18:37:30.735451+0000","last_unstale":"2023-12-24T18:37:30.735620+0000","last_undegraded":"2023-12-24T18:37:30.735620+0000","last_fullsized":"2023-12-24T18:37:30.735620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714113+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726811+0000","last_change":"2023-12-24T18:37:30.726811+0000","last_active":"2023-12-24T18:37:30.726811+0000","last_peered":"2023-12-24T18:37:30.726811+0000","last_clean":"2023-12-24T18:37:30.726811+0000","last_became_active":"2023-12-24T18:37:30.726263+0000","last_became_peered":"2023-12-24T18:37:30.726263+0000","last_unstale":"2023-12-24T18:37:30.726811+0000","last_undegraded":"2023-12-24T18:37:30.726811+0000","last_fullsized":"2023-12-24T18:37:30.726811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:46.186722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718314+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:42.486239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728398+0000","last_change":"2023-12-24T18:37:30.728398+0000","last_active":"2023-12-24T18:37:30.728398+0000","last_peered":"2023-12-24T18:37:30.728398+0000","last_clean":"2023-12-24T18:37:30.728398+0000","last_became_active":"2023-12-24T18:37:30.727322+0000","last_became_peered":"2023-12-24T18:37:30.727322+0000","last_unstale":"2023-12-24T18:37:30.728398+0000","last_undegraded":"2023-12-24T18:37:30.728398+0000","last_fullsized":"2023-12-24T18:37:30.728398+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:19.257144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713316+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.732278+0000","last_change":"2023-12-24T18:37:30.732278+0000","last_active":"2023-12-24T18:37:30.732278+0000","last_peered":"2023-12-24T18:37:30.732278+0000","last_clean":"2023-12-24T18:37:30.732278+0000","last_became_active":"2023-12-24T18:37:30.732011+0000","last_became_peered":"2023-12-24T18:37:30.732011+0000","last_unstale":"2023-12-24T18:37:30.732278+0000","last_undegraded":"2023-12-24T18:37:30.732278+0000","last_fullsized":"2023-12-24T18:37:30.732278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:44.816929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720265+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:48.463540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735290+0000","last_change":"2023-12-24T18:37:30.735290+0000","last_active":"2023-12-24T18:37:30.735290+0000","last_peered":"2023-12-24T18:37:30.735290+0000","last_clean":"2023-12-24T18:37:30.735290+0000","last_became_active":"2023-12-24T18:37:30.734943+0000","last_became_peered":"2023-12-24T18:37:30.734943+0000","last_unstale":"2023-12-24T18:37:30.735290+0000","last_undegraded":"2023-12-24T18:37:30.735290+0000","last_fullsized":"2023-12-24T18:37:30.735290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:04.492419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711811+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731578+0000","last_change":"2023-12-24T18:37:30.731578+0000","last_active":"2023-12-24T18:37:30.731578+0000","last_peered":"2023-12-24T18:37:30.731578+0000","last_clean":"2023-12-24T18:37:30.731578+0000","last_became_active":"2023-12-24T18:37:30.728684+0000","last_became_peered":"2023-12-24T18:37:30.728684+0000","last_unstale":"2023-12-24T18:37:30.731578+0000","last_undegraded":"2023-12-24T18:37:30.731578+0000","last_fullsized":"2023-12-24T18:37:30.731578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:21.694164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708820+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731246+0000","last_change":"2023-12-24T18:37:30.731246+0000","last_active":"2023-12-24T18:37:30.731246+0000","last_peered":"2023-12-24T18:37:30.731246+0000","last_clean":"2023-12-24T18:37:30.731246+0000","last_became_active":"2023-12-24T18:37:30.728209+0000","last_became_peered":"2023-12-24T18:37:30.728209+0000","last_unstale":"2023-12-24T18:37:30.731246+0000","last_undegraded":"2023-12-24T18:37:30.731246+0000","last_fullsized":"2023-12-24T18:37:30.731246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712889+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:07.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731842+0000","last_change":"2023-12-24T18:37:30.731842+0000","last_active":"2023-12-24T18:37:30.731842+0000","last_peered":"2023-12-24T18:37:30.731842+0000","last_clean":"2023-12-24T18:37:30.731842+0000","last_became_active":"2023-12-24T18:37:30.729568+0000","last_became_peered":"2023-12-24T18:37:30.729568+0000","last_unstale":"2023-12-24T18:37:30.731842+0000","last_undegraded":"2023-12-24T18:37:30.731842+0000","last_fullsized":"2023-12-24T18:37:30.731842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709733+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.718404+0000","last_change":"2023-12-24T18:37:30.718404+0000","last_active":"2023-12-24T18:37:30.718404+0000","last_peered":"2023-12-24T18:37:30.718404+0000","last_clean":"2023-12-24T18:37:30.718404+0000","last_became_active":"2023-12-24T18:37:30.717198+0000","last_became_peered":"2023-12-24T18:37:30.717198+0000","last_unstale":"2023-12-24T18:37:30.718404+0000","last_undegraded":"2023-12-24T18:37:30.718404+0000","last_fullsized":"2023-12-24T18:37:30.718404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.715872+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730130+0000","last_change":"2023-12-24T18:37:30.730130+0000","last_active":"2023-12-24T18:37:30.730130+0000","last_peered":"2023-12-24T18:37:30.730130+0000","last_clean":"2023-12-24T18:37:30.730130+0000","last_became_active":"2023-12-24T18:37:30.729797+0000","last_became_peered":"2023-12-24T18:37:30.729797+0000","last_unstale":"2023-12-24T18:37:30.730130+0000","last_undegraded":"2023-12-24T18:37:30.730130+0000","last_fullsized":"2023-12-24T18:37:30.730130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714811+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.724562+0000","last_change":"2023-12-24T18:37:30.724562+0000","last_active":"2023-12-24T18:37:30.724562+0000","last_peered":"2023-12-24T18:37:30.724562+0000","last_clean":"2023-12-24T18:37:30.724562+0000","last_became_active":"2023-12-24T18:37:30.724228+0000","last_became_peered":"2023-12-24T18:37:30.724228+0000","last_unstale":"2023-12-24T18:37:30.724562+0000","last_undegraded":"2023-12-24T18:37:30.724562+0000","last_fullsized":"2023-12-24T18:37:30.724562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:07.576510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717329+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.729872+0000","last_change":"2023-12-24T18:37:30.729872+0000","last_active":"2023-12-24T18:37:30.729872+0000","last_peered":"2023-12-24T18:37:30.729872+0000","last_clean":"2023-12-24T18:37:30.729872+0000","last_became_active":"2023-12-24T18:37:30.729531+0000","last_became_peered":"2023-12-24T18:37:30.729531+0000","last_unstale":"2023-12-24T18:37:30.729872+0000","last_undegraded":"2023-12-24T18:37:30.729872+0000","last_fullsized":"2023-12-24T18:37:30.729872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:33.618179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712800+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:22.707804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.734975+0000","last_change":"2023-12-24T18:37:30.734975+0000","last_active":"2023-12-24T18:37:30.734975+0000","last_peered":"2023-12-24T18:37:30.734975+0000","last_clean":"2023-12-24T18:37:30.734975+0000","last_became_active":"2023-12-24T18:37:30.734594+0000","last_became_peered":"2023-12-24T18:37:30.734594+0000","last_unstale":"2023-12-24T18:37:30.734975+0000","last_undegraded":"2023-12-24T18:37:30.734975+0000","last_fullsized":"2023-12-24T18:37:30.734975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713372+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726036+0000","last_change":"2023-12-24T18:37:30.726036+0000","last_active":"2023-12-24T18:37:30.726036+0000","last_peered":"2023-12-24T18:37:30.726036+0000","last_clean":"2023-12-24T18:37:30.726036+0000","last_became_active":"2023-12-24T18:37:30.725237+0000","last_became_peered":"2023-12-24T18:37:30.725237+0000","last_unstale":"2023-12-24T18:37:30.726036+0000","last_undegraded":"2023-12-24T18:37:30.726036+0000","last_fullsized":"2023-12-24T18:37:30.726036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710381+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.724051+0000","last_change":"2023-12-24T18:37:30.724051+0000","last_active":"2023-12-24T18:37:30.724051+0000","last_peered":"2023-12-24T18:37:30.724051+0000","last_clean":"2023-12-24T18:37:30.724051+0000","last_became_active":"2023-12-24T18:37:30.723700+0000","last_became_peered":"2023-12-24T18:37:30.723700+0000","last_unstale":"2023-12-24T18:37:30.724051+0000","last_undegraded":"2023-12-24T18:37:30.724051+0000","last_fullsized":"2023-12-24T18:37:30.724051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712359+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727905+0000","last_change":"2023-12-24T18:37:30.727905+0000","last_active":"2023-12-24T18:37:30.727905+0000","last_peered":"2023-12-24T18:37:30.727905+0000","last_clean":"2023-12-24T18:37:30.727905+0000","last_became_active":"2023-12-24T18:37:30.727625+0000","last_became_peered":"2023-12-24T18:37:30.727625+0000","last_unstale":"2023-12-24T18:37:30.727905+0000","last_undegraded":"2023-12-24T18:37:30.727905+0000","last_fullsized":"2023-12-24T18:37:30.727905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:27.773140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709995+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731565+0000","last_change":"2023-12-24T18:37:30.731565+0000","last_active":"2023-12-24T18:37:30.731565+0000","last_peered":"2023-12-24T18:37:30.731565+0000","last_clean":"2023-12-24T18:37:30.731565+0000","last_became_active":"2023-12-24T18:37:30.731130+0000","last_became_peered":"2023-12-24T18:37:30.731130+0000","last_unstale":"2023-12-24T18:37:30.731565+0000","last_undegraded":"2023-12-24T18:37:30.731565+0000","last_fullsized":"2023-12-24T18:37:30.731565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:28.699835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714294+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726320+0000","last_change":"2023-12-24T18:37:30.726320+0000","last_active":"2023-12-24T18:37:30.726320+0000","last_peered":"2023-12-24T18:37:30.726320+0000","last_clean":"2023-12-24T18:37:30.726320+0000","last_became_active":"2023-12-24T18:37:30.726072+0000","last_became_peered":"2023-12-24T18:37:30.726072+0000","last_unstale":"2023-12-24T18:37:30.726320+0000","last_undegraded":"2023-12-24T18:37:30.726320+0000","last_fullsized":"2023-12-24T18:37:30.726320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:22.575833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718225+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:50.477167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728172+0000","last_change":"2023-12-24T18:37:30.728172+0000","last_active":"2023-12-24T18:37:30.728172+0000","last_peered":"2023-12-24T18:37:30.728172+0000","last_clean":"2023-12-24T18:37:30.728172+0000","last_became_active":"2023-12-24T18:37:30.727872+0000","last_became_peered":"2023-12-24T18:37:30.727872+0000","last_unstale":"2023-12-24T18:37:30.728172+0000","last_undegraded":"2023-12-24T18:37:30.728172+0000","last_fullsized":"2023-12-24T18:37:30.728172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:52.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-24T18:37:29.697223+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:37:29.697223+0000","last_peered":"2023-12-24T18:37:29.697223+0000","last_clean":"2023-12-24T18:37:29.697223+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:37:29.697223+0000","last_undegraded":"2023-12-24T18:37:29.697223+0000","last_fullsized":"2023-12-24T18:37:29.697223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":765483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.3029999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.92700000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.014},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.0409999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.077},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.222},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.161}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.268}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.147},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.325}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.52},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.673}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.734},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.6100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.484}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.90400000000000003}]},{"osd":2,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.4419999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.387},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1379999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.6000000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.367}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.554},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5289999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.266},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2290000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.94699999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.738},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.585}]},{"osd":3,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.5620000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.498},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.5329999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.397}]},{"osd":7,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.6639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.84199999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0349999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.22},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.522},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.429},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.018},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.141},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.1850000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.355}]},{"osd":5,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.323},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.494},{"interface":"front","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":1.5669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.149,"5min":4.149,"15min":4.149},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.4790000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.91300000000000003}]},{"osd":3,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.014},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":1.347},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":1.113}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.4530000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.885,"5min":1.885,"15min":1.885},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":1.5309999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.923,"5min":1.923,"15min":1.923},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":1.403},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.2310000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":765483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.875},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.238}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.125},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.5580000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.202},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.0089999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.675},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.298}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.768}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:37:36.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:37:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.229+0000 7f5e11123700 1 Processor -- start 2023-12-24T18:37:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 -- start start 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e0c158cd0 0x7f5e0c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0a9c80 con 0x7f5e0c06afb0 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c06c510 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e11123700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a8e10 con 0x7f5e0c158cd0 2023-12-24T18:37:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44608/0 (socket says 172.21.15.50:44608) 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 -- 172.21.15.50:0/2698218443 learned_addr learned my addr 172.21.15.50:0/2698218443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0bfff700 1 --2- 172.21.15.50:0/2698218443 >> v2:172.21.15.82:3300/0 conn(0x7f5e0c158cd0 0x7f5e0c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 -- 172.21.15.50:0/2698218443 >> v2:172.21.15.82:3300/0 conn(0x7f5e0c158cd0 msgr2=0x7f5e0c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 --2- 172.21.15.50:0/2698218443 >> v2:172.21.15.82:3300/0 conn(0x7f5e0c158cd0 0x7f5e0c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 -- 172.21.15.50:0/2698218443 >> v1:172.21.15.82:6789/0 conn(0x7f5e0c06afb0 legacy=0x7f5e0c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.233+0000 7f5e0b7fe700 1 -- 172.21.15.50:0/2698218443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0a9070 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e0b7fe700 1 --2- 172.21.15.50:0/2698218443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c067fd0 tx=0x7f5e00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d3df234697dde server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e0affd700 1 -- 172.21.15.50:0/2698218443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00009e70 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e0affd700 1 -- 172.21.15.50:0/2698218443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000b860 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e0affd700 1 -- 172.21.15.50:0/2698218443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000bc00 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 -- 172.21.15.50:0/2698218443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c06c0c0 msgr2=0x7f5e0c0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 --2- 172.21.15.50:0/2698218443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c067fd0 tx=0x7f5e00009250 comp rx=0 tx=0).stop 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 -- 172.21.15.50:0/2698218443 shutdown_connections 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 --2- 172.21.15.50:0/2698218443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c0a88d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 --2- 172.21.15.50:0/2698218443 >> v2:172.21.15.82:3300/0 conn(0x7f5e0c158cd0 0x7f5e0c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 -- 172.21.15.50:0/2698218443 >> 172.21.15.50:0/2698218443 conn(0x7f5e0c067b80 msgr2=0x7f5e0c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 -- 172.21.15.50:0/2698218443 shutdown_connections 2023-12-24T18:37:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.237+0000 7f5e11123700 1 -- 172.21.15.50:0/2698218443 wait complete. 2023-12-24T18:37:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 Processor -- start 2023-12-24T18:37:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 -- start start 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e0c06afb0 0x7f5e0c15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0afbe0 con 0x7f5e0c158cd0 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0af320 con 0x7f5e0c06c0c0 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e11123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0af590 con 0x7f5e0c06afb0 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e10922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e10922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44618/0 (socket says 172.21.15.50:44618) 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e10922700 1 -- 172.21.15.50:0/949110386 learned_addr learned my addr 172.21.15.50:0/949110386 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.241+0000 7f5e0b7fe700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e0bfff700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e0c06afb0 0x7f5e0c15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 -- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e0c06afb0 msgr2=0x7f5e0c15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e0c06afb0 0x7f5e0c15d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 -- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0c06c0c0 msgr2=0x7f5e0c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c15d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 -- 172.21.15.50:0/949110386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000094f0 con 0x7f5e0c158cd0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e10922700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c840 tx=0x7f5e04001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04012630 con 0x7f5e0c158cd0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e040127b0 con 0x7f5e0c158cd0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c0af870 con 0x7f5e0c158cd0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04012b70 con 0x7f5e0c158cd0 2023-12-24T18:37:36.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c156070 con 0x7f5e0c158cd0 2023-12-24T18:37:36.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.245+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c04be40 con 0x7f5e0c158cd0 2023-12-24T18:37:36.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.249+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5e0401a3a0 con 0x7f5e0c158cd0 2023-12-24T18:37:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.249+0000 7f5df3fff700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.249+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f5e0407cb20 con 0x7f5e0c158cd0 2023-12-24T18:37:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.249+0000 7f5e0bfff700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.253+0000 7f5e0bfff700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 0x7f5df8062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009db0 tx=0x7f5dfc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.253+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e0404cf30 con 0x7f5e0c158cd0 2023-12-24T18:37:36.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.421+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e0c06a840 con 0x7f5df8060550 2023-12-24T18:37:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.441+0000 7f5df3fff700 1 -- 172.21.15.50:0/949110386 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282933 (secure 0 0 0) 0x7f5e0c06a840 con 0x7f5df8060550 2023-12-24T18:37:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 msgr2=0x7f5df8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 0x7f5df8062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009db0 tx=0x7f5dfc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 msgr2=0x7f5e0c146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c840 tx=0x7f5e04001670 comp rx=0 tx=0).stop 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 shutdown_connections 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e0c158cd0 0x7f5e0c146d00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0c06c0c0 0x7f5e0c15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 --2- 172.21.15.50:0/949110386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e0c06afb0 0x7f5e0c15d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 >> 172.21.15.50:0/949110386 conn(0x7f5e0c067b80 msgr2=0x7f5e0c0ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 shutdown_connections 2023-12-24T18:37:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.449+0000 7f5e11123700 1 -- 172.21.15.50:0/949110386 wait complete. 2023-12-24T18:37:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:37:36.475 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-12-24T18:37:34.760525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399080,"kb_used_data":4392,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575640,"statfs":{"total":773094113280,"available":770637455360,"internally_reserved":0,"allocated":4497408,"data_stored":2581656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.075540"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.723703+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:46.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.721891+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:51.310550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716519+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711514+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708906+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716459+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.721381+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:45.981059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720612+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:45.981059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712872+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720962+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:16.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720760+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:42.486239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710555+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716653+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710651+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717207+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713459+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.473392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712972+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711447+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:53.643013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708235+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711760+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:59.159454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716077+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709345+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714424+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:50.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708535+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711708+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:22.694177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717479+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710036+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:37:44.772706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716908+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709929+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:18.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710420+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:20.270784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712605+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:39.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712024+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713743+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728730+0000","last_change":"2023-12-24T18:37:30.728730+0000","last_active":"2023-12-24T18:37:30.728730+0000","last_peered":"2023-12-24T18:37:30.728730+0000","last_clean":"2023-12-24T18:37:30.728730+0000","last_became_active":"2023-12-24T18:37:30.726464+0000","last_became_peered":"2023-12-24T18:37:30.726464+0000","last_unstale":"2023-12-24T18:37:30.728730+0000","last_undegraded":"2023-12-24T18:37:30.728730+0000","last_fullsized":"2023-12-24T18:37:30.728730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:52.325632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718468+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727612+0000","last_change":"2023-12-24T18:37:30.727612+0000","last_active":"2023-12-24T18:37:30.727612+0000","last_peered":"2023-12-24T18:37:30.727612+0000","last_clean":"2023-12-24T18:37:30.727612+0000","last_became_active":"2023-12-24T18:37:30.727347+0000","last_became_peered":"2023-12-24T18:37:30.727347+0000","last_unstale":"2023-12-24T18:37:30.727612+0000","last_undegraded":"2023-12-24T18:37:30.727612+0000","last_fullsized":"2023-12-24T18:37:30.727612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.707786+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727891+0000","last_change":"2023-12-24T18:37:30.727891+0000","last_active":"2023-12-24T18:37:30.727891+0000","last_peered":"2023-12-24T18:37:30.727891+0000","last_clean":"2023-12-24T18:37:30.727891+0000","last_became_active":"2023-12-24T18:37:30.727617+0000","last_became_peered":"2023-12-24T18:37:30.727617+0000","last_unstale":"2023-12-24T18:37:30.727891+0000","last_undegraded":"2023-12-24T18:37:30.727891+0000","last_fullsized":"2023-12-24T18:37:30.727891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717752+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:12:08.076035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731349+0000","last_change":"2023-12-24T18:37:30.731349+0000","last_active":"2023-12-24T18:37:30.731349+0000","last_peered":"2023-12-24T18:37:30.731349+0000","last_clean":"2023-12-24T18:37:30.731349+0000","last_became_active":"2023-12-24T18:37:30.731042+0000","last_became_peered":"2023-12-24T18:37:30.731042+0000","last_unstale":"2023-12-24T18:37:30.731349+0000","last_undegraded":"2023-12-24T18:37:30.731349+0000","last_fullsized":"2023-12-24T18:37:30.731349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:40.637898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714447+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728304+0000","last_change":"2023-12-24T18:37:30.728304+0000","last_active":"2023-12-24T18:37:30.728304+0000","last_peered":"2023-12-24T18:37:30.728304+0000","last_clean":"2023-12-24T18:37:30.728304+0000","last_became_active":"2023-12-24T18:37:30.728019+0000","last_became_peered":"2023-12-24T18:37:30.728019+0000","last_unstale":"2023-12-24T18:37:30.728304+0000","last_undegraded":"2023-12-24T18:37:30.728304+0000","last_fullsized":"2023-12-24T18:37:30.728304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:25.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.716144+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728843+0000","last_change":"2023-12-24T18:37:30.728843+0000","last_active":"2023-12-24T18:37:30.728843+0000","last_peered":"2023-12-24T18:37:30.728843+0000","last_clean":"2023-12-24T18:37:30.728843+0000","last_became_active":"2023-12-24T18:37:30.726797+0000","last_became_peered":"2023-12-24T18:37:30.726797+0000","last_unstale":"2023-12-24T18:37:30.728843+0000","last_undegraded":"2023-12-24T18:37:30.728843+0000","last_fullsized":"2023-12-24T18:37:30.728843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:21.680537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708642+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735008+0000","last_change":"2023-12-24T18:37:30.735008+0000","last_active":"2023-12-24T18:37:30.735008+0000","last_peered":"2023-12-24T18:37:30.735008+0000","last_clean":"2023-12-24T18:37:30.735008+0000","last_became_active":"2023-12-24T18:37:30.734650+0000","last_became_peered":"2023-12-24T18:37:30.734650+0000","last_unstale":"2023-12-24T18:37:30.735008+0000","last_undegraded":"2023-12-24T18:37:30.735008+0000","last_fullsized":"2023-12-24T18:37:30.735008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718772+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:16.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.717189+0000","last_change":"2023-12-24T18:37:30.717189+0000","last_active":"2023-12-24T18:37:30.717189+0000","last_peered":"2023-12-24T18:37:30.717189+0000","last_clean":"2023-12-24T18:37:30.717189+0000","last_became_active":"2023-12-24T18:37:30.716878+0000","last_became_peered":"2023-12-24T18:37:30.716878+0000","last_unstale":"2023-12-24T18:37:30.717189+0000","last_undegraded":"2023-12-24T18:37:30.717189+0000","last_fullsized":"2023-12-24T18:37:30.717189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708235+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.473392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730839+0000","last_change":"2023-12-24T18:37:30.730839+0000","last_active":"2023-12-24T18:37:30.730839+0000","last_peered":"2023-12-24T18:37:30.730839+0000","last_clean":"2023-12-24T18:37:30.730839+0000","last_became_active":"2023-12-24T18:37:30.730545+0000","last_became_peered":"2023-12-24T18:37:30.730545+0000","last_unstale":"2023-12-24T18:37:30.730839+0000","last_undegraded":"2023-12-24T18:37:30.730839+0000","last_fullsized":"2023-12-24T18:37:30.730839+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:37.274253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714175+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730860+0000","last_change":"2023-12-24T18:37:30.730860+0000","last_active":"2023-12-24T18:37:30.730860+0000","last_peered":"2023-12-24T18:37:30.730860+0000","last_clean":"2023-12-24T18:37:30.730860+0000","last_became_active":"2023-12-24T18:37:30.730578+0000","last_became_peered":"2023-12-24T18:37:30.730578+0000","last_unstale":"2023-12-24T18:37:30.730860+0000","last_undegraded":"2023-12-24T18:37:30.730860+0000","last_fullsized":"2023-12-24T18:37:30.730860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:04.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712818+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.738678+0000","last_change":"2023-12-24T18:37:30.738678+0000","last_active":"2023-12-24T18:37:30.738678+0000","last_peered":"2023-12-24T18:37:30.738678+0000","last_clean":"2023-12-24T18:37:30.738678+0000","last_became_active":"2023-12-24T18:37:30.738355+0000","last_became_peered":"2023-12-24T18:37:30.738355+0000","last_unstale":"2023-12-24T18:37:30.738678+0000","last_undegraded":"2023-12-24T18:37:30.738678+0000","last_fullsized":"2023-12-24T18:37:30.738678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709029+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.729634+0000","last_change":"2023-12-24T18:37:30.729634+0000","last_active":"2023-12-24T18:37:30.729634+0000","last_peered":"2023-12-24T18:37:30.729634+0000","last_clean":"2023-12-24T18:37:30.729634+0000","last_became_active":"2023-12-24T18:37:30.729330+0000","last_became_peered":"2023-12-24T18:37:30.729330+0000","last_unstale":"2023-12-24T18:37:30.729634+0000","last_undegraded":"2023-12-24T18:37:30.729634+0000","last_fullsized":"2023-12-24T18:37:30.729634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:40.027111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713961+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.732547+0000","last_change":"2023-12-24T18:37:30.732547+0000","last_active":"2023-12-24T18:37:30.732547+0000","last_peered":"2023-12-24T18:37:30.732547+0000","last_clean":"2023-12-24T18:37:30.732547+0000","last_became_active":"2023-12-24T18:37:30.732184+0000","last_became_peered":"2023-12-24T18:37:30.732184+0000","last_unstale":"2023-12-24T18:37:30.732547+0000","last_undegraded":"2023-12-24T18:37:30.732547+0000","last_fullsized":"2023-12-24T18:37:30.732547+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.715220+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:50.477167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735620+0000","last_change":"2023-12-24T18:37:30.735620+0000","last_active":"2023-12-24T18:37:30.735620+0000","last_peered":"2023-12-24T18:37:30.735620+0000","last_clean":"2023-12-24T18:37:30.735620+0000","last_became_active":"2023-12-24T18:37:30.735451+0000","last_became_peered":"2023-12-24T18:37:30.735451+0000","last_unstale":"2023-12-24T18:37:30.735620+0000","last_undegraded":"2023-12-24T18:37:30.735620+0000","last_fullsized":"2023-12-24T18:37:30.735620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714113+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:29.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726811+0000","last_change":"2023-12-24T18:37:30.726811+0000","last_active":"2023-12-24T18:37:30.726811+0000","last_peered":"2023-12-24T18:37:30.726811+0000","last_clean":"2023-12-24T18:37:30.726811+0000","last_became_active":"2023-12-24T18:37:30.726263+0000","last_became_peered":"2023-12-24T18:37:30.726263+0000","last_unstale":"2023-12-24T18:37:30.726811+0000","last_undegraded":"2023-12-24T18:37:30.726811+0000","last_fullsized":"2023-12-24T18:37:30.726811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:46.186722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718314+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:42.486239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728398+0000","last_change":"2023-12-24T18:37:30.728398+0000","last_active":"2023-12-24T18:37:30.728398+0000","last_peered":"2023-12-24T18:37:30.728398+0000","last_clean":"2023-12-24T18:37:30.728398+0000","last_became_active":"2023-12-24T18:37:30.727322+0000","last_became_peered":"2023-12-24T18:37:30.727322+0000","last_unstale":"2023-12-24T18:37:30.728398+0000","last_undegraded":"2023-12-24T18:37:30.728398+0000","last_fullsized":"2023-12-24T18:37:30.728398+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:19.257144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713316+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.732278+0000","last_change":"2023-12-24T18:37:30.732278+0000","last_active":"2023-12-24T18:37:30.732278+0000","last_peered":"2023-12-24T18:37:30.732278+0000","last_clean":"2023-12-24T18:37:30.732278+0000","last_became_active":"2023-12-24T18:37:30.732011+0000","last_became_peered":"2023-12-24T18:37:30.732011+0000","last_unstale":"2023-12-24T18:37:30.732278+0000","last_undegraded":"2023-12-24T18:37:30.732278+0000","last_fullsized":"2023-12-24T18:37:30.732278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:44.816929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.720265+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:48.463540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.735290+0000","last_change":"2023-12-24T18:37:30.735290+0000","last_active":"2023-12-24T18:37:30.735290+0000","last_peered":"2023-12-24T18:37:30.735290+0000","last_clean":"2023-12-24T18:37:30.735290+0000","last_became_active":"2023-12-24T18:37:30.734943+0000","last_became_peered":"2023-12-24T18:37:30.734943+0000","last_unstale":"2023-12-24T18:37:30.735290+0000","last_undegraded":"2023-12-24T18:37:30.735290+0000","last_fullsized":"2023-12-24T18:37:30.735290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:04.492419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.711811+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731578+0000","last_change":"2023-12-24T18:37:30.731578+0000","last_active":"2023-12-24T18:37:30.731578+0000","last_peered":"2023-12-24T18:37:30.731578+0000","last_clean":"2023-12-24T18:37:30.731578+0000","last_became_active":"2023-12-24T18:37:30.728684+0000","last_became_peered":"2023-12-24T18:37:30.728684+0000","last_unstale":"2023-12-24T18:37:30.731578+0000","last_undegraded":"2023-12-24T18:37:30.731578+0000","last_fullsized":"2023-12-24T18:37:30.731578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:21.694164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.708820+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731246+0000","last_change":"2023-12-24T18:37:30.731246+0000","last_active":"2023-12-24T18:37:30.731246+0000","last_peered":"2023-12-24T18:37:30.731246+0000","last_clean":"2023-12-24T18:37:30.731246+0000","last_became_active":"2023-12-24T18:37:30.728209+0000","last_became_peered":"2023-12-24T18:37:30.728209+0000","last_unstale":"2023-12-24T18:37:30.731246+0000","last_undegraded":"2023-12-24T18:37:30.731246+0000","last_fullsized":"2023-12-24T18:37:30.731246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712889+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:07.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731842+0000","last_change":"2023-12-24T18:37:30.731842+0000","last_active":"2023-12-24T18:37:30.731842+0000","last_peered":"2023-12-24T18:37:30.731842+0000","last_clean":"2023-12-24T18:37:30.731842+0000","last_became_active":"2023-12-24T18:37:30.729568+0000","last_became_peered":"2023-12-24T18:37:30.729568+0000","last_unstale":"2023-12-24T18:37:30.731842+0000","last_undegraded":"2023-12-24T18:37:30.731842+0000","last_fullsized":"2023-12-24T18:37:30.731842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709733+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.718404+0000","last_change":"2023-12-24T18:37:30.718404+0000","last_active":"2023-12-24T18:37:30.718404+0000","last_peered":"2023-12-24T18:37:30.718404+0000","last_clean":"2023-12-24T18:37:30.718404+0000","last_became_active":"2023-12-24T18:37:30.717198+0000","last_became_peered":"2023-12-24T18:37:30.717198+0000","last_unstale":"2023-12-24T18:37:30.718404+0000","last_undegraded":"2023-12-24T18:37:30.718404+0000","last_fullsized":"2023-12-24T18:37:30.718404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.715872+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.730130+0000","last_change":"2023-12-24T18:37:30.730130+0000","last_active":"2023-12-24T18:37:30.730130+0000","last_peered":"2023-12-24T18:37:30.730130+0000","last_clean":"2023-12-24T18:37:30.730130+0000","last_became_active":"2023-12-24T18:37:30.729797+0000","last_became_peered":"2023-12-24T18:37:30.729797+0000","last_unstale":"2023-12-24T18:37:30.730130+0000","last_undegraded":"2023-12-24T18:37:30.730130+0000","last_fullsized":"2023-12-24T18:37:30.730130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714811+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.724562+0000","last_change":"2023-12-24T18:37:30.724562+0000","last_active":"2023-12-24T18:37:30.724562+0000","last_peered":"2023-12-24T18:37:30.724562+0000","last_clean":"2023-12-24T18:37:30.724562+0000","last_became_active":"2023-12-24T18:37:30.724228+0000","last_became_peered":"2023-12-24T18:37:30.724228+0000","last_unstale":"2023-12-24T18:37:30.724562+0000","last_undegraded":"2023-12-24T18:37:30.724562+0000","last_fullsized":"2023-12-24T18:37:30.724562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:07.576510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.717329+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.729872+0000","last_change":"2023-12-24T18:37:30.729872+0000","last_active":"2023-12-24T18:37:30.729872+0000","last_peered":"2023-12-24T18:37:30.729872+0000","last_clean":"2023-12-24T18:37:30.729872+0000","last_became_active":"2023-12-24T18:37:30.729531+0000","last_became_peered":"2023-12-24T18:37:30.729531+0000","last_unstale":"2023-12-24T18:37:30.729872+0000","last_undegraded":"2023-12-24T18:37:30.729872+0000","last_fullsized":"2023-12-24T18:37:30.729872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:33.618179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712800+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:22.707804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.734975+0000","last_change":"2023-12-24T18:37:30.734975+0000","last_active":"2023-12-24T18:37:30.734975+0000","last_peered":"2023-12-24T18:37:30.734975+0000","last_clean":"2023-12-24T18:37:30.734975+0000","last_became_active":"2023-12-24T18:37:30.734594+0000","last_became_peered":"2023-12-24T18:37:30.734594+0000","last_unstale":"2023-12-24T18:37:30.734975+0000","last_undegraded":"2023-12-24T18:37:30.734975+0000","last_fullsized":"2023-12-24T18:37:30.734975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.713372+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726036+0000","last_change":"2023-12-24T18:37:30.726036+0000","last_active":"2023-12-24T18:37:30.726036+0000","last_peered":"2023-12-24T18:37:30.726036+0000","last_clean":"2023-12-24T18:37:30.726036+0000","last_became_active":"2023-12-24T18:37:30.725237+0000","last_became_peered":"2023-12-24T18:37:30.725237+0000","last_unstale":"2023-12-24T18:37:30.726036+0000","last_undegraded":"2023-12-24T18:37:30.726036+0000","last_fullsized":"2023-12-24T18:37:30.726036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.710381+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.724051+0000","last_change":"2023-12-24T18:37:30.724051+0000","last_active":"2023-12-24T18:37:30.724051+0000","last_peered":"2023-12-24T18:37:30.724051+0000","last_clean":"2023-12-24T18:37:30.724051+0000","last_became_active":"2023-12-24T18:37:30.723700+0000","last_became_peered":"2023-12-24T18:37:30.723700+0000","last_unstale":"2023-12-24T18:37:30.724051+0000","last_undegraded":"2023-12-24T18:37:30.724051+0000","last_fullsized":"2023-12-24T18:37:30.724051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.712359+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:41.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.727905+0000","last_change":"2023-12-24T18:37:30.727905+0000","last_active":"2023-12-24T18:37:30.727905+0000","last_peered":"2023-12-24T18:37:30.727905+0000","last_clean":"2023-12-24T18:37:30.727905+0000","last_became_active":"2023-12-24T18:37:30.727625+0000","last_became_peered":"2023-12-24T18:37:30.727625+0000","last_unstale":"2023-12-24T18:37:30.727905+0000","last_undegraded":"2023-12-24T18:37:30.727905+0000","last_fullsized":"2023-12-24T18:37:30.727905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:27.773140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.709995+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.731565+0000","last_change":"2023-12-24T18:37:30.731565+0000","last_active":"2023-12-24T18:37:30.731565+0000","last_peered":"2023-12-24T18:37:30.731565+0000","last_clean":"2023-12-24T18:37:30.731565+0000","last_became_active":"2023-12-24T18:37:30.731130+0000","last_became_peered":"2023-12-24T18:37:30.731130+0000","last_unstale":"2023-12-24T18:37:30.731565+0000","last_undegraded":"2023-12-24T18:37:30.731565+0000","last_fullsized":"2023-12-24T18:37:30.731565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:28.699835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.714294+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:26.768912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.726320+0000","last_change":"2023-12-24T18:37:30.726320+0000","last_active":"2023-12-24T18:37:30.726320+0000","last_peered":"2023-12-24T18:37:30.726320+0000","last_clean":"2023-12-24T18:37:30.726320+0000","last_became_active":"2023-12-24T18:37:30.726072+0000","last_became_peered":"2023-12-24T18:37:30.726072+0000","last_unstale":"2023-12-24T18:37:30.726320+0000","last_undegraded":"2023-12-24T18:37:30.726320+0000","last_fullsized":"2023-12-24T18:37:30.726320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:22.575833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:37:30.685106+0000","last_change":"2023-12-24T18:37:30.718225+0000","last_active":"2023-12-24T18:37:30.685106+0000","last_peered":"2023-12-24T18:37:30.685106+0000","last_clean":"2023-12-24T18:37:30.685106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:37:30.685106+0000","last_undegraded":"2023-12-24T18:37:30.685106+0000","last_fullsized":"2023-12-24T18:37:30.685106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:50.477167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-24T18:37:30.728172+0000","last_change":"2023-12-24T18:37:30.728172+0000","last_active":"2023-12-24T18:37:30.728172+0000","last_peered":"2023-12-24T18:37:30.728172+0000","last_clean":"2023-12-24T18:37:30.728172+0000","last_became_active":"2023-12-24T18:37:30.727872+0000","last_became_peered":"2023-12-24T18:37:30.727872+0000","last_unstale":"2023-12-24T18:37:30.728172+0000","last_undegraded":"2023-12-24T18:37:30.728172+0000","last_fullsized":"2023-12-24T18:37:30.728172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:52.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-24T18:37:29.697223+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:37:29.697223+0000","last_peered":"2023-12-24T18:37:29.697223+0000","last_clean":"2023-12-24T18:37:29.697223+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:37:29.697223+0000","last_undegraded":"2023-12-24T18:37:29.697223+0000","last_fullsized":"2023-12-24T18:37:29.697223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":765483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.3029999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.92700000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.014},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.0409999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.077},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.222},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.161}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.268}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.147},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.325}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.52},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.673}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.734},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.6100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.484}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.90400000000000003}]},{"osd":2,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.4419999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.387},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1379999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.6000000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.367}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.554},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5289999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.266},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2290000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.94699999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.738},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.585}]},{"osd":3,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.5620000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.498},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.5329999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.397}]},{"osd":7,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.6639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.84199999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0349999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.22},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.522},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.429},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.018},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.141},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.1850000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.355}]},{"osd":5,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.323},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.494},{"interface":"front","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":1.5669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":175115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.149,"5min":4.149,"15min":4.149},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.4790000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.91300000000000003}]},{"osd":3,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.014},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":1.347},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":1.113}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.4530000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.885,"5min":1.885,"15min":1.885},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":1.5309999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.923,"5min":1.923,"15min":1.923},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":1.403},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.2310000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":765483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.875},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.238}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.125},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.5580000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.202},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.0089999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.675},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.298}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.768}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:37:36.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:37:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.681+0000 7f057baf0700 1 Processor -- start 2023-12-24T18:37:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.681+0000 7f057baf0700 1 -- start start 2023-12-24T18:37:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057baf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0574159bc0 0x7f0574159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057baf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f057406bce0 0x7f05740aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057baf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057406b850 con 0x7f05740ab040 2023-12-24T18:37:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057baf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057406ac40 con 0x7f0574159bc0 2023-12-24T18:37:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057baf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057406af20 con 0x7f057406bce0 2023-12-24T18:37:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0574159bc0 0x7f0574159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0574159bc0 0x7f0574159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44630/0 (socket says 172.21.15.50:44630) 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 -- 172.21.15.50:0/2339858174 learned_addr learned my addr 172.21.15.50:0/2339858174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057908b700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f057406bce0 0x7f05740aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 -- 172.21.15.50:0/2339858174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f057406bce0 msgr2=0x7f05740aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f057406bce0 0x7f05740aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 -- 172.21.15.50:0/2339858174 >> v1:172.21.15.82:6789/0 conn(0x7f05740ab040 legacy=0x7f05740ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.685+0000 7f057988c700 1 -- 172.21.15.50:0/2339858174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057406b200 con 0x7f0574159bc0 2023-12-24T18:37:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057988c700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f0574159f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0570009f20 tx=0x7f0570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9846aee6309b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057888a700 1 -- 172.21.15.50:0/2339858174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000e070 con 0x7f0574159bc0 2023-12-24T18:37:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057888a700 1 -- 172.21.15.50:0/2339858174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000ba80 con 0x7f0574159bc0 2023-12-24T18:37:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057888a700 1 -- 172.21.15.50:0/2339858174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700092e0 con 0x7f0574159bc0 2023-12-24T18:37:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 -- 172.21.15.50:0/2339858174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 msgr2=0x7f0574159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f0574159f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0570009f20 tx=0x7f0570009840 comp rx=0 tx=0).stop 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 -- 172.21.15.50:0/2339858174 shutdown_connections 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f057406bce0 0x7f05740aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 --2- 172.21.15.50:0/2339858174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f0574159f90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 -- 172.21.15.50:0/2339858174 >> 172.21.15.50:0/2339858174 conn(0x7f05740cbba0 msgr2=0x7f05740cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 -- 172.21.15.50:0/2339858174 shutdown_connections 2023-12-24T18:37:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 -- 172.21.15.50:0/2339858174 wait complete. 2023-12-24T18:37:36.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.689+0000 7f057baf0700 1 Processor -- start 2023-12-24T18:37:36.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 -- start start 2023-12-24T18:37:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f057406bce0 0x7f05740c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f05740ab040 0x7f05740c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c8ec0 con 0x7f0574159bc0 2023-12-24T18:37:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740b0090 con 0x7f057406bce0 2023-12-24T18:37:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057baf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740b0220 con 0x7f05740ab040 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44646/0 (socket says 172.21.15.50:44646) 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 -- 172.21.15.50:0/3087701697 learned_addr learned my addr 172.21.15.50:0/3087701697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057988c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f057406bce0 0x7f05740c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057908b700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f05740ab040 0x7f05740c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 -- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f05740ab040 msgr2=0x7f05740c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f05740ab040 0x7f05740c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 -- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f057406bce0 msgr2=0x7f05740c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f057406bce0 0x7f05740c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 -- 172.21.15.50:0/3087701697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009ae0 con 0x7f0574159bc0 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.693+0000 7f057a08d700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c590 tx=0x7f056c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00cea0 con 0x7f0574159bc0 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c011590 con 0x7f0574159bc0 2023-12-24T18:37:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c011950 con 0x7f0574159bc0 2023-12-24T18:37:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0574154cf0 con 0x7f0574159bc0 2023-12-24T18:37:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740c7380 con 0x7f0574159bc0 2023-12-24T18:37:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.697+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05740652e0 con 0x7f0574159bc0 2023-12-24T18:37:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.701+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f056c011d00 con 0x7f0574159bc0 2023-12-24T18:37:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.701+0000 7f0569ffb700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 0x7f0558062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.701+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f056c07bd10 con 0x7f0574159bc0 2023-12-24T18:37:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.701+0000 7f057988c700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 0x7f0558062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.701+0000 7f057988c700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 0x7f0558062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0570009880 tx=0x7f0570018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.709+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f056c081020 con 0x7f0574159bc0 2023-12-24T18:37:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.881+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05740b0390 con 0x7f0558060550 2023-12-24T18:37:36.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.893+0000 7f0569ffb700 1 -- 172.21.15.50:0/3087701697 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285637 (secure 0 0 0) 0x7f05740b0390 con 0x7f0558060550 2023-12-24T18:37:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:36.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 msgr2=0x7f0558062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 0x7f0558062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0570009880 tx=0x7f0570018000 comp rx=0 tx=0).stop 2023-12-24T18:37:36.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 msgr2=0x7f05741547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:36.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c590 tx=0x7f056c007ef0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 shutdown_connections 2023-12-24T18:37:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0558060550 0x7f0558062a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0574159bc0 0x7f05741547b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f05740ab040 0x7f05740c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 --2- 172.21.15.50:0/3087701697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f057406bce0 0x7f05740c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:36.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 >> 172.21.15.50:0/3087701697 conn(0x7f05740cbba0 msgr2=0x7f05740c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:36.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 shutdown_connections 2023-12-24T18:37:36.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:36.901+0000 7f057baf0700 1 -- 172.21.15.50:0/3087701697 wait complete. 2023-12-24T18:37:36.908 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:37:36.928 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-12-24T18:37:36.761049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399432,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575288,"statfs":{"total":773094113280,"available":770637094912,"internally_reserved":0,"allocated":4857856,"data_stored":2748460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.060210"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.740863+0000","last_change":"2023-12-24T18:37:31.735099+0000","last_active":"2023-12-24T18:37:31.740863+0000","last_peered":"2023-12-24T18:37:31.740863+0000","last_clean":"2023-12-24T18:37:31.740863+0000","last_became_active":"2023-12-24T18:37:31.734723+0000","last_became_peered":"2023-12-24T18:37:31.734723+0000","last_unstale":"2023-12-24T18:37:31.740863+0000","last_undegraded":"2023-12-24T18:37:31.740863+0000","last_fullsized":"2023-12-24T18:37:31.740863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:26:37.000606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751403+0000","last_change":"2023-12-24T18:37:31.738302+0000","last_active":"2023-12-24T18:37:31.751403+0000","last_peered":"2023-12-24T18:37:31.751403+0000","last_clean":"2023-12-24T18:37:31.751403+0000","last_became_active":"2023-12-24T18:37:31.737574+0000","last_became_peered":"2023-12-24T18:37:31.737574+0000","last_unstale":"2023-12-24T18:37:31.751403+0000","last_undegraded":"2023-12-24T18:37:31.751403+0000","last_fullsized":"2023-12-24T18:37:31.751403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758627+0000","last_change":"2023-12-24T18:37:31.748689+0000","last_active":"2023-12-24T18:37:31.758627+0000","last_peered":"2023-12-24T18:37:31.758627+0000","last_clean":"2023-12-24T18:37:31.758627+0000","last_became_active":"2023-12-24T18:37:31.748307+0000","last_became_peered":"2023-12-24T18:37:31.748307+0000","last_unstale":"2023-12-24T18:37:31.758627+0000","last_undegraded":"2023-12-24T18:37:31.758627+0000","last_fullsized":"2023-12-24T18:37:31.758627+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729494+0000","last_change":"2023-12-24T18:37:31.719827+0000","last_active":"2023-12-24T18:37:31.729494+0000","last_peered":"2023-12-24T18:37:31.729494+0000","last_clean":"2023-12-24T18:37:31.729494+0000","last_became_active":"2023-12-24T18:37:31.719481+0000","last_became_peered":"2023-12-24T18:37:31.719481+0000","last_unstale":"2023-12-24T18:37:31.729494+0000","last_undegraded":"2023-12-24T18:37:31.729494+0000","last_fullsized":"2023-12-24T18:37:31.729494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727308+0000","last_change":"2023-12-24T18:37:31.718181+0000","last_active":"2023-12-24T18:37:31.727308+0000","last_peered":"2023-12-24T18:37:31.727308+0000","last_clean":"2023-12-24T18:37:31.727308+0000","last_became_active":"2023-12-24T18:37:31.717789+0000","last_became_peered":"2023-12-24T18:37:31.717789+0000","last_unstale":"2023-12-24T18:37:31.727308+0000","last_undegraded":"2023-12-24T18:37:31.727308+0000","last_fullsized":"2023-12-24T18:37:31.727308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735502+0000","last_change":"2023-12-24T18:37:31.733299+0000","last_active":"2023-12-24T18:37:31.735502+0000","last_peered":"2023-12-24T18:37:31.735502+0000","last_clean":"2023-12-24T18:37:31.735502+0000","last_became_active":"2023-12-24T18:37:31.732993+0000","last_became_peered":"2023-12-24T18:37:31.732993+0000","last_unstale":"2023-12-24T18:37:31.735502+0000","last_undegraded":"2023-12-24T18:37:31.735502+0000","last_fullsized":"2023-12-24T18:37:31.735502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748682+0000","last_change":"2023-12-24T18:37:31.738868+0000","last_active":"2023-12-24T18:37:31.748682+0000","last_peered":"2023-12-24T18:37:31.748682+0000","last_clean":"2023-12-24T18:37:31.748682+0000","last_became_active":"2023-12-24T18:37:31.738542+0000","last_became_peered":"2023-12-24T18:37:31.738542+0000","last_unstale":"2023-12-24T18:37:31.748682+0000","last_undegraded":"2023-12-24T18:37:31.748682+0000","last_fullsized":"2023-12-24T18:37:31.748682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756599+0000","last_change":"2023-12-24T18:37:31.747918+0000","last_active":"2023-12-24T18:37:31.756599+0000","last_peered":"2023-12-24T18:37:31.756599+0000","last_clean":"2023-12-24T18:37:31.756599+0000","last_became_active":"2023-12-24T18:37:31.747604+0000","last_became_peered":"2023-12-24T18:37:31.747604+0000","last_unstale":"2023-12-24T18:37:31.756599+0000","last_undegraded":"2023-12-24T18:37:31.756599+0000","last_fullsized":"2023-12-24T18:37:31.756599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756246+0000","last_change":"2023-12-24T18:37:31.748140+0000","last_active":"2023-12-24T18:37:31.756246+0000","last_peered":"2023-12-24T18:37:31.756246+0000","last_clean":"2023-12-24T18:37:31.756246+0000","last_became_active":"2023-12-24T18:37:31.747786+0000","last_became_peered":"2023-12-24T18:37:31.747786+0000","last_unstale":"2023-12-24T18:37:31.756246+0000","last_undegraded":"2023-12-24T18:37:31.756246+0000","last_fullsized":"2023-12-24T18:37:31.756246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753481+0000","last_change":"2023-12-24T18:37:31.747089+0000","last_active":"2023-12-24T18:37:31.753481+0000","last_peered":"2023-12-24T18:37:31.753481+0000","last_clean":"2023-12-24T18:37:31.753481+0000","last_became_active":"2023-12-24T18:37:31.746748+0000","last_became_peered":"2023-12-24T18:37:31.746748+0000","last_unstale":"2023-12-24T18:37:31.753481+0000","last_undegraded":"2023-12-24T18:37:31.753481+0000","last_fullsized":"2023-12-24T18:37:31.753481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:46.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759092+0000","last_change":"2023-12-24T18:37:31.748895+0000","last_active":"2023-12-24T18:37:31.759092+0000","last_peered":"2023-12-24T18:37:31.759092+0000","last_clean":"2023-12-24T18:37:31.759092+0000","last_became_active":"2023-12-24T18:37:31.748572+0000","last_became_peered":"2023-12-24T18:37:31.748572+0000","last_unstale":"2023-12-24T18:37:31.759092+0000","last_undegraded":"2023-12-24T18:37:31.759092+0000","last_fullsized":"2023-12-24T18:37:31.759092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746248+0000","last_change":"2023-12-24T18:37:31.737885+0000","last_active":"2023-12-24T18:37:31.746248+0000","last_peered":"2023-12-24T18:37:31.746248+0000","last_clean":"2023-12-24T18:37:31.746248+0000","last_became_active":"2023-12-24T18:37:31.737322+0000","last_became_peered":"2023-12-24T18:37:31.737322+0000","last_unstale":"2023-12-24T18:37:31.746248+0000","last_undegraded":"2023-12-24T18:37:31.746248+0000","last_fullsized":"2023-12-24T18:37:31.746248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749615+0000","last_change":"2023-12-24T18:37:31.741041+0000","last_active":"2023-12-24T18:37:31.749615+0000","last_peered":"2023-12-24T18:37:31.749615+0000","last_clean":"2023-12-24T18:37:31.749615+0000","last_became_active":"2023-12-24T18:37:31.740330+0000","last_became_peered":"2023-12-24T18:37:31.740330+0000","last_unstale":"2023-12-24T18:37:31.749615+0000","last_undegraded":"2023-12-24T18:37:31.749615+0000","last_fullsized":"2023-12-24T18:37:31.749615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:51.310550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754446+0000","last_change":"2023-12-24T18:37:31.741214+0000","last_active":"2023-12-24T18:37:31.754446+0000","last_peered":"2023-12-24T18:37:31.754446+0000","last_clean":"2023-12-24T18:37:31.754446+0000","last_became_active":"2023-12-24T18:37:31.740517+0000","last_became_peered":"2023-12-24T18:37:31.740517+0000","last_unstale":"2023-12-24T18:37:31.754446+0000","last_undegraded":"2023-12-24T18:37:31.754446+0000","last_fullsized":"2023-12-24T18:37:31.754446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748653+0000","last_change":"2023-12-24T18:37:31.738831+0000","last_active":"2023-12-24T18:37:31.748653+0000","last_peered":"2023-12-24T18:37:31.748653+0000","last_clean":"2023-12-24T18:37:31.748653+0000","last_became_active":"2023-12-24T18:37:31.738336+0000","last_became_peered":"2023-12-24T18:37:31.738336+0000","last_unstale":"2023-12-24T18:37:31.748653+0000","last_undegraded":"2023-12-24T18:37:31.748653+0000","last_fullsized":"2023-12-24T18:37:31.748653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755829+0000","last_change":"2023-12-24T18:37:31.751422+0000","last_active":"2023-12-24T18:37:31.755829+0000","last_peered":"2023-12-24T18:37:31.755829+0000","last_clean":"2023-12-24T18:37:31.755829+0000","last_became_active":"2023-12-24T18:37:31.751075+0000","last_became_peered":"2023-12-24T18:37:31.751075+0000","last_unstale":"2023-12-24T18:37:31.755829+0000","last_undegraded":"2023-12-24T18:37:31.755829+0000","last_fullsized":"2023-12-24T18:37:31.755829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755749+0000","last_change":"2023-12-24T18:37:31.751226+0000","last_active":"2023-12-24T18:37:31.755749+0000","last_peered":"2023-12-24T18:37:31.755749+0000","last_clean":"2023-12-24T18:37:31.755749+0000","last_became_active":"2023-12-24T18:37:31.750989+0000","last_became_peered":"2023-12-24T18:37:31.750989+0000","last_unstale":"2023-12-24T18:37:31.755749+0000","last_undegraded":"2023-12-24T18:37:31.755749+0000","last_fullsized":"2023-12-24T18:37:31.755749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744496+0000","last_change":"2023-12-24T18:37:31.726685+0000","last_active":"2023-12-24T18:37:31.744496+0000","last_peered":"2023-12-24T18:37:31.744496+0000","last_clean":"2023-12-24T18:37:31.744496+0000","last_became_active":"2023-12-24T18:37:31.725408+0000","last_became_peered":"2023-12-24T18:37:31.725408+0000","last_unstale":"2023-12-24T18:37:31.744496+0000","last_undegraded":"2023-12-24T18:37:31.744496+0000","last_fullsized":"2023-12-24T18:37:31.744496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735746+0000","last_change":"2023-12-24T18:37:31.730722+0000","last_active":"2023-12-24T18:37:31.735746+0000","last_peered":"2023-12-24T18:37:31.735746+0000","last_clean":"2023-12-24T18:37:31.735746+0000","last_became_active":"2023-12-24T18:37:31.730281+0000","last_became_peered":"2023-12-24T18:37:31.730281+0000","last_unstale":"2023-12-24T18:37:31.735746+0000","last_undegraded":"2023-12-24T18:37:31.735746+0000","last_fullsized":"2023-12-24T18:37:31.735746+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744677+0000","last_change":"2023-12-24T18:37:31.726252+0000","last_active":"2023-12-24T18:37:31.744677+0000","last_peered":"2023-12-24T18:37:31.744677+0000","last_clean":"2023-12-24T18:37:31.744677+0000","last_became_active":"2023-12-24T18:37:31.725978+0000","last_became_peered":"2023-12-24T18:37:31.725978+0000","last_unstale":"2023-12-24T18:37:31.744677+0000","last_undegraded":"2023-12-24T18:37:31.744677+0000","last_fullsized":"2023-12-24T18:37:31.744677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:50.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759046+0000","last_change":"2023-12-24T18:37:31.748628+0000","last_active":"2023-12-24T18:37:31.759046+0000","last_peered":"2023-12-24T18:37:31.759046+0000","last_clean":"2023-12-24T18:37:31.759046+0000","last_became_active":"2023-12-24T18:37:31.748296+0000","last_became_peered":"2023-12-24T18:37:31.748296+0000","last_unstale":"2023-12-24T18:37:31.759046+0000","last_undegraded":"2023-12-24T18:37:31.759046+0000","last_fullsized":"2023-12-24T18:37:31.759046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.730151+0000","last_change":"2023-12-24T18:37:31.723544+0000","last_active":"2023-12-24T18:37:31.730151+0000","last_peered":"2023-12-24T18:37:31.730151+0000","last_clean":"2023-12-24T18:37:31.730151+0000","last_became_active":"2023-12-24T18:37:31.721450+0000","last_became_peered":"2023-12-24T18:37:31.721450+0000","last_unstale":"2023-12-24T18:37:31.730151+0000","last_undegraded":"2023-12-24T18:37:31.730151+0000","last_fullsized":"2023-12-24T18:37:31.730151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754221+0000","last_change":"2023-12-24T18:37:31.747279+0000","last_active":"2023-12-24T18:37:31.754221+0000","last_peered":"2023-12-24T18:37:31.754221+0000","last_clean":"2023-12-24T18:37:31.754221+0000","last_became_active":"2023-12-24T18:37:31.741625+0000","last_became_peered":"2023-12-24T18:37:31.741625+0000","last_unstale":"2023-12-24T18:37:31.754221+0000","last_undegraded":"2023-12-24T18:37:31.754221+0000","last_fullsized":"2023-12-24T18:37:31.754221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.737045+0000","last_change":"2023-12-24T18:37:31.735315+0000","last_active":"2023-12-24T18:37:31.737045+0000","last_peered":"2023-12-24T18:37:31.737045+0000","last_clean":"2023-12-24T18:37:31.737045+0000","last_became_active":"2023-12-24T18:37:31.735047+0000","last_became_peered":"2023-12-24T18:37:31.735047+0000","last_unstale":"2023-12-24T18:37:31.737045+0000","last_undegraded":"2023-12-24T18:37:31.737045+0000","last_fullsized":"2023-12-24T18:37:31.737045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744460+0000","last_change":"2023-12-24T18:37:31.736131+0000","last_active":"2023-12-24T18:37:31.744460+0000","last_peered":"2023-12-24T18:37:31.744460+0000","last_clean":"2023-12-24T18:37:31.744460+0000","last_became_active":"2023-12-24T18:37:31.735860+0000","last_became_peered":"2023-12-24T18:37:31.735860+0000","last_unstale":"2023-12-24T18:37:31.744460+0000","last_undegraded":"2023-12-24T18:37:31.744460+0000","last_fullsized":"2023-12-24T18:37:31.744460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:07.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758517+0000","last_change":"2023-12-24T18:37:31.751286+0000","last_active":"2023-12-24T18:37:31.758517+0000","last_peered":"2023-12-24T18:37:31.758517+0000","last_clean":"2023-12-24T18:37:31.758517+0000","last_became_active":"2023-12-24T18:37:31.750964+0000","last_became_peered":"2023-12-24T18:37:31.750964+0000","last_unstale":"2023-12-24T18:37:31.758517+0000","last_undegraded":"2023-12-24T18:37:31.758517+0000","last_fullsized":"2023-12-24T18:37:31.758517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744334+0000","last_change":"2023-12-24T18:37:31.727492+0000","last_active":"2023-12-24T18:37:31.744334+0000","last_peered":"2023-12-24T18:37:31.744334+0000","last_clean":"2023-12-24T18:37:31.744334+0000","last_became_active":"2023-12-24T18:37:31.726935+0000","last_became_peered":"2023-12-24T18:37:31.726935+0000","last_unstale":"2023-12-24T18:37:31.744334+0000","last_undegraded":"2023-12-24T18:37:31.744334+0000","last_fullsized":"2023-12-24T18:37:31.744334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:08.590150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752386+0000","last_change":"2023-12-24T18:37:31.742322+0000","last_active":"2023-12-24T18:37:31.752386+0000","last_peered":"2023-12-24T18:37:31.752386+0000","last_clean":"2023-12-24T18:37:31.752386+0000","last_became_active":"2023-12-24T18:37:31.739829+0000","last_became_peered":"2023-12-24T18:37:31.739829+0000","last_unstale":"2023-12-24T18:37:31.752386+0000","last_undegraded":"2023-12-24T18:37:31.752386+0000","last_fullsized":"2023-12-24T18:37:31.752386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750358+0000","last_change":"2023-12-24T18:37:31.731610+0000","last_active":"2023-12-24T18:37:31.750358+0000","last_peered":"2023-12-24T18:37:31.750358+0000","last_clean":"2023-12-24T18:37:31.750358+0000","last_became_active":"2023-12-24T18:37:31.731256+0000","last_became_peered":"2023-12-24T18:37:31.731256+0000","last_unstale":"2023-12-24T18:37:31.750358+0000","last_undegraded":"2023-12-24T18:37:31.750358+0000","last_fullsized":"2023-12-24T18:37:31.750358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:39.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744559+0000","last_change":"2023-12-24T18:37:31.733091+0000","last_active":"2023-12-24T18:37:31.744559+0000","last_peered":"2023-12-24T18:37:31.744559+0000","last_clean":"2023-12-24T18:37:31.744559+0000","last_became_active":"2023-12-24T18:37:31.732671+0000","last_became_peered":"2023-12-24T18:37:31.732671+0000","last_unstale":"2023-12-24T18:37:31.744559+0000","last_undegraded":"2023-12-24T18:37:31.744559+0000","last_fullsized":"2023-12-24T18:37:31.744559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:22.707804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750622+0000","last_change":"2023-12-24T18:37:31.745070+0000","last_active":"2023-12-24T18:37:31.750622+0000","last_peered":"2023-12-24T18:37:31.750622+0000","last_clean":"2023-12-24T18:37:31.750622+0000","last_became_active":"2023-12-24T18:37:31.744689+0000","last_became_peered":"2023-12-24T18:37:31.744689+0000","last_unstale":"2023-12-24T18:37:31.750622+0000","last_undegraded":"2023-12-24T18:37:31.750622+0000","last_fullsized":"2023-12-24T18:37:31.750622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.733104+0000","last_change":"2023-12-24T18:37:31.731375+0000","last_active":"2023-12-24T18:37:31.733104+0000","last_peered":"2023-12-24T18:37:31.733104+0000","last_clean":"2023-12-24T18:37:31.733104+0000","last_became_active":"2023-12-24T18:37:31.730403+0000","last_became_peered":"2023-12-24T18:37:31.730403+0000","last_unstale":"2023-12-24T18:37:31.733104+0000","last_undegraded":"2023-12-24T18:37:31.733104+0000","last_fullsized":"2023-12-24T18:37:31.733104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755707+0000","last_change":"2023-12-24T18:37:31.751225+0000","last_active":"2023-12-24T18:37:31.755707+0000","last_peered":"2023-12-24T18:37:31.755707+0000","last_clean":"2023-12-24T18:37:31.755707+0000","last_became_active":"2023-12-24T18:37:31.750936+0000","last_became_peered":"2023-12-24T18:37:31.750936+0000","last_unstale":"2023-12-24T18:37:31.755707+0000","last_undegraded":"2023-12-24T18:37:31.755707+0000","last_fullsized":"2023-12-24T18:37:31.755707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757582+0000","last_change":"2023-12-24T18:37:30.728730+0000","last_active":"2023-12-24T18:37:31.757582+0000","last_peered":"2023-12-24T18:37:31.757582+0000","last_clean":"2023-12-24T18:37:31.757582+0000","last_became_active":"2023-12-24T18:37:30.726464+0000","last_became_peered":"2023-12-24T18:37:30.726464+0000","last_unstale":"2023-12-24T18:37:31.757582+0000","last_undegraded":"2023-12-24T18:37:31.757582+0000","last_fullsized":"2023-12-24T18:37:31.757582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:52.325632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758679+0000","last_change":"2023-12-24T18:37:31.751442+0000","last_active":"2023-12-24T18:37:31.758679+0000","last_peered":"2023-12-24T18:37:31.758679+0000","last_clean":"2023-12-24T18:37:31.758679+0000","last_became_active":"2023-12-24T18:37:31.751127+0000","last_became_peered":"2023-12-24T18:37:31.751127+0000","last_unstale":"2023-12-24T18:37:31.758679+0000","last_undegraded":"2023-12-24T18:37:31.758679+0000","last_fullsized":"2023-12-24T18:37:31.758679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753217+0000","last_change":"2023-12-24T18:37:30.727612+0000","last_active":"2023-12-24T18:37:31.753217+0000","last_peered":"2023-12-24T18:37:31.753217+0000","last_clean":"2023-12-24T18:37:31.753217+0000","last_became_active":"2023-12-24T18:37:30.727347+0000","last_became_peered":"2023-12-24T18:37:30.727347+0000","last_unstale":"2023-12-24T18:37:31.753217+0000","last_undegraded":"2023-12-24T18:37:31.753217+0000","last_fullsized":"2023-12-24T18:37:31.753217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752818+0000","last_change":"2023-12-24T18:37:31.740893+0000","last_active":"2023-12-24T18:37:31.752818+0000","last_peered":"2023-12-24T18:37:31.752818+0000","last_clean":"2023-12-24T18:37:31.752818+0000","last_became_active":"2023-12-24T18:37:31.740598+0000","last_became_peered":"2023-12-24T18:37:31.740598+0000","last_unstale":"2023-12-24T18:37:31.752818+0000","last_undegraded":"2023-12-24T18:37:31.752818+0000","last_fullsized":"2023-12-24T18:37:31.752818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757451+0000","last_change":"2023-12-24T18:37:30.727891+0000","last_active":"2023-12-24T18:37:31.757451+0000","last_peered":"2023-12-24T18:37:31.757451+0000","last_clean":"2023-12-24T18:37:31.757451+0000","last_became_active":"2023-12-24T18:37:30.727617+0000","last_became_peered":"2023-12-24T18:37:30.727617+0000","last_unstale":"2023-12-24T18:37:31.757451+0000","last_undegraded":"2023-12-24T18:37:31.757451+0000","last_fullsized":"2023-12-24T18:37:31.757451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756143+0000","last_change":"2023-12-24T18:37:31.745035+0000","last_active":"2023-12-24T18:37:31.756143+0000","last_peered":"2023-12-24T18:37:31.756143+0000","last_clean":"2023-12-24T18:37:31.756143+0000","last_became_active":"2023-12-24T18:37:31.744733+0000","last_became_peered":"2023-12-24T18:37:31.744733+0000","last_unstale":"2023-12-24T18:37:31.756143+0000","last_undegraded":"2023-12-24T18:37:31.756143+0000","last_fullsized":"2023-12-24T18:37:31.756143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757181+0000","last_change":"2023-12-24T18:37:30.731349+0000","last_active":"2023-12-24T18:37:31.757181+0000","last_peered":"2023-12-24T18:37:31.757181+0000","last_clean":"2023-12-24T18:37:31.757181+0000","last_became_active":"2023-12-24T18:37:30.731042+0000","last_became_peered":"2023-12-24T18:37:30.731042+0000","last_unstale":"2023-12-24T18:37:31.757181+0000","last_undegraded":"2023-12-24T18:37:31.757181+0000","last_fullsized":"2023-12-24T18:37:31.757181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:40.637898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745888+0000","last_change":"2023-12-24T18:37:31.732981+0000","last_active":"2023-12-24T18:37:31.745888+0000","last_peered":"2023-12-24T18:37:31.745888+0000","last_clean":"2023-12-24T18:37:31.745888+0000","last_became_active":"2023-12-24T18:37:31.732678+0000","last_became_peered":"2023-12-24T18:37:31.732678+0000","last_unstale":"2023-12-24T18:37:31.745888+0000","last_undegraded":"2023-12-24T18:37:31.745888+0000","last_fullsized":"2023-12-24T18:37:31.745888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759382+0000","last_change":"2023-12-24T18:37:30.728304+0000","last_active":"2023-12-24T18:37:31.759382+0000","last_peered":"2023-12-24T18:37:31.759382+0000","last_clean":"2023-12-24T18:37:31.759382+0000","last_became_active":"2023-12-24T18:37:30.728019+0000","last_became_peered":"2023-12-24T18:37:30.728019+0000","last_unstale":"2023-12-24T18:37:31.759382+0000","last_undegraded":"2023-12-24T18:37:31.759382+0000","last_fullsized":"2023-12-24T18:37:31.759382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:25.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748634+0000","last_change":"2023-12-24T18:37:31.738664+0000","last_active":"2023-12-24T18:37:31.748634+0000","last_peered":"2023-12-24T18:37:31.748634+0000","last_clean":"2023-12-24T18:37:31.748634+0000","last_became_active":"2023-12-24T18:37:31.737710+0000","last_became_peered":"2023-12-24T18:37:31.737710+0000","last_unstale":"2023-12-24T18:37:31.748634+0000","last_undegraded":"2023-12-24T18:37:31.748634+0000","last_fullsized":"2023-12-24T18:37:31.748634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745790+0000","last_change":"2023-12-24T18:37:30.728843+0000","last_active":"2023-12-24T18:37:31.745790+0000","last_peered":"2023-12-24T18:37:31.745790+0000","last_clean":"2023-12-24T18:37:31.745790+0000","last_became_active":"2023-12-24T18:37:30.726797+0000","last_became_peered":"2023-12-24T18:37:30.726797+0000","last_unstale":"2023-12-24T18:37:31.745790+0000","last_undegraded":"2023-12-24T18:37:31.745790+0000","last_fullsized":"2023-12-24T18:37:31.745790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:21.680537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741352+0000","last_change":"2023-12-24T18:37:31.733957+0000","last_active":"2023-12-24T18:37:31.741352+0000","last_peered":"2023-12-24T18:37:31.741352+0000","last_clean":"2023-12-24T18:37:31.741352+0000","last_became_active":"2023-12-24T18:37:31.733461+0000","last_became_peered":"2023-12-24T18:37:31.733461+0000","last_unstale":"2023-12-24T18:37:31.741352+0000","last_undegraded":"2023-12-24T18:37:31.741352+0000","last_fullsized":"2023-12-24T18:37:31.741352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.728127+0000","last_change":"2023-12-24T18:37:30.735008+0000","last_active":"2023-12-24T18:37:31.728127+0000","last_peered":"2023-12-24T18:37:31.728127+0000","last_clean":"2023-12-24T18:37:31.728127+0000","last_became_active":"2023-12-24T18:37:30.734650+0000","last_became_peered":"2023-12-24T18:37:30.734650+0000","last_unstale":"2023-12-24T18:37:31.728127+0000","last_undegraded":"2023-12-24T18:37:31.728127+0000","last_fullsized":"2023-12-24T18:37:31.728127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753997+0000","last_change":"2023-12-24T18:37:31.739673+0000","last_active":"2023-12-24T18:37:31.753997+0000","last_peered":"2023-12-24T18:37:31.753997+0000","last_clean":"2023-12-24T18:37:31.753997+0000","last_became_active":"2023-12-24T18:37:31.739150+0000","last_became_peered":"2023-12-24T18:37:31.739150+0000","last_unstale":"2023-12-24T18:37:31.753997+0000","last_undegraded":"2023-12-24T18:37:31.753997+0000","last_fullsized":"2023-12-24T18:37:31.753997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714983+0000","last_change":"2023-12-24T18:37:30.717189+0000","last_active":"2023-12-24T18:37:31.714983+0000","last_peered":"2023-12-24T18:37:31.714983+0000","last_clean":"2023-12-24T18:37:31.714983+0000","last_became_active":"2023-12-24T18:37:30.716878+0000","last_became_peered":"2023-12-24T18:37:30.716878+0000","last_unstale":"2023-12-24T18:37:31.714983+0000","last_undegraded":"2023-12-24T18:37:31.714983+0000","last_fullsized":"2023-12-24T18:37:31.714983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729523+0000","last_change":"2023-12-24T18:37:31.725241+0000","last_active":"2023-12-24T18:37:31.729523+0000","last_peered":"2023-12-24T18:37:31.729523+0000","last_clean":"2023-12-24T18:37:31.729523+0000","last_became_active":"2023-12-24T18:37:31.724952+0000","last_became_peered":"2023-12-24T18:37:31.724952+0000","last_unstale":"2023-12-24T18:37:31.729523+0000","last_undegraded":"2023-12-24T18:37:31.729523+0000","last_fullsized":"2023-12-24T18:37:31.729523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735568+0000","last_change":"2023-12-24T18:37:30.730839+0000","last_active":"2023-12-24T18:37:31.735568+0000","last_peered":"2023-12-24T18:37:31.735568+0000","last_clean":"2023-12-24T18:37:31.735568+0000","last_became_active":"2023-12-24T18:37:30.730545+0000","last_became_peered":"2023-12-24T18:37:30.730545+0000","last_unstale":"2023-12-24T18:37:31.735568+0000","last_undegraded":"2023-12-24T18:37:31.735568+0000","last_fullsized":"2023-12-24T18:37:31.735568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:37.274253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756981+0000","last_change":"2023-12-24T18:37:31.746856+0000","last_active":"2023-12-24T18:37:31.756981+0000","last_peered":"2023-12-24T18:37:31.756981+0000","last_clean":"2023-12-24T18:37:31.756981+0000","last_became_active":"2023-12-24T18:37:31.746102+0000","last_became_peered":"2023-12-24T18:37:31.746102+0000","last_unstale":"2023-12-24T18:37:31.756981+0000","last_undegraded":"2023-12-24T18:37:31.756981+0000","last_fullsized":"2023-12-24T18:37:31.756981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.739377+0000","last_change":"2023-12-24T18:37:30.730860+0000","last_active":"2023-12-24T18:37:31.739377+0000","last_peered":"2023-12-24T18:37:31.739377+0000","last_clean":"2023-12-24T18:37:31.739377+0000","last_became_active":"2023-12-24T18:37:30.730578+0000","last_became_peered":"2023-12-24T18:37:30.730578+0000","last_unstale":"2023-12-24T18:37:31.739377+0000","last_undegraded":"2023-12-24T18:37:31.739377+0000","last_fullsized":"2023-12-24T18:37:31.739377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:04.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746288+0000","last_change":"2023-12-24T18:37:31.739973+0000","last_active":"2023-12-24T18:37:31.746288+0000","last_peered":"2023-12-24T18:37:31.746288+0000","last_clean":"2023-12-24T18:37:31.746288+0000","last_became_active":"2023-12-24T18:37:31.739700+0000","last_became_peered":"2023-12-24T18:37:31.739700+0000","last_unstale":"2023-12-24T18:37:31.746288+0000","last_undegraded":"2023-12-24T18:37:31.746288+0000","last_fullsized":"2023-12-24T18:37:31.746288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760325+0000","last_change":"2023-12-24T18:37:30.738678+0000","last_active":"2023-12-24T18:37:31.760325+0000","last_peered":"2023-12-24T18:37:31.760325+0000","last_clean":"2023-12-24T18:37:31.760325+0000","last_became_active":"2023-12-24T18:37:30.738355+0000","last_became_peered":"2023-12-24T18:37:30.738355+0000","last_unstale":"2023-12-24T18:37:31.760325+0000","last_undegraded":"2023-12-24T18:37:31.760325+0000","last_fullsized":"2023-12-24T18:37:31.760325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729663+0000","last_change":"2023-12-24T18:37:31.722588+0000","last_active":"2023-12-24T18:37:31.729663+0000","last_peered":"2023-12-24T18:37:31.729663+0000","last_clean":"2023-12-24T18:37:31.729663+0000","last_became_active":"2023-12-24T18:37:31.721787+0000","last_became_peered":"2023-12-24T18:37:31.721787+0000","last_unstale":"2023-12-24T18:37:31.729663+0000","last_undegraded":"2023-12-24T18:37:31.729663+0000","last_fullsized":"2023-12-24T18:37:31.729663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.763689+0000","last_change":"2023-12-24T18:37:30.729634+0000","last_active":"2023-12-24T18:37:31.763689+0000","last_peered":"2023-12-24T18:37:31.763689+0000","last_clean":"2023-12-24T18:37:31.763689+0000","last_became_active":"2023-12-24T18:37:30.729330+0000","last_became_peered":"2023-12-24T18:37:30.729330+0000","last_unstale":"2023-12-24T18:37:31.763689+0000","last_undegraded":"2023-12-24T18:37:31.763689+0000","last_fullsized":"2023-12-24T18:37:31.763689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:40.027111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756296+0000","last_change":"2023-12-24T18:37:31.748151+0000","last_active":"2023-12-24T18:37:31.756296+0000","last_peered":"2023-12-24T18:37:31.756296+0000","last_clean":"2023-12-24T18:37:31.756296+0000","last_became_active":"2023-12-24T18:37:31.747774+0000","last_became_peered":"2023-12-24T18:37:31.747774+0000","last_unstale":"2023-12-24T18:37:31.756296+0000","last_undegraded":"2023-12-24T18:37:31.756296+0000","last_fullsized":"2023-12-24T18:37:31.756296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759260+0000","last_change":"2023-12-24T18:37:30.732547+0000","last_active":"2023-12-24T18:37:31.759260+0000","last_peered":"2023-12-24T18:37:31.759260+0000","last_clean":"2023-12-24T18:37:31.759260+0000","last_became_active":"2023-12-24T18:37:30.732184+0000","last_became_peered":"2023-12-24T18:37:30.732184+0000","last_unstale":"2023-12-24T18:37:31.759260+0000","last_undegraded":"2023-12-24T18:37:31.759260+0000","last_fullsized":"2023-12-24T18:37:31.759260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756051+0000","last_change":"2023-12-24T18:37:31.744617+0000","last_active":"2023-12-24T18:37:31.756051+0000","last_peered":"2023-12-24T18:37:31.756051+0000","last_clean":"2023-12-24T18:37:31.756051+0000","last_became_active":"2023-12-24T18:37:31.744295+0000","last_became_peered":"2023-12-24T18:37:31.744295+0000","last_unstale":"2023-12-24T18:37:31.756051+0000","last_undegraded":"2023-12-24T18:37:31.756051+0000","last_fullsized":"2023-12-24T18:37:31.756051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727773+0000","last_change":"2023-12-24T18:37:30.735620+0000","last_active":"2023-12-24T18:37:31.727773+0000","last_peered":"2023-12-24T18:37:31.727773+0000","last_clean":"2023-12-24T18:37:31.727773+0000","last_became_active":"2023-12-24T18:37:30.735451+0000","last_became_peered":"2023-12-24T18:37:30.735451+0000","last_unstale":"2023-12-24T18:37:31.727773+0000","last_undegraded":"2023-12-24T18:37:31.727773+0000","last_fullsized":"2023-12-24T18:37:31.727773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746229+0000","last_change":"2023-12-24T18:37:31.735882+0000","last_active":"2023-12-24T18:37:31.746229+0000","last_peered":"2023-12-24T18:37:31.746229+0000","last_clean":"2023-12-24T18:37:31.746229+0000","last_became_active":"2023-12-24T18:37:31.735614+0000","last_became_peered":"2023-12-24T18:37:31.735614+0000","last_unstale":"2023-12-24T18:37:31.746229+0000","last_undegraded":"2023-12-24T18:37:31.746229+0000","last_fullsized":"2023-12-24T18:37:31.746229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.713786+0000","last_change":"2023-12-24T18:37:30.726811+0000","last_active":"2023-12-24T18:37:31.713786+0000","last_peered":"2023-12-24T18:37:31.713786+0000","last_clean":"2023-12-24T18:37:31.713786+0000","last_became_active":"2023-12-24T18:37:30.726263+0000","last_became_peered":"2023-12-24T18:37:30.726263+0000","last_unstale":"2023-12-24T18:37:31.713786+0000","last_undegraded":"2023-12-24T18:37:31.713786+0000","last_fullsized":"2023-12-24T18:37:31.713786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:46.186722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756472+0000","last_change":"2023-12-24T18:37:31.746171+0000","last_active":"2023-12-24T18:37:31.756472+0000","last_peered":"2023-12-24T18:37:31.756472+0000","last_clean":"2023-12-24T18:37:31.756472+0000","last_became_active":"2023-12-24T18:37:31.745822+0000","last_became_peered":"2023-12-24T18:37:31.745822+0000","last_unstale":"2023-12-24T18:37:31.756472+0000","last_undegraded":"2023-12-24T18:37:31.756472+0000","last_fullsized":"2023-12-24T18:37:31.756472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756433+0000","last_change":"2023-12-24T18:37:30.728398+0000","last_active":"2023-12-24T18:37:31.756433+0000","last_peered":"2023-12-24T18:37:31.756433+0000","last_clean":"2023-12-24T18:37:31.756433+0000","last_became_active":"2023-12-24T18:37:30.727322+0000","last_became_peered":"2023-12-24T18:37:30.727322+0000","last_unstale":"2023-12-24T18:37:31.756433+0000","last_undegraded":"2023-12-24T18:37:31.756433+0000","last_fullsized":"2023-12-24T18:37:31.756433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:19.257144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756297+0000","last_change":"2023-12-24T18:37:31.745515+0000","last_active":"2023-12-24T18:37:31.756297+0000","last_peered":"2023-12-24T18:37:31.756297+0000","last_clean":"2023-12-24T18:37:31.756297+0000","last_became_active":"2023-12-24T18:37:31.744837+0000","last_became_peered":"2023-12-24T18:37:31.744837+0000","last_unstale":"2023-12-24T18:37:31.756297+0000","last_undegraded":"2023-12-24T18:37:31.756297+0000","last_fullsized":"2023-12-24T18:37:31.756297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:48.463540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759619+0000","last_change":"2023-12-24T18:37:30.732278+0000","last_active":"2023-12-24T18:37:31.759619+0000","last_peered":"2023-12-24T18:37:31.759619+0000","last_clean":"2023-12-24T18:37:31.759619+0000","last_became_active":"2023-12-24T18:37:30.732011+0000","last_became_peered":"2023-12-24T18:37:30.732011+0000","last_unstale":"2023-12-24T18:37:31.759619+0000","last_undegraded":"2023-12-24T18:37:31.759619+0000","last_fullsized":"2023-12-24T18:37:31.759619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:44.816929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759113+0000","last_change":"2023-12-24T18:37:31.748990+0000","last_active":"2023-12-24T18:37:31.759113+0000","last_peered":"2023-12-24T18:37:31.759113+0000","last_clean":"2023-12-24T18:37:31.759113+0000","last_became_active":"2023-12-24T18:37:31.748643+0000","last_became_peered":"2023-12-24T18:37:31.748643+0000","last_unstale":"2023-12-24T18:37:31.759113+0000","last_undegraded":"2023-12-24T18:37:31.759113+0000","last_fullsized":"2023-12-24T18:37:31.759113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759965+0000","last_change":"2023-12-24T18:37:30.735290+0000","last_active":"2023-12-24T18:37:31.759965+0000","last_peered":"2023-12-24T18:37:31.759965+0000","last_clean":"2023-12-24T18:37:31.759965+0000","last_became_active":"2023-12-24T18:37:30.734943+0000","last_became_peered":"2023-12-24T18:37:30.734943+0000","last_unstale":"2023-12-24T18:37:31.759965+0000","last_undegraded":"2023-12-24T18:37:31.759965+0000","last_fullsized":"2023-12-24T18:37:31.759965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:04.492419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741050+0000","last_change":"2023-12-24T18:37:31.734048+0000","last_active":"2023-12-24T18:37:31.741050+0000","last_peered":"2023-12-24T18:37:31.741050+0000","last_clean":"2023-12-24T18:37:31.741050+0000","last_became_active":"2023-12-24T18:37:31.733643+0000","last_became_peered":"2023-12-24T18:37:31.733643+0000","last_unstale":"2023-12-24T18:37:31.741050+0000","last_undegraded":"2023-12-24T18:37:31.741050+0000","last_fullsized":"2023-12-24T18:37:31.741050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756984+0000","last_change":"2023-12-24T18:37:30.731578+0000","last_active":"2023-12-24T18:37:31.756984+0000","last_peered":"2023-12-24T18:37:31.756984+0000","last_clean":"2023-12-24T18:37:31.756984+0000","last_became_active":"2023-12-24T18:37:30.728684+0000","last_became_peered":"2023-12-24T18:37:30.728684+0000","last_unstale":"2023-12-24T18:37:31.756984+0000","last_undegraded":"2023-12-24T18:37:31.756984+0000","last_fullsized":"2023-12-24T18:37:31.756984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:21.694164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.736832+0000","last_change":"2023-12-24T18:37:31.734368+0000","last_active":"2023-12-24T18:37:31.736832+0000","last_peered":"2023-12-24T18:37:31.736832+0000","last_clean":"2023-12-24T18:37:31.736832+0000","last_became_active":"2023-12-24T18:37:31.734085+0000","last_became_peered":"2023-12-24T18:37:31.734085+0000","last_unstale":"2023-12-24T18:37:31.736832+0000","last_undegraded":"2023-12-24T18:37:31.736832+0000","last_fullsized":"2023-12-24T18:37:31.736832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727938+0000","last_change":"2023-12-24T18:37:30.731246+0000","last_active":"2023-12-24T18:37:31.727938+0000","last_peered":"2023-12-24T18:37:31.727938+0000","last_clean":"2023-12-24T18:37:31.727938+0000","last_became_active":"2023-12-24T18:37:30.728209+0000","last_became_peered":"2023-12-24T18:37:30.728209+0000","last_unstale":"2023-12-24T18:37:31.727938+0000","last_undegraded":"2023-12-24T18:37:31.727938+0000","last_fullsized":"2023-12-24T18:37:31.727938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754068+0000","last_change":"2023-12-24T18:37:31.748288+0000","last_active":"2023-12-24T18:37:31.754068+0000","last_peered":"2023-12-24T18:37:31.754068+0000","last_clean":"2023-12-24T18:37:31.754068+0000","last_became_active":"2023-12-24T18:37:31.747897+0000","last_became_peered":"2023-12-24T18:37:31.747897+0000","last_unstale":"2023-12-24T18:37:31.754068+0000","last_undegraded":"2023-12-24T18:37:31.754068+0000","last_fullsized":"2023-12-24T18:37:31.754068+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753437+0000","last_change":"2023-12-24T18:37:30.731842+0000","last_active":"2023-12-24T18:37:31.753437+0000","last_peered":"2023-12-24T18:37:31.753437+0000","last_clean":"2023-12-24T18:37:31.753437+0000","last_became_active":"2023-12-24T18:37:30.729568+0000","last_became_peered":"2023-12-24T18:37:30.729568+0000","last_unstale":"2023-12-24T18:37:31.753437+0000","last_undegraded":"2023-12-24T18:37:31.753437+0000","last_fullsized":"2023-12-24T18:37:31.753437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748609+0000","last_change":"2023-12-24T18:37:31.743072+0000","last_active":"2023-12-24T18:37:31.748609+0000","last_peered":"2023-12-24T18:37:31.748609+0000","last_clean":"2023-12-24T18:37:31.748609+0000","last_became_active":"2023-12-24T18:37:31.740550+0000","last_became_peered":"2023-12-24T18:37:31.740550+0000","last_unstale":"2023-12-24T18:37:31.748609+0000","last_undegraded":"2023-12-24T18:37:31.748609+0000","last_fullsized":"2023-12-24T18:37:31.748609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.711026+0000","last_change":"2023-12-24T18:37:30.718404+0000","last_active":"2023-12-24T18:37:31.711026+0000","last_peered":"2023-12-24T18:37:31.711026+0000","last_clean":"2023-12-24T18:37:31.711026+0000","last_became_active":"2023-12-24T18:37:30.717198+0000","last_became_peered":"2023-12-24T18:37:30.717198+0000","last_unstale":"2023-12-24T18:37:31.711026+0000","last_undegraded":"2023-12-24T18:37:31.711026+0000","last_fullsized":"2023-12-24T18:37:31.711026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759261+0000","last_change":"2023-12-24T18:37:31.751128+0000","last_active":"2023-12-24T18:37:31.759261+0000","last_peered":"2023-12-24T18:37:31.759261+0000","last_clean":"2023-12-24T18:37:31.759261+0000","last_became_active":"2023-12-24T18:37:31.750850+0000","last_became_peered":"2023-12-24T18:37:31.750850+0000","last_unstale":"2023-12-24T18:37:31.759261+0000","last_undegraded":"2023-12-24T18:37:31.759261+0000","last_fullsized":"2023-12-24T18:37:31.759261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:12:08.076035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720080+0000","last_change":"2023-12-24T18:37:30.730130+0000","last_active":"2023-12-24T18:37:31.720080+0000","last_peered":"2023-12-24T18:37:31.720080+0000","last_clean":"2023-12-24T18:37:31.720080+0000","last_became_active":"2023-12-24T18:37:30.729797+0000","last_became_peered":"2023-12-24T18:37:30.729797+0000","last_unstale":"2023-12-24T18:37:31.720080+0000","last_undegraded":"2023-12-24T18:37:31.720080+0000","last_fullsized":"2023-12-24T18:37:31.720080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753986+0000","last_change":"2023-12-24T18:37:31.739487+0000","last_active":"2023-12-24T18:37:31.753986+0000","last_peered":"2023-12-24T18:37:31.753986+0000","last_clean":"2023-12-24T18:37:31.753986+0000","last_became_active":"2023-12-24T18:37:31.738798+0000","last_became_peered":"2023-12-24T18:37:31.738798+0000","last_unstale":"2023-12-24T18:37:31.753986+0000","last_undegraded":"2023-12-24T18:37:31.753986+0000","last_fullsized":"2023-12-24T18:37:31.753986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.710807+0000","last_change":"2023-12-24T18:37:30.724562+0000","last_active":"2023-12-24T18:37:31.710807+0000","last_peered":"2023-12-24T18:37:31.710807+0000","last_clean":"2023-12-24T18:37:31.710807+0000","last_became_active":"2023-12-24T18:37:30.724228+0000","last_became_peered":"2023-12-24T18:37:30.724228+0000","last_unstale":"2023-12-24T18:37:31.710807+0000","last_undegraded":"2023-12-24T18:37:31.710807+0000","last_fullsized":"2023-12-24T18:37:31.710807+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:07.576510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752533+0000","last_change":"2023-12-24T18:37:31.750640+0000","last_active":"2023-12-24T18:37:31.752533+0000","last_peered":"2023-12-24T18:37:31.752533+0000","last_clean":"2023-12-24T18:37:31.752533+0000","last_became_active":"2023-12-24T18:37:31.749416+0000","last_became_peered":"2023-12-24T18:37:31.749416+0000","last_unstale":"2023-12-24T18:37:31.752533+0000","last_undegraded":"2023-12-24T18:37:31.752533+0000","last_fullsized":"2023-12-24T18:37:31.752533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760344+0000","last_change":"2023-12-24T18:37:30.729872+0000","last_active":"2023-12-24T18:37:31.760344+0000","last_peered":"2023-12-24T18:37:31.760344+0000","last_clean":"2023-12-24T18:37:31.760344+0000","last_became_active":"2023-12-24T18:37:30.729531+0000","last_became_peered":"2023-12-24T18:37:30.729531+0000","last_unstale":"2023-12-24T18:37:31.760344+0000","last_undegraded":"2023-12-24T18:37:31.760344+0000","last_fullsized":"2023-12-24T18:37:31.760344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:33.618179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757005+0000","last_change":"2023-12-24T18:37:31.749420+0000","last_active":"2023-12-24T18:37:31.757005+0000","last_peered":"2023-12-24T18:37:31.757005+0000","last_clean":"2023-12-24T18:37:31.757005+0000","last_became_active":"2023-12-24T18:37:31.749140+0000","last_became_peered":"2023-12-24T18:37:31.749140+0000","last_unstale":"2023-12-24T18:37:31.757005+0000","last_undegraded":"2023-12-24T18:37:31.757005+0000","last_fullsized":"2023-12-24T18:37:31.757005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-24T18:37:33.016354+0000","last_change":"2023-12-24T18:37:30.734975+0000","last_active":"2023-12-24T18:37:33.016354+0000","last_peered":"2023-12-24T18:37:33.016354+0000","last_clean":"2023-12-24T18:37:33.016354+0000","last_became_active":"2023-12-24T18:37:30.734594+0000","last_became_peered":"2023-12-24T18:37:30.734594+0000","last_unstale":"2023-12-24T18:37:33.016354+0000","last_undegraded":"2023-12-24T18:37:33.016354+0000","last_fullsized":"2023-12-24T18:37:33.016354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751421+0000","last_change":"2023-12-24T18:37:31.738479+0000","last_active":"2023-12-24T18:37:31.751421+0000","last_peered":"2023-12-24T18:37:31.751421+0000","last_clean":"2023-12-24T18:37:31.751421+0000","last_became_active":"2023-12-24T18:37:31.737977+0000","last_became_peered":"2023-12-24T18:37:31.737977+0000","last_unstale":"2023-12-24T18:37:31.751421+0000","last_undegraded":"2023-12-24T18:37:31.751421+0000","last_fullsized":"2023-12-24T18:37:31.751421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.724912+0000","last_change":"2023-12-24T18:37:30.726036+0000","last_active":"2023-12-24T18:37:31.724912+0000","last_peered":"2023-12-24T18:37:31.724912+0000","last_clean":"2023-12-24T18:37:31.724912+0000","last_became_active":"2023-12-24T18:37:30.725237+0000","last_became_peered":"2023-12-24T18:37:30.725237+0000","last_unstale":"2023-12-24T18:37:31.724912+0000","last_undegraded":"2023-12-24T18:37:31.724912+0000","last_fullsized":"2023-12-24T18:37:31.724912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745909+0000","last_change":"2023-12-24T18:37:31.734398+0000","last_active":"2023-12-24T18:37:31.745909+0000","last_peered":"2023-12-24T18:37:31.745909+0000","last_clean":"2023-12-24T18:37:31.745909+0000","last_became_active":"2023-12-24T18:37:31.734026+0000","last_became_peered":"2023-12-24T18:37:31.734026+0000","last_unstale":"2023-12-24T18:37:31.745909+0000","last_undegraded":"2023-12-24T18:37:31.745909+0000","last_fullsized":"2023-12-24T18:37:31.745909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720817+0000","last_change":"2023-12-24T18:37:30.724051+0000","last_active":"2023-12-24T18:37:31.720817+0000","last_peered":"2023-12-24T18:37:31.720817+0000","last_clean":"2023-12-24T18:37:31.720817+0000","last_became_active":"2023-12-24T18:37:30.723700+0000","last_became_peered":"2023-12-24T18:37:30.723700+0000","last_unstale":"2023-12-24T18:37:31.720817+0000","last_undegraded":"2023-12-24T18:37:31.720817+0000","last_fullsized":"2023-12-24T18:37:31.720817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749269+0000","last_change":"2023-12-24T18:37:31.746745+0000","last_active":"2023-12-24T18:37:31.749269+0000","last_peered":"2023-12-24T18:37:31.749269+0000","last_clean":"2023-12-24T18:37:31.749269+0000","last_became_active":"2023-12-24T18:37:31.745884+0000","last_became_peered":"2023-12-24T18:37:31.745884+0000","last_unstale":"2023-12-24T18:37:31.749269+0000","last_undegraded":"2023-12-24T18:37:31.749269+0000","last_fullsized":"2023-12-24T18:37:31.749269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714520+0000","last_change":"2023-12-24T18:37:30.727905+0000","last_active":"2023-12-24T18:37:31.714520+0000","last_peered":"2023-12-24T18:37:31.714520+0000","last_clean":"2023-12-24T18:37:31.714520+0000","last_became_active":"2023-12-24T18:37:30.727625+0000","last_became_peered":"2023-12-24T18:37:30.727625+0000","last_unstale":"2023-12-24T18:37:31.714520+0000","last_undegraded":"2023-12-24T18:37:31.714520+0000","last_fullsized":"2023-12-24T18:37:31.714520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:27.773140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741333+0000","last_change":"2023-12-24T18:37:31.733754+0000","last_active":"2023-12-24T18:37:31.741333+0000","last_peered":"2023-12-24T18:37:31.741333+0000","last_clean":"2023-12-24T18:37:31.741333+0000","last_became_active":"2023-12-24T18:37:31.733038+0000","last_became_peered":"2023-12-24T18:37:31.733038+0000","last_unstale":"2023-12-24T18:37:31.741333+0000","last_undegraded":"2023-12-24T18:37:31.741333+0000","last_fullsized":"2023-12-24T18:37:31.741333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714729+0000","last_change":"2023-12-24T18:37:30.731565+0000","last_active":"2023-12-24T18:37:31.714729+0000","last_peered":"2023-12-24T18:37:31.714729+0000","last_clean":"2023-12-24T18:37:31.714729+0000","last_became_active":"2023-12-24T18:37:30.731130+0000","last_became_peered":"2023-12-24T18:37:30.731130+0000","last_unstale":"2023-12-24T18:37:31.714729+0000","last_undegraded":"2023-12-24T18:37:31.714729+0000","last_fullsized":"2023-12-24T18:37:31.714729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:28.699835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757996+0000","last_change":"2023-12-24T18:37:31.754556+0000","last_active":"2023-12-24T18:37:31.757996+0000","last_peered":"2023-12-24T18:37:31.757996+0000","last_clean":"2023-12-24T18:37:31.757996+0000","last_became_active":"2023-12-24T18:37:31.754206+0000","last_became_peered":"2023-12-24T18:37:31.754206+0000","last_unstale":"2023-12-24T18:37:31.757996+0000","last_undegraded":"2023-12-24T18:37:31.757996+0000","last_fullsized":"2023-12-24T18:37:31.757996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.723058+0000","last_change":"2023-12-24T18:37:30.726320+0000","last_active":"2023-12-24T18:37:31.723058+0000","last_peered":"2023-12-24T18:37:31.723058+0000","last_clean":"2023-12-24T18:37:31.723058+0000","last_became_active":"2023-12-24T18:37:30.726072+0000","last_became_peered":"2023-12-24T18:37:30.726072+0000","last_unstale":"2023-12-24T18:37:31.723058+0000","last_undegraded":"2023-12-24T18:37:31.723058+0000","last_fullsized":"2023-12-24T18:37:31.723058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:22.575833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751167+0000","last_change":"2023-12-24T18:37:31.745356+0000","last_active":"2023-12-24T18:37:31.751167+0000","last_peered":"2023-12-24T18:37:31.751167+0000","last_clean":"2023-12-24T18:37:31.751167+0000","last_became_active":"2023-12-24T18:37:31.744975+0000","last_became_peered":"2023-12-24T18:37:31.744975+0000","last_unstale":"2023-12-24T18:37:31.751167+0000","last_undegraded":"2023-12-24T18:37:31.751167+0000","last_fullsized":"2023-12-24T18:37:31.751167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720854+0000","last_change":"2023-12-24T18:37:30.728172+0000","last_active":"2023-12-24T18:37:31.720854+0000","last_peered":"2023-12-24T18:37:31.720854+0000","last_clean":"2023-12-24T18:37:31.720854+0000","last_became_active":"2023-12-24T18:37:30.727872+0000","last_became_peered":"2023-12-24T18:37:30.727872+0000","last_unstale":"2023-12-24T18:37:31.720854+0000","last_undegraded":"2023-12-24T18:37:31.720854+0000","last_fullsized":"2023-12-24T18:37:31.720854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:52.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.722046+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:37:31.722046+0000","last_peered":"2023-12-24T18:37:31.722046+0000","last_clean":"2023-12-24T18:37:31.722046+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:37:31.722046+0000","last_undegraded":"2023-12-24T18:37:31.722046+0000","last_fullsized":"2023-12-24T18:37:31.722046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":787363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.004}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1910000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.389},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2390000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.879}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.347},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.103}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.026}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":195943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.335},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.262}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2130000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.056},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.0940000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.411}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.381},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.355}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.444}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.238},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.3859999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.339},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.417}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.593},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.367}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.5229999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.49}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.198},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5469999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.5},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4079999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1000000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.371}]},{"osd":3,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.26},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.595}]},{"osd":5,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.298},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.4670000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.573}]},{"osd":7,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":196959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.083}]},{"osd":1,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.71}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.488}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.411},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.895}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":2.1469999999999998},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.9430000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":2.1930000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":2.077}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.766},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":2.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.234},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.282}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.25},{"interface":"front","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":1.298}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":1.3380000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.149,"5min":4.149,"15min":4.149},"last":1.008},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.288}]},{"osd":3,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.403},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.268}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.351},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.1479999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.885,"5min":1.885,"15min":1.885},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":1.4630000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.923,"5min":1.923,"15min":1.923},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":1048576,"data_stored":785791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.748}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.623},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0629999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.296},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.016}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":1.038},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.24}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:37:36.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T18:37:37.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.133+0000 7f9c3e585700 1 Processor -- start 2023-12-24T18:37:37.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.133+0000 7f9c3e585700 1 -- start start 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3e585700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9c3815d6c0 0x7f9c380c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3e585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 0x7f9c380abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3e585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3806dab0 con 0x7f9c3815d2f0 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3e585700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c380c8f90 con 0x7f9c3815d6c0 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3e585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3806cc00 con 0x7f9c380c8b50 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c37fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c3815d2f0 0x7f9c380c7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55942/0 (socket says 172.21.15.50:55942) 2023-12-24T18:37:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c37fff700 1 -- 172.21.15.50:0/4218528968 learned_addr learned my addr 172.21.15.50:0/4218528968 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4218528968 >> v2:172.21.15.82:3300/0 conn(0x7f9c3815d6c0 0x7f9c380c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3cb22700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 0x7f9c380abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c377fe700 1 -- 172.21.15.50:0/4218528968 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705206691 0 0) 0x7f9c3806dab0 con 0x7f9c3815d2f0 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c377fe700 1 -- 172.21.15.50:0/4218528968 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c24003570 con 0x7f9c3815d2f0 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 -- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 msgr2=0x7f9c380abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 0x7f9c380abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 -- 172.21.15.50:0/4218528968 >> v1:172.21.15.50:6789/0 conn(0x7f9c3815d2f0 legacy=0x7f9c380c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 -- 172.21.15.50:0/4218528968 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3806cea0 con 0x7f9c3815d6c0 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c3cb22700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 0x7f9c380abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d6c0 0x7f9c380c8610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009e60 tx=0x7f9c20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcec221c71b940b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c377fe700 1 -- 172.21.15.50:0/4218528968 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000e070 con 0x7f9c3815d6c0 2023-12-24T18:37:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c377fe700 1 -- 172.21.15.50:0/4218528968 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000bab0 con 0x7f9c3815d6c0 2023-12-24T18:37:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.137+0000 7f9c377fe700 1 -- 172.21.15.50:0/4218528968 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000be70 con 0x7f9c3815d6c0 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d6c0 msgr2=0x7f9c380c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d6c0 0x7f9c380c8610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009e60 tx=0x7f9c20009780 comp rx=0 tx=0).stop 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- 172.21.15.50:0/4218528968 shutdown_connections 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c380c8b50 0x7f9c380abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4218528968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d6c0 0x7f9c380c8610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- 172.21.15.50:0/4218528968 >> 172.21.15.50:0/4218528968 conn(0x7f9c380670b0 msgr2=0x7f9c380674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- 172.21.15.50:0/4218528968 shutdown_connections 2023-12-24T18:37:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- 172.21.15.50:0/4218528968 wait complete. 2023-12-24T18:37:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 Processor -- start 2023-12-24T18:37:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.141+0000 7f9c3e585700 1 -- start start 2023-12-24T18:37:37.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d2f0 0x7f9c380adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 0x7f9c380c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c38171010 con 0x7f9c380c8b50 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3816df10 con 0x7f9c3815d2f0 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3816e1f0 con 0x7f9c3815d6c0 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44660/0 (socket says 172.21.15.50:44660) 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 -- 172.21.15.50:0/4208938913 learned_addr learned my addr 172.21.15.50:0/4208938913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d2f0 0x7f9c380adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3cb22700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 0x7f9c380c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 -- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 msgr2=0x7f9c380c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 0x7f9c380c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 -- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d2f0 msgr2=0x7f9c380adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d2f0 0x7f9c380adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 -- 172.21.15.50:0/4208938913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30009420 con 0x7f9c380c8b50 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3cb22700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 0x7f9c380c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c37fff700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c7c0 tx=0x7f9c28007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28005b30 con 0x7f9c380c8b50 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c20009a20 con 0x7f9c380c8b50 2023-12-24T18:37:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28005cb0 con 0x7f9c380c8b50 2023-12-24T18:37:37.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28007320 con 0x7f9c380c8b50 2023-12-24T18:37:37.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.145+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3816e7b0 con 0x7f9c380c8b50 2023-12-24T18:37:37.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.149+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c38071060 con 0x7f9c380c8b50 2023-12-24T18:37:37.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.149+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9c2801b3b0 con 0x7f9c380c8b50 2023-12-24T18:37:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.149+0000 7f9c34ff9700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 0x7f9c18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.153+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f9c2807bf30 con 0x7f9c380c8b50 2023-12-24T18:37:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.153+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 0x7f9c18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.153+0000 7f9c2f7fe700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 0x7f9c18062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c200097c0 tx=0x7f9c20019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.157+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9c2804c340 con 0x7f9c380c8b50 2023-12-24T18:37:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.389+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9c3806bec0 con 0x7f9c380c8b50 2023-12-24T18:37:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c34ff9700 1 -- 172.21.15.50:0/4208938913 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1325 (secure 0 0 0) 0x7f9c28017540 con 0x7f9c380c8b50 2023-12-24T18:37:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:37.396 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2456657920,"bytes_avail":770637455360,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5077}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-24T18:37:24.757938+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-24T18:37:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 msgr2=0x7f9c18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 0x7f9c18062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c200097c0 tx=0x7f9c20019000 comp rx=0 tx=0).stop 2023-12-24T18:37:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 msgr2=0x7f9c380c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c7c0 tx=0x7f9c28007e00 comp rx=0 tx=0).stop 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 shutdown_connections 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9c18060550 0x7f9c18062a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9c3815d6c0 0x7f9c380c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3815d2f0 0x7f9c380adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 --2- 172.21.15.50:0/4208938913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c380c8b50 0x7f9c380c3d40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 >> 172.21.15.50:0/4208938913 conn(0x7f9c380670b0 msgr2=0x7f9c3815c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 shutdown_connections 2023-12-24T18:37:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.393+0000 7f9c3e585700 1 -- 172.21.15.50:0/4208938913 wait complete. 2023-12-24T18:37:37.419 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T18:37:37.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:37:37.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.581+0000 7effd6a6e700 1 Processor -- start 2023-12-24T18:37:37.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.581+0000 7effd6a6e700 1 -- start start 2023-12-24T18:37:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd6a6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effd00ca3a0 0x7effd00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd6a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 0x7effd015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd6a6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd006ca50 con 0x7effd006b260 2023-12-24T18:37:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd6a6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00c6980 con 0x7effd00ca3a0 2023-12-24T18:37:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd6a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd006b7f0 con 0x7effd006ae10 2023-12-24T18:37:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd480a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effd00ca3a0 0x7effd00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 0x7effd015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd500b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7effd006b260 0x7effd0160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36452/0 (socket says 172.21.15.50:36452) 2023-12-24T18:37:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effd500b700 1 -- 172.21.15.50:0/2994234152 learned_addr learned my addr 172.21.15.50:0/2994234152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 -- 172.21.15.50:0/2994234152 >> v2:172.21.15.82:3300/0 conn(0x7effd00ca3a0 msgr2=0x7effd00ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 --2- 172.21.15.50:0/2994234152 >> v2:172.21.15.82:3300/0 conn(0x7effd00ca3a0 0x7effd00ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 -- 172.21.15.50:0/2994234152 >> v1:172.21.15.82:6789/0 conn(0x7effd006b260 legacy=0x7effd0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc77fe700 1 -- 172.21.15.50:0/2994234152 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266319220 0 0) 0x7effd006ca50 con 0x7effd006b260 2023-12-24T18:37:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 -- 172.21.15.50:0/2994234152 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd006bad0 con 0x7effd006ae10 2023-12-24T18:37:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc7fff700 1 --2- 172.21.15.50:0/2994234152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 0x7effd015aa50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effc00098e0 tx=0x7effc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e7b29e79642b45 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.585+0000 7effc77fe700 1 -- 172.21.15.50:0/2994234152 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000b640 con 0x7effd006ae10 2023-12-24T18:37:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effc77fe700 1 -- 172.21.15.50:0/2994234152 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000b7a0 con 0x7effd006ae10 2023-12-24T18:37:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effc77fe700 1 -- 172.21.15.50:0/2994234152 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000bb40 con 0x7effd006ae10 2023-12-24T18:37:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 -- 172.21.15.50:0/2994234152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 msgr2=0x7effd015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 --2- 172.21.15.50:0/2994234152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 0x7effd015aa50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effc00098e0 tx=0x7effc00091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 -- 172.21.15.50:0/2994234152 shutdown_connections 2023-12-24T18:37:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 --2- 172.21.15.50:0/2994234152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd006ae10 0x7effd015aa50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 --2- 172.21.15.50:0/2994234152 >> v2:172.21.15.82:3300/0 conn(0x7effd00ca3a0 0x7effd00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 -- 172.21.15.50:0/2994234152 >> 172.21.15.50:0/2994234152 conn(0x7effd00cbba0 msgr2=0x7effd00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 -- 172.21.15.50:0/2994234152 shutdown_connections 2023-12-24T18:37:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.589+0000 7effd6a6e700 1 -- 172.21.15.50:0/2994234152 wait complete. 2023-12-24T18:37:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 Processor -- start 2023-12-24T18:37:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 -- start start 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 0x7effd0150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd00ca3a0 0x7effd00b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0161a30 con 0x7effd006b260 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0154dc0 con 0x7effd006ae10 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd6a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd0161190 con 0x7effd00ca3a0 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effc7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd480a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 0x7effd0150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effc7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44670/0 (socket says 172.21.15.50:44670) 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effc7fff700 1 -- 172.21.15.50:0/3517839030 learned_addr learned my addr 172.21.15.50:0/3517839030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.593+0000 7effd500b700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd00ca3a0 0x7effd00b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 -- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd00ca3a0 msgr2=0x7effd00b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd00ca3a0 0x7effd00b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 -- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 msgr2=0x7effd0150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 0x7effd0150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 -- 172.21.15.50:0/3517839030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009420 con 0x7effd006b260 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effd480a700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 0x7effd0150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc7fff700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effc0009f80 tx=0x7effc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0006af0 con 0x7effd006b260 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0000bc0 con 0x7effd006b260 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd0161470 con 0x7effd006b260 2023-12-24T18:37:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0025420 con 0x7effd006b260 2023-12-24T18:37:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00c1b70 con 0x7effd006b260 2023-12-24T18:37:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.597+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd0154f50 con 0x7effd006b260 2023-12-24T18:37:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.601+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7effc0023070 con 0x7effd006b260 2023-12-24T18:37:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.601+0000 7effc4ff9700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 0x7effbc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.601+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7effc007db40 con 0x7effd006b260 2023-12-24T18:37:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.601+0000 7effd480a700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 0x7effbc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:37.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.605+0000 7effd480a700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 0x7effbc062ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effcc0113e0 tx=0x7effcc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:37.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.609+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7effc004dfd0 con 0x7effd006b260 2023-12-24T18:37:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.781+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effd00652e0 con 0x7effbc060620 2023-12-24T18:37:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.797+0000 7effc4ff9700 1 -- 172.21.15.50:0/3517839030 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285637 (secure 0 0 0) 0x7effd00652e0 con 0x7effbc060620 2023-12-24T18:37:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 msgr2=0x7effbc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 0x7effbc062ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effcc0113e0 tx=0x7effcc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 msgr2=0x7effd00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effc0009f80 tx=0x7effc0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 shutdown_connections 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7effbc060620 0x7effbc062ad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effd00ca3a0 0x7effd00b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006b260 0x7effd00b0c90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 --2- 172.21.15.50:0/3517839030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effd006ae10 0x7effd0150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 >> 172.21.15.50:0/3517839030 conn(0x7effd00cbba0 msgr2=0x7effd0159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 shutdown_connections 2023-12-24T18:37:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:37.809+0000 7effd6a6e700 1 -- 172.21.15.50:0/3517839030 wait complete. 2023-12-24T18:37:37.816 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:37:37.837 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-12-24T18:37:36.761049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399432,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575288,"statfs":{"total":773094113280,"available":770637094912,"internally_reserved":0,"allocated":4857856,"data_stored":2748460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.060210"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.740863+0000","last_change":"2023-12-24T18:37:31.735099+0000","last_active":"2023-12-24T18:37:31.740863+0000","last_peered":"2023-12-24T18:37:31.740863+0000","last_clean":"2023-12-24T18:37:31.740863+0000","last_became_active":"2023-12-24T18:37:31.734723+0000","last_became_peered":"2023-12-24T18:37:31.734723+0000","last_unstale":"2023-12-24T18:37:31.740863+0000","last_undegraded":"2023-12-24T18:37:31.740863+0000","last_fullsized":"2023-12-24T18:37:31.740863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:26:37.000606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751403+0000","last_change":"2023-12-24T18:37:31.738302+0000","last_active":"2023-12-24T18:37:31.751403+0000","last_peered":"2023-12-24T18:37:31.751403+0000","last_clean":"2023-12-24T18:37:31.751403+0000","last_became_active":"2023-12-24T18:37:31.737574+0000","last_became_peered":"2023-12-24T18:37:31.737574+0000","last_unstale":"2023-12-24T18:37:31.751403+0000","last_undegraded":"2023-12-24T18:37:31.751403+0000","last_fullsized":"2023-12-24T18:37:31.751403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758627+0000","last_change":"2023-12-24T18:37:31.748689+0000","last_active":"2023-12-24T18:37:31.758627+0000","last_peered":"2023-12-24T18:37:31.758627+0000","last_clean":"2023-12-24T18:37:31.758627+0000","last_became_active":"2023-12-24T18:37:31.748307+0000","last_became_peered":"2023-12-24T18:37:31.748307+0000","last_unstale":"2023-12-24T18:37:31.758627+0000","last_undegraded":"2023-12-24T18:37:31.758627+0000","last_fullsized":"2023-12-24T18:37:31.758627+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729494+0000","last_change":"2023-12-24T18:37:31.719827+0000","last_active":"2023-12-24T18:37:31.729494+0000","last_peered":"2023-12-24T18:37:31.729494+0000","last_clean":"2023-12-24T18:37:31.729494+0000","last_became_active":"2023-12-24T18:37:31.719481+0000","last_became_peered":"2023-12-24T18:37:31.719481+0000","last_unstale":"2023-12-24T18:37:31.729494+0000","last_undegraded":"2023-12-24T18:37:31.729494+0000","last_fullsized":"2023-12-24T18:37:31.729494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727308+0000","last_change":"2023-12-24T18:37:31.718181+0000","last_active":"2023-12-24T18:37:31.727308+0000","last_peered":"2023-12-24T18:37:31.727308+0000","last_clean":"2023-12-24T18:37:31.727308+0000","last_became_active":"2023-12-24T18:37:31.717789+0000","last_became_peered":"2023-12-24T18:37:31.717789+0000","last_unstale":"2023-12-24T18:37:31.727308+0000","last_undegraded":"2023-12-24T18:37:31.727308+0000","last_fullsized":"2023-12-24T18:37:31.727308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735502+0000","last_change":"2023-12-24T18:37:31.733299+0000","last_active":"2023-12-24T18:37:31.735502+0000","last_peered":"2023-12-24T18:37:31.735502+0000","last_clean":"2023-12-24T18:37:31.735502+0000","last_became_active":"2023-12-24T18:37:31.732993+0000","last_became_peered":"2023-12-24T18:37:31.732993+0000","last_unstale":"2023-12-24T18:37:31.735502+0000","last_undegraded":"2023-12-24T18:37:31.735502+0000","last_fullsized":"2023-12-24T18:37:31.735502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748682+0000","last_change":"2023-12-24T18:37:31.738868+0000","last_active":"2023-12-24T18:37:31.748682+0000","last_peered":"2023-12-24T18:37:31.748682+0000","last_clean":"2023-12-24T18:37:31.748682+0000","last_became_active":"2023-12-24T18:37:31.738542+0000","last_became_peered":"2023-12-24T18:37:31.738542+0000","last_unstale":"2023-12-24T18:37:31.748682+0000","last_undegraded":"2023-12-24T18:37:31.748682+0000","last_fullsized":"2023-12-24T18:37:31.748682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756599+0000","last_change":"2023-12-24T18:37:31.747918+0000","last_active":"2023-12-24T18:37:31.756599+0000","last_peered":"2023-12-24T18:37:31.756599+0000","last_clean":"2023-12-24T18:37:31.756599+0000","last_became_active":"2023-12-24T18:37:31.747604+0000","last_became_peered":"2023-12-24T18:37:31.747604+0000","last_unstale":"2023-12-24T18:37:31.756599+0000","last_undegraded":"2023-12-24T18:37:31.756599+0000","last_fullsized":"2023-12-24T18:37:31.756599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756246+0000","last_change":"2023-12-24T18:37:31.748140+0000","last_active":"2023-12-24T18:37:31.756246+0000","last_peered":"2023-12-24T18:37:31.756246+0000","last_clean":"2023-12-24T18:37:31.756246+0000","last_became_active":"2023-12-24T18:37:31.747786+0000","last_became_peered":"2023-12-24T18:37:31.747786+0000","last_unstale":"2023-12-24T18:37:31.756246+0000","last_undegraded":"2023-12-24T18:37:31.756246+0000","last_fullsized":"2023-12-24T18:37:31.756246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753481+0000","last_change":"2023-12-24T18:37:31.747089+0000","last_active":"2023-12-24T18:37:31.753481+0000","last_peered":"2023-12-24T18:37:31.753481+0000","last_clean":"2023-12-24T18:37:31.753481+0000","last_became_active":"2023-12-24T18:37:31.746748+0000","last_became_peered":"2023-12-24T18:37:31.746748+0000","last_unstale":"2023-12-24T18:37:31.753481+0000","last_undegraded":"2023-12-24T18:37:31.753481+0000","last_fullsized":"2023-12-24T18:37:31.753481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:46.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759092+0000","last_change":"2023-12-24T18:37:31.748895+0000","last_active":"2023-12-24T18:37:31.759092+0000","last_peered":"2023-12-24T18:37:31.759092+0000","last_clean":"2023-12-24T18:37:31.759092+0000","last_became_active":"2023-12-24T18:37:31.748572+0000","last_became_peered":"2023-12-24T18:37:31.748572+0000","last_unstale":"2023-12-24T18:37:31.759092+0000","last_undegraded":"2023-12-24T18:37:31.759092+0000","last_fullsized":"2023-12-24T18:37:31.759092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746248+0000","last_change":"2023-12-24T18:37:31.737885+0000","last_active":"2023-12-24T18:37:31.746248+0000","last_peered":"2023-12-24T18:37:31.746248+0000","last_clean":"2023-12-24T18:37:31.746248+0000","last_became_active":"2023-12-24T18:37:31.737322+0000","last_became_peered":"2023-12-24T18:37:31.737322+0000","last_unstale":"2023-12-24T18:37:31.746248+0000","last_undegraded":"2023-12-24T18:37:31.746248+0000","last_fullsized":"2023-12-24T18:37:31.746248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749615+0000","last_change":"2023-12-24T18:37:31.741041+0000","last_active":"2023-12-24T18:37:31.749615+0000","last_peered":"2023-12-24T18:37:31.749615+0000","last_clean":"2023-12-24T18:37:31.749615+0000","last_became_active":"2023-12-24T18:37:31.740330+0000","last_became_peered":"2023-12-24T18:37:31.740330+0000","last_unstale":"2023-12-24T18:37:31.749615+0000","last_undegraded":"2023-12-24T18:37:31.749615+0000","last_fullsized":"2023-12-24T18:37:31.749615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:51.310550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754446+0000","last_change":"2023-12-24T18:37:31.741214+0000","last_active":"2023-12-24T18:37:31.754446+0000","last_peered":"2023-12-24T18:37:31.754446+0000","last_clean":"2023-12-24T18:37:31.754446+0000","last_became_active":"2023-12-24T18:37:31.740517+0000","last_became_peered":"2023-12-24T18:37:31.740517+0000","last_unstale":"2023-12-24T18:37:31.754446+0000","last_undegraded":"2023-12-24T18:37:31.754446+0000","last_fullsized":"2023-12-24T18:37:31.754446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748653+0000","last_change":"2023-12-24T18:37:31.738831+0000","last_active":"2023-12-24T18:37:31.748653+0000","last_peered":"2023-12-24T18:37:31.748653+0000","last_clean":"2023-12-24T18:37:31.748653+0000","last_became_active":"2023-12-24T18:37:31.738336+0000","last_became_peered":"2023-12-24T18:37:31.738336+0000","last_unstale":"2023-12-24T18:37:31.748653+0000","last_undegraded":"2023-12-24T18:37:31.748653+0000","last_fullsized":"2023-12-24T18:37:31.748653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755829+0000","last_change":"2023-12-24T18:37:31.751422+0000","last_active":"2023-12-24T18:37:31.755829+0000","last_peered":"2023-12-24T18:37:31.755829+0000","last_clean":"2023-12-24T18:37:31.755829+0000","last_became_active":"2023-12-24T18:37:31.751075+0000","last_became_peered":"2023-12-24T18:37:31.751075+0000","last_unstale":"2023-12-24T18:37:31.755829+0000","last_undegraded":"2023-12-24T18:37:31.755829+0000","last_fullsized":"2023-12-24T18:37:31.755829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755749+0000","last_change":"2023-12-24T18:37:31.751226+0000","last_active":"2023-12-24T18:37:31.755749+0000","last_peered":"2023-12-24T18:37:31.755749+0000","last_clean":"2023-12-24T18:37:31.755749+0000","last_became_active":"2023-12-24T18:37:31.750989+0000","last_became_peered":"2023-12-24T18:37:31.750989+0000","last_unstale":"2023-12-24T18:37:31.755749+0000","last_undegraded":"2023-12-24T18:37:31.755749+0000","last_fullsized":"2023-12-24T18:37:31.755749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744496+0000","last_change":"2023-12-24T18:37:31.726685+0000","last_active":"2023-12-24T18:37:31.744496+0000","last_peered":"2023-12-24T18:37:31.744496+0000","last_clean":"2023-12-24T18:37:31.744496+0000","last_became_active":"2023-12-24T18:37:31.725408+0000","last_became_peered":"2023-12-24T18:37:31.725408+0000","last_unstale":"2023-12-24T18:37:31.744496+0000","last_undegraded":"2023-12-24T18:37:31.744496+0000","last_fullsized":"2023-12-24T18:37:31.744496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735746+0000","last_change":"2023-12-24T18:37:31.730722+0000","last_active":"2023-12-24T18:37:31.735746+0000","last_peered":"2023-12-24T18:37:31.735746+0000","last_clean":"2023-12-24T18:37:31.735746+0000","last_became_active":"2023-12-24T18:37:31.730281+0000","last_became_peered":"2023-12-24T18:37:31.730281+0000","last_unstale":"2023-12-24T18:37:31.735746+0000","last_undegraded":"2023-12-24T18:37:31.735746+0000","last_fullsized":"2023-12-24T18:37:31.735746+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744677+0000","last_change":"2023-12-24T18:37:31.726252+0000","last_active":"2023-12-24T18:37:31.744677+0000","last_peered":"2023-12-24T18:37:31.744677+0000","last_clean":"2023-12-24T18:37:31.744677+0000","last_became_active":"2023-12-24T18:37:31.725978+0000","last_became_peered":"2023-12-24T18:37:31.725978+0000","last_unstale":"2023-12-24T18:37:31.744677+0000","last_undegraded":"2023-12-24T18:37:31.744677+0000","last_fullsized":"2023-12-24T18:37:31.744677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:50.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759046+0000","last_change":"2023-12-24T18:37:31.748628+0000","last_active":"2023-12-24T18:37:31.759046+0000","last_peered":"2023-12-24T18:37:31.759046+0000","last_clean":"2023-12-24T18:37:31.759046+0000","last_became_active":"2023-12-24T18:37:31.748296+0000","last_became_peered":"2023-12-24T18:37:31.748296+0000","last_unstale":"2023-12-24T18:37:31.759046+0000","last_undegraded":"2023-12-24T18:37:31.759046+0000","last_fullsized":"2023-12-24T18:37:31.759046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.730151+0000","last_change":"2023-12-24T18:37:31.723544+0000","last_active":"2023-12-24T18:37:31.730151+0000","last_peered":"2023-12-24T18:37:31.730151+0000","last_clean":"2023-12-24T18:37:31.730151+0000","last_became_active":"2023-12-24T18:37:31.721450+0000","last_became_peered":"2023-12-24T18:37:31.721450+0000","last_unstale":"2023-12-24T18:37:31.730151+0000","last_undegraded":"2023-12-24T18:37:31.730151+0000","last_fullsized":"2023-12-24T18:37:31.730151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754221+0000","last_change":"2023-12-24T18:37:31.747279+0000","last_active":"2023-12-24T18:37:31.754221+0000","last_peered":"2023-12-24T18:37:31.754221+0000","last_clean":"2023-12-24T18:37:31.754221+0000","last_became_active":"2023-12-24T18:37:31.741625+0000","last_became_peered":"2023-12-24T18:37:31.741625+0000","last_unstale":"2023-12-24T18:37:31.754221+0000","last_undegraded":"2023-12-24T18:37:31.754221+0000","last_fullsized":"2023-12-24T18:37:31.754221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.737045+0000","last_change":"2023-12-24T18:37:31.735315+0000","last_active":"2023-12-24T18:37:31.737045+0000","last_peered":"2023-12-24T18:37:31.737045+0000","last_clean":"2023-12-24T18:37:31.737045+0000","last_became_active":"2023-12-24T18:37:31.735047+0000","last_became_peered":"2023-12-24T18:37:31.735047+0000","last_unstale":"2023-12-24T18:37:31.737045+0000","last_undegraded":"2023-12-24T18:37:31.737045+0000","last_fullsized":"2023-12-24T18:37:31.737045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744460+0000","last_change":"2023-12-24T18:37:31.736131+0000","last_active":"2023-12-24T18:37:31.744460+0000","last_peered":"2023-12-24T18:37:31.744460+0000","last_clean":"2023-12-24T18:37:31.744460+0000","last_became_active":"2023-12-24T18:37:31.735860+0000","last_became_peered":"2023-12-24T18:37:31.735860+0000","last_unstale":"2023-12-24T18:37:31.744460+0000","last_undegraded":"2023-12-24T18:37:31.744460+0000","last_fullsized":"2023-12-24T18:37:31.744460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:07.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758517+0000","last_change":"2023-12-24T18:37:31.751286+0000","last_active":"2023-12-24T18:37:31.758517+0000","last_peered":"2023-12-24T18:37:31.758517+0000","last_clean":"2023-12-24T18:37:31.758517+0000","last_became_active":"2023-12-24T18:37:31.750964+0000","last_became_peered":"2023-12-24T18:37:31.750964+0000","last_unstale":"2023-12-24T18:37:31.758517+0000","last_undegraded":"2023-12-24T18:37:31.758517+0000","last_fullsized":"2023-12-24T18:37:31.758517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744334+0000","last_change":"2023-12-24T18:37:31.727492+0000","last_active":"2023-12-24T18:37:31.744334+0000","last_peered":"2023-12-24T18:37:31.744334+0000","last_clean":"2023-12-24T18:37:31.744334+0000","last_became_active":"2023-12-24T18:37:31.726935+0000","last_became_peered":"2023-12-24T18:37:31.726935+0000","last_unstale":"2023-12-24T18:37:31.744334+0000","last_undegraded":"2023-12-24T18:37:31.744334+0000","last_fullsized":"2023-12-24T18:37:31.744334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:08.590150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752386+0000","last_change":"2023-12-24T18:37:31.742322+0000","last_active":"2023-12-24T18:37:31.752386+0000","last_peered":"2023-12-24T18:37:31.752386+0000","last_clean":"2023-12-24T18:37:31.752386+0000","last_became_active":"2023-12-24T18:37:31.739829+0000","last_became_peered":"2023-12-24T18:37:31.739829+0000","last_unstale":"2023-12-24T18:37:31.752386+0000","last_undegraded":"2023-12-24T18:37:31.752386+0000","last_fullsized":"2023-12-24T18:37:31.752386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750358+0000","last_change":"2023-12-24T18:37:31.731610+0000","last_active":"2023-12-24T18:37:31.750358+0000","last_peered":"2023-12-24T18:37:31.750358+0000","last_clean":"2023-12-24T18:37:31.750358+0000","last_became_active":"2023-12-24T18:37:31.731256+0000","last_became_peered":"2023-12-24T18:37:31.731256+0000","last_unstale":"2023-12-24T18:37:31.750358+0000","last_undegraded":"2023-12-24T18:37:31.750358+0000","last_fullsized":"2023-12-24T18:37:31.750358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:39.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744559+0000","last_change":"2023-12-24T18:37:31.733091+0000","last_active":"2023-12-24T18:37:31.744559+0000","last_peered":"2023-12-24T18:37:31.744559+0000","last_clean":"2023-12-24T18:37:31.744559+0000","last_became_active":"2023-12-24T18:37:31.732671+0000","last_became_peered":"2023-12-24T18:37:31.732671+0000","last_unstale":"2023-12-24T18:37:31.744559+0000","last_undegraded":"2023-12-24T18:37:31.744559+0000","last_fullsized":"2023-12-24T18:37:31.744559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:22.707804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750622+0000","last_change":"2023-12-24T18:37:31.745070+0000","last_active":"2023-12-24T18:37:31.750622+0000","last_peered":"2023-12-24T18:37:31.750622+0000","last_clean":"2023-12-24T18:37:31.750622+0000","last_became_active":"2023-12-24T18:37:31.744689+0000","last_became_peered":"2023-12-24T18:37:31.744689+0000","last_unstale":"2023-12-24T18:37:31.750622+0000","last_undegraded":"2023-12-24T18:37:31.750622+0000","last_fullsized":"2023-12-24T18:37:31.750622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.733104+0000","last_change":"2023-12-24T18:37:31.731375+0000","last_active":"2023-12-24T18:37:31.733104+0000","last_peered":"2023-12-24T18:37:31.733104+0000","last_clean":"2023-12-24T18:37:31.733104+0000","last_became_active":"2023-12-24T18:37:31.730403+0000","last_became_peered":"2023-12-24T18:37:31.730403+0000","last_unstale":"2023-12-24T18:37:31.733104+0000","last_undegraded":"2023-12-24T18:37:31.733104+0000","last_fullsized":"2023-12-24T18:37:31.733104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755707+0000","last_change":"2023-12-24T18:37:31.751225+0000","last_active":"2023-12-24T18:37:31.755707+0000","last_peered":"2023-12-24T18:37:31.755707+0000","last_clean":"2023-12-24T18:37:31.755707+0000","last_became_active":"2023-12-24T18:37:31.750936+0000","last_became_peered":"2023-12-24T18:37:31.750936+0000","last_unstale":"2023-12-24T18:37:31.755707+0000","last_undegraded":"2023-12-24T18:37:31.755707+0000","last_fullsized":"2023-12-24T18:37:31.755707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757582+0000","last_change":"2023-12-24T18:37:30.728730+0000","last_active":"2023-12-24T18:37:31.757582+0000","last_peered":"2023-12-24T18:37:31.757582+0000","last_clean":"2023-12-24T18:37:31.757582+0000","last_became_active":"2023-12-24T18:37:30.726464+0000","last_became_peered":"2023-12-24T18:37:30.726464+0000","last_unstale":"2023-12-24T18:37:31.757582+0000","last_undegraded":"2023-12-24T18:37:31.757582+0000","last_fullsized":"2023-12-24T18:37:31.757582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:52.325632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758679+0000","last_change":"2023-12-24T18:37:31.751442+0000","last_active":"2023-12-24T18:37:31.758679+0000","last_peered":"2023-12-24T18:37:31.758679+0000","last_clean":"2023-12-24T18:37:31.758679+0000","last_became_active":"2023-12-24T18:37:31.751127+0000","last_became_peered":"2023-12-24T18:37:31.751127+0000","last_unstale":"2023-12-24T18:37:31.758679+0000","last_undegraded":"2023-12-24T18:37:31.758679+0000","last_fullsized":"2023-12-24T18:37:31.758679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753217+0000","last_change":"2023-12-24T18:37:30.727612+0000","last_active":"2023-12-24T18:37:31.753217+0000","last_peered":"2023-12-24T18:37:31.753217+0000","last_clean":"2023-12-24T18:37:31.753217+0000","last_became_active":"2023-12-24T18:37:30.727347+0000","last_became_peered":"2023-12-24T18:37:30.727347+0000","last_unstale":"2023-12-24T18:37:31.753217+0000","last_undegraded":"2023-12-24T18:37:31.753217+0000","last_fullsized":"2023-12-24T18:37:31.753217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752818+0000","last_change":"2023-12-24T18:37:31.740893+0000","last_active":"2023-12-24T18:37:31.752818+0000","last_peered":"2023-12-24T18:37:31.752818+0000","last_clean":"2023-12-24T18:37:31.752818+0000","last_became_active":"2023-12-24T18:37:31.740598+0000","last_became_peered":"2023-12-24T18:37:31.740598+0000","last_unstale":"2023-12-24T18:37:31.752818+0000","last_undegraded":"2023-12-24T18:37:31.752818+0000","last_fullsized":"2023-12-24T18:37:31.752818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757451+0000","last_change":"2023-12-24T18:37:30.727891+0000","last_active":"2023-12-24T18:37:31.757451+0000","last_peered":"2023-12-24T18:37:31.757451+0000","last_clean":"2023-12-24T18:37:31.757451+0000","last_became_active":"2023-12-24T18:37:30.727617+0000","last_became_peered":"2023-12-24T18:37:30.727617+0000","last_unstale":"2023-12-24T18:37:31.757451+0000","last_undegraded":"2023-12-24T18:37:31.757451+0000","last_fullsized":"2023-12-24T18:37:31.757451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756143+0000","last_change":"2023-12-24T18:37:31.745035+0000","last_active":"2023-12-24T18:37:31.756143+0000","last_peered":"2023-12-24T18:37:31.756143+0000","last_clean":"2023-12-24T18:37:31.756143+0000","last_became_active":"2023-12-24T18:37:31.744733+0000","last_became_peered":"2023-12-24T18:37:31.744733+0000","last_unstale":"2023-12-24T18:37:31.756143+0000","last_undegraded":"2023-12-24T18:37:31.756143+0000","last_fullsized":"2023-12-24T18:37:31.756143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757181+0000","last_change":"2023-12-24T18:37:30.731349+0000","last_active":"2023-12-24T18:37:31.757181+0000","last_peered":"2023-12-24T18:37:31.757181+0000","last_clean":"2023-12-24T18:37:31.757181+0000","last_became_active":"2023-12-24T18:37:30.731042+0000","last_became_peered":"2023-12-24T18:37:30.731042+0000","last_unstale":"2023-12-24T18:37:31.757181+0000","last_undegraded":"2023-12-24T18:37:31.757181+0000","last_fullsized":"2023-12-24T18:37:31.757181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:40.637898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745888+0000","last_change":"2023-12-24T18:37:31.732981+0000","last_active":"2023-12-24T18:37:31.745888+0000","last_peered":"2023-12-24T18:37:31.745888+0000","last_clean":"2023-12-24T18:37:31.745888+0000","last_became_active":"2023-12-24T18:37:31.732678+0000","last_became_peered":"2023-12-24T18:37:31.732678+0000","last_unstale":"2023-12-24T18:37:31.745888+0000","last_undegraded":"2023-12-24T18:37:31.745888+0000","last_fullsized":"2023-12-24T18:37:31.745888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759382+0000","last_change":"2023-12-24T18:37:30.728304+0000","last_active":"2023-12-24T18:37:31.759382+0000","last_peered":"2023-12-24T18:37:31.759382+0000","last_clean":"2023-12-24T18:37:31.759382+0000","last_became_active":"2023-12-24T18:37:30.728019+0000","last_became_peered":"2023-12-24T18:37:30.728019+0000","last_unstale":"2023-12-24T18:37:31.759382+0000","last_undegraded":"2023-12-24T18:37:31.759382+0000","last_fullsized":"2023-12-24T18:37:31.759382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:25.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748634+0000","last_change":"2023-12-24T18:37:31.738664+0000","last_active":"2023-12-24T18:37:31.748634+0000","last_peered":"2023-12-24T18:37:31.748634+0000","last_clean":"2023-12-24T18:37:31.748634+0000","last_became_active":"2023-12-24T18:37:31.737710+0000","last_became_peered":"2023-12-24T18:37:31.737710+0000","last_unstale":"2023-12-24T18:37:31.748634+0000","last_undegraded":"2023-12-24T18:37:31.748634+0000","last_fullsized":"2023-12-24T18:37:31.748634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745790+0000","last_change":"2023-12-24T18:37:30.728843+0000","last_active":"2023-12-24T18:37:31.745790+0000","last_peered":"2023-12-24T18:37:31.745790+0000","last_clean":"2023-12-24T18:37:31.745790+0000","last_became_active":"2023-12-24T18:37:30.726797+0000","last_became_peered":"2023-12-24T18:37:30.726797+0000","last_unstale":"2023-12-24T18:37:31.745790+0000","last_undegraded":"2023-12-24T18:37:31.745790+0000","last_fullsized":"2023-12-24T18:37:31.745790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:21.680537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741352+0000","last_change":"2023-12-24T18:37:31.733957+0000","last_active":"2023-12-24T18:37:31.741352+0000","last_peered":"2023-12-24T18:37:31.741352+0000","last_clean":"2023-12-24T18:37:31.741352+0000","last_became_active":"2023-12-24T18:37:31.733461+0000","last_became_peered":"2023-12-24T18:37:31.733461+0000","last_unstale":"2023-12-24T18:37:31.741352+0000","last_undegraded":"2023-12-24T18:37:31.741352+0000","last_fullsized":"2023-12-24T18:37:31.741352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.728127+0000","last_change":"2023-12-24T18:37:30.735008+0000","last_active":"2023-12-24T18:37:31.728127+0000","last_peered":"2023-12-24T18:37:31.728127+0000","last_clean":"2023-12-24T18:37:31.728127+0000","last_became_active":"2023-12-24T18:37:30.734650+0000","last_became_peered":"2023-12-24T18:37:30.734650+0000","last_unstale":"2023-12-24T18:37:31.728127+0000","last_undegraded":"2023-12-24T18:37:31.728127+0000","last_fullsized":"2023-12-24T18:37:31.728127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753997+0000","last_change":"2023-12-24T18:37:31.739673+0000","last_active":"2023-12-24T18:37:31.753997+0000","last_peered":"2023-12-24T18:37:31.753997+0000","last_clean":"2023-12-24T18:37:31.753997+0000","last_became_active":"2023-12-24T18:37:31.739150+0000","last_became_peered":"2023-12-24T18:37:31.739150+0000","last_unstale":"2023-12-24T18:37:31.753997+0000","last_undegraded":"2023-12-24T18:37:31.753997+0000","last_fullsized":"2023-12-24T18:37:31.753997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714983+0000","last_change":"2023-12-24T18:37:30.717189+0000","last_active":"2023-12-24T18:37:31.714983+0000","last_peered":"2023-12-24T18:37:31.714983+0000","last_clean":"2023-12-24T18:37:31.714983+0000","last_became_active":"2023-12-24T18:37:30.716878+0000","last_became_peered":"2023-12-24T18:37:30.716878+0000","last_unstale":"2023-12-24T18:37:31.714983+0000","last_undegraded":"2023-12-24T18:37:31.714983+0000","last_fullsized":"2023-12-24T18:37:31.714983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729523+0000","last_change":"2023-12-24T18:37:31.725241+0000","last_active":"2023-12-24T18:37:31.729523+0000","last_peered":"2023-12-24T18:37:31.729523+0000","last_clean":"2023-12-24T18:37:31.729523+0000","last_became_active":"2023-12-24T18:37:31.724952+0000","last_became_peered":"2023-12-24T18:37:31.724952+0000","last_unstale":"2023-12-24T18:37:31.729523+0000","last_undegraded":"2023-12-24T18:37:31.729523+0000","last_fullsized":"2023-12-24T18:37:31.729523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735568+0000","last_change":"2023-12-24T18:37:30.730839+0000","last_active":"2023-12-24T18:37:31.735568+0000","last_peered":"2023-12-24T18:37:31.735568+0000","last_clean":"2023-12-24T18:37:31.735568+0000","last_became_active":"2023-12-24T18:37:30.730545+0000","last_became_peered":"2023-12-24T18:37:30.730545+0000","last_unstale":"2023-12-24T18:37:31.735568+0000","last_undegraded":"2023-12-24T18:37:31.735568+0000","last_fullsized":"2023-12-24T18:37:31.735568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:37.274253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756981+0000","last_change":"2023-12-24T18:37:31.746856+0000","last_active":"2023-12-24T18:37:31.756981+0000","last_peered":"2023-12-24T18:37:31.756981+0000","last_clean":"2023-12-24T18:37:31.756981+0000","last_became_active":"2023-12-24T18:37:31.746102+0000","last_became_peered":"2023-12-24T18:37:31.746102+0000","last_unstale":"2023-12-24T18:37:31.756981+0000","last_undegraded":"2023-12-24T18:37:31.756981+0000","last_fullsized":"2023-12-24T18:37:31.756981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.739377+0000","last_change":"2023-12-24T18:37:30.730860+0000","last_active":"2023-12-24T18:37:31.739377+0000","last_peered":"2023-12-24T18:37:31.739377+0000","last_clean":"2023-12-24T18:37:31.739377+0000","last_became_active":"2023-12-24T18:37:30.730578+0000","last_became_peered":"2023-12-24T18:37:30.730578+0000","last_unstale":"2023-12-24T18:37:31.739377+0000","last_undegraded":"2023-12-24T18:37:31.739377+0000","last_fullsized":"2023-12-24T18:37:31.739377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:04.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746288+0000","last_change":"2023-12-24T18:37:31.739973+0000","last_active":"2023-12-24T18:37:31.746288+0000","last_peered":"2023-12-24T18:37:31.746288+0000","last_clean":"2023-12-24T18:37:31.746288+0000","last_became_active":"2023-12-24T18:37:31.739700+0000","last_became_peered":"2023-12-24T18:37:31.739700+0000","last_unstale":"2023-12-24T18:37:31.746288+0000","last_undegraded":"2023-12-24T18:37:31.746288+0000","last_fullsized":"2023-12-24T18:37:31.746288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760325+0000","last_change":"2023-12-24T18:37:30.738678+0000","last_active":"2023-12-24T18:37:31.760325+0000","last_peered":"2023-12-24T18:37:31.760325+0000","last_clean":"2023-12-24T18:37:31.760325+0000","last_became_active":"2023-12-24T18:37:30.738355+0000","last_became_peered":"2023-12-24T18:37:30.738355+0000","last_unstale":"2023-12-24T18:37:31.760325+0000","last_undegraded":"2023-12-24T18:37:31.760325+0000","last_fullsized":"2023-12-24T18:37:31.760325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729663+0000","last_change":"2023-12-24T18:37:31.722588+0000","last_active":"2023-12-24T18:37:31.729663+0000","last_peered":"2023-12-24T18:37:31.729663+0000","last_clean":"2023-12-24T18:37:31.729663+0000","last_became_active":"2023-12-24T18:37:31.721787+0000","last_became_peered":"2023-12-24T18:37:31.721787+0000","last_unstale":"2023-12-24T18:37:31.729663+0000","last_undegraded":"2023-12-24T18:37:31.729663+0000","last_fullsized":"2023-12-24T18:37:31.729663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.763689+0000","last_change":"2023-12-24T18:37:30.729634+0000","last_active":"2023-12-24T18:37:31.763689+0000","last_peered":"2023-12-24T18:37:31.763689+0000","last_clean":"2023-12-24T18:37:31.763689+0000","last_became_active":"2023-12-24T18:37:30.729330+0000","last_became_peered":"2023-12-24T18:37:30.729330+0000","last_unstale":"2023-12-24T18:37:31.763689+0000","last_undegraded":"2023-12-24T18:37:31.763689+0000","last_fullsized":"2023-12-24T18:37:31.763689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:40.027111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756296+0000","last_change":"2023-12-24T18:37:31.748151+0000","last_active":"2023-12-24T18:37:31.756296+0000","last_peered":"2023-12-24T18:37:31.756296+0000","last_clean":"2023-12-24T18:37:31.756296+0000","last_became_active":"2023-12-24T18:37:31.747774+0000","last_became_peered":"2023-12-24T18:37:31.747774+0000","last_unstale":"2023-12-24T18:37:31.756296+0000","last_undegraded":"2023-12-24T18:37:31.756296+0000","last_fullsized":"2023-12-24T18:37:31.756296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759260+0000","last_change":"2023-12-24T18:37:30.732547+0000","last_active":"2023-12-24T18:37:31.759260+0000","last_peered":"2023-12-24T18:37:31.759260+0000","last_clean":"2023-12-24T18:37:31.759260+0000","last_became_active":"2023-12-24T18:37:30.732184+0000","last_became_peered":"2023-12-24T18:37:30.732184+0000","last_unstale":"2023-12-24T18:37:31.759260+0000","last_undegraded":"2023-12-24T18:37:31.759260+0000","last_fullsized":"2023-12-24T18:37:31.759260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756051+0000","last_change":"2023-12-24T18:37:31.744617+0000","last_active":"2023-12-24T18:37:31.756051+0000","last_peered":"2023-12-24T18:37:31.756051+0000","last_clean":"2023-12-24T18:37:31.756051+0000","last_became_active":"2023-12-24T18:37:31.744295+0000","last_became_peered":"2023-12-24T18:37:31.744295+0000","last_unstale":"2023-12-24T18:37:31.756051+0000","last_undegraded":"2023-12-24T18:37:31.756051+0000","last_fullsized":"2023-12-24T18:37:31.756051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727773+0000","last_change":"2023-12-24T18:37:30.735620+0000","last_active":"2023-12-24T18:37:31.727773+0000","last_peered":"2023-12-24T18:37:31.727773+0000","last_clean":"2023-12-24T18:37:31.727773+0000","last_became_active":"2023-12-24T18:37:30.735451+0000","last_became_peered":"2023-12-24T18:37:30.735451+0000","last_unstale":"2023-12-24T18:37:31.727773+0000","last_undegraded":"2023-12-24T18:37:31.727773+0000","last_fullsized":"2023-12-24T18:37:31.727773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746229+0000","last_change":"2023-12-24T18:37:31.735882+0000","last_active":"2023-12-24T18:37:31.746229+0000","last_peered":"2023-12-24T18:37:31.746229+0000","last_clean":"2023-12-24T18:37:31.746229+0000","last_became_active":"2023-12-24T18:37:31.735614+0000","last_became_peered":"2023-12-24T18:37:31.735614+0000","last_unstale":"2023-12-24T18:37:31.746229+0000","last_undegraded":"2023-12-24T18:37:31.746229+0000","last_fullsized":"2023-12-24T18:37:31.746229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.713786+0000","last_change":"2023-12-24T18:37:30.726811+0000","last_active":"2023-12-24T18:37:31.713786+0000","last_peered":"2023-12-24T18:37:31.713786+0000","last_clean":"2023-12-24T18:37:31.713786+0000","last_became_active":"2023-12-24T18:37:30.726263+0000","last_became_peered":"2023-12-24T18:37:30.726263+0000","last_unstale":"2023-12-24T18:37:31.713786+0000","last_undegraded":"2023-12-24T18:37:31.713786+0000","last_fullsized":"2023-12-24T18:37:31.713786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:46.186722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756472+0000","last_change":"2023-12-24T18:37:31.746171+0000","last_active":"2023-12-24T18:37:31.756472+0000","last_peered":"2023-12-24T18:37:31.756472+0000","last_clean":"2023-12-24T18:37:31.756472+0000","last_became_active":"2023-12-24T18:37:31.745822+0000","last_became_peered":"2023-12-24T18:37:31.745822+0000","last_unstale":"2023-12-24T18:37:31.756472+0000","last_undegraded":"2023-12-24T18:37:31.756472+0000","last_fullsized":"2023-12-24T18:37:31.756472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756433+0000","last_change":"2023-12-24T18:37:30.728398+0000","last_active":"2023-12-24T18:37:31.756433+0000","last_peered":"2023-12-24T18:37:31.756433+0000","last_clean":"2023-12-24T18:37:31.756433+0000","last_became_active":"2023-12-24T18:37:30.727322+0000","last_became_peered":"2023-12-24T18:37:30.727322+0000","last_unstale":"2023-12-24T18:37:31.756433+0000","last_undegraded":"2023-12-24T18:37:31.756433+0000","last_fullsized":"2023-12-24T18:37:31.756433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:19.257144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756297+0000","last_change":"2023-12-24T18:37:31.745515+0000","last_active":"2023-12-24T18:37:31.756297+0000","last_peered":"2023-12-24T18:37:31.756297+0000","last_clean":"2023-12-24T18:37:31.756297+0000","last_became_active":"2023-12-24T18:37:31.744837+0000","last_became_peered":"2023-12-24T18:37:31.744837+0000","last_unstale":"2023-12-24T18:37:31.756297+0000","last_undegraded":"2023-12-24T18:37:31.756297+0000","last_fullsized":"2023-12-24T18:37:31.756297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:48.463540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759619+0000","last_change":"2023-12-24T18:37:30.732278+0000","last_active":"2023-12-24T18:37:31.759619+0000","last_peered":"2023-12-24T18:37:31.759619+0000","last_clean":"2023-12-24T18:37:31.759619+0000","last_became_active":"2023-12-24T18:37:30.732011+0000","last_became_peered":"2023-12-24T18:37:30.732011+0000","last_unstale":"2023-12-24T18:37:31.759619+0000","last_undegraded":"2023-12-24T18:37:31.759619+0000","last_fullsized":"2023-12-24T18:37:31.759619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:44.816929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759113+0000","last_change":"2023-12-24T18:37:31.748990+0000","last_active":"2023-12-24T18:37:31.759113+0000","last_peered":"2023-12-24T18:37:31.759113+0000","last_clean":"2023-12-24T18:37:31.759113+0000","last_became_active":"2023-12-24T18:37:31.748643+0000","last_became_peered":"2023-12-24T18:37:31.748643+0000","last_unstale":"2023-12-24T18:37:31.759113+0000","last_undegraded":"2023-12-24T18:37:31.759113+0000","last_fullsized":"2023-12-24T18:37:31.759113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759965+0000","last_change":"2023-12-24T18:37:30.735290+0000","last_active":"2023-12-24T18:37:31.759965+0000","last_peered":"2023-12-24T18:37:31.759965+0000","last_clean":"2023-12-24T18:37:31.759965+0000","last_became_active":"2023-12-24T18:37:30.734943+0000","last_became_peered":"2023-12-24T18:37:30.734943+0000","last_unstale":"2023-12-24T18:37:31.759965+0000","last_undegraded":"2023-12-24T18:37:31.759965+0000","last_fullsized":"2023-12-24T18:37:31.759965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:04.492419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741050+0000","last_change":"2023-12-24T18:37:31.734048+0000","last_active":"2023-12-24T18:37:31.741050+0000","last_peered":"2023-12-24T18:37:31.741050+0000","last_clean":"2023-12-24T18:37:31.741050+0000","last_became_active":"2023-12-24T18:37:31.733643+0000","last_became_peered":"2023-12-24T18:37:31.733643+0000","last_unstale":"2023-12-24T18:37:31.741050+0000","last_undegraded":"2023-12-24T18:37:31.741050+0000","last_fullsized":"2023-12-24T18:37:31.741050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756984+0000","last_change":"2023-12-24T18:37:30.731578+0000","last_active":"2023-12-24T18:37:31.756984+0000","last_peered":"2023-12-24T18:37:31.756984+0000","last_clean":"2023-12-24T18:37:31.756984+0000","last_became_active":"2023-12-24T18:37:30.728684+0000","last_became_peered":"2023-12-24T18:37:30.728684+0000","last_unstale":"2023-12-24T18:37:31.756984+0000","last_undegraded":"2023-12-24T18:37:31.756984+0000","last_fullsized":"2023-12-24T18:37:31.756984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:21.694164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.736832+0000","last_change":"2023-12-24T18:37:31.734368+0000","last_active":"2023-12-24T18:37:31.736832+0000","last_peered":"2023-12-24T18:37:31.736832+0000","last_clean":"2023-12-24T18:37:31.736832+0000","last_became_active":"2023-12-24T18:37:31.734085+0000","last_became_peered":"2023-12-24T18:37:31.734085+0000","last_unstale":"2023-12-24T18:37:31.736832+0000","last_undegraded":"2023-12-24T18:37:31.736832+0000","last_fullsized":"2023-12-24T18:37:31.736832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727938+0000","last_change":"2023-12-24T18:37:30.731246+0000","last_active":"2023-12-24T18:37:31.727938+0000","last_peered":"2023-12-24T18:37:31.727938+0000","last_clean":"2023-12-24T18:37:31.727938+0000","last_became_active":"2023-12-24T18:37:30.728209+0000","last_became_peered":"2023-12-24T18:37:30.728209+0000","last_unstale":"2023-12-24T18:37:31.727938+0000","last_undegraded":"2023-12-24T18:37:31.727938+0000","last_fullsized":"2023-12-24T18:37:31.727938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754068+0000","last_change":"2023-12-24T18:37:31.748288+0000","last_active":"2023-12-24T18:37:31.754068+0000","last_peered":"2023-12-24T18:37:31.754068+0000","last_clean":"2023-12-24T18:37:31.754068+0000","last_became_active":"2023-12-24T18:37:31.747897+0000","last_became_peered":"2023-12-24T18:37:31.747897+0000","last_unstale":"2023-12-24T18:37:31.754068+0000","last_undegraded":"2023-12-24T18:37:31.754068+0000","last_fullsized":"2023-12-24T18:37:31.754068+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753437+0000","last_change":"2023-12-24T18:37:30.731842+0000","last_active":"2023-12-24T18:37:31.753437+0000","last_peered":"2023-12-24T18:37:31.753437+0000","last_clean":"2023-12-24T18:37:31.753437+0000","last_became_active":"2023-12-24T18:37:30.729568+0000","last_became_peered":"2023-12-24T18:37:30.729568+0000","last_unstale":"2023-12-24T18:37:31.753437+0000","last_undegraded":"2023-12-24T18:37:31.753437+0000","last_fullsized":"2023-12-24T18:37:31.753437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748609+0000","last_change":"2023-12-24T18:37:31.743072+0000","last_active":"2023-12-24T18:37:31.748609+0000","last_peered":"2023-12-24T18:37:31.748609+0000","last_clean":"2023-12-24T18:37:31.748609+0000","last_became_active":"2023-12-24T18:37:31.740550+0000","last_became_peered":"2023-12-24T18:37:31.740550+0000","last_unstale":"2023-12-24T18:37:31.748609+0000","last_undegraded":"2023-12-24T18:37:31.748609+0000","last_fullsized":"2023-12-24T18:37:31.748609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.711026+0000","last_change":"2023-12-24T18:37:30.718404+0000","last_active":"2023-12-24T18:37:31.711026+0000","last_peered":"2023-12-24T18:37:31.711026+0000","last_clean":"2023-12-24T18:37:31.711026+0000","last_became_active":"2023-12-24T18:37:30.717198+0000","last_became_peered":"2023-12-24T18:37:30.717198+0000","last_unstale":"2023-12-24T18:37:31.711026+0000","last_undegraded":"2023-12-24T18:37:31.711026+0000","last_fullsized":"2023-12-24T18:37:31.711026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759261+0000","last_change":"2023-12-24T18:37:31.751128+0000","last_active":"2023-12-24T18:37:31.759261+0000","last_peered":"2023-12-24T18:37:31.759261+0000","last_clean":"2023-12-24T18:37:31.759261+0000","last_became_active":"2023-12-24T18:37:31.750850+0000","last_became_peered":"2023-12-24T18:37:31.750850+0000","last_unstale":"2023-12-24T18:37:31.759261+0000","last_undegraded":"2023-12-24T18:37:31.759261+0000","last_fullsized":"2023-12-24T18:37:31.759261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:12:08.076035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720080+0000","last_change":"2023-12-24T18:37:30.730130+0000","last_active":"2023-12-24T18:37:31.720080+0000","last_peered":"2023-12-24T18:37:31.720080+0000","last_clean":"2023-12-24T18:37:31.720080+0000","last_became_active":"2023-12-24T18:37:30.729797+0000","last_became_peered":"2023-12-24T18:37:30.729797+0000","last_unstale":"2023-12-24T18:37:31.720080+0000","last_undegraded":"2023-12-24T18:37:31.720080+0000","last_fullsized":"2023-12-24T18:37:31.720080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753986+0000","last_change":"2023-12-24T18:37:31.739487+0000","last_active":"2023-12-24T18:37:31.753986+0000","last_peered":"2023-12-24T18:37:31.753986+0000","last_clean":"2023-12-24T18:37:31.753986+0000","last_became_active":"2023-12-24T18:37:31.738798+0000","last_became_peered":"2023-12-24T18:37:31.738798+0000","last_unstale":"2023-12-24T18:37:31.753986+0000","last_undegraded":"2023-12-24T18:37:31.753986+0000","last_fullsized":"2023-12-24T18:37:31.753986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.710807+0000","last_change":"2023-12-24T18:37:30.724562+0000","last_active":"2023-12-24T18:37:31.710807+0000","last_peered":"2023-12-24T18:37:31.710807+0000","last_clean":"2023-12-24T18:37:31.710807+0000","last_became_active":"2023-12-24T18:37:30.724228+0000","last_became_peered":"2023-12-24T18:37:30.724228+0000","last_unstale":"2023-12-24T18:37:31.710807+0000","last_undegraded":"2023-12-24T18:37:31.710807+0000","last_fullsized":"2023-12-24T18:37:31.710807+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:07.576510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752533+0000","last_change":"2023-12-24T18:37:31.750640+0000","last_active":"2023-12-24T18:37:31.752533+0000","last_peered":"2023-12-24T18:37:31.752533+0000","last_clean":"2023-12-24T18:37:31.752533+0000","last_became_active":"2023-12-24T18:37:31.749416+0000","last_became_peered":"2023-12-24T18:37:31.749416+0000","last_unstale":"2023-12-24T18:37:31.752533+0000","last_undegraded":"2023-12-24T18:37:31.752533+0000","last_fullsized":"2023-12-24T18:37:31.752533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760344+0000","last_change":"2023-12-24T18:37:30.729872+0000","last_active":"2023-12-24T18:37:31.760344+0000","last_peered":"2023-12-24T18:37:31.760344+0000","last_clean":"2023-12-24T18:37:31.760344+0000","last_became_active":"2023-12-24T18:37:30.729531+0000","last_became_peered":"2023-12-24T18:37:30.729531+0000","last_unstale":"2023-12-24T18:37:31.760344+0000","last_undegraded":"2023-12-24T18:37:31.760344+0000","last_fullsized":"2023-12-24T18:37:31.760344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:33.618179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757005+0000","last_change":"2023-12-24T18:37:31.749420+0000","last_active":"2023-12-24T18:37:31.757005+0000","last_peered":"2023-12-24T18:37:31.757005+0000","last_clean":"2023-12-24T18:37:31.757005+0000","last_became_active":"2023-12-24T18:37:31.749140+0000","last_became_peered":"2023-12-24T18:37:31.749140+0000","last_unstale":"2023-12-24T18:37:31.757005+0000","last_undegraded":"2023-12-24T18:37:31.757005+0000","last_fullsized":"2023-12-24T18:37:31.757005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-24T18:37:33.016354+0000","last_change":"2023-12-24T18:37:30.734975+0000","last_active":"2023-12-24T18:37:33.016354+0000","last_peered":"2023-12-24T18:37:33.016354+0000","last_clean":"2023-12-24T18:37:33.016354+0000","last_became_active":"2023-12-24T18:37:30.734594+0000","last_became_peered":"2023-12-24T18:37:30.734594+0000","last_unstale":"2023-12-24T18:37:33.016354+0000","last_undegraded":"2023-12-24T18:37:33.016354+0000","last_fullsized":"2023-12-24T18:37:33.016354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751421+0000","last_change":"2023-12-24T18:37:31.738479+0000","last_active":"2023-12-24T18:37:31.751421+0000","last_peered":"2023-12-24T18:37:31.751421+0000","last_clean":"2023-12-24T18:37:31.751421+0000","last_became_active":"2023-12-24T18:37:31.737977+0000","last_became_peered":"2023-12-24T18:37:31.737977+0000","last_unstale":"2023-12-24T18:37:31.751421+0000","last_undegraded":"2023-12-24T18:37:31.751421+0000","last_fullsized":"2023-12-24T18:37:31.751421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.724912+0000","last_change":"2023-12-24T18:37:30.726036+0000","last_active":"2023-12-24T18:37:31.724912+0000","last_peered":"2023-12-24T18:37:31.724912+0000","last_clean":"2023-12-24T18:37:31.724912+0000","last_became_active":"2023-12-24T18:37:30.725237+0000","last_became_peered":"2023-12-24T18:37:30.725237+0000","last_unstale":"2023-12-24T18:37:31.724912+0000","last_undegraded":"2023-12-24T18:37:31.724912+0000","last_fullsized":"2023-12-24T18:37:31.724912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745909+0000","last_change":"2023-12-24T18:37:31.734398+0000","last_active":"2023-12-24T18:37:31.745909+0000","last_peered":"2023-12-24T18:37:31.745909+0000","last_clean":"2023-12-24T18:37:31.745909+0000","last_became_active":"2023-12-24T18:37:31.734026+0000","last_became_peered":"2023-12-24T18:37:31.734026+0000","last_unstale":"2023-12-24T18:37:31.745909+0000","last_undegraded":"2023-12-24T18:37:31.745909+0000","last_fullsized":"2023-12-24T18:37:31.745909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720817+0000","last_change":"2023-12-24T18:37:30.724051+0000","last_active":"2023-12-24T18:37:31.720817+0000","last_peered":"2023-12-24T18:37:31.720817+0000","last_clean":"2023-12-24T18:37:31.720817+0000","last_became_active":"2023-12-24T18:37:30.723700+0000","last_became_peered":"2023-12-24T18:37:30.723700+0000","last_unstale":"2023-12-24T18:37:31.720817+0000","last_undegraded":"2023-12-24T18:37:31.720817+0000","last_fullsized":"2023-12-24T18:37:31.720817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749269+0000","last_change":"2023-12-24T18:37:31.746745+0000","last_active":"2023-12-24T18:37:31.749269+0000","last_peered":"2023-12-24T18:37:31.749269+0000","last_clean":"2023-12-24T18:37:31.749269+0000","last_became_active":"2023-12-24T18:37:31.745884+0000","last_became_peered":"2023-12-24T18:37:31.745884+0000","last_unstale":"2023-12-24T18:37:31.749269+0000","last_undegraded":"2023-12-24T18:37:31.749269+0000","last_fullsized":"2023-12-24T18:37:31.749269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714520+0000","last_change":"2023-12-24T18:37:30.727905+0000","last_active":"2023-12-24T18:37:31.714520+0000","last_peered":"2023-12-24T18:37:31.714520+0000","last_clean":"2023-12-24T18:37:31.714520+0000","last_became_active":"2023-12-24T18:37:30.727625+0000","last_became_peered":"2023-12-24T18:37:30.727625+0000","last_unstale":"2023-12-24T18:37:31.714520+0000","last_undegraded":"2023-12-24T18:37:31.714520+0000","last_fullsized":"2023-12-24T18:37:31.714520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:27.773140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741333+0000","last_change":"2023-12-24T18:37:31.733754+0000","last_active":"2023-12-24T18:37:31.741333+0000","last_peered":"2023-12-24T18:37:31.741333+0000","last_clean":"2023-12-24T18:37:31.741333+0000","last_became_active":"2023-12-24T18:37:31.733038+0000","last_became_peered":"2023-12-24T18:37:31.733038+0000","last_unstale":"2023-12-24T18:37:31.741333+0000","last_undegraded":"2023-12-24T18:37:31.741333+0000","last_fullsized":"2023-12-24T18:37:31.741333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714729+0000","last_change":"2023-12-24T18:37:30.731565+0000","last_active":"2023-12-24T18:37:31.714729+0000","last_peered":"2023-12-24T18:37:31.714729+0000","last_clean":"2023-12-24T18:37:31.714729+0000","last_became_active":"2023-12-24T18:37:30.731130+0000","last_became_peered":"2023-12-24T18:37:30.731130+0000","last_unstale":"2023-12-24T18:37:31.714729+0000","last_undegraded":"2023-12-24T18:37:31.714729+0000","last_fullsized":"2023-12-24T18:37:31.714729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:28.699835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757996+0000","last_change":"2023-12-24T18:37:31.754556+0000","last_active":"2023-12-24T18:37:31.757996+0000","last_peered":"2023-12-24T18:37:31.757996+0000","last_clean":"2023-12-24T18:37:31.757996+0000","last_became_active":"2023-12-24T18:37:31.754206+0000","last_became_peered":"2023-12-24T18:37:31.754206+0000","last_unstale":"2023-12-24T18:37:31.757996+0000","last_undegraded":"2023-12-24T18:37:31.757996+0000","last_fullsized":"2023-12-24T18:37:31.757996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.723058+0000","last_change":"2023-12-24T18:37:30.726320+0000","last_active":"2023-12-24T18:37:31.723058+0000","last_peered":"2023-12-24T18:37:31.723058+0000","last_clean":"2023-12-24T18:37:31.723058+0000","last_became_active":"2023-12-24T18:37:30.726072+0000","last_became_peered":"2023-12-24T18:37:30.726072+0000","last_unstale":"2023-12-24T18:37:31.723058+0000","last_undegraded":"2023-12-24T18:37:31.723058+0000","last_fullsized":"2023-12-24T18:37:31.723058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:22.575833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751167+0000","last_change":"2023-12-24T18:37:31.745356+0000","last_active":"2023-12-24T18:37:31.751167+0000","last_peered":"2023-12-24T18:37:31.751167+0000","last_clean":"2023-12-24T18:37:31.751167+0000","last_became_active":"2023-12-24T18:37:31.744975+0000","last_became_peered":"2023-12-24T18:37:31.744975+0000","last_unstale":"2023-12-24T18:37:31.751167+0000","last_undegraded":"2023-12-24T18:37:31.751167+0000","last_fullsized":"2023-12-24T18:37:31.751167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720854+0000","last_change":"2023-12-24T18:37:30.728172+0000","last_active":"2023-12-24T18:37:31.720854+0000","last_peered":"2023-12-24T18:37:31.720854+0000","last_clean":"2023-12-24T18:37:31.720854+0000","last_became_active":"2023-12-24T18:37:30.727872+0000","last_became_peered":"2023-12-24T18:37:30.727872+0000","last_unstale":"2023-12-24T18:37:31.720854+0000","last_undegraded":"2023-12-24T18:37:31.720854+0000","last_fullsized":"2023-12-24T18:37:31.720854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:52.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.722046+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:37:31.722046+0000","last_peered":"2023-12-24T18:37:31.722046+0000","last_clean":"2023-12-24T18:37:31.722046+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:37:31.722046+0000","last_undegraded":"2023-12-24T18:37:31.722046+0000","last_fullsized":"2023-12-24T18:37:31.722046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":787363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.004}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1910000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.389},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2390000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.879}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.347},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.103}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.026}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":195943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.335},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.262}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2130000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.056},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.0940000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.411}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.381},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.355}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.444}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.238},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.3859999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.339},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.417}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.593},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.367}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.5229999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.49}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.198},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5469999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.5},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4079999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1000000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.371}]},{"osd":3,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.26},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.595}]},{"osd":5,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.298},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.4670000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.573}]},{"osd":7,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":196959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.083}]},{"osd":1,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.71}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.488}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.411},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.895}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":2.1469999999999998},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.9430000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":2.1930000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":2.077}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.766},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":2.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.234},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.282}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.25},{"interface":"front","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":1.298}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":1.3380000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.149,"5min":4.149,"15min":4.149},"last":1.008},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.288}]},{"osd":3,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.403},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.268}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.351},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.1479999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.885,"5min":1.885,"15min":1.885},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":1.4630000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.923,"5min":1.923,"15min":1.923},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":1048576,"data_stored":785791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.748}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.623},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0629999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.296},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.016}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":1.038},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.24}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:37:40.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:37:41.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.001+0000 7f1846cf0700 1 Processor -- start 2023-12-24T18:37:41.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.001+0000 7f1846cf0700 1 -- start start 2023-12-24T18:37:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18400c6d00 0x7f18400c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1840154450 0x7f18401548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 0x7f184006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184006c820 con 0x7f1840154450 2023-12-24T18:37:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1840154de0 con 0x7f184006aca0 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1846cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184006b960 con 0x7f18400c6d00 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1840154450 0x7f18401548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1840154450 0x7f18401548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40502/0 (socket says 172.21.15.50:40502) 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 -- 172.21.15.50:0/3819573688 learned_addr learned my addr 172.21.15.50:0/3819573688 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1844a8c700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18400c6d00 0x7f18400c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f184528d700 1 --2- 172.21.15.50:0/3819573688 >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 0x7f184006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 -- 172.21.15.50:0/3819573688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18400c6d00 msgr2=0x7f18400c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18400c6d00 0x7f18400c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 -- 172.21.15.50:0/3819573688 >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 msgr2=0x7f184006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 --2- 172.21.15.50:0/3819573688 >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 0x7f184006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 -- 172.21.15.50:0/3819573688 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184006bc40 con 0x7f1840154450 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f184528d700 1 --2- 172.21.15.50:0/3819573688 >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 0x7f184006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f1837fff700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840154450 0x7f18401548a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18400c6480 tx=0x7f1830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957cbabd099f1683 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f18377fe700 1 -- 172.21.15.50:0/3819573688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830009e70 con 0x7f1840154450 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f18377fe700 1 -- 172.21.15.50:0/3819573688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000b860 con 0x7f1840154450 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.005+0000 7f18377fe700 1 -- 172.21.15.50:0/3819573688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000bc00 con 0x7f1840154450 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- 172.21.15.50:0/3819573688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840154450 msgr2=0x7f18401548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840154450 0x7f18401548a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18400c6480 tx=0x7f1830009250 comp rx=0 tx=0).stop 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- 172.21.15.50:0/3819573688 shutdown_connections 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3819573688 >> v2:172.21.15.82:3300/0 conn(0x7f184006aca0 0x7f184006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840154450 0x7f18401548a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3819573688 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18400c6d00 0x7f18400c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- 172.21.15.50:0/3819573688 >> 172.21.15.50:0/3819573688 conn(0x7f18400cbba0 msgr2=0x7f18400cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- 172.21.15.50:0/3819573688 shutdown_connections 2023-12-24T18:37:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- 172.21.15.50:0/3819573688 wait complete. 2023-12-24T18:37:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 Processor -- start 2023-12-24T18:37:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.009+0000 7f1846cf0700 1 -- start start 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18400c6d00 0x7f1840169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1840154450 0x7f184006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840167f00 con 0x7f184006aca0 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184016a350 con 0x7f18400c6d00 2023-12-24T18:37:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18400c5de0 con 0x7f1840154450 2023-12-24T18:37:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40508/0 (socket says 172.21.15.50:40508) 2023-12-24T18:37:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 -- 172.21.15.50:0/3988419970 learned_addr learned my addr 172.21.15.50:0/3988419970 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1837fff700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18400c6d00 0x7f1840169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f184528d700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1840154450 0x7f184006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 -- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1840154450 msgr2=0x7f184006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1840154450 0x7f184006cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 -- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18400c6d00 msgr2=0x7f1840169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18400c6d00 0x7f1840169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 -- 172.21.15.50:0/3988419970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300094f0 con 0x7f184006aca0 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1844a8c700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ec80 tx=0x7f183c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00c850 con 0x7f184006aca0 2023-12-24T18:37:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00c9d0 con 0x7f184006aca0 2023-12-24T18:37:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18400c51d0 con 0x7f184006aca0 2023-12-24T18:37:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cd90 con 0x7f184006aca0 2023-12-24T18:37:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.013+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18400c5790 con 0x7f184006aca0 2023-12-24T18:37:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.017+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18400652e0 con 0x7f184006aca0 2023-12-24T18:37:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.017+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f183c013680 con 0x7f184006aca0 2023-12-24T18:37:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.021+0000 7f1834ff9700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 0x7f182c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.021+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f183c07cce0 con 0x7f184006aca0 2023-12-24T18:37:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.021+0000 7f1837fff700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 0x7f182c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.021+0000 7f1837fff700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 0x7f182c062a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f18400c6480 tx=0x7f1830017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.029+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f183c04d0f0 con 0x7f184006aca0 2023-12-24T18:37:41.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.197+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f184006bf20 con 0x7f182c0605d0 2023-12-24T18:37:41.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.213+0000 7f1834ff9700 1 -- 172.21.15.50:0/3988419970 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285637 (secure 0 0 0) 0x7f184006bf20 con 0x7f182c0605d0 2023-12-24T18:37:41.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:41.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.221+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 msgr2=0x7f182c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.221+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 0x7f182c062a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f18400c6480 tx=0x7f1830017000 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.221+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 msgr2=0x7f18401679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ec80 tx=0x7f183c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 shutdown_connections 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f182c0605d0 0x7f182c062a80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1840154450 0x7f184006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18400c6d00 0x7f1840169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 --2- 172.21.15.50:0/3988419970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184006aca0 0x7f18401679c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 >> 172.21.15.50:0/3988419970 conn(0x7f18400cbba0 msgr2=0x7f18400add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 shutdown_connections 2023-12-24T18:37:41.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.225+0000 7f1846cf0700 1 -- 172.21.15.50:0/3988419970 wait complete. 2023-12-24T18:37:41.231 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:37:41.250 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-12-24T18:37:40.762891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399432,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575288,"statfs":{"total":773094113280,"available":770637094912,"internally_reserved":0,"allocated":4857856,"data_stored":2748460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.055777"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.740863+0000","last_change":"2023-12-24T18:37:31.735099+0000","last_active":"2023-12-24T18:37:31.740863+0000","last_peered":"2023-12-24T18:37:31.740863+0000","last_clean":"2023-12-24T18:37:31.740863+0000","last_became_active":"2023-12-24T18:37:31.734723+0000","last_became_peered":"2023-12-24T18:37:31.734723+0000","last_unstale":"2023-12-24T18:37:31.740863+0000","last_undegraded":"2023-12-24T18:37:31.740863+0000","last_fullsized":"2023-12-24T18:37:31.740863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:26:37.000606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751403+0000","last_change":"2023-12-24T18:37:31.738302+0000","last_active":"2023-12-24T18:37:31.751403+0000","last_peered":"2023-12-24T18:37:31.751403+0000","last_clean":"2023-12-24T18:37:31.751403+0000","last_became_active":"2023-12-24T18:37:31.737574+0000","last_became_peered":"2023-12-24T18:37:31.737574+0000","last_unstale":"2023-12-24T18:37:31.751403+0000","last_undegraded":"2023-12-24T18:37:31.751403+0000","last_fullsized":"2023-12-24T18:37:31.751403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758627+0000","last_change":"2023-12-24T18:37:31.748689+0000","last_active":"2023-12-24T18:37:31.758627+0000","last_peered":"2023-12-24T18:37:31.758627+0000","last_clean":"2023-12-24T18:37:31.758627+0000","last_became_active":"2023-12-24T18:37:31.748307+0000","last_became_peered":"2023-12-24T18:37:31.748307+0000","last_unstale":"2023-12-24T18:37:31.758627+0000","last_undegraded":"2023-12-24T18:37:31.758627+0000","last_fullsized":"2023-12-24T18:37:31.758627+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729494+0000","last_change":"2023-12-24T18:37:31.719827+0000","last_active":"2023-12-24T18:37:31.729494+0000","last_peered":"2023-12-24T18:37:31.729494+0000","last_clean":"2023-12-24T18:37:31.729494+0000","last_became_active":"2023-12-24T18:37:31.719481+0000","last_became_peered":"2023-12-24T18:37:31.719481+0000","last_unstale":"2023-12-24T18:37:31.729494+0000","last_undegraded":"2023-12-24T18:37:31.729494+0000","last_fullsized":"2023-12-24T18:37:31.729494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727308+0000","last_change":"2023-12-24T18:37:31.718181+0000","last_active":"2023-12-24T18:37:31.727308+0000","last_peered":"2023-12-24T18:37:31.727308+0000","last_clean":"2023-12-24T18:37:31.727308+0000","last_became_active":"2023-12-24T18:37:31.717789+0000","last_became_peered":"2023-12-24T18:37:31.717789+0000","last_unstale":"2023-12-24T18:37:31.727308+0000","last_undegraded":"2023-12-24T18:37:31.727308+0000","last_fullsized":"2023-12-24T18:37:31.727308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735502+0000","last_change":"2023-12-24T18:37:31.733299+0000","last_active":"2023-12-24T18:37:31.735502+0000","last_peered":"2023-12-24T18:37:31.735502+0000","last_clean":"2023-12-24T18:37:31.735502+0000","last_became_active":"2023-12-24T18:37:31.732993+0000","last_became_peered":"2023-12-24T18:37:31.732993+0000","last_unstale":"2023-12-24T18:37:31.735502+0000","last_undegraded":"2023-12-24T18:37:31.735502+0000","last_fullsized":"2023-12-24T18:37:31.735502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748682+0000","last_change":"2023-12-24T18:37:31.738868+0000","last_active":"2023-12-24T18:37:31.748682+0000","last_peered":"2023-12-24T18:37:31.748682+0000","last_clean":"2023-12-24T18:37:31.748682+0000","last_became_active":"2023-12-24T18:37:31.738542+0000","last_became_peered":"2023-12-24T18:37:31.738542+0000","last_unstale":"2023-12-24T18:37:31.748682+0000","last_undegraded":"2023-12-24T18:37:31.748682+0000","last_fullsized":"2023-12-24T18:37:31.748682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756599+0000","last_change":"2023-12-24T18:37:31.747918+0000","last_active":"2023-12-24T18:37:31.756599+0000","last_peered":"2023-12-24T18:37:31.756599+0000","last_clean":"2023-12-24T18:37:31.756599+0000","last_became_active":"2023-12-24T18:37:31.747604+0000","last_became_peered":"2023-12-24T18:37:31.747604+0000","last_unstale":"2023-12-24T18:37:31.756599+0000","last_undegraded":"2023-12-24T18:37:31.756599+0000","last_fullsized":"2023-12-24T18:37:31.756599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756246+0000","last_change":"2023-12-24T18:37:31.748140+0000","last_active":"2023-12-24T18:37:31.756246+0000","last_peered":"2023-12-24T18:37:31.756246+0000","last_clean":"2023-12-24T18:37:31.756246+0000","last_became_active":"2023-12-24T18:37:31.747786+0000","last_became_peered":"2023-12-24T18:37:31.747786+0000","last_unstale":"2023-12-24T18:37:31.756246+0000","last_undegraded":"2023-12-24T18:37:31.756246+0000","last_fullsized":"2023-12-24T18:37:31.756246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753481+0000","last_change":"2023-12-24T18:37:31.747089+0000","last_active":"2023-12-24T18:37:31.753481+0000","last_peered":"2023-12-24T18:37:31.753481+0000","last_clean":"2023-12-24T18:37:31.753481+0000","last_became_active":"2023-12-24T18:37:31.746748+0000","last_became_peered":"2023-12-24T18:37:31.746748+0000","last_unstale":"2023-12-24T18:37:31.753481+0000","last_undegraded":"2023-12-24T18:37:31.753481+0000","last_fullsized":"2023-12-24T18:37:31.753481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:46.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759092+0000","last_change":"2023-12-24T18:37:31.748895+0000","last_active":"2023-12-24T18:37:31.759092+0000","last_peered":"2023-12-24T18:37:31.759092+0000","last_clean":"2023-12-24T18:37:31.759092+0000","last_became_active":"2023-12-24T18:37:31.748572+0000","last_became_peered":"2023-12-24T18:37:31.748572+0000","last_unstale":"2023-12-24T18:37:31.759092+0000","last_undegraded":"2023-12-24T18:37:31.759092+0000","last_fullsized":"2023-12-24T18:37:31.759092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:21.259177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746248+0000","last_change":"2023-12-24T18:37:31.737885+0000","last_active":"2023-12-24T18:37:31.746248+0000","last_peered":"2023-12-24T18:37:31.746248+0000","last_clean":"2023-12-24T18:37:31.746248+0000","last_became_active":"2023-12-24T18:37:31.737322+0000","last_became_peered":"2023-12-24T18:37:31.737322+0000","last_unstale":"2023-12-24T18:37:31.746248+0000","last_undegraded":"2023-12-24T18:37:31.746248+0000","last_fullsized":"2023-12-24T18:37:31.746248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749615+0000","last_change":"2023-12-24T18:37:31.741041+0000","last_active":"2023-12-24T18:37:31.749615+0000","last_peered":"2023-12-24T18:37:31.749615+0000","last_clean":"2023-12-24T18:37:31.749615+0000","last_became_active":"2023-12-24T18:37:31.740330+0000","last_became_peered":"2023-12-24T18:37:31.740330+0000","last_unstale":"2023-12-24T18:37:31.749615+0000","last_undegraded":"2023-12-24T18:37:31.749615+0000","last_fullsized":"2023-12-24T18:37:31.749615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:51.310550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754446+0000","last_change":"2023-12-24T18:37:31.741214+0000","last_active":"2023-12-24T18:37:31.754446+0000","last_peered":"2023-12-24T18:37:31.754446+0000","last_clean":"2023-12-24T18:37:31.754446+0000","last_became_active":"2023-12-24T18:37:31.740517+0000","last_became_peered":"2023-12-24T18:37:31.740517+0000","last_unstale":"2023-12-24T18:37:31.754446+0000","last_undegraded":"2023-12-24T18:37:31.754446+0000","last_fullsized":"2023-12-24T18:37:31.754446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748653+0000","last_change":"2023-12-24T18:37:31.738831+0000","last_active":"2023-12-24T18:37:31.748653+0000","last_peered":"2023-12-24T18:37:31.748653+0000","last_clean":"2023-12-24T18:37:31.748653+0000","last_became_active":"2023-12-24T18:37:31.738336+0000","last_became_peered":"2023-12-24T18:37:31.738336+0000","last_unstale":"2023-12-24T18:37:31.748653+0000","last_undegraded":"2023-12-24T18:37:31.748653+0000","last_fullsized":"2023-12-24T18:37:31.748653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755829+0000","last_change":"2023-12-24T18:37:31.751422+0000","last_active":"2023-12-24T18:37:31.755829+0000","last_peered":"2023-12-24T18:37:31.755829+0000","last_clean":"2023-12-24T18:37:31.755829+0000","last_became_active":"2023-12-24T18:37:31.751075+0000","last_became_peered":"2023-12-24T18:37:31.751075+0000","last_unstale":"2023-12-24T18:37:31.755829+0000","last_undegraded":"2023-12-24T18:37:31.755829+0000","last_fullsized":"2023-12-24T18:37:31.755829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755749+0000","last_change":"2023-12-24T18:37:31.751226+0000","last_active":"2023-12-24T18:37:31.755749+0000","last_peered":"2023-12-24T18:37:31.755749+0000","last_clean":"2023-12-24T18:37:31.755749+0000","last_became_active":"2023-12-24T18:37:31.750989+0000","last_became_peered":"2023-12-24T18:37:31.750989+0000","last_unstale":"2023-12-24T18:37:31.755749+0000","last_undegraded":"2023-12-24T18:37:31.755749+0000","last_fullsized":"2023-12-24T18:37:31.755749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744496+0000","last_change":"2023-12-24T18:37:31.726685+0000","last_active":"2023-12-24T18:37:31.744496+0000","last_peered":"2023-12-24T18:37:31.744496+0000","last_clean":"2023-12-24T18:37:31.744496+0000","last_became_active":"2023-12-24T18:37:31.725408+0000","last_became_peered":"2023-12-24T18:37:31.725408+0000","last_unstale":"2023-12-24T18:37:31.744496+0000","last_undegraded":"2023-12-24T18:37:31.744496+0000","last_fullsized":"2023-12-24T18:37:31.744496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735746+0000","last_change":"2023-12-24T18:37:31.730722+0000","last_active":"2023-12-24T18:37:31.735746+0000","last_peered":"2023-12-24T18:37:31.735746+0000","last_clean":"2023-12-24T18:37:31.735746+0000","last_became_active":"2023-12-24T18:37:31.730281+0000","last_became_peered":"2023-12-24T18:37:31.730281+0000","last_unstale":"2023-12-24T18:37:31.735746+0000","last_undegraded":"2023-12-24T18:37:31.735746+0000","last_fullsized":"2023-12-24T18:37:31.735746+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744677+0000","last_change":"2023-12-24T18:37:31.726252+0000","last_active":"2023-12-24T18:37:31.744677+0000","last_peered":"2023-12-24T18:37:31.744677+0000","last_clean":"2023-12-24T18:37:31.744677+0000","last_became_active":"2023-12-24T18:37:31.725978+0000","last_became_peered":"2023-12-24T18:37:31.725978+0000","last_unstale":"2023-12-24T18:37:31.744677+0000","last_undegraded":"2023-12-24T18:37:31.744677+0000","last_fullsized":"2023-12-24T18:37:31.744677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:50.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759046+0000","last_change":"2023-12-24T18:37:31.748628+0000","last_active":"2023-12-24T18:37:31.759046+0000","last_peered":"2023-12-24T18:37:31.759046+0000","last_clean":"2023-12-24T18:37:31.759046+0000","last_became_active":"2023-12-24T18:37:31.748296+0000","last_became_peered":"2023-12-24T18:37:31.748296+0000","last_unstale":"2023-12-24T18:37:31.759046+0000","last_undegraded":"2023-12-24T18:37:31.759046+0000","last_fullsized":"2023-12-24T18:37:31.759046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.730151+0000","last_change":"2023-12-24T18:37:31.723544+0000","last_active":"2023-12-24T18:37:31.730151+0000","last_peered":"2023-12-24T18:37:31.730151+0000","last_clean":"2023-12-24T18:37:31.730151+0000","last_became_active":"2023-12-24T18:37:31.721450+0000","last_became_peered":"2023-12-24T18:37:31.721450+0000","last_unstale":"2023-12-24T18:37:31.730151+0000","last_undegraded":"2023-12-24T18:37:31.730151+0000","last_fullsized":"2023-12-24T18:37:31.730151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:57.555988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754221+0000","last_change":"2023-12-24T18:37:31.747279+0000","last_active":"2023-12-24T18:37:31.754221+0000","last_peered":"2023-12-24T18:37:31.754221+0000","last_clean":"2023-12-24T18:37:31.754221+0000","last_became_active":"2023-12-24T18:37:31.741625+0000","last_became_peered":"2023-12-24T18:37:31.741625+0000","last_unstale":"2023-12-24T18:37:31.754221+0000","last_undegraded":"2023-12-24T18:37:31.754221+0000","last_fullsized":"2023-12-24T18:37:31.754221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.737045+0000","last_change":"2023-12-24T18:37:31.735315+0000","last_active":"2023-12-24T18:37:31.737045+0000","last_peered":"2023-12-24T18:37:31.737045+0000","last_clean":"2023-12-24T18:37:31.737045+0000","last_became_active":"2023-12-24T18:37:31.735047+0000","last_became_peered":"2023-12-24T18:37:31.735047+0000","last_unstale":"2023-12-24T18:37:31.737045+0000","last_undegraded":"2023-12-24T18:37:31.737045+0000","last_fullsized":"2023-12-24T18:37:31.737045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744460+0000","last_change":"2023-12-24T18:37:31.736131+0000","last_active":"2023-12-24T18:37:31.744460+0000","last_peered":"2023-12-24T18:37:31.744460+0000","last_clean":"2023-12-24T18:37:31.744460+0000","last_became_active":"2023-12-24T18:37:31.735860+0000","last_became_peered":"2023-12-24T18:37:31.735860+0000","last_unstale":"2023-12-24T18:37:31.744460+0000","last_undegraded":"2023-12-24T18:37:31.744460+0000","last_fullsized":"2023-12-24T18:37:31.744460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:07.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758517+0000","last_change":"2023-12-24T18:37:31.751286+0000","last_active":"2023-12-24T18:37:31.758517+0000","last_peered":"2023-12-24T18:37:31.758517+0000","last_clean":"2023-12-24T18:37:31.758517+0000","last_became_active":"2023-12-24T18:37:31.750964+0000","last_became_peered":"2023-12-24T18:37:31.750964+0000","last_unstale":"2023-12-24T18:37:31.758517+0000","last_undegraded":"2023-12-24T18:37:31.758517+0000","last_fullsized":"2023-12-24T18:37:31.758517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744334+0000","last_change":"2023-12-24T18:37:31.727492+0000","last_active":"2023-12-24T18:37:31.744334+0000","last_peered":"2023-12-24T18:37:31.744334+0000","last_clean":"2023-12-24T18:37:31.744334+0000","last_became_active":"2023-12-24T18:37:31.726935+0000","last_became_peered":"2023-12-24T18:37:31.726935+0000","last_unstale":"2023-12-24T18:37:31.744334+0000","last_undegraded":"2023-12-24T18:37:31.744334+0000","last_fullsized":"2023-12-24T18:37:31.744334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:08.590150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752386+0000","last_change":"2023-12-24T18:37:31.742322+0000","last_active":"2023-12-24T18:37:31.752386+0000","last_peered":"2023-12-24T18:37:31.752386+0000","last_clean":"2023-12-24T18:37:31.752386+0000","last_became_active":"2023-12-24T18:37:31.739829+0000","last_became_peered":"2023-12-24T18:37:31.739829+0000","last_unstale":"2023-12-24T18:37:31.752386+0000","last_undegraded":"2023-12-24T18:37:31.752386+0000","last_fullsized":"2023-12-24T18:37:31.752386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750358+0000","last_change":"2023-12-24T18:37:31.731610+0000","last_active":"2023-12-24T18:37:31.750358+0000","last_peered":"2023-12-24T18:37:31.750358+0000","last_clean":"2023-12-24T18:37:31.750358+0000","last_became_active":"2023-12-24T18:37:31.731256+0000","last_became_peered":"2023-12-24T18:37:31.731256+0000","last_unstale":"2023-12-24T18:37:31.750358+0000","last_undegraded":"2023-12-24T18:37:31.750358+0000","last_fullsized":"2023-12-24T18:37:31.750358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:39.509418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.744559+0000","last_change":"2023-12-24T18:37:31.733091+0000","last_active":"2023-12-24T18:37:31.744559+0000","last_peered":"2023-12-24T18:37:31.744559+0000","last_clean":"2023-12-24T18:37:31.744559+0000","last_became_active":"2023-12-24T18:37:31.732671+0000","last_became_peered":"2023-12-24T18:37:31.732671+0000","last_unstale":"2023-12-24T18:37:31.744559+0000","last_undegraded":"2023-12-24T18:37:31.744559+0000","last_fullsized":"2023-12-24T18:37:31.744559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:22.707804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.750622+0000","last_change":"2023-12-24T18:37:31.745070+0000","last_active":"2023-12-24T18:37:31.750622+0000","last_peered":"2023-12-24T18:37:31.750622+0000","last_clean":"2023-12-24T18:37:31.750622+0000","last_became_active":"2023-12-24T18:37:31.744689+0000","last_became_peered":"2023-12-24T18:37:31.744689+0000","last_unstale":"2023-12-24T18:37:31.750622+0000","last_undegraded":"2023-12-24T18:37:31.750622+0000","last_fullsized":"2023-12-24T18:37:31.750622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:45.830569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.733104+0000","last_change":"2023-12-24T18:37:31.731375+0000","last_active":"2023-12-24T18:37:31.733104+0000","last_peered":"2023-12-24T18:37:31.733104+0000","last_clean":"2023-12-24T18:37:31.733104+0000","last_became_active":"2023-12-24T18:37:31.730403+0000","last_became_peered":"2023-12-24T18:37:31.730403+0000","last_unstale":"2023-12-24T18:37:31.733104+0000","last_undegraded":"2023-12-24T18:37:31.733104+0000","last_fullsized":"2023-12-24T18:37:31.733104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.755707+0000","last_change":"2023-12-24T18:37:31.751225+0000","last_active":"2023-12-24T18:37:31.755707+0000","last_peered":"2023-12-24T18:37:31.755707+0000","last_clean":"2023-12-24T18:37:31.755707+0000","last_became_active":"2023-12-24T18:37:31.750936+0000","last_became_peered":"2023-12-24T18:37:31.750936+0000","last_unstale":"2023-12-24T18:37:31.755707+0000","last_undegraded":"2023-12-24T18:37:31.755707+0000","last_fullsized":"2023-12-24T18:37:31.755707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757582+0000","last_change":"2023-12-24T18:37:30.728730+0000","last_active":"2023-12-24T18:37:31.757582+0000","last_peered":"2023-12-24T18:37:31.757582+0000","last_clean":"2023-12-24T18:37:31.757582+0000","last_became_active":"2023-12-24T18:37:30.726464+0000","last_became_peered":"2023-12-24T18:37:30.726464+0000","last_unstale":"2023-12-24T18:37:31.757582+0000","last_undegraded":"2023-12-24T18:37:31.757582+0000","last_fullsized":"2023-12-24T18:37:31.757582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:52.325632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.758679+0000","last_change":"2023-12-24T18:37:31.751442+0000","last_active":"2023-12-24T18:37:31.758679+0000","last_peered":"2023-12-24T18:37:31.758679+0000","last_clean":"2023-12-24T18:37:31.758679+0000","last_became_active":"2023-12-24T18:37:31.751127+0000","last_became_peered":"2023-12-24T18:37:31.751127+0000","last_unstale":"2023-12-24T18:37:31.758679+0000","last_undegraded":"2023-12-24T18:37:31.758679+0000","last_fullsized":"2023-12-24T18:37:31.758679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753217+0000","last_change":"2023-12-24T18:37:30.727612+0000","last_active":"2023-12-24T18:37:31.753217+0000","last_peered":"2023-12-24T18:37:31.753217+0000","last_clean":"2023-12-24T18:37:31.753217+0000","last_became_active":"2023-12-24T18:37:30.727347+0000","last_became_peered":"2023-12-24T18:37:30.727347+0000","last_unstale":"2023-12-24T18:37:31.753217+0000","last_undegraded":"2023-12-24T18:37:31.753217+0000","last_fullsized":"2023-12-24T18:37:31.753217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752818+0000","last_change":"2023-12-24T18:37:31.740893+0000","last_active":"2023-12-24T18:37:31.752818+0000","last_peered":"2023-12-24T18:37:31.752818+0000","last_clean":"2023-12-24T18:37:31.752818+0000","last_became_active":"2023-12-24T18:37:31.740598+0000","last_became_peered":"2023-12-24T18:37:31.740598+0000","last_unstale":"2023-12-24T18:37:31.752818+0000","last_undegraded":"2023-12-24T18:37:31.752818+0000","last_fullsized":"2023-12-24T18:37:31.752818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757451+0000","last_change":"2023-12-24T18:37:30.727891+0000","last_active":"2023-12-24T18:37:31.757451+0000","last_peered":"2023-12-24T18:37:31.757451+0000","last_clean":"2023-12-24T18:37:31.757451+0000","last_became_active":"2023-12-24T18:37:30.727617+0000","last_became_peered":"2023-12-24T18:37:30.727617+0000","last_unstale":"2023-12-24T18:37:31.757451+0000","last_undegraded":"2023-12-24T18:37:31.757451+0000","last_fullsized":"2023-12-24T18:37:31.757451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:42:49.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756143+0000","last_change":"2023-12-24T18:37:31.745035+0000","last_active":"2023-12-24T18:37:31.756143+0000","last_peered":"2023-12-24T18:37:31.756143+0000","last_clean":"2023-12-24T18:37:31.756143+0000","last_became_active":"2023-12-24T18:37:31.744733+0000","last_became_peered":"2023-12-24T18:37:31.744733+0000","last_unstale":"2023-12-24T18:37:31.756143+0000","last_undegraded":"2023-12-24T18:37:31.756143+0000","last_fullsized":"2023-12-24T18:37:31.756143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:29.009967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757181+0000","last_change":"2023-12-24T18:37:30.731349+0000","last_active":"2023-12-24T18:37:31.757181+0000","last_peered":"2023-12-24T18:37:31.757181+0000","last_clean":"2023-12-24T18:37:31.757181+0000","last_became_active":"2023-12-24T18:37:30.731042+0000","last_became_peered":"2023-12-24T18:37:30.731042+0000","last_unstale":"2023-12-24T18:37:31.757181+0000","last_undegraded":"2023-12-24T18:37:31.757181+0000","last_fullsized":"2023-12-24T18:37:31.757181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:40.637898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745888+0000","last_change":"2023-12-24T18:37:31.732981+0000","last_active":"2023-12-24T18:37:31.745888+0000","last_peered":"2023-12-24T18:37:31.745888+0000","last_clean":"2023-12-24T18:37:31.745888+0000","last_became_active":"2023-12-24T18:37:31.732678+0000","last_became_peered":"2023-12-24T18:37:31.732678+0000","last_unstale":"2023-12-24T18:37:31.745888+0000","last_undegraded":"2023-12-24T18:37:31.745888+0000","last_fullsized":"2023-12-24T18:37:31.745888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:38.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759382+0000","last_change":"2023-12-24T18:37:30.728304+0000","last_active":"2023-12-24T18:37:31.759382+0000","last_peered":"2023-12-24T18:37:31.759382+0000","last_clean":"2023-12-24T18:37:31.759382+0000","last_became_active":"2023-12-24T18:37:30.728019+0000","last_became_peered":"2023-12-24T18:37:30.728019+0000","last_unstale":"2023-12-24T18:37:31.759382+0000","last_undegraded":"2023-12-24T18:37:31.759382+0000","last_fullsized":"2023-12-24T18:37:31.759382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:25.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748634+0000","last_change":"2023-12-24T18:37:31.738664+0000","last_active":"2023-12-24T18:37:31.748634+0000","last_peered":"2023-12-24T18:37:31.748634+0000","last_clean":"2023-12-24T18:37:31.748634+0000","last_became_active":"2023-12-24T18:37:31.737710+0000","last_became_peered":"2023-12-24T18:37:31.737710+0000","last_unstale":"2023-12-24T18:37:31.748634+0000","last_undegraded":"2023-12-24T18:37:31.748634+0000","last_fullsized":"2023-12-24T18:37:31.748634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745790+0000","last_change":"2023-12-24T18:37:30.728843+0000","last_active":"2023-12-24T18:37:31.745790+0000","last_peered":"2023-12-24T18:37:31.745790+0000","last_clean":"2023-12-24T18:37:31.745790+0000","last_became_active":"2023-12-24T18:37:30.726797+0000","last_became_peered":"2023-12-24T18:37:30.726797+0000","last_unstale":"2023-12-24T18:37:31.745790+0000","last_undegraded":"2023-12-24T18:37:31.745790+0000","last_fullsized":"2023-12-24T18:37:31.745790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:21.680537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741352+0000","last_change":"2023-12-24T18:37:31.733957+0000","last_active":"2023-12-24T18:37:31.741352+0000","last_peered":"2023-12-24T18:37:31.741352+0000","last_clean":"2023-12-24T18:37:31.741352+0000","last_became_active":"2023-12-24T18:37:31.733461+0000","last_became_peered":"2023-12-24T18:37:31.733461+0000","last_unstale":"2023-12-24T18:37:31.741352+0000","last_undegraded":"2023-12-24T18:37:31.741352+0000","last_fullsized":"2023-12-24T18:37:31.741352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.728127+0000","last_change":"2023-12-24T18:37:30.735008+0000","last_active":"2023-12-24T18:37:31.728127+0000","last_peered":"2023-12-24T18:37:31.728127+0000","last_clean":"2023-12-24T18:37:31.728127+0000","last_became_active":"2023-12-24T18:37:30.734650+0000","last_became_peered":"2023-12-24T18:37:30.734650+0000","last_unstale":"2023-12-24T18:37:31.728127+0000","last_undegraded":"2023-12-24T18:37:31.728127+0000","last_fullsized":"2023-12-24T18:37:31.728127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753997+0000","last_change":"2023-12-24T18:37:31.739673+0000","last_active":"2023-12-24T18:37:31.753997+0000","last_peered":"2023-12-24T18:37:31.753997+0000","last_clean":"2023-12-24T18:37:31.753997+0000","last_became_active":"2023-12-24T18:37:31.739150+0000","last_became_peered":"2023-12-24T18:37:31.739150+0000","last_unstale":"2023-12-24T18:37:31.753997+0000","last_undegraded":"2023-12-24T18:37:31.753997+0000","last_fullsized":"2023-12-24T18:37:31.753997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714983+0000","last_change":"2023-12-24T18:37:30.717189+0000","last_active":"2023-12-24T18:37:31.714983+0000","last_peered":"2023-12-24T18:37:31.714983+0000","last_clean":"2023-12-24T18:37:31.714983+0000","last_became_active":"2023-12-24T18:37:30.716878+0000","last_became_peered":"2023-12-24T18:37:30.716878+0000","last_unstale":"2023-12-24T18:37:31.714983+0000","last_undegraded":"2023-12-24T18:37:31.714983+0000","last_fullsized":"2023-12-24T18:37:31.714983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729523+0000","last_change":"2023-12-24T18:37:31.725241+0000","last_active":"2023-12-24T18:37:31.729523+0000","last_peered":"2023-12-24T18:37:31.729523+0000","last_clean":"2023-12-24T18:37:31.729523+0000","last_became_active":"2023-12-24T18:37:31.724952+0000","last_became_peered":"2023-12-24T18:37:31.724952+0000","last_unstale":"2023-12-24T18:37:31.729523+0000","last_undegraded":"2023-12-24T18:37:31.729523+0000","last_fullsized":"2023-12-24T18:37:31.729523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.735568+0000","last_change":"2023-12-24T18:37:30.730839+0000","last_active":"2023-12-24T18:37:31.735568+0000","last_peered":"2023-12-24T18:37:31.735568+0000","last_clean":"2023-12-24T18:37:31.735568+0000","last_became_active":"2023-12-24T18:37:30.730545+0000","last_became_peered":"2023-12-24T18:37:30.730545+0000","last_unstale":"2023-12-24T18:37:31.735568+0000","last_undegraded":"2023-12-24T18:37:31.735568+0000","last_fullsized":"2023-12-24T18:37:31.735568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:01:37.274253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756981+0000","last_change":"2023-12-24T18:37:31.746856+0000","last_active":"2023-12-24T18:37:31.756981+0000","last_peered":"2023-12-24T18:37:31.756981+0000","last_clean":"2023-12-24T18:37:31.756981+0000","last_became_active":"2023-12-24T18:37:31.746102+0000","last_became_peered":"2023-12-24T18:37:31.746102+0000","last_unstale":"2023-12-24T18:37:31.756981+0000","last_undegraded":"2023-12-24T18:37:31.756981+0000","last_fullsized":"2023-12-24T18:37:31.756981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:04.746502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.739377+0000","last_change":"2023-12-24T18:37:30.730860+0000","last_active":"2023-12-24T18:37:31.739377+0000","last_peered":"2023-12-24T18:37:31.739377+0000","last_clean":"2023-12-24T18:37:31.739377+0000","last_became_active":"2023-12-24T18:37:30.730578+0000","last_became_peered":"2023-12-24T18:37:30.730578+0000","last_unstale":"2023-12-24T18:37:31.739377+0000","last_undegraded":"2023-12-24T18:37:31.739377+0000","last_fullsized":"2023-12-24T18:37:31.739377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:04.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746288+0000","last_change":"2023-12-24T18:37:31.739973+0000","last_active":"2023-12-24T18:37:31.746288+0000","last_peered":"2023-12-24T18:37:31.746288+0000","last_clean":"2023-12-24T18:37:31.746288+0000","last_became_active":"2023-12-24T18:37:31.739700+0000","last_became_peered":"2023-12-24T18:37:31.739700+0000","last_unstale":"2023-12-24T18:37:31.746288+0000","last_undegraded":"2023-12-24T18:37:31.746288+0000","last_fullsized":"2023-12-24T18:37:31.746288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760325+0000","last_change":"2023-12-24T18:37:30.738678+0000","last_active":"2023-12-24T18:37:31.760325+0000","last_peered":"2023-12-24T18:37:31.760325+0000","last_clean":"2023-12-24T18:37:31.760325+0000","last_became_active":"2023-12-24T18:37:30.738355+0000","last_became_peered":"2023-12-24T18:37:30.738355+0000","last_unstale":"2023-12-24T18:37:31.760325+0000","last_undegraded":"2023-12-24T18:37:31.760325+0000","last_fullsized":"2023-12-24T18:37:31.760325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.729663+0000","last_change":"2023-12-24T18:37:31.722588+0000","last_active":"2023-12-24T18:37:31.729663+0000","last_peered":"2023-12-24T18:37:31.729663+0000","last_clean":"2023-12-24T18:37:31.729663+0000","last_became_active":"2023-12-24T18:37:31.721787+0000","last_became_peered":"2023-12-24T18:37:31.721787+0000","last_unstale":"2023-12-24T18:37:31.729663+0000","last_undegraded":"2023-12-24T18:37:31.729663+0000","last_fullsized":"2023-12-24T18:37:31.729663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:41.040752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.763689+0000","last_change":"2023-12-24T18:37:30.729634+0000","last_active":"2023-12-24T18:37:31.763689+0000","last_peered":"2023-12-24T18:37:31.763689+0000","last_clean":"2023-12-24T18:37:31.763689+0000","last_became_active":"2023-12-24T18:37:30.729330+0000","last_became_peered":"2023-12-24T18:37:30.729330+0000","last_unstale":"2023-12-24T18:37:31.763689+0000","last_undegraded":"2023-12-24T18:37:31.763689+0000","last_fullsized":"2023-12-24T18:37:31.763689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:40.027111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756296+0000","last_change":"2023-12-24T18:37:31.748151+0000","last_active":"2023-12-24T18:37:31.756296+0000","last_peered":"2023-12-24T18:37:31.756296+0000","last_clean":"2023-12-24T18:37:31.756296+0000","last_became_active":"2023-12-24T18:37:31.747774+0000","last_became_peered":"2023-12-24T18:37:31.747774+0000","last_unstale":"2023-12-24T18:37:31.756296+0000","last_undegraded":"2023-12-24T18:37:31.756296+0000","last_fullsized":"2023-12-24T18:37:31.756296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:23.589473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759260+0000","last_change":"2023-12-24T18:37:30.732547+0000","last_active":"2023-12-24T18:37:31.759260+0000","last_peered":"2023-12-24T18:37:31.759260+0000","last_clean":"2023-12-24T18:37:31.759260+0000","last_became_active":"2023-12-24T18:37:30.732184+0000","last_became_peered":"2023-12-24T18:37:30.732184+0000","last_unstale":"2023-12-24T18:37:31.759260+0000","last_undegraded":"2023-12-24T18:37:31.759260+0000","last_fullsized":"2023-12-24T18:37:31.759260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:59.921647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756051+0000","last_change":"2023-12-24T18:37:31.744617+0000","last_active":"2023-12-24T18:37:31.756051+0000","last_peered":"2023-12-24T18:37:31.756051+0000","last_clean":"2023-12-24T18:37:31.756051+0000","last_became_active":"2023-12-24T18:37:31.744295+0000","last_became_peered":"2023-12-24T18:37:31.744295+0000","last_unstale":"2023-12-24T18:37:31.756051+0000","last_undegraded":"2023-12-24T18:37:31.756051+0000","last_fullsized":"2023-12-24T18:37:31.756051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:47:26.304205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727773+0000","last_change":"2023-12-24T18:37:30.735620+0000","last_active":"2023-12-24T18:37:31.727773+0000","last_peered":"2023-12-24T18:37:31.727773+0000","last_clean":"2023-12-24T18:37:31.727773+0000","last_became_active":"2023-12-24T18:37:30.735451+0000","last_became_peered":"2023-12-24T18:37:30.735451+0000","last_unstale":"2023-12-24T18:37:31.727773+0000","last_undegraded":"2023-12-24T18:37:31.727773+0000","last_fullsized":"2023-12-24T18:37:31.727773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.746229+0000","last_change":"2023-12-24T18:37:31.735882+0000","last_active":"2023-12-24T18:37:31.746229+0000","last_peered":"2023-12-24T18:37:31.746229+0000","last_clean":"2023-12-24T18:37:31.746229+0000","last_became_active":"2023-12-24T18:37:31.735614+0000","last_became_peered":"2023-12-24T18:37:31.735614+0000","last_unstale":"2023-12-24T18:37:31.746229+0000","last_undegraded":"2023-12-24T18:37:31.746229+0000","last_fullsized":"2023-12-24T18:37:31.746229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.713786+0000","last_change":"2023-12-24T18:37:30.726811+0000","last_active":"2023-12-24T18:37:31.713786+0000","last_peered":"2023-12-24T18:37:31.713786+0000","last_clean":"2023-12-24T18:37:31.713786+0000","last_became_active":"2023-12-24T18:37:30.726263+0000","last_became_peered":"2023-12-24T18:37:30.726263+0000","last_unstale":"2023-12-24T18:37:31.713786+0000","last_undegraded":"2023-12-24T18:37:31.713786+0000","last_fullsized":"2023-12-24T18:37:31.713786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:46.186722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756472+0000","last_change":"2023-12-24T18:37:31.746171+0000","last_active":"2023-12-24T18:37:31.756472+0000","last_peered":"2023-12-24T18:37:31.756472+0000","last_clean":"2023-12-24T18:37:31.756472+0000","last_became_active":"2023-12-24T18:37:31.745822+0000","last_became_peered":"2023-12-24T18:37:31.745822+0000","last_unstale":"2023-12-24T18:37:31.756472+0000","last_undegraded":"2023-12-24T18:37:31.756472+0000","last_fullsized":"2023-12-24T18:37:31.756472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:37.270637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756433+0000","last_change":"2023-12-24T18:37:30.728398+0000","last_active":"2023-12-24T18:37:31.756433+0000","last_peered":"2023-12-24T18:37:31.756433+0000","last_clean":"2023-12-24T18:37:31.756433+0000","last_became_active":"2023-12-24T18:37:30.727322+0000","last_became_peered":"2023-12-24T18:37:30.727322+0000","last_unstale":"2023-12-24T18:37:31.756433+0000","last_undegraded":"2023-12-24T18:37:31.756433+0000","last_fullsized":"2023-12-24T18:37:31.756433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:19.257144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756297+0000","last_change":"2023-12-24T18:37:31.745515+0000","last_active":"2023-12-24T18:37:31.756297+0000","last_peered":"2023-12-24T18:37:31.756297+0000","last_clean":"2023-12-24T18:37:31.756297+0000","last_became_active":"2023-12-24T18:37:31.744837+0000","last_became_peered":"2023-12-24T18:37:31.744837+0000","last_unstale":"2023-12-24T18:37:31.756297+0000","last_undegraded":"2023-12-24T18:37:31.756297+0000","last_fullsized":"2023-12-24T18:37:31.756297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:48.463540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759619+0000","last_change":"2023-12-24T18:37:30.732278+0000","last_active":"2023-12-24T18:37:31.759619+0000","last_peered":"2023-12-24T18:37:31.759619+0000","last_clean":"2023-12-24T18:37:31.759619+0000","last_became_active":"2023-12-24T18:37:30.732011+0000","last_became_peered":"2023-12-24T18:37:30.732011+0000","last_unstale":"2023-12-24T18:37:31.759619+0000","last_undegraded":"2023-12-24T18:37:31.759619+0000","last_fullsized":"2023-12-24T18:37:31.759619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:44.816929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759113+0000","last_change":"2023-12-24T18:37:31.748990+0000","last_active":"2023-12-24T18:37:31.759113+0000","last_peered":"2023-12-24T18:37:31.759113+0000","last_clean":"2023-12-24T18:37:31.759113+0000","last_became_active":"2023-12-24T18:37:31.748643+0000","last_became_peered":"2023-12-24T18:37:31.748643+0000","last_unstale":"2023-12-24T18:37:31.759113+0000","last_undegraded":"2023-12-24T18:37:31.759113+0000","last_fullsized":"2023-12-24T18:37:31.759113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:17.343004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759965+0000","last_change":"2023-12-24T18:37:30.735290+0000","last_active":"2023-12-24T18:37:31.759965+0000","last_peered":"2023-12-24T18:37:31.759965+0000","last_clean":"2023-12-24T18:37:31.759965+0000","last_became_active":"2023-12-24T18:37:30.734943+0000","last_became_peered":"2023-12-24T18:37:30.734943+0000","last_unstale":"2023-12-24T18:37:31.759965+0000","last_undegraded":"2023-12-24T18:37:31.759965+0000","last_fullsized":"2023-12-24T18:37:31.759965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:04.492419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741050+0000","last_change":"2023-12-24T18:37:31.734048+0000","last_active":"2023-12-24T18:37:31.741050+0000","last_peered":"2023-12-24T18:37:31.741050+0000","last_clean":"2023-12-24T18:37:31.741050+0000","last_became_active":"2023-12-24T18:37:31.733643+0000","last_became_peered":"2023-12-24T18:37:31.733643+0000","last_unstale":"2023-12-24T18:37:31.741050+0000","last_undegraded":"2023-12-24T18:37:31.741050+0000","last_fullsized":"2023-12-24T18:37:31.741050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:45.118128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.756984+0000","last_change":"2023-12-24T18:37:30.731578+0000","last_active":"2023-12-24T18:37:31.756984+0000","last_peered":"2023-12-24T18:37:31.756984+0000","last_clean":"2023-12-24T18:37:31.756984+0000","last_became_active":"2023-12-24T18:37:30.728684+0000","last_became_peered":"2023-12-24T18:37:30.728684+0000","last_unstale":"2023-12-24T18:37:31.756984+0000","last_undegraded":"2023-12-24T18:37:31.756984+0000","last_fullsized":"2023-12-24T18:37:31.756984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:21.694164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.736832+0000","last_change":"2023-12-24T18:37:31.734368+0000","last_active":"2023-12-24T18:37:31.736832+0000","last_peered":"2023-12-24T18:37:31.736832+0000","last_clean":"2023-12-24T18:37:31.736832+0000","last_became_active":"2023-12-24T18:37:31.734085+0000","last_became_peered":"2023-12-24T18:37:31.734085+0000","last_unstale":"2023-12-24T18:37:31.736832+0000","last_undegraded":"2023-12-24T18:37:31.736832+0000","last_fullsized":"2023-12-24T18:37:31.736832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.727938+0000","last_change":"2023-12-24T18:37:30.731246+0000","last_active":"2023-12-24T18:37:31.727938+0000","last_peered":"2023-12-24T18:37:31.727938+0000","last_clean":"2023-12-24T18:37:31.727938+0000","last_became_active":"2023-12-24T18:37:30.728209+0000","last_became_peered":"2023-12-24T18:37:30.728209+0000","last_unstale":"2023-12-24T18:37:31.727938+0000","last_undegraded":"2023-12-24T18:37:31.727938+0000","last_fullsized":"2023-12-24T18:37:31.727938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.754068+0000","last_change":"2023-12-24T18:37:31.748288+0000","last_active":"2023-12-24T18:37:31.754068+0000","last_peered":"2023-12-24T18:37:31.754068+0000","last_clean":"2023-12-24T18:37:31.754068+0000","last_became_active":"2023-12-24T18:37:31.747897+0000","last_became_peered":"2023-12-24T18:37:31.747897+0000","last_unstale":"2023-12-24T18:37:31.754068+0000","last_undegraded":"2023-12-24T18:37:31.754068+0000","last_fullsized":"2023-12-24T18:37:31.754068+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:26.353596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753437+0000","last_change":"2023-12-24T18:37:30.731842+0000","last_active":"2023-12-24T18:37:31.753437+0000","last_peered":"2023-12-24T18:37:31.753437+0000","last_clean":"2023-12-24T18:37:31.753437+0000","last_became_active":"2023-12-24T18:37:30.729568+0000","last_became_peered":"2023-12-24T18:37:30.729568+0000","last_unstale":"2023-12-24T18:37:31.753437+0000","last_undegraded":"2023-12-24T18:37:31.753437+0000","last_fullsized":"2023-12-24T18:37:31.753437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:38.495777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.748609+0000","last_change":"2023-12-24T18:37:31.743072+0000","last_active":"2023-12-24T18:37:31.748609+0000","last_peered":"2023-12-24T18:37:31.748609+0000","last_clean":"2023-12-24T18:37:31.748609+0000","last_became_active":"2023-12-24T18:37:31.740550+0000","last_became_peered":"2023-12-24T18:37:31.740550+0000","last_unstale":"2023-12-24T18:37:31.748609+0000","last_undegraded":"2023-12-24T18:37:31.748609+0000","last_fullsized":"2023-12-24T18:37:31.748609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:34.631819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.711026+0000","last_change":"2023-12-24T18:37:30.718404+0000","last_active":"2023-12-24T18:37:31.711026+0000","last_peered":"2023-12-24T18:37:31.711026+0000","last_clean":"2023-12-24T18:37:31.711026+0000","last_became_active":"2023-12-24T18:37:30.717198+0000","last_became_peered":"2023-12-24T18:37:30.717198+0000","last_unstale":"2023-12-24T18:37:31.711026+0000","last_undegraded":"2023-12-24T18:37:31.711026+0000","last_fullsized":"2023-12-24T18:37:31.711026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.759261+0000","last_change":"2023-12-24T18:37:31.751128+0000","last_active":"2023-12-24T18:37:31.759261+0000","last_peered":"2023-12-24T18:37:31.759261+0000","last_clean":"2023-12-24T18:37:31.759261+0000","last_became_active":"2023-12-24T18:37:31.750850+0000","last_became_peered":"2023-12-24T18:37:31.750850+0000","last_unstale":"2023-12-24T18:37:31.759261+0000","last_undegraded":"2023-12-24T18:37:31.759261+0000","last_fullsized":"2023-12-24T18:37:31.759261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:12:08.076035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720080+0000","last_change":"2023-12-24T18:37:30.730130+0000","last_active":"2023-12-24T18:37:31.720080+0000","last_peered":"2023-12-24T18:37:31.720080+0000","last_clean":"2023-12-24T18:37:31.720080+0000","last_became_active":"2023-12-24T18:37:30.729797+0000","last_became_peered":"2023-12-24T18:37:30.729797+0000","last_unstale":"2023-12-24T18:37:31.720080+0000","last_undegraded":"2023-12-24T18:37:31.720080+0000","last_fullsized":"2023-12-24T18:37:31.720080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:42:58.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.753986+0000","last_change":"2023-12-24T18:37:31.739487+0000","last_active":"2023-12-24T18:37:31.753986+0000","last_peered":"2023-12-24T18:37:31.753986+0000","last_clean":"2023-12-24T18:37:31.753986+0000","last_became_active":"2023-12-24T18:37:31.738798+0000","last_became_peered":"2023-12-24T18:37:31.738798+0000","last_unstale":"2023-12-24T18:37:31.753986+0000","last_undegraded":"2023-12-24T18:37:31.753986+0000","last_fullsized":"2023-12-24T18:37:31.753986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:08.960586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.710807+0000","last_change":"2023-12-24T18:37:30.724562+0000","last_active":"2023-12-24T18:37:31.710807+0000","last_peered":"2023-12-24T18:37:31.710807+0000","last_clean":"2023-12-24T18:37:31.710807+0000","last_became_active":"2023-12-24T18:37:30.724228+0000","last_became_peered":"2023-12-24T18:37:30.724228+0000","last_unstale":"2023-12-24T18:37:31.710807+0000","last_undegraded":"2023-12-24T18:37:31.710807+0000","last_fullsized":"2023-12-24T18:37:31.710807+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:07.576510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.752533+0000","last_change":"2023-12-24T18:37:31.750640+0000","last_active":"2023-12-24T18:37:31.752533+0000","last_peered":"2023-12-24T18:37:31.752533+0000","last_clean":"2023-12-24T18:37:31.752533+0000","last_became_active":"2023-12-24T18:37:31.749416+0000","last_became_peered":"2023-12-24T18:37:31.749416+0000","last_unstale":"2023-12-24T18:37:31.752533+0000","last_undegraded":"2023-12-24T18:37:31.752533+0000","last_fullsized":"2023-12-24T18:37:31.752533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:00.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.760344+0000","last_change":"2023-12-24T18:37:30.729872+0000","last_active":"2023-12-24T18:37:31.760344+0000","last_peered":"2023-12-24T18:37:31.760344+0000","last_clean":"2023-12-24T18:37:31.760344+0000","last_became_active":"2023-12-24T18:37:30.729531+0000","last_became_peered":"2023-12-24T18:37:30.729531+0000","last_unstale":"2023-12-24T18:37:31.760344+0000","last_undegraded":"2023-12-24T18:37:31.760344+0000","last_fullsized":"2023-12-24T18:37:31.760344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:33.618179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757005+0000","last_change":"2023-12-24T18:37:31.749420+0000","last_active":"2023-12-24T18:37:31.757005+0000","last_peered":"2023-12-24T18:37:31.757005+0000","last_clean":"2023-12-24T18:37:31.757005+0000","last_became_active":"2023-12-24T18:37:31.749140+0000","last_became_peered":"2023-12-24T18:37:31.749140+0000","last_unstale":"2023-12-24T18:37:31.757005+0000","last_undegraded":"2023-12-24T18:37:31.757005+0000","last_fullsized":"2023-12-24T18:37:31.757005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:29:39.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-24T18:37:33.016354+0000","last_change":"2023-12-24T18:37:30.734975+0000","last_active":"2023-12-24T18:37:33.016354+0000","last_peered":"2023-12-24T18:37:33.016354+0000","last_clean":"2023-12-24T18:37:33.016354+0000","last_became_active":"2023-12-24T18:37:30.734594+0000","last_became_peered":"2023-12-24T18:37:30.734594+0000","last_unstale":"2023-12-24T18:37:33.016354+0000","last_undegraded":"2023-12-24T18:37:33.016354+0000","last_fullsized":"2023-12-24T18:37:33.016354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:06.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751421+0000","last_change":"2023-12-24T18:37:31.738479+0000","last_active":"2023-12-24T18:37:31.751421+0000","last_peered":"2023-12-24T18:37:31.751421+0000","last_clean":"2023-12-24T18:37:31.751421+0000","last_became_active":"2023-12-24T18:37:31.737977+0000","last_became_peered":"2023-12-24T18:37:31.737977+0000","last_unstale":"2023-12-24T18:37:31.751421+0000","last_undegraded":"2023-12-24T18:37:31.751421+0000","last_fullsized":"2023-12-24T18:37:31.751421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:28.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.724912+0000","last_change":"2023-12-24T18:37:30.726036+0000","last_active":"2023-12-24T18:37:31.724912+0000","last_peered":"2023-12-24T18:37:31.724912+0000","last_clean":"2023-12-24T18:37:31.724912+0000","last_became_active":"2023-12-24T18:37:30.725237+0000","last_became_peered":"2023-12-24T18:37:30.725237+0000","last_unstale":"2023-12-24T18:37:31.724912+0000","last_undegraded":"2023-12-24T18:37:31.724912+0000","last_fullsized":"2023-12-24T18:37:31.724912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.745909+0000","last_change":"2023-12-24T18:37:31.734398+0000","last_active":"2023-12-24T18:37:31.745909+0000","last_peered":"2023-12-24T18:37:31.745909+0000","last_clean":"2023-12-24T18:37:31.745909+0000","last_became_active":"2023-12-24T18:37:31.734026+0000","last_became_peered":"2023-12-24T18:37:31.734026+0000","last_unstale":"2023-12-24T18:37:31.745909+0000","last_undegraded":"2023-12-24T18:37:31.745909+0000","last_fullsized":"2023-12-24T18:37:31.745909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:58.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720817+0000","last_change":"2023-12-24T18:37:30.724051+0000","last_active":"2023-12-24T18:37:31.720817+0000","last_peered":"2023-12-24T18:37:31.720817+0000","last_clean":"2023-12-24T18:37:31.720817+0000","last_became_active":"2023-12-24T18:37:30.723700+0000","last_became_peered":"2023-12-24T18:37:30.723700+0000","last_unstale":"2023-12-24T18:37:31.720817+0000","last_undegraded":"2023-12-24T18:37:31.720817+0000","last_fullsized":"2023-12-24T18:37:31.720817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:24.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.749269+0000","last_change":"2023-12-24T18:37:31.746745+0000","last_active":"2023-12-24T18:37:31.749269+0000","last_peered":"2023-12-24T18:37:31.749269+0000","last_clean":"2023-12-24T18:37:31.749269+0000","last_became_active":"2023-12-24T18:37:31.745884+0000","last_became_peered":"2023-12-24T18:37:31.745884+0000","last_unstale":"2023-12-24T18:37:31.749269+0000","last_undegraded":"2023-12-24T18:37:31.749269+0000","last_fullsized":"2023-12-24T18:37:31.749269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:05.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714520+0000","last_change":"2023-12-24T18:37:30.727905+0000","last_active":"2023-12-24T18:37:31.714520+0000","last_peered":"2023-12-24T18:37:31.714520+0000","last_clean":"2023-12-24T18:37:31.714520+0000","last_became_active":"2023-12-24T18:37:30.727625+0000","last_became_peered":"2023-12-24T18:37:30.727625+0000","last_unstale":"2023-12-24T18:37:31.714520+0000","last_undegraded":"2023-12-24T18:37:31.714520+0000","last_fullsized":"2023-12-24T18:37:31.714520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:27.773140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.741333+0000","last_change":"2023-12-24T18:37:31.733754+0000","last_active":"2023-12-24T18:37:31.741333+0000","last_peered":"2023-12-24T18:37:31.741333+0000","last_clean":"2023-12-24T18:37:31.741333+0000","last_became_active":"2023-12-24T18:37:31.733038+0000","last_became_peered":"2023-12-24T18:37:31.733038+0000","last_unstale":"2023-12-24T18:37:31.741333+0000","last_undegraded":"2023-12-24T18:37:31.741333+0000","last_fullsized":"2023-12-24T18:37:31.741333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:36.389567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.714729+0000","last_change":"2023-12-24T18:37:30.731565+0000","last_active":"2023-12-24T18:37:31.714729+0000","last_peered":"2023-12-24T18:37:31.714729+0000","last_clean":"2023-12-24T18:37:31.714729+0000","last_became_active":"2023-12-24T18:37:30.731130+0000","last_became_peered":"2023-12-24T18:37:30.731130+0000","last_unstale":"2023-12-24T18:37:31.714729+0000","last_undegraded":"2023-12-24T18:37:31.714729+0000","last_fullsized":"2023-12-24T18:37:31.714729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:28.699835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.757996+0000","last_change":"2023-12-24T18:37:31.754556+0000","last_active":"2023-12-24T18:37:31.757996+0000","last_peered":"2023-12-24T18:37:31.757996+0000","last_clean":"2023-12-24T18:37:31.757996+0000","last_became_active":"2023-12-24T18:37:31.754206+0000","last_became_peered":"2023-12-24T18:37:31.754206+0000","last_unstale":"2023-12-24T18:37:31.757996+0000","last_undegraded":"2023-12-24T18:37:31.757996+0000","last_fullsized":"2023-12-24T18:37:31.757996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:10:06.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.723058+0000","last_change":"2023-12-24T18:37:30.726320+0000","last_active":"2023-12-24T18:37:31.723058+0000","last_peered":"2023-12-24T18:37:31.723058+0000","last_clean":"2023-12-24T18:37:31.723058+0000","last_became_active":"2023-12-24T18:37:30.726072+0000","last_became_peered":"2023-12-24T18:37:30.726072+0000","last_unstale":"2023-12-24T18:37:31.723058+0000","last_undegraded":"2023-12-24T18:37:31.723058+0000","last_fullsized":"2023-12-24T18:37:31.723058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:22.575833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.751167+0000","last_change":"2023-12-24T18:37:31.745356+0000","last_active":"2023-12-24T18:37:31.751167+0000","last_peered":"2023-12-24T18:37:31.751167+0000","last_clean":"2023-12-24T18:37:31.751167+0000","last_became_active":"2023-12-24T18:37:31.744975+0000","last_became_peered":"2023-12-24T18:37:31.744975+0000","last_unstale":"2023-12-24T18:37:31.751167+0000","last_undegraded":"2023-12-24T18:37:31.751167+0000","last_fullsized":"2023-12-24T18:37:31.751167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:30.685106+0000","last_clean_scrub_stamp":"2023-12-24T18:37:30.685106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:22.515939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.720854+0000","last_change":"2023-12-24T18:37:30.728172+0000","last_active":"2023-12-24T18:37:31.720854+0000","last_peered":"2023-12-24T18:37:31.720854+0000","last_clean":"2023-12-24T18:37:31.720854+0000","last_became_active":"2023-12-24T18:37:30.727872+0000","last_became_peered":"2023-12-24T18:37:30.727872+0000","last_unstale":"2023-12-24T18:37:31.720854+0000","last_undegraded":"2023-12-24T18:37:31.720854+0000","last_fullsized":"2023-12-24T18:37:31.720854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:37:29.671466+0000","last_clean_scrub_stamp":"2023-12-24T18:37:29.671466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:52.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-24T18:37:31.722046+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:37:31.722046+0000","last_peered":"2023-12-24T18:37:31.722046+0000","last_clean":"2023-12-24T18:37:31.722046+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:37:31.722046+0000","last_undegraded":"2023-12-24T18:37:31.722046+0000","last_fullsized":"2023-12-24T18:37:31.722046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298324,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073516,"statfs":{"total":96636764160,"available":96331280384,"internally_reserved":0,"allocated":1060864,"data_stored":787363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.004}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1910000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.389},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2390000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.879}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.347},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.103}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.026}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":195943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.335},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.262}]},{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.2130000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.056},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.0940000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.411}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.381},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.355}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.444}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.238},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.3859999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.339},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.417}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.593},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.367}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.5229999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.49}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.198},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5469999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":195965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.5},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4079999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.1000000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.371}]},{"osd":3,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.26},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.595}]},{"osd":5,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.298},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.4670000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.573}]},{"osd":7,"last update":"Sun Dec 24 18:37:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":196959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.083}]},{"osd":1,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.71}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.488}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.411},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.895}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":2.1469999999999998},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.9430000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":2.1930000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":2.077}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.766},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":2.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.234},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.282}]},{"osd":6,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.25},{"interface":"front","average":{"1min":1.784,"5min":1.784,"15min":1.784},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":1.298}]},{"osd":7,"last update":"Sun Dec 24 18:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":1.3380000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":195479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.149,"5min":4.149,"15min":4.149},"last":1.008},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.288}]},{"osd":3,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.403},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.268}]},{"osd":4,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.351},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.1479999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.885,"5min":1.885,"15min":1.885},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":1.4630000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:37:16 2023","interfaces":[{"interface":"back","average":{"1min":1.923,"5min":1.923,"15min":1.923},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":1048576,"data_stored":785791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.748}]},{"osd":2,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.623},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0629999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.296},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.016}]},{"osd":7,"last update":"Sun Dec 24 18:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":1.038},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.24}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:37:41.255 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:37:41.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:37:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 Processor -- start 2023-12-24T18:37:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 -- start start 2023-12-24T18:37:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe48156ab0 0x7fbe48156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe480c8ee0 0x7fbe480adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4815b5a0 con 0x7fbe480adb50 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4815a990 con 0x7fbe480c8ee0 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe4759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4815ac70 con 0x7fbe48156ab0 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe3dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe480adb50 0x7fbe480c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46850/0 (socket says 172.21.15.50:46850) 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.465+0000 7fbe3dd9b700 1 -- 172.21.15.50:0/1366419687 learned_addr learned my addr 172.21.15.50:0/1366419687 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/1366419687 >> v2:172.21.15.82:3300/0 conn(0x7fbe480c8ee0 0x7fbe480adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4659c700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe48156ab0 0x7fbe48156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe45d9b700 1 -- 172.21.15.50:0/1366419687 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079826327 0 0) 0x7fbe4815b5a0 con 0x7fbe480adb50 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe45d9b700 1 -- 172.21.15.50:0/1366419687 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003570 con 0x7fbe480adb50 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 -- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe48156ab0 msgr2=0x7fbe48156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe48156ab0 0x7fbe48156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 -- 172.21.15.50:0/1366419687 >> v1:172.21.15.50:6789/0 conn(0x7fbe480adb50 legacy=0x7fbe480c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 -- 172.21.15.50:0/1366419687 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4815af50 con 0x7fbe480c8ee0 2023-12-24T18:37:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe480adf80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009e60 tx=0x7fbe40009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba22e001a6d02a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe45d9b700 1 -- 172.21.15.50:0/1366419687 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000e070 con 0x7fbe480c8ee0 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe45d9b700 1 -- 172.21.15.50:0/1366419687 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4000bab0 con 0x7fbe480c8ee0 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe45d9b700 1 -- 172.21.15.50:0/1366419687 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000be70 con 0x7fbe480c8ee0 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 -- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 msgr2=0x7fbe480adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe480adf80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009e60 tx=0x7fbe40009780 comp rx=0 tx=0).stop 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 -- 172.21.15.50:0/1366419687 shutdown_connections 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe480adf80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 --2- 172.21.15.50:0/1366419687 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe48156ab0 0x7fbe48156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 -- 172.21.15.50:0/1366419687 >> 172.21.15.50:0/1366419687 conn(0x7fbe48067250 msgr2=0x7fbe48067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 -- 172.21.15.50:0/1366419687 shutdown_connections 2023-12-24T18:37:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.469+0000 7fbe4759e700 1 -- 172.21.15.50:0/1366419687 wait complete. 2023-12-24T18:37:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 Processor -- start 2023-12-24T18:37:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 -- start start 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe480adb50 0x7fbe481590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe4816cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c5aa0 con 0x7fbe48156ab0 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480af7a0 con 0x7fbe480c8ee0 2023-12-24T18:37:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481583b0 con 0x7fbe480adb50 2023-12-24T18:37:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40510/0 (socket says 172.21.15.50:40510) 2023-12-24T18:37:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 -- 172.21.15.50:0/725980072 learned_addr learned my addr 172.21.15.50:0/725980072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe4659c700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe480adb50 0x7fbe481590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe3dd9b700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe4816cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 -- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe480adb50 msgr2=0x7fbe481590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe480adb50 0x7fbe481590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 -- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 msgr2=0x7fbe4816cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe4816cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.473+0000 7fbe46d9d700 1 -- 172.21.15.50:0/725980072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40009a20 con 0x7fbe48156ab0 2023-12-24T18:37:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe46d9d700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe40013000 tx=0x7fbe40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40012e50 con 0x7fbe48156ab0 2023-12-24T18:37:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40027470 con 0x7fbe48156ab0 2023-12-24T18:37:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40027830 con 0x7fbe48156ab0 2023-12-24T18:37:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48158c10 con 0x7fbe48156ab0 2023-12-24T18:37:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe481588a0 con 0x7fbe48156ab0 2023-12-24T18:37:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.477+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe48158da0 con 0x7fbe48156ab0 2023-12-24T18:37:41.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.481+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbe40024070 con 0x7fbe48156ab0 2023-12-24T18:37:41.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.481+0000 7fbe3effd700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 0x7fbe28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.481+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fbe4007f080 con 0x7fbe48156ab0 2023-12-24T18:37:41.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.481+0000 7fbe4659c700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 0x7fbe28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.481+0000 7fbe4659c700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 0x7fbe28062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe48170d10 tx=0x7fbe380091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.489+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe400aebe0 con 0x7fbe48156ab0 2023-12-24T18:37:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.721+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbe4815b230 con 0x7fbe48156ab0 2023-12-24T18:37:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.729+0000 7fbe3effd700 1 -- 172.21.15.50:0/725980072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbe4002c020 con 0x7fbe48156ab0 2023-12-24T18:37:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 msgr2=0x7fbe28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 0x7fbe28062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe48170d10 tx=0x7fbe380091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 msgr2=0x7fbe48152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe40013000 tx=0x7fbe40019000 comp rx=0 tx=0).stop 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 shutdown_connections 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbe28060550 0x7fbe28062a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe48156ab0 0x7fbe48152bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe480c8ee0 0x7fbe4816cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 --2- 172.21.15.50:0/725980072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe480adb50 0x7fbe481590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 >> 172.21.15.50:0/725980072 conn(0x7fbe48067250 msgr2=0x7fbe481520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 shutdown_connections 2023-12-24T18:37:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.733+0000 7fbe4759e700 1 -- 172.21.15.50:0/725980072 wait complete. 2023-12-24T18:37:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:37:41.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:37:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 Processor -- start 2023-12-24T18:37:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 -- start start 2023-12-24T18:37:41.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd34015a2d0 0x7fd3400ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400b0460 con 0x7fd34006c820 2023-12-24T18:37:41.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34006d8c0 con 0x7fd34015a2d0 2023-12-24T18:37:41.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.925+0000 7fd346616700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400afc60 con 0x7fd3400ade60 2023-12-24T18:37:41.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd34015a2d0 0x7fd3400ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd34015a2d0 0x7fd3400ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40512/0 (socket says 172.21.15.50:40512) 2023-12-24T18:37:41.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 -- 172.21.15.50:0/3727060603 learned_addr learned my addr 172.21.15.50:0/3727060603 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:41.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd344e13700 1 --1- 172.21.15.50:0/3727060603 >> v1:172.21.15.82:6789/0 conn(0x7fd34006c820 0x7fd3400ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:39058/0 (socket says 172.21.15.50:39058) 2023-12-24T18:37:41.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345e15700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 -- 172.21.15.50:0/3727060603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 msgr2=0x7fd340160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 -- 172.21.15.50:0/3727060603 >> v1:172.21.15.82:6789/0 conn(0x7fd34006c820 legacy=0x7fd3400ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 -- 172.21.15.50:0/3727060603 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34006a5c0 con 0x7fd34015a2d0 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd345614700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3400ae8b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0099b0 tx=0x7fd33c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93448f58272dda0a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd337fff700 1 -- 172.21.15.50:0/3727060603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c009ea0 con 0x7fd34015a2d0 2023-12-24T18:37:41.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd337fff700 1 -- 172.21.15.50:0/3727060603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00b860 con 0x7fd34015a2d0 2023-12-24T18:37:41.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd337fff700 1 -- 172.21.15.50:0/3727060603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00bc00 con 0x7fd34015a2d0 2023-12-24T18:37:41.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 -- 172.21.15.50:0/3727060603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 msgr2=0x7fd3400ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3400ae8b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0099b0 tx=0x7fd33c009250 comp rx=0 tx=0).stop 2023-12-24T18:37:41.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 -- 172.21.15.50:0/3727060603 shutdown_connections 2023-12-24T18:37:41.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 --2- 172.21.15.50:0/3727060603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3400ae8b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.929+0000 7fd346616700 1 -- 172.21.15.50:0/3727060603 >> 172.21.15.50:0/3727060603 conn(0x7fd340067b80 msgr2=0x7fd3400cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.933+0000 7fd346616700 1 -- 172.21.15.50:0/3727060603 shutdown_connections 2023-12-24T18:37:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.933+0000 7fd346616700 1 -- 172.21.15.50:0/3727060603 wait complete. 2023-12-24T18:37:41.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.933+0000 7fd346616700 1 Processor -- start 2023-12-24T18:37:41.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.933+0000 7fd346616700 1 -- start start 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34006c820 0x7fd340151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340169560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400ca340 con 0x7fd34015a2d0 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd340154290 con 0x7fd34006c820 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd346616700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3401521f0 con 0x7fd3400ade60 2023-12-24T18:37:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40524/0 (socket says 172.21.15.50:40524) 2023-12-24T18:37:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 -- 172.21.15.50:0/2607424399 learned_addr learned my addr 172.21.15.50:0/2607424399 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345614700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34006c820 0x7fd340151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd344e13700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 -- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 msgr2=0x7fd340169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 -- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34006c820 msgr2=0x7fd340151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34006c820 0x7fd340151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 -- 172.21.15.50:0/2607424399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0094f0 con 0x7fd34015a2d0 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.937+0000 7fd345e15700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd338009f20 tx=0x7fd33800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800cb70 con 0x7fd34015a2d0 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33800f040 con 0x7fd34015a2d0 2023-12-24T18:37:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3400ab4f0 con 0x7fd34015a2d0 2023-12-24T18:37:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338014480 con 0x7fd34015a2d0 2023-12-24T18:37:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3400c9cf0 con 0x7fd34015a2d0 2023-12-24T18:37:41.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.941+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34004be40 con 0x7fd34015a2d0 2023-12-24T18:37:41.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.945+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd338014830 con 0x7fd34015a2d0 2023-12-24T18:37:41.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.945+0000 7fd3357fa700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 0x7fd324062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:41.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.945+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fd33807d5d0 con 0x7fd34015a2d0 2023-12-24T18:37:41.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.945+0000 7fd345614700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 0x7fd324062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:41.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.945+0000 7fd345614700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 0x7fd324062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0099b0 tx=0x7fd33c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:41.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:41.953+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd33804d9e0 con 0x7fd34015a2d0 2023-12-24T18:37:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.157+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3401573a0 con 0x7fd34015a2d0 2023-12-24T18:37:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.157+0000 7fd3357fa700 1 -- 172.21.15.50:0/2607424399 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fd338051000 con 0x7fd34015a2d0 2023-12-24T18:37:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:37:42.163 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:37:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 msgr2=0x7fd324062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 0x7fd324062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0099b0 tx=0x7fd33c017000 comp rx=0 tx=0).stop 2023-12-24T18:37:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 msgr2=0x7fd3401536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd338009f20 tx=0x7fd33800b040 comp rx=0 tx=0).stop 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 shutdown_connections 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd324060550 0x7fd324062a00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd34015a2d0 0x7fd3401536f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd3400ade60 0x7fd340169560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 --2- 172.21.15.50:0/2607424399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34006c820 0x7fd340151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 >> 172.21.15.50:0/2607424399 conn(0x7fd340067b80 msgr2=0x7fd3400a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 shutdown_connections 2023-12-24T18:37:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.161+0000 7fd346616700 1 -- 172.21.15.50:0/2607424399 wait complete. 2023-12-24T18:37:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:37:42.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:37:31.150863+0000', 'modified': '2023-12-24T18:37:34.742125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5077}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5077': {'gid': 5077, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6834/168523974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6833', 'nonce': 168523974}, {'type': 'v1', 'addr': '172.21.15.82:6834', 'nonce': 168523974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:37:42.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:37:42.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-24T18:37:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 Processor -- start 2023-12-24T18:37:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 -- start start 2023-12-24T18:37:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24780b4740 0x7f2478161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247815e290 con 0x7f24780b4370 2023-12-24T18:37:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247815da30 con 0x7f24780b4740 2023-12-24T18:37:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247ffc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478161ab0 con 0x7f24780b22b0 2023-12-24T18:37:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.761+0000 7f247dd61700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24780b4370 0x7f24780b1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46858/0 (socket says 172.21.15.50:46858) 2023-12-24T18:37:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247dd61700 1 -- 172.21.15.50:0/2848887106 learned_addr learned my addr 172.21.15.50:0/2848887106 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 --2- 172.21.15.50:0/2848887106 >> v2:172.21.15.82:3300/0 conn(0x7f24780b4740 0x7f2478161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247e562700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247cd5f700 1 -- 172.21.15.50:0/2848887106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649094026 0 0) 0x7f247815e290 con 0x7f24780b4370 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 -- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 msgr2=0x7f2478161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 -- 172.21.15.50:0/2848887106 >> v1:172.21.15.50:6789/0 conn(0x7f24780b4370 legacy=0x7f24780b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 -- 172.21.15.50:0/2848887106 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478161d60 con 0x7f24780b4740 2023-12-24T18:37:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247d560700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4740 0x7f2478161030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24680098e0 tx=0x7f24680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753257c0a3769f9a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247cd5f700 1 -- 172.21.15.50:0/2848887106 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246800b640 con 0x7f24780b4740 2023-12-24T18:37:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247cd5f700 1 -- 172.21.15.50:0/2848887106 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246800b7a0 con 0x7f24780b4740 2023-12-24T18:37:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247cd5f700 1 -- 172.21.15.50:0/2848887106 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246800bb40 con 0x7f24780b4740 2023-12-24T18:37:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 -- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4740 msgr2=0x7f2478161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4740 0x7f2478161030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24680098e0 tx=0x7f24680091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 -- 172.21.15.50:0/2848887106 shutdown_connections 2023-12-24T18:37:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 --2- 172.21.15.50:0/2848887106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4740 0x7f2478161030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 -- 172.21.15.50:0/2848887106 >> 172.21.15.50:0/2848887106 conn(0x7f24780670b0 msgr2=0x7f24780674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 -- 172.21.15.50:0/2848887106 shutdown_connections 2023-12-24T18:37:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.765+0000 7f247ffc5700 1 -- 172.21.15.50:0/2848887106 wait complete. 2023-12-24T18:37:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.769+0000 7f247ffc5700 1 Processor -- start 2023-12-24T18:37:42.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.769+0000 7f247ffc5700 1 -- start start 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478088340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4370 0x7f2478089670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478089bb0 con 0x7f24780b4740 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478152fd0 con 0x7f24780b4370 2023-12-24T18:37:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478089de0 con 0x7f24780b22b0 2023-12-24T18:37:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40536/0 (socket says 172.21.15.50:40536) 2023-12-24T18:37:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 -- 172.21.15.50:0/1212185783 learned_addr learned my addr 172.21.15.50:0/1212185783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247dd61700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478088340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247d560700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4370 0x7f2478089670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 -- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 msgr2=0x7f2478088340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478088340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 -- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4370 msgr2=0x7f2478089670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4370 0x7f2478089670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 -- 172.21.15.50:0/1212185783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468009420 con 0x7f24780b4740 2023-12-24T18:37:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247e562700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2470009ec0 tx=0x7f247000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f246dffb700 1 -- 172.21.15.50:0/1212185783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000cb70 con 0x7f24780b4740 2023-12-24T18:37:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f246dffb700 1 -- 172.21.15.50:0/1212185783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000f040 con 0x7f24780b4740 2023-12-24T18:37:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247808a0c0 con 0x7f24780b4740 2023-12-24T18:37:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f246dffb700 1 -- 172.21.15.50:0/1212185783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470014480 con 0x7f24780b4740 2023-12-24T18:37:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.773+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247816d9b0 con 0x7f24780b4740 2023-12-24T18:37:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.777+0000 7f246dffb700 1 -- 172.21.15.50:0/1212185783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f24700147f0 con 0x7f24780b4740 2023-12-24T18:37:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f246dffb700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 0x7f245c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f246dffb700 1 -- 172.21.15.50:0/1212185783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f247007d5f0 con 0x7f24780b4740 2023-12-24T18:37:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f247dd61700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 0x7f245c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f247dd61700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 0x7f245c062a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2474007fd0 tx=0x7f2474007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f248228e740 1 Processor -- start 2023-12-24T18:37:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.781+0000 7f248228e740 1 -- start start 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e7df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e7e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dabf30 con 0x1c00710 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1da7ed0 con 0x1c4b790 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d6e0b0 con 0x1c00ae0 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40542/0 (socket says 172.21.15.50:40542) 2023-12-24T18:37:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 -- 172.21.15.50:0/1199104933 learned_addr learned my addr 172.21.15.50:0/1199104933 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247e562700 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e7e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247dd61700 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e7df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 -- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 msgr2=0x1e7df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e7df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 -- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 msgr2=0x1e7e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e7e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 -- 172.21.15.50:0/1199104933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c4c9e0 con 0x1c00710 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f247d560700 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2468013000 tx=0x7f2468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ff40d481f7d405 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f2462ffd700 1 -- 172.21.15.50:0/1199104933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468021070 con 0x1c00710 2023-12-24T18:37:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f2462ffd700 1 -- 172.21.15.50:0/1199104933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468000bc0 con 0x1c00710 2023-12-24T18:37:42.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f2462ffd700 1 -- 172.21.15.50:0/1199104933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246800b910 con 0x1c00710 2023-12-24T18:37:42.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- 172.21.15.50:0/1199104933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 msgr2=0x1e7e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2468013000 tx=0x7f2468017000 comp rx=0 tx=0).stop 2023-12-24T18:37:42.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- 172.21.15.50:0/1199104933 shutdown_connections 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e7e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e7e440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 --2- 172.21.15.50:0/1199104933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e7df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- 172.21.15.50:0/1199104933 >> 172.21.15.50:0/1199104933 conn(0x1c00eb0 msgr2=0x1e3a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- 172.21.15.50:0/1199104933 shutdown_connections 2023-12-24T18:37:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.785+0000 7f248228e740 1 -- 172.21.15.50:0/1199104933 wait complete. 2023-12-24T18:37:42.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 -- start start 2023-12-24T18:37:42.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 Processor -- start 2023-12-24T18:37:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e82a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e63cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d6dd50 con 0x1c00710 2023-12-24T18:37:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d46970 con 0x1c4b790 2023-12-24T18:37:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1da76e0 con 0x1c00ae0 2023-12-24T18:37:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f248228e740 10 client.0 _ll_register_callbacks cb 0x1df16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:37:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f247dd61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f247dd61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40544/0 (socket says 172.21.15.50:40544) 2023-12-24T18:37:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.789+0000 7f247dd61700 1 -- 172.21.15.50:0/1479756914 learned_addr learned my addr 172.21.15.50:0/1479756914 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247e562700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e63cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247d560700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e82a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 -- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 msgr2=0x1e82a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e82a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 -- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 msgr2=0x1e63cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e63cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 -- 172.21.15.50:0/1479756914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478161d60 con 0x1c00710 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247e562700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e63cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247d560700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e82a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f247dd61700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2474014650 tx=0x7f2474015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08eadd80c368abb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474001370 con 0x1c00710 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d46cc0 con 0x1c00710 2023-12-24T18:37:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f247401c040 con 0x1c00710 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2474007da0 con 0x1c00710 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 10 client.5214 fetch_fsmap learned FSMap version 17 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x1d76370 con 0x1c00710 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d46cc0 con 0x1c00710 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2474021430 con 0x1c00710 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 10 client.5214 fetch_fsmap finished waiting for FSMap version 17 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 10 client.5214 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 20 client.5214 populate_metadata read hostname 'smithi050' 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e652f0 0x1e8d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 4 client.5214 mds_command: new command op to 5077 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.793+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 --> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1d4a3e0 con 0x1e652f0 2023-12-24T18:37:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f247d560700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e652f0 0x1e8d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f2457fff700 10 client.5214 ms_handle_connect on v2:172.21.15.82:6833/168523974 2023-12-24T18:37:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f247d560700 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e652f0 0x1e8d6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe9d2bf8071ab7d server_cookie=9bd2f37c7d9582de in_seq=0 out_seq=0 2023-12-24T18:37:42.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f2457fff700 1 -- 172.21.15.50:0/1479756914 <== mds.0 v2:172.21.15.82:6833/168523974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1d4a3e0 con 0x1e652f0 2023-12-24T18:37:42.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f2457fff700 10 client.5214 handle_command_reply: tid=0 2023-12-24T18:37:42.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 client.5214 shutdown 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 msgr2=0x1e82510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2474014650 tx=0x7f2474015000 comp rx=0 tx=0).stop 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 shutdown_connections 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e652f0 0x1e8d6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c4b790 0x1e63cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e82a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 --2- 172.21.15.50:0/1479756914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00710 0x1e82510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f2457fff700 0 client.5214 ms_handle_reset on v2:172.21.15.82:6833/168523974 2023-12-24T18:37:42.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.797+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 >> 172.21.15.50:0/1479756914 conn(0x1c00eb0 msgr2=0x1e32f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.801+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 shutdown_connections 2023-12-24T18:37:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.801+0000 7f248228e740 1 -- 172.21.15.50:0/1479756914 wait complete. 2023-12-24T18:37:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.801+0000 7f248228e740 20 client.5214 trim_cache size 0 max 16384 2023-12-24T18:37:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 Processor -- start 2023-12-24T18:37:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 -- start start 2023-12-24T18:37:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e61780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c4b790 0x1e34ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d7c610 con 0x1c4b790 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dab9d0 con 0x1c00710 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.825+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dacef0 con 0x1c00ae0 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:58778/0 (socket says 172.21.15.50:58778) 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 -- 172.21.15.50:0/2250138527 learned_addr learned my addr 172.21.15.50:0/2250138527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247dd61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e61780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247e562700 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c4b790 0x1e34ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 -- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 msgr2=0x1e61780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e61780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 -- 172.21.15.50:0/2250138527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c4b790 msgr2=0x1e34ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c4b790 0x1e34ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 -- 172.21.15.50:0/2250138527 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d5cd80 con 0x1c00ae0 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f247d560700 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f24680098e0 tx=0x7f2468014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8540b575a191e8b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f24637fe700 1 -- 172.21.15.50:0/2250138527 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468021040 con 0x1c00ae0 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f24637fe700 1 -- 172.21.15.50:0/2250138527 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468006a90 con 0x1c00ae0 2023-12-24T18:37:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f24637fe700 1 -- 172.21.15.50:0/2250138527 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246800b430 con 0x1c00ae0 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 -- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 msgr2=0x1e61cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f24680098e0 tx=0x7f2468014000 comp rx=0 tx=0).stop 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 -- 172.21.15.50:0/2250138527 shutdown_connections 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c4b790 0x1e34ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c00ae0 0x1e61cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 --2- 172.21.15.50:0/2250138527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e61780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 -- 172.21.15.50:0/2250138527 >> 172.21.15.50:0/2250138527 conn(0x1c00eb0 msgr2=0x1e7d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 -- 172.21.15.50:0/2250138527 shutdown_connections 2023-12-24T18:37:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.829+0000 7f248228e740 1 -- 172.21.15.50:0/2250138527 wait complete. 2023-12-24T18:37:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 -- start start 2023-12-24T18:37:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 Processor -- start 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c4b790 0x1e37a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d7d550 con 0x1c00ae0 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d7bf40 con 0x1c00710 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c797c0 con 0x1c4b790 2023-12-24T18:37:42.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 10 client.0 _ll_register_callbacks cb 0x1bcc9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40566/0 (socket says 172.21.15.50:40566) 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 -- 172.21.15.50:0/2359693606 learned_addr learned my addr 172.21.15.50:0/2359693606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247dd61700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247e562700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c4b790 0x1e37a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 -- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c4b790 msgr2=0x1e37a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c4b790 0x1e37a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 -- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 msgr2=0x1e635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 -- 172.21.15.50:0/2359693606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1c4c9e0 con 0x1c00ae0 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247dd61700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f247d560700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f246801c040 tx=0x7f2468034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1a1b03395faf9a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:42.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f2457fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468021040 con 0x1c00ae0 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f2468035a40 con 0x1c00ae0 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.833+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2468000bc0 con 0x1c00ae0 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2468035e30 con 0x1c00ae0 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 10 client.5220 fetch_fsmap learned FSMap version 17 2023-12-24T18:37:42.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x1d51130 con 0x1c00ae0 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468000bc0 con 0x1c00ae0 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2468009ca0 con 0x1c00ae0 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 10 client.5220 fetch_fsmap finished waiting for FSMap version 17 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 10 client.5220 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 20 client.5220 populate_metadata read hostname 'smithi050' 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e37f40 0x1ed7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 4 client.5220 mds_command: new command op to 5077 tid=0[{"prefix": "status"}] 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 --> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1d7c410 con 0x1e37f40 2023-12-24T18:37:42.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f247dd61700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e37f40 0x1ed7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:42.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f247dd61700 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e37f40 0x1ed7320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a64391dea354695 server_cookie=97a8381feb5b005b in_seq=0 out_seq=0 2023-12-24T18:37:42.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 10 client.5220 ms_handle_connect on v2:172.21.15.82:6833/168523974 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 1 -- 172.21.15.50:0/2359693606 <== mds.0 v2:172.21.15.82:6833/168523974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1d7c410 con 0x1e37f40 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f2457fff700 10 client.5220 handle_command_reply: tid=0 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 client.5220 shutdown 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 msgr2=0x1e374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.837+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f246801c040 tx=0x7f2468034000 comp rx=0 tx=0).stop 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 shutdown_connections 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:6833/168523974,v1:172.21.15.82:6834/168523974] conn(0x1e37f40 0x1ed7320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1c4b790 0x1e37a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c00ae0 0x1e374c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 --2- 172.21.15.50:0/2359693606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1c00710 0x1e635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 >> 172.21.15.50:0/2359693606 conn(0x1c00eb0 msgr2=0x1e7d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f2457fff700 0 client.5220 ms_handle_reset on v2:172.21.15.82:6833/168523974 2023-12-24T18:37:42.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 shutdown_connections 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 1 -- 172.21.15.50:0/2359693606 wait complete. 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f248228e740 20 client.5220 trim_cache size 0 max 16384 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:37:42.847 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5077, 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.120927937999999, 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 17, 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 39, 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 39, 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 18.98800348 2023-12-24T18:37:42.848 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:37:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 msgr2=0x7f245c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 0x7f245c062a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2474007fd0 tx=0x7f2474007d10 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 msgr2=0x7f2478086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2470009ec0 tx=0x7f247000b040 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 shutdown_connections 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f245c060550 0x7f245c062a00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b4740 0x7f2478086ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24780b4370 0x7f2478089670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 --2- 172.21.15.50:0/1212185783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24780b22b0 0x7f2478088340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 >> 172.21.15.50:0/1212185783 conn(0x7f24780670b0 msgr2=0x7f24780b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 shutdown_connections 2023-12-24T18:37:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:42.841+0000 7f247ffc5700 1 -- 172.21.15.50:0/1212185783 wait complete. 2023-12-24T18:37:42.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:37:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.041+0000 7fde878a5700 1 Processor -- start 2023-12-24T18:37:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 -- start start 2023-12-24T18:37:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde800ca770 0x7fde8015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 0x7fde8006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8006ca50 con 0x7fde800ca3a0 2023-12-24T18:37:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde800c6980 con 0x7fde800ca770 2023-12-24T18:37:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde878a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8015b410 con 0x7fde8015af90 2023-12-24T18:37:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde85e42700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 0x7fde8006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde84e40700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde800ca770 0x7fde8015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.045+0000 7fde85641700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fde800ca3a0 0x7fde8006ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:39074/0 (socket says 172.21.15.50:39074) 2023-12-24T18:37:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85641700 1 -- 172.21.15.50:0/2522858730 learned_addr learned my addr 172.21.15.50:0/2522858730 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85e42700 1 -- 172.21.15.50:0/2522858730 >> v2:172.21.15.82:3300/0 conn(0x7fde800ca770 msgr2=0x7fde8015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85e42700 1 --2- 172.21.15.50:0/2522858730 >> v2:172.21.15.82:3300/0 conn(0x7fde800ca770 0x7fde8015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85e42700 1 -- 172.21.15.50:0/2522858730 >> v1:172.21.15.82:6789/0 conn(0x7fde800ca3a0 legacy=0x7fde8006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85e42700 1 -- 172.21.15.50:0/2522858730 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8006b520 con 0x7fde8015af90 2023-12-24T18:37:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde77fff700 1 -- 172.21.15.50:0/2522858730 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780597313 0 0) 0x7fde8006ca50 con 0x7fde800ca3a0 2023-12-24T18:37:43.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde85e42700 1 --2- 172.21.15.50:0/2522858730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 0x7fde8006cee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e60 tx=0x7fde78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697487da9d35c913 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:43.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde77fff700 1 -- 172.21.15.50:0/2522858730 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800e070 con 0x7fde8015af90 2023-12-24T18:37:43.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde77fff700 1 -- 172.21.15.50:0/2522858730 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800bb60 con 0x7fde8015af90 2023-12-24T18:37:43.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde77fff700 1 -- 172.21.15.50:0/2522858730 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78012430 con 0x7fde8015af90 2023-12-24T18:37:43.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 -- 172.21.15.50:0/2522858730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 msgr2=0x7fde8006cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 --2- 172.21.15.50:0/2522858730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 0x7fde8006cee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e60 tx=0x7fde78009780 comp rx=0 tx=0).stop 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 -- 172.21.15.50:0/2522858730 shutdown_connections 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 --2- 172.21.15.50:0/2522858730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde8015af90 0x7fde8006cee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 --2- 172.21.15.50:0/2522858730 >> v2:172.21.15.82:3300/0 conn(0x7fde800ca770 0x7fde8015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.049+0000 7fde878a5700 1 -- 172.21.15.50:0/2522858730 >> 172.21.15.50:0/2522858730 conn(0x7fde800cbba0 msgr2=0x7fde800cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.053+0000 7fde878a5700 1 -- 172.21.15.50:0/2522858730 shutdown_connections 2023-12-24T18:37:43.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.053+0000 7fde878a5700 1 -- 172.21.15.50:0/2522858730 wait complete. 2023-12-24T18:37:43.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.053+0000 7fde878a5700 1 Processor -- start 2023-12-24T18:37:43.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.053+0000 7fde878a5700 1 -- start start 2023-12-24T18:37:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde800ca3a0 0x7fde80148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde8015af90 0x7fde800cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800afa30 con 0x7fde800ca770 2023-12-24T18:37:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800afd10 con 0x7fde8015af90 2023-12-24T18:37:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde800afff0 con 0x7fde800ca3a0 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40570/0 (socket says 172.21.15.50:40570) 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 -- 172.21.15.50:0/1224941 learned_addr learned my addr 172.21.15.50:0/1224941 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde85641700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde800ca3a0 0x7fde80148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde85e42700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde8015af90 0x7fde800cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 -- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde800ca3a0 msgr2=0x7fde80148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde800ca3a0 0x7fde80148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 -- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde8015af90 msgr2=0x7fde800cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde8015af90 0x7fde800cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 -- 172.21.15.50:0/1224941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009a20 con 0x7fde800ca770 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde84e40700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde7000ec80 tx=0x7fde700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000c850 con 0x7fde800ca770 2023-12-24T18:37:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000c9b0 con 0x7fde800ca770 2023-12-24T18:37:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000cd50 con 0x7fde800ca770 2023-12-24T18:37:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde800b02d0 con 0x7fde800ca770 2023-12-24T18:37:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.057+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde800b0ad0 con 0x7fde800ca770 2023-12-24T18:37:43.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.061+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde800b0d50 con 0x7fde800ca770 2023-12-24T18:37:43.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.061+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fde70013680 con 0x7fde800ca770 2023-12-24T18:37:43.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.065+0000 7fde757fa700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 0x7fde64062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.065+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fde7007cba0 con 0x7fde800ca770 2023-12-24T18:37:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.065+0000 7fde85641700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 0x7fde64062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:43.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.065+0000 7fde85641700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 0x7fde64062a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde7c007fd0 tx=0x7fde7c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:43.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.069+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fde7004cfb0 con 0x7fde800ca770 2023-12-24T18:37:43.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.277+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde800652e0 con 0x7fde800ca770 2023-12-24T18:37:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde757fa700 1 -- 172.21.15.50:0/1224941 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde700505d0 con 0x7fde800ca770 2023-12-24T18:37:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:37:43.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 msgr2=0x7fde64062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 0x7fde64062a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde7c007fd0 tx=0x7fde7c007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:43.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 msgr2=0x7fde800cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:43.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde7000ec80 tx=0x7fde700091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 shutdown_connections 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fde640605d0 0x7fde64062a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde8015af90 0x7fde800cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde800ca770 0x7fde800cbf70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 --2- 172.21.15.50:0/1224941 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde800ca3a0 0x7fde80148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 >> 172.21.15.50:0/1224941 conn(0x7fde800cbba0 msgr2=0x7fde8015d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 shutdown_connections 2023-12-24T18:37:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:43.281+0000 7fde878a5700 1 -- 172.21.15.50:0/1224941 wait complete. 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:37:43.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:37:43.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.307 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:37:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:37:43.326 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:37:43.326 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:37:43.327 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:37:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:37:43.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.329 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:37:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:37:43.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.410 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:37:43.475 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:37:43.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.476 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:37:43.476 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:37:43.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:37:43.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:37:43.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:37:43.477 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:37:43.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.617 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:37:43.633 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:37:43.633 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:37:43.634 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:37:43.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:37:43.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:43.720 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:37:43.781 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:37:43.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:37:43.781 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:37:43.842 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:37:43.843 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:37:43.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:43.964 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:43.964 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:43.987 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:37:43.987 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:37:43.987 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:37:43.987 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:37:43.987 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:37:43.992 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:37:43.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:37:43.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:37:44.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:37:44.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.237+0000 7f8267878700 1 Processor -- start 2023-12-24T18:37:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.237+0000 7f8267878700 1 -- start start 2023-12-24T18:37:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8267878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82600ca770 0x7f826015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8267878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826006ca50 con 0x7f826015af90 2023-12-24T18:37:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8267878700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826015b410 con 0x7f82600ca3a0 2023-12-24T18:37:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8267878700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82600c6980 con 0x7f82600ca770 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82600ca770 0x7f826015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82600ca770 0x7f826015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40572/0 (socket says 172.21.15.50:40572) 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 -- 172.21.15.50:0/2184572803 learned_addr learned my addr 172.21.15.50:0/2184572803 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 -- 172.21.15.50:0/2184572803 >> v1:172.21.15.82:6789/0 conn(0x7f82600ca3a0 legacy=0x7f826006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 -- 172.21.15.50:0/2184572803 >> v1:172.21.15.50:6789/0 conn(0x7f826015af90 legacy=0x7f826006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.241+0000 7f8264e13700 1 -- 172.21.15.50:0/2184572803 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826006b520 con 0x7f82600ca770 2023-12-24T18:37:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8264e13700 1 --2- 172.21.15.50:0/2184572803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f826015aa50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f82500099b0 tx=0x7f8250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714804c099756aa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8257fff700 1 -- 172.21.15.50:0/2184572803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000b860 con 0x7f82600ca770 2023-12-24T18:37:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8257fff700 1 -- 172.21.15.50:0/2184572803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000b9c0 con 0x7f82600ca770 2023-12-24T18:37:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8257fff700 1 -- 172.21.15.50:0/2184572803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000bd80 con 0x7f82600ca770 2023-12-24T18:37:44.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 -- 172.21.15.50:0/2184572803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 msgr2=0x7f826015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 --2- 172.21.15.50:0/2184572803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f826015aa50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f82500099b0 tx=0x7f8250009250 comp rx=0 tx=0).stop 2023-12-24T18:37:44.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 -- 172.21.15.50:0/2184572803 shutdown_connections 2023-12-24T18:37:44.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 --2- 172.21.15.50:0/2184572803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f826015aa50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 -- 172.21.15.50:0/2184572803 >> 172.21.15.50:0/2184572803 conn(0x7f82600cbba0 msgr2=0x7f82600cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:44.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 -- 172.21.15.50:0/2184572803 shutdown_connections 2023-12-24T18:37:44.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.245+0000 7f8267878700 1 -- 172.21.15.50:0/2184572803 wait complete. 2023-12-24T18:37:44.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 Processor -- start 2023-12-24T18:37:44.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 -- start start 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82600ca3a0 0x7f82600b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826015af90 0x7f82600c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600afa80 con 0x7f82600ca770 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600b1960 con 0x7f826015af90 2023-12-24T18:37:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8267878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8260171730 con 0x7f82600ca3a0 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40580/0 (socket says 172.21.15.50:40580) 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 -- 172.21.15.50:0/2393444628 learned_addr learned my addr 172.21.15.50:0/2393444628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8265e15700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826015af90 0x7f82600c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8265614700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82600ca3a0 0x7f82600b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 -- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82600ca3a0 msgr2=0x7f82600b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82600ca3a0 0x7f82600b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 -- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826015af90 msgr2=0x7f82600c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826015af90 0x7f82600c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.249+0000 7f8264e13700 1 -- 172.21.15.50:0/2393444628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500094f0 con 0x7f82600ca770 2023-12-24T18:37:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f8264e13700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8250006fd0 tx=0x7f8250017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825001f070 con 0x7f82600ca770 2023-12-24T18:37:44.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250002f30 con 0x7f82600ca770 2023-12-24T18:37:44.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011d10 con 0x7f82600ca770 2023-12-24T18:37:44.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82600c45f0 con 0x7f82600ca770 2023-12-24T18:37:44.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8260171c40 con 0x7f82600ca770 2023-12-24T18:37:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.253+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82600652e0 con 0x7f82600ca770 2023-12-24T18:37:44.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.257+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8250023070 con 0x7f82600ca770 2023-12-24T18:37:44.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.257+0000 7f82557fa700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 0x7f8244062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.257+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f825007dd00 con 0x7f82600ca770 2023-12-24T18:37:44.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.257+0000 7f8265614700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 0x7f8244062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.257+0000 7f8265614700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 0x7f8244062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f825c003a80 tx=0x7f825c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.265+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f825004e150 con 0x7f82600ca770 2023-12-24T18:37:44.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.461+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f826006e140 con 0x7f8244060550 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.461+0000 7f82557fa700 1 -- 172.21.15.50:0/2393444628 <== mgr.4108 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f826006e140 con 0x7f8244060550 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:37:44.468 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:37:44.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 msgr2=0x7f8244062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 0x7f8244062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f825c003a80 tx=0x7f825c007ec0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 msgr2=0x7f82601711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8250006fd0 tx=0x7f8250017000 comp rx=0 tx=0).stop 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 shutdown_connections 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8244060550 0x7f8244062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826015af90 0x7f82600c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82600ca770 0x7f82601711f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 --2- 172.21.15.50:0/2393444628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82600ca3a0 0x7f82600b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 >> 172.21.15.50:0/2393444628 conn(0x7f82600cbba0 msgr2=0x7f82600c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 shutdown_connections 2023-12-24T18:37:44.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.469+0000 7f8267878700 1 -- 172.21.15.50:0/2393444628 wait complete. 2023-12-24T18:37:44.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:37:44.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.665+0000 7ff9becf0700 1 Processor -- start 2023-12-24T18:37:44.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.665+0000 7ff9becf0700 1 -- start start 2023-12-24T18:37:44.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9becf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9becf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9b806ac40 0x7ff9b815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9becf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b815e960 con 0x7ff9b8160720 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9becf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b806b070 con 0x7ff9b806ac40 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9becf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b81600a0 con 0x7ff9b8160af0 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9bca8c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff9b8160720 0x7ff9b806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:39086/0 (socket says 172.21.15.50:39086) 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9bca8c700 1 -- 172.21.15.50:0/3567742433 learned_addr learned my addr 172.21.15.50:0/3567742433 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/3567742433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9bd28d700 1 --2- 172.21.15.50:0/3567742433 >> v2:172.21.15.82:3300/0 conn(0x7ff9b806ac40 0x7ff9b815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b77fe700 1 -- 172.21.15.50:0/3567742433 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921038134 0 0) 0x7ff9b815e960 con 0x7ff9b8160720 2023-12-24T18:37:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b77fe700 1 -- 172.21.15.50:0/3567742433 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a8003570 con 0x7ff9b8160720 2023-12-24T18:37:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 -- 172.21.15.50:0/3567742433 >> v2:172.21.15.82:3300/0 conn(0x7ff9b806ac40 msgr2=0x7ff9b815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/3567742433 >> v2:172.21.15.82:3300/0 conn(0x7ff9b806ac40 0x7ff9b815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 -- 172.21.15.50:0/3567742433 >> v1:172.21.15.82:6789/0 conn(0x7ff9b8160720 legacy=0x7ff9b806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 -- 172.21.15.50:0/3567742433 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b815dd50 con 0x7ff9b8160af0 2023-12-24T18:37:44.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/3567742433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b806a700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40098e0 tx=0x7ff9a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb72a51db9e091d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b77fe700 1 -- 172.21.15.50:0/3567742433 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011630 con 0x7ff9b8160af0 2023-12-24T18:37:44.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b77fe700 1 -- 172.21.15.50:0/3567742433 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4011790 con 0x7ff9b8160af0 2023-12-24T18:37:44.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.669+0000 7ff9b77fe700 1 -- 172.21.15.50:0/3567742433 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011b30 con 0x7ff9b8160af0 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- 172.21.15.50:0/3567742433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 msgr2=0x7ff9b806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 --2- 172.21.15.50:0/3567742433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b806a700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40098e0 tx=0x7ff9a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- 172.21.15.50:0/3567742433 shutdown_connections 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 --2- 172.21.15.50:0/3567742433 >> v2:172.21.15.82:3300/0 conn(0x7ff9b806ac40 0x7ff9b815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 --2- 172.21.15.50:0/3567742433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b806a700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- 172.21.15.50:0/3567742433 >> 172.21.15.50:0/3567742433 conn(0x7ff9b8067b80 msgr2=0x7ff9b80cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- 172.21.15.50:0/3567742433 shutdown_connections 2023-12-24T18:37:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- 172.21.15.50:0/3567742433 wait complete. 2023-12-24T18:37:44.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 Processor -- start 2023-12-24T18:37:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.673+0000 7ff9becf0700 1 -- start start 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b8160720 0x7ff9b80c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b80c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b816ded0 con 0x7ff9b806ac40 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c3100 con 0x7ff9b8160720 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9becf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c24f0 con 0x7ff9b8160af0 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40586/0 (socket says 172.21.15.50:40586) 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 -- 172.21.15.50:0/1086995229 learned_addr learned my addr 172.21.15.50:0/1086995229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bd28d700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b80c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b8160720 0x7ff9b80c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 -- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 msgr2=0x7ff9b80c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b80c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 -- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b8160720 msgr2=0x7ff9b80c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b8160720 0x7ff9b80c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 -- 172.21.15.50:0/1086995229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4009420 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9bca8c700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c7c0 tx=0x7ff9ac007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.677+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac005cd0 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.681+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac005e30 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.681+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80c27d0 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.681+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac007320 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.681+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80c2d90 con 0x7ff9b806ac40 2023-12-24T18:37:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.681+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80652e0 con 0x7ff9b806ac40 2023-12-24T18:37:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.685+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff9ac01b3b0 con 0x7ff9b806ac40 2023-12-24T18:37:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.685+0000 7ff9b4ff9700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.685+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7ff9ac07bfa0 con 0x7ff9b806ac40 2023-12-24T18:37:44.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.685+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.685+0000 7ff9b7fff700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 0x7ff99c062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40091e0 tx=0x7ff9a4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:44.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.693+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff9ac04c450 con 0x7ff9b806ac40 2023-12-24T18:37:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:44.913+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff9b80b09f0 con 0x7ff9b806ac40 2023-12-24T18:37:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.265+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 6) v1 ==== 79978+0+0 (secure 0 0 0) 0x7ff9ac04c820 con 0x7ff9b806ac40 2023-12-24T18:37:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.269+0000 7ff9b4ff9700 1 -- 172.21.15.50:0/1086995229 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff9ac04c450 con 0x7ff9b806ac40 2023-12-24T18:37:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 msgr2=0x7ff99c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 0x7ff99c062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40091e0 tx=0x7ff9a4017000 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 msgr2=0x7ff9b8170900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c7c0 tx=0x7ff9ac007e00 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 shutdown_connections 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9b8160af0 0x7ff9b80c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b8160720 0x7ff9b80c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 --2- 172.21.15.50:0/1086995229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b806ac40 0x7ff9b8170900 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 >> 172.21.15.50:0/1086995229 conn(0x7ff9b8067b80 msgr2=0x7ff9b80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 shutdown_connections 2023-12-24T18:37:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.273+0000 7ff9becf0700 1 -- 172.21.15.50:0/1086995229 wait complete. 2023-12-24T18:37:45.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:37:45.453 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:45.448+0000 7fcc221ce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:37:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 Processor -- start 2023-12-24T18:37:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 -- start start 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafa0158db0 0x7fafa0159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 0x7fafa006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa006b0c0 con 0x7fafa0158db0 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa006cca0 con 0x7fafa006a700 2023-12-24T18:37:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.473+0000 7fafa562e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00a9cc0 con 0x7fafa00a9290 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:58884/0 (socket says 172.21.15.50:58884) 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 -- 172.21.15.50:0/4237418694 learned_addr learned my addr 172.21.15.50:0/4237418694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9f7fe700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 0x7fafa006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9effd700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.50:3300/0 conn(0x7fafa0158db0 0x7fafa0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 -- 172.21.15.50:0/4237418694 >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 msgr2=0x7fafa006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 0x7fafa006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 -- 172.21.15.50:0/4237418694 >> v2:172.21.15.50:3300/0 conn(0x7fafa0158db0 msgr2=0x7fafa0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.50:3300/0 conn(0x7fafa0158db0 0x7fafa0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 -- 172.21.15.50:0/4237418694 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00a9fa0 con 0x7fafa00a9290 2023-12-24T18:37:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9f7fe700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 0x7fafa006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf97fff700 1 --2- 172.21.15.50:0/4237418694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafa006c820 tx=0x7faf88009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef66fb566665b235 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9e7fc700 1 -- 172.21.15.50:0/4237418694 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800b640 con 0x7fafa00a9290 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9e7fc700 1 -- 172.21.15.50:0/4237418694 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800b7a0 con 0x7fafa00a9290 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7faf9e7fc700 1 -- 172.21.15.50:0/4237418694 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800bb60 con 0x7fafa00a9290 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 -- 172.21.15.50:0/4237418694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 msgr2=0x7fafa00a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 --2- 172.21.15.50:0/4237418694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafa006c820 tx=0x7faf88009250 comp rx=0 tx=0).stop 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 -- 172.21.15.50:0/4237418694 shutdown_connections 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.82:3300/0 conn(0x7fafa006a700 0x7fafa006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 --2- 172.21.15.50:0/4237418694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa00a96e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 --2- 172.21.15.50:0/4237418694 >> v2:172.21.15.50:3300/0 conn(0x7fafa0158db0 0x7fafa0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 -- 172.21.15.50:0/4237418694 >> 172.21.15.50:0/4237418694 conn(0x7fafa0067b80 msgr2=0x7fafa00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 -- 172.21.15.50:0/4237418694 shutdown_connections 2023-12-24T18:37:45.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.477+0000 7fafa562e700 1 -- 172.21.15.50:0/4237418694 wait complete. 2023-12-24T18:37:45.485 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fe618f5e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:37:45.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 Processor -- start 2023-12-24T18:37:45.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 -- start start 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa0158db0 0x7fafa014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014f9a0 con 0x7fafa0158db0 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014fc40 con 0x7fafa006a700 2023-12-24T18:37:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7fafa562e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014e820 con 0x7fafa00a9290 2023-12-24T18:37:45.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7faf9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7faf97fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7faf9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:36244/0 (socket says 172.21.15.50:36244) 2023-12-24T18:37:45.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7faf9effd700 1 -- 172.21.15.50:0/1095827271 learned_addr learned my addr 172.21.15.50:0/1095827271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:45.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.481+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa0158db0 0x7fafa014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 msgr2=0x7fafa014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa0158db0 msgr2=0x7fafa014e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa0158db0 0x7fafa014e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 -- 172.21.15.50:0/1095827271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009a20 con 0x7fafa006a700 2023-12-24T18:37:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf9effd700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faf9000e960 tx=0x7faf900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90013680 con 0x7fafa006a700 2023-12-24T18:37:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf900137e0 con 0x7fafa006a700 2023-12-24T18:37:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880094f0 con 0x7fafa006a700 2023-12-24T18:37:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90013b80 con 0x7fafa006a700 2023-12-24T18:37:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa014ed80 con 0x7fafa006a700 2023-12-24T18:37:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.485+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa00652e0 con 0x7fafa006a700 2023-12-24T18:37:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.489+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 6) v1 ==== 79978+0+0 (secure 0 0 0) 0x7faf9000c490 con 0x7fafa006a700 2023-12-24T18:37:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.489+0000 7faf96ffd700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 0x7faf80062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.489+0000 7faf97fff700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 msgr2=0x7faf80062b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.489+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7faf9007ca30 con 0x7fafa006a700 2023-12-24T18:37:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.489+0000 7faf97fff700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 0x7faf80062b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:37:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.497+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf9004cf00 con 0x7fafa006a700 2023-12-24T18:37:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.677+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fafa006c930 con 0x7fafa006a700 2023-12-24T18:37:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.689+0000 7faf96ffd700 1 -- 172.21.15.50:0/1095827271 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7faf90050520 con 0x7fafa006a700 2023-12-24T18:37:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7faf97fff700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 msgr2=0x7faf80062b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7faf97fff700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 0x7faf80062b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 msgr2=0x7faf80062b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 0x7faf80062b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 msgr2=0x7fafa015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faf9000e960 tx=0x7faf900091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 shutdown_connections 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7faf80060650 0x7faf80062b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa0158db0 0x7fafa014e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafa00a9290 0x7fafa014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 --2- 172.21.15.50:0/1095827271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa006a700 0x7fafa015c560 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 >> 172.21.15.50:0/1095827271 conn(0x7fafa0067b80 msgr2=0x7fafa00af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 shutdown_connections 2023-12-24T18:37:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.693+0000 7fafa562e700 1 -- 172.21.15.50:0/1095827271 wait complete. 2023-12-24T18:37:45.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:37:45.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 Processor -- start 2023-12-24T18:37:45.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 -- start start 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31440ae6b0 0x7f314415a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 0x7f31440b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 0x7f31440c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314415add0 con 0x7f31440ae6b0 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314406cc00 con 0x7f31440aea80 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31493cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314406cee0 con 0x7f31440b1bf0 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31440ae6b0 0x7f314415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31440ae6b0 0x7f314415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40630/0 (socket says 172.21.15.50:40630) 2023-12-24T18:37:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 -- 172.21.15.50:0/2647400349 learned_addr learned my addr 172.21.15.50:0/2647400349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31437fe700 1 --2- 172.21.15.50:0/2647400349 >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 0x7f31440b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3148bcb700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 0x7f31440c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 -- 172.21.15.50:0/2647400349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 msgr2=0x7f31440c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 0x7f31440c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 -- 172.21.15.50:0/2647400349 >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 msgr2=0x7f31440b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 --2- 172.21.15.50:0/2647400349 >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 0x7f31440b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3143fff700 1 -- 172.21.15.50:0/2647400349 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314406d1c0 con 0x7f31440ae6b0 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f3148bcb700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 0x7f31440c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.881+0000 7f31437fe700 1 --2- 172.21.15.50:0/2647400349 >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 0x7f31440b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f3143fff700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440ae6b0 0x7f314415a890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3144063780 tx=0x7f3134009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6f878a369b777e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f3142ffd700 1 -- 172.21.15.50:0/2647400349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400b860 con 0x7f31440ae6b0 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f3142ffd700 1 -- 172.21.15.50:0/2647400349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400b9c0 con 0x7f31440ae6b0 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f3142ffd700 1 -- 172.21.15.50:0/2647400349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400bd60 con 0x7f31440ae6b0 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 -- 172.21.15.50:0/2647400349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440ae6b0 msgr2=0x7f314415a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440ae6b0 0x7f314415a890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3144063780 tx=0x7f3134009250 comp rx=0 tx=0).stop 2023-12-24T18:37:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 -- 172.21.15.50:0/2647400349 shutdown_connections 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 --2- 172.21.15.50:0/2647400349 >> v2:172.21.15.82:3300/0 conn(0x7f31440aea80 0x7f31440b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440b1bf0 0x7f31440c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 --2- 172.21.15.50:0/2647400349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440ae6b0 0x7f314415a890 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 -- 172.21.15.50:0/2647400349 >> 172.21.15.50:0/2647400349 conn(0x7f3144068510 msgr2=0x7f31440add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 -- 172.21.15.50:0/2647400349 shutdown_connections 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 -- 172.21.15.50:0/2647400349 wait complete. 2023-12-24T18:37:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.885+0000 7f31493cc700 1 Processor -- start 2023-12-24T18:37:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- start start 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440ae6b0 0x7f3144166f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31440b1bf0 0x7f31440ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314416a270 con 0x7f31440aea80 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314416a870 con 0x7f31440b1bf0 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314416ab50 con 0x7f31440ae6b0 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40636/0 (socket says 172.21.15.50:40636) 2023-12-24T18:37:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 -- 172.21.15.50:0/754429434 learned_addr learned my addr 172.21.15.50:0/754429434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f3148bcb700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31440b1bf0 0x7f31440ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f3143fff700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440ae6b0 0x7f3144166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440ae6b0 msgr2=0x7f3144166f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440ae6b0 0x7f3144166f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31440b1bf0 msgr2=0x7f31440ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31440b1bf0 0x7f31440ab3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 -- 172.21.15.50:0/754429434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340094f0 con 0x7f31440aea80 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31437fe700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f313800e8a0 tx=0x7f3138008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800c430 con 0x7f31440aea80 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800c590 con 0x7f31440aea80 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800c950 con 0x7f31440aea80 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314416ae30 con 0x7f31440aea80 2023-12-24T18:37:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.889+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314416b3f0 con 0x7f31440aea80 2023-12-24T18:37:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314404be40 con 0x7f31440aea80 2023-12-24T18:37:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 6) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f313800cd00 con 0x7f31440aea80 2023-12-24T18:37:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f312bfff700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 0x7f3130062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f313807c7e0 con 0x7f31440aea80 2023-12-24T18:37:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f3143fff700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 msgr2=0x7f3130062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.893+0000 7f3143fff700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 0x7f3130062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:37:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:45.897+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3138050680 con 0x7f31440aea80 2023-12-24T18:37:45.974 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:45.972+0000 7fcc221ce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:37:46.046 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.044+0000 7fcc221ce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:37:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.097+0000 7f3143fff700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 msgr2=0x7f3130062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.097+0000 7f3143fff700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 0x7f3130062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:37:46.178 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.176+0000 7fcc221ce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:37:46.181 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:46.177+0000 7fe618f5e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:37:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.241+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f31440b19d0 con 0x7f31440aea80 2023-12-24T18:37:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.253+0000 7f312bfff700 1 -- 172.21.15.50:0/754429434 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3138050210 con 0x7f31440aea80 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 msgr2=0x7f3130062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 0x7f3130062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 msgr2=0x7f3144169d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f313800e8a0 tx=0x7f3138008040 comp rx=0 tx=0).stop 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 shutdown_connections 2023-12-24T18:37:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f31300605a0 0x7f3130062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31440b1bf0 0x7f31440ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440aea80 0x7f3144169d30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 --2- 172.21.15.50:0/754429434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31440ae6b0 0x7f3144166f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 >> 172.21.15.50:0/754429434 conn(0x7f3144068510 msgr2=0x7f31440ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 shutdown_connections 2023-12-24T18:37:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.257+0000 7f31493cc700 1 -- 172.21.15.50:0/754429434 wait complete. 2023-12-24T18:37:46.284 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:46.277+0000 7fe618f5e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:37:46.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:46.287 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T18:37:46.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:46.323 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-12-24T18:37:46.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-12-24T18:37:46.430 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.428+0000 7fcc221ce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:37:46.449 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:46.445+0000 7fe618f5e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:37:46.498 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.496+0000 7fcc221ce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:37:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.609+0000 7f643b59e700 1 Processor -- start 2023-12-24T18:37:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.609+0000 7f643b59e700 1 -- start start 2023-12-24T18:37:46.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f643c159080 0x7f643c06da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:46.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c06b5b0 con 0x7f643c0c5c90 2023-12-24T18:37:46.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c06df80 con 0x7f643c06a4a0 2023-12-24T18:37:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c15dbd0 con 0x7f643c159080 2023-12-24T18:37:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f643c0c5c90 0x7f643c0cab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46894/0 (socket says 172.21.15.50:46894) 2023-12-24T18:37:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643ad9d700 1 -- 172.21.15.50:0/2400838732 learned_addr learned my addr 172.21.15.50:0/2400838732 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:46.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643a59c700 1 --2- 172.21.15.50:0/2400838732 >> v2:172.21.15.82:3300/0 conn(0x7f643c159080 0x7f643c06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:46.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643959a700 1 -- 172.21.15.50:0/2400838732 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117821449 0 0) 0x7f643c06b5b0 con 0x7f643c0c5c90 2023-12-24T18:37:46.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643959a700 1 -- 172.21.15.50:0/2400838732 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6424003570 con 0x7f643c0c5c90 2023-12-24T18:37:46.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643a59c700 1 -- 172.21.15.50:0/2400838732 >> v1:172.21.15.82:6789/0 conn(0x7f643c06a4a0 legacy=0x7f643c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.613+0000 7f643a59c700 1 -- 172.21.15.50:0/2400838732 >> v1:172.21.15.50:6789/0 conn(0x7f643c0c5c90 legacy=0x7f643c0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643a59c700 1 -- 172.21.15.50:0/2400838732 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c06a9a0 con 0x7f643c159080 2023-12-24T18:37:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643a59c700 1 --2- 172.21.15.50:0/2400838732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c159080 0x7f643c06da40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f642c0098e0 tx=0x7f642c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f217bf7a25aa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643959a700 1 -- 172.21.15.50:0/2400838732 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00b640 con 0x7f643c159080 2023-12-24T18:37:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643959a700 1 -- 172.21.15.50:0/2400838732 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00b7a0 con 0x7f643c159080 2023-12-24T18:37:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643959a700 1 -- 172.21.15.50:0/2400838732 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00bb40 con 0x7f643c159080 2023-12-24T18:37:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 -- 172.21.15.50:0/2400838732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c159080 msgr2=0x7f643c06da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 --2- 172.21.15.50:0/2400838732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c159080 0x7f643c06da40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f642c0098e0 tx=0x7f642c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 -- 172.21.15.50:0/2400838732 shutdown_connections 2023-12-24T18:37:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 --2- 172.21.15.50:0/2400838732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c159080 0x7f643c06da40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 -- 172.21.15.50:0/2400838732 >> 172.21.15.50:0/2400838732 conn(0x7f643c067b80 msgr2=0x7f643c0cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 -- 172.21.15.50:0/2400838732 shutdown_connections 2023-12-24T18:37:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.617+0000 7f643b59e700 1 -- 172.21.15.50:0/2400838732 wait complete. 2023-12-24T18:37:46.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 Processor -- start 2023-12-24T18:37:46.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 -- start start 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 0x7f643c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c0c5c90 0x7f643c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0b4320 con 0x7f643c159080 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15b600 con 0x7f643c0c5c90 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0b3cd0 con 0x7f643c06a4a0 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40640/0 (socket says 172.21.15.50:40640) 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643ad9d700 1 -- 172.21.15.50:0/782455144 learned_addr learned my addr 172.21.15.50:0/782455144 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 0x7f643c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.621+0000 7f6439d9b700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c0c5c90 0x7f643c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 msgr2=0x7f643c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 0x7f643c15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c0c5c90 msgr2=0x7f643c143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c0c5c90 0x7f643c143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c009420 con 0x7f643c159080 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 0x7f643c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643ad9d700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f643400cc40 tx=0x7f6434001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400a8b0 con 0x7f643c159080 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0b3fb0 con 0x7f643c159080 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400aa10 con 0x7f643c159080 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400ad90 con 0x7f643c159080 2023-12-24T18:37:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c15b240 con 0x7f643c159080 2023-12-24T18:37:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.625+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c158c20 con 0x7f643c159080 2023-12-24T18:37:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.629+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 6) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f6434007300 con 0x7f643c159080 2023-12-24T18:37:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.629+0000 7f642a7fc700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.629+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f643407d740 con 0x7f643c159080 2023-12-24T18:37:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.629+0000 7f643a59c700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.629+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:37:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.637+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f643404db40 con 0x7f643c159080 2023-12-24T18:37:46.705 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.704+0000 7fcc221ce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:37:46.733 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:46.725+0000 7fe618f5e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:37:46.789 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.788+0000 7fcc221ce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:37:46.811 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:46.805+0000 7fe618f5e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:37:46.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.833+0000 7f643a59c700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:46.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.833+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:37:46.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:46.845+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f643c158c20 con 0x7f641c0605a0 2023-12-24T18:37:46.872 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:46.868+0000 7fcc221ce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:37:47.053 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:47.049+0000 7fe618f5e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:37:47.139 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:47.133+0000 7fe618f5e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:37:47.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:47.221+0000 7fe618f5e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:37:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:47.237+0000 7f643a59c700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:47.237+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:37:47.247 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:47.244+0000 7fcc221ce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:37:47.402 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:47.400+0000 7fcc221ce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:37:47.698 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:47.693+0000 7fe618f5e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:37:47.759 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:47.756+0000 7fcc221ce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:37:47.887 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:47.881+0000 7fe618f5e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:37:48.016 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.012+0000 7fcc221ce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:37:48.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:48.041+0000 7f643a59c700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:48.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:48.041+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:37:48.104 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.100+0000 7fcc221ce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:37:48.178 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.176+0000 7fcc221ce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:37:48.259 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.256+0000 7fcc221ce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:37:48.271 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.265+0000 7fe618f5e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:37:48.470 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.468+0000 7fcc221ce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:37:48.506 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.501+0000 7fe618f5e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:37:48.543 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.540+0000 7fcc221ce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:37:48.587 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.581+0000 7fe618f5e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:37:48.623 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.620+0000 7fcc221ce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:37:48.678 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.673+0000 7fe618f5e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:37:48.762 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.757+0000 7fe618f5e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:37:48.809 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.808+0000 7fcc221ce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:37:48.895 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:48.892+0000 7fcc221ce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:37:48.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:48.977+0000 7fe618f5e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:37:49.065 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:49.061+0000 7fe618f5e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:37:49.156 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:49.149+0000 7fe618f5e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:37:49.353 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:49.345+0000 7fe618f5e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:37:49.438 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:49.433+0000 7fe618f5e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:37:49.592 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:37:49.588+0000 7fcc221ce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:37:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:49.645+0000 7f643a59c700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:37:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:49.645+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:37:49.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:49.653+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 7) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f643404df10 con 0x7f643c159080 2023-12-24T18:37:50.169 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.165+0000 7fe618f5e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:37:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:50.181+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 8) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f6434062d20 con 0x7f643c159080 2023-12-24T18:37:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:50.181+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:37:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:50.181+0000 7f642a7fc700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5d7a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5d7a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5d7a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5d7a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5d7a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5daa8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5daa8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5daa8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5daa8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:50.368 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:37:50.361+0000 7fe5daa8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:37:51.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.193+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 9) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f643407b5c0 con 0x7f643c159080 2023-12-24T18:37:51.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.193+0000 7f642a7fc700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.193+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f643c158c20 con 0x7f641c0605a0 2023-12-24T18:37:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.197+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.201+0000 7f643a59c700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c0629d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f642c0093f0 tx=0x7f642c017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:51.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.337+0000 7f642a7fc700 1 -- 172.21.15.50:0/782455144 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f643c158c20 con 0x7f641c0605a0 2023-12-24T18:37:51.342 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir0 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 msgr2=0x7f641c0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c0629d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f642c0093f0 tx=0x7f642c017000 comp rx=0 tx=0).stop 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 msgr2=0x7f643c15cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f643400cc40 tx=0x7f6434001aa0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 shutdown_connections 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f641c0605a0 0x7f641c0629d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f643c159080 0x7f643c15cba0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f643c0c5c90 0x7f643c143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 --2- 172.21.15.50:0/782455144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f643c06a4a0 0x7f643c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 >> 172.21.15.50:0/782455144 conn(0x7f643c067b80 msgr2=0x7f643c152860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 shutdown_connections 2023-12-24T18:37:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.341+0000 7f643b59e700 1 -- 172.21.15.50:0/782455144 wait complete. 2023-12-24T18:37:51.370 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-12-24T18:37:51.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:51.371 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-12-24T18:37:51.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-12-24T18:37:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.649+0000 7f8b27fff700 1 Processor -- start 2023-12-24T18:37:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.649+0000 7f8b27fff700 1 -- start start 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b27fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b280ceb80 0x7f8b281591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b27fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2806aa80 con 0x7f8b280b2cf0 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b27fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280cc0b0 con 0x7f8b28158dd0 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b27fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b280cc390 con 0x7f8b280ceb80 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b267fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b280b2cf0 0x7f8b280ce470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49122/0 (socket says 172.21.15.50:49122) 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b267fc700 1 -- 172.21.15.50:0/2754232929 learned_addr learned my addr 172.21.15.50:0/2754232929 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b277fe700 1 --2- 172.21.15.50:0/2754232929 >> v2:172.21.15.82:3300/0 conn(0x7f8b280ceb80 0x7f8b281591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795473930 0 0) 0x7f8b2806aa80 con 0x7f8b280b2cf0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b10003570 con 0x7f8b280b2cf0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519690320 0 0) 0x7f8b280cc0b0 con 0x7f8b28158dd0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2806aa80 con 0x7f8b28158dd0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950853499 0 0) 0x7f8b10003570 con 0x7f8b280b2cf0 2023-12-24T18:37:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b277fe700 1 -- 172.21.15.50:0/2754232929 >> v1:172.21.15.82:6789/0 conn(0x7f8b28158dd0 legacy=0x7f8b280cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b277fe700 1 -- 172.21.15.50:0/2754232929 >> v1:172.21.15.50:6789/0 conn(0x7f8b280b2cf0 legacy=0x7f8b280ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b277fe700 1 -- 172.21.15.50:0/2754232929 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2806a430 con 0x7f8b280ceb80 2023-12-24T18:37:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b277fe700 1 --2- 172.21.15.50:0/2754232929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280ceb80 0x7f8b281591a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009e60 tx=0x7f8b20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701358174bad3880 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000e070 con 0x7f8b280ceb80 2023-12-24T18:37:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000b7a0 con 0x7f8b280ceb80 2023-12-24T18:37:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.653+0000 7f8b25ffb700 1 -- 172.21.15.50:0/2754232929 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0015f0 con 0x7f8b280ceb80 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 -- 172.21.15.50:0/2754232929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280ceb80 msgr2=0x7f8b281591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 --2- 172.21.15.50:0/2754232929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280ceb80 0x7f8b281591a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009e60 tx=0x7f8b20009780 comp rx=0 tx=0).stop 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 -- 172.21.15.50:0/2754232929 shutdown_connections 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 --2- 172.21.15.50:0/2754232929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280ceb80 0x7f8b281591a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 -- 172.21.15.50:0/2754232929 >> 172.21.15.50:0/2754232929 conn(0x7f8b28067b80 msgr2=0x7f8b280cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 -- 172.21.15.50:0/2754232929 shutdown_connections 2023-12-24T18:37:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.657+0000 7f8b27fff700 1 -- 172.21.15.50:0/2754232929 wait complete. 2023-12-24T18:37:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 Processor -- start 2023-12-24T18:37:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 -- start start 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280b2cf0 0x7f8b280c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 0x7f8b280c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c7f50 con 0x7f8b28158dd0 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c95a0 con 0x7f8b280b2cf0 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b27fff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28147dc0 con 0x7f8b280ceb80 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34664/0 (socket says 172.21.15.50:34664) 2023-12-24T18:37:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 -- 172.21.15.50:0/3066559026 learned_addr learned my addr 172.21.15.50:0/3066559026 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b26ffd700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280b2cf0 0x7f8b280c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b267fc700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 0x7f8b280c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 -- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 msgr2=0x7f8b280c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 0x7f8b280c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 -- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280b2cf0 msgr2=0x7f8b280c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280b2cf0 0x7f8b280c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b277fe700 1 -- 172.21.15.50:0/3066559026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009a20 con 0x7f8b28158dd0 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.661+0000 7f8b267fc700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 0x7f8b280c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b277fe700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8b20003000 tx=0x7f8b20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20012da0 con 0x7f8b28158dd0 2023-12-24T18:37:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2001e450 con 0x7f8b28158dd0 2023-12-24T18:37:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b280c8990 con 0x7f8b28158dd0 2023-12-24T18:37:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2001e810 con 0x7f8b28158dd0 2023-12-24T18:37:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280c8f50 con 0x7f8b28158dd0 2023-12-24T18:37:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.665+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2804be40 con 0x7f8b28158dd0 2023-12-24T18:37:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.669+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f8b2001eb80 con 0x7f8b28158dd0 2023-12-24T18:37:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.669+0000 7f8b0effd700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 0x7f8b140628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.669+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f8b2007eb10 con 0x7f8b28158dd0 2023-12-24T18:37:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.669+0000 7f8b26ffd700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 0x7f8b140628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.669+0000 7f8b26ffd700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 0x7f8b140628d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b180037e0 tx=0x7f8b18009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.673+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b2004f170 con 0x7f8b28158dd0 2023-12-24T18:37:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.865+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b280c96e0 con 0x7f8b14060420 2023-12-24T18:37:51.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.969+0000 7f8b0effd700 1 -- 172.21.15.50:0/3066559026 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8b280c96e0 con 0x7f8b14060420 2023-12-24T18:37:51.974 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir1 2023-12-24T18:37:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 msgr2=0x7f8b140628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 0x7f8b140628d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b180037e0 tx=0x7f8b18009040 comp rx=0 tx=0).stop 2023-12-24T18:37:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 msgr2=0x7f8b28147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8b20003000 tx=0x7f8b20017000 comp rx=0 tx=0).stop 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 shutdown_connections 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b14060420 0x7f8b140628d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b28158dd0 0x7f8b28147880 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b280ceb80 0x7f8b280c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 --2- 172.21.15.50:0/3066559026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b280b2cf0 0x7f8b280c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 >> 172.21.15.50:0/3066559026 conn(0x7f8b28067b80 msgr2=0x7f8b281559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 shutdown_connections 2023-12-24T18:37:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:51.973+0000 7f8b27fff700 1 -- 172.21.15.50:0/3066559026 wait complete. 2023-12-24T18:37:52.003 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-12-24T18:37:52.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:52.004 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-12-24T18:37:52.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-12-24T18:37:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.249+0000 7f52ee785700 1 Processor -- start 2023-12-24T18:37:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.249+0000 7f52ee785700 1 -- start start 2023-12-24T18:37:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52ee785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52e80b1460 0x7f52e81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52ee785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e815b250 con 0x7f52e815b6e0 2023-12-24T18:37:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52ee785700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e80ae550 con 0x7f52e8154820 2023-12-24T18:37:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52ee785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e8158470 con 0x7f52e80b1460 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52e80b1460 0x7f52e81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52e80b1460 0x7f52e81574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34678/0 (socket says 172.21.15.50:34678) 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 -- 172.21.15.50:0/3334764687 learned_addr learned my addr 172.21.15.50:0/3334764687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 -- 172.21.15.50:0/3334764687 >> v1:172.21.15.82:6789/0 conn(0x7f52e8154820 legacy=0x7f52e80b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 -- 172.21.15.50:0/3334764687 >> v1:172.21.15.50:6789/0 conn(0x7f52e815b6e0 legacy=0x7f52e806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 -- 172.21.15.50:0/3334764687 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8158190 con 0x7f52e80b1460 2023-12-24T18:37:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52dffff700 1 --2- 172.21.15.50:0/3334764687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81574d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52d00099b0 tx=0x7f52d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25afbdebd2fd1287 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52e77fe700 1 -- 172.21.15.50:0/3334764687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000b860 con 0x7f52e80b1460 2023-12-24T18:37:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52e77fe700 1 -- 172.21.15.50:0/3334764687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000b9c0 con 0x7f52e80b1460 2023-12-24T18:37:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.253+0000 7f52e77fe700 1 -- 172.21.15.50:0/3334764687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000bd60 con 0x7f52e80b1460 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 -- 172.21.15.50:0/3334764687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 msgr2=0x7f52e81574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 --2- 172.21.15.50:0/3334764687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81574d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52d00099b0 tx=0x7f52d0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 -- 172.21.15.50:0/3334764687 shutdown_connections 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 --2- 172.21.15.50:0/3334764687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81574d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 -- 172.21.15.50:0/3334764687 >> 172.21.15.50:0/3334764687 conn(0x7f52e8067b80 msgr2=0x7f52e80ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 -- 172.21.15.50:0/3334764687 shutdown_connections 2023-12-24T18:37:52.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.257+0000 7f52ee785700 1 -- 172.21.15.50:0/3334764687 wait complete. 2023-12-24T18:37:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 Processor -- start 2023-12-24T18:37:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 -- start start 2023-12-24T18:37:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 0x7f52e80c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52e815b6e0 0x7f52e8159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80c5800 con 0x7f52e80b1460 2023-12-24T18:37:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80c5ae0 con 0x7f52e8154820 2023-12-24T18:37:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52ee785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80c5dc0 con 0x7f52e815b6e0 2023-12-24T18:37:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34692/0 (socket says 172.21.15.50:34692) 2023-12-24T18:37:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52e7fff700 1 -- 172.21.15.50:0/2552008112 learned_addr learned my addr 172.21.15.50:0/2552008112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.261+0000 7f52dffff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 0x7f52e80c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52ecd22700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52e815b6e0 0x7f52e8159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 -- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52e815b6e0 msgr2=0x7f52e8159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52e815b6e0 0x7f52e8159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 -- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 msgr2=0x7f52e80c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 0x7f52e80c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 -- 172.21.15.50:0/2552008112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00094f0 con 0x7f52e80b1460 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52dffff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 0x7f52e80c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e7fff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c590 tx=0x7f52d800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011590 con 0x7f52e80b1460 2023-12-24T18:37:52.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d80116f0 con 0x7f52e80b1460 2023-12-24T18:37:52.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011ab0 con 0x7f52e80b1460 2023-12-24T18:37:52.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e80c60a0 con 0x7f52e80b1460 2023-12-24T18:37:52.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e8169d50 con 0x7f52e80b1460 2023-12-24T18:37:52.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.265+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e816a000 con 0x7f52e80b1460 2023-12-24T18:37:52.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.269+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f52d801b3b0 con 0x7f52e80b1460 2023-12-24T18:37:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.269+0000 7f52e4ff9700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 0x7f52c8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.269+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f52d807c410 con 0x7f52e80b1460 2023-12-24T18:37:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.269+0000 7f52dffff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 0x7f52c8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.269+0000 7f52dffff700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 0x7f52c8062c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52e80aeaf0 tx=0x7f52d0017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.277+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52d804c4a0 con 0x7f52e80b1460 2023-12-24T18:37:52.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.473+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f52e8071060 con 0x7f52c8060750 2023-12-24T18:37:52.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.577+0000 7f52e4ff9700 1 -- 172.21.15.50:0/2552008112 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f52e8071060 con 0x7f52c8060750 2023-12-24T18:37:52.584 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir2 2023-12-24T18:37:52.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.581+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 msgr2=0x7f52c8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.581+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 0x7f52c8062c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52e80aeaf0 tx=0x7f52d0017000 comp rx=0 tx=0).stop 2023-12-24T18:37:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.581+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 msgr2=0x7f52e81496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.581+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c590 tx=0x7f52d800c950 comp rx=0 tx=0).stop 2023-12-24T18:37:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 shutdown_connections 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f52c8060750 0x7f52c8062c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52e815b6e0 0x7f52e8159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52e8154820 0x7f52e80c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 --2- 172.21.15.50:0/2552008112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52e80b1460 0x7f52e81496b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 >> 172.21.15.50:0/2552008112 conn(0x7f52e8067b80 msgr2=0x7f52e80c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 shutdown_connections 2023-12-24T18:37:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.585+0000 7f52ee785700 1 -- 172.21.15.50:0/2552008112 wait complete. 2023-12-24T18:37:52.614 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-12-24T18:37:52.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:52.615 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-12-24T18:37:52.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-12-24T18:37:52.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.857+0000 7f18f6ae3700 1 Processor -- start 2023-12-24T18:37:52.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.857+0000 7f18f6ae3700 1 -- start start 2023-12-24T18:37:52.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f6ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 0x7f18f006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f6ae3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 0x7f18f00c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f6ae3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f00c5f20 con 0x7f18f00c5ac0 2023-12-24T18:37:52.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f6ae3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f015dbd0 con 0x7f18f006a4a0 2023-12-24T18:37:52.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f6ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f006b5b0 con 0x7f18f0159080 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f62e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f18f00c5ac0 0x7f18f006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49142/0 (socket says 172.21.15.50:49142) 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f62e2700 1 -- 172.21.15.50:0/3989630740 learned_addr learned my addr 172.21.15.50:0/3989630740 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/3989630740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 0x7f18f006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f52e0700 1 --2- 172.21.15.50:0/3989630740 >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 0x7f18f00c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892815160 0 0) 0x7f18e8001490 con 0x7f18f00c5ac0 2023-12-24T18:37:52.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18dc003570 con 0x7f18f00c5ac0 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737567270 0 0) 0x7f18dc003570 con 0x7f18f00c5ac0 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 -- 172.21.15.50:0/3989630740 >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 msgr2=0x7f18f00c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/3989630740 >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 0x7f18f00c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 -- 172.21.15.50:0/3989630740 >> v1:172.21.15.50:6789/0 conn(0x7f18f00c5ac0 legacy=0x7f18f006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 -- 172.21.15.50:0/3989630740 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f006df80 con 0x7f18f0159080 2023-12-24T18:37:52.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f52e0700 1 --2- 172.21.15.50:0/3989630740 >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 0x7f18f00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:52.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.861+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/3989630740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 0x7f18f006da40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0098e0 tx=0x7f18ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b0c47b11a61d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8001980 con 0x7f18f0159080 2023-12-24T18:37:52.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec011420 con 0x7f18f0159080 2023-12-24T18:37:52.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f4adf700 1 -- 172.21.15.50:0/3989630740 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0117a0 con 0x7f18f0159080 2023-12-24T18:37:52.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 -- 172.21.15.50:0/3989630740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 msgr2=0x7f18f006da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/3989630740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 0x7f18f006da40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0098e0 tx=0x7f18ec0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 -- 172.21.15.50:0/3989630740 shutdown_connections 2023-12-24T18:37:52.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/3989630740 >> v2:172.21.15.82:3300/0 conn(0x7f18f006a4a0 0x7f18f00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/3989630740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f0159080 0x7f18f006da40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 -- 172.21.15.50:0/3989630740 >> 172.21.15.50:0/3989630740 conn(0x7f18f0067b80 msgr2=0x7f18f00cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:52.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 -- 172.21.15.50:0/3989630740 shutdown_connections 2023-12-24T18:37:52.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.865+0000 7f18f6ae3700 1 -- 172.21.15.50:0/3989630740 wait complete. 2023-12-24T18:37:52.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 Processor -- start 2023-12-24T18:37:52.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 -- start start 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f00c5ac0 0x7f18f01481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 0x7f18f016c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0148730 con 0x7f18f006a4a0 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00c6fd0 con 0x7f18f0159080 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f6ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0159690 con 0x7f18f00c5ac0 2023-12-24T18:37:52.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f5ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f5ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34706/0 (socket says 172.21.15.50:34706) 2023-12-24T18:37:52.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f5ae1700 1 -- 172.21.15.50:0/2687063663 learned_addr learned my addr 172.21.15.50:0/2687063663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:52.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f52e0700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f00c5ac0 0x7f18f01481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.869+0000 7f18f62e2700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 0x7f18f016c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 -- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f00c5ac0 msgr2=0x7f18f01481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f00c5ac0 0x7f18f01481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 -- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 msgr2=0x7f18f016c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 0x7f18f016c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 -- 172.21.15.50:0/2687063663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009420 con 0x7f18f006a4a0 2023-12-24T18:37:52.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f62e2700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 0x7f18f016c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f5ae1700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18f006b6f0 tx=0x7f18ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec01caf0 con 0x7f18f006a4a0 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec01cc70 con 0x7f18f006a4a0 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec009420 con 0x7f18f006a4a0 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec01a450 con 0x7f18f006a4a0 2023-12-24T18:37:52.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f00c9920 con 0x7f18f006a4a0 2023-12-24T18:37:52.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.873+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f004be40 con 0x7f18f006a4a0 2023-12-24T18:37:52.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.877+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f18ec01a7e0 con 0x7f18f006a4a0 2023-12-24T18:37:52.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.877+0000 7f18e5ffb700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 0x7f18d4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:52.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.877+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f18ec07e7e0 con 0x7f18f006a4a0 2023-12-24T18:37:52.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.877+0000 7f18f52e0700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 0x7f18d4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.881+0000 7f18f52e0700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 0x7f18d4062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18f016c780 tx=0x7f18e00091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:52.885+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18ec04e870 con 0x7f18f006a4a0 2023-12-24T18:37:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.077+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f00c7110 con 0x7f18d4060750 2023-12-24T18:37:53.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.193+0000 7f18e5ffb700 1 -- 172.21.15.50:0/2687063663 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f18e001a030 con 0x7f18d4060750 2023-12-24T18:37:53.198 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir3 2023-12-24T18:37:53.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 msgr2=0x7f18d4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 0x7f18d4062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18f016c780 tx=0x7f18e00091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 msgr2=0x7f18f01488f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18f006b6f0 tx=0x7f18ec016000 comp rx=0 tx=0).stop 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 shutdown_connections 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f18d4060750 0x7f18d4062c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0159080 0x7f18f016c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18f00c5ac0 0x7f18f01481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 --2- 172.21.15.50:0/2687063663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18f006a4a0 0x7f18f01488f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 >> 172.21.15.50:0/2687063663 conn(0x7f18f0067b80 msgr2=0x7f18f0149900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 shutdown_connections 2023-12-24T18:37:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.197+0000 7f18f6ae3700 1 -- 172.21.15.50:0/2687063663 wait complete. 2023-12-24T18:37:53.226 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-12-24T18:37:53.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:53.226 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-12-24T18:37:53.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-12-24T18:37:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.477+0000 7f8417545700 1 Processor -- start 2023-12-24T18:37:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.477+0000 7f8417545700 1 -- start start 2023-12-24T18:37:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8417545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 0x7f841015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8417545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8417545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841006d4d0 con 0x7f84100b4060 2023-12-24T18:37:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8417545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100b44e0 con 0x7f8410156b50 2023-12-24T18:37:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8417545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100b4960 con 0x7f841006db90 2023-12-24T18:37:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:46350/0 (socket says 172.21.15.50:46350) 2023-12-24T18:37:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 -- 172.21.15.50:0/227736373 learned_addr learned my addr 172.21.15.50:0/227736373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f84152e1700 1 --2- 172.21.15.50:0/227736373 >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 0x7f841015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 -- 172.21.15.50:0/227736373 >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 msgr2=0x7f841015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 --2- 172.21.15.50:0/227736373 >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 0x7f841015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 -- 172.21.15.50:0/227736373 >> v1:172.21.15.82:6789/0 conn(0x7f84100b4060 legacy=0x7f841015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f8414ae0700 1 -- 172.21.15.50:0/227736373 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841015a620 con 0x7f841006db90 2023-12-24T18:37:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.481+0000 7f84152e1700 1 --2- 172.21.15.50:0/227736373 >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 0x7f841015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8414ae0700 1 --2- 172.21.15.50:0/227736373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9ed1f9c15bfe40 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8407fff700 1 -- 172.21.15.50:0/227736373 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000b860 con 0x7f841006db90 2023-12-24T18:37:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8407fff700 1 -- 172.21.15.50:0/227736373 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000b9c0 con 0x7f841006db90 2023-12-24T18:37:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8407fff700 1 -- 172.21.15.50:0/227736373 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000bd60 con 0x7f841006db90 2023-12-24T18:37:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 -- 172.21.15.50:0/227736373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 msgr2=0x7f84100b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 --2- 172.21.15.50:0/227736373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400009250 comp rx=0 tx=0).stop 2023-12-24T18:37:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 -- 172.21.15.50:0/227736373 shutdown_connections 2023-12-24T18:37:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 --2- 172.21.15.50:0/227736373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f841006db90 0x7f84100b3b20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 --2- 172.21.15.50:0/227736373 >> v2:172.21.15.82:3300/0 conn(0x7f8410156b50 0x7f841015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 -- 172.21.15.50:0/227736373 >> 172.21.15.50:0/227736373 conn(0x7f8410067b40 msgr2=0x7f84100b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 -- 172.21.15.50:0/227736373 shutdown_connections 2023-12-24T18:37:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.485+0000 7f8417545700 1 -- 172.21.15.50:0/227736373 wait complete. 2023-12-24T18:37:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 Processor -- start 2023-12-24T18:37:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 -- start start 2023-12-24T18:37:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 0x7f841014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8410156b50 0x7f841015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841016d820 con 0x7f841006db90 2023-12-24T18:37:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841016cc10 con 0x7f8410156b50 2023-12-24T18:37:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.489+0000 7f8417545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841016cef0 con 0x7f84100b4060 2023-12-24T18:37:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34718/0 (socket says 172.21.15.50:34718) 2023-12-24T18:37:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 -- 172.21.15.50:0/3593436099 learned_addr learned my addr 172.21.15.50:0/3593436099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f8414ae0700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 0x7f841014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f8415ae2700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8410156b50 0x7f841015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 -- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 msgr2=0x7f841014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 0x7f841014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 -- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8410156b50 msgr2=0x7f841015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8410156b50 0x7f841015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 -- 172.21.15.50:0/3593436099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000094f0 con 0x7f841006db90 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f8414ae0700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 0x7f841014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84152e1700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f840c00d860 tx=0x7f840c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c0125f0 con 0x7f841006db90 2023-12-24T18:37:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c012750 con 0x7f841006db90 2023-12-24T18:37:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c012ad0 con 0x7f841006db90 2023-12-24T18:37:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841016d1d0 con 0x7f841006db90 2023-12-24T18:37:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.493+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841014f080 con 0x7f841006db90 2023-12-24T18:37:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410071060 con 0x7f841006db90 2023-12-24T18:37:53.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f840c014430 con 0x7f841006db90 2023-12-24T18:37:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f84057fa700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 0x7f83f4062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f840c07d260 con 0x7f841006db90 2023-12-24T18:37:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f8414ae0700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 0x7f83f4062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.497+0000 7f8414ae0700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 0x7f83f4062c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:53.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.505+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f840c050d80 con 0x7f841006db90 2023-12-24T18:37:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.697+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f841016d960 con 0x7f83f4060780 2023-12-24T18:37:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.809+0000 7f84057fa700 1 -- 172.21.15.50:0/3593436099 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f840000bb30 con 0x7f83f4060780 2023-12-24T18:37:53.814 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir4 2023-12-24T18:37:53.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 msgr2=0x7f83f4062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 0x7f83f4062c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84000099b0 tx=0x7f8400017000 comp rx=0 tx=0).stop 2023-12-24T18:37:53.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 msgr2=0x7f8410152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:53.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f840c00d860 tx=0x7f840c008040 comp rx=0 tx=0).stop 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 shutdown_connections 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f83f4060780 0x7f83f4062c30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8410156b50 0x7f841015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84100b4060 0x7f841014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 --2- 172.21.15.50:0/3593436099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006db90 0x7f8410152750 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 >> 172.21.15.50:0/3593436099 conn(0x7f8410067b40 msgr2=0x7f84100b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:53.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 shutdown_connections 2023-12-24T18:37:53.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:53.813+0000 7f8417545700 1 -- 172.21.15.50:0/3593436099 wait complete. 2023-12-24T18:37:53.840 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-12-24T18:37:53.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:53.840 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-12-24T18:37:53.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-12-24T18:37:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.077+0000 7f8ecd2cd700 1 Processor -- start 2023-12-24T18:37:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.077+0000 7f8ecd2cd700 1 -- start start 2023-12-24T18:37:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ecd2cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ec8160aa0 0x7f8ec80aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ecd2cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80cb760 con 0x7f8ec81606d0 2023-12-24T18:37:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ecd2cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec8160f00 con 0x7f8ec80ca200 2023-12-24T18:37:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ecd2cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80b16a0 con 0x7f8ec8160aa0 2023-12-24T18:37:54.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ec81606d0 0x7f8ec80cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49154/0 (socket says 172.21.15.50:49154) 2023-12-24T18:37:54.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec6ffd700 1 -- 172.21.15.50:0/973788317 learned_addr learned my addr 172.21.15.50:0/973788317 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:54.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec77fe700 1 --2- 172.21.15.50:0/973788317 >> v2:172.21.15.82:3300/0 conn(0x7f8ec8160aa0 0x7f8ec80aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465935991 0 0) 0x7f8ec80cb760 con 0x7f8ec81606d0 2023-12-24T18:37:54.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb4003570 con 0x7f8ec81606d0 2023-12-24T18:37:54.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411946166 0 0) 0x7f8ec8160f00 con 0x7f8ec80ca200 2023-12-24T18:37:54.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec80cb760 con 0x7f8ec80ca200 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882515403 0 0) 0x7f8eb4003570 con 0x7f8ec81606d0 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 >> v2:172.21.15.82:3300/0 conn(0x7f8ec8160aa0 msgr2=0x7f8ec80aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 --2- 172.21.15.50:0/973788317 >> v2:172.21.15.82:3300/0 conn(0x7f8ec8160aa0 0x7f8ec80aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 >> v1:172.21.15.82:6789/0 conn(0x7f8ec80ca200 legacy=0x7f8ec806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec806c820 con 0x7f8ec81606d0 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f8eb80017f0 con 0x7f8ec81606d0 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 >> v1:172.21.15.50:6789/0 conn(0x7f8ec81606d0 legacy=0x7f8ec80cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4003bf0 0x7f8eb4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80b16a0 con 0x7f8eb4004810 2023-12-24T18:37:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb400c0b0 con 0x7f8eb4003bf0 2023-12-24T18:37:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.081+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb400c270 con 0x7f8eb40051c0 2023-12-24T18:37:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec6ffd700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4003bf0 0x7f8eb4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec77fe700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb40051c0 msgr2=0x7f8eb400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4003bf0 msgr2=0x7f8eb4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4003bf0 0x7f8eb4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/973788317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4003570 con 0x7f8eb4004810 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec77fe700 1 -- 172.21.15.50:0/973788317 reap_dead start 2023-12-24T18:37:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec6ffd700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4003bf0 0x7f8eb4003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00019e0 tx=0x7f8eb0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d51ce693646bb42 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000c590 con 0x7f8eb4004810 2023-12-24T18:37:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000c6f0 con 0x7f8eb4004810 2023-12-24T18:37:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ec67fc700 1 -- 172.21.15.50:0/973788317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000ca90 con 0x7f8eb4004810 2023-12-24T18:37:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 msgr2=0x7f8eb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00019e0 tx=0x7f8eb0007d30 comp rx=0 tx=0).stop 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/973788317 shutdown_connections 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/973788317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/973788317 >> 172.21.15.50:0/973788317 conn(0x7f8ec8067b80 msgr2=0x7f8ec80cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/973788317 shutdown_connections 2023-12-24T18:37:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.085+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/973788317 wait complete. 2023-12-24T18:37:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.089+0000 7f8ecd2cd700 1 Processor -- start 2023-12-24T18:37:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.089+0000 7f8ecd2cd700 1 -- start start 2023-12-24T18:37:54.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4004810 0x7f8ec80c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 0x7f8ec80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80b0760 con 0x7f8ec80c5120 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80c0220 con 0x7f8eb4004810 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80c56a0 con 0x7f8ec80afd80 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34734/0 (socket says 172.21.15.50:34734) 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/2458145778 learned_addr learned my addr 172.21.15.50:0/2458145778 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:54.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ec6ffd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4004810 0x7f8ec80c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ec77fe700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 0x7f8ec80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 msgr2=0x7f8ec80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 0x7f8ec80b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4004810 msgr2=0x7f8ec80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4004810 0x7f8ec80c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 -- 172.21.15.50:0/2458145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80c5980 con 0x7f8ec80c5120 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ec77fe700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 0x7f8ec80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebe7fc700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400c080 tx=0x7f8eb0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000c590 con 0x7f8ec80c5120 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000ce40 con 0x7f8ec80c5120 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec80bfbd0 con 0x7f8ec80c5120 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0007b10 con 0x7f8ec80c5120 2023-12-24T18:37:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.093+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec80c3060 con 0x7f8ec80c5120 2023-12-24T18:37:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec80c03d0 con 0x7f8ec80c5120 2023-12-24T18:37:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f8eb0019030 con 0x7f8ec80c5120 2023-12-24T18:37:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ebf7fe700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 0x7f8ea8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f8eb007e4a0 con 0x7f8ec80c5120 2023-12-24T18:37:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ec6ffd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 0x7f8ea8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.097+0000 7f8ec6ffd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 0x7f8ea8062c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8001460 tx=0x7f8eb8006040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.105+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8ec80c03d0 con 0x7f8ec80c5120 2023-12-24T18:37:54.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.309+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ec80b0760 con 0x7f8ea8060750 2023-12-24T18:37:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.413+0000 7f8ebf7fe700 1 -- 172.21.15.50:0/2458145778 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8ec80b0760 con 0x7f8ea8060750 2023-12-24T18:37:54.418 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir5 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 msgr2=0x7f8ea8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 0x7f8ea8062c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8001460 tx=0x7f8eb8006040 comp rx=0 tx=0).stop 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 msgr2=0x7f8ec815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400c080 tx=0x7f8eb0015000 comp rx=0 tx=0).stop 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 shutdown_connections 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8ea8060750 0x7f8ea8062c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ec80afd80 0x7f8ec80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec80c5120 0x7f8ec815bfb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 --2- 172.21.15.50:0/2458145778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4004810 0x7f8ec80c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 >> 172.21.15.50:0/2458145778 conn(0x7f8ec8067b80 msgr2=0x7f8ec815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 shutdown_connections 2023-12-24T18:37:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.417+0000 7f8ecd2cd700 1 -- 172.21.15.50:0/2458145778 wait complete. 2023-12-24T18:37:54.442 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-12-24T18:37:54.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:54.442 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-12-24T18:37:54.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-12-24T18:37:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.693+0000 7fb047a78700 1 Processor -- start 2023-12-24T18:37:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.693+0000 7fb047a78700 1 -- start start 2023-12-24T18:37:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0400b4230 0x7fb04015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb04006db90 0x7fb04006a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04006d4d0 con 0x7fb040156b50 2023-12-24T18:37:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400b4960 con 0x7fb0400b4230 2023-12-24T18:37:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04015a620 con 0x7fb04006db90 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0400b4230 0x7fb04015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0400b4230 0x7fb04015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34736/0 (socket says 172.21.15.50:34736) 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 -- 172.21.15.50:0/1188702878 learned_addr learned my addr 172.21.15.50:0/1188702878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb046015700 1 --2- 172.21.15.50:0/1188702878 >> v2:172.21.15.82:3300/0 conn(0x7fb04006db90 0x7fb04006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 -- 172.21.15.50:0/1188702878 >> v2:172.21.15.82:3300/0 conn(0x7fb04006db90 msgr2=0x7fb04006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 --2- 172.21.15.50:0/1188702878 >> v2:172.21.15.82:3300/0 conn(0x7fb04006db90 0x7fb04006a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 -- 172.21.15.50:0/1188702878 >> v1:172.21.15.82:6789/0 conn(0x7fb040156b50 legacy=0x7fb0400b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 -- 172.21.15.50:0/1188702878 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04006c8c0 con 0x7fb0400b4230 2023-12-24T18:37:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb045013700 1 --2- 172.21.15.50:0/1188702878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb04015a0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb04006e950 tx=0x7fb030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be6cbf5ab173bfa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb044812700 1 -- 172.21.15.50:0/1188702878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000b860 con 0x7fb0400b4230 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb044812700 1 -- 172.21.15.50:0/1188702878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000b9c0 con 0x7fb0400b4230 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb044812700 1 -- 172.21.15.50:0/1188702878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000bd60 con 0x7fb0400b4230 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- 172.21.15.50:0/1188702878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 msgr2=0x7fb04015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 --2- 172.21.15.50:0/1188702878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb04015a0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb04006e950 tx=0x7fb030009250 comp rx=0 tx=0).stop 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- 172.21.15.50:0/1188702878 shutdown_connections 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 --2- 172.21.15.50:0/1188702878 >> v2:172.21.15.82:3300/0 conn(0x7fb04006db90 0x7fb04006a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 --2- 172.21.15.50:0/1188702878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb04015a0e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- 172.21.15.50:0/1188702878 >> 172.21.15.50:0/1188702878 conn(0x7fb040067b40 msgr2=0x7fb0400b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- 172.21.15.50:0/1188702878 shutdown_connections 2023-12-24T18:37:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.697+0000 7fb047a78700 1 -- 172.21.15.50:0/1188702878 wait complete. 2023-12-24T18:37:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.701+0000 7fb047a78700 1 Processor -- start 2023-12-24T18:37:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.701+0000 7fb047a78700 1 -- start start 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 0x7fb0401695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb040156b50 0x7fb040153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400adc00 con 0x7fb0400b4230 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400ae090 con 0x7fb040156b50 2023-12-24T18:37:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400acd20 con 0x7fb04006db90 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34740/0 (socket says 172.21.15.50:34740) 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 -- 172.21.15.50:0/1270711909 learned_addr learned my addr 172.21.15.50:0/1270711909 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045814700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 0x7fb0401695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb046015700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb040156b50 0x7fb040153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 -- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 msgr2=0x7fb0401695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 0x7fb0401695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 -- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb040156b50 msgr2=0x7fb040153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb040156b50 0x7fb040153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 -- 172.21.15.50:0/1270711909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300094f0 con 0x7fb0400b4230 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045814700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 0x7fb0401695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb045013700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb040068030 tx=0x7fb030017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030024440 con 0x7fb0400b4230 2023-12-24T18:37:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0300245a0 con 0x7fb0400b4230 2023-12-24T18:37:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0400acff0 con 0x7fb0400b4230 2023-12-24T18:37:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.705+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030024960 con 0x7fb0400b4230 2023-12-24T18:37:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.709+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0400ad5b0 con 0x7fb0400b4230 2023-12-24T18:37:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.709+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb040071060 con 0x7fb0400b4230 2023-12-24T18:37:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.709+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7fb03001a420 con 0x7fb0400b4230 2023-12-24T18:37:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.713+0000 7fb035ffb700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 0x7fb024062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.713+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fb03007eb80 con 0x7fb0400b4230 2023-12-24T18:37:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.713+0000 7fb045814700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 0x7fb024062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.713+0000 7fb045814700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 0x7fb024062c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb03c001d20 tx=0x7fb03c009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.717+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb03004ec10 con 0x7fb0400b4230 2023-12-24T18:37:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:54.929+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb04006cba0 con 0x7fb024060750 2023-12-24T18:37:55.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.037+0000 7fb035ffb700 1 -- 172.21.15.50:0/1270711909 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb04006cba0 con 0x7fb024060750 2023-12-24T18:37:55.044 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir6 2023-12-24T18:37:55.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 msgr2=0x7fb024062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 0x7fb024062c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb03c001d20 tx=0x7fb03c009040 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 msgr2=0x7fb0400ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb040068030 tx=0x7fb030017000 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 shutdown_connections 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb024060750 0x7fb024062c00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb040156b50 0x7fb040153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0400b4230 0x7fb0400ac7e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 --2- 172.21.15.50:0/1270711909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb04006db90 0x7fb0401695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 >> 172.21.15.50:0/1270711909 conn(0x7fb040067b40 msgr2=0x7fb04015aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 shutdown_connections 2023-12-24T18:37:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.041+0000 7fb047a78700 1 -- 172.21.15.50:0/1270711909 wait complete. 2023-12-24T18:37:55.071 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-12-24T18:37:55.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:55.072 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-12-24T18:37:55.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-12-24T18:37:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 Processor -- start 2023-12-24T18:37:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 -- start start 2023-12-24T18:37:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78101591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781006aa80 con 0x7f78100ce470 2023-12-24T18:37:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100cc0b0 con 0x7f7810158dd0 2023-12-24T18:37:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7815e8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100cc390 con 0x7f78100b2cf0 2023-12-24T18:37:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7814e8c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7810158dd0 0x7f78100cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42456/0 (socket says 172.21.15.50:42456) 2023-12-24T18:37:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f7814e8c700 1 -- 172.21.15.50:0/3924392549 learned_addr learned my addr 172.21.15.50:0/3924392549 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f780ffff700 1 --2- 172.21.15.50:0/3924392549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78101591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.313+0000 7f781568d700 1 --1- 172.21.15.50:0/3924392549 >> v1:172.21.15.50:6789/0 conn(0x7f78100ce470 0x7f781006af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49160/0 (socket says 172.21.15.50:49160) 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780ffff700 1 -- 172.21.15.50:0/3924392549 >> v1:172.21.15.82:6789/0 conn(0x7f7810158dd0 legacy=0x7f78100cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780ffff700 1 -- 172.21.15.50:0/3924392549 >> v1:172.21.15.50:6789/0 conn(0x7f78100ce470 legacy=0x7f781006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780ffff700 1 -- 172.21.15.50:0/3924392549 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781006a430 con 0x7f78100b2cf0 2023-12-24T18:37:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780f7fe700 1 -- 172.21.15.50:0/3924392549 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378191150 0 0) 0x7f781006aa80 con 0x7f78100ce470 2023-12-24T18:37:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780ffff700 1 --2- 172.21.15.50:0/3924392549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78101591a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009900 tx=0x7f77fc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d5e44417a69802 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780f7fe700 1 -- 172.21.15.50:0/3924392549 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc009ea0 con 0x7f78100b2cf0 2023-12-24T18:37:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780f7fe700 1 -- 172.21.15.50:0/3924392549 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc005c10 con 0x7f78100b2cf0 2023-12-24T18:37:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f780f7fe700 1 -- 172.21.15.50:0/3924392549 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00b650 con 0x7f78100b2cf0 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 -- 172.21.15.50:0/3924392549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 msgr2=0x7f78101591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 --2- 172.21.15.50:0/3924392549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78101591a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009900 tx=0x7f77fc009120 comp rx=0 tx=0).stop 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 -- 172.21.15.50:0/3924392549 shutdown_connections 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 --2- 172.21.15.50:0/3924392549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78101591a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 -- 172.21.15.50:0/3924392549 >> 172.21.15.50:0/3924392549 conn(0x7f7810067b80 msgr2=0x7f78100cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 -- 172.21.15.50:0/3924392549 shutdown_connections 2023-12-24T18:37:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 -- 172.21.15.50:0/3924392549 wait complete. 2023-12-24T18:37:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.317+0000 7f7815e8e700 1 Processor -- start 2023-12-24T18:37:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- start start 2023-12-24T18:37:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78100b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7810158dd0 0x7f78100cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810172300 con 0x7f78100ce470 2023-12-24T18:37:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100b1b00 con 0x7f7810158dd0 2023-12-24T18:37:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100b1f90 con 0x7f78100b2cf0 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34744/0 (socket says 172.21.15.50:34744) 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 -- 172.21.15.50:0/2400232747 learned_addr learned my addr 172.21.15.50:0/2400232747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7814e8c700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78100b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f781568d700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7810158dd0 0x7f78100cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 -- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 msgr2=0x7f78100b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78100b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 -- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7810158dd0 msgr2=0x7f78100cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7810158dd0 0x7f78100cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 -- 172.21.15.50:0/2400232747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0093c0 con 0x7f78100ce470 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780ffff700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009390 tx=0x7f77fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0064a0 con 0x7f78100ce470 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc006620 con 0x7f78100ce470 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100b1210 con 0x7f78100ce470 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc01b480 con 0x7f78100ce470 2023-12-24T18:37:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.321+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100b1790 con 0x7f78100ce470 2023-12-24T18:37:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.325+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78100b1c70 con 0x7f78100ce470 2023-12-24T18:37:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.325+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f77fc01b7f0 con 0x7f78100ce470 2023-12-24T18:37:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.325+0000 7f780cff9700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 0x7f77f4062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.329+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f77fc07f1a0 con 0x7f78100ce470 2023-12-24T18:37:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.329+0000 7f7814e8c700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 0x7f77f4062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.329+0000 7f7814e8c700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 0x7f77f4062c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7804001780 tx=0x7f7804009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.333+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77fc04f230 con 0x7f78100ce470 2023-12-24T18:37:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.529+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f781004be40 con 0x7f77f4060780 2023-12-24T18:37:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.641+0000 7f780cff9700 1 -- 172.21.15.50:0/2400232747 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f781004be40 con 0x7f77f4060780 2023-12-24T18:37:55.645 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir7 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 msgr2=0x7f77f4062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 0x7f77f4062c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7804001780 tx=0x7f7804009040 comp rx=0 tx=0).stop 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 msgr2=0x7f7810171dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009390 tx=0x7f77fc016000 comp rx=0 tx=0).stop 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 shutdown_connections 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77f4060780 0x7f77f4062c30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7810158dd0 0x7f78100cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100ce470 0x7f7810171dc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 --2- 172.21.15.50:0/2400232747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78100b2cf0 0x7f78100b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 >> 172.21.15.50:0/2400232747 conn(0x7f7810067b80 msgr2=0x7f78100b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 shutdown_connections 2023-12-24T18:37:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.645+0000 7f7815e8e700 1 -- 172.21.15.50:0/2400232747 wait complete. 2023-12-24T18:37:55.674 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-12-24T18:37:55.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:55.674 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-12-24T18:37:55.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-12-24T18:37:55.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:37:55.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:37:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.901+0000 7f966e723700 1 Processor -- start 2023-12-24T18:37:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.901+0000 7f966e723700 1 -- start start 2023-12-24T18:37:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966e723700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9668158dd0 0x7f96681591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966e723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 0x7f96680cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966e723700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966806aa80 con 0x7f96680cbbe0 2023-12-24T18:37:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966e723700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96680cc0b0 con 0x7f9668158dd0 2023-12-24T18:37:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966e723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680cc390 con 0x7f96680b2cf0 2023-12-24T18:37:55.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966df22700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96680cbbe0 0x7f96680ce470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49164/0 (socket says 172.21.15.50:49164) 2023-12-24T18:37:55.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966df22700 1 -- 172.21.15.50:0/1819925960 learned_addr learned my addr 172.21.15.50:0/1819925960 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:55.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.905+0000 7f966d721700 1 --2- 172.21.15.50:0/1819925960 >> v2:172.21.15.50:3300/0 conn(0x7f9668158dd0 0x7f96681591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966cf20700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 0x7f96680cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174468723 0 0) 0x7f966806aa80 con 0x7f96680cbbe0 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9654003570 con 0x7f96680cbbe0 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448770009 0 0) 0x7f9654003570 con 0x7f96680cbbe0 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966d721700 1 -- 172.21.15.50:0/1819925960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 msgr2=0x7f96680cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966d721700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 0x7f96680cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966d721700 1 -- 172.21.15.50:0/1819925960 >> v1:172.21.15.50:6789/0 conn(0x7f96680cbbe0 legacy=0x7f96680ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966d721700 1 -- 172.21.15.50:0/1819925960 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966806a430 con 0x7f9668158dd0 2023-12-24T18:37:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966cf20700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 0x7f96680cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:55.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966d721700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96681591a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9664009910 tx=0x7f96640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55e09b9ac2c170f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600017f0 con 0x7f9668158dd0 2023-12-24T18:37:55.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664011420 con 0x7f9668158dd0 2023-12-24T18:37:55.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f965ffff700 1 -- 172.21.15.50:0/1819925960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640117a0 con 0x7f9668158dd0 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 -- 172.21.15.50:0/1819925960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 msgr2=0x7f96681591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96681591a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9664009910 tx=0x7f96640091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 -- 172.21.15.50:0/1819925960 shutdown_connections 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680b2cf0 0x7f96680cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 --2- 172.21.15.50:0/1819925960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96681591a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.909+0000 7f966e723700 1 -- 172.21.15.50:0/1819925960 >> 172.21.15.50:0/1819925960 conn(0x7f9668067b80 msgr2=0x7f96680cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.913+0000 7f966e723700 1 -- 172.21.15.50:0/1819925960 shutdown_connections 2023-12-24T18:37:55.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.913+0000 7f966e723700 1 -- 172.21.15.50:0/1819925960 wait complete. 2023-12-24T18:37:55.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.913+0000 7f966e723700 1 Processor -- start 2023-12-24T18:37:55.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.913+0000 7f966e723700 1 -- start start 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96680b2cf0 0x7f966815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680cbbe0 0x7f966814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966815e1b0 con 0x7f9668158dd0 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966815e910 con 0x7f96680b2cf0 2023-12-24T18:37:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966815a3b0 con 0x7f96680cbbe0 2023-12-24T18:37:55.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34758/0 (socket says 172.21.15.50:34758) 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 -- 172.21.15.50:0/3599649917 learned_addr learned my addr 172.21.15.50:0/3599649917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966cf20700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680cbbe0 0x7f966814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966d721700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96680b2cf0 0x7f966815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 -- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680cbbe0 msgr2=0x7f966814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680cbbe0 0x7f966814eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 -- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96680b2cf0 msgr2=0x7f966815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96680b2cf0 0x7f966815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 -- 172.21.15.50:0/3599649917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580093c0 con 0x7f9668158dd0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966df22700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f966000cc10 tx=0x7f9660007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660004e90 con 0x7f9668158dd0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966000a5d0 con 0x7f9668158dd0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966000a970 con 0x7f9668158dd0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.917+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664009420 con 0x7f9668158dd0 2023-12-24T18:37:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.921+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680b4e10 con 0x7f9668158dd0 2023-12-24T18:37:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.921+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966806b600 con 0x7f9668158dd0 2023-12-24T18:37:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.921+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f9660007150 con 0x7f9668158dd0 2023-12-24T18:37:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.925+0000 7f965d7fa700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 0x7f964c062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.925+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f966007c910 con 0x7f9668158dd0 2023-12-24T18:37:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.925+0000 7f966d721700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 0x7f964c062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.925+0000 7f966d721700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 0x7f964c062d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96640091e0 tx=0x7f9664016000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:55.929+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f966806b600 con 0x7f9668158dd0 2023-12-24T18:37:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.125+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f966806b600 con 0x7f964c060850 2023-12-24T18:37:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.241+0000 7f965d7fa700 1 -- 172.21.15.50:0/3599649917 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f966806b600 con 0x7f964c060850 2023-12-24T18:37:56.247 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir8 2023-12-24T18:37:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 msgr2=0x7f964c062d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 0x7f964c062d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96640091e0 tx=0x7f9664016000 comp rx=0 tx=0).stop 2023-12-24T18:37:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 msgr2=0x7f96680c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f966000cc10 tx=0x7f9660007c70 comp rx=0 tx=0).stop 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 shutdown_connections 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f964c060850 0x7f964c062d00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9668158dd0 0x7f96680c8570 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96680cbbe0 0x7f966814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 --2- 172.21.15.50:0/3599649917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96680b2cf0 0x7f966815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 >> 172.21.15.50:0/3599649917 conn(0x7f9668067b80 msgr2=0x7f96680cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 shutdown_connections 2023-12-24T18:37:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.245+0000 7f966e723700 1 -- 172.21.15.50:0/3599649917 wait complete. 2023-12-24T18:37:56.272 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-12-24T18:37:56.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:37:56.272 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-12-24T18:37:56.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-12-24T18:37:56.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.521+0000 7f799a065700 1 Processor -- start 2023-12-24T18:37:56.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.521+0000 7f799a065700 1 -- start start 2023-12-24T18:37:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f799a065700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79941547b0 0x7f79940c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f799a065700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f799415aa60 0x7f799415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f799a065700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79940cc0d0 con 0x7f7994154b80 2023-12-24T18:37:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f799a065700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799415b440 con 0x7f79941547b0 2023-12-24T18:37:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f799a065700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79940cc3b0 con 0x7f799415aa60 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79941547b0 0x7f79940c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79941547b0 0x7f79940c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34772/0 (socket says 172.21.15.50:34772) 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 -- 172.21.15.50:0/1021081366 learned_addr learned my addr 172.21.15.50:0/1021081366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f7992ffd700 1 --1- 172.21.15.50:0/1021081366 >> v1:172.21.15.50:6789/0 conn(0x7f7994154b80 0x7f799406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49178/0 (socket says 172.21.15.50:49178) 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f7993fff700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f799415aa60 0x7f799415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 -- 172.21.15.50:0/1021081366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f799415aa60 msgr2=0x7f799415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f799415aa60 0x7f799415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 -- 172.21.15.50:0/1021081366 >> v1:172.21.15.50:6789/0 conn(0x7f7994154b80 legacy=0x7f799406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 -- 172.21.15.50:0/1021081366 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799406da10 con 0x7f79941547b0 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79927fc700 1 -- 172.21.15.50:0/1021081366 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373021400 0 0) 0x7f79940cc0d0 con 0x7f7994154b80 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79937fe700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79941547b0 0x7f79940c91c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f79840099b0 tx=0x7f7984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca3eed42a9d39bd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79927fc700 1 -- 172.21.15.50:0/1021081366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984009ea0 con 0x7f79941547b0 2023-12-24T18:37:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79927fc700 1 -- 172.21.15.50:0/1021081366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400b860 con 0x7f79941547b0 2023-12-24T18:37:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.525+0000 7f79927fc700 1 -- 172.21.15.50:0/1021081366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400bc00 con 0x7f79941547b0 2023-12-24T18:37:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- 172.21.15.50:0/1021081366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79941547b0 msgr2=0x7f79940c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79941547b0 0x7f79940c91c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f79840099b0 tx=0x7f7984009250 comp rx=0 tx=0).stop 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- 172.21.15.50:0/1021081366 shutdown_connections 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f799415aa60 0x7f799415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 --2- 172.21.15.50:0/1021081366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79941547b0 0x7f79940c91c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- 172.21.15.50:0/1021081366 >> 172.21.15.50:0/1021081366 conn(0x7f7994069d90 msgr2=0x7f79940cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- 172.21.15.50:0/1021081366 shutdown_connections 2023-12-24T18:37:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- 172.21.15.50:0/1021081366 wait complete. 2023-12-24T18:37:56.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 Processor -- start 2023-12-24T18:37:56.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.529+0000 7f799a065700 1 -- start start 2023-12-24T18:37:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79941547b0 0x7f799416d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994154b80 0x7f79940c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799416e190 con 0x7f799415aa60 2023-12-24T18:37:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799416d700 con 0x7f7994154b80 2023-12-24T18:37:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79940c5890 con 0x7f79941547b0 2023-12-24T18:37:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34778/0 (socket says 172.21.15.50:34778) 2023-12-24T18:37:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 -- 172.21.15.50:0/2597799835 learned_addr learned my addr 172.21.15.50:0/2597799835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f79937fe700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79941547b0 0x7f799416d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7992ffd700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994154b80 0x7f79940c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 -- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79941547b0 msgr2=0x7f799416d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79941547b0 0x7f799416d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 -- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994154b80 msgr2=0x7f79940c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994154b80 0x7f79940c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 -- 172.21.15.50:0/2597799835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840094f0 con 0x7f799415aa60 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f7993fff700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f798c009e20 tx=0x7f798c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00ca40 con 0x7f799415aa60 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940c6cb0 con 0x7f799415aa60 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00f040 con 0x7f799415aa60 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00ce10 con 0x7f799415aa60 2023-12-24T18:37:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.533+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799416deb0 con 0x7f799415aa60 2023-12-24T18:37:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.537+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994071060 con 0x7f799415aa60 2023-12-24T18:37:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.537+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f798c014690 con 0x7f799415aa60 2023-12-24T18:37:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.537+0000 7f797b7fe700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 0x7f7980062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.541+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f798c07d720 con 0x7f799415aa60 2023-12-24T18:37:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.541+0000 7f79937fe700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 0x7f7980062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.541+0000 7f79937fe700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 0x7f7980062c00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79840099b0 tx=0x7f7984017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.545+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f798c04d750 con 0x7f799415aa60 2023-12-24T18:37:56.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.741+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f799406dcf0 con 0x7f7980060750 2023-12-24T18:37:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.857+0000 7f797b7fe700 1 -- 172.21.15.50:0/2597799835 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f799406dcf0 con 0x7f7980060750 2023-12-24T18:37:56.863 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/dir9 2023-12-24T18:37:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 msgr2=0x7f7980062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 0x7f7980062c00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79840099b0 tx=0x7f7984017000 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 msgr2=0x7f79941592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f798c009e20 tx=0x7f798c00b040 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 shutdown_connections 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7980060750 0x7f7980062c00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799415aa60 0x7f79941592f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994154b80 0x7f79940c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 --2- 172.21.15.50:0/2597799835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79941547b0 0x7f799416d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 >> 172.21.15.50:0/2597799835 conn(0x7f7994069d90 msgr2=0x7f7994157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 shutdown_connections 2023-12-24T18:37:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:56.861+0000 7f799a065700 1 -- 172.21.15.50:0/2597799835 wait complete. 2023-12-24T18:37:56.888 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-12-24T18:37:56.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-12-24T18:37:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.073+0000 7f8b35825700 1 Processor -- start 2023-12-24T18:37:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.073+0000 7f8b35825700 1 -- start start 2023-12-24T18:37:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b35825700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b30156b50 0x7f8b3015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b35825700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b300b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b35825700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3006d4d0 con 0x7f8b300b4060 2023-12-24T18:37:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b35825700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b300b44e0 con 0x7f8b30156b50 2023-12-24T18:37:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b35825700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300b4960 con 0x7f8b3006db90 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b2f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b300b4060 0x7f8b3015ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49192/0 (socket says 172.21.15.50:49192) 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/2993304482 learned_addr learned my addr 172.21.15.50:0/2993304482 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b2effd700 1 --2- 172.21.15.50:0/2993304482 >> v2:172.21.15.82:3300/0 conn(0x7f8b30156b50 0x7f8b3015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.077+0000 7f8b2e7fc700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b300b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2dffb700 1 -- 172.21.15.50:0/2993304482 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385567320 0 0) 0x7f8b3006d4d0 con 0x7f8b300b4060 2023-12-24T18:37:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2dffb700 1 -- 172.21.15.50:0/2993304482 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b18003570 con 0x7f8b300b4060 2023-12-24T18:37:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2effd700 1 -- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 msgr2=0x7f8b300b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2effd700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b300b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2effd700 1 -- 172.21.15.50:0/2993304482 >> v1:172.21.15.50:6789/0 conn(0x7f8b300b4060 legacy=0x7f8b3015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2effd700 1 -- 172.21.15.50:0/2993304482 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3015a620 con 0x7f8b30156b50 2023-12-24T18:37:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2e7fc700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b300b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:57.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2effd700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b30156b50 0x7f8b3015a0e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098e0 tx=0x7f8b200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78584df7f96e3560 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2dffb700 1 -- 172.21.15.50:0/2993304482 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20011630 con 0x7f8b30156b50 2023-12-24T18:37:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2dffb700 1 -- 172.21.15.50:0/2993304482 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20011790 con 0x7f8b30156b50 2023-12-24T18:37:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b2dffb700 1 -- 172.21.15.50:0/2993304482 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20011b30 con 0x7f8b30156b50 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 -- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b30156b50 msgr2=0x7f8b3015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b30156b50 0x7f8b3015a0e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098e0 tx=0x7f8b200091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 -- 172.21.15.50:0/2993304482 shutdown_connections 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b300b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 --2- 172.21.15.50:0/2993304482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b30156b50 0x7f8b3015a0e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 -- 172.21.15.50:0/2993304482 >> 172.21.15.50:0/2993304482 conn(0x7f8b30067b40 msgr2=0x7f8b300b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 -- 172.21.15.50:0/2993304482 shutdown_connections 2023-12-24T18:37:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.081+0000 7f8b35825700 1 -- 172.21.15.50:0/2993304482 wait complete. 2023-12-24T18:37:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 Processor -- start 2023-12-24T18:37:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 -- start start 2023-12-24T18:37:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b30154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 0x7f8b301572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300ac590 con 0x7f8b300a9470 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300ad9d0 con 0x7f8b300b4060 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b35825700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300ac2b0 con 0x7f8b3006db90 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b2e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 0x7f8b301572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34786/0 (socket says 172.21.15.50:34786) 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b2e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 0x7f8b301572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:41626/0 (socket says 172.21.15.50:41626) 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.085+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/510646905 learned_addr learned my addr 172.21.15.50:0/510646905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:57.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2effd700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b30154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 msgr2=0x7f8b30154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b30154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 msgr2=0x7f8b301572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 0x7f8b301572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/510646905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009420 con 0x7f8b300a9470 2023-12-24T18:37:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b2f7fe700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001460 tx=0x7f8b28001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800a870 con 0x7f8b300a9470 2023-12-24T18:37:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2800a9d0 con 0x7f8b300a9470 2023-12-24T18:37:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b20009420 con 0x7f8b300a9470 2023-12-24T18:37:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ad50 con 0x7f8b300a9470 2023-12-24T18:37:57.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b300adf30 con 0x7f8b300a9470 2023-12-24T18:37:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.089+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30071060 con 0x7f8b300a9470 2023-12-24T18:37:57.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.093+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f8b28007300 con 0x7f8b300a9470 2023-12-24T18:37:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.093+0000 7f8b16ffd700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 0x7f8b1c062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.093+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f8b2807d140 con 0x7f8b300a9470 2023-12-24T18:37:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.093+0000 7f8b2effd700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 0x7f8b1c062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.097+0000 7f8b2effd700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 0x7f8b1c062c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b30063580 tx=0x7f8b20017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.101+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b2804d250 con 0x7f8b300a9470 2023-12-24T18:37:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.293+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b3006c8c0 con 0x7f8b1c060750 2023-12-24T18:37:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.385+0000 7f8b16ffd700 1 -- 172.21.15.50:0/510646905 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8b3006c8c0 con 0x7f8b1c060750 2023-12-24T18:37:57.389 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-12-24T18:37:57.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 msgr2=0x7f8b1c062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 0x7f8b1c062c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b30063580 tx=0x7f8b20017000 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 msgr2=0x7f8b300ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001460 tx=0x7f8b28001a40 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 shutdown_connections 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b1c060750 0x7f8b1c062c00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b300a9470 0x7f8b300ab880 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b300b4060 0x7f8b301572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 --2- 172.21.15.50:0/510646905 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3006db90 0x7f8b30154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 >> 172.21.15.50:0/510646905 conn(0x7f8b30067b40 msgr2=0x7f8b300d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 shutdown_connections 2023-12-24T18:37:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.389+0000 7f8b35825700 1 -- 172.21.15.50:0/510646905 wait complete. 2023-12-24T18:37:57.417 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-12-24T18:37:57.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-12-24T18:37:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.589+0000 7f7b15e16700 1 Processor -- start 2023-12-24T18:37:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.589+0000 7f7b15e16700 1 -- start start 2023-12-24T18:37:57.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.589+0000 7f7b15e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 0x7f7b100c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.589+0000 7f7b15e16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1006b5b0 con 0x7f7b100c5ac0 2023-12-24T18:37:57.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b15e16700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1006a9a0 con 0x7f7b10159080 2023-12-24T18:37:57.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b15e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1015dbd0 con 0x7f7b1006a4a0 2023-12-24T18:37:57.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b15615700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b100c5ac0 0x7f7b100cab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49204/0 (socket says 172.21.15.50:49204) 2023-12-24T18:37:57.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b15615700 1 -- 172.21.15.50:0/127426152 learned_addr learned my addr 172.21.15.50:0/127426152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b14e14700 1 --1- 172.21.15.50:0/127426152 >> v1:172.21.15.82:6789/0 conn(0x7f7b10159080 0x7f7b1006da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42466/0 (socket says 172.21.15.50:42466) 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b07fff700 1 --2- 172.21.15.50:0/127426152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 0x7f7b100c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141122152 0 0) 0x7f7b1006a9a0 con 0x7f7b10159080 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af8003570 con 0x7f7b10159080 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673340672 0 0) 0x7f7b1006b5b0 con 0x7f7b100c5ac0 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1006a9a0 con 0x7f7b100c5ac0 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b07fff700 1 -- 172.21.15.50:0/127426152 >> v1:172.21.15.82:6789/0 conn(0x7f7b10159080 legacy=0x7f7b1006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b07fff700 1 -- 172.21.15.50:0/127426152 >> v1:172.21.15.50:6789/0 conn(0x7f7b100c5ac0 legacy=0x7f7b100cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b07fff700 1 -- 172.21.15.50:0/127426152 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1006ac80 con 0x7f7b1006a4a0 2023-12-24T18:37:57.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b07fff700 1 --2- 172.21.15.50:0/127426152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 0x7f7b100c5580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be70a610b1963c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.593+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011630 con 0x7f7b1006a4a0 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00011790 con 0x7f7b1006a4a0 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b077fe700 1 -- 172.21.15.50:0/127426152 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011b30 con 0x7f7b1006a4a0 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- 172.21.15.50:0/127426152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 msgr2=0x7f7b100c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 --2- 172.21.15.50:0/127426152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 0x7f7b100c5580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b000091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- 172.21.15.50:0/127426152 shutdown_connections 2023-12-24T18:37:57.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 --2- 172.21.15.50:0/127426152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b1006a4a0 0x7f7b100c5580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- 172.21.15.50:0/127426152 >> 172.21.15.50:0/127426152 conn(0x7f7b10067b80 msgr2=0x7f7b100cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:57.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- 172.21.15.50:0/127426152 shutdown_connections 2023-12-24T18:37:57.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- 172.21.15.50:0/127426152 wait complete. 2023-12-24T18:37:57.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 Processor -- start 2023-12-24T18:37:57.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.597+0000 7f7b15e16700 1 -- start start 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b100c5ac0 0x7f7b1015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b10159080 0x7f7b1016e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1016db10 con 0x7f7b1006a4a0 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100b3550 con 0x7f7b10159080 2023-12-24T18:37:57.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100b3830 con 0x7f7b100c5ac0 2023-12-24T18:37:57.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34796/0 (socket says 172.21.15.50:34796) 2023-12-24T18:37:57.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 -- 172.21.15.50:0/1894999611 learned_addr learned my addr 172.21.15.50:0/1894999611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:57.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b07fff700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b100c5ac0 0x7f7b1015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15615700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b10159080 0x7f7b1016e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 -- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b100c5ac0 msgr2=0x7f7b1015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b100c5ac0 0x7f7b1015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 -- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b10159080 msgr2=0x7f7b1016e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b10159080 0x7f7b1016e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 -- 172.21.15.50:0/1894999611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009420 con 0x7f7b1006a4a0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b14e14700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c590 tx=0x7f7b0c007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c005a70 con 0x7f7b1006a4a0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c005bd0 con 0x7f7b1006a4a0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0070d0 con 0x7f7b1006a4a0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1016dd20 con 0x7f7b1006a4a0 2023-12-24T18:37:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.601+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1016ea60 con 0x7f7b1006a4a0 2023-12-24T18:37:57.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.605+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1004be40 con 0x7f7b1006a4a0 2023-12-24T18:37:57.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.605+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f7b0c007500 con 0x7f7b1006a4a0 2023-12-24T18:37:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.605+0000 7f7b04ff9700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 0x7f7afc062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.605+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f7b0c07c260 con 0x7f7b1006a4a0 2023-12-24T18:37:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.605+0000 7f7b07fff700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 0x7f7afc062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.609+0000 7f7b07fff700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 0x7f7afc062c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7b1006a8d0 tx=0x7f7b00017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:57.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.613+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7b0c04c2f0 con 0x7f7b1006a4a0 2023-12-24T18:37:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.809+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b100cb380 con 0x7f7afc060750 2023-12-24T18:37:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.897+0000 7f7b04ff9700 1 -- 172.21.15.50:0/1894999611 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7b100cb380 con 0x7f7afc060750 2023-12-24T18:37:57.900 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.897+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 msgr2=0x7f7afc062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.897+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 0x7f7afc062c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7b1006a8d0 tx=0x7f7b00017000 comp rx=0 tx=0).stop 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.897+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 msgr2=0x7f7b100b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.897+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c590 tx=0x7f7b0c007e20 comp rx=0 tx=0).stop 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 shutdown_connections 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7afc060750 0x7f7afc062c00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b10159080 0x7f7b1016e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b100c5ac0 0x7f7b1015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 --2- 172.21.15.50:0/1894999611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1006a4a0 0x7f7b100b2f50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 >> 172.21.15.50:0/1894999611 conn(0x7f7b10067b80 msgr2=0x7f7b10152800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 shutdown_connections 2023-12-24T18:37:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:57.901+0000 7f7b15e16700 1 -- 172.21.15.50:0/1894999611 wait complete. 2023-12-24T18:37:57.930 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-12-24T18:37:57.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-12-24T18:37:58.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 Processor -- start 2023-12-24T18:37:58.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 -- start start 2023-12-24T18:37:58.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f255c156b50 0x7f255c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c06d4d0 con 0x7f255c0b4060 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0b44e0 con 0x7f255c156b50 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f2564345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b4960 con 0x7f255c06db90 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f25628e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f255c0b4060 0x7f255c15ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49210/0 (socket says 172.21.15.50:49210) 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f25620e1700 1 --2- 172.21.15.50:0/1927768242 >> v2:172.21.15.82:3300/0 conn(0x7f255c156b50 0x7f255c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f25628e2700 1 -- 172.21.15.50:0/1927768242 learned_addr learned my addr 172.21.15.50:0/1927768242 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:58.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.109+0000 7f25618e0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25610df700 1 -- 172.21.15.50:0/1927768242 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626694290 0 0) 0x7f255c06d4d0 con 0x7f255c0b4060 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25610df700 1 -- 172.21.15.50:0/1927768242 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2548003570 con 0x7f255c0b4060 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25620e1700 1 -- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 msgr2=0x7f255c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25620e1700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25620e1700 1 -- 172.21.15.50:0/1927768242 >> v1:172.21.15.50:6789/0 conn(0x7f255c0b4060 legacy=0x7f255c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25620e1700 1 -- 172.21.15.50:0/1927768242 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c15a620 con 0x7f255c156b50 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25618e0700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:37:58.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25620e1700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c15a0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25580098e0 tx=0x7f25580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae5e1bde8faebf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25610df700 1 -- 172.21.15.50:0/1927768242 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011630 con 0x7f255c156b50 2023-12-24T18:37:58.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25610df700 1 -- 172.21.15.50:0/1927768242 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011790 con 0x7f255c156b50 2023-12-24T18:37:58.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f25610df700 1 -- 172.21.15.50:0/1927768242 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011b30 con 0x7f255c156b50 2023-12-24T18:37:58.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 -- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 msgr2=0x7f255c15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c15a0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25580098e0 tx=0x7f25580091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 -- 172.21.15.50:0/1927768242 shutdown_connections 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 --2- 172.21.15.50:0/1927768242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c15a0e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 -- 172.21.15.50:0/1927768242 >> 172.21.15.50:0/1927768242 conn(0x7f255c067b40 msgr2=0x7f255c0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.113+0000 7f2564345700 1 -- 172.21.15.50:0/1927768242 shutdown_connections 2023-12-24T18:37:58.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.117+0000 7f2564345700 1 -- 172.21.15.50:0/1927768242 wait complete. 2023-12-24T18:37:58.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.117+0000 7f2564345700 1 Processor -- start 2023-12-24T18:37:58.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.117+0000 7f2564345700 1 -- start start 2023-12-24T18:37:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c16b190 con 0x7f255c0b4060 2023-12-24T18:37:58.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c158620 con 0x7f255c156b50 2023-12-24T18:37:58.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c158900 con 0x7f255c06db90 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34806/0 (socket says 172.21.15.50:34806) 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 -- 172.21.15.50:0/123930345 learned_addr learned my addr 172.21.15.50:0/123930345 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25620e1700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25628e2700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 -- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 msgr2=0x7f255c157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 -- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 msgr2=0x7f255c169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 -- 172.21.15.50:0/123930345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009420 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25618e0700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ec80 tx=0x7f254c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00c920 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00ca80 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2558009420 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00ce00 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.121+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c16ae20 con 0x7f255c0b4060 2023-12-24T18:37:58.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.125+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c16b300 con 0x7f255c0b4060 2023-12-24T18:37:58.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.125+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f254c013680 con 0x7f255c0b4060 2023-12-24T18:37:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.129+0000 7f25527fc700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 0x7f2540062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.129+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f254c07d4b0 con 0x7f255c0b4060 2023-12-24T18:37:58.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.129+0000 7f25620e1700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 0x7f2540062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.129+0000 7f25620e1700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 0x7f2540062c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25580091e0 tx=0x7f2558017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.133+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f254c04d5e0 con 0x7f255c0b4060 2023-12-24T18:37:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.337+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f255c071060 con 0x7f2540060750 2023-12-24T18:37:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.421+0000 7f25527fc700 1 -- 172.21.15.50:0/123930345 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f255c071060 con 0x7f2540060750 2023-12-24T18:37:58.426 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 msgr2=0x7f2540062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 0x7f2540062c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25580091e0 tx=0x7f2558017000 comp rx=0 tx=0).stop 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 msgr2=0x7f255c157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ec80 tx=0x7f254c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 shutdown_connections 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2540060750 0x7f2540062c00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c156b50 0x7f255c169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b4060 0x7f255c157c90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 --2- 172.21.15.50:0/123930345 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f255c06db90 0x7f255c157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 >> 172.21.15.50:0/123930345 conn(0x7f255c067b40 msgr2=0x7f255c1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 shutdown_connections 2023-12-24T18:37:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.425+0000 7f2564345700 1 -- 172.21.15.50:0/123930345 wait complete. 2023-12-24T18:37:58.454 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-12-24T18:37:58.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-12-24T18:37:58.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.637+0000 7fbf351c5700 1 Processor -- start 2023-12-24T18:37:58.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.637+0000 7fbf351c5700 1 -- start start 2023-12-24T18:37:58.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf351c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 0x7fbf3015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf351c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3006d4d0 con 0x7fbf30156b50 2023-12-24T18:37:58.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf351c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300b4960 con 0x7fbf300b4230 2023-12-24T18:37:58.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf351c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3015a620 con 0x7fbf3006db90 2023-12-24T18:37:58.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf30156b50 0x7fbf300b3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49222/0 (socket says 172.21.15.50:49222) 2023-12-24T18:37:58.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2ed9d700 1 -- 172.21.15.50:0/3791378645 learned_addr learned my addr 172.21.15.50:0/3791378645 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:37:58.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2f59e700 1 --2- 172.21.15.50:0/3791378645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 0x7fbf3015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64673837 0 0) 0x7fbf3006d4d0 con 0x7fbf30156b50 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf18003570 con 0x7fbf30156b50 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776635411 0 0) 0x7fbf24001110 con 0x7fbf300b4230 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf3006d4d0 con 0x7fbf300b4230 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2f59e700 1 -- 172.21.15.50:0/3791378645 >> v1:172.21.15.82:6789/0 conn(0x7fbf300b4230 legacy=0x7fbf3006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571204306 0 0) 0x7fbf18003570 con 0x7fbf30156b50 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2f59e700 1 -- 172.21.15.50:0/3791378645 >> v1:172.21.15.50:6789/0 conn(0x7fbf30156b50 legacy=0x7fbf300b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2f59e700 1 -- 172.21.15.50:0/3791378645 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3006c8c0 con 0x7fbf3006db90 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2f59e700 1 --2- 172.21.15.50:0/3791378645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 0x7fbf3015a0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e90 tx=0x7fbf28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28de76f0a72c203d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800e070 con 0x7fbf3006db90 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2800b870 con 0x7fbf3006db90 2023-12-24T18:37:58.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.641+0000 7fbf2dd9b700 1 -- 172.21.15.50:0/3791378645 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20001490 con 0x7fbf3006db90 2023-12-24T18:37:58.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- 172.21.15.50:0/3791378645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 msgr2=0x7fbf3015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3791378645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 0x7fbf3015a0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e90 tx=0x7fbf28009780 comp rx=0 tx=0).stop 2023-12-24T18:37:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- 172.21.15.50:0/3791378645 shutdown_connections 2023-12-24T18:37:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3791378645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf3006db90 0x7fbf3015a0e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- 172.21.15.50:0/3791378645 >> 172.21.15.50:0/3791378645 conn(0x7fbf30067b40 msgr2=0x7fbf300b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- 172.21.15.50:0/3791378645 shutdown_connections 2023-12-24T18:37:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- 172.21.15.50:0/3791378645 wait complete. 2023-12-24T18:37:58.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 Processor -- start 2023-12-24T18:37:58.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.645+0000 7fbf351c5700 1 -- start start 2023-12-24T18:37:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf300b4230 0x7fbf30156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf30156b50 0x7fbf300aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30157460 con 0x7fbf3006db90 2023-12-24T18:37:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30157730 con 0x7fbf30156b50 2023-12-24T18:37:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30157a10 con 0x7fbf300b4230 2023-12-24T18:37:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34814/0 (socket says 172.21.15.50:34814) 2023-12-24T18:37:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 -- 172.21.15.50:0/3283305676 learned_addr learned my addr 172.21.15.50:0/3283305676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2e59c700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf300b4230 0x7fbf30156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2f59e700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf30156b50 0x7fbf300aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 -- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf300b4230 msgr2=0x7fbf30156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf300b4230 0x7fbf30156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 -- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf30156b50 msgr2=0x7fbf300aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf30156b50 0x7fbf300aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 -- 172.21.15.50:0/3283305676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28009a20 con 0x7fbf3006db90 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf2ed9d700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000cb60 tx=0x7fbf20001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20007150 con 0x7fbf3006db90 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200072d0 con 0x7fbf3006db90 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20007690 con 0x7fbf3006db90 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf30157cf0 con 0x7fbf3006db90 2023-12-24T18:37:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.649+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf300aae50 con 0x7fbf3006db90 2023-12-24T18:37:58.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.653+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf300a88d0 con 0x7fbf3006db90 2023-12-24T18:37:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.653+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7fbf20004a40 con 0x7fbf3006db90 2023-12-24T18:37:58.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.657+0000 7fbf16ffd700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 0x7fbf1c062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:58.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.657+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fbf2007c550 con 0x7fbf3006db90 2023-12-24T18:37:58.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.657+0000 7fbf2e59c700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 0x7fbf1c062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.657+0000 7fbf2e59c700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 0x7fbf1c062c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf24003870 tx=0x7fbf24009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:58.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.661+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf2004c700 con 0x7fbf3006db90 2023-12-24T18:37:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.861+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf30071060 con 0x7fbf1c060750 2023-12-24T18:37:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.949+0000 7fbf16ffd700 1 -- 172.21.15.50:0/3283305676 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbf30071060 con 0x7fbf1c060750 2023-12-24T18:37:58.954 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-12-24T18:37:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 msgr2=0x7fbf1c062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 0x7fbf1c062c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf24003870 tx=0x7fbf24009040 comp rx=0 tx=0).stop 2023-12-24T18:37:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 msgr2=0x7fbf30158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000cb60 tx=0x7fbf20001a50 comp rx=0 tx=0).stop 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 shutdown_connections 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbf1c060750 0x7fbf1c062c00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf30156b50 0x7fbf300aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf300b4230 0x7fbf30156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 --2- 172.21.15.50:0/3283305676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf3006db90 0x7fbf30158d30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 >> 172.21.15.50:0/3283305676 conn(0x7fbf30067b40 msgr2=0x7fbf300d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 shutdown_connections 2023-12-24T18:37:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:58.953+0000 7fbf351c5700 1 -- 172.21.15.50:0/3283305676 wait complete. 2023-12-24T18:37:58.978 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-12-24T18:37:58.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-12-24T18:37:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.145+0000 7fd6f7745700 1 Processor -- start 2023-12-24T18:37:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.145+0000 7fd6f7745700 1 -- start start 2023-12-24T18:37:59.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6f0156b50 0x7fd6f015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f006db90 0x7fd6f00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f006d4d0 con 0x7fd6f00b4060 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00b4960 con 0x7fd6f006db90 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f015a620 con 0x7fd6f0156b50 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f006db90 0x7fd6f00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f006db90 0x7fd6f00b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34824/0 (socket says 172.21.15.50:34824) 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 -- 172.21.15.50:0/630411357 learned_addr learned my addr 172.21.15.50:0/630411357 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f54e1700 1 --2- 172.21.15.50:0/630411357 >> v2:172.21.15.82:3300/0 conn(0x7fd6f0156b50 0x7fd6f015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 -- 172.21.15.50:0/630411357 >> v2:172.21.15.82:3300/0 conn(0x7fd6f0156b50 msgr2=0x7fd6f015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 --2- 172.21.15.50:0/630411357 >> v2:172.21.15.82:3300/0 conn(0x7fd6f0156b50 0x7fd6f015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 -- 172.21.15.50:0/630411357 >> v1:172.21.15.50:6789/0 conn(0x7fd6f00b4060 legacy=0x7fd6f015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 -- 172.21.15.50:0/630411357 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00b4480 con 0x7fd6f006db90 2023-12-24T18:37:59.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f4ce0700 1 --2- 172.21.15.50:0/630411357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f006db90 0x7fd6f00b3b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0063610 tx=0x7fd6e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27cfc156d2250ee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6e7fff700 1 -- 172.21.15.50:0/630411357 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0009e70 con 0x7fd6f006db90 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6e7fff700 1 -- 172.21.15.50:0/630411357 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000b860 con 0x7fd6f006db90 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6e7fff700 1 -- 172.21.15.50:0/630411357 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000bc00 con 0x7fd6f006db90 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- 172.21.15.50:0/630411357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f006db90 msgr2=0x7fd6f00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 --2- 172.21.15.50:0/630411357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f006db90 0x7fd6f00b3b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0063610 tx=0x7fd6e0009250 comp rx=0 tx=0).stop 2023-12-24T18:37:59.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- 172.21.15.50:0/630411357 shutdown_connections 2023-12-24T18:37:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 --2- 172.21.15.50:0/630411357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f006db90 0x7fd6f00b3b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 --2- 172.21.15.50:0/630411357 >> v2:172.21.15.82:3300/0 conn(0x7fd6f0156b50 0x7fd6f015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.149+0000 7fd6f7745700 1 -- 172.21.15.50:0/630411357 >> 172.21.15.50:0/630411357 conn(0x7fd6f0067b40 msgr2=0x7fd6f00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.153+0000 7fd6f7745700 1 -- 172.21.15.50:0/630411357 shutdown_connections 2023-12-24T18:37:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.153+0000 7fd6f7745700 1 -- 172.21.15.50:0/630411357 wait complete. 2023-12-24T18:37:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.153+0000 7fd6f7745700 1 Processor -- start 2023-12-24T18:37:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.153+0000 7fd6f7745700 1 -- start start 2023-12-24T18:37:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6f006db90 0x7fd6f0170c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f00b4060 0x7fd6f008ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00afc30 con 0x7fd6f0156b50 2023-12-24T18:37:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0087290 con 0x7fd6f00b4060 2023-12-24T18:37:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0171300 con 0x7fd6f006db90 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f54e1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6f006db90 0x7fd6f0170c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34834/0 (socket says 172.21.15.50:34834) 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 -- 172.21.15.50:0/78624312 learned_addr learned my addr 172.21.15.50:0/78624312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f4ce0700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f00b4060 0x7fd6f008ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 -- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6f006db90 msgr2=0x7fd6f0170c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6f006db90 0x7fd6f0170c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 -- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f00b4060 msgr2=0x7fd6f008ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f00b4060 0x7fd6f008ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 -- 172.21.15.50:0/78624312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00094f0 con 0x7fd6f0156b50 2023-12-24T18:37:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f5ce2700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c8e0 tx=0x7fd6e8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8012630 con 0x7fd6f0156b50 2023-12-24T18:37:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8012790 con 0x7fd6f0156b50 2023-12-24T18:37:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01715e0 con 0x7fd6f0156b50 2023-12-24T18:37:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8012b50 con 0x7fd6f0156b50 2023-12-24T18:37:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.157+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f008b0c0 con 0x7fd6f0156b50 2023-12-24T18:37:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.161+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0071060 con 0x7fd6f0156b50 2023-12-24T18:37:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.161+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7fd6e801a3a0 con 0x7fd6f0156b50 2023-12-24T18:37:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.161+0000 7fd6e57fa700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 0x7fd6d4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.165+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fd6e807cfa0 con 0x7fd6f0156b50 2023-12-24T18:37:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.165+0000 7fd6f54e1700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 0x7fd6d4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.165+0000 7fd6f54e1700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 0x7fd6d4062c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009d10 tx=0x7fd6ec0091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.169+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6e8050ac0 con 0x7fd6f0156b50 2023-12-24T18:37:59.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.361+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6f00afab0 con 0x7fd6d4060750 2023-12-24T18:37:59.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.449+0000 7fd6e57fa700 1 -- 172.21.15.50:0/78624312 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd6ec009950 con 0x7fd6d4060750 2023-12-24T18:37:59.454 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-12-24T18:37:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 msgr2=0x7fd6d4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 0x7fd6d4062c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009d10 tx=0x7fd6ec0091a0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 msgr2=0x7fd6f0089b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c8e0 tx=0x7fd6e8001710 comp rx=0 tx=0).stop 2023-12-24T18:37:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 shutdown_connections 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd6d4060750 0x7fd6d4062c00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f0156b50 0x7fd6f0089b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f00b4060 0x7fd6f008ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 --2- 172.21.15.50:0/78624312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6f006db90 0x7fd6f0170c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 >> 172.21.15.50:0/78624312 conn(0x7fd6f0067b40 msgr2=0x7fd6f00cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 shutdown_connections 2023-12-24T18:37:59.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.453+0000 7fd6f7745700 1 -- 172.21.15.50:0/78624312 wait complete. 2023-12-24T18:37:59.483 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-12-24T18:37:59.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-12-24T18:37:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.661+0000 7fd6119c3700 1 Processor -- start 2023-12-24T18:37:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.661+0000 7fd6119c3700 1 -- start start 2023-12-24T18:37:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6119c3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd60c0b2cf0 0x7fd60c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6119c3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd60c0ce470 0x7fd60c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6119c3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0cee10 con 0x7fd60c158dd0 2023-12-24T18:37:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6119c3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c06aa80 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6119c3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0cc0b0 con 0x7fd60c0ce470 2023-12-24T18:37:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd60c0b2cf0 0x7fd60c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd60c0b2cf0 0x7fd60c1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36810/0 (socket says 172.21.15.50:36810) 2023-12-24T18:37:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 -- 172.21.15.50:0/2159864217 learned_addr learned my addr 172.21.15.50:0/2159864217 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd6111c2700 1 --2- 172.21.15.50:0/2159864217 >> v2:172.21.15.82:3300/0 conn(0x7fd60c0ce470 0x7fd60c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 -- 172.21.15.50:0/2159864217 >> v2:172.21.15.82:3300/0 conn(0x7fd60c0ce470 msgr2=0x7fd60c0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:37:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 --2- 172.21.15.50:0/2159864217 >> v2:172.21.15.82:3300/0 conn(0x7fd60c0ce470 0x7fd60c0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 -- 172.21.15.50:0/2159864217 >> v1:172.21.15.82:6789/0 conn(0x7fd60c158dd0 legacy=0x7fd60c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 -- 172.21.15.50:0/2159864217 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0cc390 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60bfff700 1 --2- 172.21.15.50:0/2159864217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c1591a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b5fa0 tx=0x7fd5f8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34b5c1743ec1eee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.665+0000 7fd60b7fe700 1 -- 172.21.15.50:0/2159864217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8005c10 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd60b7fe700 1 -- 172.21.15.50:0/2159864217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8005d70 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd60b7fe700 1 -- 172.21.15.50:0/2159864217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8006260 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 -- 172.21.15.50:0/2159864217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0b2cf0 msgr2=0x7fd60c1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 --2- 172.21.15.50:0/2159864217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c1591a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b5fa0 tx=0x7fd5f8009220 comp rx=0 tx=0).stop 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 -- 172.21.15.50:0/2159864217 shutdown_connections 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 --2- 172.21.15.50:0/2159864217 >> v2:172.21.15.82:3300/0 conn(0x7fd60c0ce470 0x7fd60c0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 --2- 172.21.15.50:0/2159864217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c1591a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 -- 172.21.15.50:0/2159864217 >> 172.21.15.50:0/2159864217 conn(0x7fd60c067b80 msgr2=0x7fd60c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 -- 172.21.15.50:0/2159864217 shutdown_connections 2023-12-24T18:37:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 -- 172.21.15.50:0/2159864217 wait complete. 2023-12-24T18:37:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.669+0000 7fd6119c3700 1 Processor -- start 2023-12-24T18:37:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 -- start start 2023-12-24T18:37:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c158dd0 0x7fd60c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c9030 con 0x7fd60c0ce470 2023-12-24T18:37:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c14f300 con 0x7fd60c0b2cf0 2023-12-24T18:37:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6119c3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c8420 con 0x7fd60c158dd0 2023-12-24T18:37:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36826/0 (socket says 172.21.15.50:36826) 2023-12-24T18:37:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 -- 172.21.15.50:0/59603295 learned_addr learned my addr 172.21.15.50:0/59603295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:37:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6109c1700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd6111c2700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c158dd0 0x7fd60c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 -- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c158dd0 msgr2=0x7fd60c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c158dd0 0x7fd60c0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 -- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0b2cf0 msgr2=0x7fd60c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 -- 172.21.15.50:0/59603295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009480 con 0x7fd60c0ce470 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd60bfff700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b0e0 tx=0x7fd5f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.673+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800b740 con 0x7fd60c0ce470 2023-12-24T18:37:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8020070 con 0x7fd60c0ce470 2023-12-24T18:37:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0c8700 con 0x7fd60c0ce470 2023-12-24T18:37:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800bb10 con 0x7fd60c0ce470 2023-12-24T18:37:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0c8cc0 con 0x7fd60c0ce470 2023-12-24T18:37:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c0c91e0 con 0x7fd60c0ce470 2023-12-24T18:37:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.677+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7fd5f8022030 con 0x7fd60c0ce470 2023-12-24T18:37:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.681+0000 7fd608ff9700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 0x7fd5f0062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:37:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.681+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fd5f807ea30 con 0x7fd60c0ce470 2023-12-24T18:37:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.681+0000 7fd6109c1700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 0x7fd5f0062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:37:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.681+0000 7fd6109c1700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 0x7fd5f0062c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6000039e0 tx=0x7fd600007ec0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:37:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.685+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd60c0c91e0 con 0x7fd60c0ce470 2023-12-24T18:37:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.881+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd60c04be40 con 0x7fd5f0060750 2023-12-24T18:37:59.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.977+0000 7fd608ff9700 1 -- 172.21.15.50:0/59603295 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd60c04be40 con 0x7fd5f0060750 2023-12-24T18:37:59.984 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-12-24T18:37:59.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 msgr2=0x7fd5f0062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 0x7fd5f0062c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6000039e0 tx=0x7fd600007ec0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 msgr2=0x7fd60c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b0e0 tx=0x7fd5f8016000 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 shutdown_connections 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd5f0060750 0x7fd5f0062c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c158dd0 0x7fd60c0c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c0ce470 0x7fd60c15c550 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 --2- 172.21.15.50:0/59603295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0b2cf0 0x7fd60c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.981+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 >> 172.21.15.50:0/59603295 conn(0x7fd60c067b80 msgr2=0x7fd60c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:37:59.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.985+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 shutdown_connections 2023-12-24T18:37:59.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:37:59.985+0000 7fd6119c3700 1 -- 172.21.15.50:0/59603295 wait complete. 2023-12-24T18:38:00.015 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-12-24T18:38:00.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-12-24T18:38:00.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:38:00.057+0000 7fe5c7264700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:38:00.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:38:00.057+0000 7fe5c7264700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:38:00.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:38:00.057+0000 7fe5c7264700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:38:00.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:38:00.057+0000 7fe5c7264700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:38:00.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:38:00.057+0000 7fe5c7264700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:38:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.197+0000 7f1a4e8e3700 1 Processor -- start 2023-12-24T18:38:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.197+0000 7f1a4e8e3700 1 -- start start 2023-12-24T18:38:00.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.197+0000 7f1a4e8e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a480b2cf0 0x7f1a481591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.197+0000 7f1a4e8e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a480ce470 0x7f1a480ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480cee10 con 0x7f1a48158dd0 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4806aa80 con 0x7f1a480b2cf0 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480cc0b0 con 0x7f1a480ce470 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a480b2cf0 0x7f1a481591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a480b2cf0 0x7f1a481591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36850/0 (socket says 172.21.15.50:36850) 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/3920718698 learned_addr learned my addr 172.21.15.50:0/3920718698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e0e2700 1 --2- 172.21.15.50:0/3920718698 >> v2:172.21.15.82:3300/0 conn(0x7f1a480ce470 0x7f1a480ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/3920718698 >> v2:172.21.15.82:3300/0 conn(0x7f1a480ce470 msgr2=0x7f1a480ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:38:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 --2- 172.21.15.50:0/3920718698 >> v2:172.21.15.82:3300/0 conn(0x7f1a480ce470 0x7f1a480ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/3920718698 >> v1:172.21.15.82:6789/0 conn(0x7f1a48158dd0 legacy=0x7f1a480cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/3920718698 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480cc390 con 0x7f1a480b2cf0 2023-12-24T18:38:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4d0e0700 1 --2- 172.21.15.50:0/3920718698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480b2cf0 0x7f1a481591a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1a480b5fa0 tx=0x7f1a38009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ad1d4a1a166c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4c8df700 1 -- 172.21.15.50:0/3920718698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38005c10 con 0x7f1a480b2cf0 2023-12-24T18:38:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4c8df700 1 -- 172.21.15.50:0/3920718698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38005d70 con 0x7f1a480b2cf0 2023-12-24T18:38:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4c8df700 1 -- 172.21.15.50:0/3920718698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38006260 con 0x7f1a480b2cf0 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/3920718698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480b2cf0 msgr2=0x7f1a481591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/3920718698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480b2cf0 0x7f1a481591a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1a480b5fa0 tx=0x7f1a38009220 comp rx=0 tx=0).stop 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/3920718698 shutdown_connections 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/3920718698 >> v2:172.21.15.82:3300/0 conn(0x7f1a480ce470 0x7f1a480ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/3920718698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480b2cf0 0x7f1a481591a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/3920718698 >> 172.21.15.50:0/3920718698 conn(0x7f1a48067b80 msgr2=0x7f1a480cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/3920718698 shutdown_connections 2023-12-24T18:38:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.201+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/3920718698 wait complete. 2023-12-24T18:38:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 Processor -- start 2023-12-24T18:38:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 -- start start 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a480b2cf0 0x7f1a4814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a48158dd0 0x7f1a480c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480c9030 con 0x7f1a480ce470 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4814f300 con 0x7f1a480b2cf0 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e8e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480c8420 con 0x7f1a48158dd0 2023-12-24T18:38:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36860/0 (socket says 172.21.15.50:36860) 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/1656923673 learned_addr learned my addr 172.21.15.50:0/1656923673 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4e0e2700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a48158dd0 0x7f1a480c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d8e1700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a480b2cf0 0x7f1a4814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a48158dd0 msgr2=0x7f1a480c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a48158dd0 0x7f1a480c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a480b2cf0 msgr2=0x7f1a4814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a480b2cf0 0x7f1a4814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.205+0000 7f1a4d0e0700 1 -- 172.21.15.50:0/1656923673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38009480 con 0x7f1a480ce470 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a4d0e0700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b0e0 tx=0x7f1a38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800b740 con 0x7f1a480ce470 2023-12-24T18:38:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38020070 con 0x7f1a480ce470 2023-12-24T18:38:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a480c8700 con 0x7f1a480ce470 2023-12-24T18:38:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bb10 con 0x7f1a480ce470 2023-12-24T18:38:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a480c8cc0 con 0x7f1a480ce470 2023-12-24T18:38:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.209+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a480c91e0 con 0x7f1a480ce470 2023-12-24T18:38:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.213+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 10) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f1a38022030 con 0x7f1a480ce470 2023-12-24T18:38:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.213+0000 7f1a3dffb700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 0x7f1a2c062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.213+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f1a3807eec0 con 0x7f1a480ce470 2023-12-24T18:38:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.213+0000 7f1a4d8e1700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 0x7f1a2c062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.213+0000 7f1a4d8e1700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 0x7f1a2c062c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a440039e0 tx=0x7f1a44007ec0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:00.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.217+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1a3804f010 con 0x7f1a480ce470 2023-12-24T18:38:00.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.281+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 11) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f1a3804f3e0 con 0x7f1a480ce470 2023-12-24T18:38:00.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.441+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a4804be40 con 0x7f1a2c060750 2023-12-24T18:38:00.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.753+0000 7f1a3dffb700 1 -- 172.21.15.50:0/1656923673 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1a4804be40 con 0x7f1a2c060750 2023-12-24T18:38:00.757 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 msgr2=0x7f1a2c062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 0x7f1a2c062c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a440039e0 tx=0x7f1a44007ec0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 msgr2=0x7f1a4815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b0e0 tx=0x7f1a38016000 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 shutdown_connections 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1a2c060750 0x7f1a2c062c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a48158dd0 0x7f1a480c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a480ce470 0x7f1a4815c550 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 --2- 172.21.15.50:0/1656923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a480b2cf0 0x7f1a4814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 >> 172.21.15.50:0/1656923673 conn(0x7f1a48067b80 msgr2=0x7f1a480b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 shutdown_connections 2023-12-24T18:38:00.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.757+0000 7f1a4e8e3700 1 -- 172.21.15.50:0/1656923673 wait complete. 2023-12-24T18:38:00.785 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-12-24T18:38:00.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-12-24T18:38:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.997+0000 7f10d74e3700 1 Processor -- start 2023-12-24T18:38:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.997+0000 7f10d74e3700 1 -- start start 2023-12-24T18:38:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.997+0000 7f10d74e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10d0158df0 0x7f10d01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:00.997+0000 7f10d74e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10d00cc830 0x7f10d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d015a480 con 0x7f10d00c5d10 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d00cd210 con 0x7f10d0158df0 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d0159870 con 0x7f10d00cc830 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10d0158df0 0x7f10d01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10d0158df0 0x7f10d01591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36874/0 (socket says 172.21.15.50:36874) 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 -- 172.21.15.50:0/194583679 learned_addr learned my addr 172.21.15.50:0/194583679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d6ce2700 1 --2- 172.21.15.50:0/194583679 >> v2:172.21.15.82:3300/0 conn(0x7f10d00cc830 0x7f10d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 -- 172.21.15.50:0/194583679 >> v2:172.21.15.82:3300/0 conn(0x7f10d00cc830 msgr2=0x7f10d00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:38:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 --2- 172.21.15.50:0/194583679 >> v2:172.21.15.82:3300/0 conn(0x7f10d00cc830 0x7f10d00cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 -- 172.21.15.50:0/194583679 >> v1:172.21.15.50:6789/0 conn(0x7f10d00c5d10 legacy=0x7f10d006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 -- 172.21.15.50:0/194583679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0159b50 con 0x7f10d0158df0 2023-12-24T18:38:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d64e1700 1 --2- 172.21.15.50:0/194583679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d01591c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10d006bde0 tx=0x7f10cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddec1bf9f8aa863 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d54df700 1 -- 172.21.15.50:0/194583679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc009e70 con 0x7f10d0158df0 2023-12-24T18:38:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d54df700 1 -- 172.21.15.50:0/194583679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00b860 con 0x7f10d0158df0 2023-12-24T18:38:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d54df700 1 -- 172.21.15.50:0/194583679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00bc00 con 0x7f10d0158df0 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- 172.21.15.50:0/194583679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 msgr2=0x7f10d01591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 --2- 172.21.15.50:0/194583679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d01591c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10d006bde0 tx=0x7f10cc009250 comp rx=0 tx=0).stop 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- 172.21.15.50:0/194583679 shutdown_connections 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 --2- 172.21.15.50:0/194583679 >> v2:172.21.15.82:3300/0 conn(0x7f10d00cc830 0x7f10d00cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 --2- 172.21.15.50:0/194583679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d01591c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- 172.21.15.50:0/194583679 >> 172.21.15.50:0/194583679 conn(0x7f10d00670b0 msgr2=0x7f10d00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.001+0000 7f10d74e3700 1 -- 172.21.15.50:0/194583679 shutdown_connections 2023-12-24T18:38:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.005+0000 7f10d74e3700 1 -- 172.21.15.50:0/194583679 wait complete. 2023-12-24T18:38:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.005+0000 7f10d74e3700 1 Processor -- start 2023-12-24T18:38:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.005+0000 7f10d74e3700 1 -- start start 2023-12-24T18:38:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 0x7f10d0143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d0143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00c7d60 con 0x7f10d0158df0 2023-12-24T18:38:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0169ad0 con 0x7f10d00cc830 2023-12-24T18:38:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0169db0 con 0x7f10d00c5d10 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d6ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d0143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:33034/0 (socket says 172.21.15.50:33034) 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 -- 172.21.15.50:0/4050616756 learned_addr learned my addr 172.21.15.50:0/4050616756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d5ce0700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 0x7f10d0143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 -- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 msgr2=0x7f10d0143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 0x7f10d0143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 -- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 msgr2=0x7f10d0143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d0143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 -- 172.21.15.50:0/4050616756 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0094f0 con 0x7f10d00c5d10 2023-12-24T18:38:01.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d6ce2700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d0143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:38:01.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d5ce0700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 0x7f10d0143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d64e1700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10d006a120 tx=0x7f10cc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00bbe0 con 0x7f10d00c5d10 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc011420 con 0x7f10d00c5d10 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0117e0 con 0x7f10d00c5d10 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d016a090 con 0x7f10d00c5d10 2023-12-24T18:38:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.009+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d016a890 con 0x7f10d00c5d10 2023-12-24T18:38:01.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.013+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d004be40 con 0x7f10d00c5d10 2023-12-24T18:38:01.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.013+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 11) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f10cc011c10 con 0x7f10d00c5d10 2023-12-24T18:38:01.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.013+0000 7f10c67fc700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 0x7f10b4062d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.013+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f10cc07e510 con 0x7f10d00c5d10 2023-12-24T18:38:01.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.013+0000 7f10d5ce0700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 0x7f10b4062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.017+0000 7f10d5ce0700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 0x7f10b4062d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10d006e340 tx=0x7f10c0009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.025+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f10cc04e630 con 0x7f10d00c5d10 2023-12-24T18:38:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.253+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d00b5c40 con 0x7f10b40608b0 2023-12-24T18:38:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.473+0000 7f10c67fc700 1 -- 172.21.15.50:0/4050616756 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f10d00b5c40 con 0x7f10b40608b0 2023-12-24T18:38:01.479 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-12-24T18:38:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 msgr2=0x7f10b4062d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 0x7f10b4062d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10d006e340 tx=0x7f10c0009040 comp rx=0 tx=0).stop 2023-12-24T18:38:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 msgr2=0x7f10d00ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10d006a120 tx=0x7f10cc017000 comp rx=0 tx=0).stop 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 shutdown_connections 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f10b40608b0 0x7f10b4062d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10d0158df0 0x7f10d0143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d00cc830 0x7f10d0143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 --2- 172.21.15.50:0/4050616756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10d00c5d10 0x7f10d00ce900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 >> 172.21.15.50:0/4050616756 conn(0x7f10d00670b0 msgr2=0x7f10d0157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 shutdown_connections 2023-12-24T18:38:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.477+0000 7f10d74e3700 1 -- 172.21.15.50:0/4050616756 wait complete. 2023-12-24T18:38:01.508 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-12-24T18:38:01.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-12-24T18:38:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.681+0000 7f58448f0700 1 Processor -- start 2023-12-24T18:38:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.685+0000 7f58448f0700 1 -- start start 2023-12-24T18:38:01.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.685+0000 7f58448f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58401590c0 0x7f584006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f58448f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400b3660 con 0x7f58400b4700 2023-12-24T18:38:01.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f58448f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400b3940 con 0x7f584006a730 2023-12-24T18:38:01.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f58448f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58400b3c20 con 0x7f58401590c0 2023-12-24T18:38:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58400b4700 0x7f58400b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38982/0 (socket says 172.21.15.50:38982) 2023-12-24T18:38:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583dd9b700 1 -- 172.21.15.50:0/3902020494 learned_addr learned my addr 172.21.15.50:0/3902020494 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:38:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583e59c700 1 --2- 172.21.15.50:0/3902020494 >> v2:172.21.15.50:3300/0 conn(0x7f58401590c0 0x7f584006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780810790 0 0) 0x7f58400b3660 con 0x7f58400b4700 2023-12-24T18:38:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5828003570 con 0x7f58400b4700 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702215131 0 0) 0x7f58400b3940 con 0x7f584006a730 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58400b3660 con 0x7f584006a730 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517564276 0 0) 0x7f5828003570 con 0x7f58400b4700 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583e59c700 1 -- 172.21.15.50:0/3902020494 >> v1:172.21.15.82:6789/0 conn(0x7f584006a730 legacy=0x7f5840159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583e59c700 1 -- 172.21.15.50:0/3902020494 >> v1:172.21.15.50:6789/0 conn(0x7f58400b4700 legacy=0x7f58400b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583e59c700 1 -- 172.21.15.50:0/3902020494 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400b3f00 con 0x7f58401590c0 2023-12-24T18:38:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583e59c700 1 --2- 172.21.15.50:0/3902020494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58401590c0 0x7f584006d470 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58300098e0 tx=0x7f58300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71830ed4e07b0540 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834001470 con 0x7f58401590c0 2023-12-24T18:38:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830011420 con 0x7f58401590c0 2023-12-24T18:38:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.689+0000 7f583d59a700 1 -- 172.21.15.50:0/3902020494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300117a0 con 0x7f58401590c0 2023-12-24T18:38:01.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 -- 172.21.15.50:0/3902020494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58401590c0 msgr2=0x7f584006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 --2- 172.21.15.50:0/3902020494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58401590c0 0x7f584006d470 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58300098e0 tx=0x7f58300091a0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 -- 172.21.15.50:0/3902020494 shutdown_connections 2023-12-24T18:38:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 --2- 172.21.15.50:0/3902020494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58401590c0 0x7f584006d470 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 -- 172.21.15.50:0/3902020494 >> 172.21.15.50:0/3902020494 conn(0x7f5840067b40 msgr2=0x7f58400b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 -- 172.21.15.50:0/3902020494 shutdown_connections 2023-12-24T18:38:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 -- 172.21.15.50:0/3902020494 wait complete. 2023-12-24T18:38:01.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.693+0000 7f58448f0700 1 Processor -- start 2023-12-24T18:38:01.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 -- start start 2023-12-24T18:38:01.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f584006a730 0x7f5840158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 0x7f584014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840151150 con 0x7f58400b4700 2023-12-24T18:38:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58400aefd0 con 0x7f58401590c0 2023-12-24T18:38:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f58448f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58401508b0 con 0x7f584006a730 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36908/0 (socket says 172.21.15.50:36908) 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 -- 172.21.15.50:0/2724800653 learned_addr learned my addr 172.21.15.50:0/2724800653 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583e59c700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f584006a730 0x7f5840158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583ed9d700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 0x7f584014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 -- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f584006a730 msgr2=0x7f5840158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f584006a730 0x7f5840158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 -- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 msgr2=0x7f584014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 0x7f584014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 -- 172.21.15.50:0/2724800653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830009420 con 0x7f58400b4700 2023-12-24T18:38:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583ed9d700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 0x7f584014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:38:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f583dd9b700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5834001ed0 tx=0x7f5834001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.697+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834005b30 con 0x7f58400b4700 2023-12-24T18:38:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834005c90 con 0x7f58400b4700 2023-12-24T18:38:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5840150b90 con 0x7f58400b4700 2023-12-24T18:38:01.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834007340 con 0x7f58400b4700 2023-12-24T18:38:01.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840150f20 con 0x7f58400b4700 2023-12-24T18:38:01.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840158cc0 con 0x7f58400b4700 2023-12-24T18:38:01.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.701+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 11) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f583401b400 con 0x7f58400b4700 2023-12-24T18:38:01.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.705+0000 7f582e7fc700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 0x7f5820062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:01.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.705+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f583407cb40 con 0x7f58400b4700 2023-12-24T18:38:01.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.705+0000 7f583e59c700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 0x7f5820062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:01.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.705+0000 7f583e59c700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 0x7f5820062c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58300093f0 tx=0x7f5830016000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.713+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5840158cc0 con 0x7f58400b4700 2023-12-24T18:38:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:01.917+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f58400abe50 con 0x7f58200607e0 2023-12-24T18:38:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f582e7fc700 1 -- 172.21.15.50:0/2724800653 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f58400abe50 con 0x7f58200607e0 2023-12-24T18:38:02.012 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-12-24T18:38:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 msgr2=0x7f5820062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 0x7f5820062c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58300093f0 tx=0x7f5830016000 comp rx=0 tx=0).stop 2023-12-24T18:38:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 msgr2=0x7f58400aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5834001ed0 tx=0x7f5834001a20 comp rx=0 tx=0).stop 2023-12-24T18:38:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 shutdown_connections 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.009+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58200607e0 0x7f5820062c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58401590c0 0x7f584014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58400b4700 0x7f58400aea90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 --2- 172.21.15.50:0/2724800653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f584006a730 0x7f5840158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 >> 172.21.15.50:0/2724800653 conn(0x7f5840067b40 msgr2=0x7f584015a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 shutdown_connections 2023-12-24T18:38:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.013+0000 7f58448f0700 1 -- 172.21.15.50:0/2724800653 wait complete. 2023-12-24T18:38:02.039 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-12-24T18:38:02.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-12-24T18:38:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.213+0000 7f23b1ecd700 1 Processor -- start 2023-12-24T18:38:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.213+0000 7f23b1ecd700 1 -- start start 2023-12-24T18:38:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23ac156b50 0x7f23ac15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 0x7f23ac0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 0x7f23ac15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac06d4d0 con 0x7f23ac156b50 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b4960 con 0x7f23ac06db90 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23b1ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b44c0 con 0x7f23ac0b4060 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23ac156b50 0x7f23ac15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23ac156b50 0x7f23ac15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36912/0 (socket says 172.21.15.50:36912) 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 -- 172.21.15.50:0/57927055 learned_addr learned my addr 172.21.15.50:0/57927055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23aaffd700 1 --2- 172.21.15.50:0/57927055 >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 0x7f23ac0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23abfff700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 0x7f23ac15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 -- 172.21.15.50:0/57927055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 msgr2=0x7f23ac15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 0x7f23ac15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 -- 172.21.15.50:0/57927055 >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 msgr2=0x7f23ac0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/57927055 >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 0x7f23ac0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 -- 172.21.15.50:0/57927055 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac15a620 con 0x7f23ac156b50 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23aaffd700 1 --2- 172.21.15.50:0/57927055 >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 0x7f23ac0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:38:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23abfff700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 0x7f23ac15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:38:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac156b50 0x7f23ac15a0e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23ac06a140 tx=0x7f239c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465a855c2869ef5b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23aa7fc700 1 -- 172.21.15.50:0/57927055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c00b860 con 0x7f23ac156b50 2023-12-24T18:38:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23aa7fc700 1 -- 172.21.15.50:0/57927055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c00b9c0 con 0x7f23ac156b50 2023-12-24T18:38:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.217+0000 7f23aa7fc700 1 -- 172.21.15.50:0/57927055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c00bd60 con 0x7f23ac156b50 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- 172.21.15.50:0/57927055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac156b50 msgr2=0x7f23ac15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac156b50 0x7f23ac15a0e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23ac06a140 tx=0x7f239c009250 comp rx=0 tx=0).stop 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- 172.21.15.50:0/57927055 shutdown_connections 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/57927055 >> v2:172.21.15.82:3300/0 conn(0x7f23ac06db90 0x7f23ac0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac0b4060 0x7f23ac15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/57927055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac156b50 0x7f23ac15a0e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- 172.21.15.50:0/57927055 >> 172.21.15.50:0/57927055 conn(0x7f23ac067b40 msgr2=0x7f23ac0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- 172.21.15.50:0/57927055 shutdown_connections 2023-12-24T18:38:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- 172.21.15.50:0/57927055 wait complete. 2023-12-24T18:38:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 Processor -- start 2023-12-24T18:38:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.221+0000 7f23b1ecd700 1 -- start start 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 0x7f23ac0aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac156b50 0x7f23ac0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac16ce00 con 0x7f23ac06db90 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac169d00 con 0x7f23ac0b4060 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23b1ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac169fe0 con 0x7f23ac156b50 2023-12-24T18:38:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36916/0 (socket says 172.21.15.50:36916) 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 -- 172.21.15.50:0/2443404113 learned_addr learned my addr 172.21.15.50:0/2443404113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23abfff700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac156b50 0x7f23ac0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23aaffd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 0x7f23ac0aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 -- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac156b50 msgr2=0x7f23ac0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac156b50 0x7f23ac0a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 -- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 msgr2=0x7f23ac0aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 0x7f23ac0aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 -- 172.21.15.50:0/2443404113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0094f0 con 0x7f23ac06db90 2023-12-24T18:38:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23aaffd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 0x7f23ac0aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23ab7fe700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f239c009290 tx=0x7f239c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.225+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c026480 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c01f070 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac16a2c0 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c026830 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac152c80 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac071060 con 0x7f23ac06db90 2023-12-24T18:38:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.229+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 11) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f239c026ba0 con 0x7f23ac06db90 2023-12-24T18:38:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.233+0000 7f23937fe700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 0x7f2398062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:38:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.233+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f239c021070 con 0x7f23ac06db90 2023-12-24T18:38:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.233+0000 7f23aaffd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 0x7f2398062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:38:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.233+0000 7f23aaffd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 0x7f2398062c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23a0006f00 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:38:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.237+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f239c04ecf0 con 0x7f23ac06db90 2023-12-24T18:38:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.445+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f23ac16cf40 con 0x7f23980607e0 2023-12-24T18:38:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.529+0000 7f23937fe700 1 -- 172.21.15.50:0/2443404113 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f23a0009810 con 0x7f23980607e0 2023-12-24T18:38:02.534 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 msgr2=0x7f2398062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 0x7f2398062c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23a0006f00 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 msgr2=0x7f23ac169690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f239c009290 tx=0x7f239c017000 comp rx=0 tx=0).stop 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 shutdown_connections 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f23980607e0 0x7f2398062c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f23ac156b50 0x7f23ac0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23ac0b4060 0x7f23ac0aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 --2- 172.21.15.50:0/2443404113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ac06db90 0x7f23ac169690 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:38:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 >> 172.21.15.50:0/2443404113 conn(0x7f23ac067b40 msgr2=0x7f23ac1546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:38:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 shutdown_connections 2023-12-24T18:38:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:38:02.533+0000 7f23b1ecd700 1 -- 172.21.15.50:0/2443404113 wait complete. 2023-12-24T18:38:02.567 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-12-24T18:38:25.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:38:25.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:38:55.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:38:55.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:39:25.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:39:26.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:39:56.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:39:56.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:40:26.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:40:26.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:40:56.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:40:56.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:41:26.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:41:26.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:41:56.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:41:56.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:42:00.177 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:42:00.175+0000 7fe5c5260700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:42:00.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:42:00.175+0000 7fe5c5260700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:42:00.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:42:00.175+0000 7fe5c5260700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:42:00.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:42:00.175+0000 7fe5c5260700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:42:00.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:42:00.175+0000 7fe5c5260700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:42:26.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:42:26.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:42:56.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:42:56.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:43:26.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:43:26.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:43:56.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:43:56.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:44:27.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:44:27.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:44:57.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:44:57.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:45:27.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:45:27.211 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:45:57.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:45:57.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:46:27.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:46:27.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:46:57.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:46:57.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:47:27.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:47:27.552 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:47:57.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:47:57.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:48:21.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-12-24T18:48:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 Processor -- start 2023-12-24T18:48:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 -- start start 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32780b1460 0x7f32781574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 0x7f3278157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278157f50 con 0x7f3278154820 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327815b250 con 0x7f32780b1460 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f327d2cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780ae550 con 0x7f327815b6e0 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f32767fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32780b1460 0x7f32781574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f32767fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32780b1460 0x7f32781574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41650/0 (socket says 172.21.15.50:41650) 2023-12-24T18:48:21.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.746+0000 7f32767fc700 1 -- 172.21.15.50:0/516518994 learned_addr learned my addr 172.21.15.50:0/516518994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32767fc700 1 -- 172.21.15.50:0/516518994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 msgr2=0x7f3278157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32777fe700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 0x7f3278157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32767fc700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 0x7f3278157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32767fc700 1 -- 172.21.15.50:0/516518994 >> v1:172.21.15.50:6789/0 conn(0x7f3278154820 legacy=0x7f32780b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32767fc700 1 -- 172.21.15.50:0/516518994 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278158470 con 0x7f32780b1460 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32777fe700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 0x7f3278157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f32767fc700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32780b1460 0x7f32781574d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1e01f305aeb86b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:21.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f3275ffb700 1 -- 172.21.15.50:0/516518994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00b860 con 0x7f32780b1460 2023-12-24T18:48:21.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f3275ffb700 1 -- 172.21.15.50:0/516518994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00b9c0 con 0x7f32780b1460 2023-12-24T18:48:21.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f3275ffb700 1 -- 172.21.15.50:0/516518994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00bd60 con 0x7f32780b1460 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 -- 172.21.15.50:0/516518994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32780b1460 msgr2=0x7f32781574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32780b1460 0x7f32781574d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c009250 comp rx=0 tx=0).stop 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 -- 172.21.15.50:0/516518994 shutdown_connections 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815b6e0 0x7f3278157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 --2- 172.21.15.50:0/516518994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32780b1460 0x7f32781574d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 -- 172.21.15.50:0/516518994 >> 172.21.15.50:0/516518994 conn(0x7f3278067b80 msgr2=0x7f32780ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 -- 172.21.15.50:0/516518994 shutdown_connections 2023-12-24T18:48:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.750+0000 7f327d2cd700 1 -- 172.21.15.50:0/516518994 wait complete. 2023-12-24T18:48:21.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 Processor -- start 2023-12-24T18:48:21.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 -- start start 2023-12-24T18:48:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32780b1460 0x7f32780c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 0x7f3278152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.754+0000 7f327d2cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780c7d40 con 0x7f3278154820 2023-12-24T18:48:21.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f327d2cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327815eae0 con 0x7f327815b6e0 2023-12-24T18:48:21.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f327d2cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780c56e0 con 0x7f32780b1460 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41652/0 (socket says 172.21.15.50:41652) 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 -- 172.21.15.50:0/2320949936 learned_addr learned my addr 172.21.15.50:0/2320949936 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f3276ffd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32780b1460 0x7f32780c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32777fe700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 0x7f3278152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 -- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32780b1460 msgr2=0x7f32780c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32780b1460 0x7f32780c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 -- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 msgr2=0x7f3278152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 0x7f3278152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 -- 172.21.15.50:0/2320949936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0094f0 con 0x7f3278154820 2023-12-24T18:48:21.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32777fe700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 0x7f3278152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f32767fc700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c024440 con 0x7f3278154820 2023-12-24T18:48:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c0245a0 con 0x7f3278154820 2023-12-24T18:48:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780c4df0 con 0x7f3278154820 2023-12-24T18:48:21.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c024960 con 0x7f3278154820 2023-12-24T18:48:21.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.758+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780c5110 con 0x7f3278154820 2023-12-24T18:48:21.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.762+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780c5490 con 0x7f3278154820 2023-12-24T18:48:21.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.762+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f326c01a420 con 0x7f3278154820 2023-12-24T18:48:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.762+0000 7f325effd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 0x7f3264062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.766+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f326c07ebd0 con 0x7f3278154820 2023-12-24T18:48:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.766+0000 7f3276ffd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 0x7f3264062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.766+0000 7f3276ffd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 0x7f3264062c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f327806eec0 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.770+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f326c04ed60 con 0x7f3278154820 2023-12-24T18:48:21.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:21.966+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3278071060 con 0x7f3264060750 2023-12-24T18:48:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.090+0000 7f325effd700 1 -- 172.21.15.50:0/2320949936 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3278071060 con 0x7f3264060750 2023-12-24T18:48:22.093 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 msgr2=0x7f3264062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 0x7f3264062c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f327806eec0 tx=0x7f3268009040 comp rx=0 tx=0).stop 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 msgr2=0x7f327815e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c017000 comp rx=0 tx=0).stop 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 shutdown_connections 2023-12-24T18:48:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3264060750 0x7f3264062c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f327815b6e0 0x7f3278152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3278154820 0x7f327815e5a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 --2- 172.21.15.50:0/2320949936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32780b1460 0x7f32780c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 >> 172.21.15.50:0/2320949936 conn(0x7f3278067b80 msgr2=0x7f3278157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 shutdown_connections 2023-12-24T18:48:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.094+0000 7f327d2cd700 1 -- 172.21.15.50:0/2320949936 wait complete. 2023-12-24T18:48:22.121 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-12-24T18:48:22.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-12-24T18:48:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.294+0000 7f1369ae3700 1 Processor -- start 2023-12-24T18:48:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.298+0000 7f1369ae3700 1 -- start start 2023-12-24T18:48:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1369ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1369ae3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1369ae3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1364069310 con 0x7f136415c210 2023-12-24T18:48:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1369ae3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640ca770 con 0x7f1364067fd0 2023-12-24T18:48:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1369ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1364068470 con 0x7f136406df40 2023-12-24T18:48:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f13692e2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:57954/0 (socket says 172.21.15.50:57954) 2023-12-24T18:48:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f13692e2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:39764/0 (socket says 172.21.15.50:39764) 2023-12-24T18:48:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 -- 172.21.15.50:0/30520915 learned_addr learned my addr 172.21.15.50:0/30520915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 -- 172.21.15.50:0/30520915 >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 msgr2=0x7f13640c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 --2- 172.21.15.50:0/30520915 >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 -- 172.21.15.50:0/30520915 >> v1:172.21.15.82:6789/0 conn(0x7f136415c210 legacy=0x7f136406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 -- 172.21.15.50:0/30520915 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364068700 con 0x7f136406df40 2023-12-24T18:48:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f13692e2700 1 --2- 172.21.15.50:0/30520915 >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.302+0000 7f1363fff700 1 --2- 172.21.15.50:0/30520915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13500099e0 tx=0x7f1350009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449c50f0529b8259 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f13637fe700 1 -- 172.21.15.50:0/30520915 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000b820 con 0x7f136406df40 2023-12-24T18:48:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f13637fe700 1 -- 172.21.15.50:0/30520915 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000b980 con 0x7f136406df40 2023-12-24T18:48:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f13637fe700 1 -- 172.21.15.50:0/30520915 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000bd20 con 0x7f136406df40 2023-12-24T18:48:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 -- 172.21.15.50:0/30520915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 msgr2=0x7f1364067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 --2- 172.21.15.50:0/30520915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13500099e0 tx=0x7f1350009250 comp rx=0 tx=0).stop 2023-12-24T18:48:22.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 -- 172.21.15.50:0/30520915 shutdown_connections 2023-12-24T18:48:22.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 --2- 172.21.15.50:0/30520915 >> v2:172.21.15.82:3300/0 conn(0x7f1364067fd0 0x7f13640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 --2- 172.21.15.50:0/30520915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f136406df40 0x7f1364067a90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 -- 172.21.15.50:0/30520915 >> 172.21.15.50:0/30520915 conn(0x7f136406ad60 msgr2=0x7f136406b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:22.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 -- 172.21.15.50:0/30520915 shutdown_connections 2023-12-24T18:48:22.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.306+0000 7f1369ae3700 1 -- 172.21.15.50:0/30520915 wait complete. 2023-12-24T18:48:22.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 Processor -- start 2023-12-24T18:48:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 -- start start 2023-12-24T18:48:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 0x7f136416e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 0x7f13640c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640af9e0 con 0x7f136406df40 2023-12-24T18:48:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c5a00 con 0x7f136415c210 2023-12-24T18:48:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1369ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640af0b0 con 0x7f1364067fd0 2023-12-24T18:48:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1363fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1368ae1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 0x7f136416e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f13692e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 0x7f13640c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1363fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41668/0 (socket says 172.21.15.50:41668) 2023-12-24T18:48:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.310+0000 7f1363fff700 1 -- 172.21.15.50:0/550204649 learned_addr learned my addr 172.21.15.50:0/550204649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 -- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 msgr2=0x7f13640c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 0x7f13640c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 -- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 msgr2=0x7f1364170dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 -- 172.21.15.50:0/550204649 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c009a20 con 0x7f1364067fd0 2023-12-24T18:48:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f13692e2700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 0x7f13640c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1363fff700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1368ae1700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 0x7f136416e760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f135800c590 tx=0x7f1358007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011590 con 0x7f1364067fd0 2023-12-24T18:48:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358011710 con 0x7f1364067fd0 2023-12-24T18:48:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13500094f0 con 0x7f1364067fd0 2023-12-24T18:48:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011ad0 con 0x7f1364067fd0 2023-12-24T18:48:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13640af670 con 0x7f1364067fd0 2023-12-24T18:48:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.314+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136404be40 con 0x7f1364067fd0 2023-12-24T18:48:22.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.318+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f135801b3b0 con 0x7f1364067fd0 2023-12-24T18:48:22.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.318+0000 7f1360ff9700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 0x7f1348062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.318+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f135807c1b0 con 0x7f1364067fd0 2023-12-24T18:48:22.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.318+0000 7f1363fff700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 0x7f1348062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.322+0000 7f1363fff700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 0x7f1348062c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1350003080 tx=0x7f1350017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.326+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f135804c2e0 con 0x7f1364067fd0 2023-12-24T18:48:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.530+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f13640c6280 con 0x7f1348060750 2023-12-24T18:48:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.658+0000 7f1360ff9700 1 -- 172.21.15.50:0/550204649 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f13640c6280 con 0x7f1348060750 2023-12-24T18:48:22.659 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-12-24T18:48:22.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 msgr2=0x7f1348062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 0x7f1348062c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1350003080 tx=0x7f1350017000 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 msgr2=0x7f136416e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 0x7f136416e760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f135800c590 tx=0x7f1358007ec0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 shutdown_connections 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1348060750 0x7f1348062c00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136415c210 0x7f13640c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136406df40 0x7f1364170dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 --2- 172.21.15.50:0/550204649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1364067fd0 0x7f136416e760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 >> 172.21.15.50:0/550204649 conn(0x7f136406ad60 msgr2=0x7f136415ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:22.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 shutdown_connections 2023-12-24T18:48:22.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.662+0000 7f1369ae3700 1 -- 172.21.15.50:0/550204649 wait complete. 2023-12-24T18:48:22.687 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-12-24T18:48:22.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-12-24T18:48:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.870+0000 7fb66c9cc700 1 Processor -- start 2023-12-24T18:48:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.870+0000 7fb66c9cc700 1 -- start start 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb6680c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6680c5ac0 0x7fb6680cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66806b5b0 con 0x7fb668159080 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66815dbd0 con 0x7fb6680c5ac0 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c5f40 con 0x7fb66806a4a0 2023-12-24T18:48:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6677fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb668159080 0x7fb66806da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58374/0 (socket says 172.21.15.50:58374) 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6677fe700 1 -- 172.21.15.50:0/3290057999 learned_addr learned my addr 172.21.15.50:0/3290057999 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb667fff700 1 --2- 172.21.15.50:0/3290057999 >> v2:172.21.15.50:3300/0 conn(0x7fb6680c5ac0 0x7fb6680cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 --2- 172.21.15.50:0/3290057999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb6680c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6667fc700 1 -- 172.21.15.50:0/3290057999 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790914882 0 0) 0x7fb66806b5b0 con 0x7fb668159080 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6667fc700 1 -- 172.21.15.50:0/3290057999 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb650003570 con 0x7fb668159080 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 -- 172.21.15.50:0/3290057999 >> v2:172.21.15.50:3300/0 conn(0x7fb6680c5ac0 msgr2=0x7fb6680cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 --2- 172.21.15.50:0/3290057999 >> v2:172.21.15.50:3300/0 conn(0x7fb6680c5ac0 0x7fb6680cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 -- 172.21.15.50:0/3290057999 >> v1:172.21.15.50:6789/0 conn(0x7fb668159080 legacy=0x7fb66806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 -- 172.21.15.50:0/3290057999 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66806a9a0 con 0x7fb66806a4a0 2023-12-24T18:48:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb666ffd700 1 --2- 172.21.15.50:0/3290057999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb6680c5580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0098e0 tx=0x7fb65c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb01e04e6456c563 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6667fc700 1 -- 172.21.15.50:0/3290057999 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011630 con 0x7fb66806a4a0 2023-12-24T18:48:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6667fc700 1 -- 172.21.15.50:0/3290057999 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c011790 con 0x7fb66806a4a0 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb6667fc700 1 -- 172.21.15.50:0/3290057999 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011b30 con 0x7fb66806a4a0 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.874+0000 7fb66c9cc700 1 -- 172.21.15.50:0/3290057999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 msgr2=0x7fb6680c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/3290057999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb6680c5580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0098e0 tx=0x7fb65c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 -- 172.21.15.50:0/3290057999 shutdown_connections 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/3290057999 >> v2:172.21.15.50:3300/0 conn(0x7fb6680c5ac0 0x7fb6680cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/3290057999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb6680c5580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 -- 172.21.15.50:0/3290057999 >> 172.21.15.50:0/3290057999 conn(0x7fb668067b80 msgr2=0x7fb6680cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 -- 172.21.15.50:0/3290057999 shutdown_connections 2023-12-24T18:48:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 -- 172.21.15.50:0/3290057999 wait complete. 2023-12-24T18:48:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 Processor -- start 2023-12-24T18:48:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.878+0000 7fb66c9cc700 1 -- start start 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb668169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 0x7fb668148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb668149510 con 0x7fb668159080 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66815beb0 con 0x7fb6680c5ac0 2023-12-24T18:48:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66815c190 con 0x7fb66806a4a0 2023-12-24T18:48:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41688/0 (socket says 172.21.15.50:41688) 2023-12-24T18:48:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 -- 172.21.15.50:0/2331102207 learned_addr learned my addr 172.21.15.50:0/2331102207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb6677fe700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb668169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb666ffd700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 0x7fb668148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 -- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 msgr2=0x7fb668169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb668169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 -- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 msgr2=0x7fb668148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 0x7fb668148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 -- 172.21.15.50:0/2331102207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c009420 con 0x7fb668159080 2023-12-24T18:48:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb666ffd700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 0x7fb668148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb667fff700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb660009e90 tx=0x7fb66000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000cc20 con 0x7fb668159080 2023-12-24T18:48:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000f040 con 0x7fb668159080 2023-12-24T18:48:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6681695f0 con 0x7fb668159080 2023-12-24T18:48:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660014480 con 0x7fb668159080 2023-12-24T18:48:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.882+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6681692a0 con 0x7fb668159080 2023-12-24T18:48:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.886+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb668169af0 con 0x7fb668159080 2023-12-24T18:48:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.886+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fb660014830 con 0x7fb668159080 2023-12-24T18:48:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.890+0000 7fb64f7fe700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 0x7fb654062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.890+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fb66007d970 con 0x7fb668159080 2023-12-24T18:48:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.890+0000 7fb6677fe700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 0x7fb654062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.890+0000 7fb6677fe700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 0x7fb654062c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb658007fd0 tx=0x7fb658009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:22.894+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb66004d8d0 con 0x7fb668159080 2023-12-24T18:48:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.090+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb66804be40 con 0x7fb654060780 2023-12-24T18:48:23.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.210+0000 7fb64f7fe700 1 -- 172.21.15.50:0/2331102207 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb66804be40 con 0x7fb654060780 2023-12-24T18:48:23.212 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-12-24T18:48:23.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 msgr2=0x7fb654062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 0x7fb654062c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb658007fd0 tx=0x7fb658009040 comp rx=0 tx=0).stop 2023-12-24T18:48:23.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 msgr2=0x7fb66815b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb660009e90 tx=0x7fb66000b040 comp rx=0 tx=0).stop 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 shutdown_connections 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb654060780 0x7fb654062c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb668159080 0x7fb66815b480 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6680c5ac0 0x7fb668148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 --2- 172.21.15.50:0/2331102207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb66806a4a0 0x7fb668169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 >> 172.21.15.50:0/2331102207 conn(0x7fb668067b80 msgr2=0x7fb6680cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 shutdown_connections 2023-12-24T18:48:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.214+0000 7fb66c9cc700 1 -- 172.21.15.50:0/2331102207 wait complete. 2023-12-24T18:48:23.241 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-12-24T18:48:23.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-12-24T18:48:23.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.430+0000 7f904d5c5700 1 Processor -- start 2023-12-24T18:48:23.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.430+0000 7f904d5c5700 1 -- start start 2023-12-24T18:48:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f904d5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9048158fc0 0x7f90480cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f904d5c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90480cc7f0 0x7f90480ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f904d5c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90480cabf0 con 0x7f904806a4f0 2023-12-24T18:48:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f904d5c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904806b520 con 0x7f90480cc7f0 2023-12-24T18:48:23.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f904d5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904806b060 con 0x7f9048158fc0 2023-12-24T18:48:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f90477fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f904806a4f0 0x7f904806a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58376/0 (socket says 172.21.15.50:58376) 2023-12-24T18:48:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f90477fe700 1 -- 172.21.15.50:0/2806827156 learned_addr learned my addr 172.21.15.50:0/2806827156 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9046ffd700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9048158fc0 0x7f90480cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f90467fc700 1 --2- 172.21.15.50:0/2806827156 >> v2:172.21.15.82:3300/0 conn(0x7f90480cc7f0 0x7f90480ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113523223 0 0) 0x7f90480cabf0 con 0x7f904806a4f0 2023-12-24T18:48:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9030003570 con 0x7f904806a4f0 2023-12-24T18:48:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707432691 0 0) 0x7f9030003570 con 0x7f904806a4f0 2023-12-24T18:48:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9048158fc0 msgr2=0x7f90480cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9048158fc0 0x7f90480cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 >> v2:172.21.15.82:3300/0 conn(0x7f90480cc7f0 msgr2=0x7f90480ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 --2- 172.21.15.50:0/2806827156 >> v2:172.21.15.82:3300/0 conn(0x7f90480cc7f0 0x7f90480ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480cd1a0 con 0x7f904806a4f0 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f90400017f0 con 0x7f904806a4f0 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 >> v1:172.21.15.50:6789/0 conn(0x7f904806a4f0 legacy=0x7f904806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030003a60 0x7f9030003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9030004810 0x7f9030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90300051c0 0x7f903000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904806b520 con 0x7f9030004810 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904806b060 con 0x7f90300051c0 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903000bfa0 con 0x7f9030003a60 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9046ffd700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9048158fc0 0x7f90480cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f90467fc700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9030004810 0x7f9030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f90477fe700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90300051c0 0x7f903000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.434+0000 7f9046ffd700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030003a60 0x7f9030003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 -- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030003a60 msgr2=0x7f9030003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030003a60 0x7f9030003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 -- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90300051c0 msgr2=0x7f903000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90300051c0 0x7f903000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 -- 172.21.15.50:0/2806827156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030003570 con 0x7f9030004810 2023-12-24T18:48:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90477fe700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90300051c0 0x7f903000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90467fc700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9030004810 0x7f9030004c80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f903c009c00 tx=0x7f903c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515025fb049bc58f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00e710 con 0x7f9030004810 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00e870 con 0x7f9030004810 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f9045ffb700 1 -- 172.21.15.50:0/2806827156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ec30 con 0x7f9030004810 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 -- 172.21.15.50:0/2806827156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9030004810 msgr2=0x7f9030004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 --2- 172.21.15.50:0/2806827156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9030004810 0x7f9030004c80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f903c009c00 tx=0x7f903c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f90477fe700 1 -- 172.21.15.50:0/2806827156 reap_dead start 2023-12-24T18:48:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 -- 172.21.15.50:0/2806827156 shutdown_connections 2023-12-24T18:48:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 -- 172.21.15.50:0/2806827156 >> 172.21.15.50:0/2806827156 conn(0x7f90480670b0 msgr2=0x7f90480674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 -- 172.21.15.50:0/2806827156 shutdown_connections 2023-12-24T18:48:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.438+0000 7f904d5c5700 1 -- 172.21.15.50:0/2806827156 wait complete. 2023-12-24T18:48:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.442+0000 7f904d5c5700 1 Processor -- start 2023-12-24T18:48:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.442+0000 7f904d5c5700 1 -- start start 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.442+0000 7f904d5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030004810 0x7f90480c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480c5cb0 0x7f9048169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480ce340 con 0x7f90480cd990 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b3f80 con 0x7f90480c5cb0 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b4260 con 0x7f9030004810 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41704/0 (socket says 172.21.15.50:41704) 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 -- 172.21.15.50:0/46207100 learned_addr learned my addr 172.21.15.50:0/46207100 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90467fc700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480c5cb0 0x7f9048169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f9046ffd700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030004810 0x7f90480c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 -- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030004810 msgr2=0x7f90480c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030004810 0x7f90480c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 -- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480c5cb0 msgr2=0x7f9048169360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480c5cb0 0x7f9048169360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 -- 172.21.15.50:0/46207100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480c6120 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f90477fe700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90480cd8c0 tx=0x7f90480cab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400079e0 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040007b40 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040013640 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9048169bb0 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.446+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904816a170 con 0x7f90480cd990 2023-12-24T18:48:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.450+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904804be40 con 0x7f90480cd990 2023-12-24T18:48:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.450+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f90400139b0 con 0x7f90480cd990 2023-12-24T18:48:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.450+0000 7f902effd700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 0x7f9034062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.450+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f904007d800 con 0x7f90480cd990 2023-12-24T18:48:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.450+0000 7f9046ffd700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 0x7f9034062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.454+0000 7f9046ffd700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 0x7f9034062c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90480cfa60 tx=0x7f90380091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:23.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.458+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f904004d870 con 0x7f90480cd990 2023-12-24T18:48:23.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.658+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f904806b240 con 0x7f90340607d0 2023-12-24T18:48:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.782+0000 7f902effd700 1 -- 172.21.15.50:0/46207100 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f904806b240 con 0x7f90340607d0 2023-12-24T18:48:23.784 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 msgr2=0x7f9034062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 0x7f9034062c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90480cfa60 tx=0x7f90380091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 msgr2=0x7f90480cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90480cd8c0 tx=0x7f90480cab60 comp rx=0 tx=0).stop 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 shutdown_connections 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f90340607d0 0x7f9034062c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90480cd990 0x7f90480cde00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480c5cb0 0x7f9048169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 --2- 172.21.15.50:0/46207100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9030004810 0x7f90480c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 >> 172.21.15.50:0/46207100 conn(0x7f90480670b0 msgr2=0x7f9048153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 shutdown_connections 2023-12-24T18:48:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.786+0000 7f904d5c5700 1 -- 172.21.15.50:0/46207100 wait complete. 2023-12-24T18:48:23.811 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-12-24T18:48:23.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-12-24T18:48:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.994+0000 7fc7d802e700 1 Processor -- start 2023-12-24T18:48:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.994+0000 7fc7d802e700 1 -- start start 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7d0156b50 0x7fc7d015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 0x7fc7d00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7d00b4060 0x7fc7d015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00b44e0 con 0x7fc7d0156b50 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d006d4d0 con 0x7fc7d00b4060 2023-12-24T18:48:23.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d802e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b4960 con 0x7fc7d006db90 2023-12-24T18:48:24.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7d0156b50 0x7fc7d015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7d0156b50 0x7fc7d015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41708/0 (socket says 172.21.15.50:41708) 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2120316291 learned_addr learned my addr 172.21.15.50:0/2120316291 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d65cb700 1 --2- 172.21.15.50:0/2120316291 >> v2:172.21.15.82:3300/0 conn(0x7fc7d00b4060 0x7fc7d015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d55c9700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 0x7fc7d00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2120316291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 msgr2=0x7fc7d00b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 0x7fc7d00b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2120316291 >> v2:172.21.15.82:3300/0 conn(0x7fc7d00b4060 msgr2=0x7fc7d015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2120316291 >> v2:172.21.15.82:3300/0 conn(0x7fc7d00b4060 0x7fc7d015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2120316291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015a620 con 0x7fc7d0156b50 2023-12-24T18:48:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d55c9700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 0x7fc7d00b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d0156b50 0x7fc7d015a0e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc7d006e950 tx=0x7fc7cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0dc75414fe03d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d4dc8700 1 -- 172.21.15.50:0/2120316291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc009e70 con 0x7fc7d0156b50 2023-12-24T18:48:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d4dc8700 1 -- 172.21.15.50:0/2120316291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc00b860 con 0x7fc7d0156b50 2023-12-24T18:48:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:23.998+0000 7fc7d4dc8700 1 -- 172.21.15.50:0/2120316291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00bc00 con 0x7fc7d0156b50 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 -- 172.21.15.50:0/2120316291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d0156b50 msgr2=0x7fc7d015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d0156b50 0x7fc7d015a0e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc7d006e950 tx=0x7fc7cc009250 comp rx=0 tx=0).stop 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 -- 172.21.15.50:0/2120316291 shutdown_connections 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2120316291 >> v2:172.21.15.82:3300/0 conn(0x7fc7d00b4060 0x7fc7d015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d006db90 0x7fc7d00b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2120316291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d0156b50 0x7fc7d015a0e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 -- 172.21.15.50:0/2120316291 >> 172.21.15.50:0/2120316291 conn(0x7fc7d0067b40 msgr2=0x7fc7d00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 -- 172.21.15.50:0/2120316291 shutdown_connections 2023-12-24T18:48:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.002+0000 7fc7d802e700 1 -- 172.21.15.50:0/2120316291 wait complete. 2023-12-24T18:48:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 Processor -- start 2023-12-24T18:48:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 -- start start 2023-12-24T18:48:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d00b4060 0x7fc7d0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 0x7fc7d0152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01542e0 con 0x7fc7d006db90 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01536d0 con 0x7fc7d0156b50 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d802e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01539b0 con 0x7fc7d00b4060 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41724/0 (socket says 172.21.15.50:41724) 2023-12-24T18:48:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2572224497 learned_addr learned my addr 172.21.15.50:0/2572224497 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d00b4060 msgr2=0x7fc7d0154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d00b4060 0x7fc7d0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 msgr2=0x7fc7d0152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d65cb700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 0x7fc7d0152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 0x7fc7d0152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 -- 172.21.15.50:0/2572224497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0094f0 con 0x7fc7d006db90 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d65cb700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 0x7fc7d0152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.006+0000 7fc7d5dca700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009290 tx=0x7fc7cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00bbe0 con 0x7fc7d006db90 2023-12-24T18:48:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc01f070 con 0x7fc7d006db90 2023-12-24T18:48:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0266b0 con 0x7fc7d006db90 2023-12-24T18:48:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d0153c90 con 0x7fc7d006db90 2023-12-24T18:48:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d014f110 con 0x7fc7d006db90 2023-12-24T18:48:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d0071060 con 0x7fc7d006db90 2023-12-24T18:48:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.010+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fc7cc026a60 con 0x7fc7d006db90 2023-12-24T18:48:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.014+0000 7fc7c5ffb700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 0x7fc7b4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.014+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fc7cc021070 con 0x7fc7d006db90 2023-12-24T18:48:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.014+0000 7fc7d55c9700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 0x7fc7b4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.014+0000 7fc7d55c9700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 0x7fc7b4062c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0006fd0 tx=0x7fc7c0008040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.018+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc7cc04eb00 con 0x7fc7d006db90 2023-12-24T18:48:24.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.214+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7d0154420 con 0x7fc7b4060750 2023-12-24T18:48:24.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.330+0000 7fc7c5ffb700 1 -- 172.21.15.50:0/2572224497 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc7c0009640 con 0x7fc7b4060750 2023-12-24T18:48:24.332 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-12-24T18:48:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 msgr2=0x7fc7b4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 0x7fc7b4062c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0006fd0 tx=0x7fc7c0008040 comp rx=0 tx=0).stop 2023-12-24T18:48:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 msgr2=0x7fc7d014ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009290 tx=0x7fc7cc017000 comp rx=0 tx=0).stop 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 shutdown_connections 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc7b4060750 0x7fc7b4062c00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d0156b50 0x7fc7d0152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7d00b4060 0x7fc7d0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 --2- 172.21.15.50:0/2572224497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7d006db90 0x7fc7d014ebd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 >> 172.21.15.50:0/2572224497 conn(0x7fc7d0067b40 msgr2=0x7fc7d00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 shutdown_connections 2023-12-24T18:48:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.334+0000 7fc7d802e700 1 -- 172.21.15.50:0/2572224497 wait complete. 2023-12-24T18:48:24.359 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-12-24T18:48:24.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-12-24T18:48:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.538+0000 7f0c5940c700 1 Processor -- start 2023-12-24T18:48:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.538+0000 7f0c5940c700 1 -- start start 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c5940c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0c54159210 0x7f0c540cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c5940c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540cae00 con 0x7f0c540670b0 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c5940c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540ca4d0 con 0x7f0c54158e40 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c5940c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c54159640 con 0x7f0c54159210 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c58c0b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c540670b0 0x7f0c540afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58386/0 (socket says 172.21.15.50:58386) 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3898498329 learned_addr learned my addr 172.21.15.50:0/3898498329 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c537fe700 1 --2- 172.21.15.50:0/3898498329 >> v2:172.21.15.82:3300/0 conn(0x7f0c54159210 0x7f0c540cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996370837 0 0) 0x7f0c540cae00 con 0x7f0c540670b0 2023-12-24T18:48:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c003570 con 0x7f0c540670b0 2023-12-24T18:48:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890750168 0 0) 0x7f0c540ca4d0 con 0x7f0c54158e40 2023-12-24T18:48:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c540cae00 con 0x7f0c54158e40 2023-12-24T18:48:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837719812 0 0) 0x7f0c3c003570 con 0x7f0c540670b0 2023-12-24T18:48:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 >> v2:172.21.15.82:3300/0 conn(0x7f0c54159210 msgr2=0x7f0c540cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 --2- 172.21.15.50:0/3898498329 >> v2:172.21.15.82:3300/0 conn(0x7f0c54159210 0x7f0c540cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 >> v1:172.21.15.82:6789/0 conn(0x7f0c54158e40 legacy=0x7f0c5406d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540ca7b0 con 0x7f0c540670b0 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.542+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f0c4c0017f0 con 0x7f0c540670b0 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 >> v1:172.21.15.50:6789/0 conn(0x7f0c540670b0 legacy=0x7f0c540afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c3c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3c004810 0x7f0c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c3c0051c0 0x7f0c3c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00c080 con 0x7f0c3c004810 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00c1f0 con 0x7f0c3c003bf0 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00c3b0 con 0x7f0c3c0051c0 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c3c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c537fe700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3c004810 0x7f0c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c58c0b700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c3c0051c0 0x7f0c3c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 -- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c3c0051c0 msgr2=0x7f0c3c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c3c0051c0 0x7f0c3c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 -- 172.21.15.50:0/3898498329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3c004810 msgr2=0x7f0c3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3c004810 0x7f0c3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 -- 172.21.15.50:0/3898498329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c003570 con 0x7f0c3c003bf0 2023-12-24T18:48:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3898498329 reap_dead start 2023-12-24T18:48:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c3c003fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c44001a10 tx=0x7f0c44007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309085827e191456 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400c590 con 0x7f0c3c003bf0 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400c6f0 con 0x7f0c3c003bf0 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c52ffd700 1 -- 172.21.15.50:0/3898498329 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400ca90 con 0x7f0c3c003bf0 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c5940c700 1 -- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 msgr2=0x7f0c3c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.546+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c3c003fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c44001a10 tx=0x7f0c44007d30 comp rx=0 tx=0).stop 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 -- 172.21.15.50:0/3898498329 shutdown_connections 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3898498329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c3c003fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 -- 172.21.15.50:0/3898498329 >> 172.21.15.50:0/3898498329 conn(0x7f0c540cfd90 msgr2=0x7f0c540d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 -- 172.21.15.50:0/3898498329 shutdown_connections 2023-12-24T18:48:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 -- 172.21.15.50:0/3898498329 wait complete. 2023-12-24T18:48:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 Processor -- start 2023-12-24T18:48:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.550+0000 7f0c5940c700 1 -- start start 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c541595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415c050 0x7f0c54155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540b5540 con 0x7f0c540b4b90 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540c7130 con 0x7f0c3c003bf0 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540b3a10 con 0x7f0c5415c050 2023-12-24T18:48:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c53fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c541595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41742/0 (socket says 172.21.15.50:41742) 2023-12-24T18:48:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3493448694 learned_addr learned my addr 172.21.15.50:0/3493448694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c537fe700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415c050 0x7f0c54155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415c050 msgr2=0x7f0c54155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415c050 0x7f0c54155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 msgr2=0x7f0c541595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c541595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 -- 172.21.15.50:0/3493448694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540b3cf0 con 0x7f0c540b4b90 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c541595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c58c0b700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c540cfa30 tx=0x7f0c4c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c007ac0 con 0x7f0c540b4b90 2023-12-24T18:48:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c00ac90 con 0x7f0c540b4b90 2023-12-24T18:48:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c540b3fd0 con 0x7f0c540b4b90 2023-12-24T18:48:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c013640 con 0x7f0c540b4b90 2023-12-24T18:48:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.554+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c540b36e0 con 0x7f0c540b4b90 2023-12-24T18:48:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.558+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c540c72e0 con 0x7f0c540b4b90 2023-12-24T18:48:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.558+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f0c4c013a30 con 0x7f0c540b4b90 2023-12-24T18:48:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.558+0000 7f0c3bfff700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 0x7f0c40062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.558+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f0c4c07d5a0 con 0x7f0c540b4b90 2023-12-24T18:48:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.558+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 0x7f0c40062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.562+0000 7f0c53fff700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 0x7f0c40062c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c44000c00 tx=0x7f0c44015000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.566+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c540c72e0 con 0x7f0c540b4b90 2023-12-24T18:48:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.758+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c540c72a0 con 0x7f0c40060750 2023-12-24T18:48:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.878+0000 7f0c3bfff700 1 -- 172.21.15.50:0/3493448694 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0c540c72a0 con 0x7f0c40060750 2023-12-24T18:48:24.881 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-12-24T18:48:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 msgr2=0x7f0c40062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 0x7f0c40062c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c44000c00 tx=0x7f0c44015000 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 msgr2=0x7f0c540b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c540cfa30 tx=0x7f0c4c002170 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 shutdown_connections 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0c40060750 0x7f0c40062c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c540b4b90 0x7f0c540b5000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415c050 0x7f0c54155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 --2- 172.21.15.50:0/3493448694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c003bf0 0x7f0c541595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 >> 172.21.15.50:0/3493448694 conn(0x7f0c540cfd90 msgr2=0x7f0c540ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 shutdown_connections 2023-12-24T18:48:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:24.882+0000 7f0c5940c700 1 -- 172.21.15.50:0/3493448694 wait complete. 2023-12-24T18:48:24.909 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-12-24T18:48:24.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-12-24T18:48:25.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.082+0000 7fc26e48e700 1 Processor -- start 2023-12-24T18:48:25.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.086+0000 7fc26e48e700 1 -- start start 2023-12-24T18:48:25.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.086+0000 7fc26e48e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc268155b80 0x7fc26806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26e48e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc268155f50 con 0x7fc26806d830 2023-12-24T18:48:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26e48e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2680c8300 con 0x7fc2680c7e00 2023-12-24T18:48:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26e48e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680c8ba0 con 0x7fc268155b80 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26dc8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc26806d830 0x7fc2680abb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58390/0 (socket says 172.21.15.50:58390) 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26dc8d700 1 -- 172.21.15.50:0/4229819297 learned_addr learned my addr 172.21.15.50:0/4229819297 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26d48c700 1 --2- 172.21.15.50:0/4229819297 >> v2:172.21.15.82:3300/0 conn(0x7fc268155b80 0x7fc26806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551195153 0 0) 0x7fc268155f50 con 0x7fc26806d830 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc254003570 con 0x7fc26806d830 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496815670 0 0) 0x7fc2680c8300 con 0x7fc2680c7e00 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26d48c700 1 -- 172.21.15.50:0/4229819297 >> v1:172.21.15.82:6789/0 conn(0x7fc2680c7e00 legacy=0x7fc2680cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26d48c700 1 -- 172.21.15.50:0/4229819297 >> v1:172.21.15.50:6789/0 conn(0x7fc26806d830 legacy=0x7fc2680abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26d48c700 1 -- 172.21.15.50:0/4229819297 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2680c85e0 con 0x7fc268155b80 2023-12-24T18:48:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc26d48c700 1 --2- 172.21.15.50:0/4229819297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc268155b80 0x7fc26806ba00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2640098e0 tx=0x7fc2640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bdace4fe4d4ee20 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.090+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600017f0 con 0x7fc268155b80 2023-12-24T18:48:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400f4a0 con 0x7fc268155b80 2023-12-24T18:48:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc25ffff700 1 -- 172.21.15.50:0/4229819297 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400f840 con 0x7fc268155b80 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 -- 172.21.15.50:0/4229819297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc268155b80 msgr2=0x7fc26806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 --2- 172.21.15.50:0/4229819297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc268155b80 0x7fc26806ba00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2640098e0 tx=0x7fc2640091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 -- 172.21.15.50:0/4229819297 shutdown_connections 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 --2- 172.21.15.50:0/4229819297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc268155b80 0x7fc26806ba00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 -- 172.21.15.50:0/4229819297 >> 172.21.15.50:0/4229819297 conn(0x7fc26806ad60 msgr2=0x7fc26806b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 -- 172.21.15.50:0/4229819297 shutdown_connections 2023-12-24T18:48:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.094+0000 7fc26e48e700 1 -- 172.21.15.50:0/4229819297 wait complete. 2023-12-24T18:48:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 Processor -- start 2023-12-24T18:48:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 -- start start 2023-12-24T18:48:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 0x7fc26814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 0x7fc2681536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680b0b70 con 0x7fc2680c7e00 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680c4df0 con 0x7fc26806d830 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26e48e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680b05b0 con 0x7fc268155b80 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26cc8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26d48c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 0x7fc26814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26cc8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41748/0 (socket says 172.21.15.50:41748) 2023-12-24T18:48:25.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26d48c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 0x7fc26814be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:39862/0 (socket says 172.21.15.50:39862) 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26cc8b700 1 -- 172.21.15.50:0/3632707753 learned_addr learned my addr 172.21.15.50:0/3632707753 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.098+0000 7fc26dc8d700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 0x7fc2681536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 -- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 msgr2=0x7fc2681536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 0x7fc2681536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 -- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 msgr2=0x7fc26814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 0x7fc26814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 -- 172.21.15.50:0/3632707753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009420 con 0x7fc2680c7e00 2023-12-24T18:48:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26dc8d700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 0x7fc2681536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26cc8b700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c7e0 tx=0x7fc258007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258011590 con 0x7fc2680c7e00 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258011710 con 0x7fc2680c7e00 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258011ad0 con 0x7fc2680c7e00 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2680b0890 con 0x7fc2680c7e00 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26814c3c0 con 0x7fc2680c7e00 2023-12-24T18:48:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.102+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26804be40 con 0x7fc2680c7e00 2023-12-24T18:48:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.106+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fc25801b3b0 con 0x7fc2680c7e00 2023-12-24T18:48:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.106+0000 7fc25d7fa700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 0x7fc24c062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.106+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fc25807c450 con 0x7fc2680c7e00 2023-12-24T18:48:25.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.106+0000 7fc26d48c700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 0x7fc24c062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.106+0000 7fc26d48c700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 0x7fc24c062c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2640093f0 tx=0x7fc264019000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.110+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc25804c4c0 con 0x7fc2680c7e00 2023-12-24T18:48:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.306+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2680c4900 con 0x7fc24c060750 2023-12-24T18:48:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.422+0000 7fc25d7fa700 1 -- 172.21.15.50:0/3632707753 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc264020040 con 0x7fc24c060750 2023-12-24T18:48:25.426 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-12-24T18:48:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 msgr2=0x7fc24c062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 0x7fc24c062c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2640093f0 tx=0x7fc264019000 comp rx=0 tx=0).stop 2023-12-24T18:48:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 msgr2=0x7fc2681531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c7e0 tx=0x7fc258007df0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 shutdown_connections 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc24c060750 0x7fc24c062c00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc268155b80 0x7fc2681536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2680c7e00 0x7fc2681531a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 --2- 172.21.15.50:0/3632707753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26806d830 0x7fc26814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 >> 172.21.15.50:0/3632707753 conn(0x7fc26806ad60 msgr2=0x7fc2680c2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 shutdown_connections 2023-12-24T18:48:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.426+0000 7fc26e48e700 1 -- 172.21.15.50:0/3632707753 wait complete. 2023-12-24T18:48:25.452 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-12-24T18:48:25.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-12-24T18:48:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 Processor -- start 2023-12-24T18:48:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 -- start start 2023-12-24T18:48:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9154158df0 0x7f91541591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915415a480 con 0x7f91540cc830 2023-12-24T18:48:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9154159870 con 0x7f91540c5d10 2023-12-24T18:48:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.634+0000 7f91594e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9154159b50 con 0x7f9154158df0 2023-12-24T18:48:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9158ce2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f91540cc830 0x7f915406ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2023-12-24T18:48:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9158ce2700 1 -- 172.21.15.50:0/1140495325 learned_addr learned my addr 172.21.15.50:0/1140495325 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9153fff700 1 --2- 172.21.15.50:0/1140495325 >> v2:172.21.15.82:3300/0 conn(0x7f9154158df0 0x7f91541591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9152ffd700 1 -- 172.21.15.50:0/1140495325 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282236804 0 0) 0x7f915415a480 con 0x7f91540cc830 2023-12-24T18:48:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9153fff700 1 -- 172.21.15.50:0/1140495325 >> v1:172.21.15.82:6789/0 conn(0x7f91540c5d10 legacy=0x7f915406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9153fff700 1 -- 172.21.15.50:0/1140495325 >> v1:172.21.15.50:6789/0 conn(0x7f91540cc830 legacy=0x7f915406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9153fff700 1 -- 172.21.15.50:0/1140495325 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154159e30 con 0x7f9154158df0 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9153fff700 1 --2- 172.21.15.50:0/1140495325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9154158df0 0x7f91541591c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f91440098e0 tx=0x7f91440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4204fad3a33660 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9152ffd700 1 -- 172.21.15.50:0/1140495325 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144009e80 con 0x7f9154158df0 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9152ffd700 1 -- 172.21.15.50:0/1140495325 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914400b860 con 0x7f9154158df0 2023-12-24T18:48:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f9152ffd700 1 -- 172.21.15.50:0/1140495325 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400bbe0 con 0x7f9154158df0 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 -- 172.21.15.50:0/1140495325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9154158df0 msgr2=0x7f91541591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 --2- 172.21.15.50:0/1140495325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9154158df0 0x7f91541591c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f91440098e0 tx=0x7f91440091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 -- 172.21.15.50:0/1140495325 shutdown_connections 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 --2- 172.21.15.50:0/1140495325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9154158df0 0x7f91541591c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 -- 172.21.15.50:0/1140495325 >> 172.21.15.50:0/1140495325 conn(0x7f91540670b0 msgr2=0x7f91540674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 -- 172.21.15.50:0/1140495325 shutdown_connections 2023-12-24T18:48:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.638+0000 7f91594e3700 1 -- 172.21.15.50:0/1140495325 wait complete. 2023-12-24T18:48:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 Processor -- start 2023-12-24T18:48:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 -- start start 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91540cc830 0x7f915416e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9154158df0 0x7f91540c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915416eec0 con 0x7f91540c5d10 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915416ec60 con 0x7f91540cc830 2023-12-24T18:48:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91594e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9154157880 con 0x7f9154158df0 2023-12-24T18:48:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f9153fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f9153fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41754/0 (socket says 172.21.15.50:41754) 2023-12-24T18:48:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f9153fff700 1 -- 172.21.15.50:0/2045480134 learned_addr learned my addr 172.21.15.50:0/2045480134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f91537fe700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91540cc830 0x7f915416e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.642+0000 7f9158ce2700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9154158df0 0x7f91540c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 -- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9154158df0 msgr2=0x7f91540c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9154158df0 0x7f91540c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 -- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91540cc830 msgr2=0x7f915416e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91540cc830 0x7f915416e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 -- 172.21.15.50:0/2045480134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144009420 con 0x7f91540c5d10 2023-12-24T18:48:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f9153fff700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f914400b3c0 tx=0x7f9144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914401f070 con 0x7f91540c5d10 2023-12-24T18:48:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144000c90 con 0x7f91540c5d10 2023-12-24T18:48:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400bbe0 con 0x7f91540c5d10 2023-12-24T18:48:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9154157b60 con 0x7f91540c5d10 2023-12-24T18:48:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9154158120 con 0x7f91540c5d10 2023-12-24T18:48:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.646+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915404be40 con 0x7f91540c5d10 2023-12-24T18:48:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.650+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f9144011420 con 0x7f91540c5d10 2023-12-24T18:48:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.650+0000 7f913bfff700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 0x7f9140062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.650+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f914407e2d0 con 0x7f91540c5d10 2023-12-24T18:48:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.650+0000 7f91537fe700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 0x7f9140062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.654+0000 7f91537fe700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 0x7f9140062c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f915416b8e0 tx=0x7f9148007ec0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.658+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f914404e340 con 0x7f91540c5d10 2023-12-24T18:48:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.854+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f91540b5c40 con 0x7f9140060750 2023-12-24T18:48:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.970+0000 7f913bfff700 1 -- 172.21.15.50:0/2045480134 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f91540b5c40 con 0x7f9140060750 2023-12-24T18:48:25.974 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 msgr2=0x7f9140062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 0x7f9140062c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f915416b8e0 tx=0x7f9148007ec0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 msgr2=0x7f91541571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f914400b3c0 tx=0x7f9144017000 comp rx=0 tx=0).stop 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 shutdown_connections 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9140060750 0x7f9140062c00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9154158df0 0x7f91540c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91540cc830 0x7f915416e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 --2- 172.21.15.50:0/2045480134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540c5d10 0x7f91541571a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.974+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 >> 172.21.15.50:0/2045480134 conn(0x7f91540670b0 msgr2=0x7f91540cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.978+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 shutdown_connections 2023-12-24T18:48:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:25.978+0000 7f91594e3700 1 -- 172.21.15.50:0/2045480134 wait complete. 2023-12-24T18:48:26.002 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-12-24T18:48:26.002 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-12-24T18:48:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.178+0000 7fa9e1425700 1 Processor -- start 2023-12-24T18:48:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 -- start start 2023-12-24T18:48:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9dc157df0 0x7fa9dc0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc06ca30 con 0x7fa9dc1581c0 2023-12-24T18:48:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc069150 con 0x7fa9dc157df0 2023-12-24T18:48:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.182+0000 7fa9e1425700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc069430 con 0x7fa9dc068bc0 2023-12-24T18:48:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9dc157df0 0x7fa9dc0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9dc157df0 0x7fa9dc0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41766/0 (socket says 172.21.15.50:41766) 2023-12-24T18:48:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 -- 172.21.15.50:0/1228816704 learned_addr learned my addr 172.21.15.50:0/1228816704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9db7fe700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9da7fc700 1 --1- 172.21.15.50:0/1228816704 >> v1:172.21.15.82:6789/0 conn(0x7fa9dc1581c0 0x7fa9dc0684b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60480/0 (socket says 172.21.15.50:60480) 2023-12-24T18:48:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 -- 172.21.15.50:0/1228816704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 msgr2=0x7fa9dc0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc0c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 -- 172.21.15.50:0/1228816704 >> v1:172.21.15.82:6789/0 conn(0x7fa9dc1581c0 legacy=0x7fa9dc0684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 -- 172.21.15.50:0/1228816704 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc069710 con 0x7fa9dc157df0 2023-12-24T18:48:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc0c7510 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0099b0 tx=0x7fa9cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb6d9491c41147 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9d9ffb700 1 -- 172.21.15.50:0/1228816704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc009ea0 con 0x7fa9dc157df0 2023-12-24T18:48:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9d9ffb700 1 -- 172.21.15.50:0/1228816704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00b860 con 0x7fa9dc157df0 2023-12-24T18:48:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9d9ffb700 1 -- 172.21.15.50:0/1228816704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00bc20 con 0x7fa9dc157df0 2023-12-24T18:48:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 -- 172.21.15.50:0/1228816704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 msgr2=0x7fa9dc0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc0c7510 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0099b0 tx=0x7fa9cc009250 comp rx=0 tx=0).stop 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 -- 172.21.15.50:0/1228816704 shutdown_connections 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc0c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1228816704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc0c7510 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.186+0000 7fa9e1425700 1 -- 172.21.15.50:0/1228816704 >> 172.21.15.50:0/1228816704 conn(0x7fa9dc0ccf90 msgr2=0x7fa9dc0c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.190+0000 7fa9e1425700 1 -- 172.21.15.50:0/1228816704 shutdown_connections 2023-12-24T18:48:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.190+0000 7fa9e1425700 1 -- 172.21.15.50:0/1228816704 wait complete. 2023-12-24T18:48:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.190+0000 7fa9e1425700 1 Processor -- start 2023-12-24T18:48:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.190+0000 7fa9e1425700 1 -- start start 2023-12-24T18:48:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc1581c0 0x7fa9dc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc156be0 con 0x7fa9dc157df0 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc152850 con 0x7fa9dc1581c0 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9e1425700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc155cf0 con 0x7fa9dc068bc0 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41778/0 (socket says 172.21.15.50:41778) 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9da7fc700 1 -- 172.21.15.50:0/1751418227 learned_addr learned my addr 172.21.15.50:0/1751418227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9db7fe700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc1581c0 0x7fa9dc1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 -- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc1581c0 msgr2=0x7fa9dc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc1581c0 0x7fa9dc1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 -- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 msgr2=0x7fa9dc14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.194+0000 7fa9daffd700 1 -- 172.21.15.50:0/1751418227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0094f0 con 0x7fa9dc068bc0 2023-12-24T18:48:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9da7fc700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9daffd700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc152310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0b24c0 tx=0x7fa9cc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc01f070 con 0x7fa9dc068bc0 2023-12-24T18:48:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00b9d0 con 0x7fa9dc068bc0 2023-12-24T18:48:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc155fd0 con 0x7fa9dc068bc0 2023-12-24T18:48:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011420 con 0x7fa9dc068bc0 2023-12-24T18:48:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc156590 con 0x7fa9dc068bc0 2023-12-24T18:48:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.198+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc071060 con 0x7fa9dc068bc0 2023-12-24T18:48:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.202+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fa9cc011790 con 0x7fa9dc068bc0 2023-12-24T18:48:26.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.202+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 0x7fa9c8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.202+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fa9cc07e050 con 0x7fa9dc068bc0 2023-12-24T18:48:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.202+0000 7fa9da7fc700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 0x7fa9c8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.206+0000 7fa9da7fc700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 0x7fa9c8062c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc16c950 tx=0x7fa9d0007f70 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.214+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa9cc0adbe0 con 0x7fa9dc068bc0 2023-12-24T18:48:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.410+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9dc06cec0 con 0x7fa9c8060750 2023-12-24T18:48:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.538+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1751418227 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa9dc06cec0 con 0x7fa9c8060750 2023-12-24T18:48:26.540 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-12-24T18:48:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 msgr2=0x7fa9c8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 0x7fa9c8062c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc16c950 tx=0x7fa9d0007f70 comp rx=0 tx=0).stop 2023-12-24T18:48:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 msgr2=0x7fa9dc152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc152310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0b24c0 tx=0x7fa9cc017000 comp rx=0 tx=0).stop 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 shutdown_connections 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa9c8060750 0x7fa9c8062c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc1581c0 0x7fa9dc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc157df0 0x7fa9dc14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 --2- 172.21.15.50:0/1751418227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9dc068bc0 0x7fa9dc152310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 >> 172.21.15.50:0/1751418227 conn(0x7fa9dc0ccf90 msgr2=0x7fa9dc0c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 shutdown_connections 2023-12-24T18:48:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.542+0000 7fa9e1425700 1 -- 172.21.15.50:0/1751418227 wait complete. 2023-12-24T18:48:26.568 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-12-24T18:48:26.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-12-24T18:48:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.746+0000 7fa4dcd45700 1 Processor -- start 2023-12-24T18:48:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.746+0000 7fa4dcd45700 1 -- start start 2023-12-24T18:48:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4dcd45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4d80c7630 0x7fa4d80c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4dcd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4d8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4dcd45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d806cb90 con 0x7fa4d806b7f0 2023-12-24T18:48:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4dcd45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80ac410 con 0x7fa4d80c7630 2023-12-24T18:48:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4dcd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d806bd70 con 0x7fa4d8158bc0 2023-12-24T18:48:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4d806b7f0 0x7fa4d80c6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58404/0 (socket says 172.21.15.50:58404) 2023-12-24T18:48:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d5d9b700 1 -- 172.21.15.50:0/3100188955 learned_addr learned my addr 172.21.15.50:0/3100188955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4d8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d659c700 1 --2- 172.21.15.50:0/3100188955 >> v2:172.21.15.82:3300/0 conn(0x7fa4d80c7630 0x7fa4d80c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194831475 0 0) 0x7fa4d806cb90 con 0x7fa4d806b7f0 2023-12-24T18:48:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c0003570 con 0x7fa4d806b7f0 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393512339 0 0) 0x7fa4c0003570 con 0x7fa4d806b7f0 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 msgr2=0x7fa4d8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4d8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 >> v2:172.21.15.82:3300/0 conn(0x7fa4d80c7630 msgr2=0x7fa4d80c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 --2- 172.21.15.50:0/3100188955 >> v2:172.21.15.82:3300/0 conn(0x7fa4d80c7630 0x7fa4d80c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d806c050 con 0x7fa4d806b7f0 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fa4cc001470 con 0x7fa4d806b7f0 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 >> v1:172.21.15.50:6789/0 conn(0x7fa4d806b7f0 legacy=0x7fa4d80c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80ac410 con 0x7fa4c0004810 2023-12-24T18:48:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d806bd70 con 0x7fa4c0003a60 2023-12-24T18:48:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.750+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c000ba60 con 0x7fa4d8158bc0 2023-12-24T18:48:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d659c700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 -- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 msgr2=0x7fa4c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 -- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c0003a60 msgr2=0x7fa4c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 -- 172.21.15.50:0/3100188955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0003570 con 0x7fa4c0004810 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d8158bc0 0x7fa4c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d659c700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d5d9b700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c3f0 tx=0x7fa4cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249ab4103edce578 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00cc80 con 0x7fa4c0004810 2023-12-24T18:48:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00ce20 con 0x7fa4c0004810 2023-12-24T18:48:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.754+0000 7fa4d559a700 1 -- 172.21.15.50:0/3100188955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc005b70 con 0x7fa4c0004810 2023-12-24T18:48:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- 172.21.15.50:0/3100188955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c0004810 msgr2=0x7fa4c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/3100188955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c3f0 tx=0x7fa4cc001e90 comp rx=0 tx=0).stop 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4d6d9d700 1 -- 172.21.15.50:0/3100188955 reap_dead start 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- 172.21.15.50:0/3100188955 shutdown_connections 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- 172.21.15.50:0/3100188955 >> 172.21.15.50:0/3100188955 conn(0x7fa4d80ccf50 msgr2=0x7fa4d80670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- 172.21.15.50:0/3100188955 shutdown_connections 2023-12-24T18:48:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- 172.21.15.50:0/3100188955 wait complete. 2023-12-24T18:48:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 Processor -- start 2023-12-24T18:48:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.758+0000 7fa4dcd45700 1 -- start start 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 0x7fa4d80c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80c65e0 0x7fa4d80af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 0x7fa4d81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c43a0 con 0x7fa4d80afdc0 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80af3f0 con 0x7fa4d80c65e0 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c6a50 con 0x7fa4c0004810 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 0x7fa4d81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 0x7fa4d80c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 0x7fa4d80c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:58096/0 (socket says 172.21.15.50:58096) 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d659c700 1 -- 172.21.15.50:0/1973582819 learned_addr learned my addr 172.21.15.50:0/1973582819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d5d9b700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80c65e0 0x7fa4d80af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 -- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 msgr2=0x7fa4d80c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 0x7fa4d80c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 -- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80c65e0 msgr2=0x7fa4d80af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80c65e0 0x7fa4d80af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 -- 172.21.15.50:0/1973582819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80c3b00 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4d6d9d700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 0x7fa4d81573b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8158f90 tx=0x7fa4d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000e050 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000f040 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d80c3de0 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0010d40 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81578f0 con 0x7fa4d80afdc0 2023-12-24T18:48:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.762+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d80af580 con 0x7fa4d80afdc0 2023-12-24T18:48:26.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.766+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fa4d0003020 con 0x7fa4d80afdc0 2023-12-24T18:48:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.766+0000 7fa4c67fc700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 0x7fa4b8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.766+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fa4d007d440 con 0x7fa4d80afdc0 2023-12-24T18:48:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.766+0000 7fa4d659c700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 0x7fa4b8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:26.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.766+0000 7fa4d659c700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 0x7fa4b8062c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009720 tx=0x7fa4c80091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.770+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa4d004d450 con 0x7fa4d80afdc0 2023-12-24T18:48:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:26.966+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4d8071060 con 0x7fa4b8060750 2023-12-24T18:48:27.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.086+0000 7fa4c67fc700 1 -- 172.21.15.50:0/1973582819 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa4d8071060 con 0x7fa4b8060750 2023-12-24T18:48:27.089 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-12-24T18:48:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 msgr2=0x7fa4b8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 0x7fa4b8062c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009720 tx=0x7fa4c80091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 msgr2=0x7fa4d81573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 0x7fa4d81573b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8158f90 tx=0x7fa4d000b040 comp rx=0 tx=0).stop 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 shutdown_connections 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa4b8060750 0x7fa4b8062c00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4d80afdc0 0x7fa4d81573b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80c65e0 0x7fa4d80af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 --2- 172.21.15.50:0/1973582819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c0004810 0x7fa4d80c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 >> 172.21.15.50:0/1973582819 conn(0x7fa4d80ccf50 msgr2=0x7fa4d80aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 shutdown_connections 2023-12-24T18:48:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.090+0000 7fa4dcd45700 1 -- 172.21.15.50:0/1973582819 wait complete. 2023-12-24T18:48:27.116 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-12-24T18:48:27.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:27.116 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-12-24T18:48:27.138 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:27.138 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_01_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:27.139 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:27.140 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_01_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_01_UTC'] 2023-12-24T18:48:27.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-12-24T18:48:27.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.354+0000 7fcc22ecd700 1 Processor -- start 2023-12-24T18:48:27.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.354+0000 7fcc22ecd700 1 -- start start 2023-12-24T18:48:27.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc22ecd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc1c06dab0 0x7fcc1c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc22ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 0x7fcc1c068660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc22ecd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c159560 con 0x7fcc1c068ba0 2023-12-24T18:48:27.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc22ecd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c8c50 con 0x7fcc1c06dab0 2023-12-24T18:48:27.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc22ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c8f30 con 0x7fcc1c06de80 2023-12-24T18:48:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc2146a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc1c068ba0 0x7fcc1c0cc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58412/0 (socket says 172.21.15.50:58412) 2023-12-24T18:48:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc2146a700 1 -- 172.21.15.50:0/2749340312 learned_addr learned my addr 172.21.15.50:0/2749340312 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/2749340312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 0x7fcc1c068660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc20c69700 1 --2- 172.21.15.50:0/2749340312 >> v2:172.21.15.82:3300/0 conn(0x7fcc1c06dab0 0x7fcc1c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1b7fe700 1 -- 172.21.15.50:0/2749340312 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997323148 0 0) 0x7fcc1c159560 con 0x7fcc1c068ba0 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 -- 172.21.15.50:0/2749340312 >> v2:172.21.15.82:3300/0 conn(0x7fcc1c06dab0 msgr2=0x7fcc1c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/2749340312 >> v2:172.21.15.82:3300/0 conn(0x7fcc1c06dab0 0x7fcc1c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 -- 172.21.15.50:0/2749340312 >> v1:172.21.15.50:6789/0 conn(0x7fcc1c068ba0 legacy=0x7fcc1c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 -- 172.21.15.50:0/2749340312 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0c9210 con 0x7fcc1c06de80 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.358+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/2749340312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 0x7fcc1c068660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc080098e0 tx=0x7fcc080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d28c946ecd57db server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc1b7fe700 1 -- 172.21.15.50:0/2749340312 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800b640 con 0x7fcc1c06de80 2023-12-24T18:48:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc1b7fe700 1 -- 172.21.15.50:0/2749340312 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0800b7a0 con 0x7fcc1c06de80 2023-12-24T18:48:27.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc1b7fe700 1 -- 172.21.15.50:0/2749340312 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800bb40 con 0x7fcc1c06de80 2023-12-24T18:48:27.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 -- 172.21.15.50:0/2749340312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 msgr2=0x7fcc1c068660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/2749340312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 0x7fcc1c068660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc080098e0 tx=0x7fcc080091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 -- 172.21.15.50:0/2749340312 shutdown_connections 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/2749340312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06de80 0x7fcc1c068660 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/2749340312 >> v2:172.21.15.82:3300/0 conn(0x7fcc1c06dab0 0x7fcc1c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 -- 172.21.15.50:0/2749340312 >> 172.21.15.50:0/2749340312 conn(0x7fcc1c069d90 msgr2=0x7fcc1c0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 -- 172.21.15.50:0/2749340312 shutdown_connections 2023-12-24T18:48:27.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.362+0000 7fcc22ecd700 1 -- 172.21.15.50:0/2749340312 wait complete. 2023-12-24T18:48:27.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 Processor -- start 2023-12-24T18:48:27.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 -- start start 2023-12-24T18:48:27.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06dab0 0x7fcc1c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc1c06de80 0x7fcc1c156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c148fe0 con 0x7fcc1c068ba0 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c14dfb0 con 0x7fcc1c06de80 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc22ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c5e10 con 0x7fcc1c06dab0 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41802/0 (socket says 172.21.15.50:41802) 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 -- 172.21.15.50:0/12320573 learned_addr learned my addr 172.21.15.50:0/12320573 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc2146a700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc1c06de80 0x7fcc1c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06dab0 0x7fcc1c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 -- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06dab0 msgr2=0x7fcc1c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06dab0 0x7fcc1c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 -- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc1c06de80 msgr2=0x7fcc1c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc1c06de80 0x7fcc1c156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.366+0000 7fcc20c69700 1 -- 172.21.15.50:0/12320573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009420 con 0x7fcc1c068ba0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc20c69700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000ec80 tx=0x7fcc100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000c850 con 0x7fcc1c068ba0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1000c9b0 con 0x7fcc1c068ba0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0c60f0 con 0x7fcc1c068ba0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000cd50 con 0x7fcc1c068ba0 2023-12-24T18:48:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0c66b0 con 0x7fcc1c068ba0 2023-12-24T18:48:27.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.370+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c071060 con 0x7fcc1c068ba0 2023-12-24T18:48:27.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.374+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fcc10013680 con 0x7fcc1c068ba0 2023-12-24T18:48:27.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.374+0000 7fcc18ff9700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 0x7fcc00062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.374+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fcc1007d410 con 0x7fcc1c068ba0 2023-12-24T18:48:27.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.374+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 0x7fcc00062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.378+0000 7fcc1bfff700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 0x7fcc00062c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc080093f0 tx=0x7fcc08017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.382+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcc1004d480 con 0x7fcc1c068ba0 2023-12-24T18:48:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.574+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc1c0cdb50 con 0x7fcc00060750 2023-12-24T18:48:27.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.590+0000 7fcc18ff9700 1 -- 172.21.15.50:0/12320573 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fcc1c0cdb50 con 0x7fcc00060750 2023-12-24T18:48:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:27.594 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:51", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 msgr2=0x7fcc00062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 0x7fcc00062c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc080093f0 tx=0x7fcc08017000 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 msgr2=0x7fcc1c148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000ec80 tx=0x7fcc100091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 shutdown_connections 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcc00060750 0x7fcc00062c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc1c06de80 0x7fcc1c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc1c06dab0 0x7fcc1c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 --2- 172.21.15.50:0/12320573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc1c068ba0 0x7fcc1c148aa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 >> 172.21.15.50:0/12320573 conn(0x7fcc1c069d90 msgr2=0x7fcc1c0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 shutdown_connections 2023-12-24T18:48:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.594+0000 7fcc22ecd700 1 -- 172.21.15.50:0/12320573 wait complete. 2023-12-24T18:48:27.620 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:51", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:27.620 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:51', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:01', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:27.620 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:27.620 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:27.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:27.620 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-12-24T18:48:27.642 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:27.643 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:27.644 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_01_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:27.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-12-24T18:48:27.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:48:27.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:48:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.866+0000 7f4422a6b700 1 Processor -- start 2023-12-24T18:48:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.866+0000 7f4422a6b700 1 -- start start 2023-12-24T18:48:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4422a6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 0x7f441c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4422a6b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f441c0ce470 0x7f441c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4422a6b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c06aa80 con 0x7f441c0b2cf0 2023-12-24T18:48:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4422a6b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0cee30 con 0x7f441c0ce470 2023-12-24T18:48:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4422a6b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0cc0b0 con 0x7f441c158dd0 2023-12-24T18:48:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4421268700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f441c0b2cf0 0x7f441c0cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58422/0 (socket says 172.21.15.50:58422) 2023-12-24T18:48:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4421268700 1 -- 172.21.15.50:0/52770539 learned_addr learned my addr 172.21.15.50:0/52770539 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f442226a700 1 --2- 172.21.15.50:0/52770539 >> v2:172.21.15.50:3300/0 conn(0x7f441c0ce470 0x7f441c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.870+0000 7f4421a69700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 0x7f441c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4420a67700 1 -- 172.21.15.50:0/52770539 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81545856 0 0) 0x7f441c06aa80 con 0x7f441c0b2cf0 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4420a67700 1 -- 172.21.15.50:0/52770539 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4408003570 con 0x7f441c0b2cf0 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f442226a700 1 -- 172.21.15.50:0/52770539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 msgr2=0x7f441c1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f442226a700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 0x7f441c1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f442226a700 1 -- 172.21.15.50:0/52770539 >> v1:172.21.15.50:6789/0 conn(0x7f441c0b2cf0 legacy=0x7f441c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f442226a700 1 -- 172.21.15.50:0/52770539 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0cc390 con 0x7f441c0ce470 2023-12-24T18:48:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4421a69700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 0x7f441c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f442226a700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c0ce470 0x7f441c0ce8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4414009e60 tx=0x7f4414009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2160a31819651279 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4420a67700 1 -- 172.21.15.50:0/52770539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400e070 con 0x7f441c0ce470 2023-12-24T18:48:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4420a67700 1 -- 172.21.15.50:0/52770539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400bab0 con 0x7f441c0ce470 2023-12-24T18:48:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4420a67700 1 -- 172.21.15.50:0/52770539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400be70 con 0x7f441c0ce470 2023-12-24T18:48:27.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 -- 172.21.15.50:0/52770539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c0ce470 msgr2=0x7f441c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c0ce470 0x7f441c0ce8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4414009e60 tx=0x7f4414009780 comp rx=0 tx=0).stop 2023-12-24T18:48:27.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 -- 172.21.15.50:0/52770539 shutdown_connections 2023-12-24T18:48:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c0ce470 0x7f441c0ce8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 --2- 172.21.15.50:0/52770539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c158dd0 0x7f441c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 -- 172.21.15.50:0/52770539 >> 172.21.15.50:0/52770539 conn(0x7f441c067b80 msgr2=0x7f441c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 -- 172.21.15.50:0/52770539 shutdown_connections 2023-12-24T18:48:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.874+0000 7f4422a6b700 1 -- 172.21.15.50:0/52770539 wait complete. 2023-12-24T18:48:27.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.878+0000 7f4422a6b700 1 Processor -- start 2023-12-24T18:48:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.878+0000 7f4422a6b700 1 -- start start 2023-12-24T18:48:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 0x7f441c0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c0ce470 0x7f441c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c8c00 con 0x7f441c158dd0 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c95d0 con 0x7f441c0b2cf0 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c8010 con 0x7f441c0ce470 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41820/0 (socket says 172.21.15.50:41820) 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 -- 172.21.15.50:0/4192121652 learned_addr learned my addr 172.21.15.50:0/4192121652 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4421268700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c0ce470 0x7f441c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4421a69700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 0x7f441c0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 -- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c0ce470 msgr2=0x7f441c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c0ce470 0x7f441c151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 -- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 msgr2=0x7f441c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 0x7f441c0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 -- 172.21.15.50:0/4192121652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418009420 con 0x7f441c158dd0 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4421a69700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 0x7f441c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f442226a700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f441400b610 tx=0x7f4414019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414027470 con 0x7f441c158dd0 2023-12-24T18:48:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44140275f0 con 0x7f441c158dd0 2023-12-24T18:48:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140279b0 con 0x7f441c158dd0 2023-12-24T18:48:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4414009a20 con 0x7f441c158dd0 2023-12-24T18:48:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.882+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0c85b0 con 0x7f441c158dd0 2023-12-24T18:48:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.886+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0c8db0 con 0x7f441c158dd0 2023-12-24T18:48:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.886+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f4414024070 con 0x7f441c158dd0 2023-12-24T18:48:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.890+0000 7f4411ffb700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 0x7f4400062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.890+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f441407f7c0 con 0x7f441c158dd0 2023-12-24T18:48:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.890+0000 7f4421a69700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 0x7f4400062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.890+0000 7f4421a69700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 0x7f4400062c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44180093f0 tx=0x7f4418008040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:27.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:27.894+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f441c0c8db0 con 0x7f441c158dd0 2023-12-24T18:48:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.086+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f441c04be40 con 0x7f4400060750 2023-12-24T18:48:28.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.102+0000 7f4411ffb700 1 -- 172.21.15.50:0/4192121652 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f441c04be40 con 0x7f4400060750 2023-12-24T18:48:28.106 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:28.106 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:51", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 msgr2=0x7f4400062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 0x7f4400062c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44180093f0 tx=0x7f4418008040 comp rx=0 tx=0).stop 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 msgr2=0x7f441c14f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f441400b610 tx=0x7f4414019000 comp rx=0 tx=0).stop 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 shutdown_connections 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4400060750 0x7f4400062c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f441c158dd0 0x7f441c14f170 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f441c0ce470 0x7f441c151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 --2- 172.21.15.50:0/4192121652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c0b2cf0 0x7f441c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 >> 172.21.15.50:0/4192121652 conn(0x7f441c067b80 msgr2=0x7f441c14e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 shutdown_connections 2023-12-24T18:48:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.106+0000 7f4422a6b700 1 -- 172.21.15.50:0/4192121652 wait complete. 2023-12-24T18:48:28.130 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:51", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:28.130 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:51', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:28.130 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:28.130 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:28.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:28.130 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:28.200 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:28.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-12-24T18:48:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.418+0000 7fad625cc700 1 Processor -- start 2023-12-24T18:48:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.418+0000 7fad625cc700 1 -- start start 2023-12-24T18:48:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad625cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad5c0c5c90 0x7fad5c163f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad625cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c06b5b0 con 0x7fad5c06a4a0 2023-12-24T18:48:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad625cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0cbb40 con 0x7fad5c159080 2023-12-24T18:48:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad625cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c15dbd0 con 0x7fad5c0c5c90 2023-12-24T18:48:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad5c0c5c90 0x7fad5c163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad5c0c5c90 0x7fad5c163f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41828/0 (socket says 172.21.15.50:41828) 2023-12-24T18:48:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 -- 172.21.15.50:0/1175255631 learned_addr learned my addr 172.21.15.50:0/1175255631 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 -- 172.21.15.50:0/1175255631 >> v1:172.21.15.82:6789/0 conn(0x7fad5c159080 legacy=0x7fad5c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 -- 172.21.15.50:0/1175255631 >> v1:172.21.15.50:6789/0 conn(0x7fad5c06a4a0 legacy=0x7fad5c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 -- 172.21.15.50:0/1175255631 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c06a9a0 con 0x7fad5c0c5c90 2023-12-24T18:48:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad61dcb700 1 --2- 172.21.15.50:0/1175255631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c0c5c90 0x7fad5c163f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad54009f20 tx=0x7fad54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a33b8fc8a9e119c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad53fff700 1 -- 172.21.15.50:0/1175255631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400e070 con 0x7fad5c0c5c90 2023-12-24T18:48:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad53fff700 1 -- 172.21.15.50:0/1175255631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400ba80 con 0x7fad5c0c5c90 2023-12-24T18:48:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.422+0000 7fad53fff700 1 -- 172.21.15.50:0/1175255631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540092e0 con 0x7fad5c0c5c90 2023-12-24T18:48:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- 172.21.15.50:0/1175255631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c0c5c90 msgr2=0x7fad5c163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 --2- 172.21.15.50:0/1175255631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c0c5c90 0x7fad5c163f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad54009f20 tx=0x7fad54009840 comp rx=0 tx=0).stop 2023-12-24T18:48:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- 172.21.15.50:0/1175255631 shutdown_connections 2023-12-24T18:48:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 --2- 172.21.15.50:0/1175255631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c0c5c90 0x7fad5c163f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- 172.21.15.50:0/1175255631 >> 172.21.15.50:0/1175255631 conn(0x7fad5c067b80 msgr2=0x7fad5c0cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- 172.21.15.50:0/1175255631 shutdown_connections 2023-12-24T18:48:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- 172.21.15.50:0/1175255631 wait complete. 2023-12-24T18:48:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 Processor -- start 2023-12-24T18:48:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.426+0000 7fad625cc700 1 -- start start 2023-12-24T18:48:28.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5c06a4a0 0x7fad5c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 0x7fad5c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c16d070 con 0x7fad5c159080 2023-12-24T18:48:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14f0c0 con 0x7fad5c0c5c90 2023-12-24T18:48:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c16c760 con 0x7fad5c06a4a0 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41840/0 (socket says 172.21.15.50:41840) 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 -- 172.21.15.50:0/4081105619 learned_addr learned my addr 172.21.15.50:0/4081105619 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad60dc9700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 0x7fad5c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad615ca700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5c06a4a0 0x7fad5c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 -- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5c06a4a0 msgr2=0x7fad5c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5c06a4a0 0x7fad5c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 -- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 msgr2=0x7fad5c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 0x7fad5c14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 -- 172.21.15.50:0/4081105619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009ae0 con 0x7fad5c159080 2023-12-24T18:48:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad60dc9700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 0x7fad5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad61dcb700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fad5c064390 tx=0x7fad54018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54008e40 con 0x7fad5c159080 2023-12-24T18:48:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54026460 con 0x7fad5c159080 2023-12-24T18:48:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54026820 con 0x7fad5c159080 2023-12-24T18:48:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c15fb20 con 0x7fad5c159080 2023-12-24T18:48:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.430+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c16cd00 con 0x7fad5c159080 2023-12-24T18:48:28.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.434+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c16d220 con 0x7fad5c159080 2023-12-24T18:48:28.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.434+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fad54003040 con 0x7fad5c159080 2023-12-24T18:48:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.434+0000 7fad517fa700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 0x7fad40062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.434+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fad5407ea40 con 0x7fad5c159080 2023-12-24T18:48:28.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.434+0000 7fad615ca700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 0x7fad40062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.438+0000 7fad615ca700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 0x7fad40062c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad580037c0 tx=0x7fad58009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.442+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad5c16d220 con 0x7fad5c159080 2023-12-24T18:48:28.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.650+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad5c16d220 con 0x7fad40060750 2023-12-24T18:48:28.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.666+0000 7fad517fa700 1 -- 172.21.15.50:0/4081105619 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fad5c16d220 con 0x7fad40060750 2023-12-24T18:48:28.667 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:28.667 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:52", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 msgr2=0x7fad40062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 0x7fad40062c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad580037c0 tx=0x7fad58009040 comp rx=0 tx=0).stop 2023-12-24T18:48:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 msgr2=0x7fad5c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fad5c064390 tx=0x7fad54018000 comp rx=0 tx=0).stop 2023-12-24T18:48:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 shutdown_connections 2023-12-24T18:48:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fad40060750 0x7fad40062c00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5c159080 0x7fad5c0cc1c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5c0c5c90 0x7fad5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 --2- 172.21.15.50:0/4081105619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5c06a4a0 0x7fad5c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 >> 172.21.15.50:0/4081105619 conn(0x7fad5c067b80 msgr2=0x7fad5c0ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 shutdown_connections 2023-12-24T18:48:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.670+0000 7fad625cc700 1 -- 172.21.15.50:0/4081105619 wait complete. 2023-12-24T18:48:28.690 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:52", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:28.690 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:52', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:28.690 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:28.690 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:28.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:28.691 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-12-24T18:48:28.712 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_01_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:28.713 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:28.714 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_01_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_01_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:28.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-12-24T18:48:28.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.930+0000 7efdd68f0700 1 Processor -- start 2023-12-24T18:48:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.930+0000 7efdd68f0700 1 -- start start 2023-12-24T18:48:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdd68f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 0x7efdd006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdd68f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd00b3660 con 0x7efdd006a730 2023-12-24T18:48:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdd68f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd00b3940 con 0x7efdd01590c0 2023-12-24T18:48:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdd68f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00b3c20 con 0x7efdd00b4700 2023-12-24T18:48:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcf7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 0x7efdd006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efdd01590c0 0x7efdd00b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60500/0 (socket says 172.21.15.50:60500) 2023-12-24T18:48:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcffff700 1 -- 172.21.15.50:0/3881998681 learned_addr learned my addr 172.21.15.50:0/3881998681 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdd4e8d700 1 --1- 172.21.15.50:0/3881998681 >> v1:172.21.15.50:6789/0 conn(0x7efdd006a730 0x7efdd0159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58432/0 (socket says 172.21.15.50:58432) 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049703111 0 0) 0x7efdd00b3660 con 0x7efdd006a730 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb8003570 con 0x7efdd006a730 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425491289 0 0) 0x7efdd00b3940 con 0x7efdd01590c0 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd00b3660 con 0x7efdd01590c0 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcf7fe700 1 -- 172.21.15.50:0/3881998681 >> v1:172.21.15.82:6789/0 conn(0x7efdd01590c0 legacy=0x7efdd00b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcf7fe700 1 -- 172.21.15.50:0/3881998681 >> v1:172.21.15.50:6789/0 conn(0x7efdd006a730 legacy=0x7efdd0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.934+0000 7efdcf7fe700 1 -- 172.21.15.50:0/3881998681 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00b3f00 con 0x7efdd00b4700 2023-12-24T18:48:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdcf7fe700 1 --2- 172.21.15.50:0/3881998681 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 0x7efdd006d470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009910 tx=0x7efdc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d407729319e7738 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011630 con 0x7efdd00b4700 2023-12-24T18:48:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4011790 con 0x7efdd00b4700 2023-12-24T18:48:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdceffd700 1 -- 172.21.15.50:0/3881998681 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011b30 con 0x7efdd00b4700 2023-12-24T18:48:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 -- 172.21.15.50:0/3881998681 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 msgr2=0x7efdd006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 --2- 172.21.15.50:0/3881998681 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 0x7efdd006d470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009910 tx=0x7efdc40091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 -- 172.21.15.50:0/3881998681 shutdown_connections 2023-12-24T18:48:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 --2- 172.21.15.50:0/3881998681 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd00b4700 0x7efdd006d470 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 -- 172.21.15.50:0/3881998681 >> 172.21.15.50:0/3881998681 conn(0x7efdd0067b40 msgr2=0x7efdd00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 -- 172.21.15.50:0/3881998681 shutdown_connections 2023-12-24T18:48:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.938+0000 7efdd68f0700 1 -- 172.21.15.50:0/3881998681 wait complete. 2023-12-24T18:48:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 Processor -- start 2023-12-24T18:48:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 -- start start 2023-12-24T18:48:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd006a730 0x7efdd014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdd00b4700 0x7efdd0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd016a200 con 0x7efdd01590c0 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0149450 con 0x7efdd00b4700 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd68f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd014ed90 con 0x7efdd006a730 2023-12-24T18:48:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd4e8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd4e8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41854/0 (socket says 172.21.15.50:41854) 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd4e8d700 1 -- 172.21.15.50:0/108308662 learned_addr learned my addr 172.21.15.50:0/108308662 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdcffff700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd006a730 0x7efdd014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdcf7fe700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdd00b4700 0x7efdd0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.942+0000 7efdd4e8d700 1 -- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd006a730 msgr2=0x7efdd014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd4e8d700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd006a730 0x7efdd014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd4e8d700 1 -- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdd00b4700 msgr2=0x7efdd0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd4e8d700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdd00b4700 0x7efdd0148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd4e8d700 1 -- 172.21.15.50:0/108308662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4009420 con 0x7efdd01590c0 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd4e8d700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efdc800cd10 tx=0x7efdc8001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800ce70 con 0x7efdd01590c0 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8005df0 con 0x7efdd01590c0 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800aa80 con 0x7efdd01590c0 2023-12-24T18:48:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd0169bb0 con 0x7efdd01590c0 2023-12-24T18:48:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd01550b0 con 0x7efdd01590c0 2023-12-24T18:48:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.946+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd016a370 con 0x7efdd01590c0 2023-12-24T18:48:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.950+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7efdc80070f0 con 0x7efdd01590c0 2023-12-24T18:48:28.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.950+0000 7efdb7fff700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 0x7efdbc062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.950+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7efdc807cee0 con 0x7efdd01590c0 2023-12-24T18:48:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.950+0000 7efdcffff700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 0x7efdbc062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:28.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.950+0000 7efdcffff700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 0x7efdbc062c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007fd0 tx=0x7efdc0009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:28.958+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efdc804cfd0 con 0x7efdd01590c0 2023-12-24T18:48:29.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.162+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdd0071060 con 0x7efdbc060750 2023-12-24T18:48:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.178+0000 7efdb7fff700 1 -- 172.21.15.50:0/108308662 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7efdd0071060 con 0x7efdbc060750 2023-12-24T18:48:29.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:29.183 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:53", "first": "2023-12-24T18:38:01", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 msgr2=0x7efdbc062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 0x7efdbc062c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007fd0 tx=0x7efdc0009040 comp rx=0 tx=0).stop 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 msgr2=0x7efdd0154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efdc800cd10 tx=0x7efdc8001b20 comp rx=0 tx=0).stop 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 shutdown_connections 2023-12-24T18:48:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7efdbc060750 0x7efdbc062c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd01590c0 0x7efdd0154b70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdd00b4700 0x7efdd0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 --2- 172.21.15.50:0/108308662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdd006a730 0x7efdd014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 >> 172.21.15.50:0/108308662 conn(0x7efdd0067b40 msgr2=0x7efdd00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 shutdown_connections 2023-12-24T18:48:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.182+0000 7efdd68f0700 1 -- 172.21.15.50:0/108308662 wait complete. 2023-12-24T18:48:29.207 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:53", "first": "2023-12-24T18:38:01", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:29.208 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:53', 'first': '2023-12-24T18:38:01', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:29.208 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:29.208 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:29.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:29.208 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_01_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:29.234 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:29.235 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_01_UTC 2023-12-24T18:48:29.235 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:29.235 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:29.235 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:29.236 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_01_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_01_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_01_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:29.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-12-24T18:48:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 Processor -- start 2023-12-24T18:48:29.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 -- start start 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25e415d210 0x7f25e415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406db90 0x7f25e406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e406b3e0 con 0x7f25e406c820 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e406a7d0 con 0x7f25e415d210 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.462+0000 7f25ebeae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e406aab0 con 0x7f25e406db90 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25e415d210 0x7f25e415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25ea44b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25e406c820 0x7f25e40c8640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46968/0 (socket says 172.21.15.50:46968) 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25ea44b700 1 -- 172.21.15.50:0/1054046814 learned_addr learned my addr 172.21.15.50:0/1054046814 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9449700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406db90 0x7f25e406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 -- 172.21.15.50:0/1054046814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406db90 msgr2=0x7f25e406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406db90 0x7f25e406b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 -- 172.21.15.50:0/1054046814 >> v1:172.21.15.50:6789/0 conn(0x7f25e406c820 legacy=0x7f25e40c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e8c48700 1 -- 172.21.15.50:0/1054046814 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374852441 0 0) 0x7f25e406b3e0 con 0x7f25e406c820 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 -- 172.21.15.50:0/1054046814 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e406ad90 con 0x7f25e415d210 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e9c4a700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e415d210 0x7f25e415d5e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009e60 tx=0x7f25e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffede40ab6b39c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e8c48700 1 -- 172.21.15.50:0/1054046814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000e070 con 0x7f25e415d210 2023-12-24T18:48:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e8c48700 1 -- 172.21.15.50:0/1054046814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000bb60 con 0x7f25e415d210 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25e8c48700 1 -- 172.21.15.50:0/1054046814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0012430 con 0x7f25e415d210 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25ebeae700 1 -- 172.21.15.50:0/1054046814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e415d210 msgr2=0x7f25e415d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.466+0000 7f25ebeae700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e415d210 0x7f25e415d5e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009e60 tx=0x7f25e0009780 comp rx=0 tx=0).stop 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 -- 172.21.15.50:0/1054046814 shutdown_connections 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406db90 0x7f25e406b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 --2- 172.21.15.50:0/1054046814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e415d210 0x7f25e415d5e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 -- 172.21.15.50:0/1054046814 >> 172.21.15.50:0/1054046814 conn(0x7f25e4067b80 msgr2=0x7f25e40ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 -- 172.21.15.50:0/1054046814 shutdown_connections 2023-12-24T18:48:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 -- 172.21.15.50:0/1054046814 wait complete. 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.470+0000 7f25ebeae700 1 Processor -- start 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 -- start start 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406c820 0x7f25e41528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25e415d210 0x7f25e4154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4153d10 con 0x7f25e406db90 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4153100 con 0x7f25e415d210 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ebeae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41533e0 con 0x7f25e406c820 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41830/0 (socket says 172.21.15.50:41830) 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 -- 172.21.15.50:0/4225144727 learned_addr learned my addr 172.21.15.50:0/4225144727 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25ea44b700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25e415d210 0x7f25e4154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9c4a700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406c820 0x7f25e41528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 -- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406c820 msgr2=0x7f25e41528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406c820 0x7f25e41528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 -- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25e415d210 msgr2=0x7f25e4154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25e415d210 0x7f25e4154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 -- 172.21.15.50:0/4225144727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0009a20 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25e9449700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f25d400ea50 tx=0x7f25d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.474+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400c920 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400ca80 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400ce20 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e41536c0 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e4152df0 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e4071060 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.478+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f25d4013680 con 0x7f25e406db90 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.482+0000 7f25d9ffb700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 0x7f25c8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.482+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f25d407d1e0 con 0x7f25e406db90 2023-12-24T18:48:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.482+0000 7f25e9c4a700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 0x7f25c8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.482+0000 7f25e9c4a700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 0x7f25c8062c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25e0012560 tx=0x7f25e0019000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.486+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f25d404d250 con 0x7f25e406db90 2023-12-24T18:48:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.682+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25e406b070 con 0x7f25c8060750 2023-12-24T18:48:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.698+0000 7f25d9ffb700 1 -- 172.21.15.50:0/4225144727 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f25e406b070 con 0x7f25c8060750 2023-12-24T18:48:29.701 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:29.701 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:53", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:29.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 msgr2=0x7f25c8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 0x7f25c8062c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25e0012560 tx=0x7f25e0019000 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 msgr2=0x7f25e41520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f25d400ea50 tx=0x7f25d40091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 shutdown_connections 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f25c8060750 0x7f25c8062c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25e415d210 0x7f25e4154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25e406db90 0x7f25e41520d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 --2- 172.21.15.50:0/4225144727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25e406c820 0x7f25e41528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 >> 172.21.15.50:0/4225144727 conn(0x7f25e4067b80 msgr2=0x7f25e4161070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 shutdown_connections 2023-12-24T18:48:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.702+0000 7f25ebeae700 1 -- 172.21.15.50:0/4225144727 wait complete. 2023-12-24T18:48:29.726 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:53", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:29.726 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:53', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:29.726 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:29.726 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:29.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:29.726 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-12-24T18:48:29.749 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:29.750 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:29.751 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_01_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_01_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_01_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:29.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-12-24T18:48:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.970+0000 7f30530cd700 1 Processor -- start 2023-12-24T18:48:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.970+0000 7f30530cd700 1 -- start start 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f30530cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f304c06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f30530cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0b3660 con 0x7f304c0b4700 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f30530cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0b3940 con 0x7f304c1590c0 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f30530cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0b3c20 con 0x7f304c06ae40 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f304c0b4700 0x7f304c06a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46982/0 (socket says 172.21.15.50:46982) 2023-12-24T18:48:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304bfff700 1 -- 172.21.15.50:0/2137947476 learned_addr learned my addr 172.21.15.50:0/2137947476 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f305166a700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f304c06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912749547 0 0) 0x7f304c0b3660 con 0x7f304c0b4700 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c003570 con 0x7f304c0b4700 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442385983 0 0) 0x7f304c0b3940 con 0x7f304c1590c0 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f304c0b3660 con 0x7f304c1590c0 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138539113 0 0) 0x7f303c003570 con 0x7f304c0b4700 2023-12-24T18:48:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 msgr2=0x7f304c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f304c06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 >> v1:172.21.15.82:6789/0 conn(0x7f304c1590c0 legacy=0x7f304c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0b3f00 con 0x7f304c0b4700 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f3038001470 con 0x7f304c0b4700 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f305166a700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f304c06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.974+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 >> v1:172.21.15.50:6789/0 conn(0x7f304c0b4700 legacy=0x7f304c06a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f303c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c004160 0x7f303c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c004d50 0x7f303c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0b3c20 con 0x7f303c004160 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c00bba0 con 0x7f303c004d50 2023-12-24T18:48:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c00bd60 con 0x7f304c06ae40 2023-12-24T18:48:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c004160 0x7f303c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f3050e69700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f303c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f305166a700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c004d50 0x7f303c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 -- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 msgr2=0x7f303c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f304c06ae40 0x7f303c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 -- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c004d50 msgr2=0x7f303c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c004d50 0x7f303c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 -- 172.21.15.50:0/2137947476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044009a20 con 0x7f303c004160 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304bfff700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c004160 0x7f303c004810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f303800c2a0 tx=0x7f3038001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d30a196b2c00ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800cb90 con 0x7f303c004160 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800ccf0 con 0x7f303c004160 2023-12-24T18:48:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f304b7fe700 1 -- 172.21.15.50:0/2137947476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038005b70 con 0x7f303c004160 2023-12-24T18:48:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f30530cd700 1 -- 172.21.15.50:0/2137947476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c004160 msgr2=0x7f303c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f30530cd700 1 --2- 172.21.15.50:0/2137947476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c004160 0x7f303c004810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f303800c2a0 tx=0x7f3038001e10 comp rx=0 tx=0).stop 2023-12-24T18:48:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f305166a700 1 -- 172.21.15.50:0/2137947476 reap_dead start 2023-12-24T18:48:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f30530cd700 1 -- 172.21.15.50:0/2137947476 shutdown_connections 2023-12-24T18:48:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f30530cd700 1 -- 172.21.15.50:0/2137947476 >> 172.21.15.50:0/2137947476 conn(0x7f304c067b40 msgr2=0x7f304c0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.978+0000 7f30530cd700 1 -- 172.21.15.50:0/2137947476 shutdown_connections 2023-12-24T18:48:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.982+0000 7f30530cd700 1 -- 172.21.15.50:0/2137947476 wait complete. 2023-12-24T18:48:29.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.982+0000 7f30530cd700 1 Processor -- start 2023-12-24T18:48:29.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.982+0000 7f30530cd700 1 -- start start 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f303c004160 0x7f304c1691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f304c154710 0x7f304c0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c152ba0 con 0x7f304c0ab140 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c169a70 con 0x7f304c154710 2023-12-24T18:48:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c169d50 con 0x7f303c004160 2023-12-24T18:48:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41852/0 (socket says 172.21.15.50:41852) 2023-12-24T18:48:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 -- 172.21.15.50:0/1944344878 learned_addr learned my addr 172.21.15.50:0/1944344878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f3050e69700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f303c004160 0x7f304c1691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f304bfff700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f304c154710 0x7f304c0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 -- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f303c004160 msgr2=0x7f304c1691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f303c004160 0x7f304c1691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 -- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f304c154710 msgr2=0x7f304c0aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f304c154710 0x7f304c0aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 -- 172.21.15.50:0/1944344878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c16a030 con 0x7f304c0ab140 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f305166a700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f304c063580 tx=0x7f304400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e070 con 0x7f304c0ab140 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044011d00 con 0x7f304c0ab140 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440166e0 con 0x7f304c0ab140 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.986+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c152df0 con 0x7f304c0ab140 2023-12-24T18:48:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.990+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c153850 con 0x7f304c0ab140 2023-12-24T18:48:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.990+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c152fe0 con 0x7f304c0ab140 2023-12-24T18:48:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.990+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f3044016a90 con 0x7f304c0ab140 2023-12-24T18:48:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.994+0000 7f3048ff9700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 0x7f3030062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.994+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f304407dae0 con 0x7f304c0ab140 2023-12-24T18:48:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.994+0000 7f3050e69700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 0x7f3030062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.994+0000 7f3050e69700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 0x7f3030062c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f304c06b340 tx=0x7f3040007d30 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:30.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:29.998+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f304404db00 con 0x7f304c0ab140 2023-12-24T18:48:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.194+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f304c071060 con 0x7f3030060750 2023-12-24T18:48:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.206+0000 7f3048ff9700 1 -- 172.21.15.50:0/1944344878 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f304c071060 con 0x7f3030060750 2023-12-24T18:48:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:30.210 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:54", "first": "2023-12-24T18:38:01", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 msgr2=0x7f3030062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 0x7f3030062c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f304c06b340 tx=0x7f3040007d30 comp rx=0 tx=0).stop 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 msgr2=0x7f304c153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f304c063580 tx=0x7f304400b040 comp rx=0 tx=0).stop 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 shutdown_connections 2023-12-24T18:48:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3030060750 0x7f3030062c00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304c0ab140 0x7f304c153310 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f304c154710 0x7f304c0aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 --2- 172.21.15.50:0/1944344878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f303c004160 0x7f304c1691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 >> 172.21.15.50:0/1944344878 conn(0x7f304c067b40 msgr2=0x7f304c155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.210+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 shutdown_connections 2023-12-24T18:48:30.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.214+0000 7f30530cd700 1 -- 172.21.15.50:0/1944344878 wait complete. 2023-12-24T18:48:30.234 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:54", "first": "2023-12-24T18:38:01", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:30.234 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:54', 'first': '2023-12-24T18:38:01', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:30.235 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:30.235 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:30.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:30.235 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-12-24T18:48:30.261 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_01_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:30.262 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:30.262 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_01_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_01_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:30.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-12-24T18:48:30.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 Processor -- start 2023-12-24T18:48:30.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 -- start start 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd23c1592f0 0x7fd23c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c15dc50 con 0x7fd23c0c7620 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0c7190 con 0x7fd23c158f20 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.482+0000 7fd241523700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0c9bb0 con 0x7fd23c1592f0 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd240d22700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd23c0c7620 0x7fd23c0ca230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46984/0 (socket says 172.21.15.50:46984) 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd240d22700 1 -- 172.21.15.50:0/1368390751 learned_addr learned my addr 172.21.15.50:0/1368390751 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:30.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23b7fe700 1 --2- 172.21.15.50:0/1368390751 >> v2:172.21.15.82:3300/0 conn(0x7fd23c1592f0 0x7fd23c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:30.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659472753 0 0) 0x7fd234001490 con 0x7fd23c0c7620 2023-12-24T18:48:30.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224003570 con 0x7fd23c0c7620 2023-12-24T18:48:30.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912942667 0 0) 0x7fd224003570 con 0x7fd23c0c7620 2023-12-24T18:48:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23b7fe700 1 -- 172.21.15.50:0/1368390751 >> v1:172.21.15.82:6789/0 conn(0x7fd23c158f20 legacy=0x7fd23c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23b7fe700 1 -- 172.21.15.50:0/1368390751 >> v1:172.21.15.50:6789/0 conn(0x7fd23c0c7620 legacy=0x7fd23c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23b7fe700 1 -- 172.21.15.50:0/1368390751 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0c9e90 con 0x7fd23c1592f0 2023-12-24T18:48:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23b7fe700 1 --2- 172.21.15.50:0/1368390751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c15d710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2300098e0 tx=0x7fd2300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c15915fa7dd094 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234001980 con 0x7fd23c1592f0 2023-12-24T18:48:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230011420 con 0x7fd23c1592f0 2023-12-24T18:48:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd23affd700 1 -- 172.21.15.50:0/1368390751 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300117c0 con 0x7fd23c1592f0 2023-12-24T18:48:30.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd241523700 1 -- 172.21.15.50:0/1368390751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 msgr2=0x7fd23c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.486+0000 7fd241523700 1 --2- 172.21.15.50:0/1368390751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c15d710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2300098e0 tx=0x7fd2300091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 -- 172.21.15.50:0/1368390751 shutdown_connections 2023-12-24T18:48:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 --2- 172.21.15.50:0/1368390751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c15d710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 -- 172.21.15.50:0/1368390751 >> 172.21.15.50:0/1368390751 conn(0x7fd23c067b40 msgr2=0x7fd23c0cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 -- 172.21.15.50:0/1368390751 shutdown_connections 2023-12-24T18:48:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 -- 172.21.15.50:0/1368390751 wait complete. 2023-12-24T18:48:30.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 Processor -- start 2023-12-24T18:48:30.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.490+0000 7fd241523700 1 -- start start 2023-12-24T18:48:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd23c158f20 0x7fd23c0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b0920 con 0x7fd23c0c7620 2023-12-24T18:48:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c159950 con 0x7fd23c1592f0 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c159c30 con 0x7fd23c158f20 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41868/0 (socket says 172.21.15.50:41868) 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 -- 172.21.15.50:0/67092809 learned_addr learned my addr 172.21.15.50:0/67092809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23b7fe700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd23c158f20 0x7fd23c0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd240d22700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 -- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd23c158f20 msgr2=0x7fd23c0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd23c158f20 0x7fd23c0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 -- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 msgr2=0x7fd23c0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c0c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 -- 172.21.15.50:0/67092809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230009420 con 0x7fd23c0c7620 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd240d22700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd23bfff700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c590 tx=0x7fd22c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011590 con 0x7fd23c0c7620 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c011710 con 0x7fd23c0c7620 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c159f10 con 0x7fd23c0c7620 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.494+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011ad0 con 0x7fd23c0c7620 2023-12-24T18:48:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.498+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c15a4d0 con 0x7fd23c0c7620 2023-12-24T18:48:30.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.498+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c15a6f0 con 0x7fd23c0c7620 2023-12-24T18:48:30.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.502+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fd22c01b3b0 con 0x7fd23c0c7620 2023-12-24T18:48:30.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.502+0000 7fd223fff700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 0x7fd228062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:30.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.502+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fd22c07c360 con 0x7fd23c0c7620 2023-12-24T18:48:30.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.502+0000 7fd23b7fe700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 0x7fd228062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.502+0000 7fd23b7fe700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 0x7fd228062c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2300091e0 tx=0x7fd230016000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.506+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd22c04c3d0 con 0x7fd23c0c7620 2023-12-24T18:48:30.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.706+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd23c04be40 con 0x7fd228060750 2023-12-24T18:48:30.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.722+0000 7fd223fff700 1 -- 172.21.15.50:0/67092809 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd23c04be40 con 0x7fd228060750 2023-12-24T18:48:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:30.726 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:54", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:30.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 msgr2=0x7fd228062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 0x7fd228062c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2300091e0 tx=0x7fd230016000 comp rx=0 tx=0).stop 2023-12-24T18:48:30.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 msgr2=0x7fd23c14a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:30.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c590 tx=0x7fd22c00c8a0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 shutdown_connections 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd228060750 0x7fd228062c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c1592f0 0x7fd23c0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd23c158f20 0x7fd23c0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 --2- 172.21.15.50:0/67092809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c0c7620 0x7fd23c14a9a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 >> 172.21.15.50:0/67092809 conn(0x7fd23c067b40 msgr2=0x7fd23c0c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 shutdown_connections 2023-12-24T18:48:30.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:30.726+0000 7fd241523700 1 -- 172.21.15.50:0/67092809 wait complete. 2023-12-24T18:48:30.752 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:54", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:30.752 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:54', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:30.752 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:30.752 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:30.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:30.752 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-12-24T18:48:30.775 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:30.775 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:30.775 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:30.777 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_01_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:30.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-12-24T18:48:31.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.002+0000 7f586afcc700 1 Processor -- start 2023-12-24T18:48:31.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.002+0000 7f586afcc700 1 -- start start 2023-12-24T18:48:31.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586afcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864159080 0x7f586406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586afcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58640c5c90 0x7f58640cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586afcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586406b5b0 con 0x7f586406a4a0 2023-12-24T18:48:31.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586afcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586415dbd0 con 0x7f58640c5c90 2023-12-24T18:48:31.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586afcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586406df80 con 0x7f5864159080 2023-12-24T18:48:31.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58640c5c90 0x7f58640cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58640c5c90 0x7f58640cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41874/0 (socket says 172.21.15.50:41874) 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 -- 172.21.15.50:0/1377353747 learned_addr learned my addr 172.21.15.50:0/1377353747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f5869fca700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864159080 0x7f586406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 -- 172.21.15.50:0/1377353747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864159080 msgr2=0x7f586406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864159080 0x7f586406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 -- 172.21.15.50:0/1377353747 >> v1:172.21.15.82:6789/0 conn(0x7f586406a4a0 legacy=0x7f58640c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.006+0000 7f586a7cb700 1 -- 172.21.15.50:0/1377353747 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586406a9a0 con 0x7f58640c5c90 2023-12-24T18:48:31.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586a7cb700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58640c5c90 0x7f58640cab30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f585c009f20 tx=0x7f585c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad18e12e446e600a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f5868fc8700 1 -- 172.21.15.50:0/1377353747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00e070 con 0x7f58640c5c90 2023-12-24T18:48:31.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f5868fc8700 1 -- 172.21.15.50:0/1377353747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00ba80 con 0x7f58640c5c90 2023-12-24T18:48:31.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f5868fc8700 1 -- 172.21.15.50:0/1377353747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0092e0 con 0x7f58640c5c90 2023-12-24T18:48:31.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 -- 172.21.15.50:0/1377353747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58640c5c90 msgr2=0x7f58640cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58640c5c90 0x7f58640cab30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f585c009f20 tx=0x7f585c009840 comp rx=0 tx=0).stop 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 -- 172.21.15.50:0/1377353747 shutdown_connections 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58640c5c90 0x7f58640cab30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 --2- 172.21.15.50:0/1377353747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864159080 0x7f586406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 -- 172.21.15.50:0/1377353747 >> 172.21.15.50:0/1377353747 conn(0x7f5864067b80 msgr2=0x7f58640cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 -- 172.21.15.50:0/1377353747 shutdown_connections 2023-12-24T18:48:31.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.010+0000 7f586afcc700 1 -- 172.21.15.50:0/1377353747 wait complete. 2023-12-24T18:48:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.014+0000 7f586afcc700 1 Processor -- start 2023-12-24T18:48:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.014+0000 7f586afcc700 1 -- start start 2023-12-24T18:48:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58640c5c90 0x7f586414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864159080 0x7f58640c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58641552d0 con 0x7f586406a4a0 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586415a3d0 con 0x7f5864159080 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5864153ea0 con 0x7f58640c5c90 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41888/0 (socket says 172.21.15.50:41888) 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 -- 172.21.15.50:0/573937851 learned_addr learned my addr 172.21.15.50:0/573937851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586a7cb700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864159080 0x7f58640c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f58697c9700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58640c5c90 0x7f586414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 -- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58640c5c90 msgr2=0x7f586414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58640c5c90 0x7f586414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 -- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864159080 msgr2=0x7f58640c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864159080 0x7f58640c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 -- 172.21.15.50:0/573937851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c009ae0 con 0x7f586406a4a0 2023-12-24T18:48:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5869fca700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f586000d860 tx=0x7f5860008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600125f0 con 0x7f586406a4a0 2023-12-24T18:48:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860012750 con 0x7f586406a4a0 2023-12-24T18:48:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5864154a30 con 0x7f586406a4a0 2023-12-24T18:48:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012b10 con 0x7f586406a4a0 2023-12-24T18:48:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.018+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5864154ff0 con 0x7f586406a4a0 2023-12-24T18:48:31.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.022+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586404be40 con 0x7f586406a4a0 2023-12-24T18:48:31.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.022+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f586001e460 con 0x7f586406a4a0 2023-12-24T18:48:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.026+0000 7f5859ffb700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 0x7f5848062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.026+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f586007d3b0 con 0x7f586406a4a0 2023-12-24T18:48:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.026+0000 7f58697c9700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 0x7f5848062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.026+0000 7f58697c9700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 0x7f5848062c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58641515e0 tx=0x7f5854007ec0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.030+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5860050eb0 con 0x7f586406a4a0 2023-12-24T18:48:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.230+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f586406e1c0 con 0x7f5848060750 2023-12-24T18:48:31.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.246+0000 7f5859ffb700 1 -- 172.21.15.50:0/573937851 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f586406e1c0 con 0x7f5848060750 2023-12-24T18:48:31.248 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:31.248 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:55", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:31.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 msgr2=0x7f5848062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 0x7f5848062c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58641515e0 tx=0x7f5854007ec0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 msgr2=0x7f5864153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f586000d860 tx=0x7f5860008040 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 shutdown_connections 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5848060750 0x7f5848062c00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864159080 0x7f58640c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58640c5c90 0x7f586414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 --2- 172.21.15.50:0/573937851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f586406a4a0 0x7f5864153960 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 >> 172.21.15.50:0/573937851 conn(0x7f5864067b80 msgr2=0x7f58640cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 shutdown_connections 2023-12-24T18:48:31.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.250+0000 7f586afcc700 1 -- 172.21.15.50:0/573937851 wait complete. 2023-12-24T18:48:31.272 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:55", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:31.272 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:55', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:31.272 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:31.272 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:31.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:31.273 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:31.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:31.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:31.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:31.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:31.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:31.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:31.298 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_00_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_00_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_00_UTC'] 2023-12-24T18:48:31.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-12-24T18:48:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.522+0000 7fe6c04cd700 1 Processor -- start 2023-12-24T18:48:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.522+0000 7fe6c04cd700 1 -- start start 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6c04cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b815c7a0 0x7fe6b815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6c04cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b80cb2b0 0x7fe6b80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6c04cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b806b6b0 con 0x7fe6b815c3d0 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6c04cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b806c250 con 0x7fe6b815c7a0 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6c04cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80cba20 con 0x7fe6b80cb2b0 2023-12-24T18:48:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6bda68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b815c7a0 0x7fe6b815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6be269700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe6b815c3d0 0x7fe6b806bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57982/0 (socket says 172.21.15.50:57982) 2023-12-24T18:48:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6bda68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b815c7a0 0x7fe6b815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41900/0 (socket says 172.21.15.50:41900) 2023-12-24T18:48:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6be269700 1 -- 172.21.15.50:0/2189490746 learned_addr learned my addr 172.21.15.50:0/2189490746 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.526+0000 7fe6bea6a700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b80cb2b0 0x7fe6b80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bda68700 1 -- 172.21.15.50:0/2189490746 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b80cb2b0 msgr2=0x7fe6b80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bda68700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b80cb2b0 0x7fe6b80cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bda68700 1 -- 172.21.15.50:0/2189490746 >> v1:172.21.15.82:6789/0 conn(0x7fe6b815c3d0 legacy=0x7fe6b806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bda68700 1 -- 172.21.15.50:0/2189490746 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b806ad80 con 0x7fe6b815c7a0 2023-12-24T18:48:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bda68700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c7a0 0x7fe6b815d810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80098e0 tx=0x7fe6a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5a58a16d78a1eb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bd267700 1 -- 172.21.15.50:0/2189490746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8011630 con 0x7fe6b815c7a0 2023-12-24T18:48:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bd267700 1 -- 172.21.15.50:0/2189490746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8011790 con 0x7fe6b815c7a0 2023-12-24T18:48:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6bd267700 1 -- 172.21.15.50:0/2189490746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8011b30 con 0x7fe6b815c7a0 2023-12-24T18:48:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 -- 172.21.15.50:0/2189490746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c7a0 msgr2=0x7fe6b815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c7a0 0x7fe6b815d810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80098e0 tx=0x7fe6a80091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 -- 172.21.15.50:0/2189490746 shutdown_connections 2023-12-24T18:48:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b80cb2b0 0x7fe6b80cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/2189490746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c7a0 0x7fe6b815d810 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 -- 172.21.15.50:0/2189490746 >> 172.21.15.50:0/2189490746 conn(0x7fe6b80670b0 msgr2=0x7fe6b80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 -- 172.21.15.50:0/2189490746 shutdown_connections 2023-12-24T18:48:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.530+0000 7fe6c04cd700 1 -- 172.21.15.50:0/2189490746 wait complete. 2023-12-24T18:48:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 Processor -- start 2023-12-24T18:48:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 -- start start 2023-12-24T18:48:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 0x7fe6b815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8169470 con 0x7fe6b815c3d0 2023-12-24T18:48:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81696d0 con 0x7fe6b80cb2b0 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6c04cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81699b0 con 0x7fe6b815c7a0 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6bda68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6be269700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 0x7fe6b815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.534+0000 7fe6bea6a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41904/0 (socket says 172.21.15.50:41904) 2023-12-24T18:48:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bea6a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:58398/0 (socket says 172.21.15.50:58398) 2023-12-24T18:48:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6be269700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 0x7fe6b815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:32770/0 (socket says 172.21.15.50:32770) 2023-12-24T18:48:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 -- 172.21.15.50:0/4286160788 learned_addr learned my addr 172.21.15.50:0/4286160788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 -- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 msgr2=0x7fe6b814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 -- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 msgr2=0x7fe6b815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 0x7fe6b815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 -- 172.21.15.50:0/4286160788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8009420 con 0x7fe6b815c3d0 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bea6a700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6bda68700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80030c0 tx=0x7fe6a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801cd50 con 0x7fe6b815c3d0 2023-12-24T18:48:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a801a450 con 0x7fe6b815c3d0 2023-12-24T18:48:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801a810 con 0x7fe6b815c3d0 2023-12-24T18:48:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b8169c90 con 0x7fe6b815c3d0 2023-12-24T18:48:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b815aa40 con 0x7fe6b815c3d0 2023-12-24T18:48:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.538+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b816a190 con 0x7fe6b815c3d0 2023-12-24T18:48:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.542+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fe6a801ac00 con 0x7fe6b815c3d0 2023-12-24T18:48:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.542+0000 7fe6ae7fc700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 0x7fe69c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.542+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7fe6a807ec10 con 0x7fe6b815c3d0 2023-12-24T18:48:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.542+0000 7fe6be269700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 0x7fe69c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.542+0000 7fe6be269700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 0x7fe69c062c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40058d0 tx=0x7fe6b4009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.550+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6a804ec80 con 0x7fe6b815c3d0 2023-12-24T18:48:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.746+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6b8169b20 con 0x7fe69c060780 2023-12-24T18:48:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.762+0000 7fe6ae7fc700 1 -- 172.21.15.50:0/4286160788 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe6b8169b20 con 0x7fe69c060780 2023-12-24T18:48:31.765 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:31.765 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:56", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 msgr2=0x7fe69c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 0x7fe69c062c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40058d0 tx=0x7fe6b4009040 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 msgr2=0x7fe6b80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80030c0 tx=0x7fe6a8016000 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 shutdown_connections 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe69c060780 0x7fe69c062c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b815c7a0 0x7fe6b814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b815c3d0 0x7fe6b80b3da0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 --2- 172.21.15.50:0/4286160788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b80cb2b0 0x7fe6b815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 >> 172.21.15.50:0/4286160788 conn(0x7fe6b80670b0 msgr2=0x7fe6b815b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 shutdown_connections 2023-12-24T18:48:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:31.766+0000 7fe6c04cd700 1 -- 172.21.15.50:0/4286160788 wait complete. 2023-12-24T18:48:31.792 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:56", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:31.792 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:56', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:31.792 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:31.792 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:31.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:31.792 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-12-24T18:48:31.814 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:31.814 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:31.814 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_01_UTC 2023-12-24T18:48:31.814 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:31.815 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:31.816 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_38_00_UTC', 'scheduled-2023-12-24-18_39_00_UTC', 'scheduled-2023-12-24-18_40_01_UTC', 'scheduled-2023-12-24-18_41_00_UTC', 'scheduled-2023-12-24-18_42_00_UTC', 'scheduled-2023-12-24-18_43_00_UTC', 'scheduled-2023-12-24-18_44_00_UTC', 'scheduled-2023-12-24-18_45_00_UTC', 'scheduled-2023-12-24-18_46_01_UTC', 'scheduled-2023-12-24-18_47_00_UTC', 'scheduled-2023-12-24-18_48_01_UTC'] 2023-12-24T18:48:31.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-12-24T18:48:32.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.034+0000 7f62759c5700 1 Processor -- start 2023-12-24T18:48:32.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.034+0000 7f62759c5700 1 -- start start 2023-12-24T18:48:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f62759c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6270158fc0 0x7f62700cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f62759c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 0x7f62700ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f62759c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700cabf0 con 0x7f627006a4f0 2023-12-24T18:48:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f62759c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627006b520 con 0x7f6270158fc0 2023-12-24T18:48:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f62759c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627006b060 con 0x7f62700cc7f0 2023-12-24T18:48:32.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f627006a4f0 0x7f627006a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46988/0 (socket says 172.21.15.50:46988) 2023-12-24T18:48:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626f7fe700 1 -- 172.21.15.50:0/1181528497 learned_addr learned my addr 172.21.15.50:0/1181528497 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626e7fc700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 0x7f62700ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626effd700 1 --2- 172.21.15.50:0/1181528497 >> v2:172.21.15.50:3300/0 conn(0x7f6270158fc0 0x7f62700cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626dffb700 1 -- 172.21.15.50:0/1181528497 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46137726 0 0) 0x7f62700cabf0 con 0x7f627006a4f0 2023-12-24T18:48:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626dffb700 1 -- 172.21.15.50:0/1181528497 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003570 con 0x7f627006a4f0 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626effd700 1 -- 172.21.15.50:0/1181528497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 msgr2=0x7f62700ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626effd700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 0x7f62700ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626effd700 1 -- 172.21.15.50:0/1181528497 >> v1:172.21.15.50:6789/0 conn(0x7f627006a4f0 legacy=0x7f627006a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.038+0000 7f626effd700 1 -- 172.21.15.50:0/1181528497 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700cd1a0 con 0x7f6270158fc0 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f626e7fc700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 0x7f62700ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f626effd700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6270158fc0 0x7f62700cb080 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f62600098e0 tx=0x7f62600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d571142693fece server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f626dffb700 1 -- 172.21.15.50:0/1181528497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011630 con 0x7f6270158fc0 2023-12-24T18:48:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f626dffb700 1 -- 172.21.15.50:0/1181528497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260011790 con 0x7f6270158fc0 2023-12-24T18:48:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f626dffb700 1 -- 172.21.15.50:0/1181528497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011b30 con 0x7f6270158fc0 2023-12-24T18:48:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 -- 172.21.15.50:0/1181528497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6270158fc0 msgr2=0x7f62700cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6270158fc0 0x7f62700cb080 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f62600098e0 tx=0x7f62600091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 -- 172.21.15.50:0/1181528497 shutdown_connections 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62700cc7f0 0x7f62700ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 --2- 172.21.15.50:0/1181528497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6270158fc0 0x7f62700cb080 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 -- 172.21.15.50:0/1181528497 >> 172.21.15.50:0/1181528497 conn(0x7f62700670b0 msgr2=0x7f62700674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 -- 172.21.15.50:0/1181528497 shutdown_connections 2023-12-24T18:48:32.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.042+0000 7f62759c5700 1 -- 172.21.15.50:0/1181528497 wait complete. 2023-12-24T18:48:32.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 Processor -- start 2023-12-24T18:48:32.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 -- start start 2023-12-24T18:48:32.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f627006a4f0 0x7f62700c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 0x7f62700afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c7650 con 0x7f62700cc7f0 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270151530 con 0x7f6270158fc0 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f62759c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c73b0 con 0x7f627006a4f0 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41934/0 (socket says 172.21.15.50:41934) 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 -- 172.21.15.50:0/1794070472 learned_addr learned my addr 172.21.15.50:0/1794070472 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626effd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f627006a4f0 0x7f62700c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626f7fe700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 0x7f62700afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 -- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f627006a4f0 msgr2=0x7f62700c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f627006a4f0 0x7f62700c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 -- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 msgr2=0x7f62700afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 0x7f62700afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 -- 172.21.15.50:0/1794070472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009420 con 0x7f62700cc7f0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626f7fe700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 0x7f62700afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.046+0000 7f626e7fc700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f626400ec80 tx=0x7f62640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400c8f0 con 0x7f62700cc7f0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400ca50 con 0x7f62700cc7f0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6260009420 con 0x7f62700cc7f0 2023-12-24T18:48:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400cdd0 con 0x7f62700cc7f0 2023-12-24T18:48:32.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6270150ee0 con 0x7f62700cc7f0 2023-12-24T18:48:32.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62701516a0 con 0x7f62700cc7f0 2023-12-24T18:48:32.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.050+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f6264013680 con 0x7f62700cc7f0 2023-12-24T18:48:32.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.054+0000 7f6256ffd700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 0x7f625c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.054+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f626407d130 con 0x7f62700cc7f0 2023-12-24T18:48:32.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.054+0000 7f626effd700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 0x7f625c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.054+0000 7f626effd700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 0x7f625c062c30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62600091e0 tx=0x7f6260017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.058+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f626404d1a0 con 0x7f62700cc7f0 2023-12-24T18:48:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.250+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f627004beb0 con 0x7f625c060780 2023-12-24T18:48:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.266+0000 7f6256ffd700 1 -- 172.21.15.50:0/1794070472 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f627004beb0 con 0x7f625c060780 2023-12-24T18:48:32.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:56", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 msgr2=0x7f625c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 0x7f625c062c30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62600091e0 tx=0x7f6260017000 comp rx=0 tx=0).stop 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 msgr2=0x7f62700c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f626400ec80 tx=0x7f62640091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 shutdown_connections 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f625c060780 0x7f625c062c30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270158fc0 0x7f62700afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62700cc7f0 0x7f62700c6e70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 --2- 172.21.15.50:0/1794070472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f627006a4f0 0x7f62700c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 >> 172.21.15.50:0/1794070472 conn(0x7f62700670b0 msgr2=0x7f627014ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 shutdown_connections 2023-12-24T18:48:32.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.270+0000 7f62759c5700 1 -- 172.21.15.50:0/1794070472 wait complete. 2023-12-24T18:48:32.293 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:37:56", "first": "2023-12-24T18:38:00", "last": "2023-12-24T18:48:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-12-24T18:48:32.294 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:37:56', 'first': '2023-12-24T18:38:00', 'last': '2023-12-24T18:48:01', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-12-24T18:48:32.294 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T18:48:32.295 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T18:48:32.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-12-24T18:48:32.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.474+0000 7f7ac759e700 1 Processor -- start 2023-12-24T18:48:32.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.474+0000 7f7ac759e700 1 -- start start 2023-12-24T18:48:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 0x7f7ac806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ac806a4a0 0x7f7ac80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac80c5f20 con 0x7f7ac80c5ac0 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac815dbd0 con 0x7f7ac806a4a0 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac806b5b0 con 0x7f7ac8159080 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ac80c5ac0 0x7f7ac806c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46994/0 (socket says 172.21.15.50:46994) 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 0x7f7ac806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac6d9d700 1 -- 172.21.15.50:0/312919539 learned_addr learned my addr 172.21.15.50:0/312919539 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac5d9b700 1 --2- 172.21.15.50:0/312919539 >> v2:172.21.15.82:3300/0 conn(0x7f7ac806a4a0 0x7f7ac80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac559a700 1 -- 172.21.15.50:0/312919539 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354797458 0 0) 0x7f7ac0001490 con 0x7f7ac80c5ac0 2023-12-24T18:48:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac559a700 1 -- 172.21.15.50:0/312919539 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab0003570 con 0x7f7ac80c5ac0 2023-12-24T18:48:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 -- 172.21.15.50:0/312919539 >> v2:172.21.15.82:3300/0 conn(0x7f7ac806a4a0 msgr2=0x7f7ac80c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 --2- 172.21.15.50:0/312919539 >> v2:172.21.15.82:3300/0 conn(0x7f7ac806a4a0 0x7f7ac80c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 -- 172.21.15.50:0/312919539 >> v1:172.21.15.50:6789/0 conn(0x7f7ac80c5ac0 legacy=0x7f7ac806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 -- 172.21.15.50:0/312919539 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac806df80 con 0x7f7ac8159080 2023-12-24T18:48:32.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac659c700 1 --2- 172.21.15.50:0/312919539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 0x7f7ac806da40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098e0 tx=0x7f7ab80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93cbfed21c8ce5a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac559a700 1 -- 172.21.15.50:0/312919539 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011630 con 0x7f7ac8159080 2023-12-24T18:48:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac559a700 1 -- 172.21.15.50:0/312919539 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8011790 con 0x7f7ac8159080 2023-12-24T18:48:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.478+0000 7f7ac559a700 1 -- 172.21.15.50:0/312919539 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011b30 con 0x7f7ac8159080 2023-12-24T18:48:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- 172.21.15.50:0/312919539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 msgr2=0x7f7ac806da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 --2- 172.21.15.50:0/312919539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 0x7f7ac806da40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098e0 tx=0x7f7ab80091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- 172.21.15.50:0/312919539 shutdown_connections 2023-12-24T18:48:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 --2- 172.21.15.50:0/312919539 >> v2:172.21.15.82:3300/0 conn(0x7f7ac806a4a0 0x7f7ac80c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 --2- 172.21.15.50:0/312919539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac8159080 0x7f7ac806da40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- 172.21.15.50:0/312919539 >> 172.21.15.50:0/312919539 conn(0x7f7ac8067b80 msgr2=0x7f7ac80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- 172.21.15.50:0/312919539 shutdown_connections 2023-12-24T18:48:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- 172.21.15.50:0/312919539 wait complete. 2023-12-24T18:48:32.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 Processor -- start 2023-12-24T18:48:32.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.482+0000 7f7ac759e700 1 -- start start 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac806a4a0 0x7f7ac8169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac80c5ac0 0x7f7ac80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80b59f0 con 0x7f7ac8159080 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8159580 con 0x7f7ac80c5ac0 2023-12-24T18:48:32.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8159860 con 0x7f7ac806a4a0 2023-12-24T18:48:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41944/0 (socket says 172.21.15.50:41944) 2023-12-24T18:48:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 -- 172.21.15.50:0/3861130529 learned_addr learned my addr 172.21.15.50:0/3861130529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac659c700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac806a4a0 0x7f7ac8169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac5d9b700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac80c5ac0 0x7f7ac80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 -- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac806a4a0 msgr2=0x7f7ac8169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac806a4a0 0x7f7ac8169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 -- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac80c5ac0 msgr2=0x7f7ac80b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac80c5ac0 0x7f7ac80b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 -- 172.21.15.50:0/3861130529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009420 con 0x7f7ac8159080 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac6d9d700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000cc70 tx=0x7f7ac0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000a890 con 0x7f7ac8159080 2023-12-24T18:48:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000a9f0 con 0x7f7ac8159080 2023-12-24T18:48:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8159b40 con 0x7f7ac8159080 2023-12-24T18:48:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000adb0 con 0x7f7ac8159080 2023-12-24T18:48:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.486+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac80b2df0 con 0x7f7ac8159080 2023-12-24T18:48:32.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.490+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac815a040 con 0x7f7ac8159080 2023-12-24T18:48:32.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.490+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f7ac0007300 con 0x7f7ac8159080 2023-12-24T18:48:32.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.494+0000 7f7ab67fc700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 0x7f7aa8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:32.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.494+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f7ac007cf40 con 0x7f7ac8159080 2023-12-24T18:48:32.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.494+0000 7f7ac659c700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 0x7f7aa8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:32.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.494+0000 7f7ac659c700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 0x7f7aa8062c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80093f0 tx=0x7f7ab8017000 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.502+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ac004d030 con 0x7f7ac8159080 2023-12-24T18:48:32.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.694+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ac80cd750 con 0x7f7aa8060750 2023-12-24T18:48:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.834+0000 7f7ab67fc700 1 -- 172.21.15.50:0/3861130529 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7ac80cd750 con 0x7f7aa8060750 2023-12-24T18:48:32.835 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-12-24T18:48:32.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.834+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 msgr2=0x7f7aa8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.834+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 0x7f7aa8062c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80093f0 tx=0x7f7ab8017000 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.834+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 msgr2=0x7f7ac80cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.834+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000cc70 tx=0x7f7ac0001a50 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 shutdown_connections 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7aa8060750 0x7f7aa8062c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac8159080 0x7f7ac80cfa40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac80c5ac0 0x7f7ac80b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 --2- 172.21.15.50:0/3861130529 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ac806a4a0 0x7f7ac8169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 >> 172.21.15.50:0/3861130529 conn(0x7f7ac8067b80 msgr2=0x7f7ac81537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 shutdown_connections 2023-12-24T18:48:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:32.838+0000 7f7ac759e700 1 -- 172.21.15.50:0/3861130529 wait complete. 2023-12-24T18:48:32.861 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-12-24T18:48:32.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:32.862 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-12-24T18:48:32.885 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_01_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:32.887 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:32.887 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:32.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:32.888 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:32.967 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:32.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:32.967 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:33.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:33.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.049 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:33.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:33.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.125 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:33.199 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:33.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.199 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:33.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_43_01_UTC 2023-12-24T18:48:33.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.282 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_43_01_UTC) 2023-12-24T18:48:33.362 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:33.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.362 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:33.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:33.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.444 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:33.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:33.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.522 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:33.596 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:33.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.596 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:33.677 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:33.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.677 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-12-24-18_48_01_UTC) 2023-12-24T18:48:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:33.752 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-12-24T18:48:33.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-12-24T18:48:34.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.050+0000 7f9a2e878700 1 Processor -- start 2023-12-24T18:48:34.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.050+0000 7f9a2e878700 1 -- start start 2023-12-24T18:48:34.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2e878700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a280b4230 0x7f9a2815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2e878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a2806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2e878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2806d4d0 con 0x7f9a28156b50 2023-12-24T18:48:34.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2e878700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280b4960 con 0x7f9a280b4230 2023-12-24T18:48:34.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2e878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2815a620 con 0x7f9a2806db90 2023-12-24T18:48:34.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a27fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9a28156b50 0x7f9a280b3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47002/0 (socket says 172.21.15.50:47002) 2023-12-24T18:48:34.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a27fff700 1 -- 172.21.15.50:0/173440816 learned_addr learned my addr 172.21.15.50:0/173440816 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:34.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a2ce15700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a2806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.054+0000 7f9a277fe700 1 --2- 172.21.15.50:0/173440816 >> v2:172.21.15.82:3300/0 conn(0x7f9a280b4230 0x7f9a2815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a26ffd700 1 -- 172.21.15.50:0/173440816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242850125 0 0) 0x7f9a2806d4d0 con 0x7f9a28156b50 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a26ffd700 1 -- 172.21.15.50:0/173440816 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10003570 con 0x7f9a28156b50 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a277fe700 1 -- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 msgr2=0x7f9a2806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a277fe700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a2806a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a277fe700 1 -- 172.21.15.50:0/173440816 >> v1:172.21.15.50:6789/0 conn(0x7f9a28156b50 legacy=0x7f9a280b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a277fe700 1 -- 172.21.15.50:0/173440816 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2806c8c0 con 0x7f9a280b4230 2023-12-24T18:48:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2ce15700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a2806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a277fe700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2815a0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0098e0 tx=0x7f9a1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89aa342463e418ce server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a26ffd700 1 -- 172.21.15.50:0/173440816 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011630 con 0x7f9a280b4230 2023-12-24T18:48:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a26ffd700 1 -- 172.21.15.50:0/173440816 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c011790 con 0x7f9a280b4230 2023-12-24T18:48:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a26ffd700 1 -- 172.21.15.50:0/173440816 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011b30 con 0x7f9a280b4230 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 -- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 msgr2=0x7f9a2815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2815a0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0098e0 tx=0x7f9a1c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 -- 172.21.15.50:0/173440816 shutdown_connections 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a2806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 --2- 172.21.15.50:0/173440816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2815a0e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 -- 172.21.15.50:0/173440816 >> 172.21.15.50:0/173440816 conn(0x7f9a28067b40 msgr2=0x7f9a280b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 -- 172.21.15.50:0/173440816 shutdown_connections 2023-12-24T18:48:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.058+0000 7f9a2e878700 1 -- 172.21.15.50:0/173440816 wait complete. 2023-12-24T18:48:34.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 Processor -- start 2023-12-24T18:48:34.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 -- start start 2023-12-24T18:48:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a28169340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2814f7d0 con 0x7f9a28156b50 2023-12-24T18:48:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2814fa20 con 0x7f9a280b4230 2023-12-24T18:48:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2e878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2814fd00 con 0x7f9a2806db90 2023-12-24T18:48:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41946/0 (socket says 172.21.15.50:41946) 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 -- 172.21.15.50:0/2854645481 learned_addr learned my addr 172.21.15.50:0/2854645481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a27fff700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a28169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a277fe700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 -- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 msgr2=0x7f9a28169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a28169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 -- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 msgr2=0x7f9a2814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.062+0000 7f9a2ce15700 1 -- 172.21.15.50:0/2854645481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20009a20 con 0x7f9a28156b50 2023-12-24T18:48:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a2ce15700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009fc0 tx=0x7f9a2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000cbd0 con 0x7f9a28156b50 2023-12-24T18:48:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2000f040 con 0x7f9a28156b50 2023-12-24T18:48:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c009420 con 0x7f9a28156b50 2023-12-24T18:48:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20014480 con 0x7f9a28156b50 2023-12-24T18:48:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a281502c0 con 0x7f9a28156b50 2023-12-24T18:48:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.066+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a28071060 con 0x7f9a28156b50 2023-12-24T18:48:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.070+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f9a20003020 con 0x7f9a28156b50 2023-12-24T18:48:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.070+0000 7f9a0ffff700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 0x7f9a14062cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.070+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6312+0+0 (secure 0 0 0) 0x7f9a2007d830 con 0x7f9a28156b50 2023-12-24T18:48:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.070+0000 7f9a27fff700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 0x7f9a14062cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.070+0000 7f9a27fff700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 0x7f9a14062cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.078+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a2004d810 con 0x7f9a28156b50 2023-12-24T18:48:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.270+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a2806cba0 con 0x7f9a14060820 2023-12-24T18:48:34.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.406+0000 7f9a0ffff700 1 -- 172.21.15.50:0/2854645481 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9a2806cba0 con 0x7f9a14060820 2023-12-24T18:48:34.410 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 msgr2=0x7f9a14062cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 0x7f9a14062cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18009040 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 msgr2=0x7f9a280af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009fc0 tx=0x7f9a2000b040 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 shutdown_connections 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f9a14060820 0x7f9a14062cd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28156b50 0x7f9a280af140 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a280b4230 0x7f9a2814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 --2- 172.21.15.50:0/2854645481 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a2806db90 0x7f9a28169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 >> 172.21.15.50:0/2854645481 conn(0x7f9a28067b40 msgr2=0x7f9a280d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 shutdown_connections 2023-12-24T18:48:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:34.410+0000 7f9a2e878700 1 -- 172.21.15.50:0/2854645481 wait complete. 2023-12-24T18:48:34.438 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-12-24T18:48:34.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.438 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-12-24T18:48:34.456 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:34.457 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:34.458 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:34.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.458 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:34.539 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:34.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.539 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:34.627 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:34.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.627 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:34.711 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:34.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.711 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:34.784 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:34.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.785 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:34.862 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:34.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.862 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:34.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:34.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:34.929 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_44_01_UTC) 2023-12-24T18:48:35.007 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:35.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:35.007 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:35.085 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:35.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:35.086 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:35.162 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:35.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:35.162 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:35.240 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:35.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:35.241 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:35.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:35.329 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-12-24T18:48:35.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-12-24T18:48:35.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.594+0000 7f86bbfff700 1 Processor -- start 2023-12-24T18:48:35.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.594+0000 7f86bbfff700 1 -- start start 2023-12-24T18:48:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.598+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 0x7f86bc0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.598+0000 7f86bbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86bc0cb9b0 0x7f86bc06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.598+0000 7f86bbfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86bc0c8650 con 0x7f86bc06dc70 2023-12-24T18:48:35.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.598+0000 7f86bbfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86bc0cb5c0 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.598+0000 7f86bbfff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc159460 con 0x7f86bc1533a0 2023-12-24T18:48:35.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86bc0cb9b0 0x7f86bc06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86baffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 0x7f86bc0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86bc0cb9b0 0x7f86bc06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:32822/0 (socket says 172.21.15.50:32822) 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 -- 172.21.15.50:0/3954713839 learned_addr learned my addr 172.21.15.50:0/3954713839 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86bb7fe700 1 --1- 172.21.15.50:0/3954713839 >> v1:172.21.15.82:6789/0 conn(0x7f86bc06dc70 0x7f86bc068d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:57988/0 (socket says 172.21.15.50:57988) 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 -- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 msgr2=0x7f86bc0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 0x7f86bc0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 -- 172.21.15.50:0/3954713839 >> v1:172.21.15.82:6789/0 conn(0x7f86bc06dc70 legacy=0x7f86bc068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 -- 172.21.15.50:0/3954713839 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0cbeb0 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86b9ffb700 1 -- 172.21.15.50:0/3954713839 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565871352 0 0) 0x7f86bc0c8650 con 0x7f86bc06dc70 2023-12-24T18:48:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86baffd700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 0x7f86bc0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86ba7fc700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0cb9b0 0x7f86bc06d730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86b00099b0 tx=0x7f86b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4555338ea64a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86b9ffb700 1 -- 172.21.15.50:0/3954713839 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0009ea0 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86b9ffb700 1 -- 172.21.15.50:0/3954713839 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000b860 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86b9ffb700 1 -- 172.21.15.50:0/3954713839 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000bc00 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86bbfff700 1 -- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0cb9b0 msgr2=0x7f86bc06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86bbfff700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0cb9b0 0x7f86bc06d730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86b00099b0 tx=0x7f86b0009250 comp rx=0 tx=0).stop 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.602+0000 7f86bbfff700 1 -- 172.21.15.50:0/3954713839 shutdown_connections 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0cb9b0 0x7f86bc06d730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 --2- 172.21.15.50:0/3954713839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc1533a0 0x7f86bc0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 -- 172.21.15.50:0/3954713839 >> 172.21.15.50:0/3954713839 conn(0x7f86bc0ccaf0 msgr2=0x7f86bc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 -- 172.21.15.50:0/3954713839 shutdown_connections 2023-12-24T18:48:35.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 -- 172.21.15.50:0/3954713839 wait complete. 2023-12-24T18:48:35.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 Processor -- start 2023-12-24T18:48:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.606+0000 7f86bbfff700 1 -- start start 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc0cb9b0 0x7f86bc151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 0x7f86bc0c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0aa040 con 0x7f86bc1533a0 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0aa320 con 0x7f86bc0af890 2023-12-24T18:48:35.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bbfff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0c56f0 con 0x7f86bc0cb9b0 2023-12-24T18:48:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 0x7f86bc0c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86baffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc0cb9b0 0x7f86bc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41948/0 (socket says 172.21.15.50:41948) 2023-12-24T18:48:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86ba7fc700 1 -- 172.21.15.50:0/467108845 learned_addr learned my addr 172.21.15.50:0/467108845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 -- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc0cb9b0 msgr2=0x7f86bc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc0cb9b0 0x7f86bc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 -- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 msgr2=0x7f86bc0a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 -- 172.21.15.50:0/467108845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac009420 con 0x7f86bc0af890 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86ba7fc700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.610+0000 7f86bb7fe700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 0x7f86bc0c1b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86b400cc90 tx=0x7f86b4001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4005df0 con 0x7f86bc0af890 2023-12-24T18:48:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400a6a0 con 0x7f86bc0af890 2023-12-24T18:48:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b00094f0 con 0x7f86bc0af890 2023-12-24T18:48:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b400aa60 con 0x7f86bc0af890 2023-12-24T18:48:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc0c5cb0 con 0x7f86bc0af890 2023-12-24T18:48:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.614+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc0c5550 con 0x7f86bc0af890 2023-12-24T18:48:35.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.618+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f86b40070f0 con 0x7f86bc0af890 2023-12-24T18:48:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.618+0000 7f86a2ffd700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 0x7f86a8062cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.618+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6688+0+0 (secure 0 0 0) 0x7f86b407cee0 con 0x7f86bc0af890 2023-12-24T18:48:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.618+0000 7f86baffd700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 0x7f86a8062cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.618+0000 7f86baffd700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 0x7f86a8062cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009ea0 tx=0x7f86ac0091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.626+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f86bc0c5550 con 0x7f86bc0af890 2023-12-24T18:48:35.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.834+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f86bc0c5550 con 0x7f86a8060820 2023-12-24T18:48:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.974+0000 7f86a2ffd700 1 -- 172.21.15.50:0/467108845 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f86bc0c5550 con 0x7f86a8060820 2023-12-24T18:48:35.977 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-12-24T18:48:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 msgr2=0x7f86a8062cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 0x7f86a8062cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009ea0 tx=0x7f86ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 msgr2=0x7f86bc0c1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 0x7f86bc0c1b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86b400cc90 tx=0x7f86b4001a60 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 shutdown_connections 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f86a8060820 0x7f86a8062cd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86bc0af890 0x7f86bc0c1b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86bc1533a0 0x7f86bc0a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 --2- 172.21.15.50:0/467108845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86bc0cb9b0 0x7f86bc151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 >> 172.21.15.50:0/467108845 conn(0x7f86bc0ccaf0 msgr2=0x7f86bc0c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 shutdown_connections 2023-12-24T18:48:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:35.978+0000 7f86bbfff700 1 -- 172.21.15.50:0/467108845 wait complete. 2023-12-24T18:48:36.003 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-12-24T18:48:36.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.003 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-12-24T18:48:36.025 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:36.025 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:36.025 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:36.025 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:36.025 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:36.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:36.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.028 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:36.109 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:36.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.110 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:36.185 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:36.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.186 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:36.257 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:36.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.257 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:36.328 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:36.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.329 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:36.404 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:36.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.405 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:36.482 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:36.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.482 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:36.561 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:36.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.562 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:36.633 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:36.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.633 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:36.709 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:36.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.710 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:36.788 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:36.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.788 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:36.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:36.863 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-12-24T18:48:36.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-12-24T18:48:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.154+0000 7f77d0b45700 1 Processor -- start 2023-12-24T18:48:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.154+0000 7f77d0b45700 1 -- start start 2023-12-24T18:48:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77d0b45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77cc15c7a0 0x7f77cc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77d0b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77d0b45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc06b6b0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77d0b45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc06c250 con 0x7f77cc15c7a0 2023-12-24T18:48:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77d0b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0cba20 con 0x7f77cc0cb2b0 2023-12-24T18:48:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77cc15c7a0 0x7f77cc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77cc15c7a0 0x7f77cc15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41962/0 (socket says 172.21.15.50:41962) 2023-12-24T18:48:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 -- 172.21.15.50:0/1119725107 learned_addr learned my addr 172.21.15.50:0/1119725107 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77cad9d700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 -- 172.21.15.50:0/1119725107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 msgr2=0x7f77cc0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 -- 172.21.15.50:0/1119725107 >> v1:172.21.15.82:6789/0 conn(0x7f77cc15c3d0 legacy=0x7f77cc06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 -- 172.21.15.50:0/1119725107 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc06ad80 con 0x7f77cc15c7a0 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77cad9d700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c9d9b700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c7a0 0x7f77cc15d810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f77c00099b0 tx=0x7f77c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4157f44ae5a30ec server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c959a700 1 -- 172.21.15.50:0/1119725107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000b820 con 0x7f77cc15c7a0 2023-12-24T18:48:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c959a700 1 -- 172.21.15.50:0/1119725107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000b980 con 0x7f77cc15c7a0 2023-12-24T18:48:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.158+0000 7f77c959a700 1 -- 172.21.15.50:0/1119725107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000bd20 con 0x7f77cc15c7a0 2023-12-24T18:48:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 -- 172.21.15.50:0/1119725107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c7a0 msgr2=0x7f77cc15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c7a0 0x7f77cc15d810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f77c00099b0 tx=0x7f77c0009250 comp rx=0 tx=0).stop 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 -- 172.21.15.50:0/1119725107 shutdown_connections 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 --2- 172.21.15.50:0/1119725107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c7a0 0x7f77cc15d810 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 -- 172.21.15.50:0/1119725107 >> 172.21.15.50:0/1119725107 conn(0x7f77cc0670b0 msgr2=0x7f77cc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 -- 172.21.15.50:0/1119725107 shutdown_connections 2023-12-24T18:48:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.162+0000 7f77d0b45700 1 -- 172.21.15.50:0/1119725107 wait complete. 2023-12-24T18:48:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 Processor -- start 2023-12-24T18:48:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 -- start start 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 0x7f77cc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc159870 con 0x7f77cc15c3d0 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0a8f70 con 0x7f77cc15c7a0 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77d0b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0cb050 con 0x7f77cc0cb2b0 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41978/0 (socket says 172.21.15.50:41978) 2023-12-24T18:48:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 -- 172.21.15.50:0/2099781786 learned_addr learned my addr 172.21.15.50:0/2099781786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77cad9d700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 0x7f77cc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 -- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 msgr2=0x7f77cc0a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77ca59c700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 -- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 msgr2=0x7f77cc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 0x7f77cc0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 -- 172.21.15.50:0/2099781786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00094f0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77cad9d700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 0x7f77cc0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77ca59c700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.166+0000 7f77c9d9b700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009290 tx=0x7f77c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c001c460 con 0x7f77cc15c3d0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc169630 con 0x7f77cc15c3d0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c001c5e0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c001c9a0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc169bf0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc071060 con 0x7f77cc15c3d0 2023-12-24T18:48:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.170+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f77c001a450 con 0x7f77cc15c3d0 2023-12-24T18:48:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.174+0000 7f77ba7fc700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 0x7f77ac062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.174+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6688+0+0 (secure 0 0 0) 0x7f77c007f580 con 0x7f77cc15c3d0 2023-12-24T18:48:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.174+0000 7f77ca59c700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 0x7f77ac062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.174+0000 7f77ca59c700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 0x7f77ac062c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0b1070 tx=0x7f77bc009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.178+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77c004f5d0 con 0x7f77cc15c3d0 2023-12-24T18:48:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.370+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f77cc071060 con 0x7f77ac060750 2023-12-24T18:48:37.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.514+0000 7f77ba7fc700 1 -- 172.21.15.50:0/2099781786 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f77cc071060 con 0x7f77ac060750 2023-12-24T18:48:37.518 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-12-24T18:48:37.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.518+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 msgr2=0x7f77ac062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.518+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 0x7f77ac062c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0b1070 tx=0x7f77bc009040 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.518+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 msgr2=0x7f77cc159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.518+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009290 tx=0x7f77c0016000 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 shutdown_connections 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77ac060750 0x7f77ac062c00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77cc15c7a0 0x7f77cc0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77cc15c3d0 0x7f77cc159330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 --2- 172.21.15.50:0/2099781786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77cc0cb2b0 0x7f77cc0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 >> 172.21.15.50:0/2099781786 conn(0x7f77cc0670b0 msgr2=0x7f77cc15e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 shutdown_connections 2023-12-24T18:48:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:37.522+0000 7f77d0b45700 1 -- 172.21.15.50:0/2099781786 wait complete. 2023-12-24T18:48:37.546 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-12-24T18:48:37.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.546 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-12-24T18:48:37.566 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_01_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:37.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:37.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.569 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_38_01_UTC) 2023-12-24T18:48:37.650 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:37.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.651 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:37.733 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:37.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.733 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:37.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_41_01_UTC 2023-12-24T18:48:37.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.807 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_41_01_UTC) 2023-12-24T18:48:37.888 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:37.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.888 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:37.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:37.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:37.964 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:38.037 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:38.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:38.110 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:38.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.110 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:38.189 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:38.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.190 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:38.266 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:38.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.267 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:38.344 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:38.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.344 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:38.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:38.419 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-12-24T18:48:38.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-12-24T18:48:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.714+0000 7f6eae6e3700 1 Processor -- start 2023-12-24T18:48:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.714+0000 7f6eae6e3700 1 -- start start 2023-12-24T18:48:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eae6e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6ea80c5d10 0x7f6ea81591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eae6e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 0x7f6ea80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eae6e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea815a480 con 0x7f6ea8158df0 2023-12-24T18:48:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eae6e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80cd210 con 0x7f6ea80c5d10 2023-12-24T18:48:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eae6e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8159870 con 0x7f6ea80cc830 2023-12-24T18:48:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eacee0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6ea80c5d10 0x7f6ea81591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6ead6e1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6ea8158df0 0x7f6ea806ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:58008/0 (socket says 172.21.15.50:58008) 2023-12-24T18:48:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6eadee2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 0x7f6ea80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.718+0000 7f6ead6e1700 1 -- 172.21.15.50:0/1262551246 learned_addr learned my addr 172.21.15.50:0/1262551246 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6e9ffff700 1 -- 172.21.15.50:0/1262551246 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751567178 0 0) 0x7f6ea815a480 con 0x7f6ea8158df0 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6e9ffff700 1 -- 172.21.15.50:0/1262551246 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e94003570 con 0x7f6ea8158df0 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eadee2700 1 -- 172.21.15.50:0/1262551246 >> v2:172.21.15.82:3300/0 conn(0x7f6ea80c5d10 msgr2=0x7f6ea81591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eadee2700 1 --2- 172.21.15.50:0/1262551246 >> v2:172.21.15.82:3300/0 conn(0x7f6ea80c5d10 0x7f6ea81591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eadee2700 1 -- 172.21.15.50:0/1262551246 >> v1:172.21.15.82:6789/0 conn(0x7f6ea8158df0 legacy=0x7f6ea806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eadee2700 1 -- 172.21.15.50:0/1262551246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8159b50 con 0x7f6ea80cc830 2023-12-24T18:48:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eadee2700 1 --2- 172.21.15.50:0/1262551246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 0x7f6ea80cccd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009e60 tx=0x7f6ea0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e3bf3d40b58b8f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6e9ffff700 1 -- 172.21.15.50:0/1262551246 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000e070 con 0x7f6ea80cc830 2023-12-24T18:48:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6e9ffff700 1 -- 172.21.15.50:0/1262551246 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea000bab0 con 0x7f6ea80cc830 2023-12-24T18:48:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6e9ffff700 1 -- 172.21.15.50:0/1262551246 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000be70 con 0x7f6ea80cc830 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1262551246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 msgr2=0x7f6ea80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1262551246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 0x7f6ea80cccd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009e60 tx=0x7f6ea0009780 comp rx=0 tx=0).stop 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1262551246 shutdown_connections 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1262551246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80cc830 0x7f6ea80cccd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1262551246 >> v2:172.21.15.82:3300/0 conn(0x7f6ea80c5d10 0x7f6ea81591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1262551246 >> 172.21.15.50:0/1262551246 conn(0x7f6ea80670b0 msgr2=0x7f6ea80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1262551246 shutdown_connections 2023-12-24T18:48:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.722+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1262551246 wait complete. 2023-12-24T18:48:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.726+0000 7f6eae6e3700 1 Processor -- start 2023-12-24T18:48:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.726+0000 7f6eae6e3700 1 -- start start 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.726+0000 7f6eae6e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80c5d10 0x7f6ea80c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.726+0000 7f6eae6e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea80cc830 0x7f6ea8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.726+0000 7f6eae6e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eae6e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8169420 con 0x7f6ea8158df0 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eae6e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81696e0 con 0x7f6ea80cc830 2023-12-24T18:48:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eae6e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80c8140 con 0x7f6ea80c5d10 2023-12-24T18:48:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41982/0 (socket says 172.21.15.50:41982) 2023-12-24T18:48:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 -- 172.21.15.50:0/1047840438 learned_addr learned my addr 172.21.15.50:0/1047840438 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6ead6e1700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80c5d10 0x7f6ea80c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eacee0700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea80cc830 0x7f6ea8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 -- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80c5d10 msgr2=0x7f6ea80c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80c5d10 0x7f6ea80c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 -- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea80cc830 msgr2=0x7f6ea8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea80cc830 0x7f6ea8152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 -- 172.21.15.50:0/1047840438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0009a20 con 0x7f6ea8158df0 2023-12-24T18:48:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eadee2700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ea81599b0 tx=0x7f6ea0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0012e10 con 0x7f6ea8158df0 2023-12-24T18:48:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0027470 con 0x7f6ea8158df0 2023-12-24T18:48:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0027830 con 0x7f6ea8158df0 2023-12-24T18:48:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea80c8420 con 0x7f6ea8158df0 2023-12-24T18:48:38.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.730+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea80c7e30 con 0x7f6ea8158df0 2023-12-24T18:48:38.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.734+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea80c8920 con 0x7f6ea8158df0 2023-12-24T18:48:38.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.734+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f6ea0024070 con 0x7f6ea8158df0 2023-12-24T18:48:38.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.738+0000 7f6e9d7fa700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 0x7f6e8c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:38.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.738+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6ea007f810 con 0x7f6ea8158df0 2023-12-24T18:48:38.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.738+0000 7f6ead6e1700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 0x7f6e8c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:38.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.738+0000 7f6ead6e1700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 0x7f6e8c062c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:38.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.746+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ea004f7c0 con 0x7f6ea8158df0 2023-12-24T18:48:38.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:38.946+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ea804be40 con 0x7f6e8c060780 2023-12-24T18:48:39.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.094+0000 7f6e9d7fa700 1 -- 172.21.15.50:0/1047840438 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f6ea804be40 con 0x7f6e8c060780 2023-12-24T18:48:39.097 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-12-24T18:48:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 msgr2=0x7f6e8c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 0x7f6e8c062c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4009040 comp rx=0 tx=0).stop 2023-12-24T18:48:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 msgr2=0x7f6ea8156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ea81599b0 tx=0x7f6ea0019000 comp rx=0 tx=0).stop 2023-12-24T18:48:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 shutdown_connections 2023-12-24T18:48:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e8c060780 0x7f6e8c062c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea8158df0 0x7f6ea8156a00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea80cc830 0x7f6ea8152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 --2- 172.21.15.50:0/1047840438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ea80c5d10 0x7f6ea80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 >> 172.21.15.50:0/1047840438 conn(0x7f6ea80670b0 msgr2=0x7f6ea8154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 shutdown_connections 2023-12-24T18:48:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:39.098+0000 7f6eae6e3700 1 -- 172.21.15.50:0/1047840438 wait complete. 2023-12-24T18:48:39.123 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-12-24T18:48:39.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.124 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-12-24T18:48:39.148 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:39.148 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_01_UTC 2023-12-24T18:48:39.148 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_01_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:39.149 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:39.150 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:39.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.150 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:39.228 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_39_01_UTC 2023-12-24T18:48:39.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.229 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_39_01_UTC) 2023-12-24T18:48:39.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:39.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.307 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:39.389 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:39.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.389 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:39.459 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:39.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.460 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:39.536 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:39.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.536 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:39.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:39.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.670 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:39.721 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_45_01_UTC 2023-12-24T18:48:39.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.721 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_45_01_UTC) 2023-12-24T18:48:39.771 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:39.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.772 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:39.851 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:39.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.851 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_47_01_UTC) 2023-12-24T18:48:39.928 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:39.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:39.929 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:40.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.002 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-12-24T18:48:40.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-12-24T18:48:40.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.294+0000 7f8389cf0700 1 Processor -- start 2023-12-24T18:48:40.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.294+0000 7f8389cf0700 1 -- start start 2023-12-24T18:48:40.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.294+0000 7f8389cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840691f0 0x7f83840695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8389cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8384155f70 0x7f83840c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8389cf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838406dc60 con 0x7f83840c8cf0 2023-12-24T18:48:40.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8389cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838406df40 con 0x7f8384155f70 2023-12-24T18:48:40.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8389cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838406e220 con 0x7f83840691f0 2023-12-24T18:48:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8384155f70 0x7f83840c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8384155f70 0x7f83840c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53354/0 (socket says 172.21.15.50:53354) 2023-12-24T18:48:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 -- 172.21.15.50:0/3024117385 learned_addr learned my addr 172.21.15.50:0/3024117385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f83837fe700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840691f0 0x7f83840695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 -- 172.21.15.50:0/3024117385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840691f0 msgr2=0x7f83840695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840691f0 0x7f83840695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 -- 172.21.15.50:0/3024117385 >> v1:172.21.15.82:6789/0 conn(0x7f83840c8cf0 legacy=0x7f8384155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 -- 172.21.15.50:0/3024117385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838406e500 con 0x7f8384155f70 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8382ffd700 1 -- 172.21.15.50:0/3024117385 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121690239 0 0) 0x7f838406dc60 con 0x7f83840c8cf0 2023-12-24T18:48:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8383fff700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f83840c9140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f837c0099b0 tx=0x7f837c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2480d6907b0aa003 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8382ffd700 1 -- 172.21.15.50:0/3024117385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c009ea0 con 0x7f8384155f70 2023-12-24T18:48:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8382ffd700 1 -- 172.21.15.50:0/3024117385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00b860 con 0x7f8384155f70 2023-12-24T18:48:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.298+0000 7f8382ffd700 1 -- 172.21.15.50:0/3024117385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00bc00 con 0x7f8384155f70 2023-12-24T18:48:40.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 -- 172.21.15.50:0/3024117385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 msgr2=0x7f83840c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f83840c9140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f837c0099b0 tx=0x7f837c009250 comp rx=0 tx=0).stop 2023-12-24T18:48:40.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 -- 172.21.15.50:0/3024117385 shutdown_connections 2023-12-24T18:48:40.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f83840c9140 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3024117385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840691f0 0x7f83840695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 -- 172.21.15.50:0/3024117385 >> 172.21.15.50:0/3024117385 conn(0x7f83840ccd60 msgr2=0x7f83840cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:40.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 -- 172.21.15.50:0/3024117385 shutdown_connections 2023-12-24T18:48:40.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.302+0000 7f8389cf0700 1 -- 172.21.15.50:0/3024117385 wait complete. 2023-12-24T18:48:40.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 Processor -- start 2023-12-24T18:48:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 -- start start 2023-12-24T18:48:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83840691f0 0x7f83840c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840c8cf0 0x7f8384147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841456d0 con 0x7f8384155f70 2023-12-24T18:48:40.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841459a0 con 0x7f83840691f0 2023-12-24T18:48:40.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8389cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384145c80 con 0x7f83840c8cf0 2023-12-24T18:48:40.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8383fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8383fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53370/0 (socket says 172.21.15.50:53370) 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f8383fff700 1 -- 172.21.15.50:0/3826193909 learned_addr learned my addr 172.21.15.50:0/3826193909 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.306+0000 7f83837fe700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83840691f0 0x7f83840c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f837affd700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840c8cf0 0x7f8384147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 -- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840c8cf0 msgr2=0x7f8384147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840c8cf0 0x7f8384147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 -- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83840691f0 msgr2=0x7f83840c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83840691f0 0x7f83840c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 -- 172.21.15.50:0/3826193909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0094f0 con 0x7f8384155f70 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8383fff700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f837c006fd0 tx=0x7f837c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011420 con 0x7f8384155f70 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c011580 con 0x7f8384155f70 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8384145f60 con 0x7f8384155f70 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011940 con 0x7f8384155f70 2023-12-24T18:48:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.310+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8384146520 con 0x7f8384155f70 2023-12-24T18:48:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.314+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8384146710 con 0x7f8384155f70 2023-12-24T18:48:40.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.314+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f837c02e440 con 0x7f8384155f70 2023-12-24T18:48:40.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.314+0000 7f837bfff700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 0x7f8364062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:40.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.314+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7168+0+0 (secure 0 0 0) 0x7f837c07ea50 con 0x7f8384155f70 2023-12-24T18:48:40.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.318+0000 7f83837fe700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 0x7f8364062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:40.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.318+0000 7f83837fe700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 0x7f8364062c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8374009db0 tx=0x7f83740091a0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:40.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.322+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f837c04e850 con 0x7f8384155f70 2023-12-24T18:48:40.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.518+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8384071060 con 0x7f8364060750 2023-12-24T18:48:40.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.678+0000 7f837bfff700 1 -- 172.21.15.50:0/3826193909 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8384071060 con 0x7f8364060750 2023-12-24T18:48:40.682 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-12-24T18:48:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.682+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 msgr2=0x7f8364062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.682+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 0x7f8364062c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8374009db0 tx=0x7f83740091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.682+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 msgr2=0x7f8384145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.682+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f837c006fd0 tx=0x7f837c017000 comp rx=0 tx=0).stop 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 shutdown_connections 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8364060750 0x7f8364062c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8384155f70 0x7f8384145190 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83840c8cf0 0x7f8384147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 --2- 172.21.15.50:0/3826193909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83840691f0 0x7f83840c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 >> 172.21.15.50:0/3826193909 conn(0x7f83840ccd60 msgr2=0x7f83840b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 shutdown_connections 2023-12-24T18:48:40.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:40.686+0000 7f8389cf0700 1 -- 172.21.15.50:0/3826193909 wait complete. 2023-12-24T18:48:40.712 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-12-24T18:48:40.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.713 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-12-24T18:48:40.739 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:40.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:40.742 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_38_01_UTC 2023-12-24T18:48:40.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.742 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_38_01_UTC) 2023-12-24T18:48:40.812 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:40.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.812 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:40.887 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:40.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.888 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:40.965 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:40.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:40.966 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:41.046 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:41.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.046 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:41.128 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:41.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.129 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:41.204 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_44_01_UTC 2023-12-24T18:48:41.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.205 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_44_01_UTC) 2023-12-24T18:48:41.280 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:41.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.281 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:41.362 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:41.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.363 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_46_01_UTC) 2023-12-24T18:48:41.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:41.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.440 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:41.518 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:41.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.518 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:41.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:41.606 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-12-24T18:48:41.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-12-24T18:48:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.882+0000 7f3f5a86e700 1 Processor -- start 2023-12-24T18:48:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f5a86e700 1 -- start start 2023-12-24T18:48:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f5a86e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f540ccf80 0x7f3f5415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f5a86e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5406b6b0 con 0x7f3f5415c3d0 2023-12-24T18:48:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f5a86e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540cba20 con 0x7f3f5415c7a0 2023-12-24T18:48:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f5a86e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5406c250 con 0x7f3f540ccf80 2023-12-24T18:48:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f58e0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f540ccf80 0x7f3f5415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f53fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f5415c3d0 0x7f3f5406bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40528/0 (socket says 172.21.15.50:40528) 2023-12-24T18:48:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f537fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3f5415c7a0 0x7f3f540cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42944/0 (socket says 172.21.15.50:42944) 2023-12-24T18:48:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.886+0000 7f3f53fff700 1 -- 172.21.15.50:0/3992850714 learned_addr learned my addr 172.21.15.50:0/3992850714 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592822298 0 0) 0x7f3f540cba20 con 0x7f3f5415c7a0 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c003570 con 0x7f3f5415c7a0 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643473120 0 0) 0x7f3f5406b6b0 con 0x7f3f5415c3d0 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f540cba20 con 0x7f3f5415c3d0 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f58e0b700 1 -- 172.21.15.50:0/3992850714 >> v1:172.21.15.82:6789/0 conn(0x7f3f5415c7a0 legacy=0x7f3f540cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f58e0b700 1 -- 172.21.15.50:0/3992850714 >> v1:172.21.15.50:6789/0 conn(0x7f3f5415c3d0 legacy=0x7f3f5406bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f58e0b700 1 -- 172.21.15.50:0/3992850714 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5406ad80 con 0x7f3f540ccf80 2023-12-24T18:48:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f58e0b700 1 --2- 172.21.15.50:0/3992850714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415d810 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009e60 tx=0x7f3f4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4f25c44553ce server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00e070 con 0x7f3f540ccf80 2023-12-24T18:48:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00bab0 con 0x7f3f540ccf80 2023-12-24T18:48:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f52ffd700 1 -- 172.21.15.50:0/3992850714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00be70 con 0x7f3f540ccf80 2023-12-24T18:48:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 -- 172.21.15.50:0/3992850714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 msgr2=0x7f3f5415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/3992850714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415d810 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009e60 tx=0x7f3f4c009780 comp rx=0 tx=0).stop 2023-12-24T18:48:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 -- 172.21.15.50:0/3992850714 shutdown_connections 2023-12-24T18:48:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/3992850714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415d810 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 -- 172.21.15.50:0/3992850714 >> 172.21.15.50:0/3992850714 conn(0x7f3f540670b0 msgr2=0x7f3f540674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 -- 172.21.15.50:0/3992850714 shutdown_connections 2023-12-24T18:48:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.890+0000 7f3f5a86e700 1 -- 172.21.15.50:0/3992850714 wait complete. 2023-12-24T18:48:41.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 Processor -- start 2023-12-24T18:48:41.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 -- start start 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5415c3d0 0x7f3f540b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 0x7f3f540c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b3c00 con 0x7f3f540ccf80 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b2ff0 con 0x7f3f5415c3d0 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f5a86e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b32d0 con 0x7f3f5415c7a0 2023-12-24T18:48:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53390/0 (socket says 172.21.15.50:53390) 2023-12-24T18:48:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 -- 172.21.15.50:0/1540664531 learned_addr learned my addr 172.21.15.50:0/1540664531 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f537fe700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5415c3d0 0x7f3f540b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f58e0b700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 0x7f3f540c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 -- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 msgr2=0x7f3f540c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 0x7f3f540c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 -- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5415c3d0 msgr2=0x7f3f540b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5415c3d0 0x7f3f540b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f53fff700 1 -- 172.21.15.50:0/1540664531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009a20 con 0x7f3f540ccf80 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.894+0000 7f3f58e0b700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 0x7f3f540c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f53fff700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3f440011e0 tx=0x7f3f44007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44005b30 con 0x7f3f540ccf80 2023-12-24T18:48:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44005c90 con 0x7f3f540ccf80 2023-12-24T18:48:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540b35b0 con 0x7f3f540ccf80 2023-12-24T18:48:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007320 con 0x7f3f540ccf80 2023-12-24T18:48:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5415a890 con 0x7f3f540ccf80 2023-12-24T18:48:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5406c040 con 0x7f3f540ccf80 2023-12-24T18:48:41.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.898+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f3f44007690 con 0x7f3f540ccf80 2023-12-24T18:48:41.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.902+0000 7f3f3bfff700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 0x7f3f40062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:41.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.902+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6912+0+0 (secure 0 0 0) 0x7f3f4407c500 con 0x7f3f540ccf80 2023-12-24T18:48:41.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.902+0000 7f3f537fe700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 0x7f3f40062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:41.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.902+0000 7f3f537fe700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 0x7f3f40062c00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f540a9710 tx=0x7f3f48007d40 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:41.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:41.906+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f5406c040 con 0x7f3f540ccf80 2023-12-24T18:48:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.106+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f540b3a30 con 0x7f3f40060750 2023-12-24T18:48:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.246+0000 7f3f3bfff700 1 -- 172.21.15.50:0/1540664531 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3f48004c00 con 0x7f3f40060750 2023-12-24T18:48:42.249 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-12-24T18:48:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 msgr2=0x7f3f40062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 0x7f3f40062c00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f540a9710 tx=0x7f3f48007d40 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 msgr2=0x7f3f5415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3f440011e0 tx=0x7f3f44007df0 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 shutdown_connections 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3f40060750 0x7f3f40062c00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f5415c7a0 0x7f3f540c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5415c3d0 0x7f3f540b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 --2- 172.21.15.50:0/1540664531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f540ccf80 0x7f3f5415a350 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:42.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.250+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 >> 172.21.15.50:0/1540664531 conn(0x7f3f540670b0 msgr2=0x7f3f54067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:42.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.254+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 shutdown_connections 2023-12-24T18:48:42.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:42.254+0000 7f3f5a86e700 1 -- 172.21.15.50:0/1540664531 wait complete. 2023-12-24T18:48:42.276 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-12-24T18:48:42.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.276 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_01_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:42.297 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:42.298 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:42.298 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:42.299 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:42.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.299 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:42.379 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:42.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.379 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:42.458 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:42.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.459 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:42.539 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:42.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.540 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:42.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_42_01_UTC 2023-12-24T18:48:42.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.610 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_42_01_UTC) 2023-12-24T18:48:42.689 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:42.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.690 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:42.754 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:42.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.755 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:42.825 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:42.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.826 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:42.900 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:42.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.900 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:42.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_47_01_UTC 2023-12-24T18:48:42.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:42.981 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_47_01_UTC) 2023-12-24T18:48:43.058 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:43.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:43.058 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:43.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:43.135 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-12-24T18:48:43.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-12-24T18:48:43.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.430+0000 7fec8e2f0700 1 Processor -- start 2023-12-24T18:48:43.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.430+0000 7fec8e2f0700 1 -- start start 2023-12-24T18:48:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8e2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8e2f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec8806db90 0x7fec8806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8e2f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8806d4d0 con 0x7fec88156b50 2023-12-24T18:48:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8e2f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880b4960 con 0x7fec8806db90 2023-12-24T18:48:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8e2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8815a620 con 0x7fec880b4230 2023-12-24T18:48:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec877fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec877fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:45878/0 (socket says 172.21.15.50:45878) 2023-12-24T18:48:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec877fe700 1 -- 172.21.15.50:0/3075728484 learned_addr learned my addr 172.21.15.50:0/3075728484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3075728484 >> v2:172.21.15.82:3300/0 conn(0x7fec8806db90 0x7fec8806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8c88d700 1 -- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 msgr2=0x7fec8815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8c88d700 1 -- 172.21.15.50:0/3075728484 >> v1:172.21.15.82:6789/0 conn(0x7fec88156b50 legacy=0x7fec880b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec8c88d700 1 -- 172.21.15.50:0/3075728484 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8806c8c0 con 0x7fec8806db90 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.434+0000 7fec877fe700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8806db90 0x7fec8806a730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec80009e60 tx=0x7fec80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f55014c4e3ca9db6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec86ffd700 1 -- 172.21.15.50:0/3075728484 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000e070 con 0x7fec8806db90 2023-12-24T18:48:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec86ffd700 1 -- 172.21.15.50:0/3075728484 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000bb60 con 0x7fec8806db90 2023-12-24T18:48:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec86ffd700 1 -- 172.21.15.50:0/3075728484 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80012430 con 0x7fec8806db90 2023-12-24T18:48:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8806db90 msgr2=0x7fec8806a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8806db90 0x7fec8806a730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec80009e60 tx=0x7fec80009780 comp rx=0 tx=0).stop 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3075728484 shutdown_connections 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8806db90 0x7fec8806a730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3075728484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec880b4230 0x7fec8815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3075728484 >> 172.21.15.50:0/3075728484 conn(0x7fec88067b40 msgr2=0x7fec880b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3075728484 shutdown_connections 2023-12-24T18:48:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.438+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3075728484 wait complete. 2023-12-24T18:48:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 Processor -- start 2023-12-24T18:48:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 -- start start 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec8806db90 0x7fec8808a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 0x7fec880aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 0x7fec88157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88087cd0 con 0x7fec88156b50 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88087090 con 0x7fec880b4230 2023-12-24T18:48:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8e2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec88087330 con 0x7fec8806db90 2023-12-24T18:48:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec877fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 0x7fec880aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 0x7fec88157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec877fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 0x7fec880aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:53308/0 (socket says 172.21.15.50:53308) 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec87fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec8806db90 0x7fec8808a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec877fe700 1 -- 172.21.15.50:0/3968600998 learned_addr learned my addr 172.21.15.50:0/3968600998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 -- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec8806db90 msgr2=0x7fec8808a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec8806db90 0x7fec8808a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 -- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 msgr2=0x7fec880aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 0x7fec880aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.442+0000 7fec8c88d700 1 -- 172.21.15.50:0/3968600998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0094f0 con 0x7fec88156b50 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec8c88d700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 0x7fec88157f30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fec80016000 tx=0x7fec80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80012ea0 con 0x7fec88156b50 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80027470 con 0x7fec88156b50 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80027850 con 0x7fec88156b50 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80009a20 con 0x7fec88156b50 2023-12-24T18:48:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880878f0 con 0x7fec88156b50 2023-12-24T18:48:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.446+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec88087e10 con 0x7fec88156b50 2023-12-24T18:48:43.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.450+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fec80024070 con 0x7fec88156b50 2023-12-24T18:48:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.450+0000 7fec6ffff700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 0x7fec74062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.450+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6944+0+0 (secure 0 0 0) 0x7fec8007f710 con 0x7fec88156b50 2023-12-24T18:48:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.450+0000 7fec87fff700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 0x7fec74062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.450+0000 7fec87fff700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 0x7fec74062c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec780039e0 tx=0x7fec78007ec0 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.458+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fec88087e10 con 0x7fec88156b50 2023-12-24T18:48:43.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.670+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fec88087e10 con 0x7fec74060750 2023-12-24T18:48:43.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.834+0000 7fec6ffff700 1 -- 172.21.15.50:0/3968600998 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fec88087e10 con 0x7fec74060750 2023-12-24T18:48:43.835 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-12-24T18:48:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 msgr2=0x7fec74062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 0x7fec74062c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec780039e0 tx=0x7fec78007ec0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 msgr2=0x7fec88157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 0x7fec88157f30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fec80016000 tx=0x7fec80019000 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 shutdown_connections 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fec74060750 0x7fec74062c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88156b50 0x7fec88157f30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880b4230 0x7fec880aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 --2- 172.21.15.50:0/3968600998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec8806db90 0x7fec8808a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 >> 172.21.15.50:0/3968600998 conn(0x7fec88067b40 msgr2=0x7fec881545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 shutdown_connections 2023-12-24T18:48:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:43.838+0000 7fec8e2f0700 1 -- 172.21.15.50:0/3968600998 wait complete. 2023-12-24T18:48:43.865 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-12-24T18:48:43.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:43.865 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-12-24T18:48:43.882 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:43.882 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:43.882 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:43.883 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:43.884 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:43.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:43.884 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:43.960 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:43.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:43.960 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:44.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:44.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.038 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:44.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:44.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.125 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:44.205 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:44.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.205 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:44.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:44.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.282 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:44.362 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:44.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.362 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:44.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:44.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.440 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:44.520 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:44.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.520 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_46_01_UTC) 2023-12-24T18:48:44.620 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:44.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.620 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:44.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:44.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.647 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:44.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:44.729 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-12-24T18:48:44.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-12-24T18:48:45.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.026+0000 7f1615a16700 1 Processor -- start 2023-12-24T18:48:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 -- start start 2023-12-24T18:48:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 0x7f161006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f161006a6a0 0x7f16100c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161006deb0 con 0x7f16100c7120 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161006b770 con 0x7f161006a6a0 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f1615a16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1610157500 con 0x7f16100aac10 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f160ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f161006a6a0 0x7f16100c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f160ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f161006a6a0 0x7f16100c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53410/0 (socket says 172.21.15.50:53410) 2023-12-24T18:48:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.030+0000 7f160ffff700 1 -- 172.21.15.50:0/1202200200 learned_addr learned my addr 172.21.15.50:0/1202200200 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160ffff700 1 -- 172.21.15.50:0/1202200200 >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 msgr2=0x7f161006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1614a14700 1 --2- 172.21.15.50:0/1202200200 >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 0x7f161006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160ffff700 1 --2- 172.21.15.50:0/1202200200 >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 0x7f161006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160ffff700 1 -- 172.21.15.50:0/1202200200 >> v1:172.21.15.50:6789/0 conn(0x7f16100c7120 legacy=0x7f161015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160ffff700 1 -- 172.21.15.50:0/1202200200 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100c7550 con 0x7f161006a6a0 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1614a14700 1 --2- 172.21.15.50:0/1202200200 >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 0x7f161006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160ffff700 1 --2- 172.21.15.50:0/1202200200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161006a6a0 0x7f16100c6be0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1610069770 tx=0x7f15fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7deb4b6dcd9ee134 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160f7fe700 1 -- 172.21.15.50:0/1202200200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00b8f0 con 0x7f161006a6a0 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160f7fe700 1 -- 172.21.15.50:0/1202200200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc00ba50 con 0x7f161006a6a0 2023-12-24T18:48:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f160f7fe700 1 -- 172.21.15.50:0/1202200200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00bdf0 con 0x7f161006a6a0 2023-12-24T18:48:45.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 -- 172.21.15.50:0/1202200200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161006a6a0 msgr2=0x7f16100c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 --2- 172.21.15.50:0/1202200200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161006a6a0 0x7f16100c6be0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1610069770 tx=0x7f15fc009250 comp rx=0 tx=0).stop 2023-12-24T18:48:45.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 -- 172.21.15.50:0/1202200200 shutdown_connections 2023-12-24T18:48:45.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 --2- 172.21.15.50:0/1202200200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161006a6a0 0x7f16100c6be0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 --2- 172.21.15.50:0/1202200200 >> v2:172.21.15.82:3300/0 conn(0x7f16100aac10 0x7f161006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 -- 172.21.15.50:0/1202200200 >> 172.21.15.50:0/1202200200 conn(0x7f1610067b40 msgr2=0x7f16100cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:45.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 -- 172.21.15.50:0/1202200200 shutdown_connections 2023-12-24T18:48:45.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.034+0000 7f1615a16700 1 -- 172.21.15.50:0/1202200200 wait complete. 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.038+0000 7f1615a16700 1 Processor -- start 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.038+0000 7f1615a16700 1 -- start start 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f161006a6a0 0x7f161014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16100aac10 0x7f161014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161015a520 con 0x7f16100c7120 2023-12-24T18:48:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100c9900 con 0x7f16100aac10 2023-12-24T18:48:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100c9be0 con 0x7f161006a6a0 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53422/0 (socket says 172.21.15.50:53422) 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 -- 172.21.15.50:0/423306442 learned_addr learned my addr 172.21.15.50:0/423306442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f160ffff700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16100aac10 0x7f161014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1614a14700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f161006a6a0 0x7f161014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 -- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f161006a6a0 msgr2=0x7f161014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f161006a6a0 0x7f161014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 -- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16100aac10 msgr2=0x7f161014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16100aac10 0x7f161014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 -- 172.21.15.50:0/423306442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0094f0 con 0x7f16100c7120 2023-12-24T18:48:45.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615215700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f160800c4c0 tx=0x7f1608007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:45.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011590 con 0x7f16100c7120 2023-12-24T18:48:45.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608011710 con 0x7f16100c7120 2023-12-24T18:48:45.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100c9ec0 con 0x7f16100c7120 2023-12-24T18:48:45.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011ad0 con 0x7f16100c7120 2023-12-24T18:48:45.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.042+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16100ca6c0 con 0x7f16100c7120 2023-12-24T18:48:45.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.046+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161004be40 con 0x7f16100c7120 2023-12-24T18:48:45.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.046+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f160801b3b0 con 0x7f16100c7120 2023-12-24T18:48:45.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.046+0000 7f160cff9700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 0x7f15f4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:45.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.046+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6912+0+0 (secure 0 0 0) 0x7f160807c440 con 0x7f16100c7120 2023-12-24T18:48:45.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.046+0000 7f1614a14700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 0x7f15f4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:45.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.050+0000 7f1614a14700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 0x7f15f4062c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f160400e650 tx=0x7f1604007710 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.054+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f160804c280 con 0x7f16100c7120 2023-12-24T18:48:45.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.250+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f16100cc760 con 0x7f15f4060750 2023-12-24T18:48:45.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.382+0000 7f160cff9700 1 -- 172.21.15.50:0/423306442 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f16100cc760 con 0x7f15f4060750 2023-12-24T18:48:45.386 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 msgr2=0x7f15f4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 0x7f15f4062c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f160400e650 tx=0x7f1604007710 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 msgr2=0x7f161014e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f160800c4c0 tx=0x7f1608007f50 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 shutdown_connections 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15f4060750 0x7f15f4062c00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16100c7120 0x7f161014e9b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16100aac10 0x7f161014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 --2- 172.21.15.50:0/423306442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f161006a6a0 0x7f161014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.386+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 >> 172.21.15.50:0/423306442 conn(0x7f1610067b40 msgr2=0x7f16100acd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.390+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 shutdown_connections 2023-12-24T18:48:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:45.390+0000 7f1615a16700 1 -- 172.21.15.50:0/423306442 wait complete. 2023-12-24T18:48:45.412 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-12-24T18:48:45.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.413 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-12-24T18:48:45.434 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:45.435 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:45.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:45.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.436 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:45.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:45.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.521 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:45.601 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_40_00_UTC 2023-12-24T18:48:45.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.601 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_40_00_UTC) 2023-12-24T18:48:45.683 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:45.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.683 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:45.770 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:45.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.770 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:45.850 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:45.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.850 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:45.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:45.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:45.930 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:46.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:46.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:46.009 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:46.087 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_46_00_UTC 2023-12-24T18:48:46.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:46.088 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_46_00_UTC) 2023-12-24T18:48:46.166 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:46.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:46.167 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:46.245 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_48_00_UTC 2023-12-24T18:48:46.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:46.246 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-12-24-18_48_00_UTC) 2023-12-24T18:48:46.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:46.328 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-12-24T18:48:46.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-12-24T18:48:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.630+0000 7fbace6cd700 1 Processor -- start 2023-12-24T18:48:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.630+0000 7fbace6cd700 1 -- start start 2023-12-24T18:48:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbace6cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 0x7fbac806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbace6cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac806db40 con 0x7fbac8140940 2023-12-24T18:48:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbace6cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac806ccc0 con 0x7fbac806c820 2023-12-24T18:48:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbace6cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8140d10 con 0x7fbac80696d0 2023-12-24T18:48:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbac7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbac8140940 0x7fbac8068fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40550/0 (socket says 172.21.15.50:40550) 2023-12-24T18:48:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbac7fff700 1 -- 172.21.15.50:0/2688700738 learned_addr learned my addr 172.21.15.50:0/2688700738 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.634+0000 7fbabf7fe700 1 --2- 172.21.15.50:0/2688700738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 0x7fbac806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbac77fe700 1 -- 172.21.15.50:0/2688700738 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511533679 0 0) 0x7fbac806db40 con 0x7fbac8140940 2023-12-24T18:48:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbac77fe700 1 -- 172.21.15.50:0/2688700738 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab4003570 con 0x7fbac8140940 2023-12-24T18:48:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbabf7fe700 1 -- 172.21.15.50:0/2688700738 >> v1:172.21.15.82:6789/0 conn(0x7fbac806c820 legacy=0x7fbac80acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbabf7fe700 1 -- 172.21.15.50:0/2688700738 >> v1:172.21.15.50:6789/0 conn(0x7fbac8140940 legacy=0x7fbac8068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbabf7fe700 1 -- 172.21.15.50:0/2688700738 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac806cf30 con 0x7fbac80696d0 2023-12-24T18:48:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbabf7fe700 1 --2- 172.21.15.50:0/2688700738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 0x7fbac806dfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009910 tx=0x7fbab00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f05be3e0002f476f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbac77fe700 1 -- 172.21.15.50:0/2688700738 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000b680 con 0x7fbac80696d0 2023-12-24T18:48:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbac77fe700 1 -- 172.21.15.50:0/2688700738 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab000b7e0 con 0x7fbac80696d0 2023-12-24T18:48:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbac77fe700 1 -- 172.21.15.50:0/2688700738 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000bba0 con 0x7fbac80696d0 2023-12-24T18:48:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 -- 172.21.15.50:0/2688700738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 msgr2=0x7fbac806dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 --2- 172.21.15.50:0/2688700738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 0x7fbac806dfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009910 tx=0x7fbab00091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 -- 172.21.15.50:0/2688700738 shutdown_connections 2023-12-24T18:48:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 --2- 172.21.15.50:0/2688700738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac80696d0 0x7fbac806dfd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 -- 172.21.15.50:0/2688700738 >> 172.21.15.50:0/2688700738 conn(0x7fbac80ccd60 msgr2=0x7fbac80cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 -- 172.21.15.50:0/2688700738 shutdown_connections 2023-12-24T18:48:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.638+0000 7fbace6cd700 1 -- 172.21.15.50:0/2688700738 wait complete. 2023-12-24T18:48:46.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 Processor -- start 2023-12-24T18:48:46.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 -- start start 2023-12-24T18:48:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac80696d0 0x7fbac816d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 0x7fbac816ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac816dd80 con 0x7fbac8140940 2023-12-24T18:48:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac816b340 con 0x7fbac80696d0 2023-12-24T18:48:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbace6cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac816e820 con 0x7fbac806c820 2023-12-24T18:48:46.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbaccc6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:46.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbac7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac80696d0 0x7fbac816d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:46.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 0x7fbac816ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:46.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.642+0000 7fbaccc6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53432/0 (socket says 172.21.15.50:53432) 2023-12-24T18:48:46.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbaccc6a700 1 -- 172.21.15.50:0/1908858885 learned_addr learned my addr 172.21.15.50:0/1908858885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 -- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac80696d0 msgr2=0x7fbac816d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac80696d0 0x7fbac816d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 -- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 msgr2=0x7fbac80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 -- 172.21.15.50:0/1908858885 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab0009420 con 0x7fbac806c820 2023-12-24T18:48:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbaccc6a700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbabf7fe700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 0x7fbac816ae00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbab0016000 tx=0x7fbab0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000bb60 con 0x7fbac806c820 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab0000c90 con 0x7fbac806c820 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80caaf0 con 0x7fbac806c820 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab001a660 con 0x7fbac806c820 2023-12-24T18:48:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac816df80 con 0x7fbac806c820 2023-12-24T18:48:46.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.646+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac8071060 con 0x7fbac806c820 2023-12-24T18:48:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.650+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7fbab001a9d0 con 0x7fbac806c820 2023-12-24T18:48:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.650+0000 7fbac4ff9700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 0x7fbaa8062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.650+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6960+0+0 (secure 0 0 0) 0x7fbab007ef30 con 0x7fbac806c820 2023-12-24T18:48:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.650+0000 7fbac7fff700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 0x7fbaa8062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:46.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.654+0000 7fbac7fff700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 0x7fbaa8062c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007fd0 tx=0x7fbab8009040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.662+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbab00a8be0 con 0x7fbac806c820 2023-12-24T18:48:46.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:46.894+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbac806d210 con 0x7fbaa8060750 2023-12-24T18:48:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.026+0000 7fbac4ff9700 1 -- 172.21.15.50:0/1908858885 <== mgr.5250 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fbac806d210 con 0x7fbaa8060750 2023-12-24T18:48:47.029 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-12-24T18:48:47.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 msgr2=0x7fbaa8062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:47.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 0x7fbaa8062c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007fd0 tx=0x7fbab8009040 comp rx=0 tx=0).stop 2023-12-24T18:48:47.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 msgr2=0x7fbac816ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:47.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 0x7fbac816ae00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbab0016000 tx=0x7fbab0017000 comp rx=0 tx=0).stop 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 shutdown_connections 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbaa8060750 0x7fbaa8062c00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac8140940 0x7fbac80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbac806c820 0x7fbac816ae00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 --2- 172.21.15.50:0/1908858885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac80696d0 0x7fbac816d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 >> 172.21.15.50:0/1908858885 conn(0x7fbac80ccd60 msgr2=0x7fbac80ad560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:47.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 shutdown_connections 2023-12-24T18:48:47.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:47.030+0000 7fbace6cd700 1 -- 172.21.15.50:0/1908858885 wait complete. 2023-12-24T18:48:47.056 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-12-24T18:48:47.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.056 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-12-24T18:48:47.074 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_40_01_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:47.075 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:47.076 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_38_00_UTC 2023-12-24T18:48:47.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.076 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_38_00_UTC) 2023-12-24T18:48:47.162 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_39_00_UTC 2023-12-24T18:48:47.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.162 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_39_00_UTC) 2023-12-24T18:48:47.240 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_40_01_UTC 2023-12-24T18:48:47.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.240 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_40_01_UTC) 2023-12-24T18:48:47.317 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_41_00_UTC 2023-12-24T18:48:47.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.318 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_41_00_UTC) 2023-12-24T18:48:47.402 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_42_00_UTC 2023-12-24T18:48:47.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.402 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_42_00_UTC) 2023-12-24T18:48:47.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_43_00_UTC 2023-12-24T18:48:47.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.480 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_43_00_UTC) 2023-12-24T18:48:47.558 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_44_00_UTC 2023-12-24T18:48:47.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.558 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_44_00_UTC) 2023-12-24T18:48:47.625 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_45_00_UTC 2023-12-24T18:48:47.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.625 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_45_00_UTC) 2023-12-24T18:48:47.703 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_46_01_UTC 2023-12-24T18:48:47.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.704 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_46_01_UTC) 2023-12-24T18:48:47.776 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_47_00_UTC 2023-12-24T18:48:47.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.776 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_47_00_UTC) 2023-12-24T18:48:47.845 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_48_01_UTC 2023-12-24T18:48:47.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.846 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-12-24-18_48_01_UTC) 2023-12-24T18:48:47.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:47.919 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-12-24T18:48:47.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:48:48.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.226+0000 7f3f2222e700 1 Processor -- start 2023-12-24T18:48:48.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.226+0000 7f3f2222e700 1 -- start start 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f1c1404a0 0x7f3f1c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 0x7f3f1c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c15b990 con 0x7f3f1c1404a0 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c06ccc0 con 0x7f3f1c15af50 2023-12-24T18:48:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f2222e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c15b3d0 con 0x7f3f1c140870 2023-12-24T18:48:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f1c1404a0 0x7f3f1c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f1c1404a0 0x7f3f1c15aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53442/0 (socket says 172.21.15.50:53442) 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2640969789 learned_addr learned my addr 172.21.15.50:0/2640969789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1bfff700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f13fff700 1 --2- 172.21.15.50:0/2640969789 >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 0x7f3f1c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2640969789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 msgr2=0x7f3f1c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2640969789 >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 msgr2=0x7f3f1c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2640969789 >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 0x7f3f1c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2640969789 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c15b6b0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.230+0000 7f3f13fff700 1 --2- 172.21.15.50:0/2640969789 >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 0x7f3f1c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c15aa10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c068bd0 tx=0x7f3f0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b75f5e9cd04b56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f1affd700 1 -- 172.21.15.50:0/2640969789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00b860 con 0x7f3f1c1404a0 2023-12-24T18:48:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f1affd700 1 -- 172.21.15.50:0/2640969789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00b9c0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f1affd700 1 -- 172.21.15.50:0/2640969789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00bd60 con 0x7f3f1c1404a0 2023-12-24T18:48:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 -- 172.21.15.50:0/2640969789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 msgr2=0x7f3f1c15aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c15aa10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c068bd0 tx=0x7f3f0c009250 comp rx=0 tx=0).stop 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 -- 172.21.15.50:0/2640969789 shutdown_connections 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2640969789 >> v2:172.21.15.82:3300/0 conn(0x7f3f1c15af50 0x7f3f1c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2640969789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c15aa10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 -- 172.21.15.50:0/2640969789 >> 172.21.15.50:0/2640969789 conn(0x7f3f1c067b80 msgr2=0x7f3f1c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 -- 172.21.15.50:0/2640969789 shutdown_connections 2023-12-24T18:48:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.234+0000 7f3f2222e700 1 -- 172.21.15.50:0/2640969789 wait complete. 2023-12-24T18:48:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.238+0000 7f3f2222e700 1 Processor -- start 2023-12-24T18:48:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.238+0000 7f3f2222e700 1 -- start start 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c13e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c13f160 0x7f3f1c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c13fb20 con 0x7f3f1c1404a0 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0aaed0 con 0x7f3f1c13f160 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0ad9c0 con 0x7f3f1c140870 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53456/0 (socket says 172.21.15.50:53456) 2023-12-24T18:48:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2223626258 learned_addr learned my addr 172.21.15.50:0/2223626258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1bfff700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c13f160 0x7f3f1c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f13fff700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c13e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 msgr2=0x7f3f1c13e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c13e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c13f160 msgr2=0x7f3f1c13f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c13f160 0x7f3f1c13f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 -- 172.21.15.50:0/2223626258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0094f0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f1b7fe700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009290 tx=0x7f3f0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c01a450 con 0x7f3f1c1404a0 2023-12-24T18:48:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c01a5b0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c0adca0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c01a970 con 0x7f3f1c1404a0 2023-12-24T18:48:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.242+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c0aab60 con 0x7f3f1c1404a0 2023-12-24T18:48:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.246+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0652e0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.246+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 80149+0+0 (secure 0 0 0) 0x7f3f0c01ace0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.250+0000 7f3f137fe700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 0x7f3efc062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:48.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.250+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f3f0c07e880 con 0x7f3f1c1404a0 2023-12-24T18:48:48.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.250+0000 7f3f13fff700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 0x7f3efc062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:48.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.250+0000 7f3f13fff700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 0x7f3efc062c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006f00 tx=0x7f3f04008040 comp rx=0 tx=0).ready entity=mgr.5250 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.254+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f0c04e610 con 0x7f3f1c1404a0 2023-12-24T18:48:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.478+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f3f1c06c950 con 0x7f3f1c1404a0 2023-12-24T18:48:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.610+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f3f0c04e9e0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.610+0000 7f3f137fe700 1 -- 172.21.15.50:0/2223626258 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3f0c04b1c0 con 0x7f3f1c1404a0 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 msgr2=0x7f3efc062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 0x7f3efc062c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006f00 tx=0x7f3f04008040 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 msgr2=0x7f3f1c16a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009290 tx=0x7f3f0c017000 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 shutdown_connections 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3efc0607d0 0x7f3efc062c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c13f160 0x7f3f1c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f1c140870 0x7f3f1c13e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 --2- 172.21.15.50:0/2223626258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f1c1404a0 0x7f3f1c16a890 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 >> 172.21.15.50:0/2223626258 conn(0x7f3f1c067b80 msgr2=0x7f3f1c0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 shutdown_connections 2023-12-24T18:48:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.614+0000 7f3f2222e700 1 -- 172.21.15.50:0/2223626258 wait complete. 2023-12-24T18:48:48.635 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:48:48.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:48:48.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:48:48.714 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:48:48.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:48:48.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:48:48.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:48:48.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:48:48.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:48:48.778 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:48:48.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:48:48.815 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:48.810+0000 7faf74143000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:48:48.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:48.834+0000 7fca66bcc000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:48:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 Processor -- start 2023-12-24T18:48:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 -- start start 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a0406b540 0x7f7a040ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a04159a20 0x7f7a04159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0406ba80 con 0x7f7a040ce750 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0406bd60 con 0x7f7a04159a20 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a08945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406c040 con 0x7f7a0406b540 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:48.998+0000 7f7a02d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a04159a20 0x7f7a04159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a04159a20 0x7f7a04159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53496/0 (socket says 172.21.15.50:53496) 2023-12-24T18:48:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 -- 172.21.15.50:0/317094532 learned_addr learned my addr 172.21.15.50:0/317094532 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a01d9b700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a0406b540 0x7f7a040ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 -- 172.21.15.50:0/317094532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a0406b540 msgr2=0x7f7a040ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a0406b540 0x7f7a040ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 -- 172.21.15.50:0/317094532 >> v1:172.21.15.82:6789/0 conn(0x7f7a040ce750 legacy=0x7f7a0406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 -- 172.21.15.50:0/317094532 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0406c320 con 0x7f7a04159a20 2023-12-24T18:48:49.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a02d9d700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04159ec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009f20 tx=0x7f79fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64859e776eb8a466 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a0159a700 1 -- 172.21.15.50:0/317094532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a04159a20 2023-12-24T18:48:49.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a0159a700 1 -- 172.21.15.50:0/317094532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b8d0 con 0x7f7a04159a20 2023-12-24T18:48:49.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a0159a700 1 -- 172.21.15.50:0/317094532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0092e0 con 0x7f7a04159a20 2023-12-24T18:48:49.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 -- 172.21.15.50:0/317094532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 msgr2=0x7f7a04159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04159ec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009f20 tx=0x7f79fc009840 comp rx=0 tx=0).stop 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 -- 172.21.15.50:0/317094532 shutdown_connections 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04159ec0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 --2- 172.21.15.50:0/317094532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a0406b540 0x7f7a040ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 -- 172.21.15.50:0/317094532 >> 172.21.15.50:0/317094532 conn(0x7f7a040cffb0 msgr2=0x7f7a040d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 -- 172.21.15.50:0/317094532 shutdown_connections 2023-12-24T18:48:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.002+0000 7f7a08945700 1 -- 172.21.15.50:0/317094532 wait complete. 2023-12-24T18:48:49.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 Processor -- start 2023-12-24T18:48:49.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 -- start start 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 0x7f7a0414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a040ce750 0x7f7a04152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04158650 con 0x7f7a04159a20 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040c81f0 con 0x7f7a0406b540 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a08945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04157df0 con 0x7f7a040ce750 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a02d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a02d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53512/0 (socket says 172.21.15.50:53512) 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a02d9d700 1 -- 172.21.15.50:0/3091665132 learned_addr learned my addr 172.21.15.50:0/3091665132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a0259c700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 0x7f7a0414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.006+0000 7f7a01d9b700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a040ce750 0x7f7a04152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a040ce750 msgr2=0x7f7a04152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a040ce750 0x7f7a04152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 msgr2=0x7f7a0414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 0x7f7a0414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 -- 172.21.15.50:0/3091665132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009ae0 con 0x7f7a04159a20 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a0259c700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 0x7f7a0414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a02d9d700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cc920 tx=0x7f79fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0032f0 con 0x7f7a04159a20 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc012af0 con 0x7f7a04159a20 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04158090 con 0x7f7a04159a20 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc01e430 con 0x7f7a04159a20 2023-12-24T18:48:49.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.010+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a04150190 con 0x7f7a04159a20 2023-12-24T18:48:49.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a040c8380 con 0x7f7a04159a20 2023-12-24T18:48:49.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f79fc01e820 con 0x7f7a04159a20 2023-12-24T18:48:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f79f27fc700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 0x7f79e4062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f7a0259c700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 msgr2=0x7f79e4062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7244+0+0 (secure 0 0 0) 0x7f79fc07eab0 con 0x7f7a04159a20 2023-12-24T18:48:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.014+0000 7f7a0259c700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 0x7f79e4062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:49.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.030+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f79fc04e710 con 0x7f7a04159a20 2023-12-24T18:48:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.218+0000 7f7a0259c700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 msgr2=0x7f79e4062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.218+0000 7f7a0259c700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 0x7f79e4062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:49.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.254+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a040652e0 con 0x7f7a04159a20 2023-12-24T18:48:49.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.254+0000 7f79f27fc700 1 -- 172.21.15.50:0/3091665132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f79fc051d30 con 0x7f7a04159a20 2023-12-24T18:48:49.256 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:49.256 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:48:49.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 msgr2=0x7f79e4062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 0x7f79e4062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 msgr2=0x7f7a04169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cc920 tx=0x7f79fc017000 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 shutdown_connections 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79e4060700 0x7f79e4062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a04159a20 0x7f7a04169100 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a040ce750 0x7f7a04152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 --2- 172.21.15.50:0/3091665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0406b540 0x7f7a0414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 >> 172.21.15.50:0/3091665132 conn(0x7f7a040cffb0 msgr2=0x7f7a040c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 shutdown_connections 2023-12-24T18:48:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.258+0000 7f7a08945700 1 -- 172.21.15.50:0/3091665132 wait complete. 2023-12-24T18:48:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:48:49.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:48:49.376 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:49.370+0000 7faf74143000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:48:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.446+0000 7f79db28e700 1 Processor -- start 2023-12-24T18:48:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.446+0000 7f79db28e700 1 -- start start 2023-12-24T18:48:49.449 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:49.446+0000 7fca66bcc000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:48:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79db28e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79db28e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d406e110 con 0x7f79d4155710 2023-12-24T18:48:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79db28e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d406bb40 con 0x7f79d40ad220 2023-12-24T18:48:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79db28e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d406be20 con 0x7f79d406b6b0 2023-12-24T18:48:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79daa8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79d4155710 0x7f79d4155b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38054/0 (socket says 172.21.15.50:38054) 2023-12-24T18:48:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79daa8d700 1 -- 172.21.15.50:0/4074984057 learned_addr learned my addr 172.21.15.50:0/4074984057 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d9a8b700 1 --2- 172.21.15.50:0/4074984057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d928a700 1 -- 172.21.15.50:0/4074984057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436406672 0 0) 0x7f79d406e110 con 0x7f79d4155710 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d928a700 1 -- 172.21.15.50:0/4074984057 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c0003570 con 0x7f79d4155710 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d9a8b700 1 -- 172.21.15.50:0/4074984057 >> v1:172.21.15.82:6789/0 conn(0x7f79d40ad220 legacy=0x7f79d406afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d9a8b700 1 -- 172.21.15.50:0/4074984057 >> v1:172.21.15.50:6789/0 conn(0x7f79d4155710 legacy=0x7f79d4155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d9a8b700 1 -- 172.21.15.50:0/4074984057 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40af740 con 0x7f79d406b6b0 2023-12-24T18:48:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d9a8b700 1 --2- 172.21.15.50:0/4074984057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d40ad5f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009910 tx=0x7f79c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f3f92f530ab1eb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d928a700 1 -- 172.21.15.50:0/4074984057 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400f6b0 con 0x7f79d406b6b0 2023-12-24T18:48:49.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d928a700 1 -- 172.21.15.50:0/4074984057 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400f810 con 0x7f79d406b6b0 2023-12-24T18:48:49.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.450+0000 7f79d928a700 1 -- 172.21.15.50:0/4074984057 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400fb90 con 0x7f79d406b6b0 2023-12-24T18:48:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- 172.21.15.50:0/4074984057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 msgr2=0x7f79d40ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 --2- 172.21.15.50:0/4074984057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d40ad5f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009910 tx=0x7f79c40091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- 172.21.15.50:0/4074984057 shutdown_connections 2023-12-24T18:48:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 --2- 172.21.15.50:0/4074984057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d40ad5f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- 172.21.15.50:0/4074984057 >> 172.21.15.50:0/4074984057 conn(0x7f79d4067b80 msgr2=0x7f79d40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- 172.21.15.50:0/4074984057 shutdown_connections 2023-12-24T18:48:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- 172.21.15.50:0/4074984057 wait complete. 2023-12-24T18:48:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 Processor -- start 2023-12-24T18:48:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.454+0000 7f79db28e700 1 -- start start 2023-12-24T18:48:49.457 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:49.454+0000 7faf74143000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d4148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79d40ad220 0x7f79d414d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4149c70 con 0x7f79d4155710 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4149990 con 0x7f79d40ad220 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d416c7e0 con 0x7f79d406b6b0 2023-12-24T18:48:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48578/0 (socket says 172.21.15.50:48578) 2023-12-24T18:48:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 -- 172.21.15.50:0/37473813 learned_addr learned my addr 172.21.15.50:0/37473813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79da28c700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d4148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79d9a8b700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79d40ad220 0x7f79d414d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 msgr2=0x7f79d4148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d4148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79d40ad220 msgr2=0x7f79d414d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79d40ad220 0x7f79d414d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 -- 172.21.15.50:0/37473813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009420 con 0x7f79d4155710 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79daa8d700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f79cc001460 tx=0x7f79cc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00a890 con 0x7f79d4155710 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00a9f0 con 0x7f79d4155710 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d416cac0 con 0x7f79d4155710 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ad70 con 0x7f79d4155710 2023-12-24T18:48:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.458+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d4144a60 con 0x7f79d4155710 2023-12-24T18:48:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d404be40 con 0x7f79d4155710 2023-12-24T18:48:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f79cc007300 con 0x7f79d4155710 2023-12-24T18:48:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79ca7fc700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 0x7f79b8062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7244+0+0 (secure 0 0 0) 0x7f79cc07d4f0 con 0x7f79d4155710 2023-12-24T18:48:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79da28c700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 msgr2=0x7f79b8062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.462+0000 7f79da28c700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 0x7f79b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.470+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f79cc04d240 con 0x7f79d4155710 2023-12-24T18:48:49.532 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:49.530+0000 7fca66bcc000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:48:49.654 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:49.646+0000 7faf74143000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:48:49.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.666+0000 7f79da28c700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 msgr2=0x7f79b8062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:49.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.666+0000 7f79da28c700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 0x7f79b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.714+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79d4146a60 con 0x7f79d4155710 2023-12-24T18:48:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.718+0000 7f79ca7fc700 1 -- 172.21.15.50:0/37473813 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f79cc050860 con 0x7f79d4155710 2023-12-24T18:48:49.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:49.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:48:49.554538+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1014312647":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/49267815":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1062942176":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6833/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6832/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1890246914":"2023-12-25T18:37:50.171710+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":24,"length":2},{"begin":37,"length":8},{"begin":52,"length":1},{"begin":54,"length":5},{"begin":63,"length":1},{"begin":67,"length":7},{"begin":77,"length":1},{"begin":85,"length":2},{"begin":90,"length":1},{"begin":96,"length":1},{"begin":105,"length":1},{"begin":110,"length":1},{"begin":216,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:48:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 msgr2=0x7f79b8062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 0x7f79b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 msgr2=0x7f79d414d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f79cc001460 tx=0x7f79cc001ae0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 shutdown_connections 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f79b8060700 0x7f79b8062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d4155710 0x7f79d414d560 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79d40ad220 0x7f79d414d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 --2- 172.21.15.50:0/37473813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79d406b6b0 0x7f79d4148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 >> 172.21.15.50:0/37473813 conn(0x7f79d4067b80 msgr2=0x7f79d40ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 shutdown_connections 2023-12-24T18:48:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.722+0000 7f79db28e700 1 -- 172.21.15.50:0/37473813 wait complete. 2023-12-24T18:48:49.727 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:49.726+0000 7fca66bcc000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:48:49.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:37:29.511270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:37:30.174885+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 221, 'snap_epoch': 55, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:48:49.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:48:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.906+0000 7f6a74ef0700 1 Processor -- start 2023-12-24T18:48:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.906+0000 7f6a74ef0700 1 -- start start 2023-12-24T18:48:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.910+0000 7f6a74ef0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 0x7f6a700b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.910+0000 7f6a74ef0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a7006c820 0x7f6a700b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700b3fd0 con 0x7f6a7006a710 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700b33c0 con 0x7f6a7006c820 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700b36a0 con 0x7f6a70158e00 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a7006c820 0x7f6a700b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a7006c820 0x7f6a700b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48584/0 (socket says 172.21.15.50:48584) 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/2059780549 learned_addr learned my addr 172.21.15.50:0/2059780549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6e59c700 1 --2- 172.21.15.50:0/2059780549 >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 0x7f6a700b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/2059780549 >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 msgr2=0x7f6a700b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 --2- 172.21.15.50:0/2059780549 >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 0x7f6a700b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/2059780549 >> v1:172.21.15.82:6789/0 conn(0x7f6a7006a710 legacy=0x7f6a7006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/2059780549 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700b3980 con 0x7f6a7006c820 2023-12-24T18:48:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6e59c700 1 --2- 172.21.15.50:0/2059780549 >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 0x7f6a700b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:49.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6dd9b700 1 --2- 172.21.15.50:0/2059780549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a7006c820 0x7f6a700b4460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006f8c0 tx=0x7f6a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c32b141f75e5e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6d59a700 1 -- 172.21.15.50:0/2059780549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400b860 con 0x7f6a7006c820 2023-12-24T18:48:49.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6d59a700 1 -- 172.21.15.50:0/2059780549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400b9c0 con 0x7f6a7006c820 2023-12-24T18:48:49.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a6d59a700 1 -- 172.21.15.50:0/2059780549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400bd60 con 0x7f6a7006c820 2023-12-24T18:48:49.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- 172.21.15.50:0/2059780549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a7006c820 msgr2=0x7f6a700b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/2059780549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a7006c820 0x7f6a700b4460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006f8c0 tx=0x7f6a64009250 comp rx=0 tx=0).stop 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- 172.21.15.50:0/2059780549 shutdown_connections 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/2059780549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a7006c820 0x7f6a700b4460 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/2059780549 >> v2:172.21.15.82:3300/0 conn(0x7f6a70158e00 0x7f6a700b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- 172.21.15.50:0/2059780549 >> 172.21.15.50:0/2059780549 conn(0x7f6a70067b80 msgr2=0x7f6a700cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.914+0000 7f6a74ef0700 1 -- 172.21.15.50:0/2059780549 shutdown_connections 2023-12-24T18:48:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 -- 172.21.15.50:0/2059780549 wait complete. 2023-12-24T18:48:49.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 Processor -- start 2023-12-24T18:48:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 -- start start 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a7006a710 0x7f6a7013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a70158e00 0x7f6a701501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70156cb0 con 0x7f6a70158e00 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7013ffe0 con 0x7f6a7006c820 2023-12-24T18:48:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a74ef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701560a0 con 0x7f6a7006a710 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a70158e00 0x7f6a701501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:45492/0 (socket says 172.21.15.50:45492) 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/1222879917 learned_addr learned my addr 172.21.15.50:0/1222879917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6e59c700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a7006a710 0x7f6a7013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a7006a710 msgr2=0x7f6a7013faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a7006a710 0x7f6a7013faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a70158e00 msgr2=0x7f6a701501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.918+0000 7f6a6dd9b700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a70158e00 0x7f6a701501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a6dd9b700 1 -- 172.21.15.50:0/1222879917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640094f0 con 0x7f6a7006c820 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a6dd9b700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a70069a90 tx=0x7f6a64017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64024440 con 0x7f6a7006c820 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640245a0 con 0x7f6a7006c820 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64024960 con 0x7f6a7006c820 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a70156380 con 0x7f6a7006c820 2023-12-24T18:48:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a70156940 con 0x7f6a7006c820 2023-12-24T18:48:49.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.922+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a700652e0 con 0x7f6a7006c820 2023-12-24T18:48:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.926+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f6a64024d50 con 0x7f6a7006c820 2023-12-24T18:48:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.930+0000 7f6a5e7fc700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 0x7f6a50062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.930+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f6a6407ea00 con 0x7f6a7006c820 2023-12-24T18:48:49.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.930+0000 7f6a6e59c700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 msgr2=0x7f6a50062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:49.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.930+0000 7f6a6e59c700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 0x7f6a50062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:49.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:49.938+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6a6404e960 con 0x7f6a7006c820 2023-12-24T18:48:49.963 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:49.958+0000 7faf74143000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:48:50.065 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:50.058+0000 7faf74143000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:48:50.082 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:50.082+0000 7fca66bcc000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:48:50.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.134+0000 7f6a6e59c700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 msgr2=0x7f6a50062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:50.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.134+0000 7f6a6e59c700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 0x7f6a50062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:50.159 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:50.158+0000 7fca66bcc000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:48:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.190+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a70063430 con 0x7f6a7006c820 2023-12-24T18:48:50.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.190+0000 7f6a5e7fc700 1 -- 172.21.15.50:0/1222879917 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a70063430 con 0x7f6a7006c820 2023-12-24T18:48:50.193 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 msgr2=0x7f6a50062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 0x7f6a50062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 msgr2=0x7f6a7014fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a70069a90 tx=0x7f6a64017000 comp rx=0 tx=0).stop 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 shutdown_connections 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6a50060700 0x7f6a50062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a70158e00 0x7f6a701501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a7006c820 0x7f6a7014fc90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 --2- 172.21.15.50:0/1222879917 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a7006a710 0x7f6a7013faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 >> 172.21.15.50:0/1222879917 conn(0x7f6a70067b80 msgr2=0x7f6a7015a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 shutdown_connections 2023-12-24T18:48:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.194+0000 7f6a74ef0700 1 -- 172.21.15.50:0/1222879917 wait complete. 2023-12-24T18:48:50.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:48:50.332 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:50.326+0000 7faf74143000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:48:50.421 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:50.418+0000 7faf74143000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:48:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.422+0000 7f8004cf0700 1 Processor -- start 2023-12-24T18:48:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.422+0000 7f8004cf0700 1 -- start start 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8000158e00 0x7f80000b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f800006c820 0x7f80000b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800006a710 0x7f800006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800006b0b0 con 0x7f8000158e00 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000b3fd0 con 0x7f800006c820 2023-12-24T18:48:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b33c0 con 0x7f800006a710 2023-12-24T18:48:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8000158e00 0x7f80000b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8000158e00 0x7f80000b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48602/0 (socket says 172.21.15.50:48602) 2023-12-24T18:48:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 -- 172.21.15.50:0/24629698 learned_addr learned my addr 172.21.15.50:0/24629698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffdd9b700 1 --2- 172.21.15.50:0/24629698 >> v2:172.21.15.82:3300/0 conn(0x7f800006c820 0x7f80000b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffed9d700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800006a710 0x7f800006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 -- 172.21.15.50:0/24629698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800006a710 msgr2=0x7f800006ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800006a710 0x7f800006ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 -- 172.21.15.50:0/24629698 >> v2:172.21.15.82:3300/0 conn(0x7f800006c820 msgr2=0x7f80000b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/24629698 >> v2:172.21.15.82:3300/0 conn(0x7f800006c820 0x7f80000b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 -- 172.21.15.50:0/24629698 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000b36a0 con 0x7f8000158e00 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000158e00 0x7f80000b2de0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80000692a0 tx=0x7f7ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d609af8ad65494 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffd59a700 1 -- 172.21.15.50:0/24629698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0009e70 con 0x7f8000158e00 2023-12-24T18:48:50.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffd59a700 1 -- 172.21.15.50:0/24629698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000b860 con 0x7f8000158e00 2023-12-24T18:48:50.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f7ffd59a700 1 -- 172.21.15.50:0/24629698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000bc00 con 0x7f8000158e00 2023-12-24T18:48:50.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 -- 172.21.15.50:0/24629698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000158e00 msgr2=0x7f80000b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.426+0000 7f8004cf0700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000158e00 0x7f80000b2de0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80000692a0 tx=0x7f7ff0009250 comp rx=0 tx=0).stop 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 -- 172.21.15.50:0/24629698 shutdown_connections 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 --2- 172.21.15.50:0/24629698 >> v2:172.21.15.82:3300/0 conn(0x7f800006c820 0x7f80000b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800006a710 0x7f800006ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 --2- 172.21.15.50:0/24629698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000158e00 0x7f80000b2de0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 -- 172.21.15.50:0/24629698 >> 172.21.15.50:0/24629698 conn(0x7f8000067b80 msgr2=0x7f80000cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 -- 172.21.15.50:0/24629698 shutdown_connections 2023-12-24T18:48:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 -- 172.21.15.50:0/24629698 wait complete. 2023-12-24T18:48:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 Processor -- start 2023-12-24T18:48:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.430+0000 7f8004cf0700 1 -- start start 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800006c820 0x7f800013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 0x7f80000ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ab510 con 0x7f800006a710 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ab7f0 con 0x7f800006c820 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000abad0 con 0x7f8000158e00 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48606/0 (socket says 172.21.15.50:48606) 2023-12-24T18:48:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 -- 172.21.15.50:0/2442228022 learned_addr learned my addr 172.21.15.50:0/2442228022 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffdd9b700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800006c820 0x7f800013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffed9d700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 0x7f80000ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 msgr2=0x7f80000ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 0x7f80000ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800006c820 msgr2=0x7f800013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800006c820 0x7f800013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 -- 172.21.15.50:0/2442228022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094f0 con 0x7f800006a710 2023-12-24T18:48:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffed9d700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 0x7f80000ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7ffe59c700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8000069a90 tx=0x7f7ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0000d10 con 0x7f800006a710 2023-12-24T18:48:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000bbe0 con 0x7f800006a710 2023-12-24T18:48:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80000abdb0 con 0x7f800006a710 2023-12-24T18:48:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0011670 con 0x7f800006a710 2023-12-24T18:48:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.434+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800013f620 con 0x7f800006a710 2023-12-24T18:48:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.438+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80000652e0 con 0x7f800006a710 2023-12-24T18:48:50.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.438+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f7ff0011aa0 con 0x7f800006a710 2023-12-24T18:48:50.441 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:50.438+0000 7fca66bcc000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:48:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.438+0000 7f7fee7fc700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 0x7f7fe0062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.438+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f7ff007e4a0 con 0x7f800006a710 2023-12-24T18:48:50.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.438+0000 7f7ffdd9b700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 msgr2=0x7f7fe0062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:50.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.442+0000 7f7ffdd9b700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 0x7f7fe0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:50.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.446+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ff004e380 con 0x7f800006a710 2023-12-24T18:48:50.509 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:50.502+0000 7faf74143000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:48:50.562 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:50.562+0000 7fca66bcc000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:48:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.646+0000 7f7ffdd9b700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 msgr2=0x7f7fe0062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.646+0000 7f7ffdd9b700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 0x7f7fe0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:50.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80000b4700 con 0x7f800006a710 2023-12-24T18:48:50.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f7fee7fc700 1 -- 172.21.15.50:0/2442228022 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ff00519a0 con 0x7f800006a710 2023-12-24T18:48:50.663 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:48:50.664 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:50.662+0000 7fca66bcc000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:48:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 msgr2=0x7f7fe0062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 0x7f7fe0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 msgr2=0x7f800013f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.662+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8000069a90 tx=0x7f7ff0017000 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 shutdown_connections 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7fe0060700 0x7f7fe0062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8000158e00 0x7f80000ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800006c820 0x7f800013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 --2- 172.21.15.50:0/2442228022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800006a710 0x7f800013f0e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 >> 172.21.15.50:0/2442228022 conn(0x7f8000067b80 msgr2=0x7f8000153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 shutdown_connections 2023-12-24T18:48:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.666+0000 7f8004cf0700 1 -- 172.21.15.50:0/2442228022 wait complete. 2023-12-24T18:48:50.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:48:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 Processor -- start 2023-12-24T18:48:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 -- start start 2023-12-24T18:48:50.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b10158c50 0x7f0b10159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b100caa60 con 0x7f0b100caef0 2023-12-24T18:48:50.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b100cee80 con 0x7f0b100ccea0 2023-12-24T18:48:50.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.854+0000 7f0b14bcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100af430 con 0x7f0b10158c50 2023-12-24T18:48:50.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b07fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b100caef0 0x7f0b100cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38060/0 (socket says 172.21.15.50:38060) 2023-12-24T18:48:50.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b07fff700 1 -- 172.21.15.50:0/1661620453 learned_addr learned my addr 172.21.15.50:0/1661620453 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:50.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0f7fe700 1 --2- 172.21.15.50:0/1661620453 >> v2:172.21.15.50:3300/0 conn(0x7f0b10158c50 0x7f0b10159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193642499 0 0) 0x7f0b100caa60 con 0x7f0b100caef0 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc003570 con 0x7f0b100caef0 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056740815 0 0) 0x7f0b100cee80 con 0x7f0b100ccea0 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/1661620453 >> v1:172.21.15.82:6789/0 conn(0x7f0b100ccea0 legacy=0x7f0b100afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/1661620453 >> v1:172.21.15.50:6789/0 conn(0x7f0b100caef0 legacy=0x7f0b100cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/1661620453 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100cf160 con 0x7f0b10158c50 2023-12-24T18:48:50.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0f7fe700 1 --2- 172.21.15.50:0/1661620453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b10158c50 0x7f0b10159020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b000098e0 tx=0x7f0b000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e66c54c40ac42fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000b640 con 0x7f0b10158c50 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000b7a0 con 0x7f0b10158c50 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b0effd700 1 -- 172.21.15.50:0/1661620453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000bb40 con 0x7f0b10158c50 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 -- 172.21.15.50:0/1661620453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b10158c50 msgr2=0x7f0b10159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/1661620453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b10158c50 0x7f0b10159020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b000098e0 tx=0x7f0b000091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 -- 172.21.15.50:0/1661620453 shutdown_connections 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/1661620453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b10158c50 0x7f0b10159020 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 -- 172.21.15.50:0/1661620453 >> 172.21.15.50:0/1661620453 conn(0x7f0b100670b0 msgr2=0x7f0b100674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 -- 172.21.15.50:0/1661620453 shutdown_connections 2023-12-24T18:48:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.858+0000 7f0b14bcc700 1 -- 172.21.15.50:0/1661620453 wait complete. 2023-12-24T18:48:50.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.862+0000 7f0b14bcc700 1 Processor -- start 2023-12-24T18:48:50.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.862+0000 7f0b14bcc700 1 -- start start 2023-12-24T18:48:50.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b100ccea0 0x7f0b100c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10158c50 0x7f0b100b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100b4850 con 0x7f0b100caef0 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c5500 con 0x7f0b10158c50 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c5770 con 0x7f0b100ccea0 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48628/0 (socket says 172.21.15.50:48628) 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/2243464989 learned_addr learned my addr 172.21.15.50:0/2243464989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b07fff700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b100ccea0 0x7f0b100c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0ffff700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10158c50 0x7f0b100b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b100ccea0 msgr2=0x7f0b100c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b100ccea0 0x7f0b100c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10158c50 msgr2=0x7f0b100b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10158c50 0x7f0b100b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 -- 172.21.15.50:0/2243464989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00009420 con 0x7f0b100caef0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b0f7fe700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009f80 tx=0x7f0b00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0001f070 con 0x7f0b100caef0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b00000bc0 con 0x7f0b100caef0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100c5a50 con 0x7f0b100caef0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00025420 con 0x7f0b100caef0 2023-12-24T18:48:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.866+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100b4460 con 0x7f0b100caef0 2023-12-24T18:48:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f0b00023070 con 0x7f0b100caef0 2023-12-24T18:48:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b100c5c60 con 0x7f0b100caef0 2023-12-24T18:48:50.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b077fe700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 0x7f0af0062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:50.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f0b0007e420 con 0x7f0b100caef0 2023-12-24T18:48:50.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b07fff700 1 -- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 msgr2=0x7f0af0062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:50.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.870+0000 7f0b07fff700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 0x7f0af0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:50.874+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0b0004e280 con 0x7f0b100caef0 2023-12-24T18:48:50.920 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:50.914+0000 7faf74143000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:48:51.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.050+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b100c5e40 con 0x7f0b100caef0 2023-12-24T18:48:51.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.050+0000 7f0b077fe700 1 -- 172.21.15.50:0/2243464989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b000518a0 con 0x7f0b100caef0 2023-12-24T18:48:51.052 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 msgr2=0x7f0af0062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 0x7f0af0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 msgr2=0x7f0b100b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009f80 tx=0x7f0b00017000 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 shutdown_connections 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0af0060700 0x7f0af0062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10158c50 0x7f0b100b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b100ccea0 0x7f0b100c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 --2- 172.21.15.50:0/2243464989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b100caef0 0x7f0b100b3f20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 >> 172.21.15.50:0/2243464989 conn(0x7f0b100670b0 msgr2=0x7f0b100b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 shutdown_connections 2023-12-24T18:48:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.054+0000 7f0b14bcc700 1 -- 172.21.15.50:0/2243464989 wait complete. 2023-12-24T18:48:51.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:48:51.085 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:51.082+0000 7fca66bcc000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:48:51.088 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.082+0000 7faf74143000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:48:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 Processor -- start 2023-12-24T18:48:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 -- start start 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 0x7f17080c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f170806aca0 0x7f170806b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170806c820 con 0x7f1708154450 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170806b960 con 0x7f170806aca0 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170f825700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170806bc40 con 0x7f17080c6d00 2023-12-24T18:48:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170ddc2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f170806aca0 0x7f170806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170ddc2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f170806aca0 0x7f170806b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48644/0 (socket says 172.21.15.50:48644) 2023-12-24T18:48:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.238+0000 7f170ddc2700 1 -- 172.21.15.50:0/1342371435 learned_addr learned my addr 172.21.15.50:0/1342371435 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170d5c1700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 0x7f17080c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170ddc2700 1 -- 172.21.15.50:0/1342371435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 msgr2=0x7f17080c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170ddc2700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 0x7f17080c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170ddc2700 1 -- 172.21.15.50:0/1342371435 >> v1:172.21.15.82:6789/0 conn(0x7f1708154450 legacy=0x7f17081548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170ddc2700 1 -- 172.21.15.50:0/1342371435 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170806bf20 con 0x7f170806aca0 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170d5c1700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 0x7f17080c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170ddc2700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f170806aca0 0x7f170806b100 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1700009f20 tx=0x7f1700009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bb6f255e10104c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f16fffff700 1 -- 172.21.15.50:0/1342371435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000e070 con 0x7f170806aca0 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f16fffff700 1 -- 172.21.15.50:0/1342371435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170000ba80 con 0x7f170806aca0 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f16fffff700 1 -- 172.21.15.50:0/1342371435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000092e0 con 0x7f170806aca0 2023-12-24T18:48:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 -- 172.21.15.50:0/1342371435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f170806aca0 msgr2=0x7f170806b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f170806aca0 0x7f170806b100 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1700009f20 tx=0x7f1700009840 comp rx=0 tx=0).stop 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 -- 172.21.15.50:0/1342371435 shutdown_connections 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f170806aca0 0x7f170806b100 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 --2- 172.21.15.50:0/1342371435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17080c6d00 0x7f17080c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 -- 172.21.15.50:0/1342371435 >> 172.21.15.50:0/1342371435 conn(0x7f17080cbba0 msgr2=0x7f17080cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 -- 172.21.15.50:0/1342371435 shutdown_connections 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.242+0000 7f170f825700 1 -- 172.21.15.50:0/1342371435 wait complete. 2023-12-24T18:48:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 Processor -- start 2023-12-24T18:48:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 -- start start 2023-12-24T18:48:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f170806aca0 0x7f170816cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 0x7f17080af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080af8b0 con 0x7f1708154450 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080b1120 con 0x7f17080c6d00 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170816d940 con 0x7f170806aca0 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48654/0 (socket says 172.21.15.50:48654) 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 -- 172.21.15.50:0/1175141626 learned_addr learned my addr 172.21.15.50:0/1175141626 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170d5c1700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f170806aca0 0x7f170816cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170cdc0700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 0x7f17080af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f170806aca0 msgr2=0x7f170816cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f170806aca0 0x7f170816cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 msgr2=0x7f17080af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 0x7f17080af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 -- 172.21.15.50:0/1175141626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700009ae0 con 0x7f1708154450 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170cdc0700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 0x7f17080af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170ddc2700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f170000b6c0 tx=0x7f1700018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000032f0 con 0x7f1708154450 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700026460 con 0x7f1708154450 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170816d0a0 con 0x7f1708154450 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.246+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700026800 con 0x7f1708154450 2023-12-24T18:48:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.250+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170816d660 con 0x7f1708154450 2023-12-24T18:48:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.250+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17080652e0 con 0x7f1708154450 2023-12-24T18:48:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.250+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f1700003040 con 0x7f1708154450 2023-12-24T18:48:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.254+0000 7f16fd7fa700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 0x7f16ec062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.254+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f170007f070 con 0x7f1708154450 2023-12-24T18:48:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.254+0000 7f170d5c1700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 msgr2=0x7f16ec062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.254+0000 7f170d5c1700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 0x7f16ec062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.258+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f170004ee40 con 0x7f1708154450 2023-12-24T18:48:51.272 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:51.270+0000 7fca66bcc000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:48:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.457+0000 7f170d5c1700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 msgr2=0x7f16ec062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.457+0000 7f170d5c1700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 0x7f16ec062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:51.462 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.458+0000 7faf74143000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:48:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.469+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f170806c200 con 0x7f1708154450 2023-12-24T18:48:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.469+0000 7f16fd7fa700 1 -- 172.21.15.50:0/1175141626 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f1700052460 con 0x7f1708154450 2023-12-24T18:48:51.473 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:51.473 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:48:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 msgr2=0x7f16ec062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 0x7f16ec062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 msgr2=0x7f170816c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f170000b6c0 tx=0x7f1700018000 comp rx=0 tx=0).stop 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 shutdown_connections 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f16ec060700 0x7f16ec062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708154450 0x7f170816c250 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17080c6d00 0x7f17080af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 --2- 172.21.15.50:0/1175141626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f170806aca0 0x7f170816cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 >> 172.21.15.50:0/1175141626 conn(0x7f17080cbba0 msgr2=0x7f17080cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 shutdown_connections 2023-12-24T18:48:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.473+0000 7f170f825700 1 -- 172.21.15.50:0/1175141626 wait complete. 2023-12-24T18:48:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:48:51.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:48:51.670 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:51.669+0000 7fca66bcc000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:48:51.690 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.686+0000 7faf74143000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:48:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 Processor -- start 2023-12-24T18:48:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 -- start start 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 0x7fee0c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee0c06d8c0 0x7fee0c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c06b640 con 0x7fee0c158e00 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c159710 con 0x7fee0c06d8c0 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12f63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0b5e10 con 0x7fee0c0b41e0 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.701+0000 7fee12762700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee0c06d8c0 0x7fee0c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee0c06d8c0 0x7fee0c159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48670/0 (socket says 172.21.15.50:48670) 2023-12-24T18:48:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 -- 172.21.15.50:0/1828921643 learned_addr learned my addr 172.21.15.50:0/1828921643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee11760700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 0x7fee0c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 -- 172.21.15.50:0/1828921643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 msgr2=0x7fee0c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 0x7fee0c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 -- 172.21.15.50:0/1828921643 >> v1:172.21.15.50:6789/0 conn(0x7fee0c158e00 legacy=0x7fee0c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 -- 172.21.15.50:0/1828921643 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c06b8e0 con 0x7fee0c06d8c0 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee10f5f700 1 -- 172.21.15.50:0/1828921643 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363913340 0 0) 0x7fee0c06b640 con 0x7fee0c158e00 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee11760700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 0x7fee0c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12762700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06d8c0 0x7fee0c159e30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fee04009f20 tx=0x7fee04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f29fc6ade567f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee10f5f700 1 -- 172.21.15.50:0/1828921643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400e070 con 0x7fee0c06d8c0 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee10f5f700 1 -- 172.21.15.50:0/1828921643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0400b9d0 con 0x7fee0c06d8c0 2023-12-24T18:48:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee10f5f700 1 -- 172.21.15.50:0/1828921643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee040092e0 con 0x7fee0c06d8c0 2023-12-24T18:48:51.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 -- 172.21.15.50:0/1828921643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06d8c0 msgr2=0x7fee0c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06d8c0 0x7fee0c159e30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fee04009f20 tx=0x7fee04009840 comp rx=0 tx=0).stop 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 -- 172.21.15.50:0/1828921643 shutdown_connections 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06d8c0 0x7fee0c159e30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 --2- 172.21.15.50:0/1828921643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c0b41e0 0x7fee0c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 -- 172.21.15.50:0/1828921643 >> 172.21.15.50:0/1828921643 conn(0x7fee0c067b80 msgr2=0x7fee0c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 -- 172.21.15.50:0/1828921643 shutdown_connections 2023-12-24T18:48:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.705+0000 7fee12f63700 1 -- 172.21.15.50:0/1828921643 wait complete. 2023-12-24T18:48:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.709+0000 7fee12f63700 1 Processor -- start 2023-12-24T18:48:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.709+0000 7fee12f63700 1 -- start start 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c06d8c0 0x7fee0c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee0c158e00 0x7fee0c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0b1f40 con 0x7fee0c0b41e0 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c16caa0 con 0x7fee0c158e00 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c16cd80 con 0x7fee0c06d8c0 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48680/0 (socket says 172.21.15.50:48680) 2023-12-24T18:48:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 -- 172.21.15.50:0/2135467845 learned_addr learned my addr 172.21.15.50:0/2135467845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11f61700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c06d8c0 0x7fee0c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12762700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee0c158e00 0x7fee0c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 -- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c06d8c0 msgr2=0x7fee0c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c06d8c0 0x7fee0c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 -- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee0c158e00 msgr2=0x7fee0c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee0c158e00 0x7fee0c0ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 -- 172.21.15.50:0/2135467845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009420 con 0x7fee0c0b41e0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee11760700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00ec80 tx=0x7fedfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00c850 con 0x7fee0c0b41e0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00c9b0 con 0x7fee0c0b41e0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee04009ae0 con 0x7fee0c0b41e0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00cd30 con 0x7fee0c0b41e0 2023-12-24T18:48:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.713+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c16d340 con 0x7fee0c0b41e0 2023-12-24T18:48:51.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c04be40 con 0x7fee0c0b41e0 2023-12-24T18:48:51.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7fedfc013680 con 0x7fee0c0b41e0 2023-12-24T18:48:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee01ffb700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 0x7fedf0062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fedfc07d590 con 0x7fee0c0b41e0 2023-12-24T18:48:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee11f61700 1 -- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 msgr2=0x7fedf0062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.717+0000 7fee11f61700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 0x7fedf0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:51.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.725+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fedfc04d3f0 con 0x7fee0c0b41e0 2023-12-24T18:48:51.795 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.790+0000 7faf74143000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:48:51.874 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.870+0000 7faf74143000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:48:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.901+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee0c0aadf0 con 0x7fee0c0b41e0 2023-12-24T18:48:51.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.905+0000 7fee01ffb700 1 -- 172.21.15.50:0/2135467845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16808 (secure 0 0 0) 0x7fedfc050a10 con 0x7fee0c0b41e0 2023-12-24T18:48:51.908 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:51.909 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:48:49.554538+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1014312647":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/49267815":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1062942176":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6833/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6832/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1890246914":"2023-12-25T18:37:50.171710+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":24,"length":2},{"begin":37,"length":8},{"begin":52,"length":1},{"begin":54,"length":5},{"begin":63,"length":1},{"begin":67,"length":7},{"begin":77,"length":1},{"begin":85,"length":2},{"begin":90,"length":1},{"begin":96,"length":1},{"begin":105,"length":1},{"begin":110,"length":1},{"begin":216,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:48:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 msgr2=0x7fedf0062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 0x7fedf0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 msgr2=0x7fee0c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00ec80 tx=0x7fedfc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 shutdown_connections 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fedf0060700 0x7fedf0062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee0c158e00 0x7fee0c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0b41e0 0x7fee0c0b1a00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 --2- 172.21.15.50:0/2135467845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee0c06d8c0 0x7fee0c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 >> 172.21.15.50:0/2135467845 conn(0x7fee0c067b80 msgr2=0x7fee0c0a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 shutdown_connections 2023-12-24T18:48:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:51.909+0000 7fee12f63700 1 -- 172.21.15.50:0/2135467845 wait complete. 2023-12-24T18:48:51.922 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:51.921+0000 7fca66bcc000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:48:51.933 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:48:51.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:48:51.956 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:51.950+0000 7faf74143000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:48:52.027 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.025+0000 7fca66bcc000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:48:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.089+0000 7fb18662e700 1 Processor -- start 2023-12-24T18:48:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.089+0000 7fb18662e700 1 -- start start 2023-12-24T18:48:52.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb18662e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 0x7fb1800c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb18662e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb18006aca0 0x7fb18006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb18662e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18006c820 con 0x7fb1800c6d00 2023-12-24T18:48:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb18662e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18006b960 con 0x7fb180154b60 2023-12-24T18:48:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb18662e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18006bc40 con 0x7fb18006aca0 2023-12-24T18:48:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb17f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 0x7fb1800c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb18006aca0 0x7fb18006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb17f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 0x7fb1800c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48682/0 (socket says 172.21.15.50:48682) 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb17f7fe700 1 -- 172.21.15.50:0/1343521463 learned_addr learned my addr 172.21.15.50:0/1343521463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb17ffff700 1 --1- 172.21.15.50:0/1343521463 >> v1:172.21.15.82:6789/0 conn(0x7fb1800c6d00 0x7fb180154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35104/0 (socket says 172.21.15.50:35104) 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 -- 172.21.15.50:0/1343521463 >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 msgr2=0x7fb1800c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 --2- 172.21.15.50:0/1343521463 >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 0x7fb1800c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 -- 172.21.15.50:0/1343521463 >> v1:172.21.15.82:6789/0 conn(0x7fb1800c6d00 legacy=0x7fb180154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 -- 172.21.15.50:0/1343521463 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18006bf20 con 0x7fb18006aca0 2023-12-24T18:48:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.093+0000 7fb184bcb700 1 --2- 172.21.15.50:0/1343521463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb18006b140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb180069f60 tx=0x7fb1780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df20d7f34e037c40 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb17effd700 1 -- 172.21.15.50:0/1343521463 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011630 con 0x7fb18006aca0 2023-12-24T18:48:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb17effd700 1 -- 172.21.15.50:0/1343521463 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb178011790 con 0x7fb18006aca0 2023-12-24T18:48:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb17effd700 1 -- 172.21.15.50:0/1343521463 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011b30 con 0x7fb18006aca0 2023-12-24T18:48:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 -- 172.21.15.50:0/1343521463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 msgr2=0x7fb18006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 --2- 172.21.15.50:0/1343521463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb18006b140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb180069f60 tx=0x7fb1780091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 -- 172.21.15.50:0/1343521463 shutdown_connections 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 --2- 172.21.15.50:0/1343521463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb18006b140 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 --2- 172.21.15.50:0/1343521463 >> v2:172.21.15.50:3300/0 conn(0x7fb180154b60 0x7fb1800c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 -- 172.21.15.50:0/1343521463 >> 172.21.15.50:0/1343521463 conn(0x7fb1800cbba0 msgr2=0x7fb1800cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 -- 172.21.15.50:0/1343521463 shutdown_connections 2023-12-24T18:48:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.097+0000 7fb18662e700 1 -- 172.21.15.50:0/1343521463 wait complete. 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 Processor -- start 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 -- start start 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb180150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb180154b60 0x7fb1800aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180156a30 con 0x7fb1800c6d00 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180150d40 con 0x7fb18006aca0 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb18662e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800af620 con 0x7fb180154b60 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb180150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48696/0 (socket says 172.21.15.50:48696) 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 -- 172.21.15.50:0/221595034 learned_addr learned my addr 172.21.15.50:0/221595034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb184bcb700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb180154b60 0x7fb1800aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb180154b60 msgr2=0x7fb1800aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb180154b60 0x7fb1800aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 msgr2=0x7fb180150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb180150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.101+0000 7fb17f7fe700 1 -- 172.21.15.50:0/221595034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178009420 con 0x7fb1800c6d00 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb17f7fe700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e980 tx=0x7fb174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174013680 con 0x7fb1800c6d00 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740137e0 con 0x7fb1800c6d00 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1800af900 con 0x7fb1800c6d00 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174013b60 con 0x7fb1800c6d00 2023-12-24T18:48:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1800afec0 con 0x7fb1800c6d00 2023-12-24T18:48:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800652e0 con 0x7fb1800c6d00 2023-12-24T18:48:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.105+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7fb17400c400 con 0x7fb1800c6d00 2023-12-24T18:48:52.112 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.109+0000 7fca66bcc000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:48:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.109+0000 7fb167fff700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 0x7fb16c062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.109+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fb17407d070 con 0x7fb1800c6d00 2023-12-24T18:48:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.109+0000 7fb17ffff700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 msgr2=0x7fb16c062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.109+0000 7fb17ffff700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 0x7fb16c062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.113+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb1740acbe0 con 0x7fb1800c6d00 2023-12-24T18:48:52.194 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.189+0000 7fca66bcc000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:48:52.202 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:52.198+0000 7faf74143000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:48:52.287 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:52.282+0000 7faf74143000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:48:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.313+0000 7fb17ffff700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 msgr2=0x7fb16c062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.313+0000 7fb17ffff700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 0x7fb16c062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:52.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.321+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb18006c200 con 0x7fb1800c6d00 2023-12-24T18:48:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.321+0000 7fb167fff700 1 -- 172.21.15.50:0/221595034 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fb174050960 con 0x7fb1800c6d00 2023-12-24T18:48:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:52.324 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:48:52.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 msgr2=0x7fb16c062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 0x7fb16c062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 msgr2=0x7fb1800aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e980 tx=0x7fb174009250 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 shutdown_connections 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb16c060730 0x7fb16c062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb180154b60 0x7fb1800aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1800c6d00 0x7fb1800aeab0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 --2- 172.21.15.50:0/221595034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18006aca0 0x7fb180150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 >> 172.21.15.50:0/221595034 conn(0x7fb1800cbba0 msgr2=0x7fb1800c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 shutdown_connections 2023-12-24T18:48:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.325+0000 7fb18662e700 1 -- 172.21.15.50:0/221595034 wait complete. 2023-12-24T18:48:52.329 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:48:52.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:48:52.379 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:52.374+0000 7faf74143000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:48:52.438 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.437+0000 7fca66bcc000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:48:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 Processor -- start 2023-12-24T18:48:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 -- start start 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35601590a0 0x7f356006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600a9c80 con 0x7f356006b6c0 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600a9070 con 0x7f3560158cd0 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f3564ce3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600a9350 con 0x7f35601590a0 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35601590a0 0x7f356006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35601590a0 0x7f356006c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48710/0 (socket says 172.21.15.50:48710) 2023-12-24T18:48:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 -- 172.21.15.50:0/1945399220 learned_addr learned my addr 172.21.15.50:0/1945399220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 -- 172.21.15.50:0/1945399220 >> v1:172.21.15.82:6789/0 conn(0x7f3560158cd0 legacy=0x7f356006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 -- 172.21.15.50:0/1945399220 >> v1:172.21.15.50:6789/0 conn(0x7f356006b6c0 legacy=0x7f356006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355ffff700 1 -- 172.21.15.50:0/1945399220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600a9630 con 0x7f35601590a0 2023-12-24T18:48:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.517+0000 7f355e7fc700 1 -- 172.21.15.50:0/1945399220 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933728526 0 0) 0x7f35600a9c80 con 0x7f356006b6c0 2023-12-24T18:48:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f355ffff700 1 --2- 172.21.15.50:0/1945399220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35601590a0 0x7f356006c0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3558009f20 tx=0x7f3558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e933c68ce7aeb05 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f355e7fc700 1 -- 172.21.15.50:0/1945399220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800e070 con 0x7f35601590a0 2023-12-24T18:48:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f355e7fc700 1 -- 172.21.15.50:0/1945399220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800ba80 con 0x7f35601590a0 2023-12-24T18:48:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f355e7fc700 1 -- 172.21.15.50:0/1945399220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580092e0 con 0x7f35601590a0 2023-12-24T18:48:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 -- 172.21.15.50:0/1945399220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35601590a0 msgr2=0x7f356006c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 --2- 172.21.15.50:0/1945399220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35601590a0 0x7f356006c0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3558009f20 tx=0x7f3558009840 comp rx=0 tx=0).stop 2023-12-24T18:48:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 -- 172.21.15.50:0/1945399220 shutdown_connections 2023-12-24T18:48:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 --2- 172.21.15.50:0/1945399220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35601590a0 0x7f356006c0c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 -- 172.21.15.50:0/1945399220 >> 172.21.15.50:0/1945399220 conn(0x7f3560067b80 msgr2=0x7f35600cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 -- 172.21.15.50:0/1945399220 shutdown_connections 2023-12-24T18:48:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.521+0000 7f3564ce3700 1 -- 172.21.15.50:0/1945399220 wait complete. 2023-12-24T18:48:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 Processor -- start 2023-12-24T18:48:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 -- start start 2023-12-24T18:48:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 0x7f3560155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 0x7f35601463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560156af0 con 0x7f3560158cd0 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560159f60 con 0x7f35601590a0 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f3564ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356015a240 con 0x7f356006b6c0 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f355effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f355effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48724/0 (socket says 172.21.15.50:48724) 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f355effd700 1 -- 172.21.15.50:0/2393172504 learned_addr learned my addr 172.21.15.50:0/2393172504 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f355ffff700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 0x7f35601463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.525+0000 7f355f7fe700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 0x7f3560155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.532 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.529+0000 7fca66bcc000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:48:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 msgr2=0x7f3560155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 0x7f3560155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 msgr2=0x7f3560159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 -- 172.21.15.50:0/2393172504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009ae0 con 0x7f35601590a0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355effd700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355f7fe700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 0x7f3560155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f355ffff700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 0x7f35601463c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3558015000 tx=0x7f3558018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558007d80 con 0x7f35601590a0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558025460 con 0x7f35601590a0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558025820 con 0x7f35601590a0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35601564a0 con 0x7f35601590a0 2023-12-24T18:48:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3560146900 con 0x7f35601590a0 2023-12-24T18:48:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.529+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356004be40 con 0x7f35601590a0 2023-12-24T18:48:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.533+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7f3558025bd0 con 0x7f35601590a0 2023-12-24T18:48:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.533+0000 7f35577fe700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 0x7f3540062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.533+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f355807e790 con 0x7f35601590a0 2023-12-24T18:48:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.533+0000 7f355f7fe700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 msgr2=0x7f3540062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.533+0000 7f355f7fe700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 0x7f3540062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.541+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f355804e590 con 0x7f35601590a0 2023-12-24T18:48:52.586 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:52.582+0000 7faf74143000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:48:52.628 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.625+0000 7fca66bcc000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:48:52.678 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:52.674+0000 7faf74143000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:48:52.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.737+0000 7f355f7fe700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 msgr2=0x7f3540062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:52.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.737+0000 7f355f7fe700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 0x7f3540062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:52.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.753+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356015a380 con 0x7f35601590a0 2023-12-24T18:48:52.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.753+0000 7f35577fe700 1 -- 172.21.15.50:0/2393172504 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f3558057090 con 0x7f35601590a0 2023-12-24T18:48:52.757 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:52.757 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:37:31.150863+0000","modified":"2023-12-24T18:37:34.742125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5077},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5077":{"gid":5077,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6834/168523974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":168523974},{"type":"v1","addr":"172.21.15.82:6834","nonce":168523974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T18:48:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 msgr2=0x7f3540062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 0x7f3540062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 msgr2=0x7f35601463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 0x7f35601463c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3558015000 tx=0x7f3558018000 comp rx=0 tx=0).stop 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 shutdown_connections 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f3540060700 0x7f3540062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35601590a0 0x7f35601463c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3560158cd0 0x7f3560159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 --2- 172.21.15.50:0/2393172504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f356006b6c0 0x7f3560155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 >> 172.21.15.50:0/2393172504 conn(0x7f3560067b80 msgr2=0x7f35600ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 shutdown_connections 2023-12-24T18:48:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.757+0000 7f3564ce3700 1 -- 172.21.15.50:0/2393172504 wait complete. 2023-12-24T18:48:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-24T18:48:52.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:48:52.837 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.833+0000 7fca66bcc000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:48:52.936 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:52.933+0000 7fca66bcc000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:48:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 Processor -- start 2023-12-24T18:48:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 -- start start 2023-12-24T18:48:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff19c158e00 0x7ff19c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 0x7ff19c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06b640 con 0x7ff19c06a580 2023-12-24T18:48:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c159710 con 0x7ff19c158e00 2023-12-24T18:48:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.945+0000 7ff1a25cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0b5e10 con 0x7ff19c06d8c0 2023-12-24T18:48:52.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff19c158e00 0x7ff19c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a1dcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff19c06a580 0x7ff19c06c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38074/0 (socket says 172.21.15.50:38074) 2023-12-24T18:48:52.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a1dcb700 1 -- 172.21.15.50:0/1794807307 learned_addr learned my addr 172.21.15.50:0/1794807307 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:52.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a0dc9700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 0x7ff19c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff193fff700 1 -- 172.21.15.50:0/1794807307 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092818043 0 0) 0x7ff19c06b640 con 0x7ff19c06a580 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff193fff700 1 -- 172.21.15.50:0/1794807307 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff188003570 con 0x7ff19c06a580 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 -- 172.21.15.50:0/1794807307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 msgr2=0x7ff19c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 0x7ff19c0b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 -- 172.21.15.50:0/1794807307 >> v1:172.21.15.50:6789/0 conn(0x7ff19c06a580 legacy=0x7ff19c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 -- 172.21.15.50:0/1794807307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c06b8e0 con 0x7ff19c158e00 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a0dc9700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 0x7ff19c0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a15ca700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c158e00 0x7ff19c1591d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff1980098e0 tx=0x7ff1980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15fe16a56147203 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff193fff700 1 -- 172.21.15.50:0/1794807307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011630 con 0x7ff19c158e00 2023-12-24T18:48:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff193fff700 1 -- 172.21.15.50:0/1794807307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198011790 con 0x7ff19c158e00 2023-12-24T18:48:52.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff193fff700 1 -- 172.21.15.50:0/1794807307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011b30 con 0x7ff19c158e00 2023-12-24T18:48:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a25cc700 1 -- 172.21.15.50:0/1794807307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c158e00 msgr2=0x7ff19c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.949+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c158e00 0x7ff19c1591d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff1980098e0 tx=0x7ff1980091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 -- 172.21.15.50:0/1794807307 shutdown_connections 2023-12-24T18:48:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06d8c0 0x7ff19c0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/1794807307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c158e00 0x7ff19c1591d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 -- 172.21.15.50:0/1794807307 >> 172.21.15.50:0/1794807307 conn(0x7ff19c067b80 msgr2=0x7ff19c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 -- 172.21.15.50:0/1794807307 shutdown_connections 2023-12-24T18:48:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 -- 172.21.15.50:0/1794807307 wait complete. 2023-12-24T18:48:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 Processor -- start 2023-12-24T18:48:52.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.953+0000 7ff1a25cc700 1 -- start start 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06a580 0x7ff19c140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c158e00 0x7ff19c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0abeb0 con 0x7ff19c06d8c0 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c15f8b0 con 0x7ff19c158e00 2023-12-24T18:48:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c15f2f0 con 0x7ff19c06a580 2023-12-24T18:48:52.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48746/0 (socket says 172.21.15.50:48746) 2023-12-24T18:48:52.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 -- 172.21.15.50:0/4139664916 learned_addr learned my addr 172.21.15.50:0/4139664916 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:52.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a15ca700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06a580 0x7ff19c140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a1dcb700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c158e00 0x7ff19c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 -- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06a580 msgr2=0x7ff19c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06a580 0x7ff19c140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 -- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c158e00 msgr2=0x7ff19c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c158e00 0x7ff19c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 -- 172.21.15.50:0/4139664916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009420 con 0x7ff19c06d8c0 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a0dc9700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00ecb0 tx=0x7ff18c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00c920 con 0x7ff19c06d8c0 2023-12-24T18:48:52.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00ca80 con 0x7ff19c06d8c0 2023-12-24T18:48:52.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198009420 con 0x7ff19c06d8c0 2023-12-24T18:48:52.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00ce00 con 0x7ff19c06d8c0 2023-12-24T18:48:52.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.957+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c0abbc0 con 0x7ff19c06d8c0 2023-12-24T18:48:52.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c0ac060 con 0x7ff19c06d8c0 2023-12-24T18:48:52.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7ff18c013680 con 0x7ff19c06d8c0 2023-12-24T18:48:52.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1917fa700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 0x7ff180062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:52.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7ff18c07d220 con 0x7ff19c06d8c0 2023-12-24T18:48:52.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1a15ca700 1 -- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 msgr2=0x7ff180062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:52.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.961+0000 7ff1a15ca700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 0x7ff180062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:52.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:52.969+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff19c0ac060 con 0x7ff19c06d8c0 2023-12-24T18:48:53.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.149+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff19c0ac060 con 0x7ff19c06d8c0 2023-12-24T18:48:53.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.149+0000 7ff1917fa700 1 -- 172.21.15.50:0/4139664916 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16808 (secure 0 0 0) 0x7ff19c0ac060 con 0x7ff19c06d8c0 2023-12-24T18:48:53.153 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:48:53.153 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:48:49.554538+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:37:29.511270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-24T18:37:30.174885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1014312647":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/49267815":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1062942176":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6833/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:6832/33814":"2023-12-25T18:37:50.171710+0000","172.21.15.50:0/1890246914":"2023-12-25T18:37:50.171710+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":24,"length":2},{"begin":37,"length":8},{"begin":52,"length":1},{"begin":54,"length":5},{"begin":63,"length":1},{"begin":67,"length":7},{"begin":77,"length":1},{"begin":85,"length":2},{"begin":90,"length":1},{"begin":96,"length":1},{"begin":105,"length":1},{"begin":110,"length":1},{"begin":216,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:48:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 msgr2=0x7ff180062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 0x7ff180062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 msgr2=0x7ff19c15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00ecb0 tx=0x7ff18c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 shutdown_connections 2023-12-24T18:48:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff180060700 0x7ff180062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c158e00 0x7ff19c0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff19c06d8c0 0x7ff19c15e8a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 --2- 172.21.15.50:0/4139664916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff19c06a580 0x7ff19c140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 >> 172.21.15.50:0/4139664916 conn(0x7ff19c067b80 msgr2=0x7ff19c158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 shutdown_connections 2023-12-24T18:48:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.153+0000 7ff1a25cc700 1 -- 172.21.15.50:0/4139664916 wait complete. 2023-12-24T18:48:53.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:48:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 Processor -- start 2023-12-24T18:48:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 -- start start 2023-12-24T18:48:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc17415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1740b3c90 0x7fc17406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1740b1ba0 0x7fc1740b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740b49c0 con 0x7fc1740b3c90 2023-12-24T18:48:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17406d040 con 0x7fc1740b1ba0 2023-12-24T18:48:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc17bd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b2560 con 0x7fc174158e10 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc179320700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1740b3c90 0x7fc17406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc179320700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1740b3c90 0x7fc17406da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48758/0 (socket says 172.21.15.50:48758) 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.341+0000 7fc179320700 1 -- 172.21.15.50:0/3923355367 learned_addr learned my addr 172.21.15.50:0/3923355367 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179b21700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc17415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17a322700 1 --2- 172.21.15.50:0/3923355367 >> v2:172.21.15.82:3300/0 conn(0x7fc1740b1ba0 0x7fc1740b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 -- 172.21.15.50:0/3923355367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 msgr2=0x7fc17415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc17415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 -- 172.21.15.50:0/3923355367 >> v2:172.21.15.82:3300/0 conn(0x7fc1740b1ba0 msgr2=0x7fc1740b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 --2- 172.21.15.50:0/3923355367 >> v2:172.21.15.82:3300/0 conn(0x7fc1740b1ba0 0x7fc1740b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 -- 172.21.15.50:0/3923355367 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17406d5c0 con 0x7fc1740b3c90 2023-12-24T18:48:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc179320700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17406da50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b2bb0 tx=0x7fc164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728112f526049784 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc178b1f700 1 -- 172.21.15.50:0/3923355367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400b640 con 0x7fc1740b3c90 2023-12-24T18:48:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc178b1f700 1 -- 172.21.15.50:0/3923355367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400b7a0 con 0x7fc1740b3c90 2023-12-24T18:48:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc178b1f700 1 -- 172.21.15.50:0/3923355367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400bb60 con 0x7fc1740b3c90 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 -- 172.21.15.50:0/3923355367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 msgr2=0x7fc17406da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17406da50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b2bb0 tx=0x7fc164009250 comp rx=0 tx=0).stop 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 -- 172.21.15.50:0/3923355367 shutdown_connections 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 --2- 172.21.15.50:0/3923355367 >> v2:172.21.15.82:3300/0 conn(0x7fc1740b1ba0 0x7fc1740b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17406da50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 --2- 172.21.15.50:0/3923355367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc17415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 -- 172.21.15.50:0/3923355367 >> 172.21.15.50:0/3923355367 conn(0x7fc1740670b0 msgr2=0x7fc1740674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 -- 172.21.15.50:0/3923355367 shutdown_connections 2023-12-24T18:48:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.345+0000 7fc17bd85700 1 -- 172.21.15.50:0/3923355367 wait complete. 2023-12-24T18:48:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 Processor -- start 2023-12-24T18:48:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 -- start start 2023-12-24T18:48:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1740b1ba0 0x7fc17416cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc1741591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415aae0 con 0x7fc1740b3c90 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174159ed0 con 0x7fc1740b1ba0 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.349+0000 7fc17bd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415a1b0 con 0x7fc174158e10 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48770/0 (socket says 172.21.15.50:48770) 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 -- 172.21.15.50:0/1838223005 learned_addr learned my addr 172.21.15.50:0/1838223005 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179b21700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1740b1ba0 0x7fc17416cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc17a322700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc1741591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 msgr2=0x7fc1741591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc1741591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1740b1ba0 msgr2=0x7fc17416cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1740b1ba0 0x7fc17416cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 -- 172.21.15.50:0/1838223005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640094f0 con 0x7fc1740b3c90 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc179320700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc1640094c0 tx=0x7fc164017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164000d10 con 0x7fc1740b3c90 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400b910 con 0x7fc1740b3c90 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17415a490 con 0x7fc1740b3c90 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164026430 con 0x7fc1740b3c90 2023-12-24T18:48:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.353+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174151970 con 0x7fc1740b3c90 2023-12-24T18:48:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc174151b90 con 0x7fc1740b3c90 2023-12-24T18:48:53.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) v1 ==== 80132+0+0 (secure 0 0 0) 0x7fc164023030 con 0x7fc1740b3c90 2023-12-24T18:48:53.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc169ffb700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 0x7fc158062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fc16407e780 con 0x7fc1740b3c90 2023-12-24T18:48:53.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc179b21700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 msgr2=0x7fc158062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:53.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.357+0000 7fc179b21700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 0x7fc158062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:48:53.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.365+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc16404e760 con 0x7fc1740b3c90 2023-12-24T18:48:53.410 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:48:53.406+0000 7faf74143000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:48:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.561+0000 7fc179b21700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 msgr2=0x7fc158062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:48:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.561+0000 7fc179b21700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 0x7fc158062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:48:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.569+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1740652e0 con 0x7fc1740b3c90 2023-12-24T18:48:53.575 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:48:53.573+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:48:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.577+0000 7fc169ffb700 1 -- 172.21.15.50:0/1838223005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc164051c80 con 0x7fc1740b3c90 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 msgr2=0x7fc158062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 0x7fc158062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 msgr2=0x7fc17416d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc1640094c0 tx=0x7fc164017000 comp rx=0 tx=0).stop 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 shutdown_connections 2023-12-24T18:48:53.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc158060700 0x7fc158062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc174158e10 0x7fc1741591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1740b3c90 0x7fc17416d100 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 --2- 172.21.15.50:0/1838223005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1740b1ba0 0x7fc17416cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.581+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 >> 172.21.15.50:0/1838223005 conn(0x7fc1740670b0 msgr2=0x7fc174152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.585+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 shutdown_connections 2023-12-24T18:48:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.585+0000 7fc17bd85700 1 -- 172.21.15.50:0/1838223005 wait complete. 2023-12-24T18:48:53.588 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:48:53.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:48:53.654 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:48:53.727 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.725+0000 7fca66bcc000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:48:53.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.757+0000 7f3a6f59e700 1 Processor -- start 2023-12-24T18:48:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.757+0000 7f3a6f59e700 1 -- start start 2023-12-24T18:48:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a700c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700c9ea0 con 0x7f3a700bebc0 2023-12-24T18:48:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7015d840 con 0x7f3a700ab920 2023-12-24T18:48:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70161780 con 0x7f3a700c8ee0 2023-12-24T18:48:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a700bebc0 0x7f3a70160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38080/0 (socket says 172.21.15.50:38080) 2023-12-24T18:48:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6e59c700 1 -- 172.21.15.50:0/2214998536 learned_addr learned my addr 172.21.15.50:0/2214998536 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6ed9d700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a700c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829912201 0 0) 0x7f3a700c9ea0 con 0x7f3a700bebc0 2023-12-24T18:48:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c003570 con 0x7f3a700bebc0 2023-12-24T18:48:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352792449 0 0) 0x7f3a7015d840 con 0x7f3a700ab920 2023-12-24T18:48:53.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a700c9ea0 con 0x7f3a700ab920 2023-12-24T18:48:53.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905785888 0 0) 0x7f3a5c003570 con 0x7f3a700bebc0 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 msgr2=0x7f3a700c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a700c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 >> v1:172.21.15.82:6789/0 conn(0x7f3a700ab920 legacy=0x7f3a700c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a70161a60 con 0x7f3a700bebc0 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f3a60001470 con 0x7f3a700bebc0 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 >> v1:172.21.15.50:6789/0 conn(0x7f3a700bebc0 legacy=0x7f3a70160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c003c20 0x7f3a5c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a5c004810 0x7f3a5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70161780 con 0x7f3a5c004810 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00bb40 con 0x7f3a5c003c20 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00bd00 con 0x7f3a700c8ee0 2023-12-24T18:48:53.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.761+0000 7f3a67fff700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a5c004810 0x7f3a5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6e59c700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c003c20 0x7f3a5c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6ed9d700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 -- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 msgr2=0x7f3a5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700c8ee0 0x7f3a5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 -- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c003c20 msgr2=0x7f3a5c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c003c20 0x7f3a5c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 -- 172.21.15.50:0/2214998536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c003570 con 0x7f3a5c004810 2023-12-24T18:48:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6e59c700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c003c20 0x7f3a5c004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a67fff700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a5c004810 0x7f3a5c004c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3a58001a10 tx=0x7f3a58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175b348fec433b3c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800c5d0 con 0x7f3a5c004810 2023-12-24T18:48:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800c730 con 0x7f3a5c004810 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6dd9b700 1 -- 172.21.15.50:0/2214998536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800cad0 con 0x7f3a5c004810 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2214998536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a5c004810 msgr2=0x7f3a5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 --2- 172.21.15.50:0/2214998536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a5c004810 0x7f3a5c004c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3a58001a10 tx=0x7f3a58007d30 comp rx=0 tx=0).stop 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6ed9d700 1 -- 172.21.15.50:0/2214998536 reap_dead start 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2214998536 shutdown_connections 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2214998536 >> 172.21.15.50:0/2214998536 conn(0x7f3a70067250 msgr2=0x7f3a70067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2214998536 shutdown_connections 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.765+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2214998536 wait complete. 2023-12-24T18:48:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 Processor -- start 2023-12-24T18:48:53.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 -- start start 2023-12-24T18:48:53.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c004810 0x7f3a7015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700ac750 0x7f3a701593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7015da20 con 0x7f3a701598f0 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700acf60 con 0x7f3a5c004810 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700ad240 con 0x7f3a700ac750 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48810/0 (socket says 172.21.15.50:48810) 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 -- 172.21.15.50:0/2408890550 learned_addr learned my addr 172.21.15.50:0/2408890550 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a67fff700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700ac750 0x7f3a701593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6e59c700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c004810 0x7f3a7015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 -- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700ac750 msgr2=0x7f3a701593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700ac750 0x7f3a701593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 -- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c004810 msgr2=0x7f3a7015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c004810 0x7f3a7015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.769+0000 7f3a6ed9d700 1 -- 172.21.15.50:0/2408890550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700ad520 con 0x7f3a701598f0 2023-12-24T18:48:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a6ed9d700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a70067fa0 tx=0x7f3a6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800e070 con 0x7f3a701598f0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68011b80 con 0x7f3a701598f0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68016470 con 0x7f3a701598f0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7015dc70 con 0x7f3a701598f0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a700acba0 con 0x7f3a701598f0 2023-12-24T18:48:53.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7015de60 con 0x7f3a701598f0 2023-12-24T18:48:53.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.773+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f3a68016860 con 0x7f3a701598f0 2023-12-24T18:48:53.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.777+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7047+0+0 (secure 0 0 0) 0x7f3a6807d230 con 0x7f3a701598f0 2023-12-24T18:48:53.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:53.785+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3a6804d630 con 0x7f3a701598f0 2023-12-24T18:48:53.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca3180b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca3180b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca3180b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca3180b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca3180b700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca2f006700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca2f006700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca2f006700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca2f006700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:53.842 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:48:53.837+0000 7fca2f006700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:48:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.005+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a7004be40 con 0x7f3a701598f0 2023-12-24T18:48:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.649+0000 7f3a667fc700 1 -- 172.21.15.50:0/2408890550 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a68050c50 con 0x7f3a701598f0 2023-12-24T18:48:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 msgr2=0x7f3a70159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a70067fa0 tx=0x7f3a6800b040 comp rx=0 tx=0).stop 2023-12-24T18:48:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 shutdown_connections 2023-12-24T18:48:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a701598f0 0x7f3a70159d60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a700ac750 0x7f3a701593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 --2- 172.21.15.50:0/2408890550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c004810 0x7f3a7015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 >> 172.21.15.50:0/2408890550 conn(0x7f3a70067250 msgr2=0x7f3a700caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 shutdown_connections 2023-12-24T18:48:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.653+0000 7f3a6f59e700 1 -- 172.21.15.50:0/2408890550 wait complete. 2023-12-24T18:48:54.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:48:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.869+0000 7f775c8a5700 1 Processor -- start 2023-12-24T18:48:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.869+0000 7f775c8a5700 1 -- start start 2023-12-24T18:48:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775c8a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77581590c0 0x7f775806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775c8a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f775806a730 0x7f775806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775c8a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580b3660 con 0x7f77580b4700 2023-12-24T18:48:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775c8a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775806b110 con 0x7f775806a730 2023-12-24T18:48:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775c8a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77580b3940 con 0x7f77581590c0 2023-12-24T18:48:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f775806a730 0x7f775806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f775806a730 0x7f775806abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48908/0 (socket says 172.21.15.50:48908) 2023-12-24T18:48:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7755d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f77580b4700 0x7f77580b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35122/0 (socket says 172.21.15.50:35122) 2023-12-24T18:48:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 -- 172.21.15.50:0/1730163960 learned_addr learned my addr 172.21.15.50:0/1730163960 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775659c700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77581590c0 0x7f775806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 -- 172.21.15.50:0/1730163960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77581590c0 msgr2=0x7f775806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77581590c0 0x7f775806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 -- 172.21.15.50:0/1730163960 >> v1:172.21.15.82:6789/0 conn(0x7f77580b4700 legacy=0x7f77580b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f7756d9d700 1 -- 172.21.15.50:0/1730163960 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580b3c20 con 0x7f775806a730 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.873+0000 7f775559a700 1 -- 172.21.15.50:0/1730163960 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293752281 0 0) 0x7f77580b3660 con 0x7f77580b4700 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f7756d9d700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f775806abd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7750009f20 tx=0x7f7750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83a96a83c0b96f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775559a700 1 -- 172.21.15.50:0/1730163960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000e070 con 0x7f775806a730 2023-12-24T18:48:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775559a700 1 -- 172.21.15.50:0/1730163960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000b9d0 con 0x7f775806a730 2023-12-24T18:48:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775559a700 1 -- 172.21.15.50:0/1730163960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77500092e0 con 0x7f775806a730 2023-12-24T18:48:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 -- 172.21.15.50:0/1730163960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 msgr2=0x7f775806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f775806abd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7750009f20 tx=0x7f7750009840 comp rx=0 tx=0).stop 2023-12-24T18:48:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 -- 172.21.15.50:0/1730163960 shutdown_connections 2023-12-24T18:48:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f775806abd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1730163960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77581590c0 0x7f775806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 -- 172.21.15.50:0/1730163960 >> 172.21.15.50:0/1730163960 conn(0x7f7758067b40 msgr2=0x7f77580b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 -- 172.21.15.50:0/1730163960 shutdown_connections 2023-12-24T18:48:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.877+0000 7f775c8a5700 1 -- 172.21.15.50:0/1730163960 wait complete. 2023-12-24T18:48:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 Processor -- start 2023-12-24T18:48:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 -- start start 2023-12-24T18:48:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77580b4700 0x7f775813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 0x7f775814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775814d8b0 con 0x7f775806a730 2023-12-24T18:48:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7758159c80 con 0x7f77581590c0 2023-12-24T18:48:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775c8a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775813ff90 con 0x7f77580b4700 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48922/0 (socket says 172.21.15.50:48922) 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 -- 172.21.15.50:0/1482685556 learned_addr learned my addr 172.21.15.50:0/1482685556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f7755d9b700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77580b4700 0x7f775813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f7756d9d700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 0x7f775814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 -- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77580b4700 msgr2=0x7f775813fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77580b4700 0x7f775813fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 -- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 msgr2=0x7f775814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 0x7f775814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f775659c700 1 -- 172.21.15.50:0/1482685556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009ae0 con 0x7f775806a730 2023-12-24T18:48:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.881+0000 7f7756d9d700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 0x7f775814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f775659c700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f774800e930 tx=0x7f77480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748013680 con 0x7f775806a730 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77480137e0 con 0x7f775806a730 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748013b80 con 0x7f775806a730 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775814d5d0 con 0x7f775806a730 2023-12-24T18:48:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7758159910 con 0x7f775806a730 2023-12-24T18:48:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.885+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7758159490 con 0x7f775806a730 2023-12-24T18:48:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.889+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f774800c400 con 0x7f775806a730 2023-12-24T18:48:54.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.889+0000 7f77467fc700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 0x7f7738062880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:54.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.889+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7047+0+0 (secure 0 0 0) 0x7f774807cba0 con 0x7f775806a730 2023-12-24T18:48:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.889+0000 7f7755d9b700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 0x7f7738062880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.893+0000 7f7755d9b700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 0x7f7738062880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77580b3500 tx=0x7f774c007d50 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:54.897+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7758159490 con 0x7f775806a730 2023-12-24T18:48:55.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.069+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7758159490 con 0x7f775806a730 2023-12-24T18:48:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.765+0000 7f77467fc700 1 -- 172.21.15.50:0/1482685556 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7758159490 con 0x7f775806a730 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 msgr2=0x7f7738062880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 0x7f7738062880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77580b3500 tx=0x7f774c007d50 comp rx=0 tx=0).stop 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 msgr2=0x7f7758150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f774800e930 tx=0x7f77480091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 shutdown_connections 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f77380603d0 0x7f7738062880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77581590c0 0x7f775814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77580b4700 0x7f775813fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 --2- 172.21.15.50:0/1482685556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775806a730 0x7f7758150560 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 >> 172.21.15.50:0/1482685556 conn(0x7f7758067b40 msgr2=0x7f77580b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 shutdown_connections 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.769+0000 7f775c8a5700 1 -- 172.21.15.50:0/1482685556 wait complete. 2023-12-24T18:48:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:48:55.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:48:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 Processor -- start 2023-12-24T18:48:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 -- start start 2023-12-24T18:48:55.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37ac158dd0 0x7f37ac1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac06aa80 con 0x7f37ac0cbbe0 2023-12-24T18:48:55.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac0cc0b0 con 0x7f37ac158dd0 2023-12-24T18:48:55.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b2bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0cc390 con 0x7f37ac0b2cf0 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.969+0000 7f37b1bca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37ac158dd0 0x7f37ac1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b13c9700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37ac158dd0 0x7f37ac1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48930/0 (socket says 172.21.15.50:48930) 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b23cb700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f37ac0cbbe0 0x7f37ac0ce470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35136/0 (socket says 172.21.15.50:35136) 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 -- 172.21.15.50:0/3876141546 learned_addr learned my addr 172.21.15.50:0/3876141546 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 -- 172.21.15.50:0/3876141546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 msgr2=0x7f37ac0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 --2- 172.21.15.50:0/3876141546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 -- 172.21.15.50:0/3876141546 >> v1:172.21.15.82:6789/0 conn(0x7f37ac0cbbe0 legacy=0x7f37ac0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 -- 172.21.15.50:0/3876141546 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac06a430 con 0x7f37ac158dd0 2023-12-24T18:48:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b0bc8700 1 -- 172.21.15.50:0/3876141546 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392196743 0 0) 0x7f37ac06aa80 con 0x7f37ac0cbbe0 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b1bca700 1 --2- 172.21.15.50:0/3876141546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac1591a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f37a80099e0 tx=0x7f37a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f7cd4c67b03845 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b0bc8700 1 -- 172.21.15.50:0/3876141546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a800b820 con 0x7f37ac158dd0 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b0bc8700 1 -- 172.21.15.50:0/3876141546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a800b980 con 0x7f37ac158dd0 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b0bc8700 1 -- 172.21.15.50:0/3876141546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a800bd20 con 0x7f37ac158dd0 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 -- 172.21.15.50:0/3876141546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 msgr2=0x7f37ac1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/3876141546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac1591a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f37a80099e0 tx=0x7f37a8009250 comp rx=0 tx=0).stop 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 -- 172.21.15.50:0/3876141546 shutdown_connections 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/3876141546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/3876141546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac1591a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 -- 172.21.15.50:0/3876141546 >> 172.21.15.50:0/3876141546 conn(0x7f37ac067b80 msgr2=0x7f37ac0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 -- 172.21.15.50:0/3876141546 shutdown_connections 2023-12-24T18:48:55.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.973+0000 7f37b2bcc700 1 -- 172.21.15.50:0/3876141546 wait complete. 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 Processor -- start 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 -- start start 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 0x7f37ac169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0c7d10 con 0x7f37ac158dd0 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac169b60 con 0x7f37ac0cbbe0 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b2bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0c9d10 con 0x7f37ac0b2cf0 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b23cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b23cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48944/0 (socket says 172.21.15.50:48944) 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b23cb700 1 -- 172.21.15.50:0/917460135 learned_addr learned my addr 172.21.15.50:0/917460135 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b13c9700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 0x7f37ac169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.977+0000 7f37b1bca700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 -- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 msgr2=0x7f37ac0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 -- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 msgr2=0x7f37ac169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 0x7f37ac169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 -- 172.21.15.50:0/917460135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80094f0 con 0x7f37ac158dd0 2023-12-24T18:48:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b13c9700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 0x7f37ac169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b23cb700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37a400cd50 tx=0x7f37a4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400ce50 con 0x7f37ac158dd0 2023-12-24T18:48:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4005df0 con 0x7f37ac158dd0 2023-12-24T18:48:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400aaa0 con 0x7f37ac158dd0 2023-12-24T18:48:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac16a600 con 0x7f37ac158dd0 2023-12-24T18:48:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.981+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac16a040 con 0x7f37ac158dd0 2023-12-24T18:48:55.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac0c7a70 con 0x7f37ac158dd0 2023-12-24T18:48:55.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f37a40070f0 con 0x7f37ac158dd0 2023-12-24T18:48:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37a1ffb700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 0x7f3790062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6609+0+0 (secure 0 0 0) 0x7f37a407c830 con 0x7f37ac158dd0 2023-12-24T18:48:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37b1bca700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 0x7f3790062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.985+0000 7f37b1bca700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 0x7f3790062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f37a80099e0 tx=0x7f37a8017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:55.993+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f37ac0c7a70 con 0x7f37ac158dd0 2023-12-24T18:48:56.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.165+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37ac0c7e50 con 0x7f37ac158dd0 2023-12-24T18:48:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.653+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f37a404d0c0 con 0x7f37ac158dd0 2023-12-24T18:48:56.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.777+0000 7f37a1ffb700 1 -- 172.21.15.50:0/917460135 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f37a4050310 con 0x7f37ac158dd0 2023-12-24T18:48:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 msgr2=0x7f3790062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 0x7f3790062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f37a80099e0 tx=0x7f37a8017000 comp rx=0 tx=0).stop 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 msgr2=0x7f37ac0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37a400cd50 tx=0x7f37a4001ae0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 shutdown_connections 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f37900603a0 0x7f3790062850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37ac158dd0 0x7f37ac0c97d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37ac0cbbe0 0x7f37ac169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 --2- 172.21.15.50:0/917460135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37ac0b2cf0 0x7f37ac0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 >> 172.21.15.50:0/917460135 conn(0x7f37ac067b80 msgr2=0x7f37ac15c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 shutdown_connections 2023-12-24T18:48:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.781+0000 7f37b2bcc700 1 -- 172.21.15.50:0/917460135 wait complete. 2023-12-24T18:48:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:48:56.807 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:48:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.977+0000 7fcd2ac2e700 1 Processor -- start 2023-12-24T18:48:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.977+0000 7fcd2ac2e700 1 -- start start 2023-12-24T18:48:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd2ac2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd24159080 0x7fcd240cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd2ac2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd2415d350 0x7fcd24067440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd2ac2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd240cbee0 con 0x7fcd2406dbf0 2023-12-24T18:48:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd2ac2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2406cb50 con 0x7fcd2415d350 2023-12-24T18:48:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd2ac2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2406ce30 con 0x7fcd24159080 2023-12-24T18:48:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd2415d350 0x7fcd24067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd2415d350 0x7fcd24067440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48960/0 (socket says 172.21.15.50:48960) 2023-12-24T18:48:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 -- 172.21.15.50:0/3859839559 learned_addr learned my addr 172.21.15.50:0/3859839559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd289ca700 1 --2- 172.21.15.50:0/3859839559 >> v2:172.21.15.82:3300/0 conn(0x7fcd24159080 0x7fcd240cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 -- 172.21.15.50:0/3859839559 >> v2:172.21.15.82:3300/0 conn(0x7fcd24159080 msgr2=0x7fcd240cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 --2- 172.21.15.50:0/3859839559 >> v2:172.21.15.82:3300/0 conn(0x7fcd24159080 0x7fcd240cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 -- 172.21.15.50:0/3859839559 >> v1:172.21.15.82:6789/0 conn(0x7fcd2406dbf0 legacy=0x7fcd2415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd237fe700 1 -- 172.21.15.50:0/3859839559 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450684526 0 0) 0x7fcd240cbee0 con 0x7fcd2406dbf0 2023-12-24T18:48:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.981+0000 7fcd291cb700 1 -- 172.21.15.50:0/3859839559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2406d110 con 0x7fcd2415d350 2023-12-24T18:48:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd291cb700 1 --2- 172.21.15.50:0/3859839559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd24067440 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcd2406bd70 tx=0x7fcd1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952c87756832ad06 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd237fe700 1 -- 172.21.15.50:0/3859839559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00e070 con 0x7fcd2415d350 2023-12-24T18:48:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd237fe700 1 -- 172.21.15.50:0/3859839559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00ba20 con 0x7fcd2415d350 2023-12-24T18:48:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd237fe700 1 -- 172.21.15.50:0/3859839559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0092e0 con 0x7fcd2415d350 2023-12-24T18:48:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/3859839559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 msgr2=0x7fcd24067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/3859839559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd24067440 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcd2406bd70 tx=0x7fcd1c009840 comp rx=0 tx=0).stop 2023-12-24T18:48:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/3859839559 shutdown_connections 2023-12-24T18:48:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/3859839559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd24067440 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/3859839559 >> v2:172.21.15.82:3300/0 conn(0x7fcd24159080 0x7fcd240cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/3859839559 >> 172.21.15.50:0/3859839559 conn(0x7fcd240cddd0 msgr2=0x7fcd240ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/3859839559 shutdown_connections 2023-12-24T18:48:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.985+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/3859839559 wait complete. 2023-12-24T18:48:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 Processor -- start 2023-12-24T18:48:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 -- start start 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd2406dbf0 0x7fcd240b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd24159080 0x7fcd240b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240b1e60 con 0x7fcd2415d350 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240b15f0 con 0x7fcd24159080 2023-12-24T18:48:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd2ac2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240b18a0 con 0x7fcd2406dbf0 2023-12-24T18:48:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd291cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd291cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48964/0 (socket says 172.21.15.50:48964) 2023-12-24T18:48:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd289ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd2406dbf0 0x7fcd240b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd291cb700 1 -- 172.21.15.50:0/2717103976 learned_addr learned my addr 172.21.15.50:0/2717103976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.989+0000 7fcd23fff700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd24159080 0x7fcd240b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 -- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd2406dbf0 msgr2=0x7fcd240b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd2406dbf0 0x7fcd240b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 -- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd24159080 msgr2=0x7fcd240b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd24159080 0x7fcd240b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 -- 172.21.15.50:0/2717103976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c009ae0 con 0x7fcd2415d350 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd291cb700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009880 tx=0x7fcd1c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c008a80 con 0x7fcd2415d350 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c008c00 con 0x7fcd2415d350 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd240b1b80 con 0x7fcd2415d350 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c026460 con 0x7fcd2415d350 2023-12-24T18:48:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2415a9a0 con 0x7fcd2415d350 2023-12-24T18:48:56.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.993+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd240652e0 con 0x7fcd2415d350 2023-12-24T18:48:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.997+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcd1c003040 con 0x7fcd2415d350 2023-12-24T18:48:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.997+0000 7fcd20ff9700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 0x7fcd08062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.997+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fcd1c07e790 con 0x7fcd2415d350 2023-12-24T18:48:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:56.997+0000 7fcd289ca700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 0x7fcd08062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.001+0000 7fcd289ca700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 0x7fcd08062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009db0 tx=0x7fcd180091a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.005+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd1c04ebb0 con 0x7fcd2415d350 2023-12-24T18:48:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.177+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fcd2406d3f0 con 0x7fcd2415d350 2023-12-24T18:48:57.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.189+0000 7fcd20ff9700 1 -- 172.21.15.50:0/2717103976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcd1c009940 con 0x7fcd2415d350 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 msgr2=0x7fcd08062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 0x7fcd08062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009db0 tx=0x7fcd180091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 msgr2=0x7fcd2415aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009880 tx=0x7fcd1c018000 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 shutdown_connections 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd08060580 0x7fcd08062a30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd2415d350 0x7fcd2415aec0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd24159080 0x7fcd240b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 --2- 172.21.15.50:0/2717103976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd2406dbf0 0x7fcd240b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 >> 172.21.15.50:0/2717103976 conn(0x7fcd240cddd0 msgr2=0x7fcd240cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 shutdown_connections 2023-12-24T18:48:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.193+0000 7fcd2ac2e700 1 -- 172.21.15.50:0/2717103976 wait complete. 2023-12-24T18:48:57.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:48:57.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.357+0000 7f3720385700 1 Processor -- start 2023-12-24T18:48:57.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.357+0000 7f3720385700 1 -- start start 2023-12-24T18:48:57.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f3720385700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 0x7f37180b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f3720385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806c820 0x7f37180b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f3720385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37180b3fd0 con 0x7f371806a710 2023-12-24T18:48:57.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f3720385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180b33c0 con 0x7f371806c820 2023-12-24T18:48:57.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f3720385700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180b36a0 con 0x7f3718158e00 2023-12-24T18:48:57.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806c820 0x7f37180b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806c820 0x7f37180b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48970/0 (socket says 172.21.15.50:48970) 2023-12-24T18:48:57.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 -- 172.21.15.50:0/3413539924 learned_addr learned my addr 172.21.15.50:0/3413539924 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:57.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371e121700 1 --2- 172.21.15.50:0/3413539924 >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 0x7f37180b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 -- 172.21.15.50:0/3413539924 >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 msgr2=0x7f37180b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 --2- 172.21.15.50:0/3413539924 >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 0x7f37180b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 -- 172.21.15.50:0/3413539924 >> v1:172.21.15.82:6789/0 conn(0x7f371806a710 legacy=0x7f371806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 -- 172.21.15.50:0/3413539924 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180b3980 con 0x7f371806c820 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371e121700 1 --2- 172.21.15.50:0/3413539924 >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 0x7f37180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:48:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d920700 1 --2- 172.21.15.50:0/3413539924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806c820 0x7f37180b4460 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f371806f8c0 tx=0x7f3708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745c1f7cc6bfd0bc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.361+0000 7f371d11f700 1 -- 172.21.15.50:0/3413539924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708009e70 con 0x7f371806c820 2023-12-24T18:48:57.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f371d11f700 1 -- 172.21.15.50:0/3413539924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800b860 con 0x7f371806c820 2023-12-24T18:48:57.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f371d11f700 1 -- 172.21.15.50:0/3413539924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800bc00 con 0x7f371806c820 2023-12-24T18:48:57.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 -- 172.21.15.50:0/3413539924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806c820 msgr2=0x7f37180b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 --2- 172.21.15.50:0/3413539924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806c820 0x7f37180b4460 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f371806f8c0 tx=0x7f3708009250 comp rx=0 tx=0).stop 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 -- 172.21.15.50:0/3413539924 shutdown_connections 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 --2- 172.21.15.50:0/3413539924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806c820 0x7f37180b4460 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 --2- 172.21.15.50:0/3413539924 >> v2:172.21.15.82:3300/0 conn(0x7f3718158e00 0x7f37180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 -- 172.21.15.50:0/3413539924 >> 172.21.15.50:0/3413539924 conn(0x7f3718067b80 msgr2=0x7f37180cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 -- 172.21.15.50:0/3413539924 shutdown_connections 2023-12-24T18:48:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.365+0000 7f3720385700 1 -- 172.21.15.50:0/3413539924 wait complete. 2023-12-24T18:48:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 Processor -- start 2023-12-24T18:48:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 -- start start 2023-12-24T18:48:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f371806a710 0x7f371814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f371806c820 0x7f37181697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371816c4a0 con 0x7f3718158e00 2023-12-24T18:48:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371814b250 con 0x7f371806a710 2023-12-24T18:48:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f3720385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3718157200 con 0x7f371806c820 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48974/0 (socket says 172.21.15.50:48974) 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 -- 172.21.15.50:0/3791488485 learned_addr learned my addr 172.21.15.50:0/3791488485 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e121700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f371806a710 0x7f371814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371d920700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f371806c820 0x7f37181697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 -- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f371806c820 msgr2=0x7f37181697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f371806c820 0x7f37181697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 -- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f371806a710 msgr2=0x7f371814b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f371806a710 0x7f371814b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.369+0000 7f371e922700 1 -- 172.21.15.50:0/3791488485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009420 con 0x7f3718158e00 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f371e922700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f371000c840 tx=0x7f3710001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710012630 con 0x7f3718158e00 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37100127b0 con 0x7f3718158e00 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37080094f0 con 0x7f3718158e00 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710012b70 con 0x7f3718158e00 2023-12-24T18:48:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37181577c0 con 0x7f3718158e00 2023-12-24T18:48:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.373+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371816c610 con 0x7f3718158e00 2023-12-24T18:48:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.377+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f371001a3a0 con 0x7f3718158e00 2023-12-24T18:48:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.377+0000 7f370e7fc700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 0x7f36fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.377+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f371007cb60 con 0x7f3718158e00 2023-12-24T18:48:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.377+0000 7f371e121700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 0x7f36fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.377+0000 7f371e121700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 0x7f36fc062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3714009f40 tx=0x7f37140091a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.381+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f371004cee0 con 0x7f3718158e00 2023-12-24T18:48:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.557+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f37180652e0 con 0x7f3718158e00 2023-12-24T18:48:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.569+0000 7f370e7fc700 1 -- 172.21.15.50:0/3791488485 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3710050500 con 0x7f3718158e00 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 msgr2=0x7f36fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 0x7f36fc062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3714009f40 tx=0x7f37140091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 msgr2=0x7f371814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f371000c840 tx=0x7f3710001670 comp rx=0 tx=0).stop 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 shutdown_connections 2023-12-24T18:48:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f36fc060550 0x7f36fc062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718158e00 0x7f371814ad10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f371806c820 0x7f37181697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 --2- 172.21.15.50:0/3791488485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f371806a710 0x7f371814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 >> 172.21.15.50:0/3791488485 conn(0x7f3718067b80 msgr2=0x7f371814d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 shutdown_connections 2023-12-24T18:48:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.573+0000 7f3720385700 1 -- 172.21.15.50:0/3791488485 wait complete. 2023-12-24T18:48:57.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:48:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 Processor -- start 2023-12-24T18:48:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 -- start start 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3500cc780 0x7fb3500ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35006a580 con 0x7fb350158c40 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500cd110 con 0x7fb3500cc780 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356f23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35006d700 con 0x7fb35006cd40 2023-12-24T18:48:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356722700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356722700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37880/0 (socket says 172.21.15.50:37880) 2023-12-24T18:48:57.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb356722700 1 -- 172.21.15.50:0/4144613199 learned_addr learned my addr 172.21.15.50:0/4144613199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:57.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.769+0000 7fb355720700 1 --2- 172.21.15.50:0/4144613199 >> v2:172.21.15.82:3300/0 conn(0x7fb3500cc780 0x7fb3500ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356722700 1 -- 172.21.15.50:0/4144613199 >> v2:172.21.15.82:3300/0 conn(0x7fb3500cc780 msgr2=0x7fb3500ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356722700 1 --2- 172.21.15.50:0/4144613199 >> v2:172.21.15.82:3300/0 conn(0x7fb3500cc780 0x7fb3500ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356722700 1 -- 172.21.15.50:0/4144613199 >> v1:172.21.15.82:6789/0 conn(0x7fb350158c40 legacy=0x7fb3500cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb354f1f700 1 -- 172.21.15.50:0/4144613199 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835941897 0 0) 0x7fb35006a580 con 0x7fb350158c40 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356722700 1 -- 172.21.15.50:0/4144613199 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35006a7d0 con 0x7fb35006cd40 2023-12-24T18:48:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356722700 1 --2- 172.21.15.50:0/4144613199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb348009f20 tx=0x7fb348009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5cd35fc702ae54 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb354f1f700 1 -- 172.21.15.50:0/4144613199 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800e070 con 0x7fb35006cd40 2023-12-24T18:48:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb354f1f700 1 -- 172.21.15.50:0/4144613199 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800b9d0 con 0x7fb35006cd40 2023-12-24T18:48:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb354f1f700 1 -- 172.21.15.50:0/4144613199 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480092e0 con 0x7fb35006cd40 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 -- 172.21.15.50:0/4144613199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 msgr2=0x7fb35006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 --2- 172.21.15.50:0/4144613199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb348009f20 tx=0x7fb348009840 comp rx=0 tx=0).stop 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 -- 172.21.15.50:0/4144613199 shutdown_connections 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 --2- 172.21.15.50:0/4144613199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35006d1c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 --2- 172.21.15.50:0/4144613199 >> v2:172.21.15.82:3300/0 conn(0x7fb3500cc780 0x7fb3500ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 -- 172.21.15.50:0/4144613199 >> 172.21.15.50:0/4144613199 conn(0x7fb3500d0800 msgr2=0x7fb3500b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 -- 172.21.15.50:0/4144613199 shutdown_connections 2023-12-24T18:48:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.773+0000 7fb356f23700 1 -- 172.21.15.50:0/4144613199 wait complete. 2023-12-24T18:48:57.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.777+0000 7fb356f23700 1 Processor -- start 2023-12-24T18:48:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.777+0000 7fb356f23700 1 -- start start 2023-12-24T18:48:57.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3500cc780 0x7fb3500c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c50b0 con 0x7fb350158c40 2023-12-24T18:48:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c5ef0 con 0x7fb3500cc780 2023-12-24T18:48:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c52e0 con 0x7fb35006cd40 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48976/0 (socket says 172.21.15.50:48976) 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 -- 172.21.15.50:0/1153023712 learned_addr learned my addr 172.21.15.50:0/1153023712 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb355720700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3500cc780 0x7fb3500c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb355f21700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 -- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 msgr2=0x7fb35015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 -- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3500cc780 msgr2=0x7fb3500c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3500cc780 0x7fb3500c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 -- 172.21.15.50:0/1153023712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348009ae0 con 0x7fb350158c40 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356722700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb35006d840 tx=0x7fb348018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348008b10 con 0x7fb350158c40 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348008c90 con 0x7fb350158c40 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3500c55c0 con 0x7fb350158c40 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480266b0 con 0x7fb350158c40 2023-12-24T18:48:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.781+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3500c5b80 con 0x7fb350158c40 2023-12-24T18:48:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.785+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35004be40 con 0x7fb350158c40 2023-12-24T18:48:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.785+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb348003040 con 0x7fb350158c40 2023-12-24T18:48:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.789+0000 7fb345ffb700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 0x7fb334062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.789+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fb34807ea50 con 0x7fb350158c40 2023-12-24T18:48:57.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.789+0000 7fb355f21700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 0x7fb334062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:57.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.789+0000 7fb355f21700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 0x7fb334062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3500c6160 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:57.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.797+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb34804ee80 con 0x7fb350158c40 2023-12-24T18:48:57.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:48:57.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:48:57.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.969+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb35006aab0 con 0x7fb350158c40 2023-12-24T18:48:57.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.981+0000 7fb345ffb700 1 -- 172.21.15.50:0/1153023712 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb3480524a0 con 0x7fb350158c40 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 msgr2=0x7fb334062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 0x7fb334062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3500c6160 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 msgr2=0x7fb35016c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb35006d840 tx=0x7fb348018000 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 shutdown_connections 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fb334060550 0x7fb334062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350158c40 0x7fb35016c140 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3500cc780 0x7fb3500c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 --2- 172.21.15.50:0/1153023712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb35006cd40 0x7fb35015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:57.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 >> 172.21.15.50:0/1153023712 conn(0x7fb3500d0800 msgr2=0x7fb3501576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:57.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 shutdown_connections 2023-12-24T18:48:57.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:57.985+0000 7fb356f23700 1 -- 172.21.15.50:0/1153023712 wait complete. 2023-12-24T18:48:58.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-12-24T18:48:58.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.169+0000 7fbdfd00c700 1 Processor -- start 2023-12-24T18:48:58.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.169+0000 7fbdfd00c700 1 -- start start 2023-12-24T18:48:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfd00c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfd00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfd00c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80b0460 con 0x7fbdf806c820 2023-12-24T18:48:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfd00c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf806d8c0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfd00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80afc60 con 0x7fbdf80ade60 2023-12-24T18:48:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdfc80b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:45818/0 (socket says 172.21.15.50:45818) 2023-12-24T18:48:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 -- 172.21.15.50:0/3100704522 learned_addr learned my addr 172.21.15.50:0/3100704522 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdef7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbdf806c820 0x7fbdf80ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35192/0 (socket says 172.21.15.50:35192) 2023-12-24T18:48:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 -- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 msgr2=0x7fbdf8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 --2- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 -- 172.21.15.50:0/3100704522 >> v1:172.21.15.82:6789/0 conn(0x7fbdf806c820 legacy=0x7fbdf80ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 -- 172.21.15.50:0/3100704522 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf806a5c0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.173+0000 7fbdf7fff700 1 --2- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbde80099b0 tx=0x7fbde8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849bef3ea0827722 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdf77fe700 1 -- 172.21.15.50:0/3100704522 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009ea0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdf77fe700 1 -- 172.21.15.50:0/3100704522 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800b860 con 0x7fbdf815a2d0 2023-12-24T18:48:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdf77fe700 1 -- 172.21.15.50:0/3100704522 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800bc00 con 0x7fbdf815a2d0 2023-12-24T18:48:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 -- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf815a2d0 msgr2=0x7fbdf80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbde80099b0 tx=0x7fbde8009250 comp rx=0 tx=0).stop 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 -- 172.21.15.50:0/3100704522 shutdown_connections 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/3100704522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf815a2d0 0x7fbdf80ae8b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 -- 172.21.15.50:0/3100704522 >> 172.21.15.50:0/3100704522 conn(0x7fbdf8067b80 msgr2=0x7fbdf80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 -- 172.21.15.50:0/3100704522 shutdown_connections 2023-12-24T18:48:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.177+0000 7fbdfd00c700 1 -- 172.21.15.50:0/3100704522 wait complete. 2023-12-24T18:48:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 Processor -- start 2023-12-24T18:48:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 -- start start 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf806c820 0x7fbdf80ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8158c00 con 0x7fbdf815a2d0 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8158ee0 con 0x7fbdf806c820 2023-12-24T18:48:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfd00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81591c0 con 0x7fbdf80ade60 2023-12-24T18:48:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfc80b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfc80b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48990/0 (socket says 172.21.15.50:48990) 2023-12-24T18:48:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfc80b700 1 -- 172.21.15.50:0/141192659 learned_addr learned my addr 172.21.15.50:0/141192659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdef7fe700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdf7fff700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf806c820 0x7fbdf80ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfc80b700 1 -- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 msgr2=0x7fbdf8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.181+0000 7fbdfc80b700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfc80b700 1 -- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf806c820 msgr2=0x7fbdf80ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfc80b700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf806c820 0x7fbdf80ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfc80b700 1 -- 172.21.15.50:0/141192659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80094f0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfc80b700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000ea50 tx=0x7fbdf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000ee90 con 0x7fbdf815a2d0 2023-12-24T18:48:58.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000c7f0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf81594a0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000cbb0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf80ad5f0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.185+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf804be40 con 0x7fbdf815a2d0 2023-12-24T18:48:58.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.189+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbdf0013470 con 0x7fbdf815a2d0 2023-12-24T18:48:58.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.189+0000 7fbdf4ff9700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 0x7fbdd8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.189+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fbdf007cbc0 con 0x7fbdf815a2d0 2023-12-24T18:48:58.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.189+0000 7fbdf7fff700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 0x7fbdd8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.189+0000 7fbdf7fff700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 0x7fbdd8062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbde80099b0 tx=0x7fbde8017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.197+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbdf004cf40 con 0x7fbdf815a2d0 2023-12-24T18:48:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.425+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fbdf8157610 con 0x7fbdf815a2d0 2023-12-24T18:48:58.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.677+0000 7fbdf4ff9700 1 -- 172.21.15.50:0/141192659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v459) v1 ==== 158+0+0 (secure 0 0 0) 0x7fbdf0050560 con 0x7fbdf815a2d0 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 msgr2=0x7fbdd8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 0x7fbdd8062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbde80099b0 tx=0x7fbde8017000 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 msgr2=0x7fbdf81569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000ea50 tx=0x7fbdf00091a0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 shutdown_connections 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fbdd8060550 0x7fbdd8062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf815a2d0 0x7fbdf81569d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdf80ade60 0x7fbdf8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 --2- 172.21.15.50:0/141192659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdf806c820 0x7fbdf80ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 >> 172.21.15.50:0/141192659 conn(0x7fbdf8067b80 msgr2=0x7fbdf8154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:58.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 shutdown_connections 2023-12-24T18:48:58.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.681+0000 7fbdfd00c700 1 -- 172.21.15.50:0/141192659 wait complete. 2023-12-24T18:48:58.711 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-12-24T18:48:58.711 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-12-24T18:48:58.711 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:48:58.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-12-24T18:48:58.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.889+0000 7f5e026cd700 1 Processor -- start 2023-12-24T18:48:58.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.889+0000 7f5e026cd700 1 -- start start 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e026cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5dfc06def0 0x7f5dfc168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e026cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc06ca50 con 0x7f5dfc0ca770 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e026cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc06b520 con 0x7f5dfc0ca3a0 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e026cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c6980 con 0x7f5dfc06def0 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5dfc0ca770 0x7f5dfc15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38088/0 (socket says 172.21.15.50:38088) 2023-12-24T18:48:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfb7fe700 1 -- 172.21.15.50:0/2829622477 learned_addr learned my addr 172.21.15.50:0/2829622477 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:48:58.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e00c6a700 1 --2- 172.21.15.50:0/2829622477 >> v2:172.21.15.82:3300/0 conn(0x7f5dfc06def0 0x7f5dfc168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961625579 0 0) 0x7f5dfc06ca50 con 0x7f5dfc0ca770 2023-12-24T18:48:58.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de4003570 con 0x7f5dfc0ca770 2023-12-24T18:48:58.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622886076 0 0) 0x7f5dfc06b520 con 0x7f5dfc0ca3a0 2023-12-24T18:48:58.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc06ca50 con 0x7f5dfc0ca3a0 2023-12-24T18:48:58.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2829622477 >> v1:172.21.15.82:6789/0 conn(0x7f5dfc0ca3a0 legacy=0x7f5dfc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2829622477 >> v1:172.21.15.50:6789/0 conn(0x7f5dfc0ca770 legacy=0x7f5dfc15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2829622477 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc06b7f0 con 0x7f5dfc06def0 2023-12-24T18:48:58.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.893+0000 7f5e00c6a700 1 --2- 172.21.15.50:0/2829622477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc168380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e90 tx=0x7f5df4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9126de70d9144bb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400e070 con 0x7f5dfc06def0 2023-12-24T18:48:58.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400bb90 con 0x7f5dfc06def0 2023-12-24T18:48:58.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5dfaffd700 1 -- 172.21.15.50:0/2829622477 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4012430 con 0x7f5dfc06def0 2023-12-24T18:48:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- 172.21.15.50:0/2829622477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 msgr2=0x7f5dfc168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2829622477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc168380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e90 tx=0x7f5df4009780 comp rx=0 tx=0).stop 2023-12-24T18:48:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- 172.21.15.50:0/2829622477 shutdown_connections 2023-12-24T18:48:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2829622477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc168380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- 172.21.15.50:0/2829622477 >> 172.21.15.50:0/2829622477 conn(0x7f5dfc0cbba0 msgr2=0x7f5dfc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- 172.21.15.50:0/2829622477 shutdown_connections 2023-12-24T18:48:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- 172.21.15.50:0/2829622477 wait complete. 2023-12-24T18:48:58.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 Processor -- start 2023-12-24T18:48:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.897+0000 7f5e026cd700 1 -- start start 2023-12-24T18:48:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dfc0ca3a0 0x7f5dfc171700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc1539c0 con 0x7f5dfc0ca770 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc1624b0 con 0x7f5dfc06def0 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b0ba0 con 0x7f5dfc0ca3a0 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49002/0 (socket says 172.21.15.50:49002) 2023-12-24T18:48:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2865189537 learned_addr learned my addr 172.21.15.50:0/2865189537 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5dfb7fe700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dfc0ca3a0 0x7f5dfc171700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5dfbfff700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dfc0ca3a0 msgr2=0x7f5dfc171700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dfc0ca3a0 0x7f5dfc171700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 msgr2=0x7f5dfc15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 -- 172.21.15.50:0/2865189537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009a20 con 0x7f5dfc0ca770 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5dfbfff700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e00c6a700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5df40099f0 tx=0x7f5df4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40263f0 con 0x7f5dfc0ca770 2023-12-24T18:48:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4026590 con 0x7f5dfc0ca770 2023-12-24T18:48:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0b0e80 con 0x7f5dfc0ca770 2023-12-24T18:48:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.901+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4026950 con 0x7f5dfc0ca770 2023-12-24T18:48:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.905+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc162140 con 0x7f5dfc0ca770 2023-12-24T18:48:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.905+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc162620 con 0x7f5dfc0ca770 2023-12-24T18:48:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.905+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5df402f450 con 0x7f5dfc0ca770 2023-12-24T18:48:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.909+0000 7f5de3fff700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 0x7f5de8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.909+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f5df407eb10 con 0x7f5dfc0ca770 2023-12-24T18:48:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.909+0000 7f5dfbfff700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 0x7f5de8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.909+0000 7f5dfbfff700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 0x7f5de8062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5dec003990 tx=0x7f5dec009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:58.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:58.917+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5df404ef40 con 0x7f5dfc0ca770 2023-12-24T18:48:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.145+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f5dfc0652e0 con 0x7f5dfc0ca770 2023-12-24T18:48:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.685+0000 7f5de3fff700 1 -- 172.21.15.50:0/2865189537 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v460) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5df4052560 con 0x7f5dfc0ca770 2023-12-24T18:48:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 msgr2=0x7f5de8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 0x7f5de8062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5dec003990 tx=0x7f5dec009040 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 msgr2=0x7f5dfc162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5df40099f0 tx=0x7f5df4019000 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 shutdown_connections 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5de8060550 0x7f5de8062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0ca770 0x7f5dfc162940 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dfc0ca3a0 0x7f5dfc171700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 --2- 172.21.15.50:0/2865189537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc06def0 0x7f5dfc15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 >> 172.21.15.50:0/2865189537 conn(0x7f5dfc0cbba0 msgr2=0x7f5dfc15da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 shutdown_connections 2023-12-24T18:48:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.689+0000 7f5e026cd700 1 -- 172.21.15.50:0/2865189537 wait complete. 2023-12-24T18:48:59.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:48:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.893+0000 7fcdc5478700 1 Processor -- start 2023-12-24T18:48:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.893+0000 7fcdc5478700 1 -- start start 2023-12-24T18:48:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdc5478700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdc006d550 0x7fcdc01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdc5478700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdc5478700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc006c820 con 0x7fcdc00670b0 2023-12-24T18:48:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdc5478700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc0157360 con 0x7fcdc006d550 2023-12-24T18:48:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdc5478700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015a720 con 0x7fcdc0159f30 2023-12-24T18:48:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdc006d550 0x7fcdc01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdc006d550 0x7fcdc01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54222/0 (socket says 172.21.15.50:54222) 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 -- 172.21.15.50:0/3814568478 learned_addr learned my addr 172.21.15.50:0/3814568478 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbf7fe700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 -- 172.21.15.50:0/3814568478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 msgr2=0x7fcdc014fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc014fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 -- 172.21.15.50:0/3814568478 >> v1:172.21.15.82:6789/0 conn(0x7fcdc00670b0 legacy=0x7fcdc0067480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 -- 172.21.15.50:0/3814568478 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc006ca70 con 0x7fcdc006d550 2023-12-24T18:48:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbe7fc700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc006d550 0x7fcdc01599f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400bc50 tx=0x7fcdb400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2817babdbda5b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbdffb700 1 -- 172.21.15.50:0/3814568478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400be60 con 0x7fcdc006d550 2023-12-24T18:48:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbdffb700 1 -- 172.21.15.50:0/3814568478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400de00 con 0x7fcdc006d550 2023-12-24T18:48:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.897+0000 7fcdbdffb700 1 -- 172.21.15.50:0/3814568478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40196b0 con 0x7fcdc006d550 2023-12-24T18:48:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 -- 172.21.15.50:0/3814568478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc006d550 msgr2=0x7fcdc01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc006d550 0x7fcdc01599f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400bc50 tx=0x7fcdb400b4f0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 -- 172.21.15.50:0/3814568478 shutdown_connections 2023-12-24T18:48:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc014fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 --2- 172.21.15.50:0/3814568478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc006d550 0x7fcdc01599f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 -- 172.21.15.50:0/3814568478 >> 172.21.15.50:0/3814568478 conn(0x7fcdc00cba30 msgr2=0x7fcdc00cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:48:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 -- 172.21.15.50:0/3814568478 shutdown_connections 2023-12-24T18:48:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.901+0000 7fcdc5478700 1 -- 172.21.15.50:0/3814568478 wait complete. 2023-12-24T18:48:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 Processor -- start 2023-12-24T18:48:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 -- start start 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdc006d550 0x7fcdc0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc0154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0169430 con 0x7fcdc00670b0 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01696f0 con 0x7fcdc006d550 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdc5478700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01699d0 con 0x7fcdc0159f30 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54230/0 (socket says 172.21.15.50:54230) 2023-12-24T18:48:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 -- 172.21.15.50:0/1213264412 learned_addr learned my addr 172.21.15.50:0/1213264412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:48:59.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 -- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 msgr2=0x7fcdc0154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc0154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 -- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdc006d550 msgr2=0x7fcdc0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdc006d550 0x7fcdc0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 -- 172.21.15.50:0/1213264412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb400b790 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.905+0000 7fcdbeffd700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c590 tx=0x7fcdb000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011590 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb00116f0 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc0169cb0 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011ab0 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc016a270 con 0x7fcdc00670b0 2023-12-24T18:48:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc004be40 con 0x7fcdc00670b0 2023-12-24T18:48:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.909+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcdb001b3b0 con 0x7fcdc00670b0 2023-12-24T18:48:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.913+0000 7fcda6ffd700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 0x7fcdac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:48:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.913+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fcdb007c070 con 0x7fcdc00670b0 2023-12-24T18:48:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.913+0000 7fcdbe7fc700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 0x7fcdac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:48:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.913+0000 7fcdbe7fc700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 0x7fcdac062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400bc50 tx=0x7fcdb401b000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:48:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:48:59.917+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcdb00abbe0 con 0x7fcdc00670b0 2023-12-24T18:49:00.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.089+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcdc0156bb0 con 0x7fcdc00670b0 2023-12-24T18:49:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.097+0000 7fcda6ffd700 1 -- 172.21.15.50:0/1213264412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcdb0017070 con 0x7fcdc00670b0 2023-12-24T18:49:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 msgr2=0x7fcdac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 0x7fcdac062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400bc50 tx=0x7fcdb401b000 comp rx=0 tx=0).stop 2023-12-24T18:49:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 msgr2=0x7fcdc00b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c590 tx=0x7fcdb000c950 comp rx=0 tx=0).stop 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 shutdown_connections 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcdac060550 0x7fcdac062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdc0159f30 0x7fcdc0154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdc006d550 0x7fcdc0157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 --2- 172.21.15.50:0/1213264412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdc00670b0 0x7fcdc00b0000 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 >> 172.21.15.50:0/1213264412 conn(0x7fcdc00cba30 msgr2=0x7fcdc01551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 shutdown_connections 2023-12-24T18:49:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.101+0000 7fcdc5478700 1 -- 172.21.15.50:0/1213264412 wait complete. 2023-12-24T18:49:00.126 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:49:00.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:49:00.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:49:00.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:49:00.221 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:49:00.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:49:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.393+0000 7f008162e700 1 Processor -- start 2023-12-24T18:49:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.393+0000 7f008162e700 1 -- start start 2023-12-24T18:49:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f008162e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f008162e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f007c0cc980 0x7f007c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f008162e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c06d890 con 0x7f007c15cf10 2023-12-24T18:49:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f008162e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c06ca30 con 0x7f007c0cc980 2023-12-24T18:49:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f008162e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0cd310 con 0x7f007c15c860 2023-12-24T18:49:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f007c15cf10 0x7f007c15d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40228/0 (socket says 172.21.15.50:40228) 2023-12-24T18:49:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007b7fe700 1 -- 172.21.15.50:0/453275102 learned_addr learned my addr 172.21.15.50:0/453275102 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007a7fc700 1 --2- 172.21.15.50:0/453275102 >> v2:172.21.15.82:3300/0 conn(0x7f007c0cc980 0x7f007c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f0079ffb700 1 -- 172.21.15.50:0/453275102 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196563885 0 0) 0x7f007c06d890 con 0x7f007c15cf10 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f0079ffb700 1 -- 172.21.15.50:0/453275102 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0064003570 con 0x7f007c15cf10 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 -- 172.21.15.50:0/453275102 >> v2:172.21.15.82:3300/0 conn(0x7f007c0cc980 msgr2=0x7f007c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 --2- 172.21.15.50:0/453275102 >> v2:172.21.15.82:3300/0 conn(0x7f007c0cc980 0x7f007c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 -- 172.21.15.50:0/453275102 >> v1:172.21.15.82:6789/0 conn(0x7f007c15cf10 legacy=0x7f007c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 -- 172.21.15.50:0/453275102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c06cc80 con 0x7f007c15c860 2023-12-24T18:49:00.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.397+0000 7f007affd700 1 --2- 172.21.15.50:0/453275102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c06af80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f006c0098e0 tx=0x7f006c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d2b95d8fc7d74b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f0079ffb700 1 -- 172.21.15.50:0/453275102 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c011630 con 0x7f007c15c860 2023-12-24T18:49:00.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f0079ffb700 1 -- 172.21.15.50:0/453275102 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c011790 con 0x7f007c15c860 2023-12-24T18:49:00.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f0079ffb700 1 -- 172.21.15.50:0/453275102 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c011b30 con 0x7f007c15c860 2023-12-24T18:49:00.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 -- 172.21.15.50:0/453275102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 msgr2=0x7f007c06af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 --2- 172.21.15.50:0/453275102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c06af80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f006c0098e0 tx=0x7f006c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 -- 172.21.15.50:0/453275102 shutdown_connections 2023-12-24T18:49:00.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 --2- 172.21.15.50:0/453275102 >> v2:172.21.15.82:3300/0 conn(0x7f007c0cc980 0x7f007c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 --2- 172.21.15.50:0/453275102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c06af80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 -- 172.21.15.50:0/453275102 >> 172.21.15.50:0/453275102 conn(0x7f007c0670b0 msgr2=0x7f007c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:00.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 -- 172.21.15.50:0/453275102 shutdown_connections 2023-12-24T18:49:00.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 -- 172.21.15.50:0/453275102 wait complete. 2023-12-24T18:49:00.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.401+0000 7f008162e700 1 Processor -- start 2023-12-24T18:49:00.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 -- start start 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007c15cf10 0x7f007c0a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0a9560 con 0x7f007c0cc980 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c159d90 con 0x7f007c15cf10 2023-12-24T18:49:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f008162e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c15a070 con 0x7f007c15c860 2023-12-24T18:49:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54240/0 (socket says 172.21.15.50:54240) 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 -- 172.21.15.50:0/3723932570 learned_addr learned my addr 172.21.15.50:0/3723932570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007a7fc700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007b7fe700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007c15cf10 0x7f007c0a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 -- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 msgr2=0x7f007c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 -- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007c15cf10 msgr2=0x7f007c0a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007c15cf10 0x7f007c0a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 -- 172.21.15.50:0/3723932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009420 con 0x7f007c0cc980 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007a7fc700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.405+0000 7f007affd700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cd450 tx=0x7f006c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c011b10 con 0x7f007c0cc980 2023-12-24T18:49:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0253f0 con 0x7f007c0cc980 2023-12-24T18:49:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0257b0 con 0x7f007c0cc980 2023-12-24T18:49:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c15a350 con 0x7f007c0cc980 2023-12-24T18:49:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c15b090 con 0x7f007c0cc980 2023-12-24T18:49:00.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0652e0 con 0x7f007c0cc980 2023-12-24T18:49:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.409+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f006c025ba0 con 0x7f007c0cc980 2023-12-24T18:49:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.413+0000 7f0062ffd700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.413+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f006c07e3b0 con 0x7f007c0cc980 2023-12-24T18:49:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.413+0000 7f007a7fc700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.413+0000 7f007a7fc700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 0x7f0068062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cf6d0 tx=0x7f0070008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.417+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f006c04e730 con 0x7f007c0cc980 2023-12-24T18:49:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.625+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f007c0cc060 con 0x7f007c0cc980 2023-12-24T18:49:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.625+0000 7f0062ffd700 1 -- 172.21.15.50:0/3723932570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f006c015de0 con 0x7f007c0cc980 2023-12-24T18:49:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:00.629 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4844,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/934811704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":934811704},{"type":"v1","addr":"172.21.15.82:6835","nonce":934811704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1306106041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1306106041},{"type":"v1","addr":"172.21.15.50:6837","nonce":1306106041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1100064884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1100064884},{"type":"v1","addr":"172.21.15.50:6835","nonce":1100064884}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3300847669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3300847669},{"type":"v1","addr":"172.21.15.82:6834","nonce":3300847669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 msgr2=0x7f0068062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 0x7f0068062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cf6d0 tx=0x7f0070008040 comp rx=0 tx=0).stop 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 msgr2=0x7f007c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cd450 tx=0x7f006c017000 comp rx=0 tx=0).stop 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 shutdown_connections 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007c15cf10 0x7f007c0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f007c15c860 0x7f007c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 --2- 172.21.15.50:0/3723932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f007c0cc980 0x7f007c15ab50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 >> 172.21.15.50:0/3723932570 conn(0x7f007c0670b0 msgr2=0x7f007c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 shutdown_connections 2023-12-24T18:49:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.629+0000 7f008162e700 1 -- 172.21.15.50:0/3723932570 wait complete. 2023-12-24T18:49:00.636 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 19 2023-12-24T18:49:00.656 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:49:00.656 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:49:00.657 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:49:00.657 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:49:00.657 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:49:00.657 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:49:00.657 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:49:00.657 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:49:00.657 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:49:00.657 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:49:00.658 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:49:00.658 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:49:00.658 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:49:00.658 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:49:00.658 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:49:00.658 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:49:00.677 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:49:00.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:49:00.678 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:49:00.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:49:00.681 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:49:00.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:49:00.682 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:49:00.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:49:00.724 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:49:00.724 DEBUG:teuthology.parallel:result is None 2023-12-24T18:49:00.727 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:49:00.727 DEBUG:teuthology.parallel:result is None 2023-12-24T18:49:00.731 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:49:00.731 DEBUG:teuthology.parallel:result is None 2023-12-24T18:49:00.734 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:49:00.735 DEBUG:teuthology.parallel:result is None 2023-12-24T18:49:00.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:49:00.834 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:49:00.835 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:49:00.845 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:49:00.858 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:49:00.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.917+0000 7f6cc7c2e700 1 Processor -- start 2023-12-24T18:49:00.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.917+0000 7f6cc7c2e700 1 -- start start 2023-12-24T18:49:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc7c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 0x7f6cc0159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc7c2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc006bce0 0x7f6cc00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc7c2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc006b850 con 0x7f6cc00ab040 2023-12-24T18:49:00.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc7c2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc006ac40 con 0x7f6cc006bce0 2023-12-24T18:49:00.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc7c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc006af20 con 0x7f6cc0159bc0 2023-12-24T18:49:00.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc006bce0 0x7f6cc00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc006bce0 0x7f6cc00aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54268/0 (socket says 172.21.15.50:54268) 2023-12-24T18:49:00.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 -- 172.21.15.50:0/1492348321 learned_addr learned my addr 172.21.15.50:0/1492348321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc59ca700 1 --2- 172.21.15.50:0/1492348321 >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 0x7f6cc0159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 -- 172.21.15.50:0/1492348321 >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 msgr2=0x7f6cc0159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 --2- 172.21.15.50:0/1492348321 >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 0x7f6cc0159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 -- 172.21.15.50:0/1492348321 >> v1:172.21.15.82:6789/0 conn(0x7f6cc00ab040 legacy=0x7f6cc00ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 -- 172.21.15.50:0/1492348321 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc006b200 con 0x7f6cc006bce0 2023-12-24T18:49:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc59ca700 1 --2- 172.21.15.50:0/1492348321 >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 0x7f6cc0159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc51c9700 1 --2- 172.21.15.50:0/1492348321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006bce0 0x7f6cc00aab00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0069ce0 tx=0x7f6cb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27263f7ce38bfc97 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.921+0000 7f6cc49c8700 1 -- 172.21.15.50:0/1492348321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000b860 con 0x7f6cc006bce0 2023-12-24T18:49:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc49c8700 1 -- 172.21.15.50:0/1492348321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000b9c0 con 0x7f6cc006bce0 2023-12-24T18:49:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc49c8700 1 -- 172.21.15.50:0/1492348321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000bd60 con 0x7f6cc006bce0 2023-12-24T18:49:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/1492348321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006bce0 msgr2=0x7f6cc00aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/1492348321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006bce0 0x7f6cc00aab00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0069ce0 tx=0x7f6cb0009250 comp rx=0 tx=0).stop 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/1492348321 shutdown_connections 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/1492348321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006bce0 0x7f6cc00aab00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/1492348321 >> v2:172.21.15.82:3300/0 conn(0x7f6cc0159bc0 0x7f6cc0159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/1492348321 >> 172.21.15.50:0/1492348321 conn(0x7f6cc00cbba0 msgr2=0x7f6cc00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/1492348321 shutdown_connections 2023-12-24T18:49:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.925+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/1492348321 wait complete. 2023-12-24T18:49:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 Processor -- start 2023-12-24T18:49:00.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 -- start start 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006bce0 0x7f6cc00aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00ab040 0x7f6cc016d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00b1990 con 0x7f6cc0159bc0 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00aab70 con 0x7f6cc00ab040 2023-12-24T18:49:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc7c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc016d550 con 0x7f6cc006bce0 2023-12-24T18:49:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc61cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc59ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006bce0 0x7f6cc00aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc61cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54284/0 (socket says 172.21.15.50:54284) 2023-12-24T18:49:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc61cb700 1 -- 172.21.15.50:0/2969518795 learned_addr learned my addr 172.21.15.50:0/2969518795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.929+0000 7f6cc51c9700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00ab040 0x7f6cc016d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 -- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006bce0 msgr2=0x7f6cc00aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006bce0 0x7f6cc00aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 -- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00ab040 msgr2=0x7f6cc016d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00ab040 0x7f6cc016d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 -- 172.21.15.50:0/2969518795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00094f0 con 0x7f6cc0159bc0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc61cb700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c910 tx=0x7f6cb8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8012630 con 0x7f6cc0159bc0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8012790 con 0x7f6cc0159bc0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8012b50 con 0x7f6cc0159bc0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc00aeab0 con 0x7f6cc0159bc0 2023-12-24T18:49:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc00af070 con 0x7f6cc0159bc0 2023-12-24T18:49:00.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.933+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc00652e0 con 0x7f6cc0159bc0 2023-12-24T18:49:00.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.937+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6cb801a3a0 con 0x7f6cc0159bc0 2023-12-24T18:49:00.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.937+0000 7f6cb5ffb700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 0x7f6ca4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.937+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f6cb807cc30 con 0x7f6cc0159bc0 2023-12-24T18:49:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.937+0000 7f6cc59ca700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 0x7f6ca4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.937+0000 7f6cc59ca700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 0x7f6ca4062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00adc0 tx=0x7f6cbc006f90 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:00.941+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6cb804cfb0 con 0x7f6cc0159bc0 2023-12-24T18:49:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.125+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6cc01599a0 con 0x7f6cc0159bc0 2023-12-24T18:49:01.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.709+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/2969518795 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6cb80505d0 con 0x7f6cc0159bc0 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 msgr2=0x7f6ca4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 0x7f6ca4062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00adc0 tx=0x7f6cbc006f90 comp rx=0 tx=0).stop 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 msgr2=0x7f6cc00c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c910 tx=0x7f6cb8001710 comp rx=0 tx=0).stop 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 shutdown_connections 2023-12-24T18:49:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6ca4060550 0x7f6ca4062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0159bc0 0x7f6cc00c89d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00ab040 0x7f6cc016d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 --2- 172.21.15.50:0/2969518795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006bce0 0x7f6cc00aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 >> 172.21.15.50:0/2969518795 conn(0x7f6cc00cbba0 msgr2=0x7f6cc00c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 shutdown_connections 2023-12-24T18:49:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.713+0000 7f6cc7c2e700 1 -- 172.21.15.50:0/2969518795 wait complete. 2023-12-24T18:49:01.719 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:49:01.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:49:01.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.901+0000 7f21d08f0700 1 Processor -- start 2023-12-24T18:49:01.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.905+0000 7f21d08f0700 1 -- start start 2023-12-24T18:49:01.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.905+0000 7f21d08f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21cc0ca770 0x7f21cc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.905+0000 7f21d08f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.905+0000 7f21d08f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc06ca50 con 0x7f21cc0ca3a0 2023-12-24T18:49:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21d08f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0c6980 con 0x7f21cc0ca770 2023-12-24T18:49:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21d08f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc15b410 con 0x7f21cc15af90 2023-12-24T18:49:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21ca59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f21cc0ca3a0 0x7f21cc06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56620/0 (socket says 172.21.15.50:56620) 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21ca59c700 1 -- 172.21.15.50:0/1313513048 learned_addr learned my addr 172.21.15.50:0/1313513048 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/1313513048 >> v2:172.21.15.82:3300/0 conn(0x7f21cc0ca770 0x7f21cc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21cad9d700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40375344 0 0) 0x7f21cc06ca50 con 0x7f21cc0ca3a0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b4003570 con 0x7f21cc0ca3a0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 -- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 msgr2=0x7f21cc06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 -- 172.21.15.50:0/1313513048 >> v1:172.21.15.50:6789/0 conn(0x7f21cc0ca3a0 legacy=0x7f21cc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620773755 0 0) 0x7f21b4003570 con 0x7f21cc0ca3a0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 -- 172.21.15.50:0/1313513048 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc06b520 con 0x7f21cc0ca770 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc15aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21c00098e0 tx=0x7f21c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da31504cce5c0d8f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc001470 con 0x7f21cc0ca770 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c0011420 con 0x7f21cc0ca770 2023-12-24T18:49:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.909+0000 7f21c959a700 1 -- 172.21.15.50:0/1313513048 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00117c0 con 0x7f21cc0ca770 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 msgr2=0x7f21cc15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc15aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21c00098e0 tx=0x7f21c00091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- 172.21.15.50:0/1313513048 shutdown_connections 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- 172.21.15.50:0/1313513048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc15aa50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- 172.21.15.50:0/1313513048 >> 172.21.15.50:0/1313513048 conn(0x7f21cc0cbba0 msgr2=0x7f21cc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- 172.21.15.50:0/1313513048 shutdown_connections 2023-12-24T18:49:01.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- 172.21.15.50:0/1313513048 wait complete. 2023-12-24T18:49:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 Processor -- start 2023-12-24T18:49:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- start start 2023-12-24T18:49:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0af9a0 con 0x7f21cc0ca3a0 2023-12-24T18:49:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0aeab0 con 0x7f21cc0ca770 2023-12-24T18:49:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.913+0000 7f21d08f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0aed90 con 0x7f21cc15af90 2023-12-24T18:49:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54298/0 (socket says 172.21.15.50:54298) 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ca59c700 1 -- 172.21.15.50:0/612820810 learned_addr learned my addr 172.21.15.50:0/612820810 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21cad9d700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 -- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 msgr2=0x7f21cc0b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc0b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 -- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 msgr2=0x7f21cc148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:01.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 -- 172.21.15.50:0/612820810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0009420 con 0x7f21cc0ca770 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ca59c700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21c9d9b700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc0b03e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21c0015000 tx=0x7f21c0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0000d10 con 0x7f21cc0ca770 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c001cb30 con 0x7f21cc0ca770 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c001a450 con 0x7f21cc0ca770 2023-12-24T18:49:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0af070 con 0x7f21cc0ca770 2023-12-24T18:49:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.917+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0af630 con 0x7f21cc0ca770 2023-12-24T18:49:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.921+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0afb10 con 0x7f21cc0ca770 2023-12-24T18:49:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.921+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f21c001a880 con 0x7f21cc0ca770 2023-12-24T18:49:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.925+0000 7f21ba7fc700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 0x7f21ac062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.925+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f21c007de10 con 0x7f21cc0ca770 2023-12-24T18:49:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.925+0000 7f21ca59c700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 0x7f21ac062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.925+0000 7f21ca59c700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 0x7f21ac062ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21bc007fd0 tx=0x7f21bc001b50 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:01.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:01.929+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f21c0081030 con 0x7f21cc0ca770 2023-12-24T18:49:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.157+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f21cc0652e0 con 0x7f21cc0ca770 2023-12-24T18:49:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.157+0000 7f21ba7fc700 1 -- 172.21.15.50:0/612820810 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f21c004e490 con 0x7f21cc0ca770 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:49:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:49:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:49:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:49:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:49:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:49:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:49:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:49:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:49:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:49:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:49:02.178 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:49:02.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 msgr2=0x7f21ac062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 0x7f21ac062ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21bc007fd0 tx=0x7f21bc001b50 comp rx=0 tx=0).stop 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 msgr2=0x7f21cc0b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc0b03e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21c0015000 tx=0x7f21c0016000 comp rx=0 tx=0).stop 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 shutdown_connections 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f21ac060620 0x7f21ac062ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21cc15af90 0x7f21cc0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21cc0ca770 0x7f21cc0b03e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 --2- 172.21.15.50:0/612820810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0ca3a0 0x7f21cc148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 >> 172.21.15.50:0/612820810 conn(0x7f21cc0cbba0 msgr2=0x7f21cc15da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 shutdown_connections 2023-12-24T18:49:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.161+0000 7f21d08f0700 1 -- 172.21.15.50:0/612820810 wait complete. 2023-12-24T18:49:02.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:49:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.349+0000 7fdefda2e700 1 Processor -- start 2023-12-24T18:49:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdefda2e700 1 -- start start 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdefda2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdef80cacb0 0x7fdef8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdefda2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80b04c0 con 0x7fdef8156a20 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdefda2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef815b410 con 0x7fdef80ae2e0 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdefda2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef8157330 con 0x7fdef80cacb0 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdef6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdef8156a20 0x7fdef80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56628/0 (socket says 172.21.15.50:56628) 2023-12-24T18:49:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdef6ffd700 1 -- 172.21.15.50:0/51747126 learned_addr learned my addr 172.21.15.50:0/51747126 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444441151 0 0) 0x7fdef80b04c0 con 0x7fdef8156a20 2023-12-24T18:49:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee0003570 con 0x7fdef8156a20 2023-12-24T18:49:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.353+0000 7fdef7fff700 1 --2- 172.21.15.50:0/51747126 >> v2:172.21.15.82:3300/0 conn(0x7fdef80cacb0 0x7fdef8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2877800358 0 0) 0x7fdee0003570 con 0x7fdef8156a20 2023-12-24T18:49:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 >> v2:172.21.15.82:3300/0 conn(0x7fdef80cacb0 msgr2=0x7fdef8156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 --2- 172.21.15.50:0/51747126 >> v2:172.21.15.82:3300/0 conn(0x7fdef80cacb0 0x7fdef8156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 >> v1:172.21.15.82:6789/0 conn(0x7fdef80ae2e0 legacy=0x7fdef80ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef815b8a0 con 0x7fdef8156a20 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fdee8001470 con 0x7fdef8156a20 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 >> v1:172.21.15.50:6789/0 conn(0x7fdef8156a20 legacy=0x7fdef80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 0x7fdee0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdee0004810 0x7fdee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee00051c0 0x7fdee000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8157330 con 0x7fdee0003a60 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee000c190 con 0x7fdee0004810 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee000c350 con 0x7fdee00051c0 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 0x7fdee0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef67fc700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdee0004810 0x7fdee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef7fff700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee00051c0 0x7fdee000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 -- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee00051c0 msgr2=0x7fdee000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee00051c0 0x7fdee000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 -- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdee0004810 msgr2=0x7fdee0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdee0004810 0x7fdee0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 -- 172.21.15.50:0/51747126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0003570 con 0x7fdee0003a60 2023-12-24T18:49:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef7fff700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee00051c0 0x7fdee000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef7fff700 1 -- 172.21.15.50:0/51747126 reap_dead start 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 0x7fdee0003e30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c2a0 tx=0x7fdee8001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc88af5bb167a80 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800cb90 con 0x7fdee0003a60 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee800ccf0 con 0x7fdee0003a60 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.357+0000 7fdef5ffb700 1 -- 172.21.15.50:0/51747126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8005b70 con 0x7fdee0003a60 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 msgr2=0x7fdee0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 0x7fdee0003e30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c2a0 tx=0x7fdee8001df0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- 172.21.15.50:0/51747126 shutdown_connections 2023-12-24T18:49:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 --2- 172.21.15.50:0/51747126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee0003a60 0x7fdee0003e30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- 172.21.15.50:0/51747126 >> 172.21.15.50:0/51747126 conn(0x7fdef8068790 msgr2=0x7fdef8068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- 172.21.15.50:0/51747126 shutdown_connections 2023-12-24T18:49:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- 172.21.15.50:0/51747126 wait complete. 2023-12-24T18:49:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 Processor -- start 2023-12-24T18:49:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.361+0000 7fdefda2e700 1 -- start start 2023-12-24T18:49:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee0003a60 0x7fdef80c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef80c3770 0x7fdef80c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef816d430 con 0x7fdef816ca80 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5c30 con 0x7fdef80c3770 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdefda2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5020 con 0x7fdee0003a60 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54314/0 (socket says 172.21.15.50:54314) 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 -- 172.21.15.50:0/4275699640 learned_addr learned my addr 172.21.15.50:0/4275699640 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef67fc700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef80c3770 0x7fdef80c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee0003a60 0x7fdef80c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 -- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee0003a60 msgr2=0x7fdef80c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee0003a60 0x7fdef80c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 -- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef80c3770 msgr2=0x7fdef80c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef80c3770 0x7fdef80c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 -- 172.21.15.50:0/4275699640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80c5300 con 0x7fdef816ca80 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdef7fff700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdef80cb0b0 tx=0x7fdef0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.365+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0007ea0 con 0x7fdef816ca80 2023-12-24T18:49:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000f050 con 0x7fdef816ca80 2023-12-24T18:49:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0002e80 con 0x7fdef816ca80 2023-12-24T18:49:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80c55e0 con 0x7fdef816ca80 2023-12-24T18:49:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80c7e20 con 0x7fdef816ca80 2023-12-24T18:49:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef80c5da0 con 0x7fdef816ca80 2023-12-24T18:49:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.369+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdef0003040 con 0x7fdef816ca80 2023-12-24T18:49:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.373+0000 7fdedeffd700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 0x7fdee4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.373+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fdef007c8d0 con 0x7fdef816ca80 2023-12-24T18:49:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.373+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 0x7fdee4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.373+0000 7fdef6ffd700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 0x7fdee4062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdee8008fd0 tx=0x7fdee8015000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.381+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdef004ced0 con 0x7fdef816ca80 2023-12-24T18:49:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.553+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdef80652e0 con 0x7fdef816ca80 2023-12-24T18:49:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.553+0000 7fdedeffd700 1 -- 172.21.15.50:0/4275699640 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12819 (secure 0 0 0) 0x7fdef00504f0 con 0x7fdef816ca80 2023-12-24T18:49:02.557 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:02.557 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:49:01.721749+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:49:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 msgr2=0x7fdee4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 0x7fdee4062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdee8008fd0 tx=0x7fdee8015000 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 msgr2=0x7fdef816cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdef80cb0b0 tx=0x7fdef0009850 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 shutdown_connections 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fdee4060550 0x7fdee4062a00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef816ca80 0x7fdef816cef0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef80c3770 0x7fdef80c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 --2- 172.21.15.50:0/4275699640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdee0003a60 0x7fdef80c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 >> 172.21.15.50:0/4275699640 conn(0x7fdef8068790 msgr2=0x7fdef80ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 shutdown_connections 2023-12-24T18:49:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.557+0000 7fdefda2e700 1 -- 172.21.15.50:0/4275699640 wait complete. 2023-12-24T18:49:02.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:49:02.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:49:02.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.745+0000 7f57c88cc700 1 Processor -- start 2023-12-24T18:49:02.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.745+0000 7f57c88cc700 1 -- start start 2023-12-24T18:49:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c88cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c88cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c406a580 con 0x7f57c4158c40 2023-12-24T18:49:02.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c88cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c40cd110 con 0x7f57c40cc780 2023-12-24T18:49:02.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c88cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c406a7d0 con 0x7f57c406d450 2023-12-24T18:49:02.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57c4158c40 0x7f57c40cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56630/0 (socket says 172.21.15.50:56630) 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c2d9d700 1 -- 172.21.15.50:0/2923917448 learned_addr learned my addr 172.21.15.50:0/2923917448 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c359e700 1 --2- 172.21.15.50:0/2923917448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273490353 0 0) 0x7f57c406a580 con 0x7f57c4158c40 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57ac003570 con 0x7f57c4158c40 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636115007 0 0) 0x7f57c40cd110 con 0x7f57c40cc780 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c406a580 con 0x7f57c40cc780 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c359e700 1 -- 172.21.15.50:0/2923917448 >> v1:172.21.15.82:6789/0 conn(0x7f57c40cc780 legacy=0x7f57c406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c359e700 1 -- 172.21.15.50:0/2923917448 >> v1:172.21.15.50:6789/0 conn(0x7f57c4158c40 legacy=0x7f57c40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c359e700 1 -- 172.21.15.50:0/2923917448 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c406aab0 con 0x7f57c406d450 2023-12-24T18:49:02.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c359e700 1 --2- 172.21.15.50:0/2923917448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c40ccbd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e90 tx=0x7f57bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e430dd76f789dab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00e070 con 0x7f57c406d450 2023-12-24T18:49:02.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc00bb80 con 0x7f57c406d450 2023-12-24T18:49:02.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.749+0000 7f57c1d9b700 1 -- 172.21.15.50:0/2923917448 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc012430 con 0x7f57c406d450 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- 172.21.15.50:0/2923917448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 msgr2=0x7f57c40ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 --2- 172.21.15.50:0/2923917448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c40ccbd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e90 tx=0x7f57bc009780 comp rx=0 tx=0).stop 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- 172.21.15.50:0/2923917448 shutdown_connections 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 --2- 172.21.15.50:0/2923917448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c40ccbd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- 172.21.15.50:0/2923917448 >> 172.21.15.50:0/2923917448 conn(0x7f57c40d0800 msgr2=0x7f57c40b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- 172.21.15.50:0/2923917448 shutdown_connections 2023-12-24T18:49:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- 172.21.15.50:0/2923917448 wait complete. 2023-12-24T18:49:02.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 Processor -- start 2023-12-24T18:49:02.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- start start 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 0x7f57c414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4159600 con 0x7f57c40cc780 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c415a460 con 0x7f57c4158c40 2023-12-24T18:49:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.753+0000 7f57c88cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4159850 con 0x7f57c406d450 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54326/0 (socket says 172.21.15.50:54326) 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 -- 172.21.15.50:0/597073818 learned_addr learned my addr 172.21.15.50:0/597073818 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c2d9d700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c359e700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 0x7f57c414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 -- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 msgr2=0x7f57c414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 -- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 msgr2=0x7f57c414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 0x7f57c414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 -- 172.21.15.50:0/597073818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc009a20 con 0x7f57c40cc780 2023-12-24T18:49:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c359e700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 0x7f57c414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c259c700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7c0 tx=0x7f57b8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8010510 con 0x7f57c40cc780 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8010690 con 0x7f57c40cc780 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8010a50 con 0x7f57c40cc780 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c4159b30 con 0x7f57c40cc780 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c415a0f0 con 0x7f57c40cc780 2023-12-24T18:49:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.757+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c415a5f0 con 0x7f57c40cc780 2023-12-24T18:49:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.761+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f57b801b400 con 0x7f57c40cc780 2023-12-24T18:49:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.761+0000 7f57aaffd700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 0x7f57b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.761+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f57b807c3e0 con 0x7f57c40cc780 2023-12-24T18:49:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.761+0000 7f57c2d9d700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 0x7f57b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.761+0000 7f57c2d9d700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 0x7f57b0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57b40058d0 tx=0x7f57b4009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.765+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f57b804cb30 con 0x7f57c40cc780 2023-12-24T18:49:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.937+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57c404be40 con 0x7f57c40cc780 2023-12-24T18:49:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.937+0000 7f57aaffd700 1 -- 172.21.15.50:0/597073818 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57b8050150 con 0x7f57c40cc780 2023-12-24T18:49:02.941 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:49:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.937+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 msgr2=0x7f57b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.937+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 0x7f57b0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57b40058d0 tx=0x7f57b4009040 comp rx=0 tx=0).stop 2023-12-24T18:49:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.937+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 msgr2=0x7f57c414dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7c0 tx=0x7f57b8007e10 comp rx=0 tx=0).stop 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 shutdown_connections 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f57b0060550 0x7f57b0062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c4158c40 0x7f57c414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c40cc780 0x7f57c414dce0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 --2- 172.21.15.50:0/597073818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57c406d450 0x7f57c414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 >> 172.21.15.50:0/597073818 conn(0x7f57c40d0800 msgr2=0x7f57c4154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 shutdown_connections 2023-12-24T18:49:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:02.941+0000 7f57c88cc700 1 -- 172.21.15.50:0/597073818 wait complete. 2023-12-24T18:49:02.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:49:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.121+0000 7f0ce359e700 1 Processor -- start 2023-12-24T18:49:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.121+0000 7f0ce359e700 1 -- start start 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce4158e00 0x7f0ce41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ce406d8c0 0x7f0ce40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce4159710 con 0x7f0ce406a580 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce406b640 con 0x7f0ce406d8c0 2023-12-24T18:49:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40b5e10 con 0x7f0ce4158e00 2023-12-24T18:49:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54336/0 (socket says 172.21.15.50:54336) 2023-12-24T18:49:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ce406d8c0 0x7f0ce40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce2d9d700 1 -- 172.21.15.50:0/1443464506 learned_addr learned my addr 172.21.15.50:0/1443464506 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce259c700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce4158e00 0x7f0ce41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 -- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce4158e00 msgr2=0x7f0ce41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce4158e00 0x7f0ce41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 -- 172.21.15.50:0/1443464506 >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 msgr2=0x7f0ce40b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 --2- 172.21.15.50:0/1443464506 >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 -- 172.21.15.50:0/1443464506 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce406b8e0 con 0x7f0ce406d8c0 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce2d9d700 1 --2- 172.21.15.50:0/1443464506 >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce1d9b700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406d8c0 0x7f0ce40b3ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40d0f50 tx=0x7f0cd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b4a859ee611c18 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce159a700 1 -- 172.21.15.50:0/1443464506 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8011630 con 0x7f0ce406d8c0 2023-12-24T18:49:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.125+0000 7f0ce159a700 1 -- 172.21.15.50:0/1443464506 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80117b0 con 0x7f0ce406d8c0 2023-12-24T18:49:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce159a700 1 -- 172.21.15.50:0/1443464506 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8011b70 con 0x7f0ce406d8c0 2023-12-24T18:49:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 -- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406d8c0 msgr2=0x7f0ce40b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406d8c0 0x7f0ce40b3ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40d0f50 tx=0x7f0cd80091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 -- 172.21.15.50:0/1443464506 shutdown_connections 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406d8c0 0x7f0ce40b3ad0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 --2- 172.21.15.50:0/1443464506 >> v2:172.21.15.50:3300/0 conn(0x7f0ce406a580 0x7f0ce40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 --2- 172.21.15.50:0/1443464506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce4158e00 0x7f0ce41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 -- 172.21.15.50:0/1443464506 >> 172.21.15.50:0/1443464506 conn(0x7f0ce4067b80 msgr2=0x7f0ce40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 -- 172.21.15.50:0/1443464506 shutdown_connections 2023-12-24T18:49:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.129+0000 7f0ce359e700 1 -- 172.21.15.50:0/1443464506 wait complete. 2023-12-24T18:49:03.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 Processor -- start 2023-12-24T18:49:03.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 -- start start 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406a580 0x7f0ce41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce406d8c0 0x7f0ce4147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce415b1b0 con 0x7f0ce4158e00 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4147e70 con 0x7f0ce406a580 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce415f9d0 con 0x7f0ce406d8c0 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54348/0 (socket says 172.21.15.50:54348) 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce2d9d700 1 -- 172.21.15.50:0/3483248187 learned_addr learned my addr 172.21.15.50:0/3483248187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce259c700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406a580 0x7f0ce41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.133+0000 7f0ce1d9b700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce406d8c0 0x7f0ce4147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 -- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce406d8c0 msgr2=0x7f0ce4147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce406d8c0 0x7f0ce4147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 -- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406a580 msgr2=0x7f0ce41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406a580 0x7f0ce41549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 -- 172.21.15.50:0/3483248187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009ae0 con 0x7f0ce4158e00 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce2d9d700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009f30 tx=0x7f0cdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc018070 con 0x7f0ce4158e00 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00f040 con 0x7f0ce4158e00 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00cb70 con 0x7f0ce4158e00 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd8009420 con 0x7f0ce4158e00 2023-12-24T18:49:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce415f3c0 con 0x7f0ce4158e00 2023-12-24T18:49:03.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.137+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce415fb60 con 0x7f0ce4158e00 2023-12-24T18:49:03.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.141+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0cdc003020 con 0x7f0ce4158e00 2023-12-24T18:49:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.141+0000 7f0cd27fc700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 0x7f0cc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.141+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f0cdc07c5c0 con 0x7f0ce4158e00 2023-12-24T18:49:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.141+0000 7f0ce259c700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 0x7f0cc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.141+0000 7f0ce259c700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 0x7f0cc4062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009db0 tx=0x7f0cd40091a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.149+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cdc04bbe0 con 0x7f0ce4158e00 2023-12-24T18:49:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.325+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ce415b2f0 con 0x7f0ce4158e00 2023-12-24T18:49:03.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.325+0000 7f0cd27fc700 1 -- 172.21.15.50:0/3483248187 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0cdc04cbc0 con 0x7f0ce4158e00 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:03.328 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 msgr2=0x7f0cc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 0x7f0cc4062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009db0 tx=0x7f0cd40091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 msgr2=0x7f0ce416d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009f30 tx=0x7f0cdc00b040 comp rx=0 tx=0).stop 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 shutdown_connections 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0cc4060550 0x7f0cc4062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce4158e00 0x7f0ce416d060 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ce406d8c0 0x7f0ce4147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 --2- 172.21.15.50:0/3483248187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce406a580 0x7f0ce41549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 >> 172.21.15.50:0/3483248187 conn(0x7f0ce4067b80 msgr2=0x7f0ce40b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 shutdown_connections 2023-12-24T18:49:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.329+0000 7f0ce359e700 1 -- 172.21.15.50:0/3483248187 wait complete. 2023-12-24T18:49:03.354 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:49:03.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:49:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.525+0000 7fc71166e700 1 Processor -- start 2023-12-24T18:49:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.525+0000 7fc71166e700 1 -- start start 2023-12-24T18:49:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc71166e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc70c0cbf50 0x7fc70c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc71166e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c06da40 0x7fc70c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc71166e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c06b000 con 0x7fc70c0cbb80 2023-12-24T18:49:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc71166e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c06bba0 con 0x7fc70c0cbf50 2023-12-24T18:49:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc71166e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c06d570 con 0x7fc70c06da40 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc70c0cbf50 0x7fc70c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc70c0cbf50 0x7fc70c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54358/0 (socket says 172.21.15.50:54358) 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2073546699 learned_addr learned my addr 172.21.15.50:0/2073546699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70affd700 1 --1- 172.21.15.50:0/2073546699 >> v1:172.21.15.50:6789/0 conn(0x7fc70c0cbb80 0x7fc70c06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56632/0 (socket says 172.21.15.50:56632) 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70b7fe700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c06da40 0x7fc70c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2073546699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c06da40 msgr2=0x7fc70c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c06da40 0x7fc70c06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2073546699 >> v1:172.21.15.50:6789/0 conn(0x7fc70c0cbb80 legacy=0x7fc70c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.529+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2073546699 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c06a6d0 con 0x7fc70c0cbf50 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc70a7fc700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbf50 0x7fc70c15d430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc7000099b0 tx=0x7fc700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56694cf9dcd58d80 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc709ffb700 1 -- 172.21.15.50:0/2073546699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700009ea0 con 0x7fc70c0cbf50 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc709ffb700 1 -- 172.21.15.50:0/2073546699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70000b860 con 0x7fc70c0cbf50 2023-12-24T18:49:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc709ffb700 1 -- 172.21.15.50:0/2073546699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000bc00 con 0x7fc70c0cbf50 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 -- 172.21.15.50:0/2073546699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbf50 msgr2=0x7fc70c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbf50 0x7fc70c15d430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc7000099b0 tx=0x7fc700009250 comp rx=0 tx=0).stop 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 -- 172.21.15.50:0/2073546699 shutdown_connections 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c06da40 0x7fc70c06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 --2- 172.21.15.50:0/2073546699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbf50 0x7fc70c15d430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 -- 172.21.15.50:0/2073546699 >> 172.21.15.50:0/2073546699 conn(0x7fc70c067b80 msgr2=0x7fc70c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 -- 172.21.15.50:0/2073546699 shutdown_connections 2023-12-24T18:49:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.533+0000 7fc71166e700 1 -- 172.21.15.50:0/2073546699 wait complete. 2023-12-24T18:49:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 Processor -- start 2023-12-24T18:49:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 -- start start 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c06da40 0x7fc70c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c0cbf50 0x7fc70c0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c15a2c0 con 0x7fc70c0cbb80 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c1596b0 con 0x7fc70c06da40 2023-12-24T18:49:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc71166e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c159990 con 0x7fc70c0cbf50 2023-12-24T18:49:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54370/0 (socket says 172.21.15.50:54370) 2023-12-24T18:49:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2733068170 learned_addr learned my addr 172.21.15.50:0/2733068170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70affd700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c06da40 0x7fc70c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70b7fe700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c0cbf50 0x7fc70c0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c0cbf50 msgr2=0x7fc70c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c0cbf50 0x7fc70c0b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c06da40 msgr2=0x7fc70c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c06da40 0x7fc70c156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.537+0000 7fc70a7fc700 1 -- 172.21.15.50:0/2733068170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000094f0 con 0x7fc70c0cbb80 2023-12-24T18:49:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc70a7fc700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc70c064360 tx=0x7fc700017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700000d10 con 0x7fc70c0cbb80 2023-12-24T18:49:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70000bbe0 con 0x7fc70c0cbb80 2023-12-24T18:49:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c159c70 con 0x7fc70c0cbb80 2023-12-24T18:49:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700011670 con 0x7fc70c0cbb80 2023-12-24T18:49:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.541+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c1570f0 con 0x7fc70c0cbb80 2023-12-24T18:49:03.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.545+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c04be40 con 0x7fc70c0cbb80 2023-12-24T18:49:03.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.545+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc700011aa0 con 0x7fc70c0cbb80 2023-12-24T18:49:03.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.549+0000 7fc6f2ffd700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 0x7fc6f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.549+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fc70007df10 con 0x7fc70c0cbb80 2023-12-24T18:49:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.549+0000 7fc70affd700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 0x7fc6f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:03.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.549+0000 7fc70affd700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 0x7fc6f8062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc004fd0 tx=0x7fc6fc007eb0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:03.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.553+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc70004e510 con 0x7fc70c0cbb80 2023-12-24T18:49:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:03.729+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc70c06a9b0 con 0x7fc70c0cbb80 2023-12-24T18:49:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.717+0000 7fc6f2ffd700 1 -- 172.21.15.50:0/2733068170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc700051b30 con 0x7fc70c0cbb80 2023-12-24T18:49:04.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 msgr2=0x7fc6f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 0x7fc6f8062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc004fd0 tx=0x7fc6fc007eb0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 msgr2=0x7fc70c0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc70c064360 tx=0x7fc700017000 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 shutdown_connections 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc6f8060550 0x7fc6f8062a00 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc004fd0 tx=0x7fc6fc007eb0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc70c0cbf50 0x7fc70c0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0cbb80 0x7fc70c0b4700 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 --2- 172.21.15.50:0/2733068170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c06da40 0x7fc70c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.721+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 >> 172.21.15.50:0/2733068170 conn(0x7fc70c067b80 msgr2=0x7fc70c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:04.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.725+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 shutdown_connections 2023-12-24T18:49:04.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.725+0000 7fc71166e700 1 -- 172.21.15.50:0/2733068170 wait complete. 2023-12-24T18:49:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:49:04.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:49:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.929+0000 7f19ab4f0700 1 Processor -- start 2023-12-24T18:49:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.929+0000 7f19ab4f0700 1 -- start start 2023-12-24T18:49:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19ab4f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19a40afc10 0x7f19a41554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19ab4f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a40adfb0 con 0x7f19a40b0810 2023-12-24T18:49:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19ab4f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a40c93c0 con 0x7f19a40ae420 2023-12-24T18:49:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19ab4f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a41559e0 con 0x7f19a40afc10 2023-12-24T18:49:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19a40afc10 0x7f19a41554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a9a8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19a40b0810 0x7f19a40b0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56638/0 (socket says 172.21.15.50:56638) 2023-12-24T18:49:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19a40afc10 0x7f19a41554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54372/0 (socket says 172.21.15.50:54372) 2023-12-24T18:49:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a9a8d700 1 -- 172.21.15.50:0/667362236 learned_addr learned my addr 172.21.15.50:0/667362236 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35961106 0 0) 0x7f19a40c93c0 con 0x7f19a40ae420 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1990003570 con 0x7f19a40ae420 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 -- 172.21.15.50:0/667362236 >> v1:172.21.15.82:6789/0 conn(0x7f19a40ae420 legacy=0x7f19a4063430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 -- 172.21.15.50:0/667362236 >> v1:172.21.15.50:6789/0 conn(0x7f19a40b0810 legacy=0x7f19a40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831241772 0 0) 0x7f19a40adfb0 con 0x7f19a40b0810 2023-12-24T18:49:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 -- 172.21.15.50:0/667362236 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40b0180 con 0x7f19a40afc10 2023-12-24T18:49:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.933+0000 7f19a928c700 1 --2- 172.21.15.50:0/667362236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40afc10 0x7f19a41554a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f19a00098e0 tx=0x7f19a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c583bea5833eb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a000b640 con 0x7f19a40afc10 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a000b7a0 con 0x7f19a40afc10 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f199bfff700 1 -- 172.21.15.50:0/667362236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a000bb40 con 0x7f19a40afc10 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 -- 172.21.15.50:0/667362236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40afc10 msgr2=0x7f19a41554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/667362236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40afc10 0x7f19a41554a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f19a00098e0 tx=0x7f19a00091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 -- 172.21.15.50:0/667362236 shutdown_connections 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/667362236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40afc10 0x7f19a41554a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 -- 172.21.15.50:0/667362236 >> 172.21.15.50:0/667362236 conn(0x7f19a406c820 msgr2=0x7f19a406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 -- 172.21.15.50:0/667362236 shutdown_connections 2023-12-24T18:49:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.937+0000 7f19ab4f0700 1 -- 172.21.15.50:0/667362236 wait complete. 2023-12-24T18:49:04.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.941+0000 7f19ab4f0700 1 Processor -- start 2023-12-24T18:49:04.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.941+0000 7f19ab4f0700 1 -- start start 2023-12-24T18:49:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19a40ae420 0x7f19a412fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19a40afc10 0x7f19a4148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a414bd20 con 0x7f19a40b0810 2023-12-24T18:49:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4130df0 con 0x7f19a40ae420 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a41301e0 con 0x7f19a40afc10 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54376/0 (socket says 172.21.15.50:54376) 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 -- 172.21.15.50:0/1139688083 learned_addr learned my addr 172.21.15.50:0/1139688083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a928c700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19a40ae420 0x7f19a412fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a8a8b700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19a40afc10 0x7f19a4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 -- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19a40afc10 msgr2=0x7f19a4148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19a40afc10 0x7f19a4148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 -- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19a40ae420 msgr2=0x7f19a412fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19a40ae420 0x7f19a412fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 -- 172.21.15.50:0/1139688083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009420 con 0x7f19a40b0810 2023-12-24T18:49:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19a9a8d700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f199c00ccc0 tx=0x7f199c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00a880 con 0x7f19a40b0810 2023-12-24T18:49:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00a9e0 con 0x7f19a40b0810 2023-12-24T18:49:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a41304c0 con 0x7f19a40b0810 2023-12-24T18:49:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00ad80 con 0x7f19a40b0810 2023-12-24T18:49:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.945+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a4130a80 con 0x7f19a40b0810 2023-12-24T18:49:04.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.949+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a4130fa0 con 0x7f19a40b0810 2023-12-24T18:49:04.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.949+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f199c007300 con 0x7f19a40b0810 2023-12-24T18:49:04.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.953+0000 7f19997fa700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 0x7f1988062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:04.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.953+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5891+0+0 (secure 0 0 0) 0x7f199c07cc20 con 0x7f19a40b0810 2023-12-24T18:49:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.953+0000 7f19a928c700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 0x7f1988062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:04.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.953+0000 7f19a928c700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 0x7f1988062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19a00093f0 tx=0x7f19a0017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:04.961+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19a4130fa0 con 0x7f19a40b0810 2023-12-24T18:49:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.137+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19a4130f60 con 0x7f19a40b0810 2023-12-24T18:49:05.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.729+0000 7f19997fa700 1 -- 172.21.15.50:0/1139688083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f199c04d130 con 0x7f19a40b0810 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 msgr2=0x7f1988062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 0x7f1988062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19a00093f0 tx=0x7f19a0017000 comp rx=0 tx=0).stop 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 msgr2=0x7f19a4146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f199c00ccc0 tx=0x7f199c001a20 comp rx=0 tx=0).stop 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 shutdown_connections 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1988060550 0x7f1988062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a40b0810 0x7f19a4146a40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19a40afc10 0x7f19a4148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 --2- 172.21.15.50:0/1139688083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19a40ae420 0x7f19a412fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.737+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 >> 172.21.15.50:0/1139688083 conn(0x7f19a406c820 msgr2=0x7f19a40632f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.741+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 shutdown_connections 2023-12-24T18:49:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.741+0000 7f19ab4f0700 1 -- 172.21.15.50:0/1139688083 wait complete. 2023-12-24T18:49:05.749 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:49:05.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:49:05.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.933+0000 7f7cadc0c700 1 Processor -- start 2023-12-24T18:49:05.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.933+0000 7f7cadc0c700 1 -- start start 2023-12-24T18:49:05.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cadc0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 0x7f7ca8161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:05.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cadc0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca815b5a0 con 0x7f7ca8156e80 2023-12-24T18:49:05.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cadc0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca815a990 con 0x7f7ca8156ab0 2023-12-24T18:49:05.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cadc0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815ac70 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ca8156e80 0x7f7ca80c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56652/0 (socket says 172.21.15.50:56652) 2023-12-24T18:49:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9ffff700 1 -- 172.21.15.50:0/1319262501 learned_addr learned my addr 172.21.15.50:0/1319262501 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cad40b700 1 --2- 172.21.15.50:0/1319262501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 0x7f7ca8161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085454159 0 0) 0x7f7ca815a990 con 0x7f7ca8156ab0 2023-12-24T18:49:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c90003570 con 0x7f7ca8156ab0 2023-12-24T18:49:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980516351 0 0) 0x7f7ca815b5a0 con 0x7f7ca8156e80 2023-12-24T18:49:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca815a990 con 0x7f7ca8156e80 2023-12-24T18:49:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cad40b700 1 -- 172.21.15.50:0/1319262501 >> v1:172.21.15.82:6789/0 conn(0x7f7ca8156ab0 legacy=0x7f7ca80adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cad40b700 1 -- 172.21.15.50:0/1319262501 >> v1:172.21.15.50:6789/0 conn(0x7f7ca8156e80 legacy=0x7f7ca80c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.937+0000 7f7cad40b700 1 -- 172.21.15.50:0/1319262501 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca815af50 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cad40b700 1 --2- 172.21.15.50:0/1319262501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 0x7f7ca8161c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009e90 tx=0x7f7ca0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d364433be9668cab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000e070 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000bb80 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7c9f7fe700 1 -- 172.21.15.50:0/1319262501 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0012430 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 -- 172.21.15.50:0/1319262501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 msgr2=0x7f7ca8161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/1319262501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 0x7f7ca8161c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009e90 tx=0x7f7ca0009780 comp rx=0 tx=0).stop 2023-12-24T18:49:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 -- 172.21.15.50:0/1319262501 shutdown_connections 2023-12-24T18:49:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/1319262501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca80c8ee0 0x7f7ca8161c30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 -- 172.21.15.50:0/1319262501 >> 172.21.15.50:0/1319262501 conn(0x7f7ca8067250 msgr2=0x7f7ca8067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:05.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 -- 172.21.15.50:0/1319262501 shutdown_connections 2023-12-24T18:49:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.941+0000 7f7cadc0c700 1 -- 172.21.15.50:0/1319262501 wait complete. 2023-12-24T18:49:05.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 Processor -- start 2023-12-24T18:49:05.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 -- start start 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca80c8ee0 0x7f7ca816a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca8156e80 0x7f7ca8169340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca816c6c0 con 0x7f7ca8156ab0 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80a88e0 con 0x7f7ca80c8ee0 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cadc0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80a8bc0 con 0x7f7ca8156e80 2023-12-24T18:49:05.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54382/0 (socket says 172.21.15.50:54382) 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 -- 172.21.15.50:0/3900414006 learned_addr learned my addr 172.21.15.50:0/3900414006 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cacc0a700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca80c8ee0 0x7f7ca816a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7cad40b700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca8156e80 0x7f7ca8169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 -- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca8156e80 msgr2=0x7f7ca8169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca8156e80 0x7f7ca8169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 -- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca80c8ee0 msgr2=0x7f7ca816a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca80c8ee0 0x7f7ca816a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 -- 172.21.15.50:0/3900414006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca0009a20 con 0x7f7ca8156ab0 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9ffff700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c980011e0 tx=0x7f7c98007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.945+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005b30 con 0x7f7ca8156ab0 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98005c90 con 0x7f7ca8156ab0 2023-12-24T18:49:05.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80a8ea0 con 0x7f7ca8156ab0 2023-12-24T18:49:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98007320 con 0x7f7ca8156ab0 2023-12-24T18:49:05.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca80a9460 con 0x7f7ca8156ab0 2023-12-24T18:49:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca8067620 con 0x7f7ca8156ab0 2023-12-24T18:49:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.949+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7c98007690 con 0x7f7ca8156ab0 2023-12-24T18:49:05.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.953+0000 7f7c9cff9700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 0x7f7c94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:05.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.953+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7c9807be60 con 0x7f7ca8156ab0 2023-12-24T18:49:05.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.953+0000 7f7cacc0a700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 0x7f7c94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:05.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.953+0000 7f7cacc0a700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 0x7f7c94062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80c6a80 tx=0x7f7ca4007d50 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:05.957+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ca8067620 con 0x7f7ca8156ab0 2023-12-24T18:49:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.165+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7ca8067620 con 0x7f7ca8156ab0 2023-12-24T18:49:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.753+0000 7f7c9cff9700 1 -- 172.21.15.50:0/3900414006 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7ca8067620 con 0x7f7ca8156ab0 2023-12-24T18:49:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 msgr2=0x7f7c94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 0x7f7c94062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80c6a80 tx=0x7f7ca4007d50 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 msgr2=0x7f7ca816c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c980011e0 tx=0x7f7c98007df0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 shutdown_connections 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7c94060550 0x7f7c94062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ca8156e80 0x7f7ca8169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ca8156ab0 0x7f7ca816c180 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 --2- 172.21.15.50:0/3900414006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca80c8ee0 0x7f7ca816a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 >> 172.21.15.50:0/3900414006 conn(0x7f7ca8067250 msgr2=0x7f7ca8152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 shutdown_connections 2023-12-24T18:49:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.773+0000 7f7cadc0c700 1 -- 172.21.15.50:0/3900414006 wait complete. 2023-12-24T18:49:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 7 and data pool 8 2023-12-24T18:49:06.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:49:06.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 Processor -- start 2023-12-24T18:49:06.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 -- start start 2023-12-24T18:49:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8c815a2d0 0x7fa8c80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c80b0460 con 0x7fa8c806c820 2023-12-24T18:49:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c806d8c0 con 0x7fa8c815a2d0 2023-12-24T18:49:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80afc60 con 0x7fa8c80ade60 2023-12-24T18:49:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43398/0 (socket says 172.21.15.50:43398) 2023-12-24T18:49:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c6d9d700 1 -- 172.21.15.50:0/3831006899 learned_addr learned my addr 172.21.15.50:0/3831006899 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.973+0000 7fa8c659c700 1 --2- 172.21.15.50:0/3831006899 >> v2:172.21.15.82:3300/0 conn(0x7fa8c815a2d0 0x7fa8c80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c659c700 1 -- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 msgr2=0x7fa8c8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c659c700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c659c700 1 -- 172.21.15.50:0/3831006899 >> v1:172.21.15.82:6789/0 conn(0x7fa8c806c820 legacy=0x7fa8c80ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c659c700 1 -- 172.21.15.50:0/3831006899 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c806a5c0 con 0x7fa8c815a2d0 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c6d9d700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c559a700 1 -- 172.21.15.50:0/3831006899 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100377152 0 0) 0x7fa8c80b0460 con 0x7fa8c806c820 2023-12-24T18:49:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c659c700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c80ae8b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098e0 tx=0x7fa8b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77e28595920e3e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:06.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c559a700 1 -- 172.21.15.50:0/3831006899 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800b640 con 0x7fa8c815a2d0 2023-12-24T18:49:06.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c559a700 1 -- 172.21.15.50:0/3831006899 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800b7a0 con 0x7fa8c815a2d0 2023-12-24T18:49:06.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c559a700 1 -- 172.21.15.50:0/3831006899 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800bb40 con 0x7fa8c815a2d0 2023-12-24T18:49:06.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 -- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 msgr2=0x7fa8c80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c80ae8b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098e0 tx=0x7fa8b80091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 -- 172.21.15.50:0/3831006899 shutdown_connections 2023-12-24T18:49:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c80ade60 0x7fa8c8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 --2- 172.21.15.50:0/3831006899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c80ae8b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 -- 172.21.15.50:0/3831006899 >> 172.21.15.50:0/3831006899 conn(0x7fa8c8067b80 msgr2=0x7fa8c80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 -- 172.21.15.50:0/3831006899 shutdown_connections 2023-12-24T18:49:06.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.977+0000 7fa8c759e700 1 -- 172.21.15.50:0/3831006899 wait complete. 2023-12-24T18:49:06.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 Processor -- start 2023-12-24T18:49:06.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 -- start start 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c806c820 0x7fa8c815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c816c8d0 con 0x7fa8c80ade60 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8169790 con 0x7fa8c815a2d0 2023-12-24T18:49:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8169a70 con 0x7fa8c806c820 2023-12-24T18:49:06.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54394/0 (socket says 172.21.15.50:54394) 2023-12-24T18:49:06.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c5d9b700 1 -- 172.21.15.50:0/393045894 learned_addr learned my addr 172.21.15.50:0/393045894 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:06.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c6d9d700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.981+0000 7fa8c659c700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c806c820 0x7fa8c815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 -- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c806c820 msgr2=0x7fa8c815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c806c820 0x7fa8c815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 -- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 msgr2=0x7fa8c815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:06.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 -- 172.21.15.50:0/393045894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0009ae0 con 0x7fa8c80ade60 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c5d9b700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c530 tx=0x7fa8bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011590 con 0x7fa8c80ade60 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc011710 con 0x7fa8c80ade60 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b8009420 con 0x7fa8c80ade60 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011ad0 con 0x7fa8c80ade60 2023-12-24T18:49:06.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c815ac90 con 0x7fa8c80ade60 2023-12-24T18:49:06.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.985+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c816ca40 con 0x7fa8c80ade60 2023-12-24T18:49:06.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.989+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa8bc01b3b0 con 0x7fa8c80ade60 2023-12-24T18:49:06.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.989+0000 7fa8b67fc700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 0x7fa8a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:06.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.989+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fa8bc07bf10 con 0x7fa8c80ade60 2023-12-24T18:49:06.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.989+0000 7fa8c659c700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 0x7fa8a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:06.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.989+0000 7fa8c659c700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 0x7fa8a8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80093f0 tx=0x7fa8b8017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:06.997+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8c816ca40 con 0x7fa8c80ade60 2023-12-24T18:49:07.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.177+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c816ca10 con 0x7fa8c80ade60 2023-12-24T18:49:07.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8b67fc700 1 -- 172.21.15.50:0/393045894 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16048 (secure 0 0 0) 0x7fa8bc04c1c0 con 0x7fa8c80ade60 2023-12-24T18:49:07.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":66,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:49:06.169713+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:49:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 msgr2=0x7fa8a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 0x7fa8a8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80093f0 tx=0x7fa8b8017000 comp rx=0 tx=0).stop 2023-12-24T18:49:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 msgr2=0x7fa8c81559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c530 tx=0x7fa8bc00c840 comp rx=0 tx=0).stop 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 shutdown_connections 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fa8a8060550 0x7fa8a8062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8c815a2d0 0x7fa8c815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c80ade60 0x7fa8c81559d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 --2- 172.21.15.50:0/393045894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8c806c820 0x7fa8c815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 >> 172.21.15.50:0/393045894 conn(0x7fa8c8067b80 msgr2=0x7fa8c806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 shutdown_connections 2023-12-24T18:49:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.181+0000 7fa8c759e700 1 -- 172.21.15.50:0/393045894 wait complete. 2023-12-24T18:49:07.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:49:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.373+0000 7f252fb45700 1 Processor -- start 2023-12-24T18:49:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.373+0000 7f252fb45700 1 -- start start 2023-12-24T18:49:07.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25280b4740 0x7f2528161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25280b22b0 0x7f2528161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252815e290 con 0x7f25280b4370 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252815da30 con 0x7f25280b4740 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2528161ab0 con 0x7f25280b22b0 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25280b4740 0x7f2528161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25280b4740 0x7f2528161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54400/0 (socket says 172.21.15.50:54400) 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 -- 172.21.15.50:0/2508808014 learned_addr learned my addr 172.21.15.50:0/2508808014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d8e1700 1 --1- 172.21.15.50:0/2508808014 >> v1:172.21.15.50:6789/0 conn(0x7f25280b4370 0x7f25280b1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56662/0 (socket says 172.21.15.50:56662) 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252e0e2700 1 --2- 172.21.15.50:0/2508808014 >> v2:172.21.15.82:3300/0 conn(0x7f25280b22b0 0x7f2528161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 -- 172.21.15.50:0/2508808014 >> v2:172.21.15.82:3300/0 conn(0x7f25280b22b0 msgr2=0x7f2528161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 --2- 172.21.15.50:0/2508808014 >> v2:172.21.15.82:3300/0 conn(0x7f25280b22b0 0x7f2528161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 -- 172.21.15.50:0/2508808014 >> v1:172.21.15.50:6789/0 conn(0x7f25280b4370 legacy=0x7f25280b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 -- 172.21.15.50:0/2508808014 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528161d60 con 0x7f25280b4740 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252d0e0700 1 --2- 172.21.15.50:0/2508808014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b4740 0x7f2528161030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f25280b2cd0 tx=0x7f2518009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8da199d6a2ac103 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252c8df700 1 -- 172.21.15.50:0/2508808014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518009e70 con 0x7f25280b4740 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252c8df700 1 -- 172.21.15.50:0/2508808014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800b860 con 0x7f25280b4740 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252c8df700 1 -- 172.21.15.50:0/2508808014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800bc00 con 0x7f25280b4740 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- 172.21.15.50:0/2508808014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b4740 msgr2=0x7f2528161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 --2- 172.21.15.50:0/2508808014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b4740 0x7f2528161030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f25280b2cd0 tx=0x7f2518009250 comp rx=0 tx=0).stop 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- 172.21.15.50:0/2508808014 shutdown_connections 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 --2- 172.21.15.50:0/2508808014 >> v2:172.21.15.82:3300/0 conn(0x7f25280b22b0 0x7f2528161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 --2- 172.21.15.50:0/2508808014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b4740 0x7f2528161030 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- 172.21.15.50:0/2508808014 >> 172.21.15.50:0/2508808014 conn(0x7f25280670b0 msgr2=0x7f25280674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- 172.21.15.50:0/2508808014 shutdown_connections 2023-12-24T18:49:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.377+0000 7f252fb45700 1 -- 172.21.15.50:0/2508808014 wait complete. 2023-12-24T18:49:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 Processor -- start 2023-12-24T18:49:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 -- start start 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25280b4370 0x7f25280cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25280b4740 0x7f25280cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280ce8a0 con 0x7f25280b22b0 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280ceaf0 con 0x7f25280b4740 2023-12-24T18:49:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252fb45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280cedd0 con 0x7f25280b4370 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54404/0 (socket says 172.21.15.50:54404) 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 -- 172.21.15.50:0/3478252072 learned_addr learned my addr 172.21.15.50:0/3478252072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252e0e2700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25280b4740 0x7f25280cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d0e0700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25280b4370 0x7f25280cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 -- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25280b4370 msgr2=0x7f25280cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25280b4370 0x7f25280cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 -- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25280b4740 msgr2=0x7f25280cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25280b4740 0x7f25280cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.381+0000 7f252d8e1700 1 -- 172.21.15.50:0/3478252072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180094f0 con 0x7f25280b22b0 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f252d8e1700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f252400c7c0 tx=0x7f2524007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524005a70 con 0x7f25280b22b0 2023-12-24T18:49:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524005bf0 con 0x7f25280b22b0 2023-12-24T18:49:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240070f0 con 0x7f25280b22b0 2023-12-24T18:49:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25280cf0b0 con 0x7f25280b22b0 2023-12-24T18:49:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252816dea0 con 0x7f25280b22b0 2023-12-24T18:49:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25280652e0 con 0x7f25280b22b0 2023-12-24T18:49:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.385+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2524007460 con 0x7f25280b22b0 2023-12-24T18:49:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.389+0000 7f251dffb700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 0x7f250c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.389+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f252407c540 con 0x7f25280b22b0 2023-12-24T18:49:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.389+0000 7f252d0e0700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 0x7f250c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.389+0000 7f252d0e0700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 0x7f250c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25280b2cd0 tx=0x7f2518017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.393+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f252404c910 con 0x7f25280b22b0 2023-12-24T18:49:07.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.565+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f252815dc40 con 0x7f25280b22b0 2023-12-24T18:49:07.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.565+0000 7f251dffb700 1 -- 172.21.15.50:0/3478252072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16048 (secure 0 0 0) 0x7f252404ff30 con 0x7f25280b22b0 2023-12-24T18:49:07.570 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:07.570 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":66,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:49:06.169713+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 msgr2=0x7f250c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 0x7f250c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25280b2cd0 tx=0x7f2518017000 comp rx=0 tx=0).stop 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 msgr2=0x7f252816d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f252400c7c0 tx=0x7f2524007f70 comp rx=0 tx=0).stop 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 shutdown_connections 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f250c060550 0x7f250c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25280b4740 0x7f25280cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25280b4370 0x7f25280cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 --2- 172.21.15.50:0/3478252072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25280b22b0 0x7f252816d960 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 >> 172.21.15.50:0/3478252072 conn(0x7f25280670b0 msgr2=0x7f252806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 shutdown_connections 2023-12-24T18:49:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.569+0000 7f252fb45700 1 -- 172.21.15.50:0/3478252072 wait complete. 2023-12-24T18:49:07.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:49:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 Processor -- start 2023-12-24T18:49:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 -- start start 2023-12-24T18:49:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 0x7f67d80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d80b3fd0 con 0x7f67d8158e00 2023-12-24T18:49:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d80b33c0 con 0x7f67d806c820 2023-12-24T18:49:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dfc25700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b36a0 con 0x7f67d806ae20 2023-12-24T18:49:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dd9c1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67d8158e00 0x7f67d806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56668/0 (socket says 172.21.15.50:56668) 2023-12-24T18:49:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.749+0000 7f67dd9c1700 1 -- 172.21.15.50:0/2875740744 learned_addr learned my addr 172.21.15.50:0/2875740744 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd1c0700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 0x7f67d80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160058337 0 0) 0x7f67d80b3fd0 con 0x7f67d8158e00 2023-12-24T18:49:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c4003570 con 0x7f67d8158e00 2023-12-24T18:49:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648026025 0 0) 0x7f67c4003570 con 0x7f67d8158e00 2023-12-24T18:49:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 msgr2=0x7f67d80b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 0x7f67d80b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 >> v1:172.21.15.82:6789/0 conn(0x7f67d806c820 legacy=0x7f67d8162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80b3980 con 0x7f67d8158e00 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f67d4001470 con 0x7f67d8158e00 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 >> v1:172.21.15.50:6789/0 conn(0x7f67d8158e00 legacy=0x7f67d806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c4003a90 0x7f67c4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 0x7f67c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d50 0x7f67c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b36a0 con 0x7f67c4003a90 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c400bba0 con 0x7f67c4004d50 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c400bd60 con 0x7f67d806ae20 2023-12-24T18:49:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c4003a90 0x7f67c4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 -- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 msgr2=0x7f67c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d806ae20 0x7f67c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 -- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d50 msgr2=0x7f67c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d50 0x7f67c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 -- 172.21.15.50:0/2875740744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4003570 con 0x7f67c4003a90 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c4003a90 0x7f67c4003ea0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c390 tx=0x7f67d80b3f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27165b05bd0acb7b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d400cc60 con 0x7f67c4003a90 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d400cdc0 con 0x7f67c4003a90 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dc9bf700 1 -- 172.21.15.50:0/2875740744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4005b50 con 0x7f67c4003a90 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 -- 172.21.15.50:0/2875740744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c4003a90 msgr2=0x7f67c4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2875740744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c4003a90 0x7f67c4003ea0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c390 tx=0x7f67d80b3f40 comp rx=0 tx=0).stop 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67de1c2700 1 -- 172.21.15.50:0/2875740744 reap_dead start 2023-12-24T18:49:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 -- 172.21.15.50:0/2875740744 shutdown_connections 2023-12-24T18:49:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 -- 172.21.15.50:0/2875740744 >> 172.21.15.50:0/2875740744 conn(0x7f67d8067b80 msgr2=0x7f67d80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 -- 172.21.15.50:0/2875740744 shutdown_connections 2023-12-24T18:49:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.753+0000 7f67dfc25700 1 -- 172.21.15.50:0/2875740744 wait complete. 2023-12-24T18:49:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 Processor -- start 2023-12-24T18:49:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 -- start start 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c4003a90 0x7f67d814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d814dfb0 0x7f67d80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d816cdc0 con 0x7f67d815a160 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d815ab10 con 0x7f67d814dfb0 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dfc25700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d816d8e0 con 0x7f67c4003a90 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54410/0 (socket says 172.21.15.50:54410) 2023-12-24T18:49:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 -- 172.21.15.50:0/2427230580 learned_addr learned my addr 172.21.15.50:0/2427230580 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c4003a90 0x7f67d814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67dd1c0700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d814dfb0 0x7f67d80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 -- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c4003a90 msgr2=0x7f67d814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c4003a90 0x7f67d814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 -- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d814dfb0 msgr2=0x7f67d80d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d814dfb0 0x7f67d80d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:07.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.757+0000 7f67de1c2700 1 -- 172.21.15.50:0/2427230580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d816dd70 con 0x7f67d815a160 2023-12-24T18:49:07.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.761+0000 7f67de1c2700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b60b0 tx=0x7f67d00015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0005da0 con 0x7f67d815a160 2023-12-24T18:49:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0007070 con 0x7f67d815a160 2023-12-24T18:49:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d814dd80 con 0x7f67d815a160 2023-12-24T18:49:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0007430 con 0x7f67d815a160 2023-12-24T18:49:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d816d290 con 0x7f67d815a160 2023-12-24T18:49:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d80652e0 con 0x7f67d815a160 2023-12-24T18:49:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.765+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f67d00077e0 con 0x7f67d815a160 2023-12-24T18:49:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.769+0000 7f67cdffb700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 0x7f67bc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.769+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f67d007c260 con 0x7f67d815a160 2023-12-24T18:49:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.769+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 0x7f67bc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.769+0000 7f67dd9c1700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 0x7f67bc062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67d4007cd0 tx=0x7f67d4015000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.773+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f67d004c630 con 0x7f67d815a160 2023-12-24T18:49:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:07.981+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67d80b3c60 con 0x7f67d815a160 2023-12-24T18:49:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.777+0000 7f67cdffb700 1 -- 172.21.15.50:0/2427230580 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67d004fc50 con 0x7f67d815a160 2023-12-24T18:49:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 msgr2=0x7f67bc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 0x7f67bc062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67d4007cd0 tx=0x7f67d4015000 comp rx=0 tx=0).stop 2023-12-24T18:49:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 msgr2=0x7f67d815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b60b0 tx=0x7f67d00015e0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 shutdown_connections 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f67bc060580 0x7f67bc062a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d815a160 0x7f67d815a5d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d814dfb0 0x7f67d80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 --2- 172.21.15.50:0/2427230580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c4003a90 0x7f67d814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 >> 172.21.15.50:0/2427230580 conn(0x7f67d8067b80 msgr2=0x7f67d806cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 shutdown_connections 2023-12-24T18:49:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.781+0000 7f67dfc25700 1 -- 172.21.15.50:0/2427230580 wait complete. 2023-12-24T18:49:08.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:49:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.989+0000 7f198a385700 1 Processor -- start 2023-12-24T18:49:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.989+0000 7f198a385700 1 -- start start 2023-12-24T18:49:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f198a385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19841591a0 0x7f198406a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f198a385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 0x7f198406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f198a385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b3b90 con 0x7f1984158dd0 2023-12-24T18:49:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f198a385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840b4730 con 0x7f19841591a0 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f198a385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840b5e80 con 0x7f198406dd90 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19841591a0 0x7f198406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19841591a0 0x7f198406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54426/0 (socket says 172.21.15.50:54426) 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f1983fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1984158dd0 0x7f19840b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56680/0 (socket says 172.21.15.50:56680) 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 -- 172.21.15.50:0/3067450110 learned_addr learned my addr 172.21.15.50:0/3067450110 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f1988922700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 0x7f198406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 -- 172.21.15.50:0/3067450110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 msgr2=0x7f198406ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 0x7f198406ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 -- 172.21.15.50:0/3067450110 >> v1:172.21.15.50:6789/0 conn(0x7f1984158dd0 legacy=0x7f19840b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 -- 172.21.15.50:0/3067450110 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840b2f80 con 0x7f19841591a0 2023-12-24T18:49:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f1988922700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 0x7f198406ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.993+0000 7f19837fe700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f198406a730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f19780099b0 tx=0x7f1978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bf5e664ea280a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f1982ffd700 1 -- 172.21.15.50:0/3067450110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800b860 con 0x7f19841591a0 2023-12-24T18:49:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f1982ffd700 1 -- 172.21.15.50:0/3067450110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800b9c0 con 0x7f19841591a0 2023-12-24T18:49:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f1982ffd700 1 -- 172.21.15.50:0/3067450110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800bd60 con 0x7f19841591a0 2023-12-24T18:49:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 -- 172.21.15.50:0/3067450110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 msgr2=0x7f198406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f198406a730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f19780099b0 tx=0x7f1978009250 comp rx=0 tx=0).stop 2023-12-24T18:49:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 -- 172.21.15.50:0/3067450110 shutdown_connections 2023-12-24T18:49:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f198406dd90 0x7f198406ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 --2- 172.21.15.50:0/3067450110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f198406a730 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 -- 172.21.15.50:0/3067450110 >> 172.21.15.50:0/3067450110 conn(0x7f1984067b20 msgr2=0x7f19840cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 -- 172.21.15.50:0/3067450110 shutdown_connections 2023-12-24T18:49:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:08.997+0000 7f198a385700 1 -- 172.21.15.50:0/3067450110 wait complete. 2023-12-24T18:49:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 Processor -- start 2023-12-24T18:49:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 -- start start 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 0x7f198414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 0x7f198414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198414d4f0 con 0x7f19841591a0 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198414e350 con 0x7f198406dd90 2023-12-24T18:49:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.001+0000 7f198a385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198414d740 con 0x7f1984158dd0 2023-12-24T18:49:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1988922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1988922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54432/0 (socket says 172.21.15.50:54432) 2023-12-24T18:49:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1988922700 1 -- 172.21.15.50:0/2946522745 learned_addr learned my addr 172.21.15.50:0/2946522745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 0x7f198414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f19837fe700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 0x7f198414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 -- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 msgr2=0x7f198414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 0x7f198414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 -- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 msgr2=0x7f1984159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 -- 172.21.15.50:0/2946522745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780094f0 con 0x7f198406dd90 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1988922700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f19837fe700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 0x7f198414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f1983fff700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 0x7f198414e7e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f197400c7c0 tx=0x7f1974007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974005a70 con 0x7f198406dd90 2023-12-24T18:49:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974005bf0 con 0x7f198406dd90 2023-12-24T18:49:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198414da20 con 0x7f198406dd90 2023-12-24T18:49:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740070d0 con 0x7f198406dd90 2023-12-24T18:49:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.005+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198414dfe0 con 0x7f198406dd90 2023-12-24T18:49:09.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.009+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19840652e0 con 0x7f198406dd90 2023-12-24T18:49:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.009+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1974007440 con 0x7f198406dd90 2023-12-24T18:49:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.009+0000 7f196bfff700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 0x7f1970062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.009+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f197407be00 con 0x7f198406dd90 2023-12-24T18:49:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.009+0000 7f19837fe700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 0x7f1970062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.013+0000 7f19837fe700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 0x7f1970062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19780099b0 tx=0x7f1978017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.017+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f197404c0b0 con 0x7f198406dd90 2023-12-24T18:49:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.229+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f19840b3260 con 0x7f198406dd90 2023-12-24T18:49:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.785+0000 7f196bfff700 1 -- 172.21.15.50:0/2946522745 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f197404f6d0 con 0x7f198406dd90 2023-12-24T18:49:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 msgr2=0x7f1970062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 0x7f1970062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19780099b0 tx=0x7f1978017000 comp rx=0 tx=0).stop 2023-12-24T18:49:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 msgr2=0x7f198414e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 0x7f198414e7e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f197400c7c0 tx=0x7f1974007eb0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 shutdown_connections 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f1970060580 0x7f1970062a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19841591a0 0x7f1984159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1984158dd0 0x7f198414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 --2- 172.21.15.50:0/2946522745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406dd90 0x7f198414e7e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 >> 172.21.15.50:0/2946522745 conn(0x7f1984067b20 msgr2=0x7f198414cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 shutdown_connections 2023-12-24T18:49:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.789+0000 7f198a385700 1 -- 172.21.15.50:0/2946522745 wait complete. 2023-12-24T18:49:09.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:49:09.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 Processor -- start 2023-12-24T18:49:09.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 -- start start 2023-12-24T18:49:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 0x7f35480b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3548156dc0 0x7f35480cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354806cf10 con 0x7f354806d3a0 2023-12-24T18:49:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354815b890 con 0x7f3548156dc0 2023-12-24T18:49:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354e46b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35480cd680 con 0x7f35481569f0 2023-12-24T18:49:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354cc68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3548156dc0 0x7f35480cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.989+0000 7f354d469700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 0x7f35480b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354d469700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 0x7f35480b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56638/0 (socket says 172.21.15.50:56638) 2023-12-24T18:49:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354d469700 1 -- 172.21.15.50:0/603873106 learned_addr learned my addr 172.21.15.50:0/603873106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354cc68700 1 -- 172.21.15.50:0/603873106 >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 msgr2=0x7f35480b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354cc68700 1 --2- 172.21.15.50:0/603873106 >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 0x7f35480b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354cc68700 1 -- 172.21.15.50:0/603873106 >> v1:172.21.15.50:6789/0 conn(0x7f354806d3a0 legacy=0x7f354806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354cc68700 1 -- 172.21.15.50:0/603873106 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35480cd3a0 con 0x7f3548156dc0 2023-12-24T18:49:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f353ffff700 1 -- 172.21.15.50:0/603873106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183724266 0 0) 0x7f354806cf10 con 0x7f354806d3a0 2023-12-24T18:49:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354cc68700 1 --2- 172.21.15.50:0/603873106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3548156dc0 0x7f35480cccc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f354806bf00 tx=0x7f35380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4f909e9a019c1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f353ffff700 1 -- 172.21.15.50:0/603873106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011630 con 0x7f3548156dc0 2023-12-24T18:49:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f353ffff700 1 -- 172.21.15.50:0/603873106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538011790 con 0x7f3548156dc0 2023-12-24T18:49:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f353ffff700 1 -- 172.21.15.50:0/603873106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011b30 con 0x7f3548156dc0 2023-12-24T18:49:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 -- 172.21.15.50:0/603873106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3548156dc0 msgr2=0x7f35480cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 --2- 172.21.15.50:0/603873106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3548156dc0 0x7f35480cccc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f354806bf00 tx=0x7f35380091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 -- 172.21.15.50:0/603873106 shutdown_connections 2023-12-24T18:49:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 --2- 172.21.15.50:0/603873106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3548156dc0 0x7f35480cccc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 --2- 172.21.15.50:0/603873106 >> v2:172.21.15.82:3300/0 conn(0x7f35481569f0 0x7f35480b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 -- 172.21.15.50:0/603873106 >> 172.21.15.50:0/603873106 conn(0x7f35480cdc50 msgr2=0x7f35480ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 -- 172.21.15.50:0/603873106 shutdown_connections 2023-12-24T18:49:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.993+0000 7f354e46b700 1 -- 172.21.15.50:0/603873106 wait complete. 2023-12-24T18:49:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.997+0000 7f354e46b700 1 Processor -- start 2023-12-24T18:49:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:09.997+0000 7f354e46b700 1 -- start start 2023-12-24T18:49:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 0x7f35480c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3548156dc0 0x7f3548147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480c2f30 con 0x7f354806d3a0 2023-12-24T18:49:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480c31b0 con 0x7f35481569f0 2023-12-24T18:49:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354e46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35480c3490 con 0x7f3548156dc0 2023-12-24T18:49:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354d469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 0x7f35480c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354d469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50854/0 (socket says 172.21.15.50:50854) 2023-12-24T18:49:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354d469700 1 -- 172.21.15.50:0/1052193162 learned_addr learned my addr 172.21.15.50:0/1052193162 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354dc6a700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3548156dc0 0x7f3548147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 -- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3548156dc0 msgr2=0x7f3548147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3548156dc0 0x7f3548147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 -- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 msgr2=0x7f354815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 -- 172.21.15.50:0/1052193162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009420 con 0x7f35481569f0 2023-12-24T18:49:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354d469700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.001+0000 7f354cc68700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 0x7f35480c29f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3538016000 tx=0x7f3538017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011900 con 0x7f35481569f0 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538011a60 con 0x7f35481569f0 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538025640 con 0x7f35481569f0 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35480c3770 con 0x7f35481569f0 2023-12-24T18:49:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35480c3d30 con 0x7f35481569f0 2023-12-24T18:49:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.005+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354804be40 con 0x7f35481569f0 2023-12-24T18:49:10.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.009+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f35380193b0 con 0x7f35481569f0 2023-12-24T18:49:10.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.009+0000 7f353d7fa700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 0x7f352c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.009+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f353807e240 con 0x7f35481569f0 2023-12-24T18:49:10.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.009+0000 7f354d469700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 0x7f352c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.009+0000 7f354d469700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 0x7f352c062ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3544011540 tx=0x7f3544009250 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.017+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f353804e610 con 0x7f35481569f0 2023-12-24T18:49:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.229+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f354806c8c0 con 0x7f35481569f0 2023-12-24T18:49:10.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.233+0000 7f353d7fa700 1 -- 172.21.15.50:0/1052193162 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f3538051c30 con 0x7f35481569f0 2023-12-24T18:49:10.235 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:10.235 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 msgr2=0x7f352c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 0x7f352c062ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3544011540 tx=0x7f3544009250 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 msgr2=0x7f35480c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 0x7f35480c29f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3538016000 tx=0x7f3538017000 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 shutdown_connections 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f352c060620 0x7f352c062ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3548156dc0 0x7f3548147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35481569f0 0x7f35480c29f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 --2- 172.21.15.50:0/1052193162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354806d3a0 0x7f354815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 >> 172.21.15.50:0/1052193162 conn(0x7f35480cdc50 msgr2=0x7f35480ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:10.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 shutdown_connections 2023-12-24T18:49:10.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.237+0000 7f354e46b700 1 -- 172.21.15.50:0/1052193162 wait complete. 2023-12-24T18:49:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:49:10.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:49:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.425+0000 7f4edac78700 1 Processor -- start 2023-12-24T18:49:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 -- start start 2023-12-24T18:49:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ed40ca3a0 0x7f4ed40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed406ca50 con 0x7f4ed406b260 2023-12-24T18:49:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed40c6980 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4edac78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed406b7f0 con 0x7f4ed406ae10 2023-12-24T18:49:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed8a14700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ed40ca3a0 0x7f4ed40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed8a14700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ed40ca3a0 0x7f4ed40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50870/0 (socket says 172.21.15.50:50870) 2023-12-24T18:49:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed8a14700 1 -- 172.21.15.50:0/185416276 learned_addr learned my addr 172.21.15.50:0/185416276 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed9215700 1 --1- 172.21.15.50:0/185416276 >> v1:172.21.15.50:6789/0 conn(0x7f4ed406b260 0x7f4ed4160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54732/0 (socket says 172.21.15.50:54732) 2023-12-24T18:49:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed3fff700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed8a14700 1 -- 172.21.15.50:0/185416276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 msgr2=0x7f4ed415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.429+0000 7f4ed8a14700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed8a14700 1 -- 172.21.15.50:0/185416276 >> v1:172.21.15.50:6789/0 conn(0x7f4ed406b260 legacy=0x7f4ed4160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed8a14700 1 -- 172.21.15.50:0/185416276 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed406bad0 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed8a14700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed40ca770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de0e32f7744c398 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed37fe700 1 -- 172.21.15.50:0/185416276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800b860 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed37fe700 1 -- 172.21.15.50:0/185416276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800b9c0 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4ed37fe700 1 -- 172.21.15.50:0/185416276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800bd80 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 -- 172.21.15.50:0/185416276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed40ca3a0 msgr2=0x7f4ed40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed40ca770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8009250 comp rx=0 tx=0).stop 2023-12-24T18:49:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 -- 172.21.15.50:0/185416276 shutdown_connections 2023-12-24T18:49:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 --2- 172.21.15.50:0/185416276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed40ca770 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 -- 172.21.15.50:0/185416276 >> 172.21.15.50:0/185416276 conn(0x7f4ed40cbba0 msgr2=0x7f4ed40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 -- 172.21.15.50:0/185416276 shutdown_connections 2023-12-24T18:49:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 -- 172.21.15.50:0/185416276 wait complete. 2023-12-24T18:49:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.433+0000 7f4edac78700 1 Processor -- start 2023-12-24T18:49:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- start start 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed4160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41519a0 con 0x7f4ed406b260 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed415f550 con 0x7f4ed40ca3a0 2023-12-24T18:49:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40c5560 con 0x7f4ed406ae10 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50882/0 (socket says 172.21.15.50:50882) 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 -- 172.21.15.50:0/979193626 learned_addr learned my addr 172.21.15.50:0/979193626 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed8a14700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed9215700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed4160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 -- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 msgr2=0x7f4ed415f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 -- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 msgr2=0x7f4ed4160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed4160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 -- 172.21.15.50:0/979193626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80094f0 con 0x7f4ed406b260 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed9215700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed4160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed3fff700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000d8c0 tx=0x7f4ec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000de60 con 0x7f4ed406b260 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec000b780 con 0x7f4ed406b260 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41613d0 con 0x7f4ed406b260 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000bb20 con 0x7f4ed406b260 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.437+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed40c4f10 con 0x7f4ed406b260 2023-12-24T18:49:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.441+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed415b2d0 con 0x7f4ed406b260 2023-12-24T18:49:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.441+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4ec001e460 con 0x7f4ed406b260 2023-12-24T18:49:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.445+0000 7f4ed0ff9700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 0x7f4eb8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.445+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f4ec007d120 con 0x7f4ed406b260 2023-12-24T18:49:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.445+0000 7f4ed8a14700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 0x7f4eb8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.445+0000 7f4ed8a14700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 0x7f4eb8062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.449+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ed415b2d0 con 0x7f4ed406b260 2023-12-24T18:49:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.629+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ed415b2d0 con 0x7f4ed406b260 2023-12-24T18:49:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4ed0ff9700 1 -- 172.21.15.50:0/979193626 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16035 (secure 0 0 0) 0x7f4ed415b2d0 con 0x7f4ed406b260 2023-12-24T18:49:10.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:10.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:49:07.748981+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:49:10.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 msgr2=0x7f4eb8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 0x7f4eb8062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8017000 comp rx=0 tx=0).stop 2023-12-24T18:49:10.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 msgr2=0x7f4ed4160950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000d8c0 tx=0x7f4ec0008040 comp rx=0 tx=0).stop 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 shutdown_connections 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f4eb8060580 0x7f4eb8062a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ed40ca3a0 0x7f4ed4160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ed406b260 0x7f4ed4160950 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 --2- 172.21.15.50:0/979193626 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ed406ae10 0x7f4ed415f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 >> 172.21.15.50:0/979193626 conn(0x7f4ed40cbba0 msgr2=0x7f4ed40c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 shutdown_connections 2023-12-24T18:49:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.633+0000 7f4edac78700 1 -- 172.21.15.50:0/979193626 wait complete. 2023-12-24T18:49:10.659 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:49:10.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:49:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.821+0000 7f5917a78700 1 Processor -- start 2023-12-24T18:49:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.821+0000 7f5917a78700 1 -- start start 2023-12-24T18:49:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.821+0000 7f5917a78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 0x7f591015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.821+0000 7f5917a78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59100b1ba0 0x7f59100b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.821+0000 7f5917a78700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591006d5c0 con 0x7f59100b3c90 2023-12-24T18:49:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5917a78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100b49c0 con 0x7f59100b1ba0 2023-12-24T18:49:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5917a78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591006d040 con 0x7f5910158e10 2023-12-24T18:49:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59100b1ba0 0x7f59100b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5915013700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59100b3c90 0x7f591006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54740/0 (socket says 172.21.15.50:54740) 2023-12-24T18:49:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5915013700 1 -- 172.21.15.50:0/1309876536 learned_addr learned my addr 172.21.15.50:0/1309876536 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5915814700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 0x7f591015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5914812700 1 -- 172.21.15.50:0/1309876536 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993702954 0 0) 0x7f591006d5c0 con 0x7f59100b3c90 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5914812700 1 -- 172.21.15.50:0/1309876536 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58fc003570 con 0x7f59100b3c90 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 -- 172.21.15.50:0/1309876536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 msgr2=0x7f591015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 0x7f591015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 -- 172.21.15.50:0/1309876536 >> v1:172.21.15.50:6789/0 conn(0x7f59100b3c90 legacy=0x7f591006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 -- 172.21.15.50:0/1309876536 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591015a1f0 con 0x7f59100b1ba0 2023-12-24T18:49:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5915814700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 0x7f591015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5916015700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59100b1ba0 0x7f59100b2020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5908009e60 tx=0x7f5908009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5dd403a0a055e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5914812700 1 -- 172.21.15.50:0/1309876536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800e070 con 0x7f59100b1ba0 2023-12-24T18:49:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5914812700 1 -- 172.21.15.50:0/1309876536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590800bab0 con 0x7f59100b1ba0 2023-12-24T18:49:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5914812700 1 -- 172.21.15.50:0/1309876536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800be70 con 0x7f59100b1ba0 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5917a78700 1 -- 172.21.15.50:0/1309876536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59100b1ba0 msgr2=0x7f59100b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.825+0000 7f5917a78700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59100b1ba0 0x7f59100b2020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5908009e60 tx=0x7f5908009780 comp rx=0 tx=0).stop 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- 172.21.15.50:0/1309876536 shutdown_connections 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59100b1ba0 0x7f59100b2020 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 --2- 172.21.15.50:0/1309876536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5910158e10 0x7f591015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- 172.21.15.50:0/1309876536 >> 172.21.15.50:0/1309876536 conn(0x7f59100670b0 msgr2=0x7f59100674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- 172.21.15.50:0/1309876536 shutdown_connections 2023-12-24T18:49:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- 172.21.15.50:0/1309876536 wait complete. 2023-12-24T18:49:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 Processor -- start 2023-12-24T18:49:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- start start 2023-12-24T18:49:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59100b1ba0 0x7f591014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 0x7f591015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5910151910 con 0x7f5910158e10 2023-12-24T18:49:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5910150d40 con 0x7f59100b3c90 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5917a78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591014e800 con 0x7f59100b1ba0 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5916015700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5916015700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50888/0 (socket says 172.21.15.50:50888) 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5916015700 1 -- 172.21.15.50:0/3191938334 learned_addr learned my addr 172.21.15.50:0/3191938334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.829+0000 7f5915814700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59100b1ba0 0x7f591014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5915013700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 0x7f591015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 -- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59100b1ba0 msgr2=0x7f591014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59100b1ba0 0x7f591014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 -- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 msgr2=0x7f591015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 0x7f591015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 -- 172.21.15.50:0/3191938334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009420 con 0x7f5910158e10 2023-12-24T18:49:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5915013700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 0x7f591015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5916015700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f59100684e0 tx=0x7f5908019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908027470 con 0x7f5910158e10 2023-12-24T18:49:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59080275d0 con 0x7f5910158e10 2023-12-24T18:49:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5908009a20 con 0x7f5910158e10 2023-12-24T18:49:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908027990 con 0x7f5910158e10 2023-12-24T18:49:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59101512c0 con 0x7f5910158e10 2023-12-24T18:49:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.833+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5910151a80 con 0x7f5910158e10 2023-12-24T18:49:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.837+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5908024070 con 0x7f5910158e10 2023-12-24T18:49:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.837+0000 7f5905ffb700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 0x7f58f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.837+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f590807f610 con 0x7f5910158e10 2023-12-24T18:49:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.837+0000 7f5915814700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 0x7f58f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.841+0000 7f5915814700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 0x7f58f4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f590c0093f0 tx=0x7f590c008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:10.845+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f590804f8c0 con 0x7f5910158e10 2023-12-24T18:49:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.013+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59100652e0 con 0x7f58f4060550 2023-12-24T18:49:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.029+0000 7f5905ffb700 1 -- 172.21.15.50:0/3191938334 <== mgr.5695 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285822 (secure 0 0 0) 0x7f59100652e0 con 0x7f58f4060550 2023-12-24T18:49:11.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 msgr2=0x7f58f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 0x7f58f4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f590c0093f0 tx=0x7f590c008040 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 msgr2=0x7f5910169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f59100684e0 tx=0x7f5908019000 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 shutdown_connections 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f58f4060550 0x7f58f4062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5910158e10 0x7f5910169070 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59100b3c90 0x7f591015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 --2- 172.21.15.50:0/3191938334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59100b1ba0 0x7f591014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 >> 172.21.15.50:0/3191938334 conn(0x7f59100670b0 msgr2=0x7f59100b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 shutdown_connections 2023-12-24T18:49:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.041+0000 7f5917a78700 1 -- 172.21.15.50:0/3191938334 wait complete. 2023-12-24T18:49:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:49:11.065 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:49:09.775020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443144,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752531576,"statfs":{"total":773094113280,"available":770592333824,"internally_reserved":0,"allocated":7675904,"data_stored":4356916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056853"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784940+0000","last_change":"2023-12-24T18:49:06.771289+0000","last_active":"2023-12-24T18:49:06.784940+0000","last_peered":"2023-12-24T18:49:06.784940+0000","last_clean":"2023-12-24T18:49:06.784940+0000","last_became_active":"2023-12-24T18:49:06.770961+0000","last_became_peered":"2023-12-24T18:49:06.770961+0000","last_unstale":"2023-12-24T18:49:06.784940+0000","last_undegraded":"2023-12-24T18:49:06.784940+0000","last_fullsized":"2023-12-24T18:49:06.784940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767861+0000","last_change":"2023-12-24T18:49:06.763261+0000","last_active":"2023-12-24T18:49:06.767861+0000","last_peered":"2023-12-24T18:49:06.767861+0000","last_clean":"2023-12-24T18:49:06.767861+0000","last_became_active":"2023-12-24T18:49:06.762979+0000","last_became_peered":"2023-12-24T18:49:06.762979+0000","last_unstale":"2023-12-24T18:49:06.767861+0000","last_undegraded":"2023-12-24T18:49:06.767861+0000","last_fullsized":"2023-12-24T18:49:06.767861+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:04.303823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795808+0000","last_change":"2023-12-24T18:49:06.790758+0000","last_active":"2023-12-24T18:49:06.795808+0000","last_peered":"2023-12-24T18:49:06.795808+0000","last_clean":"2023-12-24T18:49:06.795808+0000","last_became_active":"2023-12-24T18:49:06.790440+0000","last_became_peered":"2023-12-24T18:49:06.790440+0000","last_unstale":"2023-12-24T18:49:06.795808+0000","last_undegraded":"2023-12-24T18:49:06.795808+0000","last_fullsized":"2023-12-24T18:49:06.795808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:15.765483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.772909+0000","last_change":"2023-12-24T18:49:06.769721+0000","last_active":"2023-12-24T18:49:06.772909+0000","last_peered":"2023-12-24T18:49:06.772909+0000","last_clean":"2023-12-24T18:49:06.772909+0000","last_became_active":"2023-12-24T18:49:06.767864+0000","last_became_peered":"2023-12-24T18:49:06.767864+0000","last_unstale":"2023-12-24T18:49:06.772909+0000","last_undegraded":"2023-12-24T18:49:06.772909+0000","last_fullsized":"2023-12-24T18:49:06.772909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:24.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.756041+0000","last_change":"2023-12-24T18:49:06.751020+0000","last_active":"2023-12-24T18:49:06.756041+0000","last_peered":"2023-12-24T18:49:06.756041+0000","last_clean":"2023-12-24T18:49:06.756041+0000","last_became_active":"2023-12-24T18:49:06.750724+0000","last_became_peered":"2023-12-24T18:49:06.750724+0000","last_unstale":"2023-12-24T18:49:06.756041+0000","last_undegraded":"2023-12-24T18:49:06.756041+0000","last_fullsized":"2023-12-24T18:49:06.756041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794415+0000","last_change":"2023-12-24T18:49:06.767010+0000","last_active":"2023-12-24T18:49:06.794415+0000","last_peered":"2023-12-24T18:49:06.794415+0000","last_clean":"2023-12-24T18:49:06.794415+0000","last_became_active":"2023-12-24T18:49:06.757881+0000","last_became_peered":"2023-12-24T18:49:06.757881+0000","last_unstale":"2023-12-24T18:49:06.794415+0000","last_undegraded":"2023-12-24T18:49:06.794415+0000","last_fullsized":"2023-12-24T18:49:06.794415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:08.094223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796596+0000","last_change":"2023-12-24T18:49:06.778093+0000","last_active":"2023-12-24T18:49:06.796596+0000","last_peered":"2023-12-24T18:49:06.796596+0000","last_clean":"2023-12-24T18:49:06.796596+0000","last_became_active":"2023-12-24T18:49:06.777781+0000","last_became_peered":"2023-12-24T18:49:06.777781+0000","last_unstale":"2023-12-24T18:49:06.796596+0000","last_undegraded":"2023-12-24T18:49:06.796596+0000","last_fullsized":"2023-12-24T18:49:06.796596+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:34.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.769318+0000","last_change":"2023-12-24T18:49:06.762815+0000","last_active":"2023-12-24T18:49:06.769318+0000","last_peered":"2023-12-24T18:49:06.769318+0000","last_clean":"2023-12-24T18:49:06.769318+0000","last_became_active":"2023-12-24T18:49:06.762271+0000","last_became_peered":"2023-12-24T18:49:06.762271+0000","last_unstale":"2023-12-24T18:49:06.769318+0000","last_undegraded":"2023-12-24T18:49:06.769318+0000","last_fullsized":"2023-12-24T18:49:06.769318+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:31.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.789796+0000","last_change":"2023-12-24T18:49:06.788599+0000","last_active":"2023-12-24T18:49:06.789796+0000","last_peered":"2023-12-24T18:49:06.789796+0000","last_clean":"2023-12-24T18:49:06.789796+0000","last_became_active":"2023-12-24T18:49:06.788214+0000","last_became_peered":"2023-12-24T18:49:06.788214+0000","last_unstale":"2023-12-24T18:49:06.789796+0000","last_undegraded":"2023-12-24T18:49:06.789796+0000","last_fullsized":"2023-12-24T18:49:06.789796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:26.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784747+0000","last_change":"2023-12-24T18:49:06.770336+0000","last_active":"2023-12-24T18:49:06.784747+0000","last_peered":"2023-12-24T18:49:06.784747+0000","last_clean":"2023-12-24T18:49:06.784747+0000","last_became_active":"2023-12-24T18:49:06.769999+0000","last_became_peered":"2023-12-24T18:49:06.769999+0000","last_unstale":"2023-12-24T18:49:06.784747+0000","last_undegraded":"2023-12-24T18:49:06.784747+0000","last_fullsized":"2023-12-24T18:49:06.784747+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:27.404668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763932+0000","last_change":"2023-12-24T18:49:06.755503+0000","last_active":"2023-12-24T18:49:06.763932+0000","last_peered":"2023-12-24T18:49:06.763932+0000","last_clean":"2023-12-24T18:49:06.763932+0000","last_became_active":"2023-12-24T18:49:06.755189+0000","last_became_peered":"2023-12-24T18:49:06.755189+0000","last_unstale":"2023-12-24T18:49:06.763932+0000","last_undegraded":"2023-12-24T18:49:06.763932+0000","last_fullsized":"2023-12-24T18:49:06.763932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:57:57.350586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.769362+0000","last_change":"2023-12-24T18:49:06.762953+0000","last_active":"2023-12-24T18:49:06.769362+0000","last_peered":"2023-12-24T18:49:06.769362+0000","last_clean":"2023-12-24T18:49:06.769362+0000","last_became_active":"2023-12-24T18:49:06.760776+0000","last_became_peered":"2023-12-24T18:49:06.760776+0000","last_unstale":"2023-12-24T18:49:06.769362+0000","last_undegraded":"2023-12-24T18:49:06.769362+0000","last_fullsized":"2023-12-24T18:49:06.769362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:11.215614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792541+0000","last_change":"2023-12-24T18:49:06.784392+0000","last_active":"2023-12-24T18:49:06.792541+0000","last_peered":"2023-12-24T18:49:06.792541+0000","last_clean":"2023-12-24T18:49:06.792541+0000","last_became_active":"2023-12-24T18:49:06.769616+0000","last_became_peered":"2023-12-24T18:49:06.769616+0000","last_unstale":"2023-12-24T18:49:06.792541+0000","last_undegraded":"2023-12-24T18:49:06.792541+0000","last_fullsized":"2023-12-24T18:49:06.792541+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797952+0000","last_change":"2023-12-24T18:49:06.796339+0000","last_active":"2023-12-24T18:49:06.797952+0000","last_peered":"2023-12-24T18:49:06.797952+0000","last_clean":"2023-12-24T18:49:06.797952+0000","last_became_active":"2023-12-24T18:49:06.796016+0000","last_became_peered":"2023-12-24T18:49:06.796016+0000","last_unstale":"2023-12-24T18:49:06.797952+0000","last_undegraded":"2023-12-24T18:49:06.797952+0000","last_fullsized":"2023-12-24T18:49:06.797952+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:27.114083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.772872+0000","last_change":"2023-12-24T18:49:06.768789+0000","last_active":"2023-12-24T18:49:06.772872+0000","last_peered":"2023-12-24T18:49:06.772872+0000","last_clean":"2023-12-24T18:49:06.772872+0000","last_became_active":"2023-12-24T18:49:06.768521+0000","last_became_peered":"2023-12-24T18:49:06.768521+0000","last_unstale":"2023-12-24T18:49:06.772872+0000","last_undegraded":"2023-12-24T18:49:06.772872+0000","last_fullsized":"2023-12-24T18:49:06.772872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:32.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784822+0000","last_change":"2023-12-24T18:49:06.769826+0000","last_active":"2023-12-24T18:49:06.784822+0000","last_peered":"2023-12-24T18:49:06.784822+0000","last_clean":"2023-12-24T18:49:06.784822+0000","last_became_active":"2023-12-24T18:49:06.769429+0000","last_became_peered":"2023-12-24T18:49:06.769429+0000","last_unstale":"2023-12-24T18:49:06.784822+0000","last_undegraded":"2023-12-24T18:49:06.784822+0000","last_fullsized":"2023-12-24T18:49:06.784822+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798488+0000","last_change":"2023-12-24T18:49:06.790634+0000","last_active":"2023-12-24T18:49:06.798488+0000","last_peered":"2023-12-24T18:49:06.798488+0000","last_clean":"2023-12-24T18:49:06.798488+0000","last_became_active":"2023-12-24T18:49:06.787077+0000","last_became_peered":"2023-12-24T18:49:06.787077+0000","last_unstale":"2023-12-24T18:49:06.798488+0000","last_undegraded":"2023-12-24T18:49:06.798488+0000","last_fullsized":"2023-12-24T18:49:06.798488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:19.822303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767842+0000","last_change":"2023-12-24T18:49:06.762672+0000","last_active":"2023-12-24T18:49:06.767842+0000","last_peered":"2023-12-24T18:49:06.767842+0000","last_clean":"2023-12-24T18:49:06.767842+0000","last_became_active":"2023-12-24T18:49:06.762389+0000","last_became_peered":"2023-12-24T18:49:06.762389+0000","last_unstale":"2023-12-24T18:49:06.767842+0000","last_undegraded":"2023-12-24T18:49:06.767842+0000","last_fullsized":"2023-12-24T18:49:06.767842+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:07.060691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.793208+0000","last_change":"2023-12-24T18:49:06.778137+0000","last_active":"2023-12-24T18:49:06.793208+0000","last_peered":"2023-12-24T18:49:06.793208+0000","last_clean":"2023-12-24T18:49:06.793208+0000","last_became_active":"2023-12-24T18:49:06.777842+0000","last_became_peered":"2023-12-24T18:49:06.777842+0000","last_unstale":"2023-12-24T18:49:06.793208+0000","last_undegraded":"2023-12-24T18:49:06.793208+0000","last_fullsized":"2023-12-24T18:49:06.793208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:47.949611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.766137+0000","last_change":"2023-12-24T18:49:06.758528+0000","last_active":"2023-12-24T18:49:06.766137+0000","last_peered":"2023-12-24T18:49:06.766137+0000","last_clean":"2023-12-24T18:49:06.766137+0000","last_became_active":"2023-12-24T18:49:06.758185+0000","last_became_peered":"2023-12-24T18:49:06.758185+0000","last_unstale":"2023-12-24T18:49:06.766137+0000","last_undegraded":"2023-12-24T18:49:06.766137+0000","last_fullsized":"2023-12-24T18:49:06.766137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:18.158526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764126+0000","last_change":"2023-12-24T18:49:06.757710+0000","last_active":"2023-12-24T18:49:06.764126+0000","last_peered":"2023-12-24T18:49:06.764126+0000","last_clean":"2023-12-24T18:49:06.764126+0000","last_became_active":"2023-12-24T18:49:06.757439+0000","last_became_peered":"2023-12-24T18:49:06.757439+0000","last_unstale":"2023-12-24T18:49:06.764126+0000","last_undegraded":"2023-12-24T18:49:06.764126+0000","last_fullsized":"2023-12-24T18:49:06.764126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:40.276400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797492+0000","last_change":"2023-12-24T18:49:06.796228+0000","last_active":"2023-12-24T18:49:06.797492+0000","last_peered":"2023-12-24T18:49:06.797492+0000","last_clean":"2023-12-24T18:49:06.797492+0000","last_became_active":"2023-12-24T18:49:06.795882+0000","last_became_peered":"2023-12-24T18:49:06.795882+0000","last_unstale":"2023-12-24T18:49:06.797492+0000","last_undegraded":"2023-12-24T18:49:06.797492+0000","last_fullsized":"2023-12-24T18:49:06.797492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:27.114083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764377+0000","last_change":"2023-12-24T18:49:06.756881+0000","last_active":"2023-12-24T18:49:06.764377+0000","last_peered":"2023-12-24T18:49:06.764377+0000","last_clean":"2023-12-24T18:49:06.764377+0000","last_became_active":"2023-12-24T18:49:06.754312+0000","last_became_peered":"2023-12-24T18:49:06.754312+0000","last_unstale":"2023-12-24T18:49:06.764377+0000","last_undegraded":"2023-12-24T18:49:06.764377+0000","last_fullsized":"2023-12-24T18:49:06.764377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:26.403331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786909+0000","last_change":"2023-12-24T18:49:06.772258+0000","last_active":"2023-12-24T18:49:06.786909+0000","last_peered":"2023-12-24T18:49:06.786909+0000","last_clean":"2023-12-24T18:49:06.786909+0000","last_became_active":"2023-12-24T18:49:06.766509+0000","last_became_peered":"2023-12-24T18:49:06.766509+0000","last_unstale":"2023-12-24T18:49:06.786909+0000","last_undegraded":"2023-12-24T18:49:06.786909+0000","last_fullsized":"2023-12-24T18:49:06.786909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:01.052073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798394+0000","last_change":"2023-12-24T18:49:06.779515+0000","last_active":"2023-12-24T18:49:06.798394+0000","last_peered":"2023-12-24T18:49:06.798394+0000","last_clean":"2023-12-24T18:49:06.798394+0000","last_became_active":"2023-12-24T18:49:06.779206+0000","last_became_peered":"2023-12-24T18:49:06.779206+0000","last_unstale":"2023-12-24T18:49:06.798394+0000","last_undegraded":"2023-12-24T18:49:06.798394+0000","last_fullsized":"2023-12-24T18:49:06.798394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:31.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770340+0000","last_change":"2023-12-24T18:49:06.763641+0000","last_active":"2023-12-24T18:49:06.770340+0000","last_peered":"2023-12-24T18:49:06.770340+0000","last_clean":"2023-12-24T18:49:06.770340+0000","last_became_active":"2023-12-24T18:49:06.763336+0000","last_became_peered":"2023-12-24T18:49:06.763336+0000","last_unstale":"2023-12-24T18:49:06.770340+0000","last_undegraded":"2023-12-24T18:49:06.770340+0000","last_fullsized":"2023-12-24T18:49:06.770340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:01.052073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792972+0000","last_change":"2023-12-24T18:49:06.791189+0000","last_active":"2023-12-24T18:49:06.792972+0000","last_peered":"2023-12-24T18:49:06.792972+0000","last_clean":"2023-12-24T18:49:06.792972+0000","last_became_active":"2023-12-24T18:49:06.790887+0000","last_became_peered":"2023-12-24T18:49:06.790887+0000","last_unstale":"2023-12-24T18:49:06.792972+0000","last_undegraded":"2023-12-24T18:49:06.792972+0000","last_fullsized":"2023-12-24T18:49:06.792972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:24.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.753428+0000","last_change":"2023-12-24T18:49:06.748158+0000","last_active":"2023-12-24T18:49:06.753428+0000","last_peered":"2023-12-24T18:49:06.753428+0000","last_clean":"2023-12-24T18:49:06.753428+0000","last_became_active":"2023-12-24T18:49:06.747406+0000","last_became_peered":"2023-12-24T18:49:06.747406+0000","last_unstale":"2023-12-24T18:49:06.753428+0000","last_undegraded":"2023-12-24T18:49:06.753428+0000","last_fullsized":"2023-12-24T18:49:06.753428+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:32.155668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797547+0000","last_change":"2023-12-24T18:49:06.793181+0000","last_active":"2023-12-24T18:49:06.797547+0000","last_peered":"2023-12-24T18:49:06.797547+0000","last_clean":"2023-12-24T18:49:06.797547+0000","last_became_active":"2023-12-24T18:49:06.792843+0000","last_became_peered":"2023-12-24T18:49:06.792843+0000","last_unstale":"2023-12-24T18:49:06.797547+0000","last_undegraded":"2023-12-24T18:49:06.797547+0000","last_fullsized":"2023-12-24T18:49:06.797547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:46.223611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786132+0000","last_change":"2023-12-24T18:49:06.785552+0000","last_active":"2023-12-24T18:49:06.786132+0000","last_peered":"2023-12-24T18:49:06.786132+0000","last_clean":"2023-12-24T18:49:06.786132+0000","last_became_active":"2023-12-24T18:49:06.784832+0000","last_became_peered":"2023-12-24T18:49:06.784832+0000","last_unstale":"2023-12-24T18:49:06.786132+0000","last_undegraded":"2023-12-24T18:49:06.786132+0000","last_fullsized":"2023-12-24T18:49:06.786132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786034+0000","last_change":"2023-12-24T18:49:06.772951+0000","last_active":"2023-12-24T18:49:06.786034+0000","last_peered":"2023-12-24T18:49:06.786034+0000","last_clean":"2023-12-24T18:49:06.786034+0000","last_became_active":"2023-12-24T18:49:06.766418+0000","last_became_peered":"2023-12-24T18:49:06.766418+0000","last_unstale":"2023-12-24T18:49:06.786034+0000","last_undegraded":"2023-12-24T18:49:06.786034+0000","last_fullsized":"2023-12-24T18:49:06.786034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:05:44.576462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.773217+0000","last_change":"2023-12-24T18:49:06.771852+0000","last_active":"2023-12-24T18:49:06.773217+0000","last_peered":"2023-12-24T18:49:06.773217+0000","last_clean":"2023-12-24T18:49:06.773217+0000","last_became_active":"2023-12-24T18:49:06.771526+0000","last_became_peered":"2023-12-24T18:49:06.771526+0000","last_unstale":"2023-12-24T18:49:06.773217+0000","last_undegraded":"2023-12-24T18:49:06.773217+0000","last_fullsized":"2023-12-24T18:49:06.773217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:51:59.225871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.768075+0000","last_change":"2023-12-24T18:49:06.762111+0000","last_active":"2023-12-24T18:49:06.768075+0000","last_peered":"2023-12-24T18:49:06.768075+0000","last_clean":"2023-12-24T18:49:06.768075+0000","last_became_active":"2023-12-24T18:49:06.761791+0000","last_became_peered":"2023-12-24T18:49:06.761791+0000","last_unstale":"2023-12-24T18:49:06.768075+0000","last_undegraded":"2023-12-24T18:49:06.768075+0000","last_fullsized":"2023-12-24T18:49:06.768075+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:27.404668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.779951+0000","last_change":"2023-12-24T18:49:05.752925+0000","last_active":"2023-12-24T18:49:06.779951+0000","last_peered":"2023-12-24T18:49:06.779951+0000","last_clean":"2023-12-24T18:49:06.779951+0000","last_became_active":"2023-12-24T18:49:05.752548+0000","last_became_peered":"2023-12-24T18:49:05.752548+0000","last_unstale":"2023-12-24T18:49:06.779951+0000","last_undegraded":"2023-12-24T18:49:06.779951+0000","last_fullsized":"2023-12-24T18:49:06.779951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:28.596586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.775114+0000","last_change":"2023-12-24T18:49:06.773662+0000","last_active":"2023-12-24T18:49:06.775114+0000","last_peered":"2023-12-24T18:49:06.775114+0000","last_clean":"2023-12-24T18:49:06.775114+0000","last_became_active":"2023-12-24T18:49:06.773350+0000","last_became_peered":"2023-12-24T18:49:06.773350+0000","last_unstale":"2023-12-24T18:49:06.775114+0000","last_undegraded":"2023-12-24T18:49:06.775114+0000","last_fullsized":"2023-12-24T18:49:06.775114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:08.382024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795046+0000","last_change":"2023-12-24T18:49:05.767831+0000","last_active":"2023-12-24T18:49:06.795046+0000","last_peered":"2023-12-24T18:49:06.795046+0000","last_clean":"2023-12-24T18:49:06.795046+0000","last_became_active":"2023-12-24T18:49:05.767459+0000","last_became_peered":"2023-12-24T18:49:05.767459+0000","last_unstale":"2023-12-24T18:49:06.795046+0000","last_undegraded":"2023-12-24T18:49:06.795046+0000","last_fullsized":"2023-12-24T18:49:06.795046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:08.879276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763392+0000","last_change":"2023-12-24T18:49:06.757099+0000","last_active":"2023-12-24T18:49:06.763392+0000","last_peered":"2023-12-24T18:49:06.763392+0000","last_clean":"2023-12-24T18:49:06.763392+0000","last_became_active":"2023-12-24T18:49:06.756754+0000","last_became_peered":"2023-12-24T18:49:06.756754+0000","last_unstale":"2023-12-24T18:49:06.763392+0000","last_undegraded":"2023-12-24T18:49:06.763392+0000","last_fullsized":"2023-12-24T18:49:06.763392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:35.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792845+0000","last_change":"2023-12-24T18:49:05.764982+0000","last_active":"2023-12-24T18:49:06.792845+0000","last_peered":"2023-12-24T18:49:06.792845+0000","last_clean":"2023-12-24T18:49:06.792845+0000","last_became_active":"2023-12-24T18:49:05.764697+0000","last_became_peered":"2023-12-24T18:49:05.764697+0000","last_unstale":"2023-12-24T18:49:06.792845+0000","last_undegraded":"2023-12-24T18:49:06.792845+0000","last_fullsized":"2023-12-24T18:49:06.792845+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:33.863222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770315+0000","last_change":"2023-12-24T18:49:06.763733+0000","last_active":"2023-12-24T18:49:06.770315+0000","last_peered":"2023-12-24T18:49:06.770315+0000","last_clean":"2023-12-24T18:49:06.770315+0000","last_became_active":"2023-12-24T18:49:06.762591+0000","last_became_peered":"2023-12-24T18:49:06.762591+0000","last_unstale":"2023-12-24T18:49:06.770315+0000","last_undegraded":"2023-12-24T18:49:06.770315+0000","last_fullsized":"2023-12-24T18:49:06.770315+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:34.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.781685+0000","last_change":"2023-12-24T18:49:05.755816+0000","last_active":"2023-12-24T18:49:06.781685+0000","last_peered":"2023-12-24T18:49:06.781685+0000","last_clean":"2023-12-24T18:49:06.781685+0000","last_became_active":"2023-12-24T18:49:05.755521+0000","last_became_peered":"2023-12-24T18:49:05.755521+0000","last_unstale":"2023-12-24T18:49:06.781685+0000","last_undegraded":"2023-12-24T18:49:06.781685+0000","last_fullsized":"2023-12-24T18:49:06.781685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:26.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.793551+0000","last_change":"2023-12-24T18:49:06.792259+0000","last_active":"2023-12-24T18:49:06.793551+0000","last_peered":"2023-12-24T18:49:06.793551+0000","last_clean":"2023-12-24T18:49:06.793551+0000","last_became_active":"2023-12-24T18:49:06.791828+0000","last_became_peered":"2023-12-24T18:49:06.791828+0000","last_unstale":"2023-12-24T18:49:06.793551+0000","last_undegraded":"2023-12-24T18:49:06.793551+0000","last_fullsized":"2023-12-24T18:49:06.793551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:36.033114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797392+0000","last_change":"2023-12-24T18:49:05.759060+0000","last_active":"2023-12-24T18:49:06.797392+0000","last_peered":"2023-12-24T18:49:06.797392+0000","last_clean":"2023-12-24T18:49:06.797392+0000","last_became_active":"2023-12-24T18:49:05.758741+0000","last_became_peered":"2023-12-24T18:49:05.758741+0000","last_unstale":"2023-12-24T18:49:06.797392+0000","last_undegraded":"2023-12-24T18:49:06.797392+0000","last_fullsized":"2023-12-24T18:49:06.797392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:08.513083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.775735+0000","last_change":"2023-12-24T18:49:06.774930+0000","last_active":"2023-12-24T18:49:06.775735+0000","last_peered":"2023-12-24T18:49:06.775735+0000","last_clean":"2023-12-24T18:49:06.775735+0000","last_became_active":"2023-12-24T18:49:06.774602+0000","last_became_peered":"2023-12-24T18:49:06.774602+0000","last_unstale":"2023-12-24T18:49:06.775735+0000","last_undegraded":"2023-12-24T18:49:06.775735+0000","last_fullsized":"2023-12-24T18:49:06.775735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.774091+0000","last_change":"2023-12-24T18:49:05.752559+0000","last_active":"2023-12-24T18:49:06.774091+0000","last_peered":"2023-12-24T18:49:06.774091+0000","last_clean":"2023-12-24T18:49:06.774091+0000","last_became_active":"2023-12-24T18:49:05.752251+0000","last_became_peered":"2023-12-24T18:49:05.752251+0000","last_unstale":"2023-12-24T18:49:06.774091+0000","last_undegraded":"2023-12-24T18:49:06.774091+0000","last_fullsized":"2023-12-24T18:49:06.774091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:55:45.594579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770360+0000","last_change":"2023-12-24T18:49:06.763883+0000","last_active":"2023-12-24T18:49:06.770360+0000","last_peered":"2023-12-24T18:49:06.770360+0000","last_clean":"2023-12-24T18:49:06.770360+0000","last_became_active":"2023-12-24T18:49:06.763546+0000","last_became_peered":"2023-12-24T18:49:06.763546+0000","last_unstale":"2023-12-24T18:49:06.770360+0000","last_undegraded":"2023-12-24T18:49:06.770360+0000","last_fullsized":"2023-12-24T18:49:06.770360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:28.074923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742734+0000","last_change":"2023-12-24T18:49:05.750502+0000","last_active":"2023-12-24T18:49:06.742734+0000","last_peered":"2023-12-24T18:49:06.742734+0000","last_clean":"2023-12-24T18:49:06.742734+0000","last_became_active":"2023-12-24T18:49:05.750157+0000","last_became_peered":"2023-12-24T18:49:05.750157+0000","last_unstale":"2023-12-24T18:49:06.742734+0000","last_undegraded":"2023-12-24T18:49:06.742734+0000","last_fullsized":"2023-12-24T18:49:06.742734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:48:16.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798187+0000","last_change":"2023-12-24T18:49:06.797240+0000","last_active":"2023-12-24T18:49:06.798187+0000","last_peered":"2023-12-24T18:49:06.798187+0000","last_clean":"2023-12-24T18:49:06.798187+0000","last_became_active":"2023-12-24T18:49:06.796770+0000","last_became_peered":"2023-12-24T18:49:06.796770+0000","last_unstale":"2023-12-24T18:49:06.798187+0000","last_undegraded":"2023-12-24T18:49:06.798187+0000","last_fullsized":"2023-12-24T18:49:06.798187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.780513+0000","last_change":"2023-12-24T18:49:05.759172+0000","last_active":"2023-12-24T18:49:06.780513+0000","last_peered":"2023-12-24T18:49:06.780513+0000","last_clean":"2023-12-24T18:49:06.780513+0000","last_became_active":"2023-12-24T18:49:05.758881+0000","last_became_peered":"2023-12-24T18:49:05.758881+0000","last_unstale":"2023-12-24T18:49:06.780513+0000","last_undegraded":"2023-12-24T18:49:06.780513+0000","last_fullsized":"2023-12-24T18:49:06.780513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:06.046206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767102+0000","last_change":"2023-12-24T18:49:06.762736+0000","last_active":"2023-12-24T18:49:06.767102+0000","last_peered":"2023-12-24T18:49:06.767102+0000","last_clean":"2023-12-24T18:49:06.767102+0000","last_became_active":"2023-12-24T18:49:06.762348+0000","last_became_peered":"2023-12-24T18:49:06.762348+0000","last_unstale":"2023-12-24T18:49:06.767102+0000","last_undegraded":"2023-12-24T18:49:06.767102+0000","last_fullsized":"2023-12-24T18:49:06.767102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:42.581889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.753971+0000","last_change":"2023-12-24T18:49:05.755686+0000","last_active":"2023-12-24T18:49:06.753971+0000","last_peered":"2023-12-24T18:49:06.753971+0000","last_clean":"2023-12-24T18:49:06.753971+0000","last_became_active":"2023-12-24T18:49:05.755366+0000","last_became_peered":"2023-12-24T18:49:05.755366+0000","last_unstale":"2023-12-24T18:49:06.753971+0000","last_undegraded":"2023-12-24T18:49:06.753971+0000","last_fullsized":"2023-12-24T18:49:06.753971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:17.144041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770843+0000","last_change":"2023-12-24T18:49:06.767804+0000","last_active":"2023-12-24T18:49:06.770843+0000","last_peered":"2023-12-24T18:49:06.770843+0000","last_clean":"2023-12-24T18:49:06.770843+0000","last_became_active":"2023-12-24T18:49:06.767458+0000","last_became_peered":"2023-12-24T18:49:06.767458+0000","last_unstale":"2023-12-24T18:49:06.770843+0000","last_undegraded":"2023-12-24T18:49:06.770843+0000","last_fullsized":"2023-12-24T18:49:06.770843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:14.891446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.745185+0000","last_change":"2023-12-24T18:49:05.767343+0000","last_active":"2023-12-24T18:49:06.745185+0000","last_peered":"2023-12-24T18:49:06.745185+0000","last_clean":"2023-12-24T18:49:06.745185+0000","last_became_active":"2023-12-24T18:49:05.766812+0000","last_became_peered":"2023-12-24T18:49:05.766812+0000","last_unstale":"2023-12-24T18:49:06.745185+0000","last_undegraded":"2023-12-24T18:49:06.745185+0000","last_fullsized":"2023-12-24T18:49:06.745185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:33.660378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797928+0000","last_change":"2023-12-24T18:49:06.796042+0000","last_active":"2023-12-24T18:49:06.797928+0000","last_peered":"2023-12-24T18:49:06.797928+0000","last_clean":"2023-12-24T18:49:06.797928+0000","last_became_active":"2023-12-24T18:49:06.795679+0000","last_became_peered":"2023-12-24T18:49:06.795679+0000","last_unstale":"2023-12-24T18:49:06.797928+0000","last_undegraded":"2023-12-24T18:49:06.797928+0000","last_fullsized":"2023-12-24T18:49:06.797928+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.259364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794048+0000","last_change":"2023-12-24T18:49:05.767596+0000","last_active":"2023-12-24T18:49:06.794048+0000","last_peered":"2023-12-24T18:49:06.794048+0000","last_clean":"2023-12-24T18:49:06.794048+0000","last_became_active":"2023-12-24T18:49:05.767253+0000","last_became_peered":"2023-12-24T18:49:05.767253+0000","last_unstale":"2023-12-24T18:49:06.794048+0000","last_undegraded":"2023-12-24T18:49:06.794048+0000","last_fullsized":"2023-12-24T18:49:06.794048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:44.311854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764750+0000","last_change":"2023-12-24T18:49:06.759244+0000","last_active":"2023-12-24T18:49:06.764750+0000","last_peered":"2023-12-24T18:49:06.764750+0000","last_clean":"2023-12-24T18:49:06.764750+0000","last_became_active":"2023-12-24T18:49:06.758897+0000","last_became_peered":"2023-12-24T18:49:06.758897+0000","last_unstale":"2023-12-24T18:49:06.764750+0000","last_undegraded":"2023-12-24T18:49:06.764750+0000","last_fullsized":"2023-12-24T18:49:06.764750+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.800937+0000","last_change":"2023-12-24T18:49:05.756368+0000","last_active":"2023-12-24T18:49:06.800937+0000","last_peered":"2023-12-24T18:49:06.800937+0000","last_clean":"2023-12-24T18:49:06.800937+0000","last_became_active":"2023-12-24T18:49:05.755741+0000","last_became_peered":"2023-12-24T18:49:05.755741+0000","last_unstale":"2023-12-24T18:49:06.800937+0000","last_undegraded":"2023-12-24T18:49:06.800937+0000","last_fullsized":"2023-12-24T18:49:06.800937+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:39.670814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.768182+0000","last_change":"2023-12-24T18:49:06.765230+0000","last_active":"2023-12-24T18:49:06.768182+0000","last_peered":"2023-12-24T18:49:06.768182+0000","last_clean":"2023-12-24T18:49:06.768182+0000","last_became_active":"2023-12-24T18:49:06.764886+0000","last_became_peered":"2023-12-24T18:49:06.764886+0000","last_unstale":"2023-12-24T18:49:06.768182+0000","last_undegraded":"2023-12-24T18:49:06.768182+0000","last_fullsized":"2023-12-24T18:49:06.768182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:30:06.124585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797774+0000","last_change":"2023-12-24T18:49:05.766160+0000","last_active":"2023-12-24T18:49:06.797774+0000","last_peered":"2023-12-24T18:49:06.797774+0000","last_clean":"2023-12-24T18:49:06.797774+0000","last_became_active":"2023-12-24T18:49:05.765051+0000","last_became_peered":"2023-12-24T18:49:05.765051+0000","last_unstale":"2023-12-24T18:49:06.797774+0000","last_undegraded":"2023-12-24T18:49:06.797774+0000","last_fullsized":"2023-12-24T18:49:06.797774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:29.909776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795787+0000","last_change":"2023-12-24T18:49:06.782791+0000","last_active":"2023-12-24T18:49:06.795787+0000","last_peered":"2023-12-24T18:49:06.795787+0000","last_clean":"2023-12-24T18:49:06.795787+0000","last_became_active":"2023-12-24T18:49:06.782512+0000","last_became_peered":"2023-12-24T18:49:06.782512+0000","last_unstale":"2023-12-24T18:49:06.795787+0000","last_undegraded":"2023-12-24T18:49:06.795787+0000","last_fullsized":"2023-12-24T18:49:06.795787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:26.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742976+0000","last_change":"2023-12-24T18:49:05.765847+0000","last_active":"2023-12-24T18:49:06.742976+0000","last_peered":"2023-12-24T18:49:06.742976+0000","last_clean":"2023-12-24T18:49:06.742976+0000","last_became_active":"2023-12-24T18:49:05.765469+0000","last_became_peered":"2023-12-24T18:49:05.765469+0000","last_unstale":"2023-12-24T18:49:06.742976+0000","last_undegraded":"2023-12-24T18:49:06.742976+0000","last_fullsized":"2023-12-24T18:49:06.742976+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:41:12.553169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.773360+0000","last_change":"2023-12-24T18:49:06.770197+0000","last_active":"2023-12-24T18:49:06.773360+0000","last_peered":"2023-12-24T18:49:06.773360+0000","last_clean":"2023-12-24T18:49:06.773360+0000","last_became_active":"2023-12-24T18:49:06.769893+0000","last_became_peered":"2023-12-24T18:49:06.769893+0000","last_unstale":"2023-12-24T18:49:06.773360+0000","last_undegraded":"2023-12-24T18:49:06.773360+0000","last_fullsized":"2023-12-24T18:49:06.773360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:42.191222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.752060+0000","last_change":"2023-12-24T18:49:05.751953+0000","last_active":"2023-12-24T18:49:06.752060+0000","last_peered":"2023-12-24T18:49:06.752060+0000","last_clean":"2023-12-24T18:49:06.752060+0000","last_became_active":"2023-12-24T18:49:05.751619+0000","last_became_peered":"2023-12-24T18:49:05.751619+0000","last_unstale":"2023-12-24T18:49:06.752060+0000","last_undegraded":"2023-12-24T18:49:06.752060+0000","last_fullsized":"2023-12-24T18:49:06.752060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:55.547954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798505+0000","last_change":"2023-12-24T18:49:06.790839+0000","last_active":"2023-12-24T18:49:06.798505+0000","last_peered":"2023-12-24T18:49:06.798505+0000","last_clean":"2023-12-24T18:49:06.798505+0000","last_became_active":"2023-12-24T18:49:06.787462+0000","last_became_peered":"2023-12-24T18:49:06.787462+0000","last_unstale":"2023-12-24T18:49:06.798505+0000","last_undegraded":"2023-12-24T18:49:06.798505+0000","last_fullsized":"2023-12-24T18:49:06.798505+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:26:02.198401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.783411+0000","last_change":"2023-12-24T18:49:05.754218+0000","last_active":"2023-12-24T18:49:06.783411+0000","last_peered":"2023-12-24T18:49:06.783411+0000","last_clean":"2023-12-24T18:49:06.783411+0000","last_became_active":"2023-12-24T18:49:05.753928+0000","last_became_peered":"2023-12-24T18:49:05.753928+0000","last_unstale":"2023-12-24T18:49:06.783411+0000","last_undegraded":"2023-12-24T18:49:06.783411+0000","last_fullsized":"2023-12-24T18:49:06.783411+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:48:49.416446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770468+0000","last_change":"2023-12-24T18:49:06.765378+0000","last_active":"2023-12-24T18:49:06.770468+0000","last_peered":"2023-12-24T18:49:06.770468+0000","last_clean":"2023-12-24T18:49:06.770468+0000","last_became_active":"2023-12-24T18:49:06.765061+0000","last_became_peered":"2023-12-24T18:49:06.765061+0000","last_unstale":"2023-12-24T18:49:06.770468+0000","last_undegraded":"2023-12-24T18:49:06.770468+0000","last_fullsized":"2023-12-24T18:49:06.770468+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:10:29.489693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798580+0000","last_change":"2023-12-24T18:49:05.769576+0000","last_active":"2023-12-24T18:49:06.798580+0000","last_peered":"2023-12-24T18:49:06.798580+0000","last_clean":"2023-12-24T18:49:06.798580+0000","last_became_active":"2023-12-24T18:49:05.769212+0000","last_became_peered":"2023-12-24T18:49:05.769212+0000","last_unstale":"2023-12-24T18:49:06.798580+0000","last_undegraded":"2023-12-24T18:49:06.798580+0000","last_fullsized":"2023-12-24T18:49:06.798580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:50.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796324+0000","last_change":"2023-12-24T18:49:06.793760+0000","last_active":"2023-12-24T18:49:06.796324+0000","last_peered":"2023-12-24T18:49:06.796324+0000","last_clean":"2023-12-24T18:49:06.796324+0000","last_became_active":"2023-12-24T18:49:06.793485+0000","last_became_peered":"2023-12-24T18:49:06.793485+0000","last_unstale":"2023-12-24T18:49:06.796324+0000","last_undegraded":"2023-12-24T18:49:06.796324+0000","last_fullsized":"2023-12-24T18:49:06.796324+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:36.033114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.776192+0000","last_change":"2023-12-24T18:49:05.752516+0000","last_active":"2023-12-24T18:49:06.776192+0000","last_peered":"2023-12-24T18:49:06.776192+0000","last_clean":"2023-12-24T18:49:06.776192+0000","last_became_active":"2023-12-24T18:49:05.752183+0000","last_became_peered":"2023-12-24T18:49:05.752183+0000","last_unstale":"2023-12-24T18:49:06.776192+0000","last_undegraded":"2023-12-24T18:49:06.776192+0000","last_fullsized":"2023-12-24T18:49:06.776192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:24:31.209653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797362+0000","last_change":"2023-12-24T18:49:06.796399+0000","last_active":"2023-12-24T18:49:06.797362+0000","last_peered":"2023-12-24T18:49:06.797362+0000","last_clean":"2023-12-24T18:49:06.797362+0000","last_became_active":"2023-12-24T18:49:06.796007+0000","last_became_peered":"2023-12-24T18:49:06.796007+0000","last_unstale":"2023-12-24T18:49:06.797362+0000","last_undegraded":"2023-12-24T18:49:06.797362+0000","last_fullsized":"2023-12-24T18:49:06.797362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.787742+0000","last_change":"2023-12-24T18:49:05.766951+0000","last_active":"2023-12-24T18:49:06.787742+0000","last_peered":"2023-12-24T18:49:06.787742+0000","last_clean":"2023-12-24T18:49:06.787742+0000","last_became_active":"2023-12-24T18:49:05.766562+0000","last_became_peered":"2023-12-24T18:49:05.766562+0000","last_unstale":"2023-12-24T18:49:06.787742+0000","last_undegraded":"2023-12-24T18:49:06.787742+0000","last_fullsized":"2023-12-24T18:49:06.787742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:54.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792494+0000","last_change":"2023-12-24T18:49:06.783702+0000","last_active":"2023-12-24T18:49:06.792494+0000","last_peered":"2023-12-24T18:49:06.792494+0000","last_clean":"2023-12-24T18:49:06.792494+0000","last_became_active":"2023-12-24T18:49:06.775926+0000","last_became_peered":"2023-12-24T18:49:06.775926+0000","last_unstale":"2023-12-24T18:49:06.792494+0000","last_undegraded":"2023-12-24T18:49:06.792494+0000","last_fullsized":"2023-12-24T18:49:06.792494+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:34.674863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.744178+0000","last_change":"2023-12-24T18:49:05.750637+0000","last_active":"2023-12-24T18:49:06.744178+0000","last_peered":"2023-12-24T18:49:06.744178+0000","last_clean":"2023-12-24T18:49:06.744178+0000","last_became_active":"2023-12-24T18:49:05.750340+0000","last_became_peered":"2023-12-24T18:49:05.750340+0000","last_unstale":"2023-12-24T18:49:06.744178+0000","last_undegraded":"2023-12-24T18:49:06.744178+0000","last_fullsized":"2023-12-24T18:49:06.744178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:24:31.209653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.762242+0000","last_change":"2023-12-24T18:49:06.761023+0000","last_active":"2023-12-24T18:49:06.762242+0000","last_peered":"2023-12-24T18:49:06.762242+0000","last_clean":"2023-12-24T18:49:06.762242+0000","last_became_active":"2023-12-24T18:49:06.760689+0000","last_became_peered":"2023-12-24T18:49:06.760689+0000","last_unstale":"2023-12-24T18:49:06.762242+0000","last_undegraded":"2023-12-24T18:49:06.762242+0000","last_fullsized":"2023-12-24T18:49:06.762242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:47.949611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796081+0000","last_change":"2023-12-24T18:49:05.762547+0000","last_active":"2023-12-24T18:49:06.796081+0000","last_peered":"2023-12-24T18:49:06.796081+0000","last_clean":"2023-12-24T18:49:06.796081+0000","last_became_active":"2023-12-24T18:49:05.762265+0000","last_became_peered":"2023-12-24T18:49:05.762265+0000","last_unstale":"2023-12-24T18:49:06.796081+0000","last_undegraded":"2023-12-24T18:49:06.796081+0000","last_fullsized":"2023-12-24T18:49:06.796081+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:55.547954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.765816+0000","last_change":"2023-12-24T18:49:06.758684+0000","last_active":"2023-12-24T18:49:06.765816+0000","last_peered":"2023-12-24T18:49:06.765816+0000","last_clean":"2023-12-24T18:49:06.765816+0000","last_became_active":"2023-12-24T18:49:06.758370+0000","last_became_peered":"2023-12-24T18:49:06.758370+0000","last_unstale":"2023-12-24T18:49:06.765816+0000","last_undegraded":"2023-12-24T18:49:06.765816+0000","last_fullsized":"2023-12-24T18:49:06.765816+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:45.326339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761049+0000","last_change":"2023-12-24T18:49:05.761664+0000","last_active":"2023-12-24T18:49:06.761049+0000","last_peered":"2023-12-24T18:49:06.761049+0000","last_clean":"2023-12-24T18:49:06.761049+0000","last_became_active":"2023-12-24T18:49:05.761336+0000","last_became_peered":"2023-12-24T18:49:05.761336+0000","last_unstale":"2023-12-24T18:49:06.761049+0000","last_undegraded":"2023-12-24T18:49:06.761049+0000","last_fullsized":"2023-12-24T18:49:06.761049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:44.425382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797586+0000","last_change":"2023-12-24T18:49:06.789374+0000","last_active":"2023-12-24T18:49:06.797586+0000","last_peered":"2023-12-24T18:49:06.797586+0000","last_clean":"2023-12-24T18:49:06.797586+0000","last_became_active":"2023-12-24T18:49:06.784653+0000","last_became_peered":"2023-12-24T18:49:06.784653+0000","last_unstale":"2023-12-24T18:49:06.797586+0000","last_undegraded":"2023-12-24T18:49:06.797586+0000","last_fullsized":"2023-12-24T18:49:06.797586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:42.191222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.781272+0000","last_change":"2023-12-24T18:49:05.769428+0000","last_active":"2023-12-24T18:49:06.781272+0000","last_peered":"2023-12-24T18:49:06.781272+0000","last_clean":"2023-12-24T18:49:06.781272+0000","last_became_active":"2023-12-24T18:49:05.769051+0000","last_became_peered":"2023-12-24T18:49:05.769051+0000","last_unstale":"2023-12-24T18:49:06.781272+0000","last_undegraded":"2023-12-24T18:49:06.781272+0000","last_fullsized":"2023-12-24T18:49:06.781272+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:07.079737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784915+0000","last_change":"2023-12-24T18:49:06.770072+0000","last_active":"2023-12-24T18:49:06.784915+0000","last_peered":"2023-12-24T18:49:06.784915+0000","last_clean":"2023-12-24T18:49:06.784915+0000","last_became_active":"2023-12-24T18:49:06.758556+0000","last_became_peered":"2023-12-24T18:49:06.758556+0000","last_unstale":"2023-12-24T18:49:06.784915+0000","last_undegraded":"2023-12-24T18:49:06.784915+0000","last_fullsized":"2023-12-24T18:49:06.784915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:04.303823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742140+0000","last_change":"2023-12-24T18:49:05.751343+0000","last_active":"2023-12-24T18:49:06.742140+0000","last_peered":"2023-12-24T18:49:06.742140+0000","last_clean":"2023-12-24T18:49:06.742140+0000","last_became_active":"2023-12-24T18:49:05.750980+0000","last_became_peered":"2023-12-24T18:49:05.750980+0000","last_unstale":"2023-12-24T18:49:06.742140+0000","last_undegraded":"2023-12-24T18:49:06.742140+0000","last_fullsized":"2023-12-24T18:49:06.742140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:28.596586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.771709+0000","last_change":"2023-12-24T18:49:06.768340+0000","last_active":"2023-12-24T18:49:06.771709+0000","last_peered":"2023-12-24T18:49:06.771709+0000","last_clean":"2023-12-24T18:49:06.771709+0000","last_became_active":"2023-12-24T18:49:06.764824+0000","last_became_peered":"2023-12-24T18:49:06.764824+0000","last_unstale":"2023-12-24T18:49:06.771709+0000","last_undegraded":"2023-12-24T18:49:06.771709+0000","last_fullsized":"2023-12-24T18:49:06.771709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:35.283700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796850+0000","last_change":"2023-12-24T18:49:05.769064+0000","last_active":"2023-12-24T18:49:06.796850+0000","last_peered":"2023-12-24T18:49:06.796850+0000","last_clean":"2023-12-24T18:49:06.796850+0000","last_became_active":"2023-12-24T18:49:05.768714+0000","last_became_peered":"2023-12-24T18:49:05.768714+0000","last_unstale":"2023-12-24T18:49:06.796850+0000","last_undegraded":"2023-12-24T18:49:06.796850+0000","last_fullsized":"2023-12-24T18:49:06.796850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:33:14.110840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794434+0000","last_change":"2023-12-24T18:49:06.785909+0000","last_active":"2023-12-24T18:49:06.794434+0000","last_peered":"2023-12-24T18:49:06.794434+0000","last_clean":"2023-12-24T18:49:06.794434+0000","last_became_active":"2023-12-24T18:49:06.785610+0000","last_became_peered":"2023-12-24T18:49:06.785610+0000","last_unstale":"2023-12-24T18:49:06.794434+0000","last_undegraded":"2023-12-24T18:49:06.794434+0000","last_fullsized":"2023-12-24T18:49:06.794434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:32.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.750897+0000","last_change":"2023-12-24T18:49:05.754882+0000","last_active":"2023-12-24T18:49:06.750897+0000","last_peered":"2023-12-24T18:49:06.750897+0000","last_clean":"2023-12-24T18:49:06.750897+0000","last_became_active":"2023-12-24T18:49:05.753795+0000","last_became_peered":"2023-12-24T18:49:05.753795+0000","last_unstale":"2023-12-24T18:49:06.750897+0000","last_undegraded":"2023-12-24T18:49:06.750897+0000","last_fullsized":"2023-12-24T18:49:06.750897+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:41:16.161257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763864+0000","last_change":"2023-12-24T18:49:06.759502+0000","last_active":"2023-12-24T18:49:06.763864+0000","last_peered":"2023-12-24T18:49:06.763864+0000","last_clean":"2023-12-24T18:49:06.763864+0000","last_became_active":"2023-12-24T18:49:06.759169+0000","last_became_peered":"2023-12-24T18:49:06.759169+0000","last_unstale":"2023-12-24T18:49:06.763864+0000","last_undegraded":"2023-12-24T18:49:06.763864+0000","last_fullsized":"2023-12-24T18:49:06.763864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:15.765483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.783822+0000","last_change":"2023-12-24T18:49:05.761769+0000","last_active":"2023-12-24T18:49:06.783822+0000","last_peered":"2023-12-24T18:49:06.783822+0000","last_clean":"2023-12-24T18:49:06.783822+0000","last_became_active":"2023-12-24T18:49:05.761447+0000","last_became_peered":"2023-12-24T18:49:05.761447+0000","last_unstale":"2023-12-24T18:49:06.783822+0000","last_undegraded":"2023-12-24T18:49:06.783822+0000","last_fullsized":"2023-12-24T18:49:06.783822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:35.018629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795915+0000","last_change":"2023-12-24T18:49:06.792927+0000","last_active":"2023-12-24T18:49:06.795915+0000","last_peered":"2023-12-24T18:49:06.795915+0000","last_clean":"2023-12-24T18:49:06.795915+0000","last_became_active":"2023-12-24T18:49:06.792566+0000","last_became_peered":"2023-12-24T18:49:06.792566+0000","last_unstale":"2023-12-24T18:49:06.795915+0000","last_undegraded":"2023-12-24T18:49:06.795915+0000","last_fullsized":"2023-12-24T18:49:06.795915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:11.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761021+0000","last_change":"2023-12-24T18:49:05.756708+0000","last_active":"2023-12-24T18:49:06.761021+0000","last_peered":"2023-12-24T18:49:06.761021+0000","last_clean":"2023-12-24T18:49:06.761021+0000","last_became_active":"2023-12-24T18:49:05.755433+0000","last_became_peered":"2023-12-24T18:49:05.755433+0000","last_unstale":"2023-12-24T18:49:06.761021+0000","last_undegraded":"2023-12-24T18:49:06.761021+0000","last_fullsized":"2023-12-24T18:49:06.761021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:24:31.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.771970+0000","last_change":"2023-12-24T18:49:06.768964+0000","last_active":"2023-12-24T18:49:06.771970+0000","last_peered":"2023-12-24T18:49:06.771970+0000","last_clean":"2023-12-24T18:49:06.771970+0000","last_became_active":"2023-12-24T18:49:06.768700+0000","last_became_peered":"2023-12-24T18:49:06.768700+0000","last_unstale":"2023-12-24T18:49:06.771970+0000","last_undegraded":"2023-12-24T18:49:06.771970+0000","last_fullsized":"2023-12-24T18:49:06.771970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:36.492462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761161+0000","last_change":"2023-12-24T18:49:05.765664+0000","last_active":"2023-12-24T18:49:06.761161+0000","last_peered":"2023-12-24T18:49:06.761161+0000","last_clean":"2023-12-24T18:49:06.761161+0000","last_became_active":"2023-12-24T18:49:05.765290+0000","last_became_peered":"2023-12-24T18:49:05.765290+0000","last_unstale":"2023-12-24T18:49:06.761161+0000","last_undegraded":"2023-12-24T18:49:06.761161+0000","last_fullsized":"2023-12-24T18:49:06.761161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:41.567404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797605+0000","last_change":"2023-12-24T18:49:06.790092+0000","last_active":"2023-12-24T18:49:06.797605+0000","last_peered":"2023-12-24T18:49:06.797605+0000","last_clean":"2023-12-24T18:49:06.797605+0000","last_became_active":"2023-12-24T18:49:06.789664+0000","last_became_peered":"2023-12-24T18:49:06.789664+0000","last_unstale":"2023-12-24T18:49:06.797605+0000","last_undegraded":"2023-12-24T18:49:06.797605+0000","last_fullsized":"2023-12-24T18:49:06.797605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:28.074923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.744443+0000","last_change":"2023-12-24T18:49:05.747169+0000","last_active":"2023-12-24T18:49:06.744443+0000","last_peered":"2023-12-24T18:49:06.744443+0000","last_clean":"2023-12-24T18:49:06.744443+0000","last_became_active":"2023-12-24T18:49:05.746908+0000","last_became_peered":"2023-12-24T18:49:05.746908+0000","last_unstale":"2023-12-24T18:49:06.744443+0000","last_undegraded":"2023-12-24T18:49:06.744443+0000","last_fullsized":"2023-12-24T18:49:06.744443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:22.869279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770566+0000","last_change":"2023-12-24T18:49:06.764394+0000","last_active":"2023-12-24T18:49:06.770566+0000","last_peered":"2023-12-24T18:49:06.770566+0000","last_clean":"2023-12-24T18:49:06.770566+0000","last_became_active":"2023-12-24T18:49:06.764078+0000","last_became_peered":"2023-12-24T18:49:06.764078+0000","last_unstale":"2023-12-24T18:49:06.770566+0000","last_undegraded":"2023-12-24T18:49:06.770566+0000","last_fullsized":"2023-12-24T18:49:06.770566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:48:12.557713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.749435+0000","last_change":"2023-12-24T18:49:05.764778+0000","last_active":"2023-12-24T18:49:06.749435+0000","last_peered":"2023-12-24T18:49:06.749435+0000","last_clean":"2023-12-24T18:49:06.749435+0000","last_became_active":"2023-12-24T18:49:05.764257+0000","last_became_peered":"2023-12-24T18:49:05.764257+0000","last_unstale":"2023-12-24T18:49:06.749435+0000","last_undegraded":"2023-12-24T18:49:06.749435+0000","last_fullsized":"2023-12-24T18:49:06.749435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:23.564959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770304+0000","last_change":"2023-12-24T18:49:06.767954+0000","last_active":"2023-12-24T18:49:06.770304+0000","last_peered":"2023-12-24T18:49:06.770304+0000","last_clean":"2023-12-24T18:49:06.770304+0000","last_became_active":"2023-12-24T18:49:06.763706+0000","last_became_peered":"2023-12-24T18:49:06.763706+0000","last_unstale":"2023-12-24T18:49:06.770304+0000","last_undegraded":"2023-12-24T18:49:06.770304+0000","last_fullsized":"2023-12-24T18:49:06.770304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:50:48.932237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784099+0000","last_change":"2023-12-24T18:49:05.761181+0000","last_active":"2023-12-24T18:49:06.784099+0000","last_peered":"2023-12-24T18:49:06.784099+0000","last_clean":"2023-12-24T18:49:06.784099+0000","last_became_active":"2023-12-24T18:49:05.760904+0000","last_became_peered":"2023-12-24T18:49:05.760904+0000","last_unstale":"2023-12-24T18:49:06.784099+0000","last_undegraded":"2023-12-24T18:49:06.784099+0000","last_fullsized":"2023-12-24T18:49:06.784099+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:26.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":280,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.750984+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:49:06.750984+0000","last_peered":"2023-12-24T18:49:06.750984+0000","last_clean":"2023-12-24T18:49:06.750984+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:49:06.750984+0000","last_undegraded":"2023-12-24T18:49:06.750984+0000","last_fullsized":"2023-12-24T18:49:06.750984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306852,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064988,"statfs":{"total":96636764160,"available":96322547712,"internally_reserved":0,"allocated":1404928,"data_stored":986938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.159,"15min":1.179},"min":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.63700000000000001},"max":{"1min":1.5349999999999999,"5min":1.5780000000000001,"15min":2.4159999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.171,"15min":1.1859999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5309999999999999,"5min":1.5449999999999999,"15min":2.0710000000000002},"last":1.756}]},{"osd":1,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.669,"15min":1.669},"last":1.232},{"interface":"front","average":{"1min":1.151,"5min":1.194,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.472,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.222,"15min":1.206},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.704},"last":1.194},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2190000000000001,"15min":1.244},"min":{"1min":0.878,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.893},"last":1.3620000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.88300000000000001,"5min":0.85899999999999999,"15min":0.81899999999999995},"max":{"1min":1.605,"5min":1.7090000000000001,"15min":2.024},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.98599999999999999,"5min":0.874,"15min":0.83099999999999996},"max":{"1min":1.5569999999999999,"5min":1.7509999999999999,"15min":2.0590000000000002},"last":1.149}]},{"osd":4,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.149,"15min":1.2090000000000001},"min":{"1min":0.78500000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.694,"5min":1.7150000000000001,"15min":2.1099999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.242,"15min":1.292},"min":{"1min":0.93100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6040000000000001,"5min":1.79,"15min":1.9390000000000001},"last":1.645}]},{"osd":5,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.252,"15min":1.3149999999999999},"min":{"1min":1.0609999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.571,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3,"15min":1.3740000000000001},"min":{"1min":0.95399999999999996,"5min":0.93200000000000005,"15min":0.68600000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":2.403},"last":1.0940000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.375,"15min":1.4359999999999999},"min":{"1min":0.90700000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9450000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.397},{"interface":"front","average":{"1min":1.48,"5min":1.4119999999999999,"15min":1.4450000000000001},"min":{"1min":1.151,"5min":0.90400000000000003,"15min":0.90200000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":2.2069999999999999},"last":1.4350000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306272,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065568,"statfs":{"total":96636764160,"available":96323141632,"internally_reserved":0,"allocated":811008,"data_stored":397070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.25,"15min":1.2490000000000001},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.466,"5min":1.649,"15min":1.768},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.29,"15min":1.3240000000000001},"min":{"1min":0.999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.55,"5min":1.637,"15min":1.8200000000000001},"last":1.228}]},{"osd":1,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1539999999999999,"15min":1.1819999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1870000000000001,"15min":1.2050000000000001},"min":{"1min":0.80900000000000005,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.667,"5min":1.748,"15min":1.748},"last":1.1040000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.151,"15min":1.1639999999999999},"min":{"1min":0.92800000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4990000000000001,"5min":1.607,"15min":3.609},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2150000000000001,"15min":1.274},"min":{"1min":0.77800000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.794,"5min":1.794,"15min":2.0259999999999998},"last":0.93400000000000005}]},{"osd":3,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.266},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.5760000000000001,"5min":1.597,"15min":1.867},"last":0.997},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2569999999999999,"15min":1.28},"min":{"1min":1.0669999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.512,"5min":1.5580000000000001,"15min":3.8540000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1759999999999999,"15min":1.26},"min":{"1min":0.74199999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2050000000000001,"15min":1.3420000000000001},"min":{"1min":0.89100000000000001,"5min":0.66800000000000004,"15min":0.65200000000000002},"max":{"1min":2.012,"5min":2.012,"15min":3.0470000000000002},"last":0.90500000000000003}]},{"osd":5,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.2749999999999999},"min":{"1min":0.93200000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4630000000000001,"5min":1.6970000000000001,"15min":4.2779999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.329,"15min":1.3919999999999999},"min":{"1min":1.052,"5min":0.622,"15min":0.622},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":0.98199999999999998}]},{"osd":7,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.335,"15min":1.4419999999999999},"min":{"1min":1.0249999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.595,"5min":1.8069999999999999,"15min":4.4610000000000003},"last":1.155}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302168,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069672,"statfs":{"total":96636764160,"available":96327344128,"internally_reserved":0,"allocated":802816,"data_stored":396446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.181,"15min":1.171},"min":{"1min":0.68899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.752},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2889999999999999,"15min":1.3},"min":{"1min":0.85499999999999998,"5min":0.82499999999999996,"15min":0.72099999999999997},"max":{"1min":1.6120000000000001,"5min":1.7270000000000001,"15min":2.73},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.139,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.64700000000000002,"15min":0.63},"max":{"1min":1.623,"5min":1.651,"15min":1.8029999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.157,"15min":1.1180000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.655,"15min":1.655},"last":0.73199999999999998}]},{"osd":2,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.89500000000000002,"5min":0.88400000000000001,"15min":0.53900000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2410000000000001,"15min":1.2090000000000001},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.69999999999999996},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":1.651},"last":0.97999999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2669999999999999,"15min":1.268},"min":{"1min":0.93799999999999994,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.627,"5min":1.669,"15min":2.8159999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":1.0920000000000001,"5min":0.90400000000000003,"15min":0.83699999999999997},"max":{"1min":1.786,"5min":1.786,"15min":2.1389999999999998},"last":1.018}]},{"osd":4,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.133,"15min":1.1379999999999999},"min":{"1min":0.871,"5min":0.75900000000000001,"15min":0.50600000000000001},"max":{"1min":1.575,"5min":1.5900000000000001,"15min":2.202},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.2589999999999999,"15min":1.2669999999999999},"min":{"1min":0.91900000000000004,"5min":0.78200000000000003,"15min":0.58099999999999996},"max":{"1min":1.7529999999999999,"5min":1.839,"15min":1.859},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2789999999999999,"15min":1.306},"min":{"1min":0.91700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7070000000000001,"5min":1.774,"15min":2.3959999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.321,"15min":1.3140000000000001},"min":{"1min":1.0900000000000001,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.724,"5min":1.724,"15min":2.6280000000000001},"last":0.876}]},{"osd":7,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.383,"15min":1.415},"min":{"1min":1.1020000000000001,"5min":0.872,"15min":0.872},"max":{"1min":1.7010000000000001,"5min":1.784,"15min":2.879},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.409,"15min":1.429},"min":{"1min":1.1639999999999999,"5min":0.76400000000000001,"15min":0.64600000000000002},"max":{"1min":1.8660000000000001,"5min":1.911,"15min":2.2429999999999999},"last":0.92700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":806912,"data_stored":397000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1919999999999999,"15min":1.1679999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.514,"5min":1.589,"15min":1.6950000000000001},"last":1.121},{"interface":"front","average":{"1min":1.155,"5min":1.2470000000000001,"15min":1.2170000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.494,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2789999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1459999999999999,"15min":1.141},"min":{"1min":0.94499999999999995,"5min":0.79300000000000004,"15min":0.70699999999999996},"max":{"1min":1.472,"5min":1.591,"15min":1.9830000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.1160000000000001,"15min":1.109},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.48799999999999999},"max":{"1min":1.484,"5min":1.6080000000000001,"15min":1.7649999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2889999999999999,"15min":1.2709999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.5289999999999999,"5min":1.712,"15min":1.738},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.2969999999999999},"min":{"1min":0.93700000000000006,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6060000000000001,"5min":1.6479999999999999,"15min":1.7290000000000001},"last":1.1659999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.159,"15min":1.1439999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.534,"5min":1.587,"15min":1.736},"last":1.208},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.2669999999999999},"min":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.462,"5min":1.839,"15min":1.839},"last":1.0940000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.282,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.58099999999999996},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2629999999999999,"15min":1.28},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.5880000000000001,"5min":1.8129999999999999,"15min":2.3029999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2809999999999999,"15min":1.258},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.5940000000000001,"5min":1.881,"15min":1.881},"last":0.879},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.333,"15min":1.3180000000000001},"min":{"1min":0.90500000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8009999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.94399999999999995,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.6479999999999999,"5min":1.8680000000000001,"15min":2.161},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":1.085,"5min":0.84199999999999997,"15min":0.76600000000000001},"max":{"1min":1.667,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":398004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95799999999999996},"min":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.2,"5min":1.5800000000000001,"15min":1.5980000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.075,"15min":1.0269999999999999},"min":{"1min":0.84399999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.5549999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.026,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.63600000000000001,"15min":0.42999999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.589},"last":0.749},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.1899999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6180000000000001,"5min":1.677,"15min":1.7110000000000001},"last":1.508}]},{"osd":2,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.103},"min":{"1min":0.81899999999999995,"5min":0.68799999999999994,"15min":0.59499999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.1539999999999999,"15min":1.167},"min":{"1min":0.90500000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.875},"last":1.401}]},{"osd":4,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2529999999999999,"15min":1.2410000000000001},"min":{"1min":1.0489999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.669,"5min":1.7609999999999999,"15min":1.766},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.3360000000000001,"15min":1.349},"min":{"1min":1.125,"5min":0.97899999999999998,"15min":0.66300000000000003},"max":{"1min":1.6459999999999999,"5min":1.7210000000000001,"15min":1.9710000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.381,"15min":1.4099999999999999},"min":{"1min":1.081,"5min":1.0509999999999999,"15min":0.84299999999999997},"max":{"1min":1.837,"5min":1.837,"15min":2.1739999999999999},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.421,"15min":1.46},"min":{"1min":1.05,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.1539999999999999},"last":1.5920000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.4650000000000001,"15min":1.5089999999999999},"min":{"1min":1.153,"5min":1.0389999999999999,"15min":0.92200000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.2909999999999999},"last":1.653},{"interface":"front","average":{"1min":1.415,"5min":1.4099999999999999,"15min":1.429},"min":{"1min":1.1910000000000001,"5min":0.89500000000000002,"15min":0.84999999999999998},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":1.782}]},{"osd":7,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4510000000000001,"15min":1.48},"min":{"1min":1.1899999999999999,"5min":0.88300000000000001,"15min":0.79500000000000004},"max":{"1min":1.9490000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.8440000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5029999999999999,"15min":1.5189999999999999},"min":{"1min":1.294,"5min":1.0960000000000001,"15min":0.85799999999999998},"max":{"1min":1.887,"5min":1.887,"15min":2.3149999999999999},"last":1.3500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310372,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061468,"statfs":{"total":96636764160,"available":96318943232,"internally_reserved":0,"allocated":815104,"data_stored":397982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94399999999999995,"15min":0.96399999999999997},"min":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.36599999999999999},"max":{"1min":1.411,"5min":1.419,"15min":1.8420000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.081,"15min":1.1120000000000001},"min":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.442},"max":{"1min":1.464,"5min":1.486,"15min":2.1459999999999999},"last":1.282}]},{"osd":1,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.67400000000000004,"5min":0.59099999999999997,"15min":0.46200000000000002},"max":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.74},"last":0.999},{"interface":"front","average":{"1min":1.018,"5min":1.0609999999999999,"15min":1.0900000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.339,"5min":1.6020000000000001,"15min":1.774},"last":1.087}]},{"osd":3,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.147,"15min":1.1899999999999999},"min":{"1min":0.82899999999999996,"5min":0.56499999999999995,"15min":0.501},"max":{"1min":1.4370000000000001,"5min":1.5669999999999999,"15min":2.6579999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.143},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.59199999999999997},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":2.524},"last":1.1379999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3029999999999999,"15min":1.399},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.5740000000000001,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.286,"15min":1.3680000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.78400000000000003},"max":{"1min":1.611,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.327}]},{"osd":5,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.278,"15min":1.375},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.76600000000000001},"max":{"1min":1.629,"5min":1.6559999999999999,"15min":3.093},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.4370000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.613,"5min":1.762,"15min":3.0139999999999998},"last":1.4239999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.5},"min":{"1min":1.077,"5min":0.95299999999999996,"15min":0.73799999999999999},"max":{"1min":1.944,"5min":2.0019999999999998,"15min":3.589},"last":1.403},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3919999999999999,"15min":1.502},"min":{"1min":1.026,"5min":0.94399999999999995,"15min":0.82799999999999996},"max":{"1min":1.764,"5min":2.093,"15min":3.5129999999999999},"last":1.3109999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4490000000000001,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":2.044,"15min":3.242},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4670000000000001,"15min":1.5569999999999999},"min":{"1min":1.0569999999999999,"5min":1,"15min":0.81699999999999995},"max":{"1min":1.762,"5min":1.883,"15min":3.8029999999999999},"last":1.468}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302176,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069664,"statfs":{"total":96636764160,"available":96327335936,"internally_reserved":0,"allocated":811008,"data_stored":396606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.002,"15min":1.1000000000000001},"min":{"1min":0.76100000000000001,"5min":0.61799999999999999,"15min":0.51000000000000001},"max":{"1min":1.288,"5min":1.389,"15min":4.149},"last":1.099},{"interface":"front","average":{"1min":1.135,"5min":1.131,"15min":1.1879999999999999},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.58899999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":4.0830000000000002},"last":1.1759999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95599999999999996,"15min":1.0089999999999999},"min":{"1min":0.71799999999999997,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.3280000000000001,"5min":1.4770000000000001,"15min":3.7829999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.117,"15min":1.194},"min":{"1min":0.76700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.365}]},{"osd":3,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.258,"15min":1.339},"min":{"1min":1.0669999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.915,"5min":1.915,"15min":4.1849999999999996},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.099,"15min":1.1819999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.3160000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.23,"15min":1.3049999999999999},"min":{"1min":0.97399999999999998,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.6619999999999999,"5min":1.663,"15min":3.2629999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3919999999999999,"15min":1.498},"min":{"1min":1.024,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7350000000000001,"5min":1.79,"15min":4.1020000000000003},"last":1.6759999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.381,"15min":1.4830000000000001},"min":{"1min":1.0669999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.792,"5min":1.792,"15min":4.4009999999999998},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.349,"15min":1.4330000000000001},"min":{"1min":1.125,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6200000000000001,"5min":2.0089999999999999,"15min":2.637},"last":1.353}]},{"osd":6,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.486,"15min":1.589},"min":{"1min":1.153,"5min":1.097,"15min":0.90600000000000003},"max":{"1min":1.839,"5min":1.841,"15min":4.0229999999999997},"last":1.754},{"interface":"front","average":{"1min":1.52,"5min":1.4770000000000001,"15min":1.5700000000000001},"min":{"1min":1.113,"5min":1.0329999999999999,"15min":1.0109999999999999},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":4.4480000000000004},"last":1.8640000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.528,"15min":1.621},"min":{"1min":1.147,"5min":0.754,"15min":0.754},"max":{"1min":2.238,"5min":2.238,"15min":4.3470000000000004},"last":2.0790000000000002},{"interface":"front","average":{"1min":1.468,"5min":1.462,"15min":1.5269999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0149999999999999},"max":{"1min":1.726,"5min":2.1160000000000001,"15min":2.798},"last":1.704}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306852,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064988,"statfs":{"total":96636764160,"available":96322547712,"internally_reserved":0,"allocated":1404928,"data_stored":986870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.0049999999999999,"15min":1.0349999999999999},"min":{"1min":0.57799999999999996,"5min":0.51400000000000001,"15min":0.40799999999999997},"max":{"1min":1.5069999999999999,"5min":1.706,"15min":1.746},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.028,"15min":1.069},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.141,"15min":1.139},"min":{"1min":0.83899999999999997,"5min":0.70199999999999996,"15min":0.67400000000000004},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.1000000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.72499999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"max":{"1min":1.79,"5min":1.79,"15min":1.819},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.238,"15min":1.2709999999999999},"min":{"1min":0.91900000000000004,"5min":0.83299999999999996,"15min":0.53600000000000003},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.343,"15min":1.367},"min":{"1min":1.1259999999999999,"5min":0.875,"15min":0.71799999999999997},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.982},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":1.0669999999999999,"5min":0.93500000000000005,"15min":0.78300000000000003},"max":{"1min":1.6140000000000001,"5min":1.762,"15min":1.762},"last":1.155}]},{"osd":5,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3839999999999999,"15min":1.444},"min":{"1min":0.96899999999999997,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.8120000000000001,"5min":1.952,"15min":2.391},"last":1.569},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4139999999999999,"15min":1.468},"min":{"1min":1.135,"5min":0.95499999999999996,"15min":0.66000000000000003},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.2410000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.339,"15min":1.431},"min":{"1min":1.117,"5min":0.88500000000000001,"15min":0.71499999999999997},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":2.0779999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.486,"15min":1.5409999999999999},"min":{"1min":1.056,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.1579999999999999,"5min":2.161,"15min":2.23},"last":1.4379999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.486,"15min":1.5529999999999999},"min":{"1min":1.1319999999999999,"5min":1.0780000000000001,"15min":0.67500000000000004},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4339999999999999,"15min":1.528},"min":{"1min":1.109,"5min":0.93200000000000005,"15min":0.92000000000000004},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.1870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:49:11.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:49:11.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 Processor -- start 2023-12-24T18:49:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 -- start start 2023-12-24T18:49:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 0x7fd9500ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd95006c820 0x7fd9500ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 0x7fd9500b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95006d8c0 con 0x7fd95006c820 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500afc60 con 0x7fd9500adc90 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd955403700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500b0460 con 0x7fd95015a2d0 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd95006c820 0x7fd9500ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd95006c820 0x7fd9500ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50892/0 (socket says 172.21.15.50:50892) 2023-12-24T18:49:11.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 -- 172.21.15.50:0/3839447074 learned_addr learned my addr 172.21.15.50:0/3839447074 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:11.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 -- 172.21.15.50:0/3839447074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 msgr2=0x7fd9500ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:11.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd954c02700 1 --2- 172.21.15.50:0/3839447074 >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 0x7fd9500b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94ffff700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 0x7fd9500ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 0x7fd9500ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 -- 172.21.15.50:0/3839447074 >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 msgr2=0x7fd9500b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 --2- 172.21.15.50:0/3839447074 >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 0x7fd9500b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 -- 172.21.15.50:0/3839447074 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500ae100 con 0x7fd95006c820 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd954c02700 1 --2- 172.21.15.50:0/3839447074 >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 0x7fd9500b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94ffff700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 0x7fd9500ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.273+0000 7fd94f7fe700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95006c820 0x7fd9500ad750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd95006a390 tx=0x7fd944009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6032728f9f6b8dd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd94effd700 1 -- 172.21.15.50:0/3839447074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94400b860 con 0x7fd95006c820 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd94effd700 1 -- 172.21.15.50:0/3839447074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94400b9c0 con 0x7fd95006c820 2023-12-24T18:49:11.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd94effd700 1 -- 172.21.15.50:0/3839447074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94400bd60 con 0x7fd95006c820 2023-12-24T18:49:11.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 -- 172.21.15.50:0/3839447074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95006c820 msgr2=0x7fd9500ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95006c820 0x7fd9500ad750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd95006a390 tx=0x7fd944009250 comp rx=0 tx=0).stop 2023-12-24T18:49:11.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 -- 172.21.15.50:0/3839447074 shutdown_connections 2023-12-24T18:49:11.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 --2- 172.21.15.50:0/3839447074 >> v2:172.21.15.82:3300/0 conn(0x7fd9500adc90 0x7fd9500b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95006c820 0x7fd9500ad750 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 --2- 172.21.15.50:0/3839447074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd95015a2d0 0x7fd9500ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 -- 172.21.15.50:0/3839447074 >> 172.21.15.50:0/3839447074 conn(0x7fd950067b80 msgr2=0x7fd9500cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 -- 172.21.15.50:0/3839447074 shutdown_connections 2023-12-24T18:49:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.277+0000 7fd955403700 1 -- 172.21.15.50:0/3839447074 wait complete. 2023-12-24T18:49:11.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 Processor -- start 2023-12-24T18:49:11.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 -- start start 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95006c820 0x7fd9501455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9500adc90 0x7fd950146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950147e10 con 0x7fd95015a2d0 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950147980 con 0x7fd95006c820 2023-12-24T18:49:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd955403700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd950146d70 con 0x7fd9500adc90 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd954c02700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd954c02700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50894/0 (socket says 172.21.15.50:50894) 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd954c02700 1 -- 172.21.15.50:0/2815055627 learned_addr learned my addr 172.21.15.50:0/2815055627 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd94ffff700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95006c820 0x7fd9501455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.281+0000 7fd94f7fe700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9500adc90 0x7fd950146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 -- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9500adc90 msgr2=0x7fd950146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9500adc90 0x7fd950146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 -- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95006c820 msgr2=0x7fd9501455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95006c820 0x7fd9501455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 -- 172.21.15.50:0/2815055627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440094f0 con 0x7fd95015a2d0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd954c02700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd94800cf60 tx=0x7fd948007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800ae40 con 0x7fd95015a2d0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948015440 con 0x7fd95015a2d0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948015800 con 0x7fd95015a2d0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd950147050 con 0x7fd95015a2d0 2023-12-24T18:49:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950147610 con 0x7fd95015a2d0 2023-12-24T18:49:11.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.285+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95004be40 con 0x7fd95015a2d0 2023-12-24T18:49:11.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.289+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd94800d440 con 0x7fd95015a2d0 2023-12-24T18:49:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.289+0000 7fd937fff700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 0x7fd93c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.289+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fd94807d2b0 con 0x7fd95015a2d0 2023-12-24T18:49:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.289+0000 7fd94ffff700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 0x7fd93c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.293+0000 7fd94ffff700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 0x7fd93c062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd940006fd0 tx=0x7fd940008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.293+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd94804d560 con 0x7fd95015a2d0 2023-12-24T18:49:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.465+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd950146200 con 0x7fd93c060550 2023-12-24T18:49:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.473+0000 7fd937fff700 1 -- 172.21.15.50:0/2815055627 <== mgr.5695 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285822 (secure 0 0 0) 0x7fd950146200 con 0x7fd93c060550 2023-12-24T18:49:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 msgr2=0x7fd93c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 0x7fd93c062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd940006fd0 tx=0x7fd940008040 comp rx=0 tx=0).stop 2023-12-24T18:49:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 msgr2=0x7fd950158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd94800cf60 tx=0x7fd948007870 comp rx=0 tx=0).stop 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 shutdown_connections 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fd93c060550 0x7fd93c062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95015a2d0 0x7fd950158bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9500adc90 0x7fd950146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 --2- 172.21.15.50:0/2815055627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95006c820 0x7fd9501455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 >> 172.21.15.50:0/2815055627 conn(0x7fd950067b80 msgr2=0x7fd9500cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 shutdown_connections 2023-12-24T18:49:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.481+0000 7fd955403700 1 -- 172.21.15.50:0/2815055627 wait complete. 2023-12-24T18:49:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:49:11.510 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:49:09.775020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443144,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752531576,"statfs":{"total":773094113280,"available":770592333824,"internally_reserved":0,"allocated":7675904,"data_stored":4356916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056853"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784940+0000","last_change":"2023-12-24T18:49:06.771289+0000","last_active":"2023-12-24T18:49:06.784940+0000","last_peered":"2023-12-24T18:49:06.784940+0000","last_clean":"2023-12-24T18:49:06.784940+0000","last_became_active":"2023-12-24T18:49:06.770961+0000","last_became_peered":"2023-12-24T18:49:06.770961+0000","last_unstale":"2023-12-24T18:49:06.784940+0000","last_undegraded":"2023-12-24T18:49:06.784940+0000","last_fullsized":"2023-12-24T18:49:06.784940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767861+0000","last_change":"2023-12-24T18:49:06.763261+0000","last_active":"2023-12-24T18:49:06.767861+0000","last_peered":"2023-12-24T18:49:06.767861+0000","last_clean":"2023-12-24T18:49:06.767861+0000","last_became_active":"2023-12-24T18:49:06.762979+0000","last_became_peered":"2023-12-24T18:49:06.762979+0000","last_unstale":"2023-12-24T18:49:06.767861+0000","last_undegraded":"2023-12-24T18:49:06.767861+0000","last_fullsized":"2023-12-24T18:49:06.767861+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:04.303823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795808+0000","last_change":"2023-12-24T18:49:06.790758+0000","last_active":"2023-12-24T18:49:06.795808+0000","last_peered":"2023-12-24T18:49:06.795808+0000","last_clean":"2023-12-24T18:49:06.795808+0000","last_became_active":"2023-12-24T18:49:06.790440+0000","last_became_peered":"2023-12-24T18:49:06.790440+0000","last_unstale":"2023-12-24T18:49:06.795808+0000","last_undegraded":"2023-12-24T18:49:06.795808+0000","last_fullsized":"2023-12-24T18:49:06.795808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:15.765483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.772909+0000","last_change":"2023-12-24T18:49:06.769721+0000","last_active":"2023-12-24T18:49:06.772909+0000","last_peered":"2023-12-24T18:49:06.772909+0000","last_clean":"2023-12-24T18:49:06.772909+0000","last_became_active":"2023-12-24T18:49:06.767864+0000","last_became_peered":"2023-12-24T18:49:06.767864+0000","last_unstale":"2023-12-24T18:49:06.772909+0000","last_undegraded":"2023-12-24T18:49:06.772909+0000","last_fullsized":"2023-12-24T18:49:06.772909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:24.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.756041+0000","last_change":"2023-12-24T18:49:06.751020+0000","last_active":"2023-12-24T18:49:06.756041+0000","last_peered":"2023-12-24T18:49:06.756041+0000","last_clean":"2023-12-24T18:49:06.756041+0000","last_became_active":"2023-12-24T18:49:06.750724+0000","last_became_peered":"2023-12-24T18:49:06.750724+0000","last_unstale":"2023-12-24T18:49:06.756041+0000","last_undegraded":"2023-12-24T18:49:06.756041+0000","last_fullsized":"2023-12-24T18:49:06.756041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794415+0000","last_change":"2023-12-24T18:49:06.767010+0000","last_active":"2023-12-24T18:49:06.794415+0000","last_peered":"2023-12-24T18:49:06.794415+0000","last_clean":"2023-12-24T18:49:06.794415+0000","last_became_active":"2023-12-24T18:49:06.757881+0000","last_became_peered":"2023-12-24T18:49:06.757881+0000","last_unstale":"2023-12-24T18:49:06.794415+0000","last_undegraded":"2023-12-24T18:49:06.794415+0000","last_fullsized":"2023-12-24T18:49:06.794415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:08.094223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796596+0000","last_change":"2023-12-24T18:49:06.778093+0000","last_active":"2023-12-24T18:49:06.796596+0000","last_peered":"2023-12-24T18:49:06.796596+0000","last_clean":"2023-12-24T18:49:06.796596+0000","last_became_active":"2023-12-24T18:49:06.777781+0000","last_became_peered":"2023-12-24T18:49:06.777781+0000","last_unstale":"2023-12-24T18:49:06.796596+0000","last_undegraded":"2023-12-24T18:49:06.796596+0000","last_fullsized":"2023-12-24T18:49:06.796596+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:34.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.769318+0000","last_change":"2023-12-24T18:49:06.762815+0000","last_active":"2023-12-24T18:49:06.769318+0000","last_peered":"2023-12-24T18:49:06.769318+0000","last_clean":"2023-12-24T18:49:06.769318+0000","last_became_active":"2023-12-24T18:49:06.762271+0000","last_became_peered":"2023-12-24T18:49:06.762271+0000","last_unstale":"2023-12-24T18:49:06.769318+0000","last_undegraded":"2023-12-24T18:49:06.769318+0000","last_fullsized":"2023-12-24T18:49:06.769318+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:31.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.789796+0000","last_change":"2023-12-24T18:49:06.788599+0000","last_active":"2023-12-24T18:49:06.789796+0000","last_peered":"2023-12-24T18:49:06.789796+0000","last_clean":"2023-12-24T18:49:06.789796+0000","last_became_active":"2023-12-24T18:49:06.788214+0000","last_became_peered":"2023-12-24T18:49:06.788214+0000","last_unstale":"2023-12-24T18:49:06.789796+0000","last_undegraded":"2023-12-24T18:49:06.789796+0000","last_fullsized":"2023-12-24T18:49:06.789796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:26.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784747+0000","last_change":"2023-12-24T18:49:06.770336+0000","last_active":"2023-12-24T18:49:06.784747+0000","last_peered":"2023-12-24T18:49:06.784747+0000","last_clean":"2023-12-24T18:49:06.784747+0000","last_became_active":"2023-12-24T18:49:06.769999+0000","last_became_peered":"2023-12-24T18:49:06.769999+0000","last_unstale":"2023-12-24T18:49:06.784747+0000","last_undegraded":"2023-12-24T18:49:06.784747+0000","last_fullsized":"2023-12-24T18:49:06.784747+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:27.404668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763932+0000","last_change":"2023-12-24T18:49:06.755503+0000","last_active":"2023-12-24T18:49:06.763932+0000","last_peered":"2023-12-24T18:49:06.763932+0000","last_clean":"2023-12-24T18:49:06.763932+0000","last_became_active":"2023-12-24T18:49:06.755189+0000","last_became_peered":"2023-12-24T18:49:06.755189+0000","last_unstale":"2023-12-24T18:49:06.763932+0000","last_undegraded":"2023-12-24T18:49:06.763932+0000","last_fullsized":"2023-12-24T18:49:06.763932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:57:57.350586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.769362+0000","last_change":"2023-12-24T18:49:06.762953+0000","last_active":"2023-12-24T18:49:06.769362+0000","last_peered":"2023-12-24T18:49:06.769362+0000","last_clean":"2023-12-24T18:49:06.769362+0000","last_became_active":"2023-12-24T18:49:06.760776+0000","last_became_peered":"2023-12-24T18:49:06.760776+0000","last_unstale":"2023-12-24T18:49:06.769362+0000","last_undegraded":"2023-12-24T18:49:06.769362+0000","last_fullsized":"2023-12-24T18:49:06.769362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:11.215614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792541+0000","last_change":"2023-12-24T18:49:06.784392+0000","last_active":"2023-12-24T18:49:06.792541+0000","last_peered":"2023-12-24T18:49:06.792541+0000","last_clean":"2023-12-24T18:49:06.792541+0000","last_became_active":"2023-12-24T18:49:06.769616+0000","last_became_peered":"2023-12-24T18:49:06.769616+0000","last_unstale":"2023-12-24T18:49:06.792541+0000","last_undegraded":"2023-12-24T18:49:06.792541+0000","last_fullsized":"2023-12-24T18:49:06.792541+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797952+0000","last_change":"2023-12-24T18:49:06.796339+0000","last_active":"2023-12-24T18:49:06.797952+0000","last_peered":"2023-12-24T18:49:06.797952+0000","last_clean":"2023-12-24T18:49:06.797952+0000","last_became_active":"2023-12-24T18:49:06.796016+0000","last_became_peered":"2023-12-24T18:49:06.796016+0000","last_unstale":"2023-12-24T18:49:06.797952+0000","last_undegraded":"2023-12-24T18:49:06.797952+0000","last_fullsized":"2023-12-24T18:49:06.797952+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:27.114083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.772872+0000","last_change":"2023-12-24T18:49:06.768789+0000","last_active":"2023-12-24T18:49:06.772872+0000","last_peered":"2023-12-24T18:49:06.772872+0000","last_clean":"2023-12-24T18:49:06.772872+0000","last_became_active":"2023-12-24T18:49:06.768521+0000","last_became_peered":"2023-12-24T18:49:06.768521+0000","last_unstale":"2023-12-24T18:49:06.772872+0000","last_undegraded":"2023-12-24T18:49:06.772872+0000","last_fullsized":"2023-12-24T18:49:06.772872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:32.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784822+0000","last_change":"2023-12-24T18:49:06.769826+0000","last_active":"2023-12-24T18:49:06.784822+0000","last_peered":"2023-12-24T18:49:06.784822+0000","last_clean":"2023-12-24T18:49:06.784822+0000","last_became_active":"2023-12-24T18:49:06.769429+0000","last_became_peered":"2023-12-24T18:49:06.769429+0000","last_unstale":"2023-12-24T18:49:06.784822+0000","last_undegraded":"2023-12-24T18:49:06.784822+0000","last_fullsized":"2023-12-24T18:49:06.784822+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798488+0000","last_change":"2023-12-24T18:49:06.790634+0000","last_active":"2023-12-24T18:49:06.798488+0000","last_peered":"2023-12-24T18:49:06.798488+0000","last_clean":"2023-12-24T18:49:06.798488+0000","last_became_active":"2023-12-24T18:49:06.787077+0000","last_became_peered":"2023-12-24T18:49:06.787077+0000","last_unstale":"2023-12-24T18:49:06.798488+0000","last_undegraded":"2023-12-24T18:49:06.798488+0000","last_fullsized":"2023-12-24T18:49:06.798488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:19.822303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767842+0000","last_change":"2023-12-24T18:49:06.762672+0000","last_active":"2023-12-24T18:49:06.767842+0000","last_peered":"2023-12-24T18:49:06.767842+0000","last_clean":"2023-12-24T18:49:06.767842+0000","last_became_active":"2023-12-24T18:49:06.762389+0000","last_became_peered":"2023-12-24T18:49:06.762389+0000","last_unstale":"2023-12-24T18:49:06.767842+0000","last_undegraded":"2023-12-24T18:49:06.767842+0000","last_fullsized":"2023-12-24T18:49:06.767842+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:07.060691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.793208+0000","last_change":"2023-12-24T18:49:06.778137+0000","last_active":"2023-12-24T18:49:06.793208+0000","last_peered":"2023-12-24T18:49:06.793208+0000","last_clean":"2023-12-24T18:49:06.793208+0000","last_became_active":"2023-12-24T18:49:06.777842+0000","last_became_peered":"2023-12-24T18:49:06.777842+0000","last_unstale":"2023-12-24T18:49:06.793208+0000","last_undegraded":"2023-12-24T18:49:06.793208+0000","last_fullsized":"2023-12-24T18:49:06.793208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:47.949611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.766137+0000","last_change":"2023-12-24T18:49:06.758528+0000","last_active":"2023-12-24T18:49:06.766137+0000","last_peered":"2023-12-24T18:49:06.766137+0000","last_clean":"2023-12-24T18:49:06.766137+0000","last_became_active":"2023-12-24T18:49:06.758185+0000","last_became_peered":"2023-12-24T18:49:06.758185+0000","last_unstale":"2023-12-24T18:49:06.766137+0000","last_undegraded":"2023-12-24T18:49:06.766137+0000","last_fullsized":"2023-12-24T18:49:06.766137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:18.158526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764126+0000","last_change":"2023-12-24T18:49:06.757710+0000","last_active":"2023-12-24T18:49:06.764126+0000","last_peered":"2023-12-24T18:49:06.764126+0000","last_clean":"2023-12-24T18:49:06.764126+0000","last_became_active":"2023-12-24T18:49:06.757439+0000","last_became_peered":"2023-12-24T18:49:06.757439+0000","last_unstale":"2023-12-24T18:49:06.764126+0000","last_undegraded":"2023-12-24T18:49:06.764126+0000","last_fullsized":"2023-12-24T18:49:06.764126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:40.276400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797492+0000","last_change":"2023-12-24T18:49:06.796228+0000","last_active":"2023-12-24T18:49:06.797492+0000","last_peered":"2023-12-24T18:49:06.797492+0000","last_clean":"2023-12-24T18:49:06.797492+0000","last_became_active":"2023-12-24T18:49:06.795882+0000","last_became_peered":"2023-12-24T18:49:06.795882+0000","last_unstale":"2023-12-24T18:49:06.797492+0000","last_undegraded":"2023-12-24T18:49:06.797492+0000","last_fullsized":"2023-12-24T18:49:06.797492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:27.114083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764377+0000","last_change":"2023-12-24T18:49:06.756881+0000","last_active":"2023-12-24T18:49:06.764377+0000","last_peered":"2023-12-24T18:49:06.764377+0000","last_clean":"2023-12-24T18:49:06.764377+0000","last_became_active":"2023-12-24T18:49:06.754312+0000","last_became_peered":"2023-12-24T18:49:06.754312+0000","last_unstale":"2023-12-24T18:49:06.764377+0000","last_undegraded":"2023-12-24T18:49:06.764377+0000","last_fullsized":"2023-12-24T18:49:06.764377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:26.403331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786909+0000","last_change":"2023-12-24T18:49:06.772258+0000","last_active":"2023-12-24T18:49:06.786909+0000","last_peered":"2023-12-24T18:49:06.786909+0000","last_clean":"2023-12-24T18:49:06.786909+0000","last_became_active":"2023-12-24T18:49:06.766509+0000","last_became_peered":"2023-12-24T18:49:06.766509+0000","last_unstale":"2023-12-24T18:49:06.786909+0000","last_undegraded":"2023-12-24T18:49:06.786909+0000","last_fullsized":"2023-12-24T18:49:06.786909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:01.052073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798394+0000","last_change":"2023-12-24T18:49:06.779515+0000","last_active":"2023-12-24T18:49:06.798394+0000","last_peered":"2023-12-24T18:49:06.798394+0000","last_clean":"2023-12-24T18:49:06.798394+0000","last_became_active":"2023-12-24T18:49:06.779206+0000","last_became_peered":"2023-12-24T18:49:06.779206+0000","last_unstale":"2023-12-24T18:49:06.798394+0000","last_undegraded":"2023-12-24T18:49:06.798394+0000","last_fullsized":"2023-12-24T18:49:06.798394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:31.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770340+0000","last_change":"2023-12-24T18:49:06.763641+0000","last_active":"2023-12-24T18:49:06.770340+0000","last_peered":"2023-12-24T18:49:06.770340+0000","last_clean":"2023-12-24T18:49:06.770340+0000","last_became_active":"2023-12-24T18:49:06.763336+0000","last_became_peered":"2023-12-24T18:49:06.763336+0000","last_unstale":"2023-12-24T18:49:06.770340+0000","last_undegraded":"2023-12-24T18:49:06.770340+0000","last_fullsized":"2023-12-24T18:49:06.770340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:01.052073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792972+0000","last_change":"2023-12-24T18:49:06.791189+0000","last_active":"2023-12-24T18:49:06.792972+0000","last_peered":"2023-12-24T18:49:06.792972+0000","last_clean":"2023-12-24T18:49:06.792972+0000","last_became_active":"2023-12-24T18:49:06.790887+0000","last_became_peered":"2023-12-24T18:49:06.790887+0000","last_unstale":"2023-12-24T18:49:06.792972+0000","last_undegraded":"2023-12-24T18:49:06.792972+0000","last_fullsized":"2023-12-24T18:49:06.792972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:24.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.753428+0000","last_change":"2023-12-24T18:49:06.748158+0000","last_active":"2023-12-24T18:49:06.753428+0000","last_peered":"2023-12-24T18:49:06.753428+0000","last_clean":"2023-12-24T18:49:06.753428+0000","last_became_active":"2023-12-24T18:49:06.747406+0000","last_became_peered":"2023-12-24T18:49:06.747406+0000","last_unstale":"2023-12-24T18:49:06.753428+0000","last_undegraded":"2023-12-24T18:49:06.753428+0000","last_fullsized":"2023-12-24T18:49:06.753428+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:32.155668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797547+0000","last_change":"2023-12-24T18:49:06.793181+0000","last_active":"2023-12-24T18:49:06.797547+0000","last_peered":"2023-12-24T18:49:06.797547+0000","last_clean":"2023-12-24T18:49:06.797547+0000","last_became_active":"2023-12-24T18:49:06.792843+0000","last_became_peered":"2023-12-24T18:49:06.792843+0000","last_unstale":"2023-12-24T18:49:06.797547+0000","last_undegraded":"2023-12-24T18:49:06.797547+0000","last_fullsized":"2023-12-24T18:49:06.797547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:46.223611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786132+0000","last_change":"2023-12-24T18:49:06.785552+0000","last_active":"2023-12-24T18:49:06.786132+0000","last_peered":"2023-12-24T18:49:06.786132+0000","last_clean":"2023-12-24T18:49:06.786132+0000","last_became_active":"2023-12-24T18:49:06.784832+0000","last_became_peered":"2023-12-24T18:49:06.784832+0000","last_unstale":"2023-12-24T18:49:06.786132+0000","last_undegraded":"2023-12-24T18:49:06.786132+0000","last_fullsized":"2023-12-24T18:49:06.786132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.786034+0000","last_change":"2023-12-24T18:49:06.772951+0000","last_active":"2023-12-24T18:49:06.786034+0000","last_peered":"2023-12-24T18:49:06.786034+0000","last_clean":"2023-12-24T18:49:06.786034+0000","last_became_active":"2023-12-24T18:49:06.766418+0000","last_became_peered":"2023-12-24T18:49:06.766418+0000","last_unstale":"2023-12-24T18:49:06.786034+0000","last_undegraded":"2023-12-24T18:49:06.786034+0000","last_fullsized":"2023-12-24T18:49:06.786034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:05:44.576462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.773217+0000","last_change":"2023-12-24T18:49:06.771852+0000","last_active":"2023-12-24T18:49:06.773217+0000","last_peered":"2023-12-24T18:49:06.773217+0000","last_clean":"2023-12-24T18:49:06.773217+0000","last_became_active":"2023-12-24T18:49:06.771526+0000","last_became_peered":"2023-12-24T18:49:06.771526+0000","last_unstale":"2023-12-24T18:49:06.773217+0000","last_undegraded":"2023-12-24T18:49:06.773217+0000","last_fullsized":"2023-12-24T18:49:06.773217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:51:59.225871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.768075+0000","last_change":"2023-12-24T18:49:06.762111+0000","last_active":"2023-12-24T18:49:06.768075+0000","last_peered":"2023-12-24T18:49:06.768075+0000","last_clean":"2023-12-24T18:49:06.768075+0000","last_became_active":"2023-12-24T18:49:06.761791+0000","last_became_peered":"2023-12-24T18:49:06.761791+0000","last_unstale":"2023-12-24T18:49:06.768075+0000","last_undegraded":"2023-12-24T18:49:06.768075+0000","last_fullsized":"2023-12-24T18:49:06.768075+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:27.404668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.779951+0000","last_change":"2023-12-24T18:49:05.752925+0000","last_active":"2023-12-24T18:49:06.779951+0000","last_peered":"2023-12-24T18:49:06.779951+0000","last_clean":"2023-12-24T18:49:06.779951+0000","last_became_active":"2023-12-24T18:49:05.752548+0000","last_became_peered":"2023-12-24T18:49:05.752548+0000","last_unstale":"2023-12-24T18:49:06.779951+0000","last_undegraded":"2023-12-24T18:49:06.779951+0000","last_fullsized":"2023-12-24T18:49:06.779951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:28.596586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.775114+0000","last_change":"2023-12-24T18:49:06.773662+0000","last_active":"2023-12-24T18:49:06.775114+0000","last_peered":"2023-12-24T18:49:06.775114+0000","last_clean":"2023-12-24T18:49:06.775114+0000","last_became_active":"2023-12-24T18:49:06.773350+0000","last_became_peered":"2023-12-24T18:49:06.773350+0000","last_unstale":"2023-12-24T18:49:06.775114+0000","last_undegraded":"2023-12-24T18:49:06.775114+0000","last_fullsized":"2023-12-24T18:49:06.775114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:08.382024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795046+0000","last_change":"2023-12-24T18:49:05.767831+0000","last_active":"2023-12-24T18:49:06.795046+0000","last_peered":"2023-12-24T18:49:06.795046+0000","last_clean":"2023-12-24T18:49:06.795046+0000","last_became_active":"2023-12-24T18:49:05.767459+0000","last_became_peered":"2023-12-24T18:49:05.767459+0000","last_unstale":"2023-12-24T18:49:06.795046+0000","last_undegraded":"2023-12-24T18:49:06.795046+0000","last_fullsized":"2023-12-24T18:49:06.795046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:08.879276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763392+0000","last_change":"2023-12-24T18:49:06.757099+0000","last_active":"2023-12-24T18:49:06.763392+0000","last_peered":"2023-12-24T18:49:06.763392+0000","last_clean":"2023-12-24T18:49:06.763392+0000","last_became_active":"2023-12-24T18:49:06.756754+0000","last_became_peered":"2023-12-24T18:49:06.756754+0000","last_unstale":"2023-12-24T18:49:06.763392+0000","last_undegraded":"2023-12-24T18:49:06.763392+0000","last_fullsized":"2023-12-24T18:49:06.763392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:35.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792845+0000","last_change":"2023-12-24T18:49:05.764982+0000","last_active":"2023-12-24T18:49:06.792845+0000","last_peered":"2023-12-24T18:49:06.792845+0000","last_clean":"2023-12-24T18:49:06.792845+0000","last_became_active":"2023-12-24T18:49:05.764697+0000","last_became_peered":"2023-12-24T18:49:05.764697+0000","last_unstale":"2023-12-24T18:49:06.792845+0000","last_undegraded":"2023-12-24T18:49:06.792845+0000","last_fullsized":"2023-12-24T18:49:06.792845+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:33.863222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770315+0000","last_change":"2023-12-24T18:49:06.763733+0000","last_active":"2023-12-24T18:49:06.770315+0000","last_peered":"2023-12-24T18:49:06.770315+0000","last_clean":"2023-12-24T18:49:06.770315+0000","last_became_active":"2023-12-24T18:49:06.762591+0000","last_became_peered":"2023-12-24T18:49:06.762591+0000","last_unstale":"2023-12-24T18:49:06.770315+0000","last_undegraded":"2023-12-24T18:49:06.770315+0000","last_fullsized":"2023-12-24T18:49:06.770315+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:34.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.781685+0000","last_change":"2023-12-24T18:49:05.755816+0000","last_active":"2023-12-24T18:49:06.781685+0000","last_peered":"2023-12-24T18:49:06.781685+0000","last_clean":"2023-12-24T18:49:06.781685+0000","last_became_active":"2023-12-24T18:49:05.755521+0000","last_became_peered":"2023-12-24T18:49:05.755521+0000","last_unstale":"2023-12-24T18:49:06.781685+0000","last_undegraded":"2023-12-24T18:49:06.781685+0000","last_fullsized":"2023-12-24T18:49:06.781685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:26.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.793551+0000","last_change":"2023-12-24T18:49:06.792259+0000","last_active":"2023-12-24T18:49:06.793551+0000","last_peered":"2023-12-24T18:49:06.793551+0000","last_clean":"2023-12-24T18:49:06.793551+0000","last_became_active":"2023-12-24T18:49:06.791828+0000","last_became_peered":"2023-12-24T18:49:06.791828+0000","last_unstale":"2023-12-24T18:49:06.793551+0000","last_undegraded":"2023-12-24T18:49:06.793551+0000","last_fullsized":"2023-12-24T18:49:06.793551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:36.033114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797392+0000","last_change":"2023-12-24T18:49:05.759060+0000","last_active":"2023-12-24T18:49:06.797392+0000","last_peered":"2023-12-24T18:49:06.797392+0000","last_clean":"2023-12-24T18:49:06.797392+0000","last_became_active":"2023-12-24T18:49:05.758741+0000","last_became_peered":"2023-12-24T18:49:05.758741+0000","last_unstale":"2023-12-24T18:49:06.797392+0000","last_undegraded":"2023-12-24T18:49:06.797392+0000","last_fullsized":"2023-12-24T18:49:06.797392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:08.513083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.775735+0000","last_change":"2023-12-24T18:49:06.774930+0000","last_active":"2023-12-24T18:49:06.775735+0000","last_peered":"2023-12-24T18:49:06.775735+0000","last_clean":"2023-12-24T18:49:06.775735+0000","last_became_active":"2023-12-24T18:49:06.774602+0000","last_became_peered":"2023-12-24T18:49:06.774602+0000","last_unstale":"2023-12-24T18:49:06.775735+0000","last_undegraded":"2023-12-24T18:49:06.775735+0000","last_fullsized":"2023-12-24T18:49:06.775735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.774091+0000","last_change":"2023-12-24T18:49:05.752559+0000","last_active":"2023-12-24T18:49:06.774091+0000","last_peered":"2023-12-24T18:49:06.774091+0000","last_clean":"2023-12-24T18:49:06.774091+0000","last_became_active":"2023-12-24T18:49:05.752251+0000","last_became_peered":"2023-12-24T18:49:05.752251+0000","last_unstale":"2023-12-24T18:49:06.774091+0000","last_undegraded":"2023-12-24T18:49:06.774091+0000","last_fullsized":"2023-12-24T18:49:06.774091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:55:45.594579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770360+0000","last_change":"2023-12-24T18:49:06.763883+0000","last_active":"2023-12-24T18:49:06.770360+0000","last_peered":"2023-12-24T18:49:06.770360+0000","last_clean":"2023-12-24T18:49:06.770360+0000","last_became_active":"2023-12-24T18:49:06.763546+0000","last_became_peered":"2023-12-24T18:49:06.763546+0000","last_unstale":"2023-12-24T18:49:06.770360+0000","last_undegraded":"2023-12-24T18:49:06.770360+0000","last_fullsized":"2023-12-24T18:49:06.770360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:28.074923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742734+0000","last_change":"2023-12-24T18:49:05.750502+0000","last_active":"2023-12-24T18:49:06.742734+0000","last_peered":"2023-12-24T18:49:06.742734+0000","last_clean":"2023-12-24T18:49:06.742734+0000","last_became_active":"2023-12-24T18:49:05.750157+0000","last_became_peered":"2023-12-24T18:49:05.750157+0000","last_unstale":"2023-12-24T18:49:06.742734+0000","last_undegraded":"2023-12-24T18:49:06.742734+0000","last_fullsized":"2023-12-24T18:49:06.742734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:48:16.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798187+0000","last_change":"2023-12-24T18:49:06.797240+0000","last_active":"2023-12-24T18:49:06.798187+0000","last_peered":"2023-12-24T18:49:06.798187+0000","last_clean":"2023-12-24T18:49:06.798187+0000","last_became_active":"2023-12-24T18:49:06.796770+0000","last_became_peered":"2023-12-24T18:49:06.796770+0000","last_unstale":"2023-12-24T18:49:06.798187+0000","last_undegraded":"2023-12-24T18:49:06.798187+0000","last_fullsized":"2023-12-24T18:49:06.798187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:30.924261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.780513+0000","last_change":"2023-12-24T18:49:05.759172+0000","last_active":"2023-12-24T18:49:06.780513+0000","last_peered":"2023-12-24T18:49:06.780513+0000","last_clean":"2023-12-24T18:49:06.780513+0000","last_became_active":"2023-12-24T18:49:05.758881+0000","last_became_peered":"2023-12-24T18:49:05.758881+0000","last_unstale":"2023-12-24T18:49:06.780513+0000","last_undegraded":"2023-12-24T18:49:06.780513+0000","last_fullsized":"2023-12-24T18:49:06.780513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:06.046206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.767102+0000","last_change":"2023-12-24T18:49:06.762736+0000","last_active":"2023-12-24T18:49:06.767102+0000","last_peered":"2023-12-24T18:49:06.767102+0000","last_clean":"2023-12-24T18:49:06.767102+0000","last_became_active":"2023-12-24T18:49:06.762348+0000","last_became_peered":"2023-12-24T18:49:06.762348+0000","last_unstale":"2023-12-24T18:49:06.767102+0000","last_undegraded":"2023-12-24T18:49:06.767102+0000","last_fullsized":"2023-12-24T18:49:06.767102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:42.581889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.753971+0000","last_change":"2023-12-24T18:49:05.755686+0000","last_active":"2023-12-24T18:49:06.753971+0000","last_peered":"2023-12-24T18:49:06.753971+0000","last_clean":"2023-12-24T18:49:06.753971+0000","last_became_active":"2023-12-24T18:49:05.755366+0000","last_became_peered":"2023-12-24T18:49:05.755366+0000","last_unstale":"2023-12-24T18:49:06.753971+0000","last_undegraded":"2023-12-24T18:49:06.753971+0000","last_fullsized":"2023-12-24T18:49:06.753971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:17.144041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770843+0000","last_change":"2023-12-24T18:49:06.767804+0000","last_active":"2023-12-24T18:49:06.770843+0000","last_peered":"2023-12-24T18:49:06.770843+0000","last_clean":"2023-12-24T18:49:06.770843+0000","last_became_active":"2023-12-24T18:49:06.767458+0000","last_became_peered":"2023-12-24T18:49:06.767458+0000","last_unstale":"2023-12-24T18:49:06.770843+0000","last_undegraded":"2023-12-24T18:49:06.770843+0000","last_fullsized":"2023-12-24T18:49:06.770843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:45:14.891446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.745185+0000","last_change":"2023-12-24T18:49:05.767343+0000","last_active":"2023-12-24T18:49:06.745185+0000","last_peered":"2023-12-24T18:49:06.745185+0000","last_clean":"2023-12-24T18:49:06.745185+0000","last_became_active":"2023-12-24T18:49:05.766812+0000","last_became_peered":"2023-12-24T18:49:05.766812+0000","last_unstale":"2023-12-24T18:49:06.745185+0000","last_undegraded":"2023-12-24T18:49:06.745185+0000","last_fullsized":"2023-12-24T18:49:06.745185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:33.660378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797928+0000","last_change":"2023-12-24T18:49:06.796042+0000","last_active":"2023-12-24T18:49:06.797928+0000","last_peered":"2023-12-24T18:49:06.797928+0000","last_clean":"2023-12-24T18:49:06.797928+0000","last_became_active":"2023-12-24T18:49:06.795679+0000","last_became_peered":"2023-12-24T18:49:06.795679+0000","last_unstale":"2023-12-24T18:49:06.797928+0000","last_undegraded":"2023-12-24T18:49:06.797928+0000","last_fullsized":"2023-12-24T18:49:06.797928+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.259364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794048+0000","last_change":"2023-12-24T18:49:05.767596+0000","last_active":"2023-12-24T18:49:06.794048+0000","last_peered":"2023-12-24T18:49:06.794048+0000","last_clean":"2023-12-24T18:49:06.794048+0000","last_became_active":"2023-12-24T18:49:05.767253+0000","last_became_peered":"2023-12-24T18:49:05.767253+0000","last_unstale":"2023-12-24T18:49:06.794048+0000","last_undegraded":"2023-12-24T18:49:06.794048+0000","last_fullsized":"2023-12-24T18:49:06.794048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:44.311854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.764750+0000","last_change":"2023-12-24T18:49:06.759244+0000","last_active":"2023-12-24T18:49:06.764750+0000","last_peered":"2023-12-24T18:49:06.764750+0000","last_clean":"2023-12-24T18:49:06.764750+0000","last_became_active":"2023-12-24T18:49:06.758897+0000","last_became_peered":"2023-12-24T18:49:06.758897+0000","last_unstale":"2023-12-24T18:49:06.764750+0000","last_undegraded":"2023-12-24T18:49:06.764750+0000","last_fullsized":"2023-12-24T18:49:06.764750+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:09.527569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.800937+0000","last_change":"2023-12-24T18:49:05.756368+0000","last_active":"2023-12-24T18:49:06.800937+0000","last_peered":"2023-12-24T18:49:06.800937+0000","last_clean":"2023-12-24T18:49:06.800937+0000","last_became_active":"2023-12-24T18:49:05.755741+0000","last_became_peered":"2023-12-24T18:49:05.755741+0000","last_unstale":"2023-12-24T18:49:06.800937+0000","last_undegraded":"2023-12-24T18:49:06.800937+0000","last_fullsized":"2023-12-24T18:49:06.800937+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:39.670814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.768182+0000","last_change":"2023-12-24T18:49:06.765230+0000","last_active":"2023-12-24T18:49:06.768182+0000","last_peered":"2023-12-24T18:49:06.768182+0000","last_clean":"2023-12-24T18:49:06.768182+0000","last_became_active":"2023-12-24T18:49:06.764886+0000","last_became_peered":"2023-12-24T18:49:06.764886+0000","last_unstale":"2023-12-24T18:49:06.768182+0000","last_undegraded":"2023-12-24T18:49:06.768182+0000","last_fullsized":"2023-12-24T18:49:06.768182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:30:06.124585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797774+0000","last_change":"2023-12-24T18:49:05.766160+0000","last_active":"2023-12-24T18:49:06.797774+0000","last_peered":"2023-12-24T18:49:06.797774+0000","last_clean":"2023-12-24T18:49:06.797774+0000","last_became_active":"2023-12-24T18:49:05.765051+0000","last_became_peered":"2023-12-24T18:49:05.765051+0000","last_unstale":"2023-12-24T18:49:06.797774+0000","last_undegraded":"2023-12-24T18:49:06.797774+0000","last_fullsized":"2023-12-24T18:49:06.797774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:57:29.909776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795787+0000","last_change":"2023-12-24T18:49:06.782791+0000","last_active":"2023-12-24T18:49:06.795787+0000","last_peered":"2023-12-24T18:49:06.795787+0000","last_clean":"2023-12-24T18:49:06.795787+0000","last_became_active":"2023-12-24T18:49:06.782512+0000","last_became_peered":"2023-12-24T18:49:06.782512+0000","last_unstale":"2023-12-24T18:49:06.795787+0000","last_undegraded":"2023-12-24T18:49:06.795787+0000","last_fullsized":"2023-12-24T18:49:06.795787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:26.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742976+0000","last_change":"2023-12-24T18:49:05.765847+0000","last_active":"2023-12-24T18:49:06.742976+0000","last_peered":"2023-12-24T18:49:06.742976+0000","last_clean":"2023-12-24T18:49:06.742976+0000","last_became_active":"2023-12-24T18:49:05.765469+0000","last_became_peered":"2023-12-24T18:49:05.765469+0000","last_unstale":"2023-12-24T18:49:06.742976+0000","last_undegraded":"2023-12-24T18:49:06.742976+0000","last_fullsized":"2023-12-24T18:49:06.742976+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:41:12.553169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.773360+0000","last_change":"2023-12-24T18:49:06.770197+0000","last_active":"2023-12-24T18:49:06.773360+0000","last_peered":"2023-12-24T18:49:06.773360+0000","last_clean":"2023-12-24T18:49:06.773360+0000","last_became_active":"2023-12-24T18:49:06.769893+0000","last_became_peered":"2023-12-24T18:49:06.769893+0000","last_unstale":"2023-12-24T18:49:06.773360+0000","last_undegraded":"2023-12-24T18:49:06.773360+0000","last_fullsized":"2023-12-24T18:49:06.773360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:42.191222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.752060+0000","last_change":"2023-12-24T18:49:05.751953+0000","last_active":"2023-12-24T18:49:06.752060+0000","last_peered":"2023-12-24T18:49:06.752060+0000","last_clean":"2023-12-24T18:49:06.752060+0000","last_became_active":"2023-12-24T18:49:05.751619+0000","last_became_peered":"2023-12-24T18:49:05.751619+0000","last_unstale":"2023-12-24T18:49:06.752060+0000","last_undegraded":"2023-12-24T18:49:06.752060+0000","last_fullsized":"2023-12-24T18:49:06.752060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:55.547954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798505+0000","last_change":"2023-12-24T18:49:06.790839+0000","last_active":"2023-12-24T18:49:06.798505+0000","last_peered":"2023-12-24T18:49:06.798505+0000","last_clean":"2023-12-24T18:49:06.798505+0000","last_became_active":"2023-12-24T18:49:06.787462+0000","last_became_peered":"2023-12-24T18:49:06.787462+0000","last_unstale":"2023-12-24T18:49:06.798505+0000","last_undegraded":"2023-12-24T18:49:06.798505+0000","last_fullsized":"2023-12-24T18:49:06.798505+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:26:02.198401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.783411+0000","last_change":"2023-12-24T18:49:05.754218+0000","last_active":"2023-12-24T18:49:06.783411+0000","last_peered":"2023-12-24T18:49:06.783411+0000","last_clean":"2023-12-24T18:49:06.783411+0000","last_became_active":"2023-12-24T18:49:05.753928+0000","last_became_peered":"2023-12-24T18:49:05.753928+0000","last_unstale":"2023-12-24T18:49:06.783411+0000","last_undegraded":"2023-12-24T18:49:06.783411+0000","last_fullsized":"2023-12-24T18:49:06.783411+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:48:49.416446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770468+0000","last_change":"2023-12-24T18:49:06.765378+0000","last_active":"2023-12-24T18:49:06.770468+0000","last_peered":"2023-12-24T18:49:06.770468+0000","last_clean":"2023-12-24T18:49:06.770468+0000","last_became_active":"2023-12-24T18:49:06.765061+0000","last_became_peered":"2023-12-24T18:49:06.765061+0000","last_unstale":"2023-12-24T18:49:06.770468+0000","last_undegraded":"2023-12-24T18:49:06.770468+0000","last_fullsized":"2023-12-24T18:49:06.770468+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:10:29.489693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.798580+0000","last_change":"2023-12-24T18:49:05.769576+0000","last_active":"2023-12-24T18:49:06.798580+0000","last_peered":"2023-12-24T18:49:06.798580+0000","last_clean":"2023-12-24T18:49:06.798580+0000","last_became_active":"2023-12-24T18:49:05.769212+0000","last_became_peered":"2023-12-24T18:49:05.769212+0000","last_unstale":"2023-12-24T18:49:06.798580+0000","last_undegraded":"2023-12-24T18:49:06.798580+0000","last_fullsized":"2023-12-24T18:49:06.798580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:50.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796324+0000","last_change":"2023-12-24T18:49:06.793760+0000","last_active":"2023-12-24T18:49:06.796324+0000","last_peered":"2023-12-24T18:49:06.796324+0000","last_clean":"2023-12-24T18:49:06.796324+0000","last_became_active":"2023-12-24T18:49:06.793485+0000","last_became_peered":"2023-12-24T18:49:06.793485+0000","last_unstale":"2023-12-24T18:49:06.796324+0000","last_undegraded":"2023-12-24T18:49:06.796324+0000","last_fullsized":"2023-12-24T18:49:06.796324+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:36.033114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.776192+0000","last_change":"2023-12-24T18:49:05.752516+0000","last_active":"2023-12-24T18:49:06.776192+0000","last_peered":"2023-12-24T18:49:06.776192+0000","last_clean":"2023-12-24T18:49:06.776192+0000","last_became_active":"2023-12-24T18:49:05.752183+0000","last_became_peered":"2023-12-24T18:49:05.752183+0000","last_unstale":"2023-12-24T18:49:06.776192+0000","last_undegraded":"2023-12-24T18:49:06.776192+0000","last_fullsized":"2023-12-24T18:49:06.776192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:24:31.209653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797362+0000","last_change":"2023-12-24T18:49:06.796399+0000","last_active":"2023-12-24T18:49:06.797362+0000","last_peered":"2023-12-24T18:49:06.797362+0000","last_clean":"2023-12-24T18:49:06.797362+0000","last_became_active":"2023-12-24T18:49:06.796007+0000","last_became_peered":"2023-12-24T18:49:06.796007+0000","last_unstale":"2023-12-24T18:49:06.797362+0000","last_undegraded":"2023-12-24T18:49:06.797362+0000","last_fullsized":"2023-12-24T18:49:06.797362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:51.297127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.787742+0000","last_change":"2023-12-24T18:49:05.766951+0000","last_active":"2023-12-24T18:49:06.787742+0000","last_peered":"2023-12-24T18:49:06.787742+0000","last_clean":"2023-12-24T18:49:06.787742+0000","last_became_active":"2023-12-24T18:49:05.766562+0000","last_became_peered":"2023-12-24T18:49:05.766562+0000","last_unstale":"2023-12-24T18:49:06.787742+0000","last_undegraded":"2023-12-24T18:49:06.787742+0000","last_fullsized":"2023-12-24T18:49:06.787742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:54.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.792494+0000","last_change":"2023-12-24T18:49:06.783702+0000","last_active":"2023-12-24T18:49:06.792494+0000","last_peered":"2023-12-24T18:49:06.792494+0000","last_clean":"2023-12-24T18:49:06.792494+0000","last_became_active":"2023-12-24T18:49:06.775926+0000","last_became_peered":"2023-12-24T18:49:06.775926+0000","last_unstale":"2023-12-24T18:49:06.792494+0000","last_undegraded":"2023-12-24T18:49:06.792494+0000","last_fullsized":"2023-12-24T18:49:06.792494+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:34.674863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.744178+0000","last_change":"2023-12-24T18:49:05.750637+0000","last_active":"2023-12-24T18:49:06.744178+0000","last_peered":"2023-12-24T18:49:06.744178+0000","last_clean":"2023-12-24T18:49:06.744178+0000","last_became_active":"2023-12-24T18:49:05.750340+0000","last_became_peered":"2023-12-24T18:49:05.750340+0000","last_unstale":"2023-12-24T18:49:06.744178+0000","last_undegraded":"2023-12-24T18:49:06.744178+0000","last_fullsized":"2023-12-24T18:49:06.744178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:24:31.209653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.762242+0000","last_change":"2023-12-24T18:49:06.761023+0000","last_active":"2023-12-24T18:49:06.762242+0000","last_peered":"2023-12-24T18:49:06.762242+0000","last_clean":"2023-12-24T18:49:06.762242+0000","last_became_active":"2023-12-24T18:49:06.760689+0000","last_became_peered":"2023-12-24T18:49:06.760689+0000","last_unstale":"2023-12-24T18:49:06.762242+0000","last_undegraded":"2023-12-24T18:49:06.762242+0000","last_fullsized":"2023-12-24T18:49:06.762242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:47.949611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796081+0000","last_change":"2023-12-24T18:49:05.762547+0000","last_active":"2023-12-24T18:49:06.796081+0000","last_peered":"2023-12-24T18:49:06.796081+0000","last_clean":"2023-12-24T18:49:06.796081+0000","last_became_active":"2023-12-24T18:49:05.762265+0000","last_became_peered":"2023-12-24T18:49:05.762265+0000","last_unstale":"2023-12-24T18:49:06.796081+0000","last_undegraded":"2023-12-24T18:49:06.796081+0000","last_fullsized":"2023-12-24T18:49:06.796081+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:55.547954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.765816+0000","last_change":"2023-12-24T18:49:06.758684+0000","last_active":"2023-12-24T18:49:06.765816+0000","last_peered":"2023-12-24T18:49:06.765816+0000","last_clean":"2023-12-24T18:49:06.765816+0000","last_became_active":"2023-12-24T18:49:06.758370+0000","last_became_peered":"2023-12-24T18:49:06.758370+0000","last_unstale":"2023-12-24T18:49:06.765816+0000","last_undegraded":"2023-12-24T18:49:06.765816+0000","last_fullsized":"2023-12-24T18:49:06.765816+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:45.326339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761049+0000","last_change":"2023-12-24T18:49:05.761664+0000","last_active":"2023-12-24T18:49:06.761049+0000","last_peered":"2023-12-24T18:49:06.761049+0000","last_clean":"2023-12-24T18:49:06.761049+0000","last_became_active":"2023-12-24T18:49:05.761336+0000","last_became_peered":"2023-12-24T18:49:05.761336+0000","last_unstale":"2023-12-24T18:49:06.761049+0000","last_undegraded":"2023-12-24T18:49:06.761049+0000","last_fullsized":"2023-12-24T18:49:06.761049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:44.425382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797586+0000","last_change":"2023-12-24T18:49:06.789374+0000","last_active":"2023-12-24T18:49:06.797586+0000","last_peered":"2023-12-24T18:49:06.797586+0000","last_clean":"2023-12-24T18:49:06.797586+0000","last_became_active":"2023-12-24T18:49:06.784653+0000","last_became_peered":"2023-12-24T18:49:06.784653+0000","last_unstale":"2023-12-24T18:49:06.797586+0000","last_undegraded":"2023-12-24T18:49:06.797586+0000","last_fullsized":"2023-12-24T18:49:06.797586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:42.191222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.781272+0000","last_change":"2023-12-24T18:49:05.769428+0000","last_active":"2023-12-24T18:49:06.781272+0000","last_peered":"2023-12-24T18:49:06.781272+0000","last_clean":"2023-12-24T18:49:06.781272+0000","last_became_active":"2023-12-24T18:49:05.769051+0000","last_became_peered":"2023-12-24T18:49:05.769051+0000","last_unstale":"2023-12-24T18:49:06.781272+0000","last_undegraded":"2023-12-24T18:49:06.781272+0000","last_fullsized":"2023-12-24T18:49:06.781272+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:07.079737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784915+0000","last_change":"2023-12-24T18:49:06.770072+0000","last_active":"2023-12-24T18:49:06.784915+0000","last_peered":"2023-12-24T18:49:06.784915+0000","last_clean":"2023-12-24T18:49:06.784915+0000","last_became_active":"2023-12-24T18:49:06.758556+0000","last_became_peered":"2023-12-24T18:49:06.758556+0000","last_unstale":"2023-12-24T18:49:06.784915+0000","last_undegraded":"2023-12-24T18:49:06.784915+0000","last_fullsized":"2023-12-24T18:49:06.784915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:15:04.303823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.742140+0000","last_change":"2023-12-24T18:49:05.751343+0000","last_active":"2023-12-24T18:49:06.742140+0000","last_peered":"2023-12-24T18:49:06.742140+0000","last_clean":"2023-12-24T18:49:06.742140+0000","last_became_active":"2023-12-24T18:49:05.750980+0000","last_became_peered":"2023-12-24T18:49:05.750980+0000","last_unstale":"2023-12-24T18:49:06.742140+0000","last_undegraded":"2023-12-24T18:49:06.742140+0000","last_fullsized":"2023-12-24T18:49:06.742140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:28.596586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.771709+0000","last_change":"2023-12-24T18:49:06.768340+0000","last_active":"2023-12-24T18:49:06.771709+0000","last_peered":"2023-12-24T18:49:06.771709+0000","last_clean":"2023-12-24T18:49:06.771709+0000","last_became_active":"2023-12-24T18:49:06.764824+0000","last_became_peered":"2023-12-24T18:49:06.764824+0000","last_unstale":"2023-12-24T18:49:06.771709+0000","last_undegraded":"2023-12-24T18:49:06.771709+0000","last_fullsized":"2023-12-24T18:49:06.771709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:35.283700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.796850+0000","last_change":"2023-12-24T18:49:05.769064+0000","last_active":"2023-12-24T18:49:06.796850+0000","last_peered":"2023-12-24T18:49:06.796850+0000","last_clean":"2023-12-24T18:49:06.796850+0000","last_became_active":"2023-12-24T18:49:05.768714+0000","last_became_peered":"2023-12-24T18:49:05.768714+0000","last_unstale":"2023-12-24T18:49:06.796850+0000","last_undegraded":"2023-12-24T18:49:06.796850+0000","last_fullsized":"2023-12-24T18:49:06.796850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:33:14.110840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.794434+0000","last_change":"2023-12-24T18:49:06.785909+0000","last_active":"2023-12-24T18:49:06.794434+0000","last_peered":"2023-12-24T18:49:06.794434+0000","last_clean":"2023-12-24T18:49:06.794434+0000","last_became_active":"2023-12-24T18:49:06.785610+0000","last_became_peered":"2023-12-24T18:49:06.785610+0000","last_unstale":"2023-12-24T18:49:06.794434+0000","last_undegraded":"2023-12-24T18:49:06.794434+0000","last_fullsized":"2023-12-24T18:49:06.794434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:32.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.750897+0000","last_change":"2023-12-24T18:49:05.754882+0000","last_active":"2023-12-24T18:49:06.750897+0000","last_peered":"2023-12-24T18:49:06.750897+0000","last_clean":"2023-12-24T18:49:06.750897+0000","last_became_active":"2023-12-24T18:49:05.753795+0000","last_became_peered":"2023-12-24T18:49:05.753795+0000","last_unstale":"2023-12-24T18:49:06.750897+0000","last_undegraded":"2023-12-24T18:49:06.750897+0000","last_fullsized":"2023-12-24T18:49:06.750897+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:41:16.161257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.763864+0000","last_change":"2023-12-24T18:49:06.759502+0000","last_active":"2023-12-24T18:49:06.763864+0000","last_peered":"2023-12-24T18:49:06.763864+0000","last_clean":"2023-12-24T18:49:06.763864+0000","last_became_active":"2023-12-24T18:49:06.759169+0000","last_became_peered":"2023-12-24T18:49:06.759169+0000","last_unstale":"2023-12-24T18:49:06.763864+0000","last_undegraded":"2023-12-24T18:49:06.763864+0000","last_fullsized":"2023-12-24T18:49:06.763864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:15.765483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.783822+0000","last_change":"2023-12-24T18:49:05.761769+0000","last_active":"2023-12-24T18:49:06.783822+0000","last_peered":"2023-12-24T18:49:06.783822+0000","last_clean":"2023-12-24T18:49:06.783822+0000","last_became_active":"2023-12-24T18:49:05.761447+0000","last_became_peered":"2023-12-24T18:49:05.761447+0000","last_unstale":"2023-12-24T18:49:06.783822+0000","last_undegraded":"2023-12-24T18:49:06.783822+0000","last_fullsized":"2023-12-24T18:49:06.783822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:35.018629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.795915+0000","last_change":"2023-12-24T18:49:06.792927+0000","last_active":"2023-12-24T18:49:06.795915+0000","last_peered":"2023-12-24T18:49:06.795915+0000","last_clean":"2023-12-24T18:49:06.795915+0000","last_became_active":"2023-12-24T18:49:06.792566+0000","last_became_peered":"2023-12-24T18:49:06.792566+0000","last_unstale":"2023-12-24T18:49:06.795915+0000","last_undegraded":"2023-12-24T18:49:06.795915+0000","last_fullsized":"2023-12-24T18:49:06.795915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:11.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761021+0000","last_change":"2023-12-24T18:49:05.756708+0000","last_active":"2023-12-24T18:49:06.761021+0000","last_peered":"2023-12-24T18:49:06.761021+0000","last_clean":"2023-12-24T18:49:06.761021+0000","last_became_active":"2023-12-24T18:49:05.755433+0000","last_became_peered":"2023-12-24T18:49:05.755433+0000","last_unstale":"2023-12-24T18:49:06.761021+0000","last_undegraded":"2023-12-24T18:49:06.761021+0000","last_fullsized":"2023-12-24T18:49:06.761021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:24:31.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.771970+0000","last_change":"2023-12-24T18:49:06.768964+0000","last_active":"2023-12-24T18:49:06.771970+0000","last_peered":"2023-12-24T18:49:06.771970+0000","last_clean":"2023-12-24T18:49:06.771970+0000","last_became_active":"2023-12-24T18:49:06.768700+0000","last_became_peered":"2023-12-24T18:49:06.768700+0000","last_unstale":"2023-12-24T18:49:06.771970+0000","last_undegraded":"2023-12-24T18:49:06.771970+0000","last_fullsized":"2023-12-24T18:49:06.771970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:36.492462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.761161+0000","last_change":"2023-12-24T18:49:05.765664+0000","last_active":"2023-12-24T18:49:06.761161+0000","last_peered":"2023-12-24T18:49:06.761161+0000","last_clean":"2023-12-24T18:49:06.761161+0000","last_became_active":"2023-12-24T18:49:05.765290+0000","last_became_peered":"2023-12-24T18:49:05.765290+0000","last_unstale":"2023-12-24T18:49:06.761161+0000","last_undegraded":"2023-12-24T18:49:06.761161+0000","last_fullsized":"2023-12-24T18:49:06.761161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:41.567404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.797605+0000","last_change":"2023-12-24T18:49:06.790092+0000","last_active":"2023-12-24T18:49:06.797605+0000","last_peered":"2023-12-24T18:49:06.797605+0000","last_clean":"2023-12-24T18:49:06.797605+0000","last_became_active":"2023-12-24T18:49:06.789664+0000","last_became_peered":"2023-12-24T18:49:06.789664+0000","last_unstale":"2023-12-24T18:49:06.797605+0000","last_undegraded":"2023-12-24T18:49:06.797605+0000","last_fullsized":"2023-12-24T18:49:06.797605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:28.074923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.744443+0000","last_change":"2023-12-24T18:49:05.747169+0000","last_active":"2023-12-24T18:49:06.744443+0000","last_peered":"2023-12-24T18:49:06.744443+0000","last_clean":"2023-12-24T18:49:06.744443+0000","last_became_active":"2023-12-24T18:49:05.746908+0000","last_became_peered":"2023-12-24T18:49:05.746908+0000","last_unstale":"2023-12-24T18:49:06.744443+0000","last_undegraded":"2023-12-24T18:49:06.744443+0000","last_fullsized":"2023-12-24T18:49:06.744443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:22.869279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770566+0000","last_change":"2023-12-24T18:49:06.764394+0000","last_active":"2023-12-24T18:49:06.770566+0000","last_peered":"2023-12-24T18:49:06.770566+0000","last_clean":"2023-12-24T18:49:06.770566+0000","last_became_active":"2023-12-24T18:49:06.764078+0000","last_became_peered":"2023-12-24T18:49:06.764078+0000","last_unstale":"2023-12-24T18:49:06.770566+0000","last_undegraded":"2023-12-24T18:49:06.770566+0000","last_fullsized":"2023-12-24T18:49:06.770566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:48:12.557713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.749435+0000","last_change":"2023-12-24T18:49:05.764778+0000","last_active":"2023-12-24T18:49:06.749435+0000","last_peered":"2023-12-24T18:49:06.749435+0000","last_clean":"2023-12-24T18:49:06.749435+0000","last_became_active":"2023-12-24T18:49:05.764257+0000","last_became_peered":"2023-12-24T18:49:05.764257+0000","last_unstale":"2023-12-24T18:49:06.749435+0000","last_undegraded":"2023-12-24T18:49:06.749435+0000","last_fullsized":"2023-12-24T18:49:06.749435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:23.564959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.770304+0000","last_change":"2023-12-24T18:49:06.767954+0000","last_active":"2023-12-24T18:49:06.770304+0000","last_peered":"2023-12-24T18:49:06.770304+0000","last_clean":"2023-12-24T18:49:06.770304+0000","last_became_active":"2023-12-24T18:49:06.763706+0000","last_became_peered":"2023-12-24T18:49:06.763706+0000","last_unstale":"2023-12-24T18:49:06.770304+0000","last_undegraded":"2023-12-24T18:49:06.770304+0000","last_fullsized":"2023-12-24T18:49:06.770304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:05.718593+0000","last_clean_scrub_stamp":"2023-12-24T18:49:05.718593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:50:48.932237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.784099+0000","last_change":"2023-12-24T18:49:05.761181+0000","last_active":"2023-12-24T18:49:06.784099+0000","last_peered":"2023-12-24T18:49:06.784099+0000","last_clean":"2023-12-24T18:49:06.784099+0000","last_became_active":"2023-12-24T18:49:05.760904+0000","last_became_peered":"2023-12-24T18:49:05.760904+0000","last_unstale":"2023-12-24T18:49:06.784099+0000","last_undegraded":"2023-12-24T18:49:06.784099+0000","last_fullsized":"2023-12-24T18:49:06.784099+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:49:04.704107+0000","last_clean_scrub_stamp":"2023-12-24T18:49:04.704107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:26.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":280,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-24T18:49:06.750984+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:49:06.750984+0000","last_peered":"2023-12-24T18:49:06.750984+0000","last_clean":"2023-12-24T18:49:06.750984+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:49:06.750984+0000","last_undegraded":"2023-12-24T18:49:06.750984+0000","last_fullsized":"2023-12-24T18:49:06.750984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306852,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064988,"statfs":{"total":96636764160,"available":96322547712,"internally_reserved":0,"allocated":1404928,"data_stored":986938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.159,"15min":1.179},"min":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.63700000000000001},"max":{"1min":1.5349999999999999,"5min":1.5780000000000001,"15min":2.4159999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.171,"15min":1.1859999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5309999999999999,"5min":1.5449999999999999,"15min":2.0710000000000002},"last":1.756}]},{"osd":1,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.669,"15min":1.669},"last":1.232},{"interface":"front","average":{"1min":1.151,"5min":1.194,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.472,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.222,"15min":1.206},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.704},"last":1.194},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2190000000000001,"15min":1.244},"min":{"1min":0.878,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.893},"last":1.3620000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.88300000000000001,"5min":0.85899999999999999,"15min":0.81899999999999995},"max":{"1min":1.605,"5min":1.7090000000000001,"15min":2.024},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.98599999999999999,"5min":0.874,"15min":0.83099999999999996},"max":{"1min":1.5569999999999999,"5min":1.7509999999999999,"15min":2.0590000000000002},"last":1.149}]},{"osd":4,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.149,"15min":1.2090000000000001},"min":{"1min":0.78500000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.694,"5min":1.7150000000000001,"15min":2.1099999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.242,"15min":1.292},"min":{"1min":0.93100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6040000000000001,"5min":1.79,"15min":1.9390000000000001},"last":1.645}]},{"osd":5,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.252,"15min":1.3149999999999999},"min":{"1min":1.0609999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.571,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3,"15min":1.3740000000000001},"min":{"1min":0.95399999999999996,"5min":0.93200000000000005,"15min":0.68600000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":2.403},"last":1.0940000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.375,"15min":1.4359999999999999},"min":{"1min":0.90700000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9450000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.397},{"interface":"front","average":{"1min":1.48,"5min":1.4119999999999999,"15min":1.4450000000000001},"min":{"1min":1.151,"5min":0.90400000000000003,"15min":0.90200000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":2.2069999999999999},"last":1.4350000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306272,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065568,"statfs":{"total":96636764160,"available":96323141632,"internally_reserved":0,"allocated":811008,"data_stored":397070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.25,"15min":1.2490000000000001},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.466,"5min":1.649,"15min":1.768},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.29,"15min":1.3240000000000001},"min":{"1min":0.999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.55,"5min":1.637,"15min":1.8200000000000001},"last":1.228}]},{"osd":1,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1539999999999999,"15min":1.1819999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1870000000000001,"15min":1.2050000000000001},"min":{"1min":0.80900000000000005,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.667,"5min":1.748,"15min":1.748},"last":1.1040000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.151,"15min":1.1639999999999999},"min":{"1min":0.92800000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4990000000000001,"5min":1.607,"15min":3.609},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2150000000000001,"15min":1.274},"min":{"1min":0.77800000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.794,"5min":1.794,"15min":2.0259999999999998},"last":0.93400000000000005}]},{"osd":3,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.266},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.5760000000000001,"5min":1.597,"15min":1.867},"last":0.997},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2569999999999999,"15min":1.28},"min":{"1min":1.0669999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.512,"5min":1.5580000000000001,"15min":3.8540000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1759999999999999,"15min":1.26},"min":{"1min":0.74199999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2050000000000001,"15min":1.3420000000000001},"min":{"1min":0.89100000000000001,"5min":0.66800000000000004,"15min":0.65200000000000002},"max":{"1min":2.012,"5min":2.012,"15min":3.0470000000000002},"last":0.90500000000000003}]},{"osd":5,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.2749999999999999},"min":{"1min":0.93200000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4630000000000001,"5min":1.6970000000000001,"15min":4.2779999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.329,"15min":1.3919999999999999},"min":{"1min":1.052,"5min":0.622,"15min":0.622},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":0.98199999999999998}]},{"osd":7,"last update":"Sun Dec 24 18:48:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.335,"15min":1.4419999999999999},"min":{"1min":1.0249999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.595,"5min":1.8069999999999999,"15min":4.4610000000000003},"last":1.155}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302168,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069672,"statfs":{"total":96636764160,"available":96327344128,"internally_reserved":0,"allocated":802816,"data_stored":396446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.181,"15min":1.171},"min":{"1min":0.68899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.752},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2889999999999999,"15min":1.3},"min":{"1min":0.85499999999999998,"5min":0.82499999999999996,"15min":0.72099999999999997},"max":{"1min":1.6120000000000001,"5min":1.7270000000000001,"15min":2.73},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.139,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.64700000000000002,"15min":0.63},"max":{"1min":1.623,"5min":1.651,"15min":1.8029999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.157,"15min":1.1180000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.514,"5min":1.655,"15min":1.655},"last":0.73199999999999998}]},{"osd":2,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.89500000000000002,"5min":0.88400000000000001,"15min":0.53900000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2410000000000001,"15min":1.2090000000000001},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.69999999999999996},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":1.651},"last":0.97999999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2669999999999999,"15min":1.268},"min":{"1min":0.93799999999999994,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.627,"5min":1.669,"15min":2.8159999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":1.0920000000000001,"5min":0.90400000000000003,"15min":0.83699999999999997},"max":{"1min":1.786,"5min":1.786,"15min":2.1389999999999998},"last":1.018}]},{"osd":4,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.133,"15min":1.1379999999999999},"min":{"1min":0.871,"5min":0.75900000000000001,"15min":0.50600000000000001},"max":{"1min":1.575,"5min":1.5900000000000001,"15min":2.202},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.2589999999999999,"15min":1.2669999999999999},"min":{"1min":0.91900000000000004,"5min":0.78200000000000003,"15min":0.58099999999999996},"max":{"1min":1.7529999999999999,"5min":1.839,"15min":1.859},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.2789999999999999,"15min":1.306},"min":{"1min":0.91700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7070000000000001,"5min":1.774,"15min":2.3959999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.321,"15min":1.3140000000000001},"min":{"1min":1.0900000000000001,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.724,"5min":1.724,"15min":2.6280000000000001},"last":0.876}]},{"osd":7,"last update":"Sun Dec 24 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.383,"15min":1.415},"min":{"1min":1.1020000000000001,"5min":0.872,"15min":0.872},"max":{"1min":1.7010000000000001,"5min":1.784,"15min":2.879},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.409,"15min":1.429},"min":{"1min":1.1639999999999999,"5min":0.76400000000000001,"15min":0.64600000000000002},"max":{"1min":1.8660000000000001,"5min":1.911,"15min":2.2429999999999999},"last":0.92700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302172,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069668,"statfs":{"total":96636764160,"available":96327340032,"internally_reserved":0,"allocated":806912,"data_stored":397000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1919999999999999,"15min":1.1679999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.514,"5min":1.589,"15min":1.6950000000000001},"last":1.121},{"interface":"front","average":{"1min":1.155,"5min":1.2470000000000001,"15min":1.2170000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.494,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2789999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1459999999999999,"15min":1.141},"min":{"1min":0.94499999999999995,"5min":0.79300000000000004,"15min":0.70699999999999996},"max":{"1min":1.472,"5min":1.591,"15min":1.9830000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.1160000000000001,"15min":1.109},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.48799999999999999},"max":{"1min":1.484,"5min":1.6080000000000001,"15min":1.7649999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2889999999999999,"15min":1.2709999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.5289999999999999,"5min":1.712,"15min":1.738},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.2969999999999999},"min":{"1min":0.93700000000000006,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6060000000000001,"5min":1.6479999999999999,"15min":1.7290000000000001},"last":1.1659999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.159,"15min":1.1439999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.534,"5min":1.587,"15min":1.736},"last":1.208},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.2669999999999999},"min":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.462,"5min":1.839,"15min":1.839},"last":1.0940000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.282,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.58099999999999996},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2629999999999999,"15min":1.28},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.5880000000000001,"5min":1.8129999999999999,"15min":2.3029999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2809999999999999,"15min":1.258},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.5940000000000001,"5min":1.881,"15min":1.881},"last":0.879},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.333,"15min":1.3180000000000001},"min":{"1min":0.90500000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8009999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:48:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.94399999999999995,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.6479999999999999,"5min":1.8680000000000001,"15min":2.161},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":1.085,"5min":0.84199999999999997,"15min":0.76600000000000001},"max":{"1min":1.667,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":398004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95799999999999996},"min":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.2,"5min":1.5800000000000001,"15min":1.5980000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.075,"15min":1.0269999999999999},"min":{"1min":0.84399999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.5549999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.026,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.63600000000000001,"15min":0.42999999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.589},"last":0.749},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.1899999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6180000000000001,"5min":1.677,"15min":1.7110000000000001},"last":1.508}]},{"osd":2,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.103},"min":{"1min":0.81899999999999995,"5min":0.68799999999999994,"15min":0.59499999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.1539999999999999,"15min":1.167},"min":{"1min":0.90500000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.875},"last":1.401}]},{"osd":4,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2529999999999999,"15min":1.2410000000000001},"min":{"1min":1.0489999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.669,"5min":1.7609999999999999,"15min":1.766},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.3360000000000001,"15min":1.349},"min":{"1min":1.125,"5min":0.97899999999999998,"15min":0.66300000000000003},"max":{"1min":1.6459999999999999,"5min":1.7210000000000001,"15min":1.9710000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.381,"15min":1.4099999999999999},"min":{"1min":1.081,"5min":1.0509999999999999,"15min":0.84299999999999997},"max":{"1min":1.837,"5min":1.837,"15min":2.1739999999999999},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.421,"15min":1.46},"min":{"1min":1.05,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.1539999999999999},"last":1.5920000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.4650000000000001,"15min":1.5089999999999999},"min":{"1min":1.153,"5min":1.0389999999999999,"15min":0.92200000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.2909999999999999},"last":1.653},{"interface":"front","average":{"1min":1.415,"5min":1.4099999999999999,"15min":1.429},"min":{"1min":1.1910000000000001,"5min":0.89500000000000002,"15min":0.84999999999999998},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":1.782}]},{"osd":7,"last update":"Sun Dec 24 18:48:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4510000000000001,"15min":1.48},"min":{"1min":1.1899999999999999,"5min":0.88300000000000001,"15min":0.79500000000000004},"max":{"1min":1.9490000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.8440000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5029999999999999,"15min":1.5189999999999999},"min":{"1min":1.294,"5min":1.0960000000000001,"15min":0.85799999999999998},"max":{"1min":1.887,"5min":1.887,"15min":2.3149999999999999},"last":1.3500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310372,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061468,"statfs":{"total":96636764160,"available":96318943232,"internally_reserved":0,"allocated":815104,"data_stored":397982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94399999999999995,"15min":0.96399999999999997},"min":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.36599999999999999},"max":{"1min":1.411,"5min":1.419,"15min":1.8420000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.081,"15min":1.1120000000000001},"min":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.442},"max":{"1min":1.464,"5min":1.486,"15min":2.1459999999999999},"last":1.282}]},{"osd":1,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.67400000000000004,"5min":0.59099999999999997,"15min":0.46200000000000002},"max":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.74},"last":0.999},{"interface":"front","average":{"1min":1.018,"5min":1.0609999999999999,"15min":1.0900000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.339,"5min":1.6020000000000001,"15min":1.774},"last":1.087}]},{"osd":3,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.147,"15min":1.1899999999999999},"min":{"1min":0.82899999999999996,"5min":0.56499999999999995,"15min":0.501},"max":{"1min":1.4370000000000001,"5min":1.5669999999999999,"15min":2.6579999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.143},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.59199999999999997},"max":{"1min":1.3640000000000001,"5min":1.5509999999999999,"15min":2.524},"last":1.1379999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3029999999999999,"15min":1.399},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.5740000000000001,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.286,"15min":1.3680000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.78400000000000003},"max":{"1min":1.611,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.327}]},{"osd":5,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.278,"15min":1.375},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.76600000000000001},"max":{"1min":1.629,"5min":1.6559999999999999,"15min":3.093},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.4370000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.613,"5min":1.762,"15min":3.0139999999999998},"last":1.4239999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.5},"min":{"1min":1.077,"5min":0.95299999999999996,"15min":0.73799999999999999},"max":{"1min":1.944,"5min":2.0019999999999998,"15min":3.589},"last":1.403},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3919999999999999,"15min":1.502},"min":{"1min":1.026,"5min":0.94399999999999995,"15min":0.82799999999999996},"max":{"1min":1.764,"5min":2.093,"15min":3.5129999999999999},"last":1.3109999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:48:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4490000000000001,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":2.044,"15min":3.242},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4670000000000001,"15min":1.5569999999999999},"min":{"1min":1.0569999999999999,"5min":1,"15min":0.81699999999999995},"max":{"1min":1.762,"5min":1.883,"15min":3.8029999999999999},"last":1.468}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302176,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069664,"statfs":{"total":96636764160,"available":96327335936,"internally_reserved":0,"allocated":811008,"data_stored":396606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.002,"15min":1.1000000000000001},"min":{"1min":0.76100000000000001,"5min":0.61799999999999999,"15min":0.51000000000000001},"max":{"1min":1.288,"5min":1.389,"15min":4.149},"last":1.099},{"interface":"front","average":{"1min":1.135,"5min":1.131,"15min":1.1879999999999999},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.58899999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":4.0830000000000002},"last":1.1759999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95599999999999996,"15min":1.0089999999999999},"min":{"1min":0.71799999999999997,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.3280000000000001,"5min":1.4770000000000001,"15min":3.7829999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.117,"15min":1.194},"min":{"1min":0.76700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.365}]},{"osd":3,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.258,"15min":1.339},"min":{"1min":1.0669999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.915,"5min":1.915,"15min":4.1849999999999996},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.099,"15min":1.1819999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.3160000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.23,"15min":1.3049999999999999},"min":{"1min":0.97399999999999998,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.6619999999999999,"5min":1.663,"15min":3.2629999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3919999999999999,"15min":1.498},"min":{"1min":1.024,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7350000000000001,"5min":1.79,"15min":4.1020000000000003},"last":1.6759999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.381,"15min":1.4830000000000001},"min":{"1min":1.0669999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.792,"5min":1.792,"15min":4.4009999999999998},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.349,"15min":1.4330000000000001},"min":{"1min":1.125,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6200000000000001,"5min":2.0089999999999999,"15min":2.637},"last":1.353}]},{"osd":6,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.486,"15min":1.589},"min":{"1min":1.153,"5min":1.097,"15min":0.90600000000000003},"max":{"1min":1.839,"5min":1.841,"15min":4.0229999999999997},"last":1.754},{"interface":"front","average":{"1min":1.52,"5min":1.4770000000000001,"15min":1.5700000000000001},"min":{"1min":1.113,"5min":1.0329999999999999,"15min":1.0109999999999999},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":4.4480000000000004},"last":1.8640000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:48:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.528,"15min":1.621},"min":{"1min":1.147,"5min":0.754,"15min":0.754},"max":{"1min":2.238,"5min":2.238,"15min":4.3470000000000004},"last":2.0790000000000002},{"interface":"front","average":{"1min":1.468,"5min":1.462,"15min":1.5269999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0149999999999999},"max":{"1min":1.726,"5min":2.1160000000000001,"15min":2.798},"last":1.704}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306852,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064988,"statfs":{"total":96636764160,"available":96322547712,"internally_reserved":0,"allocated":1404928,"data_stored":986870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.0049999999999999,"15min":1.0349999999999999},"min":{"1min":0.57799999999999996,"5min":0.51400000000000001,"15min":0.40799999999999997},"max":{"1min":1.5069999999999999,"5min":1.706,"15min":1.746},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.028,"15min":1.069},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.141,"15min":1.139},"min":{"1min":0.83899999999999997,"5min":0.70199999999999996,"15min":0.67400000000000004},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.1000000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.72499999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"max":{"1min":1.79,"5min":1.79,"15min":1.819},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.238,"15min":1.2709999999999999},"min":{"1min":0.91900000000000004,"5min":0.83299999999999996,"15min":0.53600000000000003},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.343,"15min":1.367},"min":{"1min":1.1259999999999999,"5min":0.875,"15min":0.71799999999999997},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.982},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2889999999999999,"15min":1.3300000000000001},"min":{"1min":1.0669999999999999,"5min":0.93500000000000005,"15min":0.78300000000000003},"max":{"1min":1.6140000000000001,"5min":1.762,"15min":1.762},"last":1.155}]},{"osd":5,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3839999999999999,"15min":1.444},"min":{"1min":0.96899999999999997,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.8120000000000001,"5min":1.952,"15min":2.391},"last":1.569},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4139999999999999,"15min":1.468},"min":{"1min":1.135,"5min":0.95499999999999996,"15min":0.66000000000000003},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.2410000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.339,"15min":1.431},"min":{"1min":1.117,"5min":0.88500000000000001,"15min":0.71499999999999997},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":2.0779999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.486,"15min":1.5409999999999999},"min":{"1min":1.056,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.1579999999999999,"5min":2.161,"15min":2.23},"last":1.4379999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:48:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.486,"15min":1.5529999999999999},"min":{"1min":1.1319999999999999,"5min":1.0780000000000001,"15min":0.67500000000000004},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4339999999999999,"15min":1.528},"min":{"1min":1.109,"5min":0.93200000000000005,"15min":0.92000000000000004},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.1870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:49:11.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:49:11.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:49:11.717 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-24T18:49:11.713+0000 7f2a2bcd7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:49:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.733+0000 7fcd404cd700 1 Processor -- start 2023-12-24T18:49:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.733+0000 7fcd404cd700 1 -- start start 2023-12-24T18:49:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.737+0000 7fcd404cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd380cf4d0 0x7fcd3806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.737+0000 7fcd404cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3806ae10 0x7fcd380cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.737+0000 7fcd404cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380cd680 con 0x7fcd380cf8a0 2023-12-24T18:49:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.737+0000 7fcd404cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd38159640 con 0x7fcd3806ae10 2023-12-24T18:49:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.737+0000 7fcd404cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380cca70 con 0x7fcd380cf4d0 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3806ae10 0x7fcd380cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3806ae10 0x7fcd380cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50898/0 (socket says 172.21.15.50:50898) 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3da68700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcd380cf8a0 0x7fcd3806a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60486/0 (socket says 172.21.15.50:60486) 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 -- 172.21.15.50:0/1693657412 learned_addr learned my addr 172.21.15.50:0/1693657412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3e269700 1 --2- 172.21.15.50:0/1693657412 >> v2:172.21.15.82:3300/0 conn(0x7fcd380cf4d0 0x7fcd3806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 -- 172.21.15.50:0/1693657412 >> v2:172.21.15.82:3300/0 conn(0x7fcd380cf4d0 msgr2=0x7fcd3806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 --2- 172.21.15.50:0/1693657412 >> v2:172.21.15.82:3300/0 conn(0x7fcd380cf4d0 0x7fcd3806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 -- 172.21.15.50:0/1693657412 >> v1:172.21.15.82:6789/0 conn(0x7fcd380cf8a0 legacy=0x7fcd3806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 -- 172.21.15.50:0/1693657412 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380ccd50 con 0x7fcd3806ae10 2023-12-24T18:49:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3d267700 1 -- 172.21.15.50:0/1693657412 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810240452 0 0) 0x7fcd380cd680 con 0x7fcd380cf8a0 2023-12-24T18:49:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3ea6a700 1 --2- 172.21.15.50:0/1693657412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3806ae10 0x7fcd380cdb10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcd38063780 tx=0x7fcd30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c9858037926321 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3d267700 1 -- 172.21.15.50:0/1693657412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000e070 con 0x7fcd3806ae10 2023-12-24T18:49:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3d267700 1 -- 172.21.15.50:0/1693657412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000ba20 con 0x7fcd3806ae10 2023-12-24T18:49:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd3d267700 1 -- 172.21.15.50:0/1693657412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300092e0 con 0x7fcd3806ae10 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd404cd700 1 -- 172.21.15.50:0/1693657412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3806ae10 msgr2=0x7fcd380cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.741+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1693657412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3806ae10 0x7fcd380cdb10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcd38063780 tx=0x7fcd30009840 comp rx=0 tx=0).stop 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- 172.21.15.50:0/1693657412 shutdown_connections 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1693657412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3806ae10 0x7fcd380cdb10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1693657412 >> v2:172.21.15.82:3300/0 conn(0x7fcd380cf4d0 0x7fcd3806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- 172.21.15.50:0/1693657412 >> 172.21.15.50:0/1693657412 conn(0x7fcd38067b30 msgr2=0x7fcd380cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- 172.21.15.50:0/1693657412 shutdown_connections 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- 172.21.15.50:0/1693657412 wait complete. 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 Processor -- start 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- start start 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd3806ae10 0x7fcd380cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 0x7fcd381580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cc4b0 con 0x7fcd380cf4d0 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3815b360 con 0x7fcd380cf8a0 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd404cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381696a0 con 0x7fcd3806ae10 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.745+0000 7fcd3da68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50906/0 (socket says 172.21.15.50:50906) 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 -- 172.21.15.50:0/1940877735 learned_addr learned my addr 172.21.15.50:0/1940877735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3e269700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd3806ae10 0x7fcd380cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3ea6a700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 0x7fcd381580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 -- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd3806ae10 msgr2=0x7fcd380cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd3806ae10 0x7fcd380cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 -- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 msgr2=0x7fcd381580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 0x7fcd381580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 -- 172.21.15.50:0/1940877735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30009ae0 con 0x7fcd380cf4d0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3ea6a700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 0x7fcd381580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd3da68700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800c510 tx=0x7fcd2800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28005a70 con 0x7fcd380cf4d0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28005bd0 con 0x7fcd380cf4d0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280070d0 con 0x7fcd380cf4d0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd38169980 con 0x7fcd380cf4d0 2023-12-24T18:49:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38159c50 con 0x7fcd380cf4d0 2023-12-24T18:49:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.749+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd380652e0 con 0x7fcd380cf4d0 2023-12-24T18:49:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.753+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcd28007480 con 0x7fcd380cf4d0 2023-12-24T18:49:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.753+0000 7fcd2e7fc700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.753+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fcd2807bf50 con 0x7fcd380cf4d0 2023-12-24T18:49:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.753+0000 7fcd3e269700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.757+0000 7fcd3e269700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 0x7fcd1c062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009db0 tx=0x7fcd340091a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.761+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd2804c200 con 0x7fcd380cf4d0 2023-12-24T18:49:11.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:11.989+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcd380cd030 con 0x7fcd380cf4d0 2023-12-24T18:49:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.001+0000 7fcd2e7fc700 1 -- 172.21.15.50:0/1940877735 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcd2804f820 con 0x7fcd380cf4d0 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 msgr2=0x7fcd1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 0x7fcd1c062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009db0 tx=0x7fcd340091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 msgr2=0x7fcd3815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800c510 tx=0x7fcd2800c820 comp rx=0 tx=0).stop 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 shutdown_connections 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd380cf8a0 0x7fcd381580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd380cf4d0 0x7fcd3815a450 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 --2- 172.21.15.50:0/1940877735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd3806ae10 0x7fcd380cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 >> 172.21.15.50:0/1940877735 conn(0x7fcd38067b30 msgr2=0x7fcd380cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 shutdown_connections 2023-12-24T18:49:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.005+0000 7fcd404cd700 1 -- 172.21.15.50:0/1940877735 wait complete. 2023-12-24T18:49:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:49:12.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:49:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.185+0000 7f5a7ae43700 1 Processor -- start 2023-12-24T18:49:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.185+0000 7f5a7ae43700 1 -- start start 2023-12-24T18:49:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7ae43700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a740ae100 0x7f5a74161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7ae43700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a7406c820 0x7f5a7406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7ae43700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7406c4d0 con 0x7f5a741611b0 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7ae43700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7406c1f0 con 0x7f5a740ae100 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7ae43700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740ab5e0 con 0x7f5a7406c820 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a740ae100 0x7f5a74161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a740ae100 0x7f5a74161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50918/0 (socket says 172.21.15.50:50918) 2023-12-24T18:49:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 -- 172.21.15.50:0/3302314999 learned_addr learned my addr 172.21.15.50:0/3302314999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a7a642700 1 --2- 172.21.15.50:0/3302314999 >> v2:172.21.15.82:3300/0 conn(0x7f5a7406c820 0x7f5a7406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 -- 172.21.15.50:0/3302314999 >> v2:172.21.15.82:3300/0 conn(0x7f5a7406c820 msgr2=0x7f5a7406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 --2- 172.21.15.50:0/3302314999 >> v2:172.21.15.82:3300/0 conn(0x7f5a7406c820 0x7f5a7406cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 -- 172.21.15.50:0/3302314999 >> v1:172.21.15.82:6789/0 conn(0x7f5a741611b0 legacy=0x7f5a7406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 -- 172.21.15.50:0/3302314999 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740ab8c0 con 0x7f5a740ae100 2023-12-24T18:49:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a79640700 1 --2- 172.21.15.50:0/3302314999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a740ae100 0x7f5a74161580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406c100 tx=0x7f5a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4418f02a721c783c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a78e3f700 1 -- 172.21.15.50:0/3302314999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64009e70 con 0x7f5a740ae100 2023-12-24T18:49:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a78e3f700 1 -- 172.21.15.50:0/3302314999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400b860 con 0x7f5a740ae100 2023-12-24T18:49:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.189+0000 7f5a78e3f700 1 -- 172.21.15.50:0/3302314999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400bc00 con 0x7f5a740ae100 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3302314999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a740ae100 msgr2=0x7f5a74161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3302314999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a740ae100 0x7f5a74161580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406c100 tx=0x7f5a64009250 comp rx=0 tx=0).stop 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3302314999 shutdown_connections 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3302314999 >> v2:172.21.15.82:3300/0 conn(0x7f5a7406c820 0x7f5a7406cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3302314999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a740ae100 0x7f5a74161580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3302314999 >> 172.21.15.50:0/3302314999 conn(0x7f5a74067b80 msgr2=0x7f5a740cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3302314999 shutdown_connections 2023-12-24T18:49:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3302314999 wait complete. 2023-12-24T18:49:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 Processor -- start 2023-12-24T18:49:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.193+0000 7f5a7ae43700 1 -- start start 2023-12-24T18:49:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a740ae100 0x7f5a7415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 0x7f5a7415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740b0cb0 con 0x7f5a7406c820 2023-12-24T18:49:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740b0f90 con 0x7f5a741611b0 2023-12-24T18:49:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740b1270 con 0x7f5a740ae100 2023-12-24T18:49:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50926/0 (socket says 172.21.15.50:50926) 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 -- 172.21.15.50:0/3348179711 learned_addr learned my addr 172.21.15.50:0/3348179711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7a642700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 0x7f5a7415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79640700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a740ae100 0x7f5a7415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 -- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a740ae100 msgr2=0x7f5a7415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a740ae100 0x7f5a7415bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 -- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 msgr2=0x7f5a7415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 0x7f5a7415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 -- 172.21.15.50:0/3348179711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640094f0 con 0x7f5a7406c820 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7a642700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 0x7f5a7415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a79e41700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000cb10 tx=0x7f5a700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000a760 con 0x7f5a7406c820 2023-12-24T18:49:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7000a8e0 con 0x7f5a7406c820 2023-12-24T18:49:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a740b1550 con 0x7f5a7406c820 2023-12-24T18:49:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.197+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000aca0 con 0x7f5a7406c820 2023-12-24T18:49:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.201+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740b0980 con 0x7f5a7406c820 2023-12-24T18:49:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.201+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7415ee10 con 0x7f5a7406c820 2023-12-24T18:49:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.201+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5a70003030 con 0x7f5a7406c820 2023-12-24T18:49:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.205+0000 7f5a69ffb700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 0x7f5a58062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.205+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f5a7007ca00 con 0x7f5a7406c820 2023-12-24T18:49:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.205+0000 7f5a79640700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 0x7f5a58062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.205+0000 7f5a79640700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 0x7f5a58062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406c100 tx=0x7f5a64017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.209+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a7004cd50 con 0x7f5a7406c820 2023-12-24T18:49:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.417+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a7406c4d0 con 0x7f5a7406c820 2023-12-24T18:49:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a69ffb700 1 -- 172.21.15.50:0/3348179711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5a7406c4d0 con 0x7f5a7406c820 2023-12-24T18:49:12.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:12.423 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:49:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 msgr2=0x7f5a58062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 0x7f5a58062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406c100 tx=0x7f5a64017000 comp rx=0 tx=0).stop 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 msgr2=0x7f5a74150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000cb10 tx=0x7f5a700017b0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 shutdown_connections 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f5a58060550 0x7f5a58062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a741611b0 0x7f5a7415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a740ae100 0x7f5a7415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 --2- 172.21.15.50:0/3348179711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7406c820 0x7f5a74150a90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.421+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 >> 172.21.15.50:0/3348179711 conn(0x7f5a74067b80 msgr2=0x7f5a7406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.425+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 shutdown_connections 2023-12-24T18:49:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:12.425+0000 7f5a7ae43700 1 -- 172.21.15.50:0/3348179711 wait complete. 2023-12-24T18:49:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:49:12.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:49:06.170593+0000', 'modified': '2023-12-24T18:49:09.777673+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5884': {'gid': 5884, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6836/3415246966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3415246966}, {'type': 'v1', 'addr': '172.21.15.50:6836', 'nonce': 3415246966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:49:12.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:49:12.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T18:49:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.017+0000 7f341fe2e700 1 Processor -- start 2023-12-24T18:49:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.017+0000 7f341fe2e700 1 -- start start 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34180ca3a0 0x7f34180ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f341806ae10 0x7f341815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f341806b290 0x7f341815af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180c6980 con 0x7f341806ae10 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341806ca50 con 0x7f34180ca3a0 2023-12-24T18:49:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341fe2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341806b7f0 con 0x7f341806b290 2023-12-24T18:49:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f341806ae10 0x7f341815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f341806ae10 0x7f341815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50942/0 (socket says 172.21.15.50:50942) 2023-12-24T18:49:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 -- 172.21.15.50:0/3587870344 learned_addr learned my addr 172.21.15.50:0/3587870344 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341e3cb700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f341806b290 0x7f341815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341dbca700 1 --2- 172.21.15.50:0/3587870344 >> v2:172.21.15.82:3300/0 conn(0x7f34180ca3a0 0x7f34180ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 -- 172.21.15.50:0/3587870344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f341806b290 msgr2=0x7f341815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f341806b290 0x7f341815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 -- 172.21.15.50:0/3587870344 >> v2:172.21.15.82:3300/0 conn(0x7f34180ca3a0 msgr2=0x7f34180ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 --2- 172.21.15.50:0/3587870344 >> v2:172.21.15.82:3300/0 conn(0x7f34180ca3a0 0x7f34180ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 -- 172.21.15.50:0/3587870344 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341806bad0 con 0x7f341806ae10 2023-12-24T18:49:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.021+0000 7f341d3c9700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815aa50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3418069ce0 tx=0x7f3408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f2297fbb52afa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341cbc8700 1 -- 172.21.15.50:0/3587870344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800b640 con 0x7f341806ae10 2023-12-24T18:49:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341cbc8700 1 -- 172.21.15.50:0/3587870344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800b7a0 con 0x7f341806ae10 2023-12-24T18:49:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341cbc8700 1 -- 172.21.15.50:0/3587870344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800bb40 con 0x7f341806ae10 2023-12-24T18:49:13.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 -- 172.21.15.50:0/3587870344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 msgr2=0x7f341815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815aa50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3418069ce0 tx=0x7f3408009250 comp rx=0 tx=0).stop 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 -- 172.21.15.50:0/3587870344 shutdown_connections 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f341806b290 0x7f341815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 --2- 172.21.15.50:0/3587870344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815aa50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 --2- 172.21.15.50:0/3587870344 >> v2:172.21.15.82:3300/0 conn(0x7f34180ca3a0 0x7f34180ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 -- 172.21.15.50:0/3587870344 >> 172.21.15.50:0/3587870344 conn(0x7f34180cbba0 msgr2=0x7f34180cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 -- 172.21.15.50:0/3587870344 shutdown_connections 2023-12-24T18:49:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.025+0000 7f341fe2e700 1 -- 172.21.15.50:0/3587870344 wait complete. 2023-12-24T18:49:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 Processor -- start 2023-12-24T18:49:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 -- start start 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 0x7f341815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34180ca3a0 0x7f341815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341816dab0 con 0x7f341806ae10 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341816dd50 con 0x7f341806b290 2023-12-24T18:49:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341fe2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341816e030 con 0x7f34180ca3a0 2023-12-24T18:49:13.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50946/0 (socket says 172.21.15.50:50946) 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 -- 172.21.15.50:0/4210069013 learned_addr learned my addr 172.21.15.50:0/4210069013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341d3c9700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 0x7f341815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341e3cb700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34180ca3a0 0x7f341815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 -- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34180ca3a0 msgr2=0x7f341815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34180ca3a0 0x7f341815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 -- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 msgr2=0x7f341815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 0x7f341815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 -- 172.21.15.50:0/4210069013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080094f0 con 0x7f341806ae10 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341d3c9700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 0x7f341815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:13.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.029+0000 7f341dbca700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f341400ec80 tx=0x7f34140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f340dffb700 1 -- 172.21.15.50:0/4210069013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400c9d0 con 0x7f341806ae10 2023-12-24T18:49:13.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f340dffb700 1 -- 172.21.15.50:0/4210069013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400cb30 con 0x7f341806ae10 2023-12-24T18:49:13.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341816e310 con 0x7f341806ae10 2023-12-24T18:49:13.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f340dffb700 1 -- 172.21.15.50:0/4210069013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414013470 con 0x7f341806ae10 2023-12-24T18:49:13.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341815fb80 con 0x7f341806ae10 2023-12-24T18:49:13.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.033+0000 7f340dffb700 1 -- 172.21.15.50:0/4210069013 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3414013820 con 0x7f341806ae10 2023-12-24T18:49:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f340dffb700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 0x7f33fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f340dffb700 1 -- 172.21.15.50:0/4210069013 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f341407cdf0 con 0x7f341806ae10 2023-12-24T18:49:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f341d3c9700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 0x7f33fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f341d3c9700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 0x7f33fc062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3418069ce0 tx=0x7f3408017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f34220ba740 1 Processor -- start 2023-12-24T18:49:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.037+0000 7f34220ba740 1 -- start start 2023-12-24T18:49:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x25bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x25bc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e9f30 con 0x2389790 2023-12-24T18:49:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e5ed0 con 0x233eae0 2023-12-24T18:49:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x24ac0b0 con 0x233e710 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50956/0 (socket says 172.21.15.50:50956) 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 -- 172.21.15.50:0/1273791179 learned_addr learned my addr 172.21.15.50:0/1273791179 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341dbca700 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x25bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341d3c9700 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x25bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 -- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 msgr2=0x25bc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x25bc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 -- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 msgr2=0x25bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x25bbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 -- 172.21.15.50:0/1273791179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x238a9e0 con 0x2389790 2023-12-24T18:49:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f341e3cb700 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3410007610 tx=0x7f341000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730d2097797ab08d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f3402ffd700 1 -- 172.21.15.50:0/1273791179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000e030 con 0x2389790 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f3402ffd700 1 -- 172.21.15.50:0/1273791179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410007e40 con 0x2389790 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f3402ffd700 1 -- 172.21.15.50:0/1273791179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410015850 con 0x2389790 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- 172.21.15.50:0/1273791179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 msgr2=0x25bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3410007610 tx=0x7f341000b040 comp rx=0 tx=0).stop 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- 172.21.15.50:0/1273791179 shutdown_connections 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25bc980 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x25bc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 --2- 172.21.15.50:0/1273791179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x25bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- 172.21.15.50:0/1273791179 >> 172.21.15.50:0/1273791179 conn(0x233eeb0 msgr2=0x2578930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- 172.21.15.50:0/1273791179 shutdown_connections 2023-12-24T18:49:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.041+0000 7f34220ba740 1 -- 172.21.15.50:0/1273791179 wait complete. 2023-12-24T18:49:13.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 -- start start 2023-12-24T18:49:13.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 Processor -- start 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x25c0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x25c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x24abd50 con 0x2389790 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2484970 con 0x233e710 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2535480 con 0x233eae0 2023-12-24T18:49:13.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f34220ba740 10 client.0 _ll_register_callbacks cb 0x252f6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:49:13.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50964/0 (socket says 172.21.15.50:50964) 2023-12-24T18:49:13.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f341e3cb700 1 -- 172.21.15.50:0/3664198954 learned_addr learned my addr 172.21.15.50:0/3664198954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f341dbca700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x25c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.045+0000 7f341d3c9700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x25c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 -- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 msgr2=0x25c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x25c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 -- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 msgr2=0x25c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x25c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 -- 172.21.15.50:0/3664198954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3410007340 con 0x2389790 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341dbca700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x25c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341e3cb700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3410015930 tx=0x7f341001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91087326bf609e96 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341001f8a0 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f341000f070 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2484cc0 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3410007000 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 10 client.5988 fetch_fsmap learned FSMap version 26 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x24b4370 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2484cc0 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3410014070 con 0x2389790 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 10 client.5988 fetch_fsmap finished waiting for FSMap version 26 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 10 client.5988 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 20 client.5988 populate_metadata read hostname 'smithi050' 2023-12-24T18:49:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x25a3370 0x25cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 4 client.5988 mds_command: new command op to 5884 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 --> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x24883e0 con 0x25a3370 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341dbca700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x25a3370 0x25cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f33f7fff700 10 client.5988 ms_handle_connect on v2:172.21.15.50:6834/3415246966 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.049+0000 7f341dbca700 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x25a3370 0x25cb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fedf72660437d37 server_cookie=8def864398f3b725 in_seq=0 out_seq=0 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f33f7fff700 1 -- 172.21.15.50:0/3664198954 <== mds.0 v2:172.21.15.50:6834/3415246966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x24883e0 con 0x25a3370 2023-12-24T18:49:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f33f7fff700 10 client.5988 handle_command_reply: tid=0 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 client.5988 shutdown 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 msgr2=0x25a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3410015930 tx=0x7f341001b000 comp rx=0 tx=0).stop 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 shutdown_connections 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x25a3370 0x25cb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x25a1cb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x25c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f33f7fff700 0 client.5988 ms_handle_reset on v2:172.21.15.50:6834/3415246966 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 --2- 172.21.15.50:0/3664198954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x25c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 >> 172.21.15.50:0/3664198954 conn(0x233eeb0 msgr2=0x2570f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 shutdown_connections 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 1 -- 172.21.15.50:0/3664198954 wait complete. 2023-12-24T18:49:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.053+0000 7f34220ba740 20 client.5988 trim_cache size 0 max 16384 2023-12-24T18:49:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 Processor -- start 2023-12-24T18:49:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 -- start start 2023-12-24T18:49:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x2576500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x2576a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x23bb650 con 0x2389790 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x24af400 con 0x233eae0 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.073+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x24e3890 con 0x233e710 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x2576a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50966/0 (socket says 172.21.15.50:50966) 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341e3cb700 1 -- 172.21.15.50:0/1434133633 learned_addr learned my addr 172.21.15.50:0/1434133633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341dbca700 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x2576500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 -- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 msgr2=0x2576500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x2576500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 -- 172.21.15.50:0/1434133633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 msgr2=0x2576f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 -- 172.21.15.50:0/1434133633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x249ad80 con 0x233eae0 2023-12-24T18:49:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341e3cb700 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f341d3c9700 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x2576a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34180cccb0 tx=0x7f3408020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00becc37d9d3cc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f34037fe700 1 -- 172.21.15.50:0/1434133633 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340802e070 con 0x233eae0 2023-12-24T18:49:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f34037fe700 1 -- 172.21.15.50:0/1434133633 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340801a800 con 0x233eae0 2023-12-24T18:49:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.077+0000 7f34037fe700 1 -- 172.21.15.50:0/1434133633 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408020070 con 0x233eae0 2023-12-24T18:49:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 msgr2=0x2576a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x2576a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34180cccb0 tx=0x7f3408020000 comp rx=0 tx=0).stop 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- 172.21.15.50:0/1434133633 shutdown_connections 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x2576f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233eae0 0x2576a40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 --2- 172.21.15.50:0/1434133633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233e710 0x2576500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- 172.21.15.50:0/1434133633 >> 172.21.15.50:0/1434133633 conn(0x233eeb0 msgr2=0x2570f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- 172.21.15.50:0/1434133633 shutdown_connections 2023-12-24T18:49:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- 172.21.15.50:0/1434133633 wait complete. 2023-12-24T18:49:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 -- start start 2023-12-24T18:49:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.081+0000 7f34220ba740 1 Processor -- start 2023-12-24T18:49:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x26153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x2615930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2494c90 con 0x2389790 2023-12-24T18:49:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e99d0 con 0x233e710 2023-12-24T18:49:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x24eaef0 con 0x233eae0 2023-12-24T18:49:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 10 client.0 _ll_register_callbacks cb 0x230a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:49:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50970/0 (socket says 172.21.15.50:50970) 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 -- 172.21.15.50:0/692537480 learned_addr learned my addr 172.21.15.50:0/692537480 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341d3c9700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x2615930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341dbca700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x26153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 -- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 msgr2=0x2615930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x2615930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 -- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 msgr2=0x26153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x26153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 -- 172.21.15.50:0/692537480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24b4370 con 0x2389790 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f341e3cb700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3410015760 tx=0x7f341000b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612b73a9d2c0d769 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f33f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000e040 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34180b0340 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f3410028650 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3410007000 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 10 client.5994 fetch_fsmap learned FSMap version 26 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.085+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x7f341806bad0 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180b0340 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3410028a20 con 0x2389790 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 10 client.5994 fetch_fsmap finished waiting for FSMap version 26 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 10 client.5994 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 20 client.5994 populate_metadata read hostname 'smithi050' 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x259cc70 0x259d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 4 client.5994 mds_command: new command op to 5884 tid=0[{"prefix": "status"}] 2023-12-24T18:49:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 --> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3410007e40 con 0x259cc70 2023-12-24T18:49:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f341dbca700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x259cc70 0x259d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 10 client.5994 ms_handle_connect on v2:172.21.15.50:6834/3415246966 2023-12-24T18:49:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f341dbca700 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x259cc70 0x259d040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48655c6d4b99cf5d server_cookie=8640d6fcfcc3f163 in_seq=0 out_seq=0 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 1 -- 172.21.15.50:0/692537480 <== mds.0 v2:172.21.15.50:6834/3415246966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f3410007e40 con 0x259cc70 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 10 client.5994 handle_command_reply: tid=0 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 client.5994 shutdown 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 msgr2=0x259c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3410015760 tx=0x7f341000b070 comp rx=0 tx=0).stop 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 shutdown_connections 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:6834/3415246966,v1:172.21.15.50:6836/3415246966] conn(0x259cc70 0x259d040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2389790 0x259c730 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f33f7fff700 0 client.5994 ms_handle_reset on v2:172.21.15.50:6834/3415246966 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x233eae0 0x2615930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 --2- 172.21.15.50:0/692537480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x233e710 0x26153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 >> 172.21.15.50:0/692537480 conn(0x233eeb0 msgr2=0x2573360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 shutdown_connections 2023-12-24T18:49:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 1 -- 172.21.15.50:0/692537480 wait complete. 2023-12-24T18:49:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.089+0000 7f34220ba740 20 client.5994 trim_cache size 0 max 16384 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5884, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.3365976960000001, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 67, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 67, 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.251301636999999 2023-12-24T18:49:13.095 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 msgr2=0x7f33fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 0x7f33fc062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3418069ce0 tx=0x7f3408017000 comp rx=0 tx=0).stop 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 msgr2=0x7f341815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f341400ec80 tx=0x7f34140091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 shutdown_connections 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f33fc060580 0x7f33fc062a30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34180ca3a0 0x7f341815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f341806b290 0x7f341815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 --2- 172.21.15.50:0/4210069013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f341806ae10 0x7f341815f640 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 >> 172.21.15.50:0/4210069013 conn(0x7f34180cbba0 msgr2=0x7f3418157970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 shutdown_connections 2023-12-24T18:49:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.093+0000 7f341fe2e700 1 -- 172.21.15.50:0/4210069013 wait complete. 2023-12-24T18:49:13.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:49:13.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.285+0000 7fe361c2e700 1 Processor -- start 2023-12-24T18:49:13.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.285+0000 7fe361c2e700 1 -- start start 2023-12-24T18:49:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe361c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 0x7fe35c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe361c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c06c820 con 0x7fe35c154b60 2023-12-24T18:49:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe361c2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c06b960 con 0x7fe35c0c6d00 2023-12-24T18:49:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe361c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c06bc40 con 0x7fe35c06dcc0 2023-12-24T18:49:13.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe352ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe35c154b60 0x7fe35c06aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54756/0 (socket says 172.21.15.50:54756) 2023-12-24T18:49:13.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe352ffd700 1 -- 172.21.15.50:0/4045836050 learned_addr learned my addr 172.21.15.50:0/4045836050 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:13.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35bfff700 1 --2- 172.21.15.50:0/4045836050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 0x7fe35c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385340563 0 0) 0x7fe35c06c820 con 0x7fe35c154b60 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe348003570 con 0x7fe35c154b60 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639236646 0 0) 0x7fe35c06b960 con 0x7fe35c0c6d00 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe35c06c820 con 0x7fe35c0c6d00 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35bfff700 1 -- 172.21.15.50:0/4045836050 >> v1:172.21.15.82:6789/0 conn(0x7fe35c0c6d00 legacy=0x7fe35c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35bfff700 1 -- 172.21.15.50:0/4045836050 >> v1:172.21.15.50:6789/0 conn(0x7fe35c154b60 legacy=0x7fe35c06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35bfff700 1 -- 172.21.15.50:0/4045836050 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c06bf20 con 0x7fe35c06dcc0 2023-12-24T18:49:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35bfff700 1 --2- 172.21.15.50:0/4045836050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 0x7fe35c0c70d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe354009e90 tx=0x7fe354009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8341f8a3b34fdbf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400e070 con 0x7fe35c06dcc0 2023-12-24T18:49:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35400bb80 con 0x7fe35c06dcc0 2023-12-24T18:49:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.289+0000 7fe35affd700 1 -- 172.21.15.50:0/4045836050 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354012430 con 0x7fe35c06dcc0 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 -- 172.21.15.50:0/4045836050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 msgr2=0x7fe35c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 --2- 172.21.15.50:0/4045836050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 0x7fe35c0c70d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe354009e90 tx=0x7fe354009780 comp rx=0 tx=0).stop 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 -- 172.21.15.50:0/4045836050 shutdown_connections 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 --2- 172.21.15.50:0/4045836050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c06dcc0 0x7fe35c0c70d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 -- 172.21.15.50:0/4045836050 >> 172.21.15.50:0/4045836050 conn(0x7fe35c0cbba0 msgr2=0x7fe35c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 -- 172.21.15.50:0/4045836050 shutdown_connections 2023-12-24T18:49:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 -- 172.21.15.50:0/4045836050 wait complete. 2023-12-24T18:49:13.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.293+0000 7fe361c2e700 1 Processor -- start 2023-12-24T18:49:13.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 -- start start 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c0c6d00 0x7fe35c16a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 0x7fe35c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c168820 con 0x7fe35c06dcc0 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c16ac30 con 0x7fe35c154b60 2023-12-24T18:49:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe361c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0c4da0 con 0x7fe35c0c6d00 2023-12-24T18:49:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50984/0 (socket says 172.21.15.50:50984) 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 -- 172.21.15.50:0/1399498527 learned_addr learned my addr 172.21.15.50:0/1399498527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe352ffd700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c0c6d00 0x7fe35c16a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35bfff700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 0x7fe35c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 -- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c0c6d00 msgr2=0x7fe35c16a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c0c6d00 0x7fe35c16a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 -- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 msgr2=0x7fe35c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 0x7fe35c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 -- 172.21.15.50:0/1399498527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354009a20 con 0x7fe35c06dcc0 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35bfff700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 0x7fe35c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.297+0000 7fe35b7fe700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c790 tx=0x7fe34c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c010510 con 0x7fe35c06dcc0 2023-12-24T18:49:13.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c010670 con 0x7fe35c06dcc0 2023-12-24T18:49:13.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c010a30 con 0x7fe35c06dcc0 2023-12-24T18:49:13.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c0c5080 con 0x7fe35c06dcc0 2023-12-24T18:49:13.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c0c5640 con 0x7fe35c06dcc0 2023-12-24T18:49:13.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.301+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c0652e0 con 0x7fe35c06dcc0 2023-12-24T18:49:13.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.305+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe34c01b3b0 con 0x7fe35c06dcc0 2023-12-24T18:49:13.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.305+0000 7fe353fff700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 0x7fe33c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:13.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.305+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fe34c07c340 con 0x7fe35c06dcc0 2023-12-24T18:49:13.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.305+0000 7fe352ffd700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 0x7fe33c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:13.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.305+0000 7fe352ffd700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 0x7fe33c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe35c165490 tx=0x7fe344009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:13.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.313+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe34c04c690 con 0x7fe35c06dcc0 2023-12-24T18:49:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.529+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe35c06c200 con 0x7fe35c06dcc0 2023-12-24T18:49:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.529+0000 7fe353fff700 1 -- 172.21.15.50:0/1399498527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe34c017070 con 0x7fe35c06dcc0 2023-12-24T18:49:13.533 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 msgr2=0x7fe33c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 0x7fe33c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe35c165490 tx=0x7fe344009040 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 msgr2=0x7fe35c1682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c790 tx=0x7fe34c007e10 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 shutdown_connections 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe33c060580 0x7fe33c062a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe35c154b60 0x7fe35c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe35c0c6d00 0x7fe35c16a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 --2- 172.21.15.50:0/1399498527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe35c06dcc0 0x7fe35c1682e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 >> 172.21.15.50:0/1399498527 conn(0x7fe35c0cbba0 msgr2=0x7fe35c154220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 shutdown_connections 2023-12-24T18:49:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:13.533+0000 7fe361c2e700 1 -- 172.21.15.50:0/1399498527 wait complete. 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:49:13.556 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:49:13.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.556 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.578 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41657sec preferred_lft 41657sec 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:49:13.580 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.581 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:49:13.581 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:49:13.581 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:49:13.581 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:49:13.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.583 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:49:13.665 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:49:13.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.668 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:49:13.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.731 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:49:13.732 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:49:13.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:49:13.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:49:13.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:49:13.732 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:49:13.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.863 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:49:13.883 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:49:13.883 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:49:13.884 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:49:13.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:13.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:49:13.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:49:13.966 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:49:14.028 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:49:14.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:49:14.028 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:49:14.086 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:49:14.086 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:49:14.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:49:14.216 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:49:14.217 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:49:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:49:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:49:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:49:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:49:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:49:14.245 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:49:14.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:49:14.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:49:14.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:49:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.485+0000 7f720c745700 1 Processor -- start 2023-12-24T18:49:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.485+0000 7f720c745700 1 -- start start 2023-12-24T18:49:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7204159bc0 0x7f7204159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f720406bce0 0x7f72040aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72040ab040 0x7f72040ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720406b850 con 0x7f720406bce0 2023-12-24T18:49:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720406ac40 con 0x7f7204159bc0 2023-12-24T18:49:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720c745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720406af20 con 0x7f72040ab040 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f720406bce0 0x7f72040aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f720406bce0 0x7f72040aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50986/0 (socket says 172.21.15.50:50986) 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 -- 172.21.15.50:0/55489126 learned_addr learned my addr 172.21.15.50:0/55489126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720ace2700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72040ab040 0x7f72040ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f720a4e1700 1 --2- 172.21.15.50:0/55489126 >> v2:172.21.15.82:3300/0 conn(0x7f7204159bc0 0x7f7204159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 -- 172.21.15.50:0/55489126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72040ab040 msgr2=0x7f72040ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72040ab040 0x7f72040ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 -- 172.21.15.50:0/55489126 >> v2:172.21.15.82:3300/0 conn(0x7f7204159bc0 msgr2=0x7f7204159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 --2- 172.21.15.50:0/55489126 >> v2:172.21.15.82:3300/0 conn(0x7f7204159bc0 0x7f7204159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 -- 172.21.15.50:0/55489126 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720406b200 con 0x7f720406bce0 2023-12-24T18:49:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.489+0000 7f7209ce0700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720406bce0 0x7f72040aab00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7204069ce0 tx=0x7f71f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fd3cd1ef56cbd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f72094df700 1 -- 172.21.15.50:0/55489126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400b640 con 0x7f720406bce0 2023-12-24T18:49:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f72094df700 1 -- 172.21.15.50:0/55489126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f400b7a0 con 0x7f720406bce0 2023-12-24T18:49:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f72094df700 1 -- 172.21.15.50:0/55489126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400bb60 con 0x7f720406bce0 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 -- 172.21.15.50:0/55489126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720406bce0 msgr2=0x7f72040aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720406bce0 0x7f72040aab00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7204069ce0 tx=0x7f71f4009250 comp rx=0 tx=0).stop 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 -- 172.21.15.50:0/55489126 shutdown_connections 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72040ab040 0x7f72040ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 --2- 172.21.15.50:0/55489126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720406bce0 0x7f72040aab00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 --2- 172.21.15.50:0/55489126 >> v2:172.21.15.82:3300/0 conn(0x7f7204159bc0 0x7f7204159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 -- 172.21.15.50:0/55489126 >> 172.21.15.50:0/55489126 conn(0x7f72040cbba0 msgr2=0x7f72040cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 -- 172.21.15.50:0/55489126 shutdown_connections 2023-12-24T18:49:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 -- 172.21.15.50:0/55489126 wait complete. 2023-12-24T18:49:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.493+0000 7f720c745700 1 Processor -- start 2023-12-24T18:49:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 -- start start 2023-12-24T18:49:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f720406bce0 0x7f72040c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 0x7f7204141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041523a0 con 0x7f72040ab040 2023-12-24T18:49:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72040c7330 con 0x7f7204159bc0 2023-12-24T18:49:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72040c75d0 con 0x7f720406bce0 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50988/0 (socket says 172.21.15.50:50988) 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 -- 172.21.15.50:0/2472879358 learned_addr learned my addr 172.21.15.50:0/2472879358 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720a4e1700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f720406bce0 0x7f72040c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720ace2700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 0x7f7204141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 -- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f720406bce0 msgr2=0x7f72040c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f720406bce0 0x7f72040c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 -- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 msgr2=0x7f7204141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 0x7f7204141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 -- 172.21.15.50:0/2472879358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40094f0 con 0x7f72040ab040 2023-12-24T18:49:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720ace2700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 0x7f7204141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f7209ce0700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7204069fe0 tx=0x7f71f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4000d10 con 0x7f72040ab040 2023-12-24T18:49:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f400bb20 con 0x7f72040ab040 2023-12-24T18:49:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.497+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72040c78b0 con 0x7f72040ab040 2023-12-24T18:49:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.501+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4011670 con 0x7f72040ab040 2023-12-24T18:49:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.501+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7204141ad0 con 0x7f72040ab040 2023-12-24T18:49:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.501+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72040cb320 con 0x7f72040ab040 2023-12-24T18:49:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.501+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f71f40119e0 con 0x7f72040ab040 2023-12-24T18:49:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.505+0000 7f71fa7fc700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 0x7f71e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.505+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f71f407e190 con 0x7f72040ab040 2023-12-24T18:49:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.505+0000 7f720a4e1700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 0x7f71e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.505+0000 7f720a4e1700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 0x7f71e8062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7200009db0 tx=0x7f72000091a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.509+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72040cb320 con 0x7f72040ab040 2023-12-24T18:49:14.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.705+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f72041528b0 con 0x7f71e8060550 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f71fa7fc700 1 -- 172.21.15.50:0/2472879358 <== mgr.5695 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7200011a50 con 0x7f71e8060550 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:49:14.711 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 msgr2=0x7f71e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 0x7f71e8062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7200009db0 tx=0x7f72000091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 msgr2=0x7f720416cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7204069fe0 tx=0x7f71f4017000 comp rx=0 tx=0).stop 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 shutdown_connections 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f71e8060550 0x7f71e8062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204159bc0 0x7f7204141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72040ab040 0x7f720416cff0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 --2- 172.21.15.50:0/2472879358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f720406bce0 0x7f72040c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.709+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 >> 172.21.15.50:0/2472879358 conn(0x7f72040cbba0 msgr2=0x7f7204156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.713+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 shutdown_connections 2023-12-24T18:49:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.713+0000 7f720c745700 1 -- 172.21.15.50:0/2472879358 wait complete. 2023-12-24T18:49:14.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:49:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.901+0000 7f0314a6e700 1 Processor -- start 2023-12-24T18:49:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.901+0000 7f0314a6e700 1 -- start start 2023-12-24T18:49:14.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f0314a6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f03100cf8a0 0x7f031006a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f0314a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f0314a6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03100cd680 con 0x7f03100cf4d0 2023-12-24T18:49:14.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f0314a6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0310159640 con 0x7f03100cf8a0 2023-12-24T18:49:14.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f0314a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031006b080 con 0x7f031006ac40 2023-12-24T18:49:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030ed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f03100cf8a0 0x7f031006a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030ed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:55004/0 (socket says 172.21.15.50:55004) 2023-12-24T18:49:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f03100cf8a0 0x7f031006a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56838/0 (socket says 172.21.15.50:56838) 2023-12-24T18:49:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030ed9d700 1 -- 172.21.15.50:0/3556486358 learned_addr learned my addr 172.21.15.50:0/3556486358 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 -- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 msgr2=0x7f03100cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 -- 172.21.15.50:0/3556486358 >> v1:172.21.15.82:6789/0 conn(0x7f03100cf4d0 legacy=0x7f031006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 -- 172.21.15.50:0/3556486358 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031006d8f0 con 0x7f03100cf8a0 2023-12-24T18:49:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030ed9d700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:49:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.905+0000 7f030dd9b700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf8a0 0x7f031006a700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f03040098e0 tx=0x7f03040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89eb615ed0dfd9d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f030d59a700 1 -- 172.21.15.50:0/3556486358 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030400b640 con 0x7f03100cf8a0 2023-12-24T18:49:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f030d59a700 1 -- 172.21.15.50:0/3556486358 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030400b7a0 con 0x7f03100cf8a0 2023-12-24T18:49:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f030d59a700 1 -- 172.21.15.50:0/3556486358 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030400bb40 con 0x7f03100cf8a0 2023-12-24T18:49:14.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 -- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf8a0 msgr2=0x7f031006a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf8a0 0x7f031006a700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f03040098e0 tx=0x7f03040091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 -- 172.21.15.50:0/3556486358 shutdown_connections 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f031006ac40 0x7f03100cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 --2- 172.21.15.50:0/3556486358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf8a0 0x7f031006a700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 -- 172.21.15.50:0/3556486358 >> 172.21.15.50:0/3556486358 conn(0x7f0310067b30 msgr2=0x7f03100cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 -- 172.21.15.50:0/3556486358 shutdown_connections 2023-12-24T18:49:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.909+0000 7f0314a6e700 1 -- 172.21.15.50:0/3556486358 wait complete. 2023-12-24T18:49:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 Processor -- start 2023-12-24T18:49:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 -- start start 2023-12-24T18:49:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf4d0 0x7f03101568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03100cf8a0 0x7f031015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101543f0 con 0x7f031006ac40 2023-12-24T18:49:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310150300 con 0x7f03100cf4d0 2023-12-24T18:49:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f0314a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031015b2e0 con 0x7f03100cf8a0 2023-12-24T18:49:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f030e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f030e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51004/0 (socket says 172.21.15.50:51004) 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f030e59c700 1 -- 172.21.15.50:0/2473931922 learned_addr learned my addr 172.21.15.50:0/2473931922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f030ed9d700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03100cf8a0 0x7f031015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.913+0000 7f030dd9b700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf4d0 0x7f03101568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 -- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03100cf8a0 msgr2=0x7f031015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03100cf8a0 0x7f031015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 -- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf4d0 msgr2=0x7f03101568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf4d0 0x7f03101568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 -- 172.21.15.50:0/2473931922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009ae0 con 0x7f031006ac40 2023-12-24T18:49:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f030e59c700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f030000c590 tx=0x7f030000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300011590 con 0x7f031006ac40 2023-12-24T18:49:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300011710 con 0x7f031006ac40 2023-12-24T18:49:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0304009420 con 0x7f031006ac40 2023-12-24T18:49:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300011ad0 con 0x7f031006ac40 2023-12-24T18:49:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031015b8a0 con 0x7f031006ac40 2023-12-24T18:49:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.917+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03100652e0 con 0x7f031006ac40 2023-12-24T18:49:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.921+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f030001b3b0 con 0x7f031006ac40 2023-12-24T18:49:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.921+0000 7f02fe7fc700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 0x7f02f0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.921+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f030007bf70 con 0x7f031006ac40 2023-12-24T18:49:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.921+0000 7f030dd9b700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 0x7f02f0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.925+0000 7f030dd9b700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 0x7f02f0062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03100cfc90 tx=0x7f0304017000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:14.925+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f030004c220 con 0x7f031006ac40 2023-12-24T18:49:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.137+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f03100cca70 con 0x7f031006ac40 2023-12-24T18:49:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.565+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 19) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f030004c5f0 con 0x7f031006ac40 2023-12-24T18:49:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f02fe7fc700 1 -- 172.21.15.50:0/2473931922 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f030004fcb0 con 0x7f031006ac40 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 msgr2=0x7f02f0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 0x7f02f0062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03100cfc90 tx=0x7f0304017000 comp rx=0 tx=0).stop 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 msgr2=0x7f031014fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f030000c590 tx=0x7f030000c8a0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 shutdown_connections 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f02f0060580 0x7f02f0062a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03100cf8a0 0x7f031015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03100cf4d0 0x7f03101568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 --2- 172.21.15.50:0/2473931922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f031006ac40 0x7f031014fdc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 >> 172.21.15.50:0/2473931922 conn(0x7f0310067b30 msgr2=0x7f031015eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 shutdown_connections 2023-12-24T18:49:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.569+0000 7f0314a6e700 1 -- 172.21.15.50:0/2473931922 wait complete. 2023-12-24T18:49:15.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:49:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.757+0000 7f15f8aae700 1 Processor -- start 2023-12-24T18:49:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.757+0000 7f15f8aae700 1 -- start start 2023-12-24T18:49:15.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f8aae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15f415b4f0 0x7f15f406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f8aae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f415b060 con 0x7f15f4140730 2023-12-24T18:49:15.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f8aae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f406e3b0 con 0x7f15f406df90 2023-12-24T18:49:15.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f8aae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f415b940 con 0x7f15f415b4f0 2023-12-24T18:49:15.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f15f4140730 0x7f15f4157400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54782/0 (socket says 172.21.15.50:54782) 2023-12-24T18:49:15.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f259c700 1 -- 172.21.15.50:0/2041134858 learned_addr learned my addr 172.21.15.50:0/2041134858 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/2041134858 >> v2:172.21.15.82:3300/0 conn(0x7f15f415b4f0 0x7f15f406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643568134 0 0) 0x7f15f415b060 con 0x7f15f4140730 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003570 con 0x7f15f4140730 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044631431 0 0) 0x7f15f406e3b0 con 0x7f15f406df90 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f415b060 con 0x7f15f406df90 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3468233022 0 0) 0x7f15e0003570 con 0x7f15f4140730 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 >> v2:172.21.15.82:3300/0 conn(0x7f15f415b4f0 msgr2=0x7f15f406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 --2- 172.21.15.50:0/2041134858 >> v2:172.21.15.82:3300/0 conn(0x7f15f415b4f0 0x7f15f406da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 >> v1:172.21.15.82:6789/0 conn(0x7f15f406df90 legacy=0x7f15f40c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4157f60 con 0x7f15f4140730 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f15e4001470 con 0x7f15f4140730 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 >> v1:172.21.15.50:6789/0 conn(0x7f15f4140730 legacy=0x7f15f4157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0003bf0 0x7f15e0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 0x7f15e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15e00051c0 0x7f15e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415b940 con 0x7f15e0004810 2023-12-24T18:49:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e000c050 con 0x7f15e00051c0 2023-12-24T18:49:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.761+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e000c210 con 0x7f15e0003bf0 2023-12-24T18:49:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 0x7f15e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f259c700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0003bf0 0x7f15e0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f2d9d700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15e00051c0 0x7f15e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 -- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0003bf0 msgr2=0x7f15e0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0003bf0 0x7f15e0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 -- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15e00051c0 msgr2=0x7f15e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15e00051c0 0x7f15e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 -- 172.21.15.50:0/2041134858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0003570 con 0x7f15e0004810 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f2d9d700 1 -- 172.21.15.50:0/2041134858 reap_dead start 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 0x7f15e0004c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009c00 tx=0x7f15dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c4305a47770d32 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00e710 con 0x7f15e0004810 2023-12-24T18:49:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc00e870 con 0x7f15e0004810 2023-12-24T18:49:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f1d9b700 1 -- 172.21.15.50:0/2041134858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00ec30 con 0x7f15e0004810 2023-12-24T18:49:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 -- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 msgr2=0x7f15e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 0x7f15e0004c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009c00 tx=0x7f15dc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 -- 172.21.15.50:0/2041134858 shutdown_connections 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 --2- 172.21.15.50:0/2041134858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e0004810 0x7f15e0004c80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 -- 172.21.15.50:0/2041134858 >> 172.21.15.50:0/2041134858 conn(0x7f15f40ccc80 msgr2=0x7f15f40cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 -- 172.21.15.50:0/2041134858 shutdown_connections 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.765+0000 7f15f8aae700 1 -- 172.21.15.50:0/2041134858 wait complete. 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 Processor -- start 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- start start 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0004810 0x7f15f40c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 0x7f15f40c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c54b0 con 0x7f15f413ea20 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40ac070 con 0x7f15f413e5b0 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c48a0 con 0x7f15e0004810 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51046/0 (socket says 172.21.15.50:51046) 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 -- 172.21.15.50:0/1478593092 learned_addr learned my addr 172.21.15.50:0/1478593092 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f259c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0004810 0x7f15f40c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 0x7f15f40c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 -- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0004810 msgr2=0x7f15f40c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0004810 0x7f15f40c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 -- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 msgr2=0x7f15f40c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 0x7f15f40c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 -- 172.21.15.50:0/1478593092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40c4b80 con 0x7f15f413ea20 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15e9d9b700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 0x7f15f40c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f2d9d700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f15f4069f40 tx=0x7f15ec0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec006e80 con 0x7f15f413ea20 2023-12-24T18:49:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00c540 con 0x7f15f413ea20 2023-12-24T18:49:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40c4e60 con 0x7f15f413ea20 2023-12-24T18:49:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00c900 con 0x7f15f413ea20 2023-12-24T18:49:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.769+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f40c5e80 con 0x7f15f413ea20 2023-12-24T18:49:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f40652e0 con 0x7f15f413ea20 2023-12-24T18:49:15.782 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:15.773+0000 7fd2c5b5f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f15ec00ccf0 con 0x7f15f413ea20 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15eaffd700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 0x7f15d4062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15f259c700 1 -- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 msgr2=0x7f15d4062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f15ec07c9a0 con 0x7f15f413ea20 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.773+0000 7f15f259c700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 0x7f15d4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:49:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.777+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f15ec04ce10 con 0x7f15f413ea20 2023-12-24T18:49:15.792 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:15.785+0000 7ff4f755f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:49:15.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.953+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f15f4158240 con 0x7f15f413ea20 2023-12-24T18:49:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.965+0000 7f15eaffd700 1 -- 172.21.15.50:0/1478593092 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f15ec050430 con 0x7f15f413ea20 2023-12-24T18:49:15.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 msgr2=0x7f15d4062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:49:15.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 0x7f15d4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 msgr2=0x7f15f40c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f15f4069f40 tx=0x7f15ec0017a0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 shutdown_connections 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f15d4060670 0x7f15d4062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f413ea20 0x7f15f40c4270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f413e5b0 0x7f15f40c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 --2- 172.21.15.50:0/1478593092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15e0004810 0x7f15f40c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 >> 172.21.15.50:0/1478593092 conn(0x7f15f40ccc80 msgr2=0x7f15f40c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 shutdown_connections 2023-12-24T18:49:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:15.969+0000 7f15f8aae700 1 -- 172.21.15.50:0/1478593092 wait complete. 2023-12-24T18:49:15.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:49:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.169+0000 7fca79385700 1 Processor -- start 2023-12-24T18:49:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.169+0000 7fca79385700 1 -- start start 2023-12-24T18:49:16.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca79385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 0x7fca7415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca79385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7415d8d0 con 0x7fca74158ab0 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca79385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7406a740 con 0x7fca7406b220 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca79385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7406a530 con 0x7fca740ccc90 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca737fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 0x7fca7415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca72ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fca74158ab0 0x7fca74158e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54786/0 (socket says 172.21.15.50:54786) 2023-12-24T18:49:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca72ffd700 1 -- 172.21.15.50:0/3005482186 learned_addr learned my addr 172.21.15.50:0/3005482186 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:16.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca737fe700 1 -- 172.21.15.50:0/3005482186 >> v1:172.21.15.82:6789/0 conn(0x7fca7406b220 legacy=0x7fca740cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca737fe700 1 -- 172.21.15.50:0/3005482186 >> v1:172.21.15.50:6789/0 conn(0x7fca74158ab0 legacy=0x7fca74158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca737fe700 1 -- 172.21.15.50:0/3005482186 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7406aa20 con 0x7fca740ccc90 2023-12-24T18:49:16.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca71ffb700 1 -- 172.21.15.50:0/3005482186 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012838643 0 0) 0x7fca7415d8d0 con 0x7fca74158ab0 2023-12-24T18:49:16.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca737fe700 1 --2- 172.21.15.50:0/3005482186 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 0x7fca7415cbc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009ec0 tx=0x7fca6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f9f8f0d0a8c300 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca71ffb700 1 -- 172.21.15.50:0/3005482186 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00e070 con 0x7fca740ccc90 2023-12-24T18:49:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca71ffb700 1 -- 172.21.15.50:0/3005482186 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00bbf0 con 0x7fca740ccc90 2023-12-24T18:49:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.173+0000 7fca71ffb700 1 -- 172.21.15.50:0/3005482186 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c012430 con 0x7fca740ccc90 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 -- 172.21.15.50:0/3005482186 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 msgr2=0x7fca7415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 --2- 172.21.15.50:0/3005482186 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 0x7fca7415cbc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009ec0 tx=0x7fca6c009780 comp rx=0 tx=0).stop 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 -- 172.21.15.50:0/3005482186 shutdown_connections 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 --2- 172.21.15.50:0/3005482186 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca740ccc90 0x7fca7415cbc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 -- 172.21.15.50:0/3005482186 >> 172.21.15.50:0/3005482186 conn(0x7fca740670b0 msgr2=0x7fca740674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 -- 172.21.15.50:0/3005482186 shutdown_connections 2023-12-24T18:49:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 -- 172.21.15.50:0/3005482186 wait complete. 2023-12-24T18:49:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.177+0000 7fca79385700 1 Processor -- start 2023-12-24T18:49:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- start start 2023-12-24T18:49:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca740ccc90 0x7fca7415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 0x7fca7415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c5420 con 0x7fca7406b220 2023-12-24T18:49:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c5700 con 0x7fca740ccc90 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c59e0 con 0x7fca74158ab0 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51062/0 (socket says 172.21.15.50:51062) 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 -- 172.21.15.50:0/509268921 learned_addr learned my addr 172.21.15.50:0/509268921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca727fc700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca740ccc90 0x7fca7415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca737fe700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 0x7fca7415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 -- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 msgr2=0x7fca7415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 0x7fca7415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 -- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca740ccc90 msgr2=0x7fca7415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca740ccc90 0x7fca7415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 -- 172.21.15.50:0/509268921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009a20 con 0x7fca7406b220 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca737fe700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 0x7fca7415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:49:16.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca72ffd700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c560 tx=0x7fca64000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64005b30 con 0x7fca7406b220 2023-12-24T18:49:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca64005c90 con 0x7fca7406b220 2023-12-24T18:49:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca740c5cc0 con 0x7fca7406b220 2023-12-24T18:49:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64007320 con 0x7fca7406b220 2023-12-24T18:49:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.181+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca740b56d0 con 0x7fca7406b220 2023-12-24T18:49:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.185+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7404be40 con 0x7fca7406b220 2023-12-24T18:49:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.185+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fca6401b3b0 con 0x7fca7406b220 2023-12-24T18:49:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.189+0000 7fca5affd700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 0x7fca60062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.189+0000 7fca727fc700 1 -- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 msgr2=0x7fca60062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.189+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fca6407c090 con 0x7fca7406b220 2023-12-24T18:49:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.189+0000 7fca727fc700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 0x7fca60062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:49:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.193+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca6404c340 con 0x7fca7406b220 2023-12-24T18:49:16.334 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:16.329+0000 7ff4f755f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:49:16.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:16.353+0000 7fd2c5b5f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:49:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.369+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fca7406bc00 con 0x7fca7406b220 2023-12-24T18:49:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.377+0000 7fca5affd700 1 -- 172.21.15.50:0/509268921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fca6404f960 con 0x7fca7406b220 2023-12-24T18:49:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 msgr2=0x7fca60062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:49:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 0x7fca60062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 msgr2=0x7fca740c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c560 tx=0x7fca64000fe0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 shutdown_connections 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fca600605a0 0x7fca60062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fca74158ab0 0x7fca7415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca740ccc90 0x7fca7415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 --2- 172.21.15.50:0/509268921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca7406b220 0x7fca740c64c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 >> 172.21.15.50:0/509268921 conn(0x7fca740670b0 msgr2=0x7fca74067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 shutdown_connections 2023-12-24T18:49:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.381+0000 7fca79385700 1 -- 172.21.15.50:0/509268921 wait complete. 2023-12-24T18:49:16.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:16.404 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T18:49:16.406 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:16.401+0000 7ff4f755f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:49:16.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-12-24T18:49:16.442 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:16.441+0000 7fd2c5b5f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:49:16.567 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:16.561+0000 7ff4f755f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:49:16.601 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:16.597+0000 7fd2c5b5f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:49:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.617+0000 7f3928dcc700 1 Processor -- start 2023-12-24T18:49:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.617+0000 7f3928dcc700 1 -- start start 2023-12-24T18:49:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3928dcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f392406a4a0 0x7f39240c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3928dcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392406b5b0 con 0x7f39240c5ac0 2023-12-24T18:49:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3928dcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39240c5ee0 con 0x7f3924159080 2023-12-24T18:49:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3928dcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392415dbd0 con 0x7f392406a4a0 2023-12-24T18:49:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3922ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f392406a4a0 0x7f39240c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3923fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39240c5ac0 0x7f39240cab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54788/0 (socket says 172.21.15.50:54788) 2023-12-24T18:49:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3923fff700 1 -- 172.21.15.50:0/3321284816 learned_addr learned my addr 172.21.15.50:0/3321284816 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f39237fe700 1 --1- 172.21.15.50:0/3321284816 >> v1:172.21.15.82:6789/0 conn(0x7f3924159080 0x7f392406da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60546/0 (socket says 172.21.15.50:60546) 2023-12-24T18:49:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3922ffd700 1 -- 172.21.15.50:0/3321284816 >> v1:172.21.15.82:6789/0 conn(0x7f3924159080 legacy=0x7f392406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3922ffd700 1 -- 172.21.15.50:0/3321284816 >> v1:172.21.15.50:6789/0 conn(0x7f39240c5ac0 legacy=0x7f39240cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3922ffd700 1 -- 172.21.15.50:0/3321284816 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392406a9a0 con 0x7f392406a4a0 2023-12-24T18:49:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.621+0000 7f3922ffd700 1 --2- 172.21.15.50:0/3321284816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392406a4a0 0x7f39240c5580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f39180098e0 tx=0x7f39180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7ec073191f1ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f39227fc700 1 -- 172.21.15.50:0/3321284816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918009e80 con 0x7f392406a4a0 2023-12-24T18:49:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f39227fc700 1 -- 172.21.15.50:0/3321284816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800b860 con 0x7f392406a4a0 2023-12-24T18:49:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f39227fc700 1 -- 172.21.15.50:0/3321284816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800bbe0 con 0x7f392406a4a0 2023-12-24T18:49:16.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 -- 172.21.15.50:0/3321284816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392406a4a0 msgr2=0x7f39240c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 --2- 172.21.15.50:0/3321284816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392406a4a0 0x7f39240c5580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f39180098e0 tx=0x7f39180091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 -- 172.21.15.50:0/3321284816 shutdown_connections 2023-12-24T18:49:16.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 --2- 172.21.15.50:0/3321284816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392406a4a0 0x7f39240c5580 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 -- 172.21.15.50:0/3321284816 >> 172.21.15.50:0/3321284816 conn(0x7f3924067b80 msgr2=0x7f39240cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:16.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 -- 172.21.15.50:0/3321284816 shutdown_connections 2023-12-24T18:49:16.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.625+0000 7f3928dcc700 1 -- 172.21.15.50:0/3321284816 wait complete. 2023-12-24T18:49:16.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 Processor -- start 2023-12-24T18:49:16.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- start start 2023-12-24T18:49:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392406a4a0 0x7f3924151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39240c5ac0 0x7f3924159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240b2e00 con 0x7f3924159080 2023-12-24T18:49:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3924158780 con 0x7f39240c5ac0 2023-12-24T18:49:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392415a9d0 con 0x7f392406a4a0 2023-12-24T18:49:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51086/0 (socket says 172.21.15.50:51086) 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 -- 172.21.15.50:0/4212331523 learned_addr learned my addr 172.21.15.50:0/4212331523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392406a4a0 0x7f3924151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3922ffd700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39240c5ac0 0x7f3924159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392406a4a0 msgr2=0x7f3924151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392406a4a0 0x7f3924151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39240c5ac0 msgr2=0x7f3924159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39240c5ac0 0x7f3924159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009420 con 0x7f3924159080 2023-12-24T18:49:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3923fff700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f391c00cc70 tx=0x7f391c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00a850 con 0x7f3924159080 2023-12-24T18:49:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00a9b0 con 0x7f3924159080 2023-12-24T18:49:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392415acb0 con 0x7f3924159080 2023-12-24T18:49:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00ad70 con 0x7f3924159080 2023-12-24T18:49:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.629+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39241521f0 con 0x7f3924159080 2023-12-24T18:49:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.633+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39240b2fb0 con 0x7f3924159080 2023-12-24T18:49:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.633+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f391c007300 con 0x7f3924159080 2023-12-24T18:49:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.633+0000 7f390b7fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.637+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6373+0+0 (secure 0 0 0) 0x7f391c07ce10 con 0x7f3924159080 2023-12-24T18:49:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.637+0000 7f39237fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.637+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:49:16.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.641+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f39240b2fb0 con 0x7f3924159080 2023-12-24T18:49:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.833+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f39240b2bf0 con 0x7f39100605a0 2023-12-24T18:49:16.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.841+0000 7f39237fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:16.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:16.841+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:49:16.858 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:16.853+0000 7ff4f755f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:49:16.889 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:16.885+0000 7fd2c5b5f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:49:16.935 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:16.929+0000 7ff4f755f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:49:16.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:16.965+0000 7fd2c5b5f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:49:17.158 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:17.153+0000 7ff4f755f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:49:17.196 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:17.193+0000 7fd2c5b5f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:49:17.244 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:17.237+0000 7ff4f755f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:49:17.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:17.245+0000 7f39237fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:17.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:17.245+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:49:17.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:17.285+0000 7fd2c5b5f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:49:17.334 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:17.329+0000 7ff4f755f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:49:17.380 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:17.377+0000 7fd2c5b5f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:49:17.732 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:17.725+0000 7ff4f755f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:49:17.801 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:17.797+0000 7fd2c5b5f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:49:17.912 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:17.905+0000 7ff4f755f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:49:17.977 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:17.973+0000 7fd2c5b5f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:49:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:18.049+0000 7f39237fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:18.049+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:49:18.283 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.277+0000 7ff4f755f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:49:18.363 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:18.361+0000 7fd2c5b5f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:49:18.497 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.489+0000 7ff4f755f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:49:18.592 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.585+0000 7ff4f755f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:49:18.594 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:18.589+0000 7fd2c5b5f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:49:18.689 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.681+0000 7ff4f755f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:49:18.692 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:18.689+0000 7fd2c5b5f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:49:18.769 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.761+0000 7ff4f755f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:49:18.773 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:18.769+0000 7fd2c5b5f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:49:18.863 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:18.861+0000 7fd2c5b5f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:49:18.984 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:18.977+0000 7ff4f755f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:49:19.059 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:19.053+0000 7ff4f755f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:49:19.104 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:19.101+0000 7fd2c5b5f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:49:19.142 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:19.137+0000 7ff4f755f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:49:19.191 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:19.189+0000 7fd2c5b5f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:49:19.288 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:19.285+0000 7fd2c5b5f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:49:19.323 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:19.317+0000 7ff4f755f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:49:19.408 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:19.401+0000 7ff4f755f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:49:19.494 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:19.493+0000 7fd2c5b5f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:49:19.590 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:19.585+0000 7fd2c5b5f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:49:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:19.653+0000 7f39237fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:49:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:19.653+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:49:20.107 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:49:20.101+0000 7ff4f755f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:49:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:20.173+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 20) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f391c04d510 con 0x7f3924159080 2023-12-24T18:49:20.352 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.349+0000 7fd2c5b5f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:49:20.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:20.365+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 21) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f391c057950 con 0x7f3924159080 2023-12-24T18:49:20.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:20.365+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f3910062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:49:20.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:20.365+0000 7f390b7fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f3910062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:20.567 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd287743700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.567 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd287743700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.567 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd287743700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.567 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd287743700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.567 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd287743700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.568 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd283f3c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.568 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd283f3c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.568 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd283f3c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.568 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd283f3c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:20.568 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:49:20.565+0000 7fd283f3c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:49:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.377+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 22) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f391c04dde0 con 0x7f3924159080 2023-12-24T18:49:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.377+0000 7f390b7fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f39100629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.377+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3910007d90 con 0x7f39100605a0 2023-12-24T18:49:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.377+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f39100629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.381+0000 7f39237fe700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f39100629d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39140012b0 tx=0x7f3914007eb0 comp rx=0 tx=0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.489+0000 7f390b7fe700 1 -- 172.21.15.50:0/4212331523 <== mgr.6018 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3910007d90 con 0x7f39100605a0 2023-12-24T18:49:21.494 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 msgr2=0x7f39100629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f39100629d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39140012b0 tx=0x7f3914007eb0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 msgr2=0x7f392415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f391c00cc70 tx=0x7f391c001a50 comp rx=0 tx=0).stop 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 shutdown_connections 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f39100605a0 0x7f39100629d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3924159080 0x7f392415a350 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39240c5ac0 0x7f3924159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 --2- 172.21.15.50:0/4212331523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392406a4a0 0x7f3924151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 >> 172.21.15.50:0/4212331523 conn(0x7f3924067b80 msgr2=0x7f39240d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:21.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 shutdown_connections 2023-12-24T18:49:21.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.493+0000 7f3928dcc700 1 -- 172.21.15.50:0/4212331523 wait complete. 2023-12-24T18:49:21.520 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T18:49:21.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-12-24T18:49:21.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 Processor -- start 2023-12-24T18:49:21.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 -- start start 2023-12-24T18:49:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b940c7630 0x7f8b940c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9406b7f0 0x7f8b940c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9406cb90 con 0x7f8b94158bc0 2023-12-24T18:49:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b94159730 con 0x7f8b940c7630 2023-12-24T18:49:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.713+0000 7f8b9ab45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ac410 con 0x7f8b9406b7f0 2023-12-24T18:49:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b940c7630 0x7f8b940c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9406b7f0 0x7f8b940c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b940c7630 0x7f8b940c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:60718/0 (socket says 172.21.15.50:60718) 2023-12-24T18:49:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 -- 172.21.15.50:0/1052150703 learned_addr learned my addr 172.21.15.50:0/1052150703 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b990e2700 1 --1- 172.21.15.50:0/1052150703 >> v1:172.21.15.82:6789/0 conn(0x7f8b94158bc0 0x7f8b94159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:48808/0 (socket says 172.21.15.50:48808) 2023-12-24T18:49:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 -- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9406b7f0 msgr2=0x7f8b940c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:49:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 --2- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9406b7f0 0x7f8b940c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 -- 172.21.15.50:0/1052150703 >> v1:172.21.15.82:6789/0 conn(0x7f8b94158bc0 legacy=0x7f8b94159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 -- 172.21.15.50:0/1052150703 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9406bd70 con 0x7f8b940c7630 2023-12-24T18:49:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b988e1700 1 --2- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b940c7630 0x7f8b940c7a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b880099b0 tx=0x7f8b88009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4fe4a147181f72 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b937fe700 1 -- 172.21.15.50:0/1052150703 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88009ea0 con 0x7f8b940c7630 2023-12-24T18:49:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b937fe700 1 -- 172.21.15.50:0/1052150703 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800b860 con 0x7f8b940c7630 2023-12-24T18:49:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.717+0000 7f8b937fe700 1 -- 172.21.15.50:0/1052150703 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800bc00 con 0x7f8b940c7630 2023-12-24T18:49:21.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 -- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b940c7630 msgr2=0x7f8b940c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b940c7630 0x7f8b940c7a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b880099b0 tx=0x7f8b88009250 comp rx=0 tx=0).stop 2023-12-24T18:49:21.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 -- 172.21.15.50:0/1052150703 shutdown_connections 2023-12-24T18:49:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9406b7f0 0x7f8b940c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/1052150703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b940c7630 0x7f8b940c7a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 -- 172.21.15.50:0/1052150703 >> 172.21.15.50:0/1052150703 conn(0x7f8b940ccf50 msgr2=0x7f8b940670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 -- 172.21.15.50:0/1052150703 shutdown_connections 2023-12-24T18:49:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 -- 172.21.15.50:0/1052150703 wait complete. 2023-12-24T18:49:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.721+0000 7f8b9ab45700 1 Processor -- start 2023-12-24T18:49:21.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 -- start start 2023-12-24T18:49:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 0x7f8b940c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94158bc0 0x7f8b940c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94159ba0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415b350 con 0x7f8b94158bc0 2023-12-24T18:49:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b9ab45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415b5c0 con 0x7f8b940c7630 2023-12-24T18:49:21.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47842/0 (socket says 172.21.15.50:47842) 2023-12-24T18:49:21.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 -- 172.21.15.50:0/2819747558 learned_addr learned my addr 172.21.15.50:0/2819747558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:21.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b990e2700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94158bc0 0x7f8b940c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b93fff700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 0x7f8b940c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 -- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 msgr2=0x7f8b940c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 0x7f8b940c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 -- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94158bc0 msgr2=0x7f8b940c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94158bc0 0x7f8b940c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b988e1700 1 -- 172.21.15.50:0/2819747558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880094f0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.725+0000 7f8b93fff700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 0x7f8b940c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:49:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b988e1700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800bbe0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88011420 con 0x7f8b9406b7f0 2023-12-24T18:49:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9415b8a0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880117c0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b94157670 con 0x7f8b9406b7f0 2023-12-24T18:49:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.729+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9415bd80 con 0x7f8b9406b7f0 2023-12-24T18:49:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.733+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f8b88011bf0 con 0x7f8b9406b7f0 2023-12-24T18:49:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.733+0000 7f8b90ff9700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 0x7f8b780628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.733+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6631+0+0 (secure 0 0 0) 0x7f8b8807e300 con 0x7f8b9406b7f0 2023-12-24T18:49:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.733+0000 7f8b93fff700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 0x7f8b780628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.733+0000 7f8b93fff700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 0x7f8b780628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b940c2ff0 tx=0x7f8b80008040 comp rx=0 tx=0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.741+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b8804e730 con 0x7f8b9406b7f0 2023-12-24T18:49:21.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:21.945+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b94071060 con 0x7f8b780603f0 2023-12-24T18:49:22.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.045+0000 7f8b90ff9700 1 -- 172.21.15.50:0/2819747558 <== mgr.6018 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8b94071060 con 0x7f8b780603f0 2023-12-24T18:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T18:49:22.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 msgr2=0x7f8b780628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 0x7f8b780628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b940c2ff0 tx=0x7f8b80008040 comp rx=0 tx=0).stop 2023-12-24T18:49:22.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 msgr2=0x7f8b94157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88017000 comp rx=0 tx=0).stop 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 shutdown_connections 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8b780603f0 0x7f8b780628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94158bc0 0x7f8b940c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c7630 0x7f8b940c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 --2- 172.21.15.50:0/2819747558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406b7f0 0x7f8b94157130 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 >> 172.21.15.50:0/2819747558 conn(0x7f8b940ccf50 msgr2=0x7f8b94157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 shutdown_connections 2023-12-24T18:49:22.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.049+0000 7f8b9ab45700 1 -- 172.21.15.50:0/2819747558 wait complete. 2023-12-24T18:49:22.077 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T18:49:22.077 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-12-24-18_50_00 in ~38s... 2023-12-24T18:49:22.077 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-12-24-18_51_00 in ~98s... 2023-12-24T18:49:22.077 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-12-24T18:49:22.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-12-24T18:49:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.249+0000 7f6d3b59e700 1 Processor -- start 2023-12-24T18:49:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.249+0000 7f6d3b59e700 1 -- start start 2023-12-24T18:49:22.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.253+0000 7f6d3b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d3c0aac10 0x7f6d3c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:22.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.253+0000 7f6d3b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c06deb0 con 0x7f6d3c0c72f0 2023-12-24T18:49:22.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c06b770 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c157500 con 0x7f6d3c0aac10 2023-12-24T18:49:22.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d3c0c72f0 0x7f6d3c0aba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40384/0 (socket says 172.21.15.50:40384) 2023-12-24T18:49:22.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3ad9d700 1 -- 172.21.15.50:0/1662745812 learned_addr learned my addr 172.21.15.50:0/1662745812 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:49:22.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3a59c700 1 --2- 172.21.15.50:0/1662745812 >> v2:172.21.15.82:3300/0 conn(0x7f6d3c0aac10 0x7f6d3c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:22.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722442147 0 0) 0x7f6d3c06deb0 con 0x7f6d3c0c72f0 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d24003570 con 0x7f6d3c0c72f0 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598430689 0 0) 0x7f6d3c06b770 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3c06deb0 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1662745812 >> v1:172.21.15.82:6789/0 conn(0x7f6d3c06a6a0 legacy=0x7f6d3c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1662745812 >> v1:172.21.15.50:6789/0 conn(0x7f6d3c0c72f0 legacy=0x7f6d3c0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1662745812 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c06d770 con 0x7f6d3c0aac10 2023-12-24T18:49:22.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3a59c700 1 --2- 172.21.15.50:0/1662745812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c06d230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0098e0 tx=0x7f6d2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e282027400de29 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:22.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011630 con 0x7f6d3c0aac10 2023-12-24T18:49:22.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011790 con 0x7f6d3c0aac10 2023-12-24T18:49:22.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.257+0000 7f6d3959a700 1 -- 172.21.15.50:0/1662745812 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011b30 con 0x7f6d3c0aac10 2023-12-24T18:49:22.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1662745812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 msgr2=0x7f6d3c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1662745812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c06d230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0098e0 tx=0x7f6d2c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1662745812 shutdown_connections 2023-12-24T18:49:22.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1662745812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c06d230 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1662745812 >> 172.21.15.50:0/1662745812 conn(0x7f6d3c067b40 msgr2=0x7f6d3c0cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:22.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1662745812 shutdown_connections 2023-12-24T18:49:22.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1662745812 wait complete. 2023-12-24T18:49:22.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 Processor -- start 2023-12-24T18:49:22.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.261+0000 7f6d3b59e700 1 -- start start 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d3c0c72f0 0x7f6d3c155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1691e0 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c16cc80 con 0x7f6d3c0aac10 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c16cf60 con 0x7f6d3c0c72f0 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47844/0 (socket says 172.21.15.50:47844) 2023-12-24T18:49:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1011615581 learned_addr learned my addr 172.21.15.50:0/1011615581 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:49:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3ad9d700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d3c0c72f0 0x7f6d3c155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d39d9b700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d3c0c72f0 msgr2=0x7f6d3c155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d3c0c72f0 0x7f6d3c155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 msgr2=0x7f6d3c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 -- 172.21.15.50:0/1011615581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c009420 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3a59c700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c069a70 tx=0x7f6d2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c01f070 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011900 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c16d240 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c023410 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.265+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c15a360 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.269+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c16d740 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.269+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f6d2c00b400 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.269+0000 7f6d2a7fc700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 0x7f6d1c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:49:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.269+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6631+0+0 (secure 0 0 0) 0x7f6d2c07dbd0 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.269+0000 7f6d39d9b700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 0x7f6d1c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:49:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.273+0000 7f6d39d9b700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 0x7f6d1c0628a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c156320 tx=0x7f6d30009040 comp rx=0 tx=0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:49:22.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.277+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d2c04e110 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.389+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 23) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f6d2c04e4e0 con 0x7f6d3c06a6a0 2023-12-24T18:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.477+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d3c169380 con 0x7f6d1c0603f0 2023-12-24T18:49:22.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.489+0000 7f6d2a7fc700 1 -- 172.21.15.50:0/1011615581 <== mgr.6018 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f6d3c169380 con 0x7f6d1c0603f0 2023-12-24T18:49:22.494 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:49:22.494 INFO:teuthology.orchestra.run.smithi050.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-12-24T18:49:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 msgr2=0x7f6d1c0628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 0x7f6d1c0628a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c156320 tx=0x7f6d30009040 comp rx=0 tx=0).stop 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 msgr2=0x7f6d3c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c069a70 tx=0x7f6d2c017000 comp rx=0 tx=0).stop 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 shutdown_connections 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6d1c0603f0 0x7f6d1c0628a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d3c0c72f0 0x7f6d3c155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d3c0aac10 0x7f6d3c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 --2- 172.21.15.50:0/1011615581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d3c06a6a0 0x7f6d3c0af2e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:49:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.493+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 >> 172.21.15.50:0/1011615581 conn(0x7f6d3c067b40 msgr2=0x7f6d3c0ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:49:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.497+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 shutdown_connections 2023-12-24T18:49:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:49:22.497+0000 7f6d3b59e700 1 -- 172.21.15.50:0/1011615581 wait complete. 2023-12-24T18:49:22.519 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-12-24T18:49:22.520 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-12-24T18:49:22.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:22.520 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:22.542 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:22.543 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:22.543 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:23.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:23.544 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:23.570 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:23.571 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:23.571 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:24.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:24.572 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:24.596 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:24.596 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:24.596 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:25.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:25.597 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:25.622 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:25.622 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:25.622 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:26.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:26.623 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:26.647 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:26.647 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:26.647 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:27.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:27.649 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:27.672 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:27.672 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:27.673 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:27.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:49:27.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:49:28.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:28.674 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:28.699 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:28.699 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:28.699 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:29.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:29.701 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:29.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:29.727 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:29.727 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:30.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:30.728 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:30.752 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:30.752 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:30.752 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:31.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:31.753 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:31.780 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:31.780 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:31.780 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:32.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:32.781 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:32.804 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:32.804 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:32.804 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:33.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:33.806 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:33.831 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:33.831 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:33.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:34.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:34.832 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:34.856 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:34.856 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:34.856 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:35.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:35.858 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:35.883 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:35.883 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:35.883 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:36.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:36.885 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:36.909 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:36.909 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:36.909 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:37.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:37.910 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:37.934 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:37.934 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:37.934 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:38.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:38.935 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:38.960 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:38.960 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:38.960 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:39.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:39.961 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:39.987 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:39.987 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:39.987 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:40.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:40.988 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:41.014 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:41.014 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:41.014 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:42.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:42.015 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:42.041 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:42.041 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:42.041 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:43.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:43.042 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:43.064 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:43.064 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:43.064 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:44.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:44.066 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:44.092 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:44.092 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:44.092 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:45.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:45.093 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:45.119 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:45.119 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:45.119 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:46.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:46.120 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:46.146 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:46.146 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:46.146 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:47.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:47.147 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:47.171 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:47.171 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:47.171 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:48.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:48.172 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:48.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:48.198 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:48.199 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:49.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:49.200 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:49.225 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:49.225 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:49.225 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:50.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:50.226 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:50.250 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:50.250 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:50.250 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:51.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:51.251 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:51.276 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:51.276 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:51.276 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:52.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:52.277 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:52.303 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:52.303 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:52.303 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:53.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:53.304 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:53.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:53.331 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:53.331 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:54.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:54.331 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:54.357 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:54.357 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:54.357 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:55.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:55.358 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:55.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:55.385 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:55.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:56.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:56.385 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:56.406 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:56.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:56.406 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:57.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:57.407 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:57.432 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:57.432 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:57.432 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:58.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:49:58.013 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:49:58.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:58.433 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:58.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:58.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:58.460 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:49:59.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:49:59.460 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:49:59.484 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:49:59.484 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:49:59.485 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:50:00.068+0000 7fd276721700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:50:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:50:00.068+0000 7fd276721700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:50:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:50:00.068+0000 7fd276721700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:50:00.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:50:00.068+0000 7fd276721700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:50:00.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:50:00.068+0000 7fd276721700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:50:00.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:00.486 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:00.510 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:00.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:00.512 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:00.512 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:00.512 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-12-24-18_50_00_UTC'] 2023-12-24T18:50:00.512 DEBUG:tasks.cephfs.test_snap_schedules:exec=1703443762.0776143, now = 1703443800.5125809, timo = 38 2023-12-24T18:50:01.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:01.513 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:01.539 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:01.539 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:01.540 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:02.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:02.541 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:02.566 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:02.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:02.568 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:02.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:03.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:03.568 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:03.589 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:03.591 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:03.591 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:03.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:04.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:04.593 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:04.614 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:04.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:04.616 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:04.616 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:05.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:05.617 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:05.640 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:05.642 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:05.642 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:05.642 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:06.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:06.643 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:06.666 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:06.668 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:06.668 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:06.668 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:07.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:07.669 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:07.690 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:07.692 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:07.692 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:07.692 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:08.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:08.693 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:08.717 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:08.719 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:08.719 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:08.719 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:09.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:09.721 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:09.745 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:09.746 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:09.747 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:09.747 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:10.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:10.747 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:10.770 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:10.771 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:10.772 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:10.772 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:11.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:11.773 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:11.797 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:11.798 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:11.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:11.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:12.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:12.801 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:12.825 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:12.826 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:12.826 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:12.826 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:13.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:13.827 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:13.852 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:13.854 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:13.854 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:13.854 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:14.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:14.855 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:14.878 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:14.879 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:14.879 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:14.879 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:15.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:15.880 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:15.906 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:15.907 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:15.908 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:15.908 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:16.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:16.908 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:16.933 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:16.935 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:16.935 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:16.935 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:17.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:17.936 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:17.961 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:17.962 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:17.963 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:17.963 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:18.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:18.965 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:18.987 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:18.989 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:18.989 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:18.989 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:19.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:19.991 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:20.018 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:20.018 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:20.018 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:21.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:21.019 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:21.044 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:21.045 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:21.046 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:21.046 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:22.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:22.047 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:22.071 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:22.073 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:22.073 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:22.073 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:23.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:23.075 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:23.096 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:23.097 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:23.098 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:23.098 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:24.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:24.098 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:24.120 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:24.121 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:24.122 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:24.122 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:25.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:25.122 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:25.144 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:25.146 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:25.146 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:25.146 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:26.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:26.147 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:26.169 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:26.171 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:26.171 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:26.171 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:27.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:27.173 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:27.197 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:27.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:27.198 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:27.198 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:28.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:28.200 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:28.225 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:28.227 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:28.227 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:28.227 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:28.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:50:28.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:50:29.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:29.228 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:29.253 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:29.255 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:29.255 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:29.255 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:30.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:30.257 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:30.280 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:30.282 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:30.282 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:30.283 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:31.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:31.283 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:31.307 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:31.309 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:31.309 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:31.309 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:32.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:32.311 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:32.338 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:32.338 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:32.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:33.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:33.338 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:33.357 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:33.358 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:33.358 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:33.359 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:34.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:34.359 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:34.381 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:34.383 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:34.383 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:34.383 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:35.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:35.384 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:35.406 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:35.407 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:35.407 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:35.407 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:36.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:36.408 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:36.427 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:36.428 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:36.429 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:36.429 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:37.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:37.429 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:37.454 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:37.455 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:37.456 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:37.456 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:38.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:38.457 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:38.480 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:38.481 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:38.481 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:38.482 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:39.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:39.483 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:39.506 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:39.507 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:39.507 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:39.507 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:40.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:40.508 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:40.533 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:40.535 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:40.535 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:40.535 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:41.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:41.536 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:41.560 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:41.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:41.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:41.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:42.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:42.564 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:42.589 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:42.591 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:42.591 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:42.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:43.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:43.592 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:43.614 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:43.615 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:43.616 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:43.616 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:44.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:44.617 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:44.642 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:44.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:44.643 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:44.643 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:45.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:45.645 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:45.665 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:45.667 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:45.667 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:45.667 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:46.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:46.668 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:46.689 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:46.691 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:46.691 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:46.691 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:47.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:47.692 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:47.715 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:47.716 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:47.716 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:47.716 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:48.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:48.718 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:48.742 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:48.743 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:48.743 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:48.743 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:49.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:49.745 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:49.769 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:49.770 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:49.771 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:49.771 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:50.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:50.772 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:50.792 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:50.794 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:50.794 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:50.794 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:51.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:51.795 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:51.817 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:51.819 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:51.819 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:51.819 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:52.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:52.819 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:52.844 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:52.846 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:52.846 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:52.846 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:53.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:53.848 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:53.870 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:53.871 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:53.872 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:53.872 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:54.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:54.873 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:54.894 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:54.896 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:54.896 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:54.896 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:55.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:55.897 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:55.919 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:55.921 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:55.921 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:55.921 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:56.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:56.923 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:56.946 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:56.948 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:56.948 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:56.948 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:57.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:57.950 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:57.972 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:57.973 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:57.974 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:57.974 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:50:58.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:50:58.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:50:58.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:50:58.975 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:50:58.998 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:50:59.000 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:50:59.000 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:50:59.001 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:51:00.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:00.002 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:51:00.024 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:51:00.026 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC'} 2023-12-24T18:51:00.026 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:51:00.026 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:51:01.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:01.027 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:51:01.050 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:51:01.050 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_51_00_UTC 2023-12-24T18:51:01.051 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_50_00_UTC', 'scheduled-2023-12-24-18_51_00_UTC'} 2023-12-24T18:51:01.051 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-12-24-18_51_00_UTC'} 2023-12-24T18:51:01.052 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:51:01.052 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-12-24-18_51_00_UTC'] 2023-12-24T18:51:01.052 DEBUG:tasks.cephfs.test_snap_schedules:exec=1703443762.0776143, now = 1703443861.052185, timo = 98 2023-12-24T18:51:02.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-12-24T18:51:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.234+0000 7fc114a0c700 1 Processor -- start 2023-12-24T18:51:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.234+0000 7fc114a0c700 1 -- start start 2023-12-24T18:51:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc114a0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc110158dd0 0x7fc1101591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc114a0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1100ce470 0x7fc1100ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc114a0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100cee10 con 0x7fc1100b2cf0 2023-12-24T18:51:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc114a0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11006aa80 con 0x7fc1100ce470 2023-12-24T18:51:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc114a0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100cc0b0 con 0x7fc110158dd0 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc10ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1100ce470 0x7fc1100ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc10ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1100ce470 0x7fc1100ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33530/0 (socket says 172.21.15.50:33530) 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc10ffff700 1 -- 172.21.15.50:0/545092117 learned_addr learned my addr 172.21.15.50:0/545092117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.238+0000 7fc10f7fe700 1 --2- 172.21.15.50:0/545092117 >> v2:172.21.15.82:3300/0 conn(0x7fc110158dd0 0x7fc1101591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10ffff700 1 -- 172.21.15.50:0/545092117 >> v2:172.21.15.82:3300/0 conn(0x7fc110158dd0 msgr2=0x7fc1101591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10ffff700 1 --2- 172.21.15.50:0/545092117 >> v2:172.21.15.82:3300/0 conn(0x7fc110158dd0 0x7fc1101591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10ffff700 1 -- 172.21.15.50:0/545092117 >> v1:172.21.15.50:6789/0 conn(0x7fc1100b2cf0 legacy=0x7fc1100cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10ffff700 1 -- 172.21.15.50:0/545092117 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100cc390 con 0x7fc1100ce470 2023-12-24T18:51:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10ffff700 1 --2- 172.21.15.50:0/545092117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100ce470 0x7fc1100ce8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc1100cf160 tx=0x7fc108009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca995c670aa2d85 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10e7fc700 1 -- 172.21.15.50:0/545092117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800e070 con 0x7fc1100ce470 2023-12-24T18:51:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10e7fc700 1 -- 172.21.15.50:0/545092117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800ba50 con 0x7fc1100ce470 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc10e7fc700 1 -- 172.21.15.50:0/545092117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080092e0 con 0x7fc1100ce470 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 -- 172.21.15.50:0/545092117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100ce470 msgr2=0x7fc1100ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 --2- 172.21.15.50:0/545092117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100ce470 0x7fc1100ce8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc1100cf160 tx=0x7fc108009840 comp rx=0 tx=0).stop 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 -- 172.21.15.50:0/545092117 shutdown_connections 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 --2- 172.21.15.50:0/545092117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100ce470 0x7fc1100ce8d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 --2- 172.21.15.50:0/545092117 >> v2:172.21.15.82:3300/0 conn(0x7fc110158dd0 0x7fc1101591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 -- 172.21.15.50:0/545092117 >> 172.21.15.50:0/545092117 conn(0x7fc110067b80 msgr2=0x7fc1100cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 -- 172.21.15.50:0/545092117 shutdown_connections 2023-12-24T18:51:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.242+0000 7fc114a0c700 1 -- 172.21.15.50:0/545092117 wait complete. 2023-12-24T18:51:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 Processor -- start 2023-12-24T18:51:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 -- start start 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1100ce470 0x7fc11015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc110158dd0 0x7fc11015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b5b30 con 0x7fc1100b2cf0 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b4f20 con 0x7fc1100ce470 2023-12-24T18:51:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc114a0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b5200 con 0x7fc110158dd0 2023-12-24T18:51:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.246+0000 7fc10f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33534/0 (socket says 172.21.15.50:33534) 2023-12-24T18:51:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 -- 172.21.15.50:0/2670839272 learned_addr learned my addr 172.21.15.50:0/2670839272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10effd700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1100ce470 0x7fc11015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10ffff700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc110158dd0 0x7fc11015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 -- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc110158dd0 msgr2=0x7fc11015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc110158dd0 0x7fc11015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 -- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1100ce470 msgr2=0x7fc11015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1100ce470 0x7fc11015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 -- 172.21.15.50:0/2670839272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108009ae0 con 0x7fc1100b2cf0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc10f7fe700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc10000d860 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000125f0 con 0x7fc1100b2cf0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100012750 con 0x7fc1100b2cf0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100b54e0 con 0x7fc1100b2cf0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100012b10 con 0x7fc1100b2cf0 2023-12-24T18:51:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.250+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1101429b0 con 0x7fc1100b2cf0 2023-12-24T18:51:02.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.254+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11004be40 con 0x7fc1100b2cf0 2023-12-24T18:51:02.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.254+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 25) v1 ==== 80092+0+0 (secure 0 0 0) 0x7fc10001e460 con 0x7fc1100b2cf0 2023-12-24T18:51:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.254+0000 7fc0f77fe700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 0x7fc0fc062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.254+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fc10007d2e0 con 0x7fc1100b2cf0 2023-12-24T18:51:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.254+0000 7fc10effd700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 0x7fc0fc062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.258+0000 7fc10effd700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 0x7fc0fc062b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1100c71c0 tx=0x7fc104007e40 comp rx=0 tx=0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.262+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc100050e70 con 0x7fc1100b2cf0 2023-12-24T18:51:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.454+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 --> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc11006a430 con 0x7fc0fc0606c0 2023-12-24T18:51:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.578+0000 7fc0f77fe700 1 -- 172.21.15.50:0/2670839272 <== mgr.6018 v2:172.21.15.50:6832/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc11006a430 con 0x7fc0fc0606c0 2023-12-24T18:51:02.582 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path snap_test_dir1 2023-12-24T18:51:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.582+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 msgr2=0x7fc0fc062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.582+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 0x7fc0fc062b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1100c71c0 tx=0x7fc104007e40 comp rx=0 tx=0).stop 2023-12-24T18:51:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.582+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 msgr2=0x7fc110142470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.582+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc10000d860 tx=0x7fc100008040 comp rx=0 tx=0).stop 2023-12-24T18:51:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 shutdown_connections 2023-12-24T18:51:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fc0fc0606c0 0x7fc0fc062b70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc110158dd0 0x7fc11015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1100ce470 0x7fc11015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 --2- 172.21.15.50:0/2670839272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1100b2cf0 0x7fc110142470 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 >> 172.21.15.50:0/2670839272 conn(0x7fc110067b80 msgr2=0x7fc1101556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 shutdown_connections 2023-12-24T18:51:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:02.586+0000 7fc114a0c700 1 -- 172.21.15.50:0/2670839272 wait complete. 2023-12-24T18:51:02.609 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-12-24T18:51:02.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:02.609 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:51:02.628 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:51:02.628 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_51_00_UTC 2023-12-24T18:51:02.629 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_50_00_UTC 2023-12-24T18:51:02.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:02.630 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_50_00_UTC) 2023-12-24T18:51:02.704 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_51_00_UTC 2023-12-24T18:51:02.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:02.705 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_51_00_UTC) 2023-12-24T18:51:02.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:02.782 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T18:51:02.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:51:03.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 Processor -- start 2023-12-24T18:51:03.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 -- start start 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00bebc0 0x7ff5f00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5f00bef90 0x7ff5f00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00c9ea0 con 0x7ff5f00ab920 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f015d840 con 0x7ff5f00bef90 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f6ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0161780 con 0x7ff5f00bebc0 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f54e0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff5f00ab920 0x7ff5f0160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41076/0 (socket says 172.21.15.50:41076) 2023-12-24T18:51:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f54e0700 1 -- 172.21.15.50:0/3372491311 learned_addr learned my addr 172.21.15.50:0/3372491311 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:03.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.070+0000 7ff5f5ce1700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00bebc0 0x7ff5f00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/3372491311 >> v2:172.21.15.82:3300/0 conn(0x7ff5f00bef90 0x7ff5f00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f4cdf700 1 -- 172.21.15.50:0/3372491311 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241625665 0 0) 0x7ff5f00c9ea0 con 0x7ff5f00ab920 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f4cdf700 1 -- 172.21.15.50:0/3372491311 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc003570 con 0x7ff5f00ab920 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 -- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00bebc0 msgr2=0x7ff5f00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00bebc0 0x7ff5f00c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 -- 172.21.15.50:0/3372491311 >> v1:172.21.15.50:6789/0 conn(0x7ff5f00ab920 legacy=0x7ff5f0160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 -- 172.21.15.50:0/3372491311 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0161a60 con 0x7ff5f00bef90 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bef90 0x7ff5f00c87d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009e60 tx=0x7ff5e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd97b76710b81c26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f4cdf700 1 -- 172.21.15.50:0/3372491311 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800e070 con 0x7ff5f00bef90 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f4cdf700 1 -- 172.21.15.50:0/3372491311 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800bab0 con 0x7ff5f00bef90 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f4cdf700 1 -- 172.21.15.50:0/3372491311 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800be70 con 0x7ff5f00bef90 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bef90 msgr2=0x7ff5f00c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bef90 0x7ff5f00c87d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009e60 tx=0x7ff5e8009780 comp rx=0 tx=0).stop 2023-12-24T18:51:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/3372491311 shutdown_connections 2023-12-24T18:51:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bef90 0x7ff5f00c87d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/3372491311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00bebc0 0x7ff5f00c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/3372491311 >> 172.21.15.50:0/3372491311 conn(0x7ff5f0067250 msgr2=0x7ff5f0067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/3372491311 shutdown_connections 2023-12-24T18:51:03.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.074+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/3372491311 wait complete. 2023-12-24T18:51:03.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 Processor -- start 2023-12-24T18:51:03.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 -- start start 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00ab920 0x7ff5f01592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bebc0 0x7ff5f00c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00c0400 con 0x7ff5f00bef90 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01597f0 con 0x7ff5f00bebc0 2023-12-24T18:51:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.078+0000 7ff5f6ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00bf7f0 con 0x7ff5f00ab920 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33546/0 (socket says 172.21.15.50:33546) 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 -- 172.21.15.50:0/1199197513 learned_addr learned my addr 172.21.15.50:0/1199197513 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f5ce1700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00ab920 0x7ff5f01592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f54e0700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bebc0 0x7ff5f00c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 -- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00ab920 msgr2=0x7ff5f01592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00ab920 0x7ff5f01592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 -- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bebc0 msgr2=0x7ff5f00c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bebc0 0x7ff5f00c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 -- 172.21.15.50:0/1199197513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009a20 con 0x7ff5f00bef90 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f64e2700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00c9540 tx=0x7ff5e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8012e10 con 0x7ff5f00bef90 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8027470 con 0x7ff5f00bef90 2023-12-24T18:51:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f00bfad0 con 0x7ff5f00bef90 2023-12-24T18:51:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8027830 con 0x7ff5f00bef90 2023-12-24T18:51:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.082+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f00c0090 con 0x7ff5f00bef90 2023-12-24T18:51:03.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.086+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f00c0570 con 0x7ff5f00bef90 2023-12-24T18:51:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.086+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 25) v1 ==== 80092+0+0 (secure 0 0 0) 0x7ff5e8024070 con 0x7ff5f00bef90 2023-12-24T18:51:03.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.090+0000 7ff5e5ffb700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 0x7ff5d4062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:03.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.090+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7ff5e807f800 con 0x7ff5f00bef90 2023-12-24T18:51:03.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.090+0000 7ff5f5ce1700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 0x7ff5d4062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:03.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.090+0000 7ff5f5ce1700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 0x7ff5d4062b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009db0 tx=0x7ff5ec0091a0 comp rx=0 tx=0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:03.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.094+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff5e804f860 con 0x7ff5f00bef90 2023-12-24T18:51:03.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.302+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff5f004be40 con 0x7ff5f00bef90 2023-12-24T18:51:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.622+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7ff5e8003040 con 0x7ff5f00bef90 2023-12-24T18:51:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.626+0000 7ff5e5ffb700 1 -- 172.21.15.50:0/1199197513 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v26) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff5e8064dc0 con 0x7ff5f00bef90 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 msgr2=0x7ff5d4062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 0x7ff5d4062b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009db0 tx=0x7ff5ec0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 msgr2=0x7ff5f015c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00c9540 tx=0x7ff5e8019000 comp rx=0 tx=0).stop 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 shutdown_connections 2023-12-24T18:51:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7ff5d40606c0 0x7ff5d4062b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5f00bef90 0x7ff5f015c350 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f00bebc0 0x7ff5f00c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 --2- 172.21.15.50:0/1199197513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5f00ab920 0x7ff5f01592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 >> 172.21.15.50:0/1199197513 conn(0x7ff5f0067250 msgr2=0x7ff5f006aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 shutdown_connections 2023-12-24T18:51:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.630+0000 7ff5f6ce3700 1 -- 172.21.15.50:0/1199197513 wait complete. 2023-12-24T18:51:03.654 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:51:03.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:03.704 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:03.741 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:51:03.741 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:51:03.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:03.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:03.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:51:03.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:03.798 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:51:03.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:03.818 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:03.815+0000 7efdeff21000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:03.827 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:03.826+0000 7f292b7c8000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.994+0000 7f6133c6e700 1 Processor -- start 2023-12-24T18:51:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6133c6e700 1 -- start start 2023-12-24T18:51:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6133c6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c06a760 0x7f612c06ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6133c6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c15d660 con 0x7f612c158bc0 2023-12-24T18:51:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6133c6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c15cda0 con 0x7f612c0c54d0 2023-12-24T18:51:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6133c6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c15d010 con 0x7f612c06a760 2023-12-24T18:51:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6131209700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f612c158bc0 0x7f612c159010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41086/0 (socket says 172.21.15.50:41086) 2023-12-24T18:51:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6131209700 1 -- 172.21.15.50:0/1004689908 learned_addr learned my addr 172.21.15.50:0/1004689908 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6131a0a700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c06a760 0x7f612c06ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172381007 0 0) 0x7f612c15d660 con 0x7f612c158bc0 2023-12-24T18:51:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:03.998+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6118003570 con 0x7f612c158bc0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512665975 0 0) 0x7f612c15cda0 con 0x7f612c0c54d0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f612c15d660 con 0x7f612c0c54d0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352190116 0 0) 0x7f6118003570 con 0x7f612c158bc0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c06a760 msgr2=0x7f612c06ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c06a760 0x7f612c06ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 >> v1:172.21.15.82:6789/0 conn(0x7f612c0c54d0 legacy=0x7f612c0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c15d2f0 con 0x7f612c158bc0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f611c001470 con 0x7f612c158bc0 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 >> v1:172.21.15.50:6789/0 conn(0x7f612c158bc0 legacy=0x7f612c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6118003c20 0x7f6118004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118004810 0x7f6118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180051c0 0x7f611800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c15d010 con 0x7f61180051c0 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611800c020 con 0x7f6118003c20 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611800c1e0 con 0x7f6118004810 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180051c0 0x7f611800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6131209700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118004810 0x7f6118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6131a0a700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6118003c20 0x7f6118004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 -- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118004810 msgr2=0x7f6118004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118004810 0x7f6118004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 -- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6118003c20 msgr2=0x7f6118004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6118003c20 0x7f6118004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 -- 172.21.15.50:0/1004689908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118003570 con 0x7f61180051c0 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6131209700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118004810 0x7f6118004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6131a0a700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6118003c20 0x7f6118004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180051c0 0x7f611800ba60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6124002120 tx=0x7f61240017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3efbfc0f292745 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124001ab0 con 0x7f61180051c0 2023-12-24T18:51:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612400c980 con 0x7f61180051c0 2023-12-24T18:51:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6130a08700 1 -- 172.21.15.50:0/1004689908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400cd20 con 0x7f61180051c0 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 -- 172.21.15.50:0/1004689908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180051c0 msgr2=0x7f611800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 --2- 172.21.15.50:0/1004689908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180051c0 0x7f611800ba60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6124002120 tx=0x7f61240017a0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f613220b700 1 -- 172.21.15.50:0/1004689908 reap_dead start 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 -- 172.21.15.50:0/1004689908 shutdown_connections 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 -- 172.21.15.50:0/1004689908 >> 172.21.15.50:0/1004689908 conn(0x7f612c067b80 msgr2=0x7f612c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 -- 172.21.15.50:0/1004689908 shutdown_connections 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.002+0000 7f6133c6e700 1 -- 172.21.15.50:0/1004689908 wait complete. 2023-12-24T18:51:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 Processor -- start 2023-12-24T18:51:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 -- start start 2023-12-24T18:51:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180051c0 0x7f612c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c0b2de0 0x7f612c0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0b3e80 con 0x7f612c0b4310 2023-12-24T18:51:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c156270 con 0x7f61180051c0 2023-12-24T18:51:04.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.006+0000 7f6133c6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0b3270 con 0x7f612c0b2de0 2023-12-24T18:51:04.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6131a0a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180051c0 0x7f612c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33596/0 (socket says 172.21.15.50:33596) 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 -- 172.21.15.50:0/2280549854 learned_addr learned my addr 172.21.15.50:0/2280549854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6131209700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c0b2de0 0x7f612c0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c0b2de0 msgr2=0x7f612c0b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c0b2de0 0x7f612c0b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180051c0 msgr2=0x7f612c155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180051c0 0x7f612c155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 -- 172.21.15.50:0/2280549854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0b3550 con 0x7f612c0b4310 2023-12-24T18:51:04.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f613220b700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f612400c6a0 tx=0x7f6124016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124001ab0 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124012e90 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400c6d0 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c0b3830 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.010+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c144e30 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c0b4030 con 0x7f612c0b4310 2023-12-24T18:51:04.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f6124025030 con 0x7f612c0b4310 2023-12-24T18:51:04.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6121ffb700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 0x7f6110062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f612407edb0 con 0x7f612c0b4310 2023-12-24T18:51:04.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6131a0a700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 msgr2=0x7f6110062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:04.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.014+0000 7f6131a0a700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 0x7f6110062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:04.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.022+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f612c0b4030 con 0x7f612c0b4310 2023-12-24T18:51:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.218+0000 7f6131a0a700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 msgr2=0x7f6110062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.218+0000 7f6131a0a700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 0x7f6110062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.238+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f612c0652e0 con 0x7f612c0b4310 2023-12-24T18:51:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.238+0000 7f6121ffb700 1 -- 172.21.15.50:0/2280549854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f612402d070 con 0x7f612c0b4310 2023-12-24T18:51:04.239 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:04.239 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 msgr2=0x7f6110062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 0x7f6110062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 msgr2=0x7f612c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f612400c6a0 tx=0x7f6124016000 comp rx=0 tx=0).stop 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 shutdown_connections 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6110060670 0x7f6110062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f612c0b4310 0x7f612c0b47b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f612c0b2de0 0x7f612c0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 --2- 172.21.15.50:0/2280549854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180051c0 0x7f612c155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 >> 172.21.15.50:0/2280549854 conn(0x7f612c067b80 msgr2=0x7f612c0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 shutdown_connections 2023-12-24T18:51:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.242+0000 7f6133c6e700 1 -- 172.21.15.50:0/2280549854 wait complete. 2023-12-24T18:51:04.245 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:51:04.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:04.373 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:04.371+0000 7efdeff21000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:04.412 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:04.410+0000 7f292b7c8000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.422+0000 7f224ce78700 1 Processor -- start 2023-12-24T18:51:04.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.422+0000 7f224ce78700 1 -- start start 2023-12-24T18:51:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f224815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 0x7f224806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22480b1ba0 0x7f22480b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480b49c0 con 0x7f22480b1ba0 2023-12-24T18:51:04.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224806d040 con 0x7f22480b3c90 2023-12-24T18:51:04.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224ce78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22480b2560 con 0x7f2248158e10 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2246d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22480b1ba0 0x7f22480b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2246d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22480b1ba0 0x7f22480b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33604/0 (socket says 172.21.15.50:33604) 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2246d9d700 1 -- 172.21.15.50:0/436952740 learned_addr learned my addr 172.21.15.50:0/436952740 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2245d9b700 1 --2- 172.21.15.50:0/436952740 >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 0x7f224806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f224659c700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f224815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2246d9d700 1 -- 172.21.15.50:0/436952740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 msgr2=0x7f224815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.426+0000 7f2246d9d700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f224815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f2246d9d700 1 -- 172.21.15.50:0/436952740 >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 msgr2=0x7f224806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f2246d9d700 1 --2- 172.21.15.50:0/436952740 >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 0x7f224806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f2246d9d700 1 -- 172.21.15.50:0/436952740 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224806d5c0 con 0x7f22480b1ba0 2023-12-24T18:51:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f2245d9b700 1 --2- 172.21.15.50:0/436952740 >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 0x7f224806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f2246d9d700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1ba0 0x7f22480b2020 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2248069250 tx=0x7f2240009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c40a2e7fe0d96c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224559a700 1 -- 172.21.15.50:0/436952740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000e070 con 0x7f22480b1ba0 2023-12-24T18:51:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224559a700 1 -- 172.21.15.50:0/436952740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224000ba50 con 0x7f22480b1ba0 2023-12-24T18:51:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224559a700 1 -- 172.21.15.50:0/436952740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400092e0 con 0x7f22480b1ba0 2023-12-24T18:51:04.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 -- 172.21.15.50:0/436952740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1ba0 msgr2=0x7f22480b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1ba0 0x7f22480b2020 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2248069250 tx=0x7f2240009840 comp rx=0 tx=0).stop 2023-12-24T18:51:04.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 -- 172.21.15.50:0/436952740 shutdown_connections 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 --2- 172.21.15.50:0/436952740 >> v2:172.21.15.82:3300/0 conn(0x7f22480b3c90 0x7f224806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1ba0 0x7f22480b2020 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 --2- 172.21.15.50:0/436952740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f224815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 -- 172.21.15.50:0/436952740 >> 172.21.15.50:0/436952740 conn(0x7f22480670b0 msgr2=0x7f22480674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 -- 172.21.15.50:0/436952740 shutdown_connections 2023-12-24T18:51:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.430+0000 7f224ce78700 1 -- 172.21.15.50:0/436952740 wait complete. 2023-12-24T18:51:04.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 Processor -- start 2023-12-24T18:51:04.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 -- start start 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480b1ba0 0x7f22480a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f2248168b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248152b80 con 0x7f22480b3c90 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224815cb40 con 0x7f22480b1ba0 2023-12-24T18:51:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224ce78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224815bcd0 con 0x7f2248158e10 2023-12-24T18:51:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f224659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480b1ba0 0x7f22480a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33612/0 (socket says 172.21.15.50:33612) 2023-12-24T18:51:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 -- 172.21.15.50:0/672652164 learned_addr learned my addr 172.21.15.50:0/672652164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2246d9d700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f2248168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 -- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 msgr2=0x7f2248168b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f2248168b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 -- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480b1ba0 msgr2=0x7f22480a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480b1ba0 0x7f22480a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 -- 172.21.15.50:0/672652164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240009ae0 con 0x7f22480b3c90 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.434+0000 7f2245d9b700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f223000e8d0 tx=0x7f2230008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230013410 con 0x7f22480b3c90 2023-12-24T18:51:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230013570 con 0x7f22480b3c90 2023-12-24T18:51:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224815cfd0 con 0x7f22480b3c90 2023-12-24T18:51:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230013910 con 0x7f22480b3c90 2023-12-24T18:51:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224815c210 con 0x7f22480b3c90 2023-12-24T18:51:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.438+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22480652e0 con 0x7f22480b3c90 2023-12-24T18:51:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.442+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f2230013d00 con 0x7f22480b3c90 2023-12-24T18:51:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.442+0000 7f223e7fc700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 0x7f2228062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.442+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f223007cc10 con 0x7f22480b3c90 2023-12-24T18:51:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.442+0000 7f224659c700 1 -- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 msgr2=0x7f2228062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.442+0000 7f224659c700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 0x7f2228062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.446+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f223004cb60 con 0x7f22480b3c90 2023-12-24T18:51:04.454 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:04.451+0000 7efdeff21000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:04.496 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:04.494+0000 7f292b7c8000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:04.596 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:04.591+0000 7efdeff21000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:04.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.626+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f224806ca20 con 0x7f22480b3c90 2023-12-24T18:51:04.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.626+0000 7f223e7fc700 1 -- 172.21.15.50:0/672652164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16498 (secure 0 0 0) 0x7f2230020090 con 0x7f22480b3c90 2023-12-24T18:51:04.629 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:04.630 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:50:21.666741+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3631433410":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/4285504704":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/1012194613":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/3584600883":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6833/33814":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6832/33814":"2023-12-25T18:49:20.357006+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 msgr2=0x7f2228062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 0x7f2228062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 msgr2=0x7f224815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f223000e8d0 tx=0x7f2230008040 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 shutdown_connections 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f2228060670 0x7f2228062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2248158e10 0x7f2248168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b3c90 0x7f224815b790 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 --2- 172.21.15.50:0/672652164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480b1ba0 0x7f22480a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 >> 172.21.15.50:0/672652164 conn(0x7f22480670b0 msgr2=0x7f2248156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 shutdown_connections 2023-12-24T18:51:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.630+0000 7f224ce78700 1 -- 172.21.15.50:0/672652164 wait complete. 2023-12-24T18:51:04.649 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:04.646+0000 7f292b7c8000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:49:03.798044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:49:05.200685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:51:04.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:51:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.822+0000 7f6eb31c5700 1 Processor -- start 2023-12-24T18:51:04.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.822+0000 7f6eb31c5700 1 -- start start 2023-12-24T18:51:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb31c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6eac06ae20 0x7f6eac0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb31c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0b3fd0 con 0x7f6eac06c820 2023-12-24T18:51:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb31c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0b33c0 con 0x7f6eac158e00 2023-12-24T18:51:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb31c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0b36a0 con 0x7f6eac06ae20 2023-12-24T18:51:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eabfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6eac06ae20 0x7f6eac0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb1762700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6eac06c820 0x7f6eac162c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41094/0 (socket says 172.21.15.50:41094) 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eb1762700 1 -- 172.21.15.50:0/4270326449 learned_addr learned my addr 172.21.15.50:0/4270326449 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eabfff700 1 -- 172.21.15.50:0/4270326449 >> v1:172.21.15.82:6789/0 conn(0x7f6eac158e00 legacy=0x7f6eac06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eabfff700 1 -- 172.21.15.50:0/4270326449 >> v1:172.21.15.50:6789/0 conn(0x7f6eac06c820 legacy=0x7f6eac162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eab7fe700 1 -- 172.21.15.50:0/4270326449 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521540887 0 0) 0x7f6eac0b33c0 con 0x7f6eac158e00 2023-12-24T18:51:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eabfff700 1 -- 172.21.15.50:0/4270326449 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0b3980 con 0x7f6eac06ae20 2023-12-24T18:51:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eabfff700 1 --2- 172.21.15.50:0/4270326449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac0b2de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6e980098e0 tx=0x7f6e980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc03051484b2f65 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.826+0000 7f6eab7fe700 1 -- 172.21.15.50:0/4270326449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98009e80 con 0x7f6eac06ae20 2023-12-24T18:51:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eab7fe700 1 -- 172.21.15.50:0/4270326449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9800b760 con 0x7f6eac06ae20 2023-12-24T18:51:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eab7fe700 1 -- 172.21.15.50:0/4270326449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800bae0 con 0x7f6eac06ae20 2023-12-24T18:51:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- 172.21.15.50:0/4270326449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 msgr2=0x7f6eac0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/4270326449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac0b2de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6e980098e0 tx=0x7f6e980091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- 172.21.15.50:0/4270326449 shutdown_connections 2023-12-24T18:51:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/4270326449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac0b2de0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- 172.21.15.50:0/4270326449 >> 172.21.15.50:0/4270326449 conn(0x7f6eac067b80 msgr2=0x7f6eac0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- 172.21.15.50:0/4270326449 shutdown_connections 2023-12-24T18:51:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- 172.21.15.50:0/4270326449 wait complete. 2023-12-24T18:51:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 Processor -- start 2023-12-24T18:51:04.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.830+0000 7f6eb31c5700 1 -- start start 2023-12-24T18:51:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eac06c820 0x7f6eac14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6eac158e00 0x7f6eac14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b10e0 con 0x7f6eac06ae20 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac171070 con 0x7f6eac06c820 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b1380 con 0x7f6eac158e00 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33624/0 (socket says 172.21.15.50:33624) 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 -- 172.21.15.50:0/231501242 learned_addr learned my addr 172.21.15.50:0/231501242 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eabfff700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eac06c820 0x7f6eac14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb1762700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6eac158e00 0x7f6eac14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 -- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6eac158e00 msgr2=0x7f6eac14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6eac158e00 0x7f6eac14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 -- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eac06c820 msgr2=0x7f6eac14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eac06c820 0x7f6eac14d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 -- 172.21.15.50:0/231501242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98009420 con 0x7f6eac06ae20 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb0f61700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c530 tx=0x7f6ea000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011590 con 0x7f6eac06ae20 2023-12-24T18:51:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea00116f0 con 0x7f6eac06ae20 2023-12-24T18:51:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011ab0 con 0x7f6eac06ae20 2023-12-24T18:51:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac171280 con 0x7f6eac06ae20 2023-12-24T18:51:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.834+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac171840 con 0x7f6eac06ae20 2023-12-24T18:51:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac0652e0 con 0x7f6eac06ae20 2023-12-24T18:51:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f6ea001b3b0 con 0x7f6eac06ae20 2023-12-24T18:51:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6ea8ff9700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 0x7f6e90062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6eabfff700 1 -- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 msgr2=0x7f6e90062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f6ea007c360 con 0x7f6eac06ae20 2023-12-24T18:51:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.838+0000 7f6eabfff700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 0x7f6e90062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:04.846+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ea004c3c0 con 0x7f6eac06ae20 2023-12-24T18:51:04.874 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:04.871+0000 7efdeff21000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:04.934 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:04.934+0000 7f292b7c8000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:04.950 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:04.947+0000 7efdeff21000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:05.011 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:05.010+0000 7f292b7c8000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.018+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6eac0b3c60 con 0x7f6eac06ae20 2023-12-24T18:51:05.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6ea8ff9700 1 -- 172.21.15.50:0/231501242 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ea00170a0 con 0x7f6eac06ae20 2023-12-24T18:51:05.022 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 msgr2=0x7f6e90062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 0x7f6e90062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 msgr2=0x7f6eac170b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c530 tx=0x7f6ea000c8f0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 shutdown_connections 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f6e90060670 0x7f6e90062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6eac158e00 0x7f6eac14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eac06c820 0x7f6eac14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 --2- 172.21.15.50:0/231501242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eac06ae20 0x7f6eac170b30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 >> 172.21.15.50:0/231501242 conn(0x7f6eac067b80 msgr2=0x7f6eac159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 shutdown_connections 2023-12-24T18:51:05.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.022+0000 7f6eb31c5700 1 -- 172.21.15.50:0/231501242 wait complete. 2023-12-24T18:51:05.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:51:05.175 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:05.171+0000 7efdeff21000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 Processor -- start 2023-12-24T18:51:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 -- start start 2023-12-24T18:51:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 0x7f92d40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40b3fd0 con 0x7f92d406ae20 2023-12-24T18:51:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40b33c0 con 0x7f92d4158e00 2023-12-24T18:51:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92db6cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b36a0 con 0x7f92d406c820 2023-12-24T18:51:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92d8c68700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92d406ae20 0x7f92d4160c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41098/0 (socket says 172.21.15.50:41098) 2023-12-24T18:51:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92d8c68700 1 -- 172.21.15.50:0/2101324339 learned_addr learned my addr 172.21.15.50:0/2101324339 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.202+0000 7f92d9c6a700 1 --2- 172.21.15.50:0/2101324339 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 0x7f92d40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366221241 0 0) 0x7f92d40b33c0 con 0x7f92d4158e00 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c0003570 con 0x7f92d4158e00 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019128139 0 0) 0x7f92d40b3fd0 con 0x7f92d406ae20 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d40b33c0 con 0x7f92d406ae20 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92d9c6a700 1 -- 172.21.15.50:0/2101324339 >> v1:172.21.15.82:6789/0 conn(0x7f92d4158e00 legacy=0x7f92d406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92d9c6a700 1 -- 172.21.15.50:0/2101324339 >> v1:172.21.15.50:6789/0 conn(0x7f92d406ae20 legacy=0x7f92d4160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92d9c6a700 1 -- 172.21.15.50:0/2101324339 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40b3980 con 0x7f92d406c820 2023-12-24T18:51:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92d9c6a700 1 --2- 172.21.15.50:0/2101324339 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 0x7f92d40b2de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009e90 tx=0x7f92cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3f225478d28f25 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00e070 con 0x7f92d406c820 2023-12-24T18:51:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00bb80 con 0x7f92d406c820 2023-12-24T18:51:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92cbfff700 1 -- 172.21.15.50:0/2101324339 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc012430 con 0x7f92d406c820 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 -- 172.21.15.50:0/2101324339 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 msgr2=0x7f92d40b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 --2- 172.21.15.50:0/2101324339 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 0x7f92d40b2de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009e90 tx=0x7f92cc009780 comp rx=0 tx=0).stop 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 -- 172.21.15.50:0/2101324339 shutdown_connections 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 --2- 172.21.15.50:0/2101324339 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406c820 0x7f92d40b2de0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 -- 172.21.15.50:0/2101324339 >> 172.21.15.50:0/2101324339 conn(0x7f92d4067b80 msgr2=0x7f92d40cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 -- 172.21.15.50:0/2101324339 shutdown_connections 2023-12-24T18:51:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.206+0000 7f92db6cd700 1 -- 172.21.15.50:0/2101324339 wait complete. 2023-12-24T18:51:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.210+0000 7f92db6cd700 1 Processor -- start 2023-12-24T18:51:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.210+0000 7f92db6cd700 1 -- start start 2023-12-24T18:51:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406ae20 0x7f92d4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 0x7f92d40ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 0x7f92d40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40aafe0 con 0x7f92d4158e00 2023-12-24T18:51:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4152bb0 con 0x7f92d406c820 2023-12-24T18:51:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40aa480 con 0x7f92d406ae20 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d9c6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 0x7f92d40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 0x7f92d40ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d9c6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 0x7f92d40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33636/0 (socket says 172.21.15.50:33636) 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d9c6a700 1 -- 172.21.15.50:0/3495857958 learned_addr learned my addr 172.21.15.50:0/3495857958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d9469700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406ae20 0x7f92d4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 -- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406ae20 msgr2=0x7f92d4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406ae20 0x7f92d4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 -- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 msgr2=0x7f92d40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 0x7f92d40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 -- 172.21.15.50:0/3495857958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc009a20 con 0x7f92d406c820 2023-12-24T18:51:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92d8c68700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 0x7f92d40ad9d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f92d406b220 tx=0x7f92c4007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4005b30 con 0x7f92d406c820 2023-12-24T18:51:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4005cb0 con 0x7f92d406c820 2023-12-24T18:51:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4007320 con 0x7f92d406c820 2023-12-24T18:51:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40ab280 con 0x7f92d406c820 2023-12-24T18:51:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.214+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40ab840 con 0x7f92d406c820 2023-12-24T18:51:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d40aba30 con 0x7f92d406c820 2023-12-24T18:51:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f92c401b3b0 con 0x7f92d406c820 2023-12-24T18:51:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92c97fa700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 0x7f92b8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f92c407c160 con 0x7f92d406c820 2023-12-24T18:51:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92d9469700 1 -- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 msgr2=0x7f92b8062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.218+0000 7f92d9469700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 0x7f92b8062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.230+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f92c404c1c0 con 0x7f92d406c820 2023-12-24T18:51:05.256 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:05.251+0000 7efdeff21000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:05.259 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:05.258+0000 7f292b7c8000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:05.354 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:05.354+0000 7f292b7c8000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:05.355 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:05.351+0000 7efdeff21000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:05.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.406+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92d40652e0 con 0x7f92d406c820 2023-12-24T18:51:05.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.406+0000 7f92c97fa700 1 -- 172.21.15.50:0/3495857958 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92c404f7e0 con 0x7f92d406c820 2023-12-24T18:51:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:51:05.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 msgr2=0x7f92b8062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:05.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 0x7f92b8062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 msgr2=0x7f92d40ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 0x7f92d40ad9d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f92d406b220 tx=0x7f92c4007d50 comp rx=0 tx=0).stop 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 shutdown_connections 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f92b80606a0 0x7f92b8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d4158e00 0x7f92d40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d406c820 0x7f92d40ad9d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 --2- 172.21.15.50:0/3495857958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d406ae20 0x7f92d4152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 >> 172.21.15.50:0/3495857958 conn(0x7f92d4067b80 msgr2=0x7f92d415b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 shutdown_connections 2023-12-24T18:51:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.410+0000 7f92db6cd700 1 -- 172.21.15.50:0/3495857958 wait complete. 2023-12-24T18:51:05.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:51:05.443 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:05.442+0000 7f292b7c8000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.602+0000 7fe87ece3700 1 Processor -- start 2023-12-24T18:51:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.602+0000 7fe87ece3700 1 -- start start 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.602+0000 7fe87ece3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe878158c50 0x7fe8780afca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ece3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780ce020 con 0x7fe878159020 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ece3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780cb700 con 0x7fe8780cc770 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ece3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780cae60 con 0x7fe878158c50 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87d4e0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe878159020 0x7fe8780ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41108/0 (socket says 172.21.15.50:41108) 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87d4e0700 1 -- 172.21.15.50:0/3989284735 learned_addr learned my addr 172.21.15.50:0/3989284735 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87dce1700 1 --2- 172.21.15.50:0/3989284735 >> v2:172.21.15.82:3300/0 conn(0x7fe878158c50 0x7fe8780afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276088461 0 0) 0x7fe8780ce020 con 0x7fe878159020 2023-12-24T18:51:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe864003570 con 0x7fe878159020 2023-12-24T18:51:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609590368 0 0) 0x7fe870001110 con 0x7fe8780cc770 2023-12-24T18:51:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8780ce020 con 0x7fe8780cc770 2023-12-24T18:51:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87dce1700 1 -- 172.21.15.50:0/3989284735 >> v1:172.21.15.82:6789/0 conn(0x7fe8780cc770 legacy=0x7fe8780ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87dce1700 1 -- 172.21.15.50:0/3989284735 >> v1:172.21.15.50:6789/0 conn(0x7fe878159020 legacy=0x7fe8780ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87dce1700 1 -- 172.21.15.50:0/3989284735 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780cb140 con 0x7fe878158c50 2023-12-24T18:51:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87dce1700 1 --2- 172.21.15.50:0/3989284735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878158c50 0x7fe8780afca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe874009e60 tx=0x7fe874009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19899098c6f706 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87400e070 con 0x7fe878158c50 2023-12-24T18:51:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87400bab0 con 0x7fe878158c50 2023-12-24T18:51:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ccdf700 1 -- 172.21.15.50:0/3989284735 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87400be70 con 0x7fe878158c50 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ece3700 1 -- 172.21.15.50:0/3989284735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878158c50 msgr2=0x7fe8780afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.606+0000 7fe87ece3700 1 --2- 172.21.15.50:0/3989284735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878158c50 0x7fe8780afca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe874009e60 tx=0x7fe874009780 comp rx=0 tx=0).stop 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 -- 172.21.15.50:0/3989284735 shutdown_connections 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 --2- 172.21.15.50:0/3989284735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878158c50 0x7fe8780afca0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 -- 172.21.15.50:0/3989284735 >> 172.21.15.50:0/3989284735 conn(0x7fe8780670b0 msgr2=0x7fe8780674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 -- 172.21.15.50:0/3989284735 shutdown_connections 2023-12-24T18:51:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 -- 172.21.15.50:0/3989284735 wait complete. 2023-12-24T18:51:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 Processor -- start 2023-12-24T18:51:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.610+0000 7fe87ece3700 1 -- start start 2023-12-24T18:51:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8780cc770 0x7fe8780b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878159020 0x7fe8780c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878159fb0 con 0x7fe878158c50 2023-12-24T18:51:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780b5350 con 0x7fe878159020 2023-12-24T18:51:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878159680 con 0x7fe8780cc770 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33640/0 (socket says 172.21.15.50:33640) 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 -- 172.21.15.50:0/1741377767 learned_addr learned my addr 172.21.15.50:0/1741377767 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87e4e2700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878159020 0x7fe8780c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87dce1700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8780cc770 0x7fe8780b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8780cc770 msgr2=0x7fe8780b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8780cc770 0x7fe8780b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878159020 msgr2=0x7fe8780c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878159020 0x7fe8780c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 -- 172.21.15.50:0/1741377767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874009a20 con 0x7fe878158c50 2023-12-24T18:51:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87d4e0700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7c0 tx=0x7fe868007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868005b30 con 0x7fe878158c50 2023-12-24T18:51:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868005c90 con 0x7fe878158c50 2023-12-24T18:51:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868007300 con 0x7fe878158c50 2023-12-24T18:51:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.614+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878159960 con 0x7fe878158c50 2023-12-24T18:51:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.618+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8780b55d0 con 0x7fe878158c50 2023-12-24T18:51:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.618+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87804be40 con 0x7fe878158c50 2023-12-24T18:51:05.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.618+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fe86801b3b0 con 0x7fe878158c50 2023-12-24T18:51:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.622+0000 7fe86dffb700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 0x7fe85c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.622+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fe86807c140 con 0x7fe878158c50 2023-12-24T18:51:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.622+0000 7fe87dce1700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 msgr2=0x7fe85c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.622+0000 7fe87dce1700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 0x7fe85c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:05.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.630+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe86804fcd0 con 0x7fe878158c50 2023-12-24T18:51:05.772 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:05.767+0000 7efdeff21000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.822+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8780cb420 con 0x7fe878158c50 2023-12-24T18:51:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.822+0000 7fe86dffb700 1 -- 172.21.15.50:0/1741377767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe86804f860 con 0x7fe878158c50 2023-12-24T18:51:05.823 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:51:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87dce1700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 msgr2=0x7fe85c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87dce1700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 0x7fe85c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 msgr2=0x7fe85c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 0x7fe85c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 msgr2=0x7fe878156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7c0 tx=0x7fe868007ea0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 shutdown_connections 2023-12-24T18:51:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7fe85c060670 0x7fe85c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878159020 0x7fe8780c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe878158c50 0x7fe878156710 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 --2- 172.21.15.50:0/1741377767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8780cc770 0x7fe8780b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 >> 172.21.15.50:0/1741377767 conn(0x7fe8780670b0 msgr2=0x7fe87806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 shutdown_connections 2023-12-24T18:51:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:05.826+0000 7fe87ece3700 1 -- 172.21.15.50:0/1741377767 wait complete. 2023-12-24T18:51:05.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:05.874 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:05.874+0000 7f292b7c8000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:05.962 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:05.959+0000 7efdeff21000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 Processor -- start 2023-12-24T18:51:06.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 -- start start 2023-12-24T18:51:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f856c158e10 0x7f856c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f856c0b1ba0 0x7f856c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c06d5c0 con 0x7f856c0b3c90 2023-12-24T18:51:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0b49c0 con 0x7f856c0b1ba0 2023-12-24T18:51:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f8571eae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c06d040 con 0x7f856c158e10 2023-12-24T18:51:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f856bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f856c0b1ba0 0x7f856c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f856bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f856c0b1ba0 0x7f856c0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33654/0 (socket says 172.21.15.50:33654) 2023-12-24T18:51:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f856bfff700 1 -- 172.21.15.50:0/470840137 learned_addr learned my addr 172.21.15.50:0/470840137 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.038+0000 7f856b7fe700 1 --2- 172.21.15.50:0/470840137 >> v2:172.21.15.82:3300/0 conn(0x7f856c158e10 0x7f856c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856bfff700 1 -- 172.21.15.50:0/470840137 >> v2:172.21.15.82:3300/0 conn(0x7f856c158e10 msgr2=0x7f856c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856bfff700 1 --2- 172.21.15.50:0/470840137 >> v2:172.21.15.82:3300/0 conn(0x7f856c158e10 0x7f856c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856bfff700 1 -- 172.21.15.50:0/470840137 >> v1:172.21.15.50:6789/0 conn(0x7f856c0b3c90 legacy=0x7f856c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856a7fc700 1 -- 172.21.15.50:0/470840137 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656778630 0 0) 0x7f856c06d5c0 con 0x7f856c0b3c90 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856bfff700 1 -- 172.21.15.50:0/470840137 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0b2520 con 0x7f856c0b1ba0 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856bfff700 1 --2- 172.21.15.50:0/470840137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b1ba0 0x7f856c0b1fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f856c068410 tx=0x7f8564009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50ee68d764cdae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856a7fc700 1 -- 172.21.15.50:0/470840137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400e070 con 0x7f856c0b1ba0 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856a7fc700 1 -- 172.21.15.50:0/470840137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400ba20 con 0x7f856c0b1ba0 2023-12-24T18:51:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f856a7fc700 1 -- 172.21.15.50:0/470840137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640092e0 con 0x7f856c0b1ba0 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 -- 172.21.15.50:0/470840137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b1ba0 msgr2=0x7f856c0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 --2- 172.21.15.50:0/470840137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b1ba0 0x7f856c0b1fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f856c068410 tx=0x7f8564009840 comp rx=0 tx=0).stop 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 -- 172.21.15.50:0/470840137 shutdown_connections 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 --2- 172.21.15.50:0/470840137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b1ba0 0x7f856c0b1fe0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 --2- 172.21.15.50:0/470840137 >> v2:172.21.15.82:3300/0 conn(0x7f856c158e10 0x7f856c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 -- 172.21.15.50:0/470840137 >> 172.21.15.50:0/470840137 conn(0x7f856c0670b0 msgr2=0x7f856c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 -- 172.21.15.50:0/470840137 shutdown_connections 2023-12-24T18:51:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.042+0000 7f8571eae700 1 -- 172.21.15.50:0/470840137 wait complete. 2023-12-24T18:51:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 Processor -- start 2023-12-24T18:51:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 -- start start 2023-12-24T18:51:06.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f856c0b1ba0 0x7f856c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 0x7f856c16d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c1591e0 con 0x7f856c0b3c90 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c1597a0 con 0x7f856c158e10 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f8571eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c16e180 con 0x7f856c0b1ba0 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33670/0 (socket says 172.21.15.50:33670) 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 -- 172.21.15.50:0/1330990373 learned_addr learned my addr 172.21.15.50:0/1330990373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856b7fe700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f856c0b1ba0 0x7f856c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856bfff700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 0x7f856c16d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f856c0b1ba0 msgr2=0x7f856c159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f856c0b1ba0 0x7f856c159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 msgr2=0x7f856c16d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 0x7f856c16d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856affd700 1 -- 172.21.15.50:0/1330990373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009ae0 con 0x7f856c0b3c90 2023-12-24T18:51:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.046+0000 7f856bfff700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 0x7f856c16d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f856affd700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f856000c7e0 tx=0x7f8560007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560012700 con 0x7f856c0b3c90 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560012880 con 0x7f856c0b3c90 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560012c40 con 0x7f856c0b3c90 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c16e460 con 0x7f856c0b3c90 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c15d050 con 0x7f856c0b3c90 2023-12-24T18:51:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.050+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c159910 con 0x7f856c0b3c90 2023-12-24T18:51:06.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f856001b400 con 0x7f856c0b3c90 2023-12-24T18:51:06.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f85537fe700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 0x7f8558062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f856007c900 con 0x7f856c0b3c90 2023-12-24T18:51:06.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f856b7fe700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 msgr2=0x7f8558062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:06.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f856b7fe700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 0x7f8558062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:06.057 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.054+0000 7f292b7c8000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.062+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f856004ca00 con 0x7f856c0b3c90 2023-12-24T18:51:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.258+0000 7f856b7fe700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 msgr2=0x7f8558062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.258+0000 7f856b7fe700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 0x7f8558062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.270+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f856c0652e0 con 0x7f856c0b3c90 2023-12-24T18:51:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.270+0000 7f85537fe700 1 -- 172.21.15.50:0/1330990373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f856007ae60 con 0x7f856c0b3c90 2023-12-24T18:51:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:06.273 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 msgr2=0x7f8558062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 0x7f8558062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 msgr2=0x7f856c15cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f856000c7e0 tx=0x7f8560007df0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 shutdown_connections 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8558060670 0x7f8558062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f856c158e10 0x7f856c16d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f856c0b3c90 0x7f856c15cb10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 --2- 172.21.15.50:0/1330990373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f856c0b1ba0 0x7f856c159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 >> 172.21.15.50:0/1330990373 conn(0x7f856c0670b0 msgr2=0x7f856c156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 shutdown_connections 2023-12-24T18:51:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.274+0000 7f8571eae700 1 -- 172.21.15.50:0/1330990373 wait complete. 2023-12-24T18:51:06.279 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:51:06.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:06.334 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:06.331+0000 7efdeff21000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:06.449 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.446+0000 7f292b7c8000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 Processor -- start 2023-12-24T18:51:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 -- start start 2023-12-24T18:51:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eb4158e10 0x7f7eb415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7eb40b3c90 0x7f7eb406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb406d5c0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40b49c0 con 0x7f7eb4158e10 2023-12-24T18:51:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb98a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb406d040 con 0x7f7eb40b3c90 2023-12-24T18:51:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eb4158e10 0x7f7eb415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eb4158e10 0x7f7eb415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33672/0 (socket says 172.21.15.50:33672) 2023-12-24T18:51:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/3205550954 learned_addr learned my addr 172.21.15.50:0/3205550954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.470+0000 7f7eabfff700 1 --2- 172.21.15.50:0/3205550954 >> v2:172.21.15.82:3300/0 conn(0x7f7eb40b3c90 0x7f7eb406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/3205550954 >> v2:172.21.15.82:3300/0 conn(0x7f7eb40b3c90 msgr2=0x7f7eb406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb2ffd700 1 --2- 172.21.15.50:0/3205550954 >> v2:172.21.15.82:3300/0 conn(0x7f7eb40b3c90 0x7f7eb406da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/3205550954 >> v1:172.21.15.82:6789/0 conn(0x7f7eb40b1ba0 legacy=0x7f7eb40b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb27fc700 1 -- 172.21.15.50:0/3205550954 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270694068 0 0) 0x7f7eb406d5c0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/3205550954 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb406df90 con 0x7f7eb4158e10 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb2ffd700 1 --2- 172.21.15.50:0/3205550954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb4158e10 0x7f7eb415d6d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40694f0 tx=0x7f7ea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feaaeb7d14118c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb27fc700 1 -- 172.21.15.50:0/3205550954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4009e70 con 0x7f7eb4158e10 2023-12-24T18:51:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb27fc700 1 -- 172.21.15.50:0/3205550954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400b860 con 0x7f7eb4158e10 2023-12-24T18:51:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb27fc700 1 -- 172.21.15.50:0/3205550954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400bc00 con 0x7f7eb4158e10 2023-12-24T18:51:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 -- 172.21.15.50:0/3205550954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb4158e10 msgr2=0x7f7eb415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/3205550954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb4158e10 0x7f7eb415d6d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40694f0 tx=0x7f7ea4009250 comp rx=0 tx=0).stop 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 -- 172.21.15.50:0/3205550954 shutdown_connections 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/3205550954 >> v2:172.21.15.82:3300/0 conn(0x7f7eb40b3c90 0x7f7eb406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/3205550954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb4158e10 0x7f7eb415d6d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 -- 172.21.15.50:0/3205550954 >> 172.21.15.50:0/3205550954 conn(0x7f7eb40670b0 msgr2=0x7f7eb40674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 -- 172.21.15.50:0/3205550954 shutdown_connections 2023-12-24T18:51:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.474+0000 7f7eb98a5700 1 -- 172.21.15.50:0/3205550954 wait complete. 2023-12-24T18:51:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 Processor -- start 2023-12-24T18:51:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 -- start start 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb40b3c90 0x7f7eb4150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb4158e10 0x7f7eb4150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4153a50 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4152e40 con 0x7f7eb40b3c90 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.478+0000 7f7eb98a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4153120 con 0x7f7eb4158e10 2023-12-24T18:51:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33688/0 (socket says 172.21.15.50:33688) 2023-12-24T18:51:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/2358168101 learned_addr learned my addr 172.21.15.50:0/2358168101 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eabfff700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb40b3c90 0x7f7eb4150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb37fe700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb4158e10 0x7f7eb4150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb4158e10 msgr2=0x7f7eb4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb4158e10 0x7f7eb4150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb40b3c90 msgr2=0x7f7eb4150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb40b3c90 0x7f7eb4150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 -- 172.21.15.50:0/2358168101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40094f0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb2ffd700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40094c0 tx=0x7f7ea4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4000c90 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400b9d0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4153400 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4025420 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.482+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb413ddd0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40652e0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f7ea4023070 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eaaffd700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 0x7f7e94062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f7ea407e170 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eabfff700 1 -- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 msgr2=0x7f7e94062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.486+0000 7f7eabfff700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 0x7f7e94062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:06.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.494+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ea404e1d0 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.576 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:06.571+0000 7efdeff21000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.670+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eb40b4400 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.674+0000 7f7eaaffd700 1 -- 172.21.15.50:0/2358168101 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f7ea4055e60 con 0x7f7eb40b1ba0 2023-12-24T18:51:06.676 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:06.676 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:06.639388+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3631433410":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/4285504704":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/1012194613":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/3584600883":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6833/33814":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6832/33814":"2023-12-25T18:49:20.357006+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 msgr2=0x7f7e94062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 0x7f7e94062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 msgr2=0x7f7eb413d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40094c0 tx=0x7f7ea4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 shutdown_connections 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f7e940606a0 0x7f7e94062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb4158e10 0x7f7eb4150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb40b3c90 0x7f7eb4150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 --2- 172.21.15.50:0/2358168101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb40b1ba0 0x7f7eb413d890 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 >> 172.21.15.50:0/2358168101 conn(0x7f7eb40670b0 msgr2=0x7f7eb415dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 shutdown_connections 2023-12-24T18:51:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.678+0000 7f7eb98a5700 1 -- 172.21.15.50:0/2358168101 wait complete. 2023-12-24T18:51:06.683 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:06.679+0000 7efdeff21000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:06.711 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:51:06.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:06.719 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.718+0000 7f292b7c8000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:06.776 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:06.771+0000 7efdeff21000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:06.824 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.822+0000 7f292b7c8000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:06.863 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:06.859+0000 7efdeff21000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.874+0000 7f876d42e700 1 Processor -- start 2023-12-24T18:51:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.874+0000 7f876d42e700 1 -- start start 2023-12-24T18:51:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f876d42e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87680ce750 0x7f87680ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f876d42e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f876806ae30 0x7f876806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f876d42e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876815a580 con 0x7f8768159a20 2023-12-24T18:51:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f876d42e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876806b7e0 con 0x7f876806ae30 2023-12-24T18:51:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f876d42e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876806ba80 con 0x7f87680ce750 2023-12-24T18:51:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87677fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8768159a20 0x7f8768159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41126/0 (socket says 172.21.15.50:41126) 2023-12-24T18:51:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87677fe700 1 -- 172.21.15.50:0/192865318 learned_addr learned my addr 172.21.15.50:0/192865318 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 --2- 172.21.15.50:0/192865318 >> v2:172.21.15.50:3300/0 conn(0x7f876806ae30 0x7f876806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8766ffd700 1 --2- 172.21.15.50:0/192865318 >> v2:172.21.15.82:3300/0 conn(0x7f87680ce750 0x7f87680ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8765ffb700 1 -- 172.21.15.50:0/192865318 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934531671 0 0) 0x7f876815a580 con 0x7f8768159a20 2023-12-24T18:51:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8765ffb700 1 -- 172.21.15.50:0/192865318 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8750003570 con 0x7f8768159a20 2023-12-24T18:51:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 -- 172.21.15.50:0/192865318 >> v2:172.21.15.82:3300/0 conn(0x7f87680ce750 msgr2=0x7f87680ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:06.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 --2- 172.21.15.50:0/192865318 >> v2:172.21.15.82:3300/0 conn(0x7f87680ce750 0x7f87680ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 -- 172.21.15.50:0/192865318 >> v1:172.21.15.50:6789/0 conn(0x7f8768159a20 legacy=0x7f8768159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 -- 172.21.15.50:0/192865318 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876806bd60 con 0x7f876806ae30 2023-12-24T18:51:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f87667fc700 1 --2- 172.21.15.50:0/192865318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f876806ae30 0x7f876806b2a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87680cda50 tx=0x7f875c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887b8b3fabfa1665 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8765ffb700 1 -- 172.21.15.50:0/192865318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c011630 con 0x7f876806ae30 2023-12-24T18:51:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8765ffb700 1 -- 172.21.15.50:0/192865318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0117b0 con 0x7f876806ae30 2023-12-24T18:51:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.878+0000 7f8765ffb700 1 -- 172.21.15.50:0/192865318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c011b30 con 0x7f876806ae30 2023-12-24T18:51:06.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- 172.21.15.50:0/192865318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f876806ae30 msgr2=0x7f876806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 --2- 172.21.15.50:0/192865318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f876806ae30 0x7f876806b2a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87680cda50 tx=0x7f875c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- 172.21.15.50:0/192865318 shutdown_connections 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 --2- 172.21.15.50:0/192865318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f876806ae30 0x7f876806b2a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 --2- 172.21.15.50:0/192865318 >> v2:172.21.15.82:3300/0 conn(0x7f87680ce750 0x7f87680ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- 172.21.15.50:0/192865318 >> 172.21.15.50:0/192865318 conn(0x7f87680cffb0 msgr2=0x7f87680d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- 172.21.15.50:0/192865318 shutdown_connections 2023-12-24T18:51:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- 172.21.15.50:0/192865318 wait complete. 2023-12-24T18:51:06.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 Processor -- start 2023-12-24T18:51:06.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.882+0000 7f876d42e700 1 -- start start 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876806ae30 0x7f87680c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87680ce750 0x7f87681436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87680c9b30 con 0x7f8768159a20 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768143c00 con 0x7f876806ae30 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680c9160 con 0x7f87680ce750 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33702/0 (socket says 172.21.15.50:33702) 2023-12-24T18:51:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 -- 172.21.15.50:0/2607057199 learned_addr learned my addr 172.21.15.50:0/2607057199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:06.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87667fc700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87680ce750 0x7f87681436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f8766ffd700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876806ae30 0x7f87680c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87680ce750 msgr2=0x7f87681436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87680ce750 0x7f87681436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876806ae30 msgr2=0x7f87680c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876806ae30 0x7f87680c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 -- 172.21.15.50:0/2607057199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c009420 con 0x7f8768159a20 2023-12-24T18:51:06.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f87677fe700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8760001460 tx=0x7f8760001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000a870 con 0x7f8768159a20 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000a9d0 con 0x7f8768159a20 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876816a2c0 con 0x7f8768159a20 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000ad50 con 0x7f8768159a20 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.886+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87680c8830 con 0x7f8768159a20 2023-12-24T18:51:06.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.890+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680652e0 con 0x7f8768159a20 2023-12-24T18:51:06.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.894+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f8760007300 con 0x7f8768159a20 2023-12-24T18:51:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.894+0000 7f874effd700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 0x7f8754062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.894+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6745+0+0 (secure 0 0 0) 0x7f876007d110 con 0x7f8768159a20 2023-12-24T18:51:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.894+0000 7f8766ffd700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 msgr2=0x7f8754062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.894+0000 7f8766ffd700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 0x7f8754062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:06.898+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f876004d130 con 0x7f8768159a20 2023-12-24T18:51:06.910 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.910+0000 7f292b7c8000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:06.999 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:06.998+0000 7f292b7c8000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:07.096 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:07.091+0000 7efdeff21000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:07.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.098+0000 7f8766ffd700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 msgr2=0x7f8754062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.098+0000 7f8766ffd700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 0x7f8754062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:07.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.110+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f876806c040 con 0x7f8768159a20 2023-12-24T18:51:07.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.110+0000 7f874effd700 1 -- 172.21.15.50:0/2607057199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f8760050750 con 0x7f8768159a20 2023-12-24T18:51:07.113 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 msgr2=0x7f8754062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 0x7f8754062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 msgr2=0x7f8768169d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8760001460 tx=0x7f8760001a40 comp rx=0 tx=0).stop 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 shutdown_connections 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f8754060670 0x7f8754062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8768159a20 0x7f8768169d80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87680ce750 0x7f87681436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 --2- 172.21.15.50:0/2607057199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876806ae30 0x7f87680c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 >> 172.21.15.50:0/2607057199 conn(0x7f87680cffb0 msgr2=0x7f8768153370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:07.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 shutdown_connections 2023-12-24T18:51:07.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.114+0000 7f876d42e700 1 -- 172.21.15.50:0/2607057199 wait complete. 2023-12-24T18:51:07.117 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:51:07.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:07.173 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:07.167+0000 7efdeff21000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:07.240 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:07.238+0000 7f292b7c8000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:07.270 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:07.267+0000 7efdeff21000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:07.337 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:07.334+0000 7f292b7c8000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:07.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 Processor -- start 2023-12-24T18:51:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 -- start start 2023-12-24T18:51:07.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a080b4f50 0x7f8a080b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080cf980 con 0x7f8a0806a510 2023-12-24T18:51:07.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0806aa10 con 0x7f8a080cc780 2023-12-24T18:51:07.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a0d6f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0806acf0 con 0x7f8a080b4f50 2023-12-24T18:51:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a067fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a0806a510 0x7f8a08159f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41136/0 (socket says 172.21.15.50:41136) 2023-12-24T18:51:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a067fc700 1 -- 172.21.15.50:0/3814422711 learned_addr learned my addr 172.21.15.50:0/3814422711 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.354+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/3814422711 >> v2:172.21.15.50:3300/0 conn(0x7f8a080b4f50 0x7f8a080b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712641263 0 0) 0x7f8a080cf980 con 0x7f8a0806a510 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f0003570 con 0x7f8a0806a510 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798896184 0 0) 0x7f8a0806aa10 con 0x7f8a080cc780 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a080cf980 con 0x7f8a080cc780 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225083037 0 0) 0x7f89f0003570 con 0x7f8a0806a510 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 >> v2:172.21.15.50:3300/0 conn(0x7f8a080b4f50 msgr2=0x7f8a080b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 --2- 172.21.15.50:0/3814422711 >> v2:172.21.15.50:3300/0 conn(0x7f8a080b4f50 0x7f8a080b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 >> v1:172.21.15.82:6789/0 conn(0x7f8a080cc780 legacy=0x7f8a081564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0806afd0 con 0x7f8a0806a510 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f89fc001470 con 0x7f8a0806a510 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/3814422711 >> v2:172.21.15.50:3300/0 conn(0x7f8a080b4f50 0x7f8a080b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 >> v1:172.21.15.50:6789/0 conn(0x7f8a0806a510 legacy=0x7f8a08159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0003bf0 0x7f89f0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 0x7f89f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f00051c0 0x7f89f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0806acf0 con 0x7f89f0004810 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f000c0b0 con 0x7f89f00051c0 2023-12-24T18:51:07.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f000c270 con 0x7f89f0003bf0 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 0x7f89f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0003bf0 0x7f89f0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 -- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0003bf0 msgr2=0x7f89f0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0003bf0 0x7f89f0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 -- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f00051c0 msgr2=0x7f89f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a077fe700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f00051c0 0x7f89f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f00051c0 0x7f89f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 -- 172.21.15.50:0/3814422711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0003570 con 0x7f89f0004810 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0003bf0 0x7f89f0003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a077fe700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f00051c0 0x7f89f000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a077fe700 1 -- 172.21.15.50:0/3814422711 reap_dead start 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a067fc700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 0x7f89f0004c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c2d0 tx=0x7f89fc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd26592d4cbbe575 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00cc00 con 0x7f89f0004810 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00cd60 con 0x7f89f0004810 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.358+0000 7f8a05ffb700 1 -- 172.21.15.50:0/3814422711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc005b70 con 0x7f89f0004810 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 msgr2=0x7f89f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 0x7f89f0004c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c2d0 tx=0x7f89fc001e10 comp rx=0 tx=0).stop 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/3814422711 shutdown_connections 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/3814422711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f0004810 0x7f89f0004c80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/3814422711 >> 172.21.15.50:0/3814422711 conn(0x7f8a080670b0 msgr2=0x7f8a08067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/3814422711 shutdown_connections 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/3814422711 wait complete. 2023-12-24T18:51:07.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 Processor -- start 2023-12-24T18:51:07.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- start start 2023-12-24T18:51:07.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0004810 0x7f8a0814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 0x7f8a081531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a081556b0 con 0x7f8a08155240 2023-12-24T18:51:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08152f10 con 0x7f89f0004810 2023-12-24T18:51:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.362+0000 7f8a0d6f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08158530 con 0x7f8a081580b0 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33722/0 (socket says 172.21.15.50:33722) 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 -- 172.21.15.50:0/572070637 learned_addr learned my addr 172.21.15.50:0/572070637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0004810 0x7f8a0814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a077fe700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 0x7f8a081531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 msgr2=0x7f8a081531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 0x7f8a081531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0004810 msgr2=0x7f8a0814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0004810 0x7f8a0814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 -- 172.21.15.50:0/572070637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08157c20 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a077fe700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 0x7f8a081531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a067fc700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c8c0 tx=0x7f89fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00ced0 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc001b30 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0070d0 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a081558d0 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a081575d0 con 0x7f8a08155240 2023-12-24T18:51:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.366+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a08157db0 con 0x7f8a08155240 2023-12-24T18:51:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.370+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f89fc007460 con 0x7f8a08155240 2023-12-24T18:51:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.370+0000 7f89eeffd700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 0x7f89f4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.370+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6745+0+0 (secure 0 0 0) 0x7f89fc07da60 con 0x7f8a08155240 2023-12-24T18:51:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.370+0000 7f8a06ffd700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 msgr2=0x7f89f4062bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.370+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 0x7f89f4062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:07.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.378+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89fc04da90 con 0x7f8a08155240 2023-12-24T18:51:07.432 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:07.430+0000 7f292b7c8000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:07.475 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:07.471+0000 7efdeff21000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.574+0000 7f8a06ffd700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 msgr2=0x7f89f4062bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.574+0000 7f8a06ffd700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 0x7f89f4062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:07.577 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:07.575+0000 7efdeff21000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.582+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a0804be40 con 0x7f8a08155240 2023-12-24T18:51:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.582+0000 7f89eeffd700 1 -- 172.21.15.50:0/572070637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f89fc017090 con 0x7f8a08155240 2023-12-24T18:51:07.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:07.586 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:49:06.170593+0000","modified":"2023-12-24T18:49:09.777673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5884":{"gid":5884,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3415246966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3415246966},{"type":"v1","addr":"172.21.15.50:6836","nonce":3415246966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 msgr2=0x7f89f4062bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 0x7f89f4062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 msgr2=0x7f8a0813ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c8c0 tx=0x7f89fc015000 comp rx=0 tx=0).stop 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 shutdown_connections 2023-12-24T18:51:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f89f4060740 0x7f89f4062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a081580b0 0x7f8a081531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a08155240 0x7f8a0813ae40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 --2- 172.21.15.50:0/572070637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0004810 0x7f8a0814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 >> 172.21.15.50:0/572070637 conn(0x7f8a080670b0 msgr2=0x7f8a080b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 shutdown_connections 2023-12-24T18:51:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.590+0000 7f8a0d6f0700 1 -- 172.21.15.50:0/572070637 wait complete. 2023-12-24T18:51:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-12-24T18:51:07.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:07.656 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:07.654+0000 7f292b7c8000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:07.752 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:07.750+0000 7f292b7c8000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 Processor -- start 2023-12-24T18:51:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 -- start start 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 0x7f02341590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f023406c0c0 0x7f02340a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 0x7f023406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023406c510 con 0x7f023406c0c0 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340a9c80 con 0x7f0234158cd0 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023adcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02340a8e10 con 0x7f023406afb0 2023-12-24T18:51:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f023406c0c0 0x7f02340a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f023406c0c0 0x7f02340a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33738/0 (socket says 172.21.15.50:33738) 2023-12-24T18:51:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 -- 172.21.15.50:0/3673708408 learned_addr learned my addr 172.21.15.50:0/3673708408 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f0239dca700 1 --2- 172.21.15.50:0/3673708408 >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 0x7f02341590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023a5cb700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 0x7f023406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 -- 172.21.15.50:0/3673708408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 msgr2=0x7f023406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 0x7f023406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 -- 172.21.15.50:0/3673708408 >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 msgr2=0x7f02341590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 --2- 172.21.15.50:0/3673708408 >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 0x7f02341590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 -- 172.21.15.50:0/3673708408 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023406b900 con 0x7f023406c0c0 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f0239dca700 1 --2- 172.21.15.50:0/3673708408 >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 0x7f02341590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f023a5cb700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 0x7f023406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.774+0000 7f02395c9700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406c0c0 0x7f02340a88d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0234067fd0 tx=0x7f0224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561317f426c8276b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f0238dc8700 1 -- 172.21.15.50:0/3673708408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400b820 con 0x7f023406c0c0 2023-12-24T18:51:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f0238dc8700 1 -- 172.21.15.50:0/3673708408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400b980 con 0x7f023406c0c0 2023-12-24T18:51:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f0238dc8700 1 -- 172.21.15.50:0/3673708408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400bd20 con 0x7f023406c0c0 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 -- 172.21.15.50:0/3673708408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406c0c0 msgr2=0x7f02340a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406c0c0 0x7f02340a88d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0234067fd0 tx=0x7f0224009250 comp rx=0 tx=0).stop 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 -- 172.21.15.50:0/3673708408 shutdown_connections 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406afb0 0x7f023406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 --2- 172.21.15.50:0/3673708408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406c0c0 0x7f02340a88d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 --2- 172.21.15.50:0/3673708408 >> v2:172.21.15.82:3300/0 conn(0x7f0234158cd0 0x7f02341590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 -- 172.21.15.50:0/3673708408 >> 172.21.15.50:0/3673708408 conn(0x7f0234067b80 msgr2=0x7f02340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:07.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 -- 172.21.15.50:0/3673708408 shutdown_connections 2023-12-24T18:51:07.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.778+0000 7f023adcc700 1 -- 172.21.15.50:0/3673708408 wait complete. 2023-12-24T18:51:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 Processor -- start 2023-12-24T18:51:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 -- start start 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406c0c0 0x7f0234157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234158cd0 0x7f0234150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023416d360 con 0x7f023406afb0 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340b0030 con 0x7f0234158cd0 2023-12-24T18:51:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023adcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02340af420 con 0x7f023406c0c0 2023-12-24T18:51:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33752/0 (socket says 172.21.15.50:33752) 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 -- 172.21.15.50:0/2170304142 learned_addr learned my addr 172.21.15.50:0/2170304142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f023a5cb700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234158cd0 0x7f0234150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f02395c9700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406c0c0 0x7f0234157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 -- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406c0c0 msgr2=0x7f0234157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406c0c0 0x7f0234157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 -- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234158cd0 msgr2=0x7f0234150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.782+0000 7f0239dca700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234158cd0 0x7f0234150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0239dca700 1 -- 172.21.15.50:0/2170304142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240094f0 con 0x7f023406afb0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0239dca700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f023000c830 tx=0x7f0230008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230011600 con 0x7f023406afb0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230011760 con 0x7f023406afb0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02340af700 con 0x7f023406afb0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230011b20 con 0x7f023406afb0 2023-12-24T18:51:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02340afcc0 con 0x7f023406afb0 2023-12-24T18:51:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023404be40 con 0x7f023406afb0 2023-12-24T18:51:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.786+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f0230018360 con 0x7f023406afb0 2023-12-24T18:51:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.790+0000 7f0229ffb700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 0x7f0218062c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.790+0000 7f02395c9700 1 -- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 msgr2=0x7f0218062c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.790+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6745+0+0 (secure 0 0 0) 0x7f023007cdf0 con 0x7f023406afb0 2023-12-24T18:51:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.790+0000 7f02395c9700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 0x7f0218062c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:07.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.794+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f023004cd90 con 0x7f023406afb0 2023-12-24T18:51:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.974+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02340a8b20 con 0x7f023406afb0 2023-12-24T18:51:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.974+0000 7f0229ffb700 1 -- 172.21.15.50:0/2170304142 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f0230015090 con 0x7f023406afb0 2023-12-24T18:51:07.978 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:07.978 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:06.639388+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:49:03.798044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-24T18:49:05.200685+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3631433410":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/4285504704":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/1012194613":"2023-12-25T18:49:20.357006+0000","172.21.15.50:0/3584600883":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6833/33814":"2023-12-25T18:49:20.357006+0000","172.21.15.50:6832/33814":"2023-12-25T18:49:20.357006+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 msgr2=0x7f0218062c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 0x7f0218062c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 msgr2=0x7f0234155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f023000c830 tx=0x7f0230008040 comp rx=0 tx=0).stop 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 shutdown_connections 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f0218060770 0x7f0218062c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234158cd0 0x7f0234150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f023406c0c0 0x7f0234157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 --2- 172.21.15.50:0/2170304142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f023406afb0 0x7f0234155c20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 >> 172.21.15.50:0/2170304142 conn(0x7f0234067b80 msgr2=0x7f02340ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 shutdown_connections 2023-12-24T18:51:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:07.978+0000 7f023adcc700 1 -- 172.21.15.50:0/2170304142 wait complete. 2023-12-24T18:51:08.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:51:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 Processor -- start 2023-12-24T18:51:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 -- start start 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 0x7f077806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aba30 0x7f07780ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07780ac1b0 0x7f0778158be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780ac630 con 0x7f07780ac1b0 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780c7360 con 0x7f07780aba30 2023-12-24T18:51:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077f82e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780682d0 con 0x7f077806ca50 2023-12-24T18:51:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077ddcb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07780ac1b0 0x7f0778158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077cdc9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aba30 0x7f07780ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077cdc9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aba30 0x7f07780ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48972/0 (socket says 172.21.15.50:48972) 2023-12-24T18:51:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077cdc9700 1 -- 172.21.15.50:0/3596287839 learned_addr learned my addr 172.21.15.50:0/3596287839 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.222+0000 7f077d5ca700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 0x7f077806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 -- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 msgr2=0x7f077806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 0x7f077806ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 -- 172.21.15.50:0/3596287839 >> v2:172.21.15.50:3300/0 conn(0x7f07780ac1b0 msgr2=0x7f0778158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 --2- 172.21.15.50:0/3596287839 >> v2:172.21.15.50:3300/0 conn(0x7f07780ac1b0 0x7f0778158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 -- 172.21.15.50:0/3596287839 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780c75e0 con 0x7f07780aba30 2023-12-24T18:51:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077d5ca700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 0x7f077806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077cdc9700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780ae9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07780cc340 tx=0x7f0768009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee30b385c62ff6b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f076ffff700 1 -- 172.21.15.50:0/3596287839 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768009e70 con 0x7f07780aba30 2023-12-24T18:51:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f076ffff700 1 -- 172.21.15.50:0/3596287839 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800b860 con 0x7f07780aba30 2023-12-24T18:51:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f076ffff700 1 -- 172.21.15.50:0/3596287839 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800bc00 con 0x7f07780aba30 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 -- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 msgr2=0x7f07780ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780ae9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07780cc340 tx=0x7f0768009250 comp rx=0 tx=0).stop 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 -- 172.21.15.50:0/3596287839 shutdown_connections 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780ae9a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 --2- 172.21.15.50:0/3596287839 >> v2:172.21.15.50:3300/0 conn(0x7f07780ac1b0 0x7f0778158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 --2- 172.21.15.50:0/3596287839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f077806ca50 0x7f077806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 -- 172.21.15.50:0/3596287839 >> 172.21.15.50:0/3596287839 conn(0x7f07780c8e50 msgr2=0x7f07780c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 -- 172.21.15.50:0/3596287839 shutdown_connections 2023-12-24T18:51:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.226+0000 7f077f82e700 1 -- 172.21.15.50:0/3596287839 wait complete. 2023-12-24T18:51:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.230+0000 7f077f82e700 1 Processor -- start 2023-12-24T18:51:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.230+0000 7f077f82e700 1 -- start start 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07780ac1b0 0x7f07780c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780af190 con 0x7f077806ca50 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ae2a0 con 0x7f07780aba30 2023-12-24T18:51:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780af3a0 con 0x7f07780ac1b0 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33782/0 (socket says 172.21.15.50:33782) 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 -- 172.21.15.50:0/57678879 learned_addr learned my addr 172.21.15.50:0/57678879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077cdc9700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077ddcb700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07780ac1b0 0x7f07780c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07780ac1b0 msgr2=0x7f07780c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07780ac1b0 0x7f07780c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 msgr2=0x7f07780add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 -- 172.21.15.50:0/57678879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680094f0 con 0x7f077806ca50 2023-12-24T18:51:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077d5ca700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f077400e8d0 tx=0x7f0774008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774013410 con 0x7f077806ca50 2023-12-24T18:51:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774013570 con 0x7f077806ca50 2023-12-24T18:51:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774013910 con 0x7f077806ca50 2023-12-24T18:51:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780af680 con 0x7f077806ca50 2023-12-24T18:51:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.234+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780afc40 con 0x7f077806ca50 2023-12-24T18:51:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.238+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07780652e0 con 0x7f077806ca50 2023-12-24T18:51:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.238+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f0774013d40 con 0x7f077806ca50 2023-12-24T18:51:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.242+0000 7f076d7fa700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 0x7f075c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.242+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6745+0+0 (secure 0 0 0) 0x7f077407cb10 con 0x7f077806ca50 2023-12-24T18:51:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.242+0000 7f077cdc9700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 msgr2=0x7f075c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.242+0000 7f077cdc9700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 0x7f075c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.246+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f077404cad0 con 0x7f077806ca50 2023-12-24T18:51:08.333 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:08.327+0000 7efdeff21000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.446+0000 7f077cdc9700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 msgr2=0x7f075c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6832/33814 2023-12-24T18:51:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.446+0000 7f077cdc9700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 0x7f075c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.454+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f07780c78c0 con 0x7f077806ca50 2023-12-24T18:51:08.457 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:51:08.454+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:51:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.462+0000 7f076d7fa700 1 -- 172.21.15.50:0/57678879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f07740500f0 con 0x7f077806ca50 2023-12-24T18:51:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 msgr2=0x7f075c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 0x7f075c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 msgr2=0x7f07780bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f077400e8d0 tx=0x7f0774008040 comp rx=0 tx=0).stop 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 shutdown_connections 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:6832/33814,v1:172.21.15.50:6833/33814] conn(0x7f075c060670 0x7f075c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07780ac1b0 0x7f07780c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aba30 0x7f07780add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 --2- 172.21.15.50:0/57678879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f077806ca50 0x7f07780bfe20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 >> 172.21.15.50:0/57678879 conn(0x7f07780c8e50 msgr2=0x7f0778152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 shutdown_connections 2023-12-24T18:51:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.466+0000 7f077f82e700 1 -- 172.21.15.50:0/57678879 wait complete. 2023-12-24T18:51:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:51:08.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:51:08.558 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:51:08.580 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.578+0000 7f292b7c8000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 Processor -- start 2023-12-24T18:51:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 -- start start 2023-12-24T18:51:08.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f02d8159020 0x7f02d80cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80caa60 con 0x7f02d8158c50 2023-12-24T18:51:08.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80cd100 con 0x7f02d80cccd0 2023-12-24T18:51:08.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.654+0000 7f02de5cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80af430 con 0x7f02d8159020 2023-12-24T18:51:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dd5ca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02d8158c50 0x7f02d80caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41142/0 (socket says 172.21.15.50:41142) 2023-12-24T18:51:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dd5ca700 1 -- 172.21.15.50:0/1376003522 learned_addr learned my addr 172.21.15.50:0/1376003522 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:08.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dcdc9700 1 --2- 172.21.15.50:0/1376003522 >> v2:172.21.15.82:3300/0 conn(0x7f02d8159020 0x7f02d80cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02cffff700 1 -- 172.21.15.50:0/1376003522 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604677660 0 0) 0x7f02d80caa60 con 0x7f02d8158c50 2023-12-24T18:51:08.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02cffff700 1 -- 172.21.15.50:0/1376003522 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c4003570 con 0x7f02d8158c50 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dcdc9700 1 -- 172.21.15.50:0/1376003522 >> v1:172.21.15.82:6789/0 conn(0x7f02d80cccd0 legacy=0x7f02d80afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dcdc9700 1 -- 172.21.15.50:0/1376003522 >> v1:172.21.15.50:6789/0 conn(0x7f02d8158c50 legacy=0x7f02d80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dcdc9700 1 -- 172.21.15.50:0/1376003522 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80cee80 con 0x7f02d8159020 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02dcdc9700 1 --2- 172.21.15.50:0/1376003522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8159020 0x7f02d80cc790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02c80098e0 tx=0x7f02c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7f91aa6e6b0cc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02cffff700 1 -- 172.21.15.50:0/1376003522 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c800b640 con 0x7f02d8159020 2023-12-24T18:51:08.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02cffff700 1 -- 172.21.15.50:0/1376003522 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c800b7a0 con 0x7f02d8159020 2023-12-24T18:51:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02cffff700 1 -- 172.21.15.50:0/1376003522 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c800bb20 con 0x7f02d8159020 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02de5cc700 1 -- 172.21.15.50:0/1376003522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8159020 msgr2=0x7f02d80cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.658+0000 7f02de5cc700 1 --2- 172.21.15.50:0/1376003522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8159020 0x7f02d80cc790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02c80098e0 tx=0x7f02c80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 -- 172.21.15.50:0/1376003522 shutdown_connections 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 --2- 172.21.15.50:0/1376003522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8159020 0x7f02d80cc790 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 -- 172.21.15.50:0/1376003522 >> 172.21.15.50:0/1376003522 conn(0x7f02d80670b0 msgr2=0x7f02d80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 -- 172.21.15.50:0/1376003522 shutdown_connections 2023-12-24T18:51:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 -- 172.21.15.50:0/1376003522 wait complete. 2023-12-24T18:51:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 Processor -- start 2023-12-24T18:51:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.662+0000 7f02de5cc700 1 -- start start 2023-12-24T18:51:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 0x7f02d80b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02d8159020 0x7f02d80b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80b3c30 con 0x7f02d80cccd0 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80b3020 con 0x7f02d8158c50 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80b3300 con 0x7f02d8159020 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33866/0 (socket says 172.21.15.50:33866) 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 -- 172.21.15.50:0/581220632 learned_addr learned my addr 172.21.15.50:0/581220632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dcdc9700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 0x7f02d80b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dddcb700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02d8159020 0x7f02d80b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 -- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02d8159020 msgr2=0x7f02d80b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02d8159020 0x7f02d80b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 -- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 msgr2=0x7f02d80b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 0x7f02d80b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 -- 172.21.15.50:0/581220632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8009420 con 0x7f02d80cccd0 2023-12-24T18:51:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dcdc9700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 0x7f02d80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02dd5ca700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c7c0 tx=0x7f02d4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4005cd0 con 0x7f02d80cccd0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4005e30 con 0x7f02d80cccd0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4007320 con 0x7f02d80cccd0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d80b35e0 con 0x7f02d80cccd0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.666+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d80b2c80 con 0x7f02d80cccd0 2023-12-24T18:51:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.670+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d804be40 con 0x7f02d80cccd0 2023-12-24T18:51:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.670+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 27) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f02d401b3b0 con 0x7f02d80cccd0 2023-12-24T18:51:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.670+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7061+0+0 (secure 0 0 0) 0x7f02d407c350 con 0x7f02d80cccd0 2023-12-24T18:51:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f02d404c7c0 con 0x7f02d80cccd0 2023-12-24T18:51:08.679 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f28f2ad0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.679 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f28f2ad0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.680 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f28f2ad0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.680 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f28f2ad0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.680 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.678+0000 7f28f2ad0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.683 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.682+0000 7f28f5ad6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.683 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.682+0000 7f28f5ad6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.683 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.682+0000 7f28f5ad6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.683 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.682+0000 7f28f5ad6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.683 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:08.682+0000 7f28f5ad6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:08.898+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02d80d0cf0 con 0x7f02d80cccd0 2023-12-24T18:51:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.470+0000 7f02cd7fa700 1 -- 172.21.15.50:0/581220632 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f02d404fde0 con 0x7f02d80cccd0 2023-12-24T18:51:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 msgr2=0x7f02d815bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c7c0 tx=0x7f02d4007e00 comp rx=0 tx=0).stop 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 shutdown_connections 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02d8159020 0x7f02d80b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d8158c50 0x7f02d80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 --2- 172.21.15.50:0/581220632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d80cccd0 0x7f02d815bc90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 >> 172.21.15.50:0/581220632 conn(0x7f02d80670b0 msgr2=0x7f02d815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 shutdown_connections 2023-12-24T18:51:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.474+0000 7f02de5cc700 1 -- 172.21.15.50:0/581220632 wait complete. 2023-12-24T18:51:09.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:51:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.670+0000 7fcb05ecd700 1 Processor -- start 2023-12-24T18:51:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.670+0000 7fcb05ecd700 1 -- start start 2023-12-24T18:51:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb001594d0 0x7fcb000cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb000cb530 con 0x7fcb000cb130 2023-12-24T18:51:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb00068800 con 0x7fcb00159100 2023-12-24T18:51:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00068ae0 con 0x7fcb001594d0 2023-12-24T18:51:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcaff7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcb00159100 0x7fcb000c7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42286/0 (socket says 172.21.15.50:42286) 2023-12-24T18:51:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcaff7fe700 1 -- 172.21.15.50:0/4289486438 learned_addr learned my addr 172.21.15.50:0/4289486438 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb000cb130 0x7fcb0006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44016/0 (socket says 172.21.15.50:44016) 2023-12-24T18:51:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafeffd700 1 --2- 172.21.15.50:0/4289486438 >> v2:172.21.15.82:3300/0 conn(0x7fcb001594d0 0x7fcb000cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720464325 0 0) 0x7fcb00068800 con 0x7fcb00159100 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae8003570 con 0x7fcb00159100 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845392443 0 0) 0x7fcb000cb530 con 0x7fcb000cb130 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb00068800 con 0x7fcb000cb130 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafeffd700 1 -- 172.21.15.50:0/4289486438 >> v1:172.21.15.82:6789/0 conn(0x7fcb00159100 legacy=0x7fcb000c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafeffd700 1 -- 172.21.15.50:0/4289486438 >> v1:172.21.15.50:6789/0 conn(0x7fcb000cb130 legacy=0x7fcb0006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafeffd700 1 -- 172.21.15.50:0/4289486438 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00068dc0 con 0x7fcb001594d0 2023-12-24T18:51:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafeffd700 1 --2- 172.21.15.50:0/4289486438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb001594d0 0x7fcb000cabf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40098e0 tx=0x7fcaf40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f872a6727c548594 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011630 con 0x7fcb001594d0 2023-12-24T18:51:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011790 con 0x7fcb001594d0 2023-12-24T18:51:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcafe7fc700 1 -- 172.21.15.50:0/4289486438 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011b30 con 0x7fcb001594d0 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 -- 172.21.15.50:0/4289486438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb001594d0 msgr2=0x7fcb000cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.674+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/4289486438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb001594d0 0x7fcb000cabf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40098e0 tx=0x7fcaf40091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- 172.21.15.50:0/4289486438 shutdown_connections 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/4289486438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb001594d0 0x7fcb000cabf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- 172.21.15.50:0/4289486438 >> 172.21.15.50:0/4289486438 conn(0x7fcb000ccf90 msgr2=0x7fcb000c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- 172.21.15.50:0/4289486438 shutdown_connections 2023-12-24T18:51:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- 172.21.15.50:0/4289486438 wait complete. 2023-12-24T18:51:09.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 Processor -- start 2023-12-24T18:51:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- start start 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 0x7fcb0015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 0x7fcb00154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb001594d0 0x7fcb0015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000af260 con 0x7fcb000cb130 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0015b9f0 con 0x7fcb00159100 2023-12-24T18:51:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcb05ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0016a8a0 con 0x7fcb001594d0 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.678+0000 7fcaff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 0x7fcb0015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcaff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 0x7fcb0015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54496/0 (socket says 172.21.15.50:54496) 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcaff7fe700 1 -- 172.21.15.50:0/1652272756 learned_addr learned my addr 172.21.15.50:0/1652272756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 0x7fcb00154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafffff700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb001594d0 0x7fcb0015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 -- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb001594d0 msgr2=0x7fcb0015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb001594d0 0x7fcb0015eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 -- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 msgr2=0x7fcb0015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 0x7fcb0015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 -- 172.21.15.50:0/1652272756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009420 con 0x7fcb00159100 2023-12-24T18:51:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcafeffd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 0x7fcb00154ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4016000 tx=0x7fcaf4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf401f070 con 0x7fcb00159100 2023-12-24T18:51:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011900 con 0x7fcb00159100 2023-12-24T18:51:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4023410 con 0x7fcb00159100 2023-12-24T18:51:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00159e90 con 0x7fcb00159100 2023-12-24T18:51:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.682+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0015a450 con 0x7fcb00159100 2023-12-24T18:51:09.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.686+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb000af3d0 con 0x7fcb00159100 2023-12-24T18:51:09.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.686+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 28) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fcaf40193b0 con 0x7fcb00159100 2023-12-24T18:51:09.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.686+0000 7fcae77fe700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 0x7fcaec062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:09.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.686+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7061+0+0 (secure 0 0 0) 0x7fcaf407d770 con 0x7fcb00159100 2023-12-24T18:51:09.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.686+0000 7fcaff7fe700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 0x7fcaec062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:09.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.690+0000 7fcaff7fe700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 0x7fcaec062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00058d0 tx=0x7fcaf0009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:09.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.694+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcb000af3d0 con 0x7fcb00159100 2023-12-24T18:51:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:09.866+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb000af3d0 con 0x7fcb00159100 2023-12-24T18:51:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.666+0000 7fcae77fe700 1 -- 172.21.15.50:0/1652272756 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcb000af3d0 con 0x7fcb00159100 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 msgr2=0x7fcaec062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 0x7fcaec062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00058d0 tx=0x7fcaf0009040 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 msgr2=0x7fcb00154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 0x7fcb00154ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4016000 tx=0x7fcaf4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 shutdown_connections 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcaec0603a0 0x7fcaec062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb001594d0 0x7fcb0015eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb00159100 0x7fcb00154ea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 --2- 172.21.15.50:0/1652272756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb000cb130 0x7fcb0015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 >> 172.21.15.50:0/1652272756 conn(0x7fcb000ccf90 msgr2=0x7fcb0006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 shutdown_connections 2023-12-24T18:51:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.670+0000 7fcb05ecd700 1 -- 172.21.15.50:0/1652272756 wait complete. 2023-12-24T18:51:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:51:10.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:51:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.862+0000 7fef714ae700 1 Processor -- start 2023-12-24T18:51:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- start start 2023-12-24T18:51:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef6c0670b0 0x7fef6c067480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c0b2080 0x7fef6c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c06cf20 con 0x7fef6c06a3a0 2023-12-24T18:51:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c06cbd0 con 0x7fef6c0b2080 2023-12-24T18:51:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0679c0 con 0x7fef6c0670b0 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c0b2080 0x7fef6c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c0b2080 0x7fef6c06a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54506/0 (socket says 172.21.15.50:54506) 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1690419958 learned_addr learned my addr 172.21.15.50:0/1690419958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6affd700 1 --2- 172.21.15.50:0/1690419958 >> v2:172.21.15.82:3300/0 conn(0x7fef6c0670b0 0x7fef6c067480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1690419958 >> v2:172.21.15.82:3300/0 conn(0x7fef6c0670b0 msgr2=0x7fef6c067480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 --2- 172.21.15.50:0/1690419958 >> v2:172.21.15.82:3300/0 conn(0x7fef6c0670b0 0x7fef6c067480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1690419958 >> v1:172.21.15.82:6789/0 conn(0x7fef6c06a3a0 legacy=0x7fef6c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1690419958 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c06ae20 con 0x7fef6c0b2080 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef6b7fe700 1 --2- 172.21.15.50:0/1690419958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c06a7f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0cfb20 tx=0x7fef64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153e71d6984e02f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef69ffb700 1 -- 172.21.15.50:0/1690419958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400e070 con 0x7fef6c0b2080 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef69ffb700 1 -- 172.21.15.50:0/1690419958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6400ba20 con 0x7fef6c0b2080 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef69ffb700 1 -- 172.21.15.50:0/1690419958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640092e0 con 0x7fef6c0b2080 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- 172.21.15.50:0/1690419958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 msgr2=0x7fef6c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 --2- 172.21.15.50:0/1690419958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c06a7f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0cfb20 tx=0x7fef64009840 comp rx=0 tx=0).stop 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- 172.21.15.50:0/1690419958 shutdown_connections 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 --2- 172.21.15.50:0/1690419958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c06a7f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 --2- 172.21.15.50:0/1690419958 >> v2:172.21.15.82:3300/0 conn(0x7fef6c0670b0 0x7fef6c067480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.866+0000 7fef714ae700 1 -- 172.21.15.50:0/1690419958 >> 172.21.15.50:0/1690419958 conn(0x7fef6c0cfe40 msgr2=0x7fef6c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- 172.21.15.50:0/1690419958 shutdown_connections 2023-12-24T18:51:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- 172.21.15.50:0/1690419958 wait complete. 2023-12-24T18:51:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 Processor -- start 2023-12-24T18:51:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- start start 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef6c0670b0 0x7fef6c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef6c06a3a0 0x7fef6c0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c6c20 con 0x7fef6c0b2080 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0cab20 con 0x7fef6c0670b0 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.870+0000 7fef714ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0cae00 con 0x7fef6c06a3a0 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54520/0 (socket says 172.21.15.50:54520) 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1070077985 learned_addr learned my addr 172.21.15.50:0/1070077985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6affd700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef6c0670b0 0x7fef6c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6a7fc700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef6c06a3a0 0x7fef6c0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef6c06a3a0 msgr2=0x7fef6c0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef6c06a3a0 0x7fef6c0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef6c0670b0 msgr2=0x7fef6c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef6c0670b0 0x7fef6c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 -- 172.21.15.50:0/1070077985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64009ae0 con 0x7fef6c0b2080 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef6b7fe700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fef640072f0 tx=0x7fef64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64008b00 con 0x7fef6c0b2080 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64008c60 con 0x7fef6c0b2080 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64026460 con 0x7fef6c0b2080 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0cb0e0 con 0x7fef6c0b2080 2023-12-24T18:51:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c0cb6a0 con 0x7fef6c0b2080 2023-12-24T18:51:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.874+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04be40 con 0x7fef6c0b2080 2023-12-24T18:51:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.878+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fef64003040 con 0x7fef6c0b2080 2023-12-24T18:51:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.878+0000 7fef52ffd700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 0x7fef58062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.878+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fef6407ea60 con 0x7fef6c0b2080 2023-12-24T18:51:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.878+0000 7fef6affd700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 0x7fef58062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.878+0000 7fef6affd700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 0x7fef58062ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d10 tx=0x7fef5c0091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:10.886+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fef6404eca0 con 0x7fef6c0b2080 2023-12-24T18:51:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.062+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef6c06bba0 con 0x7fef6c0b2080 2023-12-24T18:51:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.690+0000 7fef52ffd700 1 -- 172.21.15.50:0/1070077985 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef640522c0 con 0x7fef6c0b2080 2023-12-24T18:51:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.694+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 msgr2=0x7fef58062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.694+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 0x7fef58062ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d10 tx=0x7fef5c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.694+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 msgr2=0x7fef6c0ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.694+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fef640072f0 tx=0x7fef64018000 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 shutdown_connections 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fef58060620 0x7fef58062ad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c0b2080 0x7fef6c0ab870 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef6c06a3a0 0x7fef6c0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 --2- 172.21.15.50:0/1070077985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef6c0670b0 0x7fef6c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 >> 172.21.15.50:0/1070077985 conn(0x7fef6c0cfe40 msgr2=0x7fef6c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 shutdown_connections 2023-12-24T18:51:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.698+0000 7fef714ae700 1 -- 172.21.15.50:0/1070077985 wait complete. 2023-12-24T18:51:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:51:11.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:51:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 Processor -- start 2023-12-24T18:51:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 -- start start 2023-12-24T18:51:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0c1407c0 0x7f7d0c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c13e470 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0cc2d0 con 0x7f7d0c1407c0 2023-12-24T18:51:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.898+0000 7f7d1302e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c13db40 con 0x7f7d0c1403f0 2023-12-24T18:51:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d115cb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d0c0cbd20 0x7f7d0c15aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44030/0 (socket says 172.21.15.50:44030) 2023-12-24T18:51:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d115cb700 1 -- 172.21.15.50:0/1075013086 learned_addr learned my addr 172.21.15.50:0/1075013086 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/1075013086 >> v2:172.21.15.50:3300/0 conn(0x7f7d0c1407c0 0x7f7d0c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d10dca700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 -- 172.21.15.50:0/1075013086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 msgr2=0x7f7d0c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 -- 172.21.15.50:0/1075013086 >> v1:172.21.15.50:6789/0 conn(0x7f7d0c0cbd20 legacy=0x7f7d0c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0b7fe700 1 -- 172.21.15.50:0/1075013086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200218374 0 0) 0x7f7d0c13e470 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 -- 172.21.15.50:0/1075013086 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c13de20 con 0x7f7d0c1407c0 2023-12-24T18:51:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d10dca700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0b1510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80098e0 tx=0x7f7cf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ea68d2c767b835 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0b7fe700 1 -- 172.21.15.50:0/1075013086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8009e80 con 0x7f7d0c1407c0 2023-12-24T18:51:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0b7fe700 1 -- 172.21.15.50:0/1075013086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800b860 con 0x7f7d0c1407c0 2023-12-24T18:51:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d0b7fe700 1 -- 172.21.15.50:0/1075013086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800bbe0 con 0x7f7d0c1407c0 2023-12-24T18:51:11.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 -- 172.21.15.50:0/1075013086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c1407c0 msgr2=0x7f7d0c0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0b1510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80098e0 tx=0x7f7cf80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 -- 172.21.15.50:0/1075013086 shutdown_connections 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0b1510 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 --2- 172.21.15.50:0/1075013086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 -- 172.21.15.50:0/1075013086 >> 172.21.15.50:0/1075013086 conn(0x7f7d0c06c820 msgr2=0x7f7d0c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 -- 172.21.15.50:0/1075013086 shutdown_connections 2023-12-24T18:51:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.902+0000 7f7d1302e700 1 -- 172.21.15.50:0/1075013086 wait complete. 2023-12-24T18:51:11.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.906+0000 7f7d1302e700 1 Processor -- start 2023-12-24T18:51:11.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.906+0000 7f7d1302e700 1 -- start start 2023-12-24T18:51:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c159d60 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c158e70 con 0x7f7d0c1407c0 2023-12-24T18:51:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c159150 con 0x7f7d0c1403f0 2023-12-24T18:51:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54540/0 (socket says 172.21.15.50:54540) 2023-12-24T18:51:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 -- 172.21.15.50:0/2027419992 learned_addr learned my addr 172.21.15.50:0/2027419992 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d115cb700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 -- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 msgr2=0x7f7d0c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 -- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c1407c0 msgr2=0x7f7d0c0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 -- 172.21.15.50:0/2027419992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8009420 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d10dca700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e8d0 tx=0x7f7d00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000ee70 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000c5e0 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c159430 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000c980 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.910+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1599f0 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.914+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0652e0 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.914+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7d00013410 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.914+0000 7f7d08ff9700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 0x7f7cf0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.914+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f7d0007c850 con 0x7f7d0c0cbd20 2023-12-24T18:51:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.918+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 0x7f7cf0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.918+0000 7f7d0bfff700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 0x7f7cf0062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80091e0 tx=0x7f7cf8017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:11.922+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d0004cbe0 con 0x7f7d0c0cbd20 2023-12-24T18:51:12.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.094+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f7d0c159ea0 con 0x7f7d0c0cbd20 2023-12-24T18:51:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.106+0000 7f7d08ff9700 1 -- 172.21.15.50:0/2027419992 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7d00050200 con 0x7f7d0c0cbd20 2023-12-24T18:51:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 msgr2=0x7f7cf0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 0x7f7cf0062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80091e0 tx=0x7f7cf8017000 comp rx=0 tx=0).stop 2023-12-24T18:51:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 msgr2=0x7f7d0c16bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e8d0 tx=0x7f7d00008040 comp rx=0 tx=0).stop 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 shutdown_connections 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7cf0060550 0x7f7cf0062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c1407c0 0x7f7d0c0ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d0c1403f0 0x7f7d0c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 --2- 172.21.15.50:0/2027419992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0c0cbd20 0x7f7d0c16bfe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 >> 172.21.15.50:0/2027419992 conn(0x7f7d0c06c820 msgr2=0x7f7d0c15a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 shutdown_connections 2023-12-24T18:51:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.110+0000 7f7d1302e700 1 -- 172.21.15.50:0/2027419992 wait complete. 2023-12-24T18:51:12.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:51:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.310+0000 7fae19878700 1 Processor -- start 2023-12-24T18:51:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.310+0000 7fae19878700 1 -- start start 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae140cf4d0 0x7fae1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae140cf8a0 0x7fae1406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 0x7fae1415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae14159640 con 0x7fae140cf8a0 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1406b0a0 con 0x7fae1406ac40 2023-12-24T18:51:12.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae19878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140cd680 con 0x7fae140cf4d0 2023-12-24T18:51:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae140cf8a0 0x7fae1406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae137fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 0x7fae1415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae140cf8a0 0x7fae1406a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54542/0 (socket says 172.21.15.50:54542) 2023-12-24T18:51:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 -- 172.21.15.50:0/2236625232 learned_addr learned my addr 172.21.15.50:0/2236625232 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae12ffd700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae140cf4d0 0x7fae1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 -- 172.21.15.50:0/2236625232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae140cf4d0 msgr2=0x7fae1406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae140cf4d0 0x7fae1406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 -- 172.21.15.50:0/2236625232 >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 msgr2=0x7fae1415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 --2- 172.21.15.50:0/2236625232 >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 0x7fae1415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 -- 172.21.15.50:0/2236625232 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140cca70 con 0x7fae140cf8a0 2023-12-24T18:51:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae137fe700 1 --2- 172.21.15.50:0/2236625232 >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 0x7fae1415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.314+0000 7fae127fc700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae1406a700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fae1406a690 tx=0x7fae08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662a204516b253fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae11ffb700 1 -- 172.21.15.50:0/2236625232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800b640 con 0x7fae140cf8a0 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae11ffb700 1 -- 172.21.15.50:0/2236625232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0800b7a0 con 0x7fae140cf8a0 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae11ffb700 1 -- 172.21.15.50:0/2236625232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800bb60 con 0x7fae140cf8a0 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- 172.21.15.50:0/2236625232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 msgr2=0x7fae1406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae1406a700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fae1406a690 tx=0x7fae08009250 comp rx=0 tx=0).stop 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- 172.21.15.50:0/2236625232 shutdown_connections 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 --2- 172.21.15.50:0/2236625232 >> v2:172.21.15.82:3300/0 conn(0x7fae1406ac40 0x7fae1415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae1406a700 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 --2- 172.21.15.50:0/2236625232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae140cf4d0 0x7fae1406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- 172.21.15.50:0/2236625232 >> 172.21.15.50:0/2236625232 conn(0x7fae14067b30 msgr2=0x7fae140cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- 172.21.15.50:0/2236625232 shutdown_connections 2023-12-24T18:51:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- 172.21.15.50:0/2236625232 wait complete. 2023-12-24T18:51:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 Processor -- start 2023-12-24T18:51:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.318+0000 7fae19878700 1 -- start start 2023-12-24T18:51:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 0x7fae141540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae140cf4d0 0x7fae1414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14155a30 con 0x7fae140cf8a0 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14155cd0 con 0x7fae140cf4d0 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae14152e20 con 0x7fae1406ac40 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54550/0 (socket says 172.21.15.50:54550) 2023-12-24T18:51:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 -- 172.21.15.50:0/2402073112 learned_addr learned my addr 172.21.15.50:0/2402073112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:12.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae12ffd700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 0x7fae141540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae127fc700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae140cf4d0 0x7fae1414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 -- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 msgr2=0x7fae141540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 0x7fae141540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 -- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae140cf4d0 msgr2=0x7fae1414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae140cf4d0 0x7fae1414da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 -- 172.21.15.50:0/2402073112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009a20 con 0x7fae140cf8a0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae12ffd700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 0x7fae141540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae137fe700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009fc0 tx=0x7fae0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00cd30 con 0x7fae140cf8a0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00f040 con 0x7fae140cf8a0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0146d0 con 0x7fae140cf8a0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080094f0 con 0x7fae140cf8a0 2023-12-24T18:51:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.322+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141533e0 con 0x7fae140cf8a0 2023-12-24T18:51:12.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.326+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae141535d0 con 0x7fae140cf8a0 2023-12-24T18:51:12.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.326+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fae0c003020 con 0x7fae140cf8a0 2023-12-24T18:51:12.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.326+0000 7fadfaffd700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 0x7fae00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.326+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7fae0c07d4c0 con 0x7fae140cf8a0 2023-12-24T18:51:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.326+0000 7fae12ffd700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 0x7fae00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.330+0000 7fae12ffd700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 0x7fae00062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae04009cf0 tx=0x7fae04008040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.334+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae0c04d850 con 0x7fae140cf8a0 2023-12-24T18:51:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.514+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fae140652e0 con 0x7fae140cf8a0 2023-12-24T18:51:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.518+0000 7fadfaffd700 1 -- 172.21.15.50:0/2402073112 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7fae0c050e70 con 0x7fae140cf8a0 2023-12-24T18:51:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 msgr2=0x7fae00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 0x7fae00062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae04009cf0 tx=0x7fae04008040 comp rx=0 tx=0).stop 2023-12-24T18:51:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 msgr2=0x7fae14154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009fc0 tx=0x7fae0c00b040 comp rx=0 tx=0).stop 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 shutdown_connections 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae00060550 0x7fae00062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae140cf8a0 0x7fae14154720 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae140cf4d0 0x7fae1414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 --2- 172.21.15.50:0/2402073112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae1406ac40 0x7fae141540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.522+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 >> 172.21.15.50:0/2402073112 conn(0x7fae14067b30 msgr2=0x7fae140cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.526+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 shutdown_connections 2023-12-24T18:51:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.526+0000 7fae19878700 1 -- 172.21.15.50:0/2402073112 wait complete. 2023-12-24T18:51:12.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:51:12.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 Processor -- start 2023-12-24T18:51:12.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 -- start start 2023-12-24T18:51:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 0x7f72bc159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72bc0ccea0 0x7f72bc0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0caa60 con 0x7f72bc0caef0 2023-12-24T18:51:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0af430 con 0x7f72bc0ccea0 2023-12-24T18:51:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c1a4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0cee80 con 0x7f72bc158c50 2023-12-24T18:51:12.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72bbfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72bc0caef0 0x7f72bc0cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44040/0 (socket says 172.21.15.50:44040) 2023-12-24T18:51:12.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72bbfff700 1 -- 172.21.15.50:0/1533127690 learned_addr learned my addr 172.21.15.50:0/1533127690 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:12.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c124b700 1 --2- 172.21.15.50:0/1533127690 >> v2:172.21.15.82:3300/0 conn(0x7f72bc0ccea0 0x7f72bc0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.710+0000 7f72c0a4a700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 0x7f72bc159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72bb7fe700 1 -- 172.21.15.50:0/1533127690 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339635186 0 0) 0x7f72bc0caa60 con 0x7f72bc0caef0 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72bb7fe700 1 -- 172.21.15.50:0/1533127690 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003570 con 0x7f72bc0caef0 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c124b700 1 -- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 msgr2=0x7f72bc159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c124b700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 0x7f72bc159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c124b700 1 -- 172.21.15.50:0/1533127690 >> v1:172.21.15.50:6789/0 conn(0x7f72bc0caef0 legacy=0x7f72bc0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c124b700 1 -- 172.21.15.50:0/1533127690 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0cf160 con 0x7f72bc0ccea0 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c0a4a700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 0x7f72bc159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c124b700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0ccea0 0x7f72bc0cb320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009e60 tx=0x7f72b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e003fb75cad78862 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72bb7fe700 1 -- 172.21.15.50:0/1533127690 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e070 con 0x7f72bc0ccea0 2023-12-24T18:51:12.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72bb7fe700 1 -- 172.21.15.50:0/1533127690 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400bab0 con 0x7f72bc0ccea0 2023-12-24T18:51:12.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72bb7fe700 1 -- 172.21.15.50:0/1533127690 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400be70 con 0x7f72bc0ccea0 2023-12-24T18:51:12.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0ccea0 msgr2=0x7f72bc0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0ccea0 0x7f72bc0cb320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009e60 tx=0x7f72b4009780 comp rx=0 tx=0).stop 2023-12-24T18:51:12.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1533127690 shutdown_connections 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0ccea0 0x7f72bc0cb320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1533127690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc158c50 0x7f72bc159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1533127690 >> 172.21.15.50:0/1533127690 conn(0x7f72bc0670b0 msgr2=0x7f72bc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1533127690 shutdown_connections 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.714+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1533127690 wait complete. 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 Processor -- start 2023-12-24T18:51:12.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 -- start start 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0caef0 0x7f72bc14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc0ccea0 0x7f72bc15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c5160 con 0x7f72bc158c50 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c55f0 con 0x7f72bc0caef0 2023-12-24T18:51:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c1a4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c4550 con 0x7f72bc0ccea0 2023-12-24T18:51:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c124b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c124b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54564/0 (socket says 172.21.15.50:54564) 2023-12-24T18:51:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c124b700 1 -- 172.21.15.50:0/1888367774 learned_addr learned my addr 172.21.15.50:0/1888367774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72bbfff700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc0ccea0 0x7f72bc15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.718+0000 7f72c0a4a700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0caef0 0x7f72bc14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 -- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc0ccea0 msgr2=0x7f72bc15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc0ccea0 0x7f72bc15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 -- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0caef0 msgr2=0x7f72bc14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0caef0 0x7f72bc14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 -- 172.21.15.50:0/1888367774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009420 con 0x7f72bc158c50 2023-12-24T18:51:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c124b700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f72b4013000 tx=0x7f72b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4012e10 con 0x7f72bc158c50 2023-12-24T18:51:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4027470 con 0x7f72bc158c50 2023-12-24T18:51:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4027830 con 0x7f72bc158c50 2023-12-24T18:51:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4009a20 con 0x7f72bc158c50 2023-12-24T18:51:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc0c4b10 con 0x7f72bc158c50 2023-12-24T18:51:12.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.722+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc06e170 con 0x7f72bc158c50 2023-12-24T18:51:12.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.726+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f72b4024070 con 0x7f72bc158c50 2023-12-24T18:51:12.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.726+0000 7f72b8ff9700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 0x7f72a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:12.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.726+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f72b407f380 con 0x7f72bc158c50 2023-12-24T18:51:12.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.726+0000 7f72c0a4a700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 0x7f72a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:12.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.726+0000 7f72c0a4a700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 0x7f72a0062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009ea0 tx=0x7f72b00091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:12.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.730+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72bc06e170 con 0x7f72bc158c50 2023-12-24T18:51:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.910+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f72bc0cac10 con 0x7f72bc158c50 2023-12-24T18:51:12.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.918+0000 7f72b8ff9700 1 -- 172.21.15.50:0/1888367774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72bc0cac10 con 0x7f72bc158c50 2023-12-24T18:51:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 msgr2=0x7f72a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 0x7f72a0062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009ea0 tx=0x7f72b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 msgr2=0x7f72bc15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f72b4013000 tx=0x7f72b4019000 comp rx=0 tx=0).stop 2023-12-24T18:51:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 shutdown_connections 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f72a0060550 0x7f72a0062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72bc158c50 0x7f72bc15b630 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72bc0ccea0 0x7f72bc15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 --2- 172.21.15.50:0/1888367774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72bc0caef0 0x7f72bc14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 >> 172.21.15.50:0/1888367774 conn(0x7f72bc0670b0 msgr2=0x7f72bc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 shutdown_connections 2023-12-24T18:51:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:12.922+0000 7f72c1a4c700 1 -- 172.21.15.50:0/1888367774 wait complete. 2023-12-24T18:51:12.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-12-24T18:51:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.114+0000 7f553880c700 1 Processor -- start 2023-12-24T18:51:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.114+0000 7f553880c700 1 -- start start 2023-12-24T18:51:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f553880c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553415a2d0 0x7f55340ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f553880c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f553406c820 0x7f55340ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f553880c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340b0460 con 0x7f55340adc90 2023-12-24T18:51:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f553880c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553406d8c0 con 0x7f553406c820 2023-12-24T18:51:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f553880c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55340afc60 con 0x7f553415a2d0 2023-12-24T18:51:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5533fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f55340adc90 0x7f55340b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44042/0 (socket says 172.21.15.50:44042) 2023-12-24T18:51:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5533fff700 1 -- 172.21.15.50:0/3738455230 learned_addr learned my addr 172.21.15.50:0/3738455230 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f55337fe700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553415a2d0 0x7f55340ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 --2- 172.21.15.50:0/3738455230 >> v2:172.21.15.82:3300/0 conn(0x7f553406c820 0x7f55340ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723719045 0 0) 0x7f55340b0460 con 0x7f55340adc90 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551c003570 con 0x7f55340adc90 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 -- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553415a2d0 msgr2=0x7f55340ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553415a2d0 0x7f55340ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 -- 172.21.15.50:0/3738455230 >> v1:172.21.15.50:6789/0 conn(0x7f55340adc90 legacy=0x7f55340b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853752752 0 0) 0x7f551c003570 con 0x7f55340adc90 2023-12-24T18:51:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 -- 172.21.15.50:0/3738455230 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340ae100 con 0x7f553406c820 2023-12-24T18:51:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.118+0000 7f5532ffd700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553406c820 0x7f55340ad750 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55280098e0 tx=0x7f55280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0b9baf4c0796b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c0017f0 con 0x7f553406c820 2023-12-24T18:51:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528011420 con 0x7f553406c820 2023-12-24T18:51:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f55327fc700 1 -- 172.21.15.50:0/3738455230 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280117c0 con 0x7f553406c820 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 -- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553406c820 msgr2=0x7f55340ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553406c820 0x7f55340ad750 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55280098e0 tx=0x7f55280091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 -- 172.21.15.50:0/3738455230 shutdown_connections 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553406c820 0x7f55340ad750 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 --2- 172.21.15.50:0/3738455230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553415a2d0 0x7f55340ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 -- 172.21.15.50:0/3738455230 >> 172.21.15.50:0/3738455230 conn(0x7f5534067b80 msgr2=0x7f55340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 -- 172.21.15.50:0/3738455230 shutdown_connections 2023-12-24T18:51:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.122+0000 7f553880c700 1 -- 172.21.15.50:0/3738455230 wait complete. 2023-12-24T18:51:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 Processor -- start 2023-12-24T18:51:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 -- start start 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 0x7f5534145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55340adc90 0x7f55341585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534155b40 con 0x7f553415a2d0 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534156100 con 0x7f55340adc90 2023-12-24T18:51:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f553880c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55341590d0 con 0x7f553406c820 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f5533fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f5533fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54572/0 (socket says 172.21.15.50:54572) 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f5533fff700 1 -- 172.21.15.50:0/663660671 learned_addr learned my addr 172.21.15.50:0/663660671 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f55337fe700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 0x7f5534145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.126+0000 7f5532ffd700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55340adc90 0x7f55341585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 -- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 msgr2=0x7f5534145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 0x7f5534145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 -- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55340adc90 msgr2=0x7f55341585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55340adc90 0x7f55341585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 -- 172.21.15.50:0/663660671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009420 con 0x7f553415a2d0 2023-12-24T18:51:13.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f55337fe700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 0x7f5534145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:13.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f5533fff700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f552c001560 tx=0x7f552c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c004dc0 con 0x7f553415a2d0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00a6a0 con 0x7f553415a2d0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55341593b0 con 0x7f553415a2d0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00aa60 con 0x7f553415a2d0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55340a4760 con 0x7f553415a2d0 2023-12-24T18:51:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.130+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5534156270 con 0x7f553415a2d0 2023-12-24T18:51:13.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.134+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f552c007150 con 0x7f553415a2d0 2023-12-24T18:51:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.134+0000 7f551b7fe700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 0x7f5520062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.134+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f552c07bf80 con 0x7f553415a2d0 2023-12-24T18:51:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.134+0000 7f55337fe700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 0x7f5520062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.134+0000 7f55337fe700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 0x7f5520062ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55240113e0 tx=0x7f55240091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.142+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f552c04c390 con 0x7f553415a2d0 2023-12-24T18:51:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.378+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f553404be40 con 0x7f553415a2d0 2023-12-24T18:51:13.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.702+0000 7f551b7fe700 1 -- 172.21.15.50:0/663660671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v544) v1 ==== 154+0+0 (secure 0 0 0) 0x7f552c018020 con 0x7f553415a2d0 2023-12-24T18:51:13.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 msgr2=0x7f5520062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 0x7f5520062ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55240113e0 tx=0x7f55240091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 msgr2=0x7f55340a4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f552c001560 tx=0x7f552c001640 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 shutdown_connections 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5520060600 0x7f5520062ab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553415a2d0 0x7f55340a4ef0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55340adc90 0x7f55341585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 --2- 172.21.15.50:0/663660671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553406c820 0x7f5534145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 >> 172.21.15.50:0/663660671 conn(0x7f5534067b80 msgr2=0x7f553406b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 shutdown_connections 2023-12-24T18:51:13.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.706+0000 7f553880c700 1 -- 172.21.15.50:0/663660671 wait complete. 2023-12-24T18:51:13.731 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-12-24T18:51:13.731 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-12-24T18:51:13.732 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:51:13.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-12-24T18:51:13.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.898+0000 7f7bca0ae700 1 Processor -- start 2023-12-24T18:51:13.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.898+0000 7f7bca0ae700 1 -- start start 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7bc413f920 0x7f7bc406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7bc40cb3c0 0x7f7bc406b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc406a6a0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40cb8a0 con 0x7f7bc413f920 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bca0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc406a960 con 0x7f7bc413f550 2023-12-24T18:51:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bc3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7bc40cb3c0 0x7f7bc406b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bc3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7bc40cb3c0 0x7f7bc406b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54574/0 (socket says 172.21.15.50:54574) 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bc3fff700 1 -- 172.21.15.50:0/2813498152 learned_addr learned my addr 172.21.15.50:0/2813498152 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bc37fe700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.902+0000 7f7bc2ffd700 1 --2- 172.21.15.50:0/2813498152 >> v2:172.21.15.82:3300/0 conn(0x7f7bc413f920 0x7f7bc406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 -- 172.21.15.50:0/2813498152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 msgr2=0x7f7bc40ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 -- 172.21.15.50:0/2813498152 >> v2:172.21.15.82:3300/0 conn(0x7f7bc413f920 msgr2=0x7f7bc406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 --2- 172.21.15.50:0/2813498152 >> v2:172.21.15.82:3300/0 conn(0x7f7bc413f920 0x7f7bc406b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 -- 172.21.15.50:0/2813498152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc406ac40 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc37fe700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc3fff700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc406b980 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7bc406e1f0 tx=0x7f7bbc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c757a31af7cf53c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc27fc700 1 -- 172.21.15.50:0/2813498152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc010070 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc27fc700 1 -- 172.21.15.50:0/2813498152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00dde0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bc27fc700 1 -- 172.21.15.50:0/2813498152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00b320 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 -- 172.21.15.50:0/2813498152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 msgr2=0x7f7bc406b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc406b980 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7bc406e1f0 tx=0x7f7bbc00ba50 comp rx=0 tx=0).stop 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 -- 172.21.15.50:0/2813498152 shutdown_connections 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/2813498152 >> v2:172.21.15.82:3300/0 conn(0x7f7bc413f920 0x7f7bc406b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc406b980 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/2813498152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 -- 172.21.15.50:0/2813498152 >> 172.21.15.50:0/2813498152 conn(0x7f7bc40cbba0 msgr2=0x7f7bc40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 -- 172.21.15.50:0/2813498152 shutdown_connections 2023-12-24T18:51:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.906+0000 7f7bca0ae700 1 -- 172.21.15.50:0/2813498152 wait complete. 2023-12-24T18:51:13.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.910+0000 7f7bca0ae700 1 Processor -- start 2023-12-24T18:51:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.910+0000 7f7bca0ae700 1 -- start start 2023-12-24T18:51:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc413f920 0x7f7bc40af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4158510 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4157900 con 0x7f7bc413f920 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4157be0 con 0x7f7bc413f550 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54586/0 (socket says 172.21.15.50:54586) 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 -- 172.21.15.50:0/125877038 learned_addr learned my addr 172.21.15.50:0/125877038 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc2ffd700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc3fff700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc413f920 0x7f7bc40af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 -- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 msgr2=0x7f7bc40c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 -- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc413f920 msgr2=0x7f7bc40af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc413f920 0x7f7bc40af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 -- 172.21.15.50:0/125877038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc00bcf0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bc37fe700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400e8d0 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4013410 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4013570 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4157ec0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4013910 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.914+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc41575b0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.918+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40652e0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.918+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7bb4013d00 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.922+0000 7f7bab7fe700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 0x7f7bb0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.922+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f7bb407c6a0 con 0x7f7bc40cb3c0 2023-12-24T18:51:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.922+0000 7f7bc2ffd700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 0x7f7bb0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.922+0000 7f7bc2ffd700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 0x7f7bb0062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7bc413ca70 tx=0x7f7bb80091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:13.926+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7bb404cad0 con 0x7f7bc40cb3c0 2023-12-24T18:51:14.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.158+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f7bc41596b0 con 0x7f7bc40cb3c0 2023-12-24T18:51:14.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.710+0000 7f7bab7fe700 1 -- 172.21.15.50:0/125877038 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v545) v1 ==== 159+0+0 (secure 0 0 0) 0x7f7bb40500f0 con 0x7f7bc40cb3c0 2023-12-24T18:51:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 msgr2=0x7f7bb0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 0x7f7bb0062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7bc413ca70 tx=0x7f7bb80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 msgr2=0x7f7bc413c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400e8d0 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 shutdown_connections 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7bb0060580 0x7f7bb0062a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc413f920 0x7f7bc40af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bc413f550 0x7f7bc40c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 --2- 172.21.15.50:0/125877038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bc40cb3c0 0x7f7bc413c0d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 >> 172.21.15.50:0/125877038 conn(0x7f7bc40cbba0 msgr2=0x7f7bc40ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.714+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 shutdown_connections 2023-12-24T18:51:14.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.718+0000 7f7bca0ae700 1 -- 172.21.15.50:0/125877038 wait complete. 2023-12-24T18:51:14.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:51:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.918+0000 7f396e08e700 1 Processor -- start 2023-12-24T18:51:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.918+0000 7f396e08e700 1 -- start start 2023-12-24T18:51:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396e08e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 0x7f3968159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396e08e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39680caef0 0x7f39680cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396e08e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39680caa60 con 0x7f39680cc790 2023-12-24T18:51:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396e08e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680af430 con 0x7f39680caef0 2023-12-24T18:51:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396e08e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680cee80 con 0x7f3968158c50 2023-12-24T18:51:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396d88d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39680cc790 0x7f39680afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44050/0 (socket says 172.21.15.50:44050) 2023-12-24T18:51:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396d88d700 1 -- 172.21.15.50:0/2239595170 learned_addr learned my addr 172.21.15.50:0/2239595170 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 --2- 172.21.15.50:0/2239595170 >> v2:172.21.15.50:3300/0 conn(0x7f39680caef0 0x7f39680cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396d08c700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 0x7f3968159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f395ffff700 1 -- 172.21.15.50:0/2239595170 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648047414 0 0) 0x7f39680caa60 con 0x7f39680cc790 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f395ffff700 1 -- 172.21.15.50:0/2239595170 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3954003570 con 0x7f39680cc790 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 -- 172.21.15.50:0/2239595170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 msgr2=0x7f3968159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 0x7f3968159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 -- 172.21.15.50:0/2239595170 >> v1:172.21.15.50:6789/0 conn(0x7f39680cc790 legacy=0x7f39680afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 -- 172.21.15.50:0/2239595170 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680cf160 con 0x7f39680caef0 2023-12-24T18:51:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396d08c700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 0x7f3968159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f396c88b700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680caef0 0x7f39680cb320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f39580098e0 tx=0x7f39580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd75631fd5e54ea server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f395ffff700 1 -- 172.21.15.50:0/2239595170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958011630 con 0x7f39680caef0 2023-12-24T18:51:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f395ffff700 1 -- 172.21.15.50:0/2239595170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958011790 con 0x7f39680caef0 2023-12-24T18:51:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.922+0000 7f395ffff700 1 -- 172.21.15.50:0/2239595170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958011b30 con 0x7f39680caef0 2023-12-24T18:51:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- 172.21.15.50:0/2239595170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680caef0 msgr2=0x7f39680cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680caef0 0x7f39680cb320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f39580098e0 tx=0x7f39580091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- 172.21.15.50:0/2239595170 shutdown_connections 2023-12-24T18:51:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680caef0 0x7f39680cb320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 --2- 172.21.15.50:0/2239595170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3968158c50 0x7f3968159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- 172.21.15.50:0/2239595170 >> 172.21.15.50:0/2239595170 conn(0x7f39680670b0 msgr2=0x7f39680674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- 172.21.15.50:0/2239595170 shutdown_connections 2023-12-24T18:51:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- 172.21.15.50:0/2239595170 wait complete. 2023-12-24T18:51:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 Processor -- start 2023-12-24T18:51:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.926+0000 7f396e08e700 1 -- start start 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f39680caef0 0x7f3968169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 0x7f39680c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b44e0 con 0x7f39680cc790 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396815a840 con 0x7f3968158c50 2023-12-24T18:51:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396816a320 con 0x7f39680caef0 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54608/0 (socket says 172.21.15.50:54608) 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 -- 172.21.15.50:0/3608224328 learned_addr learned my addr 172.21.15.50:0/3608224328 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396d88d700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 0x7f39680c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396d08c700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f39680caef0 0x7f3968169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 -- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f39680caef0 msgr2=0x7f3968169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f39680caef0 0x7f3968169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 -- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 msgr2=0x7f39680c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 0x7f39680c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 -- 172.21.15.50:0/3608224328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964009420 con 0x7f39680cc790 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396d88d700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 0x7f39680c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396c88b700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f39680cd560 tx=0x7f3958017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958011b10 con 0x7f39680cc790 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580253f0 con 0x7f39680cc790 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958025790 con 0x7f39680cc790 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3958009420 con 0x7f39680cc790 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.930+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396815aa90 con 0x7f39680cc790 2023-12-24T18:51:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.934+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396804be40 con 0x7f39680cc790 2023-12-24T18:51:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.934+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3958025b80 con 0x7f39680cc790 2023-12-24T18:51:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.934+0000 7f395d7fa700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 0x7f394c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.934+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f395807e270 con 0x7f39680cc790 2023-12-24T18:51:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.934+0000 7f396d08c700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 0x7f394c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.938+0000 7f396d08c700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 0x7f394c062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3964009da0 tx=0x7f3964008040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:14.942+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f395804e6a0 con 0x7f39680cc790 2023-12-24T18:51:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.110+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f39680ca410 con 0x7f39680cc790 2023-12-24T18:51:15.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.122+0000 7f395d7fa700 1 -- 172.21.15.50:0/3608224328 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3958051cc0 con 0x7f39680cc790 2023-12-24T18:51:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 msgr2=0x7f394c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 0x7f394c062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3964009da0 tx=0x7f3964008040 comp rx=0 tx=0).stop 2023-12-24T18:51:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 msgr2=0x7f39680c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f39680cd560 tx=0x7f3958017000 comp rx=0 tx=0).stop 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 shutdown_connections 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f394c060550 0x7f394c062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3968158c50 0x7f39680c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39680cc790 0x7f39680c5a20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 --2- 172.21.15.50:0/3608224328 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f39680caef0 0x7f3968169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 >> 172.21.15.50:0/3608224328 conn(0x7f39680670b0 msgr2=0x7f396806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 shutdown_connections 2023-12-24T18:51:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.126+0000 7f396e08e700 1 -- 172.21.15.50:0/3608224328 wait complete. 2023-12-24T18:51:15.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:51:15.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:15.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:15.241 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:51:15.241 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:51:15.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:15.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.402+0000 7f28a42ae700 1 Processor -- start 2023-12-24T18:51:15.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.402+0000 7f28a42ae700 1 -- start start 2023-12-24T18:51:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a42ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f289c154b60 0x7f289c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a42ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c06c820 con 0x7f289c0c6d00 2023-12-24T18:51:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a42ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c06b960 con 0x7f289c06aca0 2023-12-24T18:51:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a42ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c06bc40 con 0x7f289c154b60 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f289c154b60 0x7f289c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f289c154b60 0x7f289c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54618/0 (socket says 172.21.15.50:54618) 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 -- 172.21.15.50:0/4245193011 learned_addr learned my addr 172.21.15.50:0/4245193011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a204a700 1 --1- 172.21.15.50:0/4245193011 >> v1:172.21.15.50:6789/0 conn(0x7f289c0c6d00 0x7f289c154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44060/0 (socket says 172.21.15.50:44060) 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 -- 172.21.15.50:0/4245193011 >> v1:172.21.15.82:6789/0 conn(0x7f289c06aca0 legacy=0x7f289c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 -- 172.21.15.50:0/4245193011 >> v1:172.21.15.50:6789/0 conn(0x7f289c0c6d00 legacy=0x7f289c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 -- 172.21.15.50:0/4245193011 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c06bf20 con 0x7f289c154b60 2023-12-24T18:51:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1849700 1 --2- 172.21.15.50:0/4245193011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c154b60 0x7f289c0c70d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f288c0099b0 tx=0x7f288c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a6c4e3d90843b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1048700 1 -- 172.21.15.50:0/4245193011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00b860 con 0x7f289c154b60 2023-12-24T18:51:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1048700 1 -- 172.21.15.50:0/4245193011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00b9c0 con 0x7f289c154b60 2023-12-24T18:51:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.406+0000 7f28a1048700 1 -- 172.21.15.50:0/4245193011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00bd60 con 0x7f289c154b60 2023-12-24T18:51:15.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 -- 172.21.15.50:0/4245193011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c154b60 msgr2=0x7f289c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 --2- 172.21.15.50:0/4245193011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c154b60 0x7f289c0c70d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f288c0099b0 tx=0x7f288c009250 comp rx=0 tx=0).stop 2023-12-24T18:51:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 -- 172.21.15.50:0/4245193011 shutdown_connections 2023-12-24T18:51:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 --2- 172.21.15.50:0/4245193011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c154b60 0x7f289c0c70d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 -- 172.21.15.50:0/4245193011 >> 172.21.15.50:0/4245193011 conn(0x7f289c0cbba0 msgr2=0x7f289c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 -- 172.21.15.50:0/4245193011 shutdown_connections 2023-12-24T18:51:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.410+0000 7f28a42ae700 1 -- 172.21.15.50:0/4245193011 wait complete. 2023-12-24T18:51:15.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 Processor -- start 2023-12-24T18:51:15.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 -- start start 2023-12-24T18:51:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 0x7f289c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 0x7f289c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c16a4e0 con 0x7f289c0c6d00 2023-12-24T18:51:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c169910 con 0x7f289c154b60 2023-12-24T18:51:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a42ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c169bb0 con 0x7f289c06aca0 2023-12-24T18:51:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54630/0 (socket says 172.21.15.50:54630) 2023-12-24T18:51:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 -- 172.21.15.50:0/3414375028 learned_addr learned my addr 172.21.15.50:0/3414375028 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a204a700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 0x7f289c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a284b700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 0x7f289c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 -- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 msgr2=0x7f289c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 0x7f289c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 -- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 msgr2=0x7f289c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 0x7f289c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a1849700 1 -- 172.21.15.50:0/3414375028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0094f0 con 0x7f289c0c6d00 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a204a700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 0x7f289c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.414+0000 7f28a284b700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 0x7f289c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28a1849700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f289c069da0 tx=0x7f288c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c011ea0 con 0x7f289c0c6d00 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c01a630 con 0x7f289c0c6d00 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c01a9d0 con 0x7f289c0c6d00 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c169e90 con 0x7f289c0c6d00 2023-12-24T18:51:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c152c60 con 0x7f289c0c6d00 2023-12-24T18:51:15.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.418+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c152e50 con 0x7f289c0c6d00 2023-12-24T18:51:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.422+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f288c02d440 con 0x7f289c0c6d00 2023-12-24T18:51:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.422+0000 7f28927fc700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 0x7f2880062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.422+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7f288c07e500 con 0x7f289c0c6d00 2023-12-24T18:51:15.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.422+0000 7f28a204a700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 0x7f2880062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.422+0000 7f28a204a700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 0x7f2880062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2898007fd0 tx=0x7f2898007e10 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.430+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f288c04e890 con 0x7f289c0c6d00 2023-12-24T18:51:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.634+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f289c065340 con 0x7f289c0c6d00 2023-12-24T18:51:15.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28927fc700 1 -- 172.21.15.50:0/3414375028 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f288c015de0 con 0x7f289c0c6d00 2023-12-24T18:51:15.638 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:15.638 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2969490169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2969490169},{"type":"v1","addr":"172.21.15.82:6833","nonce":2969490169}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2395600386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2395600386},{"type":"v1","addr":"172.21.15.82:6835","nonce":2395600386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2204388539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2204388539},{"type":"v1","addr":"172.21.15.50:6837","nonce":2204388539}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1696619523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1696619523},{"type":"v1","addr":"172.21.15.50:6833","nonce":1696619523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 msgr2=0x7f2880062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 0x7f2880062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2898007fd0 tx=0x7f2898007e10 comp rx=0 tx=0).stop 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 msgr2=0x7f289c0aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f289c069da0 tx=0x7f288c017000 comp rx=0 tx=0).stop 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 shutdown_connections 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2880060550 0x7f2880062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f289c154b60 0x7f289c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f289c0c6d00 0x7f289c0aa630 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 --2- 172.21.15.50:0/3414375028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f289c06aca0 0x7f289c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 >> 172.21.15.50:0/3414375028 conn(0x7f289c0cbba0 msgr2=0x7f289c1538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:15.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 shutdown_connections 2023-12-24T18:51:15.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.638+0000 7f28a42ae700 1 -- 172.21.15.50:0/3414375028 wait complete. 2023-12-24T18:51:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2023-12-24T18:51:15.662 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:51:15.662 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:51:15.662 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:51:15.662 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:15.662 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:51:15.662 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:51:15.663 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:51:15.663 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:15.663 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:51:15.663 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:51:15.663 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:51:15.663 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:15.663 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:51:15.663 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:51:15.664 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:51:15.664 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:15.678 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:51:15.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:51:15.685 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:51:15.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:51:15.694 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:51:15.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:51:15.695 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:51:15.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:51:15.731 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:51:15.732 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:15.738 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:51:15.738 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:15.743 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:51:15.743 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:15.746 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:51:15.746 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:15.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:51:15.842 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:51:15.842 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:51:15.861 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:51:15.864 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:51:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.910+0000 7fc4c920c700 1 Processor -- start 2023-12-24T18:51:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.910+0000 7fc4c920c700 1 -- start start 2023-12-24T18:51:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c920c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4c40ad220 0x7fc4c40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c920c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c406e110 con 0x7fc4c4155e20 2023-12-24T18:51:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c920c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c406bb40 con 0x7fc4c406afa0 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c920c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c406be20 con 0x7fc4c40ad220 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4c40ad220 0x7fc4c40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c8a0b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc4c4155e20 0x7fc4c40aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44068/0 (socket says 172.21.15.50:44068) 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c8a0b700 1 -- 172.21.15.50:0/1602672438 learned_addr learned my addr 172.21.15.50:0/1602672438 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4c40ad220 0x7fc4c40ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54676/0 (socket says 172.21.15.50:54676) 2023-12-24T18:51:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078765815 0 0) 0x7fc4c406e110 con 0x7fc4c4155e20 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a4003570 con 0x7fc4c4155e20 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513197747 0 0) 0x7fc4c406bb40 con 0x7fc4c406afa0 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 -- 172.21.15.50:0/1602672438 >> v1:172.21.15.82:6789/0 conn(0x7fc4c406afa0 legacy=0x7fc4c4155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 -- 172.21.15.50:0/1602672438 >> v1:172.21.15.50:6789/0 conn(0x7fc4c4155e20 legacy=0x7fc4c40aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 -- 172.21.15.50:0/1602672438 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40af740 con 0x7fc4c40ad220 2023-12-24T18:51:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c3fff700 1 --2- 172.21.15.50:0/1602672438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c40ad220 0x7fc4c40ad5f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40098e0 tx=0x7fc4b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29ba33145824535 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.914+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400b640 con 0x7fc4c40ad220 2023-12-24T18:51:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400b7a0 con 0x7fc4c40ad220 2023-12-24T18:51:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c37fe700 1 -- 172.21.15.50:0/1602672438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400bb40 con 0x7fc4c40ad220 2023-12-24T18:51:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 -- 172.21.15.50:0/1602672438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c40ad220 msgr2=0x7fc4c40ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 --2- 172.21.15.50:0/1602672438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c40ad220 0x7fc4c40ad5f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40098e0 tx=0x7fc4b40091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 -- 172.21.15.50:0/1602672438 shutdown_connections 2023-12-24T18:51:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 --2- 172.21.15.50:0/1602672438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c40ad220 0x7fc4c40ad5f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 -- 172.21.15.50:0/1602672438 >> 172.21.15.50:0/1602672438 conn(0x7fc4c4067b80 msgr2=0x7fc4c40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 -- 172.21.15.50:0/1602672438 shutdown_connections 2023-12-24T18:51:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 -- 172.21.15.50:0/1602672438 wait complete. 2023-12-24T18:51:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.918+0000 7fc4c920c700 1 Processor -- start 2023-12-24T18:51:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- start start 2023-12-24T18:51:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 0x7fc4c41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c4155e20 0x7fc4c4154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41537a0 con 0x7fc4c406afa0 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4152b90 con 0x7fc4c4155e20 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4152e70 con 0x7fc4c40ad220 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54688/0 (socket says 172.21.15.50:54688) 2023-12-24T18:51:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 -- 172.21.15.50:0/761191654 learned_addr learned my addr 172.21.15.50:0/761191654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c8a0b700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c4155e20 0x7fc4c4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4bb7fe700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 0x7fc4c41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 -- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 msgr2=0x7fc4c41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 0x7fc4c41589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 -- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c4155e20 msgr2=0x7fc4c4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c4155e20 0x7fc4c4154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 -- 172.21.15.50:0/761191654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009420 con 0x7fc4c406afa0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4bb7fe700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 0x7fc4c41589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c3fff700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40c95c0 tx=0x7fc4b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b401f070 con 0x7fc4c406afa0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400bb20 con 0x7fc4c406afa0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4011650 con 0x7fc4c406afa0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c4153150 con 0x7fc4c406afa0 2023-12-24T18:51:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.922+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c4154170 con 0x7fc4c406afa0 2023-12-24T18:51:15.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.926+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c404be40 con 0x7fc4c406afa0 2023-12-24T18:51:15.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.926+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc4b4011a40 con 0x7fc4c406afa0 2023-12-24T18:51:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.926+0000 7fc4c0ff9700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 0x7fc4a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.930+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6151+0+0 (secure 0 0 0) 0x7fc4b407de90 con 0x7fc4c406afa0 2023-12-24T18:51:15.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.930+0000 7fc4bb7fe700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 0x7fc4a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:15.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.930+0000 7fc4bb7fe700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 0x7fc4a8062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0011e0 tx=0x7fc4ac009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:15.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:15.934+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4b404e220 con 0x7fc4c406afa0 2023-12-24T18:51:16.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.126+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc4c40cc840 con 0x7fc4c406afa0 2023-12-24T18:51:16.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.738+0000 7fc4c0ff9700 1 -- 172.21.15.50:0/761191654 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc4b4051840 con 0x7fc4c406afa0 2023-12-24T18:51:16.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 msgr2=0x7fc4a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 0x7fc4a8062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0011e0 tx=0x7fc4ac009040 comp rx=0 tx=0).stop 2023-12-24T18:51:16.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 msgr2=0x7fc4c4153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40c95c0 tx=0x7fc4b4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 shutdown_connections 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc4a8060550 0x7fc4a8062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c4155e20 0x7fc4c4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4c40ad220 0x7fc4c41589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 --2- 172.21.15.50:0/761191654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4c406afa0 0x7fc4c4153c30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 >> 172.21.15.50:0/761191654 conn(0x7fc4c4067b80 msgr2=0x7fc4c414d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 shutdown_connections 2023-12-24T18:51:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.742+0000 7fc4c920c700 1 -- 172.21.15.50:0/761191654 wait complete. 2023-12-24T18:51:16.745 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:51:16.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:51:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 Processor -- start 2023-12-24T18:51:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 -- start start 2023-12-24T18:51:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f365c154b60 0x7f365c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c06c820 con 0x7f365c0c6d00 2023-12-24T18:51:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c06b960 con 0x7f365c154b60 2023-12-24T18:51:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f36614cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c06bc40 con 0x7f365c06aca0 2023-12-24T18:51:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f3653fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f365c154b60 0x7f365c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f3653fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f365c154b60 0x7f365c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54696/0 (socket says 172.21.15.50:54696) 2023-12-24T18:51:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f3653fff700 1 -- 172.21.15.50:0/1528904756 learned_addr learned my addr 172.21.15.50:0/1528904756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.930+0000 7f365b7fe700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f3653fff700 1 -- 172.21.15.50:0/1528904756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 msgr2=0x7f365c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f3653fff700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f3653fff700 1 -- 172.21.15.50:0/1528904756 >> v1:172.21.15.50:6789/0 conn(0x7f365c0c6d00 legacy=0x7f365c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f3653fff700 1 -- 172.21.15.50:0/1528904756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c06bf20 con 0x7f365c154b60 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f365b7fe700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f3653fff700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c0c70d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36440099b0 tx=0x7f3644009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32441eb0e3662906 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f365a7fc700 1 -- 172.21.15.50:0/1528904756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400b860 con 0x7f365c154b60 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f365a7fc700 1 -- 172.21.15.50:0/1528904756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400b9c0 con 0x7f365c154b60 2023-12-24T18:51:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f365a7fc700 1 -- 172.21.15.50:0/1528904756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400bd60 con 0x7f365c154b60 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 -- 172.21.15.50:0/1528904756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 msgr2=0x7f365c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c0c70d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36440099b0 tx=0x7f3644009250 comp rx=0 tx=0).stop 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 -- 172.21.15.50:0/1528904756 shutdown_connections 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 --2- 172.21.15.50:0/1528904756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c0c70d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 -- 172.21.15.50:0/1528904756 >> 172.21.15.50:0/1528904756 conn(0x7f365c0cbba0 msgr2=0x7f365c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 -- 172.21.15.50:0/1528904756 shutdown_connections 2023-12-24T18:51:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.934+0000 7f36614cd700 1 -- 172.21.15.50:0/1528904756 wait complete. 2023-12-24T18:51:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 Processor -- start 2023-12-24T18:51:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 -- start start 2023-12-24T18:51:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365c0c6d00 0x7f365c0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c16a320 con 0x7f365c154b60 2023-12-24T18:51:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c156bf0 con 0x7f365c0c6d00 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f36614cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c156e40 con 0x7f365c06aca0 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54710/0 (socket says 172.21.15.50:54710) 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 -- 172.21.15.50:0/1017180128 learned_addr learned my addr 172.21.15.50:0/1017180128 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f3653fff700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365c0c6d00 0x7f365c0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365affd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 -- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 msgr2=0x7f365c169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 -- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365c0c6d00 msgr2=0x7f365c0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365c0c6d00 0x7f365c0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 -- 172.21.15.50:0/1017180128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440094f0 con 0x7f365c154b60 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.938+0000 7f365b7fe700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f365400d180 tx=0x7f3654009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365400dcc0 con 0x7f365c154b60 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365400f040 con 0x7f365c154b60 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c157120 con 0x7f365c154b60 2023-12-24T18:51:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654015690 con 0x7f365c154b60 2023-12-24T18:51:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0ad9c0 con 0x7f365c154b60 2023-12-24T18:51:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c157360 con 0x7f365c154b60 2023-12-24T18:51:16.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f365401e3b0 con 0x7f365c154b60 2023-12-24T18:51:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.942+0000 7f3652ffd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 0x7f363c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.946+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f365407cc60 con 0x7f365c154b60 2023-12-24T18:51:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.946+0000 7f365affd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 0x7f363c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:16.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.946+0000 7f365affd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 0x7f363c062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f364c0039f0 tx=0x7f364c007ec0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:16.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:16.950+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f365c157360 con 0x7f365c154b60 2023-12-24T18:51:17.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.182+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f365c157360 con 0x7f365c154b60 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.182+0000 7f3652ffd700 1 -- 172.21.15.50:0/1017180128 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f365c157360 con 0x7f365c154b60 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:51:17.185 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.186 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:51:17.187 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:17.189 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:51:17.190 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.191 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.194 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:51:17.195 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:51:17.197 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.201 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:51:17.202 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:51:17.203 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:51:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 msgr2=0x7f363c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 0x7f363c062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f364c0039f0 tx=0x7f364c007ec0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 msgr2=0x7f365c152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f365400d180 tx=0x7f3654009a50 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 shutdown_connections 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f363c060550 0x7f363c062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c154b60 0x7f365c152e60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365c0c6d00 0x7f365c0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 --2- 172.21.15.50:0/1017180128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f365c06aca0 0x7f365c169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 >> 172.21.15.50:0/1017180128 conn(0x7f365c0cbba0 msgr2=0x7f365c154220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 shutdown_connections 2023-12-24T18:51:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.186+0000 7f36614cd700 1 -- 172.21.15.50:0/1017180128 wait complete. 2023-12-24T18:51:17.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.378+0000 7f262f22e700 1 Processor -- start 2023-12-24T18:51:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.382+0000 7f262f22e700 1 -- start start 2023-12-24T18:51:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.382+0000 7f262f22e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 0x7f262806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262806c820 con 0x7f2628154450 2023-12-24T18:51:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262806b960 con 0x7f26280c6d00 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262806bc40 con 0x7f262806aca0 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262cfca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262cfca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54726/0 (socket says 172.21.15.50:54726) 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262cfca700 1 -- 172.21.15.50:0/3535228453 learned_addr learned my addr 172.21.15.50:0/3535228453 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 --2- 172.21.15.50:0/3535228453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 0x7f262806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 -- 172.21.15.50:0/3535228453 >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 msgr2=0x7f26280c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 --2- 172.21.15.50:0/3535228453 >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 -- 172.21.15.50:0/3535228453 >> v1:172.21.15.50:6789/0 conn(0x7f2628154450 legacy=0x7f26281548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 -- 172.21.15.50:0/3535228453 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262806bf20 con 0x7f262806aca0 2023-12-24T18:51:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262cfca700 1 --2- 172.21.15.50:0/3535228453 >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f26277fe700 1 -- 172.21.15.50:0/3535228453 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229533432 0 0) 0x7f262806c820 con 0x7f2628154450 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262d7cb700 1 --2- 172.21.15.50:0/3535228453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 0x7f262806b140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e60 tx=0x7f2620009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b98577e6ed17136 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f26277fe700 1 -- 172.21.15.50:0/3535228453 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000e070 con 0x7f262806aca0 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f26277fe700 1 -- 172.21.15.50:0/3535228453 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000bb60 con 0x7f262806aca0 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f26277fe700 1 -- 172.21.15.50:0/3535228453 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620012430 con 0x7f262806aca0 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 -- 172.21.15.50:0/3535228453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 msgr2=0x7f262806b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.386+0000 7f262f22e700 1 --2- 172.21.15.50:0/3535228453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 0x7f262806b140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e60 tx=0x7f2620009780 comp rx=0 tx=0).stop 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- 172.21.15.50:0/3535228453 shutdown_connections 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 --2- 172.21.15.50:0/3535228453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f262806aca0 0x7f262806b140 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 --2- 172.21.15.50:0/3535228453 >> v2:172.21.15.50:3300/0 conn(0x7f26280c6d00 0x7f26280c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- 172.21.15.50:0/3535228453 >> 172.21.15.50:0/3535228453 conn(0x7f26280cbba0 msgr2=0x7f26280cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- 172.21.15.50:0/3535228453 shutdown_connections 2023-12-24T18:51:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- 172.21.15.50:0/3535228453 wait complete. 2023-12-24T18:51:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 Processor -- start 2023-12-24T18:51:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- start start 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 0x7f262816e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2628154450 0x7f26280c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c3000 con 0x7f262806aca0 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c4ea0 con 0x7f2628154450 2023-12-24T18:51:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.390+0000 7f262f22e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26281568f0 con 0x7f26280c6d00 2023-12-24T18:51:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262cfca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262cfca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54734/0 (socket says 172.21.15.50:54734) 2023-12-24T18:51:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262cfca700 1 -- 172.21.15.50:0/370287869 learned_addr learned my addr 172.21.15.50:0/370287869 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 0x7f262816e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262d7cb700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2628154450 0x7f26280c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 -- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2628154450 msgr2=0x7f26280c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2628154450 0x7f26280c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 -- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 msgr2=0x7f26281563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 -- 172.21.15.50:0/370287869 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0094f0 con 0x7f26280c6d00 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262cfca700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2627fff700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 0x7f262816e1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f261400c510 tx=0x7f2614007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400ce80 con 0x7f26280c6d00 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614011590 con 0x7f26280c6d00 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2620009a20 con 0x7f26280c6d00 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614011950 con 0x7f26280c6d00 2023-12-24T18:51:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280c4850 con 0x7f26280c6d00 2023-12-24T18:51:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.394+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280652e0 con 0x7f26280c6d00 2023-12-24T18:51:17.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.398+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2614011d40 con 0x7f26280c6d00 2023-12-24T18:51:17.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.398+0000 7f2624ff9700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 0x7f260c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.398+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f261407bb40 con 0x7f26280c6d00 2023-12-24T18:51:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.398+0000 7f262cfca700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 0x7f260c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.402+0000 7f262cfca700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 0x7f260c062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2628153e10 tx=0x7f261c009250 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.410+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f261404c130 con 0x7f26280c6d00 2023-12-24T18:51:17.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.578+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26280c4bf0 con 0x7f26280c6d00 2023-12-24T18:51:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f2624ff9700 1 -- 172.21.15.50:0/370287869 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+12863 (secure 0 0 0) 0x7f261404f750 con 0x7f26280c6d00 2023-12-24T18:51:17.583 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:17.583 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":79,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:16.746946+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 msgr2=0x7f260c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 0x7f260c062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2628153e10 tx=0x7f261c009250 comp rx=0 tx=0).stop 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 msgr2=0x7f262816e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 0x7f262816e1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f261400c510 tx=0x7f2614007ec0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 shutdown_connections 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f260c060550 0x7f260c062a00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2628154450 0x7f26280c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26280c6d00 0x7f262816e1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 --2- 172.21.15.50:0/370287869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262806aca0 0x7f26281563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.582+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 >> 172.21.15.50:0/370287869 conn(0x7f26280cbba0 msgr2=0x7f2628062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.586+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 shutdown_connections 2023-12-24T18:51:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.586+0000 7f262f22e700 1 -- 172.21.15.50:0/370287869 wait complete. 2023-12-24T18:51:17.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:51:17.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:51:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 Processor -- start 2023-12-24T18:51:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 -- start start 2023-12-24T18:51:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 0x7fe44c163e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c0c71f0 con 0x7fe44c0c8dd0 2023-12-24T18:51:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c15cb10 con 0x7fe44c0c8a00 2023-12-24T18:51:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.790+0000 7fe45200c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c15d790 con 0x7fe44c1500c0 2023-12-24T18:51:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe450809700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe44c0c8dd0 0x7fe44c14f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44102/0 (socket says 172.21.15.50:44102) 2023-12-24T18:51:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe450809700 1 -- 172.21.15.50:0/2822781577 learned_addr learned my addr 172.21.15.50:0/2822781577 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45180b700 1 --2- 172.21.15.50:0/2822781577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 0x7fe44c163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677738027 0 0) 0x7fe44c0c71f0 con 0x7fe44c0c8dd0 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe438003570 con 0x7fe44c0c8dd0 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45180b700 1 -- 172.21.15.50:0/2822781577 >> v1:172.21.15.82:6789/0 conn(0x7fe44c0c8a00 legacy=0x7fe44c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018558721 0 0) 0x7fe44c15cb10 con 0x7fe44c0c8a00 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45180b700 1 -- 172.21.15.50:0/2822781577 >> v1:172.21.15.50:6789/0 conn(0x7fe44c0c8dd0 legacy=0x7fe44c14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45180b700 1 -- 172.21.15.50:0/2822781577 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c15cdf0 con 0x7fe44c1500c0 2023-12-24T18:51:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45180b700 1 --2- 172.21.15.50:0/2822781577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 0x7fe44c163e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe444009e90 tx=0x7fe444009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d2d9d2806afa84 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400e070 con 0x7fe44c1500c0 2023-12-24T18:51:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44400bc30 con 0x7fe44c1500c0 2023-12-24T18:51:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe443fff700 1 -- 172.21.15.50:0/2822781577 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe444012430 con 0x7fe44c1500c0 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45200c700 1 -- 172.21.15.50:0/2822781577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 msgr2=0x7fe44c163e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45200c700 1 --2- 172.21.15.50:0/2822781577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 0x7fe44c163e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe444009e90 tx=0x7fe444009780 comp rx=0 tx=0).stop 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45200c700 1 -- 172.21.15.50:0/2822781577 shutdown_connections 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45200c700 1 --2- 172.21.15.50:0/2822781577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c1500c0 0x7fe44c163e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.794+0000 7fe45200c700 1 -- 172.21.15.50:0/2822781577 >> 172.21.15.50:0/2822781577 conn(0x7fe44c067250 msgr2=0x7fe44c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.798+0000 7fe45200c700 1 -- 172.21.15.50:0/2822781577 shutdown_connections 2023-12-24T18:51:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.798+0000 7fe45200c700 1 -- 172.21.15.50:0/2822781577 wait complete. 2023-12-24T18:51:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.798+0000 7fe45200c700 1 Processor -- start 2023-12-24T18:51:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.798+0000 7fe45200c700 1 -- start start 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c0c8a00 0x7fe44c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe44c0c8dd0 0x7fe44c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1525f0 con 0x7fe44c1500c0 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1519e0 con 0x7fe44c0c8dd0 2023-12-24T18:51:17.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45200c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c151cc0 con 0x7fe44c0c8a00 2023-12-24T18:51:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45100a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c0c8a00 0x7fe44c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54746/0 (socket says 172.21.15.50:54746) 2023-12-24T18:51:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 -- 172.21.15.50:0/2143091447 learned_addr learned my addr 172.21.15.50:0/2143091447 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe450809700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe44c0c8dd0 0x7fe44c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 -- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c0c8a00 msgr2=0x7fe44c14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c0c8a00 0x7fe44c14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 -- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe44c0c8dd0 msgr2=0x7fe44c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe44c0c8dd0 0x7fe44c0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.802+0000 7fe45180b700 1 -- 172.21.15.50:0/2143091447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444009a20 con 0x7fe44c1500c0 2023-12-24T18:51:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe45180b700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0c9540 tx=0x7fe444019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44401b420 con 0x7fe44c1500c0 2023-12-24T18:51:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44401b5a0 con 0x7fe44c1500c0 2023-12-24T18:51:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44401b960 con 0x7fe44c1500c0 2023-12-24T18:51:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c151fa0 con 0x7fe44c1500c0 2023-12-24T18:51:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c14f280 con 0x7fe44c1500c0 2023-12-24T18:51:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.806+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c063fe0 con 0x7fe44c1500c0 2023-12-24T18:51:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.810+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe44401bcd0 con 0x7fe44c1500c0 2023-12-24T18:51:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.810+0000 7fe4417fa700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 0x7fe430062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.810+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fe44407e640 con 0x7fe44c1500c0 2023-12-24T18:51:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.810+0000 7fe45100a700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 0x7fe430062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.810+0000 7fe45100a700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 0x7fe430062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe448007fd0 tx=0x7fe448007d30 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:17.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.818+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe44c063fe0 con 0x7fe44c1500c0 2023-12-24T18:51:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.994+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe44c063fe0 con 0x7fe44c1500c0 2023-12-24T18:51:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe4417fa700 1 -- 172.21.15.50:0/2143091447 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe44c063fe0 con 0x7fe44c1500c0 2023-12-24T18:51:17.998 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:51:18.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 msgr2=0x7fe430062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 0x7fe430062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe448007fd0 tx=0x7fe448007d30 comp rx=0 tx=0).stop 2023-12-24T18:51:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 msgr2=0x7fe44c152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0c9540 tx=0x7fe444019000 comp rx=0 tx=0).stop 2023-12-24T18:51:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 shutdown_connections 2023-12-24T18:51:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe430060550 0x7fe430062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c1500c0 0x7fe44c152a80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe44c0c8dd0 0x7fe44c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 --2- 172.21.15.50:0/2143091447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe44c0c8a00 0x7fe44c14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 >> 172.21.15.50:0/2143091447 conn(0x7fe44c067250 msgr2=0x7fe44c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 shutdown_connections 2023-12-24T18:51:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:17.998+0000 7fe45200c700 1 -- 172.21.15.50:0/2143091447 wait complete. 2023-12-24T18:51:18.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:51:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 Processor -- start 2023-12-24T18:51:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 -- start start 2023-12-24T18:51:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f417006c820 0x7f41700ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41700b0460 con 0x7f417015a2d0 2023-12-24T18:51:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417006a5c0 con 0x7f41700adc90 2023-12-24T18:51:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.190+0000 7f4175c16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417006d8c0 con 0x7f417006c820 2023-12-24T18:51:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4174c14700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f417015a2d0 0x7f41700ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44104/0 (socket says 172.21.15.50:44104) 2023-12-24T18:51:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4174c14700 1 -- 172.21.15.50:0/3749439664 learned_addr learned my addr 172.21.15.50:0/3749439664 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4167fff700 1 --2- 172.21.15.50:0/3749439664 >> v2:172.21.15.82:3300/0 conn(0x7f417006c820 0x7f41700ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786275296 0 0) 0x7f417006a5c0 con 0x7f41700adc90 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4158003570 con 0x7f41700adc90 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14935646 0 0) 0x7f41700b0460 con 0x7f417015a2d0 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417006a5c0 con 0x7f417015a2d0 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4167fff700 1 -- 172.21.15.50:0/3749439664 >> v1:172.21.15.82:6789/0 conn(0x7f41700adc90 legacy=0x7f4170160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4167fff700 1 -- 172.21.15.50:0/3749439664 >> v1:172.21.15.50:6789/0 conn(0x7f417015a2d0 legacy=0x7f41700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4167fff700 1 -- 172.21.15.50:0/3749439664 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417006ccb0 con 0x7f417006c820 2023-12-24T18:51:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4167fff700 1 --2- 172.21.15.50:0/3749439664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417006c820 0x7f41700ad750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41600098e0 tx=0x7f41600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef3e427c041d38f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160011630 con 0x7f417006c820 2023-12-24T18:51:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160011790 con 0x7f417006c820 2023-12-24T18:51:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f41677fe700 1 -- 172.21.15.50:0/3749439664 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160011b30 con 0x7f417006c820 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4175c16700 1 -- 172.21.15.50:0/3749439664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417006c820 msgr2=0x7f41700ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.194+0000 7f4175c16700 1 --2- 172.21.15.50:0/3749439664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417006c820 0x7f41700ad750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41600098e0 tx=0x7f41600091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 -- 172.21.15.50:0/3749439664 shutdown_connections 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 --2- 172.21.15.50:0/3749439664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417006c820 0x7f41700ad750 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 -- 172.21.15.50:0/3749439664 >> 172.21.15.50:0/3749439664 conn(0x7f4170067b80 msgr2=0x7f41700cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 -- 172.21.15.50:0/3749439664 shutdown_connections 2023-12-24T18:51:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 -- 172.21.15.50:0/3749439664 wait complete. 2023-12-24T18:51:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 Processor -- start 2023-12-24T18:51:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.198+0000 7f4175c16700 1 -- start start 2023-12-24T18:51:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f417006c820 0x7f4170146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41700adc90 0x7f41700ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417016d280 con 0x7f417015a2d0 2023-12-24T18:51:18.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417016c390 con 0x7f41700adc90 2023-12-24T18:51:18.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175c16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417016c670 con 0x7f417006c820 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54752/0 (socket says 172.21.15.50:54752) 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 -- 172.21.15.50:0/168190643 learned_addr learned my addr 172.21.15.50:0/168190643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4174c14700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f417006c820 0x7f4170146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4167fff700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41700adc90 0x7f41700ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 -- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f417006c820 msgr2=0x7f4170146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f417006c820 0x7f4170146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 -- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41700adc90 msgr2=0x7f41700ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41700adc90 0x7f41700ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 -- 172.21.15.50:0/168190643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009420 con 0x7f417015a2d0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.202+0000 7f4175415700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f416800c910 tx=0x7f41680027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168012630 con 0x7f417015a2d0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680127b0 con 0x7f417015a2d0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168012b70 con 0x7f417015a2d0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417016c950 con 0x7f417015a2d0 2023-12-24T18:51:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417016cf10 con 0x7f417015a2d0 2023-12-24T18:51:18.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.206+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417004be40 con 0x7f417015a2d0 2023-12-24T18:51:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.210+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f416801b400 con 0x7f417015a2d0 2023-12-24T18:51:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.210+0000 7f4164ff9700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 0x7f415c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.210+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f416807cab0 con 0x7f417015a2d0 2023-12-24T18:51:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.210+0000 7f4174c14700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 0x7f415c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.210+0000 7f4174c14700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 0x7f415c062a80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f416c007fd0 tx=0x7f416c009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.218+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f416804d0a0 con 0x7f417015a2d0 2023-12-24T18:51:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.394+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f417006bcd0 con 0x7f417015a2d0 2023-12-24T18:51:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.394+0000 7f4164ff9700 1 -- 172.21.15.50:0/168190643 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4168016090 con 0x7f417015a2d0 2023-12-24T18:51:18.396 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:51:18.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:18.397 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:51:18.397 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:51:18.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:18.397 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:51:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 msgr2=0x7f415c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 0x7f415c062a80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f416c007fd0 tx=0x7f416c009040 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 msgr2=0x7f41700a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f416800c910 tx=0x7f41680027a0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 shutdown_connections 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f415c0605d0 0x7f415c062a80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417015a2d0 0x7f41700a9990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41700adc90 0x7f41700ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 --2- 172.21.15.50:0/168190643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f417006c820 0x7f4170146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 >> 172.21.15.50:0/168190643 conn(0x7f4170067b80 msgr2=0x7f417006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 shutdown_connections 2023-12-24T18:51:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.398+0000 7f4175c16700 1 -- 172.21.15.50:0/168190643 wait complete. 2023-12-24T18:51:18.425 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:51:18.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:51:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.602+0000 7f686d8f0700 1 Processor -- start 2023-12-24T18:51:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.602+0000 7f686d8f0700 1 -- start start 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68681606d0 0x7f6868160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68680ca200 0x7f68680cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 0x7f686806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680b16a0 con 0x7f68680ca200 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686806c820 con 0x7f68681606d0 2023-12-24T18:51:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f686d8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686806cb00 con 0x7f686806d8c0 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68680ca200 0x7f68680cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f68677fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 0x7f686806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68680ca200 0x7f68680cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54766/0 (socket says 172.21.15.50:54766) 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f68677fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 0x7f686806dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:47086/0 (socket says 172.21.15.50:47086) 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 -- 172.21.15.50:0/2147374674 learned_addr learned my addr 172.21.15.50:0/2147374674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f6866ffd700 1 --2- 172.21.15.50:0/2147374674 >> v2:172.21.15.82:3300/0 conn(0x7f68681606d0 0x7f6868160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 -- 172.21.15.50:0/2147374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 msgr2=0x7f686806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 --2- 172.21.15.50:0/2147374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 0x7f686806dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 -- 172.21.15.50:0/2147374674 >> v2:172.21.15.82:3300/0 conn(0x7f68681606d0 msgr2=0x7f6868160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 --2- 172.21.15.50:0/2147374674 >> v2:172.21.15.82:3300/0 conn(0x7f68681606d0 0x7f6868160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 -- 172.21.15.50:0/2147374674 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686806cde0 con 0x7f68680ca200 2023-12-24T18:51:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.606+0000 7f685ffff700 1 --2- 172.21.15.50:0/2147374674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68680ca200 0x7f68680cb050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6868068720 tx=0x7f6850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83899dff71d8907 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f68667fc700 1 -- 172.21.15.50:0/2147374674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000b640 con 0x7f68680ca200 2023-12-24T18:51:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f68667fc700 1 -- 172.21.15.50:0/2147374674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685000b7a0 con 0x7f68680ca200 2023-12-24T18:51:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f68667fc700 1 -- 172.21.15.50:0/2147374674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000bb60 con 0x7f68680ca200 2023-12-24T18:51:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 -- 172.21.15.50:0/2147374674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68680ca200 msgr2=0x7f68680cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 --2- 172.21.15.50:0/2147374674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68680ca200 0x7f68680cb050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6868068720 tx=0x7f6850009250 comp rx=0 tx=0).stop 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 -- 172.21.15.50:0/2147374674 shutdown_connections 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 --2- 172.21.15.50:0/2147374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f686806d8c0 0x7f686806dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 --2- 172.21.15.50:0/2147374674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68680ca200 0x7f68680cb050 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 --2- 172.21.15.50:0/2147374674 >> v2:172.21.15.82:3300/0 conn(0x7f68681606d0 0x7f6868160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 -- 172.21.15.50:0/2147374674 >> 172.21.15.50:0/2147374674 conn(0x7f6868067b80 msgr2=0x7f68680cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 -- 172.21.15.50:0/2147374674 shutdown_connections 2023-12-24T18:51:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.610+0000 7f686d8f0700 1 -- 172.21.15.50:0/2147374674 wait complete. 2023-12-24T18:51:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 Processor -- start 2023-12-24T18:51:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 -- start start 2023-12-24T18:51:18.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f686806d8c0 0x7f68680c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68680ca200 0x7f686815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680bd5b0 con 0x7f68681606d0 2023-12-24T18:51:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868171750 con 0x7f686806d8c0 2023-12-24T18:51:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f686d8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6868171a30 con 0x7f68680ca200 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f68677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f68677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54774/0 (socket says 172.21.15.50:54774) 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f68677fe700 1 -- 172.21.15.50:0/235290986 learned_addr learned my addr 172.21.15.50:0/235290986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f685ffff700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68680ca200 0x7f686815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.614+0000 7f6866ffd700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f686806d8c0 0x7f68680c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 -- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68680ca200 msgr2=0x7f686815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68680ca200 0x7f686815f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 -- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f686806d8c0 msgr2=0x7f68680c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f686806d8c0 0x7f68680c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 -- 172.21.15.50:0/235290986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500094f0 con 0x7f68681606d0 2023-12-24T18:51:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f68677fe700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6860009e90 tx=0x7f686000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000cb70 con 0x7f68681606d0 2023-12-24T18:51:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000f040 con 0x7f68681606d0 2023-12-24T18:51:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860014480 con 0x7f68681606d0 2023-12-24T18:51:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68680bcf60 con 0x7f68681606d0 2023-12-24T18:51:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68680bc9c0 con 0x7f68681606d0 2023-12-24T18:51:18.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.618+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68680bd720 con 0x7f68681606d0 2023-12-24T18:51:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.622+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6860014830 con 0x7f68681606d0 2023-12-24T18:51:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.622+0000 7f685effd700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 0x7f6848062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.622+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f686007cff0 con 0x7f68681606d0 2023-12-24T18:51:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.622+0000 7f6866ffd700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 0x7f6848062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.622+0000 7f6866ffd700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 0x7f6848062ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d10 tx=0x7f68580091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.630+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f686004d6c0 con 0x7f68681606d0 2023-12-24T18:51:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:18.810+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f686804be40 con 0x7f68681606d0 2023-12-24T18:51:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.754+0000 7f685effd700 1 -- 172.21.15.50:0/235290986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6860050ce0 con 0x7f68681606d0 2023-12-24T18:51:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 msgr2=0x7f6848062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 0x7f6848062ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d10 tx=0x7f68580091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 msgr2=0x7f6868170c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6860009e90 tx=0x7f686000b040 comp rx=0 tx=0).stop 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 shutdown_connections 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6848060620 0x7f6848062ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68681606d0 0x7f6868170c70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68680ca200 0x7f686815f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 --2- 172.21.15.50:0/235290986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f686806d8c0 0x7f68680c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 >> 172.21.15.50:0/235290986 conn(0x7f6868067b80 msgr2=0x7f686815fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 shutdown_connections 2023-12-24T18:51:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.762+0000 7f686d8f0700 1 -- 172.21.15.50:0/235290986 wait complete. 2023-12-24T18:51:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:51:19.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:51:19.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.962+0000 7f506b945700 1 Processor -- start 2023-12-24T18:51:19.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.962+0000 7f506b945700 1 -- start start 2023-12-24T18:51:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f506b945700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640cf8a0 0x7f506406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f506b945700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640cd680 con 0x7f506406ac40 2023-12-24T18:51:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f506b945700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506406d8f0 con 0x7f50640cf4d0 2023-12-24T18:51:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f506b945700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064159640 con 0x7f50640cf8a0 2023-12-24T18:51:19.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f5068ee0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640cf8a0 0x7f506406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:19.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f5068ee0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640cf8a0 0x7f506406a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53120/0 (socket says 172.21.15.50:53120) 2023-12-24T18:51:19.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.966+0000 7f5068ee0700 1 -- 172.21.15.50:0/2643220786 learned_addr learned my addr 172.21.15.50:0/2643220786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120211483 0 0) 0x7f506406d8f0 con 0x7f50640cf4d0 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5050003570 con 0x7f50640cf4d0 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f5068ee0700 1 -- 172.21.15.50:0/2643220786 >> v1:172.21.15.82:6789/0 conn(0x7f50640cf4d0 legacy=0x7f506406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292125524 0 0) 0x7f50640cd680 con 0x7f506406ac40 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f5068ee0700 1 -- 172.21.15.50:0/2643220786 >> v1:172.21.15.50:6789/0 conn(0x7f506406ac40 legacy=0x7f50640cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f5068ee0700 1 -- 172.21.15.50:0/2643220786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506406b030 con 0x7f50640cf8a0 2023-12-24T18:51:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f5068ee0700 1 --2- 172.21.15.50:0/2643220786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f506406a700 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f50540099b0 tx=0x7f5054009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f4057e175b655e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054009ea0 con 0x7f50640cf8a0 2023-12-24T18:51:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400b860 con 0x7f50640cf8a0 2023-12-24T18:51:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f505bfff700 1 -- 172.21.15.50:0/2643220786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400bc20 con 0x7f50640cf8a0 2023-12-24T18:51:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 -- 172.21.15.50:0/2643220786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 msgr2=0x7f506406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 --2- 172.21.15.50:0/2643220786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f506406a700 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f50540099b0 tx=0x7f5054009250 comp rx=0 tx=0).stop 2023-12-24T18:51:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 -- 172.21.15.50:0/2643220786 shutdown_connections 2023-12-24T18:51:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 --2- 172.21.15.50:0/2643220786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f506406a700 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 -- 172.21.15.50:0/2643220786 >> 172.21.15.50:0/2643220786 conn(0x7f5064067b30 msgr2=0x7f50640cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:19.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 -- 172.21.15.50:0/2643220786 shutdown_connections 2023-12-24T18:51:19.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.970+0000 7f506b945700 1 -- 172.21.15.50:0/2643220786 wait complete. 2023-12-24T18:51:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 Processor -- start 2023-12-24T18:51:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 -- start start 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506406ac40 0x7f506415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50640cf4d0 0x7f5064169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064152140 con 0x7f50640cf8a0 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064152c80 con 0x7f506406ac40 2023-12-24T18:51:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f506b945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5064152350 con 0x7f50640cf4d0 2023-12-24T18:51:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f5069ee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f5069ee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53126/0 (socket says 172.21.15.50:53126) 2023-12-24T18:51:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f5069ee2700 1 -- 172.21.15.50:0/176277812 learned_addr learned my addr 172.21.15.50:0/176277812 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f50696e1700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506406ac40 0x7f506415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.974+0000 7f5068ee0700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50640cf4d0 0x7f5064169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 -- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50640cf4d0 msgr2=0x7f5064169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50640cf4d0 0x7f5064169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 -- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506406ac40 msgr2=0x7f506415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506406ac40 0x7f506415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 -- 172.21.15.50:0/176277812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540094f0 con 0x7f50640cf8a0 2023-12-24T18:51:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f5069ee2700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c8e0 tx=0x7f505c0016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:19.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c012630 con 0x7f50640cf8a0 2023-12-24T18:51:19.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0127b0 con 0x7f50640cf8a0 2023-12-24T18:51:19.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5064152630 con 0x7f50640cf8a0 2023-12-24T18:51:19.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c012b70 con 0x7f50640cf8a0 2023-12-24T18:51:19.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506415ced0 con 0x7f50640cf8a0 2023-12-24T18:51:19.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.978+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5064152e10 con 0x7f50640cf8a0 2023-12-24T18:51:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.982+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f505c003030 con 0x7f50640cf8a0 2023-12-24T18:51:19.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.982+0000 7f50597fa700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 0x7f5048062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:19.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.982+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f505c07c820 con 0x7f50640cf8a0 2023-12-24T18:51:19.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.982+0000 7f50696e1700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 0x7f5048062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.982+0000 7f50696e1700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 0x7f5048062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5060007fd0 tx=0x7f5060007d50 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:19.990+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f505c04cca0 con 0x7f50640cf8a0 2023-12-24T18:51:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.166+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f50640652e0 con 0x7f50640cf8a0 2023-12-24T18:51:20.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.770+0000 7f50597fa700 1 -- 172.21.15.50:0/176277812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f505c0502c0 con 0x7f50640cf8a0 2023-12-24T18:51:20.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 msgr2=0x7f5048062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 0x7f5048062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5060007fd0 tx=0x7f5060007d50 comp rx=0 tx=0).stop 2023-12-24T18:51:20.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 msgr2=0x7f5064150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c8e0 tx=0x7f505c0016c0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 shutdown_connections 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5048060580 0x7f5048062a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640cf8a0 0x7f5064150aa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50640cf4d0 0x7f5064169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 --2- 172.21.15.50:0/176277812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506406ac40 0x7f506415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 >> 172.21.15.50:0/176277812 conn(0x7f5064067b30 msgr2=0x7f5064158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 shutdown_connections 2023-12-24T18:51:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.782+0000 7f506b945700 1 -- 172.21.15.50:0/176277812 wait complete. 2023-12-24T18:51:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:51:20.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:51:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 Processor -- start 2023-12-24T18:51:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 -- start start 2023-12-24T18:51:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d74158c40 0x7f9d740cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d740cc780 0x7f9d740ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406a580 con 0x7f9d7406cd40 2023-12-24T18:51:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d740cd110 con 0x7f9d74158c40 2023-12-24T18:51:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d797cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7406a7d0 con 0x7f9d740cc780 2023-12-24T18:51:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d73fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d74158c40 0x7f9d740cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d73fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d74158c40 0x7f9d740cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53140/0 (socket says 172.21.15.50:53140) 2023-12-24T18:51:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d73fff700 1 -- 172.21.15.50:0/2507245529 learned_addr learned my addr 172.21.15.50:0/2507245529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d6b7fe700 1 --2- 172.21.15.50:0/2507245529 >> v2:172.21.15.82:3300/0 conn(0x7f9d740cc780 0x7f9d740ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d73fff700 1 -- 172.21.15.50:0/2507245529 >> v2:172.21.15.82:3300/0 conn(0x7f9d740cc780 msgr2=0x7f9d740ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.978+0000 7f9d73fff700 1 --2- 172.21.15.50:0/2507245529 >> v2:172.21.15.82:3300/0 conn(0x7f9d740cc780 0x7f9d740ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d73fff700 1 -- 172.21.15.50:0/2507245529 >> v1:172.21.15.82:6789/0 conn(0x7f9d7406cd40 legacy=0x7f9d7406d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d73fff700 1 -- 172.21.15.50:0/2507245529 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7406aab0 con 0x7f9d74158c40 2023-12-24T18:51:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d73fff700 1 --2- 172.21.15.50:0/2507245529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d74158c40 0x7f9d740cf500 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d74069010 tx=0x7f9d64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d975ba121a4919a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d737fe700 1 -- 172.21.15.50:0/2507245529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400b860 con 0x7f9d74158c40 2023-12-24T18:51:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d737fe700 1 -- 172.21.15.50:0/2507245529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400b9c0 con 0x7f9d74158c40 2023-12-24T18:51:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d737fe700 1 -- 172.21.15.50:0/2507245529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400bd60 con 0x7f9d74158c40 2023-12-24T18:51:20.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 -- 172.21.15.50:0/2507245529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d74158c40 msgr2=0x7f9d740cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 --2- 172.21.15.50:0/2507245529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d74158c40 0x7f9d740cf500 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d74069010 tx=0x7f9d64009250 comp rx=0 tx=0).stop 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 -- 172.21.15.50:0/2507245529 shutdown_connections 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 --2- 172.21.15.50:0/2507245529 >> v2:172.21.15.82:3300/0 conn(0x7f9d740cc780 0x7f9d740ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 --2- 172.21.15.50:0/2507245529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d74158c40 0x7f9d740cf500 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 -- 172.21.15.50:0/2507245529 >> 172.21.15.50:0/2507245529 conn(0x7f9d740d0800 msgr2=0x7f9d740b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 -- 172.21.15.50:0/2507245529 shutdown_connections 2023-12-24T18:51:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.982+0000 7f9d797cc700 1 -- 172.21.15.50:0/2507245529 wait complete. 2023-12-24T18:51:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.986+0000 7f9d797cc700 1 Processor -- start 2023-12-24T18:51:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.986+0000 7f9d797cc700 1 -- start start 2023-12-24T18:51:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 0x7f9d74146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d74158c40 0x7f9d74157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74146da0 con 0x7f9d740cc780 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74169ac0 con 0x7f9d7406cd40 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c5860 con 0x7f9d74158c40 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53154/0 (socket says 172.21.15.50:53154) 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 -- 172.21.15.50:0/967318938 learned_addr learned my addr 172.21.15.50:0/967318938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d73fff700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 0x7f9d74146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d78fcb700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d74158c40 0x7f9d74157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 -- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d74158c40 msgr2=0x7f9d74157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d74158c40 0x7f9d74157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 -- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 msgr2=0x7f9d74146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 0x7f9d74146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 -- 172.21.15.50:0/967318938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640094f0 con 0x7f9d740cc780 2023-12-24T18:51:20.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d73fff700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 0x7f9d74146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d6b7fe700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d890 tx=0x7f9d5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0125f0 con 0x7f9d740cc780 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c012770 con 0x7f9d740cc780 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d740c5b40 con 0x7f9d740cc780 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c012b30 con 0x7f9d740cc780 2023-12-24T18:51:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.990+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d74169400 con 0x7f9d740cc780 2023-12-24T18:51:20.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.994+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74154f10 con 0x7f9d740cc780 2023-12-24T18:51:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.998+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9d5c01e460 con 0x7f9d740cc780 2023-12-24T18:51:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.998+0000 7f9d70ff9700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 0x7f9d54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.998+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6301+0+0 (secure 0 0 0) 0x7f9d5c07cf30 con 0x7f9d740cc780 2023-12-24T18:51:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.998+0000 7f9d73fff700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 0x7f9d54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:20.998+0000 7f9d73fff700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 0x7f9d54062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d74069010 tx=0x7f9d64017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.006+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9d74154f10 con 0x7f9d740cc780 2023-12-24T18:51:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.218+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d74154f10 con 0x7f9d740cc780 2023-12-24T18:51:21.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.778+0000 7f9d70ff9700 1 -- 172.21.15.50:0/967318938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v31) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9d74154f10 con 0x7f9d740cc780 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 msgr2=0x7f9d54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 0x7f9d54062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d74069010 tx=0x7f9d64017000 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 msgr2=0x7f9d74157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d890 tx=0x7f9d5c008040 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 shutdown_connections 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9d54060550 0x7f9d54062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d74158c40 0x7f9d74157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d740cc780 0x7f9d74157a40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 --2- 172.21.15.50:0/967318938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7406cd40 0x7f9d74146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 >> 172.21.15.50:0/967318938 conn(0x7f9d740d0800 msgr2=0x7f9d740b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 shutdown_connections 2023-12-24T18:51:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.786+0000 7f9d797cc700 1 -- 172.21.15.50:0/967318938 wait complete. 2023-12-24T18:51:21.802 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 9 and data pool 10 2023-12-24T18:51:21.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 Processor -- start 2023-12-24T18:51:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 -- start start 2023-12-24T18:51:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c01611b0 0x7fe0c0161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0c006c820 0x7fe0c006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c006c4d0 con 0x7fe0c00ae100 2023-12-24T18:51:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c006c1f0 con 0x7fe0c01611b0 2023-12-24T18:51:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.982+0000 7fe0c59cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00ab5e0 con 0x7fe0c006c820 2023-12-24T18:51:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c01611b0 0x7fe0c0161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c01611b0 0x7fe0c0161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53158/0 (socket says 172.21.15.50:53158) 2023-12-24T18:51:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2652231998 learned_addr learned my addr 172.21.15.50:0/2652231998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c51cb700 1 --2- 172.21.15.50:0/2652231998 >> v2:172.21.15.82:3300/0 conn(0x7fe0c006c820 0x7fe0c006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0b7fff700 1 --1- 172.21.15.50:0/2652231998 >> v1:172.21.15.50:6789/0 conn(0x7fe0c00ae100 0x7fe0c006b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45418/0 (socket says 172.21.15.50:45418) 2023-12-24T18:51:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2652231998 >> v2:172.21.15.82:3300/0 conn(0x7fe0c006c820 msgr2=0x7fe0c006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 --2- 172.21.15.50:0/2652231998 >> v2:172.21.15.82:3300/0 conn(0x7fe0c006c820 0x7fe0c006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2652231998 >> v1:172.21.15.50:6789/0 conn(0x7fe0c00ae100 legacy=0x7fe0c006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2652231998 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00ab8c0 con 0x7fe0c01611b0 2023-12-24T18:51:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c49ca700 1 --2- 172.21.15.50:0/2652231998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c01611b0 0x7fe0c0161580 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0c006c100 tx=0x7fe0bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252b760f7bfab868 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0b77fe700 1 -- 172.21.15.50:0/2652231998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00e070 con 0x7fe0c01611b0 2023-12-24T18:51:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0b77fe700 1 -- 172.21.15.50:0/2652231998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00ba20 con 0x7fe0c01611b0 2023-12-24T18:51:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0b77fe700 1 -- 172.21.15.50:0/2652231998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0092e0 con 0x7fe0c01611b0 2023-12-24T18:51:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2652231998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c01611b0 msgr2=0x7fe0c0161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.986+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2652231998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c01611b0 0x7fe0c0161580 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0c006c100 tx=0x7fe0bc009840 comp rx=0 tx=0).stop 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2652231998 shutdown_connections 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2652231998 >> v2:172.21.15.82:3300/0 conn(0x7fe0c006c820 0x7fe0c006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2652231998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c01611b0 0x7fe0c0161580 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2652231998 >> 172.21.15.50:0/2652231998 conn(0x7fe0c0067b80 msgr2=0x7fe0c00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2652231998 shutdown_connections 2023-12-24T18:51:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2652231998 wait complete. 2023-12-24T18:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 Processor -- start 2023-12-24T18:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.990+0000 7fe0c59cc700 1 -- start start 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00ae100 0x7fe0c0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0c01611b0 0x7fe0c015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00cb880 con 0x7fe0c006c820 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00cb070 con 0x7fe0c00ae100 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00cb2c0 con 0x7fe0c01611b0 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53162/0 (socket says 172.21.15.50:53162) 2023-12-24T18:51:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2352631625 learned_addr learned my addr 172.21.15.50:0/2352631625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0b7fff700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00ae100 0x7fe0c0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0c01611b0 msgr2=0x7fe0c015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0c01611b0 0x7fe0c015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00ae100 msgr2=0x7fe0c0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00ae100 0x7fe0c0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 -- 172.21.15.50:0/2352631625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009ae0 con 0x7fe0c006c820 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c49ca700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00c95c0 tx=0x7fe0bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc008a80 con 0x7fe0c006c820 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc008c00 con 0x7fe0c006c820 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc026460 con 0x7fe0c006c820 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00cb5a0 con 0x7fe0c006c820 2023-12-24T18:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.994+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00b04e0 con 0x7fe0c006c820 2023-12-24T18:51:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.998+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c004be40 con 0x7fe0c006c820 2023-12-24T18:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.998+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe0bc003040 con 0x7fe0c006c820 2023-12-24T18:51:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.998+0000 7fe0b4ff9700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 0x7fe0ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.998+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fe0bc07e8e0 con 0x7fe0c006c820 2023-12-24T18:51:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:21.998+0000 7fe0b7fff700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 0x7fe0ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.002+0000 7fe0b7fff700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 0x7fe0ac062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0b0007d70 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.006+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0bc04eb70 con 0x7fe0c006c820 2023-12-24T18:51:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.178+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c01578a0 con 0x7fe0c006c820 2023-12-24T18:51:22.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0b4ff9700 1 -- 172.21.15.50:0/2352631625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16094 (secure 0 0 0) 0x7fe0bc052190 con 0x7fe0c006c820 2023-12-24T18:51:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:22.183 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":82,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:21.221875+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 msgr2=0x7fe0ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 0x7fe0ac062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0b0007d70 comp rx=0 tx=0).stop 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 msgr2=0x7fe0c00ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00c95c0 tx=0x7fe0bc018000 comp rx=0 tx=0).stop 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 shutdown_connections 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe0ac060550 0x7fe0ac062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0c01611b0 0x7fe0c015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00ae100 0x7fe0c0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 --2- 172.21.15.50:0/2352631625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c006c820 0x7fe0c00ae870 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 >> 172.21.15.50:0/2352631625 conn(0x7fe0c0067b80 msgr2=0x7fe0c015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:22.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.182+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 shutdown_connections 2023-12-24T18:51:22.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.186+0000 7fe0c59cc700 1 -- 172.21.15.50:0/2352631625 wait complete. 2023-12-24T18:51:22.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:22.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.374+0000 7fd28eaae700 1 Processor -- start 2023-12-24T18:51:22.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.374+0000 7fd28eaae700 1 -- start start 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 0x7fd2880ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd28806ae30 0x7fd28806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd288159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28806b7e0 con 0x7fd28806ae30 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28806ba80 con 0x7fd2880ce750 2023-12-24T18:51:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28eaae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28806bd60 con 0x7fd288159a20 2023-12-24T18:51:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd28806ae30 0x7fd28806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd28806ae30 0x7fd28806b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53166/0 (socket says 172.21.15.50:53166) 2023-12-24T18:51:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 -- 172.21.15.50:0/4085033237 learned_addr learned my addr 172.21.15.50:0/4085033237 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28d04b700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd288159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28c84a700 1 --2- 172.21.15.50:0/4085033237 >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 0x7fd2880ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 -- 172.21.15.50:0/4085033237 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 msgr2=0x7fd288159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd288159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 -- 172.21.15.50:0/4085033237 >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 msgr2=0x7fd2880ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 --2- 172.21.15.50:0/4085033237 >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 0x7fd2880ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd27ffff700 1 -- 172.21.15.50:0/4085033237 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28806c040 con 0x7fd28806ae30 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28d04b700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd288159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.378+0000 7fd28c84a700 1 --2- 172.21.15.50:0/4085033237 >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 0x7fd2880ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:22.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd27ffff700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd28806ae30 0x7fd28806b2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd2880cda50 tx=0x7fd278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687f7cb9f1aeef33 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd27f7fe700 1 -- 172.21.15.50:0/4085033237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800b860 con 0x7fd28806ae30 2023-12-24T18:51:22.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd27f7fe700 1 -- 172.21.15.50:0/4085033237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800b9c0 con 0x7fd28806ae30 2023-12-24T18:51:22.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd27f7fe700 1 -- 172.21.15.50:0/4085033237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800bd60 con 0x7fd28806ae30 2023-12-24T18:51:22.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 -- 172.21.15.50:0/4085033237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd28806ae30 msgr2=0x7fd28806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd28806ae30 0x7fd28806b2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd2880cda50 tx=0x7fd278009250 comp rx=0 tx=0).stop 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 -- 172.21.15.50:0/4085033237 shutdown_connections 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd288159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 --2- 172.21.15.50:0/4085033237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd28806ae30 0x7fd28806b2a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 --2- 172.21.15.50:0/4085033237 >> v2:172.21.15.82:3300/0 conn(0x7fd2880ce750 0x7fd2880ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 -- 172.21.15.50:0/4085033237 >> 172.21.15.50:0/4085033237 conn(0x7fd2880cffb0 msgr2=0x7fd2880d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 -- 172.21.15.50:0/4085033237 shutdown_connections 2023-12-24T18:51:22.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.382+0000 7fd28eaae700 1 -- 172.21.15.50:0/4085033237 wait complete. 2023-12-24T18:51:22.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 Processor -- start 2023-12-24T18:51:22.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 -- start start 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 0x7fd28813f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd28815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880c99e0 con 0x7fd2880ce750 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28815b0c0 con 0x7fd28806ae30 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28eaae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28815a790 con 0x7fd288159a20 2023-12-24T18:51:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53182/0 (socket says 172.21.15.50:53182) 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 -- 172.21.15.50:0/2429060369 learned_addr learned my addr 172.21.15.50:0/2429060369 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28d04b700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd28815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28c84a700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 0x7fd28813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 -- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 msgr2=0x7fd28815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd28815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 -- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 msgr2=0x7fd28813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 0x7fd28813f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 -- 172.21.15.50:0/2429060369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780094f0 con 0x7fd2880ce750 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd28c84a700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 0x7fd28813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.386+0000 7fd27ffff700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd278009290 tx=0x7fd278017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278026480 con 0x7fd2880ce750 2023-12-24T18:51:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27801f070 con 0x7fd2880ce750 2023-12-24T18:51:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28815aa70 con 0x7fd2880ce750 2023-12-24T18:51:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278026830 con 0x7fd2880ce750 2023-12-24T18:51:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880c8b90 con 0x7fd2880ce750 2023-12-24T18:51:22.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.390+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28815b250 con 0x7fd2880ce750 2023-12-24T18:51:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.394+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd278026ba0 con 0x7fd2880ce750 2023-12-24T18:51:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.394+0000 7fd27cff9700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 0x7fd274062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.394+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd278021070 con 0x7fd2880ce750 2023-12-24T18:51:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.394+0000 7fd28c84a700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 0x7fd274062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.394+0000 7fd28c84a700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 0x7fd274062ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2840076e0 tx=0x7fd2840098f0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.402+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd27804ec90 con 0x7fd2880ce750 2023-12-24T18:51:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.574+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2880652e0 con 0x7fd2880ce750 2023-12-24T18:51:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd27cff9700 1 -- 172.21.15.50:0/2429060369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16094 (secure 0 0 0) 0x7fd2780522b0 con 0x7fd2880ce750 2023-12-24T18:51:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:22.578 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":82,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:21.221875+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 msgr2=0x7fd274062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 0x7fd274062ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2840076e0 tx=0x7fd2840098f0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 msgr2=0x7fd28815d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd278009290 tx=0x7fd278017000 comp rx=0 tx=0).stop 2023-12-24T18:51:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 shutdown_connections 2023-12-24T18:51:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd274060620 0x7fd274062ad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd288159a20 0x7fd28815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2880ce750 0x7fd28815d010 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 --2- 172.21.15.50:0/2429060369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd28806ae30 0x7fd28813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 >> 172.21.15.50:0/2429060369 conn(0x7fd2880cffb0 msgr2=0x7fd2880c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 shutdown_connections 2023-12-24T18:51:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.578+0000 7fd28eaae700 1 -- 172.21.15.50:0/2429060369 wait complete. 2023-12-24T18:51:22.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:51:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.770+0000 7fda807c5700 1 Processor -- start 2023-12-24T18:51:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.770+0000 7fda807c5700 1 -- start start 2023-12-24T18:51:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda807c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda7806ae20 0x7fda780b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda807c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda7806c820 0x7fda780b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda807c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780b3fd0 con 0x7fda78158e00 2023-12-24T18:51:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda807c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780b33c0 con 0x7fda7806ae20 2023-12-24T18:51:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda807c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780b36a0 con 0x7fda7806c820 2023-12-24T18:51:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.774+0000 7fda7dd60700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda7806ae20 0x7fda780b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda7806ae20 0x7fda780b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53188/0 (socket says 172.21.15.50:53188) 2023-12-24T18:51:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 -- 172.21.15.50:0/2435381958 learned_addr learned my addr 172.21.15.50:0/2435381958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7ed62700 1 --2- 172.21.15.50:0/2435381958 >> v2:172.21.15.82:3300/0 conn(0x7fda7806c820 0x7fda780b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 -- 172.21.15.50:0/2435381958 >> v2:172.21.15.82:3300/0 conn(0x7fda7806c820 msgr2=0x7fda780b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 --2- 172.21.15.50:0/2435381958 >> v2:172.21.15.82:3300/0 conn(0x7fda7806c820 0x7fda780b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 -- 172.21.15.50:0/2435381958 >> v1:172.21.15.82:6789/0 conn(0x7fda78158e00 legacy=0x7fda7806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 -- 172.21.15.50:0/2435381958 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780b3980 con 0x7fda7806ae20 2023-12-24T18:51:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7dd60700 1 --2- 172.21.15.50:0/2435381958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7806ae20 0x7fda780b2de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fda780b60b0 tx=0x7fda68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3a031f98621c1c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7d55f700 1 -- 172.21.15.50:0/2435381958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68009e70 con 0x7fda7806ae20 2023-12-24T18:51:22.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7d55f700 1 -- 172.21.15.50:0/2435381958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6800b860 con 0x7fda7806ae20 2023-12-24T18:51:22.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda7d55f700 1 -- 172.21.15.50:0/2435381958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6800bc00 con 0x7fda7806ae20 2023-12-24T18:51:22.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 -- 172.21.15.50:0/2435381958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7806ae20 msgr2=0x7fda780b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 --2- 172.21.15.50:0/2435381958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7806ae20 0x7fda780b2de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fda780b60b0 tx=0x7fda68009250 comp rx=0 tx=0).stop 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 -- 172.21.15.50:0/2435381958 shutdown_connections 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 --2- 172.21.15.50:0/2435381958 >> v2:172.21.15.82:3300/0 conn(0x7fda7806c820 0x7fda780b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 --2- 172.21.15.50:0/2435381958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7806ae20 0x7fda780b2de0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 -- 172.21.15.50:0/2435381958 >> 172.21.15.50:0/2435381958 conn(0x7fda78067b80 msgr2=0x7fda780cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 -- 172.21.15.50:0/2435381958 shutdown_connections 2023-12-24T18:51:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.778+0000 7fda807c5700 1 -- 172.21.15.50:0/2435381958 wait complete. 2023-12-24T18:51:22.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 Processor -- start 2023-12-24T18:51:22.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 -- start start 2023-12-24T18:51:22.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7806ae20 0x7fda78157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7806c820 0x7fda7814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78151480 con 0x7fda78158e00 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78150870 con 0x7fda7806ae20 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda807c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda78150b50 con 0x7fda7806c820 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53200/0 (socket says 172.21.15.50:53200) 2023-12-24T18:51:22.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 -- 172.21.15.50:0/1044767238 learned_addr learned my addr 172.21.15.50:0/1044767238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7dd60700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7806c820 0x7fda7814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7e561700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7806ae20 0x7fda78157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 -- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7806c820 msgr2=0x7fda7814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7806c820 0x7fda7814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 -- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7806ae20 msgr2=0x7fda78157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:22.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7806ae20 0x7fda78157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:22.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.782+0000 7fda7ed62700 1 -- 172.21.15.50:0/1044767238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680094f0 con 0x7fda78158e00 2023-12-24T18:51:22.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda7ed62700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fda70009df0 tx=0x7fda7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000cb50 con 0x7fda78158e00 2023-12-24T18:51:22.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000f040 con 0x7fda78158e00 2023-12-24T18:51:22.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda78150e30 con 0x7fda78158e00 2023-12-24T18:51:22.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70014480 con 0x7fda78158e00 2023-12-24T18:51:22.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78157930 con 0x7fda78158e00 2023-12-24T18:51:22.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.786+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780652e0 con 0x7fda78158e00 2023-12-24T18:51:22.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.790+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fda70014830 con 0x7fda78158e00 2023-12-24T18:51:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.790+0000 7fda6e7fc700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 0x7fda5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.790+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fda7007d3e0 con 0x7fda78158e00 2023-12-24T18:51:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.790+0000 7fda7e561700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 0x7fda5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:22.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.790+0000 7fda7e561700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 0x7fda5c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda74003860 tx=0x7fda74009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:22.798+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda7004d710 con 0x7fda78158e00 2023-12-24T18:51:23.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.010+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fda7806dd40 con 0x7fda78158e00 2023-12-24T18:51:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.818+0000 7fda6e7fc700 1 -- 172.21.15.50:0/1044767238 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7fda70050d30 con 0x7fda78158e00 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 msgr2=0x7fda5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 0x7fda5c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda74003860 tx=0x7fda74009040 comp rx=0 tx=0).stop 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 msgr2=0x7fda7816bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fda70009df0 tx=0x7fda7000b040 comp rx=0 tx=0).stop 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 shutdown_connections 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda5c060550 0x7fda5c062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78158e00 0x7fda7816bdb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7806c820 0x7fda7814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 --2- 172.21.15.50:0/1044767238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7806ae20 0x7fda78157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 >> 172.21.15.50:0/1044767238 conn(0x7fda78067b80 msgr2=0x7fda7815a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 shutdown_connections 2023-12-24T18:51:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:23.822+0000 7fda807c5700 1 -- 172.21.15.50:0/1044767238 wait complete. 2023-12-24T18:51:23.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:51:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.010+0000 7f4920dc5700 1 Processor -- start 2023-12-24T18:51:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.010+0000 7f4920dc5700 1 -- start start 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c0cf4d0 0x7f491c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f491c0cf8a0 0x7f491c06a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f491c06ac40 0x7f491c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c159640 con 0x7f491c0cf8a0 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c06b0a0 con 0x7f491c06ac40 2023-12-24T18:51:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4920dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0cd680 con 0x7f491c0cf4d0 2023-12-24T18:51:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4919d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f491c0cf8a0 0x7f491c06a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f491a59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c0cf4d0 0x7f491c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f491ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f491c06ac40 0x7f491c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4919d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f491c0cf8a0 0x7f491c06a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53204/0 (socket says 172.21.15.50:53204) 2023-12-24T18:51:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.014+0000 7f4919d9b700 1 -- 172.21.15.50:0/137706310 learned_addr learned my addr 172.21.15.50:0/137706310 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 -- 172.21.15.50:0/137706310 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c0cf4d0 msgr2=0x7f491c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 --2- 172.21.15.50:0/137706310 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c0cf4d0 0x7f491c06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 -- 172.21.15.50:0/137706310 >> v2:172.21.15.82:3300/0 conn(0x7f491c06ac40 msgr2=0x7f491c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 --2- 172.21.15.50:0/137706310 >> v2:172.21.15.82:3300/0 conn(0x7f491c06ac40 0x7f491c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 -- 172.21.15.50:0/137706310 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0cca70 con 0x7f491c0cf8a0 2023-12-24T18:51:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4919d9b700 1 --2- 172.21.15.50:0/137706310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c06a700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f491c06a690 tx=0x7f4910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4277c54300919925 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f491959a700 1 -- 172.21.15.50:0/137706310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000b640 con 0x7f491c0cf8a0 2023-12-24T18:51:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f491959a700 1 -- 172.21.15.50:0/137706310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491000b7a0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f491959a700 1 -- 172.21.15.50:0/137706310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000bb60 con 0x7f491c0cf8a0 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 -- 172.21.15.50:0/137706310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 msgr2=0x7f491c06a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 --2- 172.21.15.50:0/137706310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c06a700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f491c06a690 tx=0x7f4910009250 comp rx=0 tx=0).stop 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 -- 172.21.15.50:0/137706310 shutdown_connections 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 --2- 172.21.15.50:0/137706310 >> v2:172.21.15.82:3300/0 conn(0x7f491c06ac40 0x7f491c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 --2- 172.21.15.50:0/137706310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c06a700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 --2- 172.21.15.50:0/137706310 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c0cf4d0 0x7f491c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 -- 172.21.15.50:0/137706310 >> 172.21.15.50:0/137706310 conn(0x7f491c067b30 msgr2=0x7f491c0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 -- 172.21.15.50:0/137706310 shutdown_connections 2023-12-24T18:51:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.018+0000 7f4920dc5700 1 -- 172.21.15.50:0/137706310 wait complete. 2023-12-24T18:51:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 Processor -- start 2023-12-24T18:51:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 -- start start 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c06ac40 0x7f491c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c0cf4d0 0x7f491c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0cc190 con 0x7f491c0cf8a0 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c15cd00 con 0x7f491c0cf4d0 2023-12-24T18:51:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4920dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0cb8f0 con 0x7f491c06ac40 2023-12-24T18:51:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53220/0 (socket says 172.21.15.50:53220) 2023-12-24T18:51:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 -- 172.21.15.50:0/2533570951 learned_addr learned my addr 172.21.15.50:0/2533570951 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491a59c700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c06ac40 0x7f491c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f4919d9b700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c0cf4d0 0x7f491c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 -- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c06ac40 msgr2=0x7f491c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c06ac40 0x7f491c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 -- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c0cf4d0 msgr2=0x7f491c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c0cf4d0 0x7f491c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.022+0000 7f491ad9d700 1 -- 172.21.15.50:0/2533570951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100094f0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f491ad9d700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4914009ec0 tx=0x7f491400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400cb70 con 0x7f491c0cf8a0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c0cbbd0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400f040 con 0x7f491c0cf8a0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914014480 con 0x7f491c0cf8a0 2023-12-24T18:51:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c14af90 con 0x7f491c0cf8a0 2023-12-24T18:51:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.026+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0652e0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.030+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4914014830 con 0x7f491c0cf8a0 2023-12-24T18:51:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.030+0000 7f490a7fc700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 0x7f48fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.030+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f491407d440 con 0x7f491c0cf8a0 2023-12-24T18:51:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.030+0000 7f491a59c700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 0x7f48fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.030+0000 7f491a59c700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 0x7f48fc062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f490c009d20 tx=0x7f490c0091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.038+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f491404d6d0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.246+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f491c15ce40 con 0x7f491c0cf8a0 2023-12-24T18:51:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f490a7fc700 1 -- 172.21.15.50:0/2533570951 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4914050cf0 con 0x7f491c0cf8a0 2023-12-24T18:51:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 msgr2=0x7f48fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 0x7f48fc062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f490c009d20 tx=0x7f490c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 msgr2=0x7f491c0c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4914009ec0 tx=0x7f491400b040 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 shutdown_connections 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f48fc060550 0x7f48fc062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491c0cf8a0 0x7f491c0c8d90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c0cf4d0 0x7f491c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 --2- 172.21.15.50:0/2533570951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f491c06ac40 0x7f491c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 >> 172.21.15.50:0/2533570951 conn(0x7f491c067b30 msgr2=0x7f491c158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.826+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 shutdown_connections 2023-12-24T18:51:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:24.830+0000 7f4920dc5700 1 -- 172.21.15.50:0/2533570951 wait complete. 2023-12-24T18:51:24.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 Processor -- start 2023-12-24T18:51:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 -- start start 2023-12-24T18:51:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae6015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae6015af90 0x7fae6006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6006ca50 con 0x7fae600ca3a0 2023-12-24T18:51:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600c6980 con 0x7fae6015af90 2023-12-24T18:51:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.018+0000 7fae64e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6015b410 con 0x7fae600ca770 2023-12-24T18:51:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae600ca3a0 0x7fae6006ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45426/0 (socket says 172.21.15.50:45426) 2023-12-24T18:51:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5e59c700 1 -- 172.21.15.50:0/2519956704 learned_addr learned my addr 172.21.15.50:0/2519956704 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 --2- 172.21.15.50:0/2519956704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae6015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5ed9d700 1 --2- 172.21.15.50:0/2519956704 >> v2:172.21.15.82:3300/0 conn(0x7fae6015af90 0x7fae6006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 -- 172.21.15.50:0/2519956704 >> v2:172.21.15.82:3300/0 conn(0x7fae6015af90 msgr2=0x7fae6006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 --2- 172.21.15.50:0/2519956704 >> v2:172.21.15.82:3300/0 conn(0x7fae6015af90 0x7fae6006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5dd9b700 1 -- 172.21.15.50:0/2519956704 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474204293 0 0) 0x7fae6006ca50 con 0x7fae600ca3a0 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 -- 172.21.15.50:0/2519956704 >> v1:172.21.15.50:6789/0 conn(0x7fae600ca3a0 legacy=0x7fae6006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 -- 172.21.15.50:0/2519956704 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6006b520 con 0x7fae600ca770 2023-12-24T18:51:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae55d9b700 1 --2- 172.21.15.50:0/2519956704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae6015aa50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae480098e0 tx=0x7fae480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ee6a4c6350461f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5dd9b700 1 -- 172.21.15.50:0/2519956704 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48009e80 con 0x7fae600ca770 2023-12-24T18:51:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5dd9b700 1 -- 172.21.15.50:0/2519956704 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800b860 con 0x7fae600ca770 2023-12-24T18:51:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae5dd9b700 1 -- 172.21.15.50:0/2519956704 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bbe0 con 0x7fae600ca770 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 -- 172.21.15.50:0/2519956704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 msgr2=0x7fae6015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 --2- 172.21.15.50:0/2519956704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae6015aa50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae480098e0 tx=0x7fae480091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 -- 172.21.15.50:0/2519956704 shutdown_connections 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 --2- 172.21.15.50:0/2519956704 >> v2:172.21.15.82:3300/0 conn(0x7fae6015af90 0x7fae6006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 --2- 172.21.15.50:0/2519956704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae6015aa50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 -- 172.21.15.50:0/2519956704 >> 172.21.15.50:0/2519956704 conn(0x7fae600cbba0 msgr2=0x7fae600cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.022+0000 7fae64e6e700 1 -- 172.21.15.50:0/2519956704 shutdown_connections 2023-12-24T18:51:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.026+0000 7fae64e6e700 1 -- 172.21.15.50:0/2519956704 wait complete. 2023-12-24T18:51:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.026+0000 7fae64e6e700 1 Processor -- start 2023-12-24T18:51:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.026+0000 7fae64e6e700 1 -- start start 2023-12-24T18:51:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae600c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 0x7fae600b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600c6c70 con 0x7fae600ca3a0 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600b1600 con 0x7fae6015af90 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600b1050 con 0x7fae600ca770 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53222/0 (socket says 172.21.15.50:53222) 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 -- 172.21.15.50:0/4244797817 learned_addr learned my addr 172.21.15.50:0/4244797817 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5ed9d700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 0x7fae600b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae55d9b700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae600c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 -- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 msgr2=0x7fae600c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae600c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 -- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 msgr2=0x7fae600b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 0x7fae600b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 -- 172.21.15.50:0/4244797817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009420 con 0x7fae600ca3a0 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5ed9d700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 0x7fae600b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae5e59c700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fae5000cd80 tx=0x7fae50001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000ab10 con 0x7fae600ca3a0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000ac70 con 0x7fae600ca3a0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500070f0 con 0x7fae600ca3a0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.030+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae600b1320 con 0x7fae600ca3a0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.034+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600c71f0 con 0x7fae600ca3a0 2023-12-24T18:51:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.034+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae600c6ad0 con 0x7fae600ca3a0 2023-12-24T18:51:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.034+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fae500074e0 con 0x7fae600ca3a0 2023-12-24T18:51:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.038+0000 7fae56ffd700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 0x7fae40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.038+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fae5007d0c0 con 0x7fae600ca3a0 2023-12-24T18:51:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.038+0000 7fae55d9b700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 0x7fae40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.038+0000 7fae55d9b700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 0x7fae40062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae6006b240 tx=0x7fae48017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.042+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae600c6ad0 con 0x7fae600ca3a0 2023-12-24T18:51:25.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.250+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae600c6ad0 con 0x7fae600ca3a0 2023-12-24T18:51:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.250+0000 7fae56ffd700 1 -- 172.21.15.50:0/4244797817 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7fae600c6ad0 con 0x7fae600ca3a0 2023-12-24T18:51:25.252 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:25.252 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 msgr2=0x7fae40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 0x7fae40062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae6006b240 tx=0x7fae48017000 comp rx=0 tx=0).stop 2023-12-24T18:51:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 msgr2=0x7fae600c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fae5000cd80 tx=0x7fae50001ae0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 shutdown_connections 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fae40060550 0x7fae40062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6015af90 0x7fae600b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae600ca770 0x7fae600c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 --2- 172.21.15.50:0/4244797817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae600ca3a0 0x7fae600c3c90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 >> 172.21.15.50:0/4244797817 conn(0x7fae600cbba0 msgr2=0x7fae600cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 shutdown_connections 2023-12-24T18:51:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.254+0000 7fae64e6e700 1 -- 172.21.15.50:0/4244797817 wait complete. 2023-12-24T18:51:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:25.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.446+0000 7f09a5cae700 1 Processor -- start 2023-12-24T18:51:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.446+0000 7f09a5cae700 1 -- start start 2023-12-24T18:51:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f09a5cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f09a5cae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 0x7f09a00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f09a5cae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006b850 con 0x7f09a00ab040 2023-12-24T18:51:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f09a5cae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a006ac40 con 0x7f09a006bce0 2023-12-24T18:51:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f09a5cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006af20 con 0x7f09a0159bc0 2023-12-24T18:51:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:59690/0 (socket says 172.21.15.50:59690) 2023-12-24T18:51:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 -- 172.21.15.50:0/964319548 learned_addr learned my addr 172.21.15.50:0/964319548 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f0997fff700 1 --2- 172.21.15.50:0/964319548 >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 0x7f09a00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 -- 172.21.15.50:0/964319548 >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 msgr2=0x7f09a00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 --2- 172.21.15.50:0/964319548 >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 0x7f09a00aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099effd700 1 -- 172.21.15.50:0/964319548 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056301624 0 0) 0x7f09a006b850 con 0x7f09a00ab040 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 -- 172.21.15.50:0/964319548 >> v1:172.21.15.50:6789/0 conn(0x7f09a00ab040 legacy=0x7f09a00ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 -- 172.21.15.50:0/964319548 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a006b200 con 0x7f09a0159bc0 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f0997fff700 1 --2- 172.21.15.50:0/964319548 >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 0x7f09a00aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.450+0000 7f099f7fe700 1 --2- 172.21.15.50:0/964319548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09900099b0 tx=0x7f0990009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4ac515047a2b93 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f099effd700 1 -- 172.21.15.50:0/964319548 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990009ea0 con 0x7f09a0159bc0 2023-12-24T18:51:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f099effd700 1 -- 172.21.15.50:0/964319548 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000b860 con 0x7f09a0159bc0 2023-12-24T18:51:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f099effd700 1 -- 172.21.15.50:0/964319548 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000bc00 con 0x7f09a0159bc0 2023-12-24T18:51:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 -- 172.21.15.50:0/964319548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 msgr2=0x7f09a0159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 --2- 172.21.15.50:0/964319548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09900099b0 tx=0x7f0990009250 comp rx=0 tx=0).stop 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 -- 172.21.15.50:0/964319548 shutdown_connections 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 --2- 172.21.15.50:0/964319548 >> v2:172.21.15.50:3300/0 conn(0x7f09a006bce0 0x7f09a00aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 --2- 172.21.15.50:0/964319548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a0159f90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 -- 172.21.15.50:0/964319548 >> 172.21.15.50:0/964319548 conn(0x7f09a00cbba0 msgr2=0x7f09a00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 -- 172.21.15.50:0/964319548 shutdown_connections 2023-12-24T18:51:25.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.454+0000 7f09a5cae700 1 -- 172.21.15.50:0/964319548 wait complete. 2023-12-24T18:51:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 Processor -- start 2023-12-24T18:51:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 -- start start 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09a006bce0 0x7f09a00c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a00a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c5aa0 con 0x7f09a00ab040 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c7190 con 0x7f09a006bce0 2023-12-24T18:51:25.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f09a5cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c57c0 con 0x7f09a0159bc0 2023-12-24T18:51:25.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53242/0 (socket says 172.21.15.50:53242) 2023-12-24T18:51:25.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 -- 172.21.15.50:0/2228539293 learned_addr learned my addr 172.21.15.50:0/2228539293 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f099f7fe700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09a006bce0 0x7f09a00c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f099ffff700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a00a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 -- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 msgr2=0x7f09a00a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a00a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 -- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09a006bce0 msgr2=0x7f09a00c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09a006bce0 0x7f09a00c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f0997fff700 1 -- 172.21.15.50:0/2228539293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009420 con 0x7f09a00ab040 2023-12-24T18:51:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.458+0000 7f099ffff700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a00a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f0997fff700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f098800ecb0 tx=0x7f09880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800c920 con 0x7f09a00ab040 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800ca80 con 0x7f09a00ab040 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09900094f0 con 0x7f09a00ab040 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800ce00 con 0x7f09a00ab040 2023-12-24T18:51:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a00c6e20 con 0x7f09a00ab040 2023-12-24T18:51:25.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.462+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00c7320 con 0x7f09a00ab040 2023-12-24T18:51:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.466+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0988013680 con 0x7f09a00ab040 2023-12-24T18:51:25.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.466+0000 7f09977fe700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 0x7f0980062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.466+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f098807cdd0 con 0x7f09a00ab040 2023-12-24T18:51:25.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.466+0000 7f099f7fe700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 0x7f0980062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.466+0000 7f099f7fe700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 0x7f0980062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09900099b0 tx=0x7f0990017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.474+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f098804d060 con 0x7f09a00ab040 2023-12-24T18:51:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.650+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09a00652e0 con 0x7f09a00ab040 2023-12-24T18:51:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.654+0000 7f09977fe700 1 -- 172.21.15.50:0/2228539293 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16081 (secure 0 0 0) 0x7f0988050680 con 0x7f09a00ab040 2023-12-24T18:51:25.656 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:25.656 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":83,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:22.790787+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 msgr2=0x7f0980062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 0x7f0980062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09900099b0 tx=0x7f0990017000 comp rx=0 tx=0).stop 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 msgr2=0x7f09a00b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f098800ecb0 tx=0x7f09880091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 shutdown_connections 2023-12-24T18:51:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0980060550 0x7f0980062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09a0159bc0 0x7f09a00a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a00ab040 0x7f09a00b1160 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 --2- 172.21.15.50:0/2228539293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09a006bce0 0x7f09a00c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 >> 172.21.15.50:0/2228539293 conn(0x7f09a00cbba0 msgr2=0x7f09a006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 shutdown_connections 2023-12-24T18:51:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.658+0000 7f09a5cae700 1 -- 172.21.15.50:0/2228539293 wait complete. 2023-12-24T18:51:25.684 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:51:25.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:51:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.854+0000 7fc2b9d45700 1 Processor -- start 2023-12-24T18:51:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.854+0000 7fc2b9d45700 1 -- start start 2023-12-24T18:51:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2b40c6d00 0x7fc2b40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b406c820 con 0x7fc2b406aca0 2023-12-24T18:51:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b406b960 con 0x7fc2b4154450 2023-12-24T18:51:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b406bc40 con 0x7fc2b40c6d00 2023-12-24T18:51:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2b40c6d00 0x7fc2b40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2b40c6d00 0x7fc2b40c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53248/0 (socket says 172.21.15.50:53248) 2023-12-24T18:51:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1032594590 learned_addr learned my addr 172.21.15.50:0/1032594590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b3fff700 1 --1- 172.21.15.50:0/1032594590 >> v1:172.21.15.50:6789/0 conn(0x7fc2b406aca0 0x7fc2b406b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45442/0 (socket says 172.21.15.50:45442) 2023-12-24T18:51:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1032594590 >> v1:172.21.15.82:6789/0 conn(0x7fc2b4154450 legacy=0x7fc2b41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1032594590 >> v1:172.21.15.50:6789/0 conn(0x7fc2b406aca0 legacy=0x7fc2b406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1032594590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b406bf20 con 0x7fc2b40c6d00 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b27fc700 1 -- 172.21.15.50:0/1032594590 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218186910 0 0) 0x7fc2b406b960 con 0x7fc2b4154450 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b37fe700 1 --2- 172.21.15.50:0/1032594590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b40c6d00 0x7fc2b40c70d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40099b0 tx=0x7fc2a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192535d04f4b9b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b27fc700 1 -- 172.21.15.50:0/1032594590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400b860 con 0x7fc2b40c6d00 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b27fc700 1 -- 172.21.15.50:0/1032594590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400b9c0 con 0x7fc2b40c6d00 2023-12-24T18:51:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b27fc700 1 -- 172.21.15.50:0/1032594590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400bd60 con 0x7fc2b40c6d00 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1032594590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b40c6d00 msgr2=0x7fc2b40c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.858+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1032594590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b40c6d00 0x7fc2b40c70d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40099b0 tx=0x7fc2a4009250 comp rx=0 tx=0).stop 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1032594590 shutdown_connections 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1032594590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b40c6d00 0x7fc2b40c70d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1032594590 >> 172.21.15.50:0/1032594590 conn(0x7fc2b40cbba0 msgr2=0x7fc2b40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1032594590 shutdown_connections 2023-12-24T18:51:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1032594590 wait complete. 2023-12-24T18:51:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 Processor -- start 2023-12-24T18:51:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.862+0000 7fc2b9d45700 1 -- start start 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2b40c6d00 0x7fc2b416a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2b4154450 0x7fc2b40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40abd60 con 0x7fc2b406aca0 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40ac8e0 con 0x7fc2b4154450 2023-12-24T18:51:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40abfb0 con 0x7fc2b40c6d00 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53254/0 (socket says 172.21.15.50:53254) 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1159036446 learned_addr learned my addr 172.21.15.50:0/1159036446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b3fff700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2b4154450 0x7fc2b40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b2ffd700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2b40c6d00 0x7fc2b416a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2b40c6d00 msgr2=0x7fc2b416a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2b40c6d00 0x7fc2b416a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2b4154450 msgr2=0x7fc2b40c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2b4154450 0x7fc2b40c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 -- 172.21.15.50:0/1159036446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40094f0 con 0x7fc2b406aca0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b37fe700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4069da0 tx=0x7fc2a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a401f070 con 0x7fc2b406aca0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4011d10 con 0x7fc2b406aca0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b40ac290 con 0x7fc2b406aca0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4025670 con 0x7fc2b406aca0 2023-12-24T18:51:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.866+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b416c880 con 0x7fc2b406aca0 2023-12-24T18:51:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.870+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40652e0 con 0x7fc2b406aca0 2023-12-24T18:51:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.870+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc2a4023070 con 0x7fc2b406aca0 2023-12-24T18:51:25.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.870+0000 7fc29b7fe700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 0x7fc2a0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:25.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.870+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fc2a407dff0 con 0x7fc2b406aca0 2023-12-24T18:51:25.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.874+0000 7fc2b2ffd700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 0x7fc2a0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:25.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.874+0000 7fc2b2ffd700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 0x7fc2a0062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4154eb0 tx=0x7fc2a8009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:25.878+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc2a404e390 con 0x7fc2b406aca0 2023-12-24T18:51:26.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.046+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2b40aca20 con 0x7fc2a0060580 2023-12-24T18:51:26.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.066+0000 7fc29b7fe700 1 -- 172.21.15.50:0/1159036446 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271062 (secure 0 0 0) 0x7fc2a8013420 con 0x7fc2a0060580 2023-12-24T18:51:26.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 msgr2=0x7fc2a0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 0x7fc2a0062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4154eb0 tx=0x7fc2a8009040 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 msgr2=0x7fc2b416c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4069da0 tx=0x7fc2a4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 shutdown_connections 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc2a0060580 0x7fc2a0062a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2b4154450 0x7fc2b40c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2b40c6d00 0x7fc2b416a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 --2- 172.21.15.50:0/1159036446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2b406aca0 0x7fc2b416c340 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 >> 172.21.15.50:0/1159036446 conn(0x7fc2b40cbba0 msgr2=0x7fc2b4159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 shutdown_connections 2023-12-24T18:51:26.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.074+0000 7fc2b9d45700 1 -- 172.21.15.50:0/1159036446 wait complete. 2023-12-24T18:51:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:51:26.096 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:51:24.616977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448392,"kb_used_data":8648,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752526328,"statfs":{"total":773094113280,"available":770586959872,"internally_reserved":0,"allocated":8855552,"data_stored":5000776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.860844"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"73'161","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-24T18:51:17.180901+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:17.180901+0000","last_peered":"2023-12-24T18:51:17.180901+0000","last_clean":"2023-12-24T18:51:17.180901+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:17.180901+0000","last_undegraded":"2023-12-24T18:51:17.180901+0000","last_fullsized":"2023-12-24T18:51:17.180901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311092,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060748,"statfs":{"total":96636764160,"available":96318205952,"internally_reserved":0,"allocated":1552384,"data_stored":1067873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.81100000000000005,"5min":0.746,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.304},{"interface":"front","average":{"1min":1.258,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.95899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6339999999999999,"5min":1.756,"15min":2.0710000000000002},"last":0.94799999999999995}]},{"osd":1,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1279999999999999,"15min":1.1439999999999999},"min":{"1min":0.88800000000000001,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4850000000000001,"5min":1.5389999999999999,"15min":1.669},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.2,"15min":1.222},"min":{"1min":0.96499999999999997,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.625,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.048}]},{"osd":2,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.236,"15min":1.214},"min":{"1min":0.94299999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5620000000000001,"5min":1.625,"15min":1.704},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.24,"15min":1.236},"min":{"1min":0.98699999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.595,"5min":1.6799999999999999,"15min":1.893},"last":1.395}]},{"osd":3,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0609999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.024},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.284,"15min":1.3080000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.623,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.222}]},{"osd":4,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1879999999999999,"15min":1.1950000000000001},"min":{"1min":0.88700000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.256,"5min":1.2430000000000001,"15min":1.2789999999999999},"min":{"1min":0.876,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6599999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.083}]},{"osd":5,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2709999999999999,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.331,"15min":1.351},"min":{"1min":1.01,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.8380000000000001,"5min":1.9590000000000001,"15min":2.403},"last":1.2729999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.409,"15min":1.429},"min":{"1min":1.05,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9259999999999999,"5min":1.956,"15min":2.4889999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":0.98599999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.2069999999999999},"last":1.377}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065424,"statfs":{"total":96636764160,"available":96322994176,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1850000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":1.119}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.0089999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":1.264}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.2989999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.0660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.177,"15min":1.1850000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.752},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3049999999999999,"15min":1.3029999999999999},"min":{"1min":0.876,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.839,"5min":1.839,"15min":2.73},"last":1.3700000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1100000000000001,"15min":1.139},"min":{"1min":0.75600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1599999999999999,"15min":1.1379999999999999},"min":{"1min":0.85199999999999998,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.3080000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.53900000000000003},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.2230000000000001},"min":{"1min":0.96899999999999997,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.5129999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.292,"15min":1.2669999999999999},"min":{"1min":0.876,"5min":0.86699999999999999,"15min":0.82399999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.605},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3029999999999999,"15min":1.3},"min":{"1min":1.0149999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.639,"5min":1.786,"15min":2.1389999999999998},"last":1.2470000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1519999999999999,"15min":1.1339999999999999},"min":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.607,"5min":1.633,"15min":2.202},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.266,"15min":1.256},"min":{"1min":0.85399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.6559999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2509999999999999,"15min":1.2829999999999999},"min":{"1min":0.82199999999999995,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":2.3959999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.29,"15min":1.3029999999999999},"min":{"1min":0.93999999999999995,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.611,"5min":1.724,"15min":2.6280000000000001},"last":1.4450000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.403,"15min":1.403},"min":{"1min":1.022,"5min":0.88,"15min":0.872},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.879},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.397,"15min":1.415},"min":{"1min":1.151,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.889,"5min":1.911,"15min":2.2429999999999999},"last":1.399}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.81399999999999995,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.6000000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.232,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.609,"5min":1.621,"15min":1.6879999999999999},"last":1.3109999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.1459999999999999},"min":{"1min":0.871,"5min":0.73199999999999998,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.589,"15min":1.9830000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1519999999999999,"15min":1.125},"min":{"1min":0.879,"5min":0.76200000000000001,"15min":0.48799999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3200000000000001,"15min":1.298},"min":{"1min":1.175,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":1.798},"last":1.528},{"interface":"front","average":{"1min":1.417,"5min":1.329,"15min":1.3120000000000001},"min":{"1min":1.2110000000000001,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6519999999999999,"5min":1.748,"15min":1.748},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.179,"15min":1.1699999999999999},"min":{"1min":1.05,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.6830000000000001,"5min":1.714,"15min":1.736},"last":1.175},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.93100000000000005,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.839},"last":1.351}]},{"osd":5,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.2829999999999999,"15min":1.252},"min":{"1min":1.105,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":1.744,"5min":1.837,"15min":1.837},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.3200000000000001,"15min":1.3049999999999999},"min":{"1min":1.262,"5min":0.623,"15min":0.623},"max":{"1min":1.7789999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.387}]},{"osd":6,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.274},"min":{"1min":0.94099999999999995,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.823,"5min":1.823,"15min":1.881},"last":1.421},{"interface":"front","average":{"1min":1.413,"5min":1.3500000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.829,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4470000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.319,"15min":1.292},"min":{"1min":1.133,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.161},"last":1.498},{"interface":"front","average":{"1min":1.494,"5min":1.4079999999999999,"15min":1.399},"min":{"1min":1.1180000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.9359999999999999},"last":1.5820000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065424,"statfs":{"total":96636764160,"available":96322994176,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97699999999999998,"15min":0.95999999999999996},"min":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.4099999999999999,"5min":1.577,"15min":1.5980000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1200000000000001,"15min":1.056},"min":{"1min":0.74299999999999999,"5min":0.65500000000000003,"15min":0.46000000000000002},"max":{"1min":1.417,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.748}]},{"osd":1,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.42999999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.204,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.871,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5269999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.077,"15min":1.097},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":1.135},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1859999999999999,"15min":1.177},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.028}]},{"osd":4,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.262,"15min":1.244},"min":{"1min":0.91500000000000004,"5min":0.82199999999999995,"15min":0.64600000000000002},"max":{"1min":1.6120000000000001,"5min":1.7609999999999999,"15min":1.766},"last":1.107},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.345,"15min":1.343},"min":{"1min":1.167,"5min":0.96499999999999997,"15min":0.66300000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.9710000000000001},"last":1.222}]},{"osd":5,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.782,"5min":1.837,"15min":2.1739999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":1.0289999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.1539999999999999},"last":1.474}]},{"osd":6,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":1.1859999999999999,"5min":1.153,"15min":0.92200000000000004},"max":{"1min":2.0579999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.431,"15min":1.419},"min":{"1min":0.98799999999999999,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7529999999999999,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.488,"15min":1.47},"min":{"1min":1.0700000000000001,"5min":1.0620000000000001,"15min":0.79500000000000004},"max":{"1min":1.7370000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5149999999999999,"15min":1.518},"min":{"1min":1.103,"5min":1.103,"15min":0.85799999999999998},"max":{"1min":1.7350000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.393}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310512,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061328,"statfs":{"total":96636764160,"available":96318799872,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91700000000000004,"15min":0.94199999999999995},"min":{"1min":0.61499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2110000000000001,"5min":1.411,"15min":1.8420000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.84099999999999997,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92600000000000005,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0429999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6519999999999999,"5min":1.976,"15min":1.976},"last":0.748}]},{"osd":3,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1279999999999999,"15min":1.1539999999999999},"min":{"1min":0.71099999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.625,"5min":1.625,"15min":2.6579999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0600000000000001,"15min":1.105},"min":{"1min":0.81499999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.542,"5min":1.6819999999999999,"15min":2.524},"last":0.92100000000000004}]},{"osd":4,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.298,"15min":1.3520000000000001},"min":{"1min":1.083,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.639,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.252},{"interface":"front","average":{"1min":1.365,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":1.226,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5449999999999999,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.798}]},{"osd":5,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.266,"15min":1.325},"min":{"1min":0.98799999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.734,"5min":1.734,"15min":3.093},"last":1.851},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.357,"15min":1.3959999999999999},"min":{"1min":1.02,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.841,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.46}]},{"osd":6,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.395,"15min":1.448},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9299999999999999,"5min":1.944,"15min":3.589},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.377,"15min":1.4470000000000001},"min":{"1min":1.1799999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.7589999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.45,"15min":1.502},"min":{"1min":1.206,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.0710000000000002,"15min":3.242},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.464,"15min":1.51},"min":{"1min":1.151,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.696}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.70999999999999996,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.8149999999999999,"15min":4.149},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.155},"min":{"1min":0.88300000000000001,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.042}]},{"osd":2,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.97499999999999998},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":1.494,"15min":3.7829999999999999},"last":1.198},{"interface":"front","average":{"1min":1.204,"5min":1.1220000000000001,"15min":1.1619999999999999},"min":{"1min":0.754,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.73,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.544}]},{"osd":3,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.272,"15min":1.2949999999999999},"min":{"1min":1.0629999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8140000000000001,"5min":1.915,"15min":4.1849999999999996},"last":1.823},{"interface":"front","average":{"1min":1.109,"5min":1.1240000000000001,"15min":1.1359999999999999},"min":{"1min":0.87,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3480000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.9410000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.262,"15min":1.278},"min":{"1min":1.1759999999999999,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.681,"5min":1.681,"15min":3.2629999999999999},"last":1.476},{"interface":"front","average":{"1min":1.526,"5min":1.4370000000000001,"15min":1.462},"min":{"1min":1.2190000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.1930000000000001,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.6719999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.3959999999999999,"15min":1.431},"min":{"1min":0.999,"5min":0.879,"15min":0.879},"max":{"1min":1.887,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3540000000000001,"15min":1.3979999999999999},"min":{"1min":1.0589999999999999,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6799999999999999,"5min":1.8340000000000001,"15min":2.637},"last":1.6240000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.514,"15min":1.542},"min":{"1min":1.282,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":2.1269999999999998,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.911},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.482,"15min":1.518},"min":{"1min":1.0409999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8260000000000001,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.8580000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.524,"15min":1.569},"min":{"1min":1.198,"5min":0.754,"15min":0.754},"max":{"1min":1.802,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.714},{"interface":"front","average":{"1min":1.544,"5min":1.4730000000000001,"15min":1.498},"min":{"1min":1.208,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.919,"5min":1.9710000000000001,"15min":2.798},"last":1.7809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306996,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064844,"statfs":{"total":96636764160,"available":96322400256,"internally_reserved":0,"allocated":1552384,"data_stored":1067873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.65700000000000003,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.72099999999999997,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.429,"5min":1.702,"15min":1.746},"last":1.5229999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":1.0549999999999999},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.7,"15min":1.7},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.113,"15min":1.1240000000000001},"min":{"1min":0.78500000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.6160000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0049999999999999,"15min":1.0249999999999999},"min":{"1min":0.69599999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.819},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.234,"15min":1.248},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.5349999999999999,"5min":1.929,"15min":1.929},"last":1.4239999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.593,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.325},{"interface":"front","average":{"1min":1.244,"5min":1.262,"15min":1.3049999999999999},"min":{"1min":0.97999999999999998,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.651,"5min":1.762,"15min":1.762},"last":1.3759999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.825,"5min":1.952,"15min":2.391},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.4350000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.6719999999999999,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.4690000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3149999999999999,"15min":1.389},"min":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4590000000000001,"5min":1.877,"15min":2.0779999999999998},"last":1.246},{"interface":"front","average":{"1min":1.446,"5min":1.47,"15min":1.5069999999999999},"min":{"1min":1.2609999999999999,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":1.903,"5min":2.161,"15min":2.23},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4670000000000001,"15min":1.5089999999999999},"min":{"1min":1.2050000000000001,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":1.5820000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.569},{"interface":"front","average":{"1min":1.405,"5min":1.409,"15min":1.482},"min":{"1min":1.179,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.736,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.161}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:51:26.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:51:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 Processor -- start 2023-12-24T18:51:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 -- start start 2023-12-24T18:51:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d740ca770 0x7f0d7415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d7415af90 0x7f0d7406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7406ca50 con 0x7f0d740ca3a0 2023-12-24T18:51:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d740c6980 con 0x7f0d740ca770 2023-12-24T18:51:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d78ef0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7415b410 con 0x7f0d7415af90 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d6bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d740ca770 0x7f0d7415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d6bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d740ca770 0x7f0d7415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53258/0 (socket says 172.21.15.50:53258) 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.302+0000 7f0d6bfff700 1 -- 172.21.15.50:0/2471399339 learned_addr learned my addr 172.21.15.50:0/2471399339 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d72d9d700 1 --2- 172.21.15.50:0/2471399339 >> v2:172.21.15.82:3300/0 conn(0x7f0d7415af90 0x7f0d7406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d6bfff700 1 -- 172.21.15.50:0/2471399339 >> v2:172.21.15.82:3300/0 conn(0x7f0d7415af90 msgr2=0x7f0d7406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d6bfff700 1 --2- 172.21.15.50:0/2471399339 >> v2:172.21.15.82:3300/0 conn(0x7f0d7415af90 0x7f0d7406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d6bfff700 1 -- 172.21.15.50:0/2471399339 >> v1:172.21.15.50:6789/0 conn(0x7f0d740ca3a0 legacy=0x7f0d7406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d6bfff700 1 -- 172.21.15.50:0/2471399339 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7406b520 con 0x7f0d740ca770 2023-12-24T18:51:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d6bfff700 1 --2- 172.21.15.50:0/2471399339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d740ca770 0x7f0d7415aa50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0d740c6210 tx=0x7f0d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd7004f914f6556 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d71d9b700 1 -- 172.21.15.50:0/2471399339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c009e70 con 0x7f0d740ca770 2023-12-24T18:51:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d71d9b700 1 -- 172.21.15.50:0/2471399339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c00b860 con 0x7f0d740ca770 2023-12-24T18:51:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d71d9b700 1 -- 172.21.15.50:0/2471399339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00bc20 con 0x7f0d740ca770 2023-12-24T18:51:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 -- 172.21.15.50:0/2471399339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d740ca770 msgr2=0x7f0d7415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/2471399339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d740ca770 0x7f0d7415aa50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0d740c6210 tx=0x7f0d5c009250 comp rx=0 tx=0).stop 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 -- 172.21.15.50:0/2471399339 shutdown_connections 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/2471399339 >> v2:172.21.15.82:3300/0 conn(0x7f0d7415af90 0x7f0d7406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/2471399339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d740ca770 0x7f0d7415aa50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 -- 172.21.15.50:0/2471399339 >> 172.21.15.50:0/2471399339 conn(0x7f0d740cbba0 msgr2=0x7f0d740cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 -- 172.21.15.50:0/2471399339 shutdown_connections 2023-12-24T18:51:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.306+0000 7f0d78ef0700 1 -- 172.21.15.50:0/2471399339 wait complete. 2023-12-24T18:51:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 Processor -- start 2023-12-24T18:51:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 -- start start 2023-12-24T18:51:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d740ca3a0 0x7f0d740b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d740ca770 0x7f0d74156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b0f60 con 0x7f0d7415af90 2023-12-24T18:51:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7416e690 con 0x7f0d740ca3a0 2023-12-24T18:51:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.310+0000 7f0d78ef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b09a0 con 0x7f0d740ca770 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d740ca3a0 0x7f0d740b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53260/0 (socket says 172.21.15.50:53260) 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d6bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d740ca770 0x7f0d74156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 -- 172.21.15.50:0/3234171799 learned_addr learned my addr 172.21.15.50:0/3234171799 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 -- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d740ca770 msgr2=0x7f0d74156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d740ca770 0x7f0d74156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 -- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d740ca3a0 msgr2=0x7f0d740b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d740ca3a0 0x7f0d740b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 -- 172.21.15.50:0/3234171799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0094f0 con 0x7f0d7415af90 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d72d9d700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009e20 tx=0x7f0d6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00caa0 con 0x7f0d7415af90 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00f040 con 0x7f0d7415af90 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d740b0c80 con 0x7f0d7415af90 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00ce70 con 0x7f0d7415af90 2023-12-24T18:51:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d74156b90 con 0x7f0d7415af90 2023-12-24T18:51:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.314+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74170d30 con 0x7f0d7415af90 2023-12-24T18:51:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.318+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0d6c014690 con 0x7f0d7415af90 2023-12-24T18:51:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.318+0000 7f0d6a7fc700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 0x7f0d54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.318+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f0d6c07d2c0 con 0x7f0d7415af90 2023-12-24T18:51:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.322+0000 7f0d7259c700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 0x7f0d54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.322+0000 7f0d7259c700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 0x7f0d54062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d74161990 tx=0x7f0d64009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.326+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d74170d30 con 0x7f0d7415af90 2023-12-24T18:51:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.490+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d74170d30 con 0x7f0d54060550 2023-12-24T18:51:26.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.506+0000 7f0d6a7fc700 1 -- 172.21.15.50:0/3234171799 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271062 (secure 0 0 0) 0x7f0d74170d30 con 0x7f0d54060550 2023-12-24T18:51:26.510 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 msgr2=0x7f0d54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 0x7f0d54062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d74161990 tx=0x7f0d64009040 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 msgr2=0x7f0d740c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009e20 tx=0x7f0d6c00b040 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 shutdown_connections 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0d54060550 0x7f0d54062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7415af90 0x7f0d740c2c50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d740ca770 0x7f0d74156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 --2- 172.21.15.50:0/3234171799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d740ca3a0 0x7f0d740b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 >> 172.21.15.50:0/3234171799 conn(0x7f0d740cbba0 msgr2=0x7f0d740c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:26.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 shutdown_connections 2023-12-24T18:51:26.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.514+0000 7f0d78ef0700 1 -- 172.21.15.50:0/3234171799 wait complete. 2023-12-24T18:51:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:51:26.537 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:51:24.616977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448392,"kb_used_data":8648,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752526328,"statfs":{"total":773094113280,"available":770586959872,"internally_reserved":0,"allocated":8855552,"data_stored":5000776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.860844"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:20.756203+0000","last_change":"2023-12-24T18:51:20.756203+0000","last_active":"2023-12-24T18:51:20.756203+0000","last_peered":"2023-12-24T18:51:20.756203+0000","last_clean":"2023-12-24T18:51:20.756203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:20.756203+0000","last_undegraded":"2023-12-24T18:51:20.756203+0000","last_fullsized":"2023-12-24T18:51:20.756203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:19.737278+0000","last_change":"2023-12-24T18:51:19.737278+0000","last_active":"2023-12-24T18:51:19.737278+0000","last_peered":"2023-12-24T18:51:19.737278+0000","last_clean":"2023-12-24T18:51:19.737278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:19.737278+0000","last_undegraded":"2023-12-24T18:51:19.737278+0000","last_fullsized":"2023-12-24T18:51:19.737278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"73'161","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-24T18:51:17.180901+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:17.180901+0000","last_peered":"2023-12-24T18:51:17.180901+0000","last_clean":"2023-12-24T18:51:17.180901+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:17.180901+0000","last_undegraded":"2023-12-24T18:51:17.180901+0000","last_fullsized":"2023-12-24T18:51:17.180901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311092,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060748,"statfs":{"total":96636764160,"available":96318205952,"internally_reserved":0,"allocated":1552384,"data_stored":1067873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.81100000000000005,"5min":0.746,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.304},{"interface":"front","average":{"1min":1.258,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.95899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6339999999999999,"5min":1.756,"15min":2.0710000000000002},"last":0.94799999999999995}]},{"osd":1,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1279999999999999,"15min":1.1439999999999999},"min":{"1min":0.88800000000000001,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4850000000000001,"5min":1.5389999999999999,"15min":1.669},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.2,"15min":1.222},"min":{"1min":0.96499999999999997,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.625,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.048}]},{"osd":2,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.236,"15min":1.214},"min":{"1min":0.94299999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5620000000000001,"5min":1.625,"15min":1.704},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.24,"15min":1.236},"min":{"1min":0.98699999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.595,"5min":1.6799999999999999,"15min":1.893},"last":1.395}]},{"osd":3,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0609999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.024},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.284,"15min":1.3080000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.623,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.222}]},{"osd":4,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1879999999999999,"15min":1.1950000000000001},"min":{"1min":0.88700000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.256,"5min":1.2430000000000001,"15min":1.2789999999999999},"min":{"1min":0.876,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6599999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.083}]},{"osd":5,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2709999999999999,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.331,"15min":1.351},"min":{"1min":1.01,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.8380000000000001,"5min":1.9590000000000001,"15min":2.403},"last":1.2729999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.409,"15min":1.429},"min":{"1min":1.05,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9259999999999999,"5min":1.956,"15min":2.4889999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":0.98599999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.2069999999999999},"last":1.377}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065424,"statfs":{"total":96636764160,"available":96322994176,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1850000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":1.119}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.0089999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":1.264}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.2989999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.0660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.177,"15min":1.1850000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.752},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3049999999999999,"15min":1.3029999999999999},"min":{"1min":0.876,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.839,"5min":1.839,"15min":2.73},"last":1.3700000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1100000000000001,"15min":1.139},"min":{"1min":0.75600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1599999999999999,"15min":1.1379999999999999},"min":{"1min":0.85199999999999998,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.3080000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.53900000000000003},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.2230000000000001},"min":{"1min":0.96899999999999997,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.5129999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.292,"15min":1.2669999999999999},"min":{"1min":0.876,"5min":0.86699999999999999,"15min":0.82399999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.605},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3029999999999999,"15min":1.3},"min":{"1min":1.0149999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.639,"5min":1.786,"15min":2.1389999999999998},"last":1.2470000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1519999999999999,"15min":1.1339999999999999},"min":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.607,"5min":1.633,"15min":2.202},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.266,"15min":1.256},"min":{"1min":0.85399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.6559999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2509999999999999,"15min":1.2829999999999999},"min":{"1min":0.82199999999999995,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":2.3959999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.29,"15min":1.3029999999999999},"min":{"1min":0.93999999999999995,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.611,"5min":1.724,"15min":2.6280000000000001},"last":1.4450000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.403,"15min":1.403},"min":{"1min":1.022,"5min":0.88,"15min":0.872},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.879},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.397,"15min":1.415},"min":{"1min":1.151,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.889,"5min":1.911,"15min":2.2429999999999999},"last":1.399}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.81399999999999995,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.6000000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.232,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.609,"5min":1.621,"15min":1.6879999999999999},"last":1.3109999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.1459999999999999},"min":{"1min":0.871,"5min":0.73199999999999998,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.589,"15min":1.9830000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1519999999999999,"15min":1.125},"min":{"1min":0.879,"5min":0.76200000000000001,"15min":0.48799999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3200000000000001,"15min":1.298},"min":{"1min":1.175,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":1.798},"last":1.528},{"interface":"front","average":{"1min":1.417,"5min":1.329,"15min":1.3120000000000001},"min":{"1min":1.2110000000000001,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6519999999999999,"5min":1.748,"15min":1.748},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.179,"15min":1.1699999999999999},"min":{"1min":1.05,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.6830000000000001,"5min":1.714,"15min":1.736},"last":1.175},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.93100000000000005,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.839},"last":1.351}]},{"osd":5,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.2829999999999999,"15min":1.252},"min":{"1min":1.105,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":1.744,"5min":1.837,"15min":1.837},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.3200000000000001,"15min":1.3049999999999999},"min":{"1min":1.262,"5min":0.623,"15min":0.623},"max":{"1min":1.7789999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.387}]},{"osd":6,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.274},"min":{"1min":0.94099999999999995,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.823,"5min":1.823,"15min":1.881},"last":1.421},{"interface":"front","average":{"1min":1.413,"5min":1.3500000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.829,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4470000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.319,"15min":1.292},"min":{"1min":1.133,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.161},"last":1.498},{"interface":"front","average":{"1min":1.494,"5min":1.4079999999999999,"15min":1.399},"min":{"1min":1.1180000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.9359999999999999},"last":1.5820000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065424,"statfs":{"total":96636764160,"available":96322994176,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97699999999999998,"15min":0.95999999999999996},"min":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.4099999999999999,"5min":1.577,"15min":1.5980000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1200000000000001,"15min":1.056},"min":{"1min":0.74299999999999999,"5min":0.65500000000000003,"15min":0.46000000000000002},"max":{"1min":1.417,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.748}]},{"osd":1,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.42999999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.204,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.871,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5269999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.077,"15min":1.097},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":1.135},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1859999999999999,"15min":1.177},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.028}]},{"osd":4,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.262,"15min":1.244},"min":{"1min":0.91500000000000004,"5min":0.82199999999999995,"15min":0.64600000000000002},"max":{"1min":1.6120000000000001,"5min":1.7609999999999999,"15min":1.766},"last":1.107},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.345,"15min":1.343},"min":{"1min":1.167,"5min":0.96499999999999997,"15min":0.66300000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.9710000000000001},"last":1.222}]},{"osd":5,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.782,"5min":1.837,"15min":2.1739999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":1.0289999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.1539999999999999},"last":1.474}]},{"osd":6,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":1.1859999999999999,"5min":1.153,"15min":0.92200000000000004},"max":{"1min":2.0579999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.431,"15min":1.419},"min":{"1min":0.98799999999999999,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7529999999999999,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.488,"15min":1.47},"min":{"1min":1.0700000000000001,"5min":1.0620000000000001,"15min":0.79500000000000004},"max":{"1min":1.7370000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5149999999999999,"15min":1.518},"min":{"1min":1.103,"5min":1.103,"15min":0.85799999999999998},"max":{"1min":1.7350000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.393}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310512,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061328,"statfs":{"total":96636764160,"available":96318799872,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91700000000000004,"15min":0.94199999999999995},"min":{"1min":0.61499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2110000000000001,"5min":1.411,"15min":1.8420000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.84099999999999997,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92600000000000005,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0429999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6519999999999999,"5min":1.976,"15min":1.976},"last":0.748}]},{"osd":3,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1279999999999999,"15min":1.1539999999999999},"min":{"1min":0.71099999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.625,"5min":1.625,"15min":2.6579999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0600000000000001,"15min":1.105},"min":{"1min":0.81499999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.542,"5min":1.6819999999999999,"15min":2.524},"last":0.92100000000000004}]},{"osd":4,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.298,"15min":1.3520000000000001},"min":{"1min":1.083,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.639,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.252},{"interface":"front","average":{"1min":1.365,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":1.226,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5449999999999999,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.798}]},{"osd":5,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.266,"15min":1.325},"min":{"1min":0.98799999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.734,"5min":1.734,"15min":3.093},"last":1.851},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.357,"15min":1.3959999999999999},"min":{"1min":1.02,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.841,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.46}]},{"osd":6,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.395,"15min":1.448},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9299999999999999,"5min":1.944,"15min":3.589},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.377,"15min":1.4470000000000001},"min":{"1min":1.1799999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.7589999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.45,"15min":1.502},"min":{"1min":1.206,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.0710000000000002,"15min":3.242},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.464,"15min":1.51},"min":{"1min":1.151,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.696}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":477505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.70999999999999996,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.8149999999999999,"15min":4.149},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.155},"min":{"1min":0.88300000000000001,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.042}]},{"osd":2,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.97499999999999998},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":1.494,"15min":3.7829999999999999},"last":1.198},{"interface":"front","average":{"1min":1.204,"5min":1.1220000000000001,"15min":1.1619999999999999},"min":{"1min":0.754,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.73,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.544}]},{"osd":3,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.272,"15min":1.2949999999999999},"min":{"1min":1.0629999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8140000000000001,"5min":1.915,"15min":4.1849999999999996},"last":1.823},{"interface":"front","average":{"1min":1.109,"5min":1.1240000000000001,"15min":1.1359999999999999},"min":{"1min":0.87,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3480000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.9410000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.262,"15min":1.278},"min":{"1min":1.1759999999999999,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.681,"5min":1.681,"15min":3.2629999999999999},"last":1.476},{"interface":"front","average":{"1min":1.526,"5min":1.4370000000000001,"15min":1.462},"min":{"1min":1.2190000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.1930000000000001,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.6719999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.3959999999999999,"15min":1.431},"min":{"1min":0.999,"5min":0.879,"15min":0.879},"max":{"1min":1.887,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3540000000000001,"15min":1.3979999999999999},"min":{"1min":1.0589999999999999,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6799999999999999,"5min":1.8340000000000001,"15min":2.637},"last":1.6240000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.514,"15min":1.542},"min":{"1min":1.282,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":2.1269999999999998,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.911},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.482,"15min":1.518},"min":{"1min":1.0409999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8260000000000001,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.8580000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.524,"15min":1.569},"min":{"1min":1.198,"5min":0.754,"15min":0.754},"max":{"1min":1.802,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.714},{"interface":"front","average":{"1min":1.544,"5min":1.4730000000000001,"15min":1.498},"min":{"1min":1.208,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.919,"5min":1.9710000000000001,"15min":2.798},"last":1.7809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306996,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064844,"statfs":{"total":96636764160,"available":96322400256,"internally_reserved":0,"allocated":1552384,"data_stored":1067873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.65700000000000003,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.72099999999999997,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.429,"5min":1.702,"15min":1.746},"last":1.5229999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":1.0549999999999999},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.7,"15min":1.7},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.113,"15min":1.1240000000000001},"min":{"1min":0.78500000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.6160000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0049999999999999,"15min":1.0249999999999999},"min":{"1min":0.69599999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.819},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.234,"15min":1.248},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.5349999999999999,"5min":1.929,"15min":1.929},"last":1.4239999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.593,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.325},{"interface":"front","average":{"1min":1.244,"5min":1.262,"15min":1.3049999999999999},"min":{"1min":0.97999999999999998,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.651,"5min":1.762,"15min":1.762},"last":1.3759999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.825,"5min":1.952,"15min":2.391},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.4350000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.6719999999999999,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.4690000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3149999999999999,"15min":1.389},"min":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4590000000000001,"5min":1.877,"15min":2.0779999999999998},"last":1.246},{"interface":"front","average":{"1min":1.446,"5min":1.47,"15min":1.5069999999999999},"min":{"1min":1.2609999999999999,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":1.903,"5min":2.161,"15min":2.23},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4670000000000001,"15min":1.5089999999999999},"min":{"1min":1.2050000000000001,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":1.5820000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.569},{"interface":"front","average":{"1min":1.405,"5min":1.409,"15min":1.482},"min":{"1min":1.179,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.736,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.161}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:51:26.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:51:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.742+0000 7f3379345700 1 Processor -- start 2023-12-24T18:51:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.742+0000 7f3379345700 1 -- start start 2023-12-24T18:51:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3379345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f337406def0 0x7f3374168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3379345700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337406ca50 con 0x7f33740ca770 2023-12-24T18:51:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3379345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337406b520 con 0x7f33740ca3a0 2023-12-24T18:51:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3379345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33740c6980 con 0x7f337406def0 2023-12-24T18:51:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f33727fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33740ca770 0x7f337415aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45458/0 (socket says 172.21.15.50:45458) 2023-12-24T18:51:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f33727fc700 1 -- 172.21.15.50:0/3895521538 learned_addr learned my addr 172.21.15.50:0/3895521538 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f33737fe700 1 --2- 172.21.15.50:0/3895521538 >> v2:172.21.15.82:3300/0 conn(0x7f337406def0 0x7f3374168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098950163 0 0) 0x7f337406ca50 con 0x7f33740ca770 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f335c003570 con 0x7f33740ca770 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.746+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107698092 0 0) 0x7f337406b520 con 0x7f33740ca3a0 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337406ca50 con 0x7f33740ca3a0 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f33737fe700 1 -- 172.21.15.50:0/3895521538 >> v1:172.21.15.82:6789/0 conn(0x7f33740ca3a0 legacy=0x7f337406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f33737fe700 1 -- 172.21.15.50:0/3895521538 >> v1:172.21.15.50:6789/0 conn(0x7f33740ca770 legacy=0x7f337415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f33737fe700 1 -- 172.21.15.50:0/3895521538 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337406b7f0 con 0x7f337406def0 2023-12-24T18:51:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f33737fe700 1 --2- 172.21.15.50:0/3895521538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f3374168380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f336c009e90 tx=0x7f336c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db921fe53e9f29 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00e070 con 0x7f337406def0 2023-12-24T18:51:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00bb90 con 0x7f337406def0 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3371ffb700 1 -- 172.21.15.50:0/3895521538 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c012430 con 0x7f337406def0 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 -- 172.21.15.50:0/3895521538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 msgr2=0x7f3374168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 --2- 172.21.15.50:0/3895521538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f3374168380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f336c009e90 tx=0x7f336c009780 comp rx=0 tx=0).stop 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 -- 172.21.15.50:0/3895521538 shutdown_connections 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 --2- 172.21.15.50:0/3895521538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f3374168380 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 -- 172.21.15.50:0/3895521538 >> 172.21.15.50:0/3895521538 conn(0x7f33740cbba0 msgr2=0x7f33740cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 -- 172.21.15.50:0/3895521538 shutdown_connections 2023-12-24T18:51:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.750+0000 7f3379345700 1 -- 172.21.15.50:0/3895521538 wait complete. 2023-12-24T18:51:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.754+0000 7f3379345700 1 Processor -- start 2023-12-24T18:51:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.754+0000 7f3379345700 1 -- start start 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f337415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33740ca3a0 0x7f3374171700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33741539c0 con 0x7f33740ca770 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33741624b0 con 0x7f337406def0 2023-12-24T18:51:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33740b0ba0 con 0x7f33740ca3a0 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53270/0 (socket says 172.21.15.50:53270) 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 -- 172.21.15.50:0/1130699170 learned_addr learned my addr 172.21.15.50:0/1130699170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3372ffd700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f337415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33727fc700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33740ca3a0 0x7f3374171700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 -- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33740ca3a0 msgr2=0x7f3374171700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33740ca3a0 0x7f3374171700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 -- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 msgr2=0x7f337415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f337415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 -- 172.21.15.50:0/1130699170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c009a20 con 0x7f33740ca770 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f33737fe700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f336c0099f0 tx=0x7f336c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0263f0 con 0x7f33740ca770 2023-12-24T18:51:26.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c026590 con 0x7f33740ca770 2023-12-24T18:51:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c026950 con 0x7f33740ca770 2023-12-24T18:51:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33740b0e80 con 0x7f33740ca770 2023-12-24T18:51:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.758+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374162140 con 0x7f33740ca770 2023-12-24T18:51:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.762+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3374162620 con 0x7f33740ca770 2023-12-24T18:51:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.762+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f336c02f450 con 0x7f33740ca770 2023-12-24T18:51:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.762+0000 7f335affd700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 0x7f3360062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.762+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f336c07eb40 con 0x7f33740ca770 2023-12-24T18:51:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.762+0000 7f3372ffd700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 0x7f3360062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:26.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.766+0000 7f3372ffd700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 0x7f3360062a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3364007fd0 tx=0x7f3364007d50 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.766+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f336c04ee80 con 0x7f33740ca770 2023-12-24T18:51:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.934+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33740652e0 con 0x7f33600605d0 2023-12-24T18:51:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.950+0000 7f335affd700 1 -- 172.21.15.50:0/1130699170 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285722 (secure 0 0 0) 0x7f33740652e0 con 0x7f33600605d0 2023-12-24T18:51:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 msgr2=0x7f3360062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 0x7f3360062a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3364007fd0 tx=0x7f3364007d50 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 msgr2=0x7f3374162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f336c0099f0 tx=0x7f336c019000 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 shutdown_connections 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f33600605d0 0x7f3360062a80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740ca770 0x7f3374162940 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33740ca3a0 0x7f3374171700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 --2- 172.21.15.50:0/1130699170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337406def0 0x7f337415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 >> 172.21.15.50:0/1130699170 conn(0x7f33740cbba0 msgr2=0x7f337415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 shutdown_connections 2023-12-24T18:51:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:26.958+0000 7f3379345700 1 -- 172.21.15.50:0/1130699170 wait complete. 2023-12-24T18:51:26.963 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:51:26.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:51:26.617531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448840,"kb_used_data":9096,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752525880,"statfs":{"total":773094113280,"available":770586501120,"internally_reserved":0,"allocated":9314304,"data_stored":5228548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001863"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821178+0000","last_change":"2023-12-24T18:51:21.819785+0000","last_active":"2023-12-24T18:51:21.821178+0000","last_peered":"2023-12-24T18:51:21.821178+0000","last_clean":"2023-12-24T18:51:21.821178+0000","last_became_active":"2023-12-24T18:51:21.819456+0000","last_became_peered":"2023-12-24T18:51:21.819456+0000","last_unstale":"2023-12-24T18:51:21.821178+0000","last_undegraded":"2023-12-24T18:51:21.821178+0000","last_fullsized":"2023-12-24T18:51:21.821178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812666+0000","last_change":"2023-12-24T18:51:21.806851+0000","last_active":"2023-12-24T18:51:21.812666+0000","last_peered":"2023-12-24T18:51:21.812666+0000","last_clean":"2023-12-24T18:51:21.812666+0000","last_became_active":"2023-12-24T18:51:21.806576+0000","last_became_peered":"2023-12-24T18:51:21.806576+0000","last_unstale":"2023-12-24T18:51:21.812666+0000","last_undegraded":"2023-12-24T18:51:21.812666+0000","last_fullsized":"2023-12-24T18:51:21.812666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823611+0000","last_change":"2023-12-24T18:51:21.819671+0000","last_active":"2023-12-24T18:51:21.823611+0000","last_peered":"2023-12-24T18:51:21.823611+0000","last_clean":"2023-12-24T18:51:21.823611+0000","last_became_active":"2023-12-24T18:51:21.818893+0000","last_became_peered":"2023-12-24T18:51:21.818893+0000","last_unstale":"2023-12-24T18:51:21.823611+0000","last_undegraded":"2023-12-24T18:51:21.823611+0000","last_fullsized":"2023-12-24T18:51:21.823611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816611+0000","last_change":"2023-12-24T18:51:21.798895+0000","last_active":"2023-12-24T18:51:21.816611+0000","last_peered":"2023-12-24T18:51:21.816611+0000","last_clean":"2023-12-24T18:51:21.816611+0000","last_became_active":"2023-12-24T18:51:21.798557+0000","last_became_peered":"2023-12-24T18:51:21.798557+0000","last_unstale":"2023-12-24T18:51:21.816611+0000","last_undegraded":"2023-12-24T18:51:21.816611+0000","last_fullsized":"2023-12-24T18:51:21.816611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800756+0000","last_change":"2023-12-24T18:51:21.797440+0000","last_active":"2023-12-24T18:51:21.800756+0000","last_peered":"2023-12-24T18:51:21.800756+0000","last_clean":"2023-12-24T18:51:21.800756+0000","last_became_active":"2023-12-24T18:51:21.797140+0000","last_became_peered":"2023-12-24T18:51:21.797140+0000","last_unstale":"2023-12-24T18:51:21.800756+0000","last_undegraded":"2023-12-24T18:51:21.800756+0000","last_fullsized":"2023-12-24T18:51:21.800756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:23.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819570+0000","last_change":"2023-12-24T18:51:21.815459+0000","last_active":"2023-12-24T18:51:21.819570+0000","last_peered":"2023-12-24T18:51:21.819570+0000","last_clean":"2023-12-24T18:51:21.819570+0000","last_became_active":"2023-12-24T18:51:21.815115+0000","last_became_peered":"2023-12-24T18:51:21.815115+0000","last_unstale":"2023-12-24T18:51:21.819570+0000","last_undegraded":"2023-12-24T18:51:21.819570+0000","last_fullsized":"2023-12-24T18:51:21.819570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:08.317193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825388+0000","last_change":"2023-12-24T18:51:21.823901+0000","last_active":"2023-12-24T18:51:21.825388+0000","last_peered":"2023-12-24T18:51:21.825388+0000","last_clean":"2023-12-24T18:51:21.825388+0000","last_became_active":"2023-12-24T18:51:21.823640+0000","last_became_peered":"2023-12-24T18:51:21.823640+0000","last_unstale":"2023-12-24T18:51:21.825388+0000","last_undegraded":"2023-12-24T18:51:21.825388+0000","last_fullsized":"2023-12-24T18:51:21.825388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:05.709486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821418+0000","last_change":"2023-12-24T18:51:21.807937+0000","last_active":"2023-12-24T18:51:21.821418+0000","last_peered":"2023-12-24T18:51:21.821418+0000","last_clean":"2023-12-24T18:51:21.821418+0000","last_became_active":"2023-12-24T18:51:21.807692+0000","last_became_peered":"2023-12-24T18:51:21.807692+0000","last_unstale":"2023-12-24T18:51:21.821418+0000","last_undegraded":"2023-12-24T18:51:21.821418+0000","last_fullsized":"2023-12-24T18:51:21.821418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:22.255385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828591+0000","last_change":"2023-12-24T18:51:21.827147+0000","last_active":"2023-12-24T18:51:21.828591+0000","last_peered":"2023-12-24T18:51:21.828591+0000","last_clean":"2023-12-24T18:51:21.828591+0000","last_became_active":"2023-12-24T18:51:21.826796+0000","last_became_peered":"2023-12-24T18:51:21.826796+0000","last_unstale":"2023-12-24T18:51:21.828591+0000","last_undegraded":"2023-12-24T18:51:21.828591+0000","last_fullsized":"2023-12-24T18:51:21.828591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823397+0000","last_change":"2023-12-24T18:51:21.818362+0000","last_active":"2023-12-24T18:51:21.823397+0000","last_peered":"2023-12-24T18:51:21.823397+0000","last_clean":"2023-12-24T18:51:21.823397+0000","last_became_active":"2023-12-24T18:51:21.818064+0000","last_became_peered":"2023-12-24T18:51:21.818064+0000","last_unstale":"2023-12-24T18:51:21.823397+0000","last_undegraded":"2023-12-24T18:51:21.823397+0000","last_fullsized":"2023-12-24T18:51:21.823397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826082+0000","last_change":"2023-12-24T18:51:21.809953+0000","last_active":"2023-12-24T18:51:21.826082+0000","last_peered":"2023-12-24T18:51:21.826082+0000","last_clean":"2023-12-24T18:51:21.826082+0000","last_became_active":"2023-12-24T18:51:21.803585+0000","last_became_peered":"2023-12-24T18:51:21.803585+0000","last_unstale":"2023-12-24T18:51:21.826082+0000","last_undegraded":"2023-12-24T18:51:21.826082+0000","last_fullsized":"2023-12-24T18:51:21.826082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823139+0000","last_change":"2023-12-24T18:51:21.820778+0000","last_active":"2023-12-24T18:51:21.823139+0000","last_peered":"2023-12-24T18:51:21.823139+0000","last_clean":"2023-12-24T18:51:21.823139+0000","last_became_active":"2023-12-24T18:51:21.820424+0000","last_became_peered":"2023-12-24T18:51:21.820424+0000","last_unstale":"2023-12-24T18:51:21.823139+0000","last_undegraded":"2023-12-24T18:51:21.823139+0000","last_fullsized":"2023-12-24T18:51:21.823139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:59.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821445+0000","last_change":"2023-12-24T18:51:21.808858+0000","last_active":"2023-12-24T18:51:21.821445+0000","last_peered":"2023-12-24T18:51:21.821445+0000","last_clean":"2023-12-24T18:51:21.821445+0000","last_became_active":"2023-12-24T18:51:21.808519+0000","last_became_peered":"2023-12-24T18:51:21.808519+0000","last_unstale":"2023-12-24T18:51:21.821445+0000","last_undegraded":"2023-12-24T18:51:21.821445+0000","last_fullsized":"2023-12-24T18:51:21.821445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:35.109063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823591+0000","last_change":"2023-12-24T18:51:21.820063+0000","last_active":"2023-12-24T18:51:21.823591+0000","last_peered":"2023-12-24T18:51:21.823591+0000","last_clean":"2023-12-24T18:51:21.823591+0000","last_became_active":"2023-12-24T18:51:21.819577+0000","last_became_peered":"2023-12-24T18:51:21.819577+0000","last_unstale":"2023-12-24T18:51:21.823591+0000","last_undegraded":"2023-12-24T18:51:21.823591+0000","last_fullsized":"2023-12-24T18:51:21.823591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823514+0000","last_change":"2023-12-24T18:51:21.819612+0000","last_active":"2023-12-24T18:51:21.823514+0000","last_peered":"2023-12-24T18:51:21.823514+0000","last_clean":"2023-12-24T18:51:21.823514+0000","last_became_active":"2023-12-24T18:51:21.819125+0000","last_became_peered":"2023-12-24T18:51:21.819125+0000","last_unstale":"2023-12-24T18:51:21.823514+0000","last_undegraded":"2023-12-24T18:51:21.823514+0000","last_fullsized":"2023-12-24T18:51:21.823514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812248+0000","last_change":"2023-12-24T18:51:21.810490+0000","last_active":"2023-12-24T18:51:21.812248+0000","last_peered":"2023-12-24T18:51:21.812248+0000","last_clean":"2023-12-24T18:51:21.812248+0000","last_became_active":"2023-12-24T18:51:21.810205+0000","last_became_peered":"2023-12-24T18:51:21.810205+0000","last_unstale":"2023-12-24T18:51:21.812248+0000","last_undegraded":"2023-12-24T18:51:21.812248+0000","last_fullsized":"2023-12-24T18:51:21.812248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:53:06.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830113+0000","last_change":"2023-12-24T18:51:21.829159+0000","last_active":"2023-12-24T18:51:21.830113+0000","last_peered":"2023-12-24T18:51:21.830113+0000","last_clean":"2023-12-24T18:51:21.830113+0000","last_became_active":"2023-12-24T18:51:21.828823+0000","last_became_peered":"2023-12-24T18:51:21.828823+0000","last_unstale":"2023-12-24T18:51:21.830113+0000","last_undegraded":"2023-12-24T18:51:21.830113+0000","last_fullsized":"2023-12-24T18:51:21.830113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822659+0000","last_change":"2023-12-24T18:51:21.802952+0000","last_active":"2023-12-24T18:51:21.822659+0000","last_peered":"2023-12-24T18:51:21.822659+0000","last_clean":"2023-12-24T18:51:21.822659+0000","last_became_active":"2023-12-24T18:51:21.802657+0000","last_became_peered":"2023-12-24T18:51:21.802657+0000","last_unstale":"2023-12-24T18:51:21.822659+0000","last_undegraded":"2023-12-24T18:51:21.822659+0000","last_fullsized":"2023-12-24T18:51:21.822659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800193+0000","last_change":"2023-12-24T18:51:21.796598+0000","last_active":"2023-12-24T18:51:21.800193+0000","last_peered":"2023-12-24T18:51:21.800193+0000","last_clean":"2023-12-24T18:51:21.800193+0000","last_became_active":"2023-12-24T18:51:21.796218+0000","last_became_peered":"2023-12-24T18:51:21.796218+0000","last_unstale":"2023-12-24T18:51:21.800193+0000","last_undegraded":"2023-12-24T18:51:21.800193+0000","last_fullsized":"2023-12-24T18:51:21.800193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:43.192930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804809+0000","last_change":"2023-12-24T18:51:21.801245+0000","last_active":"2023-12-24T18:51:21.804809+0000","last_peered":"2023-12-24T18:51:21.804809+0000","last_clean":"2023-12-24T18:51:21.804809+0000","last_became_active":"2023-12-24T18:51:21.800807+0000","last_became_peered":"2023-12-24T18:51:21.800807+0000","last_unstale":"2023-12-24T18:51:21.804809+0000","last_undegraded":"2023-12-24T18:51:21.804809+0000","last_fullsized":"2023-12-24T18:51:21.804809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:42.625747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820563+0000","last_change":"2023-12-24T18:51:21.807273+0000","last_active":"2023-12-24T18:51:21.820563+0000","last_peered":"2023-12-24T18:51:21.820563+0000","last_clean":"2023-12-24T18:51:21.820563+0000","last_became_active":"2023-12-24T18:51:21.806962+0000","last_became_peered":"2023-12-24T18:51:21.806962+0000","last_unstale":"2023-12-24T18:51:21.820563+0000","last_undegraded":"2023-12-24T18:51:21.820563+0000","last_fullsized":"2023-12-24T18:51:21.820563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:52.774219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.818769+0000","last_change":"2023-12-24T18:51:21.817316+0000","last_active":"2023-12-24T18:51:21.818769+0000","last_peered":"2023-12-24T18:51:21.818769+0000","last_clean":"2023-12-24T18:51:21.818769+0000","last_became_active":"2023-12-24T18:51:21.815806+0000","last_became_peered":"2023-12-24T18:51:21.815806+0000","last_unstale":"2023-12-24T18:51:21.818769+0000","last_undegraded":"2023-12-24T18:51:21.818769+0000","last_fullsized":"2023-12-24T18:51:21.818769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:23.889830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824295+0000","last_change":"2023-12-24T18:51:21.822330+0000","last_active":"2023-12-24T18:51:21.824295+0000","last_peered":"2023-12-24T18:51:21.824295+0000","last_clean":"2023-12-24T18:51:21.824295+0000","last_became_active":"2023-12-24T18:51:21.822027+0000","last_became_peered":"2023-12-24T18:51:21.822027+0000","last_unstale":"2023-12-24T18:51:21.824295+0000","last_undegraded":"2023-12-24T18:51:21.824295+0000","last_fullsized":"2023-12-24T18:51:21.824295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:09.103122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823693+0000","last_change":"2023-12-24T18:51:21.819796+0000","last_active":"2023-12-24T18:51:21.823693+0000","last_peered":"2023-12-24T18:51:21.823693+0000","last_clean":"2023-12-24T18:51:21.823693+0000","last_became_active":"2023-12-24T18:51:21.819005+0000","last_became_peered":"2023-12-24T18:51:21.819005+0000","last_unstale":"2023-12-24T18:51:21.823693+0000","last_undegraded":"2023-12-24T18:51:21.823693+0000","last_fullsized":"2023-12-24T18:51:21.823693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821624+0000","last_change":"2023-12-24T18:51:21.811274+0000","last_active":"2023-12-24T18:51:21.821624+0000","last_peered":"2023-12-24T18:51:21.821624+0000","last_clean":"2023-12-24T18:51:21.821624+0000","last_became_active":"2023-12-24T18:51:21.810813+0000","last_became_peered":"2023-12-24T18:51:21.810813+0000","last_unstale":"2023-12-24T18:51:21.821624+0000","last_undegraded":"2023-12-24T18:51:21.821624+0000","last_fullsized":"2023-12-24T18:51:21.821624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:11:55.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820133+0000","last_change":"2023-12-24T18:51:21.807476+0000","last_active":"2023-12-24T18:51:21.820133+0000","last_peered":"2023-12-24T18:51:21.820133+0000","last_clean":"2023-12-24T18:51:21.820133+0000","last_became_active":"2023-12-24T18:51:21.807216+0000","last_became_peered":"2023-12-24T18:51:21.807216+0000","last_unstale":"2023-12-24T18:51:21.820133+0000","last_undegraded":"2023-12-24T18:51:21.820133+0000","last_fullsized":"2023-12-24T18:51:21.820133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:02.747482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.799945+0000","last_change":"2023-12-24T18:51:21.794682+0000","last_active":"2023-12-24T18:51:21.799945+0000","last_peered":"2023-12-24T18:51:21.799945+0000","last_clean":"2023-12-24T18:51:21.799945+0000","last_became_active":"2023-12-24T18:51:21.794355+0000","last_became_peered":"2023-12-24T18:51:21.794355+0000","last_unstale":"2023-12-24T18:51:21.799945+0000","last_undegraded":"2023-12-24T18:51:21.799945+0000","last_fullsized":"2023-12-24T18:51:21.799945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814356+0000","last_change":"2023-12-24T18:51:21.810845+0000","last_active":"2023-12-24T18:51:21.814356+0000","last_peered":"2023-12-24T18:51:21.814356+0000","last_clean":"2023-12-24T18:51:21.814356+0000","last_became_active":"2023-12-24T18:51:21.810551+0000","last_became_peered":"2023-12-24T18:51:21.810551+0000","last_unstale":"2023-12-24T18:51:21.814356+0000","last_undegraded":"2023-12-24T18:51:21.814356+0000","last_fullsized":"2023-12-24T18:51:21.814356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.829015+0000","last_change":"2023-12-24T18:51:21.827819+0000","last_active":"2023-12-24T18:51:21.829015+0000","last_peered":"2023-12-24T18:51:21.829015+0000","last_clean":"2023-12-24T18:51:21.829015+0000","last_became_active":"2023-12-24T18:51:21.827261+0000","last_became_peered":"2023-12-24T18:51:21.827261+0000","last_unstale":"2023-12-24T18:51:21.829015+0000","last_undegraded":"2023-12-24T18:51:21.829015+0000","last_fullsized":"2023-12-24T18:51:21.829015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824418+0000","last_change":"2023-12-24T18:51:21.823865+0000","last_active":"2023-12-24T18:51:21.824418+0000","last_peered":"2023-12-24T18:51:21.824418+0000","last_clean":"2023-12-24T18:51:21.824418+0000","last_became_active":"2023-12-24T18:51:21.820623+0000","last_became_peered":"2023-12-24T18:51:21.820623+0000","last_unstale":"2023-12-24T18:51:21.824418+0000","last_undegraded":"2023-12-24T18:51:21.824418+0000","last_fullsized":"2023-12-24T18:51:21.824418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:43.024890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795732+0000","last_change":"2023-12-24T18:51:21.793682+0000","last_active":"2023-12-24T18:51:21.795732+0000","last_peered":"2023-12-24T18:51:21.795732+0000","last_clean":"2023-12-24T18:51:21.795732+0000","last_became_active":"2023-12-24T18:51:21.793275+0000","last_became_peered":"2023-12-24T18:51:21.793275+0000","last_unstale":"2023-12-24T18:51:21.795732+0000","last_undegraded":"2023-12-24T18:51:21.795732+0000","last_fullsized":"2023-12-24T18:51:21.795732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:09.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806600+0000","last_change":"2023-12-24T18:51:21.803059+0000","last_active":"2023-12-24T18:51:21.806600+0000","last_peered":"2023-12-24T18:51:21.806600+0000","last_clean":"2023-12-24T18:51:21.806600+0000","last_became_active":"2023-12-24T18:51:21.802781+0000","last_became_peered":"2023-12-24T18:51:21.802781+0000","last_unstale":"2023-12-24T18:51:21.806600+0000","last_undegraded":"2023-12-24T18:51:21.806600+0000","last_fullsized":"2023-12-24T18:51:21.806600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:49.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819785+0000","last_change":"2023-12-24T18:51:21.812040+0000","last_active":"2023-12-24T18:51:21.819785+0000","last_peered":"2023-12-24T18:51:21.819785+0000","last_clean":"2023-12-24T18:51:21.819785+0000","last_became_active":"2023-12-24T18:51:21.811754+0000","last_became_peered":"2023-12-24T18:51:21.811754+0000","last_unstale":"2023-12-24T18:51:21.819785+0000","last_undegraded":"2023-12-24T18:51:21.819785+0000","last_fullsized":"2023-12-24T18:51:21.819785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:04.056916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823033+0000","last_change":"2023-12-24T18:51:20.798916+0000","last_active":"2023-12-24T18:51:21.823033+0000","last_peered":"2023-12-24T18:51:21.823033+0000","last_clean":"2023-12-24T18:51:21.823033+0000","last_became_active":"2023-12-24T18:51:20.798544+0000","last_became_peered":"2023-12-24T18:51:20.798544+0000","last_unstale":"2023-12-24T18:51:21.823033+0000","last_undegraded":"2023-12-24T18:51:21.823033+0000","last_fullsized":"2023-12-24T18:51:21.823033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826098+0000","last_change":"2023-12-24T18:51:21.810131+0000","last_active":"2023-12-24T18:51:21.826098+0000","last_peered":"2023-12-24T18:51:21.826098+0000","last_clean":"2023-12-24T18:51:21.826098+0000","last_became_active":"2023-12-24T18:51:21.809525+0000","last_became_peered":"2023-12-24T18:51:21.809525+0000","last_unstale":"2023-12-24T18:51:21.826098+0000","last_undegraded":"2023-12-24T18:51:21.826098+0000","last_fullsized":"2023-12-24T18:51:21.826098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806347+0000","last_change":"2023-12-24T18:51:20.805863+0000","last_active":"2023-12-24T18:51:21.806347+0000","last_peered":"2023-12-24T18:51:21.806347+0000","last_clean":"2023-12-24T18:51:21.806347+0000","last_became_active":"2023-12-24T18:51:20.805505+0000","last_became_peered":"2023-12-24T18:51:20.805505+0000","last_unstale":"2023-12-24T18:51:21.806347+0000","last_undegraded":"2023-12-24T18:51:21.806347+0000","last_fullsized":"2023-12-24T18:51:21.806347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:21.236460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815682+0000","last_change":"2023-12-24T18:51:21.811172+0000","last_active":"2023-12-24T18:51:21.815682+0000","last_peered":"2023-12-24T18:51:21.815682+0000","last_clean":"2023-12-24T18:51:21.815682+0000","last_became_active":"2023-12-24T18:51:21.809843+0000","last_became_peered":"2023-12-24T18:51:21.809843+0000","last_unstale":"2023-12-24T18:51:21.815682+0000","last_undegraded":"2023-12-24T18:51:21.815682+0000","last_fullsized":"2023-12-24T18:51:21.815682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:36.662622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819717+0000","last_change":"2023-12-24T18:51:20.799302+0000","last_active":"2023-12-24T18:51:21.819717+0000","last_peered":"2023-12-24T18:51:21.819717+0000","last_clean":"2023-12-24T18:51:21.819717+0000","last_became_active":"2023-12-24T18:51:20.799011+0000","last_became_peered":"2023-12-24T18:51:20.799011+0000","last_unstale":"2023-12-24T18:51:21.819717+0000","last_undegraded":"2023-12-24T18:51:21.819717+0000","last_fullsized":"2023-12-24T18:51:21.819717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:51.755294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823338+0000","last_change":"2023-12-24T18:51:21.818274+0000","last_active":"2023-12-24T18:51:21.823338+0000","last_peered":"2023-12-24T18:51:21.823338+0000","last_clean":"2023-12-24T18:51:21.823338+0000","last_became_active":"2023-12-24T18:51:21.817981+0000","last_became_peered":"2023-12-24T18:51:21.817981+0000","last_unstale":"2023-12-24T18:51:21.823338+0000","last_undegraded":"2023-12-24T18:51:21.823338+0000","last_fullsized":"2023-12-24T18:51:21.823338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:00.886194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815461+0000","last_change":"2023-12-24T18:51:20.798149+0000","last_active":"2023-12-24T18:51:21.815461+0000","last_peered":"2023-12-24T18:51:21.815461+0000","last_clean":"2023-12-24T18:51:21.815461+0000","last_became_active":"2023-12-24T18:51:20.797835+0000","last_became_peered":"2023-12-24T18:51:20.797835+0000","last_unstale":"2023-12-24T18:51:21.815461+0000","last_undegraded":"2023-12-24T18:51:21.815461+0000","last_fullsized":"2023-12-24T18:51:21.815461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:34.090138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804820+0000","last_change":"2023-12-24T18:51:21.797085+0000","last_active":"2023-12-24T18:51:21.804820+0000","last_peered":"2023-12-24T18:51:21.804820+0000","last_clean":"2023-12-24T18:51:21.804820+0000","last_became_active":"2023-12-24T18:51:21.796784+0000","last_became_peered":"2023-12-24T18:51:21.796784+0000","last_unstale":"2023-12-24T18:51:21.804820+0000","last_undegraded":"2023-12-24T18:51:21.804820+0000","last_fullsized":"2023-12-24T18:51:21.804820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:26:15.942937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816419+0000","last_change":"2023-12-24T18:51:20.801016+0000","last_active":"2023-12-24T18:51:21.816419+0000","last_peered":"2023-12-24T18:51:21.816419+0000","last_clean":"2023-12-24T18:51:21.816419+0000","last_became_active":"2023-12-24T18:51:20.800722+0000","last_became_peered":"2023-12-24T18:51:20.800722+0000","last_unstale":"2023-12-24T18:51:21.816419+0000","last_undegraded":"2023-12-24T18:51:21.816419+0000","last_fullsized":"2023-12-24T18:51:21.816419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:49.537267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830093+0000","last_change":"2023-12-24T18:51:21.829091+0000","last_active":"2023-12-24T18:51:21.830093+0000","last_peered":"2023-12-24T18:51:21.830093+0000","last_clean":"2023-12-24T18:51:21.830093+0000","last_became_active":"2023-12-24T18:51:21.828800+0000","last_became_peered":"2023-12-24T18:51:21.828800+0000","last_unstale":"2023-12-24T18:51:21.830093+0000","last_undegraded":"2023-12-24T18:51:21.830093+0000","last_fullsized":"2023-12-24T18:51:21.830093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816803+0000","last_change":"2023-12-24T18:51:20.795608+0000","last_active":"2023-12-24T18:51:21.816803+0000","last_peered":"2023-12-24T18:51:21.816803+0000","last_clean":"2023-12-24T18:51:21.816803+0000","last_became_active":"2023-12-24T18:51:20.795091+0000","last_became_peered":"2023-12-24T18:51:20.795091+0000","last_unstale":"2023-12-24T18:51:21.816803+0000","last_undegraded":"2023-12-24T18:51:21.816803+0000","last_fullsized":"2023-12-24T18:51:21.816803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:33.654937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812706+0000","last_change":"2023-12-24T18:51:21.803121+0000","last_active":"2023-12-24T18:51:21.812706+0000","last_peered":"2023-12-24T18:51:21.812706+0000","last_clean":"2023-12-24T18:51:21.812706+0000","last_became_active":"2023-12-24T18:51:21.802824+0000","last_became_peered":"2023-12-24T18:51:21.802824+0000","last_unstale":"2023-12-24T18:51:21.812706+0000","last_undegraded":"2023-12-24T18:51:21.812706+0000","last_fullsized":"2023-12-24T18:51:21.812706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:51.275038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787040+0000","last_change":"2023-12-24T18:51:20.801342+0000","last_active":"2023-12-24T18:51:21.787040+0000","last_peered":"2023-12-24T18:51:21.787040+0000","last_clean":"2023-12-24T18:51:21.787040+0000","last_became_active":"2023-12-24T18:51:20.796984+0000","last_became_peered":"2023-12-24T18:51:20.796984+0000","last_unstale":"2023-12-24T18:51:21.787040+0000","last_undegraded":"2023-12-24T18:51:21.787040+0000","last_fullsized":"2023-12-24T18:51:21.787040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:28.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804843+0000","last_change":"2023-12-24T18:51:21.801636+0000","last_active":"2023-12-24T18:51:21.804843+0000","last_peered":"2023-12-24T18:51:21.804843+0000","last_clean":"2023-12-24T18:51:21.804843+0000","last_became_active":"2023-12-24T18:51:21.801356+0000","last_became_peered":"2023-12-24T18:51:21.801356+0000","last_unstale":"2023-12-24T18:51:21.804843+0000","last_undegraded":"2023-12-24T18:51:21.804843+0000","last_fullsized":"2023-12-24T18:51:21.804843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:37.573190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.788157+0000","last_change":"2023-12-24T18:51:20.799261+0000","last_active":"2023-12-24T18:51:21.788157+0000","last_peered":"2023-12-24T18:51:21.788157+0000","last_clean":"2023-12-24T18:51:21.788157+0000","last_became_active":"2023-12-24T18:51:20.797187+0000","last_became_peered":"2023-12-24T18:51:20.797187+0000","last_unstale":"2023-12-24T18:51:21.788157+0000","last_undegraded":"2023-12-24T18:51:21.788157+0000","last_fullsized":"2023-12-24T18:51:21.788157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:55:33.831411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.813264+0000","last_change":"2023-12-24T18:51:21.806185+0000","last_active":"2023-12-24T18:51:21.813264+0000","last_peered":"2023-12-24T18:51:21.813264+0000","last_clean":"2023-12-24T18:51:21.813264+0000","last_became_active":"2023-12-24T18:51:21.805835+0000","last_became_peered":"2023-12-24T18:51:21.805835+0000","last_unstale":"2023-12-24T18:51:21.813264+0000","last_undegraded":"2023-12-24T18:51:21.813264+0000","last_fullsized":"2023-12-24T18:51:21.813264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810950+0000","last_change":"2023-12-24T18:51:20.799268+0000","last_active":"2023-12-24T18:51:21.810950+0000","last_peered":"2023-12-24T18:51:21.810950+0000","last_clean":"2023-12-24T18:51:21.810950+0000","last_became_active":"2023-12-24T18:51:20.798656+0000","last_became_peered":"2023-12-24T18:51:20.798656+0000","last_unstale":"2023-12-24T18:51:21.810950+0000","last_undegraded":"2023-12-24T18:51:21.810950+0000","last_fullsized":"2023-12-24T18:51:21.810950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814664+0000","last_change":"2023-12-24T18:51:21.812241+0000","last_active":"2023-12-24T18:51:21.814664+0000","last_peered":"2023-12-24T18:51:21.814664+0000","last_clean":"2023-12-24T18:51:21.814664+0000","last_became_active":"2023-12-24T18:51:21.811946+0000","last_became_peered":"2023-12-24T18:51:21.811946+0000","last_unstale":"2023-12-24T18:51:21.814664+0000","last_undegraded":"2023-12-24T18:51:21.814664+0000","last_fullsized":"2023-12-24T18:51:21.814664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:42.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.783186+0000","last_change":"2023-12-24T18:51:20.797775+0000","last_active":"2023-12-24T18:51:21.783186+0000","last_peered":"2023-12-24T18:51:21.783186+0000","last_clean":"2023-12-24T18:51:21.783186+0000","last_became_active":"2023-12-24T18:51:20.797521+0000","last_became_peered":"2023-12-24T18:51:20.797521+0000","last_unstale":"2023-12-24T18:51:21.783186+0000","last_undegraded":"2023-12-24T18:51:21.783186+0000","last_fullsized":"2023-12-24T18:51:21.783186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812907+0000","last_change":"2023-12-24T18:51:21.806668+0000","last_active":"2023-12-24T18:51:21.812907+0000","last_peered":"2023-12-24T18:51:21.812907+0000","last_clean":"2023-12-24T18:51:21.812907+0000","last_became_active":"2023-12-24T18:51:21.806344+0000","last_became_peered":"2023-12-24T18:51:21.806344+0000","last_unstale":"2023-12-24T18:51:21.812907+0000","last_undegraded":"2023-12-24T18:51:21.812907+0000","last_fullsized":"2023-12-24T18:51:21.812907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:53.149173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821823+0000","last_change":"2023-12-24T18:51:20.796308+0000","last_active":"2023-12-24T18:51:21.821823+0000","last_peered":"2023-12-24T18:51:21.821823+0000","last_clean":"2023-12-24T18:51:21.821823+0000","last_became_active":"2023-12-24T18:51:20.796033+0000","last_became_peered":"2023-12-24T18:51:20.796033+0000","last_unstale":"2023-12-24T18:51:21.821823+0000","last_undegraded":"2023-12-24T18:51:21.821823+0000","last_fullsized":"2023-12-24T18:51:21.821823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805819+0000","last_change":"2023-12-24T18:51:21.797143+0000","last_active":"2023-12-24T18:51:21.805819+0000","last_peered":"2023-12-24T18:51:21.805819+0000","last_clean":"2023-12-24T18:51:21.805819+0000","last_became_active":"2023-12-24T18:51:21.795899+0000","last_became_peered":"2023-12-24T18:51:21.795899+0000","last_unstale":"2023-12-24T18:51:21.805819+0000","last_undegraded":"2023-12-24T18:51:21.805819+0000","last_fullsized":"2023-12-24T18:51:21.805819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:11.668152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'6","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.832629+0000","last_change":"2023-12-24T18:51:20.801730+0000","last_active":"2023-12-24T18:51:21.832629+0000","last_peered":"2023-12-24T18:51:21.832629+0000","last_clean":"2023-12-24T18:51:21.832629+0000","last_became_active":"2023-12-24T18:51:20.800473+0000","last_became_peered":"2023-12-24T18:51:20.800473+0000","last_unstale":"2023-12-24T18:51:21.832629+0000","last_undegraded":"2023-12-24T18:51:21.832629+0000","last_fullsized":"2023-12-24T18:51:21.832629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826474+0000","last_change":"2023-12-24T18:51:21.820977+0000","last_active":"2023-12-24T18:51:21.826474+0000","last_peered":"2023-12-24T18:51:21.826474+0000","last_clean":"2023-12-24T18:51:21.826474+0000","last_became_active":"2023-12-24T18:51:21.818241+0000","last_became_peered":"2023-12-24T18:51:21.818241+0000","last_unstale":"2023-12-24T18:51:21.826474+0000","last_undegraded":"2023-12-24T18:51:21.826474+0000","last_fullsized":"2023-12-24T18:51:21.826474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820347+0000","last_change":"2023-12-24T18:51:20.800176+0000","last_active":"2023-12-24T18:51:21.820347+0000","last_peered":"2023-12-24T18:51:21.820347+0000","last_clean":"2023-12-24T18:51:21.820347+0000","last_became_active":"2023-12-24T18:51:20.799887+0000","last_became_peered":"2023-12-24T18:51:20.799887+0000","last_unstale":"2023-12-24T18:51:21.820347+0000","last_undegraded":"2023-12-24T18:51:21.820347+0000","last_fullsized":"2023-12-24T18:51:21.820347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:03.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815988+0000","last_change":"2023-12-24T18:51:21.804426+0000","last_active":"2023-12-24T18:51:21.815988+0000","last_peered":"2023-12-24T18:51:21.815988+0000","last_clean":"2023-12-24T18:51:21.815988+0000","last_became_active":"2023-12-24T18:51:21.804188+0000","last_became_peered":"2023-12-24T18:51:21.804188+0000","last_unstale":"2023-12-24T18:51:21.815988+0000","last_undegraded":"2023-12-24T18:51:21.815988+0000","last_fullsized":"2023-12-24T18:51:21.815988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:01:45.952397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795490+0000","last_change":"2023-12-24T18:51:20.793803+0000","last_active":"2023-12-24T18:51:21.795490+0000","last_peered":"2023-12-24T18:51:21.795490+0000","last_clean":"2023-12-24T18:51:21.795490+0000","last_became_active":"2023-12-24T18:51:20.793511+0000","last_became_peered":"2023-12-24T18:51:20.793511+0000","last_unstale":"2023-12-24T18:51:21.795490+0000","last_undegraded":"2023-12-24T18:51:21.795490+0000","last_fullsized":"2023-12-24T18:51:21.795490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:51.391869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798434+0000","last_change":"2023-12-24T18:51:21.796751+0000","last_active":"2023-12-24T18:51:21.798434+0000","last_peered":"2023-12-24T18:51:21.798434+0000","last_clean":"2023-12-24T18:51:21.798434+0000","last_became_active":"2023-12-24T18:51:21.796428+0000","last_became_peered":"2023-12-24T18:51:21.796428+0000","last_unstale":"2023-12-24T18:51:21.798434+0000","last_undegraded":"2023-12-24T18:51:21.798434+0000","last_fullsized":"2023-12-24T18:51:21.798434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:46.461772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810290+0000","last_change":"2023-12-24T18:51:20.795592+0000","last_active":"2023-12-24T18:51:21.810290+0000","last_peered":"2023-12-24T18:51:21.810290+0000","last_clean":"2023-12-24T18:51:21.810290+0000","last_became_active":"2023-12-24T18:51:20.794829+0000","last_became_peered":"2023-12-24T18:51:20.794829+0000","last_unstale":"2023-12-24T18:51:21.810290+0000","last_undegraded":"2023-12-24T18:51:21.810290+0000","last_fullsized":"2023-12-24T18:51:21.810290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820598+0000","last_change":"2023-12-24T18:51:21.818722+0000","last_active":"2023-12-24T18:51:21.820598+0000","last_peered":"2023-12-24T18:51:21.820598+0000","last_clean":"2023-12-24T18:51:21.820598+0000","last_became_active":"2023-12-24T18:51:21.818412+0000","last_became_peered":"2023-12-24T18:51:21.818412+0000","last_unstale":"2023-12-24T18:51:21.820598+0000","last_undegraded":"2023-12-24T18:51:21.820598+0000","last_fullsized":"2023-12-24T18:51:21.820598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'8","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823505+0000","last_change":"2023-12-24T18:51:20.795854+0000","last_active":"2023-12-24T18:51:21.823505+0000","last_peered":"2023-12-24T18:51:21.823505+0000","last_clean":"2023-12-24T18:51:21.823505+0000","last_became_active":"2023-12-24T18:51:20.795547+0000","last_became_peered":"2023-12-24T18:51:20.795547+0000","last_unstale":"2023-12-24T18:51:21.823505+0000","last_undegraded":"2023-12-24T18:51:21.823505+0000","last_fullsized":"2023-12-24T18:51:21.823505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828564+0000","last_change":"2023-12-24T18:51:21.827156+0000","last_active":"2023-12-24T18:51:21.828564+0000","last_peered":"2023-12-24T18:51:21.828564+0000","last_clean":"2023-12-24T18:51:21.828564+0000","last_became_active":"2023-12-24T18:51:21.826804+0000","last_became_peered":"2023-12-24T18:51:21.826804+0000","last_unstale":"2023-12-24T18:51:21.828564+0000","last_undegraded":"2023-12-24T18:51:21.828564+0000","last_fullsized":"2023-12-24T18:51:21.828564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816079+0000","last_change":"2023-12-24T18:51:20.794130+0000","last_active":"2023-12-24T18:51:21.816079+0000","last_peered":"2023-12-24T18:51:21.816079+0000","last_clean":"2023-12-24T18:51:21.816079+0000","last_became_active":"2023-12-24T18:51:20.793857+0000","last_became_peered":"2023-12-24T18:51:20.793857+0000","last_unstale":"2023-12-24T18:51:21.816079+0000","last_undegraded":"2023-12-24T18:51:21.816079+0000","last_fullsized":"2023-12-24T18:51:21.816079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:10.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.809314+0000","last_change":"2023-12-24T18:51:21.800501+0000","last_active":"2023-12-24T18:51:21.809314+0000","last_peered":"2023-12-24T18:51:21.809314+0000","last_clean":"2023-12-24T18:51:21.809314+0000","last_became_active":"2023-12-24T18:51:21.800202+0000","last_became_peered":"2023-12-24T18:51:21.800202+0000","last_unstale":"2023-12-24T18:51:21.809314+0000","last_undegraded":"2023-12-24T18:51:21.809314+0000","last_fullsized":"2023-12-24T18:51:21.809314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:57.225140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826820+0000","last_change":"2023-12-24T18:51:20.796568+0000","last_active":"2023-12-24T18:51:21.826820+0000","last_peered":"2023-12-24T18:51:21.826820+0000","last_clean":"2023-12-24T18:51:21.826820+0000","last_became_active":"2023-12-24T18:51:20.795623+0000","last_became_peered":"2023-12-24T18:51:20.795623+0000","last_unstale":"2023-12-24T18:51:21.826820+0000","last_undegraded":"2023-12-24T18:51:21.826820+0000","last_fullsized":"2023-12-24T18:51:21.826820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825999+0000","last_change":"2023-12-24T18:51:21.808110+0000","last_active":"2023-12-24T18:51:21.825999+0000","last_peered":"2023-12-24T18:51:21.825999+0000","last_clean":"2023-12-24T18:51:21.825999+0000","last_became_active":"2023-12-24T18:51:21.807795+0000","last_became_peered":"2023-12-24T18:51:21.807795+0000","last_unstale":"2023-12-24T18:51:21.825999+0000","last_undegraded":"2023-12-24T18:51:21.825999+0000","last_fullsized":"2023-12-24T18:51:21.825999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819954+0000","last_change":"2023-12-24T18:51:20.798695+0000","last_active":"2023-12-24T18:51:21.819954+0000","last_peered":"2023-12-24T18:51:21.819954+0000","last_clean":"2023-12-24T18:51:21.819954+0000","last_became_active":"2023-12-24T18:51:20.796324+0000","last_became_peered":"2023-12-24T18:51:20.796324+0000","last_unstale":"2023-12-24T18:51:21.819954+0000","last_undegraded":"2023-12-24T18:51:21.819954+0000","last_fullsized":"2023-12-24T18:51:21.819954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:50.256113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816876+0000","last_change":"2023-12-24T18:51:21.810400+0000","last_active":"2023-12-24T18:51:21.816876+0000","last_peered":"2023-12-24T18:51:21.816876+0000","last_clean":"2023-12-24T18:51:21.816876+0000","last_became_active":"2023-12-24T18:51:21.804997+0000","last_became_peered":"2023-12-24T18:51:21.804997+0000","last_unstale":"2023-12-24T18:51:21.816876+0000","last_undegraded":"2023-12-24T18:51:21.816876+0000","last_fullsized":"2023-12-24T18:51:21.816876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:40.264126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787219+0000","last_change":"2023-12-24T18:51:20.791815+0000","last_active":"2023-12-24T18:51:21.787219+0000","last_peered":"2023-12-24T18:51:21.787219+0000","last_clean":"2023-12-24T18:51:21.787219+0000","last_became_active":"2023-12-24T18:51:20.791134+0000","last_became_peered":"2023-12-24T18:51:20.791134+0000","last_unstale":"2023-12-24T18:51:21.787219+0000","last_undegraded":"2023-12-24T18:51:21.787219+0000","last_fullsized":"2023-12-24T18:51:21.787219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:32.995781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804423+0000","last_change":"2023-12-24T18:51:21.799154+0000","last_active":"2023-12-24T18:51:21.804423+0000","last_peered":"2023-12-24T18:51:21.804423+0000","last_clean":"2023-12-24T18:51:21.804423+0000","last_became_active":"2023-12-24T18:51:21.798814+0000","last_became_peered":"2023-12-24T18:51:21.798814+0000","last_unstale":"2023-12-24T18:51:21.804423+0000","last_undegraded":"2023-12-24T18:51:21.804423+0000","last_fullsized":"2023-12-24T18:51:21.804423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:50.556192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.808097+0000","last_change":"2023-12-24T18:51:20.801286+0000","last_active":"2023-12-24T18:51:21.808097+0000","last_peered":"2023-12-24T18:51:21.808097+0000","last_clean":"2023-12-24T18:51:21.808097+0000","last_became_active":"2023-12-24T18:51:20.800996+0000","last_became_peered":"2023-12-24T18:51:20.800996+0000","last_unstale":"2023-12-24T18:51:21.808097+0000","last_undegraded":"2023-12-24T18:51:21.808097+0000","last_fullsized":"2023-12-24T18:51:21.808097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:27.237655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816008+0000","last_change":"2023-12-24T18:51:21.805580+0000","last_active":"2023-12-24T18:51:21.816008+0000","last_peered":"2023-12-24T18:51:21.816008+0000","last_clean":"2023-12-24T18:51:21.816008+0000","last_became_active":"2023-12-24T18:51:21.804008+0000","last_became_peered":"2023-12-24T18:51:21.804008+0000","last_unstale":"2023-12-24T18:51:21.816008+0000","last_undegraded":"2023-12-24T18:51:21.816008+0000","last_fullsized":"2023-12-24T18:51:21.816008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:28.256580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795604+0000","last_change":"2023-12-24T18:51:20.794817+0000","last_active":"2023-12-24T18:51:21.795604+0000","last_peered":"2023-12-24T18:51:21.795604+0000","last_clean":"2023-12-24T18:51:21.795604+0000","last_became_active":"2023-12-24T18:51:20.794467+0000","last_became_peered":"2023-12-24T18:51:20.794467+0000","last_unstale":"2023-12-24T18:51:21.795604+0000","last_undegraded":"2023-12-24T18:51:21.795604+0000","last_fullsized":"2023-12-24T18:51:21.795604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:02:41.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812686+0000","last_change":"2023-12-24T18:51:21.802498+0000","last_active":"2023-12-24T18:51:21.812686+0000","last_peered":"2023-12-24T18:51:21.812686+0000","last_clean":"2023-12-24T18:51:21.812686+0000","last_became_active":"2023-12-24T18:51:21.801035+0000","last_became_peered":"2023-12-24T18:51:21.801035+0000","last_unstale":"2023-12-24T18:51:21.812686+0000","last_undegraded":"2023-12-24T18:51:21.812686+0000","last_fullsized":"2023-12-24T18:51:21.812686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:08:09.546970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.796474+0000","last_change":"2023-12-24T18:51:20.804643+0000","last_active":"2023-12-24T18:51:21.796474+0000","last_peered":"2023-12-24T18:51:21.796474+0000","last_clean":"2023-12-24T18:51:21.796474+0000","last_became_active":"2023-12-24T18:51:20.804341+0000","last_became_peered":"2023-12-24T18:51:20.804341+0000","last_unstale":"2023-12-24T18:51:21.796474+0000","last_undegraded":"2023-12-24T18:51:21.796474+0000","last_fullsized":"2023-12-24T18:51:21.796474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:58.705231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822021+0000","last_change":"2023-12-24T18:51:21.821178+0000","last_active":"2023-12-24T18:51:21.822021+0000","last_peered":"2023-12-24T18:51:21.822021+0000","last_clean":"2023-12-24T18:51:21.822021+0000","last_became_active":"2023-12-24T18:51:21.820835+0000","last_became_peered":"2023-12-24T18:51:21.820835+0000","last_unstale":"2023-12-24T18:51:21.822021+0000","last_undegraded":"2023-12-24T18:51:21.822021+0000","last_fullsized":"2023-12-24T18:51:21.822021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:34.673863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815997+0000","last_change":"2023-12-24T18:51:20.792138+0000","last_active":"2023-12-24T18:51:21.815997+0000","last_peered":"2023-12-24T18:51:21.815997+0000","last_clean":"2023-12-24T18:51:21.815997+0000","last_became_active":"2023-12-24T18:51:20.791834+0000","last_became_peered":"2023-12-24T18:51:20.791834+0000","last_unstale":"2023-12-24T18:51:21.815997+0000","last_undegraded":"2023-12-24T18:51:21.815997+0000","last_fullsized":"2023-12-24T18:51:21.815997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:34.490587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812210+0000","last_change":"2023-12-24T18:51:21.806603+0000","last_active":"2023-12-24T18:51:21.812210+0000","last_peered":"2023-12-24T18:51:21.812210+0000","last_clean":"2023-12-24T18:51:21.812210+0000","last_became_active":"2023-12-24T18:51:21.806278+0000","last_became_peered":"2023-12-24T18:51:21.806278+0000","last_unstale":"2023-12-24T18:51:21.812210+0000","last_undegraded":"2023-12-24T18:51:21.812210+0000","last_fullsized":"2023-12-24T18:51:21.812210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:19.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.796327+0000","last_change":"2023-12-24T18:51:20.786762+0000","last_active":"2023-12-24T18:51:21.796327+0000","last_peered":"2023-12-24T18:51:21.796327+0000","last_clean":"2023-12-24T18:51:21.796327+0000","last_became_active":"2023-12-24T18:51:20.786201+0000","last_became_peered":"2023-12-24T18:51:20.786201+0000","last_unstale":"2023-12-24T18:51:21.796327+0000","last_undegraded":"2023-12-24T18:51:21.796327+0000","last_fullsized":"2023-12-24T18:51:21.796327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:08.896817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816846+0000","last_change":"2023-12-24T18:51:21.805091+0000","last_active":"2023-12-24T18:51:21.816846+0000","last_peered":"2023-12-24T18:51:21.816846+0000","last_clean":"2023-12-24T18:51:21.816846+0000","last_became_active":"2023-12-24T18:51:21.804789+0000","last_became_peered":"2023-12-24T18:51:21.804789+0000","last_unstale":"2023-12-24T18:51:21.816846+0000","last_undegraded":"2023-12-24T18:51:21.816846+0000","last_fullsized":"2023-12-24T18:51:21.816846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:11.577979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800246+0000","last_change":"2023-12-24T18:51:20.800325+0000","last_active":"2023-12-24T18:51:21.800246+0000","last_peered":"2023-12-24T18:51:21.800246+0000","last_clean":"2023-12-24T18:51:21.800246+0000","last_became_active":"2023-12-24T18:51:20.799937+0000","last_became_peered":"2023-12-24T18:51:20.799937+0000","last_unstale":"2023-12-24T18:51:21.800246+0000","last_undegraded":"2023-12-24T18:51:21.800246+0000","last_fullsized":"2023-12-24T18:51:21.800246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:42.005965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815532+0000","last_change":"2023-12-24T18:51:21.805172+0000","last_active":"2023-12-24T18:51:21.815532+0000","last_peered":"2023-12-24T18:51:21.815532+0000","last_clean":"2023-12-24T18:51:21.815532+0000","last_became_active":"2023-12-24T18:51:21.804860+0000","last_became_peered":"2023-12-24T18:51:21.804860+0000","last_unstale":"2023-12-24T18:51:21.815532+0000","last_undegraded":"2023-12-24T18:51:21.815532+0000","last_fullsized":"2023-12-24T18:51:21.815532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:24.570402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805302+0000","last_change":"2023-12-24T18:51:20.800807+0000","last_active":"2023-12-24T18:51:21.805302+0000","last_peered":"2023-12-24T18:51:21.805302+0000","last_clean":"2023-12-24T18:51:21.805302+0000","last_became_active":"2023-12-24T18:51:20.800021+0000","last_became_peered":"2023-12-24T18:51:20.800021+0000","last_unstale":"2023-12-24T18:51:21.805302+0000","last_undegraded":"2023-12-24T18:51:21.805302+0000","last_fullsized":"2023-12-24T18:51:21.805302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806406+0000","last_change":"2023-12-24T18:51:21.799830+0000","last_active":"2023-12-24T18:51:21.806406+0000","last_peered":"2023-12-24T18:51:21.806406+0000","last_clean":"2023-12-24T18:51:21.806406+0000","last_became_active":"2023-12-24T18:51:21.799513+0000","last_became_peered":"2023-12-24T18:51:21.799513+0000","last_unstale":"2023-12-24T18:51:21.806406+0000","last_undegraded":"2023-12-24T18:51:21.806406+0000","last_fullsized":"2023-12-24T18:51:21.806406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:27.608666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814015+0000","last_change":"2023-12-24T18:51:20.795218+0000","last_active":"2023-12-24T18:51:21.814015+0000","last_peered":"2023-12-24T18:51:21.814015+0000","last_clean":"2023-12-24T18:51:21.814015+0000","last_became_active":"2023-12-24T18:51:20.794894+0000","last_became_peered":"2023-12-24T18:51:20.794894+0000","last_unstale":"2023-12-24T18:51:21.814015+0000","last_undegraded":"2023-12-24T18:51:21.814015+0000","last_fullsized":"2023-12-24T18:51:21.814015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826633+0000","last_change":"2023-12-24T18:51:21.820648+0000","last_active":"2023-12-24T18:51:21.826633+0000","last_peered":"2023-12-24T18:51:21.826633+0000","last_clean":"2023-12-24T18:51:21.826633+0000","last_became_active":"2023-12-24T18:51:21.820365+0000","last_became_peered":"2023-12-24T18:51:21.820365+0000","last_unstale":"2023-12-24T18:51:21.826633+0000","last_undegraded":"2023-12-24T18:51:21.826633+0000","last_fullsized":"2023-12-24T18:51:21.826633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:22.978393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787304+0000","last_change":"2023-12-24T18:51:20.795379+0000","last_active":"2023-12-24T18:51:21.787304+0000","last_peered":"2023-12-24T18:51:21.787304+0000","last_clean":"2023-12-24T18:51:21.787304+0000","last_became_active":"2023-12-24T18:51:20.794763+0000","last_became_peered":"2023-12-24T18:51:20.794763+0000","last_unstale":"2023-12-24T18:51:21.787304+0000","last_undegraded":"2023-12-24T18:51:21.787304+0000","last_fullsized":"2023-12-24T18:51:21.787304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:46.484178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830962+0000","last_change":"2023-12-24T18:51:21.830222+0000","last_active":"2023-12-24T18:51:21.830962+0000","last_peered":"2023-12-24T18:51:21.830962+0000","last_clean":"2023-12-24T18:51:21.830962+0000","last_became_active":"2023-12-24T18:51:21.829914+0000","last_became_peered":"2023-12-24T18:51:21.829914+0000","last_unstale":"2023-12-24T18:51:21.830962+0000","last_undegraded":"2023-12-24T18:51:21.830962+0000","last_fullsized":"2023-12-24T18:51:21.830962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787204+0000","last_change":"2023-12-24T18:51:20.797264+0000","last_active":"2023-12-24T18:51:21.787204+0000","last_peered":"2023-12-24T18:51:21.787204+0000","last_clean":"2023-12-24T18:51:21.787204+0000","last_became_active":"2023-12-24T18:51:20.796622+0000","last_became_peered":"2023-12-24T18:51:20.796622+0000","last_unstale":"2023-12-24T18:51:21.787204+0000","last_undegraded":"2023-12-24T18:51:21.787204+0000","last_fullsized":"2023-12-24T18:51:21.787204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:17.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825231+0000","last_change":"2023-12-24T18:51:21.823379+0000","last_active":"2023-12-24T18:51:21.825231+0000","last_peered":"2023-12-24T18:51:21.825231+0000","last_clean":"2023-12-24T18:51:21.825231+0000","last_became_active":"2023-12-24T18:51:21.822915+0000","last_became_peered":"2023-12-24T18:51:21.822915+0000","last_unstale":"2023-12-24T18:51:21.825231+0000","last_undegraded":"2023-12-24T18:51:21.825231+0000","last_fullsized":"2023-12-24T18:51:21.825231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:40.383017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798113+0000","last_change":"2023-12-24T18:51:20.800223+0000","last_active":"2023-12-24T18:51:21.798113+0000","last_peered":"2023-12-24T18:51:21.798113+0000","last_clean":"2023-12-24T18:51:21.798113+0000","last_became_active":"2023-12-24T18:51:20.797749+0000","last_became_peered":"2023-12-24T18:51:20.797749+0000","last_unstale":"2023-12-24T18:51:21.798113+0000","last_undegraded":"2023-12-24T18:51:21.798113+0000","last_fullsized":"2023-12-24T18:51:21.798113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:42.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812812+0000","last_change":"2023-12-24T18:51:21.803735+0000","last_active":"2023-12-24T18:51:21.812812+0000","last_peered":"2023-12-24T18:51:21.812812+0000","last_clean":"2023-12-24T18:51:21.812812+0000","last_became_active":"2023-12-24T18:51:21.803444+0000","last_became_peered":"2023-12-24T18:51:21.803444+0000","last_unstale":"2023-12-24T18:51:21.812812+0000","last_undegraded":"2023-12-24T18:51:21.812812+0000","last_fullsized":"2023-12-24T18:51:21.812812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:21:22.617491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.786484+0000","last_change":"2023-12-24T18:51:20.803474+0000","last_active":"2023-12-24T18:51:21.786484+0000","last_peered":"2023-12-24T18:51:21.786484+0000","last_clean":"2023-12-24T18:51:21.786484+0000","last_became_active":"2023-12-24T18:51:20.803145+0000","last_became_peered":"2023-12-24T18:51:20.803145+0000","last_unstale":"2023-12-24T18:51:21.786484+0000","last_undegraded":"2023-12-24T18:51:21.786484+0000","last_fullsized":"2023-12-24T18:51:21.786484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:35.643697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"73'161","reported_seq":372,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810576+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:21.810576+0000","last_peered":"2023-12-24T18:51:21.810576+0000","last_clean":"2023-12-24T18:51:21.810576+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:21.810576+0000","last_undegraded":"2023-12-24T18:51:21.810576+0000","last_fullsized":"2023-12-24T18:51:21.810576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311156,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060684,"statfs":{"total":96636764160,"available":96318140416,"internally_reserved":0,"allocated":1617920,"data_stored":1096516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.81100000000000005,"5min":0.746,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.21},{"interface":"front","average":{"1min":1.258,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.95899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6339999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.1659999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1279999999999999,"15min":1.1439999999999999},"min":{"1min":0.88800000000000001,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4850000000000001,"5min":1.5389999999999999,"15min":1.669},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2,"15min":1.222},"min":{"1min":0.96499999999999997,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.625,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.236,"15min":1.214},"min":{"1min":0.94299999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5620000000000001,"5min":1.625,"15min":1.704},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.24,"15min":1.236},"min":{"1min":0.98699999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.595,"5min":1.6799999999999999,"15min":1.893},"last":0.90300000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0609999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.024},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.284,"15min":1.3080000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.623,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.258}]},{"osd":4,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1879999999999999,"15min":1.1950000000000001},"min":{"1min":0.88700000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.2430000000000001,"15min":1.2789999999999999},"min":{"1min":0.876,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6599999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.998}]},{"osd":5,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2709999999999999,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.331,"15min":1.351},"min":{"1min":1.01,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.8380000000000001,"5min":1.9590000000000001,"15min":2.403},"last":1.3300000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.409,"15min":1.429},"min":{"1min":1.05,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9259999999999999,"5min":1.956,"15min":2.4889999999999999},"last":1.083},{"interface":"front","average":{"1min":1.444,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":0.98599999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.2069999999999999},"last":1.4570000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306468,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065372,"statfs":{"total":96636764160,"available":96322940928,"internally_reserved":0,"allocated":1011712,"data_stored":505434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.232}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":1.349}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":1.419}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.129}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.202},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":1.6140000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":1.27},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.5289999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1011712,"data_stored":505422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.177,"15min":1.1850000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.752},"last":1.133},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3049999999999999,"15min":1.3029999999999999},"min":{"1min":0.876,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.839,"5min":1.839,"15min":2.73},"last":1.2849999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1100000000000001,"15min":1.139},"min":{"1min":0.75600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1599999999999999,"15min":1.1379999999999999},"min":{"1min":0.85199999999999998,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.53900000000000003},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.486},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.2230000000000001},"min":{"1min":0.96899999999999997,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.361}]},{"osd":3,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.292,"15min":1.2669999999999999},"min":{"1min":0.876,"5min":0.86699999999999999,"15min":0.82399999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.101},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3029999999999999,"15min":1.3},"min":{"1min":1.0149999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.639,"5min":1.786,"15min":2.1389999999999998},"last":1.6459999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1519999999999999,"15min":1.1339999999999999},"min":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.607,"5min":1.633,"15min":2.202},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.294,"5min":1.266,"15min":1.256},"min":{"1min":0.85399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2509999999999999,"15min":1.2829999999999999},"min":{"1min":0.82199999999999995,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":2.3959999999999999},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.29,"15min":1.3029999999999999},"min":{"1min":0.93999999999999995,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.611,"5min":1.724,"15min":2.6280000000000001},"last":1.089}]},{"osd":7,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.403,"15min":1.403},"min":{"1min":1.022,"5min":0.88,"15min":0.872},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.879},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.397,"15min":1.415},"min":{"1min":1.151,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.889,"5min":1.911,"15min":2.2429999999999999},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":506936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.81399999999999995,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.6000000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.232,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.609,"5min":1.621,"15min":1.6879999999999999},"last":1.4790000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.1459999999999999},"min":{"1min":0.871,"5min":0.73199999999999998,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.589,"15min":1.9830000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1519999999999999,"15min":1.125},"min":{"1min":0.879,"5min":0.76200000000000001,"15min":0.48799999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.165}]},{"osd":2,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3200000000000001,"15min":1.298},"min":{"1min":1.175,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":1.798},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.329,"15min":1.3120000000000001},"min":{"1min":1.2110000000000001,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6519999999999999,"5min":1.748,"15min":1.748},"last":1.506}]},{"osd":3,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.179,"15min":1.1699999999999999},"min":{"1min":1.05,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.6830000000000001,"5min":1.714,"15min":1.736},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.93100000000000005,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.839},"last":1.522}]},{"osd":5,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.2829999999999999,"15min":1.252},"min":{"1min":1.105,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":1.744,"5min":1.837,"15min":1.837},"last":0.876},{"interface":"front","average":{"1min":1.47,"5min":1.3200000000000001,"15min":1.3049999999999999},"min":{"1min":1.262,"5min":0.623,"15min":0.623},"max":{"1min":1.7789999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.3520000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.274},"min":{"1min":0.94099999999999995,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.823,"5min":1.823,"15min":1.881},"last":1.26},{"interface":"front","average":{"1min":1.413,"5min":1.3500000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.829,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3160000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.319,"15min":1.292},"min":{"1min":1.133,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.161},"last":1.587},{"interface":"front","average":{"1min":1.494,"5min":1.4079999999999999,"15min":1.399},"min":{"1min":1.1180000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.9359999999999999},"last":1.6890000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97699999999999998,"15min":0.95999999999999996},"min":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.4099999999999999,"5min":1.577,"15min":1.5980000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1200000000000001,"15min":1.056},"min":{"1min":0.74299999999999999,"5min":0.65500000000000003,"15min":0.46000000000000002},"max":{"1min":1.417,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.42999999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.204,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.871,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5269999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.077,"15min":1.097},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1859999999999999,"15min":1.177},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.875},"last":0.754}]},{"osd":4,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.262,"15min":1.244},"min":{"1min":0.91500000000000004,"5min":0.82199999999999995,"15min":0.64600000000000002},"max":{"1min":1.6120000000000001,"5min":1.7609999999999999,"15min":1.766},"last":1.45},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.345,"15min":1.343},"min":{"1min":1.167,"5min":0.96499999999999997,"15min":0.66300000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.9710000000000001},"last":1.115}]},{"osd":5,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.782,"5min":1.837,"15min":2.1739999999999999},"last":1.381},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":1.0289999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.1539999999999999},"last":1.4850000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":1.1859999999999999,"5min":1.153,"15min":0.92200000000000004},"max":{"1min":2.0579999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.431,"15min":1.419},"min":{"1min":0.98799999999999999,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7529999999999999,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":1.149}]},{"osd":7,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.488,"15min":1.47},"min":{"1min":1.0700000000000001,"5min":1.0620000000000001,"15min":0.79500000000000004},"max":{"1min":1.7370000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.337},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5149999999999999,"15min":1.518},"min":{"1min":1.103,"5min":1.103,"15min":0.85799999999999998},"max":{"1min":1.7350000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.228}]}]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310560,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061280,"statfs":{"total":96636764160,"available":96318750720,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91700000000000004,"15min":0.94199999999999995},"min":{"1min":0.61499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2110000000000001,"5min":1.411,"15min":1.8420000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.84099999999999997,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":1.3440000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92600000000000005,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.006},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0429999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6519999999999999,"5min":1.976,"15min":1.976},"last":1.0700000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1279999999999999,"15min":1.1539999999999999},"min":{"1min":0.71099999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.625,"5min":1.625,"15min":2.6579999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0600000000000001,"15min":1.105},"min":{"1min":0.81499999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.542,"5min":1.6819999999999999,"15min":2.524},"last":1.111}]},{"osd":4,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.298,"15min":1.3520000000000001},"min":{"1min":1.083,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.639,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":1.226,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5449999999999999,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.5840000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.266,"15min":1.325},"min":{"1min":0.98799999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.734,"5min":1.734,"15min":3.093},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.357,"15min":1.3959999999999999},"min":{"1min":1.02,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.841,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.7070000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.395,"15min":1.448},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9299999999999999,"5min":1.944,"15min":3.589},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.377,"15min":1.4470000000000001},"min":{"1min":1.1799999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.4390000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.45,"15min":1.502},"min":{"1min":1.206,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.0710000000000002,"15min":3.242},"last":1.796},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.464,"15min":1.51},"min":{"1min":1.151,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.6930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302396,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069444,"statfs":{"total":96636764160,"available":96327110656,"internally_reserved":0,"allocated":1036288,"data_stored":507672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.70999999999999996,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.8149999999999999,"15min":4.149},"last":1.04},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.155},"min":{"1min":0.88300000000000001,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.1970000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.97499999999999998},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.204,"5min":1.1220000000000001,"15min":1.1619999999999999},"min":{"1min":0.754,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.73,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":0.79100000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.272,"15min":1.2949999999999999},"min":{"1min":1.0629999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8140000000000001,"5min":1.915,"15min":4.1849999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.109,"5min":1.1240000000000001,"15min":1.1359999999999999},"min":{"1min":0.87,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3480000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.069}]},{"osd":4,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.262,"15min":1.278},"min":{"1min":1.1759999999999999,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.681,"5min":1.681,"15min":3.2629999999999999},"last":0.746},{"interface":"front","average":{"1min":1.526,"5min":1.4370000000000001,"15min":1.462},"min":{"1min":1.2190000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.1930000000000001,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":0.88400000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.3959999999999999,"15min":1.431},"min":{"1min":0.999,"5min":0.879,"15min":0.879},"max":{"1min":1.887,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3540000000000001,"15min":1.3979999999999999},"min":{"1min":1.0589999999999999,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6799999999999999,"5min":1.8340000000000001,"15min":2.637},"last":1.1160000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.514,"15min":1.542},"min":{"1min":1.282,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":2.1269999999999998,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.153},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.482,"15min":1.518},"min":{"1min":1.0409999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8260000000000001,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.3580000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.524,"15min":1.569},"min":{"1min":1.198,"5min":0.754,"15min":0.754},"max":{"1min":1.802,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4730000000000001,"15min":1.498},"min":{"1min":1.208,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.919,"5min":1.9710000000000001,"15min":2.798},"last":1.2410000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307044,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064796,"statfs":{"total":96636764160,"available":96322351104,"internally_reserved":0,"allocated":1601536,"data_stored":1095768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.65700000000000003,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.87},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.72099999999999997,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.429,"5min":1.702,"15min":1.746},"last":0.93300000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":1.0549999999999999},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.7,"15min":1.7},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.113,"15min":1.1240000000000001},"min":{"1min":0.78500000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0049999999999999,"15min":1.0249999999999999},"min":{"1min":0.69599999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.819},"last":0.997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.234,"15min":1.248},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.5349999999999999,"5min":1.929,"15min":1.929},"last":1.329}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.593,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.262,"15min":1.3049999999999999},"min":{"1min":0.97999999999999998,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.651,"5min":1.762,"15min":1.762},"last":1.2509999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.825,"5min":1.952,"15min":2.391},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.4350000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.6719999999999999,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.978}]},{"osd":6,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3149999999999999,"15min":1.389},"min":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4590000000000001,"5min":1.877,"15min":2.0779999999999998},"last":1.77},{"interface":"front","average":{"1min":1.446,"5min":1.47,"15min":1.5069999999999999},"min":{"1min":1.2609999999999999,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":1.903,"5min":2.161,"15min":2.23},"last":1.8560000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4670000000000001,"15min":1.5089999999999999},"min":{"1min":1.2050000000000001,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":1.5820000000000001,"5min":2.8980000000000001,"15min":3.262},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.409,"15min":1.482},"min":{"1min":1.179,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.736,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.917}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:51:26.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T18:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.194+0000 7fc08e185700 1 Processor -- start 2023-12-24T18:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.194+0000 7fc08e185700 1 -- start start 2023-12-24T18:51:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc08e185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc088151320 0x7fc0880b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc08e185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc08815b1f0 0x7fc0880ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc08e185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880cdbb0 con 0x7fc0881516f0 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc08e185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08815b950 con 0x7fc088151320 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc08e185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880ccfa0 con 0x7fc08815b1f0 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc088151320 0x7fc0880b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc086ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc0881516f0 0x7fc08815aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45462/0 (socket says 172.21.15.50:45462) 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc086ffd700 1 -- 172.21.15.50:0/102958251 learned_addr learned my addr 172.21.15.50:0/102958251 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc087fff700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc08815b1f0 0x7fc0880ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 -- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc08815b1f0 msgr2=0x7fc0880ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc08815b1f0 0x7fc0880ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 -- 172.21.15.50:0/102958251 >> v1:172.21.15.50:6789/0 conn(0x7fc0881516f0 legacy=0x7fc08815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 -- 172.21.15.50:0/102958251 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880cd280 con 0x7fc088151320 2023-12-24T18:51:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0877fe700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc088151320 0x7fc0880b3700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098e0 tx=0x7fc0780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a788c01d68716c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.198+0000 7fc0867fc700 1 -- 172.21.15.50:0/102958251 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800b640 con 0x7fc088151320 2023-12-24T18:51:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc0867fc700 1 -- 172.21.15.50:0/102958251 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800b7a0 con 0x7fc088151320 2023-12-24T18:51:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc0867fc700 1 -- 172.21.15.50:0/102958251 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800bb40 con 0x7fc088151320 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 -- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc088151320 msgr2=0x7fc0880b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc088151320 0x7fc0880b3700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098e0 tx=0x7fc0780091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 -- 172.21.15.50:0/102958251 shutdown_connections 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc08815b1f0 0x7fc0880ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 --2- 172.21.15.50:0/102958251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc088151320 0x7fc0880b3700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 -- 172.21.15.50:0/102958251 >> 172.21.15.50:0/102958251 conn(0x7fc08806d2f0 msgr2=0x7fc08806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 -- 172.21.15.50:0/102958251 shutdown_connections 2023-12-24T18:51:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.202+0000 7fc08e185700 1 -- 172.21.15.50:0/102958251 wait complete. 2023-12-24T18:51:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 Processor -- start 2023-12-24T18:51:27.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 -- start start 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc088151320 0x7fc0880670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08815b1f0 0x7fc0880aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880c9cf0 con 0x7fc0881516f0 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880682f0 con 0x7fc08815b1f0 2023-12-24T18:51:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc08e185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880676e0 con 0x7fc088151320 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53286/0 (socket says 172.21.15.50:53286) 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc086ffd700 1 -- 172.21.15.50:0/3525020311 learned_addr learned my addr 172.21.15.50:0/3525020311 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc0877fe700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc088151320 0x7fc0880670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.206+0000 7fc087fff700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08815b1f0 0x7fc0880aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 -- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc088151320 msgr2=0x7fc0880670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc088151320 0x7fc0880670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 -- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08815b1f0 msgr2=0x7fc0880aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08815b1f0 0x7fc0880aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 -- 172.21.15.50:0/3525020311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078009420 con 0x7fc0881516f0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc086ffd700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c7c0 tx=0x7fc07c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c005b30 con 0x7fc0881516f0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c005c90 con 0x7fc0881516f0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0880679c0 con 0x7fc0881516f0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004a80 con 0x7fc0881516f0 2023-12-24T18:51:27.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088067f80 con 0x7fc0881516f0 2023-12-24T18:51:27.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.210+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088071060 con 0x7fc0881516f0 2023-12-24T18:51:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.214+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc07c0070d0 con 0x7fc0881516f0 2023-12-24T18:51:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.214+0000 7fc06f7fe700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 0x7fc074062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.214+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fc07c07be10 con 0x7fc0881516f0 2023-12-24T18:51:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.214+0000 7fc0877fe700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 0x7fc074062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.214+0000 7fc0877fe700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 0x7fc074062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0780093f0 tx=0x7fc078017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.218+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc07c049be0 con 0x7fc0881516f0 2023-12-24T18:51:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.454+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc0880cd560 con 0x7fc0881516f0 2023-12-24T18:51:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.458+0000 7fc06f7fe700 1 -- 172.21.15.50:0/3525020311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7fc07c07f030 con 0x7fc0881516f0 2023-12-24T18:51:27.458 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:27.458 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":924,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2507612160,"bytes_avail":770586501120,"bytes_total":773094113280,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6349}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-24T18:50:22.405110+0000","services":{}},"progress_events":{}} 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 msgr2=0x7fc074062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 0x7fc074062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0780093f0 tx=0x7fc078017000 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 msgr2=0x7fc0880c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c7c0 tx=0x7fc07c007f70 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 shutdown_connections 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc074060550 0x7fc074062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08815b1f0 0x7fc0880aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0881516f0 0x7fc0880c97b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 --2- 172.21.15.50:0/3525020311 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc088151320 0x7fc0880670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 >> 172.21.15.50:0/3525020311 conn(0x7fc08806d2f0 msgr2=0x7fc08815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 shutdown_connections 2023-12-24T18:51:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.462+0000 7fc08e185700 1 -- 172.21.15.50:0/3525020311 wait complete. 2023-12-24T18:51:27.482 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T18:51:27.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:51:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 Processor -- start 2023-12-24T18:51:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 -- start start 2023-12-24T18:51:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 0x7f4c480ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c4815b160 0x7f4c4806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4806ca50 con 0x7f4c4806ae10 2023-12-24T18:51:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c480c6980 con 0x7f4c4815b160 2023-12-24T18:51:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4fd85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4806b7f0 con 0x7f4c480ca3a0 2023-12-24T18:51:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4e322700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c4815b160 0x7f4c4806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4db21700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 0x7f4c480ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4d320700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4c4806ae10 0x7f4c4815aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:44622/0 (socket says 172.21.15.50:44622) 2023-12-24T18:51:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.650+0000 7f4c4d320700 1 -- 172.21.15.50:0/1904804077 learned_addr learned my addr 172.21.15.50:0/1904804077 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4cb1f700 1 -- 172.21.15.50:0/1904804077 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744484194 0 0) 0x7f4c4806ca50 con 0x7f4c4806ae10 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4e322700 1 -- 172.21.15.50:0/1904804077 >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 msgr2=0x7f4c480ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4e322700 1 --2- 172.21.15.50:0/1904804077 >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 0x7f4c480ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4e322700 1 -- 172.21.15.50:0/1904804077 >> v1:172.21.15.82:6789/0 conn(0x7f4c4806ae10 legacy=0x7f4c4815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4e322700 1 -- 172.21.15.50:0/1904804077 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4806bad0 con 0x7f4c4815b160 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4db21700 1 --2- 172.21.15.50:0/1904804077 >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 0x7f4c480ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4e322700 1 --2- 172.21.15.50:0/1904804077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4815b160 0x7f4c4806cee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4c48069ce0 tx=0x7f4c40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4066f3134e78b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4cb1f700 1 -- 172.21.15.50:0/1904804077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000e070 con 0x7f4c4815b160 2023-12-24T18:51:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4cb1f700 1 -- 172.21.15.50:0/1904804077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000bb60 con 0x7f4c4815b160 2023-12-24T18:51:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4cb1f700 1 -- 172.21.15.50:0/1904804077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40012430 con 0x7f4c4815b160 2023-12-24T18:51:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1904804077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4815b160 msgr2=0x7f4c4806cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1904804077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4815b160 0x7f4c4806cee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4c48069ce0 tx=0x7f4c40009780 comp rx=0 tx=0).stop 2023-12-24T18:51:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1904804077 shutdown_connections 2023-12-24T18:51:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1904804077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4815b160 0x7f4c4806cee0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1904804077 >> v2:172.21.15.82:3300/0 conn(0x7f4c480ca3a0 0x7f4c480ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1904804077 >> 172.21.15.50:0/1904804077 conn(0x7f4c480cbba0 msgr2=0x7f4c480cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1904804077 shutdown_connections 2023-12-24T18:51:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.654+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1904804077 wait complete. 2023-12-24T18:51:27.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 Processor -- start 2023-12-24T18:51:27.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 -- start start 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c480ca3a0 0x7f4c4816dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c4815b160 0x7f4c481560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4816e530 con 0x7f4c4806ae10 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48156600 con 0x7f4c4815b160 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4fd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480afbb0 con 0x7f4c480ca3a0 2023-12-24T18:51:27.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4db21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4db21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53302/0 (socket says 172.21.15.50:53302) 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4db21700 1 -- 172.21.15.50:0/1260689915 learned_addr learned my addr 172.21.15.50:0/1260689915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4e322700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c4815b160 0x7f4c481560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.658+0000 7f4c4d320700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c480ca3a0 0x7f4c4816dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 -- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c480ca3a0 msgr2=0x7f4c4816dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c480ca3a0 0x7f4c4816dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 -- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c4815b160 msgr2=0x7f4c481560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c4815b160 0x7f4c481560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 -- 172.21.15.50:0/1260689915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009420 con 0x7f4c4806ae10 2023-12-24T18:51:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4db21700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400ecb0 tx=0x7f4c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4400c920 con 0x7f4c4806ae10 2023-12-24T18:51:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4400ca80 con 0x7f4c4806ae10 2023-12-24T18:51:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4400ce00 con 0x7f4c4806ae10 2023-12-24T18:51:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40009a20 con 0x7f4c4806ae10 2023-12-24T18:51:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c480b0710 con 0x7f4c4806ae10 2023-12-24T18:51:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.662+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c480652e0 con 0x7f4c4806ae10 2023-12-24T18:51:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.666+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4c44013680 con 0x7f4c4806ae10 2023-12-24T18:51:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.666+0000 7f4c3dffb700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 0x7f4c2c062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.666+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f4c4407cd00 con 0x7f4c4806ae10 2023-12-24T18:51:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.666+0000 7f4c4d320700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 0x7f4c2c062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.670+0000 7f4c4d320700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 0x7f4c2c062b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c4815e6c0 tx=0x7f4c38007d30 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.674+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c4404d010 con 0x7f4c4806ae10 2023-12-24T18:51:27.740 INFO:tasks.ceph.mds.d.smithi082.stderr:2023-12-24T18:51:27.739+0000 7fcf005b2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:51:27.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.842+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c4806bdb0 con 0x7f4c2c060650 2023-12-24T18:51:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.862+0000 7f4c3dffb700 1 -- 172.21.15.50:0/1260689915 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285722 (secure 0 0 0) 0x7f4c4806bdb0 con 0x7f4c2c060650 2023-12-24T18:51:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 msgr2=0x7f4c2c062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 0x7f4c2c062b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c4815e6c0 tx=0x7f4c38007d30 comp rx=0 tx=0).stop 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 msgr2=0x7f4c480b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400ecb0 tx=0x7f4c440091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 shutdown_connections 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c2c060650 0x7f4c2c062b00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c4815b160 0x7f4c481560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c480ca3a0 0x7f4c4816dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.866+0000 7f4c4fd85700 1 --2- 172.21.15.50:0/1260689915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c4806ae10 0x7f4c480b0ba0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.870+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 >> 172.21.15.50:0/1260689915 conn(0x7f4c480cbba0 msgr2=0x7f4c480cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.870+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 shutdown_connections 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:27.870+0000 7f4c4fd85700 1 -- 172.21.15.50:0/1260689915 wait complete. 2023-12-24T18:51:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:51:27.891 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:51:26.617531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448840,"kb_used_data":9096,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752525880,"statfs":{"total":773094113280,"available":770586501120,"internally_reserved":0,"allocated":9314304,"data_stored":5228548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001863"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821178+0000","last_change":"2023-12-24T18:51:21.819785+0000","last_active":"2023-12-24T18:51:21.821178+0000","last_peered":"2023-12-24T18:51:21.821178+0000","last_clean":"2023-12-24T18:51:21.821178+0000","last_became_active":"2023-12-24T18:51:21.819456+0000","last_became_peered":"2023-12-24T18:51:21.819456+0000","last_unstale":"2023-12-24T18:51:21.821178+0000","last_undegraded":"2023-12-24T18:51:21.821178+0000","last_fullsized":"2023-12-24T18:51:21.821178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812666+0000","last_change":"2023-12-24T18:51:21.806851+0000","last_active":"2023-12-24T18:51:21.812666+0000","last_peered":"2023-12-24T18:51:21.812666+0000","last_clean":"2023-12-24T18:51:21.812666+0000","last_became_active":"2023-12-24T18:51:21.806576+0000","last_became_peered":"2023-12-24T18:51:21.806576+0000","last_unstale":"2023-12-24T18:51:21.812666+0000","last_undegraded":"2023-12-24T18:51:21.812666+0000","last_fullsized":"2023-12-24T18:51:21.812666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823611+0000","last_change":"2023-12-24T18:51:21.819671+0000","last_active":"2023-12-24T18:51:21.823611+0000","last_peered":"2023-12-24T18:51:21.823611+0000","last_clean":"2023-12-24T18:51:21.823611+0000","last_became_active":"2023-12-24T18:51:21.818893+0000","last_became_peered":"2023-12-24T18:51:21.818893+0000","last_unstale":"2023-12-24T18:51:21.823611+0000","last_undegraded":"2023-12-24T18:51:21.823611+0000","last_fullsized":"2023-12-24T18:51:21.823611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816611+0000","last_change":"2023-12-24T18:51:21.798895+0000","last_active":"2023-12-24T18:51:21.816611+0000","last_peered":"2023-12-24T18:51:21.816611+0000","last_clean":"2023-12-24T18:51:21.816611+0000","last_became_active":"2023-12-24T18:51:21.798557+0000","last_became_peered":"2023-12-24T18:51:21.798557+0000","last_unstale":"2023-12-24T18:51:21.816611+0000","last_undegraded":"2023-12-24T18:51:21.816611+0000","last_fullsized":"2023-12-24T18:51:21.816611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800756+0000","last_change":"2023-12-24T18:51:21.797440+0000","last_active":"2023-12-24T18:51:21.800756+0000","last_peered":"2023-12-24T18:51:21.800756+0000","last_clean":"2023-12-24T18:51:21.800756+0000","last_became_active":"2023-12-24T18:51:21.797140+0000","last_became_peered":"2023-12-24T18:51:21.797140+0000","last_unstale":"2023-12-24T18:51:21.800756+0000","last_undegraded":"2023-12-24T18:51:21.800756+0000","last_fullsized":"2023-12-24T18:51:21.800756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:23.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819570+0000","last_change":"2023-12-24T18:51:21.815459+0000","last_active":"2023-12-24T18:51:21.819570+0000","last_peered":"2023-12-24T18:51:21.819570+0000","last_clean":"2023-12-24T18:51:21.819570+0000","last_became_active":"2023-12-24T18:51:21.815115+0000","last_became_peered":"2023-12-24T18:51:21.815115+0000","last_unstale":"2023-12-24T18:51:21.819570+0000","last_undegraded":"2023-12-24T18:51:21.819570+0000","last_fullsized":"2023-12-24T18:51:21.819570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:08.317193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825388+0000","last_change":"2023-12-24T18:51:21.823901+0000","last_active":"2023-12-24T18:51:21.825388+0000","last_peered":"2023-12-24T18:51:21.825388+0000","last_clean":"2023-12-24T18:51:21.825388+0000","last_became_active":"2023-12-24T18:51:21.823640+0000","last_became_peered":"2023-12-24T18:51:21.823640+0000","last_unstale":"2023-12-24T18:51:21.825388+0000","last_undegraded":"2023-12-24T18:51:21.825388+0000","last_fullsized":"2023-12-24T18:51:21.825388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:05.709486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821418+0000","last_change":"2023-12-24T18:51:21.807937+0000","last_active":"2023-12-24T18:51:21.821418+0000","last_peered":"2023-12-24T18:51:21.821418+0000","last_clean":"2023-12-24T18:51:21.821418+0000","last_became_active":"2023-12-24T18:51:21.807692+0000","last_became_peered":"2023-12-24T18:51:21.807692+0000","last_unstale":"2023-12-24T18:51:21.821418+0000","last_undegraded":"2023-12-24T18:51:21.821418+0000","last_fullsized":"2023-12-24T18:51:21.821418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:22.255385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828591+0000","last_change":"2023-12-24T18:51:21.827147+0000","last_active":"2023-12-24T18:51:21.828591+0000","last_peered":"2023-12-24T18:51:21.828591+0000","last_clean":"2023-12-24T18:51:21.828591+0000","last_became_active":"2023-12-24T18:51:21.826796+0000","last_became_peered":"2023-12-24T18:51:21.826796+0000","last_unstale":"2023-12-24T18:51:21.828591+0000","last_undegraded":"2023-12-24T18:51:21.828591+0000","last_fullsized":"2023-12-24T18:51:21.828591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823397+0000","last_change":"2023-12-24T18:51:21.818362+0000","last_active":"2023-12-24T18:51:21.823397+0000","last_peered":"2023-12-24T18:51:21.823397+0000","last_clean":"2023-12-24T18:51:21.823397+0000","last_became_active":"2023-12-24T18:51:21.818064+0000","last_became_peered":"2023-12-24T18:51:21.818064+0000","last_unstale":"2023-12-24T18:51:21.823397+0000","last_undegraded":"2023-12-24T18:51:21.823397+0000","last_fullsized":"2023-12-24T18:51:21.823397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826082+0000","last_change":"2023-12-24T18:51:21.809953+0000","last_active":"2023-12-24T18:51:21.826082+0000","last_peered":"2023-12-24T18:51:21.826082+0000","last_clean":"2023-12-24T18:51:21.826082+0000","last_became_active":"2023-12-24T18:51:21.803585+0000","last_became_peered":"2023-12-24T18:51:21.803585+0000","last_unstale":"2023-12-24T18:51:21.826082+0000","last_undegraded":"2023-12-24T18:51:21.826082+0000","last_fullsized":"2023-12-24T18:51:21.826082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823139+0000","last_change":"2023-12-24T18:51:21.820778+0000","last_active":"2023-12-24T18:51:21.823139+0000","last_peered":"2023-12-24T18:51:21.823139+0000","last_clean":"2023-12-24T18:51:21.823139+0000","last_became_active":"2023-12-24T18:51:21.820424+0000","last_became_peered":"2023-12-24T18:51:21.820424+0000","last_unstale":"2023-12-24T18:51:21.823139+0000","last_undegraded":"2023-12-24T18:51:21.823139+0000","last_fullsized":"2023-12-24T18:51:21.823139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:59.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821445+0000","last_change":"2023-12-24T18:51:21.808858+0000","last_active":"2023-12-24T18:51:21.821445+0000","last_peered":"2023-12-24T18:51:21.821445+0000","last_clean":"2023-12-24T18:51:21.821445+0000","last_became_active":"2023-12-24T18:51:21.808519+0000","last_became_peered":"2023-12-24T18:51:21.808519+0000","last_unstale":"2023-12-24T18:51:21.821445+0000","last_undegraded":"2023-12-24T18:51:21.821445+0000","last_fullsized":"2023-12-24T18:51:21.821445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:35.109063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823591+0000","last_change":"2023-12-24T18:51:21.820063+0000","last_active":"2023-12-24T18:51:21.823591+0000","last_peered":"2023-12-24T18:51:21.823591+0000","last_clean":"2023-12-24T18:51:21.823591+0000","last_became_active":"2023-12-24T18:51:21.819577+0000","last_became_peered":"2023-12-24T18:51:21.819577+0000","last_unstale":"2023-12-24T18:51:21.823591+0000","last_undegraded":"2023-12-24T18:51:21.823591+0000","last_fullsized":"2023-12-24T18:51:21.823591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823514+0000","last_change":"2023-12-24T18:51:21.819612+0000","last_active":"2023-12-24T18:51:21.823514+0000","last_peered":"2023-12-24T18:51:21.823514+0000","last_clean":"2023-12-24T18:51:21.823514+0000","last_became_active":"2023-12-24T18:51:21.819125+0000","last_became_peered":"2023-12-24T18:51:21.819125+0000","last_unstale":"2023-12-24T18:51:21.823514+0000","last_undegraded":"2023-12-24T18:51:21.823514+0000","last_fullsized":"2023-12-24T18:51:21.823514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812248+0000","last_change":"2023-12-24T18:51:21.810490+0000","last_active":"2023-12-24T18:51:21.812248+0000","last_peered":"2023-12-24T18:51:21.812248+0000","last_clean":"2023-12-24T18:51:21.812248+0000","last_became_active":"2023-12-24T18:51:21.810205+0000","last_became_peered":"2023-12-24T18:51:21.810205+0000","last_unstale":"2023-12-24T18:51:21.812248+0000","last_undegraded":"2023-12-24T18:51:21.812248+0000","last_fullsized":"2023-12-24T18:51:21.812248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:53:06.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830113+0000","last_change":"2023-12-24T18:51:21.829159+0000","last_active":"2023-12-24T18:51:21.830113+0000","last_peered":"2023-12-24T18:51:21.830113+0000","last_clean":"2023-12-24T18:51:21.830113+0000","last_became_active":"2023-12-24T18:51:21.828823+0000","last_became_peered":"2023-12-24T18:51:21.828823+0000","last_unstale":"2023-12-24T18:51:21.830113+0000","last_undegraded":"2023-12-24T18:51:21.830113+0000","last_fullsized":"2023-12-24T18:51:21.830113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822659+0000","last_change":"2023-12-24T18:51:21.802952+0000","last_active":"2023-12-24T18:51:21.822659+0000","last_peered":"2023-12-24T18:51:21.822659+0000","last_clean":"2023-12-24T18:51:21.822659+0000","last_became_active":"2023-12-24T18:51:21.802657+0000","last_became_peered":"2023-12-24T18:51:21.802657+0000","last_unstale":"2023-12-24T18:51:21.822659+0000","last_undegraded":"2023-12-24T18:51:21.822659+0000","last_fullsized":"2023-12-24T18:51:21.822659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800193+0000","last_change":"2023-12-24T18:51:21.796598+0000","last_active":"2023-12-24T18:51:21.800193+0000","last_peered":"2023-12-24T18:51:21.800193+0000","last_clean":"2023-12-24T18:51:21.800193+0000","last_became_active":"2023-12-24T18:51:21.796218+0000","last_became_peered":"2023-12-24T18:51:21.796218+0000","last_unstale":"2023-12-24T18:51:21.800193+0000","last_undegraded":"2023-12-24T18:51:21.800193+0000","last_fullsized":"2023-12-24T18:51:21.800193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:43.192930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804809+0000","last_change":"2023-12-24T18:51:21.801245+0000","last_active":"2023-12-24T18:51:21.804809+0000","last_peered":"2023-12-24T18:51:21.804809+0000","last_clean":"2023-12-24T18:51:21.804809+0000","last_became_active":"2023-12-24T18:51:21.800807+0000","last_became_peered":"2023-12-24T18:51:21.800807+0000","last_unstale":"2023-12-24T18:51:21.804809+0000","last_undegraded":"2023-12-24T18:51:21.804809+0000","last_fullsized":"2023-12-24T18:51:21.804809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:42.625747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820563+0000","last_change":"2023-12-24T18:51:21.807273+0000","last_active":"2023-12-24T18:51:21.820563+0000","last_peered":"2023-12-24T18:51:21.820563+0000","last_clean":"2023-12-24T18:51:21.820563+0000","last_became_active":"2023-12-24T18:51:21.806962+0000","last_became_peered":"2023-12-24T18:51:21.806962+0000","last_unstale":"2023-12-24T18:51:21.820563+0000","last_undegraded":"2023-12-24T18:51:21.820563+0000","last_fullsized":"2023-12-24T18:51:21.820563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:52.774219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.818769+0000","last_change":"2023-12-24T18:51:21.817316+0000","last_active":"2023-12-24T18:51:21.818769+0000","last_peered":"2023-12-24T18:51:21.818769+0000","last_clean":"2023-12-24T18:51:21.818769+0000","last_became_active":"2023-12-24T18:51:21.815806+0000","last_became_peered":"2023-12-24T18:51:21.815806+0000","last_unstale":"2023-12-24T18:51:21.818769+0000","last_undegraded":"2023-12-24T18:51:21.818769+0000","last_fullsized":"2023-12-24T18:51:21.818769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:23.889830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824295+0000","last_change":"2023-12-24T18:51:21.822330+0000","last_active":"2023-12-24T18:51:21.824295+0000","last_peered":"2023-12-24T18:51:21.824295+0000","last_clean":"2023-12-24T18:51:21.824295+0000","last_became_active":"2023-12-24T18:51:21.822027+0000","last_became_peered":"2023-12-24T18:51:21.822027+0000","last_unstale":"2023-12-24T18:51:21.824295+0000","last_undegraded":"2023-12-24T18:51:21.824295+0000","last_fullsized":"2023-12-24T18:51:21.824295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:09.103122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823693+0000","last_change":"2023-12-24T18:51:21.819796+0000","last_active":"2023-12-24T18:51:21.823693+0000","last_peered":"2023-12-24T18:51:21.823693+0000","last_clean":"2023-12-24T18:51:21.823693+0000","last_became_active":"2023-12-24T18:51:21.819005+0000","last_became_peered":"2023-12-24T18:51:21.819005+0000","last_unstale":"2023-12-24T18:51:21.823693+0000","last_undegraded":"2023-12-24T18:51:21.823693+0000","last_fullsized":"2023-12-24T18:51:21.823693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821624+0000","last_change":"2023-12-24T18:51:21.811274+0000","last_active":"2023-12-24T18:51:21.821624+0000","last_peered":"2023-12-24T18:51:21.821624+0000","last_clean":"2023-12-24T18:51:21.821624+0000","last_became_active":"2023-12-24T18:51:21.810813+0000","last_became_peered":"2023-12-24T18:51:21.810813+0000","last_unstale":"2023-12-24T18:51:21.821624+0000","last_undegraded":"2023-12-24T18:51:21.821624+0000","last_fullsized":"2023-12-24T18:51:21.821624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:11:55.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820133+0000","last_change":"2023-12-24T18:51:21.807476+0000","last_active":"2023-12-24T18:51:21.820133+0000","last_peered":"2023-12-24T18:51:21.820133+0000","last_clean":"2023-12-24T18:51:21.820133+0000","last_became_active":"2023-12-24T18:51:21.807216+0000","last_became_peered":"2023-12-24T18:51:21.807216+0000","last_unstale":"2023-12-24T18:51:21.820133+0000","last_undegraded":"2023-12-24T18:51:21.820133+0000","last_fullsized":"2023-12-24T18:51:21.820133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:02.747482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.799945+0000","last_change":"2023-12-24T18:51:21.794682+0000","last_active":"2023-12-24T18:51:21.799945+0000","last_peered":"2023-12-24T18:51:21.799945+0000","last_clean":"2023-12-24T18:51:21.799945+0000","last_became_active":"2023-12-24T18:51:21.794355+0000","last_became_peered":"2023-12-24T18:51:21.794355+0000","last_unstale":"2023-12-24T18:51:21.799945+0000","last_undegraded":"2023-12-24T18:51:21.799945+0000","last_fullsized":"2023-12-24T18:51:21.799945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814356+0000","last_change":"2023-12-24T18:51:21.810845+0000","last_active":"2023-12-24T18:51:21.814356+0000","last_peered":"2023-12-24T18:51:21.814356+0000","last_clean":"2023-12-24T18:51:21.814356+0000","last_became_active":"2023-12-24T18:51:21.810551+0000","last_became_peered":"2023-12-24T18:51:21.810551+0000","last_unstale":"2023-12-24T18:51:21.814356+0000","last_undegraded":"2023-12-24T18:51:21.814356+0000","last_fullsized":"2023-12-24T18:51:21.814356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.829015+0000","last_change":"2023-12-24T18:51:21.827819+0000","last_active":"2023-12-24T18:51:21.829015+0000","last_peered":"2023-12-24T18:51:21.829015+0000","last_clean":"2023-12-24T18:51:21.829015+0000","last_became_active":"2023-12-24T18:51:21.827261+0000","last_became_peered":"2023-12-24T18:51:21.827261+0000","last_unstale":"2023-12-24T18:51:21.829015+0000","last_undegraded":"2023-12-24T18:51:21.829015+0000","last_fullsized":"2023-12-24T18:51:21.829015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824418+0000","last_change":"2023-12-24T18:51:21.823865+0000","last_active":"2023-12-24T18:51:21.824418+0000","last_peered":"2023-12-24T18:51:21.824418+0000","last_clean":"2023-12-24T18:51:21.824418+0000","last_became_active":"2023-12-24T18:51:21.820623+0000","last_became_peered":"2023-12-24T18:51:21.820623+0000","last_unstale":"2023-12-24T18:51:21.824418+0000","last_undegraded":"2023-12-24T18:51:21.824418+0000","last_fullsized":"2023-12-24T18:51:21.824418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:43.024890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795732+0000","last_change":"2023-12-24T18:51:21.793682+0000","last_active":"2023-12-24T18:51:21.795732+0000","last_peered":"2023-12-24T18:51:21.795732+0000","last_clean":"2023-12-24T18:51:21.795732+0000","last_became_active":"2023-12-24T18:51:21.793275+0000","last_became_peered":"2023-12-24T18:51:21.793275+0000","last_unstale":"2023-12-24T18:51:21.795732+0000","last_undegraded":"2023-12-24T18:51:21.795732+0000","last_fullsized":"2023-12-24T18:51:21.795732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:09.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806600+0000","last_change":"2023-12-24T18:51:21.803059+0000","last_active":"2023-12-24T18:51:21.806600+0000","last_peered":"2023-12-24T18:51:21.806600+0000","last_clean":"2023-12-24T18:51:21.806600+0000","last_became_active":"2023-12-24T18:51:21.802781+0000","last_became_peered":"2023-12-24T18:51:21.802781+0000","last_unstale":"2023-12-24T18:51:21.806600+0000","last_undegraded":"2023-12-24T18:51:21.806600+0000","last_fullsized":"2023-12-24T18:51:21.806600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:49.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819785+0000","last_change":"2023-12-24T18:51:21.812040+0000","last_active":"2023-12-24T18:51:21.819785+0000","last_peered":"2023-12-24T18:51:21.819785+0000","last_clean":"2023-12-24T18:51:21.819785+0000","last_became_active":"2023-12-24T18:51:21.811754+0000","last_became_peered":"2023-12-24T18:51:21.811754+0000","last_unstale":"2023-12-24T18:51:21.819785+0000","last_undegraded":"2023-12-24T18:51:21.819785+0000","last_fullsized":"2023-12-24T18:51:21.819785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:04.056916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823033+0000","last_change":"2023-12-24T18:51:20.798916+0000","last_active":"2023-12-24T18:51:21.823033+0000","last_peered":"2023-12-24T18:51:21.823033+0000","last_clean":"2023-12-24T18:51:21.823033+0000","last_became_active":"2023-12-24T18:51:20.798544+0000","last_became_peered":"2023-12-24T18:51:20.798544+0000","last_unstale":"2023-12-24T18:51:21.823033+0000","last_undegraded":"2023-12-24T18:51:21.823033+0000","last_fullsized":"2023-12-24T18:51:21.823033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826098+0000","last_change":"2023-12-24T18:51:21.810131+0000","last_active":"2023-12-24T18:51:21.826098+0000","last_peered":"2023-12-24T18:51:21.826098+0000","last_clean":"2023-12-24T18:51:21.826098+0000","last_became_active":"2023-12-24T18:51:21.809525+0000","last_became_peered":"2023-12-24T18:51:21.809525+0000","last_unstale":"2023-12-24T18:51:21.826098+0000","last_undegraded":"2023-12-24T18:51:21.826098+0000","last_fullsized":"2023-12-24T18:51:21.826098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806347+0000","last_change":"2023-12-24T18:51:20.805863+0000","last_active":"2023-12-24T18:51:21.806347+0000","last_peered":"2023-12-24T18:51:21.806347+0000","last_clean":"2023-12-24T18:51:21.806347+0000","last_became_active":"2023-12-24T18:51:20.805505+0000","last_became_peered":"2023-12-24T18:51:20.805505+0000","last_unstale":"2023-12-24T18:51:21.806347+0000","last_undegraded":"2023-12-24T18:51:21.806347+0000","last_fullsized":"2023-12-24T18:51:21.806347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:21.236460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815682+0000","last_change":"2023-12-24T18:51:21.811172+0000","last_active":"2023-12-24T18:51:21.815682+0000","last_peered":"2023-12-24T18:51:21.815682+0000","last_clean":"2023-12-24T18:51:21.815682+0000","last_became_active":"2023-12-24T18:51:21.809843+0000","last_became_peered":"2023-12-24T18:51:21.809843+0000","last_unstale":"2023-12-24T18:51:21.815682+0000","last_undegraded":"2023-12-24T18:51:21.815682+0000","last_fullsized":"2023-12-24T18:51:21.815682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:36.662622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819717+0000","last_change":"2023-12-24T18:51:20.799302+0000","last_active":"2023-12-24T18:51:21.819717+0000","last_peered":"2023-12-24T18:51:21.819717+0000","last_clean":"2023-12-24T18:51:21.819717+0000","last_became_active":"2023-12-24T18:51:20.799011+0000","last_became_peered":"2023-12-24T18:51:20.799011+0000","last_unstale":"2023-12-24T18:51:21.819717+0000","last_undegraded":"2023-12-24T18:51:21.819717+0000","last_fullsized":"2023-12-24T18:51:21.819717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:51.755294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823338+0000","last_change":"2023-12-24T18:51:21.818274+0000","last_active":"2023-12-24T18:51:21.823338+0000","last_peered":"2023-12-24T18:51:21.823338+0000","last_clean":"2023-12-24T18:51:21.823338+0000","last_became_active":"2023-12-24T18:51:21.817981+0000","last_became_peered":"2023-12-24T18:51:21.817981+0000","last_unstale":"2023-12-24T18:51:21.823338+0000","last_undegraded":"2023-12-24T18:51:21.823338+0000","last_fullsized":"2023-12-24T18:51:21.823338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:00.886194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815461+0000","last_change":"2023-12-24T18:51:20.798149+0000","last_active":"2023-12-24T18:51:21.815461+0000","last_peered":"2023-12-24T18:51:21.815461+0000","last_clean":"2023-12-24T18:51:21.815461+0000","last_became_active":"2023-12-24T18:51:20.797835+0000","last_became_peered":"2023-12-24T18:51:20.797835+0000","last_unstale":"2023-12-24T18:51:21.815461+0000","last_undegraded":"2023-12-24T18:51:21.815461+0000","last_fullsized":"2023-12-24T18:51:21.815461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:34.090138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804820+0000","last_change":"2023-12-24T18:51:21.797085+0000","last_active":"2023-12-24T18:51:21.804820+0000","last_peered":"2023-12-24T18:51:21.804820+0000","last_clean":"2023-12-24T18:51:21.804820+0000","last_became_active":"2023-12-24T18:51:21.796784+0000","last_became_peered":"2023-12-24T18:51:21.796784+0000","last_unstale":"2023-12-24T18:51:21.804820+0000","last_undegraded":"2023-12-24T18:51:21.804820+0000","last_fullsized":"2023-12-24T18:51:21.804820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:26:15.942937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816419+0000","last_change":"2023-12-24T18:51:20.801016+0000","last_active":"2023-12-24T18:51:21.816419+0000","last_peered":"2023-12-24T18:51:21.816419+0000","last_clean":"2023-12-24T18:51:21.816419+0000","last_became_active":"2023-12-24T18:51:20.800722+0000","last_became_peered":"2023-12-24T18:51:20.800722+0000","last_unstale":"2023-12-24T18:51:21.816419+0000","last_undegraded":"2023-12-24T18:51:21.816419+0000","last_fullsized":"2023-12-24T18:51:21.816419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:49.537267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830093+0000","last_change":"2023-12-24T18:51:21.829091+0000","last_active":"2023-12-24T18:51:21.830093+0000","last_peered":"2023-12-24T18:51:21.830093+0000","last_clean":"2023-12-24T18:51:21.830093+0000","last_became_active":"2023-12-24T18:51:21.828800+0000","last_became_peered":"2023-12-24T18:51:21.828800+0000","last_unstale":"2023-12-24T18:51:21.830093+0000","last_undegraded":"2023-12-24T18:51:21.830093+0000","last_fullsized":"2023-12-24T18:51:21.830093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816803+0000","last_change":"2023-12-24T18:51:20.795608+0000","last_active":"2023-12-24T18:51:21.816803+0000","last_peered":"2023-12-24T18:51:21.816803+0000","last_clean":"2023-12-24T18:51:21.816803+0000","last_became_active":"2023-12-24T18:51:20.795091+0000","last_became_peered":"2023-12-24T18:51:20.795091+0000","last_unstale":"2023-12-24T18:51:21.816803+0000","last_undegraded":"2023-12-24T18:51:21.816803+0000","last_fullsized":"2023-12-24T18:51:21.816803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:33.654937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812706+0000","last_change":"2023-12-24T18:51:21.803121+0000","last_active":"2023-12-24T18:51:21.812706+0000","last_peered":"2023-12-24T18:51:21.812706+0000","last_clean":"2023-12-24T18:51:21.812706+0000","last_became_active":"2023-12-24T18:51:21.802824+0000","last_became_peered":"2023-12-24T18:51:21.802824+0000","last_unstale":"2023-12-24T18:51:21.812706+0000","last_undegraded":"2023-12-24T18:51:21.812706+0000","last_fullsized":"2023-12-24T18:51:21.812706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:51.275038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787040+0000","last_change":"2023-12-24T18:51:20.801342+0000","last_active":"2023-12-24T18:51:21.787040+0000","last_peered":"2023-12-24T18:51:21.787040+0000","last_clean":"2023-12-24T18:51:21.787040+0000","last_became_active":"2023-12-24T18:51:20.796984+0000","last_became_peered":"2023-12-24T18:51:20.796984+0000","last_unstale":"2023-12-24T18:51:21.787040+0000","last_undegraded":"2023-12-24T18:51:21.787040+0000","last_fullsized":"2023-12-24T18:51:21.787040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:28.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804843+0000","last_change":"2023-12-24T18:51:21.801636+0000","last_active":"2023-12-24T18:51:21.804843+0000","last_peered":"2023-12-24T18:51:21.804843+0000","last_clean":"2023-12-24T18:51:21.804843+0000","last_became_active":"2023-12-24T18:51:21.801356+0000","last_became_peered":"2023-12-24T18:51:21.801356+0000","last_unstale":"2023-12-24T18:51:21.804843+0000","last_undegraded":"2023-12-24T18:51:21.804843+0000","last_fullsized":"2023-12-24T18:51:21.804843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:37.573190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.788157+0000","last_change":"2023-12-24T18:51:20.799261+0000","last_active":"2023-12-24T18:51:21.788157+0000","last_peered":"2023-12-24T18:51:21.788157+0000","last_clean":"2023-12-24T18:51:21.788157+0000","last_became_active":"2023-12-24T18:51:20.797187+0000","last_became_peered":"2023-12-24T18:51:20.797187+0000","last_unstale":"2023-12-24T18:51:21.788157+0000","last_undegraded":"2023-12-24T18:51:21.788157+0000","last_fullsized":"2023-12-24T18:51:21.788157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:55:33.831411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.813264+0000","last_change":"2023-12-24T18:51:21.806185+0000","last_active":"2023-12-24T18:51:21.813264+0000","last_peered":"2023-12-24T18:51:21.813264+0000","last_clean":"2023-12-24T18:51:21.813264+0000","last_became_active":"2023-12-24T18:51:21.805835+0000","last_became_peered":"2023-12-24T18:51:21.805835+0000","last_unstale":"2023-12-24T18:51:21.813264+0000","last_undegraded":"2023-12-24T18:51:21.813264+0000","last_fullsized":"2023-12-24T18:51:21.813264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810950+0000","last_change":"2023-12-24T18:51:20.799268+0000","last_active":"2023-12-24T18:51:21.810950+0000","last_peered":"2023-12-24T18:51:21.810950+0000","last_clean":"2023-12-24T18:51:21.810950+0000","last_became_active":"2023-12-24T18:51:20.798656+0000","last_became_peered":"2023-12-24T18:51:20.798656+0000","last_unstale":"2023-12-24T18:51:21.810950+0000","last_undegraded":"2023-12-24T18:51:21.810950+0000","last_fullsized":"2023-12-24T18:51:21.810950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814664+0000","last_change":"2023-12-24T18:51:21.812241+0000","last_active":"2023-12-24T18:51:21.814664+0000","last_peered":"2023-12-24T18:51:21.814664+0000","last_clean":"2023-12-24T18:51:21.814664+0000","last_became_active":"2023-12-24T18:51:21.811946+0000","last_became_peered":"2023-12-24T18:51:21.811946+0000","last_unstale":"2023-12-24T18:51:21.814664+0000","last_undegraded":"2023-12-24T18:51:21.814664+0000","last_fullsized":"2023-12-24T18:51:21.814664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:42.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.783186+0000","last_change":"2023-12-24T18:51:20.797775+0000","last_active":"2023-12-24T18:51:21.783186+0000","last_peered":"2023-12-24T18:51:21.783186+0000","last_clean":"2023-12-24T18:51:21.783186+0000","last_became_active":"2023-12-24T18:51:20.797521+0000","last_became_peered":"2023-12-24T18:51:20.797521+0000","last_unstale":"2023-12-24T18:51:21.783186+0000","last_undegraded":"2023-12-24T18:51:21.783186+0000","last_fullsized":"2023-12-24T18:51:21.783186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812907+0000","last_change":"2023-12-24T18:51:21.806668+0000","last_active":"2023-12-24T18:51:21.812907+0000","last_peered":"2023-12-24T18:51:21.812907+0000","last_clean":"2023-12-24T18:51:21.812907+0000","last_became_active":"2023-12-24T18:51:21.806344+0000","last_became_peered":"2023-12-24T18:51:21.806344+0000","last_unstale":"2023-12-24T18:51:21.812907+0000","last_undegraded":"2023-12-24T18:51:21.812907+0000","last_fullsized":"2023-12-24T18:51:21.812907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:53.149173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821823+0000","last_change":"2023-12-24T18:51:20.796308+0000","last_active":"2023-12-24T18:51:21.821823+0000","last_peered":"2023-12-24T18:51:21.821823+0000","last_clean":"2023-12-24T18:51:21.821823+0000","last_became_active":"2023-12-24T18:51:20.796033+0000","last_became_peered":"2023-12-24T18:51:20.796033+0000","last_unstale":"2023-12-24T18:51:21.821823+0000","last_undegraded":"2023-12-24T18:51:21.821823+0000","last_fullsized":"2023-12-24T18:51:21.821823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805819+0000","last_change":"2023-12-24T18:51:21.797143+0000","last_active":"2023-12-24T18:51:21.805819+0000","last_peered":"2023-12-24T18:51:21.805819+0000","last_clean":"2023-12-24T18:51:21.805819+0000","last_became_active":"2023-12-24T18:51:21.795899+0000","last_became_peered":"2023-12-24T18:51:21.795899+0000","last_unstale":"2023-12-24T18:51:21.805819+0000","last_undegraded":"2023-12-24T18:51:21.805819+0000","last_fullsized":"2023-12-24T18:51:21.805819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:11.668152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'6","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.832629+0000","last_change":"2023-12-24T18:51:20.801730+0000","last_active":"2023-12-24T18:51:21.832629+0000","last_peered":"2023-12-24T18:51:21.832629+0000","last_clean":"2023-12-24T18:51:21.832629+0000","last_became_active":"2023-12-24T18:51:20.800473+0000","last_became_peered":"2023-12-24T18:51:20.800473+0000","last_unstale":"2023-12-24T18:51:21.832629+0000","last_undegraded":"2023-12-24T18:51:21.832629+0000","last_fullsized":"2023-12-24T18:51:21.832629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826474+0000","last_change":"2023-12-24T18:51:21.820977+0000","last_active":"2023-12-24T18:51:21.826474+0000","last_peered":"2023-12-24T18:51:21.826474+0000","last_clean":"2023-12-24T18:51:21.826474+0000","last_became_active":"2023-12-24T18:51:21.818241+0000","last_became_peered":"2023-12-24T18:51:21.818241+0000","last_unstale":"2023-12-24T18:51:21.826474+0000","last_undegraded":"2023-12-24T18:51:21.826474+0000","last_fullsized":"2023-12-24T18:51:21.826474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820347+0000","last_change":"2023-12-24T18:51:20.800176+0000","last_active":"2023-12-24T18:51:21.820347+0000","last_peered":"2023-12-24T18:51:21.820347+0000","last_clean":"2023-12-24T18:51:21.820347+0000","last_became_active":"2023-12-24T18:51:20.799887+0000","last_became_peered":"2023-12-24T18:51:20.799887+0000","last_unstale":"2023-12-24T18:51:21.820347+0000","last_undegraded":"2023-12-24T18:51:21.820347+0000","last_fullsized":"2023-12-24T18:51:21.820347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:03.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815988+0000","last_change":"2023-12-24T18:51:21.804426+0000","last_active":"2023-12-24T18:51:21.815988+0000","last_peered":"2023-12-24T18:51:21.815988+0000","last_clean":"2023-12-24T18:51:21.815988+0000","last_became_active":"2023-12-24T18:51:21.804188+0000","last_became_peered":"2023-12-24T18:51:21.804188+0000","last_unstale":"2023-12-24T18:51:21.815988+0000","last_undegraded":"2023-12-24T18:51:21.815988+0000","last_fullsized":"2023-12-24T18:51:21.815988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:01:45.952397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795490+0000","last_change":"2023-12-24T18:51:20.793803+0000","last_active":"2023-12-24T18:51:21.795490+0000","last_peered":"2023-12-24T18:51:21.795490+0000","last_clean":"2023-12-24T18:51:21.795490+0000","last_became_active":"2023-12-24T18:51:20.793511+0000","last_became_peered":"2023-12-24T18:51:20.793511+0000","last_unstale":"2023-12-24T18:51:21.795490+0000","last_undegraded":"2023-12-24T18:51:21.795490+0000","last_fullsized":"2023-12-24T18:51:21.795490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:51.391869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798434+0000","last_change":"2023-12-24T18:51:21.796751+0000","last_active":"2023-12-24T18:51:21.798434+0000","last_peered":"2023-12-24T18:51:21.798434+0000","last_clean":"2023-12-24T18:51:21.798434+0000","last_became_active":"2023-12-24T18:51:21.796428+0000","last_became_peered":"2023-12-24T18:51:21.796428+0000","last_unstale":"2023-12-24T18:51:21.798434+0000","last_undegraded":"2023-12-24T18:51:21.798434+0000","last_fullsized":"2023-12-24T18:51:21.798434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:46.461772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810290+0000","last_change":"2023-12-24T18:51:20.795592+0000","last_active":"2023-12-24T18:51:21.810290+0000","last_peered":"2023-12-24T18:51:21.810290+0000","last_clean":"2023-12-24T18:51:21.810290+0000","last_became_active":"2023-12-24T18:51:20.794829+0000","last_became_peered":"2023-12-24T18:51:20.794829+0000","last_unstale":"2023-12-24T18:51:21.810290+0000","last_undegraded":"2023-12-24T18:51:21.810290+0000","last_fullsized":"2023-12-24T18:51:21.810290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820598+0000","last_change":"2023-12-24T18:51:21.818722+0000","last_active":"2023-12-24T18:51:21.820598+0000","last_peered":"2023-12-24T18:51:21.820598+0000","last_clean":"2023-12-24T18:51:21.820598+0000","last_became_active":"2023-12-24T18:51:21.818412+0000","last_became_peered":"2023-12-24T18:51:21.818412+0000","last_unstale":"2023-12-24T18:51:21.820598+0000","last_undegraded":"2023-12-24T18:51:21.820598+0000","last_fullsized":"2023-12-24T18:51:21.820598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'8","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823505+0000","last_change":"2023-12-24T18:51:20.795854+0000","last_active":"2023-12-24T18:51:21.823505+0000","last_peered":"2023-12-24T18:51:21.823505+0000","last_clean":"2023-12-24T18:51:21.823505+0000","last_became_active":"2023-12-24T18:51:20.795547+0000","last_became_peered":"2023-12-24T18:51:20.795547+0000","last_unstale":"2023-12-24T18:51:21.823505+0000","last_undegraded":"2023-12-24T18:51:21.823505+0000","last_fullsized":"2023-12-24T18:51:21.823505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828564+0000","last_change":"2023-12-24T18:51:21.827156+0000","last_active":"2023-12-24T18:51:21.828564+0000","last_peered":"2023-12-24T18:51:21.828564+0000","last_clean":"2023-12-24T18:51:21.828564+0000","last_became_active":"2023-12-24T18:51:21.826804+0000","last_became_peered":"2023-12-24T18:51:21.826804+0000","last_unstale":"2023-12-24T18:51:21.828564+0000","last_undegraded":"2023-12-24T18:51:21.828564+0000","last_fullsized":"2023-12-24T18:51:21.828564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816079+0000","last_change":"2023-12-24T18:51:20.794130+0000","last_active":"2023-12-24T18:51:21.816079+0000","last_peered":"2023-12-24T18:51:21.816079+0000","last_clean":"2023-12-24T18:51:21.816079+0000","last_became_active":"2023-12-24T18:51:20.793857+0000","last_became_peered":"2023-12-24T18:51:20.793857+0000","last_unstale":"2023-12-24T18:51:21.816079+0000","last_undegraded":"2023-12-24T18:51:21.816079+0000","last_fullsized":"2023-12-24T18:51:21.816079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:10.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.809314+0000","last_change":"2023-12-24T18:51:21.800501+0000","last_active":"2023-12-24T18:51:21.809314+0000","last_peered":"2023-12-24T18:51:21.809314+0000","last_clean":"2023-12-24T18:51:21.809314+0000","last_became_active":"2023-12-24T18:51:21.800202+0000","last_became_peered":"2023-12-24T18:51:21.800202+0000","last_unstale":"2023-12-24T18:51:21.809314+0000","last_undegraded":"2023-12-24T18:51:21.809314+0000","last_fullsized":"2023-12-24T18:51:21.809314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:57.225140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826820+0000","last_change":"2023-12-24T18:51:20.796568+0000","last_active":"2023-12-24T18:51:21.826820+0000","last_peered":"2023-12-24T18:51:21.826820+0000","last_clean":"2023-12-24T18:51:21.826820+0000","last_became_active":"2023-12-24T18:51:20.795623+0000","last_became_peered":"2023-12-24T18:51:20.795623+0000","last_unstale":"2023-12-24T18:51:21.826820+0000","last_undegraded":"2023-12-24T18:51:21.826820+0000","last_fullsized":"2023-12-24T18:51:21.826820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825999+0000","last_change":"2023-12-24T18:51:21.808110+0000","last_active":"2023-12-24T18:51:21.825999+0000","last_peered":"2023-12-24T18:51:21.825999+0000","last_clean":"2023-12-24T18:51:21.825999+0000","last_became_active":"2023-12-24T18:51:21.807795+0000","last_became_peered":"2023-12-24T18:51:21.807795+0000","last_unstale":"2023-12-24T18:51:21.825999+0000","last_undegraded":"2023-12-24T18:51:21.825999+0000","last_fullsized":"2023-12-24T18:51:21.825999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819954+0000","last_change":"2023-12-24T18:51:20.798695+0000","last_active":"2023-12-24T18:51:21.819954+0000","last_peered":"2023-12-24T18:51:21.819954+0000","last_clean":"2023-12-24T18:51:21.819954+0000","last_became_active":"2023-12-24T18:51:20.796324+0000","last_became_peered":"2023-12-24T18:51:20.796324+0000","last_unstale":"2023-12-24T18:51:21.819954+0000","last_undegraded":"2023-12-24T18:51:21.819954+0000","last_fullsized":"2023-12-24T18:51:21.819954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:50.256113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816876+0000","last_change":"2023-12-24T18:51:21.810400+0000","last_active":"2023-12-24T18:51:21.816876+0000","last_peered":"2023-12-24T18:51:21.816876+0000","last_clean":"2023-12-24T18:51:21.816876+0000","last_became_active":"2023-12-24T18:51:21.804997+0000","last_became_peered":"2023-12-24T18:51:21.804997+0000","last_unstale":"2023-12-24T18:51:21.816876+0000","last_undegraded":"2023-12-24T18:51:21.816876+0000","last_fullsized":"2023-12-24T18:51:21.816876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:40.264126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787219+0000","last_change":"2023-12-24T18:51:20.791815+0000","last_active":"2023-12-24T18:51:21.787219+0000","last_peered":"2023-12-24T18:51:21.787219+0000","last_clean":"2023-12-24T18:51:21.787219+0000","last_became_active":"2023-12-24T18:51:20.791134+0000","last_became_peered":"2023-12-24T18:51:20.791134+0000","last_unstale":"2023-12-24T18:51:21.787219+0000","last_undegraded":"2023-12-24T18:51:21.787219+0000","last_fullsized":"2023-12-24T18:51:21.787219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:32.995781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804423+0000","last_change":"2023-12-24T18:51:21.799154+0000","last_active":"2023-12-24T18:51:21.804423+0000","last_peered":"2023-12-24T18:51:21.804423+0000","last_clean":"2023-12-24T18:51:21.804423+0000","last_became_active":"2023-12-24T18:51:21.798814+0000","last_became_peered":"2023-12-24T18:51:21.798814+0000","last_unstale":"2023-12-24T18:51:21.804423+0000","last_undegraded":"2023-12-24T18:51:21.804423+0000","last_fullsized":"2023-12-24T18:51:21.804423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:50.556192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.808097+0000","last_change":"2023-12-24T18:51:20.801286+0000","last_active":"2023-12-24T18:51:21.808097+0000","last_peered":"2023-12-24T18:51:21.808097+0000","last_clean":"2023-12-24T18:51:21.808097+0000","last_became_active":"2023-12-24T18:51:20.800996+0000","last_became_peered":"2023-12-24T18:51:20.800996+0000","last_unstale":"2023-12-24T18:51:21.808097+0000","last_undegraded":"2023-12-24T18:51:21.808097+0000","last_fullsized":"2023-12-24T18:51:21.808097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:27.237655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816008+0000","last_change":"2023-12-24T18:51:21.805580+0000","last_active":"2023-12-24T18:51:21.816008+0000","last_peered":"2023-12-24T18:51:21.816008+0000","last_clean":"2023-12-24T18:51:21.816008+0000","last_became_active":"2023-12-24T18:51:21.804008+0000","last_became_peered":"2023-12-24T18:51:21.804008+0000","last_unstale":"2023-12-24T18:51:21.816008+0000","last_undegraded":"2023-12-24T18:51:21.816008+0000","last_fullsized":"2023-12-24T18:51:21.816008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:28.256580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795604+0000","last_change":"2023-12-24T18:51:20.794817+0000","last_active":"2023-12-24T18:51:21.795604+0000","last_peered":"2023-12-24T18:51:21.795604+0000","last_clean":"2023-12-24T18:51:21.795604+0000","last_became_active":"2023-12-24T18:51:20.794467+0000","last_became_peered":"2023-12-24T18:51:20.794467+0000","last_unstale":"2023-12-24T18:51:21.795604+0000","last_undegraded":"2023-12-24T18:51:21.795604+0000","last_fullsized":"2023-12-24T18:51:21.795604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:02:41.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812686+0000","last_change":"2023-12-24T18:51:21.802498+0000","last_active":"2023-12-24T18:51:21.812686+0000","last_peered":"2023-12-24T18:51:21.812686+0000","last_clean":"2023-12-24T18:51:21.812686+0000","last_became_active":"2023-12-24T18:51:21.801035+0000","last_became_peered":"2023-12-24T18:51:21.801035+0000","last_unstale":"2023-12-24T18:51:21.812686+0000","last_undegraded":"2023-12-24T18:51:21.812686+0000","last_fullsized":"2023-12-24T18:51:21.812686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:08:09.546970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.796474+0000","last_change":"2023-12-24T18:51:20.804643+0000","last_active":"2023-12-24T18:51:21.796474+0000","last_peered":"2023-12-24T18:51:21.796474+0000","last_clean":"2023-12-24T18:51:21.796474+0000","last_became_active":"2023-12-24T18:51:20.804341+0000","last_became_peered":"2023-12-24T18:51:20.804341+0000","last_unstale":"2023-12-24T18:51:21.796474+0000","last_undegraded":"2023-12-24T18:51:21.796474+0000","last_fullsized":"2023-12-24T18:51:21.796474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:58.705231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822021+0000","last_change":"2023-12-24T18:51:21.821178+0000","last_active":"2023-12-24T18:51:21.822021+0000","last_peered":"2023-12-24T18:51:21.822021+0000","last_clean":"2023-12-24T18:51:21.822021+0000","last_became_active":"2023-12-24T18:51:21.820835+0000","last_became_peered":"2023-12-24T18:51:21.820835+0000","last_unstale":"2023-12-24T18:51:21.822021+0000","last_undegraded":"2023-12-24T18:51:21.822021+0000","last_fullsized":"2023-12-24T18:51:21.822021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:34.673863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815997+0000","last_change":"2023-12-24T18:51:20.792138+0000","last_active":"2023-12-24T18:51:21.815997+0000","last_peered":"2023-12-24T18:51:21.815997+0000","last_clean":"2023-12-24T18:51:21.815997+0000","last_became_active":"2023-12-24T18:51:20.791834+0000","last_became_peered":"2023-12-24T18:51:20.791834+0000","last_unstale":"2023-12-24T18:51:21.815997+0000","last_undegraded":"2023-12-24T18:51:21.815997+0000","last_fullsized":"2023-12-24T18:51:21.815997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:34.490587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812210+0000","last_change":"2023-12-24T18:51:21.806603+0000","last_active":"2023-12-24T18:51:21.812210+0000","last_peered":"2023-12-24T18:51:21.812210+0000","last_clean":"2023-12-24T18:51:21.812210+0000","last_became_active":"2023-12-24T18:51:21.806278+0000","last_became_peered":"2023-12-24T18:51:21.806278+0000","last_unstale":"2023-12-24T18:51:21.812210+0000","last_undegraded":"2023-12-24T18:51:21.812210+0000","last_fullsized":"2023-12-24T18:51:21.812210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:19.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.796327+0000","last_change":"2023-12-24T18:51:20.786762+0000","last_active":"2023-12-24T18:51:21.796327+0000","last_peered":"2023-12-24T18:51:21.796327+0000","last_clean":"2023-12-24T18:51:21.796327+0000","last_became_active":"2023-12-24T18:51:20.786201+0000","last_became_peered":"2023-12-24T18:51:20.786201+0000","last_unstale":"2023-12-24T18:51:21.796327+0000","last_undegraded":"2023-12-24T18:51:21.796327+0000","last_fullsized":"2023-12-24T18:51:21.796327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:08.896817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816846+0000","last_change":"2023-12-24T18:51:21.805091+0000","last_active":"2023-12-24T18:51:21.816846+0000","last_peered":"2023-12-24T18:51:21.816846+0000","last_clean":"2023-12-24T18:51:21.816846+0000","last_became_active":"2023-12-24T18:51:21.804789+0000","last_became_peered":"2023-12-24T18:51:21.804789+0000","last_unstale":"2023-12-24T18:51:21.816846+0000","last_undegraded":"2023-12-24T18:51:21.816846+0000","last_fullsized":"2023-12-24T18:51:21.816846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:11.577979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800246+0000","last_change":"2023-12-24T18:51:20.800325+0000","last_active":"2023-12-24T18:51:21.800246+0000","last_peered":"2023-12-24T18:51:21.800246+0000","last_clean":"2023-12-24T18:51:21.800246+0000","last_became_active":"2023-12-24T18:51:20.799937+0000","last_became_peered":"2023-12-24T18:51:20.799937+0000","last_unstale":"2023-12-24T18:51:21.800246+0000","last_undegraded":"2023-12-24T18:51:21.800246+0000","last_fullsized":"2023-12-24T18:51:21.800246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:42.005965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815532+0000","last_change":"2023-12-24T18:51:21.805172+0000","last_active":"2023-12-24T18:51:21.815532+0000","last_peered":"2023-12-24T18:51:21.815532+0000","last_clean":"2023-12-24T18:51:21.815532+0000","last_became_active":"2023-12-24T18:51:21.804860+0000","last_became_peered":"2023-12-24T18:51:21.804860+0000","last_unstale":"2023-12-24T18:51:21.815532+0000","last_undegraded":"2023-12-24T18:51:21.815532+0000","last_fullsized":"2023-12-24T18:51:21.815532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:24.570402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805302+0000","last_change":"2023-12-24T18:51:20.800807+0000","last_active":"2023-12-24T18:51:21.805302+0000","last_peered":"2023-12-24T18:51:21.805302+0000","last_clean":"2023-12-24T18:51:21.805302+0000","last_became_active":"2023-12-24T18:51:20.800021+0000","last_became_peered":"2023-12-24T18:51:20.800021+0000","last_unstale":"2023-12-24T18:51:21.805302+0000","last_undegraded":"2023-12-24T18:51:21.805302+0000","last_fullsized":"2023-12-24T18:51:21.805302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806406+0000","last_change":"2023-12-24T18:51:21.799830+0000","last_active":"2023-12-24T18:51:21.806406+0000","last_peered":"2023-12-24T18:51:21.806406+0000","last_clean":"2023-12-24T18:51:21.806406+0000","last_became_active":"2023-12-24T18:51:21.799513+0000","last_became_peered":"2023-12-24T18:51:21.799513+0000","last_unstale":"2023-12-24T18:51:21.806406+0000","last_undegraded":"2023-12-24T18:51:21.806406+0000","last_fullsized":"2023-12-24T18:51:21.806406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:27.608666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814015+0000","last_change":"2023-12-24T18:51:20.795218+0000","last_active":"2023-12-24T18:51:21.814015+0000","last_peered":"2023-12-24T18:51:21.814015+0000","last_clean":"2023-12-24T18:51:21.814015+0000","last_became_active":"2023-12-24T18:51:20.794894+0000","last_became_peered":"2023-12-24T18:51:20.794894+0000","last_unstale":"2023-12-24T18:51:21.814015+0000","last_undegraded":"2023-12-24T18:51:21.814015+0000","last_fullsized":"2023-12-24T18:51:21.814015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826633+0000","last_change":"2023-12-24T18:51:21.820648+0000","last_active":"2023-12-24T18:51:21.826633+0000","last_peered":"2023-12-24T18:51:21.826633+0000","last_clean":"2023-12-24T18:51:21.826633+0000","last_became_active":"2023-12-24T18:51:21.820365+0000","last_became_peered":"2023-12-24T18:51:21.820365+0000","last_unstale":"2023-12-24T18:51:21.826633+0000","last_undegraded":"2023-12-24T18:51:21.826633+0000","last_fullsized":"2023-12-24T18:51:21.826633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:22.978393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787304+0000","last_change":"2023-12-24T18:51:20.795379+0000","last_active":"2023-12-24T18:51:21.787304+0000","last_peered":"2023-12-24T18:51:21.787304+0000","last_clean":"2023-12-24T18:51:21.787304+0000","last_became_active":"2023-12-24T18:51:20.794763+0000","last_became_peered":"2023-12-24T18:51:20.794763+0000","last_unstale":"2023-12-24T18:51:21.787304+0000","last_undegraded":"2023-12-24T18:51:21.787304+0000","last_fullsized":"2023-12-24T18:51:21.787304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:46.484178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830962+0000","last_change":"2023-12-24T18:51:21.830222+0000","last_active":"2023-12-24T18:51:21.830962+0000","last_peered":"2023-12-24T18:51:21.830962+0000","last_clean":"2023-12-24T18:51:21.830962+0000","last_became_active":"2023-12-24T18:51:21.829914+0000","last_became_peered":"2023-12-24T18:51:21.829914+0000","last_unstale":"2023-12-24T18:51:21.830962+0000","last_undegraded":"2023-12-24T18:51:21.830962+0000","last_fullsized":"2023-12-24T18:51:21.830962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787204+0000","last_change":"2023-12-24T18:51:20.797264+0000","last_active":"2023-12-24T18:51:21.787204+0000","last_peered":"2023-12-24T18:51:21.787204+0000","last_clean":"2023-12-24T18:51:21.787204+0000","last_became_active":"2023-12-24T18:51:20.796622+0000","last_became_peered":"2023-12-24T18:51:20.796622+0000","last_unstale":"2023-12-24T18:51:21.787204+0000","last_undegraded":"2023-12-24T18:51:21.787204+0000","last_fullsized":"2023-12-24T18:51:21.787204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:17.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825231+0000","last_change":"2023-12-24T18:51:21.823379+0000","last_active":"2023-12-24T18:51:21.825231+0000","last_peered":"2023-12-24T18:51:21.825231+0000","last_clean":"2023-12-24T18:51:21.825231+0000","last_became_active":"2023-12-24T18:51:21.822915+0000","last_became_peered":"2023-12-24T18:51:21.822915+0000","last_unstale":"2023-12-24T18:51:21.825231+0000","last_undegraded":"2023-12-24T18:51:21.825231+0000","last_fullsized":"2023-12-24T18:51:21.825231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:40.383017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798113+0000","last_change":"2023-12-24T18:51:20.800223+0000","last_active":"2023-12-24T18:51:21.798113+0000","last_peered":"2023-12-24T18:51:21.798113+0000","last_clean":"2023-12-24T18:51:21.798113+0000","last_became_active":"2023-12-24T18:51:20.797749+0000","last_became_peered":"2023-12-24T18:51:20.797749+0000","last_unstale":"2023-12-24T18:51:21.798113+0000","last_undegraded":"2023-12-24T18:51:21.798113+0000","last_fullsized":"2023-12-24T18:51:21.798113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:42.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812812+0000","last_change":"2023-12-24T18:51:21.803735+0000","last_active":"2023-12-24T18:51:21.812812+0000","last_peered":"2023-12-24T18:51:21.812812+0000","last_clean":"2023-12-24T18:51:21.812812+0000","last_became_active":"2023-12-24T18:51:21.803444+0000","last_became_peered":"2023-12-24T18:51:21.803444+0000","last_unstale":"2023-12-24T18:51:21.812812+0000","last_undegraded":"2023-12-24T18:51:21.812812+0000","last_fullsized":"2023-12-24T18:51:21.812812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:21:22.617491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.786484+0000","last_change":"2023-12-24T18:51:20.803474+0000","last_active":"2023-12-24T18:51:21.786484+0000","last_peered":"2023-12-24T18:51:21.786484+0000","last_clean":"2023-12-24T18:51:21.786484+0000","last_became_active":"2023-12-24T18:51:20.803145+0000","last_became_peered":"2023-12-24T18:51:20.803145+0000","last_unstale":"2023-12-24T18:51:21.786484+0000","last_undegraded":"2023-12-24T18:51:21.786484+0000","last_fullsized":"2023-12-24T18:51:21.786484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:35.643697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"73'161","reported_seq":372,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810576+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:21.810576+0000","last_peered":"2023-12-24T18:51:21.810576+0000","last_clean":"2023-12-24T18:51:21.810576+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:21.810576+0000","last_undegraded":"2023-12-24T18:51:21.810576+0000","last_fullsized":"2023-12-24T18:51:21.810576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311156,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060684,"statfs":{"total":96636764160,"available":96318140416,"internally_reserved":0,"allocated":1617920,"data_stored":1096516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.81100000000000005,"5min":0.746,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.21},{"interface":"front","average":{"1min":1.258,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.95899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6339999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.1659999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1279999999999999,"15min":1.1439999999999999},"min":{"1min":0.88800000000000001,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4850000000000001,"5min":1.5389999999999999,"15min":1.669},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2,"15min":1.222},"min":{"1min":0.96499999999999997,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.625,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.236,"15min":1.214},"min":{"1min":0.94299999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5620000000000001,"5min":1.625,"15min":1.704},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.24,"15min":1.236},"min":{"1min":0.98699999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.595,"5min":1.6799999999999999,"15min":1.893},"last":0.90300000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0609999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.024},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.284,"15min":1.3080000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.623,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.258}]},{"osd":4,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1879999999999999,"15min":1.1950000000000001},"min":{"1min":0.88700000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.2430000000000001,"15min":1.2789999999999999},"min":{"1min":0.876,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6599999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.998}]},{"osd":5,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2709999999999999,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.331,"15min":1.351},"min":{"1min":1.01,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.8380000000000001,"5min":1.9590000000000001,"15min":2.403},"last":1.3300000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.409,"15min":1.429},"min":{"1min":1.05,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9259999999999999,"5min":1.956,"15min":2.4889999999999999},"last":1.083},{"interface":"front","average":{"1min":1.444,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":0.98599999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.2069999999999999},"last":1.4570000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306468,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065372,"statfs":{"total":96636764160,"available":96322940928,"internally_reserved":0,"allocated":1011712,"data_stored":505434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.232}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":1.349}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":1.419}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.129}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.202},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":1.6140000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":1.27},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.5289999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1011712,"data_stored":505422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.177,"15min":1.1850000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.752},"last":1.133},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3049999999999999,"15min":1.3029999999999999},"min":{"1min":0.876,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.839,"5min":1.839,"15min":2.73},"last":1.2849999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1100000000000001,"15min":1.139},"min":{"1min":0.75600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1599999999999999,"15min":1.1379999999999999},"min":{"1min":0.85199999999999998,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.53900000000000003},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.486},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.2230000000000001},"min":{"1min":0.96899999999999997,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.361}]},{"osd":3,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.292,"15min":1.2669999999999999},"min":{"1min":0.876,"5min":0.86699999999999999,"15min":0.82399999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.101},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3029999999999999,"15min":1.3},"min":{"1min":1.0149999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.639,"5min":1.786,"15min":2.1389999999999998},"last":1.6459999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1519999999999999,"15min":1.1339999999999999},"min":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.607,"5min":1.633,"15min":2.202},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.294,"5min":1.266,"15min":1.256},"min":{"1min":0.85399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2509999999999999,"15min":1.2829999999999999},"min":{"1min":0.82199999999999995,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":2.3959999999999999},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.29,"15min":1.3029999999999999},"min":{"1min":0.93999999999999995,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.611,"5min":1.724,"15min":2.6280000000000001},"last":1.089}]},{"osd":7,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.403,"15min":1.403},"min":{"1min":1.022,"5min":0.88,"15min":0.872},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.879},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.397,"15min":1.415},"min":{"1min":1.151,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.889,"5min":1.911,"15min":2.2429999999999999},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":506936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.81399999999999995,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.6000000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.232,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.609,"5min":1.621,"15min":1.6879999999999999},"last":1.4790000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.1459999999999999},"min":{"1min":0.871,"5min":0.73199999999999998,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.589,"15min":1.9830000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1519999999999999,"15min":1.125},"min":{"1min":0.879,"5min":0.76200000000000001,"15min":0.48799999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.165}]},{"osd":2,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3200000000000001,"15min":1.298},"min":{"1min":1.175,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":1.798},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.329,"15min":1.3120000000000001},"min":{"1min":1.2110000000000001,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6519999999999999,"5min":1.748,"15min":1.748},"last":1.506}]},{"osd":3,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.179,"15min":1.1699999999999999},"min":{"1min":1.05,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.6830000000000001,"5min":1.714,"15min":1.736},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.93100000000000005,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.839},"last":1.522}]},{"osd":5,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.2829999999999999,"15min":1.252},"min":{"1min":1.105,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":1.744,"5min":1.837,"15min":1.837},"last":0.876},{"interface":"front","average":{"1min":1.47,"5min":1.3200000000000001,"15min":1.3049999999999999},"min":{"1min":1.262,"5min":0.623,"15min":0.623},"max":{"1min":1.7789999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.3520000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.274},"min":{"1min":0.94099999999999995,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.823,"5min":1.823,"15min":1.881},"last":1.26},{"interface":"front","average":{"1min":1.413,"5min":1.3500000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.829,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3160000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.319,"15min":1.292},"min":{"1min":1.133,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.161},"last":1.587},{"interface":"front","average":{"1min":1.494,"5min":1.4079999999999999,"15min":1.399},"min":{"1min":1.1180000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.9359999999999999},"last":1.6890000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97699999999999998,"15min":0.95999999999999996},"min":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.4099999999999999,"5min":1.577,"15min":1.5980000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1200000000000001,"15min":1.056},"min":{"1min":0.74299999999999999,"5min":0.65500000000000003,"15min":0.46000000000000002},"max":{"1min":1.417,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.42999999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.204,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.871,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5269999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.077,"15min":1.097},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1859999999999999,"15min":1.177},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.875},"last":0.754}]},{"osd":4,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.262,"15min":1.244},"min":{"1min":0.91500000000000004,"5min":0.82199999999999995,"15min":0.64600000000000002},"max":{"1min":1.6120000000000001,"5min":1.7609999999999999,"15min":1.766},"last":1.45},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.345,"15min":1.343},"min":{"1min":1.167,"5min":0.96499999999999997,"15min":0.66300000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.9710000000000001},"last":1.115}]},{"osd":5,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.782,"5min":1.837,"15min":2.1739999999999999},"last":1.381},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":1.0289999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.1539999999999999},"last":1.4850000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":1.1859999999999999,"5min":1.153,"15min":0.92200000000000004},"max":{"1min":2.0579999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.431,"15min":1.419},"min":{"1min":0.98799999999999999,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7529999999999999,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":1.149}]},{"osd":7,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.488,"15min":1.47},"min":{"1min":1.0700000000000001,"5min":1.0620000000000001,"15min":0.79500000000000004},"max":{"1min":1.7370000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.337},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5149999999999999,"15min":1.518},"min":{"1min":1.103,"5min":1.103,"15min":0.85799999999999998},"max":{"1min":1.7350000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.228}]}]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310560,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061280,"statfs":{"total":96636764160,"available":96318750720,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91700000000000004,"15min":0.94199999999999995},"min":{"1min":0.61499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2110000000000001,"5min":1.411,"15min":1.8420000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.84099999999999997,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":1.3440000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92600000000000005,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.006},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0429999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6519999999999999,"5min":1.976,"15min":1.976},"last":1.0700000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1279999999999999,"15min":1.1539999999999999},"min":{"1min":0.71099999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.625,"5min":1.625,"15min":2.6579999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0600000000000001,"15min":1.105},"min":{"1min":0.81499999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.542,"5min":1.6819999999999999,"15min":2.524},"last":1.111}]},{"osd":4,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.298,"15min":1.3520000000000001},"min":{"1min":1.083,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.639,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":1.226,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5449999999999999,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.5840000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.266,"15min":1.325},"min":{"1min":0.98799999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.734,"5min":1.734,"15min":3.093},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.357,"15min":1.3959999999999999},"min":{"1min":1.02,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.841,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.7070000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.395,"15min":1.448},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9299999999999999,"5min":1.944,"15min":3.589},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.377,"15min":1.4470000000000001},"min":{"1min":1.1799999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.4390000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.45,"15min":1.502},"min":{"1min":1.206,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.0710000000000002,"15min":3.242},"last":1.796},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.464,"15min":1.51},"min":{"1min":1.151,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.6930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302396,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069444,"statfs":{"total":96636764160,"available":96327110656,"internally_reserved":0,"allocated":1036288,"data_stored":507672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.70999999999999996,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.8149999999999999,"15min":4.149},"last":1.04},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.155},"min":{"1min":0.88300000000000001,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.1970000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.97499999999999998},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.204,"5min":1.1220000000000001,"15min":1.1619999999999999},"min":{"1min":0.754,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.73,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":0.79100000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.272,"15min":1.2949999999999999},"min":{"1min":1.0629999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8140000000000001,"5min":1.915,"15min":4.1849999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.109,"5min":1.1240000000000001,"15min":1.1359999999999999},"min":{"1min":0.87,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3480000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.069}]},{"osd":4,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.262,"15min":1.278},"min":{"1min":1.1759999999999999,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.681,"5min":1.681,"15min":3.2629999999999999},"last":0.746},{"interface":"front","average":{"1min":1.526,"5min":1.4370000000000001,"15min":1.462},"min":{"1min":1.2190000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.1930000000000001,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":0.88400000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.3959999999999999,"15min":1.431},"min":{"1min":0.999,"5min":0.879,"15min":0.879},"max":{"1min":1.887,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3540000000000001,"15min":1.3979999999999999},"min":{"1min":1.0589999999999999,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6799999999999999,"5min":1.8340000000000001,"15min":2.637},"last":1.1160000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.514,"15min":1.542},"min":{"1min":1.282,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":2.1269999999999998,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.153},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.482,"15min":1.518},"min":{"1min":1.0409999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8260000000000001,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.3580000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.524,"15min":1.569},"min":{"1min":1.198,"5min":0.754,"15min":0.754},"max":{"1min":1.802,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4730000000000001,"15min":1.498},"min":{"1min":1.208,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.919,"5min":1.9710000000000001,"15min":2.798},"last":1.2410000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307044,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064796,"statfs":{"total":96636764160,"available":96322351104,"internally_reserved":0,"allocated":1601536,"data_stored":1095768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.65700000000000003,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.87},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.72099999999999997,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.429,"5min":1.702,"15min":1.746},"last":0.93300000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":1.0549999999999999},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.7,"15min":1.7},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.113,"15min":1.1240000000000001},"min":{"1min":0.78500000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0049999999999999,"15min":1.0249999999999999},"min":{"1min":0.69599999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.819},"last":0.997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.234,"15min":1.248},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.5349999999999999,"5min":1.929,"15min":1.929},"last":1.329}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.593,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.262,"15min":1.3049999999999999},"min":{"1min":0.97999999999999998,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.651,"5min":1.762,"15min":1.762},"last":1.2509999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.825,"5min":1.952,"15min":2.391},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.4350000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.6719999999999999,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.978}]},{"osd":6,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3149999999999999,"15min":1.389},"min":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4590000000000001,"5min":1.877,"15min":2.0779999999999998},"last":1.77},{"interface":"front","average":{"1min":1.446,"5min":1.47,"15min":1.5069999999999999},"min":{"1min":1.2609999999999999,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":1.903,"5min":2.161,"15min":2.23},"last":1.8560000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4670000000000001,"15min":1.5089999999999999},"min":{"1min":1.2050000000000001,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":1.5820000000000001,"5min":2.8980000000000001,"15min":3.262},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.409,"15min":1.482},"min":{"1min":1.179,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.736,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.917}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:51:28.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:51:28.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:51:30.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:51:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.066+0000 7fd41a016700 1 Processor -- start 2023-12-24T18:51:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 -- start start 2023-12-24T18:51:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4141611b0 0x7fd414161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd41406c820 0x7fd41406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41406c4d0 con 0x7fd4140ae100 2023-12-24T18:51:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41406c1f0 con 0x7fd41406c820 2023-12-24T18:51:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd41a016700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4140ab5e0 con 0x7fd4141611b0 2023-12-24T18:51:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd418813700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd4140ae100 0x7fd41406b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39656/0 (socket says 172.21.15.50:39656) 2023-12-24T18:51:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd418813700 1 -- 172.21.15.50:0/2065089158 learned_addr learned my addr 172.21.15.50:0/2065089158 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd419815700 1 --2- 172.21.15.50:0/2065089158 >> v2:172.21.15.50:3300/0 conn(0x7fd41406c820 0x7fd41406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.070+0000 7fd419014700 1 --2- 172.21.15.50:0/2065089158 >> v2:172.21.15.82:3300/0 conn(0x7fd4141611b0 0x7fd414161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728316451 0 0) 0x7fd404001110 con 0x7fd4140ae100 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd400003570 con 0x7fd4140ae100 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd419815700 1 -- 172.21.15.50:0/2065089158 >> v2:172.21.15.82:3300/0 conn(0x7fd4141611b0 msgr2=0x7fd414161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd419815700 1 --2- 172.21.15.50:0/2065089158 >> v2:172.21.15.82:3300/0 conn(0x7fd4141611b0 0x7fd414161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd419815700 1 -- 172.21.15.50:0/2065089158 >> v1:172.21.15.50:6789/0 conn(0x7fd4140ae100 legacy=0x7fd41406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069645542 0 0) 0x7fd400003570 con 0x7fd4140ae100 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd419815700 1 -- 172.21.15.50:0/2065089158 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140ab8c0 con 0x7fd41406c820 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd419815700 1 --2- 172.21.15.50:0/2065089158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd41406c820 0x7fd41406cc60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd414068070 tx=0x7fd40c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a78589efc23ba3c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00e070 con 0x7fd41406c820 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00b7a0 con 0x7fd41406c820 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd40bfff700 1 -- 172.21.15.50:0/2065089158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404001600 con 0x7fd41406c820 2023-12-24T18:51:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 -- 172.21.15.50:0/2065089158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd41406c820 msgr2=0x7fd41406cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 --2- 172.21.15.50:0/2065089158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd41406c820 0x7fd41406cc60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd414068070 tx=0x7fd40c009780 comp rx=0 tx=0).stop 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 -- 172.21.15.50:0/2065089158 shutdown_connections 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 --2- 172.21.15.50:0/2065089158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd41406c820 0x7fd41406cc60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 --2- 172.21.15.50:0/2065089158 >> v2:172.21.15.82:3300/0 conn(0x7fd4141611b0 0x7fd414161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 -- 172.21.15.50:0/2065089158 >> 172.21.15.50:0/2065089158 conn(0x7fd414067b80 msgr2=0x7fd4140cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 -- 172.21.15.50:0/2065089158 shutdown_connections 2023-12-24T18:51:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.074+0000 7fd41a016700 1 -- 172.21.15.50:0/2065089158 wait complete. 2023-12-24T18:51:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 Processor -- start 2023-12-24T18:51:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 -- start start 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd41406c820 0x7fd4141558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4140ae100 0x7fd41406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140aef50 con 0x7fd4141611b0 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414155e10 con 0x7fd4140ae100 2023-12-24T18:51:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd41a016700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd414160490 con 0x7fd41406c820 2023-12-24T18:51:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd419815700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd419815700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49338/0 (socket says 172.21.15.50:49338) 2023-12-24T18:51:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd419815700 1 -- 172.21.15.50:0/2224807365 learned_addr learned my addr 172.21.15.50:0/2224807365 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd418813700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4140ae100 0x7fd41406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.078+0000 7fd419014700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd41406c820 0x7fd4141558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 -- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd41406c820 msgr2=0x7fd4141558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd41406c820 0x7fd4141558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 -- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4140ae100 msgr2=0x7fd41406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4140ae100 0x7fd41406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 -- 172.21.15.50:0/2224807365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009a20 con 0x7fd4141611b0 2023-12-24T18:51:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd419815700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd4140c95c0 tx=0x7fd40c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c012ad0 con 0x7fd4141611b0 2023-12-24T18:51:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c012c50 con 0x7fd4141611b0 2023-12-24T18:51:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c01e430 con 0x7fd4141611b0 2023-12-24T18:51:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd414160770 con 0x7fd4141611b0 2023-12-24T18:51:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140aeae0 con 0x7fd4141611b0 2023-12-24T18:51:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.082+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4140af0c0 con 0x7fd4141611b0 2023-12-24T18:51:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.086+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd40c01e820 con 0x7fd4141611b0 2023-12-24T18:51:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.086+0000 7fd4097fa700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 0x7fd3f8062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.086+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd40c07eb90 con 0x7fd4141611b0 2023-12-24T18:51:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.086+0000 7fd419014700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 0x7fd3f8062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.090+0000 7fd419014700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 0x7fd3f8062a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd410009db0 tx=0x7fd4100091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.094+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd40c04ee20 con 0x7fd4141611b0 2023-12-24T18:51:31.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.266+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd41404be40 con 0x7fd3f80605d0 2023-12-24T18:51:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.282+0000 7fd4097fa700 1 -- 172.21.15.50:0/2224807365 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285599 (secure 0 0 0) 0x7fd41404be40 con 0x7fd3f80605d0 2023-12-24T18:51:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 msgr2=0x7fd3f8062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 0x7fd3f8062a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd410009db0 tx=0x7fd4100091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 msgr2=0x7fd41406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd4140c95c0 tx=0x7fd40c018000 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 shutdown_connections 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd3f80605d0 0x7fd3f8062a80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4141611b0 0x7fd41406dc00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4140ae100 0x7fd41406d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 --2- 172.21.15.50:0/2224807365 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd41406c820 0x7fd4141558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 >> 172.21.15.50:0/2224807365 conn(0x7fd414067b80 msgr2=0x7fd414157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.290+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 shutdown_connections 2023-12-24T18:51:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.294+0000 7fd41a016700 1 -- 172.21.15.50:0/2224807365 wait complete. 2023-12-24T18:51:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:51:31.314 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-24T18:51:30.618913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448840,"kb_used_data":9096,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752525880,"statfs":{"total":773094113280,"available":770586501120,"internally_reserved":0,"allocated":9314304,"data_stored":5228548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.841240"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821178+0000","last_change":"2023-12-24T18:51:21.819785+0000","last_active":"2023-12-24T18:51:21.821178+0000","last_peered":"2023-12-24T18:51:21.821178+0000","last_clean":"2023-12-24T18:51:21.821178+0000","last_became_active":"2023-12-24T18:51:21.819456+0000","last_became_peered":"2023-12-24T18:51:21.819456+0000","last_unstale":"2023-12-24T18:51:21.821178+0000","last_undegraded":"2023-12-24T18:51:21.821178+0000","last_fullsized":"2023-12-24T18:51:21.821178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812666+0000","last_change":"2023-12-24T18:51:21.806851+0000","last_active":"2023-12-24T18:51:21.812666+0000","last_peered":"2023-12-24T18:51:21.812666+0000","last_clean":"2023-12-24T18:51:21.812666+0000","last_became_active":"2023-12-24T18:51:21.806576+0000","last_became_peered":"2023-12-24T18:51:21.806576+0000","last_unstale":"2023-12-24T18:51:21.812666+0000","last_undegraded":"2023-12-24T18:51:21.812666+0000","last_fullsized":"2023-12-24T18:51:21.812666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823611+0000","last_change":"2023-12-24T18:51:21.819671+0000","last_active":"2023-12-24T18:51:21.823611+0000","last_peered":"2023-12-24T18:51:21.823611+0000","last_clean":"2023-12-24T18:51:21.823611+0000","last_became_active":"2023-12-24T18:51:21.818893+0000","last_became_peered":"2023-12-24T18:51:21.818893+0000","last_unstale":"2023-12-24T18:51:21.823611+0000","last_undegraded":"2023-12-24T18:51:21.823611+0000","last_fullsized":"2023-12-24T18:51:21.823611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816611+0000","last_change":"2023-12-24T18:51:21.798895+0000","last_active":"2023-12-24T18:51:21.816611+0000","last_peered":"2023-12-24T18:51:21.816611+0000","last_clean":"2023-12-24T18:51:21.816611+0000","last_became_active":"2023-12-24T18:51:21.798557+0000","last_became_peered":"2023-12-24T18:51:21.798557+0000","last_unstale":"2023-12-24T18:51:21.816611+0000","last_undegraded":"2023-12-24T18:51:21.816611+0000","last_fullsized":"2023-12-24T18:51:21.816611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800756+0000","last_change":"2023-12-24T18:51:21.797440+0000","last_active":"2023-12-24T18:51:21.800756+0000","last_peered":"2023-12-24T18:51:21.800756+0000","last_clean":"2023-12-24T18:51:21.800756+0000","last_became_active":"2023-12-24T18:51:21.797140+0000","last_became_peered":"2023-12-24T18:51:21.797140+0000","last_unstale":"2023-12-24T18:51:21.800756+0000","last_undegraded":"2023-12-24T18:51:21.800756+0000","last_fullsized":"2023-12-24T18:51:21.800756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:23.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819570+0000","last_change":"2023-12-24T18:51:21.815459+0000","last_active":"2023-12-24T18:51:21.819570+0000","last_peered":"2023-12-24T18:51:21.819570+0000","last_clean":"2023-12-24T18:51:21.819570+0000","last_became_active":"2023-12-24T18:51:21.815115+0000","last_became_peered":"2023-12-24T18:51:21.815115+0000","last_unstale":"2023-12-24T18:51:21.819570+0000","last_undegraded":"2023-12-24T18:51:21.819570+0000","last_fullsized":"2023-12-24T18:51:21.819570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:08.317193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825388+0000","last_change":"2023-12-24T18:51:21.823901+0000","last_active":"2023-12-24T18:51:21.825388+0000","last_peered":"2023-12-24T18:51:21.825388+0000","last_clean":"2023-12-24T18:51:21.825388+0000","last_became_active":"2023-12-24T18:51:21.823640+0000","last_became_peered":"2023-12-24T18:51:21.823640+0000","last_unstale":"2023-12-24T18:51:21.825388+0000","last_undegraded":"2023-12-24T18:51:21.825388+0000","last_fullsized":"2023-12-24T18:51:21.825388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:05.709486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821418+0000","last_change":"2023-12-24T18:51:21.807937+0000","last_active":"2023-12-24T18:51:21.821418+0000","last_peered":"2023-12-24T18:51:21.821418+0000","last_clean":"2023-12-24T18:51:21.821418+0000","last_became_active":"2023-12-24T18:51:21.807692+0000","last_became_peered":"2023-12-24T18:51:21.807692+0000","last_unstale":"2023-12-24T18:51:21.821418+0000","last_undegraded":"2023-12-24T18:51:21.821418+0000","last_fullsized":"2023-12-24T18:51:21.821418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:22.255385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828591+0000","last_change":"2023-12-24T18:51:21.827147+0000","last_active":"2023-12-24T18:51:21.828591+0000","last_peered":"2023-12-24T18:51:21.828591+0000","last_clean":"2023-12-24T18:51:21.828591+0000","last_became_active":"2023-12-24T18:51:21.826796+0000","last_became_peered":"2023-12-24T18:51:21.826796+0000","last_unstale":"2023-12-24T18:51:21.828591+0000","last_undegraded":"2023-12-24T18:51:21.828591+0000","last_fullsized":"2023-12-24T18:51:21.828591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823397+0000","last_change":"2023-12-24T18:51:21.818362+0000","last_active":"2023-12-24T18:51:21.823397+0000","last_peered":"2023-12-24T18:51:21.823397+0000","last_clean":"2023-12-24T18:51:21.823397+0000","last_became_active":"2023-12-24T18:51:21.818064+0000","last_became_peered":"2023-12-24T18:51:21.818064+0000","last_unstale":"2023-12-24T18:51:21.823397+0000","last_undegraded":"2023-12-24T18:51:21.823397+0000","last_fullsized":"2023-12-24T18:51:21.823397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826082+0000","last_change":"2023-12-24T18:51:21.809953+0000","last_active":"2023-12-24T18:51:21.826082+0000","last_peered":"2023-12-24T18:51:21.826082+0000","last_clean":"2023-12-24T18:51:21.826082+0000","last_became_active":"2023-12-24T18:51:21.803585+0000","last_became_peered":"2023-12-24T18:51:21.803585+0000","last_unstale":"2023-12-24T18:51:21.826082+0000","last_undegraded":"2023-12-24T18:51:21.826082+0000","last_fullsized":"2023-12-24T18:51:21.826082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823139+0000","last_change":"2023-12-24T18:51:21.820778+0000","last_active":"2023-12-24T18:51:21.823139+0000","last_peered":"2023-12-24T18:51:21.823139+0000","last_clean":"2023-12-24T18:51:21.823139+0000","last_became_active":"2023-12-24T18:51:21.820424+0000","last_became_peered":"2023-12-24T18:51:21.820424+0000","last_unstale":"2023-12-24T18:51:21.823139+0000","last_undegraded":"2023-12-24T18:51:21.823139+0000","last_fullsized":"2023-12-24T18:51:21.823139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:59.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821445+0000","last_change":"2023-12-24T18:51:21.808858+0000","last_active":"2023-12-24T18:51:21.821445+0000","last_peered":"2023-12-24T18:51:21.821445+0000","last_clean":"2023-12-24T18:51:21.821445+0000","last_became_active":"2023-12-24T18:51:21.808519+0000","last_became_peered":"2023-12-24T18:51:21.808519+0000","last_unstale":"2023-12-24T18:51:21.821445+0000","last_undegraded":"2023-12-24T18:51:21.821445+0000","last_fullsized":"2023-12-24T18:51:21.821445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:35.109063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823591+0000","last_change":"2023-12-24T18:51:21.820063+0000","last_active":"2023-12-24T18:51:21.823591+0000","last_peered":"2023-12-24T18:51:21.823591+0000","last_clean":"2023-12-24T18:51:21.823591+0000","last_became_active":"2023-12-24T18:51:21.819577+0000","last_became_peered":"2023-12-24T18:51:21.819577+0000","last_unstale":"2023-12-24T18:51:21.823591+0000","last_undegraded":"2023-12-24T18:51:21.823591+0000","last_fullsized":"2023-12-24T18:51:21.823591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823514+0000","last_change":"2023-12-24T18:51:21.819612+0000","last_active":"2023-12-24T18:51:21.823514+0000","last_peered":"2023-12-24T18:51:21.823514+0000","last_clean":"2023-12-24T18:51:21.823514+0000","last_became_active":"2023-12-24T18:51:21.819125+0000","last_became_peered":"2023-12-24T18:51:21.819125+0000","last_unstale":"2023-12-24T18:51:21.823514+0000","last_undegraded":"2023-12-24T18:51:21.823514+0000","last_fullsized":"2023-12-24T18:51:21.823514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812248+0000","last_change":"2023-12-24T18:51:21.810490+0000","last_active":"2023-12-24T18:51:21.812248+0000","last_peered":"2023-12-24T18:51:21.812248+0000","last_clean":"2023-12-24T18:51:21.812248+0000","last_became_active":"2023-12-24T18:51:21.810205+0000","last_became_peered":"2023-12-24T18:51:21.810205+0000","last_unstale":"2023-12-24T18:51:21.812248+0000","last_undegraded":"2023-12-24T18:51:21.812248+0000","last_fullsized":"2023-12-24T18:51:21.812248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:53:06.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830113+0000","last_change":"2023-12-24T18:51:21.829159+0000","last_active":"2023-12-24T18:51:21.830113+0000","last_peered":"2023-12-24T18:51:21.830113+0000","last_clean":"2023-12-24T18:51:21.830113+0000","last_became_active":"2023-12-24T18:51:21.828823+0000","last_became_peered":"2023-12-24T18:51:21.828823+0000","last_unstale":"2023-12-24T18:51:21.830113+0000","last_undegraded":"2023-12-24T18:51:21.830113+0000","last_fullsized":"2023-12-24T18:51:21.830113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822659+0000","last_change":"2023-12-24T18:51:21.802952+0000","last_active":"2023-12-24T18:51:21.822659+0000","last_peered":"2023-12-24T18:51:21.822659+0000","last_clean":"2023-12-24T18:51:21.822659+0000","last_became_active":"2023-12-24T18:51:21.802657+0000","last_became_peered":"2023-12-24T18:51:21.802657+0000","last_unstale":"2023-12-24T18:51:21.822659+0000","last_undegraded":"2023-12-24T18:51:21.822659+0000","last_fullsized":"2023-12-24T18:51:21.822659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800193+0000","last_change":"2023-12-24T18:51:21.796598+0000","last_active":"2023-12-24T18:51:21.800193+0000","last_peered":"2023-12-24T18:51:21.800193+0000","last_clean":"2023-12-24T18:51:21.800193+0000","last_became_active":"2023-12-24T18:51:21.796218+0000","last_became_peered":"2023-12-24T18:51:21.796218+0000","last_unstale":"2023-12-24T18:51:21.800193+0000","last_undegraded":"2023-12-24T18:51:21.800193+0000","last_fullsized":"2023-12-24T18:51:21.800193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:43.192930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804809+0000","last_change":"2023-12-24T18:51:21.801245+0000","last_active":"2023-12-24T18:51:21.804809+0000","last_peered":"2023-12-24T18:51:21.804809+0000","last_clean":"2023-12-24T18:51:21.804809+0000","last_became_active":"2023-12-24T18:51:21.800807+0000","last_became_peered":"2023-12-24T18:51:21.800807+0000","last_unstale":"2023-12-24T18:51:21.804809+0000","last_undegraded":"2023-12-24T18:51:21.804809+0000","last_fullsized":"2023-12-24T18:51:21.804809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:42.625747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820563+0000","last_change":"2023-12-24T18:51:21.807273+0000","last_active":"2023-12-24T18:51:21.820563+0000","last_peered":"2023-12-24T18:51:21.820563+0000","last_clean":"2023-12-24T18:51:21.820563+0000","last_became_active":"2023-12-24T18:51:21.806962+0000","last_became_peered":"2023-12-24T18:51:21.806962+0000","last_unstale":"2023-12-24T18:51:21.820563+0000","last_undegraded":"2023-12-24T18:51:21.820563+0000","last_fullsized":"2023-12-24T18:51:21.820563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:52.774219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.818769+0000","last_change":"2023-12-24T18:51:21.817316+0000","last_active":"2023-12-24T18:51:21.818769+0000","last_peered":"2023-12-24T18:51:21.818769+0000","last_clean":"2023-12-24T18:51:21.818769+0000","last_became_active":"2023-12-24T18:51:21.815806+0000","last_became_peered":"2023-12-24T18:51:21.815806+0000","last_unstale":"2023-12-24T18:51:21.818769+0000","last_undegraded":"2023-12-24T18:51:21.818769+0000","last_fullsized":"2023-12-24T18:51:21.818769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:23.889830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824295+0000","last_change":"2023-12-24T18:51:21.822330+0000","last_active":"2023-12-24T18:51:21.824295+0000","last_peered":"2023-12-24T18:51:21.824295+0000","last_clean":"2023-12-24T18:51:21.824295+0000","last_became_active":"2023-12-24T18:51:21.822027+0000","last_became_peered":"2023-12-24T18:51:21.822027+0000","last_unstale":"2023-12-24T18:51:21.824295+0000","last_undegraded":"2023-12-24T18:51:21.824295+0000","last_fullsized":"2023-12-24T18:51:21.824295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:09.103122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823693+0000","last_change":"2023-12-24T18:51:21.819796+0000","last_active":"2023-12-24T18:51:21.823693+0000","last_peered":"2023-12-24T18:51:21.823693+0000","last_clean":"2023-12-24T18:51:21.823693+0000","last_became_active":"2023-12-24T18:51:21.819005+0000","last_became_peered":"2023-12-24T18:51:21.819005+0000","last_unstale":"2023-12-24T18:51:21.823693+0000","last_undegraded":"2023-12-24T18:51:21.823693+0000","last_fullsized":"2023-12-24T18:51:21.823693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:48.410181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821624+0000","last_change":"2023-12-24T18:51:21.811274+0000","last_active":"2023-12-24T18:51:21.821624+0000","last_peered":"2023-12-24T18:51:21.821624+0000","last_clean":"2023-12-24T18:51:21.821624+0000","last_became_active":"2023-12-24T18:51:21.810813+0000","last_became_peered":"2023-12-24T18:51:21.810813+0000","last_unstale":"2023-12-24T18:51:21.821624+0000","last_undegraded":"2023-12-24T18:51:21.821624+0000","last_fullsized":"2023-12-24T18:51:21.821624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:11:55.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820133+0000","last_change":"2023-12-24T18:51:21.807476+0000","last_active":"2023-12-24T18:51:21.820133+0000","last_peered":"2023-12-24T18:51:21.820133+0000","last_clean":"2023-12-24T18:51:21.820133+0000","last_became_active":"2023-12-24T18:51:21.807216+0000","last_became_peered":"2023-12-24T18:51:21.807216+0000","last_unstale":"2023-12-24T18:51:21.820133+0000","last_undegraded":"2023-12-24T18:51:21.820133+0000","last_fullsized":"2023-12-24T18:51:21.820133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:55:02.747482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.799945+0000","last_change":"2023-12-24T18:51:21.794682+0000","last_active":"2023-12-24T18:51:21.799945+0000","last_peered":"2023-12-24T18:51:21.799945+0000","last_clean":"2023-12-24T18:51:21.799945+0000","last_became_active":"2023-12-24T18:51:21.794355+0000","last_became_peered":"2023-12-24T18:51:21.794355+0000","last_unstale":"2023-12-24T18:51:21.799945+0000","last_undegraded":"2023-12-24T18:51:21.799945+0000","last_fullsized":"2023-12-24T18:51:21.799945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814356+0000","last_change":"2023-12-24T18:51:21.810845+0000","last_active":"2023-12-24T18:51:21.814356+0000","last_peered":"2023-12-24T18:51:21.814356+0000","last_clean":"2023-12-24T18:51:21.814356+0000","last_became_active":"2023-12-24T18:51:21.810551+0000","last_became_peered":"2023-12-24T18:51:21.810551+0000","last_unstale":"2023-12-24T18:51:21.814356+0000","last_undegraded":"2023-12-24T18:51:21.814356+0000","last_fullsized":"2023-12-24T18:51:21.814356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.829015+0000","last_change":"2023-12-24T18:51:21.827819+0000","last_active":"2023-12-24T18:51:21.829015+0000","last_peered":"2023-12-24T18:51:21.829015+0000","last_clean":"2023-12-24T18:51:21.829015+0000","last_became_active":"2023-12-24T18:51:21.827261+0000","last_became_peered":"2023-12-24T18:51:21.827261+0000","last_unstale":"2023-12-24T18:51:21.829015+0000","last_undegraded":"2023-12-24T18:51:21.829015+0000","last_fullsized":"2023-12-24T18:51:21.829015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:10.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.824418+0000","last_change":"2023-12-24T18:51:21.823865+0000","last_active":"2023-12-24T18:51:21.824418+0000","last_peered":"2023-12-24T18:51:21.824418+0000","last_clean":"2023-12-24T18:51:21.824418+0000","last_became_active":"2023-12-24T18:51:21.820623+0000","last_became_peered":"2023-12-24T18:51:21.820623+0000","last_unstale":"2023-12-24T18:51:21.824418+0000","last_undegraded":"2023-12-24T18:51:21.824418+0000","last_fullsized":"2023-12-24T18:51:21.824418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:43.024890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795732+0000","last_change":"2023-12-24T18:51:21.793682+0000","last_active":"2023-12-24T18:51:21.795732+0000","last_peered":"2023-12-24T18:51:21.795732+0000","last_clean":"2023-12-24T18:51:21.795732+0000","last_became_active":"2023-12-24T18:51:21.793275+0000","last_became_peered":"2023-12-24T18:51:21.793275+0000","last_unstale":"2023-12-24T18:51:21.795732+0000","last_undegraded":"2023-12-24T18:51:21.795732+0000","last_fullsized":"2023-12-24T18:51:21.795732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:09.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806600+0000","last_change":"2023-12-24T18:51:21.803059+0000","last_active":"2023-12-24T18:51:21.806600+0000","last_peered":"2023-12-24T18:51:21.806600+0000","last_clean":"2023-12-24T18:51:21.806600+0000","last_became_active":"2023-12-24T18:51:21.802781+0000","last_became_peered":"2023-12-24T18:51:21.802781+0000","last_unstale":"2023-12-24T18:51:21.806600+0000","last_undegraded":"2023-12-24T18:51:21.806600+0000","last_fullsized":"2023-12-24T18:51:21.806600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:49.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819785+0000","last_change":"2023-12-24T18:51:21.812040+0000","last_active":"2023-12-24T18:51:21.819785+0000","last_peered":"2023-12-24T18:51:21.819785+0000","last_clean":"2023-12-24T18:51:21.819785+0000","last_became_active":"2023-12-24T18:51:21.811754+0000","last_became_peered":"2023-12-24T18:51:21.811754+0000","last_unstale":"2023-12-24T18:51:21.819785+0000","last_undegraded":"2023-12-24T18:51:21.819785+0000","last_fullsized":"2023-12-24T18:51:21.819785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:04.056916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823033+0000","last_change":"2023-12-24T18:51:20.798916+0000","last_active":"2023-12-24T18:51:21.823033+0000","last_peered":"2023-12-24T18:51:21.823033+0000","last_clean":"2023-12-24T18:51:21.823033+0000","last_became_active":"2023-12-24T18:51:20.798544+0000","last_became_peered":"2023-12-24T18:51:20.798544+0000","last_unstale":"2023-12-24T18:51:21.823033+0000","last_undegraded":"2023-12-24T18:51:21.823033+0000","last_fullsized":"2023-12-24T18:51:21.823033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826098+0000","last_change":"2023-12-24T18:51:21.810131+0000","last_active":"2023-12-24T18:51:21.826098+0000","last_peered":"2023-12-24T18:51:21.826098+0000","last_clean":"2023-12-24T18:51:21.826098+0000","last_became_active":"2023-12-24T18:51:21.809525+0000","last_became_peered":"2023-12-24T18:51:21.809525+0000","last_unstale":"2023-12-24T18:51:21.826098+0000","last_undegraded":"2023-12-24T18:51:21.826098+0000","last_fullsized":"2023-12-24T18:51:21.826098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806347+0000","last_change":"2023-12-24T18:51:20.805863+0000","last_active":"2023-12-24T18:51:21.806347+0000","last_peered":"2023-12-24T18:51:21.806347+0000","last_clean":"2023-12-24T18:51:21.806347+0000","last_became_active":"2023-12-24T18:51:20.805505+0000","last_became_peered":"2023-12-24T18:51:20.805505+0000","last_unstale":"2023-12-24T18:51:21.806347+0000","last_undegraded":"2023-12-24T18:51:21.806347+0000","last_fullsized":"2023-12-24T18:51:21.806347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:21.236460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815682+0000","last_change":"2023-12-24T18:51:21.811172+0000","last_active":"2023-12-24T18:51:21.815682+0000","last_peered":"2023-12-24T18:51:21.815682+0000","last_clean":"2023-12-24T18:51:21.815682+0000","last_became_active":"2023-12-24T18:51:21.809843+0000","last_became_peered":"2023-12-24T18:51:21.809843+0000","last_unstale":"2023-12-24T18:51:21.815682+0000","last_undegraded":"2023-12-24T18:51:21.815682+0000","last_fullsized":"2023-12-24T18:51:21.815682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:36.662622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819717+0000","last_change":"2023-12-24T18:51:20.799302+0000","last_active":"2023-12-24T18:51:21.819717+0000","last_peered":"2023-12-24T18:51:21.819717+0000","last_clean":"2023-12-24T18:51:21.819717+0000","last_became_active":"2023-12-24T18:51:20.799011+0000","last_became_peered":"2023-12-24T18:51:20.799011+0000","last_unstale":"2023-12-24T18:51:21.819717+0000","last_undegraded":"2023-12-24T18:51:21.819717+0000","last_fullsized":"2023-12-24T18:51:21.819717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:51.755294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823338+0000","last_change":"2023-12-24T18:51:21.818274+0000","last_active":"2023-12-24T18:51:21.823338+0000","last_peered":"2023-12-24T18:51:21.823338+0000","last_clean":"2023-12-24T18:51:21.823338+0000","last_became_active":"2023-12-24T18:51:21.817981+0000","last_became_peered":"2023-12-24T18:51:21.817981+0000","last_unstale":"2023-12-24T18:51:21.823338+0000","last_undegraded":"2023-12-24T18:51:21.823338+0000","last_fullsized":"2023-12-24T18:51:21.823338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:00.886194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815461+0000","last_change":"2023-12-24T18:51:20.798149+0000","last_active":"2023-12-24T18:51:21.815461+0000","last_peered":"2023-12-24T18:51:21.815461+0000","last_clean":"2023-12-24T18:51:21.815461+0000","last_became_active":"2023-12-24T18:51:20.797835+0000","last_became_peered":"2023-12-24T18:51:20.797835+0000","last_unstale":"2023-12-24T18:51:21.815461+0000","last_undegraded":"2023-12-24T18:51:21.815461+0000","last_fullsized":"2023-12-24T18:51:21.815461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:23:34.090138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804820+0000","last_change":"2023-12-24T18:51:21.797085+0000","last_active":"2023-12-24T18:51:21.804820+0000","last_peered":"2023-12-24T18:51:21.804820+0000","last_clean":"2023-12-24T18:51:21.804820+0000","last_became_active":"2023-12-24T18:51:21.796784+0000","last_became_peered":"2023-12-24T18:51:21.796784+0000","last_unstale":"2023-12-24T18:51:21.804820+0000","last_undegraded":"2023-12-24T18:51:21.804820+0000","last_fullsized":"2023-12-24T18:51:21.804820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:26:15.942937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816419+0000","last_change":"2023-12-24T18:51:20.801016+0000","last_active":"2023-12-24T18:51:21.816419+0000","last_peered":"2023-12-24T18:51:21.816419+0000","last_clean":"2023-12-24T18:51:21.816419+0000","last_became_active":"2023-12-24T18:51:20.800722+0000","last_became_peered":"2023-12-24T18:51:20.800722+0000","last_unstale":"2023-12-24T18:51:21.816419+0000","last_undegraded":"2023-12-24T18:51:21.816419+0000","last_fullsized":"2023-12-24T18:51:21.816419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:49.537267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830093+0000","last_change":"2023-12-24T18:51:21.829091+0000","last_active":"2023-12-24T18:51:21.830093+0000","last_peered":"2023-12-24T18:51:21.830093+0000","last_clean":"2023-12-24T18:51:21.830093+0000","last_became_active":"2023-12-24T18:51:21.828800+0000","last_became_peered":"2023-12-24T18:51:21.828800+0000","last_unstale":"2023-12-24T18:51:21.830093+0000","last_undegraded":"2023-12-24T18:51:21.830093+0000","last_fullsized":"2023-12-24T18:51:21.830093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:03.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816803+0000","last_change":"2023-12-24T18:51:20.795608+0000","last_active":"2023-12-24T18:51:21.816803+0000","last_peered":"2023-12-24T18:51:21.816803+0000","last_clean":"2023-12-24T18:51:21.816803+0000","last_became_active":"2023-12-24T18:51:20.795091+0000","last_became_peered":"2023-12-24T18:51:20.795091+0000","last_unstale":"2023-12-24T18:51:21.816803+0000","last_undegraded":"2023-12-24T18:51:21.816803+0000","last_fullsized":"2023-12-24T18:51:21.816803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:33.654937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812706+0000","last_change":"2023-12-24T18:51:21.803121+0000","last_active":"2023-12-24T18:51:21.812706+0000","last_peered":"2023-12-24T18:51:21.812706+0000","last_clean":"2023-12-24T18:51:21.812706+0000","last_became_active":"2023-12-24T18:51:21.802824+0000","last_became_peered":"2023-12-24T18:51:21.802824+0000","last_unstale":"2023-12-24T18:51:21.812706+0000","last_undegraded":"2023-12-24T18:51:21.812706+0000","last_fullsized":"2023-12-24T18:51:21.812706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:51.275038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787040+0000","last_change":"2023-12-24T18:51:20.801342+0000","last_active":"2023-12-24T18:51:21.787040+0000","last_peered":"2023-12-24T18:51:21.787040+0000","last_clean":"2023-12-24T18:51:21.787040+0000","last_became_active":"2023-12-24T18:51:20.796984+0000","last_became_peered":"2023-12-24T18:51:20.796984+0000","last_unstale":"2023-12-24T18:51:21.787040+0000","last_undegraded":"2023-12-24T18:51:21.787040+0000","last_fullsized":"2023-12-24T18:51:21.787040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:28.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804843+0000","last_change":"2023-12-24T18:51:21.801636+0000","last_active":"2023-12-24T18:51:21.804843+0000","last_peered":"2023-12-24T18:51:21.804843+0000","last_clean":"2023-12-24T18:51:21.804843+0000","last_became_active":"2023-12-24T18:51:21.801356+0000","last_became_peered":"2023-12-24T18:51:21.801356+0000","last_unstale":"2023-12-24T18:51:21.804843+0000","last_undegraded":"2023-12-24T18:51:21.804843+0000","last_fullsized":"2023-12-24T18:51:21.804843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:37.573190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.788157+0000","last_change":"2023-12-24T18:51:20.799261+0000","last_active":"2023-12-24T18:51:21.788157+0000","last_peered":"2023-12-24T18:51:21.788157+0000","last_clean":"2023-12-24T18:51:21.788157+0000","last_became_active":"2023-12-24T18:51:20.797187+0000","last_became_peered":"2023-12-24T18:51:20.797187+0000","last_unstale":"2023-12-24T18:51:21.788157+0000","last_undegraded":"2023-12-24T18:51:21.788157+0000","last_fullsized":"2023-12-24T18:51:21.788157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:55:33.831411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.813264+0000","last_change":"2023-12-24T18:51:21.806185+0000","last_active":"2023-12-24T18:51:21.813264+0000","last_peered":"2023-12-24T18:51:21.813264+0000","last_clean":"2023-12-24T18:51:21.813264+0000","last_became_active":"2023-12-24T18:51:21.805835+0000","last_became_peered":"2023-12-24T18:51:21.805835+0000","last_unstale":"2023-12-24T18:51:21.813264+0000","last_undegraded":"2023-12-24T18:51:21.813264+0000","last_fullsized":"2023-12-24T18:51:21.813264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810950+0000","last_change":"2023-12-24T18:51:20.799268+0000","last_active":"2023-12-24T18:51:21.810950+0000","last_peered":"2023-12-24T18:51:21.810950+0000","last_clean":"2023-12-24T18:51:21.810950+0000","last_became_active":"2023-12-24T18:51:20.798656+0000","last_became_peered":"2023-12-24T18:51:20.798656+0000","last_unstale":"2023-12-24T18:51:21.810950+0000","last_undegraded":"2023-12-24T18:51:21.810950+0000","last_fullsized":"2023-12-24T18:51:21.810950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814664+0000","last_change":"2023-12-24T18:51:21.812241+0000","last_active":"2023-12-24T18:51:21.814664+0000","last_peered":"2023-12-24T18:51:21.814664+0000","last_clean":"2023-12-24T18:51:21.814664+0000","last_became_active":"2023-12-24T18:51:21.811946+0000","last_became_peered":"2023-12-24T18:51:21.811946+0000","last_unstale":"2023-12-24T18:51:21.814664+0000","last_undegraded":"2023-12-24T18:51:21.814664+0000","last_fullsized":"2023-12-24T18:51:21.814664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:02:42.102184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.783186+0000","last_change":"2023-12-24T18:51:20.797775+0000","last_active":"2023-12-24T18:51:21.783186+0000","last_peered":"2023-12-24T18:51:21.783186+0000","last_clean":"2023-12-24T18:51:21.783186+0000","last_became_active":"2023-12-24T18:51:20.797521+0000","last_became_peered":"2023-12-24T18:51:20.797521+0000","last_unstale":"2023-12-24T18:51:21.783186+0000","last_undegraded":"2023-12-24T18:51:21.783186+0000","last_fullsized":"2023-12-24T18:51:21.783186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:39.245201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812907+0000","last_change":"2023-12-24T18:51:21.806668+0000","last_active":"2023-12-24T18:51:21.812907+0000","last_peered":"2023-12-24T18:51:21.812907+0000","last_clean":"2023-12-24T18:51:21.812907+0000","last_became_active":"2023-12-24T18:51:21.806344+0000","last_became_peered":"2023-12-24T18:51:21.806344+0000","last_unstale":"2023-12-24T18:51:21.812907+0000","last_undegraded":"2023-12-24T18:51:21.812907+0000","last_fullsized":"2023-12-24T18:51:21.812907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:53.149173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.821823+0000","last_change":"2023-12-24T18:51:20.796308+0000","last_active":"2023-12-24T18:51:21.821823+0000","last_peered":"2023-12-24T18:51:21.821823+0000","last_clean":"2023-12-24T18:51:21.821823+0000","last_became_active":"2023-12-24T18:51:20.796033+0000","last_became_peered":"2023-12-24T18:51:20.796033+0000","last_unstale":"2023-12-24T18:51:21.821823+0000","last_undegraded":"2023-12-24T18:51:21.821823+0000","last_fullsized":"2023-12-24T18:51:21.821823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805819+0000","last_change":"2023-12-24T18:51:21.797143+0000","last_active":"2023-12-24T18:51:21.805819+0000","last_peered":"2023-12-24T18:51:21.805819+0000","last_clean":"2023-12-24T18:51:21.805819+0000","last_became_active":"2023-12-24T18:51:21.795899+0000","last_became_peered":"2023-12-24T18:51:21.795899+0000","last_unstale":"2023-12-24T18:51:21.805819+0000","last_undegraded":"2023-12-24T18:51:21.805819+0000","last_fullsized":"2023-12-24T18:51:21.805819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:11.668152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'6","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.832629+0000","last_change":"2023-12-24T18:51:20.801730+0000","last_active":"2023-12-24T18:51:21.832629+0000","last_peered":"2023-12-24T18:51:21.832629+0000","last_clean":"2023-12-24T18:51:21.832629+0000","last_became_active":"2023-12-24T18:51:20.800473+0000","last_became_peered":"2023-12-24T18:51:20.800473+0000","last_unstale":"2023-12-24T18:51:21.832629+0000","last_undegraded":"2023-12-24T18:51:21.832629+0000","last_fullsized":"2023-12-24T18:51:21.832629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826474+0000","last_change":"2023-12-24T18:51:21.820977+0000","last_active":"2023-12-24T18:51:21.826474+0000","last_peered":"2023-12-24T18:51:21.826474+0000","last_clean":"2023-12-24T18:51:21.826474+0000","last_became_active":"2023-12-24T18:51:21.818241+0000","last_became_peered":"2023-12-24T18:51:21.818241+0000","last_unstale":"2023-12-24T18:51:21.826474+0000","last_undegraded":"2023-12-24T18:51:21.826474+0000","last_fullsized":"2023-12-24T18:51:21.826474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:09.889525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820347+0000","last_change":"2023-12-24T18:51:20.800176+0000","last_active":"2023-12-24T18:51:21.820347+0000","last_peered":"2023-12-24T18:51:21.820347+0000","last_clean":"2023-12-24T18:51:21.820347+0000","last_became_active":"2023-12-24T18:51:20.799887+0000","last_became_peered":"2023-12-24T18:51:20.799887+0000","last_unstale":"2023-12-24T18:51:21.820347+0000","last_undegraded":"2023-12-24T18:51:21.820347+0000","last_fullsized":"2023-12-24T18:51:21.820347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:14:03.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815988+0000","last_change":"2023-12-24T18:51:21.804426+0000","last_active":"2023-12-24T18:51:21.815988+0000","last_peered":"2023-12-24T18:51:21.815988+0000","last_clean":"2023-12-24T18:51:21.815988+0000","last_became_active":"2023-12-24T18:51:21.804188+0000","last_became_peered":"2023-12-24T18:51:21.804188+0000","last_unstale":"2023-12-24T18:51:21.815988+0000","last_undegraded":"2023-12-24T18:51:21.815988+0000","last_fullsized":"2023-12-24T18:51:21.815988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:01:45.952397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795490+0000","last_change":"2023-12-24T18:51:20.793803+0000","last_active":"2023-12-24T18:51:21.795490+0000","last_peered":"2023-12-24T18:51:21.795490+0000","last_clean":"2023-12-24T18:51:21.795490+0000","last_became_active":"2023-12-24T18:51:20.793511+0000","last_became_peered":"2023-12-24T18:51:20.793511+0000","last_unstale":"2023-12-24T18:51:21.795490+0000","last_undegraded":"2023-12-24T18:51:21.795490+0000","last_fullsized":"2023-12-24T18:51:21.795490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:51.391869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798434+0000","last_change":"2023-12-24T18:51:21.796751+0000","last_active":"2023-12-24T18:51:21.798434+0000","last_peered":"2023-12-24T18:51:21.798434+0000","last_clean":"2023-12-24T18:51:21.798434+0000","last_became_active":"2023-12-24T18:51:21.796428+0000","last_became_peered":"2023-12-24T18:51:21.796428+0000","last_unstale":"2023-12-24T18:51:21.798434+0000","last_undegraded":"2023-12-24T18:51:21.798434+0000","last_fullsized":"2023-12-24T18:51:21.798434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:46.461772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810290+0000","last_change":"2023-12-24T18:51:20.795592+0000","last_active":"2023-12-24T18:51:21.810290+0000","last_peered":"2023-12-24T18:51:21.810290+0000","last_clean":"2023-12-24T18:51:21.810290+0000","last_became_active":"2023-12-24T18:51:20.794829+0000","last_became_peered":"2023-12-24T18:51:20.794829+0000","last_unstale":"2023-12-24T18:51:21.810290+0000","last_undegraded":"2023-12-24T18:51:21.810290+0000","last_fullsized":"2023-12-24T18:51:21.810290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:45.442847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.820598+0000","last_change":"2023-12-24T18:51:21.818722+0000","last_active":"2023-12-24T18:51:21.820598+0000","last_peered":"2023-12-24T18:51:21.820598+0000","last_clean":"2023-12-24T18:51:21.820598+0000","last_became_active":"2023-12-24T18:51:21.818412+0000","last_became_peered":"2023-12-24T18:51:21.818412+0000","last_unstale":"2023-12-24T18:51:21.820598+0000","last_undegraded":"2023-12-24T18:51:21.820598+0000","last_fullsized":"2023-12-24T18:51:21.820598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:00.878858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'8","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.823505+0000","last_change":"2023-12-24T18:51:20.795854+0000","last_active":"2023-12-24T18:51:21.823505+0000","last_peered":"2023-12-24T18:51:21.823505+0000","last_clean":"2023-12-24T18:51:21.823505+0000","last_became_active":"2023-12-24T18:51:20.795547+0000","last_became_peered":"2023-12-24T18:51:20.795547+0000","last_unstale":"2023-12-24T18:51:21.823505+0000","last_undegraded":"2023-12-24T18:51:21.823505+0000","last_fullsized":"2023-12-24T18:51:21.823505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.828564+0000","last_change":"2023-12-24T18:51:21.827156+0000","last_active":"2023-12-24T18:51:21.828564+0000","last_peered":"2023-12-24T18:51:21.828564+0000","last_clean":"2023-12-24T18:51:21.828564+0000","last_became_active":"2023-12-24T18:51:21.826804+0000","last_became_peered":"2023-12-24T18:51:21.826804+0000","last_unstale":"2023-12-24T18:51:21.828564+0000","last_undegraded":"2023-12-24T18:51:21.828564+0000","last_fullsized":"2023-12-24T18:51:21.828564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:38.393596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816079+0000","last_change":"2023-12-24T18:51:20.794130+0000","last_active":"2023-12-24T18:51:21.816079+0000","last_peered":"2023-12-24T18:51:21.816079+0000","last_clean":"2023-12-24T18:51:21.816079+0000","last_became_active":"2023-12-24T18:51:20.793857+0000","last_became_peered":"2023-12-24T18:51:20.793857+0000","last_unstale":"2023-12-24T18:51:21.816079+0000","last_undegraded":"2023-12-24T18:51:21.816079+0000","last_fullsized":"2023-12-24T18:51:21.816079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:10.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.809314+0000","last_change":"2023-12-24T18:51:21.800501+0000","last_active":"2023-12-24T18:51:21.809314+0000","last_peered":"2023-12-24T18:51:21.809314+0000","last_clean":"2023-12-24T18:51:21.809314+0000","last_became_active":"2023-12-24T18:51:21.800202+0000","last_became_peered":"2023-12-24T18:51:21.800202+0000","last_unstale":"2023-12-24T18:51:21.809314+0000","last_undegraded":"2023-12-24T18:51:21.809314+0000","last_fullsized":"2023-12-24T18:51:21.809314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:57.225140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826820+0000","last_change":"2023-12-24T18:51:20.796568+0000","last_active":"2023-12-24T18:51:21.826820+0000","last_peered":"2023-12-24T18:51:21.826820+0000","last_clean":"2023-12-24T18:51:21.826820+0000","last_became_active":"2023-12-24T18:51:20.795623+0000","last_became_peered":"2023-12-24T18:51:20.795623+0000","last_unstale":"2023-12-24T18:51:21.826820+0000","last_undegraded":"2023-12-24T18:51:21.826820+0000","last_fullsized":"2023-12-24T18:51:21.826820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.589741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825999+0000","last_change":"2023-12-24T18:51:21.808110+0000","last_active":"2023-12-24T18:51:21.825999+0000","last_peered":"2023-12-24T18:51:21.825999+0000","last_clean":"2023-12-24T18:51:21.825999+0000","last_became_active":"2023-12-24T18:51:21.807795+0000","last_became_peered":"2023-12-24T18:51:21.807795+0000","last_unstale":"2023-12-24T18:51:21.825999+0000","last_undegraded":"2023-12-24T18:51:21.825999+0000","last_fullsized":"2023-12-24T18:51:21.825999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:07.072843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.819954+0000","last_change":"2023-12-24T18:51:20.798695+0000","last_active":"2023-12-24T18:51:21.819954+0000","last_peered":"2023-12-24T18:51:21.819954+0000","last_clean":"2023-12-24T18:51:21.819954+0000","last_became_active":"2023-12-24T18:51:20.796324+0000","last_became_peered":"2023-12-24T18:51:20.796324+0000","last_unstale":"2023-12-24T18:51:21.819954+0000","last_undegraded":"2023-12-24T18:51:21.819954+0000","last_fullsized":"2023-12-24T18:51:21.819954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:50.256113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816876+0000","last_change":"2023-12-24T18:51:21.810400+0000","last_active":"2023-12-24T18:51:21.816876+0000","last_peered":"2023-12-24T18:51:21.816876+0000","last_clean":"2023-12-24T18:51:21.816876+0000","last_became_active":"2023-12-24T18:51:21.804997+0000","last_became_peered":"2023-12-24T18:51:21.804997+0000","last_unstale":"2023-12-24T18:51:21.816876+0000","last_undegraded":"2023-12-24T18:51:21.816876+0000","last_fullsized":"2023-12-24T18:51:21.816876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:08:40.264126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787219+0000","last_change":"2023-12-24T18:51:20.791815+0000","last_active":"2023-12-24T18:51:21.787219+0000","last_peered":"2023-12-24T18:51:21.787219+0000","last_clean":"2023-12-24T18:51:21.787219+0000","last_became_active":"2023-12-24T18:51:20.791134+0000","last_became_peered":"2023-12-24T18:51:20.791134+0000","last_unstale":"2023-12-24T18:51:21.787219+0000","last_undegraded":"2023-12-24T18:51:21.787219+0000","last_fullsized":"2023-12-24T18:51:21.787219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:32.995781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.804423+0000","last_change":"2023-12-24T18:51:21.799154+0000","last_active":"2023-12-24T18:51:21.804423+0000","last_peered":"2023-12-24T18:51:21.804423+0000","last_clean":"2023-12-24T18:51:21.804423+0000","last_became_active":"2023-12-24T18:51:21.798814+0000","last_became_peered":"2023-12-24T18:51:21.798814+0000","last_unstale":"2023-12-24T18:51:21.804423+0000","last_undegraded":"2023-12-24T18:51:21.804423+0000","last_fullsized":"2023-12-24T18:51:21.804423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:52:50.556192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.808097+0000","last_change":"2023-12-24T18:51:20.801286+0000","last_active":"2023-12-24T18:51:21.808097+0000","last_peered":"2023-12-24T18:51:21.808097+0000","last_clean":"2023-12-24T18:51:21.808097+0000","last_became_active":"2023-12-24T18:51:20.800996+0000","last_became_peered":"2023-12-24T18:51:20.800996+0000","last_unstale":"2023-12-24T18:51:21.808097+0000","last_undegraded":"2023-12-24T18:51:21.808097+0000","last_fullsized":"2023-12-24T18:51:21.808097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:27.237655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816008+0000","last_change":"2023-12-24T18:51:21.805580+0000","last_active":"2023-12-24T18:51:21.816008+0000","last_peered":"2023-12-24T18:51:21.816008+0000","last_clean":"2023-12-24T18:51:21.816008+0000","last_became_active":"2023-12-24T18:51:21.804008+0000","last_became_peered":"2023-12-24T18:51:21.804008+0000","last_unstale":"2023-12-24T18:51:21.816008+0000","last_undegraded":"2023-12-24T18:51:21.816008+0000","last_fullsized":"2023-12-24T18:51:21.816008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:28.256580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.795604+0000","last_change":"2023-12-24T18:51:20.794817+0000","last_active":"2023-12-24T18:51:21.795604+0000","last_peered":"2023-12-24T18:51:21.795604+0000","last_clean":"2023-12-24T18:51:21.795604+0000","last_became_active":"2023-12-24T18:51:20.794467+0000","last_became_peered":"2023-12-24T18:51:20.794467+0000","last_unstale":"2023-12-24T18:51:21.795604+0000","last_undegraded":"2023-12-24T18:51:21.795604+0000","last_fullsized":"2023-12-24T18:51:21.795604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:02:41.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812686+0000","last_change":"2023-12-24T18:51:21.802498+0000","last_active":"2023-12-24T18:51:21.812686+0000","last_peered":"2023-12-24T18:51:21.812686+0000","last_clean":"2023-12-24T18:51:21.812686+0000","last_became_active":"2023-12-24T18:51:21.801035+0000","last_became_peered":"2023-12-24T18:51:21.801035+0000","last_unstale":"2023-12-24T18:51:21.812686+0000","last_undegraded":"2023-12-24T18:51:21.812686+0000","last_fullsized":"2023-12-24T18:51:21.812686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:08:09.546970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.796474+0000","last_change":"2023-12-24T18:51:20.804643+0000","last_active":"2023-12-24T18:51:21.796474+0000","last_peered":"2023-12-24T18:51:21.796474+0000","last_clean":"2023-12-24T18:51:21.796474+0000","last_became_active":"2023-12-24T18:51:20.804341+0000","last_became_peered":"2023-12-24T18:51:20.804341+0000","last_unstale":"2023-12-24T18:51:21.796474+0000","last_undegraded":"2023-12-24T18:51:21.796474+0000","last_fullsized":"2023-12-24T18:51:21.796474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:58.705231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.822021+0000","last_change":"2023-12-24T18:51:21.821178+0000","last_active":"2023-12-24T18:51:21.822021+0000","last_peered":"2023-12-24T18:51:21.822021+0000","last_clean":"2023-12-24T18:51:21.822021+0000","last_became_active":"2023-12-24T18:51:21.820835+0000","last_became_peered":"2023-12-24T18:51:21.820835+0000","last_unstale":"2023-12-24T18:51:21.822021+0000","last_undegraded":"2023-12-24T18:51:21.822021+0000","last_fullsized":"2023-12-24T18:51:21.822021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:34.673863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815997+0000","last_change":"2023-12-24T18:51:20.792138+0000","last_active":"2023-12-24T18:51:21.815997+0000","last_peered":"2023-12-24T18:51:21.815997+0000","last_clean":"2023-12-24T18:51:21.815997+0000","last_became_active":"2023-12-24T18:51:20.791834+0000","last_became_peered":"2023-12-24T18:51:20.791834+0000","last_unstale":"2023-12-24T18:51:21.815997+0000","last_undegraded":"2023-12-24T18:51:21.815997+0000","last_fullsized":"2023-12-24T18:51:21.815997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:34.490587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812210+0000","last_change":"2023-12-24T18:51:21.806603+0000","last_active":"2023-12-24T18:51:21.812210+0000","last_peered":"2023-12-24T18:51:21.812210+0000","last_clean":"2023-12-24T18:51:21.812210+0000","last_became_active":"2023-12-24T18:51:21.806278+0000","last_became_peered":"2023-12-24T18:51:21.806278+0000","last_unstale":"2023-12-24T18:51:21.812210+0000","last_undegraded":"2023-12-24T18:51:21.812210+0000","last_fullsized":"2023-12-24T18:51:21.812210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:19.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-24T18:51:22.982304+0000","last_change":"2023-12-24T18:51:20.786762+0000","last_active":"2023-12-24T18:51:22.982304+0000","last_peered":"2023-12-24T18:51:22.982304+0000","last_clean":"2023-12-24T18:51:22.982304+0000","last_became_active":"2023-12-24T18:51:20.786201+0000","last_became_peered":"2023-12-24T18:51:20.786201+0000","last_unstale":"2023-12-24T18:51:22.982304+0000","last_undegraded":"2023-12-24T18:51:22.982304+0000","last_fullsized":"2023-12-24T18:51:22.982304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:08.896817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.816846+0000","last_change":"2023-12-24T18:51:21.805091+0000","last_active":"2023-12-24T18:51:21.816846+0000","last_peered":"2023-12-24T18:51:21.816846+0000","last_clean":"2023-12-24T18:51:21.816846+0000","last_became_active":"2023-12-24T18:51:21.804789+0000","last_became_peered":"2023-12-24T18:51:21.804789+0000","last_unstale":"2023-12-24T18:51:21.816846+0000","last_undegraded":"2023-12-24T18:51:21.816846+0000","last_fullsized":"2023-12-24T18:51:21.816846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:11.577979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.800246+0000","last_change":"2023-12-24T18:51:20.800325+0000","last_active":"2023-12-24T18:51:21.800246+0000","last_peered":"2023-12-24T18:51:21.800246+0000","last_clean":"2023-12-24T18:51:21.800246+0000","last_became_active":"2023-12-24T18:51:20.799937+0000","last_became_peered":"2023-12-24T18:51:20.799937+0000","last_unstale":"2023-12-24T18:51:21.800246+0000","last_undegraded":"2023-12-24T18:51:21.800246+0000","last_fullsized":"2023-12-24T18:51:21.800246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:42.005965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.815532+0000","last_change":"2023-12-24T18:51:21.805172+0000","last_active":"2023-12-24T18:51:21.815532+0000","last_peered":"2023-12-24T18:51:21.815532+0000","last_clean":"2023-12-24T18:51:21.815532+0000","last_became_active":"2023-12-24T18:51:21.804860+0000","last_became_peered":"2023-12-24T18:51:21.804860+0000","last_unstale":"2023-12-24T18:51:21.815532+0000","last_undegraded":"2023-12-24T18:51:21.815532+0000","last_fullsized":"2023-12-24T18:51:21.815532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:43:24.570402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.805302+0000","last_change":"2023-12-24T18:51:20.800807+0000","last_active":"2023-12-24T18:51:21.805302+0000","last_peered":"2023-12-24T18:51:21.805302+0000","last_clean":"2023-12-24T18:51:21.805302+0000","last_became_active":"2023-12-24T18:51:20.800021+0000","last_became_peered":"2023-12-24T18:51:20.800021+0000","last_unstale":"2023-12-24T18:51:21.805302+0000","last_undegraded":"2023-12-24T18:51:21.805302+0000","last_fullsized":"2023-12-24T18:51:21.805302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:56.206215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.806406+0000","last_change":"2023-12-24T18:51:21.799830+0000","last_active":"2023-12-24T18:51:21.806406+0000","last_peered":"2023-12-24T18:51:21.806406+0000","last_clean":"2023-12-24T18:51:21.806406+0000","last_became_active":"2023-12-24T18:51:21.799513+0000","last_became_peered":"2023-12-24T18:51:21.799513+0000","last_unstale":"2023-12-24T18:51:21.806406+0000","last_undegraded":"2023-12-24T18:51:21.806406+0000","last_fullsized":"2023-12-24T18:51:21.806406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:27.608666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.814015+0000","last_change":"2023-12-24T18:51:20.795218+0000","last_active":"2023-12-24T18:51:21.814015+0000","last_peered":"2023-12-24T18:51:21.814015+0000","last_clean":"2023-12-24T18:51:21.814015+0000","last_became_active":"2023-12-24T18:51:20.794894+0000","last_became_peered":"2023-12-24T18:51:20.794894+0000","last_unstale":"2023-12-24T18:51:21.814015+0000","last_undegraded":"2023-12-24T18:51:21.814015+0000","last_fullsized":"2023-12-24T18:51:21.814015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:22.664805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.826633+0000","last_change":"2023-12-24T18:51:21.820648+0000","last_active":"2023-12-24T18:51:21.826633+0000","last_peered":"2023-12-24T18:51:21.826633+0000","last_clean":"2023-12-24T18:51:21.826633+0000","last_became_active":"2023-12-24T18:51:21.820365+0000","last_became_peered":"2023-12-24T18:51:21.820365+0000","last_unstale":"2023-12-24T18:51:21.826633+0000","last_undegraded":"2023-12-24T18:51:21.826633+0000","last_fullsized":"2023-12-24T18:51:21.826633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:22.978393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787304+0000","last_change":"2023-12-24T18:51:20.795379+0000","last_active":"2023-12-24T18:51:21.787304+0000","last_peered":"2023-12-24T18:51:21.787304+0000","last_clean":"2023-12-24T18:51:21.787304+0000","last_became_active":"2023-12-24T18:51:20.794763+0000","last_became_peered":"2023-12-24T18:51:20.794763+0000","last_unstale":"2023-12-24T18:51:21.787304+0000","last_undegraded":"2023-12-24T18:51:21.787304+0000","last_fullsized":"2023-12-24T18:51:21.787304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:46.484178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.830962+0000","last_change":"2023-12-24T18:51:21.830222+0000","last_active":"2023-12-24T18:51:21.830962+0000","last_peered":"2023-12-24T18:51:21.830962+0000","last_clean":"2023-12-24T18:51:21.830962+0000","last_became_active":"2023-12-24T18:51:21.829914+0000","last_became_peered":"2023-12-24T18:51:21.829914+0000","last_unstale":"2023-12-24T18:51:21.830962+0000","last_undegraded":"2023-12-24T18:51:21.830962+0000","last_fullsized":"2023-12-24T18:51:21.830962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.279766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.787204+0000","last_change":"2023-12-24T18:51:20.797264+0000","last_active":"2023-12-24T18:51:21.787204+0000","last_peered":"2023-12-24T18:51:21.787204+0000","last_clean":"2023-12-24T18:51:21.787204+0000","last_became_active":"2023-12-24T18:51:20.796622+0000","last_became_peered":"2023-12-24T18:51:20.796622+0000","last_unstale":"2023-12-24T18:51:21.787204+0000","last_undegraded":"2023-12-24T18:51:21.787204+0000","last_fullsized":"2023-12-24T18:51:21.787204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:17.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.825231+0000","last_change":"2023-12-24T18:51:21.823379+0000","last_active":"2023-12-24T18:51:21.825231+0000","last_peered":"2023-12-24T18:51:21.825231+0000","last_clean":"2023-12-24T18:51:21.825231+0000","last_became_active":"2023-12-24T18:51:21.822915+0000","last_became_peered":"2023-12-24T18:51:21.822915+0000","last_unstale":"2023-12-24T18:51:21.825231+0000","last_undegraded":"2023-12-24T18:51:21.825231+0000","last_fullsized":"2023-12-24T18:51:21.825231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:40.383017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.798113+0000","last_change":"2023-12-24T18:51:20.800223+0000","last_active":"2023-12-24T18:51:21.798113+0000","last_peered":"2023-12-24T18:51:21.798113+0000","last_clean":"2023-12-24T18:51:21.798113+0000","last_became_active":"2023-12-24T18:51:20.797749+0000","last_became_peered":"2023-12-24T18:51:20.797749+0000","last_unstale":"2023-12-24T18:51:21.798113+0000","last_undegraded":"2023-12-24T18:51:21.798113+0000","last_fullsized":"2023-12-24T18:51:21.798113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:42.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.812812+0000","last_change":"2023-12-24T18:51:21.803735+0000","last_active":"2023-12-24T18:51:21.812812+0000","last_peered":"2023-12-24T18:51:21.812812+0000","last_clean":"2023-12-24T18:51:21.812812+0000","last_became_active":"2023-12-24T18:51:21.803444+0000","last_became_peered":"2023-12-24T18:51:21.803444+0000","last_unstale":"2023-12-24T18:51:21.812812+0000","last_undegraded":"2023-12-24T18:51:21.812812+0000","last_fullsized":"2023-12-24T18:51:21.812812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:20.756203+0000","last_clean_scrub_stamp":"2023-12-24T18:51:20.756203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:21:22.617491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.786484+0000","last_change":"2023-12-24T18:51:20.803474+0000","last_active":"2023-12-24T18:51:21.786484+0000","last_peered":"2023-12-24T18:51:21.786484+0000","last_clean":"2023-12-24T18:51:21.786484+0000","last_became_active":"2023-12-24T18:51:20.803145+0000","last_became_peered":"2023-12-24T18:51:20.803145+0000","last_unstale":"2023-12-24T18:51:21.786484+0000","last_undegraded":"2023-12-24T18:51:21.786484+0000","last_fullsized":"2023-12-24T18:51:21.786484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:19.737278+0000","last_clean_scrub_stamp":"2023-12-24T18:51:19.737278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:56:35.643697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"73'161","reported_seq":372,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-24T18:51:21.810576+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:21.810576+0000","last_peered":"2023-12-24T18:51:21.810576+0000","last_clean":"2023-12-24T18:51:21.810576+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:21.810576+0000","last_undegraded":"2023-12-24T18:51:21.810576+0000","last_fullsized":"2023-12-24T18:51:21.810576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311156,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060684,"statfs":{"total":96636764160,"available":96318140416,"internally_reserved":0,"allocated":1617920,"data_stored":1096516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.81100000000000005,"5min":0.746,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":1.577,"15min":2.4159999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.258,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.95899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6339999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.0600000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1279999999999999,"15min":1.1439999999999999},"min":{"1min":0.88800000000000001,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.4850000000000001,"5min":1.5389999999999999,"15min":1.669},"last":1.115},{"interface":"front","average":{"1min":1.278,"5min":1.2,"15min":1.222},"min":{"1min":0.96499999999999997,"5min":0.78300000000000003,"15min":0.73099999999999998},"max":{"1min":1.625,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.319}]},{"osd":2,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.236,"15min":1.214},"min":{"1min":0.94299999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5620000000000001,"5min":1.625,"15min":1.704},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.24,"15min":1.236},"min":{"1min":0.98699999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.595,"5min":1.6799999999999999,"15min":1.893},"last":1.381}]},{"osd":3,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0609999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.024},"last":1.45},{"interface":"front","average":{"1min":1.329,"5min":1.284,"15min":1.3080000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.623,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.514}]},{"osd":4,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1879999999999999,"15min":1.1950000000000001},"min":{"1min":0.88700000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.417},{"interface":"front","average":{"1min":1.256,"5min":1.2430000000000001,"15min":1.2789999999999999},"min":{"1min":0.876,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6599999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2709999999999999,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.331,"15min":1.351},"min":{"1min":1.01,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.8380000000000001,"5min":1.9590000000000001,"15min":2.403},"last":1.48}]},{"osd":6,"last update":"Sun Dec 24 18:50:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.409,"15min":1.429},"min":{"1min":1.05,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9259999999999999,"5min":1.956,"15min":2.4889999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4059999999999999,"15min":1.4279999999999999},"min":{"1min":0.98599999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.2069999999999999},"last":1.54}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306468,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065372,"statfs":{"total":96636764160,"available":96322940928,"internally_reserved":0,"allocated":1011712,"data_stored":505434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.5329999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":1.254}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":0.94699999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.1479999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.042},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":1.629}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":1.294},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.228}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.431}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":1011712,"data_stored":505422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.177,"15min":1.1850000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.752},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3049999999999999,"15min":1.3029999999999999},"min":{"1min":0.876,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.839,"5min":1.839,"15min":2.73},"last":0.89000000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1100000000000001,"15min":1.139},"min":{"1min":0.75600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1599999999999999,"15min":1.1379999999999999},"min":{"1min":0.85199999999999998,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.997}]},{"osd":2,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.53900000000000003},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.296},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.254,"15min":1.2230000000000001},"min":{"1min":0.96899999999999997,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1659999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.292,"15min":1.2669999999999999},"min":{"1min":0.876,"5min":0.86699999999999999,"15min":0.82399999999999995},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3029999999999999,"15min":1.3},"min":{"1min":1.0149999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.639,"5min":1.786,"15min":2.1389999999999998},"last":1.0549999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1519999999999999,"15min":1.1339999999999999},"min":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.607,"5min":1.633,"15min":2.202},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.266,"15min":1.256},"min":{"1min":0.85399999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2509999999999999,"15min":1.2829999999999999},"min":{"1min":0.82199999999999995,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":2.3959999999999999},"last":1.357},{"interface":"front","average":{"1min":1.27,"5min":1.29,"15min":1.3029999999999999},"min":{"1min":0.93999999999999995,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":1.611,"5min":1.724,"15min":2.6280000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.403,"15min":1.403},"min":{"1min":1.022,"5min":0.88,"15min":0.872},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.879},"last":1.54},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.397,"15min":1.415},"min":{"1min":1.151,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.889,"5min":1.911,"15min":2.2429999999999999},"last":1.4430000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":506936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.81399999999999995,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.6000000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.232,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.79300000000000004,"15min":0.64500000000000002},"max":{"1min":1.609,"5min":1.621,"15min":1.6879999999999999},"last":1.091}]},{"osd":1,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.1459999999999999},"min":{"1min":0.871,"5min":0.73199999999999998,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.589,"15min":1.9830000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1519999999999999,"15min":1.125},"min":{"1min":0.879,"5min":0.76200000000000001,"15min":0.48799999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.1819999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3200000000000001,"15min":1.298},"min":{"1min":1.175,"5min":0.82699999999999996,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":1.798},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.329,"15min":1.3120000000000001},"min":{"1min":1.2110000000000001,"5min":0.92100000000000004,"15min":0.69699999999999995},"max":{"1min":1.6519999999999999,"5min":1.748,"15min":1.748},"last":1.5029999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.179,"15min":1.1699999999999999},"min":{"1min":1.05,"5min":0.70699999999999996,"15min":0.61299999999999999},"max":{"1min":1.6830000000000001,"5min":1.714,"15min":1.736},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.274,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.93100000000000005,"5min":0.86699999999999999,"15min":0.77400000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.839},"last":1.0409999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.2829999999999999,"15min":1.252},"min":{"1min":1.105,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":1.744,"5min":1.837,"15min":1.837},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.3200000000000001,"15min":1.3049999999999999},"min":{"1min":1.262,"5min":0.623,"15min":0.623},"max":{"1min":1.7789999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.321}]},{"osd":6,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.274},"min":{"1min":0.94099999999999995,"5min":0.78200000000000003,"15min":0.745},"max":{"1min":1.823,"5min":1.823,"15min":1.881},"last":1.353},{"interface":"front","average":{"1min":1.413,"5min":1.3500000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.829,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2929999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.319,"15min":1.292},"min":{"1min":1.133,"5min":0.77900000000000003,"15min":0.753},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.161},"last":1.236},{"interface":"front","average":{"1min":1.494,"5min":1.4079999999999999,"15min":1.399},"min":{"1min":1.1180000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.9359999999999999},"last":1.476}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97699999999999998,"15min":0.95999999999999996},"min":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.44400000000000001},"max":{"1min":1.4099999999999999,"5min":1.577,"15min":1.5980000000000001},"last":0.753},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1200000000000001,"15min":1.056},"min":{"1min":0.74299999999999999,"5min":0.65500000000000003,"15min":0.46000000000000002},"max":{"1min":1.417,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.4330000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.42999999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.204,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.871,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5269999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1850000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.077,"15min":1.097},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":1.337},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1859999999999999,"15min":1.177},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.05}]},{"osd":4,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.262,"15min":1.244},"min":{"1min":0.91500000000000004,"5min":0.82199999999999995,"15min":0.64600000000000002},"max":{"1min":1.6120000000000001,"5min":1.7609999999999999,"15min":1.766},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.345,"15min":1.343},"min":{"1min":1.167,"5min":0.96499999999999997,"15min":0.66300000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.9710000000000001},"last":1.127}]},{"osd":5,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.782,"5min":1.837,"15min":2.1739999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4510000000000001,"15min":1.45},"min":{"1min":1.0289999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.1539999999999999},"last":1.4670000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":1.1859999999999999,"5min":1.153,"15min":0.92200000000000004},"max":{"1min":2.0579999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.393},{"interface":"front","average":{"1min":1.452,"5min":1.431,"15min":1.419},"min":{"1min":0.98799999999999999,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7529999999999999,"5min":1.9610000000000001,"15min":2.3730000000000002},"last":1.272}]},{"osd":7,"last update":"Sun Dec 24 18:50:40 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.488,"15min":1.47},"min":{"1min":1.0700000000000001,"5min":1.0620000000000001,"15min":0.79500000000000004},"max":{"1min":1.7370000000000001,"5min":2.1070000000000002,"15min":2.4460000000000002},"last":1.089},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5149999999999999,"15min":1.518},"min":{"1min":1.103,"5min":1.103,"15min":0.85799999999999998},"max":{"1min":1.7350000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310560,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061280,"statfs":{"total":96636764160,"available":96318750720,"internally_reserved":0,"allocated":1007616,"data_stored":505400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91700000000000004,"15min":0.94199999999999995},"min":{"1min":0.61499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2110000000000001,"5min":1.411,"15min":1.8420000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.091,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.84099999999999997,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":1.0629999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92600000000000005,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0429999999999999,"15min":1.079},"min":{"1min":0.75700000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6519999999999999,"5min":1.976,"15min":1.976},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1279999999999999,"15min":1.1539999999999999},"min":{"1min":0.71099999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.625,"5min":1.625,"15min":2.6579999999999999},"last":0.998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0600000000000001,"15min":1.105},"min":{"1min":0.81499999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.542,"5min":1.6819999999999999,"15min":2.524},"last":0.69099999999999995}]},{"osd":4,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.298,"15min":1.3520000000000001},"min":{"1min":1.083,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.639,"5min":1.6599999999999999,"15min":3.1480000000000001},"last":1.304},{"interface":"front","average":{"1min":1.365,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":1.226,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5449999999999999,"5min":1.6419999999999999,"15min":2.8740000000000001},"last":1.141}]},{"osd":5,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.266,"15min":1.325},"min":{"1min":0.98799999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.734,"5min":1.734,"15min":3.093},"last":1.401},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.357,"15min":1.3959999999999999},"min":{"1min":1.02,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.841,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.395,"15min":1.448},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9299999999999999,"5min":1.944,"15min":3.589},"last":1.089},{"interface":"front","average":{"1min":1.474,"5min":1.377,"15min":1.4470000000000001},"min":{"1min":1.1799999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.3340000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:50:42 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.45,"15min":1.502},"min":{"1min":1.206,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.0710000000000002,"15min":3.242},"last":1.431},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.464,"15min":1.51},"min":{"1min":1.151,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.361}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302396,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069444,"statfs":{"total":96636764160,"available":96327110656,"internally_reserved":0,"allocated":1036288,"data_stored":507672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.70999999999999996,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.663,"5min":1.8149999999999999,"15min":4.149},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.155},"min":{"1min":0.88300000000000001,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.97499999999999998},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.204,"5min":1.1220000000000001,"15min":1.1619999999999999},"min":{"1min":0.754,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.73,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.155}]},{"osd":3,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.272,"15min":1.2949999999999999},"min":{"1min":1.0629999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8140000000000001,"5min":1.915,"15min":4.1849999999999996},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.1240000000000001,"15min":1.1359999999999999},"min":{"1min":0.87,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3480000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.4610000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.262,"15min":1.278},"min":{"1min":1.1759999999999999,"5min":0.66100000000000003,"15min":0.64100000000000001},"max":{"1min":1.681,"5min":1.681,"15min":3.2629999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.4370000000000001,"15min":1.462},"min":{"1min":1.2190000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.1930000000000001,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.077}]},{"osd":5,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.3959999999999999,"15min":1.431},"min":{"1min":0.999,"5min":0.879,"15min":0.879},"max":{"1min":1.887,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3540000000000001,"15min":1.3979999999999999},"min":{"1min":1.0589999999999999,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.6799999999999999,"5min":1.8340000000000001,"15min":2.637},"last":1.506}]},{"osd":6,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.514,"15min":1.542},"min":{"1min":1.282,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":2.1269999999999998,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.482,"15min":1.518},"min":{"1min":1.0409999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8260000000000001,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.8879999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.524,"15min":1.569},"min":{"1min":1.198,"5min":0.754,"15min":0.754},"max":{"1min":1.802,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.544,"5min":1.4730000000000001,"15min":1.498},"min":{"1min":1.208,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.919,"5min":1.9710000000000001,"15min":2.798},"last":1.446}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307044,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064796,"statfs":{"total":96636764160,"available":96322351104,"internally_reserved":0,"allocated":1601536,"data_stored":1095768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.65700000000000003,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.879},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.72099999999999997,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.429,"5min":1.702,"15min":1.746},"last":1.4179999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":1.0549999999999999},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.7,"15min":1.7},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.113,"15min":1.1240000000000001},"min":{"1min":0.78500000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.0760000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.0049999999999999,"15min":1.0249999999999999},"min":{"1min":0.69599999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.819},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.234,"15min":1.248},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.5349999999999999,"5min":1.929,"15min":1.929},"last":1.488}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.593,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.196},{"interface":"front","average":{"1min":1.244,"5min":1.262,"15min":1.3049999999999999},"min":{"1min":0.97999999999999998,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.651,"5min":1.762,"15min":1.762},"last":1.1519999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.373,"15min":1.4119999999999999},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":1.825,"5min":1.952,"15min":2.391},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.4350000000000001},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.6719999999999999,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.3029999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3149999999999999,"15min":1.389},"min":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4590000000000001,"5min":1.877,"15min":2.0779999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.47,"15min":1.5069999999999999},"min":{"1min":1.2609999999999999,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":1.903,"5min":2.161,"15min":2.23},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4670000000000001,"15min":1.5089999999999999},"min":{"1min":1.2050000000000001,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":1.5820000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.409,"15min":1.482},"min":{"1min":1.179,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.736,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.462}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:51:31.319 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:51:31.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:51:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.530+0000 7f5e27785700 1 Processor -- start 2023-12-24T18:51:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.530+0000 7f5e27785700 1 -- start start 2023-12-24T18:51:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.530+0000 7f5e27785700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e20159070 0x7f5e200cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.530+0000 7f5e27785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e200ca850 0x7f5e2006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e27785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2006b5c0 con 0x7f5e20159440 2023-12-24T18:51:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e27785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2006a9b0 con 0x7f5e200ca850 2023-12-24T18:51:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e27785700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2006ac90 con 0x7f5e20159070 2023-12-24T18:51:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e200ca850 0x7f5e2006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e200ca850 0x7f5e2006ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49348/0 (socket says 172.21.15.50:49348) 2023-12-24T18:51:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e25d22700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e20159440 0x7f5e2006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39672/0 (socket says 172.21.15.50:39672) 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 -- 172.21.15.50:0/3146703659 learned_addr learned my addr 172.21.15.50:0/3146703659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e25521700 1 --2- 172.21.15.50:0/3146703659 >> v2:172.21.15.82:3300/0 conn(0x7f5e20159070 0x7f5e200cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 -- 172.21.15.50:0/3146703659 >> v2:172.21.15.82:3300/0 conn(0x7f5e20159070 msgr2=0x7f5e200cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 --2- 172.21.15.50:0/3146703659 >> v2:172.21.15.82:3300/0 conn(0x7f5e20159070 0x7f5e200cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 -- 172.21.15.50:0/3146703659 >> v1:172.21.15.50:6789/0 conn(0x7f5e20159440 legacy=0x7f5e2006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e17fff700 1 -- 172.21.15.50:0/3146703659 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264759851 0 0) 0x7f5e2006b5c0 con 0x7f5e20159440 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 -- 172.21.15.50:0/3146703659 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2006af70 con 0x7f5e200ca850 2023-12-24T18:51:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e24d20700 1 --2- 172.21.15.50:0/3146703659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e2006ba50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5e20068000 tx=0x7f5e10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cad7f08f22aaf72 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e17fff700 1 -- 172.21.15.50:0/3146703659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10009e70 con 0x7f5e200ca850 2023-12-24T18:51:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e17fff700 1 -- 172.21.15.50:0/3146703659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1000b860 con 0x7f5e200ca850 2023-12-24T18:51:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.534+0000 7f5e17fff700 1 -- 172.21.15.50:0/3146703659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000bc00 con 0x7f5e200ca850 2023-12-24T18:51:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- 172.21.15.50:0/3146703659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 msgr2=0x7f5e2006ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 --2- 172.21.15.50:0/3146703659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e2006ba50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5e20068000 tx=0x7f5e10009250 comp rx=0 tx=0).stop 2023-12-24T18:51:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- 172.21.15.50:0/3146703659 shutdown_connections 2023-12-24T18:51:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 --2- 172.21.15.50:0/3146703659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e2006ba50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 --2- 172.21.15.50:0/3146703659 >> v2:172.21.15.82:3300/0 conn(0x7f5e20159070 0x7f5e200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- 172.21.15.50:0/3146703659 >> 172.21.15.50:0/3146703659 conn(0x7f5e20067b50 msgr2=0x7f5e200cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- 172.21.15.50:0/3146703659 shutdown_connections 2023-12-24T18:51:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- 172.21.15.50:0/3146703659 wait complete. 2023-12-24T18:51:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 Processor -- start 2023-12-24T18:51:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.538+0000 7f5e27785700 1 -- start start 2023-12-24T18:51:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 0x7f5e20154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e20159440 0x7f5e200c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20152d50 con 0x7f5e200ca850 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200c6620 con 0x7f5e20159070 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20154090 con 0x7f5e20159440 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49364/0 (socket says 172.21.15.50:49364) 2023-12-24T18:51:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 -- 172.21.15.50:0/1239856207 learned_addr learned my addr 172.21.15.50:0/1239856207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e24d20700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 0x7f5e20154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 -- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e20159440 msgr2=0x7f5e200c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e20159440 0x7f5e200c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 -- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 msgr2=0x7f5e20154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 0x7f5e20154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 -- 172.21.15.50:0/1239856207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e100094f0 con 0x7f5e200ca850 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e24d20700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 0x7f5e20154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e25521700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00ec80 tx=0x7f5e1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00c9d0 con 0x7f5e200ca850 2023-12-24T18:51:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c00cb30 con 0x7f5e200ca850 2023-12-24T18:51:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c013470 con 0x7f5e200ca850 2023-12-24T18:51:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e20169e30 con 0x7f5e200ca850 2023-12-24T18:51:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.542+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e20153760 con 0x7f5e200ca850 2023-12-24T18:51:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.546+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e200652e0 con 0x7f5e200ca850 2023-12-24T18:51:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.546+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5e1c0137e0 con 0x7f5e200ca850 2023-12-24T18:51:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.550+0000 7f5e157fa700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 0x7f5e04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.550+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f5e1c07ce40 con 0x7f5e200ca850 2023-12-24T18:51:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.550+0000 7f5e24d20700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 0x7f5e04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.550+0000 7f5e24d20700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 0x7f5e04062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e20068000 tx=0x7f5e10017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.558+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e1c04d0d0 con 0x7f5e200ca850 2023-12-24T18:51:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.786+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5e2006b2e0 con 0x7f5e200ca850 2023-12-24T18:51:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.798+0000 7f5e157fa700 1 -- 172.21.15.50:0/1239856207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5e1c0506f0 con 0x7f5e200ca850 2023-12-24T18:51:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 msgr2=0x7f5e04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 0x7f5e04062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e20068000 tx=0x7f5e10017000 comp rx=0 tx=0).stop 2023-12-24T18:51:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 msgr2=0x7f5e201698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00ec80 tx=0x7f5e1c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 shutdown_connections 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e04060550 0x7f5e04062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e20159440 0x7f5e200c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e20159070 0x7f5e20154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 --2- 172.21.15.50:0/1239856207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200ca850 0x7f5e201698f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 >> 172.21.15.50:0/1239856207 conn(0x7f5e20067b50 msgr2=0x7f5e200cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 shutdown_connections 2023-12-24T18:51:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.802+0000 7f5e27785700 1 -- 172.21.15.50:0/1239856207 wait complete. 2023-12-24T18:51:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:51:31.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:31.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.986+0000 7f557968e700 1 Processor -- start 2023-12-24T18:51:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.986+0000 7f557968e700 1 -- start start 2023-12-24T18:51:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f557968e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f557968e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f557406c820 0x7f55740ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f557968e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740b0460 con 0x7f55740adc90 2023-12-24T18:51:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f557968e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557406d8c0 con 0x7f557406c820 2023-12-24T18:51:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f557968e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740afc60 con 0x7f557415a2d0 2023-12-24T18:51:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42378/0 (socket says 172.21.15.50:42378) 2023-12-24T18:51:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 -- 172.21.15.50:0/252872374 learned_addr learned my addr 172.21.15.50:0/252872374 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f55737fe700 1 --2- 172.21.15.50:0/252872374 >> v2:172.21.15.82:3300/0 conn(0x7f557406c820 0x7f55740ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 -- 172.21.15.50:0/252872374 >> v2:172.21.15.82:3300/0 conn(0x7f557406c820 msgr2=0x7f55740ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 --2- 172.21.15.50:0/252872374 >> v2:172.21.15.82:3300/0 conn(0x7f557406c820 0x7f55740ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 -- 172.21.15.50:0/252872374 >> v1:172.21.15.82:6789/0 conn(0x7f55740adc90 legacy=0x7f55740b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.990+0000 7f5573fff700 1 -- 172.21.15.50:0/252872374 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740ae100 con 0x7f557415a2d0 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f5573fff700 1 --2- 172.21.15.50:0/252872374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55640099b0 tx=0x7f5564009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c07d9a17ebd86a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f5572ffd700 1 -- 172.21.15.50:0/252872374 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564009ea0 con 0x7f557415a2d0 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f5572ffd700 1 -- 172.21.15.50:0/252872374 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556400b860 con 0x7f557415a2d0 2023-12-24T18:51:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f5572ffd700 1 -- 172.21.15.50:0/252872374 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400bc00 con 0x7f557415a2d0 2023-12-24T18:51:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 -- 172.21.15.50:0/252872374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 msgr2=0x7f55740ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 --2- 172.21.15.50:0/252872374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55640099b0 tx=0x7f5564009250 comp rx=0 tx=0).stop 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 -- 172.21.15.50:0/252872374 shutdown_connections 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 --2- 172.21.15.50:0/252872374 >> v2:172.21.15.82:3300/0 conn(0x7f557406c820 0x7f55740ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 --2- 172.21.15.50:0/252872374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f557415a2d0 0x7f55740ae8b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 -- 172.21.15.50:0/252872374 >> 172.21.15.50:0/252872374 conn(0x7f5574067b80 msgr2=0x7f55740cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 -- 172.21.15.50:0/252872374 shutdown_connections 2023-12-24T18:51:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 -- 172.21.15.50:0/252872374 wait complete. 2023-12-24T18:51:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.994+0000 7f557968e700 1 Processor -- start 2023-12-24T18:51:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 -- start start 2023-12-24T18:51:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55740adc90 0x7f55740a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557415a2d0 0x7f55740a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a72b0 con 0x7f557406c820 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574153240 con 0x7f557415a2d0 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f557968e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a44c0 con 0x7f55740adc90 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49370/0 (socket says 172.21.15.50:49370) 2023-12-24T18:51:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 -- 172.21.15.50:0/2307341737 learned_addr learned my addr 172.21.15.50:0/2307341737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f55737fe700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55740adc90 0x7f55740a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5578e8d700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557415a2d0 0x7f55740a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 -- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55740adc90 msgr2=0x7f55740a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55740adc90 0x7f55740a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 -- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557415a2d0 msgr2=0x7f55740a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557415a2d0 0x7f55740a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 -- 172.21.15.50:0/2307341737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640094f0 con 0x7f557406c820 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:31.998+0000 7f5573fff700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f557406d870 tx=0x7f5564017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400b9d0 con 0x7f557406c820 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740a4760 con 0x7f557406c820 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556400bb30 con 0x7f557406c820 2023-12-24T18:51:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564011670 con 0x7f557406c820 2023-12-24T18:51:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740a6d70 con 0x7f557406c820 2023-12-24T18:51:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55740a70f0 con 0x7f557406c820 2023-12-24T18:51:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.002+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5564011a60 con 0x7f557406c820 2023-12-24T18:51:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.006+0000 7f555bfff700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.006+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f556407e260 con 0x7f557406c820 2023-12-24T18:51:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.006+0000 7f55737fe700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.006+0000 7f55737fe700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 0x7f5560062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55741548c0 tx=0x7f55680091a0 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.010+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f556404e4f0 con 0x7f557406c820 2023-12-24T18:51:32.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.222+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55740b0040 con 0x7f557406c820 2023-12-24T18:51:32.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.222+0000 7f555bfff700 1 -- 172.21.15.50:0/2307341737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f5564051b10 con 0x7f557406c820 2023-12-24T18:51:32.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:32.224 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 msgr2=0x7f5560062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 0x7f5560062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55741548c0 tx=0x7f55680091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 msgr2=0x7f5574152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f557406d870 tx=0x7f5564017000 comp rx=0 tx=0).stop 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 shutdown_connections 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557415a2d0 0x7f55740a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55740adc90 0x7f55740a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 --2- 172.21.15.50:0/2307341737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557406c820 0x7f5574152d00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 >> 172.21.15.50:0/2307341737 conn(0x7f5574067b80 msgr2=0x7f5574154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 shutdown_connections 2023-12-24T18:51:32.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.226+0000 7f557968e700 1 -- 172.21.15.50:0/2307341737 wait complete. 2023-12-24T18:51:32.230 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:32.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:51:21.222503+0000', 'modified': '2023-12-24T18:51:24.819095+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6349': {'gid': 6349, 'name': 'd', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6835/465649876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 465649876}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 465649876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:51:32.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:51:32.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-24T18:51:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 Processor -- start 2023-12-24T18:51:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 -- start start 2023-12-24T18:51:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f201c0ae100 0x7f201c161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f201c06c820 0x7f201c06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c06c4d0 con 0x7f201c1611b0 2023-12-24T18:51:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c06c1f0 con 0x7f201c0ae100 2023-12-24T18:51:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.830+0000 7f20229cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0ab5e0 con 0x7f201c06c820 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f201c06c820 0x7f201c06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f201c06c820 0x7f201c06cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:55458/0 (socket says 172.21.15.50:55458) 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 -- 172.21.15.50:0/2580568241 learned_addr learned my addr 172.21.15.50:0/2580568241 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20219ca700 1 --1- 172.21.15.50:0/2580568241 >> v1:172.21.15.82:6789/0 conn(0x7f201c1611b0 0x7f201c06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51066/0 (socket says 172.21.15.50:51066) 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20211c9700 1 --2- 172.21.15.50:0/2580568241 >> v2:172.21.15.50:3300/0 conn(0x7f201c0ae100 0x7f201c161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 -- 172.21.15.50:0/2580568241 >> v2:172.21.15.50:3300/0 conn(0x7f201c0ae100 msgr2=0x7f201c161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 --2- 172.21.15.50:0/2580568241 >> v2:172.21.15.50:3300/0 conn(0x7f201c0ae100 0x7f201c161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 -- 172.21.15.50:0/2580568241 >> v1:172.21.15.82:6789/0 conn(0x7f201c1611b0 legacy=0x7f201c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 -- 172.21.15.50:0/2580568241 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0ab8c0 con 0x7f201c06c820 2023-12-24T18:51:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20221cb700 1 --2- 172.21.15.50:0/2580568241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c06c820 0x7f201c06cc60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f201c06c100 tx=0x7f2014009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ebb6d3e0b1659cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20209c8700 1 -- 172.21.15.50:0/2580568241 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400e070 con 0x7f201c06c820 2023-12-24T18:51:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20209c8700 1 -- 172.21.15.50:0/2580568241 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400ba50 con 0x7f201c06c820 2023-12-24T18:51:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20209c8700 1 -- 172.21.15.50:0/2580568241 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140092e0 con 0x7f201c06c820 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 -- 172.21.15.50:0/2580568241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c06c820 msgr2=0x7f201c06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 --2- 172.21.15.50:0/2580568241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c06c820 0x7f201c06cc60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f201c06c100 tx=0x7f2014009840 comp rx=0 tx=0).stop 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 -- 172.21.15.50:0/2580568241 shutdown_connections 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 --2- 172.21.15.50:0/2580568241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c06c820 0x7f201c06cc60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 --2- 172.21.15.50:0/2580568241 >> v2:172.21.15.50:3300/0 conn(0x7f201c0ae100 0x7f201c161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 -- 172.21.15.50:0/2580568241 >> 172.21.15.50:0/2580568241 conn(0x7f201c067b80 msgr2=0x7f201c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 -- 172.21.15.50:0/2580568241 shutdown_connections 2023-12-24T18:51:32.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.834+0000 7f20229cc700 1 -- 172.21.15.50:0/2580568241 wait complete. 2023-12-24T18:51:32.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.838+0000 7f20229cc700 1 Processor -- start 2023-12-24T18:51:32.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.838+0000 7f20229cc700 1 -- start start 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f201c0ae100 0x7f201c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 0x7f201c15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1719d0 con 0x7f201c06c820 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c162500 con 0x7f201c1611b0 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1627e0 con 0x7f201c0ae100 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49394/0 (socket says 172.21.15.50:49394) 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 -- 172.21.15.50:0/1826888632 learned_addr learned my addr 172.21.15.50:0/1826888632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20211c9700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f201c0ae100 0x7f201c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20221cb700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 0x7f201c15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 -- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f201c0ae100 msgr2=0x7f201c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f201c0ae100 0x7f201c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 -- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 msgr2=0x7f201c15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 0x7f201c15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 -- 172.21.15.50:0/1826888632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009ae0 con 0x7f201c06c820 2023-12-24T18:51:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20221cb700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 0x7f201c15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:32.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20219ca700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f201800c7c0 tx=0x7f2018007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f2011ffb700 1 -- 172.21.15.50:0/1826888632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018005a70 con 0x7f201c06c820 2023-12-24T18:51:32.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f2011ffb700 1 -- 172.21.15.50:0/1826888632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018005bd0 con 0x7f201c06c820 2023-12-24T18:51:32.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c0c7b10 con 0x7f201c06c820 2023-12-24T18:51:32.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f2011ffb700 1 -- 172.21.15.50:0/1826888632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180070d0 con 0x7f201c06c820 2023-12-24T18:51:32.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.842+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c154e80 con 0x7f201c06c820 2023-12-24T18:51:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.846+0000 7f2011ffb700 1 -- 172.21.15.50:0/1826888632 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2018007480 con 0x7f201c06c820 2023-12-24T18:51:32.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.846+0000 7f2011ffb700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 0x7f2000062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2011ffb700 1 -- 172.21.15.50:0/1826888632 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f201807bd20 con 0x7f201c06c820 2023-12-24T18:51:32.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20211c9700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 0x7f2000062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20211c9700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 0x7f2000062ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f201c1620f0 tx=0x7f200c008040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 Processor -- start 2023-12-24T18:51:32.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 -- start start 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aec980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a19f30 con 0x286eae0 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a15ed0 con 0x286e710 2023-12-24T18:51:32.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x29dc0b0 con 0x28b9790 2023-12-24T18:51:32.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49398/0 (socket says 172.21.15.50:49398) 2023-12-24T18:51:32.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20219ca700 1 -- 172.21.15.50:0/3138268205 learned_addr learned my addr 172.21.15.50:0/3138268205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.850+0000 7f20211c9700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20221cb700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 -- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 msgr2=0x2aec980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aec980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 -- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 msgr2=0x2aec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 -- 172.21.15.50:0/3138268205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28ba9e0 con 0x286eae0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20211c9700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f20219ca700 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f20180070a0 tx=0x7f2018079e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7829d88c27edb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2006ffd700 1 -- 172.21.15.50:0/3138268205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018065070 con 0x286eae0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2006ffd700 1 -- 172.21.15.50:0/3138268205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018052f80 con 0x286eae0 2023-12-24T18:51:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2006ffd700 1 -- 172.21.15.50:0/3138268205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018056cd0 con 0x286eae0 2023-12-24T18:51:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 -- 172.21.15.50:0/3138268205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 msgr2=0x2aebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f20180070a0 tx=0x7f2018079e40 comp rx=0 tx=0).stop 2023-12-24T18:51:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 -- 172.21.15.50:0/3138268205 shutdown_connections 2023-12-24T18:51:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aec980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 --2- 172.21.15.50:0/3138268205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aebf00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 -- 172.21.15.50:0/3138268205 >> 172.21.15.50:0/3138268205 conn(0x286eeb0 msgr2=0x2aa8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 -- 172.21.15.50:0/3138268205 shutdown_connections 2023-12-24T18:51:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.854+0000 7f2025ecd740 1 -- 172.21.15.50:0/3138268205 wait complete. 2023-12-24T18:51:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 -- start start 2023-12-24T18:51:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 Processor -- start 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286eae0 0x2af0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 0x2ad1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x29dbd50 con 0x286e710 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x29b4970 con 0x28b9790 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a1a810 con 0x286eae0 2023-12-24T18:51:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f2025ecd740 10 client.0 _ll_register_callbacks cb 0x2a5f6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:51:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49400/0 (socket says 172.21.15.50:49400) 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 -- 172.21.15.50:0/2377106528 learned_addr learned my addr 172.21.15.50:0/2377106528 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20221cb700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 0x2ad1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20211c9700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286eae0 0x2af0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 -- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286eae0 msgr2=0x2af0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286eae0 0x2af0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 -- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 msgr2=0x2ad1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 0x2ad1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20219ca700 1 -- 172.21.15.50:0/2377106528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c154e80 con 0x286e710 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.858+0000 7f20221cb700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 0x2ad1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f20219ca700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f20180070a0 tx=0x7f2018065000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e6c8400b3066c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018056d50 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29b4cc0 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f201804e090 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2018056840 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 10 client.6519 fetch_fsmap learned FSMap version 35 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x29e4370 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29b4cc0 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f201804bae0 con 0x286e710 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 10 client.6519 fetch_fsmap finished waiting for FSMap version 35 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 10 client.6519 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 20 client.6519 populate_metadata read hostname 'smithi050' 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2ad32a0 0x2afb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 4 client.6519 mds_command: new command op to 6349 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:51:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 --> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29b83e0 con 0x2ad32a0 2023-12-24T18:51:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f20211c9700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2ad32a0 0x2afb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f20211c9700 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2ad32a0 0x2afb6b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e936463a2fa3fdd server_cookie=28bd9e6f4ee3462c in_seq=0 out_seq=0 2023-12-24T18:51:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.862+0000 7f1ffbfff700 10 client.6519 ms_handle_connect on v2:172.21.15.82:6834/465649876 2023-12-24T18:51:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f1ffbfff700 1 -- 172.21.15.50:0/2377106528 <== mds.0 v2:172.21.15.82:6834/465649876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x29b83e0 con 0x2ad32a0 2023-12-24T18:51:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f1ffbfff700 10 client.6519 handle_command_reply: tid=0 2023-12-24T18:51:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 client.6519 shutdown 2023-12-24T18:51:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 msgr2=0x2af0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f20180070a0 tx=0x7f2018065000 comp rx=0 tx=0).stop 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 shutdown_connections 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2ad32a0 0x2afb6b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x28b9790 0x2ad1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f1ffbfff700 0 client.6519 ms_handle_reset on v2:172.21.15.82:6834/465649876 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286eae0 0x2af0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 --2- 172.21.15.50:0/2377106528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286e710 0x2af0510 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 >> 172.21.15.50:0/2377106528 conn(0x286eeb0 msgr2=0x2aa0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 shutdown_connections 2023-12-24T18:51:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 1 -- 172.21.15.50:0/2377106528 wait complete. 2023-12-24T18:51:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.866+0000 7f2025ecd740 20 client.6519 trim_cache size 0 max 16384 2023-12-24T18:51:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 Processor -- start 2023-12-24T18:51:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 -- start start 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aa2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aeb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x29eb550 con 0x286eae0 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e77c0 con 0x286e710 2023-12-24T18:51:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x28eb650 con 0x28b9790 2023-12-24T18:51:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49410/0 (socket says 172.21.15.50:49410) 2023-12-24T18:51:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 -- 172.21.15.50:0/1486315361 learned_addr learned my addr 172.21.15.50:0/1486315361 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20221cb700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20219ca700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aa2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 -- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 msgr2=0x2aeb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aeb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 -- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 msgr2=0x2aa2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aa2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20211c9700 1 -- 172.21.15.50:0/1486315361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29cad80 con 0x286eae0 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.890+0000 7f20219ca700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aa2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f20211c9700 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f200c006fd0 tx=0x7f200c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c9be4e8acfe9b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f20077fe700 1 -- 172.21.15.50:0/1486315361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c016890 con 0x286eae0 2023-12-24T18:51:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f20077fe700 1 -- 172.21.15.50:0/1486315361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0169f0 con 0x286eae0 2023-12-24T18:51:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f20077fe700 1 -- 172.21.15.50:0/1486315361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c016dd0 con 0x286eae0 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- 172.21.15.50:0/1486315361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 msgr2=0x2aa3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f200c006fd0 tx=0x7f200c017000 comp rx=0 tx=0).stop 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- 172.21.15.50:0/1486315361 shutdown_connections 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x28b9790 0x2aeb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x286eae0 0x2aa3010 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1486315361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286e710 0x2aa2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- 172.21.15.50:0/1486315361 >> 172.21.15.50:0/1486315361 conn(0x286eeb0 msgr2=0x2aa21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- 172.21.15.50:0/1486315361 shutdown_connections 2023-12-24T18:51:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- 172.21.15.50:0/1486315361 wait complete. 2023-12-24T18:51:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.894+0000 7f2025ecd740 1 -- start start 2023-12-24T18:51:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 Processor -- start 2023-12-24T18:51:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286e710 0x2b45ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286eae0 0x2b46010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1aef0 con 0x28b9790 2023-12-24T18:51:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a199d0 con 0x286eae0 2023-12-24T18:51:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a13890 con 0x286e710 2023-12-24T18:51:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f2025ecd740 10 client.0 _ll_register_callbacks cb 0x283a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f20221cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f20221cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49416/0 (socket says 172.21.15.50:49416) 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f20221cb700 1 -- 172.21.15.50:0/1403074791 learned_addr learned my addr 172.21.15.50:0/1403074791 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f20211c9700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286eae0 0x2b46010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.898+0000 7f20219ca700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286e710 0x2b45ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 -- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286e710 msgr2=0x2b45ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286e710 0x2b45ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 -- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286eae0 msgr2=0x2b46010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286eae0 0x2b46010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 -- 172.21.15.50:0/1403074791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c00e040 con 0x28b9790 2023-12-24T18:51:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20221cb700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2014009570 tx=0x7f2014018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada28e19dfb720d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:51:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014007200 con 0x28b9790 2023-12-24T18:51:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f201401c410 con 0x28b9790 2023-12-24T18:51:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2018056d50 con 0x28b9790 2023-12-24T18:51:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f201401c7e0 con 0x28b9790 2023-12-24T18:51:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 10 client.6525 fetch_fsmap learned FSMap version 35 2023-12-24T18:51:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x29bf130 con 0x28b9790 2023-12-24T18:51:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018056d50 con 0x28b9790 2023-12-24T18:51:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f201400b050 con 0x28b9790 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 10 client.6525 fetch_fsmap finished waiting for FSMap version 35 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 10 client.6525 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 20 client.6525 populate_metadata read hostname 'smithi050' 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2b4c9e0 0x2b4edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 4 client.6525 mds_command: new command op to 6349 tid=0[{"prefix": "status"}] 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 --> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f2018052f80 con 0x2b4c9e0 2023-12-24T18:51:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.902+0000 7f20219ca700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2b4c9e0 0x2b4edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20219ca700 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2b4c9e0 0x2b4edc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e94ed598c820b0a server_cookie=100739dfd4b4acd8 in_seq=0 out_seq=0 2023-12-24T18:51:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f1ffbfff700 10 client.6525 ms_handle_connect on v2:172.21.15.82:6834/465649876 2023-12-24T18:51:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f1ffbfff700 1 -- 172.21.15.50:0/1403074791 <== mds.0 v2:172.21.15.82:6834/465649876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f2018052f80 con 0x2b4c9e0 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f1ffbfff700 10 client.6525 handle_command_reply: tid=0 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 client.6525 shutdown 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 msgr2=0x2aa54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2014009570 tx=0x7f2014018000 comp rx=0 tx=0).stop 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 shutdown_connections 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:6834/465649876,v1:172.21.15.82:6835/465649876] conn(0x2b4c9e0 0x2b4edc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28b9790 0x2aa54c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x286eae0 0x2b46010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 --2- 172.21.15.50:0/1403074791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x286e710 0x2b45ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f1ffbfff700 0 client.6525 ms_handle_reset on v2:172.21.15.82:6834/465649876 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 >> 172.21.15.50:0/1403074791 conn(0x286eeb0 msgr2=0x2aa3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 shutdown_connections 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 1 -- 172.21.15.50:0/1403074791 wait complete. 2023-12-24T18:51:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f2025ecd740 20 client.6525 trim_cache size 0 max 16384 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6349, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.130086021, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 35, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 83, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 83, 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.035411808999999 2023-12-24T18:51:32.909 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:51:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 msgr2=0x7f2000062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 0x7f2000062ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f201c1620f0 tx=0x7f200c008040 comp rx=0 tx=0).stop 2023-12-24T18:51:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 msgr2=0x7f201c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f201800c7c0 tx=0x7f2018007f70 comp rx=0 tx=0).stop 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 shutdown_connections 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2000060620 0x7f2000062ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f201c1611b0 0x7f201c15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f201c0ae100 0x7f201c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 --2- 172.21.15.50:0/1826888632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f201c06c820 0x7f201c1550e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.906+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 >> 172.21.15.50:0/1826888632 conn(0x7f201c067b80 msgr2=0x7f201c0abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.910+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 shutdown_connections 2023-12-24T18:51:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:32.910+0000 7f20229cc700 1 -- 172.21.15.50:0/1826888632 wait complete. 2023-12-24T18:51:32.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:51:33.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.098+0000 7f0c31a2e700 1 Processor -- start 2023-12-24T18:51:33.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 -- start start 2023-12-24T18:51:33.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c2c0c6d00 0x7f0c2c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 0x7f0c2c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c06c820 con 0x7f0c2c06aca0 2023-12-24T18:51:33.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c154de0 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c31a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c06b960 con 0x7f0c2c154450 2023-12-24T18:51:33.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.102+0000 7f0c2affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c2c0c6d00 0x7f0c2c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c2c06aca0 0x7f0c2c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39674/0 (socket says 172.21.15.50:39674) 2023-12-24T18:51:33.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2b7fe700 1 -- 172.21.15.50:0/1756199839 learned_addr learned my addr 172.21.15.50:0/1756199839 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:33.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c23fff700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 0x7f0c2c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2a7fc700 1 -- 172.21.15.50:0/1756199839 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687834787 0 0) 0x7f0c2c06c820 con 0x7f0c2c06aca0 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2a7fc700 1 -- 172.21.15.50:0/1756199839 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c18003570 con 0x7f0c2c06aca0 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2affd700 1 -- 172.21.15.50:0/1756199839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 msgr2=0x7f0c2c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2affd700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 0x7f0c2c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2affd700 1 -- 172.21.15.50:0/1756199839 >> v1:172.21.15.50:6789/0 conn(0x7f0c2c06aca0 legacy=0x7f0c2c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2affd700 1 -- 172.21.15.50:0/1756199839 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c06bc40 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c23fff700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 0x7f0c2c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:33.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2affd700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c0c70d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0098e0 tx=0x7f0c1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6945fa213edda9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:33.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2a7fc700 1 -- 172.21.15.50:0/1756199839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00b640 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2a7fc700 1 -- 172.21.15.50:0/1756199839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00b7a0 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c2a7fc700 1 -- 172.21.15.50:0/1756199839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00bb40 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1756199839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0c6d00 msgr2=0x7f0c2c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c0c70d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0098e0 tx=0x7f0c1c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1756199839 shutdown_connections 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c154450 0x7f0c2c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1756199839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c0c70d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1756199839 >> 172.21.15.50:0/1756199839 conn(0x7f0c2c0cbba0 msgr2=0x7f0c2c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1756199839 shutdown_connections 2023-12-24T18:51:33.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.106+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1756199839 wait complete. 2023-12-24T18:51:33.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.110+0000 7f0c31a2e700 1 Processor -- start 2023-12-24T18:51:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.110+0000 7f0c31a2e700 1 -- start start 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c06aca0 0x7f0c2c140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c1558b0 con 0x7f0c2c154450 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c155b90 con 0x7f0c2c0c6d00 2023-12-24T18:51:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c155e70 con 0x7f0c2c06aca0 2023-12-24T18:51:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49434/0 (socket says 172.21.15.50:49434) 2023-12-24T18:51:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c06aca0 0x7f0c2c140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 -- 172.21.15.50:0/1305639937 learned_addr learned my addr 172.21.15.50:0/1305639937 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c23fff700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 -- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c06aca0 msgr2=0x7f0c2c140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c06aca0 0x7f0c2c140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 -- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c0c6d00 msgr2=0x7f0c2c152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 -- 172.21.15.50:0/1305639937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c009420 con 0x7f0c2c154450 2023-12-24T18:51:33.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c2b7fe700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c24001460 tx=0x7f0c24001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400a890 con 0x7f0c2c154450 2023-12-24T18:51:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2400a9f0 con 0x7f0c2c154450 2023-12-24T18:51:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400ad70 con 0x7f0c2c154450 2023-12-24T18:51:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c156150 con 0x7f0c2c154450 2023-12-24T18:51:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.114+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c1534d0 con 0x7f0c2c154450 2023-12-24T18:51:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.118+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c156650 con 0x7f0c2c154450 2023-12-24T18:51:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.118+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0c24007300 con 0x7f0c2c154450 2023-12-24T18:51:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.122+0000 7f0c22ffd700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 0x7f0c0c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.122+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f0c2407ce50 con 0x7f0c2c154450 2023-12-24T18:51:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.122+0000 7f0c2affd700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 0x7f0c0c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:33.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.122+0000 7f0c2affd700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 0x7f0c0c062a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0093f0 tx=0x7f0c1c017000 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:33.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.126+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c2404d160 con 0x7f0c2c154450 2023-12-24T18:51:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.334+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c2c0652e0 con 0x7f0c2c154450 2023-12-24T18:51:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.338+0000 7f0c22ffd700 1 -- 172.21.15.50:0/1305639937 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0c24050780 con 0x7f0c2c154450 2023-12-24T18:51:33.338 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 msgr2=0x7f0c0c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 0x7f0c0c062a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0093f0 tx=0x7f0c1c017000 comp rx=0 tx=0).stop 2023-12-24T18:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 msgr2=0x7f0c2c0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c24001460 tx=0x7f0c24001ae0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 shutdown_connections 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c0c060580 0x7f0c0c062a30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c154450 0x7f0c2c0adba0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c0c6d00 0x7f0c2c152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 --2- 172.21.15.50:0/1305639937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c2c06aca0 0x7f0c2c140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 >> 172.21.15.50:0/1305639937 conn(0x7f0c2c0cbba0 msgr2=0x7f0c2c158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 shutdown_connections 2023-12-24T18:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:33.342+0000 7f0c31a2e700 1 -- 172.21.15.50:0/1305639937 wait complete. 2023-12-24T18:51:33.363 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:51:33.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:51:33.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:51:33.363 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:51:33.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:33.364 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:51:33.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:51:33.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:51:33.364 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:51:33.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.364 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:51:33.383 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:51:33.384 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41517sec preferred_lft 41517sec 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:51:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:51:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:51:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:51:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:51:33.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.388 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:51:33.471 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:51:33.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.475 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:51:33.541 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:51:33.541 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:51:33.542 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:51:33.542 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:51:33.542 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:51:33.542 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:51:33.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:51:33.543 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:51:33.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.676 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:51:33.697 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:51:33.697 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:51:33.698 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:51:33.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:33.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:51:33.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:51:33.776 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:33.835 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:51:33.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:51:33.836 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:33.896 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:51:33.896 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:51:33.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:51:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:51:34.021 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:51:34.049 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:51:34.049 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:51:34.049 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:51:34.049 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:51:34.049 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:51:34.053 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:51:34.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:34.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:34.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:51:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 Processor -- start 2023-12-24T18:51:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 -- start start 2023-12-24T18:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 0x7f1c6015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 0x7f1c6006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6006ca50 con 0x7f1c600ca3a0 2023-12-24T18:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c600c6980 con 0x7f1c6015af90 2023-12-24T18:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c67acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6015b410 con 0x7f1c600ca770 2023-12-24T18:51:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c65869700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c600ca3a0 0x7f1c6006ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39682/0 (socket says 172.21.15.50:39682) 2023-12-24T18:51:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c65869700 1 -- 172.21.15.50:0/3460472097 learned_addr learned my addr 172.21.15.50:0/3460472097 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c65068700 1 --2- 172.21.15.50:0/3460472097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 0x7f1c6015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.298+0000 7f1c6606a700 1 --2- 172.21.15.50:0/3460472097 >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 0x7f1c6006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c65068700 1 -- 172.21.15.50:0/3460472097 >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 msgr2=0x7f1c6006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c65068700 1 --2- 172.21.15.50:0/3460472097 >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 0x7f1c6006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c65068700 1 -- 172.21.15.50:0/3460472097 >> v1:172.21.15.50:6789/0 conn(0x7f1c600ca3a0 legacy=0x7f1c6006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c65068700 1 -- 172.21.15.50:0/3460472097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6006b520 con 0x7f1c600ca770 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c6606a700 1 --2- 172.21.15.50:0/3460472097 >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 0x7f1c6006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c64867700 1 -- 172.21.15.50:0/3460472097 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034131479 0 0) 0x7f1c6006ca50 con 0x7f1c600ca3a0 2023-12-24T18:51:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c65068700 1 --2- 172.21.15.50:0/3460472097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 0x7f1c6015aa50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1c500098e0 tx=0x7f1c500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab993a170342480 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c64867700 1 -- 172.21.15.50:0/3460472097 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b640 con 0x7f1c600ca770 2023-12-24T18:51:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c64867700 1 -- 172.21.15.50:0/3460472097 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000b7a0 con 0x7f1c600ca770 2023-12-24T18:51:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c64867700 1 -- 172.21.15.50:0/3460472097 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000bb40 con 0x7f1c600ca770 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 -- 172.21.15.50:0/3460472097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 msgr2=0x7f1c6015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 --2- 172.21.15.50:0/3460472097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 0x7f1c6015aa50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1c500098e0 tx=0x7f1c500091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 -- 172.21.15.50:0/3460472097 shutdown_connections 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 --2- 172.21.15.50:0/3460472097 >> v2:172.21.15.82:3300/0 conn(0x7f1c6015af90 0x7f1c6006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 --2- 172.21.15.50:0/3460472097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c600ca770 0x7f1c6015aa50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 -- 172.21.15.50:0/3460472097 >> 172.21.15.50:0/3460472097 conn(0x7f1c600cbba0 msgr2=0x7f1c600cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 -- 172.21.15.50:0/3460472097 shutdown_connections 2023-12-24T18:51:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.302+0000 7f1c67acd700 1 -- 172.21.15.50:0/3460472097 wait complete. 2023-12-24T18:51:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.306+0000 7f1c67acd700 1 Processor -- start 2023-12-24T18:51:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 -- start start 2023-12-24T18:51:34.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c600ca3a0 0x7f1c6015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 0x7f1c60156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600afe30 con 0x7f1c600ca770 2023-12-24T18:51:34.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6015fe30 con 0x7f1c600ca3a0 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c67acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6015f220 con 0x7f1c6015af90 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c65068700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c65068700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49446/0 (socket says 172.21.15.50:49446) 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c65068700 1 -- 172.21.15.50:0/1098158769 learned_addr learned my addr 172.21.15.50:0/1098158769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 0x7f1c60156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c65869700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c600ca3a0 0x7f1c6015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 -- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c600ca3a0 msgr2=0x7f1c6015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c600ca3a0 0x7f1c6015ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 -- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 msgr2=0x7f1c600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 -- 172.21.15.50:0/1098158769 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009a20 con 0x7f1c6015af90 2023-12-24T18:51:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c65068700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.310+0000 7f1c6606a700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 0x7f1c60156ff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009f40 tx=0x7f1c5800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800cb70 con 0x7f1c6015af90 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5800f040 con 0x7f1c6015af90 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58014480 con 0x7f1c6015af90 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50009420 con 0x7f1c6015af90 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6015f7e0 con 0x7f1c6015af90 2023-12-24T18:51:34.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6015ffe0 con 0x7f1c6015af90 2023-12-24T18:51:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.314+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1c58003020 con 0x7f1c6015af90 2023-12-24T18:51:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.318+0000 7f1c55ffb700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 0x7f1c44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.318+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f1c5807d290 con 0x7f1c6015af90 2023-12-24T18:51:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.318+0000 7f1c65869700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 0x7f1c44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.318+0000 7f1c65869700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 0x7f1c44062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007160 tx=0x7f1c5c007f50 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.326+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1c6015ffe0 con 0x7f1c6015af90 2023-12-24T18:51:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.522+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c6015ffa0 con 0x7f1c44060550 2023-12-24T18:51:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.526+0000 7f1c55ffb700 1 -- 172.21.15.50:0/1098158769 <== mgr.6135 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1c6015ffa0 con 0x7f1c44060550 2023-12-24T18:51:34.527 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:51:34.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:34.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:51:34.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:34.528 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:51:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 msgr2=0x7f1c44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 0x7f1c44062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007160 tx=0x7f1c5c007f50 comp rx=0 tx=0).stop 2023-12-24T18:51:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 msgr2=0x7f1c60156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 0x7f1c60156ff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009f40 tx=0x7f1c5800b040 comp rx=0 tx=0).stop 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 shutdown_connections 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1c44060550 0x7f1c44062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c6015af90 0x7f1c60156ff0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c600ca770 0x7f1c600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 --2- 172.21.15.50:0/1098158769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c600ca3a0 0x7f1c6015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 >> 172.21.15.50:0/1098158769 conn(0x7f1c600cbba0 msgr2=0x7f1c600c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 shutdown_connections 2023-12-24T18:51:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.530+0000 7f1c67acd700 1 -- 172.21.15.50:0/1098158769 wait complete. 2023-12-24T18:51:34.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:51:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.726+0000 7f6802c03700 1 Processor -- start 2023-12-24T18:51:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.726+0000 7f6802c03700 1 -- start start 2023-12-24T18:51:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802c03700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67fc0ab920 0x7f67fc0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802c03700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0bef90 0x7f67fc0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802c03700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc0c9ea0 con 0x7f67fc0bebc0 2023-12-24T18:51:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802c03700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc15d840 con 0x7f67fc0ab920 2023-12-24T18:51:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802c03700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc161780 con 0x7f67fc0bef90 2023-12-24T18:51:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6801400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67fc0ab920 0x7f67fc0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6801400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67fc0ab920 0x7f67fc0c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49462/0 (socket says 172.21.15.50:49462) 2023-12-24T18:51:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6801400700 1 -- 172.21.15.50:0/616981416 learned_addr learned my addr 172.21.15.50:0/616981416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.730+0000 7f6802402700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0bef90 0x7f67fc0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6801400700 1 -- 172.21.15.50:0/616981416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0bef90 msgr2=0x7f67fc0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6801400700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0bef90 0x7f67fc0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6801400700 1 -- 172.21.15.50:0/616981416 >> v1:172.21.15.82:6789/0 conn(0x7f67fc0bebc0 legacy=0x7f67fc160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6801400700 1 -- 172.21.15.50:0/616981416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc161a60 con 0x7f67fc0ab920 2023-12-24T18:51:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6801400700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0ab920 0x7f67fc0c6f50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0099b0 tx=0x7f67ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2551a43890a30b69 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6800bff700 1 -- 172.21.15.50:0/616981416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00b860 con 0x7f67fc0ab920 2023-12-24T18:51:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6800bff700 1 -- 172.21.15.50:0/616981416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec00b9c0 con 0x7f67fc0ab920 2023-12-24T18:51:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6800bff700 1 -- 172.21.15.50:0/616981416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00bd60 con 0x7f67fc0ab920 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 -- 172.21.15.50:0/616981416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0ab920 msgr2=0x7f67fc0c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0ab920 0x7f67fc0c6f50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0099b0 tx=0x7f67ec009250 comp rx=0 tx=0).stop 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 -- 172.21.15.50:0/616981416 shutdown_connections 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0bef90 0x7f67fc0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 --2- 172.21.15.50:0/616981416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0ab920 0x7f67fc0c6f50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 -- 172.21.15.50:0/616981416 >> 172.21.15.50:0/616981416 conn(0x7f67fc067250 msgr2=0x7f67fc067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 -- 172.21.15.50:0/616981416 shutdown_connections 2023-12-24T18:51:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.734+0000 7f6802c03700 1 -- 172.21.15.50:0/616981416 wait complete. 2023-12-24T18:51:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.738+0000 7f6802c03700 1 Processor -- start 2023-12-24T18:51:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.738+0000 7f6802c03700 1 -- start start 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.738+0000 7f6802c03700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0ab920 0x7f67fc159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.738+0000 7f6802c03700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.738+0000 7f6802c03700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67fc0bef90 0x7f67fc0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802c03700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc16de10 con 0x7f67fc0bebc0 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802c03700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc16e0f0 con 0x7f67fc0bef90 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802c03700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc16e3d0 con 0x7f67fc0ab920 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49466/0 (socket says 172.21.15.50:49466) 2023-12-24T18:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 -- 172.21.15.50:0/2295605490 learned_addr learned my addr 172.21.15.50:0/2295605490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802402700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67fc0bef90 0x7f67fc0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801c01700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0ab920 0x7f67fc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 -- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0ab920 msgr2=0x7f67fc159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0ab920 0x7f67fc159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 -- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67fc0bef90 msgr2=0x7f67fc0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67fc0bef90 0x7f67fc0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 -- 172.21.15.50:0/2295605490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0094f0 con 0x7f67fc0bebc0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6801400700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009290 tx=0x7f67ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec024440 con 0x7f67fc0bebc0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0245a0 con 0x7f67fc0bebc0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc16e6b0 con 0x7f67fc0bebc0 2023-12-24T18:51:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec024960 con 0x7f67fc0bebc0 2023-12-24T18:51:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.742+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0c2a70 con 0x7f67fc0bebc0 2023-12-24T18:51:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.746+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc04be40 con 0x7f67fc0bebc0 2023-12-24T18:51:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.746+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f67ec01a420 con 0x7f67fc0bebc0 2023-12-24T18:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.750+0000 7f67f1ffb700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 0x7f67e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.750+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f67ec07e8f0 con 0x7f67fc0bebc0 2023-12-24T18:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.750+0000 7f6801c01700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 0x7f67e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.750+0000 7f6801c01700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 0x7f67e0062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67f8003860 tx=0x7f67f8009040 comp rx=0 tx=0).ready entity=mgr.6135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.754+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f67ec04eb80 con 0x7f67fc0bebc0 2023-12-24T18:51:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:34.978+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f67fc16df50 con 0x7f67fc0bebc0 2023-12-24T18:51:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.662+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 30) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f67ec04ef50 con 0x7f67fc0bebc0 2023-12-24T18:51:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.662+0000 7f67f1ffb700 1 -- 172.21.15.50:0/2295605490 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v30) v1 ==== 92+0+0 (secure 0 0 0) 0x7f67ec052610 con 0x7f67fc0bebc0 2023-12-24T18:51:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 msgr2=0x7f67e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 0x7f67e0062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67f8003860 tx=0x7f67f8009040 comp rx=0 tx=0).stop 2023-12-24T18:51:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 msgr2=0x7f67fc0c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009290 tx=0x7f67ec017000 comp rx=0 tx=0).stop 2023-12-24T18:51:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 shutdown_connections 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f67e0060550 0x7f67e0062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67fc0bef90 0x7f67fc0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67fc0bebc0 0x7f67fc0c5f70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 --2- 172.21.15.50:0/2295605490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67fc0ab920 0x7f67fc159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 >> 172.21.15.50:0/2295605490 conn(0x7f67fc067250 msgr2=0x7f67fc15a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 shutdown_connections 2023-12-24T18:51:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.666+0000 7f6802c03700 1 -- 172.21.15.50:0/2295605490 wait complete. 2023-12-24T18:51:35.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:51:35.852 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:35.846+0000 7f9a5735b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.862+0000 7fe8e5216700 1 Processor -- start 2023-12-24T18:51:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.862+0000 7fe8e5216700 1 -- start start 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e5216700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e5216700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8e006cd40 0x7fe8e006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e5216700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e006a580 con 0x7fe8e0158c40 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e5216700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00cd110 con 0x7fe8e006cd40 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e5216700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e006d700 con 0x7fe8e00cc780 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8e006cd40 0x7fe8e006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8df7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8e006cd40 0x7fe8e006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:55556/0 (socket says 172.21.15.50:55556) 2023-12-24T18:51:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4024900707 learned_addr learned my addr 172.21.15.50:0/4024900707 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8df7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42550/0 (socket says 172.21.15.50:42550) 2023-12-24T18:51:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 msgr2=0x7fe8e00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 --2- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4024900707 >> v1:172.21.15.82:6789/0 conn(0x7fe8e0158c40 legacy=0x7fe8e00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4024900707 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e006a7d0 con 0x7fe8e006cd40 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8e4a15700 1 --2- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e006cd40 0x7fe8e006d1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22add758fb737199 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8deffd700 1 -- 172.21.15.50:0/4024900707 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800e070 con 0x7fe8e006cd40 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8deffd700 1 -- 172.21.15.50:0/4024900707 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800b9d0 con 0x7fe8e006cd40 2023-12-24T18:51:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.866+0000 7fe8deffd700 1 -- 172.21.15.50:0/4024900707 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80092e0 con 0x7fe8e006cd40 2023-12-24T18:51:35.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 -- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e006cd40 msgr2=0x7fe8e006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e006cd40 0x7fe8e006d1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).stop 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 -- 172.21.15.50:0/4024900707 shutdown_connections 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e006cd40 0x7fe8e006d1c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4024900707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 -- 172.21.15.50:0/4024900707 >> 172.21.15.50:0/4024900707 conn(0x7fe8e00d0800 msgr2=0x7fe8e00b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 -- 172.21.15.50:0/4024900707 shutdown_connections 2023-12-24T18:51:35.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 -- 172.21.15.50:0/4024900707 wait complete. 2023-12-24T18:51:35.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.870+0000 7fe8e5216700 1 Processor -- start 2023-12-24T18:51:35.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 -- start start 2023-12-24T18:51:35.874 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:35.874+0000 7f381916c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:35.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e006cd40 0x7fe8e0169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e016a310 con 0x7fe8e006cd40 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0152f30 con 0x7fe8e0158c40 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e5216700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00cb440 con 0x7fe8e00cc780 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e006cd40 0x7fe8e0169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:55562/0 (socket says 172.21.15.50:55562) 2023-12-24T18:51:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4256570497 learned_addr learned my addr 172.21.15.50:0/4256570497 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8df7fe700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 msgr2=0x7fe8e00c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e006cd40 msgr2=0x7fe8e0169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e006cd40 0x7fe8e0169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 -- 172.21.15.50:0/4256570497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009ae0 con 0x7fe8e0158c40 2023-12-24T18:51:35.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.874+0000 7fe8e4a15700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0069860 tx=0x7fe8d8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:35.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8008b10 con 0x7fe8e0158c40 2023-12-24T18:51:35.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8008cb0 con 0x7fe8e0158c40 2023-12-24T18:51:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e00ca830 con 0x7fe8e0158c40 2023-12-24T18:51:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d801c660 con 0x7fe8e0158c40 2023-12-24T18:51:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e00cadf0 con 0x7fe8e0158c40 2023-12-24T18:51:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e00cb5f0 con 0x7fe8e0158c40 2023-12-24T18:51:35.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.878+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fe8d8003040 con 0x7fe8e0158c40 2023-12-24T18:51:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.882+0000 7fe8c7fff700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 0x7fe8cc062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.882+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fe8d807e2c0 con 0x7fe8e0158c40 2023-12-24T18:51:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.882+0000 7fe8dffff700 1 -- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 msgr2=0x7fe8cc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.882+0000 7fe8dffff700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 0x7fe8cc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:35.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:35.890+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe8e00cb5f0 con 0x7fe8e0158c40 2023-12-24T18:51:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.066+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe8e00cb5b0 con 0x7fe8e0158c40 2023-12-24T18:51:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.078+0000 7fe8c7fff700 1 -- 172.21.15.50:0/4256570497 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe8d804e550 con 0x7fe8e0158c40 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 msgr2=0x7fe8cc062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 0x7fe8cc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 msgr2=0x7fe8e01453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0069860 tx=0x7fe8d8018000 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 shutdown_connections 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe8cc0605a0 0x7fe8cc062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e0158c40 0x7fe8e01453f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8e00cc780 0x7fe8e00c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 --2- 172.21.15.50:0/4256570497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e006cd40 0x7fe8e0169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.082+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 >> 172.21.15.50:0/4256570497 conn(0x7fe8e00d0800 msgr2=0x7fe8e0153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.086+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 shutdown_connections 2023-12-24T18:51:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.086+0000 7fe8e5216700 1 -- 172.21.15.50:0/4256570497 wait complete. 2023-12-24T18:51:36.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:51:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.278+0000 7fafaf59e700 1 Processor -- start 2023-12-24T18:51:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.282+0000 7fafaf59e700 1 -- start start 2023-12-24T18:51:36.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafb00cc780 0x7fafb00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006a580 con 0x7fafb006cd40 2023-12-24T18:51:36.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00cd110 con 0x7fafb00cc780 2023-12-24T18:51:36.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb006a7d0 con 0x7fafb0158c40 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fafb006cd40 0x7fafb006d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39702/0 (socket says 172.21.15.50:39702) 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafb00cc780 0x7fafb00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaed9d700 1 -- 172.21.15.50:0/2630773174 learned_addr learned my addr 172.21.15.50:0/2630773174 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafae59c700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 -- 172.21.15.50:0/2630773174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 msgr2=0x7fafb00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb00cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 -- 172.21.15.50:0/2630773174 >> v1:172.21.15.50:6789/0 conn(0x7fafb006cd40 legacy=0x7fafb006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafad59a700 1 -- 172.21.15.50:0/2630773174 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891254685 0 0) 0x7fafb006a580 con 0x7fafb006cd40 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 -- 172.21.15.50:0/2630773174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb006aab0 con 0x7fafb00cc780 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafadd9b700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb00ccbd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fafa40098e0 tx=0x7fafa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594a8392f0dfa3ae server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafad59a700 1 -- 172.21.15.50:0/2630773174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4009e80 con 0x7fafb00cc780 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafad59a700 1 -- 172.21.15.50:0/2630773174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400b860 con 0x7fafb00cc780 2023-12-24T18:51:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafad59a700 1 -- 172.21.15.50:0/2630773174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400bbe0 con 0x7fafb00cc780 2023-12-24T18:51:36.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 -- 172.21.15.50:0/2630773174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 msgr2=0x7fafb00ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.286+0000 7fafaf59e700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb00ccbd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fafa40098e0 tx=0x7fafa40091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- 172.21.15.50:0/2630773174 shutdown_connections 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb00ccbd0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 --2- 172.21.15.50:0/2630773174 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- 172.21.15.50:0/2630773174 >> 172.21.15.50:0/2630773174 conn(0x7fafb00d0800 msgr2=0x7fafb00b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- 172.21.15.50:0/2630773174 shutdown_connections 2023-12-24T18:51:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- 172.21.15.50:0/2630773174 wait complete. 2023-12-24T18:51:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 Processor -- start 2023-12-24T18:51:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- start start 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 0x7fafb0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb016a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c5360 con 0x7fafb00cc780 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c9490 con 0x7fafb006cd40 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaf59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c7370 con 0x7fafb0158c40 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafadd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafadd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49486/0 (socket says 172.21.15.50:49486) 2023-12-24T18:51:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafadd9b700 1 -- 172.21.15.50:0/3115272220 learned_addr learned my addr 172.21.15.50:0/3115272220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafae59c700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 0x7fafb0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.290+0000 7fafaed9d700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb016a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 -- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 msgr2=0x7fafb016a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb016a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 -- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 msgr2=0x7fafb0153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 0x7fafb0153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 -- 172.21.15.50:0/3115272220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009420 con 0x7fafb00cc780 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafae59c700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 0x7fafb0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafadd9b700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b3c0 tx=0x7fafa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400b9d0 con 0x7fafb00cc780 2023-12-24T18:51:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400bb50 con 0x7fafb00cc780 2023-12-24T18:51:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00c4d10 con 0x7fafb00cc780 2023-12-24T18:51:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4011670 con 0x7fafb00cc780 2023-12-24T18:51:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb016a540 con 0x7fafb00cc780 2023-12-24T18:51:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.294+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00c4b70 con 0x7fafb00cc780 2023-12-24T18:51:36.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.298+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fafa4011a20 con 0x7fafb00cc780 2023-12-24T18:51:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.298+0000 7faf9e7fc700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 0x7faf90062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.298+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fafa407e0a0 con 0x7fafb00cc780 2023-12-24T18:51:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.298+0000 7fafae59c700 1 -- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 msgr2=0x7faf90062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.298+0000 7fafae59c700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 0x7faf90062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:36.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.302+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fafb00c4b70 con 0x7fafb00cc780 2023-12-24T18:51:36.391 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:36.386+0000 7f9a5735b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:36.453 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:36.450+0000 7f381916c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:36.462 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:36.458+0000 7f9a5735b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.482+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fafb00c5510 con 0x7fafb00cc780 2023-12-24T18:51:36.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7faf9e7fc700 1 -- 172.21.15.50:0/3115272220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7fafb00c5510 con 0x7fafb00cc780 2023-12-24T18:51:36.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 msgr2=0x7faf90062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 0x7faf90062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 msgr2=0x7fafb016a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b3c0 tx=0x7fafa4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 shutdown_connections 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7faf900605a0 0x7faf90062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fafb0158c40 0x7fafb016a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb00cc780 0x7fafb016a7b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 --2- 172.21.15.50:0/3115272220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafb006cd40 0x7fafb0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.490+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 >> 172.21.15.50:0/3115272220 conn(0x7fafb00d0800 msgr2=0x7fafb00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.494+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 shutdown_connections 2023-12-24T18:51:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.494+0000 7fafaf59e700 1 -- 172.21.15.50:0/3115272220 wait complete. 2023-12-24T18:51:36.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:36.512 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T18:51:36.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-12-24T18:51:36.536 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:36.534+0000 7f381916c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:36.593 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:36.586+0000 7f9a5735b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:36.695 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:36.694+0000 7f381916c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:36.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.750+0000 7fd45e678700 1 Processor -- start 2023-12-24T18:51:36.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.750+0000 7fd45e678700 1 -- start start 2023-12-24T18:51:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45e678700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd45815c3d0 0x7fd45815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45e678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4580cb2b0 0x7fd4580cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45e678700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45806b6b0 con 0x7fd45815c7a0 2023-12-24T18:51:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45e678700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45806c250 con 0x7fd45815c3d0 2023-12-24T18:51:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45e678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580cba20 con 0x7fd4580cb2b0 2023-12-24T18:51:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd45815c3d0 0x7fd45815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd4577fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd45815c7a0 0x7fd45806bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39716/0 (socket says 172.21.15.50:39716) 2023-12-24T18:51:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd4577fe700 1 -- 172.21.15.50:0/1009167132 learned_addr learned my addr 172.21.15.50:0/1009167132 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd45cc15700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4580cb2b0 0x7fd4580cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd456ffd700 1 -- 172.21.15.50:0/1009167132 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490600428 0 0) 0x7fd45806b6b0 con 0x7fd45815c7a0 2023-12-24T18:51:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd456ffd700 1 -- 172.21.15.50:0/1009167132 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd440003570 con 0x7fd45815c7a0 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 -- 172.21.15.50:0/1009167132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4580cb2b0 msgr2=0x7fd4580cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4580cb2b0 0x7fd4580cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 -- 172.21.15.50:0/1009167132 >> v1:172.21.15.50:6789/0 conn(0x7fd45815c7a0 legacy=0x7fd45806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 -- 172.21.15.50:0/1009167132 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45806ad80 con 0x7fd45815c3d0 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd457fff700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd45815d810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098e0 tx=0x7fd4480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1016fdf46ac25cd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd456ffd700 1 -- 172.21.15.50:0/1009167132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448011630 con 0x7fd45815c3d0 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd456ffd700 1 -- 172.21.15.50:0/1009167132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448011790 con 0x7fd45815c3d0 2023-12-24T18:51:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.754+0000 7fd456ffd700 1 -- 172.21.15.50:0/1009167132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448011b30 con 0x7fd45815c3d0 2023-12-24T18:51:36.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- 172.21.15.50:0/1009167132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 msgr2=0x7fd45815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd45815d810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098e0 tx=0x7fd4480091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- 172.21.15.50:0/1009167132 shutdown_connections 2023-12-24T18:51:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4580cb2b0 0x7fd4580cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 --2- 172.21.15.50:0/1009167132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd45815d810 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- 172.21.15.50:0/1009167132 >> 172.21.15.50:0/1009167132 conn(0x7fd4580670b0 msgr2=0x7fd4580674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- 172.21.15.50:0/1009167132 shutdown_connections 2023-12-24T18:51:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- 172.21.15.50:0/1009167132 wait complete. 2023-12-24T18:51:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 Processor -- start 2023-12-24T18:51:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 -- start start 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.758+0000 7fd45e678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580cb2b0 0x7fd4580c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd4581550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd45815c7a0 0x7fd45815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c46b0 con 0x7fd45815c3d0 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458155600 con 0x7fd4580cb2b0 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c3b30 con 0x7fd45815c7a0 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd4581550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd4581550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49504/0 (socket says 172.21.15.50:49504) 2023-12-24T18:51:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 -- 172.21.15.50:0/312396628 learned_addr learned my addr 172.21.15.50:0/312396628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580cb2b0 0x7fd4580c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45cc15700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd45815c7a0 0x7fd45815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd45815c7a0 msgr2=0x7fd45815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd45815c7a0 0x7fd45815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580cb2b0 msgr2=0x7fd4580c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580cb2b0 0x7fd4580c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009420 con 0x7fd45815c3d0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd4577fe700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45815c3d0 0x7fd4581550c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c7c0 tx=0x7fd44c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c005cd0 con 0x7fd45815c3d0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c005e30 con 0x7fd45815c3d0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c007320 con 0x7fd45815c3d0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580c3d80 con 0x7fd45815c3d0 2023-12-24T18:51:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c4340 con 0x7fd45815c3d0 2023-12-24T18:51:36.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.762+0000 7fd45e678700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580c4860 con 0x7fd45815c3d0 2023-12-24T18:51:36.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.766+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fd44c007690 con 0x7fd45815c3d0 2023-12-24T18:51:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.766+0000 7fd43ffff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.766+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd44c07c1c0 con 0x7fd45815c3d0 2023-12-24T18:51:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.766+0000 7fd457fff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.766+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:36.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.774+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd4580c4860 con 0x7fd45815c3d0 2023-12-24T18:51:36.844 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:36.838+0000 7f9a5735b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:36.911 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:36.906+0000 7f9a5735b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.966+0000 7fd45e678700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4580c4860 con 0x7fd4440605a0 2023-12-24T18:51:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.970+0000 7fd457fff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:36.970+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:36.978 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:36.978+0000 7f381916c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:37.060 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:37.058+0000 7f381916c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:37.125 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:37.122+0000 7f9a5735b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:37.212 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:37.206+0000 7f9a5735b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:37.292 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:37.286+0000 7f9a5735b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:37.299 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:37.298+0000 7f381916c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:37.374+0000 7fd457fff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:37.374+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:51:37.391 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:37.390+0000 7f381916c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:37.480 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:37.478+0000 7f381916c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:37.656 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:37.650+0000 7f9a5735b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:37.817 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:37.810+0000 7f9a5735b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:37.895 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:37.894+0000 7f381916c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:38.073 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.070+0000 7f381916c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:38.177 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.174+0000 7f9a5735b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:38.178+0000 7fd457fff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:38.178+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:51:38.411 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.406+0000 7f9a5735b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:38.459 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.458+0000 7f381916c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:38.505 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.502+0000 7f9a5735b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:38.590 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.586+0000 7f9a5735b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:38.676 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.670+0000 7f9a5735b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:38.689 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.686+0000 7f381916c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:38.780 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.778+0000 7f381916c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:38.861 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.858+0000 7f381916c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:38.920 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.914+0000 7f9a5735b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:38.938 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:38.938+0000 7f381916c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:39.005 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:38.998+0000 7f9a5735b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:39.093 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:39.086+0000 7f9a5735b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:39.159 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:39.158+0000 7f381916c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:39.238 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:39.238+0000 7f381916c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:39.295 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:39.290+0000 7f9a5735b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:39.325 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:39.322+0000 7f381916c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:39.386 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:39.382+0000 7f9a5735b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:39.523 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:39.521+0000 7f381916c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:39.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:39.605+0000 7f381916c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:39.781+0000 7fd457fff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:39.781+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:51:40.120 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:40.114+0000 7f9a5735b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:40.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:40.185+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 31) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fd44c04c820 con 0x7fd45815c3d0 2023-12-24T18:51:40.352 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.349+0000 7f381916c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:40.369+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 32) v1 ==== 79689+0+0 (secure 0 0 0) 0x7fd44c053600 con 0x7fd45815c3d0 2023-12-24T18:51:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:40.369+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 msgr2=0x7fd444062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:40.369+0000 7fd43ffff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd444062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:40.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d9cc6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d9cc6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d9cc6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d9cc6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d9cc6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.573 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d6cc0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.573 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d6cc0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.573 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d6cc0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.573 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d6cc0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:40.573 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:40.569+0000 7f37d6cc0700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.377+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 33) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fd44c04d0f0 con 0x7fd45815c3d0 2023-12-24T18:51:41.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.377+0000 7fd43ffff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd4440629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.377+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4580c4860 con 0x7fd4440605a0 2023-12-24T18:51:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.381+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd4440629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.385+0000 7fd457fff700 1 --2- 172.21.15.50:0/312396628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fd4440605a0 0x7fd4440629d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4480091e0 tx=0x7fd448017000 comp rx=0 tx=0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:41.398 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:41.397+0000 7f37e1cd6700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-12-24T18:51:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.397+0000 7fd43ffff700 1 -- 172.21.15.50:0/312396628 <== mgr.5987 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fd4580c4860 con 0x7fd4440605a0 2023-12-24T18:51:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-12-24T18:51:41.407 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-24T18:51:41.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:41.408 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T18:51:41.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:51:41.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.657+0000 7ff8a326e700 1 Processor -- start 2023-12-24T18:51:41.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.657+0000 7ff8a326e700 1 -- start start 2023-12-24T18:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a326e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a326e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff89c06ac50 0x7ff89c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a326e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c06bd70 con 0x7ff89c15d1d0 2023-12-24T18:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a326e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c06b0d0 con 0x7ff89c06ac50 2023-12-24T18:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a326e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c06c9c0 con 0x7ff89c0b4430 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:56224/0 (socket says 172.21.15.50:56224) 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 -- 172.21.15.50:0/1431466014 learned_addr learned my addr 172.21.15.50:0/1431466014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a100a700 1 --1- 172.21.15.50:0/1431466014 >> v1:172.21.15.82:6789/0 conn(0x7ff89c15d1d0 0x7ff89c0b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51122/0 (socket says 172.21.15.50:51122) 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a180b700 1 --2- 172.21.15.50:0/1431466014 >> v2:172.21.15.82:3300/0 conn(0x7ff89c06ac50 0x7ff89c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 -- 172.21.15.50:0/1431466014 >> v2:172.21.15.82:3300/0 conn(0x7ff89c06ac50 msgr2=0x7ff89c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 --2- 172.21.15.50:0/1431466014 >> v2:172.21.15.82:3300/0 conn(0x7ff89c06ac50 0x7ff89c06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 -- 172.21.15.50:0/1431466014 >> v1:172.21.15.82:6789/0 conn(0x7ff89c15d1d0 legacy=0x7ff89c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff8a0809700 1 -- 172.21.15.50:0/1431466014 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c06cca0 con 0x7ff89c0b4430 2023-12-24T18:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.661+0000 7ff893fff700 1 -- 172.21.15.50:0/1431466014 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969223055 0 0) 0x7ff89c06bd70 con 0x7ff89c15d1d0 2023-12-24T18:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a0809700 1 --2- 172.21.15.50:0/1431466014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0099b0 tx=0x7ff88c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3dcdc17027b2fed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff893fff700 1 -- 172.21.15.50:0/1431466014 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c009ea0 con 0x7ff89c0b4430 2023-12-24T18:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff893fff700 1 -- 172.21.15.50:0/1431466014 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00b860 con 0x7ff89c0b4430 2023-12-24T18:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff893fff700 1 -- 172.21.15.50:0/1431466014 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00bc00 con 0x7ff89c0b4430 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 -- 172.21.15.50:0/1431466014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 msgr2=0x7ff89c06a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 --2- 172.21.15.50:0/1431466014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0099b0 tx=0x7ff88c009250 comp rx=0 tx=0).stop 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 -- 172.21.15.50:0/1431466014 shutdown_connections 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 --2- 172.21.15.50:0/1431466014 >> v2:172.21.15.82:3300/0 conn(0x7ff89c06ac50 0x7ff89c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 --2- 172.21.15.50:0/1431466014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c0b4430 0x7ff89c06a710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 -- 172.21.15.50:0/1431466014 >> 172.21.15.50:0/1431466014 conn(0x7ff89c067b80 msgr2=0x7ff89c0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 -- 172.21.15.50:0/1431466014 shutdown_connections 2023-12-24T18:51:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.665+0000 7ff8a326e700 1 -- 172.21.15.50:0/1431466014 wait complete. 2023-12-24T18:51:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 Processor -- start 2023-12-24T18:51:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 -- start start 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c06ac50 0x7ff89c16ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff89c15d1d0 0x7ff89c16c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0ab770 con 0x7ff89c0b4430 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c16f3a0 con 0x7ff89c15d1d0 2023-12-24T18:51:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a326e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c16e790 con 0x7ff89c06ac50 2023-12-24T18:51:41.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a0809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a0809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60640/0 (socket says 172.21.15.50:60640) 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.669+0000 7ff8a0809700 1 -- 172.21.15.50:0/972582417 learned_addr learned my addr 172.21.15.50:0/972582417 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a100a700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c06ac50 0x7ff89c16ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a180b700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff89c15d1d0 0x7ff89c16c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 -- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c06ac50 msgr2=0x7ff89c16ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c06ac50 0x7ff89c16ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 -- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff89c15d1d0 msgr2=0x7ff89c16c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff89c15d1d0 0x7ff89c16c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 -- 172.21.15.50:0/972582417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0094f0 con 0x7ff89c0b4430 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a0809700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff89c06cb00 tx=0x7ff88c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c000d10 con 0x7ff89c0b4430 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00bbe0 con 0x7ff89c0b4430 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c011690 con 0x7ff89c0b4430 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c16ea70 con 0x7ff89c0b4430 2023-12-24T18:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c16f030 con 0x7ff89c0b4430 2023-12-24T18:51:41.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.673+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c0652e0 con 0x7ff89c0b4430 2023-12-24T18:51:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.677+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 33) v1 ==== 79816+0+0 (secure 0 0 0) 0x7ff88c011ac0 con 0x7ff89c0b4430 2023-12-24T18:51:41.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.677+0000 7ff8917fa700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 0x7ff8800628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:41.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.677+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7ff88c07e1d0 con 0x7ff89c0b4430 2023-12-24T18:51:41.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.677+0000 7ff8a100a700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 0x7ff8800628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:41.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.677+0000 7ff8a100a700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 0x7ff8800628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff89c160af0 tx=0x7ff898007ef0 comp rx=0 tx=0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:41.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.685+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff88c04e6b0 con 0x7ff89c0b4430 2023-12-24T18:51:41.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:41.901+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff89c06cf80 con 0x7ff89c0b4430 2023-12-24T18:51:42.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.397+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7ff88c04ea80 con 0x7ff89c0b4430 2023-12-24T18:51:42.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.397+0000 7ff8917fa700 1 -- 172.21.15.50:0/972582417 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff88c02e3f0 con 0x7ff89c0b4430 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 msgr2=0x7ff8800628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 0x7ff8800628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff89c160af0 tx=0x7ff898007ef0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 msgr2=0x7ff89c16db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff89c06cb00 tx=0x7ff88c017000 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 shutdown_connections 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8800603f0 0x7ff8800628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff89c15d1d0 0x7ff89c16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff89c0b4430 0x7ff89c16db10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 --2- 172.21.15.50:0/972582417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff89c06ac50 0x7ff89c16ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 >> 172.21.15.50:0/972582417 conn(0x7ff89c067b80 msgr2=0x7ff89c15ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:42.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 shutdown_connections 2023-12-24T18:51:42.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.401+0000 7ff8a326e700 1 -- 172.21.15.50:0/972582417 wait complete. 2023-12-24T18:51:42.428 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:51:42.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:42.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:42.511 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:51:42.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:51:42.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:51:42.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:51:42.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:51:42.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:51:42.561 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:51:42.590 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:42.586+0000 7fe86fdce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:42.619 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:42.617+0000 7fee0115d000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:51:42.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 Processor -- start 2023-12-24T18:51:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 -- start start 2023-12-24T18:51:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f313006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31300cb7f0 con 0x7f3130158e00 2023-12-24T18:51:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31300cabe0 con 0x7f313006c820 2023-12-24T18:51:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f313542e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300caec0 con 0x7f31301591d0 2023-12-24T18:51:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3130158e00 0x7f31300cbc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37176/0 (socket says 172.21.15.50:37176) 2023-12-24T18:51:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312effd700 1 -- 172.21.15.50:0/2224894464 learned_addr learned my addr 172.21.15.50:0/2224894464 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312e7fc700 1 --2- 172.21.15.50:0/2224894464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f313006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312e7fc700 1 -- 172.21.15.50:0/2224894464 >> v1:172.21.15.82:6789/0 conn(0x7f313006c820 legacy=0x7f313006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312dffb700 1 -- 172.21.15.50:0/2224894464 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853157677 0 0) 0x7f31300cb7f0 con 0x7f3130158e00 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312e7fc700 1 -- 172.21.15.50:0/2224894464 >> v1:172.21.15.50:6789/0 conn(0x7f3130158e00 legacy=0x7f31300cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.821+0000 7f312e7fc700 1 -- 172.21.15.50:0/2224894464 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300cb1a0 con 0x7f31301591d0 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f312e7fc700 1 --2- 172.21.15.50:0/2224894464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f313006a580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3124009890 tx=0x7f31240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f1ed766c73fcac server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f312dffb700 1 -- 172.21.15.50:0/2224894464 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124011630 con 0x7f31301591d0 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f312dffb700 1 -- 172.21.15.50:0/2224894464 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124011790 con 0x7f31301591d0 2023-12-24T18:51:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f312dffb700 1 -- 172.21.15.50:0/2224894464 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124011b50 con 0x7f31301591d0 2023-12-24T18:51:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 -- 172.21.15.50:0/2224894464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 msgr2=0x7f313006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 --2- 172.21.15.50:0/2224894464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f313006a580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3124009890 tx=0x7f31240091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 -- 172.21.15.50:0/2224894464 shutdown_connections 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 --2- 172.21.15.50:0/2224894464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f313006a580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 -- 172.21.15.50:0/2224894464 >> 172.21.15.50:0/2224894464 conn(0x7f3130067b80 msgr2=0x7f31300cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 -- 172.21.15.50:0/2224894464 shutdown_connections 2023-12-24T18:51:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.825+0000 7f313542e700 1 -- 172.21.15.50:0/2224894464 wait complete. 2023-12-24T18:51:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 Processor -- start 2023-12-24T18:51:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 -- start start 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 0x7f3130147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f31301545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300b2c80 con 0x7f313006c820 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130147fa0 con 0x7f3130158e00 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f313542e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313016a4a0 con 0x7f31301591d0 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 0x7f3130147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50500/0 (socket says 172.21.15.50:50500) 2023-12-24T18:51:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 -- 172.21.15.50:0/3885775269 learned_addr learned my addr 172.21.15.50:0/3885775269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 0x7f3130147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60648/0 (socket says 172.21.15.50:60648) 2023-12-24T18:51:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312f7fe700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f31301545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 msgr2=0x7f31301545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f31301545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 msgr2=0x7f3130147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 0x7f3130147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312e7fc700 1 -- 172.21.15.50:0/3885775269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009420 con 0x7f3130158e00 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.829+0000 7f312f7fe700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f31301545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f312e7fc700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f313006ead0 tx=0x7f3124016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124011b10 con 0x7f3130158e00 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124006a90 con 0x7f3130158e00 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312401a6c0 con 0x7f3130158e00 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3130169840 con 0x7f3130158e00 2023-12-24T18:51:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3130169e00 con 0x7f3130158e00 2023-12-24T18:51:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.833+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31300b2df0 con 0x7f3130158e00 2023-12-24T18:51:42.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.837+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f312401aab0 con 0x7f3130158e00 2023-12-24T18:51:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.837+0000 7f3116ffd700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 0x7f311c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.837+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f312407eba0 con 0x7f3130158e00 2023-12-24T18:51:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.837+0000 7f312effd700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 msgr2=0x7f311c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:42.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.837+0000 7f312effd700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 0x7f311c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:42.845+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f312404eab0 con 0x7f3130158e00 2023-12-24T18:51:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.041+0000 7f312effd700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 msgr2=0x7f311c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.041+0000 7f312effd700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 0x7f311c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:43.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.057+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f313004be40 con 0x7f3130158e00 2023-12-24T18:51:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.057+0000 7f3116ffd700 1 -- 172.21.15.50:0/3885775269 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f31240520d0 con 0x7f3130158e00 2023-12-24T18:51:43.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 msgr2=0x7f311c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 0x7f311c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 msgr2=0x7f31300c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f313006ead0 tx=0x7f3124016000 comp rx=0 tx=0).stop 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 shutdown_connections 2023-12-24T18:51:43.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f311c060700 0x7f311c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31301591d0 0x7f31301545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3130158e00 0x7f31300c9760 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 --2- 172.21.15.50:0/3885775269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313006c820 0x7f3130147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 >> 172.21.15.50:0/3885775269 conn(0x7f3130067b80 msgr2=0x7f3130153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 shutdown_connections 2023-12-24T18:51:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.061+0000 7f313542e700 1 -- 172.21.15.50:0/3885775269 wait complete. 2023-12-24T18:51:43.066 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:43.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:43.122 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.118+0000 7fe86fdce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:43.192 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.186+0000 7fe86fdce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:43.204 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:43.201+0000 7fee0115d000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.245+0000 7fda9c785700 1 Processor -- start 2023-12-24T18:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.245+0000 7fda9c785700 1 -- start start 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940ca770 0x7fda9415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9406ca50 con 0x7fda9415af90 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9415b410 con 0x7fda940ca3a0 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940c6980 con 0x7fda940ca770 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940ca770 0x7fda9415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940ca770 0x7fda9415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60658/0 (socket says 172.21.15.50:60658) 2023-12-24T18:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 -- 172.21.15.50:0/3184806857 learned_addr learned my addr 172.21.15.50:0/3184806857 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9ad22700 1 --1- 172.21.15.50:0/3184806857 >> v1:172.21.15.50:6789/0 conn(0x7fda9415af90 0x7fda9406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37180/0 (socket says 172.21.15.50:37180) 2023-12-24T18:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 -- 172.21.15.50:0/3184806857 >> v1:172.21.15.82:6789/0 conn(0x7fda940ca3a0 legacy=0x7fda9406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 -- 172.21.15.50:0/3184806857 >> v1:172.21.15.50:6789/0 conn(0x7fda9415af90 legacy=0x7fda9406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 -- 172.21.15.50:0/3184806857 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9406b520 con 0x7fda940ca770 2023-12-24T18:51:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda99d20700 1 --2- 172.21.15.50:0/3184806857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca770 0x7fda9415aa50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda840099b0 tx=0x7fda84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98863ae046f04e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9951f700 1 -- 172.21.15.50:0/3184806857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400b760 con 0x7fda940ca770 2023-12-24T18:51:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9951f700 1 -- 172.21.15.50:0/3184806857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400b8c0 con 0x7fda940ca770 2023-12-24T18:51:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9951f700 1 -- 172.21.15.50:0/3184806857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400bc80 con 0x7fda940ca770 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- 172.21.15.50:0/3184806857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca770 msgr2=0x7fda9415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 --2- 172.21.15.50:0/3184806857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca770 0x7fda9415aa50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda840099b0 tx=0x7fda84009250 comp rx=0 tx=0).stop 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- 172.21.15.50:0/3184806857 shutdown_connections 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 --2- 172.21.15.50:0/3184806857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca770 0x7fda9415aa50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- 172.21.15.50:0/3184806857 >> 172.21.15.50:0/3184806857 conn(0x7fda940cbba0 msgr2=0x7fda940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- 172.21.15.50:0/3184806857 shutdown_connections 2023-12-24T18:51:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.249+0000 7fda9c785700 1 -- 172.21.15.50:0/3184806857 wait complete. 2023-12-24T18:51:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 Processor -- start 2023-12-24T18:51:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 -- start start 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 0x7fda9415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda9415af90 0x7fda940c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940c3f80 con 0x7fda940ca3a0 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b0c00 con 0x7fda940ca770 2023-12-24T18:51:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9c785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b1780 con 0x7fda9415af90 2023-12-24T18:51:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9a521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9a521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60666/0 (socket says 172.21.15.50:60666) 2023-12-24T18:51:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.253+0000 7fda9a521700 1 -- 172.21.15.50:0/4248487772 learned_addr learned my addr 172.21.15.50:0/4248487772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda99d20700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 0x7fda9415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9ad22700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda9415af90 0x7fda940c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 -- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda9415af90 msgr2=0x7fda940c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda9415af90 0x7fda940c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 -- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 msgr2=0x7fda9415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 0x7fda9415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 -- 172.21.15.50:0/4248487772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840094f0 con 0x7fda940ca3a0 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda99d20700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 0x7fda9415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9a521700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c590 tx=0x7fda9000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90011590 con 0x7fda940ca3a0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda900116f0 con 0x7fda940ca3a0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda940b0eb0 con 0x7fda940ca3a0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90011ab0 con 0x7fda940ca3a0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9415e1a0 con 0x7fda940ca3a0 2023-12-24T18:51:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.257+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda940b15b0 con 0x7fda940ca3a0 2023-12-24T18:51:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.261+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fda9001b3b0 con 0x7fda940ca3a0 2023-12-24T18:51:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.261+0000 7fda8a7fc700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 0x7fda78062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.261+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fda9007c4d0 con 0x7fda940ca3a0 2023-12-24T18:51:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.261+0000 7fda99d20700 1 -- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 msgr2=0x7fda78062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.261+0000 7fda99d20700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 0x7fda78062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.269+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda9004c3e0 con 0x7fda940ca3a0 2023-12-24T18:51:43.280 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:43.277+0000 7fee0115d000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:51:43.330 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.326+0000 7fe86fdce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:43.433 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:43.429+0000 7fee0115d000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.445+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9415e390 con 0x7fda940ca3a0 2023-12-24T18:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.445+0000 7fda8a7fc700 1 -- 172.21.15.50:0/4248487772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16448 (secure 0 0 0) 0x7fda90017090 con 0x7fda940ca3a0 2023-12-24T18:51:43.449 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:43.449 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:40.359892+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2952635358":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2571557199":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2638846780":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/1417166884":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6836/33814":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6834/33814":"2023-12-25T18:51:40.359800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 msgr2=0x7fda78062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 0x7fda78062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 msgr2=0x7fda940c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c590 tx=0x7fda9000c950 comp rx=0 tx=0).stop 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 shutdown_connections 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fda78060700 0x7fda78062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda9415af90 0x7fda940c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda940ca770 0x7fda9415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 --2- 172.21.15.50:0/4248487772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940ca3a0 0x7fda940c3a40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 >> 172.21.15.50:0/4248487772 conn(0x7fda940cbba0 msgr2=0x7fda9415cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 shutdown_connections 2023-12-24T18:51:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.449+0000 7fda9c785700 1 -- 172.21.15.50:0/4248487772 wait complete. 2023-12-24T18:51:43.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:51:18.882615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:51:20.237274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:51:43.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:51:43.582 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.578+0000 7fe86fdce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 Processor -- start 2023-12-24T18:51:43.651 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.646+0000 7fe86fdce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:43.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 -- start start 2023-12-24T18:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a340cc4e0 0x7f8a3406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a340cb040 con 0x7f8a34069560 2023-12-24T18:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3406f0a0 con 0x7f8a34158e10 2023-12-24T18:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.649+0000 7f8a3c145700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3406f380 con 0x7f8a340cc4e0 2023-12-24T18:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a396e0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a34069560 0x7f8a3406e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37194/0 (socket says 172.21.15.50:37194) 2023-12-24T18:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a396e0700 1 -- 172.21.15.50:0/888504854 learned_addr learned my addr 172.21.15.50:0/888504854 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3a6e2700 1 --2- 172.21.15.50:0/888504854 >> v2:172.21.15.82:3300/0 conn(0x7f8a340cc4e0 0x7f8a3406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a38edf700 1 -- 172.21.15.50:0/888504854 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353782755 0 0) 0x7f8a340cb040 con 0x7f8a34069560 2023-12-24T18:51:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a38edf700 1 -- 172.21.15.50:0/888504854 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a20003570 con 0x7f8a34069560 2023-12-24T18:51:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3a6e2700 1 -- 172.21.15.50:0/888504854 >> v1:172.21.15.82:6789/0 conn(0x7f8a34158e10 legacy=0x7f8a34068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3a6e2700 1 -- 172.21.15.50:0/888504854 >> v1:172.21.15.50:6789/0 conn(0x7f8a34069560 legacy=0x7f8a3406e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3a6e2700 1 -- 172.21.15.50:0/888504854 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340ca9f0 con 0x7f8a340cc4e0 2023-12-24T18:51:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3a6e2700 1 --2- 172.21.15.50:0/888504854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a340cc4e0 0x7f8a3406ea50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009e60 tx=0x7f8a2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3dd938d809168cd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a38edf700 1 -- 172.21.15.50:0/888504854 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00e070 con 0x7f8a340cc4e0 2023-12-24T18:51:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a38edf700 1 -- 172.21.15.50:0/888504854 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00bb60 con 0x7f8a340cc4e0 2023-12-24T18:51:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a38edf700 1 -- 172.21.15.50:0/888504854 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c012430 con 0x7f8a340cc4e0 2023-12-24T18:51:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3c145700 1 -- 172.21.15.50:0/888504854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a340cc4e0 msgr2=0x7f8a3406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3c145700 1 --2- 172.21.15.50:0/888504854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a340cc4e0 0x7f8a3406ea50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009e60 tx=0x7f8a2c009780 comp rx=0 tx=0).stop 2023-12-24T18:51:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3c145700 1 -- 172.21.15.50:0/888504854 shutdown_connections 2023-12-24T18:51:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3c145700 1 --2- 172.21.15.50:0/888504854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a340cc4e0 0x7f8a3406ea50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.653+0000 7f8a3c145700 1 -- 172.21.15.50:0/888504854 >> 172.21.15.50:0/888504854 conn(0x7f8a340ccc80 msgr2=0x7f8a340cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.657+0000 7f8a3c145700 1 -- 172.21.15.50:0/888504854 shutdown_connections 2023-12-24T18:51:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.657+0000 7f8a3c145700 1 -- 172.21.15.50:0/888504854 wait complete. 2023-12-24T18:51:43.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.657+0000 7f8a3c145700 1 Processor -- start 2023-12-24T18:51:43.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.657+0000 7f8a3c145700 1 -- start start 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a340cc4e0 0x7f8a340acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a34158e10 0x7f8a341542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34156820 con 0x7f8a34069560 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a341573a0 con 0x7f8a34158e10 2023-12-24T18:51:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34156a70 con 0x7f8a340cc4e0 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60678/0 (socket says 172.21.15.50:60678) 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 -- 172.21.15.50:0/2029133738 learned_addr learned my addr 172.21.15.50:0/2029133738 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a396e0700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a340cc4e0 0x7f8a340acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3a6e2700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a34158e10 0x7f8a341542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 -- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a340cc4e0 msgr2=0x7f8a340acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a340cc4e0 0x7f8a340acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 -- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a34158e10 msgr2=0x7f8a341542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a34158e10 0x7f8a341542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 -- 172.21.15.50:0/2029133738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c009a20 con 0x7f8a34069560 2023-12-24T18:51:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a39ee1700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c510 tx=0x7f8a3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30011590 con 0x7f8a34069560 2023-12-24T18:51:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30011710 con 0x7f8a34069560 2023-12-24T18:51:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a34156d50 con 0x7f8a34069560 2023-12-24T18:51:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30011ad0 con 0x7f8a34069560 2023-12-24T18:51:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.661+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a34152b00 con 0x7f8a34069560 2023-12-24T18:51:43.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.665+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a340c38b0 con 0x7f8a34069560 2023-12-24T18:51:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.665+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f8a3001b3b0 con 0x7f8a34069560 2023-12-24T18:51:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.665+0000 7f8a29ffb700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 0x7f8a18062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.669+0000 7f8a396e0700 1 -- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 msgr2=0x7f8a18062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.669+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f8a3007c290 con 0x7f8a34069560 2023-12-24T18:51:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.669+0000 7f8a396e0700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 0x7f8a18062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:43.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.673+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8a3004c1a0 con 0x7f8a34069560 2023-12-24T18:51:43.731 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:43.729+0000 7fee0115d000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:51:43.813 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:43.809+0000 7fee0115d000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.841+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a340652e0 con 0x7f8a34069560 2023-12-24T18:51:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.841+0000 7f8a29ffb700 1 -- 172.21.15.50:0/2029133738 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a3004f7c0 con 0x7f8a34069560 2023-12-24T18:51:43.844 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 msgr2=0x7f8a18062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 0x7f8a18062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 msgr2=0x7f8a341525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c510 tx=0x7f8a3000c820 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 shutdown_connections 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f8a18060700 0x7f8a18062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a34158e10 0x7f8a341542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a340cc4e0 0x7f8a340acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 --2- 172.21.15.50:0/2029133738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a34069560 0x7f8a341525c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 >> 172.21.15.50:0/2029133738 conn(0x7f8a340ccc80 msgr2=0x7f8a341554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 shutdown_connections 2023-12-24T18:51:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:43.845+0000 7f8a3c145700 1 -- 172.21.15.50:0/2029133738 wait complete. 2023-12-24T18:51:43.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:51:43.868 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.862+0000 7fe86fdce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:43.950 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:43.946+0000 7fe86fdce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:44.035 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:44.030+0000 7fe86fdce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 Processor -- start 2023-12-24T18:51:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 -- start start 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1948158c50 0x7f1948159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19480caef0 0x7f19480cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19480cc790 0x7f19480ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19480af430 con 0x7f19480cc790 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19480cd150 con 0x7f19480caef0 2023-12-24T18:51:44.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194f523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480caa60 con 0x7f1948158c50 2023-12-24T18:51:44.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194ed22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19480cc790 0x7f19480ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194ed22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19480cc790 0x7f19480ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60680/0 (socket says 172.21.15.50:60680) 2023-12-24T18:51:44.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194ed22700 1 -- 172.21.15.50:0/738535793 learned_addr learned my addr 172.21.15.50:0/738535793 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194e521700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1948158c50 0x7f1948159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.037+0000 7f194dd20700 1 --2- 172.21.15.50:0/738535793 >> v2:172.21.15.82:3300/0 conn(0x7f19480caef0 0x7f19480cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 -- 172.21.15.50:0/738535793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1948158c50 msgr2=0x7f1948159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1948158c50 0x7f1948159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 -- 172.21.15.50:0/738535793 >> v2:172.21.15.82:3300/0 conn(0x7f19480caef0 msgr2=0x7f19480cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 --2- 172.21.15.50:0/738535793 >> v2:172.21.15.82:3300/0 conn(0x7f19480caef0 0x7f19480cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 -- 172.21.15.50:0/738535793 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480cee80 con 0x7f19480cc790 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194ed22700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19480cc790 0x7f19480ccc10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f19480d0e50 tx=0x7f1940009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6599167eb51052 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194d51f700 1 -- 172.21.15.50:0/738535793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000b640 con 0x7f19480cc790 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194d51f700 1 -- 172.21.15.50:0/738535793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000b7a0 con 0x7f19480cc790 2023-12-24T18:51:44.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194d51f700 1 -- 172.21.15.50:0/738535793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000bb60 con 0x7f19480cc790 2023-12-24T18:51:44.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 -- 172.21.15.50:0/738535793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19480cc790 msgr2=0x7f19480ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19480cc790 0x7f19480ccc10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f19480d0e50 tx=0x7f1940009250 comp rx=0 tx=0).stop 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 -- 172.21.15.50:0/738535793 shutdown_connections 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 --2- 172.21.15.50:0/738535793 >> v2:172.21.15.82:3300/0 conn(0x7f19480caef0 0x7f19480cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19480cc790 0x7f19480ccc10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 --2- 172.21.15.50:0/738535793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1948158c50 0x7f1948159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 -- 172.21.15.50:0/738535793 >> 172.21.15.50:0/738535793 conn(0x7f19480670b0 msgr2=0x7f19480674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 -- 172.21.15.50:0/738535793 shutdown_connections 2023-12-24T18:51:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.041+0000 7f194f523700 1 -- 172.21.15.50:0/738535793 wait complete. 2023-12-24T18:51:44.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 Processor -- start 2023-12-24T18:51:44.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 -- start start 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480caef0 0x7f194815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480c92e0 con 0x7f1948158c50 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194815ac90 con 0x7f19480cc790 2023-12-24T18:51:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194f523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194815af70 con 0x7f19480caef0 2023-12-24T18:51:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194ed22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194dd20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194dd20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50564/0 (socket says 172.21.15.50:50564) 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 -- 172.21.15.50:0/619973015 learned_addr learned my addr 172.21.15.50:0/619973015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.045+0000 7f194ed22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60682/0 (socket says 172.21.15.50:60682) 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194e521700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480caef0 0x7f194815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 -- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480caef0 msgr2=0x7f194815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480caef0 0x7f194815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 -- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 msgr2=0x7f1948157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 -- 172.21.15.50:0/619973015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400094f0 con 0x7f19480cc790 2023-12-24T18:51:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194ed22700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194dd20700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f193800ec80 tx=0x7f19380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800c850 con 0x7f19480cc790 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800c9b0 con 0x7f19480cc790 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194815b250 con 0x7f19480cc790 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800cd50 con 0x7f19480cc790 2023-12-24T18:51:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194815b810 con 0x7f19480cc790 2023-12-24T18:51:44.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.049+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19480af5d0 con 0x7f19480cc790 2023-12-24T18:51:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.053+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f1938013680 con 0x7f19480cc790 2023-12-24T18:51:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.053+0000 7f193e7fc700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 0x7f192c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.053+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f193807d170 con 0x7f19480cc790 2023-12-24T18:51:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.053+0000 7f194e521700 1 -- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 msgr2=0x7f192c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.053+0000 7f194e521700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 0x7f192c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.061+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19480af5d0 con 0x7f19480cc790 2023-12-24T18:51:44.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:44.065+0000 7fee0115d000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:51:44.158 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:44.157+0000 7fee0115d000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:51:44.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.237+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19480af5d0 con 0x7f19480cc790 2023-12-24T18:51:44.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.237+0000 7f193e7fc700 1 -- 172.21.15.50:0/619973015 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19480af5d0 con 0x7f19480cc790 2023-12-24T18:51:44.241 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 msgr2=0x7f192c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 0x7f192c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 msgr2=0x7f19480c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f193800ec80 tx=0x7f19380091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 shutdown_connections 2023-12-24T18:51:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f192c060700 0x7f192c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948158c50 0x7f1948157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19480cc790 0x7f19480c70b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 --2- 172.21.15.50:0/619973015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480caef0 0x7f194815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 >> 172.21.15.50:0/619973015 conn(0x7f19480670b0 msgr2=0x7f194806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 shutdown_connections 2023-12-24T18:51:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.241+0000 7f194f523700 1 -- 172.21.15.50:0/619973015 wait complete. 2023-12-24T18:51:44.253 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:44.249+0000 7fee0115d000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:51:44.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:51:44.408 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:44.402+0000 7fe86fdce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 Processor -- start 2023-12-24T18:51:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 -- start start 2023-12-24T18:51:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d640c8dd0 0x7f2d6414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d6414fef0 0x7f2d640c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640c71f0 con 0x7f2d640c8a00 2023-12-24T18:51:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6415d790 con 0x7f2d6414fef0 2023-12-24T18:51:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.425+0000 7f2d6a923700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6415cb10 con 0x7f2d640c8dd0 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d6414fef0 0x7f2d640c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d6414fef0 0x7f2d640c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60688/0 (socket says 172.21.15.50:60688) 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 -- 172.21.15.50:0/29764826 learned_addr learned my addr 172.21.15.50:0/29764826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d69120700 1 --2- 172.21.15.50:0/29764826 >> v2:172.21.15.82:3300/0 conn(0x7f2d640c8dd0 0x7f2d6414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 -- 172.21.15.50:0/29764826 >> v2:172.21.15.82:3300/0 conn(0x7f2d640c8dd0 msgr2=0x7f2d6414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 --2- 172.21.15.50:0/29764826 >> v2:172.21.15.82:3300/0 conn(0x7f2d640c8dd0 0x7f2d6414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 -- 172.21.15.50:0/29764826 >> v1:172.21.15.50:6789/0 conn(0x7f2d640c8a00 legacy=0x7f2d640c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 -- 172.21.15.50:0/29764826 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6415cdf0 con 0x7f2d6414fef0 2023-12-24T18:51:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a122700 1 --2- 172.21.15.50:0/29764826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d6414fef0 0x7f2d640c9df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2d6406a0a0 tx=0x7f2d5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c297c235eb8bba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6891f700 1 -- 172.21.15.50:0/29764826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00e070 con 0x7f2d6414fef0 2023-12-24T18:51:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6891f700 1 -- 172.21.15.50:0/29764826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00ba50 con 0x7f2d6414fef0 2023-12-24T18:51:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6891f700 1 -- 172.21.15.50:0/29764826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0092e0 con 0x7f2d6414fef0 2023-12-24T18:51:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a923700 1 -- 172.21.15.50:0/29764826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d6414fef0 msgr2=0x7f2d640c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.429+0000 7f2d6a923700 1 --2- 172.21.15.50:0/29764826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d6414fef0 0x7f2d640c9df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2d6406a0a0 tx=0x7f2d5c009840 comp rx=0 tx=0).stop 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 -- 172.21.15.50:0/29764826 shutdown_connections 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 --2- 172.21.15.50:0/29764826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d6414fef0 0x7f2d640c9df0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 --2- 172.21.15.50:0/29764826 >> v2:172.21.15.82:3300/0 conn(0x7f2d640c8dd0 0x7f2d6414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 -- 172.21.15.50:0/29764826 >> 172.21.15.50:0/29764826 conn(0x7f2d64067250 msgr2=0x7f2d64067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 -- 172.21.15.50:0/29764826 shutdown_connections 2023-12-24T18:51:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 -- 172.21.15.50:0/29764826 wait complete. 2023-12-24T18:51:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 Processor -- start 2023-12-24T18:51:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 -- start start 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 0x7f2d640ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.433+0000 7f2d6a923700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d6414fef0 0x7f2d640afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640afa60 con 0x7f2d640c8dd0 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640c2740 con 0x7f2d6414fef0 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640aee50 con 0x7f2d640c8a00 2023-12-24T18:51:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60692/0 (socket says 172.21.15.50:60692) 2023-12-24T18:51:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 -- 172.21.15.50:0/2494908904 learned_addr learned my addr 172.21.15.50:0/2494908904 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a122700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d6414fef0 0x7f2d640afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69921700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 0x7f2d640ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 -- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 msgr2=0x7f2d640ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 0x7f2d640ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 -- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d6414fef0 msgr2=0x7f2d640afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d6414fef0 0x7f2d640afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 -- 172.21.15.50:0/2494908904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009ae0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69921700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 0x7f2d640ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d69120700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400d890 tx=0x7f2d54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540125f0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54012750 con 0x7f2d640c8dd0 2023-12-24T18:51:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d640af130 con 0x7f2d640c8dd0 2023-12-24T18:51:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012ad0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d640af6f0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.437+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d640afbd0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.441+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f2d5401e460 con 0x7f2d640c8dd0 2023-12-24T18:51:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.441+0000 7f2d59ffb700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 0x7f2d48062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.441+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f2d5407d570 con 0x7f2d640c8dd0 2023-12-24T18:51:44.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.441+0000 7f2d69921700 1 -- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 msgr2=0x7f2d48062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:44.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.441+0000 7f2d69921700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 0x7f2d48062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:44.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.449+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d5404d480 con 0x7f2d640c8dd0 2023-12-24T18:51:44.565 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:44.558+0000 7fe86fdce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.629+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d6404be40 con 0x7f2d640c8dd0 2023-12-24T18:51:44.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.629+0000 7f2d59ffb700 1 -- 172.21.15.50:0/2494908904 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d54050aa0 con 0x7f2d640c8dd0 2023-12-24T18:51:44.633 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 msgr2=0x7f2d48062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 0x7f2d48062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 msgr2=0x7f2d64168fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400d890 tx=0x7f2d54008040 comp rx=0 tx=0).stop 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 shutdown_connections 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2d48060700 0x7f2d48062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d6414fef0 0x7f2d640afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.633+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d640c8dd0 0x7f2d64168fb0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.637+0000 7f2d6a923700 1 --2- 172.21.15.50:0/2494908904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d640c8a00 0x7f2d640ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.637+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 >> 172.21.15.50:0/2494908904 conn(0x7f2d64067250 msgr2=0x7f2d6415aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.637+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 shutdown_connections 2023-12-24T18:51:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.637+0000 7f2d6a923700 1 -- 172.21.15.50:0/2494908904 wait complete. 2023-12-24T18:51:44.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:44.700 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:44.697+0000 7fee0115d000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:51:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.837+0000 7f1f3306e700 1 Processor -- start 2023-12-24T18:51:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 -- start start 2023-12-24T18:51:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f2c159bc0 0x7f1f2c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f2c0ca110 0x7f1f2c0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0caab0 con 0x7f1f2c06bce0 2023-12-24T18:51:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c06b850 con 0x7f1f2c0ca110 2023-12-24T18:51:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3306e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c06ac40 con 0x7f1f2c159bc0 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f30e0a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f2c159bc0 0x7f1f2c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f30e0a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f2c159bc0 0x7f1f2c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50590/0 (socket says 172.21.15.50:50590) 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f30e0a700 1 -- 172.21.15.50:0/2947080011 learned_addr learned my addr 172.21.15.50:0/2947080011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.841+0000 7f1f3160b700 1 --2- 172.21.15.50:0/2947080011 >> v2:172.21.15.50:3300/0 conn(0x7f1f2c0ca110 0x7f1f2c0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f30e0a700 1 -- 172.21.15.50:0/2947080011 >> v2:172.21.15.50:3300/0 conn(0x7f1f2c0ca110 msgr2=0x7f1f2c0ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f30e0a700 1 --2- 172.21.15.50:0/2947080011 >> v2:172.21.15.50:3300/0 conn(0x7f1f2c0ca110 0x7f1f2c0ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f30e0a700 1 -- 172.21.15.50:0/2947080011 >> v1:172.21.15.82:6789/0 conn(0x7f1f2c06bce0 legacy=0x7f1f2c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f30e0a700 1 -- 172.21.15.50:0/2947080011 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c06af20 con 0x7f1f2c159bc0 2023-12-24T18:51:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f2b7fe700 1 -- 172.21.15.50:0/2947080011 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286548308 0 0) 0x7f1f18001110 con 0x7f1f2c06bce0 2023-12-24T18:51:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f30e0a700 1 --2- 172.21.15.50:0/2947080011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c159bc0 0x7f1f2c159f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c069ce0 tx=0x7f1f20009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609ee0f5bb0c52d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f2b7fe700 1 -- 172.21.15.50:0/2947080011 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20009e70 con 0x7f1f2c159bc0 2023-12-24T18:51:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f2b7fe700 1 -- 172.21.15.50:0/2947080011 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2000b860 con 0x7f1f2c159bc0 2023-12-24T18:51:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f2b7fe700 1 -- 172.21.15.50:0/2947080011 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000bc00 con 0x7f1f2c159bc0 2023-12-24T18:51:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 -- 172.21.15.50:0/2947080011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c159bc0 msgr2=0x7f1f2c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 --2- 172.21.15.50:0/2947080011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c159bc0 0x7f1f2c159f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c069ce0 tx=0x7f1f20009250 comp rx=0 tx=0).stop 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 -- 172.21.15.50:0/2947080011 shutdown_connections 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 --2- 172.21.15.50:0/2947080011 >> v2:172.21.15.50:3300/0 conn(0x7f1f2c0ca110 0x7f1f2c0ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 --2- 172.21.15.50:0/2947080011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c159bc0 0x7f1f2c159f90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 -- 172.21.15.50:0/2947080011 >> 172.21.15.50:0/2947080011 conn(0x7f1f2c0cbba0 msgr2=0x7f1f2c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 -- 172.21.15.50:0/2947080011 shutdown_connections 2023-12-24T18:51:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.845+0000 7f1f3306e700 1 -- 172.21.15.50:0/2947080011 wait complete. 2023-12-24T18:51:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 Processor -- start 2023-12-24T18:51:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 -- start start 2023-12-24T18:51:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 0x7f1f2c0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1f2c159bc0 0x7f1f2c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c153e30 con 0x7f1f2c0ca110 2023-12-24T18:51:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15a0c0 con 0x7f1f2c06bce0 2023-12-24T18:51:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3306e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15a3a0 con 0x7f1f2c159bc0 2023-12-24T18:51:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f2bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f30e0a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 0x7f1f2c0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f3160b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1f2c159bc0 0x7f1f2c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f2bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60714/0 (socket says 172.21.15.50:60714) 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.849+0000 7f1f2bfff700 1 -- 172.21.15.50:0/1482072628 learned_addr learned my addr 172.21.15.50:0/1482072628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1f2c159bc0 msgr2=0x7f1f2c1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1f2c159bc0 0x7f1f2c1464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 msgr2=0x7f1f2c0b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 0x7f1f2c0b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 -- 172.21.15.50:0/1482072628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200094f0 con 0x7f1f2c0ca110 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f30e0a700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 0x7f1f2c0b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f2bfff700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c560 tx=0x7f1f18007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18016070 con 0x7f1f2c0ca110 2023-12-24T18:51:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18006820 con 0x7f1f2c0ca110 2023-12-24T18:51:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18006be0 con 0x7f1f2c0ca110 2023-12-24T18:51:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c15a680 con 0x7f1f2c0ca110 2023-12-24T18:51:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c1535c0 con 0x7f1f2c0ca110 2023-12-24T18:51:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.853+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c15ab80 con 0x7f1f2c0ca110 2023-12-24T18:51:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.857+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f1f18006f90 con 0x7f1f2c0ca110 2023-12-24T18:51:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.857+0000 7f1f28ff9700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 0x7f1f10062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.857+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f1f1807c4c0 con 0x7f1f2c0ca110 2023-12-24T18:51:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.857+0000 7f1f30e0a700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 msgr2=0x7f1f10062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.857+0000 7f1f30e0a700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 0x7f1f10062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:44.865+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f1804c3d0 con 0x7f1f2c0ca110 2023-12-24T18:51:44.902 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:44.901+0000 7fee0115d000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:51:44.908 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:44.902+0000 7fe86fdce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.061+0000 7f1f30e0a700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 msgr2=0x7f1f10062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.061+0000 7f1f30e0a700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 0x7f1f10062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:45.125 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.118+0000 7fe86fdce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:45.214 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.210+0000 7fe86fdce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.225+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f2c0caab0 con 0x7f1f2c0ca110 2023-12-24T18:51:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.229+0000 7f1f28ff9700 1 -- 172.21.15.50:0/1482072628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f1f2c0caab0 con 0x7f1f2c0ca110 2023-12-24T18:51:45.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:45.231 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:45.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 msgr2=0x7f1f10062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:45.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 0x7f1f10062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 msgr2=0x7f1f2c1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c560 tx=0x7f1f18007f50 comp rx=0 tx=0).stop 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 shutdown_connections 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1f10060700 0x7f1f10062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1f2c159bc0 0x7f1f2c1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2c0ca110 0x7f1f2c1538f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 --2- 172.21.15.50:0/1482072628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f2c06bce0 0x7f1f2c0b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 >> 172.21.15.50:0/1482072628 conn(0x7f1f2c0cbba0 msgr2=0x7f1f2c0c1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 shutdown_connections 2023-12-24T18:51:45.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.233+0000 7f1f3306e700 1 -- 172.21.15.50:0/1482072628 wait complete. 2023-12-24T18:51:45.236 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:45.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:45.291 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.286+0000 7fe86fdce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:45.368 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.362+0000 7fe86fdce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:45.416 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:45.413+0000 7fee0115d000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:51:45.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.461+0000 7f7c2dee3700 1 Processor -- start 2023-12-24T18:51:45.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.461+0000 7f7c2dee3700 1 -- start start 2023-12-24T18:51:45.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2dee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c28155140 0x7f7c2806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2dee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2dee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2806d4d0 con 0x7f7c28156730 2023-12-24T18:51:45.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2dee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2806c8c0 con 0x7f7c28155140 2023-12-24T18:51:45.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2dee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2806cba0 con 0x7f7c28155510 2023-12-24T18:51:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:56306/0 (socket says 172.21.15.50:56306) 2023-12-24T18:51:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2cee1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c28155140 0x7f7c2806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 -- 172.21.15.50:0/388383638 learned_addr learned my addr 172.21.15.50:0/388383638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 -- 172.21.15.50:0/388383638 >> v2:172.21.15.82:3300/0 conn(0x7f7c28155140 msgr2=0x7f7c2806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 --2- 172.21.15.50:0/388383638 >> v2:172.21.15.82:3300/0 conn(0x7f7c28155140 0x7f7c2806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 -- 172.21.15.50:0/388383638 >> v1:172.21.15.82:6789/0 conn(0x7f7c28156730 legacy=0x7f7c2806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 -- 172.21.15.50:0/388383638 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2806ce80 con 0x7f7c28155510 2023-12-24T18:51:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c2d6e2700 1 --2- 172.21.15.50:0/388383638 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000ab50 tx=0x7f7c2000a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9d2fe3eaf3ef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c1f7fe700 1 -- 172.21.15.50:0/388383638 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000c970 con 0x7f7c28155510 2023-12-24T18:51:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c1f7fe700 1 -- 172.21.15.50:0/388383638 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000cad0 con 0x7f7c28155510 2023-12-24T18:51:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.465+0000 7f7c1f7fe700 1 -- 172.21.15.50:0/388383638 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000ce70 con 0x7f7c28155510 2023-12-24T18:51:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 -- 172.21.15.50:0/388383638 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 msgr2=0x7f7c28156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/388383638 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000ab50 tx=0x7f7c2000a3f0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 -- 172.21.15.50:0/388383638 shutdown_connections 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/388383638 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28155510 0x7f7c28156b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/388383638 >> v2:172.21.15.82:3300/0 conn(0x7f7c28155140 0x7f7c2806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 -- 172.21.15.50:0/388383638 >> 172.21.15.50:0/388383638 conn(0x7f7c28067b80 msgr2=0x7f7c280cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 -- 172.21.15.50:0/388383638 shutdown_connections 2023-12-24T18:51:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.469+0000 7f7c2dee3700 1 -- 172.21.15.50:0/388383638 wait complete. 2023-12-24T18:51:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 Processor -- start 2023-12-24T18:51:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 -- start start 2023-12-24T18:51:45.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c28155510 0x7f7c2816c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 0x7f7c2816cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2816a390 con 0x7f7c28155140 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2816af10 con 0x7f7c28155510 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2dee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2816a5e0 con 0x7f7c28156730 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60720/0 (socket says 172.21.15.50:60720) 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 -- 172.21.15.50:0/222049737 learned_addr learned my addr 172.21.15.50:0/222049737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c1ffff700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c28155510 0x7f7c2816c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2d6e2700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 0x7f7c2816cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 -- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 msgr2=0x7f7c2816cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 0x7f7c2816cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 -- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c28155510 msgr2=0x7f7c2816c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c28155510 0x7f7c2816c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 -- 172.21.15.50:0/222049737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2000a690 con 0x7f7c28155140 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2d6e2700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 0x7f7c2816cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.473+0000 7f7c2cee1700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009f20 tx=0x7f7c2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400cbd0 con 0x7f7c28155140 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400f040 con 0x7f7c28155140 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24014480 con 0x7f7c28155140 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2816a8c0 con 0x7f7c28155140 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280c5860 con 0x7f7c28155140 2023-12-24T18:51:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.477+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2804be40 con 0x7f7c28155140 2023-12-24T18:51:45.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.481+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f7c240147f0 con 0x7f7c28155140 2023-12-24T18:51:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.481+0000 7f7c1cff9700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 0x7f7c14062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.481+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f7c2407dd20 con 0x7f7c28155140 2023-12-24T18:51:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.481+0000 7f7c1ffff700 1 -- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 msgr2=0x7f7c14062c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:45.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.481+0000 7f7c1ffff700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 0x7f7c14062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.485+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c2404db20 con 0x7f7c28155140 2023-12-24T18:51:45.580 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.574+0000 7fe86fdce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:45.647 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:45.645+0000 7fee0115d000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:51:45.658 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.654+0000 7fe86fdce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:45.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.661+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c28154160 con 0x7f7c28155140 2023-12-24T18:51:45.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.661+0000 7f7c1cff9700 1 -- 172.21.15.50:0/222049737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16448 (secure 0 0 0) 0x7f7c24051140 con 0x7f7c28155140 2023-12-24T18:51:45.665 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:45.666 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:40.359892+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2952635358":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2571557199":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2638846780":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/1417166884":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6836/33814":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6834/33814":"2023-12-25T18:51:40.359800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 msgr2=0x7f7c14062c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 0x7f7c14062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 msgr2=0x7f7c28141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009f20 tx=0x7f7c2400b040 comp rx=0 tx=0).stop 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 shutdown_connections 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c14060780 0x7f7c14062c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c28156730 0x7f7c2816cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c28155510 0x7f7c2816c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 --2- 172.21.15.50:0/222049737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28155140 0x7f7c28141de0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 >> 172.21.15.50:0/222049737 conn(0x7f7c28067b80 msgr2=0x7f7c280af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 shutdown_connections 2023-12-24T18:51:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.665+0000 7f7c2dee3700 1 -- 172.21.15.50:0/222049737 wait complete. 2023-12-24T18:51:45.690 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:51:45.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:45.739 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.734+0000 7fe86fdce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:45.748 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:45.745+0000 7fee0115d000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:51:45.831 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:45.829+0000 7fee0115d000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:51:45.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.849+0000 7f401f59e700 1 Processor -- start 2023-12-24T18:51:45.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.849+0000 7f401f59e700 1 -- start start 2023-12-24T18:51:45.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402015a2d0 0x7f40200ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f4020160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200b0460 con 0x7f402006c820 2023-12-24T18:51:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402006d8c0 con 0x7f402015a2d0 2023-12-24T18:51:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40200afc60 con 0x7f40200ade60 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402015a2d0 0x7f40200ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402015a2d0 0x7f40200ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50632/0 (socket says 172.21.15.50:50632) 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 -- 172.21.15.50:0/3491393279 learned_addr learned my addr 172.21.15.50:0/3491393279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401dd9b700 1 --1- 172.21.15.50:0/3491393279 >> v1:172.21.15.82:6789/0 conn(0x7f402006c820 0x7f40200ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51202/0 (socket says 172.21.15.50:51202) 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401ed9d700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f4020160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 -- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 msgr2=0x7f4020160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f4020160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 -- 172.21.15.50:0/3491393279 >> v1:172.21.15.82:6789/0 conn(0x7f402006c820 legacy=0x7f40200ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.853+0000 7f401e59c700 1 -- 172.21.15.50:0/3491393279 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402006a5c0 con 0x7f402015a2d0 2023-12-24T18:51:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401e59c700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200ae8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f40100099b0 tx=0x7f4010009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641924864cf6cfa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401d59a700 1 -- 172.21.15.50:0/3491393279 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010009ea0 con 0x7f402015a2d0 2023-12-24T18:51:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401d59a700 1 -- 172.21.15.50:0/3491393279 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401000b860 con 0x7f402015a2d0 2023-12-24T18:51:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401d59a700 1 -- 172.21.15.50:0/3491393279 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401000bc00 con 0x7f402015a2d0 2023-12-24T18:51:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 -- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 msgr2=0x7f40200ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200ae8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f40100099b0 tx=0x7f4010009250 comp rx=0 tx=0).stop 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 -- 172.21.15.50:0/3491393279 shutdown_connections 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f4020160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 --2- 172.21.15.50:0/3491393279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200ae8b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 -- 172.21.15.50:0/3491393279 >> 172.21.15.50:0/3491393279 conn(0x7f4020067b80 msgr2=0x7f40200cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 -- 172.21.15.50:0/3491393279 shutdown_connections 2023-12-24T18:51:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.857+0000 7f401f59e700 1 -- 172.21.15.50:0/3491393279 wait complete. 2023-12-24T18:51:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 Processor -- start 2023-12-24T18:51:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 -- start start 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f40200a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200aa4f0 con 0x7f402006c820 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200abbb0 con 0x7f402015a2d0 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40200abe90 con 0x7f40200ade60 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.861+0000 7f401e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401dd9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f40200a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60734/0 (socket says 172.21.15.50:60734) 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 -- 172.21.15.50:0/1000614098 learned_addr learned my addr 172.21.15.50:0/1000614098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 msgr2=0x7f40200a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f40200a9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 msgr2=0x7f40200c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 -- 172.21.15.50:0/1000614098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100094f0 con 0x7f402006c820 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401e59c700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40200ae3d0 tx=0x7f4010017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010000d10 con 0x7f402006c820 2023-12-24T18:51:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401000bbe0 con 0x7f402006c820 2023-12-24T18:51:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011670 con 0x7f402006c820 2023-12-24T18:51:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40200ac170 con 0x7f402006c820 2023-12-24T18:51:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40200ac730 con 0x7f402006c820 2023-12-24T18:51:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.865+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40200ac940 con 0x7f402006c820 2023-12-24T18:51:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.869+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f4010011aa0 con 0x7f402006c820 2023-12-24T18:51:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.869+0000 7f400e7fc700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 0x7f4000062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.869+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f401007e390 con 0x7f402006c820 2023-12-24T18:51:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.869+0000 7f401dd9b700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 msgr2=0x7f4000062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:45.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.869+0000 7f401dd9b700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 0x7f4000062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:45.877+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f401004e320 con 0x7f402006c820 2023-12-24T18:51:45.922 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:45.921+0000 7fee0115d000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:51:45.931 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:45.926+0000 7fe86fdce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:46.012 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:46.006+0000 7fe86fdce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.073+0000 7f401dd9b700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 msgr2=0x7f4000062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.073+0000 7f401dd9b700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 0x7f4000062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.089+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f402004be40 con 0x7f402006c820 2023-12-24T18:51:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.089+0000 7f400e7fc700 1 -- 172.21.15.50:0/1000614098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f4010051940 con 0x7f402006c820 2023-12-24T18:51:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:46.092 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 msgr2=0x7f4000062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 0x7f4000062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 msgr2=0x7f40200ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40200ae3d0 tx=0x7f4010017000 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 shutdown_connections 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4000060700 0x7f4000062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402015a2d0 0x7f40200c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40200ade60 0x7f40200a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 --2- 172.21.15.50:0/1000614098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f402006c820 0x7f40200ab540 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 >> 172.21.15.50:0/1000614098 conn(0x7f4020067b80 msgr2=0x7f4020154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 shutdown_connections 2023-12-24T18:51:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.093+0000 7f401f59e700 1 -- 172.21.15.50:0/1000614098 wait complete. 2023-12-24T18:51:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:46.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:46.165 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:46.161+0000 7fee0115d000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:51:46.252 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:46.249+0000 7fee0115d000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:51:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.273+0000 7f92afd85700 1 Processor -- start 2023-12-24T18:51:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.273+0000 7f92afd85700 1 -- start start 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a815d170 0x7f92a80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 0x7f92a806be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92a8161090 0x7f92a8161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a8161a50 con 0x7f92a8161090 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a80b0200 con 0x7f92a806b9f0 2023-12-24T18:51:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92afd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80af5f0 con 0x7f92a815d170 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92a8161090 0x7f92a8161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92a8161090 0x7f92a8161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60746/0 (socket says 172.21.15.50:60746) 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 -- 172.21.15.50:0/2652173881 learned_addr learned my addr 172.21.15.50:0/2652173881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ad320700 1 --2- 172.21.15.50:0/2652173881 >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 0x7f92a806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92adb21700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a815d170 0x7f92a80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 -- 172.21.15.50:0/2652173881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a815d170 msgr2=0x7f92a80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a815d170 0x7f92a80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 -- 172.21.15.50:0/2652173881 >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 msgr2=0x7f92a806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 --2- 172.21.15.50:0/2652173881 >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 0x7f92a806be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 -- 172.21.15.50:0/2652173881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80af8d0 con 0x7f92a8161090 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ad320700 1 --2- 172.21.15.50:0/2652173881 >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 0x7f92a806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92ae322700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a8161090 0x7f92a8161510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f92a806a380 tx=0x7f92a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd82a231e0f7ac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92acb1f700 1 -- 172.21.15.50:0/2652173881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000e070 con 0x7f92a8161090 2023-12-24T18:51:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92acb1f700 1 -- 172.21.15.50:0/2652173881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a000b970 con 0x7f92a8161090 2023-12-24T18:51:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.277+0000 7f92acb1f700 1 -- 172.21.15.50:0/2652173881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00092e0 con 0x7f92a8161090 2023-12-24T18:51:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 -- 172.21.15.50:0/2652173881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a8161090 msgr2=0x7f92a8161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a8161090 0x7f92a8161510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f92a806a380 tx=0x7f92a0009840 comp rx=0 tx=0).stop 2023-12-24T18:51:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 -- 172.21.15.50:0/2652173881 shutdown_connections 2023-12-24T18:51:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 --2- 172.21.15.50:0/2652173881 >> v2:172.21.15.82:3300/0 conn(0x7f92a806b9f0 0x7f92a806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a8161090 0x7f92a8161510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 --2- 172.21.15.50:0/2652173881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a815d170 0x7f92a80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 -- 172.21.15.50:0/2652173881 >> 172.21.15.50:0/2652173881 conn(0x7f92a80670b0 msgr2=0x7f92a8067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 -- 172.21.15.50:0/2652173881 shutdown_connections 2023-12-24T18:51:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.281+0000 7f92afd85700 1 -- 172.21.15.50:0/2652173881 wait complete. 2023-12-24T18:51:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 Processor -- start 2023-12-24T18:51:46.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 -- start start 2023-12-24T18:51:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a815d170 0x7f92a80a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a8161090 0x7f92a80a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80a71a0 con 0x7f92a806b9f0 2023-12-24T18:51:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80a7ee0 con 0x7f92a815d170 2023-12-24T18:51:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92afd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80a81c0 con 0x7f92a8161090 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60754/0 (socket says 172.21.15.50:60754) 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 -- 172.21.15.50:0/3987107548 learned_addr learned my addr 172.21.15.50:0/3987107548 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92ad320700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a815d170 0x7f92a80a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92ae322700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a8161090 0x7f92a80a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a8161090 msgr2=0x7f92a80a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a8161090 0x7f92a80a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a815d170 msgr2=0x7f92a80a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a815d170 0x7f92a80a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.285+0000 7f92adb21700 1 -- 172.21.15.50:0/3987107548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009420 con 0x7f92a806b9f0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f92adb21700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f92a400ec80 tx=0x7f92a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400c9d0 con 0x7f92a806b9f0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a400cb30 con 0x7f92a806b9f0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4013470 con 0x7f92a806b9f0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a0009ae0 con 0x7f92a806b9f0 2023-12-24T18:51:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a80a8780 con 0x7f92a806b9f0 2023-12-24T18:51:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.289+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a80652e0 con 0x7f92a806b9f0 2023-12-24T18:51:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.293+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f92a4013820 con 0x7f92a806b9f0 2023-12-24T18:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.293+0000 7f929dffb700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 0x7f928c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.293+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f92a407d260 con 0x7f92a806b9f0 2023-12-24T18:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.293+0000 7f92ad320700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 msgr2=0x7f928c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.293+0000 7f92ad320700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 0x7f928c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.297+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f92a404d210 con 0x7f92a806b9f0 2023-12-24T18:51:46.375 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:46.373+0000 7fee0115d000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:51:46.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.497+0000 7f92ad320700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 msgr2=0x7f928c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:46.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.497+0000 7f92ad320700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 0x7f928c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.565+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92a80afbb0 con 0x7f92a806b9f0 2023-12-24T18:51:46.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.565+0000 7f929dffb700 1 -- 172.21.15.50:0/3987107548 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f92a4050830 con 0x7f92a806b9f0 2023-12-24T18:51:46.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:46.569 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:51:21.222503+0000","modified":"2023-12-24T18:51:24.819095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6349":{"gid":6349,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/465649876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":465649876},{"type":"v1","addr":"172.21.15.82:6835","nonce":465649876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 msgr2=0x7f928c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 0x7f928c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 msgr2=0x7f92a80ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f92a400ec80 tx=0x7f92a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 shutdown_connections 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f928c060700 0x7f928c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92a8161090 0x7f92a80a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a815d170 0x7f92a80a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 --2- 172.21.15.50:0/3987107548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92a806b9f0 0x7f92a80ab800 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 >> 172.21.15.50:0/3987107548 conn(0x7f92a80670b0 msgr2=0x7f92a806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 shutdown_connections 2023-12-24T18:51:46.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.569+0000 7f92afd85700 1 -- 172.21.15.50:0/3987107548 wait complete. 2023-12-24T18:51:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-12-24T18:51:46.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:46.612 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:46.609+0000 7fee0115d000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:51:46.708 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:46.705+0000 7fee0115d000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:51:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 Processor -- start 2023-12-24T18:51:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 -- start start 2023-12-24T18:51:46.768 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:51:46.762+0000 7fe86fdce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:46.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 0x7f7c7c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c7c15b160 0x7f7c7c06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c06ca50 con 0x7f7c7c06ae10 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0c6980 con 0x7f7c7c15b160 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.765+0000 7f7c8406e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c06b7f0 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8260b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c7c15b160 0x7f7c7c06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 0x7f7c7c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81609700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7c7c06ae10 0x7f7c7c15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51208/0 (socket says 172.21.15.50:51208) 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81609700 1 -- 172.21.15.50:0/601158073 learned_addr learned my addr 172.21.15.50:0/601158073 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 -- 172.21.15.50:0/601158073 >> v2:172.21.15.50:3300/0 conn(0x7f7c7c15b160 msgr2=0x7f7c7c06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 --2- 172.21.15.50:0/601158073 >> v2:172.21.15.50:3300/0 conn(0x7f7c7c15b160 0x7f7c7c06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 -- 172.21.15.50:0/601158073 >> v1:172.21.15.82:6789/0 conn(0x7f7c7c06ae10 legacy=0x7f7c7c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 -- 172.21.15.50:0/601158073 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c06bad0 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c80e08700 1 -- 172.21.15.50:0/601158073 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860506662 0 0) 0x7f7c7c06ca50 con 0x7f7c7c06ae10 2023-12-24T18:51:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c81e0a700 1 --2- 172.21.15.50:0/601158073 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 0x7f7c7c0ca770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098e0 tx=0x7f7c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d63c8728e9eb57 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c80e08700 1 -- 172.21.15.50:0/601158073 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800b640 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c80e08700 1 -- 172.21.15.50:0/601158073 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800b7a0 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c80e08700 1 -- 172.21.15.50:0/601158073 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800bb40 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 -- 172.21.15.50:0/601158073 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 msgr2=0x7f7c7c0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 --2- 172.21.15.50:0/601158073 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 0x7f7c7c0ca770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098e0 tx=0x7f7c780091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 -- 172.21.15.50:0/601158073 shutdown_connections 2023-12-24T18:51:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 --2- 172.21.15.50:0/601158073 >> v2:172.21.15.50:3300/0 conn(0x7f7c7c15b160 0x7f7c7c06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 --2- 172.21.15.50:0/601158073 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c0ca3a0 0x7f7c7c0ca770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 -- 172.21.15.50:0/601158073 >> 172.21.15.50:0/601158073 conn(0x7f7c7c0cbba0 msgr2=0x7f7c7c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:46.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 -- 172.21.15.50:0/601158073 shutdown_connections 2023-12-24T18:51:46.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.769+0000 7f7c8406e700 1 -- 172.21.15.50:0/601158073 wait complete. 2023-12-24T18:51:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.773+0000 7f7c8406e700 1 Processor -- start 2023-12-24T18:51:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.773+0000 7f7c8406e700 1 -- start start 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 0x7f7c7c16e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c7c15b160 0x7f7c7c0afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0c9340 con 0x7f7c7c0ca3a0 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c16e9d0 con 0x7f7c7c15b160 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0af580 con 0x7f7c7c06ae10 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 0x7f7c7c16e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 0x7f7c7c16e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60774/0 (socket says 172.21.15.50:60774) 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:56374/0 (socket says 172.21.15.50:56374) 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81609700 1 -- 172.21.15.50:0/1323797227 learned_addr learned my addr 172.21.15.50:0/1323797227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8260b700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c7c15b160 0x7f7c7c0afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 -- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c7c15b160 msgr2=0x7f7c7c0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c7c15b160 0x7f7c7c0afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 -- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 msgr2=0x7f7c7c16e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 0x7f7c7c16e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 -- 172.21.15.50:0/1323797227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009420 con 0x7f7c7c06ae10 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c81e0a700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c78016000 tx=0x7f7c78017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78000bc0 con 0x7f7c7c06ae10 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800b910 con 0x7f7c7c06ae10 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78026480 con 0x7f7c7c06ae10 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c155c70 con 0x7f7c7c06ae10 2023-12-24T18:51:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.777+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c0aef30 con 0x7f7c7c06ae10 2023-12-24T18:51:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.781+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c0c6560 con 0x7f7c7c06ae10 2023-12-24T18:51:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.781+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f7c78023030 con 0x7f7c7c06ae10 2023-12-24T18:51:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.785+0000 7f7c71ffb700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 0x7f7c60062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.785+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f7c7807e3e0 con 0x7f7c7c06ae10 2023-12-24T18:51:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.785+0000 7f7c81609700 1 -- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 msgr2=0x7f7c60062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.785+0000 7f7c81609700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 0x7f7c60062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:46.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.793+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c7c0c6560 con 0x7f7c7c06ae10 2023-12-24T18:51:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.965+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7c0c6560 con 0x7f7c7c06ae10 2023-12-24T18:51:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.969+0000 7f7c71ffb700 1 -- 172.21.15.50:0/1323797227 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16448 (secure 0 0 0) 0x7f7c7c0c6560 con 0x7f7c7c06ae10 2023-12-24T18:51:46.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:46.972 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:40.359892+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:18.882615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:20.237274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2952635358":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2571557199":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/2638846780":"2023-12-25T18:51:40.359800+0000","172.21.15.50:0/1417166884":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6836/33814":"2023-12-25T18:51:40.359800+0000","172.21.15.50:6834/33814":"2023-12-25T18:51:40.359800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 msgr2=0x7f7c60062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 0x7f7c60062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 msgr2=0x7f7c7c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c78016000 tx=0x7f7c78017000 comp rx=0 tx=0).stop 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 shutdown_connections 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7c60060700 0x7f7c60062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c7c15b160 0x7f7c7c0afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0ca3a0 0x7f7c7c16e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 --2- 172.21.15.50:0/1323797227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7c06ae10 0x7f7c7c1552f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 >> 172.21.15.50:0/1323797227 conn(0x7f7c7c0cbba0 msgr2=0x7f7c7c1576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 shutdown_connections 2023-12-24T18:51:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:46.973+0000 7f7c8406e700 1 -- 172.21.15.50:0/1323797227 wait complete. 2023-12-24T18:51:46.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:51:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.161+0000 7f933ed23700 1 Processor -- start 2023-12-24T18:51:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.161+0000 7f933ed23700 1 -- start start 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933ed23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f933806b6c0 0x7f93381590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933ed23700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f933806c0c0 0x7f93380a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933ed23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380a9c80 con 0x7f9338158cd0 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933ed23700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933806c4f0 con 0x7f933806c0c0 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933ed23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93380a8e10 con 0x7f933806b6c0 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f933806c0c0 0x7f93380a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f933806c0c0 0x7f93380a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60776/0 (socket says 172.21.15.50:60776) 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 -- 172.21.15.50:0/259688922 learned_addr learned my addr 172.21.15.50:0/259688922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933d520700 1 --2- 172.21.15.50:0/259688922 >> v2:172.21.15.82:3300/0 conn(0x7f933806b6c0 0x7f93381590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 -- 172.21.15.50:0/259688922 >> v2:172.21.15.82:3300/0 conn(0x7f933806b6c0 msgr2=0x7f93381590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 --2- 172.21.15.50:0/259688922 >> v2:172.21.15.82:3300/0 conn(0x7f933806b6c0 0x7f93381590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 -- 172.21.15.50:0/259688922 >> v1:172.21.15.50:6789/0 conn(0x7f9338158cd0 legacy=0x7f933806afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 -- 172.21.15.50:0/259688922 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380a9070 con 0x7f933806c0c0 2023-12-24T18:51:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933cd1f700 1 -- 172.21.15.50:0/259688922 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021341277 0 0) 0x7f93380a9c80 con 0x7f9338158cd0 2023-12-24T18:51:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933e522700 1 --2- 172.21.15.50:0/259688922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806c0c0 0x7f93380a88d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f93380b1b40 tx=0x7f9330009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1e51d84ea6c7c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933cd1f700 1 -- 172.21.15.50:0/259688922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933000e070 con 0x7f933806c0c0 2023-12-24T18:51:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933cd1f700 1 -- 172.21.15.50:0/259688922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933000ba20 con 0x7f933806c0c0 2023-12-24T18:51:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.165+0000 7f933cd1f700 1 -- 172.21.15.50:0/259688922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300092e0 con 0x7f933806c0c0 2023-12-24T18:51:47.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 -- 172.21.15.50:0/259688922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806c0c0 msgr2=0x7f93380a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 --2- 172.21.15.50:0/259688922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806c0c0 0x7f93380a88d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f93380b1b40 tx=0x7f9330009840 comp rx=0 tx=0).stop 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 -- 172.21.15.50:0/259688922 shutdown_connections 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 --2- 172.21.15.50:0/259688922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806c0c0 0x7f93380a88d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 --2- 172.21.15.50:0/259688922 >> v2:172.21.15.82:3300/0 conn(0x7f933806b6c0 0x7f93381590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 -- 172.21.15.50:0/259688922 >> 172.21.15.50:0/259688922 conn(0x7f9338067b80 msgr2=0x7f93380cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 -- 172.21.15.50:0/259688922 shutdown_connections 2023-12-24T18:51:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.169+0000 7f933ed23700 1 -- 172.21.15.50:0/259688922 wait complete. 2023-12-24T18:51:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 Processor -- start 2023-12-24T18:51:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 -- start start 2023-12-24T18:51:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f933806c0c0 0x7f933815df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9338158cd0 0x7f933815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93380ab620 con 0x7f933806b6c0 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338151d30 con 0x7f933806c0c0 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380adcf0 con 0x7f9338158cd0 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60788/0 (socket says 172.21.15.50:60788) 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 -- 172.21.15.50:0/47754962 learned_addr learned my addr 172.21.15.50:0/47754962 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933e522700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9338158cd0 0x7f933815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933d520700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f933806c0c0 0x7f933815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9338158cd0 msgr2=0x7f933815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9338158cd0 0x7f933815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f933806c0c0 msgr2=0x7f933815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f933806c0c0 0x7f933815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 -- 172.21.15.50:0/47754962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330009ae0 con 0x7f933806b6c0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933dd21700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f933400c7e0 tx=0x7f9334007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340105c0 con 0x7f933806b6c0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334010740 con 0x7f933806b6c0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334010b00 con 0x7f933806b6c0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.173+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93380adfd0 con 0x7f933806b6c0 2023-12-24T18:51:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.177+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9338152260 con 0x7f933806b6c0 2023-12-24T18:51:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.177+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93380ae1c0 con 0x7f933806b6c0 2023-12-24T18:51:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.177+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 34) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f933401b3b0 con 0x7f933806b6c0 2023-12-24T18:51:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.181+0000 7f932dffb700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 0x7f931c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.181+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f933407c4a0 con 0x7f933806b6c0 2023-12-24T18:51:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.181+0000 7f933d520700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 msgr2=0x7f931c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.181+0000 7f933d520700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 0x7f931c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:51:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.189+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f933404c3b0 con 0x7f933806b6c0 2023-12-24T18:51:47.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.385+0000 7f933d520700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 msgr2=0x7f931c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:51:47.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.385+0000 7f933d520700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 0x7f931c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:51:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.397+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f933806a840 con 0x7f933806b6c0 2023-12-24T18:51:47.400 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:51:47.397+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:51:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.409+0000 7f932dffb700 1 -- 172.21.15.50:0/47754962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9334017090 con 0x7f933806b6c0 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 msgr2=0x7f931c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 0x7f931c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 msgr2=0x7f9338144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f933400c7e0 tx=0x7f9334007df0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 shutdown_connections 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f931c060700 0x7f931c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9338158cd0 0x7f933815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f933806c0c0 0x7f933815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 --2- 172.21.15.50:0/47754962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933806b6c0 0x7f9338144570 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 >> 172.21.15.50:0/47754962 conn(0x7f9338067b80 msgr2=0x7f9338154720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 shutdown_connections 2023-12-24T18:51:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.413+0000 7f933ed23700 1 -- 172.21.15.50:0/47754962 wait complete. 2023-12-24T18:51:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:51:47.423 INFO:tasks.ceph.mds.d.smithi082.stderr: -2152> 2023-12-24T18:51:27.739+0000 7fcf005b2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:51:47.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:51:47.466 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:51:47.500 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.497+0000 7fee0115d000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:51:47.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 Processor -- start 2023-12-24T18:51:47.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 -- start start 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 0x7fe90c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe90c06d450 0x7fe90c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c06a580 con 0x7fe90c0cc780 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c0cd110 con 0x7fe90c06d450 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911963700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c06a7d0 con 0x7fe90c158c40 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe910961700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 0x7fe90c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911162700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe90c06d450 0x7fe90c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911162700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe90c06d450 0x7fe90c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60904/0 (socket says 172.21.15.50:60904) 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe910961700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 0x7fe90c0cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50816/0 (socket says 172.21.15.50:50816) 2023-12-24T18:51:47.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.609+0000 7fe911162700 1 -- 172.21.15.50:0/4171537921 learned_addr learned my addr 172.21.15.50:0/4171537921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911162700 1 -- 172.21.15.50:0/4171537921 >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 msgr2=0x7fe90c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911162700 1 --2- 172.21.15.50:0/4171537921 >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 0x7fe90c0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911162700 1 -- 172.21.15.50:0/4171537921 >> v1:172.21.15.82:6789/0 conn(0x7fe90c0cc780 legacy=0x7fe90c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911162700 1 -- 172.21.15.50:0/4171537921 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c06aab0 con 0x7fe90c06d450 2023-12-24T18:51:47.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911162700 1 --2- 172.21.15.50:0/4171537921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c06d450 0x7fe90c0ccbd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe90c069f90 tx=0x7fe904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c944b6af575bba86 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:47.615 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedca619700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.615 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedca619700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.615 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedca619700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.615 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedca619700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.615 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedca619700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe90bfff700 1 -- 172.21.15.50:0/4171537921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904009e70 con 0x7fe90c06d450 2023-12-24T18:51:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe90bfff700 1 -- 172.21.15.50:0/4171537921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400b860 con 0x7fe90c06d450 2023-12-24T18:51:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe90bfff700 1 -- 172.21.15.50:0/4171537921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400bc00 con 0x7fe90c06d450 2023-12-24T18:51:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 -- 172.21.15.50:0/4171537921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c06d450 msgr2=0x7fe90c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 --2- 172.21.15.50:0/4171537921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c06d450 0x7fe90c0ccbd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe90c069f90 tx=0x7fe904009250 comp rx=0 tx=0).stop 2023-12-24T18:51:47.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedc8615700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedc8615700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedc8615700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedc8615700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fedc8615700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:51:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 -- 172.21.15.50:0/4171537921 shutdown_connections 2023-12-24T18:51:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 --2- 172.21.15.50:0/4171537921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c06d450 0x7fe90c0ccbd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 --2- 172.21.15.50:0/4171537921 >> v2:172.21.15.82:3300/0 conn(0x7fe90c158c40 0x7fe90c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 -- 172.21.15.50:0/4171537921 >> 172.21.15.50:0/4171537921 conn(0x7fe90c0d0800 msgr2=0x7fe90c0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 -- 172.21.15.50:0/4171537921 shutdown_connections 2023-12-24T18:51:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.613+0000 7fe911963700 1 -- 172.21.15.50:0/4171537921 wait complete. 2023-12-24T18:51:47.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 Processor -- start 2023-12-24T18:51:47.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 -- start start 2023-12-24T18:51:47.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c0cc780 0x7fe90c0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c158c40 0x7fe90c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15beb0 con 0x7fe90c158c40 2023-12-24T18:51:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15b6a0 con 0x7fe90c06d450 2023-12-24T18:51:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911963700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c152b30 con 0x7fe90c0cc780 2023-12-24T18:51:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe910961700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe910961700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50838/0 (socket says 172.21.15.50:50838) 2023-12-24T18:51:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe910961700 1 -- 172.21.15.50:0/1147498281 learned_addr learned my addr 172.21.15.50:0/1147498281 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe903fff700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c0cc780 0x7fe90c0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.617+0000 7fe911162700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c158c40 0x7fe90c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 -- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c0cc780 msgr2=0x7fe90c0c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c0cc780 0x7fe90c0c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 -- 172.21.15.50:0/1147498281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c158c40 msgr2=0x7fe90c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c158c40 0x7fe90c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 -- 172.21.15.50:0/1147498281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9040094f0 con 0x7fe90c06d450 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe910961700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009e80 tx=0x7fe8fc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00caa0 con 0x7fe90c06d450 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00f040 con 0x7fe90c06d450 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00ce50 con 0x7fe90c06d450 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c169560 con 0x7fe90c06d450 2023-12-24T18:51:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c15bbd0 con 0x7fe90c06d450 2023-12-24T18:51:47.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c04be40 con 0x7fe90c06d450 2023-12-24T18:51:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.621+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 79672+0+0 (secure 0 0 0) 0x7fe8fc014690 con 0x7fe90c06d450 2023-12-24T18:51:47.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.625+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7046+0+0 (secure 0 0 0) 0x7fe8fc07d100 con 0x7fe90c06d450 2023-12-24T18:51:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.629+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe8fc04d2b0 con 0x7fe90c06d450 2023-12-24T18:51:47.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:47.845+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe90c06ad90 con 0x7fe90c06d450 2023-12-24T18:51:48.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.445+0000 7fe9097fa700 1 -- 172.21.15.50:0/1147498281 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe8fc050aa0 con 0x7fe90c06d450 2023-12-24T18:51:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 msgr2=0x7fe90c1468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009e80 tx=0x7fe8fc00b040 comp rx=0 tx=0).stop 2023-12-24T18:51:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 shutdown_connections 2023-12-24T18:51:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe90c158c40 0x7fe90c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c0cc780 0x7fe90c0c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 --2- 172.21.15.50:0/1147498281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c06d450 0x7fe90c1468f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 >> 172.21.15.50:0/1147498281 conn(0x7fe90c0d0800 msgr2=0x7fe90c0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 shutdown_connections 2023-12-24T18:51:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.449+0000 7fe911963700 1 -- 172.21.15.50:0/1147498281 wait complete. 2023-12-24T18:51:48.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:51:48.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.649+0000 7f6626a16700 1 Processor -- start 2023-12-24T18:51:48.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.649+0000 7f6626a16700 1 -- start start 2023-12-24T18:51:48.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626a16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6620159080 0x7f662006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626a16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 0x7f66200c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626a16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66200c5f20 con 0x7f66200c5ac0 2023-12-24T18:51:48.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626a16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662015dbd0 con 0x7f6620159080 2023-12-24T18:51:48.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626a16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662006b5b0 con 0x7f662006a4a0 2023-12-24T18:51:48.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626215700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66200c5ac0 0x7f662006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37218/0 (socket says 172.21.15.50:37218) 2023-12-24T18:51:48.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6626215700 1 -- 172.21.15.50:0/1293809734 learned_addr learned my addr 172.21.15.50:0/1293809734 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625a14700 1 --2- 172.21.15.50:0/1293809734 >> v2:172.21.15.82:3300/0 conn(0x7f6620159080 0x7f662006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625213700 1 --2- 172.21.15.50:0/1293809734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 0x7f66200c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6624a12700 1 -- 172.21.15.50:0/1293809734 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433793490 0 0) 0x7f6618001490 con 0x7f66200c5ac0 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6624a12700 1 -- 172.21.15.50:0/1293809734 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f660c003570 con 0x7f66200c5ac0 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625213700 1 -- 172.21.15.50:0/1293809734 >> v2:172.21.15.82:3300/0 conn(0x7f6620159080 msgr2=0x7f662006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625213700 1 --2- 172.21.15.50:0/1293809734 >> v2:172.21.15.82:3300/0 conn(0x7f6620159080 0x7f662006da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625213700 1 -- 172.21.15.50:0/1293809734 >> v1:172.21.15.50:6789/0 conn(0x7f66200c5ac0 legacy=0x7f662006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:48.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.653+0000 7f6625213700 1 -- 172.21.15.50:0/1293809734 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662006df80 con 0x7f662006a4a0 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6625213700 1 --2- 172.21.15.50:0/1293809734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 0x7f66200c5580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66100098e0 tx=0x7f66100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279ace9daa7afdf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6624a12700 1 -- 172.21.15.50:0/1293809734 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011630 con 0x7f662006a4a0 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6624a12700 1 -- 172.21.15.50:0/1293809734 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610011790 con 0x7f662006a4a0 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6624a12700 1 -- 172.21.15.50:0/1293809734 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011b30 con 0x7f662006a4a0 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 -- 172.21.15.50:0/1293809734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 msgr2=0x7f66200c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:48.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 --2- 172.21.15.50:0/1293809734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 0x7f66200c5580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66100098e0 tx=0x7f66100091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 -- 172.21.15.50:0/1293809734 shutdown_connections 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 --2- 172.21.15.50:0/1293809734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f662006a4a0 0x7f66200c5580 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 --2- 172.21.15.50:0/1293809734 >> v2:172.21.15.82:3300/0 conn(0x7f6620159080 0x7f662006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 -- 172.21.15.50:0/1293809734 >> 172.21.15.50:0/1293809734 conn(0x7f6620067b80 msgr2=0x7f66200cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 -- 172.21.15.50:0/1293809734 shutdown_connections 2023-12-24T18:51:48.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 -- 172.21.15.50:0/1293809734 wait complete. 2023-12-24T18:51:48.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.657+0000 7f6626a16700 1 Processor -- start 2023-12-24T18:51:48.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 -- start start 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66200c5ac0 0x7f662015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6620159080 0x7f662015d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620159860 con 0x7f662006a4a0 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200b47b0 con 0x7f6620159080 2023-12-24T18:51:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66200b4a90 con 0x7f66200c5ac0 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60938/0 (socket says 172.21.15.50:60938) 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 -- 172.21.15.50:0/252742369 learned_addr learned my addr 172.21.15.50:0/252742369 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625213700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66200c5ac0 0x7f662015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626215700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6620159080 0x7f662015d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 -- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66200c5ac0 msgr2=0x7f662015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66200c5ac0 0x7f662015cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 -- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6620159080 msgr2=0x7f662015d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6620159080 0x7f662015d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 -- 172.21.15.50:0/252742369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610009420 con 0x7f662006a4a0 2023-12-24T18:51:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6625a14700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f661c00e930 tx=0x7f661c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c013680 con 0x7f662006a4a0 2023-12-24T18:51:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66200b4d70 con 0x7f662006a4a0 2023-12-24T18:51:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c0137e0 con 0x7f662006a4a0 2023-12-24T18:51:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.661+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c013b80 con 0x7f662006a4a0 2023-12-24T18:51:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.665+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6620148730 con 0x7f662006a4a0 2023-12-24T18:51:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.665+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662004be40 con 0x7f662006a4a0 2023-12-24T18:51:48.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.665+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 37) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f661c00c3e0 con 0x7f662006a4a0 2023-12-24T18:51:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.669+0000 7f6615ffb700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 0x7f6604062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.669+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7046+0+0 (secure 0 0 0) 0x7f661c07cb20 con 0x7f662006a4a0 2023-12-24T18:51:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.669+0000 7f6625213700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 0x7f6604062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.669+0000 7f6625213700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 0x7f6604062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f662006a8d0 tx=0x7f6610017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.677+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f661c04cdb0 con 0x7f662006a4a0 2023-12-24T18:51:48.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:48.853+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f662006e1c0 con 0x7f662006a4a0 2023-12-24T18:51:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.629+0000 7f6615ffb700 1 -- 172.21.15.50:0/252742369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f661c0503d0 con 0x7f662006a4a0 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 msgr2=0x7f6604062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 0x7f6604062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f662006a8d0 tx=0x7f6610017000 comp rx=0 tx=0).stop 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 msgr2=0x7f66201481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f661c00e930 tx=0x7f661c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 shutdown_connections 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f66040603a0 0x7f6604062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6620159080 0x7f662015d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66200c5ac0 0x7f662015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 --2- 172.21.15.50:0/252742369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662006a4a0 0x7f66201481f0 secure :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f661c00e930 tx=0x7f661c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 >> 172.21.15.50:0/252742369 conn(0x7f6620067b80 msgr2=0x7f6620149920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 shutdown_connections 2023-12-24T18:51:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.633+0000 7f6626a16700 1 -- 172.21.15.50:0/252742369 wait complete. 2023-12-24T18:51:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:51:49.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:51:49.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 Processor -- start 2023-12-24T18:51:49.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 -- start start 2023-12-24T18:51:49.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:49.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6998069910 con 0x7f6998068ec0 2023-12-24T18:51:49.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6998069630 con 0x7f699815d4a0 2023-12-24T18:51:49.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.873+0000 7f699ceae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69980ca1c0 con 0x7f699815d870 2023-12-24T18:51:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:34416/0 (socket says 172.21.15.50:34416) 2023-12-24T18:51:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 -- 172.21.15.50:0/2394651483 learned_addr learned my addr 172.21.15.50:0/2394651483 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 -- 172.21.15.50:0/2394651483 >> v1:172.21.15.82:6789/0 conn(0x7f699815d4a0 legacy=0x7f69980c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f6995d9b700 1 -- 172.21.15.50:0/2394651483 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162972743 0 0) 0x7f6998069630 con 0x7f699815d4a0 2023-12-24T18:51:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 -- 172.21.15.50:0/2394651483 >> v1:172.21.15.50:6789/0 conn(0x7f6998068ec0 legacy=0x7f699806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 -- 172.21.15.50:0/2394651483 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980ca4a0 con 0x7f699815d870 2023-12-24T18:51:49.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.877+0000 7f698ffff700 1 --2- 172.21.15.50:0/2394651483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69800099e0 tx=0x7f6980009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78ea5478dd32d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.885+0000 7f6995d9b700 1 -- 172.21.15.50:0/2394651483 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000b760 con 0x7f699815d870 2023-12-24T18:51:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.885+0000 7f6995d9b700 1 -- 172.21.15.50:0/2394651483 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698000b8c0 con 0x7f699815d870 2023-12-24T18:51:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.885+0000 7f6995d9b700 1 -- 172.21.15.50:0/2394651483 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000bc80 con 0x7f699815d870 2023-12-24T18:51:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.885+0000 7f699ceae700 1 -- 172.21.15.50:0/2394651483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 msgr2=0x7f699806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.885+0000 7f699ceae700 1 --2- 172.21.15.50:0/2394651483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69800099e0 tx=0x7f6980009250 comp rx=0 tx=0).stop 2023-12-24T18:51:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 -- 172.21.15.50:0/2394651483 shutdown_connections 2023-12-24T18:51:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 --2- 172.21.15.50:0/2394651483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699815d870 0x7f699806d7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 -- 172.21.15.50:0/2394651483 >> 172.21.15.50:0/2394651483 conn(0x7f69980ccf90 msgr2=0x7f69980c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 -- 172.21.15.50:0/2394651483 shutdown_connections 2023-12-24T18:51:49.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 -- 172.21.15.50:0/2394651483 wait complete. 2023-12-24T18:51:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 Processor -- start 2023-12-24T18:51:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.889+0000 7f699ceae700 1 -- start start 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 0x7f69980afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 0x7f6998163060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980b0e80 con 0x7f699815d870 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c4390 con 0x7f699815d4a0 2023-12-24T18:51:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699ceae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c4080 con 0x7f6998068ec0 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f698ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 0x7f69980afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f698ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 0x7f69980afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f698ffff700 1 -- 172.21.15.50:0/97432610 learned_addr learned my addr 172.21.15.50:0/97432610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:34430/0 (socket says 172.21.15.50:34430) 2023-12-24T18:51:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f6996d9d700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 0x7f6998163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 -- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 msgr2=0x7f69980afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 0x7f69980afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 -- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 msgr2=0x7f6998163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 0x7f6998163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 -- 172.21.15.50:0/97432610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800094f0 con 0x7f6998068ec0 2023-12-24T18:51:49.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f6996d9d700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 0x7f6998163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.893+0000 7f699659c700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f698800c590 tx=0x7f6988007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988011590 con 0x7f6998068ec0 2023-12-24T18:51:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6988011710 con 0x7f6998068ec0 2023-12-24T18:51:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69980b05e0 con 0x7f6998068ec0 2023-12-24T18:51:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988011ad0 con 0x7f6998068ec0 2023-12-24T18:51:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69980b0ba0 con 0x7f6998068ec0 2023-12-24T18:51:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6998071060 con 0x7f6998068ec0 2023-12-24T18:51:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 37) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f698801b3b0 con 0x7f6998068ec0 2023-12-24T18:51:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 0x7f6978062950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f698807bc60 con 0x7f6998068ec0 2023-12-24T18:51:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.897+0000 7f698ffff700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 0x7f6978062950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.901+0000 7f698ffff700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 0x7f6978062950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6998160cc0 tx=0x7f6980016000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:49.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:49.901+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f698804c150 con 0x7f6998068ec0 2023-12-24T18:51:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.089+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f69980ca780 con 0x7f6998068ec0 2023-12-24T18:51:50.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.453+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6988055080 con 0x7f6998068ec0 2023-12-24T18:51:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.633+0000 7f698e7fc700 1 -- 172.21.15.50:0/97432610 <== mon.2 v2:172.21.15.82:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f698804fe10 con 0x7f6998068ec0 2023-12-24T18:51:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 msgr2=0x7f6978062950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 0x7f6978062950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6998160cc0 tx=0x7f6980016000 comp rx=0 tx=0).stop 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 msgr2=0x7f6998156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f698800c590 tx=0x7f6988007ce0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 shutdown_connections 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f69780604a0 0x7f6978062950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f699815d870 0x7f6998163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699815d4a0 0x7f69980afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 --2- 172.21.15.50:0/97432610 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6998068ec0 0x7f6998156ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.637+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 >> 172.21.15.50:0/97432610 conn(0x7f69980ccf90 msgr2=0x7f699806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.641+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 shutdown_connections 2023-12-24T18:51:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.641+0000 7f699ceae700 1 -- 172.21.15.50:0/97432610 wait complete. 2023-12-24T18:51:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:51:50.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:51:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 Processor -- start 2023-12-24T18:51:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 -- start start 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 0x7ff0d80c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d80cb980 0x7ff0d815d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d815dcc0 0x7ff0d815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d815e680 con 0x7ff0d815dcc0 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80c9a50 con 0x7ff0d815d3b0 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.833+0000 7ff0dda2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80cbdd0 con 0x7ff0d80cb980 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d815dcc0 0x7ff0d815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d815dcc0 0x7ff0d815e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49136/0 (socket says 172.21.15.50:49136) 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 -- 172.21.15.50:0/2893649006 learned_addr learned my addr 172.21.15.50:0/2893649006 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d6ffd700 1 --2- 172.21.15.50:0/2893649006 >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 0x7ff0d80c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d67fc700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d80cb980 0x7ff0d815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 -- 172.21.15.50:0/2893649006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d80cb980 msgr2=0x7ff0d815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d80cb980 0x7ff0d815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 -- 172.21.15.50:0/2893649006 >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 msgr2=0x7ff0d80c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 --2- 172.21.15.50:0/2893649006 >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 0x7ff0d80c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 -- 172.21.15.50:0/2893649006 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80c8e40 con 0x7ff0d815dcc0 2023-12-24T18:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d6ffd700 1 --2- 172.21.15.50:0/2893649006 >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 0x7ff0d80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d77fe700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815dcc0 0x7ff0d815e140 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806ba80 tx=0x7ff0d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acf5323977a3408 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d5ffb700 1 -- 172.21.15.50:0/2893649006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000e070 con 0x7ff0d815dcc0 2023-12-24T18:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d5ffb700 1 -- 172.21.15.50:0/2893649006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000b970 con 0x7ff0d815dcc0 2023-12-24T18:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0d5ffb700 1 -- 172.21.15.50:0/2893649006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00092e0 con 0x7ff0d815dcc0 2023-12-24T18:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2893649006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815dcc0 msgr2=0x7ff0d815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815dcc0 0x7ff0d815e140 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806ba80 tx=0x7ff0d0009840 comp rx=0 tx=0).stop 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2893649006 shutdown_connections 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815dcc0 0x7ff0d815e140 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2893649006 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d80cb980 0x7ff0d815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2893649006 >> v2:172.21.15.82:3300/0 conn(0x7ff0d815d3b0 0x7ff0d80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.837+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2893649006 >> 172.21.15.50:0/2893649006 conn(0x7ff0d80cddb0 msgr2=0x7ff0d80ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.841+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2893649006 shutdown_connections 2023-12-24T18:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.841+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2893649006 wait complete. 2023-12-24T18:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.841+0000 7ff0dda2e700 1 Processor -- start 2023-12-24T18:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.841+0000 7ff0dda2e700 1 -- start start 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.841+0000 7ff0dda2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d815d3b0 0x7ff0d80b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815dcc0 0x7ff0d80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80c7770 con 0x7ff0d80cb980 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8147980 con 0x7ff0d815dcc0 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80c6ed0 con 0x7ff0d815d3b0 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49150/0 (socket says 172.21.15.50:49150) 2023-12-24T18:51:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 -- 172.21.15.50:0/2070895159 learned_addr learned my addr 172.21.15.50:0/2070895159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d77fe700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815dcc0 0x7ff0d80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d67fc700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d815d3b0 0x7ff0d80b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 -- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d815d3b0 msgr2=0x7ff0d80b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d815d3b0 0x7ff0d80b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 -- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815dcc0 msgr2=0x7ff0d80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815dcc0 0x7ff0d80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 -- 172.21.15.50:0/2070895159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009420 con 0x7ff0d80cb980 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0d6ffd700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ecb0 tx=0x7ff0c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800ee60 con 0x7ff0d80cb980 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800cbe0 con 0x7ff0d80cb980 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d0009ae0 con 0x7ff0d80cb980 2023-12-24T18:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8013470 con 0x7ff0d80cb980 2023-12-24T18:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80c7490 con 0x7ff0d80cb980 2023-12-24T18:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.845+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d80b1390 con 0x7ff0d80cb980 2023-12-24T18:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.849+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff0c8013820 con 0x7ff0d80cb980 2023-12-24T18:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.849+0000 7ff0beffd700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 0x7ff0c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.849+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7ff0c807cec0 con 0x7ff0d80cb980 2023-12-24T18:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.849+0000 7ff0d67fc700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 0x7ff0c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.849+0000 7ff0d67fc700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 0x7ff0c4062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80c7b80 tx=0x7ff0cc008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:50.853+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff0c804d220 con 0x7ff0d80cb980 2023-12-24T18:51:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.033+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff0d80652e0 con 0x7ff0d80cb980 2023-12-24T18:51:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0beffd700 1 -- 172.21.15.50:0/2070895159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff0c8050840 con 0x7ff0d80cb980 2023-12-24T18:51:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 msgr2=0x7ff0c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 0x7ff0c4062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80c7b80 tx=0x7ff0cc008040 comp rx=0 tx=0).stop 2023-12-24T18:51:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 msgr2=0x7ff0d80c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ecb0 tx=0x7ff0c80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 shutdown_connections 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0c4060550 0x7ff0c4062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815dcc0 0x7ff0d80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d815d3b0 0x7ff0d80b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 --2- 172.21.15.50:0/2070895159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80cb980 0x7ff0d80c6810 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.045+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 >> 172.21.15.50:0/2070895159 conn(0x7ff0d80cddb0 msgr2=0x7ff0d80cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.049+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 shutdown_connections 2023-12-24T18:51:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.049+0000 7ff0dda2e700 1 -- 172.21.15.50:0/2070895159 wait complete. 2023-12-24T18:51:51.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:51:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.241+0000 7fddbc8ae700 1 Processor -- start 2023-12-24T18:51:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.241+0000 7fddbc8ae700 1 -- start start 2023-12-24T18:51:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddbc8ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddb806ae10 0x7fddb8164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddbc8ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80cd680 con 0x7fddb80cf8a0 2023-12-24T18:51:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddbc8ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb806d8f0 con 0x7fddb80cf4d0 2023-12-24T18:51:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddbc8ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8159640 con 0x7fddb806ae10 2023-12-24T18:51:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddb806ae10 0x7fddb8164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddb80cf8a0 0x7fddb806a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57220/0 (socket says 172.21.15.50:57220) 2023-12-24T18:51:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb5d9b700 1 -- 172.21.15.50:0/2011586751 learned_addr learned my addr 172.21.15.50:0/2011586751 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb6d9d700 1 -- 172.21.15.50:0/2011586751 >> v1:172.21.15.82:6789/0 conn(0x7fddb80cf4d0 legacy=0x7fddb806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb6d9d700 1 -- 172.21.15.50:0/2011586751 >> v1:172.21.15.50:6789/0 conn(0x7fddb80cf8a0 legacy=0x7fddb806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb6d9d700 1 -- 172.21.15.50:0/2011586751 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80cca70 con 0x7fddb806ae10 2023-12-24T18:51:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.245+0000 7fddb6d9d700 1 --2- 172.21.15.50:0/2011586751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb806ae10 0x7fddb8164010 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009e60 tx=0x7fddb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e5cc1b8de27b44 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddb559a700 1 -- 172.21.15.50:0/2011586751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000e070 con 0x7fddb806ae10 2023-12-24T18:51:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddb559a700 1 -- 172.21.15.50:0/2011586751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000bc30 con 0x7fddb806ae10 2023-12-24T18:51:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddb559a700 1 -- 172.21.15.50:0/2011586751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0012430 con 0x7fddb806ae10 2023-12-24T18:51:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 -- 172.21.15.50:0/2011586751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb806ae10 msgr2=0x7fddb8164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/2011586751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb806ae10 0x7fddb8164010 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009e60 tx=0x7fddb0009780 comp rx=0 tx=0).stop 2023-12-24T18:51:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 -- 172.21.15.50:0/2011586751 shutdown_connections 2023-12-24T18:51:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/2011586751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb806ae10 0x7fddb8164010 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 -- 172.21.15.50:0/2011586751 >> 172.21.15.50:0/2011586751 conn(0x7fddb8067b30 msgr2=0x7fddb80cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 -- 172.21.15.50:0/2011586751 shutdown_connections 2023-12-24T18:51:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.249+0000 7fddbc8ae700 1 -- 172.21.15.50:0/2011586751 wait complete. 2023-12-24T18:51:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 Processor -- start 2023-12-24T18:51:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 -- start start 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 0x7fddb8169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddb80cf8a0 0x7fddb80c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c7410 con 0x7fddb80cf4d0 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb816a040 con 0x7fddb80cf8a0 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddbc8ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8156f10 con 0x7fddb806ae10 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49170/0 (socket says 172.21.15.50:49170) 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 -- 172.21.15.50:0/1768190423 learned_addr learned my addr 172.21.15.50:0/1768190423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb6d9d700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddb80cf8a0 0x7fddb80c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb659c700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 0x7fddb8169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 -- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 msgr2=0x7fddb8169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 0x7fddb8169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 -- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddb80cf8a0 msgr2=0x7fddb80c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.253+0000 7fddb5d9b700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddb80cf8a0 0x7fddb80c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddb5d9b700 1 -- 172.21.15.50:0/1768190423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0009a20 con 0x7fddb80cf4d0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddb659c700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 0x7fddb8169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddb5d9b700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c560 tx=0x7fddac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac005b30 con 0x7fddb80cf4d0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac005cb0 con 0x7fddb80cf4d0 2023-12-24T18:51:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac007320 con 0x7fddb80cf4d0 2023-12-24T18:51:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c6800 con 0x7fddb80cf4d0 2023-12-24T18:51:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80c6dc0 con 0x7fddb80cf4d0 2023-12-24T18:51:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.257+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb80c7580 con 0x7fddb80cf4d0 2023-12-24T18:51:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.261+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fddac01b3b0 con 0x7fddb80cf4d0 2023-12-24T18:51:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.261+0000 7fdda67fc700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 0x7fdd98062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.261+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fddac07bdb0 con 0x7fddb80cf4d0 2023-12-24T18:51:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.261+0000 7fddb659c700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 0x7fdd98062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.261+0000 7fddb659c700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 0x7fdd98062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdda8007fd0 tx=0x7fdda8009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.265+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddac080070 con 0x7fddb80cf4d0 2023-12-24T18:51:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.437+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fddb80d0d20 con 0x7fddb80cf4d0 2023-12-24T18:51:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.449+0000 7fdda67fc700 1 -- 172.21.15.50:0/1768190423 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7fddac04c110 con 0x7fddb80cf4d0 2023-12-24T18:51:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 msgr2=0x7fdd98062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 0x7fdd98062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdda8007fd0 tx=0x7fdda8009040 comp rx=0 tx=0).stop 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 msgr2=0x7fddb81569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c560 tx=0x7fddac007f60 comp rx=0 tx=0).stop 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 shutdown_connections 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fdd98060550 0x7fdd98062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddb80cf8a0 0x7fddb80c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb80cf4d0 0x7fddb81569d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 --2- 172.21.15.50:0/1768190423 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddb806ae10 0x7fddb8169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 >> 172.21.15.50:0/1768190423 conn(0x7fddb8067b30 msgr2=0x7fddb8158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 shutdown_connections 2023-12-24T18:51:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.453+0000 7fddbc8ae700 1 -- 172.21.15.50:0/1768190423 wait complete. 2023-12-24T18:51:51.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:51:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.641+0000 7ff515b63700 1 Processor -- start 2023-12-24T18:51:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.641+0000 7ff515b63700 1 -- start start 2023-12-24T18:51:51.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515b63700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff510158c50 0x7ff510159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515b63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515b63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100caa60 con 0x7ff5100cc790 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515b63700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100af430 con 0x7ff510158c50 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515b63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100cee80 con 0x7ff5100caef0 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff514b61700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff510158c50 0x7ff510159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:34482/0 (socket says 172.21.15.50:34482) 2023-12-24T18:51:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 -- 172.21.15.50:0/834907882 learned_addr learned my addr 172.21.15.50:0/834907882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff515362700 1 --1- 172.21.15.50:0/834907882 >> v1:172.21.15.50:6789/0 conn(0x7ff5100cc790 0x7ff5100afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57234/0 (socket says 172.21.15.50:57234) 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50f7fe700 1 -- 172.21.15.50:0/834907882 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720067009 0 0) 0x7ff5100caa60 con 0x7ff5100cc790 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 -- 172.21.15.50:0/834907882 >> v2:172.21.15.82:3300/0 conn(0x7ff510158c50 msgr2=0x7ff510159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 --2- 172.21.15.50:0/834907882 >> v2:172.21.15.82:3300/0 conn(0x7ff510158c50 0x7ff510159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 -- 172.21.15.50:0/834907882 >> v1:172.21.15.50:6789/0 conn(0x7ff5100cc790 legacy=0x7ff5100afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 -- 172.21.15.50:0/834907882 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100cf160 con 0x7ff5100caef0 2023-12-24T18:51:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50ffff700 1 --2- 172.21.15.50:0/834907882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=414727e847fe8a9e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.645+0000 7ff50f7fe700 1 -- 172.21.15.50:0/834907882 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc009ea0 con 0x7ff5100caef0 2023-12-24T18:51:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff50f7fe700 1 -- 172.21.15.50:0/834907882 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00b860 con 0x7ff5100caef0 2023-12-24T18:51:51.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff50f7fe700 1 -- 172.21.15.50:0/834907882 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00bc00 con 0x7ff5100caef0 2023-12-24T18:51:51.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- 172.21.15.50:0/834907882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 msgr2=0x7ff5100cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 --2- 172.21.15.50:0/834907882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc009250 comp rx=0 tx=0).stop 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- 172.21.15.50:0/834907882 shutdown_connections 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 --2- 172.21.15.50:0/834907882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100caef0 0x7ff5100cb320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 --2- 172.21.15.50:0/834907882 >> v2:172.21.15.82:3300/0 conn(0x7ff510158c50 0x7ff510159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- 172.21.15.50:0/834907882 >> 172.21.15.50:0/834907882 conn(0x7ff5100670b0 msgr2=0x7ff5100674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- 172.21.15.50:0/834907882 shutdown_connections 2023-12-24T18:51:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- 172.21.15.50:0/834907882 wait complete. 2023-12-24T18:51:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 Processor -- start 2023-12-24T18:51:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.649+0000 7ff515b63700 1 -- start start 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100caef0 0x7ff510156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100cc790 0x7ff51015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51016c950 con 0x7ff510158c50 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101698d0 con 0x7ff5100caef0 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff510169bb0 con 0x7ff5100cc790 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49172/0 (socket says 172.21.15.50:49172) 2023-12-24T18:51:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 -- 172.21.15.50:0/3539377000 learned_addr learned my addr 172.21.15.50:0/3539377000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff50ffff700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100cc790 0x7ff51015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff514b61700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100caef0 0x7ff510156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 -- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100cc790 msgr2=0x7ff51015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100cc790 0x7ff51015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 -- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100caef0 msgr2=0x7ff510156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100caef0 0x7ff510156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 -- 172.21.15.50:0/3539377000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0094f0 con 0x7ff510158c50 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515362700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff50800cd50 tx=0x7ff508001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508005df0 con 0x7ff510158c50 2023-12-24T18:51:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800a8b0 con 0x7ff510158c50 2023-12-24T18:51:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ac70 con 0x7ff510158c50 2023-12-24T18:51:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff510169e90 con 0x7ff510158c50 2023-12-24T18:51:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.653+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5101570e0 con 0x7ff510158c50 2023-12-24T18:51:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.657+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51016cac0 con 0x7ff510158c50 2023-12-24T18:51:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.657+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff508007300 con 0x7ff510158c50 2023-12-24T18:51:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.657+0000 7ff50cff9700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 0x7ff4f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.657+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7ff50807cb50 con 0x7ff510158c50 2023-12-24T18:51:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.657+0000 7ff514b61700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 0x7ff4f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.661+0000 7ff514b61700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 0x7ff4f4062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff504009d10 tx=0x7ff5040091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.665+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff50804cf30 con 0x7ff510158c50 2023-12-24T18:51:51.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.837+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff51004be40 con 0x7ff510158c50 2023-12-24T18:51:51.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.849+0000 7ff50cff9700 1 -- 172.21.15.50:0/3539377000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff508050550 con 0x7ff510158c50 2023-12-24T18:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 msgr2=0x7ff4f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 0x7ff4f4062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff504009d10 tx=0x7ff5040091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 msgr2=0x7ff5100c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff50800cd50 tx=0x7ff508001b10 comp rx=0 tx=0).stop 2023-12-24T18:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 shutdown_connections 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff4f4060550 0x7ff4f4062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff510158c50 0x7ff5100c38d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5100cc790 0x7ff51015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 --2- 172.21.15.50:0/3539377000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100caef0 0x7ff510156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 >> 172.21.15.50:0/3539377000 conn(0x7ff5100670b0 msgr2=0x7ff5101582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 shutdown_connections 2023-12-24T18:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:51.853+0000 7ff515b63700 1 -- 172.21.15.50:0/3539377000 wait complete. 2023-12-24T18:51:51.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-12-24T18:51:52.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.049+0000 7fbf8ee4c700 1 Processor -- start 2023-12-24T18:51:52.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.053+0000 7fbf8ee4c700 1 -- start start 2023-12-24T18:51:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ee4c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbf88158e00 0x7fbf881591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ee4c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8806b640 con 0x7fbf880b41e0 2023-12-24T18:51:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ee4c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf880b5e10 con 0x7fbf8806d8c0 2023-12-24T18:51:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ee4c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf88159710 con 0x7fbf88158e00 2023-12-24T18:51:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8e64b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf880b41e0 0x7fbf88159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57240/0 (socket says 172.21.15.50:57240) 2023-12-24T18:51:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8e64b700 1 -- 172.21.15.50:0/2626791481 learned_addr learned my addr 172.21.15.50:0/2626791481 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8de4a700 1 --2- 172.21.15.50:0/2626791481 >> v2:172.21.15.82:3300/0 conn(0x7fbf88158e00 0x7fbf881591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317499859 0 0) 0x7fbf8806b640 con 0x7fbf880b41e0 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf74003570 con 0x7fbf880b41e0 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332284002 0 0) 0x7fbf880b5e10 con 0x7fbf8806d8c0 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8806b640 con 0x7fbf8806d8c0 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8de4a700 1 -- 172.21.15.50:0/2626791481 >> v1:172.21.15.82:6789/0 conn(0x7fbf8806d8c0 legacy=0x7fbf880b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8de4a700 1 -- 172.21.15.50:0/2626791481 >> v1:172.21.15.50:6789/0 conn(0x7fbf880b41e0 legacy=0x7fbf88159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8de4a700 1 -- 172.21.15.50:0/2626791481 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8806b8e0 con 0x7fbf88158e00 2023-12-24T18:51:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.057+0000 7fbf8de4a700 1 --2- 172.21.15.50:0/2626791481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881591d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbf840098e0 tx=0x7fbf840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7eb82b02df7e8f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84011630 con 0x7fbf88158e00 2023-12-24T18:51:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84011790 con 0x7fbf88158e00 2023-12-24T18:51:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ce48700 1 -- 172.21.15.50:0/2626791481 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84011b30 con 0x7fbf88158e00 2023-12-24T18:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/2626791481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 msgr2=0x7fbf881591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/2626791481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881591d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbf840098e0 tx=0x7fbf840091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/2626791481 shutdown_connections 2023-12-24T18:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/2626791481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881591d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/2626791481 >> 172.21.15.50:0/2626791481 conn(0x7fbf88067b80 msgr2=0x7fbf880b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/2626791481 shutdown_connections 2023-12-24T18:51:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.061+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/2626791481 wait complete. 2023-12-24T18:51:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 Processor -- start 2023-12-24T18:51:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 -- start start 2023-12-24T18:51:52.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf8806d8c0 0x7fbf880ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ac390 con 0x7fbf880b41e0 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ab780 con 0x7fbf88158e00 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8ee4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880aba60 con 0x7fbf8806d8c0 2023-12-24T18:51:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8d649700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8d649700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49178/0 (socket says 172.21.15.50:49178) 2023-12-24T18:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8d649700 1 -- 172.21.15.50:0/4277548809 learned_addr learned my addr 172.21.15.50:0/4277548809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.065+0000 7fbf8de4a700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf8806d8c0 0x7fbf880ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8e64b700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 -- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf8806d8c0 msgr2=0x7fbf880ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf8806d8c0 0x7fbf880ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 -- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 msgr2=0x7fbf881685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 -- 172.21.15.50:0/4277548809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009420 con 0x7fbf880b41e0 2023-12-24T18:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8d649700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c580 tx=0x7fbf78007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78010510 con 0x7fbf880b41e0 2023-12-24T18:51:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78010670 con 0x7fbf880b41e0 2023-12-24T18:51:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78010a30 con 0x7fbf880b41e0 2023-12-24T18:51:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf880abd40 con 0x7fbf880b41e0 2023-12-24T18:51:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf880ab470 con 0x7fbf880b41e0 2023-12-24T18:51:52.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.069+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf880ac540 con 0x7fbf880b41e0 2023-12-24T18:51:52.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.073+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbf7801b400 con 0x7fbf880b41e0 2023-12-24T18:51:52.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.073+0000 7fbf7dffb700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 0x7fbf6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.073+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fbf7807c5a0 con 0x7fbf880b41e0 2023-12-24T18:51:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.073+0000 7fbf8de4a700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 0x7fbf6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.077+0000 7fbf8de4a700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 0x7fbf6c062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf840093f0 tx=0x7fbf84017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.081+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf880ac540 con 0x7fbf880b41e0 2023-12-24T18:51:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.313+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fbf8804be40 con 0x7fbf880b41e0 2023-12-24T18:51:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.465+0000 7fbf7dffb700 1 -- 172.21.15.50:0/4277548809 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v577) v1 ==== 156+0+0 (secure 0 0 0) 0x7fbf7804c900 con 0x7fbf880b41e0 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 msgr2=0x7fbf6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 0x7fbf6c062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf840093f0 tx=0x7fbf84017000 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 msgr2=0x7fbf880aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c580 tx=0x7fbf78007e10 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 shutdown_connections 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbf6c060550 0x7fbf6c062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf88158e00 0x7fbf881685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf880b41e0 0x7fbf880aaf30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 --2- 172.21.15.50:0/4277548809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf8806d8c0 0x7fbf880ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 >> 172.21.15.50:0/4277548809 conn(0x7fbf88067b80 msgr2=0x7fbf880b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:52.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 shutdown_connections 2023-12-24T18:51:52.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.469+0000 7fbf8ee4c700 1 -- 172.21.15.50:0/4277548809 wait complete. 2023-12-24T18:51:52.495 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-12-24T18:51:52.495 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-12-24T18:51:52.495 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:51:52.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-12-24T18:51:52.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.669+0000 7f049d185700 1 Processor -- start 2023-12-24T18:51:52.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.669+0000 7f049d185700 1 -- start start 2023-12-24T18:51:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049d185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 0x7f04980c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049d185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049806c820 con 0x7f0498154450 2023-12-24T18:51:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049d185700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049806b960 con 0x7f049806aca0 2023-12-24T18:51:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049d185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049806bc40 con 0x7f04980c6d00 2023-12-24T18:51:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f048ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0498154450 0x7f04981548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57248/0 (socket says 172.21.15.50:57248) 2023-12-24T18:51:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f048ffff700 1 -- 172.21.15.50:0/384216729 learned_addr learned my addr 172.21.15.50:0/384216729 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f0496d9d700 1 --2- 172.21.15.50:0/384216729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 0x7f04980c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243706682 0 0) 0x7f049806b960 con 0x7f049806aca0 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0484003570 con 0x7f049806aca0 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167999582 0 0) 0x7f049806c820 con 0x7f0498154450 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f0496d9d700 1 -- 172.21.15.50:0/384216729 >> v1:172.21.15.82:6789/0 conn(0x7f049806aca0 legacy=0x7f049806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f0496d9d700 1 -- 172.21.15.50:0/384216729 >> v1:172.21.15.50:6789/0 conn(0x7f0498154450 legacy=0x7f04981548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f0496d9d700 1 -- 172.21.15.50:0/384216729 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049806bf20 con 0x7f04980c6d00 2023-12-24T18:51:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.673+0000 7f0496d9d700 1 --2- 172.21.15.50:0/384216729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 0x7f04980c70d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0488009910 tx=0x7f04880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a358fdf1c1b620e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800b680 con 0x7f04980c6d00 2023-12-24T18:51:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048800b7e0 con 0x7f04980c6d00 2023-12-24T18:51:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049659c700 1 -- 172.21.15.50:0/384216729 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800bba0 con 0x7f04980c6d00 2023-12-24T18:51:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- 172.21.15.50:0/384216729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 msgr2=0x7f04980c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 --2- 172.21.15.50:0/384216729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 0x7f04980c70d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0488009910 tx=0x7f04880091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- 172.21.15.50:0/384216729 shutdown_connections 2023-12-24T18:51:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 --2- 172.21.15.50:0/384216729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04980c6d00 0x7f04980c70d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- 172.21.15.50:0/384216729 >> 172.21.15.50:0/384216729 conn(0x7f04980cbba0 msgr2=0x7f04980cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- 172.21.15.50:0/384216729 shutdown_connections 2023-12-24T18:51:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- 172.21.15.50:0/384216729 wait complete. 2023-12-24T18:51:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 Processor -- start 2023-12-24T18:51:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.677+0000 7f049d185700 1 -- start start 2023-12-24T18:51:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f049806aca0 0x7f04980cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498154450 0x7f0498152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049815afd0 con 0x7f04980c6d00 2023-12-24T18:51:52.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0498155810 con 0x7f0498154450 2023-12-24T18:51:52.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0498155530 con 0x7f049806aca0 2023-12-24T18:51:52.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49188/0 (socket says 172.21.15.50:49188) 2023-12-24T18:51:52.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 -- 172.21.15.50:0/1756918145 learned_addr learned my addr 172.21.15.50:0/1756918145 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:52.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f0496d9d700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f049806aca0 0x7f04980cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049759e700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498154450 0x7f0498152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 -- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f049806aca0 msgr2=0x7f04980cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f049806aca0 0x7f04980cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 -- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498154450 msgr2=0x7f0498152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:52.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498154450 0x7f0498152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 -- 172.21.15.50:0/1756918145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009420 con 0x7f04980c6d00 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048ffff700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f048000c5e0 tx=0x7f0480001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480005b30 con 0x7f04980c6d00 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480005c90 con 0x7f04980c6d00 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049815a980 con 0x7f04980c6d00 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480007320 con 0x7f04980c6d00 2023-12-24T18:51:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.681+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04980cb6c0 con 0x7f04980c6d00 2023-12-24T18:51:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.685+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049815a7e0 con 0x7f04980c6d00 2023-12-24T18:51:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.685+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f048001b3b0 con 0x7f04980c6d00 2023-12-24T18:51:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.689+0000 7f048effd700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 0x7f0478062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.689+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7f048007bde0 con 0x7f04980c6d00 2023-12-24T18:51:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.689+0000 7f0496d9d700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 0x7f0478062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:52.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.689+0000 7f0496d9d700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 0x7f0478062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f04880093f0 tx=0x7f0488017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.693+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f049815a7e0 con 0x7f04980c6d00 2023-12-24T18:51:52.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:52.929+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f049815b180 con 0x7f04980c6d00 2023-12-24T18:51:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.473+0000 7f048effd700 1 -- 172.21.15.50:0/1756918145 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v578) v1 ==== 169+0+0 (secure 0 0 0) 0x7f049815b180 con 0x7f04980c6d00 2023-12-24T18:51:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 msgr2=0x7f0478062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 0x7f0478062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f04880093f0 tx=0x7f0488017000 comp rx=0 tx=0).stop 2023-12-24T18:51:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 msgr2=0x7f049815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f048000c5e0 tx=0x7f0480001070 comp rx=0 tx=0).stop 2023-12-24T18:51:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 shutdown_connections 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0478060550 0x7f0478062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498154450 0x7f0498152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04980c6d00 0x7f049815b460 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 --2- 172.21.15.50:0/1756918145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f049806aca0 0x7f04980cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 >> 172.21.15.50:0/1756918145 conn(0x7f04980cbba0 msgr2=0x7f04980c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 shutdown_connections 2023-12-24T18:51:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.477+0000 7f049d185700 1 -- 172.21.15.50:0/1756918145 wait complete. 2023-12-24T18:51:53.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:51:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 Processor -- start 2023-12-24T18:51:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 -- start start 2023-12-24T18:51:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6c8158c40 0x7fe6c80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c806d450 0x7fe6c80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c806a580 con 0x7fe6c80cc780 2023-12-24T18:51:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c80cd110 con 0x7fe6c8158c40 2023-12-24T18:51:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.673+0000 7fe6c759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c806a7d0 con 0x7fe6c806d450 2023-12-24T18:51:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6c8158c40 0x7fe6c80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6c80cc780 0x7fe6c806cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57254/0 (socket says 172.21.15.50:57254) 2023-12-24T18:51:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c5d9b700 1 -- 172.21.15.50:0/3416297224 learned_addr learned my addr 172.21.15.50:0/3416297224 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c6d9d700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c806d450 0x7fe6c80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c559a700 1 -- 172.21.15.50:0/3416297224 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525530909 0 0) 0x7fe6c806a580 con 0x7fe6c80cc780 2023-12-24T18:51:53.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c559a700 1 -- 172.21.15.50:0/3416297224 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b0003570 con 0x7fe6c80cc780 2023-12-24T18:51:53.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 -- 172.21.15.50:0/3416297224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c806d450 msgr2=0x7fe6c80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:53.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c806d450 0x7fe6c80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 -- 172.21.15.50:0/3416297224 >> v1:172.21.15.50:6789/0 conn(0x7fe6c80cc780 legacy=0x7fe6c806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 -- 172.21.15.50:0/3416297224 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c806aab0 con 0x7fe6c8158c40 2023-12-24T18:51:53.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c659c700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c8158c40 0x7fe6c80cf500 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098e0 tx=0x7fe6b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c866cf7a89fdd9b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c559a700 1 -- 172.21.15.50:0/3416297224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011630 con 0x7fe6c8158c40 2023-12-24T18:51:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c559a700 1 -- 172.21.15.50:0/3416297224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8011790 con 0x7fe6c8158c40 2023-12-24T18:51:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c559a700 1 -- 172.21.15.50:0/3416297224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011b30 con 0x7fe6c8158c40 2023-12-24T18:51:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c759e700 1 -- 172.21.15.50:0/3416297224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c8158c40 msgr2=0x7fe6c80cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.677+0000 7fe6c759e700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c8158c40 0x7fe6c80cf500 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098e0 tx=0x7fe6b80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 -- 172.21.15.50:0/3416297224 shutdown_connections 2023-12-24T18:51:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c806d450 0x7fe6c80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 --2- 172.21.15.50:0/3416297224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c8158c40 0x7fe6c80cf500 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 -- 172.21.15.50:0/3416297224 >> 172.21.15.50:0/3416297224 conn(0x7fe6c80d0800 msgr2=0x7fe6c80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 -- 172.21.15.50:0/3416297224 shutdown_connections 2023-12-24T18:51:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 -- 172.21.15.50:0/3416297224 wait complete. 2023-12-24T18:51:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 Processor -- start 2023-12-24T18:51:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.681+0000 7fe6c759e700 1 -- start start 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c80cc780 0x7fe6c80c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6c8158c40 0x7fe6c80b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8089860 con 0x7fe6c806d450 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c808a080 con 0x7fe6c8158c40 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8089ac0 con 0x7fe6c80cc780 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49212/0 (socket says 172.21.15.50:49212) 2023-12-24T18:51:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 -- 172.21.15.50:0/2310784950 learned_addr learned my addr 172.21.15.50:0/2310784950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c5d9b700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c80cc780 0x7fe6c80c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c6d9d700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6c8158c40 0x7fe6c80b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 -- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c80cc780 msgr2=0x7fe6c80c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c80cc780 0x7fe6c80c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 -- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6c8158c40 msgr2=0x7fe6c80b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6c8158c40 0x7fe6c80b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 -- 172.21.15.50:0/2310784950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009420 con 0x7fe6c806d450 2023-12-24T18:51:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c659c700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8069860 tx=0x7fe6b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011900 con 0x7fe6c806d450 2023-12-24T18:51:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8011a60 con 0x7fe6c806d450 2023-12-24T18:51:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c8089da0 con 0x7fe6c806d450 2023-12-24T18:51:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8025670 con 0x7fe6c806d450 2023-12-24T18:51:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.685+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c80c9490 con 0x7fe6c806d450 2023-12-24T18:51:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.689+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c80c96b0 con 0x7fe6c806d450 2023-12-24T18:51:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.689+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe6b8023070 con 0x7fe6c806d450 2023-12-24T18:51:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.693+0000 7fe6b67fc700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 0x7fe6a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.693+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fe6b807de10 con 0x7fe6c806d450 2023-12-24T18:51:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.693+0000 7fe6c5d9b700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 0x7fe6a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.693+0000 7fe6c5d9b700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 0x7fe6a8062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8170ba0 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:53.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.697+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6b8081030 con 0x7fe6c806d450 2023-12-24T18:51:53.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.873+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe6c81540d0 con 0x7fe6c806d450 2023-12-24T18:51:53.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.881+0000 7fe6b67fc700 1 -- 172.21.15.50:0/2310784950 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6b80150c0 con 0x7fe6c806d450 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 msgr2=0x7fe6a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 0x7fe6a8062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8170ba0 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 msgr2=0x7fe6c8153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8069860 tx=0x7fe6b8017000 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 shutdown_connections 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe6a8060580 0x7fe6a8062a30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6c8158c40 0x7fe6c80b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6c80cc780 0x7fe6c80c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 --2- 172.21.15.50:0/2310784950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c806d450 0x7fe6c8153ad0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 >> 172.21.15.50:0/2310784950 conn(0x7fe6c80d0800 msgr2=0x7fe6c80b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 shutdown_connections 2023-12-24T18:51:53.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:53.885+0000 7fe6c759e700 1 -- 172.21.15.50:0/2310784950 wait complete. 2023-12-24T18:51:53.911 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:51:53.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:53.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:51:53.994 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:51:53.994 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:51:53.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:51:54.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 Processor -- start 2023-12-24T18:51:54.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 -- start start 2023-12-24T18:51:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc36c06def0 0x7fc36c168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c06ca50 con 0x7fc36c0ca770 2023-12-24T18:51:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c06b520 con 0x7fc36c0ca3a0 2023-12-24T18:51:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.169+0000 7fc370a65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0c6980 con 0x7fc36c06def0 2023-12-24T18:51:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc369d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc36c0ca770 0x7fc36c15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57268/0 (socket says 172.21.15.50:57268) 2023-12-24T18:51:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc369d9b700 1 -- 172.21.15.50:0/2748656764 learned_addr learned my addr 172.21.15.50:0/2748656764 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/2748656764 >> v2:172.21.15.82:3300/0 conn(0x7fc36c06def0 0x7fc36c168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233169260 0 0) 0x7fc36c06ca50 con 0x7fc36c0ca770 2023-12-24T18:51:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc354003570 con 0x7fc36c0ca770 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091087699 0 0) 0x7fc36c06b520 con 0x7fc36c0ca3a0 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc36c06ca50 con 0x7fc36c0ca3a0 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660557245 0 0) 0x7fc354003570 con 0x7fc36c0ca770 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 >> v2:172.21.15.82:3300/0 conn(0x7fc36c06def0 msgr2=0x7fc36c168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 --2- 172.21.15.50:0/2748656764 >> v2:172.21.15.82:3300/0 conn(0x7fc36c06def0 0x7fc36c168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 >> v1:172.21.15.82:6789/0 conn(0x7fc36c0ca3a0 legacy=0x7fc36c06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c06b7f0 con 0x7fc36c0ca770 2023-12-24T18:51:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fc360001470 con 0x7fc36c0ca770 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 >> v1:172.21.15.50:6789/0 conn(0x7fc36c0ca770 legacy=0x7fc36c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354003c20 0x7fc354004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc354004810 0x7fc354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc35400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35400c200 con 0x7fc354005280 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35400c370 con 0x7fc354003c20 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35400c530 con 0x7fc354004810 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc35400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36a59c700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354003c20 0x7fc354004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc369d9b700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc354004810 0x7fc354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 -- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc354004810 msgr2=0x7fc354004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc354004810 0x7fc354004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 -- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354003c20 msgr2=0x7fc354004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354003c20 0x7fc354004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 -- 172.21.15.50:0/2748656764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354003570 con 0x7fc354005280 2023-12-24T18:51:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc369d9b700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc354004810 0x7fc354004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 -- 172.21.15.50:0/2748656764 reap_dead start 2023-12-24T18:51:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc35400ba60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc36c06e310 tx=0x7fc36400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04d9d488df04f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.173+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400ea90 con 0x7fc354005280 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400f040 con 0x7fc354005280 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc36959a700 1 -- 172.21.15.50:0/2748656764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400ee40 con 0x7fc354005280 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 -- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 msgr2=0x7fc35400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc35400ba60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc36c06e310 tx=0x7fc36400b040 comp rx=0 tx=0).stop 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 -- 172.21.15.50:0/2748656764 shutdown_connections 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 --2- 172.21.15.50:0/2748656764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc35400ba60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 -- 172.21.15.50:0/2748656764 >> 172.21.15.50:0/2748656764 conn(0x7fc36c0cbba0 msgr2=0x7fc36c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 -- 172.21.15.50:0/2748656764 shutdown_connections 2023-12-24T18:51:54.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 -- 172.21.15.50:0/2748656764 wait complete. 2023-12-24T18:51:54.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.177+0000 7fc370a65700 1 Processor -- start 2023-12-24T18:51:54.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 -- start start 2023-12-24T18:51:54.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0c11b0 0x7fc36c0c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 0x7fc36c160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0c1b60 con 0x7fc354005280 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0aebe0 con 0x7fc36c0c11b0 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc370a65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c147320 con 0x7fc36c160300 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49234/0 (socket says 172.21.15.50:49234) 2023-12-24T18:51:54.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 -- 172.21.15.50:0/975212847 learned_addr learned my addr 172.21.15.50:0/975212847 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc369d9b700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0c11b0 0x7fc36c0c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 0x7fc36c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 -- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 msgr2=0x7fc36c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 0x7fc36c160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 -- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0c11b0 msgr2=0x7fc36c0c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0c11b0 0x7fc36c0c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 -- 172.21.15.50:0/975212847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c161080 con 0x7fc354005280 2023-12-24T18:51:54.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36ad9d700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 0x7fc36c160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.181+0000 7fc36a59c700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00e580 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00eea0 con 0x7fc354005280 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c010040 con 0x7fc354005280 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0017c0 con 0x7fc354005280 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c161360 con 0x7fc354005280 2023-12-24T18:51:54.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c161920 con 0x7fc354005280 2023-12-24T18:51:54.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c0652e0 con 0x7fc354005280 2023-12-24T18:51:54.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.185+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc35c001b70 con 0x7fc354005280 2023-12-24T18:51:54.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.189+0000 7fc35a7fc700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 0x7fc34c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.189+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fc35c07c660 con 0x7fc354005280 2023-12-24T18:51:54.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.189+0000 7fc369d9b700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 0x7fc34c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.189+0000 7fc369d9b700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 0x7fc34c062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc36c1548e0 tx=0x7fc360009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.193+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc35c050450 con 0x7fc354005280 2023-12-24T18:51:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.405+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc36c06bad0 con 0x7fc354005280 2023-12-24T18:51:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.405+0000 7fc35a7fc700 1 -- 172.21.15.50:0/975212847 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3520 (secure 0 0 0) 0x7fc35c04ffe0 con 0x7fc354005280 2023-12-24T18:51:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:54.408 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1196786870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1196786870},{"type":"v1","addr":"172.21.15.50:6835","nonce":1196786870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/18979065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":18979065},{"type":"v1","addr":"172.21.15.50:6837","nonce":18979065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3725455768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3725455768},{"type":"v1","addr":"172.21.15.82:6833","nonce":3725455768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/408694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":408694716},{"type":"v1","addr":"172.21.15.82:6835","nonce":408694716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 msgr2=0x7fc34c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 0x7fc34c062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc36c1548e0 tx=0x7fc360009040 comp rx=0 tx=0).stop 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 msgr2=0x7fc36c146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00e580 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 shutdown_connections 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc34c060550 0x7fc34c062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c160300 0x7fc36c160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0c11b0 0x7fc36c0c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 --2- 172.21.15.50:0/975212847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc354005280 0x7fc36c146de0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 >> 172.21.15.50:0/975212847 conn(0x7fc36c0cbba0 msgr2=0x7fc36c0c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:54.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 shutdown_connections 2023-12-24T18:51:54.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.409+0000 7fc370a65700 1 -- 172.21.15.50:0/975212847 wait complete. 2023-12-24T18:51:54.412 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 37 2023-12-24T18:51:54.429 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:51:54.429 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:51:54.429 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:51:54.429 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:54.429 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:51:54.430 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:51:54.430 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:51:54.430 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:54.430 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:51:54.430 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:51:54.430 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:51:54.430 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:54.431 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:51:54.431 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:51:54.431 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:51:54.431 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:51:54.447 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:51:54.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:51:54.449 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:51:54.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:51:54.459 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:51:54.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:51:54.459 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:51:54.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:51:54.495 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:51:54.495 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:54.499 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:51:54.499 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:54.507 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:51:54.508 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:54.513 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:51:54.513 DEBUG:teuthology.parallel:result is None 2023-12-24T18:51:54.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:51:54.609 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:51:54.615 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:51:54.623 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:51:54.635 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:51:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 Processor -- start 2023-12-24T18:51:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 -- start start 2023-12-24T18:51:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1500e72f0 0x7fa150034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa150053260 con 0x7fa1500500a0 2023-12-24T18:51:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500070c0 con 0x7fa150033c50 2023-12-24T18:51:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.673+0000 7fa15dc8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500073a0 con 0x7fa1500e72f0 2023-12-24T18:51:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa157fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1500e72f0 0x7fa150034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15d48d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa1500500a0 0x7fa1500536f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57288/0 (socket says 172.21.15.50:57288) 2023-12-24T18:51:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15d48d700 1 -- 172.21.15.50:0/3870549985 learned_addr learned my addr 172.21.15.50:0/3870549985 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa157fff700 1 -- 172.21.15.50:0/3870549985 >> v1:172.21.15.82:6789/0 conn(0x7fa150033c50 legacy=0x7fa1500e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa157fff700 1 -- 172.21.15.50:0/3870549985 >> v1:172.21.15.50:6789/0 conn(0x7fa1500500a0 legacy=0x7fa1500536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa1577fe700 1 -- 172.21.15.50:0/3870549985 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830255723 0 0) 0x7fa150053260 con 0x7fa1500500a0 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa157fff700 1 -- 172.21.15.50:0/3870549985 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150007680 con 0x7fa1500e72f0 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa157fff700 1 --2- 172.21.15.50:0/3870549985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500e72f0 0x7fa150034020 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa1440098e0 tx=0x7fa1440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd4a2deced18e7d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa1577fe700 1 -- 172.21.15.50:0/3870549985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144009e80 con 0x7fa1500e72f0 2023-12-24T18:51:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa1577fe700 1 -- 172.21.15.50:0/3870549985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400b860 con 0x7fa1500e72f0 2023-12-24T18:51:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa1577fe700 1 -- 172.21.15.50:0/3870549985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400bbe0 con 0x7fa1500e72f0 2023-12-24T18:51:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 -- 172.21.15.50:0/3870549985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500e72f0 msgr2=0x7fa150034020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/3870549985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500e72f0 0x7fa150034020 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa1440098e0 tx=0x7fa1440091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 -- 172.21.15.50:0/3870549985 shutdown_connections 2023-12-24T18:51:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/3870549985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500e72f0 0x7fa150034020 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 -- 172.21.15.50:0/3870549985 >> 172.21.15.50:0/3870549985 conn(0x7fa150054d40 msgr2=0x7fa150055110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 -- 172.21.15.50:0/3870549985 shutdown_connections 2023-12-24T18:51:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.677+0000 7fa15dc8e700 1 -- 172.21.15.50:0/3870549985 wait complete. 2023-12-24T18:51:54.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 Processor -- start 2023-12-24T18:51:54.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 -- start start 2023-12-24T18:51:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa150033c50 0x7fa1500e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1500e72f0 0x7fa1500e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500e8570 con 0x7fa1500500a0 2023-12-24T18:51:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150039410 con 0x7fa1500e72f0 2023-12-24T18:51:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa15dc8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500e7960 con 0x7fa150033c50 2023-12-24T18:51:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.681+0000 7fa157fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49274/0 (socket says 172.21.15.50:49274) 2023-12-24T18:51:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 -- 172.21.15.50:0/999620873 learned_addr learned my addr 172.21.15.50:0/999620873 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa15d48d700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1500e72f0 0x7fa1500e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa15cc8c700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa150033c50 0x7fa1500e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 -- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa150033c50 msgr2=0x7fa1500e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa150033c50 0x7fa1500e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 -- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1500e72f0 msgr2=0x7fa1500e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1500e72f0 0x7fa1500e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 -- 172.21.15.50:0/999620873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009420 con 0x7fa1500500a0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa157fff700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa1440093f0 tx=0x7fa144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400baa0 con 0x7fa1500500a0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144026430 con 0x7fa1500500a0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500e7c40 con 0x7fa1500500a0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440267f0 con 0x7fa1500500a0 2023-12-24T18:51:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500e8200 con 0x7fa1500500a0 2023-12-24T18:51:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.685+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500053d0 con 0x7fa1500500a0 2023-12-24T18:51:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.689+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa144023030 con 0x7fa1500500a0 2023-12-24T18:51:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.689+0000 7fa154ff9700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 0x7fa13c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.689+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fa14407e330 con 0x7fa1500500a0 2023-12-24T18:51:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.689+0000 7fa15cc8c700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 0x7fa13c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.689+0000 7fa15cc8c700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 0x7fa13c062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003880 tx=0x7fa14c009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.693+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa14404e710 con 0x7fa1500500a0 2023-12-24T18:51:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:54.877+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa1500504a0 con 0x7fa1500500a0 2023-12-24T18:51:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.501+0000 7fa154ff9700 1 -- 172.21.15.50:0/999620873 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa144051d30 con 0x7fa1500500a0 2023-12-24T18:51:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 msgr2=0x7fa13c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 0x7fa13c062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003880 tx=0x7fa14c009040 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 msgr2=0x7fa150038ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa1440093f0 tx=0x7fa144017000 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 shutdown_connections 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa13c060580 0x7fa13c062a30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1500e72f0 0x7fa1500e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500500a0 0x7fa150038ed0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 --2- 172.21.15.50:0/999620873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa150033c50 0x7fa1500e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.505+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 >> 172.21.15.50:0/999620873 conn(0x7fa150054d40 msgr2=0x7fa1500e3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.509+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 shutdown_connections 2023-12-24T18:51:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.509+0000 7fa15dc8e700 1 -- 172.21.15.50:0/999620873 wait complete. 2023-12-24T18:51:55.512 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:51:55.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:51:55.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 Processor -- start 2023-12-24T18:51:55.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 -- start start 2023-12-24T18:51:55.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2580c6d00 0x7fc2580c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:55.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25806c820 con 0x7fc258154450 2023-12-24T18:51:55.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25806b960 con 0x7fc25806aca0 2023-12-24T18:51:55.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.697+0000 7fc25d66e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25806bc40 con 0x7fc2580c6d00 2023-12-24T18:51:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2580c6d00 0x7fc2580c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2580c6d00 0x7fc2580c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49286/0 (socket says 172.21.15.50:49286) 2023-12-24T18:51:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 -- 172.21.15.50:0/2462362320 learned_addr learned my addr 172.21.15.50:0/2462362320 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 -- 172.21.15.50:0/2462362320 >> v1:172.21.15.82:6789/0 conn(0x7fc25806aca0 legacy=0x7fc25806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 -- 172.21.15.50:0/2462362320 >> v1:172.21.15.50:6789/0 conn(0x7fc258154450 legacy=0x7fc2581548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 -- 172.21.15.50:0/2462362320 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25806bf20 con 0x7fc2580c6d00 2023-12-24T18:51:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc256ffd700 1 --2- 172.21.15.50:0/2462362320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580c6d00 0x7fc2580c70d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc2480099b0 tx=0x7fc248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c75a6e80e6cae8f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc2567fc700 1 -- 172.21.15.50:0/2462362320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b820 con 0x7fc2580c6d00 2023-12-24T18:51:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc2567fc700 1 -- 172.21.15.50:0/2462362320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800b980 con 0x7fc2580c6d00 2023-12-24T18:51:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc2567fc700 1 -- 172.21.15.50:0/2462362320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800bd20 con 0x7fc2580c6d00 2023-12-24T18:51:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 -- 172.21.15.50:0/2462362320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580c6d00 msgr2=0x7fc2580c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 --2- 172.21.15.50:0/2462362320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580c6d00 0x7fc2580c70d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc2480099b0 tx=0x7fc248009250 comp rx=0 tx=0).stop 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 -- 172.21.15.50:0/2462362320 shutdown_connections 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 --2- 172.21.15.50:0/2462362320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580c6d00 0x7fc2580c70d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 -- 172.21.15.50:0/2462362320 >> 172.21.15.50:0/2462362320 conn(0x7fc2580cbba0 msgr2=0x7fc2580cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 -- 172.21.15.50:0/2462362320 shutdown_connections 2023-12-24T18:51:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.701+0000 7fc25d66e700 1 -- 172.21.15.50:0/2462362320 wait complete. 2023-12-24T18:51:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 Processor -- start 2023-12-24T18:51:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 -- start start 2023-12-24T18:51:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc25806aca0 0x7fc258152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc258154450 0x7fc2580aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25816dae0 con 0x7fc2580b0100 2023-12-24T18:51:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25816ced0 con 0x7fc25806aca0 2023-12-24T18:51:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc25d66e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25816d1b0 con 0x7fc258154450 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49290/0 (socket says 172.21.15.50:49290) 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 -- 172.21.15.50:0/4027116503 learned_addr learned my addr 172.21.15.50:0/4027116503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc256ffd700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc25806aca0 0x7fc258152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc24ffff700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc258154450 0x7fc2580aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 -- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc258154450 msgr2=0x7fc2580aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc258154450 0x7fc2580aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 -- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc25806aca0 msgr2=0x7fc258152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc25806aca0 0x7fc258152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 -- 172.21.15.50:0/4027116503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480094f0 con 0x7fc2580b0100 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.705+0000 7fc2577fe700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c930 tx=0x7fc2500026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250012630 con 0x7fc2580b0100 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2500127d0 con 0x7fc2580b0100 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250012b90 con 0x7fc2580b0100 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25816d490 con 0x7fc2580b0100 2023-12-24T18:51:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc258152d70 con 0x7fc2580b0100 2023-12-24T18:51:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25816dc90 con 0x7fc2580b0100 2023-12-24T18:51:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.709+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc25001b400 con 0x7fc2580b0100 2023-12-24T18:51:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.713+0000 7fc24effd700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 0x7fc238062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.713+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fc25007ca40 con 0x7fc2580b0100 2023-12-24T18:51:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.713+0000 7fc256ffd700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 0x7fc238062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.713+0000 7fc256ffd700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 0x7fc238062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc2480099b0 tx=0x7fc248016000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.717+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc25816dc90 con 0x7fc2580b0100 2023-12-24T18:51:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.953+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc2580652e0 con 0x7fc2580b0100 2023-12-24T18:51:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.953+0000 7fc24effd700 1 -- 172.21.15.50:0/4027116503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc25004d030 con 0x7fc2580b0100 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:51:55.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:51:55.966 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:55.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:51:55.968 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:51:55.970 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:51:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.957+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 msgr2=0x7fc238062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.957+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 0x7fc238062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc2480099b0 tx=0x7fc248016000 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.957+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 msgr2=0x7fc2580aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.957+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c930 tx=0x7fc2500026e0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 shutdown_connections 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc238060550 0x7fc238062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2580b0100 0x7fc2580aab40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc258154450 0x7fc2580aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 --2- 172.21.15.50:0/4027116503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc25806aca0 0x7fc258152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 >> 172.21.15.50:0/4027116503 conn(0x7fc2580cbba0 msgr2=0x7fc258159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 shutdown_connections 2023-12-24T18:51:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:55.961+0000 7fc25d66e700 1 -- 172.21.15.50:0/4027116503 wait complete. 2023-12-24T18:51:55.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:51:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.141+0000 7f2876d45700 1 Processor -- start 2023-12-24T18:51:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.141+0000 7f2876d45700 1 -- start start 2023-12-24T18:51:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2876d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2876d45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f287006aca0 0x7f287006b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2876d45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287006c820 con 0x7f28700c6d00 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2876d45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287006b960 con 0x7f287006aca0 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2876d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287006bc40 con 0x7f2870154b60 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2874ae1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28700c6d00 0x7f2870154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57314/0 (socket says 172.21.15.50:57314) 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f2874ae1700 1 -- 172.21.15.50:0/571579187 learned_addr learned my addr 172.21.15.50:0/571579187 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 --2- 172.21.15.50:0/571579187 >> v2:172.21.15.82:3300/0 conn(0x7f287006aca0 0x7f287006b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f286ffff700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f286f7fe700 1 -- 172.21.15.50:0/571579187 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260177073 0 0) 0x7f287006c820 con 0x7f28700c6d00 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f286f7fe700 1 -- 172.21.15.50:0/571579187 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003570 con 0x7f28700c6d00 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 -- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 msgr2=0x7f28700c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 -- 172.21.15.50:0/571579187 >> v1:172.21.15.50:6789/0 conn(0x7f28700c6d00 legacy=0x7f2870154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 -- 172.21.15.50:0/571579187 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287006bf20 con 0x7f287006aca0 2023-12-24T18:51:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f28752e2700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f287006b100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f28680098e0 tx=0x7f28680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f9800a5ca467a3a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.145+0000 7f286f7fe700 1 -- 172.21.15.50:0/571579187 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868011630 con 0x7f287006aca0 2023-12-24T18:51:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f286f7fe700 1 -- 172.21.15.50:0/571579187 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868011790 con 0x7f287006aca0 2023-12-24T18:51:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f286f7fe700 1 -- 172.21.15.50:0/571579187 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868011b30 con 0x7f287006aca0 2023-12-24T18:51:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 msgr2=0x7f287006b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f287006b100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f28680098e0 tx=0x7f28680091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- 172.21.15.50:0/571579187 shutdown_connections 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f287006b100 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 --2- 172.21.15.50:0/571579187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- 172.21.15.50:0/571579187 >> 172.21.15.50:0/571579187 conn(0x7f28700cbba0 msgr2=0x7f28700cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- 172.21.15.50:0/571579187 shutdown_connections 2023-12-24T18:51:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- 172.21.15.50:0/571579187 wait complete. 2023-12-24T18:51:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 Processor -- start 2023-12-24T18:51:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.149+0000 7f2876d45700 1 -- start start 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 0x7f287016de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 0x7f2870159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287015a180 con 0x7f287006aca0 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700ca880 con 0x7f2870154b60 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2876d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700c9c70 con 0x7f28700c6d00 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49296/0 (socket says 172.21.15.50:49296) 2023-12-24T18:51:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 -- 172.21.15.50:0/375027175 learned_addr learned my addr 172.21.15.50:0/375027175 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f28752e2700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 0x7f2870159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f286ffff700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 0x7f287016de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 -- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 msgr2=0x7f287016de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 0x7f287016de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 -- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 msgr2=0x7f2870159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 0x7f2870159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 -- 172.21.15.50:0/375027175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009420 con 0x7f287006aca0 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f286ffff700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 0x7f287016de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f28752e2700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 0x7f2870159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:51:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.153+0000 7f2874ae1700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f286400cd60 tx=0x7f2864001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400ab30 con 0x7f287006aca0 2023-12-24T18:51:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400acb0 con 0x7f287006aca0 2023-12-24T18:51:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700c9f50 con 0x7f287006aca0 2023-12-24T18:51:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864007340 con 0x7f287006aca0 2023-12-24T18:51:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700ca510 con 0x7f287006aca0 2023-12-24T18:51:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700ab910 con 0x7f287006aca0 2023-12-24T18:51:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.157+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2864007770 con 0x7f287006aca0 2023-12-24T18:51:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.161+0000 7f286cff9700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 0x7f2854062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.161+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f286407cc80 con 0x7f287006aca0 2023-12-24T18:51:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.161+0000 7f286ffff700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 0x7f2854062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.161+0000 7f286ffff700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 0x7f2854062ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28700633d0 tx=0x7f285c008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.165+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f28700ab910 con 0x7f287006aca0 2023-12-24T18:51:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.333+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28700ab910 con 0x7f287006aca0 2023-12-24T18:51:56.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.333+0000 7f286cff9700 1 -- 172.21.15.50:0/375027175 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+12864 (secure 0 0 0) 0x7f28700ab910 con 0x7f287006aca0 2023-12-24T18:51:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:56.338 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":92,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:51:55.518493+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:51:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 msgr2=0x7f2854062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 0x7f2854062ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28700633d0 tx=0x7f285c008040 comp rx=0 tx=0).stop 2023-12-24T18:51:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 msgr2=0x7f28701519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f286400cd60 tx=0x7f2864001b10 comp rx=0 tx=0).stop 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 shutdown_connections 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f2854060620 0x7f2854062ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2870154b60 0x7f2870159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28700c6d00 0x7f287016de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 --2- 172.21.15.50:0/375027175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f287006aca0 0x7f28701519a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 >> 172.21.15.50:0/375027175 conn(0x7f28700cbba0 msgr2=0x7f2870153660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 shutdown_connections 2023-12-24T18:51:56.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.337+0000 7f2876d45700 1 -- 172.21.15.50:0/375027175 wait complete. 2023-12-24T18:51:56.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:51:56.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:51:56.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.529+0000 7f76e9416700 1 Processor -- start 2023-12-24T18:51:56.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 -- start start 2023-12-24T18:51:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76e406d450 0x7f76e40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e406a580 con 0x7f76e40cc780 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40cd110 con 0x7f76e406d450 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e9416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e406a7d0 con 0x7f76e4158c40 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.533+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e8c15700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76e406d450 0x7f76e40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:34658/0 (socket says 172.21.15.50:34658) 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 -- 172.21.15.50:0/589584940 learned_addr learned my addr 172.21.15.50:0/589584940 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e37fe700 1 --1- 172.21.15.50:0/589584940 >> v1:172.21.15.82:6789/0 conn(0x7f76e40cc780 0x7f76e406cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:56824/0 (socket says 172.21.15.50:56824) 2023-12-24T18:51:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 -- 172.21.15.50:0/589584940 >> v2:172.21.15.82:3300/0 conn(0x7f76e406d450 msgr2=0x7f76e40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 --2- 172.21.15.50:0/589584940 >> v2:172.21.15.82:3300/0 conn(0x7f76e406d450 0x7f76e40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 -- 172.21.15.50:0/589584940 >> v1:172.21.15.82:6789/0 conn(0x7f76e40cc780 legacy=0x7f76e406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 -- 172.21.15.50:0/589584940 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e406aab0 con 0x7f76e4158c40 2023-12-24T18:51:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e3fff700 1 --2- 172.21.15.50:0/589584940 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76d40099b0 tx=0x7f76d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e17bc11581ab8ac server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e2ffd700 1 -- 172.21.15.50:0/589584940 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4009ea0 con 0x7f76e4158c40 2023-12-24T18:51:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e2ffd700 1 -- 172.21.15.50:0/589584940 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400b860 con 0x7f76e4158c40 2023-12-24T18:51:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e2ffd700 1 -- 172.21.15.50:0/589584940 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400bc00 con 0x7f76e4158c40 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 -- 172.21.15.50:0/589584940 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 msgr2=0x7f76e40cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 --2- 172.21.15.50:0/589584940 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76d40099b0 tx=0x7f76d4009250 comp rx=0 tx=0).stop 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 -- 172.21.15.50:0/589584940 shutdown_connections 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 --2- 172.21.15.50:0/589584940 >> v2:172.21.15.82:3300/0 conn(0x7f76e406d450 0x7f76e40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 --2- 172.21.15.50:0/589584940 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40cf500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 -- 172.21.15.50:0/589584940 >> 172.21.15.50:0/589584940 conn(0x7f76e40d0800 msgr2=0x7f76e40b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 -- 172.21.15.50:0/589584940 shutdown_connections 2023-12-24T18:51:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.537+0000 7f76e9416700 1 -- 172.21.15.50:0/589584940 wait complete. 2023-12-24T18:51:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 Processor -- start 2023-12-24T18:51:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 -- start start 2023-12-24T18:51:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e406d450 0x7f76e41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4153820 con 0x7f76e40cc780 2023-12-24T18:51:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415de20 con 0x7f76e406d450 2023-12-24T18:51:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e9416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415d210 con 0x7f76e4158c40 2023-12-24T18:51:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49300/0 (socket says 172.21.15.50:49300) 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e37fe700 1 -- 172.21.15.50:0/608217559 learned_addr learned my addr 172.21.15.50:0/608217559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e3fff700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e406d450 0x7f76e41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.541+0000 7f76e8c15700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 -- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 msgr2=0x7f76e40b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 -- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e406d450 msgr2=0x7f76e41532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e406d450 0x7f76e41532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 -- 172.21.15.50:0/608217559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40094f0 con 0x7f76e40cc780 2023-12-24T18:51:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e37fe700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c7f0 tx=0x7f76d8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8005a70 con 0x7f76e40cc780 2023-12-24T18:51:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8005bf0 con 0x7f76e40cc780 2023-12-24T18:51:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80070d0 con 0x7f76e40cc780 2023-12-24T18:51:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e415d4f0 con 0x7f76e40cc780 2023-12-24T18:51:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e415dab0 con 0x7f76e40cc780 2023-12-24T18:51:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.545+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e404be40 con 0x7f76e40cc780 2023-12-24T18:51:56.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.549+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f76d8007480 con 0x7f76e40cc780 2023-12-24T18:51:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.549+0000 7f76cbfff700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 0x7f76d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.549+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f76d807bbb0 con 0x7f76e40cc780 2023-12-24T18:51:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.549+0000 7f76e3fff700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 0x7f76d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.553+0000 7f76e3fff700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 0x7f76d0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76d40099b0 tx=0x7f76d4017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.557+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f76d804c1a0 con 0x7f76e40cc780 2023-12-24T18:51:56.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.729+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76e415df60 con 0x7f76e40cc780 2023-12-24T18:51:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.729+0000 7f76cbfff700 1 -- 172.21.15.50:0/608217559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76d804f7c0 con 0x7f76e40cc780 2023-12-24T18:51:56.733 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 msgr2=0x7f76d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 0x7f76d0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76d40099b0 tx=0x7f76d4017000 comp rx=0 tx=0).stop 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 msgr2=0x7f76e41539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c7f0 tx=0x7f76d8007f70 comp rx=0 tx=0).stop 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 shutdown_connections 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f76d0060550 0x7f76d0062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e4158c40 0x7f76e40b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76e40cc780 0x7f76e41539a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 --2- 172.21.15.50:0/608217559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e406d450 0x7f76e41532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 >> 172.21.15.50:0/608217559 conn(0x7f76e40d0800 msgr2=0x7f76e4155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 shutdown_connections 2023-12-24T18:51:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.733+0000 7f76e9416700 1 -- 172.21.15.50:0/608217559 wait complete. 2023-12-24T18:51:56.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:51:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.921+0000 7f0f06d45700 1 Processor -- start 2023-12-24T18:51:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 -- start start 2023-12-24T18:51:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f0015c860 0x7f0f0006af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f000b10e0 0x7f0f000ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0006d890 con 0x7f0f000cc980 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0006ca30 con 0x7f0f000b10e0 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f06d45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000cd310 con 0x7f0f0015c860 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0ef7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0f000cc980 0x7f0f0015cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57328/0 (socket says 172.21.15.50:57328) 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0ef7fff700 1 -- 172.21.15.50:0/2994754945 learned_addr learned my addr 172.21.15.50:0/2994754945 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f052e2700 1 --2- 172.21.15.50:0/2994754945 >> v2:172.21.15.50:3300/0 conn(0x7f0f000b10e0 0x7f0f000ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f04ae1700 1 --2- 172.21.15.50:0/2994754945 >> v2:172.21.15.82:3300/0 conn(0x7f0f0015c860 0x7f0f0006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0ef77fe700 1 -- 172.21.15.50:0/2994754945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287677048 0 0) 0x7f0f0006d890 con 0x7f0f000cc980 2023-12-24T18:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0ef77fe700 1 -- 172.21.15.50:0/2994754945 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee8003570 con 0x7f0f000cc980 2023-12-24T18:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f052e2700 1 -- 172.21.15.50:0/2994754945 >> v2:172.21.15.82:3300/0 conn(0x7f0f0015c860 msgr2=0x7f0f0006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f052e2700 1 --2- 172.21.15.50:0/2994754945 >> v2:172.21.15.82:3300/0 conn(0x7f0f0015c860 0x7f0f0006af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f052e2700 1 -- 172.21.15.50:0/2994754945 >> v1:172.21.15.50:6789/0 conn(0x7f0f000cc980 legacy=0x7f0f0015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.925+0000 7f0f052e2700 1 -- 172.21.15.50:0/2994754945 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0006cc80 con 0x7f0f000b10e0 2023-12-24T18:51:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f052e2700 1 --2- 172.21.15.50:0/2994754945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f000ccdd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0f0006b980 tx=0x7f0ef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bcbeb47e272e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0ef77fe700 1 -- 172.21.15.50:0/2994754945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8011630 con 0x7f0f000b10e0 2023-12-24T18:51:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0ef77fe700 1 -- 172.21.15.50:0/2994754945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80117b0 con 0x7f0f000b10e0 2023-12-24T18:51:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0ef77fe700 1 -- 172.21.15.50:0/2994754945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8011b70 con 0x7f0f000b10e0 2023-12-24T18:51:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 -- 172.21.15.50:0/2994754945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 msgr2=0x7f0f000ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2994754945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f000ccdd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0f0006b980 tx=0x7f0ef80091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 -- 172.21.15.50:0/2994754945 shutdown_connections 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2994754945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f000ccdd0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2994754945 >> v2:172.21.15.82:3300/0 conn(0x7f0f0015c860 0x7f0f0006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 -- 172.21.15.50:0/2994754945 >> 172.21.15.50:0/2994754945 conn(0x7f0f000670b0 msgr2=0x7f0f000674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 -- 172.21.15.50:0/2994754945 shutdown_connections 2023-12-24T18:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 -- 172.21.15.50:0/2994754945 wait complete. 2023-12-24T18:51:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.929+0000 7f0f06d45700 1 Processor -- start 2023-12-24T18:51:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- start start 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 0x7f0f000c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 0x7f0f0015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000c8900 con 0x7f0f000b10e0 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000b46f0 con 0x7f0f000cc980 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000ca1c0 con 0x7f0f0015c860 2023-12-24T18:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49316/0 (socket says 172.21.15.50:49316) 2023-12-24T18:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 -- 172.21.15.50:0/2291475515 learned_addr learned my addr 172.21.15.50:0/2291475515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0ef7fff700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 0x7f0f000c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f052e2700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 0x7f0f0015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 -- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 msgr2=0x7f0f0015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 0x7f0f0015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 -- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 msgr2=0x7f0f000c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 0x7f0f000c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 -- 172.21.15.50:0/2291475515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8009420 con 0x7f0f000b10e0 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0ef7fff700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 0x7f0f000c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f052e2700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 0x7f0f0015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f04ae1700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009e80 tx=0x7f0efc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00cc20 con 0x7f0f000b10e0 2023-12-24T18:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00f040 con 0x7f0f000b10e0 2023-12-24T18:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000c8340 con 0x7f0f000b10e0 2023-12-24T18:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc014480 con 0x7f0f000b10e0 2023-12-24T18:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.933+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f000b4380 con 0x7f0f000b10e0 2023-12-24T18:51:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.937+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f000652e0 con 0x7f0f000b10e0 2023-12-24T18:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.937+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0efc0147f0 con 0x7f0f000b10e0 2023-12-24T18:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.937+0000 7f0ef4ff9700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 0x7f0eec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.941+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f0efc07d430 con 0x7f0f000b10e0 2023-12-24T18:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.941+0000 7f0ef7fff700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 0x7f0eec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.941+0000 7f0ef7fff700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 0x7f0eec062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0007fd0 tx=0x7f0ef0009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:56.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:56.945+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0efc0514b0 con 0x7f0f000b10e0 2023-12-24T18:51:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.125+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f0006b540 con 0x7f0f000b10e0 2023-12-24T18:51:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.125+0000 7f0ef4ff9700 1 -- 172.21.15.50:0/2291475515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0efc051040 con 0x7f0f000b10e0 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:51:57.129 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 msgr2=0x7f0eec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 0x7f0eec062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0007fd0 tx=0x7f0ef0009040 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 msgr2=0x7f0f00153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009e80 tx=0x7f0efc00b040 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 shutdown_connections 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0eec060550 0x7f0eec062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f0015c860 0x7f0f0015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f000cc980 0x7f0f000c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 --2- 172.21.15.50:0/2291475515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f000b10e0 0x7f0f00153310 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 >> 172.21.15.50:0/2291475515 conn(0x7f0f000670b0 msgr2=0x7f0f000b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 shutdown_connections 2023-12-24T18:51:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.129+0000 7f0f06d45700 1 -- 172.21.15.50:0/2291475515 wait complete. 2023-12-24T18:51:57.150 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:51:57.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:51:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.329+0000 7f077f59e700 1 Processor -- start 2023-12-24T18:51:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.329+0000 7f077f59e700 1 -- start start 2023-12-24T18:51:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f078006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07800c5c90 0x7f07800cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078006b5b0 con 0x7f078006a4a0 2023-12-24T18:51:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078015dbd0 con 0x7f07800c5c90 2023-12-24T18:51:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078006df80 con 0x7f0780159080 2023-12-24T18:51:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07800c5c90 0x7f07800cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07800c5c90 0x7f07800cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49326/0 (socket says 172.21.15.50:49326) 2023-12-24T18:51:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 -- 172.21.15.50:0/537666216 learned_addr learned my addr 172.21.15.50:0/537666216 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077e59c700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f078006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 -- 172.21.15.50:0/537666216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 msgr2=0x7f078006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f078006da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 -- 172.21.15.50:0/537666216 >> v1:172.21.15.50:6789/0 conn(0x7f078006a4a0 legacy=0x7f07800c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 -- 172.21.15.50:0/537666216 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078006a9a0 con 0x7f07800c5c90 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077ed9d700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07800c5c90 0x7f07800cab30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0778009f20 tx=0x7f0778009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ec286f04f62cda server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077d59a700 1 -- 172.21.15.50:0/537666216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800e070 con 0x7f07800c5c90 2023-12-24T18:51:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077d59a700 1 -- 172.21.15.50:0/537666216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800b9d0 con 0x7f07800c5c90 2023-12-24T18:51:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.333+0000 7f077d59a700 1 -- 172.21.15.50:0/537666216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780092e0 con 0x7f07800c5c90 2023-12-24T18:51:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- 172.21.15.50:0/537666216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07800c5c90 msgr2=0x7f07800cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07800c5c90 0x7f07800cab30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0778009f20 tx=0x7f0778009840 comp rx=0 tx=0).stop 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- 172.21.15.50:0/537666216 shutdown_connections 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07800c5c90 0x7f07800cab30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 --2- 172.21.15.50:0/537666216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f078006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- 172.21.15.50:0/537666216 >> 172.21.15.50:0/537666216 conn(0x7f0780067b80 msgr2=0x7f07800cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- 172.21.15.50:0/537666216 shutdown_connections 2023-12-24T18:51:57.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- 172.21.15.50:0/537666216 wait complete. 2023-12-24T18:51:57.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 Processor -- start 2023-12-24T18:51:57.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.337+0000 7f077f59e700 1 -- start start 2023-12-24T18:51:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07800c5c90 0x7f0780159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f0780159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780151fa0 con 0x7f078006a4a0 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078015abd0 con 0x7f07800c5c90 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0780159fc0 con 0x7f0780159080 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49336/0 (socket says 172.21.15.50:49336) 2023-12-24T18:51:57.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 -- 172.21.15.50:0/1183682560 learned_addr learned my addr 172.21.15.50:0/1183682560 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077ed9d700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f0780159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077dd9b700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07800c5c90 0x7f0780159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 -- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 msgr2=0x7f0780159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f0780159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 -- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07800c5c90 msgr2=0x7f0780159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07800c5c90 0x7f0780159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 -- 172.21.15.50:0/1183682560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778009ae0 con 0x7f078006a4a0 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077e59c700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f077000e950 tx=0x7f07700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:57.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000c850 con 0x7f078006a4a0 2023-12-24T18:51:57.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000c9b0 con 0x7f078006a4a0 2023-12-24T18:51:57.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078015a2a0 con 0x7f078006a4a0 2023-12-24T18:51:57.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000cdb0 con 0x7f078006a4a0 2023-12-24T18:51:57.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.341+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078015a860 con 0x7f078006a4a0 2023-12-24T18:51:57.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.345+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078004be40 con 0x7f078006a4a0 2023-12-24T18:51:57.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.345+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0770013680 con 0x7f078006a4a0 2023-12-24T18:51:57.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.345+0000 7f076e7fc700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 0x7f0760062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:57.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.345+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f077007c9f0 con 0x7f078006a4a0 2023-12-24T18:51:57.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.345+0000 7f077dd9b700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 0x7f0760062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:57.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.349+0000 7f077dd9b700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 0x7f0760062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f078006b4f0 tx=0x7f0774009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.353+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f077004cfe0 con 0x7f078006a4a0 2023-12-24T18:51:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:57.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f078006e1c0 con 0x7f078006a4a0 2023-12-24T18:51:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.517+0000 7f076e7fc700 1 -- 172.21.15.50:0/1183682560 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0770050600 con 0x7f078006a4a0 2023-12-24T18:51:58.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:51:58.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 msgr2=0x7f0760062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 0x7f0760062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f078006b4f0 tx=0x7f0774009040 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 msgr2=0x7f07801514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f077000e950 tx=0x7f07700091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 shutdown_connections 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0760060550 0x7f0760062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0780159080 0x7f0780159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07800c5c90 0x7f0780159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 --2- 172.21.15.50:0/1183682560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f078006a4a0 0x7f07801514b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 >> 172.21.15.50:0/1183682560 conn(0x7f0780067b80 msgr2=0x7f07800cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 shutdown_connections 2023-12-24T18:51:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.525+0000 7f077f59e700 1 -- 172.21.15.50:0/1183682560 wait complete. 2023-12-24T18:51:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:51:58.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:51:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.793+0000 7f611c88e700 1 Processor -- start 2023-12-24T18:51:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.793+0000 7f611c88e700 1 -- start start 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6118158c50 0x7f6118159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61180caef0 0x7f61180cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61180cc790 0x7f61180ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180af430 con 0x7f61180cc790 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180cd150 con 0x7f6118158c50 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f611c88e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180caa60 con 0x7f61180caef0 2023-12-24T18:51:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f6117fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61180cc790 0x7f61180ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f6117fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61180cc790 0x7f61180ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49346/0 (socket says 172.21.15.50:49346) 2023-12-24T18:51:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f6117fff700 1 -- 172.21.15.50:0/4166082723 learned_addr learned my addr 172.21.15.50:0/4166082723 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.797+0000 7f6116ffd700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61180caef0 0x7f61180cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f61177fe700 1 --2- 172.21.15.50:0/4166082723 >> v2:172.21.15.82:3300/0 conn(0x7f6118158c50 0x7f6118159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 -- 172.21.15.50:0/4166082723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61180caef0 msgr2=0x7f61180cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61180caef0 0x7f61180cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 -- 172.21.15.50:0/4166082723 >> v2:172.21.15.82:3300/0 conn(0x7f6118158c50 msgr2=0x7f6118159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 --2- 172.21.15.50:0/4166082723 >> v2:172.21.15.82:3300/0 conn(0x7f6118158c50 0x7f6118159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 -- 172.21.15.50:0/4166082723 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180cee80 con 0x7f61180cc790 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f6117fff700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180cc790 0x7f61180ccc10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f611806dcf0 tx=0x7f6110009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d4c4cec863e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f61167fc700 1 -- 172.21.15.50:0/4166082723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000e070 con 0x7f61180cc790 2023-12-24T18:51:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f61167fc700 1 -- 172.21.15.50:0/4166082723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000ba20 con 0x7f61180cc790 2023-12-24T18:51:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f61167fc700 1 -- 172.21.15.50:0/4166082723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100092e0 con 0x7f61180cc790 2023-12-24T18:51:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 -- 172.21.15.50:0/4166082723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180cc790 msgr2=0x7f61180ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180cc790 0x7f61180ccc10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f611806dcf0 tx=0x7f6110009840 comp rx=0 tx=0).stop 2023-12-24T18:51:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 -- 172.21.15.50:0/4166082723 shutdown_connections 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180cc790 0x7f61180ccc10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 --2- 172.21.15.50:0/4166082723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61180caef0 0x7f61180cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 --2- 172.21.15.50:0/4166082723 >> v2:172.21.15.82:3300/0 conn(0x7f6118158c50 0x7f6118159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 -- 172.21.15.50:0/4166082723 >> 172.21.15.50:0/4166082723 conn(0x7f61180670b0 msgr2=0x7f61180674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 -- 172.21.15.50:0/4166082723 shutdown_connections 2023-12-24T18:51:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.801+0000 7f611c88e700 1 -- 172.21.15.50:0/4166082723 wait complete. 2023-12-24T18:51:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 Processor -- start 2023-12-24T18:51:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 -- start start 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180cc790 0x7f61180b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118158c50 0x7f61180b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b4420 con 0x7f61180caef0 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b4700 con 0x7f61180cc790 2023-12-24T18:51:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f611c88e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b49e0 con 0x7f6118158c50 2023-12-24T18:51:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49360/0 (socket says 172.21.15.50:49360) 2023-12-24T18:51:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 -- 172.21.15.50:0/1867229583 learned_addr learned my addr 172.21.15.50:0/1867229583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f6116ffd700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180cc790 0x7f61180b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f6117fff700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118158c50 0x7f61180b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 -- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118158c50 msgr2=0x7f61180b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118158c50 0x7f61180b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 -- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180cc790 msgr2=0x7f61180b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.805+0000 7f61177fe700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180cc790 0x7f61180b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f61177fe700 1 -- 172.21.15.50:0/1867229583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009ae0 con 0x7f61180caef0 2023-12-24T18:51:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f61177fe700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f610800d860 tx=0x7f6108008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080125f0 con 0x7f61180caef0 2023-12-24T18:51:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108012750 con 0x7f61180caef0 2023-12-24T18:51:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108012b10 con 0x7f61180caef0 2023-12-24T18:51:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61180b4cc0 con 0x7f61180caef0 2023-12-24T18:51:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61180b5a00 con 0x7f61180caef0 2023-12-24T18:51:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.809+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6118158880 con 0x7f61180caef0 2023-12-24T18:51:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.813+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f610801e460 con 0x7f61180caef0 2023-12-24T18:51:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.813+0000 7f60ff7fe700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 0x7f6104062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.813+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f610807ce90 con 0x7f61180caef0 2023-12-24T18:51:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.813+0000 7f6116ffd700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 0x7f6104062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.813+0000 7f6116ffd700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 0x7f6104062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61180b42e0 tx=0x7f610c0091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:58.821+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6118158880 con 0x7f61180caef0 2023-12-24T18:51:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.001+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6118158880 con 0x7f61180caef0 2023-12-24T18:51:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.537+0000 7f60ff7fe700 1 -- 172.21.15.50:0/1867229583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6118158880 con 0x7f61180caef0 2023-12-24T18:51:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.541+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 msgr2=0x7f6104062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.541+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 0x7f6104062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61180b42e0 tx=0x7f610c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.541+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 msgr2=0x7f61181573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.541+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f610800d860 tx=0x7f6108008040 comp rx=0 tx=0).stop 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 shutdown_connections 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6104060550 0x7f6104062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6118158c50 0x7f61180b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180cc790 0x7f61180b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 --2- 172.21.15.50:0/1867229583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61180caef0 0x7f61181573c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.549+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 >> 172.21.15.50:0/1867229583 conn(0x7f61180670b0 msgr2=0x7f6118067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:59.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.553+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 shutdown_connections 2023-12-24T18:51:59.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.553+0000 7f611c88e700 1 -- 172.21.15.50:0/1867229583 wait complete. 2023-12-24T18:51:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:51:59.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:51:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.765+0000 7f020088e700 1 Processor -- start 2023-12-24T18:51:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.765+0000 7f020088e700 1 -- start start 2023-12-24T18:51:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.765+0000 7f020088e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01fc156ab0 0x7f01fc156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.765+0000 7f020088e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.765+0000 7f020088e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01fc15b5a0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f020088e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc15a990 con 0x7f01fc156ab0 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f020088e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc15ac70 con 0x7f01fc0adb50 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fbfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f01fc0c87d0 0x7f01fc0ab750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45306/0 (socket says 172.21.15.50:45306) 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fbfff700 1 -- 172.21.15.50:0/1329748336 learned_addr learned my addr 172.21.15.50:0/1329748336 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:51:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/1329748336 >> v2:172.21.15.50:3300/0 conn(0x7f01fc156ab0 0x7f01fc156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01faffd700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fa7fc700 1 -- 172.21.15.50:0/1329748336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511370539 0 0) 0x7f01fc15b5a0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fa7fc700 1 -- 172.21.15.50:0/1329748336 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e4003570 con 0x7f01fc0c87d0 2023-12-24T18:51:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 -- 172.21.15.50:0/1329748336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 msgr2=0x7f01fc0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:51:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 -- 172.21.15.50:0/1329748336 >> v1:172.21.15.50:6789/0 conn(0x7f01fc0c87d0 legacy=0x7f01fc0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 -- 172.21.15.50:0/1329748336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc15af50 con 0x7f01fc156ab0 2023-12-24T18:51:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc156ab0 0x7f01fc156e80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0098e0 tx=0x7f01ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c792764322ddd591 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fa7fc700 1 -- 172.21.15.50:0/1329748336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011630 con 0x7f01fc156ab0 2023-12-24T18:51:59.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fa7fc700 1 -- 172.21.15.50:0/1329748336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec011790 con 0x7f01fc156ab0 2023-12-24T18:51:59.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.769+0000 7f01fa7fc700 1 -- 172.21.15.50:0/1329748336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011b30 con 0x7f01fc156ab0 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- 172.21.15.50:0/1329748336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc156ab0 msgr2=0x7f01fc156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc156ab0 0x7f01fc156e80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0098e0 tx=0x7f01ec0091a0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- 172.21.15.50:0/1329748336 shutdown_connections 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 --2- 172.21.15.50:0/1329748336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc156ab0 0x7f01fc156e80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- 172.21.15.50:0/1329748336 >> 172.21.15.50:0/1329748336 conn(0x7f01fc067250 msgr2=0x7f01fc067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- 172.21.15.50:0/1329748336 shutdown_connections 2023-12-24T18:51:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- 172.21.15.50:0/1329748336 wait complete. 2023-12-24T18:51:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 Processor -- start 2023-12-24T18:51:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.773+0000 7f020088e700 1 -- start start 2023-12-24T18:51:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01fc156ab0 0x7f01fc0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc15a0a0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc0b08e0 con 0x7f01fc156ab0 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f020088e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc0b0bc0 con 0x7f01fc0adb50 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57802/0 (socket says 172.21.15.50:57802) 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 -- 172.21.15.50:0/656133747 learned_addr learned my addr 172.21.15.50:0/656133747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01fbfff700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01fc156ab0 0x7f01fc0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 -- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 msgr2=0x7f01fc159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 -- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01fc156ab0 msgr2=0x7f01fc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01fc156ab0 0x7f01fc0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 -- 172.21.15.50:0/656133747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec009420 con 0x7f01fc0c87d0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.777+0000 7f01faffd700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ec80 tx=0x7f01f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000c850 con 0x7f01fc0c87d0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000c9b0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000cd50 con 0x7f01fc0c87d0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01fc0b0ea0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01fc0b1460 con 0x7f01fc0c87d0 2023-12-24T18:51:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc04be40 con 0x7f01fc0c87d0 2023-12-24T18:51:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.781+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f01f0013680 con 0x7f01fc0c87d0 2023-12-24T18:51:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.785+0000 7f01e37fe700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 0x7f01e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:51:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.785+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6301+0+0 (secure 0 0 0) 0x7f01f007ccc0 con 0x7f01fc0c87d0 2023-12-24T18:51:59.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.785+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 0x7f01e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:51:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.785+0000 7f01fb7fe700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 0x7f01e8062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0091e0 tx=0x7f01ec017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:51:59.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:51:59.793+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01f0083080 con 0x7f01fc0c87d0 2023-12-24T18:52:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.001+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f01fc06a8e0 con 0x7f01fc0c87d0 2023-12-24T18:52:00.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.549+0000 7f01e37fe700 1 -- 172.21.15.50:0/656133747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f01f004cfc0 con 0x7f01fc0c87d0 2023-12-24T18:52:00.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.565+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 msgr2=0x7f01e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.565+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 0x7f01e8062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0091e0 tx=0x7f01ec017000 comp rx=0 tx=0).stop 2023-12-24T18:52:00.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.565+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 msgr2=0x7f01fc0a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.565+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ec80 tx=0x7f01f00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 shutdown_connections 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f01e8060550 0x7f01e8062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01fc156ab0 0x7f01fc0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc0c87d0 0x7f01fc0a9b70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 --2- 172.21.15.50:0/656133747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01fc0adb50 0x7f01fc159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.569+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 >> 172.21.15.50:0/656133747 conn(0x7f01fc067250 msgr2=0x7f01fc0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:00.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.573+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 shutdown_connections 2023-12-24T18:52:00.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.573+0000 7f020088e700 1 -- 172.21.15.50:0/656133747 wait complete. 2023-12-24T18:52:00.580 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 11 and data pool 12 2023-12-24T18:52:00.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.769+0000 7f3efce0c700 1 Processor -- start 2023-12-24T18:52:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.769+0000 7f3efce0c700 1 -- start start 2023-12-24T18:52:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3efce0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef80ad220 0x7f3ef80ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3efce0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef8155e20 0x7f3ef806b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3efce0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef806e110 con 0x7f3ef806afa0 2023-12-24T18:52:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3efce0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef806b960 con 0x7f3ef80ad220 2023-12-24T18:52:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3efce0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806bb40 con 0x7f3ef8155e20 2023-12-24T18:52:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef80ad220 0x7f3ef80ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef80ad220 0x7f3ef80ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57810/0 (socket says 172.21.15.50:57810) 2023-12-24T18:52:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 -- 172.21.15.50:0/963720605 learned_addr learned my addr 172.21.15.50:0/963720605 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef7fff700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef8155e20 0x7f3ef806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 -- 172.21.15.50:0/963720605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef8155e20 msgr2=0x7f3ef806b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef8155e20 0x7f3ef806b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 -- 172.21.15.50:0/963720605 >> v1:172.21.15.82:6789/0 conn(0x7f3ef806afa0 legacy=0x7f3ef8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 -- 172.21.15.50:0/963720605 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef806be20 con 0x7f3ef80ad220 2023-12-24T18:52:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef77fe700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80ad5f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbb84f88d424851 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.773+0000 7f3ef6ffd700 1 -- 172.21.15.50:0/963720605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800b860 con 0x7f3ef80ad220 2023-12-24T18:52:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3ef6ffd700 1 -- 172.21.15.50:0/963720605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800b9c0 con 0x7f3ef80ad220 2023-12-24T18:52:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3ef6ffd700 1 -- 172.21.15.50:0/963720605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800bd60 con 0x7f3ef80ad220 2023-12-24T18:52:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 -- 172.21.15.50:0/963720605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 msgr2=0x7f3ef80ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80ad5f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8009250 comp rx=0 tx=0).stop 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 -- 172.21.15.50:0/963720605 shutdown_connections 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef8155e20 0x7f3ef806b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 --2- 172.21.15.50:0/963720605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80ad5f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 -- 172.21.15.50:0/963720605 >> 172.21.15.50:0/963720605 conn(0x7f3ef8067b80 msgr2=0x7f3ef80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 -- 172.21.15.50:0/963720605 shutdown_connections 2023-12-24T18:52:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.777+0000 7f3efce0c700 1 -- 172.21.15.50:0/963720605 wait complete. 2023-12-24T18:52:00.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 Processor -- start 2023-12-24T18:52:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 -- start start 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef806afa0 0x7f3ef8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef8155e20 0x7f3ef815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8158850 con 0x7f3ef80ad220 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8155120 con 0x7f3ef8155e20 2023-12-24T18:52:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3efce0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8157c40 con 0x7f3ef806afa0 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57818/0 (socket says 172.21.15.50:57818) 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 -- 172.21.15.50:0/910851251 learned_addr learned my addr 172.21.15.50:0/910851251 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3ef7fff700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef8155e20 0x7f3ef815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3ef77fe700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef806afa0 0x7f3ef8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 -- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef806afa0 msgr2=0x7f3ef8158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef806afa0 0x7f3ef8158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 -- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef8155e20 msgr2=0x7f3ef815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef8155e20 0x7f3ef815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.781+0000 7f3eeeffd700 1 -- 172.21.15.50:0/910851251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80094f0 con 0x7f3ef80ad220 2023-12-24T18:52:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3eeeffd700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4e0 tx=0x7f3ee000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011590 con 0x7f3ef80ad220 2023-12-24T18:52:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011710 con 0x7f3ef80ad220 2023-12-24T18:52:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8157f20 con 0x7f3ef80ad220 2023-12-24T18:52:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011ad0 con 0x7f3ef80ad220 2023-12-24T18:52:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef81584e0 con 0x7f3ef80ad220 2023-12-24T18:52:00.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.785+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef8158a00 con 0x7f3ef80ad220 2023-12-24T18:52:00.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.789+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3ee001b3b0 con 0x7f3ef80ad220 2023-12-24T18:52:00.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.789+0000 7f3eeffff700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 0x7f3ed8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:00.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.789+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f3ee007bff0 con 0x7f3ef80ad220 2023-12-24T18:52:00.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.789+0000 7f3ef77fe700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 0x7f3ed8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:00.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.793+0000 7f3ef77fe700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 0x7f3ed8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:00.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.797+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3ef8158a00 con 0x7f3ef80ad220 2023-12-24T18:52:00.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.985+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ef804be40 con 0x7f3ef80ad220 2023-12-24T18:52:00.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3eeffff700 1 -- 172.21.15.50:0/910851251 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16095 (secure 0 0 0) 0x7f3ee0017020 con 0x7f3ef80ad220 2023-12-24T18:52:00.991 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:00.991 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:00.007057+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 msgr2=0x7f3ed8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 0x7f3ed8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8017000 comp rx=0 tx=0).stop 2023-12-24T18:52:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 msgr2=0x7f3ef80cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4e0 tx=0x7f3ee000c8a0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 shutdown_connections 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3ed8060550 0x7f3ed8062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef8155e20 0x7f3ef815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef80ad220 0x7f3ef80cb010 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 --2- 172.21.15.50:0/910851251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ef806afa0 0x7f3ef8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.989+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 >> 172.21.15.50:0/910851251 conn(0x7f3ef8067b80 msgr2=0x7f3ef80c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.993+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 shutdown_connections 2023-12-24T18:52:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:00.993+0000 7f3efce0c700 1 -- 172.21.15.50:0/910851251 wait complete. 2023-12-24T18:52:01.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.165+0000 7fa490545700 1 Processor -- start 2023-12-24T18:52:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.165+0000 7fa490545700 1 -- start start 2023-12-24T18:52:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa490545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881534d0 0x7fa4880cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa490545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48815d2a0 0x7fa488068450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa490545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48806c950 con 0x7fa4880cc8f0 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa490545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4880c9530 con 0x7fa48815d2a0 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa490545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880c9810 con 0x7fa4881534d0 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa48eae2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48815d2a0 0x7fa488068450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa48eae2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48815d2a0 0x7fa488068450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57824/0 (socket says 172.21.15.50:57824) 2023-12-24T18:52:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa48eae2700 1 -- 172.21.15.50:0/1696552923 learned_addr learned my addr 172.21.15.50:0/1696552923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.169+0000 7fa48e2e1700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881534d0 0x7fa4880cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48eae2700 1 -- 172.21.15.50:0/1696552923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881534d0 msgr2=0x7fa4880cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48eae2700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881534d0 0x7fa4880cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48eae2700 1 -- 172.21.15.50:0/1696552923 >> v1:172.21.15.82:6789/0 conn(0x7fa4880cc8f0 legacy=0x7fa48815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48eae2700 1 -- 172.21.15.50:0/1696552923 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880c9af0 con 0x7fa48815d2a0 2023-12-24T18:52:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48eae2700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48815d2a0 0x7fa488068450 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa480009f20 tx=0x7fa480009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ba7590320f4536 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48d2df700 1 -- 172.21.15.50:0/1696552923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000e070 con 0x7fa48815d2a0 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48d2df700 1 -- 172.21.15.50:0/1696552923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b9d0 con 0x7fa48815d2a0 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa48d2df700 1 -- 172.21.15.50:0/1696552923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800092e0 con 0x7fa48815d2a0 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 -- 172.21.15.50:0/1696552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48815d2a0 msgr2=0x7fa488068450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48815d2a0 0x7fa488068450 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa480009f20 tx=0x7fa480009840 comp rx=0 tx=0).stop 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 -- 172.21.15.50:0/1696552923 shutdown_connections 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48815d2a0 0x7fa488068450 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 --2- 172.21.15.50:0/1696552923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881534d0 0x7fa4880cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 -- 172.21.15.50:0/1696552923 >> 172.21.15.50:0/1696552923 conn(0x7fa4880cddd0 msgr2=0x7fa4880ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 -- 172.21.15.50:0/1696552923 shutdown_connections 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.173+0000 7fa490545700 1 -- 172.21.15.50:0/1696552923 wait complete. 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 Processor -- start 2023-12-24T18:52:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 -- start start 2023-12-24T18:52:01.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48815d2a0 0x7fa4880c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 0x7fa4880c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488150200 con 0x7fa4881534d0 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b1540 con 0x7fa48815d2a0 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa490545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880c80a0 con 0x7fa4880b3740 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48eae2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 0x7fa4880c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48dae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48815d2a0 0x7fa4880c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48eae2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 0x7fa4880c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:35944/0 (socket says 172.21.15.50:35944) 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48eae2700 1 -- 172.21.15.50:0/3158322387 learned_addr learned my addr 172.21.15.50:0/3158322387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57826/0 (socket says 172.21.15.50:57826) 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 -- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 msgr2=0x7fa4880c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 0x7fa4880c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 -- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48815d2a0 msgr2=0x7fa4880c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48815d2a0 0x7fa4880c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.177+0000 7fa48e2e1700 1 -- 172.21.15.50:0/3158322387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009ae0 con 0x7fa4881534d0 2023-12-24T18:52:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa48e2e1700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa48400ea50 tx=0x7fa4840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400ee90 con 0x7fa4881534d0 2023-12-24T18:52:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48400c7f0 con 0x7fa4881534d0 2023-12-24T18:52:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400cb90 con 0x7fa4881534d0 2023-12-24T18:52:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48815c060 con 0x7fa4881534d0 2023-12-24T18:52:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880b0ef0 con 0x7fa4881534d0 2023-12-24T18:52:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.181+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4880652e0 con 0x7fa4881534d0 2023-12-24T18:52:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.185+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa484013470 con 0x7fa4881534d0 2023-12-24T18:52:01.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.185+0000 7fa47e7fc700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 0x7fa46c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.185+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fa48407cbc0 con 0x7fa4881534d0 2023-12-24T18:52:01.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.185+0000 7fa48dae0700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 0x7fa46c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.185+0000 7fa48dae0700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 0x7fa46c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b1da0 tx=0x7fa478007ec0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.193+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa48404cef0 con 0x7fa4881534d0 2023-12-24T18:52:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.365+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4880c9220 con 0x7fa4881534d0 2023-12-24T18:52:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.365+0000 7fa47e7fc700 1 -- 172.21.15.50:0/3158322387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16095 (secure 0 0 0) 0x7fa484050510 con 0x7fa4881534d0 2023-12-24T18:52:01.370 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:01.370 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:00.007057+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 msgr2=0x7fa46c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 0x7fa46c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b1da0 tx=0x7fa478007ec0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 msgr2=0x7fa48815b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa48400ea50 tx=0x7fa4840091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 shutdown_connections 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa46c060550 0x7fa46c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4880b3740 0x7fa4880c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48815d2a0 0x7fa4880c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 --2- 172.21.15.50:0/3158322387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881534d0 0x7fa48815b5a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 >> 172.21.15.50:0/3158322387 conn(0x7fa4880cddd0 msgr2=0x7fa4880ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 shutdown_connections 2023-12-24T18:52:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.373+0000 7fa490545700 1 -- 172.21.15.50:0/3158322387 wait complete. 2023-12-24T18:52:01.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:52:01.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 Processor -- start 2023-12-24T18:52:01.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 -- start start 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf8806c820 0x7fcf880cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf8806d300 0x7fcf88160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880cd380 con 0x7fcf880cc210 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880cc770 con 0x7fcf8806d300 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8e00c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880cca50 con 0x7fcf8806c820 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8d80b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf8806d300 0x7fcf88160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8d80b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf8806d300 0x7fcf88160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57836/0 (socket says 172.21.15.50:57836) 2023-12-24T18:52:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8d80b700 1 -- 172.21.15.50:0/4034813136 learned_addr learned my addr 172.21.15.50:0/4034813136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.565+0000 7fcf8d00a700 1 --2- 172.21.15.50:0/4034813136 >> v2:172.21.15.82:3300/0 conn(0x7fcf8806c820 0x7fcf880cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8d80b700 1 -- 172.21.15.50:0/4034813136 >> v2:172.21.15.82:3300/0 conn(0x7fcf8806c820 msgr2=0x7fcf880cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8d80b700 1 --2- 172.21.15.50:0/4034813136 >> v2:172.21.15.82:3300/0 conn(0x7fcf8806c820 0x7fcf880cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8d80b700 1 -- 172.21.15.50:0/4034813136 >> v1:172.21.15.50:6789/0 conn(0x7fcf880cc210 legacy=0x7fcf8806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8d80b700 1 -- 172.21.15.50:0/4034813136 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880ccd30 con 0x7fcf8806d300 2023-12-24T18:52:01.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8d80b700 1 --2- 172.21.15.50:0/4034813136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf88160820 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcf880636c0 tx=0x7fcf80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b617dab4d7d29f4b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf7ffff700 1 -- 172.21.15.50:0/4034813136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000e070 con 0x7fcf8806d300 2023-12-24T18:52:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf7ffff700 1 -- 172.21.15.50:0/4034813136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000ba20 con 0x7fcf8806d300 2023-12-24T18:52:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf7ffff700 1 -- 172.21.15.50:0/4034813136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800092e0 con 0x7fcf8806d300 2023-12-24T18:52:01.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 -- 172.21.15.50:0/4034813136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 msgr2=0x7fcf88160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/4034813136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf88160820 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcf880636c0 tx=0x7fcf80009840 comp rx=0 tx=0).stop 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 -- 172.21.15.50:0/4034813136 shutdown_connections 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/4034813136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf88160820 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/4034813136 >> v2:172.21.15.82:3300/0 conn(0x7fcf8806c820 0x7fcf880cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.569+0000 7fcf8e00c700 1 -- 172.21.15.50:0/4034813136 >> 172.21.15.50:0/4034813136 conn(0x7fcf880ca600 msgr2=0x7fcf880caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.573+0000 7fcf8e00c700 1 -- 172.21.15.50:0/4034813136 shutdown_connections 2023-12-24T18:52:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.573+0000 7fcf8e00c700 1 -- 172.21.15.50:0/4034813136 wait complete. 2023-12-24T18:52:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.573+0000 7fcf8e00c700 1 Processor -- start 2023-12-24T18:52:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.573+0000 7fcf8e00c700 1 -- start start 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf8806c820 0x7fcf8814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf880cc210 0x7fcf880b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8814b7f0 con 0x7fcf8806d300 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf88158b20 con 0x7fcf8806c820 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8816add0 con 0x7fcf880cc210 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57842/0 (socket says 172.21.15.50:57842) 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 -- 172.21.15.50:0/2875809965 learned_addr learned my addr 172.21.15.50:0/2875809965 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8d80b700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf880cc210 0x7fcf880b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8d00a700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf8806c820 0x7fcf8814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 -- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf880cc210 msgr2=0x7fcf880b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf880cc210 0x7fcf880b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 -- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf8806c820 msgr2=0x7fcf8814b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf8806c820 0x7fcf8814b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 -- 172.21.15.50:0/2875809965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009ae0 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8c809700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c5c0 tx=0x7fcf7800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011590 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78011710 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8816b0b0 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011ad0 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8816b670 con 0x7fcf8806d300 2023-12-24T18:52:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.577+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8804be40 con 0x7fcf8806d300 2023-12-24T18:52:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.581+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcf7801b3b0 con 0x7fcf8806d300 2023-12-24T18:52:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.581+0000 7fcf7d7fa700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 0x7fcf6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.581+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fcf7807be70 con 0x7fcf8806d300 2023-12-24T18:52:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.581+0000 7fcf8d00a700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 0x7fcf6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.581+0000 7fcf8d00a700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 0x7fcf6c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009d10 tx=0x7fcf840091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:01.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.589+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf7804c100 con 0x7fcf8806d300 2023-12-24T18:52:01.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:01.805+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf880ad6f0 con 0x7fcf8806d300 2023-12-24T18:52:02.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.577+0000 7fcf7d7fa700 1 -- 172.21.15.50:0/2875809965 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf7804f720 con 0x7fcf8806d300 2023-12-24T18:52:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 msgr2=0x7fcf6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 0x7fcf6c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009d10 tx=0x7fcf840091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 msgr2=0x7fcf881585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c5c0 tx=0x7fcf7800c8d0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 shutdown_connections 2023-12-24T18:52:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fcf6c060550 0x7fcf6c062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf880cc210 0x7fcf880b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf8806d300 0x7fcf881585e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 --2- 172.21.15.50:0/2875809965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf8806c820 0x7fcf8814b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 >> 172.21.15.50:0/2875809965 conn(0x7fcf880ca600 msgr2=0x7fcf880adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 shutdown_connections 2023-12-24T18:52:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.581+0000 7fcf8e00c700 1 -- 172.21.15.50:0/2875809965 wait complete. 2023-12-24T18:52:02.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:52:02.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.789+0000 7f444662e700 1 Processor -- start 2023-12-24T18:52:02.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.789+0000 7f444662e700 1 -- start start 2023-12-24T18:52:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f444662e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444013f530 0x7f44400ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f444662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f900 0x7f44400ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f444662e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400c93e0 con 0x7f444006d700 2023-12-24T18:52:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f444662e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400ca220 con 0x7f444013f530 2023-12-24T18:52:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f444662e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c9610 con 0x7f444013f900 2023-12-24T18:52:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444013f530 0x7f44400ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444013f530 0x7f44400ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57852/0 (socket says 172.21.15.50:57852) 2023-12-24T18:52:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f4444bcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f444006d700 0x7f444006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45314/0 (socket says 172.21.15.50:45314) 2023-12-24T18:52:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 -- 172.21.15.50:0/2305526929 learned_addr learned my addr 172.21.15.50:0/2305526929 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f44377fe700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f900 0x7f44400ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 -- 172.21.15.50:0/2305526929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f900 msgr2=0x7f44400ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f900 0x7f44400ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 -- 172.21.15.50:0/2305526929 >> v1:172.21.15.50:6789/0 conn(0x7f444006d700 legacy=0x7f444006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 -- 172.21.15.50:0/2305526929 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400c98f0 con 0x7f444013f530 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443f7fe700 1 -- 172.21.15.50:0/2305526929 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723521396 0 0) 0x7f44400c93e0 con 0x7f444006d700 2023-12-24T18:52:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.793+0000 7f443ffff700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444013f530 0x7f44400ad4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f44300099b0 tx=0x7f4430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229963567e2ce30 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f443f7fe700 1 -- 172.21.15.50:0/2305526929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430009ea0 con 0x7f444013f530 2023-12-24T18:52:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f443f7fe700 1 -- 172.21.15.50:0/2305526929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000b860 con 0x7f444013f530 2023-12-24T18:52:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f443f7fe700 1 -- 172.21.15.50:0/2305526929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000bc00 con 0x7f444013f530 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 -- 172.21.15.50:0/2305526929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444013f530 msgr2=0x7f44400ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444013f530 0x7f44400ad4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f44300099b0 tx=0x7f4430009250 comp rx=0 tx=0).stop 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 -- 172.21.15.50:0/2305526929 shutdown_connections 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f900 0x7f44400ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 --2- 172.21.15.50:0/2305526929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444013f530 0x7f44400ad4d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 -- 172.21.15.50:0/2305526929 >> 172.21.15.50:0/2305526929 conn(0x7f4440067b80 msgr2=0x7f44400cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 -- 172.21.15.50:0/2305526929 shutdown_connections 2023-12-24T18:52:02.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 -- 172.21.15.50:0/2305526929 wait complete. 2023-12-24T18:52:02.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.797+0000 7f444662e700 1 Processor -- start 2023-12-24T18:52:02.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 -- start start 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f530 0x7f44401571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 0x7f44401552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444015aa90 con 0x7f444006d700 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444015ad70 con 0x7f444013f900 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f444662e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444015a120 con 0x7f444013f530 2023-12-24T18:52:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57862/0 (socket says 172.21.15.50:57862) 2023-12-24T18:52:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 -- 172.21.15.50:0/3757139744 learned_addr learned my addr 172.21.15.50:0/3757139744 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f44377fe700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f530 0x7f44401571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f4444bcb700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 0x7f44401552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 -- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f530 msgr2=0x7f44401571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f530 0x7f44401571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 -- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 msgr2=0x7f44401552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 0x7f44401552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 -- 172.21.15.50:0/3757139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44300094f0 con 0x7f444006d700 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f4444bcb700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 0x7f44401552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.801+0000 7f443ffff700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4430006fd0 tx=0x7f4430017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000bbe0 con 0x7f444006d700 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430011420 con 0x7f444006d700 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44300117c0 con 0x7f444006d700 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444015a400 con 0x7f444006d700 2023-12-24T18:52:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440159e10 con 0x7f444006d700 2023-12-24T18:52:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.805+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44400652e0 con 0x7f444006d700 2023-12-24T18:52:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.809+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4430011bb0 con 0x7f444006d700 2023-12-24T18:52:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.809+0000 7f443cff9700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 0x7f4420062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.809+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f443007e030 con 0x7f444006d700 2023-12-24T18:52:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.809+0000 7f44377fe700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 0x7f4420062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.809+0000 7f44377fe700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 0x7f4420062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f44400ad3d0 tx=0x7f442800b040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:02.813+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f443004e3e0 con 0x7f444006d700 2023-12-24T18:52:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.025+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f44400c9bd0 con 0x7f444006d700 2023-12-24T18:52:03.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.593+0000 7f443cff9700 1 -- 172.21.15.50:0/3757139744 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4430011e60 con 0x7f444006d700 2023-12-24T18:52:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 msgr2=0x7f4420062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 0x7f4420062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f44400ad3d0 tx=0x7f442800b040 comp rx=0 tx=0).stop 2023-12-24T18:52:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 msgr2=0x7f44401598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4430006fd0 tx=0x7f4430017000 comp rx=0 tx=0).stop 2023-12-24T18:52:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 shutdown_connections 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4420060550 0x7f4420062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444013f900 0x7f44401552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f444013f530 0x7f44401571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 --2- 172.21.15.50:0/3757139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444006d700 0x7f44401598d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 >> 172.21.15.50:0/3757139744 conn(0x7f4440067b80 msgr2=0x7f444013e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 shutdown_connections 2023-12-24T18:52:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.597+0000 7f444662e700 1 -- 172.21.15.50:0/3757139744 wait complete. 2023-12-24T18:52:03.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.789+0000 7f88c984c700 1 Processor -- start 2023-12-24T18:52:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.789+0000 7f88c984c700 1 -- start start 2023-12-24T18:52:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.793+0000 7f88c984c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f88c406b6c0 0x7f88c41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.793+0000 7f88c984c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c406c0c0 0x7f88c40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.793+0000 7f88c984c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40a9c80 con 0x7f88c4158cd0 2023-12-24T18:52:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.793+0000 7f88c984c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c406c4f0 con 0x7f88c406b6c0 2023-12-24T18:52:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.793+0000 7f88c984c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40a8e10 con 0x7f88c406c0c0 2023-12-24T18:52:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c884a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88c4158cd0 0x7f88c406afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45324/0 (socket says 172.21.15.50:45324) 2023-12-24T18:52:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f88c406b6c0 0x7f88c41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c884a700 1 -- 172.21.15.50:0/3673490437 learned_addr learned my addr 172.21.15.50:0/3673490437 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c904b700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c406c0c0 0x7f88c40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 -- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c406c0c0 msgr2=0x7f88c40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c406c0c0 0x7f88c40a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 -- 172.21.15.50:0/3673490437 >> v1:172.21.15.50:6789/0 conn(0x7f88c4158cd0 legacy=0x7f88c406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 -- 172.21.15.50:0/3673490437 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40a9070 con 0x7f88c406b6c0 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c37fe700 1 -- 172.21.15.50:0/3673490437 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271851447 0 0) 0x7f88c40a9c80 con 0x7f88c4158cd0 2023-12-24T18:52:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c3fff700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406b6c0 0x7f88c41590a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098e0 tx=0x7f88b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5aecfe7f8ef9f35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c37fe700 1 -- 172.21.15.50:0/3673490437 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000b640 con 0x7f88c406b6c0 2023-12-24T18:52:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c37fe700 1 -- 172.21.15.50:0/3673490437 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000b7a0 con 0x7f88c406b6c0 2023-12-24T18:52:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c37fe700 1 -- 172.21.15.50:0/3673490437 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000bb40 con 0x7f88c406b6c0 2023-12-24T18:52:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 -- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406b6c0 msgr2=0x7f88c41590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406b6c0 0x7f88c41590a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098e0 tx=0x7f88b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 -- 172.21.15.50:0/3673490437 shutdown_connections 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c406c0c0 0x7f88c40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 --2- 172.21.15.50:0/3673490437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406b6c0 0x7f88c41590a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 -- 172.21.15.50:0/3673490437 >> 172.21.15.50:0/3673490437 conn(0x7f88c4067b80 msgr2=0x7f88c40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.797+0000 7f88c984c700 1 -- 172.21.15.50:0/3673490437 shutdown_connections 2023-12-24T18:52:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.801+0000 7f88c984c700 1 -- 172.21.15.50:0/3673490437 wait complete. 2023-12-24T18:52:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.801+0000 7f88c984c700 1 Processor -- start 2023-12-24T18:52:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.801+0000 7f88c984c700 1 -- start start 2023-12-24T18:52:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406c0c0 0x7f88c41692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 0x7f88c4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4156360 con 0x7f88c406b6c0 2023-12-24T18:52:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41590a0 con 0x7f88c406c0c0 2023-12-24T18:52:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4159c20 con 0x7f88c4158cd0 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57868/0 (socket says 172.21.15.50:57868) 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 -- 172.21.15.50:0/4167237452 learned_addr learned my addr 172.21.15.50:0/4167237452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c3fff700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406c0c0 0x7f88c41692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c904b700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 0x7f88c4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 -- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 msgr2=0x7f88c4156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 0x7f88c4156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 -- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406c0c0 msgr2=0x7f88c41692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406c0c0 0x7f88c41692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 -- 172.21.15.50:0/4167237452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b0009420 con 0x7f88c406b6c0 2023-12-24T18:52:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c904b700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 0x7f88c4156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c884a700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c7e0 tx=0x7f88b8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005b30 con 0x7f88c406b6c0 2023-12-24T18:52:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8005c90 con 0x7f88c406b6c0 2023-12-24T18:52:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c41592f0 con 0x7f88c406b6c0 2023-12-24T18:52:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007320 con 0x7f88c406b6c0 2023-12-24T18:52:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.805+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41598b0 con 0x7f88c406b6c0 2023-12-24T18:52:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.809+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c404be40 con 0x7f88c406b6c0 2023-12-24T18:52:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.809+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f88b801b3b0 con 0x7f88c406b6c0 2023-12-24T18:52:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.809+0000 7f88c0ff9700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 0x7f88a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.809+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f88b807bfe0 con 0x7f88c406b6c0 2023-12-24T18:52:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.809+0000 7f88c3fff700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 0x7f88a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.813+0000 7f88c3fff700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 0x7f88a8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f88b00093f0 tx=0x7f88b0017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:03.817+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f88b804c2d0 con 0x7f88c406b6c0 2023-12-24T18:52:04.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.029+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c40ae440 con 0x7f88c406b6c0 2023-12-24T18:52:04.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.029+0000 7f88c0ff9700 1 -- 172.21.15.50:0/4167237452 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f88b804f8f0 con 0x7f88c406b6c0 2023-12-24T18:52:04.033 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 msgr2=0x7f88a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 0x7f88a8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f88b00093f0 tx=0x7f88b0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 msgr2=0x7f88c4146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c7e0 tx=0x7f88b8007df0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 shutdown_connections 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f88a8060550 0x7f88a8062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c4158cd0 0x7f88c4156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c406c0c0 0x7f88c41692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 --2- 172.21.15.50:0/4167237452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88c406b6c0 0x7f88c4146420 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 >> 172.21.15.50:0/4167237452 conn(0x7f88c4067b80 msgr2=0x7f88c40ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 shutdown_connections 2023-12-24T18:52:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.033+0000 7f88c984c700 1 -- 172.21.15.50:0/4167237452 wait complete. 2023-12-24T18:52:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:04.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.221+0000 7f703262e700 1 Processor -- start 2023-12-24T18:52:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f703262e700 1 -- start start 2023-12-24T18:52:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f703262e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f702c159bc0 0x7f702c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f703262e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c06b850 con 0x7f702c0ca110 2023-12-24T18:52:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f703262e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c06ac40 con 0x7f702c06bce0 2023-12-24T18:52:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f703262e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c06af20 con 0x7f702c159bc0 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f702c159bc0 0x7f702c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f702c159bc0 0x7f702c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57882/0 (socket says 172.21.15.50:57882) 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 -- 172.21.15.50:0/2819140853 learned_addr learned my addr 172.21.15.50:0/2819140853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 -- 172.21.15.50:0/2819140853 >> v1:172.21.15.82:6789/0 conn(0x7f702c06bce0 legacy=0x7f702c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 -- 172.21.15.50:0/2819140853 >> v1:172.21.15.50:6789/0 conn(0x7f702c0ca110 legacy=0x7f702c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.225+0000 7f702bfff700 1 -- 172.21.15.50:0/2819140853 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c06b200 con 0x7f702c159bc0 2023-12-24T18:52:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f702bfff700 1 --2- 172.21.15.50:0/2819140853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c159bc0 0x7f702c159f90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f701c009f20 tx=0x7f701c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295af5ac0002b570 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f702affd700 1 -- 172.21.15.50:0/2819140853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00e070 con 0x7f702c159bc0 2023-12-24T18:52:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f702affd700 1 -- 172.21.15.50:0/2819140853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c00ba40 con 0x7f702c159bc0 2023-12-24T18:52:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f702affd700 1 -- 172.21.15.50:0/2819140853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0092e0 con 0x7f702c159bc0 2023-12-24T18:52:04.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 -- 172.21.15.50:0/2819140853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c159bc0 msgr2=0x7f702c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 --2- 172.21.15.50:0/2819140853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c159bc0 0x7f702c159f90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f701c009f20 tx=0x7f701c009840 comp rx=0 tx=0).stop 2023-12-24T18:52:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 -- 172.21.15.50:0/2819140853 shutdown_connections 2023-12-24T18:52:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 --2- 172.21.15.50:0/2819140853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c159bc0 0x7f702c159f90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 -- 172.21.15.50:0/2819140853 >> 172.21.15.50:0/2819140853 conn(0x7f702c0cbba0 msgr2=0x7f702c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 -- 172.21.15.50:0/2819140853 shutdown_connections 2023-12-24T18:52:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.229+0000 7f703262e700 1 -- 172.21.15.50:0/2819140853 wait complete. 2023-12-24T18:52:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 Processor -- start 2023-12-24T18:52:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 -- start start 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 0x7f702c1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f702c159bc0 0x7f702c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c16d7e0 con 0x7f702c06bce0 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0ae500 con 0x7f702c0ca110 2023-12-24T18:52:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f703262e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c16cef0 con 0x7f702c159bc0 2023-12-24T18:52:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f702bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.233+0000 7f702bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57894/0 (socket says 172.21.15.50:57894) 2023-12-24T18:52:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 -- 172.21.15.50:0/2073978067 learned_addr learned my addr 172.21.15.50:0/2073978067 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702b7fe700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 0x7f702c1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f7030bcb700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f702c159bc0 0x7f702c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 -- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f702c159bc0 msgr2=0x7f702c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f702c159bc0 0x7f702c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 -- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 msgr2=0x7f702c1559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 0x7f702c1559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 -- 172.21.15.50:0/2073978067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c009ae0 con 0x7f702c06bce0 2023-12-24T18:52:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702b7fe700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 0x7f702c1559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f702bfff700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f702c069fe0 tx=0x7f701c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c012ae0 con 0x7f702c06bce0 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c012c60 con 0x7f702c06bce0 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c16dc70 con 0x7f702c06bce0 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c01d420 con 0x7f702c06bce0 2023-12-24T18:52:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c16d190 con 0x7f702c06bce0 2023-12-24T18:52:04.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.237+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c0652e0 con 0x7f702c06bce0 2023-12-24T18:52:04.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.241+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f701c01d850 con 0x7f702c06bce0 2023-12-24T18:52:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.241+0000 7f7013fff700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 0x7f7018062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.241+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f701c07e1e0 con 0x7f702c06bce0 2023-12-24T18:52:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.241+0000 7f702b7fe700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 0x7f7018062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.241+0000 7f702b7fe700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 0x7f7018062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7020006fd0 tx=0x7f7020008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.249+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f701c04e510 con 0x7f702c06bce0 2023-12-24T18:52:04.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.421+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f702c06b4e0 con 0x7f702c06bce0 2023-12-24T18:52:04.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.425+0000 7f7013fff700 1 -- 172.21.15.50:0/2073978067 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16082 (secure 0 0 0) 0x7f701c051b30 con 0x7f702c06bce0 2023-12-24T18:52:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:04.428 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:01.545799+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 msgr2=0x7f7018062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 0x7f7018062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7020006fd0 tx=0x7f7020008040 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 msgr2=0x7f702c0ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f702c069fe0 tx=0x7f701c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 shutdown_connections 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7018060550 0x7f7018062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f702c159bc0 0x7f702c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f702c0ca110 0x7f702c1559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 --2- 172.21.15.50:0/2073978067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f702c06bce0 0x7f702c0ade70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 >> 172.21.15.50:0/2073978067 conn(0x7f702c0cbba0 msgr2=0x7f702c0c1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 shutdown_connections 2023-12-24T18:52:04.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.429+0000 7f703262e700 1 -- 172.21.15.50:0/2073978067 wait complete. 2023-12-24T18:52:04.451 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:52:04.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.621+0000 7f4c5826e700 1 Processor -- start 2023-12-24T18:52:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.621+0000 7f4c5826e700 1 -- start start 2023-12-24T18:52:04.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c500c6d00 0x7f4c500c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c50154450 0x7f4c501548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c5006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5006c820 con 0x7f4c50154450 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c50154e10 con 0x7f4c500c6d00 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c5826e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5006b960 con 0x7f4c5006aca0 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.625+0000 7f4c55809700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c50154450 0x7f4c501548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c50154450 0x7f4c501548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57900/0 (socket says 172.21.15.50:57900) 2023-12-24T18:52:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 -- 172.21.15.50:0/301821793 learned_addr learned my addr 172.21.15.50:0/301821793 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:04.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5600a700 1 --2- 172.21.15.50:0/301821793 >> v2:172.21.15.82:3300/0 conn(0x7f4c500c6d00 0x7f4c500c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5680b700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c5006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 -- 172.21.15.50:0/301821793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 msgr2=0x7f4c5006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c5006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 -- 172.21.15.50:0/301821793 >> v2:172.21.15.82:3300/0 conn(0x7f4c500c6d00 msgr2=0x7f4c500c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 --2- 172.21.15.50:0/301821793 >> v2:172.21.15.82:3300/0 conn(0x7f4c500c6d00 0x7f4c500c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 -- 172.21.15.50:0/301821793 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5006bc40 con 0x7f4c50154450 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5680b700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c5006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55809700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c50154450 0x7f4c501548d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4c400099b0 tx=0x7f4c40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420f2d885cb10bab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55008700 1 -- 172.21.15.50:0/301821793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000b820 con 0x7f4c50154450 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55008700 1 -- 172.21.15.50:0/301821793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000b980 con 0x7f4c50154450 2023-12-24T18:52:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c55008700 1 -- 172.21.15.50:0/301821793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000bd20 con 0x7f4c50154450 2023-12-24T18:52:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 -- 172.21.15.50:0/301821793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c50154450 msgr2=0x7f4c501548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c50154450 0x7f4c501548d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4c400099b0 tx=0x7f4c40009250 comp rx=0 tx=0).stop 2023-12-24T18:52:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 -- 172.21.15.50:0/301821793 shutdown_connections 2023-12-24T18:52:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c5006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 --2- 172.21.15.50:0/301821793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c50154450 0x7f4c501548d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 --2- 172.21.15.50:0/301821793 >> v2:172.21.15.82:3300/0 conn(0x7f4c500c6d00 0x7f4c500c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 -- 172.21.15.50:0/301821793 >> 172.21.15.50:0/301821793 conn(0x7f4c500cbba0 msgr2=0x7f4c500cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 -- 172.21.15.50:0/301821793 shutdown_connections 2023-12-24T18:52:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.629+0000 7f4c5826e700 1 -- 172.21.15.50:0/301821793 wait complete. 2023-12-24T18:52:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 Processor -- start 2023-12-24T18:52:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 -- start start 2023-12-24T18:52:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c500b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50154450 0x7f4c500cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500a9680 con 0x7f4c500c6d00 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500a8a70 con 0x7f4c50154450 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5826e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500a8d50 con 0x7f4c5006aca0 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c55809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c55809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57902/0 (socket says 172.21.15.50:57902) 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c55809700 1 -- 172.21.15.50:0/1699904953 learned_addr learned my addr 172.21.15.50:0/1699904953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5600a700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c500b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.633+0000 7f4c5680b700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50154450 0x7f4c500cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 -- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 msgr2=0x7f4c500b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c500b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 -- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50154450 msgr2=0x7f4c500cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50154450 0x7f4c500cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 -- 172.21.15.50:0/1699904953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400094f0 con 0x7f4c500c6d00 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c55809700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4c400094c0 tx=0x7f4c40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011d50 con 0x7f4c500c6d00 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40024440 con 0x7f4c500c6d00 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40024800 con 0x7f4c500c6d00 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c500a9030 con 0x7f4c500c6d00 2023-12-24T18:52:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c500a9d60 con 0x7f4c500c6d00 2023-12-24T18:52:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.637+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500a9830 con 0x7f4c500c6d00 2023-12-24T18:52:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.641+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4c4002d440 con 0x7f4c500c6d00 2023-12-24T18:52:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.641+0000 7f4c467fc700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 0x7f4c34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.641+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f4c4007e400 con 0x7f4c500c6d00 2023-12-24T18:52:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.641+0000 7f4c5600a700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 0x7f4c34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.641+0000 7f4c5600a700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 0x7f4c34062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:04.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.649+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c500a9830 con 0x7f4c500c6d00 2023-12-24T18:52:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.817+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c500afaf0 con 0x7f4c34060550 2023-12-24T18:52:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.837+0000 7f4c467fc700 1 -- 172.21.15.50:0/1699904953 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277341 (secure 0 0 0) 0x7f4c500afaf0 con 0x7f4c34060550 2023-12-24T18:52:04.847 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 msgr2=0x7f4c34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 0x7f4c34062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2023-12-24T18:52:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 msgr2=0x7f4c500ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4c400094c0 tx=0x7f4c40017000 comp rx=0 tx=0).stop 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 shutdown_connections 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f4c34060550 0x7f4c34062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50154450 0x7f4c500cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c500c6d00 0x7f4c500ca740 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 --2- 172.21.15.50:0/1699904953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c5006aca0 0x7f4c500b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 >> 172.21.15.50:0/1699904953 conn(0x7f4c500cbba0 msgr2=0x7f4c500c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 shutdown_connections 2023-12-24T18:52:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:04.849+0000 7f4c5826e700 1 -- 172.21.15.50:0/1699904953 wait complete. 2023-12-24T18:52:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:04.872 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:52:03.535849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591082,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":288,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449764,"kb_used_data":10020,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752524956,"statfs":{"total":773094113280,"available":770585554944,"internally_reserved":0,"allocated":10260480,"data_stored":5732113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":714,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016437"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556788+0000","last_change":"2023-12-24T18:52:00.550465+0000","last_active":"2023-12-24T18:52:00.556788+0000","last_peered":"2023-12-24T18:52:00.556788+0000","last_clean":"2023-12-24T18:52:00.556788+0000","last_became_active":"2023-12-24T18:52:00.548715+0000","last_became_peered":"2023-12-24T18:52:00.548715+0000","last_unstale":"2023-12-24T18:52:00.556788+0000","last_undegraded":"2023-12-24T18:52:00.556788+0000","last_fullsized":"2023-12-24T18:52:00.556788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:21.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558190+0000","last_change":"2023-12-24T18:52:00.549039+0000","last_active":"2023-12-24T18:52:00.558190+0000","last_peered":"2023-12-24T18:52:00.558190+0000","last_clean":"2023-12-24T18:52:00.558190+0000","last_became_active":"2023-12-24T18:52:00.548667+0000","last_became_peered":"2023-12-24T18:52:00.548667+0000","last_unstale":"2023-12-24T18:52:00.558190+0000","last_undegraded":"2023-12-24T18:52:00.558190+0000","last_fullsized":"2023-12-24T18:52:00.558190+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:21.389294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561904+0000","last_change":"2023-12-24T18:52:00.557270+0000","last_active":"2023-12-24T18:52:00.561904+0000","last_peered":"2023-12-24T18:52:00.561904+0000","last_clean":"2023-12-24T18:52:00.561904+0000","last_became_active":"2023-12-24T18:52:00.556889+0000","last_became_peered":"2023-12-24T18:52:00.556889+0000","last_unstale":"2023-12-24T18:52:00.561904+0000","last_undegraded":"2023-12-24T18:52:00.561904+0000","last_fullsized":"2023-12-24T18:52:00.561904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:20.212691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555279+0000","last_change":"2023-12-24T18:52:00.545139+0000","last_active":"2023-12-24T18:52:00.555279+0000","last_peered":"2023-12-24T18:52:00.555279+0000","last_clean":"2023-12-24T18:52:00.555279+0000","last_became_active":"2023-12-24T18:52:00.544719+0000","last_became_peered":"2023-12-24T18:52:00.544719+0000","last_unstale":"2023-12-24T18:52:00.555279+0000","last_undegraded":"2023-12-24T18:52:00.555279+0000","last_fullsized":"2023-12-24T18:52:00.555279+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:51:16.336737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569906+0000","last_change":"2023-12-24T18:52:00.565282+0000","last_active":"2023-12-24T18:52:00.569906+0000","last_peered":"2023-12-24T18:52:00.569906+0000","last_clean":"2023-12-24T18:52:00.569906+0000","last_became_active":"2023-12-24T18:52:00.564944+0000","last_became_peered":"2023-12-24T18:52:00.564944+0000","last_unstale":"2023-12-24T18:52:00.569906+0000","last_undegraded":"2023-12-24T18:52:00.569906+0000","last_fullsized":"2023-12-24T18:52:00.569906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:27.996639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575515+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.575515+0000","last_peered":"2023-12-24T18:52:00.575515+0000","last_clean":"2023-12-24T18:52:00.575515+0000","last_became_active":"2023-12-24T18:52:00.569078+0000","last_became_peered":"2023-12-24T18:52:00.569078+0000","last_unstale":"2023-12-24T18:52:00.575515+0000","last_undegraded":"2023-12-24T18:52:00.575515+0000","last_fullsized":"2023-12-24T18:52:00.575515+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:37.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569886+0000","last_change":"2023-12-24T18:52:00.559981+0000","last_active":"2023-12-24T18:52:00.569886+0000","last_peered":"2023-12-24T18:52:00.569886+0000","last_clean":"2023-12-24T18:52:00.569886+0000","last_became_active":"2023-12-24T18:52:00.559686+0000","last_became_peered":"2023-12-24T18:52:00.559686+0000","last_unstale":"2023-12-24T18:52:00.569886+0000","last_undegraded":"2023-12-24T18:52:00.569886+0000","last_fullsized":"2023-12-24T18:52:00.569886+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:02.653377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.587142+0000","last_change":"2023-12-24T18:51:59.560513+0000","last_active":"2023-12-24T18:52:00.587142+0000","last_peered":"2023-12-24T18:52:00.587142+0000","last_clean":"2023-12-24T18:52:00.587142+0000","last_became_active":"2023-12-24T18:51:59.560225+0000","last_became_peered":"2023-12-24T18:51:59.560225+0000","last_unstale":"2023-12-24T18:52:00.587142+0000","last_undegraded":"2023-12-24T18:52:00.587142+0000","last_fullsized":"2023-12-24T18:52:00.587142+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:56.229203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525759+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:33:17.458263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525727+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:28.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.526077+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:12:08.973767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.521114+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:16:18.396954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528764+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:10.664098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523705+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:44:58.222310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533933+0000","last_change":"2023-12-24T18:51:59.555474+0000","last_active":"2023-12-24T18:52:00.533933+0000","last_peered":"2023-12-24T18:52:00.533933+0000","last_clean":"2023-12-24T18:52:00.533933+0000","last_became_active":"2023-12-24T18:51:59.555176+0000","last_became_peered":"2023-12-24T18:51:59.555176+0000","last_unstale":"2023-12-24T18:52:00.533933+0000","last_undegraded":"2023-12-24T18:52:00.533933+0000","last_fullsized":"2023-12-24T18:52:00.533933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:49.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.526413+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:20.456995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.529229+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:47.748931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584722+0000","last_change":"2023-12-24T18:51:59.563834+0000","last_active":"2023-12-24T18:52:00.584722+0000","last_peered":"2023-12-24T18:52:00.584722+0000","last_clean":"2023-12-24T18:52:00.584722+0000","last_became_active":"2023-12-24T18:51:59.563554+0000","last_became_peered":"2023-12-24T18:51:59.563554+0000","last_unstale":"2023-12-24T18:52:00.584722+0000","last_undegraded":"2023-12-24T18:52:00.584722+0000","last_fullsized":"2023-12-24T18:52:00.584722+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:11.764121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524964+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:20.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528764+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:57.697068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524914+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:59.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533861+0000","last_change":"2023-12-24T18:51:59.559764+0000","last_active":"2023-12-24T18:52:00.533861+0000","last_peered":"2023-12-24T18:52:00.533861+0000","last_clean":"2023-12-24T18:52:00.533861+0000","last_became_active":"2023-12-24T18:51:59.559483+0000","last_became_peered":"2023-12-24T18:51:59.559483+0000","last_unstale":"2023-12-24T18:52:00.533861+0000","last_undegraded":"2023-12-24T18:52:00.533861+0000","last_fullsized":"2023-12-24T18:52:00.533861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:30.523634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523878+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:32:55.404271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524767+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555712+0000","last_change":"2023-12-24T18:52:00.545358+0000","last_active":"2023-12-24T18:52:00.555712+0000","last_peered":"2023-12-24T18:52:00.555712+0000","last_clean":"2023-12-24T18:52:00.555712+0000","last_became_active":"2023-12-24T18:52:00.544226+0000","last_became_peered":"2023-12-24T18:52:00.544226+0000","last_unstale":"2023-12-24T18:52:00.555712+0000","last_undegraded":"2023-12-24T18:52:00.555712+0000","last_fullsized":"2023-12-24T18:52:00.555712+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:20.865731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.521066+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:04.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575534+0000","last_change":"2023-12-24T18:52:00.569871+0000","last_active":"2023-12-24T18:52:00.575534+0000","last_peered":"2023-12-24T18:52:00.575534+0000","last_clean":"2023-12-24T18:52:00.575534+0000","last_became_active":"2023-12-24T18:52:00.569429+0000","last_became_peered":"2023-12-24T18:52:00.569429+0000","last_unstale":"2023-12-24T18:52:00.575534+0000","last_undegraded":"2023-12-24T18:52:00.575534+0000","last_fullsized":"2023-12-24T18:52:00.575534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:47.866668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584375+0000","last_change":"2023-12-24T18:51:59.556434+0000","last_active":"2023-12-24T18:52:00.584375+0000","last_peered":"2023-12-24T18:52:00.584375+0000","last_clean":"2023-12-24T18:52:00.584375+0000","last_became_active":"2023-12-24T18:51:59.555988+0000","last_became_peered":"2023-12-24T18:51:59.555988+0000","last_unstale":"2023-12-24T18:52:00.584375+0000","last_undegraded":"2023-12-24T18:52:00.584375+0000","last_fullsized":"2023-12-24T18:52:00.584375+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.701812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.533706+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.530144+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:52:19.317104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.527960+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:45.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528829+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.529702+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:40.007690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523612+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:27:43.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524649+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:28.870937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524838+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:39.108892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524892+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:26.982508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.535757+0000","last_change":"2023-12-24T18:51:59.561581+0000","last_active":"2023-12-24T18:52:00.535757+0000","last_peered":"2023-12-24T18:52:00.535757+0000","last_clean":"2023-12-24T18:52:00.535757+0000","last_became_active":"2023-12-24T18:51:59.559809+0000","last_became_peered":"2023-12-24T18:51:59.559809+0000","last_unstale":"2023-12-24T18:52:00.535757+0000","last_undegraded":"2023-12-24T18:52:00.535757+0000","last_fullsized":"2023-12-24T18:52:00.535757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:20.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525463+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:55.528917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.534323+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:39.108892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.527831+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:18.058668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":456,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-12-24T18:51:55.529328+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:55.529328+0000","last_peered":"2023-12-24T18:51:55.529328+0000","last_clean":"2023-12-24T18:51:55.529328+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:55.529328+0000","last_undegraded":"2023-12-24T18:51:55.529328+0000","last_fullsized":"2023-12-24T18:51:55.529328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":714,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":1155713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.0209999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.196},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.417}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":1.361},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":1.3899999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":1.51},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.3100000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.145},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.448}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":1.329}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.2849999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306580,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065260,"statfs":{"total":96636764160,"available":96322826240,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.016},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.077}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":1.196},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":1.365}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.145},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.1240000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.238},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":0.871}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.151}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.091},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.745}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":1.042},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.361}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.224}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.3879999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.294},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.319},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.4179999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":1.254}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.159}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.4430000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":1.3360000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.371},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.3979999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":1.202},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.071}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.018},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.4710000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306580,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065260,"statfs":{"total":96636764160,"available":96322826240,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94999999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.071}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.752},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":1.367}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":1.111},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":1.268}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":1.149}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.2110000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310736,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061104,"statfs":{"total":96636764160,"available":96318570496,"internally_reserved":0,"allocated":1187840,"data_stored":593962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.87},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":1.357}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":2.069},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.752}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.843}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.802}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.169}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":0.95999999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.208}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.522},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.778}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.6519999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.798},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.5529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":1155713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.292}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.528}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.1180000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.895}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.6799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:04.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 Processor -- start 2023-12-24T18:52:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 -- start start 2023-12-24T18:52:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc1611b0 0x7f08fc161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08fc06c820 0x7f08fc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc06c4d0 con 0x7f08fc0ae100 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc06c1f0 con 0x7f08fc06c820 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.081+0000 7f0902c0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0ab5e0 con 0x7f08fc1611b0 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08fc06c820 0x7f08fc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0901409700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08fc0ae100 0x7f08fc06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45350/0 (socket says 172.21.15.50:45350) 2023-12-24T18:52:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0901409700 1 -- 172.21.15.50:0/1511142065 learned_addr learned my addr 172.21.15.50:0/1511142065 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0901c0a700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc1611b0 0x7f08fc161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 -- 172.21.15.50:0/1511142065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc1611b0 msgr2=0x7f08fc161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc1611b0 0x7f08fc161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 -- 172.21.15.50:0/1511142065 >> v1:172.21.15.50:6789/0 conn(0x7f08fc0ae100 legacy=0x7f08fc06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 -- 172.21.15.50:0/1511142065 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0ab8c0 con 0x7f08fc06c820 2023-12-24T18:52:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0900c08700 1 -- 172.21.15.50:0/1511142065 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357848654 0 0) 0x7f08ec001110 con 0x7f08fc0ae100 2023-12-24T18:52:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f090240b700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc06c820 0x7f08fc06cc50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009e60 tx=0x7f08f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ddd789e36fa7d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0900c08700 1 -- 172.21.15.50:0/1511142065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400e070 con 0x7f08fc06c820 2023-12-24T18:52:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0900c08700 1 -- 172.21.15.50:0/1511142065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400bb60 con 0x7f08fc06c820 2023-12-24T18:52:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0900c08700 1 -- 172.21.15.50:0/1511142065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4012430 con 0x7f08fc06c820 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 -- 172.21.15.50:0/1511142065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc06c820 msgr2=0x7f08fc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc06c820 0x7f08fc06cc50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009e60 tx=0x7f08f4009780 comp rx=0 tx=0).stop 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 -- 172.21.15.50:0/1511142065 shutdown_connections 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc06c820 0x7f08fc06cc50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1511142065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc1611b0 0x7f08fc161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 -- 172.21.15.50:0/1511142065 >> 172.21.15.50:0/1511142065 conn(0x7f08fc067b80 msgr2=0x7f08fc0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 -- 172.21.15.50:0/1511142065 shutdown_connections 2023-12-24T18:52:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.085+0000 7f0902c0c700 1 -- 172.21.15.50:0/1511142065 wait complete. 2023-12-24T18:52:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 Processor -- start 2023-12-24T18:52:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 -- start start 2023-12-24T18:52:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc06c820 0x7f08fc142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc0ae100 0x7f08fc156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15c450 con 0x7f08fc1611b0 2023-12-24T18:52:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15ef70 con 0x7f08fc0ae100 2023-12-24T18:52:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.089+0000 7f0902c0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15f210 con 0x7f08fc06c820 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57930/0 (socket says 172.21.15.50:57930) 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 -- 172.21.15.50:0/1374339893 learned_addr learned my addr 172.21.15.50:0/1374339893 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f0901409700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc0ae100 0x7f08fc156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f0901c0a700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc06c820 0x7f08fc142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 -- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc06c820 msgr2=0x7f08fc142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc06c820 0x7f08fc142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 -- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc0ae100 msgr2=0x7f08fc156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc0ae100 0x7f08fc156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 -- 172.21.15.50:0/1374339893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009a20 con 0x7f08fc1611b0 2023-12-24T18:52:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f090240b700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0c95c0 tx=0x7f08f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4012ea0 con 0x7f08fc1611b0 2023-12-24T18:52:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4027470 con 0x7f08fc1611b0 2023-12-24T18:52:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc15bbb0 con 0x7f08fc1611b0 2023-12-24T18:52:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4027830 con 0x7f08fc1611b0 2023-12-24T18:52:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.093+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc15c170 con 0x7f08fc1611b0 2023-12-24T18:52:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.097+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc15f380 con 0x7f08fc1611b0 2023-12-24T18:52:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.097+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f08f4024070 con 0x7f08fc1611b0 2023-12-24T18:52:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.097+0000 7f08f1ffb700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 0x7f08e0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.097+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f08f407f200 con 0x7f08fc1611b0 2023-12-24T18:52:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.097+0000 7f0901c0a700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 0x7f08e0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.101+0000 7f0901c0a700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 0x7f08e0062ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08fc1509a0 tx=0x7f08f80091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.105+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f08f404f510 con 0x7f08fc1611b0 2023-12-24T18:52:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.269+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08fc06a840 con 0x7f08e0060620 2023-12-24T18:52:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.285+0000 7f08f1ffb700 1 -- 172.21.15.50:0/1374339893 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277341 (secure 0 0 0) 0x7f08fc06a840 con 0x7f08e0060620 2023-12-24T18:52:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 msgr2=0x7f08e0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 0x7f08e0062ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08fc1509a0 tx=0x7f08f80091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 msgr2=0x7f08fc06ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0c95c0 tx=0x7f08f4019000 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 shutdown_connections 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f08e0060620 0x7f08e0062ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08fc1611b0 0x7f08fc06ae20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc0ae100 0x7f08fc156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 --2- 172.21.15.50:0/1374339893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08fc06c820 0x7f08fc142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 >> 172.21.15.50:0/1374339893 conn(0x7f08fc067b80 msgr2=0x7f08fc150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:05.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 shutdown_connections 2023-12-24T18:52:05.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.293+0000 7f0902c0c700 1 -- 172.21.15.50:0/1374339893 wait complete. 2023-12-24T18:52:05.297 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:05.320 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:52:03.535849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591082,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":288,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449764,"kb_used_data":10020,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752524956,"statfs":{"total":773094113280,"available":770585554944,"internally_reserved":0,"allocated":10260480,"data_stored":5732113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":714,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016437"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556788+0000","last_change":"2023-12-24T18:52:00.550465+0000","last_active":"2023-12-24T18:52:00.556788+0000","last_peered":"2023-12-24T18:52:00.556788+0000","last_clean":"2023-12-24T18:52:00.556788+0000","last_became_active":"2023-12-24T18:52:00.548715+0000","last_became_peered":"2023-12-24T18:52:00.548715+0000","last_unstale":"2023-12-24T18:52:00.556788+0000","last_undegraded":"2023-12-24T18:52:00.556788+0000","last_fullsized":"2023-12-24T18:52:00.556788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:21.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558190+0000","last_change":"2023-12-24T18:52:00.549039+0000","last_active":"2023-12-24T18:52:00.558190+0000","last_peered":"2023-12-24T18:52:00.558190+0000","last_clean":"2023-12-24T18:52:00.558190+0000","last_became_active":"2023-12-24T18:52:00.548667+0000","last_became_peered":"2023-12-24T18:52:00.548667+0000","last_unstale":"2023-12-24T18:52:00.558190+0000","last_undegraded":"2023-12-24T18:52:00.558190+0000","last_fullsized":"2023-12-24T18:52:00.558190+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:21.389294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561904+0000","last_change":"2023-12-24T18:52:00.557270+0000","last_active":"2023-12-24T18:52:00.561904+0000","last_peered":"2023-12-24T18:52:00.561904+0000","last_clean":"2023-12-24T18:52:00.561904+0000","last_became_active":"2023-12-24T18:52:00.556889+0000","last_became_peered":"2023-12-24T18:52:00.556889+0000","last_unstale":"2023-12-24T18:52:00.561904+0000","last_undegraded":"2023-12-24T18:52:00.561904+0000","last_fullsized":"2023-12-24T18:52:00.561904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:20.212691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555279+0000","last_change":"2023-12-24T18:52:00.545139+0000","last_active":"2023-12-24T18:52:00.555279+0000","last_peered":"2023-12-24T18:52:00.555279+0000","last_clean":"2023-12-24T18:52:00.555279+0000","last_became_active":"2023-12-24T18:52:00.544719+0000","last_became_peered":"2023-12-24T18:52:00.544719+0000","last_unstale":"2023-12-24T18:52:00.555279+0000","last_undegraded":"2023-12-24T18:52:00.555279+0000","last_fullsized":"2023-12-24T18:52:00.555279+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:51:16.336737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569906+0000","last_change":"2023-12-24T18:52:00.565282+0000","last_active":"2023-12-24T18:52:00.569906+0000","last_peered":"2023-12-24T18:52:00.569906+0000","last_clean":"2023-12-24T18:52:00.569906+0000","last_became_active":"2023-12-24T18:52:00.564944+0000","last_became_peered":"2023-12-24T18:52:00.564944+0000","last_unstale":"2023-12-24T18:52:00.569906+0000","last_undegraded":"2023-12-24T18:52:00.569906+0000","last_fullsized":"2023-12-24T18:52:00.569906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:27.996639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575515+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.575515+0000","last_peered":"2023-12-24T18:52:00.575515+0000","last_clean":"2023-12-24T18:52:00.575515+0000","last_became_active":"2023-12-24T18:52:00.569078+0000","last_became_peered":"2023-12-24T18:52:00.569078+0000","last_unstale":"2023-12-24T18:52:00.575515+0000","last_undegraded":"2023-12-24T18:52:00.575515+0000","last_fullsized":"2023-12-24T18:52:00.575515+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:37.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569886+0000","last_change":"2023-12-24T18:52:00.559981+0000","last_active":"2023-12-24T18:52:00.569886+0000","last_peered":"2023-12-24T18:52:00.569886+0000","last_clean":"2023-12-24T18:52:00.569886+0000","last_became_active":"2023-12-24T18:52:00.559686+0000","last_became_peered":"2023-12-24T18:52:00.559686+0000","last_unstale":"2023-12-24T18:52:00.569886+0000","last_undegraded":"2023-12-24T18:52:00.569886+0000","last_fullsized":"2023-12-24T18:52:00.569886+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:02.653377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.587142+0000","last_change":"2023-12-24T18:51:59.560513+0000","last_active":"2023-12-24T18:52:00.587142+0000","last_peered":"2023-12-24T18:52:00.587142+0000","last_clean":"2023-12-24T18:52:00.587142+0000","last_became_active":"2023-12-24T18:51:59.560225+0000","last_became_peered":"2023-12-24T18:51:59.560225+0000","last_unstale":"2023-12-24T18:52:00.587142+0000","last_undegraded":"2023-12-24T18:52:00.587142+0000","last_fullsized":"2023-12-24T18:52:00.587142+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:56.229203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525759+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:33:17.458263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525727+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:28.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.526077+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:12:08.973767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.521114+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:16:18.396954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528764+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:10.664098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523705+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:44:58.222310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533933+0000","last_change":"2023-12-24T18:51:59.555474+0000","last_active":"2023-12-24T18:52:00.533933+0000","last_peered":"2023-12-24T18:52:00.533933+0000","last_clean":"2023-12-24T18:52:00.533933+0000","last_became_active":"2023-12-24T18:51:59.555176+0000","last_became_peered":"2023-12-24T18:51:59.555176+0000","last_unstale":"2023-12-24T18:52:00.533933+0000","last_undegraded":"2023-12-24T18:52:00.533933+0000","last_fullsized":"2023-12-24T18:52:00.533933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:49.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.526413+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:20.456995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.529229+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:47.748931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584722+0000","last_change":"2023-12-24T18:51:59.563834+0000","last_active":"2023-12-24T18:52:00.584722+0000","last_peered":"2023-12-24T18:52:00.584722+0000","last_clean":"2023-12-24T18:52:00.584722+0000","last_became_active":"2023-12-24T18:51:59.563554+0000","last_became_peered":"2023-12-24T18:51:59.563554+0000","last_unstale":"2023-12-24T18:52:00.584722+0000","last_undegraded":"2023-12-24T18:52:00.584722+0000","last_fullsized":"2023-12-24T18:52:00.584722+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:11.764121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524964+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:20.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528764+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:57.697068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524914+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:59.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533861+0000","last_change":"2023-12-24T18:51:59.559764+0000","last_active":"2023-12-24T18:52:00.533861+0000","last_peered":"2023-12-24T18:52:00.533861+0000","last_clean":"2023-12-24T18:52:00.533861+0000","last_became_active":"2023-12-24T18:51:59.559483+0000","last_became_peered":"2023-12-24T18:51:59.559483+0000","last_unstale":"2023-12-24T18:52:00.533861+0000","last_undegraded":"2023-12-24T18:52:00.533861+0000","last_fullsized":"2023-12-24T18:52:00.533861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:30.523634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523878+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:32:55.404271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524767+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555712+0000","last_change":"2023-12-24T18:52:00.545358+0000","last_active":"2023-12-24T18:52:00.555712+0000","last_peered":"2023-12-24T18:52:00.555712+0000","last_clean":"2023-12-24T18:52:00.555712+0000","last_became_active":"2023-12-24T18:52:00.544226+0000","last_became_peered":"2023-12-24T18:52:00.544226+0000","last_unstale":"2023-12-24T18:52:00.555712+0000","last_undegraded":"2023-12-24T18:52:00.555712+0000","last_fullsized":"2023-12-24T18:52:00.555712+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:20.865731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.521066+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:04.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575534+0000","last_change":"2023-12-24T18:52:00.569871+0000","last_active":"2023-12-24T18:52:00.575534+0000","last_peered":"2023-12-24T18:52:00.575534+0000","last_clean":"2023-12-24T18:52:00.575534+0000","last_became_active":"2023-12-24T18:52:00.569429+0000","last_became_peered":"2023-12-24T18:52:00.569429+0000","last_unstale":"2023-12-24T18:52:00.575534+0000","last_undegraded":"2023-12-24T18:52:00.575534+0000","last_fullsized":"2023-12-24T18:52:00.575534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:47.866668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584375+0000","last_change":"2023-12-24T18:51:59.556434+0000","last_active":"2023-12-24T18:52:00.584375+0000","last_peered":"2023-12-24T18:52:00.584375+0000","last_clean":"2023-12-24T18:52:00.584375+0000","last_became_active":"2023-12-24T18:51:59.555988+0000","last_became_peered":"2023-12-24T18:51:59.555988+0000","last_unstale":"2023-12-24T18:52:00.584375+0000","last_undegraded":"2023-12-24T18:52:00.584375+0000","last_fullsized":"2023-12-24T18:52:00.584375+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.701812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.533706+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.530144+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:52:19.317104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.527960+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:45.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.528829+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.529702+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:40.007690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.523612+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:27:43.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524649+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:28.870937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524838+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:39.108892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.524892+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:26.982508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.535757+0000","last_change":"2023-12-24T18:51:59.561581+0000","last_active":"2023-12-24T18:52:00.535757+0000","last_peered":"2023-12-24T18:52:00.535757+0000","last_clean":"2023-12-24T18:52:00.535757+0000","last_became_active":"2023-12-24T18:51:59.559809+0000","last_became_peered":"2023-12-24T18:51:59.559809+0000","last_unstale":"2023-12-24T18:52:00.535757+0000","last_undegraded":"2023-12-24T18:52:00.535757+0000","last_fullsized":"2023-12-24T18:52:00.535757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:20.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.525463+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:55.528917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.534323+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:39.108892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:51:59.519750+0000","last_change":"2023-12-24T18:51:59.519750+0000","last_active":"2023-12-24T18:51:59.519750+0000","last_peered":"2023-12-24T18:51:59.519750+0000","last_clean":"2023-12-24T18:51:59.519750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:59.519750+0000","last_undegraded":"2023-12-24T18:51:59.519750+0000","last_fullsized":"2023-12-24T18:51:59.519750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T18:51:58.505618+0000","last_change":"2023-12-24T18:51:58.527831+0000","last_active":"2023-12-24T18:51:58.505618+0000","last_peered":"2023-12-24T18:51:58.505618+0000","last_clean":"2023-12-24T18:51:58.505618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:51:58.505618+0000","last_undegraded":"2023-12-24T18:51:58.505618+0000","last_fullsized":"2023-12-24T18:51:58.505618+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:18.058668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":456,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-12-24T18:51:55.529328+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:51:55.529328+0000","last_peered":"2023-12-24T18:51:55.529328+0000","last_clean":"2023-12-24T18:51:55.529328+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:51:55.529328+0000","last_undegraded":"2023-12-24T18:51:55.529328+0000","last_fullsized":"2023-12-24T18:51:55.529328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":714,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":1155713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.0209999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.196},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.417}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":1.361},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":1.3899999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":1.51},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.3100000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.145},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.448}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":1.329}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.2849999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306580,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065260,"statfs":{"total":96636764160,"available":96322826240,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.242,"15min":1.2529999999999999},"min":{"1min":0.94499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.016},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.319,"15min":1.3220000000000001},"min":{"1min":1.1279999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.077}]},{"osd":1,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1459999999999999,"15min":1.173},"min":{"1min":0.81599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6200000000000001,"5min":1.667,"15min":1.667},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1899999999999999,"15min":1.202},"min":{"1min":0.97199999999999998,"5min":0.78500000000000003,"15min":0.76900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.748},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1559999999999999,"15min":1.1699999999999999},"min":{"1min":0.95599999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":3.609},"last":1.196},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.244,"15min":1.2669999999999999},"min":{"1min":0.88700000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.585,"5min":1.794,"15min":2.0259999999999998},"last":1.365}]},{"osd":3,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2549999999999999,"15min":1.2629999999999999},"min":{"1min":0.96399999999999997,"5min":0.78100000000000003,"15min":0.71199999999999997},"max":{"1min":1.536,"5min":1.6659999999999999,"15min":1.867},"last":1.145},{"interface":"front","average":{"1min":1.389,"5min":1.28,"15min":1.282},"min":{"1min":1.0720000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6499999999999999,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.1240000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.202,"15min":1.226},"min":{"1min":0.92800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.238},{"interface":"front","average":{"1min":1.363,"5min":1.264,"15min":1.2929999999999999},"min":{"1min":0.95899999999999996,"5min":0.68700000000000006,"15min":0.65200000000000002},"max":{"1min":1.6359999999999999,"5min":2.012,"15min":3.0470000000000002},"last":0.871}]},{"osd":5,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1970000000000001,"15min":1.25},"min":{"1min":0.95599999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.2779999999999996},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3400000000000001,"15min":1.367},"min":{"1min":1.145,"5min":0.622,"15min":0.622},"max":{"1min":1.8280000000000001,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:50:54 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3680000000000001,"15min":1.4119999999999999},"min":{"1min":1.1859999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9330000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.4059999999999999},"min":{"1min":0.92400000000000004,"5min":0.80700000000000005,"15min":0.58799999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.151}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.091},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.745}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":1.042},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.361}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.224}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.3879999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.294},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.319},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.4179999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":1.254}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.159}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.4430000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":1.3360000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.371},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.3979999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":1.202},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.071}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.018},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.4710000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306580,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065260,"statfs":{"total":96636764160,"available":96322826240,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94999999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.071}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.752},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":1.367}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":1.111},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":1.268}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":1.149}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.2110000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310736,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061104,"statfs":{"total":96636764160,"available":96318570496,"internally_reserved":0,"allocated":1187840,"data_stored":593962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.87},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":1.357}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":2.069},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.752}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.843}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.802}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":565345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.169}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":0.95999999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.208}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.522},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.778}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.6519999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.798},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.5529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":1155713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.292}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.528}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.1180000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.895}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.6799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:05.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.537+0000 7f1edd5c5700 1 Processor -- start 2023-12-24T18:52:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.537+0000 7f1edd5c5700 1 -- start start 2023-12-24T18:52:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1edd5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed80b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1edd5c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ed80cc780 0x7f1ed81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1edd5c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80cf980 con 0x7f1ed80b4f50 2023-12-24T18:52:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1edd5c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80ccc00 con 0x7f1ed80cc780 2023-12-24T18:52:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1edd5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed806aa10 con 0x7f1ed806a510 2023-12-24T18:52:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed67fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed80b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed6ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ed80b4f50 0x7f1ed8159f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35894/0 (socket says 172.21.15.50:35894) 2023-12-24T18:52:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed6ffd700 1 -- 172.21.15.50:0/2433645764 learned_addr learned my addr 172.21.15.50:0/2433645764 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed77fe700 1 --2- 172.21.15.50:0/2433645764 >> v2:172.21.15.82:3300/0 conn(0x7f1ed80cc780 0x7f1ed81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed5ffb700 1 -- 172.21.15.50:0/2433645764 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293880183 0 0) 0x7f1ed80cf980 con 0x7f1ed80b4f50 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed5ffb700 1 -- 172.21.15.50:0/2433645764 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec0003570 con 0x7f1ed80b4f50 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed67fc700 1 -- 172.21.15.50:0/2433645764 >> v2:172.21.15.82:3300/0 conn(0x7f1ed80cc780 msgr2=0x7f1ed81564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed67fc700 1 --2- 172.21.15.50:0/2433645764 >> v2:172.21.15.82:3300/0 conn(0x7f1ed80cc780 0x7f1ed81564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed67fc700 1 -- 172.21.15.50:0/2433645764 >> v1:172.21.15.82:6789/0 conn(0x7f1ed80b4f50 legacy=0x7f1ed8159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.541+0000 7f1ed67fc700 1 -- 172.21.15.50:0/2433645764 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed806acf0 con 0x7f1ed806a510 2023-12-24T18:52:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1ed67fc700 1 --2- 172.21.15.50:0/2433645764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed80b5320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0098e0 tx=0x7f1ecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e383525af71e1ad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1ed5ffb700 1 -- 172.21.15.50:0/2433645764 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011630 con 0x7f1ed806a510 2023-12-24T18:52:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1ed5ffb700 1 -- 172.21.15.50:0/2433645764 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc011790 con 0x7f1ed806a510 2023-12-24T18:52:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1ed5ffb700 1 -- 172.21.15.50:0/2433645764 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011b30 con 0x7f1ed806a510 2023-12-24T18:52:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 -- 172.21.15.50:0/2433645764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 msgr2=0x7f1ed80b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/2433645764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed80b5320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0098e0 tx=0x7f1ecc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 -- 172.21.15.50:0/2433645764 shutdown_connections 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/2433645764 >> v2:172.21.15.82:3300/0 conn(0x7f1ed80cc780 0x7f1ed81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/2433645764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed80b5320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 -- 172.21.15.50:0/2433645764 >> 172.21.15.50:0/2433645764 conn(0x7f1ed80670b0 msgr2=0x7f1ed8067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 -- 172.21.15.50:0/2433645764 shutdown_connections 2023-12-24T18:52:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.545+0000 7f1edd5c5700 1 -- 172.21.15.50:0/2433645764 wait complete. 2023-12-24T18:52:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 Processor -- start 2023-12-24T18:52:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 -- start start 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed81690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 0x7f1ed8157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8169630 con 0x7f1ed80b4f50 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815abf0 con 0x7f1ed80cc780 2023-12-24T18:52:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1edd5c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815aed0 con 0x7f1ed806a510 2023-12-24T18:52:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 0x7f1ed8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed6ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed81690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57946/0 (socket says 172.21.15.50:57946) 2023-12-24T18:52:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 -- 172.21.15.50:0/176449851 learned_addr learned my addr 172.21.15.50:0/176449851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 -- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 msgr2=0x7f1ed81690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed81690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 -- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 msgr2=0x7f1ed8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 0x7f1ed8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 -- 172.21.15.50:0/176449851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc009420 con 0x7f1ed80b4f50 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed77fe700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 0x7f1ed8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed6ffd700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed81690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.549+0000 7f1ed67fc700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc013000 tx=0x7f1ecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011900 con 0x7f1ed80b4f50 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc011a60 con 0x7f1ed80b4f50 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc025640 con 0x7f1ed80b4f50 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed815cc90 con 0x7f1ed80b4f50 2023-12-24T18:52:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed815d250 con 0x7f1ed80b4f50 2023-12-24T18:52:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.553+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed815b060 con 0x7f1ed80b4f50 2023-12-24T18:52:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.557+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1ecc025a30 con 0x7f1ed80b4f50 2023-12-24T18:52:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.557+0000 7f1ebeffd700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 0x7f1ec4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.557+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f1ecc07e160 con 0x7f1ed80b4f50 2023-12-24T18:52:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.557+0000 7f1ed6ffd700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 0x7f1ec4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.557+0000 7f1ed6ffd700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 0x7f1ec4062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.565+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ecc04e430 con 0x7f1ed80b4f50 2023-12-24T18:52:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.737+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ed804be40 con 0x7f1ec4060580 2023-12-24T18:52:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.753+0000 7f1ebeffd700 1 -- 172.21.15.50:0/176449851 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286667 (secure 0 0 0) 0x7f1ed804be40 con 0x7f1ec4060580 2023-12-24T18:52:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 msgr2=0x7f1ec4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 0x7f1ec4062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).stop 2023-12-24T18:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 msgr2=0x7f1ed8147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc013000 tx=0x7f1ecc017000 comp rx=0 tx=0).stop 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 shutdown_connections 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ec4060580 0x7f1ec4062a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed80cc780 0x7f1ed8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed80b4f50 0x7f1ed8147470 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 --2- 172.21.15.50:0/176449851 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ed806a510 0x7f1ed81690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 >> 172.21.15.50:0/176449851 conn(0x7f1ed80670b0 msgr2=0x7f1ed8158890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 shutdown_connections 2023-12-24T18:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.765+0000 7f1edd5c5700 1 -- 172.21.15.50:0/176449851 wait complete. 2023-12-24T18:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:05.789 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:52:05.536706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450116,"kb_used_data":10372,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752524604,"statfs":{"total":773094113280,"available":770585194496,"internally_reserved":0,"allocated":10620928,"data_stored":5910380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002084"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560376+0000","last_change":"2023-12-24T18:52:00.558063+0000","last_active":"2023-12-24T18:52:00.560376+0000","last_peered":"2023-12-24T18:52:00.560376+0000","last_clean":"2023-12-24T18:52:00.560376+0000","last_became_active":"2023-12-24T18:52:00.557729+0000","last_became_peered":"2023-12-24T18:52:00.557729+0000","last_unstale":"2023-12-24T18:52:00.560376+0000","last_undegraded":"2023-12-24T18:52:00.560376+0000","last_fullsized":"2023-12-24T18:52:00.560376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:26.424669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580239+0000","last_change":"2023-12-24T18:52:00.569504+0000","last_active":"2023-12-24T18:52:00.580239+0000","last_peered":"2023-12-24T18:52:00.580239+0000","last_clean":"2023-12-24T18:52:00.580239+0000","last_became_active":"2023-12-24T18:52:00.568841+0000","last_became_peered":"2023-12-24T18:52:00.568841+0000","last_unstale":"2023-12-24T18:52:00.580239+0000","last_undegraded":"2023-12-24T18:52:00.580239+0000","last_fullsized":"2023-12-24T18:52:00.580239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579355+0000","last_change":"2023-12-24T18:52:00.576740+0000","last_active":"2023-12-24T18:52:00.579355+0000","last_peered":"2023-12-24T18:52:00.579355+0000","last_clean":"2023-12-24T18:52:00.579355+0000","last_became_active":"2023-12-24T18:52:00.576396+0000","last_became_peered":"2023-12-24T18:52:00.576396+0000","last_unstale":"2023-12-24T18:52:00.579355+0000","last_undegraded":"2023-12-24T18:52:00.579355+0000","last_fullsized":"2023-12-24T18:52:00.579355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558034+0000","last_change":"2023-12-24T18:52:00.555455+0000","last_active":"2023-12-24T18:52:00.558034+0000","last_peered":"2023-12-24T18:52:00.558034+0000","last_clean":"2023-12-24T18:52:00.558034+0000","last_became_active":"2023-12-24T18:52:00.555156+0000","last_became_peered":"2023-12-24T18:52:00.555156+0000","last_unstale":"2023-12-24T18:52:00.558034+0000","last_undegraded":"2023-12-24T18:52:00.558034+0000","last_fullsized":"2023-12-24T18:52:00.558034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:46.401166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556788+0000","last_change":"2023-12-24T18:52:00.550465+0000","last_active":"2023-12-24T18:52:00.556788+0000","last_peered":"2023-12-24T18:52:00.556788+0000","last_clean":"2023-12-24T18:52:00.556788+0000","last_became_active":"2023-12-24T18:52:00.548715+0000","last_became_peered":"2023-12-24T18:52:00.548715+0000","last_unstale":"2023-12-24T18:52:00.556788+0000","last_undegraded":"2023-12-24T18:52:00.556788+0000","last_fullsized":"2023-12-24T18:52:00.556788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:21.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576024+0000","last_change":"2023-12-24T18:52:00.561472+0000","last_active":"2023-12-24T18:52:00.576024+0000","last_peered":"2023-12-24T18:52:00.576024+0000","last_clean":"2023-12-24T18:52:00.576024+0000","last_became_active":"2023-12-24T18:52:00.561192+0000","last_became_peered":"2023-12-24T18:52:00.561192+0000","last_unstale":"2023-12-24T18:52:00.576024+0000","last_undegraded":"2023-12-24T18:52:00.576024+0000","last_fullsized":"2023-12-24T18:52:00.576024+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556084+0000","last_change":"2023-12-24T18:52:00.552379+0000","last_active":"2023-12-24T18:52:00.556084+0000","last_peered":"2023-12-24T18:52:00.556084+0000","last_clean":"2023-12-24T18:52:00.556084+0000","last_became_active":"2023-12-24T18:52:00.552096+0000","last_became_peered":"2023-12-24T18:52:00.552096+0000","last_unstale":"2023-12-24T18:52:00.556084+0000","last_undegraded":"2023-12-24T18:52:00.556084+0000","last_fullsized":"2023-12-24T18:52:00.556084+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:21.471127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558190+0000","last_change":"2023-12-24T18:52:00.549039+0000","last_active":"2023-12-24T18:52:00.558190+0000","last_peered":"2023-12-24T18:52:00.558190+0000","last_clean":"2023-12-24T18:52:00.558190+0000","last_became_active":"2023-12-24T18:52:00.548667+0000","last_became_peered":"2023-12-24T18:52:00.548667+0000","last_unstale":"2023-12-24T18:52:00.558190+0000","last_undegraded":"2023-12-24T18:52:00.558190+0000","last_fullsized":"2023-12-24T18:52:00.558190+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:21.389294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563539+0000","last_change":"2023-12-24T18:52:00.558814+0000","last_active":"2023-12-24T18:52:00.563539+0000","last_peered":"2023-12-24T18:52:00.563539+0000","last_clean":"2023-12-24T18:52:00.563539+0000","last_became_active":"2023-12-24T18:52:00.558495+0000","last_became_peered":"2023-12-24T18:52:00.558495+0000","last_unstale":"2023-12-24T18:52:00.563539+0000","last_undegraded":"2023-12-24T18:52:00.563539+0000","last_fullsized":"2023-12-24T18:52:00.563539+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560037+0000","last_change":"2023-12-24T18:52:00.556283+0000","last_active":"2023-12-24T18:52:00.560037+0000","last_peered":"2023-12-24T18:52:00.560037+0000","last_clean":"2023-12-24T18:52:00.560037+0000","last_became_active":"2023-12-24T18:52:00.555540+0000","last_became_peered":"2023-12-24T18:52:00.555540+0000","last_unstale":"2023-12-24T18:52:00.560037+0000","last_undegraded":"2023-12-24T18:52:00.560037+0000","last_fullsized":"2023-12-24T18:52:00.560037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:52.730786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581435+0000","last_change":"2023-12-24T18:52:00.571623+0000","last_active":"2023-12-24T18:52:00.581435+0000","last_peered":"2023-12-24T18:52:00.581435+0000","last_clean":"2023-12-24T18:52:00.581435+0000","last_became_active":"2023-12-24T18:52:00.571367+0000","last_became_peered":"2023-12-24T18:52:00.571367+0000","last_unstale":"2023-12-24T18:52:00.581435+0000","last_undegraded":"2023-12-24T18:52:00.581435+0000","last_fullsized":"2023-12-24T18:52:00.581435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577183+0000","last_change":"2023-12-24T18:52:00.572056+0000","last_active":"2023-12-24T18:52:00.577183+0000","last_peered":"2023-12-24T18:52:00.577183+0000","last_clean":"2023-12-24T18:52:00.577183+0000","last_became_active":"2023-12-24T18:52:00.571638+0000","last_became_peered":"2023-12-24T18:52:00.571638+0000","last_unstale":"2023-12-24T18:52:00.577183+0000","last_undegraded":"2023-12-24T18:52:00.577183+0000","last_fullsized":"2023-12-24T18:52:00.577183+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:36.407352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561904+0000","last_change":"2023-12-24T18:52:00.557270+0000","last_active":"2023-12-24T18:52:00.561904+0000","last_peered":"2023-12-24T18:52:00.561904+0000","last_clean":"2023-12-24T18:52:00.561904+0000","last_became_active":"2023-12-24T18:52:00.556889+0000","last_became_peered":"2023-12-24T18:52:00.556889+0000","last_unstale":"2023-12-24T18:52:00.561904+0000","last_undegraded":"2023-12-24T18:52:00.561904+0000","last_fullsized":"2023-12-24T18:52:00.561904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:20.212691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.566645+0000","last_change":"2023-12-24T18:52:00.557501+0000","last_active":"2023-12-24T18:52:00.566645+0000","last_peered":"2023-12-24T18:52:00.566645+0000","last_clean":"2023-12-24T18:52:00.566645+0000","last_became_active":"2023-12-24T18:52:00.557177+0000","last_became_peered":"2023-12-24T18:52:00.557177+0000","last_unstale":"2023-12-24T18:52:00.566645+0000","last_undegraded":"2023-12-24T18:52:00.566645+0000","last_fullsized":"2023-12-24T18:52:00.566645+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581494+0000","last_change":"2023-12-24T18:52:00.571058+0000","last_active":"2023-12-24T18:52:00.581494+0000","last_peered":"2023-12-24T18:52:00.581494+0000","last_clean":"2023-12-24T18:52:00.581494+0000","last_became_active":"2023-12-24T18:52:00.570595+0000","last_became_peered":"2023-12-24T18:52:00.570595+0000","last_unstale":"2023-12-24T18:52:00.581494+0000","last_undegraded":"2023-12-24T18:52:00.581494+0000","last_fullsized":"2023-12-24T18:52:00.581494+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:23.145352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558690+0000","last_change":"2023-12-24T18:52:00.553062+0000","last_active":"2023-12-24T18:52:00.558690+0000","last_peered":"2023-12-24T18:52:00.558690+0000","last_clean":"2023-12-24T18:52:00.558690+0000","last_became_active":"2023-12-24T18:52:00.552593+0000","last_became_peered":"2023-12-24T18:52:00.552593+0000","last_unstale":"2023-12-24T18:52:00.558690+0000","last_undegraded":"2023-12-24T18:52:00.558690+0000","last_fullsized":"2023-12-24T18:52:00.558690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:44:59.236442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555279+0000","last_change":"2023-12-24T18:52:00.545139+0000","last_active":"2023-12-24T18:52:00.555279+0000","last_peered":"2023-12-24T18:52:00.555279+0000","last_clean":"2023-12-24T18:52:00.555279+0000","last_became_active":"2023-12-24T18:52:00.544719+0000","last_became_peered":"2023-12-24T18:52:00.544719+0000","last_unstale":"2023-12-24T18:52:00.555279+0000","last_undegraded":"2023-12-24T18:52:00.555279+0000","last_fullsized":"2023-12-24T18:52:00.555279+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:51:16.336737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561577+0000","last_change":"2023-12-24T18:52:00.560496+0000","last_active":"2023-12-24T18:52:00.561577+0000","last_peered":"2023-12-24T18:52:00.561577+0000","last_clean":"2023-12-24T18:52:00.561577+0000","last_became_active":"2023-12-24T18:52:00.560160+0000","last_became_peered":"2023-12-24T18:52:00.560160+0000","last_unstale":"2023-12-24T18:52:00.561577+0000","last_undegraded":"2023-12-24T18:52:00.561577+0000","last_fullsized":"2023-12-24T18:52:00.561577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573973+0000","last_change":"2023-12-24T18:52:00.567357+0000","last_active":"2023-12-24T18:52:00.573973+0000","last_peered":"2023-12-24T18:52:00.573973+0000","last_clean":"2023-12-24T18:52:00.573973+0000","last_became_active":"2023-12-24T18:52:00.567065+0000","last_became_peered":"2023-12-24T18:52:00.567065+0000","last_unstale":"2023-12-24T18:52:00.573973+0000","last_undegraded":"2023-12-24T18:52:00.573973+0000","last_fullsized":"2023-12-24T18:52:00.573973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569906+0000","last_change":"2023-12-24T18:52:00.565282+0000","last_active":"2023-12-24T18:52:00.569906+0000","last_peered":"2023-12-24T18:52:00.569906+0000","last_clean":"2023-12-24T18:52:00.569906+0000","last_became_active":"2023-12-24T18:52:00.564944+0000","last_became_peered":"2023-12-24T18:52:00.564944+0000","last_unstale":"2023-12-24T18:52:00.569906+0000","last_undegraded":"2023-12-24T18:52:00.569906+0000","last_fullsized":"2023-12-24T18:52:00.569906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:27.996639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564011+0000","last_change":"2023-12-24T18:52:00.560156+0000","last_active":"2023-12-24T18:52:00.564011+0000","last_peered":"2023-12-24T18:52:00.564011+0000","last_clean":"2023-12-24T18:52:00.564011+0000","last_became_active":"2023-12-24T18:52:00.559835+0000","last_became_peered":"2023-12-24T18:52:00.559835+0000","last_unstale":"2023-12-24T18:52:00.564011+0000","last_undegraded":"2023-12-24T18:52:00.564011+0000","last_fullsized":"2023-12-24T18:52:00.564011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575515+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.575515+0000","last_peered":"2023-12-24T18:52:00.575515+0000","last_clean":"2023-12-24T18:52:00.575515+0000","last_became_active":"2023-12-24T18:52:00.569078+0000","last_became_peered":"2023-12-24T18:52:00.569078+0000","last_unstale":"2023-12-24T18:52:00.575515+0000","last_undegraded":"2023-12-24T18:52:00.575515+0000","last_fullsized":"2023-12-24T18:52:00.575515+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:37.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562883+0000","last_change":"2023-12-24T18:52:00.554636+0000","last_active":"2023-12-24T18:52:00.562883+0000","last_peered":"2023-12-24T18:52:00.562883+0000","last_clean":"2023-12-24T18:52:00.562883+0000","last_became_active":"2023-12-24T18:52:00.554361+0000","last_became_peered":"2023-12-24T18:52:00.554361+0000","last_unstale":"2023-12-24T18:52:00.562883+0000","last_undegraded":"2023-12-24T18:52:00.562883+0000","last_fullsized":"2023-12-24T18:52:00.562883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581456+0000","last_change":"2023-12-24T18:52:00.573300+0000","last_active":"2023-12-24T18:52:00.581456+0000","last_peered":"2023-12-24T18:52:00.581456+0000","last_clean":"2023-12-24T18:52:00.581456+0000","last_became_active":"2023-12-24T18:52:00.573033+0000","last_became_peered":"2023-12-24T18:52:00.573033+0000","last_unstale":"2023-12-24T18:52:00.581456+0000","last_undegraded":"2023-12-24T18:52:00.581456+0000","last_fullsized":"2023-12-24T18:52:00.581456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:06.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583195+0000","last_change":"2023-12-24T18:52:00.578493+0000","last_active":"2023-12-24T18:52:00.583195+0000","last_peered":"2023-12-24T18:52:00.583195+0000","last_clean":"2023-12-24T18:52:00.583195+0000","last_became_active":"2023-12-24T18:52:00.574687+0000","last_became_peered":"2023-12-24T18:52:00.574687+0000","last_unstale":"2023-12-24T18:52:00.583195+0000","last_undegraded":"2023-12-24T18:52:00.583195+0000","last_fullsized":"2023-12-24T18:52:00.583195+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:31.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575109+0000","last_change":"2023-12-24T18:52:00.570902+0000","last_active":"2023-12-24T18:52:00.575109+0000","last_peered":"2023-12-24T18:52:00.575109+0000","last_clean":"2023-12-24T18:52:00.575109+0000","last_became_active":"2023-12-24T18:52:00.570625+0000","last_became_peered":"2023-12-24T18:52:00.570625+0000","last_unstale":"2023-12-24T18:52:00.575109+0000","last_undegraded":"2023-12-24T18:52:00.575109+0000","last_fullsized":"2023-12-24T18:52:00.575109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:19.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558760+0000","last_change":"2023-12-24T18:52:00.555017+0000","last_active":"2023-12-24T18:52:00.558760+0000","last_peered":"2023-12-24T18:52:00.558760+0000","last_clean":"2023-12-24T18:52:00.558760+0000","last_became_active":"2023-12-24T18:52:00.554730+0000","last_became_peered":"2023-12-24T18:52:00.554730+0000","last_unstale":"2023-12-24T18:52:00.558760+0000","last_undegraded":"2023-12-24T18:52:00.558760+0000","last_fullsized":"2023-12-24T18:52:00.558760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:27:44.715738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569886+0000","last_change":"2023-12-24T18:52:00.559981+0000","last_active":"2023-12-24T18:52:00.569886+0000","last_peered":"2023-12-24T18:52:00.569886+0000","last_clean":"2023-12-24T18:52:00.569886+0000","last_became_active":"2023-12-24T18:52:00.559686+0000","last_became_peered":"2023-12-24T18:52:00.559686+0000","last_unstale":"2023-12-24T18:52:00.569886+0000","last_undegraded":"2023-12-24T18:52:00.569886+0000","last_fullsized":"2023-12-24T18:52:00.569886+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:02.653377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579860+0000","last_change":"2023-12-24T18:52:00.563821+0000","last_active":"2023-12-24T18:52:00.579860+0000","last_peered":"2023-12-24T18:52:00.579860+0000","last_clean":"2023-12-24T18:52:00.579860+0000","last_became_active":"2023-12-24T18:52:00.562334+0000","last_became_peered":"2023-12-24T18:52:00.562334+0000","last_unstale":"2023-12-24T18:52:00.579860+0000","last_undegraded":"2023-12-24T18:52:00.579860+0000","last_fullsized":"2023-12-24T18:52:00.579860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:17.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572921+0000","last_change":"2023-12-24T18:52:00.570963+0000","last_active":"2023-12-24T18:52:00.572921+0000","last_peered":"2023-12-24T18:52:00.572921+0000","last_clean":"2023-12-24T18:52:00.572921+0000","last_became_active":"2023-12-24T18:52:00.570636+0000","last_became_peered":"2023-12-24T18:52:00.570636+0000","last_unstale":"2023-12-24T18:52:00.572921+0000","last_undegraded":"2023-12-24T18:52:00.572921+0000","last_fullsized":"2023-12-24T18:52:00.572921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:46.621395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561498+0000","last_change":"2023-12-24T18:52:00.555134+0000","last_active":"2023-12-24T18:52:00.561498+0000","last_peered":"2023-12-24T18:52:00.561498+0000","last_clean":"2023-12-24T18:52:00.561498+0000","last_became_active":"2023-12-24T18:52:00.554827+0000","last_became_peered":"2023-12-24T18:52:00.554827+0000","last_unstale":"2023-12-24T18:52:00.561498+0000","last_undegraded":"2023-12-24T18:52:00.561498+0000","last_fullsized":"2023-12-24T18:52:00.561498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558630+0000","last_change":"2023-12-24T18:52:00.552873+0000","last_active":"2023-12-24T18:52:00.558630+0000","last_peered":"2023-12-24T18:52:00.558630+0000","last_clean":"2023-12-24T18:52:00.558630+0000","last_became_active":"2023-12-24T18:52:00.552192+0000","last_became_peered":"2023-12-24T18:52:00.552192+0000","last_unstale":"2023-12-24T18:52:00.558630+0000","last_undegraded":"2023-12-24T18:52:00.558630+0000","last_fullsized":"2023-12-24T18:52:00.558630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:32:56.418403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571921+0000","last_change":"2023-12-24T18:52:00.568911+0000","last_active":"2023-12-24T18:52:00.571921+0000","last_peered":"2023-12-24T18:52:00.571921+0000","last_clean":"2023-12-24T18:52:00.571921+0000","last_became_active":"2023-12-24T18:52:00.562331+0000","last_became_peered":"2023-12-24T18:52:00.562331+0000","last_unstale":"2023-12-24T18:52:00.571921+0000","last_undegraded":"2023-12-24T18:52:00.571921+0000","last_fullsized":"2023-12-24T18:52:00.571921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.587142+0000","last_change":"2023-12-24T18:51:59.560513+0000","last_active":"2023-12-24T18:52:00.587142+0000","last_peered":"2023-12-24T18:52:00.587142+0000","last_clean":"2023-12-24T18:52:00.587142+0000","last_became_active":"2023-12-24T18:51:59.560225+0000","last_became_peered":"2023-12-24T18:51:59.560225+0000","last_unstale":"2023-12-24T18:52:00.587142+0000","last_undegraded":"2023-12-24T18:52:00.587142+0000","last_fullsized":"2023-12-24T18:52:00.587142+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:56.229203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581366+0000","last_change":"2023-12-24T18:52:00.570854+0000","last_active":"2023-12-24T18:52:00.581366+0000","last_peered":"2023-12-24T18:52:00.581366+0000","last_clean":"2023-12-24T18:52:00.581366+0000","last_became_active":"2023-12-24T18:52:00.570282+0000","last_became_peered":"2023-12-24T18:52:00.570282+0000","last_unstale":"2023-12-24T18:52:00.581366+0000","last_undegraded":"2023-12-24T18:52:00.581366+0000","last_fullsized":"2023-12-24T18:52:00.581366+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578388+0000","last_change":"2023-12-24T18:51:59.562783+0000","last_active":"2023-12-24T18:52:00.578388+0000","last_peered":"2023-12-24T18:52:00.578388+0000","last_clean":"2023-12-24T18:52:00.578388+0000","last_became_active":"2023-12-24T18:51:59.562354+0000","last_became_peered":"2023-12-24T18:51:59.562354+0000","last_unstale":"2023-12-24T18:52:00.578388+0000","last_undegraded":"2023-12-24T18:52:00.578388+0000","last_fullsized":"2023-12-24T18:52:00.578388+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:53:48.820902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563607+0000","last_change":"2023-12-24T18:52:00.559045+0000","last_active":"2023-12-24T18:52:00.563607+0000","last_peered":"2023-12-24T18:52:00.563607+0000","last_clean":"2023-12-24T18:52:00.563607+0000","last_became_active":"2023-12-24T18:52:00.558385+0000","last_became_peered":"2023-12-24T18:52:00.558385+0000","last_unstale":"2023-12-24T18:52:00.563607+0000","last_undegraded":"2023-12-24T18:52:00.563607+0000","last_fullsized":"2023-12-24T18:52:00.563607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580249+0000","last_change":"2023-12-24T18:51:59.567098+0000","last_active":"2023-12-24T18:52:00.580249+0000","last_peered":"2023-12-24T18:52:00.580249+0000","last_clean":"2023-12-24T18:52:00.580249+0000","last_became_active":"2023-12-24T18:51:59.566789+0000","last_became_peered":"2023-12-24T18:51:59.566789+0000","last_unstale":"2023-12-24T18:52:00.580249+0000","last_undegraded":"2023-12-24T18:52:00.580249+0000","last_fullsized":"2023-12-24T18:52:00.580249+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:45.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564242+0000","last_change":"2023-12-24T18:52:00.560666+0000","last_active":"2023-12-24T18:52:00.564242+0000","last_peered":"2023-12-24T18:52:00.564242+0000","last_clean":"2023-12-24T18:52:00.564242+0000","last_became_active":"2023-12-24T18:52:00.560152+0000","last_became_peered":"2023-12-24T18:52:00.560152+0000","last_unstale":"2023-12-24T18:52:00.564242+0000","last_undegraded":"2023-12-24T18:52:00.564242+0000","last_fullsized":"2023-12-24T18:52:00.564242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578726+0000","last_change":"2023-12-24T18:51:59.555189+0000","last_active":"2023-12-24T18:52:00.578726+0000","last_peered":"2023-12-24T18:52:00.578726+0000","last_clean":"2023-12-24T18:52:00.578726+0000","last_became_active":"2023-12-24T18:51:59.554890+0000","last_became_peered":"2023-12-24T18:51:59.554890+0000","last_unstale":"2023-12-24T18:52:00.578726+0000","last_undegraded":"2023-12-24T18:52:00.578726+0000","last_fullsized":"2023-12-24T18:52:00.578726+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:10.472948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577862+0000","last_change":"2023-12-24T18:52:00.565705+0000","last_active":"2023-12-24T18:52:00.577862+0000","last_peered":"2023-12-24T18:52:00.577862+0000","last_clean":"2023-12-24T18:52:00.577862+0000","last_became_active":"2023-12-24T18:52:00.565425+0000","last_became_peered":"2023-12-24T18:52:00.565425+0000","last_unstale":"2023-12-24T18:52:00.577862+0000","last_undegraded":"2023-12-24T18:52:00.577862+0000","last_fullsized":"2023-12-24T18:52:00.577862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578099+0000","last_change":"2023-12-24T18:51:59.557491+0000","last_active":"2023-12-24T18:52:00.578099+0000","last_peered":"2023-12-24T18:52:00.578099+0000","last_clean":"2023-12-24T18:52:00.578099+0000","last_became_active":"2023-12-24T18:51:59.557202+0000","last_became_peered":"2023-12-24T18:51:59.557202+0000","last_unstale":"2023-12-24T18:52:00.578099+0000","last_undegraded":"2023-12-24T18:52:00.578099+0000","last_fullsized":"2023-12-24T18:52:00.578099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:28.870937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571198+0000","last_change":"2023-12-24T18:52:00.564751+0000","last_active":"2023-12-24T18:52:00.571198+0000","last_peered":"2023-12-24T18:52:00.571198+0000","last_clean":"2023-12-24T18:52:00.571198+0000","last_became_active":"2023-12-24T18:52:00.564426+0000","last_became_peered":"2023-12-24T18:52:00.564426+0000","last_unstale":"2023-12-24T18:52:00.571198+0000","last_undegraded":"2023-12-24T18:52:00.571198+0000","last_fullsized":"2023-12-24T18:52:00.571198+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580007+0000","last_change":"2023-12-24T18:51:59.564659+0000","last_active":"2023-12-24T18:52:00.580007+0000","last_peered":"2023-12-24T18:52:00.580007+0000","last_clean":"2023-12-24T18:52:00.580007+0000","last_became_active":"2023-12-24T18:51:59.564138+0000","last_became_peered":"2023-12-24T18:51:59.564138+0000","last_unstale":"2023-12-24T18:52:00.580007+0000","last_undegraded":"2023-12-24T18:52:00.580007+0000","last_fullsized":"2023-12-24T18:52:00.580007+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:23.704122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553008+0000","last_change":"2023-12-24T18:52:00.546644+0000","last_active":"2023-12-24T18:52:00.553008+0000","last_peered":"2023-12-24T18:52:00.553008+0000","last_clean":"2023-12-24T18:52:00.553008+0000","last_became_active":"2023-12-24T18:52:00.546215+0000","last_became_peered":"2023-12-24T18:52:00.546215+0000","last_unstale":"2023-12-24T18:52:00.553008+0000","last_undegraded":"2023-12-24T18:52:00.553008+0000","last_fullsized":"2023-12-24T18:52:00.553008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563629+0000","last_change":"2023-12-24T18:51:59.567933+0000","last_active":"2023-12-24T18:52:00.563629+0000","last_peered":"2023-12-24T18:52:00.563629+0000","last_clean":"2023-12-24T18:52:00.563629+0000","last_became_active":"2023-12-24T18:51:59.565545+0000","last_became_peered":"2023-12-24T18:51:59.565545+0000","last_unstale":"2023-12-24T18:52:00.563629+0000","last_undegraded":"2023-12-24T18:52:00.563629+0000","last_fullsized":"2023-12-24T18:52:00.563629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:25.410537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544015+0000","last_change":"2023-12-24T18:52:00.540551+0000","last_active":"2023-12-24T18:52:00.544015+0000","last_peered":"2023-12-24T18:52:00.544015+0000","last_clean":"2023-12-24T18:52:00.544015+0000","last_became_active":"2023-12-24T18:52:00.540174+0000","last_became_peered":"2023-12-24T18:52:00.540174+0000","last_unstale":"2023-12-24T18:52:00.544015+0000","last_undegraded":"2023-12-24T18:52:00.544015+0000","last_fullsized":"2023-12-24T18:52:00.544015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:46.701428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533933+0000","last_change":"2023-12-24T18:51:59.555474+0000","last_active":"2023-12-24T18:52:00.533933+0000","last_peered":"2023-12-24T18:52:00.533933+0000","last_clean":"2023-12-24T18:52:00.533933+0000","last_became_active":"2023-12-24T18:51:59.555176+0000","last_became_peered":"2023-12-24T18:51:59.555176+0000","last_unstale":"2023-12-24T18:52:00.533933+0000","last_undegraded":"2023-12-24T18:52:00.533933+0000","last_fullsized":"2023-12-24T18:52:00.533933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:49.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573754+0000","last_change":"2023-12-24T18:52:00.563773+0000","last_active":"2023-12-24T18:52:00.573754+0000","last_peered":"2023-12-24T18:52:00.573754+0000","last_clean":"2023-12-24T18:52:00.573754+0000","last_became_active":"2023-12-24T18:52:00.562920+0000","last_became_peered":"2023-12-24T18:52:00.562920+0000","last_unstale":"2023-12-24T18:52:00.573754+0000","last_undegraded":"2023-12-24T18:52:00.573754+0000","last_fullsized":"2023-12-24T18:52:00.573754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:12.838585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545785+0000","last_change":"2023-12-24T18:51:59.565593+0000","last_active":"2023-12-24T18:52:00.545785+0000","last_peered":"2023-12-24T18:52:00.545785+0000","last_clean":"2023-12-24T18:52:00.545785+0000","last_became_active":"2023-12-24T18:51:59.564576+0000","last_became_peered":"2023-12-24T18:51:59.564576+0000","last_unstale":"2023-12-24T18:52:00.545785+0000","last_undegraded":"2023-12-24T18:52:00.545785+0000","last_fullsized":"2023-12-24T18:52:00.545785+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:16:08.803893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.559973+0000","last_change":"2023-12-24T18:52:00.556118+0000","last_active":"2023-12-24T18:52:00.559973+0000","last_peered":"2023-12-24T18:52:00.559973+0000","last_clean":"2023-12-24T18:52:00.559973+0000","last_became_active":"2023-12-24T18:52:00.555483+0000","last_became_peered":"2023-12-24T18:52:00.555483+0000","last_unstale":"2023-12-24T18:52:00.559973+0000","last_undegraded":"2023-12-24T18:52:00.559973+0000","last_fullsized":"2023-12-24T18:52:00.559973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:17.010626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545899+0000","last_change":"2023-12-24T18:51:59.560456+0000","last_active":"2023-12-24T18:52:00.545899+0000","last_peered":"2023-12-24T18:52:00.545899+0000","last_clean":"2023-12-24T18:52:00.545899+0000","last_became_active":"2023-12-24T18:51:59.557516+0000","last_became_peered":"2023-12-24T18:51:59.557516+0000","last_unstale":"2023-12-24T18:52:00.545899+0000","last_undegraded":"2023-12-24T18:52:00.545899+0000","last_fullsized":"2023-12-24T18:52:00.545899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:59.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576047+0000","last_change":"2023-12-24T18:52:00.566554+0000","last_active":"2023-12-24T18:52:00.576047+0000","last_peered":"2023-12-24T18:52:00.576047+0000","last_clean":"2023-12-24T18:52:00.576047+0000","last_became_active":"2023-12-24T18:52:00.565824+0000","last_became_peered":"2023-12-24T18:52:00.565824+0000","last_unstale":"2023-12-24T18:52:00.576047+0000","last_undegraded":"2023-12-24T18:52:00.576047+0000","last_fullsized":"2023-12-24T18:52:00.576047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584722+0000","last_change":"2023-12-24T18:51:59.563834+0000","last_active":"2023-12-24T18:52:00.584722+0000","last_peered":"2023-12-24T18:52:00.584722+0000","last_clean":"2023-12-24T18:52:00.584722+0000","last_became_active":"2023-12-24T18:51:59.563554+0000","last_became_peered":"2023-12-24T18:51:59.563554+0000","last_unstale":"2023-12-24T18:52:00.584722+0000","last_undegraded":"2023-12-24T18:52:00.584722+0000","last_fullsized":"2023-12-24T18:52:00.584722+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:11.764121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571866+0000","last_change":"2023-12-24T18:52:00.568031+0000","last_active":"2023-12-24T18:52:00.571866+0000","last_peered":"2023-12-24T18:52:00.571866+0000","last_clean":"2023-12-24T18:52:00.571866+0000","last_became_active":"2023-12-24T18:52:00.567688+0000","last_became_peered":"2023-12-24T18:52:00.567688+0000","last_unstale":"2023-12-24T18:52:00.571866+0000","last_undegraded":"2023-12-24T18:52:00.571866+0000","last_fullsized":"2023-12-24T18:52:00.571866+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583974+0000","last_change":"2023-12-24T18:51:59.552298+0000","last_active":"2023-12-24T18:52:00.583974+0000","last_peered":"2023-12-24T18:52:00.583974+0000","last_clean":"2023-12-24T18:52:00.583974+0000","last_became_active":"2023-12-24T18:51:59.551849+0000","last_became_peered":"2023-12-24T18:51:59.551849+0000","last_unstale":"2023-12-24T18:52:00.583974+0000","last_undegraded":"2023-12-24T18:52:00.583974+0000","last_fullsized":"2023-12-24T18:52:00.583974+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:34.496851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560444+0000","last_change":"2023-12-24T18:52:00.557935+0000","last_active":"2023-12-24T18:52:00.560444+0000","last_peered":"2023-12-24T18:52:00.560444+0000","last_clean":"2023-12-24T18:52:00.560444+0000","last_became_active":"2023-12-24T18:52:00.557655+0000","last_became_peered":"2023-12-24T18:52:00.557655+0000","last_unstale":"2023-12-24T18:52:00.560444+0000","last_undegraded":"2023-12-24T18:52:00.560444+0000","last_fullsized":"2023-12-24T18:52:00.560444+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:48.707502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580237+0000","last_change":"2023-12-24T18:51:59.564611+0000","last_active":"2023-12-24T18:52:00.580237+0000","last_peered":"2023-12-24T18:52:00.580237+0000","last_clean":"2023-12-24T18:52:00.580237+0000","last_became_active":"2023-12-24T18:51:59.563284+0000","last_became_peered":"2023-12-24T18:51:59.563284+0000","last_unstale":"2023-12-24T18:52:00.580237+0000","last_undegraded":"2023-12-24T18:52:00.580237+0000","last_fullsized":"2023-12-24T18:52:00.580237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:33.688280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564452+0000","last_change":"2023-12-24T18:52:00.561136+0000","last_active":"2023-12-24T18:52:00.564452+0000","last_peered":"2023-12-24T18:52:00.564452+0000","last_clean":"2023-12-24T18:52:00.564452+0000","last_became_active":"2023-12-24T18:52:00.560835+0000","last_became_peered":"2023-12-24T18:52:00.560835+0000","last_unstale":"2023-12-24T18:52:00.564452+0000","last_undegraded":"2023-12-24T18:52:00.564452+0000","last_fullsized":"2023-12-24T18:52:00.564452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:39.818376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541090+0000","last_change":"2023-12-24T18:51:59.563671+0000","last_active":"2023-12-24T18:52:00.541090+0000","last_peered":"2023-12-24T18:52:00.541090+0000","last_clean":"2023-12-24T18:52:00.541090+0000","last_became_active":"2023-12-24T18:51:59.563139+0000","last_became_peered":"2023-12-24T18:51:59.563139+0000","last_unstale":"2023-12-24T18:52:00.541090+0000","last_undegraded":"2023-12-24T18:52:00.541090+0000","last_fullsized":"2023-12-24T18:52:00.541090+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:37.280782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552563+0000","last_change":"2023-12-24T18:52:00.549471+0000","last_active":"2023-12-24T18:52:00.552563+0000","last_peered":"2023-12-24T18:52:00.552563+0000","last_clean":"2023-12-24T18:52:00.552563+0000","last_became_active":"2023-12-24T18:52:00.546256+0000","last_became_peered":"2023-12-24T18:52:00.546256+0000","last_unstale":"2023-12-24T18:52:00.552563+0000","last_undegraded":"2023-12-24T18:52:00.552563+0000","last_fullsized":"2023-12-24T18:52:00.552563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:40.123024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533861+0000","last_change":"2023-12-24T18:51:59.559764+0000","last_active":"2023-12-24T18:52:00.533861+0000","last_peered":"2023-12-24T18:52:00.533861+0000","last_clean":"2023-12-24T18:52:00.533861+0000","last_became_active":"2023-12-24T18:51:59.559483+0000","last_became_peered":"2023-12-24T18:51:59.559483+0000","last_unstale":"2023-12-24T18:52:00.533861+0000","last_undegraded":"2023-12-24T18:52:00.533861+0000","last_fullsized":"2023-12-24T18:52:00.533861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:30.523634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560640+0000","last_change":"2023-12-24T18:52:00.557427+0000","last_active":"2023-12-24T18:52:00.560640+0000","last_peered":"2023-12-24T18:52:00.560640+0000","last_clean":"2023-12-24T18:52:00.560640+0000","last_became_active":"2023-12-24T18:52:00.556754+0000","last_became_peered":"2023-12-24T18:52:00.556754+0000","last_unstale":"2023-12-24T18:52:00.560640+0000","last_undegraded":"2023-12-24T18:52:00.560640+0000","last_fullsized":"2023-12-24T18:52:00.560640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:00.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.590899+0000","last_change":"2023-12-24T18:51:59.559686+0000","last_active":"2023-12-24T18:52:00.590899+0000","last_peered":"2023-12-24T18:52:00.590899+0000","last_clean":"2023-12-24T18:52:00.590899+0000","last_became_active":"2023-12-24T18:51:59.559289+0000","last_became_peered":"2023-12-24T18:51:59.559289+0000","last_unstale":"2023-12-24T18:52:00.590899+0000","last_undegraded":"2023-12-24T18:52:00.590899+0000","last_fullsized":"2023-12-24T18:52:00.590899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:45.999020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.574228+0000","last_change":"2023-12-24T18:52:00.568663+0000","last_active":"2023-12-24T18:52:00.574228+0000","last_peered":"2023-12-24T18:52:00.574228+0000","last_clean":"2023-12-24T18:52:00.574228+0000","last_became_active":"2023-12-24T18:52:00.567550+0000","last_became_peered":"2023-12-24T18:52:00.567550+0000","last_unstale":"2023-12-24T18:52:00.574228+0000","last_undegraded":"2023-12-24T18:52:00.574228+0000","last_fullsized":"2023-12-24T18:52:00.574228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578978+0000","last_change":"2023-12-24T18:51:59.569543+0000","last_active":"2023-12-24T18:52:00.578978+0000","last_peered":"2023-12-24T18:52:00.578978+0000","last_clean":"2023-12-24T18:52:00.578978+0000","last_became_active":"2023-12-24T18:51:59.569232+0000","last_became_peered":"2023-12-24T18:51:59.569232+0000","last_unstale":"2023-12-24T18:52:00.578978+0000","last_undegraded":"2023-12-24T18:52:00.578978+0000","last_fullsized":"2023-12-24T18:52:00.578978+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:10.664098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555712+0000","last_change":"2023-12-24T18:52:00.545358+0000","last_active":"2023-12-24T18:52:00.555712+0000","last_peered":"2023-12-24T18:52:00.555712+0000","last_clean":"2023-12-24T18:52:00.555712+0000","last_became_active":"2023-12-24T18:52:00.544226+0000","last_became_peered":"2023-12-24T18:52:00.544226+0000","last_unstale":"2023-12-24T18:52:00.555712+0000","last_undegraded":"2023-12-24T18:52:00.555712+0000","last_fullsized":"2023-12-24T18:52:00.555712+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:20.865731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579115+0000","last_change":"2023-12-24T18:51:59.562654+0000","last_active":"2023-12-24T18:52:00.579115+0000","last_peered":"2023-12-24T18:52:00.579115+0000","last_clean":"2023-12-24T18:52:00.579115+0000","last_became_active":"2023-12-24T18:51:59.561839+0000","last_became_peered":"2023-12-24T18:51:59.561839+0000","last_unstale":"2023-12-24T18:52:00.579115+0000","last_undegraded":"2023-12-24T18:52:00.579115+0000","last_fullsized":"2023-12-24T18:52:00.579115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575534+0000","last_change":"2023-12-24T18:52:00.569871+0000","last_active":"2023-12-24T18:52:00.575534+0000","last_peered":"2023-12-24T18:52:00.575534+0000","last_clean":"2023-12-24T18:52:00.575534+0000","last_became_active":"2023-12-24T18:52:00.569429+0000","last_became_peered":"2023-12-24T18:52:00.569429+0000","last_unstale":"2023-12-24T18:52:00.575534+0000","last_undegraded":"2023-12-24T18:52:00.575534+0000","last_fullsized":"2023-12-24T18:52:00.575534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:47.866668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584375+0000","last_change":"2023-12-24T18:51:59.556434+0000","last_active":"2023-12-24T18:52:00.584375+0000","last_peered":"2023-12-24T18:52:00.584375+0000","last_clean":"2023-12-24T18:52:00.584375+0000","last_became_active":"2023-12-24T18:51:59.555988+0000","last_became_peered":"2023-12-24T18:51:59.555988+0000","last_unstale":"2023-12-24T18:52:00.584375+0000","last_undegraded":"2023-12-24T18:52:00.584375+0000","last_fullsized":"2023-12-24T18:52:00.584375+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.701812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.568204+0000","last_change":"2023-12-24T18:52:00.563195+0000","last_active":"2023-12-24T18:52:00.568204+0000","last_peered":"2023-12-24T18:52:00.568204+0000","last_clean":"2023-12-24T18:52:00.568204+0000","last_became_active":"2023-12-24T18:52:00.562922+0000","last_became_peered":"2023-12-24T18:52:00.562922+0000","last_unstale":"2023-12-24T18:52:00.568204+0000","last_undegraded":"2023-12-24T18:52:00.568204+0000","last_fullsized":"2023-12-24T18:52:00.568204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547242+0000","last_change":"2023-12-24T18:51:59.567644+0000","last_active":"2023-12-24T18:52:00.547242+0000","last_peered":"2023-12-24T18:52:00.547242+0000","last_clean":"2023-12-24T18:52:00.547242+0000","last_became_active":"2023-12-24T18:51:59.567305+0000","last_became_peered":"2023-12-24T18:51:59.567305+0000","last_unstale":"2023-12-24T18:52:00.547242+0000","last_undegraded":"2023-12-24T18:52:00.547242+0000","last_fullsized":"2023-12-24T18:52:00.547242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:59.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571736+0000","last_change":"2023-12-24T18:52:00.564644+0000","last_active":"2023-12-24T18:52:00.571736+0000","last_peered":"2023-12-24T18:52:00.571736+0000","last_clean":"2023-12-24T18:52:00.571736+0000","last_became_active":"2023-12-24T18:52:00.562736+0000","last_became_peered":"2023-12-24T18:52:00.562736+0000","last_unstale":"2023-12-24T18:52:00.571736+0000","last_undegraded":"2023-12-24T18:52:00.571736+0000","last_fullsized":"2023-12-24T18:52:00.571736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.586345+0000","last_change":"2023-12-24T18:51:59.563318+0000","last_active":"2023-12-24T18:52:00.586345+0000","last_peered":"2023-12-24T18:52:00.586345+0000","last_clean":"2023-12-24T18:52:00.586345+0000","last_became_active":"2023-12-24T18:51:59.563041+0000","last_became_peered":"2023-12-24T18:51:59.563041+0000","last_unstale":"2023-12-24T18:52:00.586345+0000","last_undegraded":"2023-12-24T18:52:00.586345+0000","last_fullsized":"2023-12-24T18:52:00.586345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:02.933403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580259+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.580259+0000","last_peered":"2023-12-24T18:52:00.580259+0000","last_clean":"2023-12-24T18:52:00.580259+0000","last_became_active":"2023-12-24T18:52:00.569136+0000","last_became_peered":"2023-12-24T18:52:00.569136+0000","last_unstale":"2023-12-24T18:52:00.580259+0000","last_undegraded":"2023-12-24T18:52:00.580259+0000","last_fullsized":"2023-12-24T18:52:00.580259+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:54.262839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547939+0000","last_change":"2023-12-24T18:51:59.562274+0000","last_active":"2023-12-24T18:52:00.547939+0000","last_peered":"2023-12-24T18:52:00.547939+0000","last_clean":"2023-12-24T18:52:00.547939+0000","last_became_active":"2023-12-24T18:51:59.561873+0000","last_became_peered":"2023-12-24T18:51:59.561873+0000","last_unstale":"2023-12-24T18:52:00.547939+0000","last_undegraded":"2023-12-24T18:52:00.547939+0000","last_fullsized":"2023-12-24T18:52:00.547939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:15.751745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560734+0000","last_change":"2023-12-24T18:52:00.558328+0000","last_active":"2023-12-24T18:52:00.560734+0000","last_peered":"2023-12-24T18:52:00.560734+0000","last_clean":"2023-12-24T18:52:00.560734+0000","last_became_active":"2023-12-24T18:52:00.557968+0000","last_became_peered":"2023-12-24T18:52:00.557968+0000","last_unstale":"2023-12-24T18:52:00.560734+0000","last_undegraded":"2023-12-24T18:52:00.560734+0000","last_fullsized":"2023-12-24T18:52:00.560734+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:33:18.472395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547647+0000","last_change":"2023-12-24T18:51:59.565291+0000","last_active":"2023-12-24T18:52:00.547647+0000","last_peered":"2023-12-24T18:52:00.547647+0000","last_clean":"2023-12-24T18:52:00.547647+0000","last_became_active":"2023-12-24T18:51:59.565011+0000","last_became_peered":"2023-12-24T18:51:59.565011+0000","last_unstale":"2023-12-24T18:52:00.547647+0000","last_undegraded":"2023-12-24T18:52:00.547647+0000","last_fullsized":"2023-12-24T18:52:00.547647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:41.268461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.551315+0000","last_change":"2023-12-24T18:52:00.541779+0000","last_active":"2023-12-24T18:52:00.551315+0000","last_peered":"2023-12-24T18:52:00.551315+0000","last_clean":"2023-12-24T18:52:00.551315+0000","last_became_active":"2023-12-24T18:52:00.541478+0000","last_became_peered":"2023-12-24T18:52:00.541478+0000","last_unstale":"2023-12-24T18:52:00.551315+0000","last_undegraded":"2023-12-24T18:52:00.551315+0000","last_fullsized":"2023-12-24T18:52:00.551315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:11.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578326+0000","last_change":"2023-12-24T18:51:59.561838+0000","last_active":"2023-12-24T18:52:00.578326+0000","last_peered":"2023-12-24T18:52:00.578326+0000","last_clean":"2023-12-24T18:52:00.578326+0000","last_became_active":"2023-12-24T18:51:59.561517+0000","last_became_peered":"2023-12-24T18:51:59.561517+0000","last_unstale":"2023-12-24T18:52:00.578326+0000","last_undegraded":"2023-12-24T18:52:00.578326+0000","last_fullsized":"2023-12-24T18:52:00.578326+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:31.948199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552526+0000","last_change":"2023-12-24T18:52:00.548971+0000","last_active":"2023-12-24T18:52:00.552526+0000","last_peered":"2023-12-24T18:52:00.552526+0000","last_clean":"2023-12-24T18:52:00.552526+0000","last_became_active":"2023-12-24T18:52:00.548657+0000","last_became_peered":"2023-12-24T18:52:00.548657+0000","last_unstale":"2023-12-24T18:52:00.552526+0000","last_undegraded":"2023-12-24T18:52:00.552526+0000","last_fullsized":"2023-12-24T18:52:00.552526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:53.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.566735+0000","last_change":"2023-12-24T18:51:59.566224+0000","last_active":"2023-12-24T18:52:00.566735+0000","last_peered":"2023-12-24T18:52:00.566735+0000","last_clean":"2023-12-24T18:52:00.566735+0000","last_became_active":"2023-12-24T18:51:59.565918+0000","last_became_peered":"2023-12-24T18:51:59.565918+0000","last_unstale":"2023-12-24T18:52:00.566735+0000","last_undegraded":"2023-12-24T18:52:00.566735+0000","last_fullsized":"2023-12-24T18:52:00.566735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.607263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562776+0000","last_change":"2023-12-24T18:52:00.553610+0000","last_active":"2023-12-24T18:52:00.562776+0000","last_peered":"2023-12-24T18:52:00.562776+0000","last_clean":"2023-12-24T18:52:00.562776+0000","last_became_active":"2023-12-24T18:52:00.553340+0000","last_became_peered":"2023-12-24T18:52:00.553340+0000","last_unstale":"2023-12-24T18:52:00.562776+0000","last_undegraded":"2023-12-24T18:52:00.562776+0000","last_fullsized":"2023-12-24T18:52:00.562776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544682+0000","last_change":"2023-12-24T18:51:59.565113+0000","last_active":"2023-12-24T18:52:00.544682+0000","last_peered":"2023-12-24T18:52:00.544682+0000","last_clean":"2023-12-24T18:52:00.544682+0000","last_became_active":"2023-12-24T18:51:59.564760+0000","last_became_peered":"2023-12-24T18:51:59.564760+0000","last_unstale":"2023-12-24T18:52:00.544682+0000","last_undegraded":"2023-12-24T18:52:00.544682+0000","last_fullsized":"2023-12-24T18:52:00.544682+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:00.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573848+0000","last_change":"2023-12-24T18:52:00.563547+0000","last_active":"2023-12-24T18:52:00.573848+0000","last_peered":"2023-12-24T18:52:00.573848+0000","last_clean":"2023-12-24T18:52:00.573848+0000","last_became_active":"2023-12-24T18:52:00.563170+0000","last_became_peered":"2023-12-24T18:52:00.563170+0000","last_unstale":"2023-12-24T18:52:00.573848+0000","last_undegraded":"2023-12-24T18:52:00.573848+0000","last_fullsized":"2023-12-24T18:52:00.573848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:07.005934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541426+0000","last_change":"2023-12-24T18:51:59.562638+0000","last_active":"2023-12-24T18:52:00.541426+0000","last_peered":"2023-12-24T18:52:00.541426+0000","last_clean":"2023-12-24T18:52:00.541426+0000","last_became_active":"2023-12-24T18:51:59.562343+0000","last_became_peered":"2023-12-24T18:51:59.562343+0000","last_unstale":"2023-12-24T18:52:00.541426+0000","last_undegraded":"2023-12-24T18:52:00.541426+0000","last_fullsized":"2023-12-24T18:52:00.541426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:38.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553042+0000","last_change":"2023-12-24T18:52:00.549045+0000","last_active":"2023-12-24T18:52:00.553042+0000","last_peered":"2023-12-24T18:52:00.553042+0000","last_clean":"2023-12-24T18:52:00.553042+0000","last_became_active":"2023-12-24T18:52:00.548766+0000","last_became_peered":"2023-12-24T18:52:00.548766+0000","last_unstale":"2023-12-24T18:52:00.553042+0000","last_undegraded":"2023-12-24T18:52:00.553042+0000","last_fullsized":"2023-12-24T18:52:00.553042+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:29.885069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533318+0000","last_change":"2023-12-24T18:51:59.558150+0000","last_active":"2023-12-24T18:52:00.533318+0000","last_peered":"2023-12-24T18:52:00.533318+0000","last_clean":"2023-12-24T18:52:00.533318+0000","last_became_active":"2023-12-24T18:51:59.557796+0000","last_became_peered":"2023-12-24T18:51:59.557796+0000","last_unstale":"2023-12-24T18:52:00.533318+0000","last_undegraded":"2023-12-24T18:52:00.533318+0000","last_fullsized":"2023-12-24T18:52:00.533318+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:21:27.849190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.557046+0000","last_change":"2023-12-24T18:52:00.554275+0000","last_active":"2023-12-24T18:52:00.557046+0000","last_peered":"2023-12-24T18:52:00.557046+0000","last_clean":"2023-12-24T18:52:00.557046+0000","last_became_active":"2023-12-24T18:52:00.553218+0000","last_became_peered":"2023-12-24T18:52:00.553218+0000","last_unstale":"2023-12-24T18:52:00.557046+0000","last_undegraded":"2023-12-24T18:52:00.557046+0000","last_fullsized":"2023-12-24T18:52:00.557046+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:29.884462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.535757+0000","last_change":"2023-12-24T18:51:59.561581+0000","last_active":"2023-12-24T18:52:00.535757+0000","last_peered":"2023-12-24T18:52:00.535757+0000","last_clean":"2023-12-24T18:52:00.535757+0000","last_became_active":"2023-12-24T18:51:59.559809+0000","last_became_peered":"2023-12-24T18:51:59.559809+0000","last_unstale":"2023-12-24T18:52:00.535757+0000","last_undegraded":"2023-12-24T18:52:00.535757+0000","last_fullsized":"2023-12-24T18:52:00.535757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:20.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572125+0000","last_change":"2023-12-24T18:52:00.571033+0000","last_active":"2023-12-24T18:52:00.572125+0000","last_peered":"2023-12-24T18:52:00.572125+0000","last_clean":"2023-12-24T18:52:00.572125+0000","last_became_active":"2023-12-24T18:52:00.570672+0000","last_became_peered":"2023-12-24T18:52:00.570672+0000","last_unstale":"2023-12-24T18:52:00.572125+0000","last_undegraded":"2023-12-24T18:52:00.572125+0000","last_fullsized":"2023-12-24T18:52:00.572125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.537177+0000","last_change":"2023-12-24T18:51:59.552749+0000","last_active":"2023-12-24T18:52:00.537177+0000","last_peered":"2023-12-24T18:52:00.537177+0000","last_clean":"2023-12-24T18:52:00.537177+0000","last_became_active":"2023-12-24T18:51:59.552333+0000","last_became_peered":"2023-12-24T18:51:59.552333+0000","last_unstale":"2023-12-24T18:52:00.537177+0000","last_undegraded":"2023-12-24T18:52:00.537177+0000","last_fullsized":"2023-12-24T18:52:00.537177+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:42.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569740+0000","last_change":"2023-12-24T18:52:00.565285+0000","last_active":"2023-12-24T18:52:00.569740+0000","last_peered":"2023-12-24T18:52:00.569740+0000","last_clean":"2023-12-24T18:52:00.569740+0000","last_became_active":"2023-12-24T18:52:00.561876+0000","last_became_peered":"2023-12-24T18:52:00.561876+0000","last_unstale":"2023-12-24T18:52:00.569740+0000","last_undegraded":"2023-12-24T18:52:00.569740+0000","last_fullsized":"2023-12-24T18:52:00.569740+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.546993+0000","last_change":"2023-12-24T18:51:59.568249+0000","last_active":"2023-12-24T18:52:00.546993+0000","last_peered":"2023-12-24T18:52:00.546993+0000","last_clean":"2023-12-24T18:52:00.546993+0000","last_became_active":"2023-12-24T18:51:59.565524+0000","last_became_peered":"2023-12-24T18:51:59.565524+0000","last_unstale":"2023-12-24T18:52:00.546993+0000","last_undegraded":"2023-12-24T18:52:00.546993+0000","last_fullsized":"2023-12-24T18:52:00.546993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:28.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564200+0000","last_change":"2023-12-24T18:52:00.562853+0000","last_active":"2023-12-24T18:52:00.564200+0000","last_peered":"2023-12-24T18:52:00.564200+0000","last_clean":"2023-12-24T18:52:00.564200+0000","last_became_active":"2023-12-24T18:52:00.562558+0000","last_became_peered":"2023-12-24T18:52:00.562558+0000","last_unstale":"2023-12-24T18:52:00.564200+0000","last_undegraded":"2023-12-24T18:52:00.564200+0000","last_fullsized":"2023-12-24T18:52:00.564200+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:47.013152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552006+0000","last_change":"2023-12-24T18:51:59.556251+0000","last_active":"2023-12-24T18:52:00.552006+0000","last_peered":"2023-12-24T18:52:00.552006+0000","last_clean":"2023-12-24T18:52:00.552006+0000","last_became_active":"2023-12-24T18:51:59.555893+0000","last_became_peered":"2023-12-24T18:51:59.555893+0000","last_unstale":"2023-12-24T18:52:00.552006+0000","last_undegraded":"2023-12-24T18:52:00.552006+0000","last_fullsized":"2023-12-24T18:52:00.552006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:34.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":459,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541591+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:52:00.541591+0000","last_peered":"2023-12-24T18:52:00.541591+0000","last_clean":"2023-12-24T18:52:00.541591+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:52:00.541591+0000","last_undegraded":"2023-12-24T18:52:00.541591+0000","last_fullsized":"2023-12-24T18:52:00.541591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311308,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060532,"statfs":{"total":96636764160,"available":96317984768,"internally_reserved":0,"allocated":1773568,"data_stored":1183638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.304}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.131},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.081}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":0.752},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":0.95299999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.3819999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.194}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":0.89200000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.357},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.3320000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306640,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065200,"statfs":{"total":96636764160,"available":96322764800,"internally_reserved":0,"allocated":1187840,"data_stored":594784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6220000000000001,"5min":1.788,"15min":1.788},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4159999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1279999999999999,"15min":1.1599999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6060000000000001,"5min":1.667,"15min":1.667},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2050000000000001,"15min":1.1990000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.599,"5min":1.7390000000000001,"15min":1.748},"last":1.2090000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1499999999999999,"15min":1.1659999999999999},"min":{"1min":0.72899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4610000000000001,"5min":1.542,"15min":3.609},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.232,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.5640000000000001,"5min":1.794,"15min":2.0259999999999998},"last":1.175}]},{"osd":3,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2509999999999999,"15min":1.26},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.655,"5min":1.6659999999999999,"15min":1.867},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":0.73799999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"max":{"1min":1.4330000000000001,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.3009999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1870000000000001,"15min":1.202},"min":{"1min":0.67300000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.5129999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.274,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.65200000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.0470000000000002},"last":0.89100000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.2,"15min":1.2290000000000001},"min":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":4.2779999999999996},"last":0.997},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3320000000000001,"15min":1.351},"min":{"1min":0.85999999999999999,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":1.669,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.2609999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3740000000000001,"15min":1.3919999999999999},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.73999999999999999},"max":{"1min":1.9950000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.052},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":0.97599999999999998,"5min":0.80800000000000005,"15min":0.58799999999999997},"max":{"1min":1.536,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":586298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":1},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.089}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.89700000000000002}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.036}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.125},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.81499999999999995}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.173},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.155},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.2609999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302552,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069288,"statfs":{"total":96636764160,"available":96326950912,"internally_reserved":0,"allocated":1196032,"data_stored":594888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.752}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":0.87}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.101},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1799999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.0169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":586818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":3.4260000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":5.0700000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":2.4580000000000002},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":3.5089999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":2.363},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":4.0019999999999998}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":6.8289999999999997},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":2.944}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":2.516},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":6.6589999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":5.4400000000000004},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":5.8970000000000002}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":5.3380000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":5.3070000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310736,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061104,"statfs":{"total":96636764160,"available":96318570496,"internally_reserved":0,"allocated":1187840,"data_stored":593962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.87},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":1.357}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":2.069},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.752}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.843}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.802}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302528,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069312,"statfs":{"total":96636764160,"available":96326975488,"internally_reserved":0,"allocated":1171456,"data_stored":586376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.502}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.351},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.655}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.4510000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.601},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.28}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.403},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.3009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307208,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064632,"statfs":{"total":96636764160,"available":96322183168,"internally_reserved":0,"allocated":1769472,"data_stored":1183616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.3899999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":1.107},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.2290000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.593}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.706}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.454},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.7470000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.79},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.345}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:05.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T18:52:05.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 Processor -- start 2023-12-24T18:52:05.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 -- start start 2023-12-24T18:52:06.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1afc06a5c0 0x7f1afc0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc0b3fe0 0x7f1afc0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0cc870 con 0x7f1afc158d40 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc06b490 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b02ee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc06b730 con 0x7f1afc06a5c0 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:05.997+0000 7f1b026e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc0b3fe0 0x7f1afc0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc0b3fe0 0x7f1afc0cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57958/0 (socket says 172.21.15.50:57958) 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 -- 172.21.15.50:0/4017927796 learned_addr learned my addr 172.21.15.50:0/4017927796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b016e0700 1 --2- 172.21.15.50:0/4017927796 >> v2:172.21.15.82:3300/0 conn(0x7f1afc06a5c0 0x7f1afc0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 -- 172.21.15.50:0/4017927796 >> v2:172.21.15.82:3300/0 conn(0x7f1afc06a5c0 msgr2=0x7f1afc0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:06.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 --2- 172.21.15.50:0/4017927796 >> v2:172.21.15.82:3300/0 conn(0x7f1afc06a5c0 0x7f1afc0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 -- 172.21.15.50:0/4017927796 >> v1:172.21.15.82:6789/0 conn(0x7f1afc158d40 legacy=0x7f1afc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 -- 172.21.15.50:0/4017927796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc06ba10 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b026e2700 1 --2- 172.21.15.50:0/4017927796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc0b3fe0 0x7f1afc0cd240 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1afc068090 tx=0x7f1af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f92b5051720fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b00edf700 1 -- 172.21.15.50:0/4017927796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4009e70 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b00edf700 1 -- 172.21.15.50:0/4017927796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af400b860 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b00edf700 1 -- 172.21.15.50:0/4017927796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400bc00 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 -- 172.21.15.50:0/4017927796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc0b3fe0 msgr2=0x7f1afc0cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/4017927796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc0b3fe0 0x7f1afc0cd240 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1afc068090 tx=0x7f1af4009250 comp rx=0 tx=0).stop 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 -- 172.21.15.50:0/4017927796 shutdown_connections 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/4017927796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc0b3fe0 0x7f1afc0cd240 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/4017927796 >> v2:172.21.15.82:3300/0 conn(0x7f1afc06a5c0 0x7f1afc0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 -- 172.21.15.50:0/4017927796 >> 172.21.15.50:0/4017927796 conn(0x7f1afc067b70 msgr2=0x7f1afc0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:06.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 -- 172.21.15.50:0/4017927796 shutdown_connections 2023-12-24T18:52:06.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.001+0000 7f1b02ee3700 1 -- 172.21.15.50:0/4017927796 wait complete. 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 Processor -- start 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 -- start start 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1afc0b3fe0 0x7f1afc0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1afc158d40 0x7f1afc0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8b60 con 0x7f1afc06a5c0 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8e40 con 0x7f1afc158d40 2023-12-24T18:52:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b02ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0cbcf0 con 0x7f1afc0b3fe0 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b01ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b01ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57972/0 (socket says 172.21.15.50:57972) 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.005+0000 7f1b01ee1700 1 -- 172.21.15.50:0/3309919113 learned_addr learned my addr 172.21.15.50:0/3309919113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b016e0700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1afc0b3fe0 0x7f1afc0c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b026e2700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1afc158d40 0x7f1afc0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 -- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1afc0b3fe0 msgr2=0x7f1afc0c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1afc0b3fe0 0x7f1afc0c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 -- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1afc158d40 msgr2=0x7f1afc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1afc158d40 0x7f1afc0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 -- 172.21.15.50:0/3309919113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40094f0 con 0x7f1afc06a5c0 2023-12-24T18:52:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b01ee1700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c910 tx=0x7f1af8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8012630 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af80127b0 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc0cbfd0 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8012b70 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc156170 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.009+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc04be40 con 0x7f1afc06a5c0 2023-12-24T18:52:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.013+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1af8003030 con 0x7f1afc06a5c0 2023-12-24T18:52:06.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.013+0000 7f1af1ffb700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 0x7f1ae0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.013+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f1af807ca80 con 0x7f1afc06a5c0 2023-12-24T18:52:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.013+0000 7f1b016e0700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 0x7f1ae0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.013+0000 7f1b016e0700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 0x7f1ae0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1afc159e70 tx=0x7f1aec0091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.021+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1af804cd10 con 0x7f1afc06a5c0 2023-12-24T18:52:06.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.253+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1afc06bcf0 con 0x7f1afc06a5c0 2023-12-24T18:52:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.253+0000 7f1af1ffb700 1 -- 172.21.15.50:0/3309919113 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7f1af8050330 con 0x7f1afc06a5c0 2023-12-24T18:52:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":962,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":96,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2508918784,"bytes_avail":770585194496,"bytes_total":773094113280,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":44,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6834}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-24T18:50:22.405110+0000","services":{}},"progress_events":{}} 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 msgr2=0x7f1ae0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 0x7f1ae0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1afc159e70 tx=0x7f1aec0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 msgr2=0x7f1afc155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c910 tx=0x7f1af8001710 comp rx=0 tx=0).stop 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 shutdown_connections 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f1ae0060550 0x7f1ae0062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1afc158d40 0x7f1afc0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1afc0b3fe0 0x7f1afc0c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 --2- 172.21.15.50:0/3309919113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc06a5c0 0x7f1afc155c30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 >> 172.21.15.50:0/3309919113 conn(0x7f1afc067b70 msgr2=0x7f1afc15d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 shutdown_connections 2023-12-24T18:52:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.261+0000 7f1b02ee3700 1 -- 172.21.15.50:0/3309919113 wait complete. 2023-12-24T18:52:06.283 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T18:52:06.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.441+0000 7f40cf59e700 1 Processor -- start 2023-12-24T18:52:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.441+0000 7f40cf59e700 1 -- start start 2023-12-24T18:52:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 0x7f40d00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cf59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40d006c820 0x7f40d00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cf59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00b0460 con 0x7f40d00adc90 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cf59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006d8c0 con 0x7f40d006c820 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cf59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00afc60 con 0x7f40d015a2d0 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40ce59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 0x7f40d00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40d006c820 0x7f40d00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40d006c820 0x7f40d00ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:37982/0 (socket says 172.21.15.50:37982) 2023-12-24T18:52:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 -- 172.21.15.50:0/250772763 learned_addr learned my addr 172.21.15.50:0/250772763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 -- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 msgr2=0x7f40d00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 0x7f40d00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 -- 172.21.15.50:0/250772763 >> v1:172.21.15.82:6789/0 conn(0x7f40d00adc90 legacy=0x7f40d00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 -- 172.21.15.50:0/250772763 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00ae100 con 0x7f40d006c820 2023-12-24T18:52:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40ce59c700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 0x7f40d00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d006c820 0x7f40d00ad750 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f40c40099b0 tx=0x7f40c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcce7c76bd97bcf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cd59a700 1 -- 172.21.15.50:0/250772763 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4009ea0 con 0x7f40d006c820 2023-12-24T18:52:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cd59a700 1 -- 172.21.15.50:0/250772763 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400b860 con 0x7f40d006c820 2023-12-24T18:52:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.445+0000 7f40cd59a700 1 -- 172.21.15.50:0/250772763 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400bc00 con 0x7f40d006c820 2023-12-24T18:52:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 -- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d006c820 msgr2=0x7f40d00ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d006c820 0x7f40d00ad750 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f40c40099b0 tx=0x7f40c4009250 comp rx=0 tx=0).stop 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 -- 172.21.15.50:0/250772763 shutdown_connections 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d006c820 0x7f40d00ad750 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 --2- 172.21.15.50:0/250772763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d015a2d0 0x7f40d00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 -- 172.21.15.50:0/250772763 >> 172.21.15.50:0/250772763 conn(0x7f40d0067b80 msgr2=0x7f40d00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 -- 172.21.15.50:0/250772763 shutdown_connections 2023-12-24T18:52:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 -- 172.21.15.50:0/250772763 wait complete. 2023-12-24T18:52:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.449+0000 7f40cf59e700 1 Processor -- start 2023-12-24T18:52:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 -- start start 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d006c820 0x7f40d0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 0x7f40d015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015c560 con 0x7f40d015a2d0 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015be10 con 0x7f40d00adc90 2023-12-24T18:52:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cf59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015b870 con 0x7f40d006c820 2023-12-24T18:52:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40ced9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40ced9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57986/0 (socket says 172.21.15.50:57986) 2023-12-24T18:52:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40ced9d700 1 -- 172.21.15.50:0/1826911099 learned_addr learned my addr 172.21.15.50:0/1826911099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40ce59c700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d006c820 0x7f40d0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 0x7f40d015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 -- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d006c820 msgr2=0x7f40d0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d006c820 0x7f40d0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 -- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 msgr2=0x7f40d00a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 -- 172.21.15.50:0/1826911099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009420 con 0x7f40d00adc90 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40ced9d700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.453+0000 7f40cdd9b700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 0x7f40d015c020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f40d006a390 tx=0x7f40c4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4000d10 con 0x7f40d00adc90 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400bbe0 con 0x7f40d00adc90 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011650 con 0x7f40d00adc90 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40094f0 con 0x7f40d00adc90 2023-12-24T18:52:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00a4670 con 0x7f40d00adc90 2023-12-24T18:52:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.457+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d004be40 con 0x7f40d00adc90 2023-12-24T18:52:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.461+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f40c4011a80 con 0x7f40d00adc90 2023-12-24T18:52:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.461+0000 7f40be7fc700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 0x7f40b0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.461+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f40c407dee0 con 0x7f40d00adc90 2023-12-24T18:52:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.461+0000 7f40ce59c700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 0x7f40b0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.465+0000 7f40ce59c700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 0x7f40b0062ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009ea0 tx=0x7f40c00091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:06.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.469+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f40c404e270 con 0x7f40d00adc90 2023-12-24T18:52:06.520 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-12-24T18:52:06.517+0000 7f7c28688700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:52:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.645+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40d0065040 con 0x7f40b0060620 2023-12-24T18:52:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.661+0000 7f40be7fc700 1 -- 172.21.15.50:0/1826911099 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286667 (secure 0 0 0) 0x7f40d0065040 con 0x7f40b0060620 2023-12-24T18:52:06.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 msgr2=0x7f40b0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 0x7f40b0062ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009ea0 tx=0x7f40c00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 msgr2=0x7f40d015c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 0x7f40d015c020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f40d006a390 tx=0x7f40c4017000 comp rx=0 tx=0).stop 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 shutdown_connections 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f40b0060620 0x7f40b0062ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d015a2d0 0x7f40d00a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d00adc90 0x7f40d015c020 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 --2- 172.21.15.50:0/1826911099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40d006c820 0x7f40d0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 >> 172.21.15.50:0/1826911099 conn(0x7f40d0067b80 msgr2=0x7f40d0154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 shutdown_connections 2023-12-24T18:52:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:06.669+0000 7f40cf59e700 1 -- 172.21.15.50:0/1826911099 wait complete. 2023-12-24T18:52:06.673 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:06.695 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:52:05.536706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450116,"kb_used_data":10372,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752524604,"statfs":{"total":773094113280,"available":770585194496,"internally_reserved":0,"allocated":10620928,"data_stored":5910380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002084"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560376+0000","last_change":"2023-12-24T18:52:00.558063+0000","last_active":"2023-12-24T18:52:00.560376+0000","last_peered":"2023-12-24T18:52:00.560376+0000","last_clean":"2023-12-24T18:52:00.560376+0000","last_became_active":"2023-12-24T18:52:00.557729+0000","last_became_peered":"2023-12-24T18:52:00.557729+0000","last_unstale":"2023-12-24T18:52:00.560376+0000","last_undegraded":"2023-12-24T18:52:00.560376+0000","last_fullsized":"2023-12-24T18:52:00.560376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:26.424669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580239+0000","last_change":"2023-12-24T18:52:00.569504+0000","last_active":"2023-12-24T18:52:00.580239+0000","last_peered":"2023-12-24T18:52:00.580239+0000","last_clean":"2023-12-24T18:52:00.580239+0000","last_became_active":"2023-12-24T18:52:00.568841+0000","last_became_peered":"2023-12-24T18:52:00.568841+0000","last_unstale":"2023-12-24T18:52:00.580239+0000","last_undegraded":"2023-12-24T18:52:00.580239+0000","last_fullsized":"2023-12-24T18:52:00.580239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579355+0000","last_change":"2023-12-24T18:52:00.576740+0000","last_active":"2023-12-24T18:52:00.579355+0000","last_peered":"2023-12-24T18:52:00.579355+0000","last_clean":"2023-12-24T18:52:00.579355+0000","last_became_active":"2023-12-24T18:52:00.576396+0000","last_became_peered":"2023-12-24T18:52:00.576396+0000","last_unstale":"2023-12-24T18:52:00.579355+0000","last_undegraded":"2023-12-24T18:52:00.579355+0000","last_fullsized":"2023-12-24T18:52:00.579355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558034+0000","last_change":"2023-12-24T18:52:00.555455+0000","last_active":"2023-12-24T18:52:00.558034+0000","last_peered":"2023-12-24T18:52:00.558034+0000","last_clean":"2023-12-24T18:52:00.558034+0000","last_became_active":"2023-12-24T18:52:00.555156+0000","last_became_peered":"2023-12-24T18:52:00.555156+0000","last_unstale":"2023-12-24T18:52:00.558034+0000","last_undegraded":"2023-12-24T18:52:00.558034+0000","last_fullsized":"2023-12-24T18:52:00.558034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:46.401166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556788+0000","last_change":"2023-12-24T18:52:00.550465+0000","last_active":"2023-12-24T18:52:00.556788+0000","last_peered":"2023-12-24T18:52:00.556788+0000","last_clean":"2023-12-24T18:52:00.556788+0000","last_became_active":"2023-12-24T18:52:00.548715+0000","last_became_peered":"2023-12-24T18:52:00.548715+0000","last_unstale":"2023-12-24T18:52:00.556788+0000","last_undegraded":"2023-12-24T18:52:00.556788+0000","last_fullsized":"2023-12-24T18:52:00.556788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:21.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576024+0000","last_change":"2023-12-24T18:52:00.561472+0000","last_active":"2023-12-24T18:52:00.576024+0000","last_peered":"2023-12-24T18:52:00.576024+0000","last_clean":"2023-12-24T18:52:00.576024+0000","last_became_active":"2023-12-24T18:52:00.561192+0000","last_became_peered":"2023-12-24T18:52:00.561192+0000","last_unstale":"2023-12-24T18:52:00.576024+0000","last_undegraded":"2023-12-24T18:52:00.576024+0000","last_fullsized":"2023-12-24T18:52:00.576024+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556084+0000","last_change":"2023-12-24T18:52:00.552379+0000","last_active":"2023-12-24T18:52:00.556084+0000","last_peered":"2023-12-24T18:52:00.556084+0000","last_clean":"2023-12-24T18:52:00.556084+0000","last_became_active":"2023-12-24T18:52:00.552096+0000","last_became_peered":"2023-12-24T18:52:00.552096+0000","last_unstale":"2023-12-24T18:52:00.556084+0000","last_undegraded":"2023-12-24T18:52:00.556084+0000","last_fullsized":"2023-12-24T18:52:00.556084+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:21.471127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558190+0000","last_change":"2023-12-24T18:52:00.549039+0000","last_active":"2023-12-24T18:52:00.558190+0000","last_peered":"2023-12-24T18:52:00.558190+0000","last_clean":"2023-12-24T18:52:00.558190+0000","last_became_active":"2023-12-24T18:52:00.548667+0000","last_became_peered":"2023-12-24T18:52:00.548667+0000","last_unstale":"2023-12-24T18:52:00.558190+0000","last_undegraded":"2023-12-24T18:52:00.558190+0000","last_fullsized":"2023-12-24T18:52:00.558190+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:21.389294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563539+0000","last_change":"2023-12-24T18:52:00.558814+0000","last_active":"2023-12-24T18:52:00.563539+0000","last_peered":"2023-12-24T18:52:00.563539+0000","last_clean":"2023-12-24T18:52:00.563539+0000","last_became_active":"2023-12-24T18:52:00.558495+0000","last_became_peered":"2023-12-24T18:52:00.558495+0000","last_unstale":"2023-12-24T18:52:00.563539+0000","last_undegraded":"2023-12-24T18:52:00.563539+0000","last_fullsized":"2023-12-24T18:52:00.563539+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560037+0000","last_change":"2023-12-24T18:52:00.556283+0000","last_active":"2023-12-24T18:52:00.560037+0000","last_peered":"2023-12-24T18:52:00.560037+0000","last_clean":"2023-12-24T18:52:00.560037+0000","last_became_active":"2023-12-24T18:52:00.555540+0000","last_became_peered":"2023-12-24T18:52:00.555540+0000","last_unstale":"2023-12-24T18:52:00.560037+0000","last_undegraded":"2023-12-24T18:52:00.560037+0000","last_fullsized":"2023-12-24T18:52:00.560037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:52.730786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581435+0000","last_change":"2023-12-24T18:52:00.571623+0000","last_active":"2023-12-24T18:52:00.581435+0000","last_peered":"2023-12-24T18:52:00.581435+0000","last_clean":"2023-12-24T18:52:00.581435+0000","last_became_active":"2023-12-24T18:52:00.571367+0000","last_became_peered":"2023-12-24T18:52:00.571367+0000","last_unstale":"2023-12-24T18:52:00.581435+0000","last_undegraded":"2023-12-24T18:52:00.581435+0000","last_fullsized":"2023-12-24T18:52:00.581435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577183+0000","last_change":"2023-12-24T18:52:00.572056+0000","last_active":"2023-12-24T18:52:00.577183+0000","last_peered":"2023-12-24T18:52:00.577183+0000","last_clean":"2023-12-24T18:52:00.577183+0000","last_became_active":"2023-12-24T18:52:00.571638+0000","last_became_peered":"2023-12-24T18:52:00.571638+0000","last_unstale":"2023-12-24T18:52:00.577183+0000","last_undegraded":"2023-12-24T18:52:00.577183+0000","last_fullsized":"2023-12-24T18:52:00.577183+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:36.407352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561904+0000","last_change":"2023-12-24T18:52:00.557270+0000","last_active":"2023-12-24T18:52:00.561904+0000","last_peered":"2023-12-24T18:52:00.561904+0000","last_clean":"2023-12-24T18:52:00.561904+0000","last_became_active":"2023-12-24T18:52:00.556889+0000","last_became_peered":"2023-12-24T18:52:00.556889+0000","last_unstale":"2023-12-24T18:52:00.561904+0000","last_undegraded":"2023-12-24T18:52:00.561904+0000","last_fullsized":"2023-12-24T18:52:00.561904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:20.212691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.566645+0000","last_change":"2023-12-24T18:52:00.557501+0000","last_active":"2023-12-24T18:52:00.566645+0000","last_peered":"2023-12-24T18:52:00.566645+0000","last_clean":"2023-12-24T18:52:00.566645+0000","last_became_active":"2023-12-24T18:52:00.557177+0000","last_became_peered":"2023-12-24T18:52:00.557177+0000","last_unstale":"2023-12-24T18:52:00.566645+0000","last_undegraded":"2023-12-24T18:52:00.566645+0000","last_fullsized":"2023-12-24T18:52:00.566645+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581494+0000","last_change":"2023-12-24T18:52:00.571058+0000","last_active":"2023-12-24T18:52:00.581494+0000","last_peered":"2023-12-24T18:52:00.581494+0000","last_clean":"2023-12-24T18:52:00.581494+0000","last_became_active":"2023-12-24T18:52:00.570595+0000","last_became_peered":"2023-12-24T18:52:00.570595+0000","last_unstale":"2023-12-24T18:52:00.581494+0000","last_undegraded":"2023-12-24T18:52:00.581494+0000","last_fullsized":"2023-12-24T18:52:00.581494+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:23.145352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558690+0000","last_change":"2023-12-24T18:52:00.553062+0000","last_active":"2023-12-24T18:52:00.558690+0000","last_peered":"2023-12-24T18:52:00.558690+0000","last_clean":"2023-12-24T18:52:00.558690+0000","last_became_active":"2023-12-24T18:52:00.552593+0000","last_became_peered":"2023-12-24T18:52:00.552593+0000","last_unstale":"2023-12-24T18:52:00.558690+0000","last_undegraded":"2023-12-24T18:52:00.558690+0000","last_fullsized":"2023-12-24T18:52:00.558690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:44:59.236442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555279+0000","last_change":"2023-12-24T18:52:00.545139+0000","last_active":"2023-12-24T18:52:00.555279+0000","last_peered":"2023-12-24T18:52:00.555279+0000","last_clean":"2023-12-24T18:52:00.555279+0000","last_became_active":"2023-12-24T18:52:00.544719+0000","last_became_peered":"2023-12-24T18:52:00.544719+0000","last_unstale":"2023-12-24T18:52:00.555279+0000","last_undegraded":"2023-12-24T18:52:00.555279+0000","last_fullsized":"2023-12-24T18:52:00.555279+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:51:16.336737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561577+0000","last_change":"2023-12-24T18:52:00.560496+0000","last_active":"2023-12-24T18:52:00.561577+0000","last_peered":"2023-12-24T18:52:00.561577+0000","last_clean":"2023-12-24T18:52:00.561577+0000","last_became_active":"2023-12-24T18:52:00.560160+0000","last_became_peered":"2023-12-24T18:52:00.560160+0000","last_unstale":"2023-12-24T18:52:00.561577+0000","last_undegraded":"2023-12-24T18:52:00.561577+0000","last_fullsized":"2023-12-24T18:52:00.561577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573973+0000","last_change":"2023-12-24T18:52:00.567357+0000","last_active":"2023-12-24T18:52:00.573973+0000","last_peered":"2023-12-24T18:52:00.573973+0000","last_clean":"2023-12-24T18:52:00.573973+0000","last_became_active":"2023-12-24T18:52:00.567065+0000","last_became_peered":"2023-12-24T18:52:00.567065+0000","last_unstale":"2023-12-24T18:52:00.573973+0000","last_undegraded":"2023-12-24T18:52:00.573973+0000","last_fullsized":"2023-12-24T18:52:00.573973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569906+0000","last_change":"2023-12-24T18:52:00.565282+0000","last_active":"2023-12-24T18:52:00.569906+0000","last_peered":"2023-12-24T18:52:00.569906+0000","last_clean":"2023-12-24T18:52:00.569906+0000","last_became_active":"2023-12-24T18:52:00.564944+0000","last_became_peered":"2023-12-24T18:52:00.564944+0000","last_unstale":"2023-12-24T18:52:00.569906+0000","last_undegraded":"2023-12-24T18:52:00.569906+0000","last_fullsized":"2023-12-24T18:52:00.569906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:27.996639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564011+0000","last_change":"2023-12-24T18:52:00.560156+0000","last_active":"2023-12-24T18:52:00.564011+0000","last_peered":"2023-12-24T18:52:00.564011+0000","last_clean":"2023-12-24T18:52:00.564011+0000","last_became_active":"2023-12-24T18:52:00.559835+0000","last_became_peered":"2023-12-24T18:52:00.559835+0000","last_unstale":"2023-12-24T18:52:00.564011+0000","last_undegraded":"2023-12-24T18:52:00.564011+0000","last_fullsized":"2023-12-24T18:52:00.564011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575515+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.575515+0000","last_peered":"2023-12-24T18:52:00.575515+0000","last_clean":"2023-12-24T18:52:00.575515+0000","last_became_active":"2023-12-24T18:52:00.569078+0000","last_became_peered":"2023-12-24T18:52:00.569078+0000","last_unstale":"2023-12-24T18:52:00.575515+0000","last_undegraded":"2023-12-24T18:52:00.575515+0000","last_fullsized":"2023-12-24T18:52:00.575515+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:37.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562883+0000","last_change":"2023-12-24T18:52:00.554636+0000","last_active":"2023-12-24T18:52:00.562883+0000","last_peered":"2023-12-24T18:52:00.562883+0000","last_clean":"2023-12-24T18:52:00.562883+0000","last_became_active":"2023-12-24T18:52:00.554361+0000","last_became_peered":"2023-12-24T18:52:00.554361+0000","last_unstale":"2023-12-24T18:52:00.562883+0000","last_undegraded":"2023-12-24T18:52:00.562883+0000","last_fullsized":"2023-12-24T18:52:00.562883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581456+0000","last_change":"2023-12-24T18:52:00.573300+0000","last_active":"2023-12-24T18:52:00.581456+0000","last_peered":"2023-12-24T18:52:00.581456+0000","last_clean":"2023-12-24T18:52:00.581456+0000","last_became_active":"2023-12-24T18:52:00.573033+0000","last_became_peered":"2023-12-24T18:52:00.573033+0000","last_unstale":"2023-12-24T18:52:00.581456+0000","last_undegraded":"2023-12-24T18:52:00.581456+0000","last_fullsized":"2023-12-24T18:52:00.581456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:06.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583195+0000","last_change":"2023-12-24T18:52:00.578493+0000","last_active":"2023-12-24T18:52:00.583195+0000","last_peered":"2023-12-24T18:52:00.583195+0000","last_clean":"2023-12-24T18:52:00.583195+0000","last_became_active":"2023-12-24T18:52:00.574687+0000","last_became_peered":"2023-12-24T18:52:00.574687+0000","last_unstale":"2023-12-24T18:52:00.583195+0000","last_undegraded":"2023-12-24T18:52:00.583195+0000","last_fullsized":"2023-12-24T18:52:00.583195+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:31.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575109+0000","last_change":"2023-12-24T18:52:00.570902+0000","last_active":"2023-12-24T18:52:00.575109+0000","last_peered":"2023-12-24T18:52:00.575109+0000","last_clean":"2023-12-24T18:52:00.575109+0000","last_became_active":"2023-12-24T18:52:00.570625+0000","last_became_peered":"2023-12-24T18:52:00.570625+0000","last_unstale":"2023-12-24T18:52:00.575109+0000","last_undegraded":"2023-12-24T18:52:00.575109+0000","last_fullsized":"2023-12-24T18:52:00.575109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:19.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558760+0000","last_change":"2023-12-24T18:52:00.555017+0000","last_active":"2023-12-24T18:52:00.558760+0000","last_peered":"2023-12-24T18:52:00.558760+0000","last_clean":"2023-12-24T18:52:00.558760+0000","last_became_active":"2023-12-24T18:52:00.554730+0000","last_became_peered":"2023-12-24T18:52:00.554730+0000","last_unstale":"2023-12-24T18:52:00.558760+0000","last_undegraded":"2023-12-24T18:52:00.558760+0000","last_fullsized":"2023-12-24T18:52:00.558760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:27:44.715738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569886+0000","last_change":"2023-12-24T18:52:00.559981+0000","last_active":"2023-12-24T18:52:00.569886+0000","last_peered":"2023-12-24T18:52:00.569886+0000","last_clean":"2023-12-24T18:52:00.569886+0000","last_became_active":"2023-12-24T18:52:00.559686+0000","last_became_peered":"2023-12-24T18:52:00.559686+0000","last_unstale":"2023-12-24T18:52:00.569886+0000","last_undegraded":"2023-12-24T18:52:00.569886+0000","last_fullsized":"2023-12-24T18:52:00.569886+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:02.653377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579860+0000","last_change":"2023-12-24T18:52:00.563821+0000","last_active":"2023-12-24T18:52:00.579860+0000","last_peered":"2023-12-24T18:52:00.579860+0000","last_clean":"2023-12-24T18:52:00.579860+0000","last_became_active":"2023-12-24T18:52:00.562334+0000","last_became_peered":"2023-12-24T18:52:00.562334+0000","last_unstale":"2023-12-24T18:52:00.579860+0000","last_undegraded":"2023-12-24T18:52:00.579860+0000","last_fullsized":"2023-12-24T18:52:00.579860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:17.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572921+0000","last_change":"2023-12-24T18:52:00.570963+0000","last_active":"2023-12-24T18:52:00.572921+0000","last_peered":"2023-12-24T18:52:00.572921+0000","last_clean":"2023-12-24T18:52:00.572921+0000","last_became_active":"2023-12-24T18:52:00.570636+0000","last_became_peered":"2023-12-24T18:52:00.570636+0000","last_unstale":"2023-12-24T18:52:00.572921+0000","last_undegraded":"2023-12-24T18:52:00.572921+0000","last_fullsized":"2023-12-24T18:52:00.572921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:46.621395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561498+0000","last_change":"2023-12-24T18:52:00.555134+0000","last_active":"2023-12-24T18:52:00.561498+0000","last_peered":"2023-12-24T18:52:00.561498+0000","last_clean":"2023-12-24T18:52:00.561498+0000","last_became_active":"2023-12-24T18:52:00.554827+0000","last_became_peered":"2023-12-24T18:52:00.554827+0000","last_unstale":"2023-12-24T18:52:00.561498+0000","last_undegraded":"2023-12-24T18:52:00.561498+0000","last_fullsized":"2023-12-24T18:52:00.561498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558630+0000","last_change":"2023-12-24T18:52:00.552873+0000","last_active":"2023-12-24T18:52:00.558630+0000","last_peered":"2023-12-24T18:52:00.558630+0000","last_clean":"2023-12-24T18:52:00.558630+0000","last_became_active":"2023-12-24T18:52:00.552192+0000","last_became_peered":"2023-12-24T18:52:00.552192+0000","last_unstale":"2023-12-24T18:52:00.558630+0000","last_undegraded":"2023-12-24T18:52:00.558630+0000","last_fullsized":"2023-12-24T18:52:00.558630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:32:56.418403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571921+0000","last_change":"2023-12-24T18:52:00.568911+0000","last_active":"2023-12-24T18:52:00.571921+0000","last_peered":"2023-12-24T18:52:00.571921+0000","last_clean":"2023-12-24T18:52:00.571921+0000","last_became_active":"2023-12-24T18:52:00.562331+0000","last_became_peered":"2023-12-24T18:52:00.562331+0000","last_unstale":"2023-12-24T18:52:00.571921+0000","last_undegraded":"2023-12-24T18:52:00.571921+0000","last_fullsized":"2023-12-24T18:52:00.571921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.587142+0000","last_change":"2023-12-24T18:51:59.560513+0000","last_active":"2023-12-24T18:52:00.587142+0000","last_peered":"2023-12-24T18:52:00.587142+0000","last_clean":"2023-12-24T18:52:00.587142+0000","last_became_active":"2023-12-24T18:51:59.560225+0000","last_became_peered":"2023-12-24T18:51:59.560225+0000","last_unstale":"2023-12-24T18:52:00.587142+0000","last_undegraded":"2023-12-24T18:52:00.587142+0000","last_fullsized":"2023-12-24T18:52:00.587142+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:56.229203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581366+0000","last_change":"2023-12-24T18:52:00.570854+0000","last_active":"2023-12-24T18:52:00.581366+0000","last_peered":"2023-12-24T18:52:00.581366+0000","last_clean":"2023-12-24T18:52:00.581366+0000","last_became_active":"2023-12-24T18:52:00.570282+0000","last_became_peered":"2023-12-24T18:52:00.570282+0000","last_unstale":"2023-12-24T18:52:00.581366+0000","last_undegraded":"2023-12-24T18:52:00.581366+0000","last_fullsized":"2023-12-24T18:52:00.581366+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578388+0000","last_change":"2023-12-24T18:51:59.562783+0000","last_active":"2023-12-24T18:52:00.578388+0000","last_peered":"2023-12-24T18:52:00.578388+0000","last_clean":"2023-12-24T18:52:00.578388+0000","last_became_active":"2023-12-24T18:51:59.562354+0000","last_became_peered":"2023-12-24T18:51:59.562354+0000","last_unstale":"2023-12-24T18:52:00.578388+0000","last_undegraded":"2023-12-24T18:52:00.578388+0000","last_fullsized":"2023-12-24T18:52:00.578388+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:53:48.820902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563607+0000","last_change":"2023-12-24T18:52:00.559045+0000","last_active":"2023-12-24T18:52:00.563607+0000","last_peered":"2023-12-24T18:52:00.563607+0000","last_clean":"2023-12-24T18:52:00.563607+0000","last_became_active":"2023-12-24T18:52:00.558385+0000","last_became_peered":"2023-12-24T18:52:00.558385+0000","last_unstale":"2023-12-24T18:52:00.563607+0000","last_undegraded":"2023-12-24T18:52:00.563607+0000","last_fullsized":"2023-12-24T18:52:00.563607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580249+0000","last_change":"2023-12-24T18:51:59.567098+0000","last_active":"2023-12-24T18:52:00.580249+0000","last_peered":"2023-12-24T18:52:00.580249+0000","last_clean":"2023-12-24T18:52:00.580249+0000","last_became_active":"2023-12-24T18:51:59.566789+0000","last_became_peered":"2023-12-24T18:51:59.566789+0000","last_unstale":"2023-12-24T18:52:00.580249+0000","last_undegraded":"2023-12-24T18:52:00.580249+0000","last_fullsized":"2023-12-24T18:52:00.580249+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:45.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564242+0000","last_change":"2023-12-24T18:52:00.560666+0000","last_active":"2023-12-24T18:52:00.564242+0000","last_peered":"2023-12-24T18:52:00.564242+0000","last_clean":"2023-12-24T18:52:00.564242+0000","last_became_active":"2023-12-24T18:52:00.560152+0000","last_became_peered":"2023-12-24T18:52:00.560152+0000","last_unstale":"2023-12-24T18:52:00.564242+0000","last_undegraded":"2023-12-24T18:52:00.564242+0000","last_fullsized":"2023-12-24T18:52:00.564242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578726+0000","last_change":"2023-12-24T18:51:59.555189+0000","last_active":"2023-12-24T18:52:00.578726+0000","last_peered":"2023-12-24T18:52:00.578726+0000","last_clean":"2023-12-24T18:52:00.578726+0000","last_became_active":"2023-12-24T18:51:59.554890+0000","last_became_peered":"2023-12-24T18:51:59.554890+0000","last_unstale":"2023-12-24T18:52:00.578726+0000","last_undegraded":"2023-12-24T18:52:00.578726+0000","last_fullsized":"2023-12-24T18:52:00.578726+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:10.472948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577862+0000","last_change":"2023-12-24T18:52:00.565705+0000","last_active":"2023-12-24T18:52:00.577862+0000","last_peered":"2023-12-24T18:52:00.577862+0000","last_clean":"2023-12-24T18:52:00.577862+0000","last_became_active":"2023-12-24T18:52:00.565425+0000","last_became_peered":"2023-12-24T18:52:00.565425+0000","last_unstale":"2023-12-24T18:52:00.577862+0000","last_undegraded":"2023-12-24T18:52:00.577862+0000","last_fullsized":"2023-12-24T18:52:00.577862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578099+0000","last_change":"2023-12-24T18:51:59.557491+0000","last_active":"2023-12-24T18:52:00.578099+0000","last_peered":"2023-12-24T18:52:00.578099+0000","last_clean":"2023-12-24T18:52:00.578099+0000","last_became_active":"2023-12-24T18:51:59.557202+0000","last_became_peered":"2023-12-24T18:51:59.557202+0000","last_unstale":"2023-12-24T18:52:00.578099+0000","last_undegraded":"2023-12-24T18:52:00.578099+0000","last_fullsized":"2023-12-24T18:52:00.578099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:28.870937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571198+0000","last_change":"2023-12-24T18:52:00.564751+0000","last_active":"2023-12-24T18:52:00.571198+0000","last_peered":"2023-12-24T18:52:00.571198+0000","last_clean":"2023-12-24T18:52:00.571198+0000","last_became_active":"2023-12-24T18:52:00.564426+0000","last_became_peered":"2023-12-24T18:52:00.564426+0000","last_unstale":"2023-12-24T18:52:00.571198+0000","last_undegraded":"2023-12-24T18:52:00.571198+0000","last_fullsized":"2023-12-24T18:52:00.571198+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580007+0000","last_change":"2023-12-24T18:51:59.564659+0000","last_active":"2023-12-24T18:52:00.580007+0000","last_peered":"2023-12-24T18:52:00.580007+0000","last_clean":"2023-12-24T18:52:00.580007+0000","last_became_active":"2023-12-24T18:51:59.564138+0000","last_became_peered":"2023-12-24T18:51:59.564138+0000","last_unstale":"2023-12-24T18:52:00.580007+0000","last_undegraded":"2023-12-24T18:52:00.580007+0000","last_fullsized":"2023-12-24T18:52:00.580007+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:23.704122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553008+0000","last_change":"2023-12-24T18:52:00.546644+0000","last_active":"2023-12-24T18:52:00.553008+0000","last_peered":"2023-12-24T18:52:00.553008+0000","last_clean":"2023-12-24T18:52:00.553008+0000","last_became_active":"2023-12-24T18:52:00.546215+0000","last_became_peered":"2023-12-24T18:52:00.546215+0000","last_unstale":"2023-12-24T18:52:00.553008+0000","last_undegraded":"2023-12-24T18:52:00.553008+0000","last_fullsized":"2023-12-24T18:52:00.553008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563629+0000","last_change":"2023-12-24T18:51:59.567933+0000","last_active":"2023-12-24T18:52:00.563629+0000","last_peered":"2023-12-24T18:52:00.563629+0000","last_clean":"2023-12-24T18:52:00.563629+0000","last_became_active":"2023-12-24T18:51:59.565545+0000","last_became_peered":"2023-12-24T18:51:59.565545+0000","last_unstale":"2023-12-24T18:52:00.563629+0000","last_undegraded":"2023-12-24T18:52:00.563629+0000","last_fullsized":"2023-12-24T18:52:00.563629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:25.410537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544015+0000","last_change":"2023-12-24T18:52:00.540551+0000","last_active":"2023-12-24T18:52:00.544015+0000","last_peered":"2023-12-24T18:52:00.544015+0000","last_clean":"2023-12-24T18:52:00.544015+0000","last_became_active":"2023-12-24T18:52:00.540174+0000","last_became_peered":"2023-12-24T18:52:00.540174+0000","last_unstale":"2023-12-24T18:52:00.544015+0000","last_undegraded":"2023-12-24T18:52:00.544015+0000","last_fullsized":"2023-12-24T18:52:00.544015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:46.701428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533933+0000","last_change":"2023-12-24T18:51:59.555474+0000","last_active":"2023-12-24T18:52:00.533933+0000","last_peered":"2023-12-24T18:52:00.533933+0000","last_clean":"2023-12-24T18:52:00.533933+0000","last_became_active":"2023-12-24T18:51:59.555176+0000","last_became_peered":"2023-12-24T18:51:59.555176+0000","last_unstale":"2023-12-24T18:52:00.533933+0000","last_undegraded":"2023-12-24T18:52:00.533933+0000","last_fullsized":"2023-12-24T18:52:00.533933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:49.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573754+0000","last_change":"2023-12-24T18:52:00.563773+0000","last_active":"2023-12-24T18:52:00.573754+0000","last_peered":"2023-12-24T18:52:00.573754+0000","last_clean":"2023-12-24T18:52:00.573754+0000","last_became_active":"2023-12-24T18:52:00.562920+0000","last_became_peered":"2023-12-24T18:52:00.562920+0000","last_unstale":"2023-12-24T18:52:00.573754+0000","last_undegraded":"2023-12-24T18:52:00.573754+0000","last_fullsized":"2023-12-24T18:52:00.573754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:12.838585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545785+0000","last_change":"2023-12-24T18:51:59.565593+0000","last_active":"2023-12-24T18:52:00.545785+0000","last_peered":"2023-12-24T18:52:00.545785+0000","last_clean":"2023-12-24T18:52:00.545785+0000","last_became_active":"2023-12-24T18:51:59.564576+0000","last_became_peered":"2023-12-24T18:51:59.564576+0000","last_unstale":"2023-12-24T18:52:00.545785+0000","last_undegraded":"2023-12-24T18:52:00.545785+0000","last_fullsized":"2023-12-24T18:52:00.545785+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:16:08.803893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.559973+0000","last_change":"2023-12-24T18:52:00.556118+0000","last_active":"2023-12-24T18:52:00.559973+0000","last_peered":"2023-12-24T18:52:00.559973+0000","last_clean":"2023-12-24T18:52:00.559973+0000","last_became_active":"2023-12-24T18:52:00.555483+0000","last_became_peered":"2023-12-24T18:52:00.555483+0000","last_unstale":"2023-12-24T18:52:00.559973+0000","last_undegraded":"2023-12-24T18:52:00.559973+0000","last_fullsized":"2023-12-24T18:52:00.559973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:17.010626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545899+0000","last_change":"2023-12-24T18:51:59.560456+0000","last_active":"2023-12-24T18:52:00.545899+0000","last_peered":"2023-12-24T18:52:00.545899+0000","last_clean":"2023-12-24T18:52:00.545899+0000","last_became_active":"2023-12-24T18:51:59.557516+0000","last_became_peered":"2023-12-24T18:51:59.557516+0000","last_unstale":"2023-12-24T18:52:00.545899+0000","last_undegraded":"2023-12-24T18:52:00.545899+0000","last_fullsized":"2023-12-24T18:52:00.545899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:59.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576047+0000","last_change":"2023-12-24T18:52:00.566554+0000","last_active":"2023-12-24T18:52:00.576047+0000","last_peered":"2023-12-24T18:52:00.576047+0000","last_clean":"2023-12-24T18:52:00.576047+0000","last_became_active":"2023-12-24T18:52:00.565824+0000","last_became_peered":"2023-12-24T18:52:00.565824+0000","last_unstale":"2023-12-24T18:52:00.576047+0000","last_undegraded":"2023-12-24T18:52:00.576047+0000","last_fullsized":"2023-12-24T18:52:00.576047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584722+0000","last_change":"2023-12-24T18:51:59.563834+0000","last_active":"2023-12-24T18:52:00.584722+0000","last_peered":"2023-12-24T18:52:00.584722+0000","last_clean":"2023-12-24T18:52:00.584722+0000","last_became_active":"2023-12-24T18:51:59.563554+0000","last_became_peered":"2023-12-24T18:51:59.563554+0000","last_unstale":"2023-12-24T18:52:00.584722+0000","last_undegraded":"2023-12-24T18:52:00.584722+0000","last_fullsized":"2023-12-24T18:52:00.584722+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:11.764121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571866+0000","last_change":"2023-12-24T18:52:00.568031+0000","last_active":"2023-12-24T18:52:00.571866+0000","last_peered":"2023-12-24T18:52:00.571866+0000","last_clean":"2023-12-24T18:52:00.571866+0000","last_became_active":"2023-12-24T18:52:00.567688+0000","last_became_peered":"2023-12-24T18:52:00.567688+0000","last_unstale":"2023-12-24T18:52:00.571866+0000","last_undegraded":"2023-12-24T18:52:00.571866+0000","last_fullsized":"2023-12-24T18:52:00.571866+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583974+0000","last_change":"2023-12-24T18:51:59.552298+0000","last_active":"2023-12-24T18:52:00.583974+0000","last_peered":"2023-12-24T18:52:00.583974+0000","last_clean":"2023-12-24T18:52:00.583974+0000","last_became_active":"2023-12-24T18:51:59.551849+0000","last_became_peered":"2023-12-24T18:51:59.551849+0000","last_unstale":"2023-12-24T18:52:00.583974+0000","last_undegraded":"2023-12-24T18:52:00.583974+0000","last_fullsized":"2023-12-24T18:52:00.583974+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:34.496851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560444+0000","last_change":"2023-12-24T18:52:00.557935+0000","last_active":"2023-12-24T18:52:00.560444+0000","last_peered":"2023-12-24T18:52:00.560444+0000","last_clean":"2023-12-24T18:52:00.560444+0000","last_became_active":"2023-12-24T18:52:00.557655+0000","last_became_peered":"2023-12-24T18:52:00.557655+0000","last_unstale":"2023-12-24T18:52:00.560444+0000","last_undegraded":"2023-12-24T18:52:00.560444+0000","last_fullsized":"2023-12-24T18:52:00.560444+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:48.707502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580237+0000","last_change":"2023-12-24T18:51:59.564611+0000","last_active":"2023-12-24T18:52:00.580237+0000","last_peered":"2023-12-24T18:52:00.580237+0000","last_clean":"2023-12-24T18:52:00.580237+0000","last_became_active":"2023-12-24T18:51:59.563284+0000","last_became_peered":"2023-12-24T18:51:59.563284+0000","last_unstale":"2023-12-24T18:52:00.580237+0000","last_undegraded":"2023-12-24T18:52:00.580237+0000","last_fullsized":"2023-12-24T18:52:00.580237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:33.688280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564452+0000","last_change":"2023-12-24T18:52:00.561136+0000","last_active":"2023-12-24T18:52:00.564452+0000","last_peered":"2023-12-24T18:52:00.564452+0000","last_clean":"2023-12-24T18:52:00.564452+0000","last_became_active":"2023-12-24T18:52:00.560835+0000","last_became_peered":"2023-12-24T18:52:00.560835+0000","last_unstale":"2023-12-24T18:52:00.564452+0000","last_undegraded":"2023-12-24T18:52:00.564452+0000","last_fullsized":"2023-12-24T18:52:00.564452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:39.818376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541090+0000","last_change":"2023-12-24T18:51:59.563671+0000","last_active":"2023-12-24T18:52:00.541090+0000","last_peered":"2023-12-24T18:52:00.541090+0000","last_clean":"2023-12-24T18:52:00.541090+0000","last_became_active":"2023-12-24T18:51:59.563139+0000","last_became_peered":"2023-12-24T18:51:59.563139+0000","last_unstale":"2023-12-24T18:52:00.541090+0000","last_undegraded":"2023-12-24T18:52:00.541090+0000","last_fullsized":"2023-12-24T18:52:00.541090+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:37.280782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552563+0000","last_change":"2023-12-24T18:52:00.549471+0000","last_active":"2023-12-24T18:52:00.552563+0000","last_peered":"2023-12-24T18:52:00.552563+0000","last_clean":"2023-12-24T18:52:00.552563+0000","last_became_active":"2023-12-24T18:52:00.546256+0000","last_became_peered":"2023-12-24T18:52:00.546256+0000","last_unstale":"2023-12-24T18:52:00.552563+0000","last_undegraded":"2023-12-24T18:52:00.552563+0000","last_fullsized":"2023-12-24T18:52:00.552563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:40.123024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533861+0000","last_change":"2023-12-24T18:51:59.559764+0000","last_active":"2023-12-24T18:52:00.533861+0000","last_peered":"2023-12-24T18:52:00.533861+0000","last_clean":"2023-12-24T18:52:00.533861+0000","last_became_active":"2023-12-24T18:51:59.559483+0000","last_became_peered":"2023-12-24T18:51:59.559483+0000","last_unstale":"2023-12-24T18:52:00.533861+0000","last_undegraded":"2023-12-24T18:52:00.533861+0000","last_fullsized":"2023-12-24T18:52:00.533861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:30.523634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560640+0000","last_change":"2023-12-24T18:52:00.557427+0000","last_active":"2023-12-24T18:52:00.560640+0000","last_peered":"2023-12-24T18:52:00.560640+0000","last_clean":"2023-12-24T18:52:00.560640+0000","last_became_active":"2023-12-24T18:52:00.556754+0000","last_became_peered":"2023-12-24T18:52:00.556754+0000","last_unstale":"2023-12-24T18:52:00.560640+0000","last_undegraded":"2023-12-24T18:52:00.560640+0000","last_fullsized":"2023-12-24T18:52:00.560640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:00.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.590899+0000","last_change":"2023-12-24T18:51:59.559686+0000","last_active":"2023-12-24T18:52:00.590899+0000","last_peered":"2023-12-24T18:52:00.590899+0000","last_clean":"2023-12-24T18:52:00.590899+0000","last_became_active":"2023-12-24T18:51:59.559289+0000","last_became_peered":"2023-12-24T18:51:59.559289+0000","last_unstale":"2023-12-24T18:52:00.590899+0000","last_undegraded":"2023-12-24T18:52:00.590899+0000","last_fullsized":"2023-12-24T18:52:00.590899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:45.999020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.574228+0000","last_change":"2023-12-24T18:52:00.568663+0000","last_active":"2023-12-24T18:52:00.574228+0000","last_peered":"2023-12-24T18:52:00.574228+0000","last_clean":"2023-12-24T18:52:00.574228+0000","last_became_active":"2023-12-24T18:52:00.567550+0000","last_became_peered":"2023-12-24T18:52:00.567550+0000","last_unstale":"2023-12-24T18:52:00.574228+0000","last_undegraded":"2023-12-24T18:52:00.574228+0000","last_fullsized":"2023-12-24T18:52:00.574228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578978+0000","last_change":"2023-12-24T18:51:59.569543+0000","last_active":"2023-12-24T18:52:00.578978+0000","last_peered":"2023-12-24T18:52:00.578978+0000","last_clean":"2023-12-24T18:52:00.578978+0000","last_became_active":"2023-12-24T18:51:59.569232+0000","last_became_peered":"2023-12-24T18:51:59.569232+0000","last_unstale":"2023-12-24T18:52:00.578978+0000","last_undegraded":"2023-12-24T18:52:00.578978+0000","last_fullsized":"2023-12-24T18:52:00.578978+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:10.664098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555712+0000","last_change":"2023-12-24T18:52:00.545358+0000","last_active":"2023-12-24T18:52:00.555712+0000","last_peered":"2023-12-24T18:52:00.555712+0000","last_clean":"2023-12-24T18:52:00.555712+0000","last_became_active":"2023-12-24T18:52:00.544226+0000","last_became_peered":"2023-12-24T18:52:00.544226+0000","last_unstale":"2023-12-24T18:52:00.555712+0000","last_undegraded":"2023-12-24T18:52:00.555712+0000","last_fullsized":"2023-12-24T18:52:00.555712+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:20.865731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579115+0000","last_change":"2023-12-24T18:51:59.562654+0000","last_active":"2023-12-24T18:52:00.579115+0000","last_peered":"2023-12-24T18:52:00.579115+0000","last_clean":"2023-12-24T18:52:00.579115+0000","last_became_active":"2023-12-24T18:51:59.561839+0000","last_became_peered":"2023-12-24T18:51:59.561839+0000","last_unstale":"2023-12-24T18:52:00.579115+0000","last_undegraded":"2023-12-24T18:52:00.579115+0000","last_fullsized":"2023-12-24T18:52:00.579115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575534+0000","last_change":"2023-12-24T18:52:00.569871+0000","last_active":"2023-12-24T18:52:00.575534+0000","last_peered":"2023-12-24T18:52:00.575534+0000","last_clean":"2023-12-24T18:52:00.575534+0000","last_became_active":"2023-12-24T18:52:00.569429+0000","last_became_peered":"2023-12-24T18:52:00.569429+0000","last_unstale":"2023-12-24T18:52:00.575534+0000","last_undegraded":"2023-12-24T18:52:00.575534+0000","last_fullsized":"2023-12-24T18:52:00.575534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:47.866668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584375+0000","last_change":"2023-12-24T18:51:59.556434+0000","last_active":"2023-12-24T18:52:00.584375+0000","last_peered":"2023-12-24T18:52:00.584375+0000","last_clean":"2023-12-24T18:52:00.584375+0000","last_became_active":"2023-12-24T18:51:59.555988+0000","last_became_peered":"2023-12-24T18:51:59.555988+0000","last_unstale":"2023-12-24T18:52:00.584375+0000","last_undegraded":"2023-12-24T18:52:00.584375+0000","last_fullsized":"2023-12-24T18:52:00.584375+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.701812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.568204+0000","last_change":"2023-12-24T18:52:00.563195+0000","last_active":"2023-12-24T18:52:00.568204+0000","last_peered":"2023-12-24T18:52:00.568204+0000","last_clean":"2023-12-24T18:52:00.568204+0000","last_became_active":"2023-12-24T18:52:00.562922+0000","last_became_peered":"2023-12-24T18:52:00.562922+0000","last_unstale":"2023-12-24T18:52:00.568204+0000","last_undegraded":"2023-12-24T18:52:00.568204+0000","last_fullsized":"2023-12-24T18:52:00.568204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547242+0000","last_change":"2023-12-24T18:51:59.567644+0000","last_active":"2023-12-24T18:52:00.547242+0000","last_peered":"2023-12-24T18:52:00.547242+0000","last_clean":"2023-12-24T18:52:00.547242+0000","last_became_active":"2023-12-24T18:51:59.567305+0000","last_became_peered":"2023-12-24T18:51:59.567305+0000","last_unstale":"2023-12-24T18:52:00.547242+0000","last_undegraded":"2023-12-24T18:52:00.547242+0000","last_fullsized":"2023-12-24T18:52:00.547242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:59.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571736+0000","last_change":"2023-12-24T18:52:00.564644+0000","last_active":"2023-12-24T18:52:00.571736+0000","last_peered":"2023-12-24T18:52:00.571736+0000","last_clean":"2023-12-24T18:52:00.571736+0000","last_became_active":"2023-12-24T18:52:00.562736+0000","last_became_peered":"2023-12-24T18:52:00.562736+0000","last_unstale":"2023-12-24T18:52:00.571736+0000","last_undegraded":"2023-12-24T18:52:00.571736+0000","last_fullsized":"2023-12-24T18:52:00.571736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.586345+0000","last_change":"2023-12-24T18:51:59.563318+0000","last_active":"2023-12-24T18:52:00.586345+0000","last_peered":"2023-12-24T18:52:00.586345+0000","last_clean":"2023-12-24T18:52:00.586345+0000","last_became_active":"2023-12-24T18:51:59.563041+0000","last_became_peered":"2023-12-24T18:51:59.563041+0000","last_unstale":"2023-12-24T18:52:00.586345+0000","last_undegraded":"2023-12-24T18:52:00.586345+0000","last_fullsized":"2023-12-24T18:52:00.586345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:02.933403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580259+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.580259+0000","last_peered":"2023-12-24T18:52:00.580259+0000","last_clean":"2023-12-24T18:52:00.580259+0000","last_became_active":"2023-12-24T18:52:00.569136+0000","last_became_peered":"2023-12-24T18:52:00.569136+0000","last_unstale":"2023-12-24T18:52:00.580259+0000","last_undegraded":"2023-12-24T18:52:00.580259+0000","last_fullsized":"2023-12-24T18:52:00.580259+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:54.262839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547939+0000","last_change":"2023-12-24T18:51:59.562274+0000","last_active":"2023-12-24T18:52:00.547939+0000","last_peered":"2023-12-24T18:52:00.547939+0000","last_clean":"2023-12-24T18:52:00.547939+0000","last_became_active":"2023-12-24T18:51:59.561873+0000","last_became_peered":"2023-12-24T18:51:59.561873+0000","last_unstale":"2023-12-24T18:52:00.547939+0000","last_undegraded":"2023-12-24T18:52:00.547939+0000","last_fullsized":"2023-12-24T18:52:00.547939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:15.751745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560734+0000","last_change":"2023-12-24T18:52:00.558328+0000","last_active":"2023-12-24T18:52:00.560734+0000","last_peered":"2023-12-24T18:52:00.560734+0000","last_clean":"2023-12-24T18:52:00.560734+0000","last_became_active":"2023-12-24T18:52:00.557968+0000","last_became_peered":"2023-12-24T18:52:00.557968+0000","last_unstale":"2023-12-24T18:52:00.560734+0000","last_undegraded":"2023-12-24T18:52:00.560734+0000","last_fullsized":"2023-12-24T18:52:00.560734+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:33:18.472395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547647+0000","last_change":"2023-12-24T18:51:59.565291+0000","last_active":"2023-12-24T18:52:00.547647+0000","last_peered":"2023-12-24T18:52:00.547647+0000","last_clean":"2023-12-24T18:52:00.547647+0000","last_became_active":"2023-12-24T18:51:59.565011+0000","last_became_peered":"2023-12-24T18:51:59.565011+0000","last_unstale":"2023-12-24T18:52:00.547647+0000","last_undegraded":"2023-12-24T18:52:00.547647+0000","last_fullsized":"2023-12-24T18:52:00.547647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:41.268461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.551315+0000","last_change":"2023-12-24T18:52:00.541779+0000","last_active":"2023-12-24T18:52:00.551315+0000","last_peered":"2023-12-24T18:52:00.551315+0000","last_clean":"2023-12-24T18:52:00.551315+0000","last_became_active":"2023-12-24T18:52:00.541478+0000","last_became_peered":"2023-12-24T18:52:00.541478+0000","last_unstale":"2023-12-24T18:52:00.551315+0000","last_undegraded":"2023-12-24T18:52:00.551315+0000","last_fullsized":"2023-12-24T18:52:00.551315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:11.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578326+0000","last_change":"2023-12-24T18:51:59.561838+0000","last_active":"2023-12-24T18:52:00.578326+0000","last_peered":"2023-12-24T18:52:00.578326+0000","last_clean":"2023-12-24T18:52:00.578326+0000","last_became_active":"2023-12-24T18:51:59.561517+0000","last_became_peered":"2023-12-24T18:51:59.561517+0000","last_unstale":"2023-12-24T18:52:00.578326+0000","last_undegraded":"2023-12-24T18:52:00.578326+0000","last_fullsized":"2023-12-24T18:52:00.578326+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:31.948199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552526+0000","last_change":"2023-12-24T18:52:00.548971+0000","last_active":"2023-12-24T18:52:00.552526+0000","last_peered":"2023-12-24T18:52:00.552526+0000","last_clean":"2023-12-24T18:52:00.552526+0000","last_became_active":"2023-12-24T18:52:00.548657+0000","last_became_peered":"2023-12-24T18:52:00.548657+0000","last_unstale":"2023-12-24T18:52:00.552526+0000","last_undegraded":"2023-12-24T18:52:00.552526+0000","last_fullsized":"2023-12-24T18:52:00.552526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:53.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.566735+0000","last_change":"2023-12-24T18:51:59.566224+0000","last_active":"2023-12-24T18:52:00.566735+0000","last_peered":"2023-12-24T18:52:00.566735+0000","last_clean":"2023-12-24T18:52:00.566735+0000","last_became_active":"2023-12-24T18:51:59.565918+0000","last_became_peered":"2023-12-24T18:51:59.565918+0000","last_unstale":"2023-12-24T18:52:00.566735+0000","last_undegraded":"2023-12-24T18:52:00.566735+0000","last_fullsized":"2023-12-24T18:52:00.566735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.607263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562776+0000","last_change":"2023-12-24T18:52:00.553610+0000","last_active":"2023-12-24T18:52:00.562776+0000","last_peered":"2023-12-24T18:52:00.562776+0000","last_clean":"2023-12-24T18:52:00.562776+0000","last_became_active":"2023-12-24T18:52:00.553340+0000","last_became_peered":"2023-12-24T18:52:00.553340+0000","last_unstale":"2023-12-24T18:52:00.562776+0000","last_undegraded":"2023-12-24T18:52:00.562776+0000","last_fullsized":"2023-12-24T18:52:00.562776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544682+0000","last_change":"2023-12-24T18:51:59.565113+0000","last_active":"2023-12-24T18:52:00.544682+0000","last_peered":"2023-12-24T18:52:00.544682+0000","last_clean":"2023-12-24T18:52:00.544682+0000","last_became_active":"2023-12-24T18:51:59.564760+0000","last_became_peered":"2023-12-24T18:51:59.564760+0000","last_unstale":"2023-12-24T18:52:00.544682+0000","last_undegraded":"2023-12-24T18:52:00.544682+0000","last_fullsized":"2023-12-24T18:52:00.544682+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:00.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573848+0000","last_change":"2023-12-24T18:52:00.563547+0000","last_active":"2023-12-24T18:52:00.573848+0000","last_peered":"2023-12-24T18:52:00.573848+0000","last_clean":"2023-12-24T18:52:00.573848+0000","last_became_active":"2023-12-24T18:52:00.563170+0000","last_became_peered":"2023-12-24T18:52:00.563170+0000","last_unstale":"2023-12-24T18:52:00.573848+0000","last_undegraded":"2023-12-24T18:52:00.573848+0000","last_fullsized":"2023-12-24T18:52:00.573848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:07.005934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541426+0000","last_change":"2023-12-24T18:51:59.562638+0000","last_active":"2023-12-24T18:52:00.541426+0000","last_peered":"2023-12-24T18:52:00.541426+0000","last_clean":"2023-12-24T18:52:00.541426+0000","last_became_active":"2023-12-24T18:51:59.562343+0000","last_became_peered":"2023-12-24T18:51:59.562343+0000","last_unstale":"2023-12-24T18:52:00.541426+0000","last_undegraded":"2023-12-24T18:52:00.541426+0000","last_fullsized":"2023-12-24T18:52:00.541426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:38.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553042+0000","last_change":"2023-12-24T18:52:00.549045+0000","last_active":"2023-12-24T18:52:00.553042+0000","last_peered":"2023-12-24T18:52:00.553042+0000","last_clean":"2023-12-24T18:52:00.553042+0000","last_became_active":"2023-12-24T18:52:00.548766+0000","last_became_peered":"2023-12-24T18:52:00.548766+0000","last_unstale":"2023-12-24T18:52:00.553042+0000","last_undegraded":"2023-12-24T18:52:00.553042+0000","last_fullsized":"2023-12-24T18:52:00.553042+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:29.885069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533318+0000","last_change":"2023-12-24T18:51:59.558150+0000","last_active":"2023-12-24T18:52:00.533318+0000","last_peered":"2023-12-24T18:52:00.533318+0000","last_clean":"2023-12-24T18:52:00.533318+0000","last_became_active":"2023-12-24T18:51:59.557796+0000","last_became_peered":"2023-12-24T18:51:59.557796+0000","last_unstale":"2023-12-24T18:52:00.533318+0000","last_undegraded":"2023-12-24T18:52:00.533318+0000","last_fullsized":"2023-12-24T18:52:00.533318+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:21:27.849190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.557046+0000","last_change":"2023-12-24T18:52:00.554275+0000","last_active":"2023-12-24T18:52:00.557046+0000","last_peered":"2023-12-24T18:52:00.557046+0000","last_clean":"2023-12-24T18:52:00.557046+0000","last_became_active":"2023-12-24T18:52:00.553218+0000","last_became_peered":"2023-12-24T18:52:00.553218+0000","last_unstale":"2023-12-24T18:52:00.557046+0000","last_undegraded":"2023-12-24T18:52:00.557046+0000","last_fullsized":"2023-12-24T18:52:00.557046+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:29.884462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.535757+0000","last_change":"2023-12-24T18:51:59.561581+0000","last_active":"2023-12-24T18:52:00.535757+0000","last_peered":"2023-12-24T18:52:00.535757+0000","last_clean":"2023-12-24T18:52:00.535757+0000","last_became_active":"2023-12-24T18:51:59.559809+0000","last_became_peered":"2023-12-24T18:51:59.559809+0000","last_unstale":"2023-12-24T18:52:00.535757+0000","last_undegraded":"2023-12-24T18:52:00.535757+0000","last_fullsized":"2023-12-24T18:52:00.535757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:20.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572125+0000","last_change":"2023-12-24T18:52:00.571033+0000","last_active":"2023-12-24T18:52:00.572125+0000","last_peered":"2023-12-24T18:52:00.572125+0000","last_clean":"2023-12-24T18:52:00.572125+0000","last_became_active":"2023-12-24T18:52:00.570672+0000","last_became_peered":"2023-12-24T18:52:00.570672+0000","last_unstale":"2023-12-24T18:52:00.572125+0000","last_undegraded":"2023-12-24T18:52:00.572125+0000","last_fullsized":"2023-12-24T18:52:00.572125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.537177+0000","last_change":"2023-12-24T18:51:59.552749+0000","last_active":"2023-12-24T18:52:00.537177+0000","last_peered":"2023-12-24T18:52:00.537177+0000","last_clean":"2023-12-24T18:52:00.537177+0000","last_became_active":"2023-12-24T18:51:59.552333+0000","last_became_peered":"2023-12-24T18:51:59.552333+0000","last_unstale":"2023-12-24T18:52:00.537177+0000","last_undegraded":"2023-12-24T18:52:00.537177+0000","last_fullsized":"2023-12-24T18:52:00.537177+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:42.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569740+0000","last_change":"2023-12-24T18:52:00.565285+0000","last_active":"2023-12-24T18:52:00.569740+0000","last_peered":"2023-12-24T18:52:00.569740+0000","last_clean":"2023-12-24T18:52:00.569740+0000","last_became_active":"2023-12-24T18:52:00.561876+0000","last_became_peered":"2023-12-24T18:52:00.561876+0000","last_unstale":"2023-12-24T18:52:00.569740+0000","last_undegraded":"2023-12-24T18:52:00.569740+0000","last_fullsized":"2023-12-24T18:52:00.569740+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.546993+0000","last_change":"2023-12-24T18:51:59.568249+0000","last_active":"2023-12-24T18:52:00.546993+0000","last_peered":"2023-12-24T18:52:00.546993+0000","last_clean":"2023-12-24T18:52:00.546993+0000","last_became_active":"2023-12-24T18:51:59.565524+0000","last_became_peered":"2023-12-24T18:51:59.565524+0000","last_unstale":"2023-12-24T18:52:00.546993+0000","last_undegraded":"2023-12-24T18:52:00.546993+0000","last_fullsized":"2023-12-24T18:52:00.546993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:28.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564200+0000","last_change":"2023-12-24T18:52:00.562853+0000","last_active":"2023-12-24T18:52:00.564200+0000","last_peered":"2023-12-24T18:52:00.564200+0000","last_clean":"2023-12-24T18:52:00.564200+0000","last_became_active":"2023-12-24T18:52:00.562558+0000","last_became_peered":"2023-12-24T18:52:00.562558+0000","last_unstale":"2023-12-24T18:52:00.564200+0000","last_undegraded":"2023-12-24T18:52:00.564200+0000","last_fullsized":"2023-12-24T18:52:00.564200+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:47.013152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552006+0000","last_change":"2023-12-24T18:51:59.556251+0000","last_active":"2023-12-24T18:52:00.552006+0000","last_peered":"2023-12-24T18:52:00.552006+0000","last_clean":"2023-12-24T18:52:00.552006+0000","last_became_active":"2023-12-24T18:51:59.555893+0000","last_became_peered":"2023-12-24T18:51:59.555893+0000","last_unstale":"2023-12-24T18:52:00.552006+0000","last_undegraded":"2023-12-24T18:52:00.552006+0000","last_fullsized":"2023-12-24T18:52:00.552006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:34.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":459,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541591+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:52:00.541591+0000","last_peered":"2023-12-24T18:52:00.541591+0000","last_clean":"2023-12-24T18:52:00.541591+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:52:00.541591+0000","last_undegraded":"2023-12-24T18:52:00.541591+0000","last_fullsized":"2023-12-24T18:52:00.541591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311308,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060532,"statfs":{"total":96636764160,"available":96317984768,"internally_reserved":0,"allocated":1773568,"data_stored":1183638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.304}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.131},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.081}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":0.752},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":0.95299999999999996}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.3819999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.194}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":0.89200000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.357},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.3320000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306640,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065200,"statfs":{"total":96636764160,"available":96322764800,"internally_reserved":0,"allocated":1187840,"data_stored":594784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6220000000000001,"5min":1.788,"15min":1.788},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4159999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1279999999999999,"15min":1.1599999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6060000000000001,"5min":1.667,"15min":1.667},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2050000000000001,"15min":1.1990000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.599,"5min":1.7390000000000001,"15min":1.748},"last":1.2090000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1499999999999999,"15min":1.1659999999999999},"min":{"1min":0.72899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4610000000000001,"5min":1.542,"15min":3.609},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.232,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.5640000000000001,"5min":1.794,"15min":2.0259999999999998},"last":1.175}]},{"osd":3,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2509999999999999,"15min":1.26},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.655,"5min":1.6659999999999999,"15min":1.867},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":0.73799999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"max":{"1min":1.4330000000000001,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.3009999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1870000000000001,"15min":1.202},"min":{"1min":0.67300000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.5129999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.274,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.65200000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.0470000000000002},"last":0.89100000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.2,"15min":1.2290000000000001},"min":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":4.2779999999999996},"last":0.997},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3320000000000001,"15min":1.351},"min":{"1min":0.85999999999999999,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":1.669,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.2609999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3740000000000001,"15min":1.3919999999999999},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.73999999999999999},"max":{"1min":1.9950000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.052},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":0.97599999999999998,"5min":0.80800000000000005,"15min":0.58799999999999997},"max":{"1min":1.536,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.2410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":586298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":1},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.089}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.89700000000000002}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.036}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.125},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.81499999999999995}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.173},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.155},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.2609999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302552,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069288,"statfs":{"total":96636764160,"available":96326950912,"internally_reserved":0,"allocated":1196032,"data_stored":594888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.752}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":0.87}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.101},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1799999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.0169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":586818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":3.4260000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":5.0700000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":2.4580000000000002},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":3.5089999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":2.363},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":4.0019999999999998}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":6.8289999999999997},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":2.944}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":2.516},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":6.6589999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":5.4400000000000004},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":5.8970000000000002}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":5.3380000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":5.3070000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310736,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061104,"statfs":{"total":96636764160,"available":96318570496,"internally_reserved":0,"allocated":1187840,"data_stored":593962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.87},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":1.357}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":2.069},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.752}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.843}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.802}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302528,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069312,"statfs":{"total":96636764160,"available":96326975488,"internally_reserved":0,"allocated":1171456,"data_stored":586376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.502}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.351},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.655}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.4510000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.601},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.28}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.403},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.3009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307208,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064632,"statfs":{"total":96636764160,"available":96322183168,"internally_reserved":0,"allocated":1769472,"data_stored":1183616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.3899999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":1.107},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.2290000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.593}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.706}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.454},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.7470000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.79},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.345}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:09.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.869+0000 7f945546e700 1 Processor -- start 2023-12-24T18:52:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.869+0000 7f945546e700 1 -- start start 2023-12-24T18:52:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f945546e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94500c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f945546e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945006c820 con 0x7f9450154b60 2023-12-24T18:52:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f945546e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945006b960 con 0x7f94500c6d00 2023-12-24T18:52:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f945546e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945006bc40 con 0x7f945006dcc0 2023-12-24T18:52:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9450154b60 0x7f945006aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53688/0 (socket says 172.21.15.50:53688) 2023-12-24T18:52:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944e7fc700 1 -- 172.21.15.50:0/508780625 learned_addr learned my addr 172.21.15.50:0/508780625 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944f7fe700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94500c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983381131 0 0) 0x7f945006c820 con 0x7f9450154b60 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9438003570 con 0x7f9450154b60 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376786099 0 0) 0x7f9438003570 con 0x7f9450154b60 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 msgr2=0x7f94500c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94500c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 >> v1:172.21.15.82:6789/0 conn(0x7f94500c6d00 legacy=0x7f9450154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945006bf20 con 0x7f9450154b60 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f9444001470 con 0x7f9450154b60 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 >> v1:172.21.15.50:6789/0 conn(0x7f9450154b60 legacy=0x7f945006aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9438004810 0x7f9438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94380051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945006bc40 con 0x7f9438004810 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943800bb90 con 0x7f9438003a90 2023-12-24T18:52:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943800bd50 con 0x7f945006dcc0 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.873+0000 7f944e7fc700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9438004810 0x7f9438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944effd700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944f7fe700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94380051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 -- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 msgr2=0x7f94380051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f945006dcc0 0x7f94380051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 -- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9438003a90 msgr2=0x7f9438003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 -- 172.21.15.50:0/508780625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438003570 con 0x7f9438004810 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944e7fc700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9438004810 0x7f9438004c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f944400c3c0 tx=0x7f9444001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da17e76f465a64ee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400cc90 con 0x7f9438004810 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400cdf0 con 0x7f9438004810 2023-12-24T18:52:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944dffb700 1 -- 172.21.15.50:0/508780625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444005b50 con 0x7f9438004810 2023-12-24T18:52:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 -- 172.21.15.50:0/508780625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9438004810 msgr2=0x7f9438004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 --2- 172.21.15.50:0/508780625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9438004810 0x7f9438004c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f944400c3c0 tx=0x7f9444001e50 comp rx=0 tx=0).stop 2023-12-24T18:52:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f944f7fe700 1 -- 172.21.15.50:0/508780625 reap_dead start 2023-12-24T18:52:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 -- 172.21.15.50:0/508780625 shutdown_connections 2023-12-24T18:52:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 -- 172.21.15.50:0/508780625 >> 172.21.15.50:0/508780625 conn(0x7f94500cbba0 msgr2=0x7f94500cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 -- 172.21.15.50:0/508780625 shutdown_connections 2023-12-24T18:52:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.877+0000 7f945546e700 1 -- 172.21.15.50:0/508780625 wait complete. 2023-12-24T18:52:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.881+0000 7f945546e700 1 Processor -- start 2023-12-24T18:52:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.881+0000 7f945546e700 1 -- start start 2023-12-24T18:52:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9438004810 0x7f94501680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94500abd60 0x7f9450165b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500ae2e0 con 0x7f945014f1f0 2023-12-24T18:52:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450166060 con 0x7f94500abd60 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500ac260 con 0x7f9438004810 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34888/0 (socket says 172.21.15.50:34888) 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 -- 172.21.15.50:0/1697538847 learned_addr learned my addr 172.21.15.50:0/1697538847 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944e7fc700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94500abd60 0x7f9450165b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944effd700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9438004810 0x7f94501680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 -- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9438004810 msgr2=0x7f94501680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9438004810 0x7f94501680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 -- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94500abd60 msgr2=0x7f9450165b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94500abd60 0x7f9450165b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 -- 172.21.15.50:0/1697538847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500ac540 con 0x7f945014f1f0 2023-12-24T18:52:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f944f7fe700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9450069dd0 tx=0x7f944800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944800e040 con 0x7f945014f1f0 2023-12-24T18:52:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944800f040 con 0x7f945014f1f0 2023-12-24T18:52:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944800fd90 con 0x7f945014f1f0 2023-12-24T18:52:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94500ac820 con 0x7f945014f1f0 2023-12-24T18:52:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.885+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945014fbd0 con 0x7f945014f1f0 2023-12-24T18:52:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.889+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9450166350 con 0x7f945014f1f0 2023-12-24T18:52:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.889+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9448015640 con 0x7f945014f1f0 2023-12-24T18:52:09.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.893+0000 7f9436ffd700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 0x7f943c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:09.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.893+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f944807d420 con 0x7f945014f1f0 2023-12-24T18:52:09.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.893+0000 7f944effd700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 0x7f943c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:09.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.893+0000 7f944effd700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 0x7f943c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94500cb980 tx=0x7f9440007d30 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:09.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:09.897+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9450166350 con 0x7f945014f1f0 2023-12-24T18:52:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.061+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9450166350 con 0x7f943c060580 2023-12-24T18:52:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.081+0000 7f9436ffd700 1 -- 172.21.15.50:0/1697538847 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286560 (secure 0 0 0) 0x7f9450166350 con 0x7f943c060580 2023-12-24T18:52:10.087 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 msgr2=0x7f943c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 0x7f943c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94500cb980 tx=0x7f9440007d30 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 msgr2=0x7f945014f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9450069dd0 tx=0x7f944800b040 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 shutdown_connections 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f943c060580 0x7f943c062a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f945014f1f0 0x7f945014f690 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94500abd60 0x7f9450165b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 --2- 172.21.15.50:0/1697538847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9438004810 0x7f94501680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 >> 172.21.15.50:0/1697538847 conn(0x7f94500cbba0 msgr2=0x7f9450153660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 shutdown_connections 2023-12-24T18:52:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.089+0000 7f945546e700 1 -- 172.21.15.50:0/1697538847 wait complete. 2023-12-24T18:52:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:10.111 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-24T18:52:09.538435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450152,"kb_used_data":10408,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752524568,"statfs":{"total":773094113280,"available":770585157632,"internally_reserved":0,"allocated":10657792,"data_stored":5931332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.008594"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560376+0000","last_change":"2023-12-24T18:52:00.558063+0000","last_active":"2023-12-24T18:52:00.560376+0000","last_peered":"2023-12-24T18:52:00.560376+0000","last_clean":"2023-12-24T18:52:00.560376+0000","last_became_active":"2023-12-24T18:52:00.557729+0000","last_became_peered":"2023-12-24T18:52:00.557729+0000","last_unstale":"2023-12-24T18:52:00.560376+0000","last_undegraded":"2023-12-24T18:52:00.560376+0000","last_fullsized":"2023-12-24T18:52:00.560376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:26.424669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580239+0000","last_change":"2023-12-24T18:52:00.569504+0000","last_active":"2023-12-24T18:52:00.580239+0000","last_peered":"2023-12-24T18:52:00.580239+0000","last_clean":"2023-12-24T18:52:00.580239+0000","last_became_active":"2023-12-24T18:52:00.568841+0000","last_became_peered":"2023-12-24T18:52:00.568841+0000","last_unstale":"2023-12-24T18:52:00.580239+0000","last_undegraded":"2023-12-24T18:52:00.580239+0000","last_fullsized":"2023-12-24T18:52:00.580239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579355+0000","last_change":"2023-12-24T18:52:00.576740+0000","last_active":"2023-12-24T18:52:00.579355+0000","last_peered":"2023-12-24T18:52:00.579355+0000","last_clean":"2023-12-24T18:52:00.579355+0000","last_became_active":"2023-12-24T18:52:00.576396+0000","last_became_peered":"2023-12-24T18:52:00.576396+0000","last_unstale":"2023-12-24T18:52:00.579355+0000","last_undegraded":"2023-12-24T18:52:00.579355+0000","last_fullsized":"2023-12-24T18:52:00.579355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558034+0000","last_change":"2023-12-24T18:52:00.555455+0000","last_active":"2023-12-24T18:52:00.558034+0000","last_peered":"2023-12-24T18:52:00.558034+0000","last_clean":"2023-12-24T18:52:00.558034+0000","last_became_active":"2023-12-24T18:52:00.555156+0000","last_became_peered":"2023-12-24T18:52:00.555156+0000","last_unstale":"2023-12-24T18:52:00.558034+0000","last_undegraded":"2023-12-24T18:52:00.558034+0000","last_fullsized":"2023-12-24T18:52:00.558034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:46.401166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556788+0000","last_change":"2023-12-24T18:52:00.550465+0000","last_active":"2023-12-24T18:52:00.556788+0000","last_peered":"2023-12-24T18:52:00.556788+0000","last_clean":"2023-12-24T18:52:00.556788+0000","last_became_active":"2023-12-24T18:52:00.548715+0000","last_became_peered":"2023-12-24T18:52:00.548715+0000","last_unstale":"2023-12-24T18:52:00.556788+0000","last_undegraded":"2023-12-24T18:52:00.556788+0000","last_fullsized":"2023-12-24T18:52:00.556788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:21.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576024+0000","last_change":"2023-12-24T18:52:00.561472+0000","last_active":"2023-12-24T18:52:00.576024+0000","last_peered":"2023-12-24T18:52:00.576024+0000","last_clean":"2023-12-24T18:52:00.576024+0000","last_became_active":"2023-12-24T18:52:00.561192+0000","last_became_peered":"2023-12-24T18:52:00.561192+0000","last_unstale":"2023-12-24T18:52:00.576024+0000","last_undegraded":"2023-12-24T18:52:00.576024+0000","last_fullsized":"2023-12-24T18:52:00.576024+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.556084+0000","last_change":"2023-12-24T18:52:00.552379+0000","last_active":"2023-12-24T18:52:00.556084+0000","last_peered":"2023-12-24T18:52:00.556084+0000","last_clean":"2023-12-24T18:52:00.556084+0000","last_became_active":"2023-12-24T18:52:00.552096+0000","last_became_peered":"2023-12-24T18:52:00.552096+0000","last_unstale":"2023-12-24T18:52:00.556084+0000","last_undegraded":"2023-12-24T18:52:00.556084+0000","last_fullsized":"2023-12-24T18:52:00.556084+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:21.471127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558190+0000","last_change":"2023-12-24T18:52:00.549039+0000","last_active":"2023-12-24T18:52:00.558190+0000","last_peered":"2023-12-24T18:52:00.558190+0000","last_clean":"2023-12-24T18:52:00.558190+0000","last_became_active":"2023-12-24T18:52:00.548667+0000","last_became_peered":"2023-12-24T18:52:00.548667+0000","last_unstale":"2023-12-24T18:52:00.558190+0000","last_undegraded":"2023-12-24T18:52:00.558190+0000","last_fullsized":"2023-12-24T18:52:00.558190+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:21.389294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563539+0000","last_change":"2023-12-24T18:52:00.558814+0000","last_active":"2023-12-24T18:52:00.563539+0000","last_peered":"2023-12-24T18:52:00.563539+0000","last_clean":"2023-12-24T18:52:00.563539+0000","last_became_active":"2023-12-24T18:52:00.558495+0000","last_became_peered":"2023-12-24T18:52:00.558495+0000","last_unstale":"2023-12-24T18:52:00.563539+0000","last_undegraded":"2023-12-24T18:52:00.563539+0000","last_fullsized":"2023-12-24T18:52:00.563539+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560037+0000","last_change":"2023-12-24T18:52:00.556283+0000","last_active":"2023-12-24T18:52:00.560037+0000","last_peered":"2023-12-24T18:52:00.560037+0000","last_clean":"2023-12-24T18:52:00.560037+0000","last_became_active":"2023-12-24T18:52:00.555540+0000","last_became_peered":"2023-12-24T18:52:00.555540+0000","last_unstale":"2023-12-24T18:52:00.560037+0000","last_undegraded":"2023-12-24T18:52:00.560037+0000","last_fullsized":"2023-12-24T18:52:00.560037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:52.730786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581435+0000","last_change":"2023-12-24T18:52:00.571623+0000","last_active":"2023-12-24T18:52:00.581435+0000","last_peered":"2023-12-24T18:52:00.581435+0000","last_clean":"2023-12-24T18:52:00.581435+0000","last_became_active":"2023-12-24T18:52:00.571367+0000","last_became_peered":"2023-12-24T18:52:00.571367+0000","last_unstale":"2023-12-24T18:52:00.581435+0000","last_undegraded":"2023-12-24T18:52:00.581435+0000","last_fullsized":"2023-12-24T18:52:00.581435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577183+0000","last_change":"2023-12-24T18:52:00.572056+0000","last_active":"2023-12-24T18:52:00.577183+0000","last_peered":"2023-12-24T18:52:00.577183+0000","last_clean":"2023-12-24T18:52:00.577183+0000","last_became_active":"2023-12-24T18:52:00.571638+0000","last_became_peered":"2023-12-24T18:52:00.571638+0000","last_unstale":"2023-12-24T18:52:00.577183+0000","last_undegraded":"2023-12-24T18:52:00.577183+0000","last_fullsized":"2023-12-24T18:52:00.577183+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:47:36.407352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561904+0000","last_change":"2023-12-24T18:52:00.557270+0000","last_active":"2023-12-24T18:52:00.561904+0000","last_peered":"2023-12-24T18:52:00.561904+0000","last_clean":"2023-12-24T18:52:00.561904+0000","last_became_active":"2023-12-24T18:52:00.556889+0000","last_became_peered":"2023-12-24T18:52:00.556889+0000","last_unstale":"2023-12-24T18:52:00.561904+0000","last_undegraded":"2023-12-24T18:52:00.561904+0000","last_fullsized":"2023-12-24T18:52:00.561904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:46:20.212691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.566645+0000","last_change":"2023-12-24T18:52:00.557501+0000","last_active":"2023-12-24T18:52:00.566645+0000","last_peered":"2023-12-24T18:52:00.566645+0000","last_clean":"2023-12-24T18:52:00.566645+0000","last_became_active":"2023-12-24T18:52:00.557177+0000","last_became_peered":"2023-12-24T18:52:00.557177+0000","last_unstale":"2023-12-24T18:52:00.566645+0000","last_undegraded":"2023-12-24T18:52:00.566645+0000","last_fullsized":"2023-12-24T18:52:00.566645+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581494+0000","last_change":"2023-12-24T18:52:00.571058+0000","last_active":"2023-12-24T18:52:00.581494+0000","last_peered":"2023-12-24T18:52:00.581494+0000","last_clean":"2023-12-24T18:52:00.581494+0000","last_became_active":"2023-12-24T18:52:00.570595+0000","last_became_peered":"2023-12-24T18:52:00.570595+0000","last_unstale":"2023-12-24T18:52:00.581494+0000","last_undegraded":"2023-12-24T18:52:00.581494+0000","last_fullsized":"2023-12-24T18:52:00.581494+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:23.145352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558690+0000","last_change":"2023-12-24T18:52:00.553062+0000","last_active":"2023-12-24T18:52:00.558690+0000","last_peered":"2023-12-24T18:52:00.558690+0000","last_clean":"2023-12-24T18:52:00.558690+0000","last_became_active":"2023-12-24T18:52:00.552593+0000","last_became_peered":"2023-12-24T18:52:00.552593+0000","last_unstale":"2023-12-24T18:52:00.558690+0000","last_undegraded":"2023-12-24T18:52:00.558690+0000","last_fullsized":"2023-12-24T18:52:00.558690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:44:59.236442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555279+0000","last_change":"2023-12-24T18:52:00.545139+0000","last_active":"2023-12-24T18:52:00.555279+0000","last_peered":"2023-12-24T18:52:00.555279+0000","last_clean":"2023-12-24T18:52:00.555279+0000","last_became_active":"2023-12-24T18:52:00.544719+0000","last_became_peered":"2023-12-24T18:52:00.544719+0000","last_unstale":"2023-12-24T18:52:00.555279+0000","last_undegraded":"2023-12-24T18:52:00.555279+0000","last_fullsized":"2023-12-24T18:52:00.555279+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:51:16.336737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561577+0000","last_change":"2023-12-24T18:52:00.560496+0000","last_active":"2023-12-24T18:52:00.561577+0000","last_peered":"2023-12-24T18:52:00.561577+0000","last_clean":"2023-12-24T18:52:00.561577+0000","last_became_active":"2023-12-24T18:52:00.560160+0000","last_became_peered":"2023-12-24T18:52:00.560160+0000","last_unstale":"2023-12-24T18:52:00.561577+0000","last_undegraded":"2023-12-24T18:52:00.561577+0000","last_fullsized":"2023-12-24T18:52:00.561577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:25:41.021822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573973+0000","last_change":"2023-12-24T18:52:00.567357+0000","last_active":"2023-12-24T18:52:00.573973+0000","last_peered":"2023-12-24T18:52:00.573973+0000","last_clean":"2023-12-24T18:52:00.573973+0000","last_became_active":"2023-12-24T18:52:00.567065+0000","last_became_peered":"2023-12-24T18:52:00.567065+0000","last_unstale":"2023-12-24T18:52:00.573973+0000","last_undegraded":"2023-12-24T18:52:00.573973+0000","last_fullsized":"2023-12-24T18:52:00.573973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:21.809966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569906+0000","last_change":"2023-12-24T18:52:00.565282+0000","last_active":"2023-12-24T18:52:00.569906+0000","last_peered":"2023-12-24T18:52:00.569906+0000","last_clean":"2023-12-24T18:52:00.569906+0000","last_became_active":"2023-12-24T18:52:00.564944+0000","last_became_peered":"2023-12-24T18:52:00.564944+0000","last_unstale":"2023-12-24T18:52:00.569906+0000","last_undegraded":"2023-12-24T18:52:00.569906+0000","last_fullsized":"2023-12-24T18:52:00.569906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:27.996639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564011+0000","last_change":"2023-12-24T18:52:00.560156+0000","last_active":"2023-12-24T18:52:00.564011+0000","last_peered":"2023-12-24T18:52:00.564011+0000","last_clean":"2023-12-24T18:52:00.564011+0000","last_became_active":"2023-12-24T18:52:00.559835+0000","last_became_peered":"2023-12-24T18:52:00.559835+0000","last_unstale":"2023-12-24T18:52:00.564011+0000","last_undegraded":"2023-12-24T18:52:00.564011+0000","last_fullsized":"2023-12-24T18:52:00.564011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575515+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.575515+0000","last_peered":"2023-12-24T18:52:00.575515+0000","last_clean":"2023-12-24T18:52:00.575515+0000","last_became_active":"2023-12-24T18:52:00.569078+0000","last_became_peered":"2023-12-24T18:52:00.569078+0000","last_unstale":"2023-12-24T18:52:00.575515+0000","last_undegraded":"2023-12-24T18:52:00.575515+0000","last_fullsized":"2023-12-24T18:52:00.575515+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:37.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562883+0000","last_change":"2023-12-24T18:52:00.554636+0000","last_active":"2023-12-24T18:52:00.562883+0000","last_peered":"2023-12-24T18:52:00.562883+0000","last_clean":"2023-12-24T18:52:00.562883+0000","last_became_active":"2023-12-24T18:52:00.554361+0000","last_became_peered":"2023-12-24T18:52:00.554361+0000","last_unstale":"2023-12-24T18:52:00.562883+0000","last_undegraded":"2023-12-24T18:52:00.562883+0000","last_fullsized":"2023-12-24T18:52:00.562883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:00.730392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581456+0000","last_change":"2023-12-24T18:52:00.573300+0000","last_active":"2023-12-24T18:52:00.581456+0000","last_peered":"2023-12-24T18:52:00.581456+0000","last_clean":"2023-12-24T18:52:00.581456+0000","last_became_active":"2023-12-24T18:52:00.573033+0000","last_became_peered":"2023-12-24T18:52:00.573033+0000","last_unstale":"2023-12-24T18:52:00.581456+0000","last_undegraded":"2023-12-24T18:52:00.581456+0000","last_fullsized":"2023-12-24T18:52:00.581456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:06.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583195+0000","last_change":"2023-12-24T18:52:00.578493+0000","last_active":"2023-12-24T18:52:00.583195+0000","last_peered":"2023-12-24T18:52:00.583195+0000","last_clean":"2023-12-24T18:52:00.583195+0000","last_became_active":"2023-12-24T18:52:00.574687+0000","last_became_peered":"2023-12-24T18:52:00.574687+0000","last_unstale":"2023-12-24T18:52:00.583195+0000","last_undegraded":"2023-12-24T18:52:00.583195+0000","last_fullsized":"2023-12-24T18:52:00.583195+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:31.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575109+0000","last_change":"2023-12-24T18:52:00.570902+0000","last_active":"2023-12-24T18:52:00.575109+0000","last_peered":"2023-12-24T18:52:00.575109+0000","last_clean":"2023-12-24T18:52:00.575109+0000","last_became_active":"2023-12-24T18:52:00.570625+0000","last_became_peered":"2023-12-24T18:52:00.570625+0000","last_unstale":"2023-12-24T18:52:00.575109+0000","last_undegraded":"2023-12-24T18:52:00.575109+0000","last_fullsized":"2023-12-24T18:52:00.575109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:05:19.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558760+0000","last_change":"2023-12-24T18:52:00.555017+0000","last_active":"2023-12-24T18:52:00.558760+0000","last_peered":"2023-12-24T18:52:00.558760+0000","last_clean":"2023-12-24T18:52:00.558760+0000","last_became_active":"2023-12-24T18:52:00.554730+0000","last_became_peered":"2023-12-24T18:52:00.554730+0000","last_unstale":"2023-12-24T18:52:00.558760+0000","last_undegraded":"2023-12-24T18:52:00.558760+0000","last_fullsized":"2023-12-24T18:52:00.558760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:27:44.715738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569886+0000","last_change":"2023-12-24T18:52:00.559981+0000","last_active":"2023-12-24T18:52:00.569886+0000","last_peered":"2023-12-24T18:52:00.569886+0000","last_clean":"2023-12-24T18:52:00.569886+0000","last_became_active":"2023-12-24T18:52:00.559686+0000","last_became_peered":"2023-12-24T18:52:00.559686+0000","last_unstale":"2023-12-24T18:52:00.569886+0000","last_undegraded":"2023-12-24T18:52:00.569886+0000","last_fullsized":"2023-12-24T18:52:00.569886+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:02.653377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579860+0000","last_change":"2023-12-24T18:52:00.563821+0000","last_active":"2023-12-24T18:52:00.579860+0000","last_peered":"2023-12-24T18:52:00.579860+0000","last_clean":"2023-12-24T18:52:00.579860+0000","last_became_active":"2023-12-24T18:52:00.562334+0000","last_became_peered":"2023-12-24T18:52:00.562334+0000","last_unstale":"2023-12-24T18:52:00.579860+0000","last_undegraded":"2023-12-24T18:52:00.579860+0000","last_fullsized":"2023-12-24T18:52:00.579860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:17.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572921+0000","last_change":"2023-12-24T18:52:00.570963+0000","last_active":"2023-12-24T18:52:00.572921+0000","last_peered":"2023-12-24T18:52:00.572921+0000","last_clean":"2023-12-24T18:52:00.572921+0000","last_became_active":"2023-12-24T18:52:00.570636+0000","last_became_peered":"2023-12-24T18:52:00.570636+0000","last_unstale":"2023-12-24T18:52:00.572921+0000","last_undegraded":"2023-12-24T18:52:00.572921+0000","last_fullsized":"2023-12-24T18:52:00.572921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:46.621395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.561498+0000","last_change":"2023-12-24T18:52:00.555134+0000","last_active":"2023-12-24T18:52:00.561498+0000","last_peered":"2023-12-24T18:52:00.561498+0000","last_clean":"2023-12-24T18:52:00.561498+0000","last_became_active":"2023-12-24T18:52:00.554827+0000","last_became_peered":"2023-12-24T18:52:00.554827+0000","last_unstale":"2023-12-24T18:52:00.561498+0000","last_undegraded":"2023-12-24T18:52:00.561498+0000","last_fullsized":"2023-12-24T18:52:00.561498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.558630+0000","last_change":"2023-12-24T18:52:00.552873+0000","last_active":"2023-12-24T18:52:00.558630+0000","last_peered":"2023-12-24T18:52:00.558630+0000","last_clean":"2023-12-24T18:52:00.558630+0000","last_became_active":"2023-12-24T18:52:00.552192+0000","last_became_peered":"2023-12-24T18:52:00.552192+0000","last_unstale":"2023-12-24T18:52:00.558630+0000","last_undegraded":"2023-12-24T18:52:00.558630+0000","last_fullsized":"2023-12-24T18:52:00.558630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:32:56.418403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571921+0000","last_change":"2023-12-24T18:52:00.568911+0000","last_active":"2023-12-24T18:52:00.571921+0000","last_peered":"2023-12-24T18:52:00.571921+0000","last_clean":"2023-12-24T18:52:00.571921+0000","last_became_active":"2023-12-24T18:52:00.562331+0000","last_became_peered":"2023-12-24T18:52:00.562331+0000","last_unstale":"2023-12-24T18:52:00.571921+0000","last_undegraded":"2023-12-24T18:52:00.571921+0000","last_fullsized":"2023-12-24T18:52:00.571921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.587142+0000","last_change":"2023-12-24T18:51:59.560513+0000","last_active":"2023-12-24T18:52:00.587142+0000","last_peered":"2023-12-24T18:52:00.587142+0000","last_clean":"2023-12-24T18:52:00.587142+0000","last_became_active":"2023-12-24T18:51:59.560225+0000","last_became_peered":"2023-12-24T18:51:59.560225+0000","last_unstale":"2023-12-24T18:52:00.587142+0000","last_undegraded":"2023-12-24T18:52:00.587142+0000","last_fullsized":"2023-12-24T18:52:00.587142+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:56.229203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.581366+0000","last_change":"2023-12-24T18:52:00.570854+0000","last_active":"2023-12-24T18:52:00.581366+0000","last_peered":"2023-12-24T18:52:00.581366+0000","last_clean":"2023-12-24T18:52:00.581366+0000","last_became_active":"2023-12-24T18:52:00.570282+0000","last_became_peered":"2023-12-24T18:52:00.570282+0000","last_unstale":"2023-12-24T18:52:00.581366+0000","last_undegraded":"2023-12-24T18:52:00.581366+0000","last_fullsized":"2023-12-24T18:52:00.581366+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578388+0000","last_change":"2023-12-24T18:51:59.562783+0000","last_active":"2023-12-24T18:52:00.578388+0000","last_peered":"2023-12-24T18:52:00.578388+0000","last_clean":"2023-12-24T18:52:00.578388+0000","last_became_active":"2023-12-24T18:51:59.562354+0000","last_became_peered":"2023-12-24T18:51:59.562354+0000","last_unstale":"2023-12-24T18:52:00.578388+0000","last_undegraded":"2023-12-24T18:52:00.578388+0000","last_fullsized":"2023-12-24T18:52:00.578388+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:53:48.820902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563607+0000","last_change":"2023-12-24T18:52:00.559045+0000","last_active":"2023-12-24T18:52:00.563607+0000","last_peered":"2023-12-24T18:52:00.563607+0000","last_clean":"2023-12-24T18:52:00.563607+0000","last_became_active":"2023-12-24T18:52:00.558385+0000","last_became_peered":"2023-12-24T18:52:00.558385+0000","last_unstale":"2023-12-24T18:52:00.563607+0000","last_undegraded":"2023-12-24T18:52:00.563607+0000","last_fullsized":"2023-12-24T18:52:00.563607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580249+0000","last_change":"2023-12-24T18:51:59.567098+0000","last_active":"2023-12-24T18:52:00.580249+0000","last_peered":"2023-12-24T18:52:00.580249+0000","last_clean":"2023-12-24T18:52:00.580249+0000","last_became_active":"2023-12-24T18:51:59.566789+0000","last_became_peered":"2023-12-24T18:51:59.566789+0000","last_unstale":"2023-12-24T18:52:00.580249+0000","last_undegraded":"2023-12-24T18:52:00.580249+0000","last_fullsized":"2023-12-24T18:52:00.580249+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:45.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564242+0000","last_change":"2023-12-24T18:52:00.560666+0000","last_active":"2023-12-24T18:52:00.564242+0000","last_peered":"2023-12-24T18:52:00.564242+0000","last_clean":"2023-12-24T18:52:00.564242+0000","last_became_active":"2023-12-24T18:52:00.560152+0000","last_became_peered":"2023-12-24T18:52:00.560152+0000","last_unstale":"2023-12-24T18:52:00.564242+0000","last_undegraded":"2023-12-24T18:52:00.564242+0000","last_fullsized":"2023-12-24T18:52:00.564242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578726+0000","last_change":"2023-12-24T18:51:59.555189+0000","last_active":"2023-12-24T18:52:00.578726+0000","last_peered":"2023-12-24T18:52:00.578726+0000","last_clean":"2023-12-24T18:52:00.578726+0000","last_became_active":"2023-12-24T18:51:59.554890+0000","last_became_peered":"2023-12-24T18:51:59.554890+0000","last_unstale":"2023-12-24T18:52:00.578726+0000","last_undegraded":"2023-12-24T18:52:00.578726+0000","last_fullsized":"2023-12-24T18:52:00.578726+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:10.472948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.577862+0000","last_change":"2023-12-24T18:52:00.565705+0000","last_active":"2023-12-24T18:52:00.577862+0000","last_peered":"2023-12-24T18:52:00.577862+0000","last_clean":"2023-12-24T18:52:00.577862+0000","last_became_active":"2023-12-24T18:52:00.565425+0000","last_became_peered":"2023-12-24T18:52:00.565425+0000","last_unstale":"2023-12-24T18:52:00.577862+0000","last_undegraded":"2023-12-24T18:52:00.577862+0000","last_fullsized":"2023-12-24T18:52:00.577862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578099+0000","last_change":"2023-12-24T18:51:59.557491+0000","last_active":"2023-12-24T18:52:00.578099+0000","last_peered":"2023-12-24T18:52:00.578099+0000","last_clean":"2023-12-24T18:52:00.578099+0000","last_became_active":"2023-12-24T18:51:59.557202+0000","last_became_peered":"2023-12-24T18:51:59.557202+0000","last_unstale":"2023-12-24T18:52:00.578099+0000","last_undegraded":"2023-12-24T18:52:00.578099+0000","last_fullsized":"2023-12-24T18:52:00.578099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:28.870937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571198+0000","last_change":"2023-12-24T18:52:00.564751+0000","last_active":"2023-12-24T18:52:00.571198+0000","last_peered":"2023-12-24T18:52:00.571198+0000","last_clean":"2023-12-24T18:52:00.571198+0000","last_became_active":"2023-12-24T18:52:00.564426+0000","last_became_peered":"2023-12-24T18:52:00.564426+0000","last_unstale":"2023-12-24T18:52:00.571198+0000","last_undegraded":"2023-12-24T18:52:00.571198+0000","last_fullsized":"2023-12-24T18:52:00.571198+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580007+0000","last_change":"2023-12-24T18:51:59.564659+0000","last_active":"2023-12-24T18:52:00.580007+0000","last_peered":"2023-12-24T18:52:00.580007+0000","last_clean":"2023-12-24T18:52:00.580007+0000","last_became_active":"2023-12-24T18:51:59.564138+0000","last_became_peered":"2023-12-24T18:51:59.564138+0000","last_unstale":"2023-12-24T18:52:00.580007+0000","last_undegraded":"2023-12-24T18:52:00.580007+0000","last_fullsized":"2023-12-24T18:52:00.580007+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:23.704122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553008+0000","last_change":"2023-12-24T18:52:00.546644+0000","last_active":"2023-12-24T18:52:00.553008+0000","last_peered":"2023-12-24T18:52:00.553008+0000","last_clean":"2023-12-24T18:52:00.553008+0000","last_became_active":"2023-12-24T18:52:00.546215+0000","last_became_peered":"2023-12-24T18:52:00.546215+0000","last_unstale":"2023-12-24T18:52:00.553008+0000","last_undegraded":"2023-12-24T18:52:00.553008+0000","last_fullsized":"2023-12-24T18:52:00.553008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:58.711200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.563629+0000","last_change":"2023-12-24T18:51:59.567933+0000","last_active":"2023-12-24T18:52:00.563629+0000","last_peered":"2023-12-24T18:52:00.563629+0000","last_clean":"2023-12-24T18:52:00.563629+0000","last_became_active":"2023-12-24T18:51:59.565545+0000","last_became_peered":"2023-12-24T18:51:59.565545+0000","last_unstale":"2023-12-24T18:52:00.563629+0000","last_undegraded":"2023-12-24T18:52:00.563629+0000","last_fullsized":"2023-12-24T18:52:00.563629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:25.410537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544015+0000","last_change":"2023-12-24T18:52:00.540551+0000","last_active":"2023-12-24T18:52:00.544015+0000","last_peered":"2023-12-24T18:52:00.544015+0000","last_clean":"2023-12-24T18:52:00.544015+0000","last_became_active":"2023-12-24T18:52:00.540174+0000","last_became_peered":"2023-12-24T18:52:00.540174+0000","last_unstale":"2023-12-24T18:52:00.544015+0000","last_undegraded":"2023-12-24T18:52:00.544015+0000","last_fullsized":"2023-12-24T18:52:00.544015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:46.701428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533933+0000","last_change":"2023-12-24T18:51:59.555474+0000","last_active":"2023-12-24T18:52:00.533933+0000","last_peered":"2023-12-24T18:52:00.533933+0000","last_clean":"2023-12-24T18:52:00.533933+0000","last_became_active":"2023-12-24T18:51:59.555176+0000","last_became_peered":"2023-12-24T18:51:59.555176+0000","last_unstale":"2023-12-24T18:52:00.533933+0000","last_undegraded":"2023-12-24T18:52:00.533933+0000","last_fullsized":"2023-12-24T18:52:00.533933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:07:49.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573754+0000","last_change":"2023-12-24T18:52:00.563773+0000","last_active":"2023-12-24T18:52:00.573754+0000","last_peered":"2023-12-24T18:52:00.573754+0000","last_clean":"2023-12-24T18:52:00.573754+0000","last_became_active":"2023-12-24T18:52:00.562920+0000","last_became_peered":"2023-12-24T18:52:00.562920+0000","last_unstale":"2023-12-24T18:52:00.573754+0000","last_undegraded":"2023-12-24T18:52:00.573754+0000","last_fullsized":"2023-12-24T18:52:00.573754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:49:12.838585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545785+0000","last_change":"2023-12-24T18:51:59.565593+0000","last_active":"2023-12-24T18:52:00.545785+0000","last_peered":"2023-12-24T18:52:00.545785+0000","last_clean":"2023-12-24T18:52:00.545785+0000","last_became_active":"2023-12-24T18:51:59.564576+0000","last_became_peered":"2023-12-24T18:51:59.564576+0000","last_unstale":"2023-12-24T18:52:00.545785+0000","last_undegraded":"2023-12-24T18:52:00.545785+0000","last_fullsized":"2023-12-24T18:52:00.545785+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:16:08.803893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.559973+0000","last_change":"2023-12-24T18:52:00.556118+0000","last_active":"2023-12-24T18:52:00.559973+0000","last_peered":"2023-12-24T18:52:00.559973+0000","last_clean":"2023-12-24T18:52:00.559973+0000","last_became_active":"2023-12-24T18:52:00.555483+0000","last_became_peered":"2023-12-24T18:52:00.555483+0000","last_unstale":"2023-12-24T18:52:00.559973+0000","last_undegraded":"2023-12-24T18:52:00.559973+0000","last_fullsized":"2023-12-24T18:52:00.559973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:17.010626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.545899+0000","last_change":"2023-12-24T18:51:59.560456+0000","last_active":"2023-12-24T18:52:00.545899+0000","last_peered":"2023-12-24T18:52:00.545899+0000","last_clean":"2023-12-24T18:52:00.545899+0000","last_became_active":"2023-12-24T18:51:59.557516+0000","last_became_peered":"2023-12-24T18:51:59.557516+0000","last_unstale":"2023-12-24T18:52:00.545899+0000","last_undegraded":"2023-12-24T18:52:00.545899+0000","last_fullsized":"2023-12-24T18:52:00.545899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:59.716260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.576047+0000","last_change":"2023-12-24T18:52:00.566554+0000","last_active":"2023-12-24T18:52:00.576047+0000","last_peered":"2023-12-24T18:52:00.576047+0000","last_clean":"2023-12-24T18:52:00.576047+0000","last_became_active":"2023-12-24T18:52:00.565824+0000","last_became_peered":"2023-12-24T18:52:00.565824+0000","last_unstale":"2023-12-24T18:52:00.576047+0000","last_undegraded":"2023-12-24T18:52:00.576047+0000","last_fullsized":"2023-12-24T18:52:00.576047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:26.246699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584722+0000","last_change":"2023-12-24T18:51:59.563834+0000","last_active":"2023-12-24T18:52:00.584722+0000","last_peered":"2023-12-24T18:52:00.584722+0000","last_clean":"2023-12-24T18:52:00.584722+0000","last_became_active":"2023-12-24T18:51:59.563554+0000","last_became_peered":"2023-12-24T18:51:59.563554+0000","last_unstale":"2023-12-24T18:52:00.584722+0000","last_undegraded":"2023-12-24T18:52:00.584722+0000","last_fullsized":"2023-12-24T18:52:00.584722+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:11.764121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571866+0000","last_change":"2023-12-24T18:52:00.568031+0000","last_active":"2023-12-24T18:52:00.571866+0000","last_peered":"2023-12-24T18:52:00.571866+0000","last_clean":"2023-12-24T18:52:00.571866+0000","last_became_active":"2023-12-24T18:52:00.567688+0000","last_became_peered":"2023-12-24T18:52:00.567688+0000","last_unstale":"2023-12-24T18:52:00.571866+0000","last_undegraded":"2023-12-24T18:52:00.571866+0000","last_fullsized":"2023-12-24T18:52:00.571866+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:34.702412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.583974+0000","last_change":"2023-12-24T18:51:59.552298+0000","last_active":"2023-12-24T18:52:00.583974+0000","last_peered":"2023-12-24T18:52:00.583974+0000","last_clean":"2023-12-24T18:52:00.583974+0000","last_became_active":"2023-12-24T18:51:59.551849+0000","last_became_peered":"2023-12-24T18:51:59.551849+0000","last_unstale":"2023-12-24T18:52:00.583974+0000","last_undegraded":"2023-12-24T18:52:00.583974+0000","last_fullsized":"2023-12-24T18:52:00.583974+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:34.496851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560444+0000","last_change":"2023-12-24T18:52:00.557935+0000","last_active":"2023-12-24T18:52:00.560444+0000","last_peered":"2023-12-24T18:52:00.560444+0000","last_clean":"2023-12-24T18:52:00.560444+0000","last_became_active":"2023-12-24T18:52:00.557655+0000","last_became_peered":"2023-12-24T18:52:00.557655+0000","last_unstale":"2023-12-24T18:52:00.560444+0000","last_undegraded":"2023-12-24T18:52:00.560444+0000","last_fullsized":"2023-12-24T18:52:00.560444+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:48.707502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580237+0000","last_change":"2023-12-24T18:51:59.564611+0000","last_active":"2023-12-24T18:52:00.580237+0000","last_peered":"2023-12-24T18:52:00.580237+0000","last_clean":"2023-12-24T18:52:00.580237+0000","last_became_active":"2023-12-24T18:51:59.563284+0000","last_became_peered":"2023-12-24T18:51:59.563284+0000","last_unstale":"2023-12-24T18:52:00.580237+0000","last_undegraded":"2023-12-24T18:52:00.580237+0000","last_fullsized":"2023-12-24T18:52:00.580237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:33.688280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564452+0000","last_change":"2023-12-24T18:52:00.561136+0000","last_active":"2023-12-24T18:52:00.564452+0000","last_peered":"2023-12-24T18:52:00.564452+0000","last_clean":"2023-12-24T18:52:00.564452+0000","last_became_active":"2023-12-24T18:52:00.560835+0000","last_became_peered":"2023-12-24T18:52:00.560835+0000","last_unstale":"2023-12-24T18:52:00.564452+0000","last_undegraded":"2023-12-24T18:52:00.564452+0000","last_fullsized":"2023-12-24T18:52:00.564452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:39.818376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541090+0000","last_change":"2023-12-24T18:51:59.563671+0000","last_active":"2023-12-24T18:52:00.541090+0000","last_peered":"2023-12-24T18:52:00.541090+0000","last_clean":"2023-12-24T18:52:00.541090+0000","last_became_active":"2023-12-24T18:51:59.563139+0000","last_became_peered":"2023-12-24T18:51:59.563139+0000","last_unstale":"2023-12-24T18:52:00.541090+0000","last_undegraded":"2023-12-24T18:52:00.541090+0000","last_fullsized":"2023-12-24T18:52:00.541090+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:37.280782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552563+0000","last_change":"2023-12-24T18:52:00.549471+0000","last_active":"2023-12-24T18:52:00.552563+0000","last_peered":"2023-12-24T18:52:00.552563+0000","last_clean":"2023-12-24T18:52:00.552563+0000","last_became_active":"2023-12-24T18:52:00.546256+0000","last_became_peered":"2023-12-24T18:52:00.546256+0000","last_unstale":"2023-12-24T18:52:00.552563+0000","last_undegraded":"2023-12-24T18:52:00.552563+0000","last_fullsized":"2023-12-24T18:52:00.552563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:22:40.123024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533861+0000","last_change":"2023-12-24T18:51:59.559764+0000","last_active":"2023-12-24T18:52:00.533861+0000","last_peered":"2023-12-24T18:52:00.533861+0000","last_clean":"2023-12-24T18:52:00.533861+0000","last_became_active":"2023-12-24T18:51:59.559483+0000","last_became_peered":"2023-12-24T18:51:59.559483+0000","last_unstale":"2023-12-24T18:52:00.533861+0000","last_undegraded":"2023-12-24T18:52:00.533861+0000","last_fullsized":"2023-12-24T18:52:00.533861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:04:30.523634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560640+0000","last_change":"2023-12-24T18:52:00.557427+0000","last_active":"2023-12-24T18:52:00.560640+0000","last_peered":"2023-12-24T18:52:00.560640+0000","last_clean":"2023-12-24T18:52:00.560640+0000","last_became_active":"2023-12-24T18:52:00.556754+0000","last_became_peered":"2023-12-24T18:52:00.556754+0000","last_unstale":"2023-12-24T18:52:00.560640+0000","last_undegraded":"2023-12-24T18:52:00.560640+0000","last_fullsized":"2023-12-24T18:52:00.560640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:00.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.590899+0000","last_change":"2023-12-24T18:51:59.559686+0000","last_active":"2023-12-24T18:52:00.590899+0000","last_peered":"2023-12-24T18:52:00.590899+0000","last_clean":"2023-12-24T18:52:00.590899+0000","last_became_active":"2023-12-24T18:51:59.559289+0000","last_became_peered":"2023-12-24T18:51:59.559289+0000","last_unstale":"2023-12-24T18:52:00.590899+0000","last_undegraded":"2023-12-24T18:52:00.590899+0000","last_fullsized":"2023-12-24T18:52:00.590899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:45.999020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.574228+0000","last_change":"2023-12-24T18:52:00.568663+0000","last_active":"2023-12-24T18:52:00.574228+0000","last_peered":"2023-12-24T18:52:00.574228+0000","last_clean":"2023-12-24T18:52:00.574228+0000","last_became_active":"2023-12-24T18:52:00.567550+0000","last_became_peered":"2023-12-24T18:52:00.567550+0000","last_unstale":"2023-12-24T18:52:00.574228+0000","last_undegraded":"2023-12-24T18:52:00.574228+0000","last_fullsized":"2023-12-24T18:52:00.574228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:13.121894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578978+0000","last_change":"2023-12-24T18:51:59.569543+0000","last_active":"2023-12-24T18:52:00.578978+0000","last_peered":"2023-12-24T18:52:00.578978+0000","last_clean":"2023-12-24T18:52:00.578978+0000","last_became_active":"2023-12-24T18:51:59.569232+0000","last_became_peered":"2023-12-24T18:51:59.569232+0000","last_unstale":"2023-12-24T18:52:00.578978+0000","last_undegraded":"2023-12-24T18:52:00.578978+0000","last_fullsized":"2023-12-24T18:52:00.578978+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:10.664098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.555712+0000","last_change":"2023-12-24T18:52:00.545358+0000","last_active":"2023-12-24T18:52:00.555712+0000","last_peered":"2023-12-24T18:52:00.555712+0000","last_clean":"2023-12-24T18:52:00.555712+0000","last_became_active":"2023-12-24T18:52:00.544226+0000","last_became_peered":"2023-12-24T18:52:00.544226+0000","last_unstale":"2023-12-24T18:52:00.555712+0000","last_undegraded":"2023-12-24T18:52:00.555712+0000","last_fullsized":"2023-12-24T18:52:00.555712+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:20.865731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.579115+0000","last_change":"2023-12-24T18:51:59.562654+0000","last_active":"2023-12-24T18:52:00.579115+0000","last_peered":"2023-12-24T18:52:00.579115+0000","last_clean":"2023-12-24T18:52:00.579115+0000","last_became_active":"2023-12-24T18:51:59.561839+0000","last_became_peered":"2023-12-24T18:51:59.561839+0000","last_unstale":"2023-12-24T18:52:00.579115+0000","last_undegraded":"2023-12-24T18:52:00.579115+0000","last_fullsized":"2023-12-24T18:52:00.579115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:52.175998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.575534+0000","last_change":"2023-12-24T18:52:00.569871+0000","last_active":"2023-12-24T18:52:00.575534+0000","last_peered":"2023-12-24T18:52:00.575534+0000","last_clean":"2023-12-24T18:52:00.575534+0000","last_became_active":"2023-12-24T18:52:00.569429+0000","last_became_peered":"2023-12-24T18:52:00.569429+0000","last_unstale":"2023-12-24T18:52:00.575534+0000","last_undegraded":"2023-12-24T18:52:00.575534+0000","last_fullsized":"2023-12-24T18:52:00.575534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:47.866668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.584375+0000","last_change":"2023-12-24T18:51:59.556434+0000","last_active":"2023-12-24T18:52:00.584375+0000","last_peered":"2023-12-24T18:52:00.584375+0000","last_clean":"2023-12-24T18:52:00.584375+0000","last_became_active":"2023-12-24T18:51:59.555988+0000","last_became_peered":"2023-12-24T18:51:59.555988+0000","last_unstale":"2023-12-24T18:52:00.584375+0000","last_undegraded":"2023-12-24T18:52:00.584375+0000","last_fullsized":"2023-12-24T18:52:00.584375+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.701812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.568204+0000","last_change":"2023-12-24T18:52:00.563195+0000","last_active":"2023-12-24T18:52:00.568204+0000","last_peered":"2023-12-24T18:52:00.568204+0000","last_clean":"2023-12-24T18:52:00.568204+0000","last_became_active":"2023-12-24T18:52:00.562922+0000","last_became_peered":"2023-12-24T18:52:00.562922+0000","last_unstale":"2023-12-24T18:52:00.568204+0000","last_undegraded":"2023-12-24T18:52:00.568204+0000","last_fullsized":"2023-12-24T18:52:00.568204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:20.599324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547242+0000","last_change":"2023-12-24T18:51:59.567644+0000","last_active":"2023-12-24T18:52:00.547242+0000","last_peered":"2023-12-24T18:52:00.547242+0000","last_clean":"2023-12-24T18:52:00.547242+0000","last_became_active":"2023-12-24T18:51:59.567305+0000","last_became_peered":"2023-12-24T18:51:59.567305+0000","last_unstale":"2023-12-24T18:52:00.547242+0000","last_undegraded":"2023-12-24T18:52:00.547242+0000","last_fullsized":"2023-12-24T18:52:00.547242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:59.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.571736+0000","last_change":"2023-12-24T18:52:00.564644+0000","last_active":"2023-12-24T18:52:00.571736+0000","last_peered":"2023-12-24T18:52:00.571736+0000","last_clean":"2023-12-24T18:52:00.571736+0000","last_became_active":"2023-12-24T18:52:00.562736+0000","last_became_peered":"2023-12-24T18:52:00.562736+0000","last_unstale":"2023-12-24T18:52:00.571736+0000","last_undegraded":"2023-12-24T18:52:00.571736+0000","last_fullsized":"2023-12-24T18:52:00.571736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:47.923390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.586345+0000","last_change":"2023-12-24T18:51:59.563318+0000","last_active":"2023-12-24T18:52:00.586345+0000","last_peered":"2023-12-24T18:52:00.586345+0000","last_clean":"2023-12-24T18:52:00.586345+0000","last_became_active":"2023-12-24T18:51:59.563041+0000","last_became_peered":"2023-12-24T18:51:59.563041+0000","last_unstale":"2023-12-24T18:52:00.586345+0000","last_undegraded":"2023-12-24T18:52:00.586345+0000","last_fullsized":"2023-12-24T18:52:00.586345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:41:02.933403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.580259+0000","last_change":"2023-12-24T18:52:00.569690+0000","last_active":"2023-12-24T18:52:00.580259+0000","last_peered":"2023-12-24T18:52:00.580259+0000","last_clean":"2023-12-24T18:52:00.580259+0000","last_became_active":"2023-12-24T18:52:00.569136+0000","last_became_peered":"2023-12-24T18:52:00.569136+0000","last_unstale":"2023-12-24T18:52:00.580259+0000","last_undegraded":"2023-12-24T18:52:00.580259+0000","last_fullsized":"2023-12-24T18:52:00.580259+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:54.262839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547939+0000","last_change":"2023-12-24T18:51:59.562274+0000","last_active":"2023-12-24T18:52:00.547939+0000","last_peered":"2023-12-24T18:52:00.547939+0000","last_clean":"2023-12-24T18:52:00.547939+0000","last_became_active":"2023-12-24T18:51:59.561873+0000","last_became_peered":"2023-12-24T18:51:59.561873+0000","last_unstale":"2023-12-24T18:52:00.547939+0000","last_undegraded":"2023-12-24T18:52:00.547939+0000","last_fullsized":"2023-12-24T18:52:00.547939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:15.751745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.560734+0000","last_change":"2023-12-24T18:52:00.558328+0000","last_active":"2023-12-24T18:52:00.560734+0000","last_peered":"2023-12-24T18:52:00.560734+0000","last_clean":"2023-12-24T18:52:00.560734+0000","last_became_active":"2023-12-24T18:52:00.557968+0000","last_became_peered":"2023-12-24T18:52:00.557968+0000","last_unstale":"2023-12-24T18:52:00.560734+0000","last_undegraded":"2023-12-24T18:52:00.560734+0000","last_fullsized":"2023-12-24T18:52:00.560734+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:33:18.472395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.547647+0000","last_change":"2023-12-24T18:51:59.565291+0000","last_active":"2023-12-24T18:52:00.547647+0000","last_peered":"2023-12-24T18:52:00.547647+0000","last_clean":"2023-12-24T18:52:00.547647+0000","last_became_active":"2023-12-24T18:51:59.565011+0000","last_became_peered":"2023-12-24T18:51:59.565011+0000","last_unstale":"2023-12-24T18:52:00.547647+0000","last_undegraded":"2023-12-24T18:52:00.547647+0000","last_fullsized":"2023-12-24T18:52:00.547647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:41.268461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.551315+0000","last_change":"2023-12-24T18:52:00.541779+0000","last_active":"2023-12-24T18:52:00.551315+0000","last_peered":"2023-12-24T18:52:00.551315+0000","last_clean":"2023-12-24T18:52:00.551315+0000","last_became_active":"2023-12-24T18:52:00.541478+0000","last_became_peered":"2023-12-24T18:52:00.541478+0000","last_unstale":"2023-12-24T18:52:00.551315+0000","last_undegraded":"2023-12-24T18:52:00.551315+0000","last_fullsized":"2023-12-24T18:52:00.551315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:56:11.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.578326+0000","last_change":"2023-12-24T18:51:59.561838+0000","last_active":"2023-12-24T18:52:00.578326+0000","last_peered":"2023-12-24T18:52:00.578326+0000","last_clean":"2023-12-24T18:52:00.578326+0000","last_became_active":"2023-12-24T18:51:59.561517+0000","last_became_peered":"2023-12-24T18:51:59.561517+0000","last_unstale":"2023-12-24T18:52:00.578326+0000","last_undegraded":"2023-12-24T18:52:00.578326+0000","last_fullsized":"2023-12-24T18:52:00.578326+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:31.948199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552526+0000","last_change":"2023-12-24T18:52:00.548971+0000","last_active":"2023-12-24T18:52:00.552526+0000","last_peered":"2023-12-24T18:52:00.552526+0000","last_clean":"2023-12-24T18:52:00.552526+0000","last_became_active":"2023-12-24T18:52:00.548657+0000","last_became_peered":"2023-12-24T18:52:00.548657+0000","last_unstale":"2023-12-24T18:52:00.552526+0000","last_undegraded":"2023-12-24T18:52:00.552526+0000","last_fullsized":"2023-12-24T18:52:00.552526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:54:53.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-12-24T18:52:01.756498+0000","last_change":"2023-12-24T18:51:59.566224+0000","last_active":"2023-12-24T18:52:01.756498+0000","last_peered":"2023-12-24T18:52:01.756498+0000","last_clean":"2023-12-24T18:52:01.756498+0000","last_became_active":"2023-12-24T18:51:59.565918+0000","last_became_peered":"2023-12-24T18:51:59.565918+0000","last_unstale":"2023-12-24T18:52:01.756498+0000","last_undegraded":"2023-12-24T18:52:01.756498+0000","last_fullsized":"2023-12-24T18:52:01.756498+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.607263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.562776+0000","last_change":"2023-12-24T18:52:00.553610+0000","last_active":"2023-12-24T18:52:00.562776+0000","last_peered":"2023-12-24T18:52:00.562776+0000","last_clean":"2023-12-24T18:52:00.562776+0000","last_became_active":"2023-12-24T18:52:00.553340+0000","last_became_peered":"2023-12-24T18:52:00.553340+0000","last_unstale":"2023-12-24T18:52:00.562776+0000","last_undegraded":"2023-12-24T18:52:00.562776+0000","last_fullsized":"2023-12-24T18:52:00.562776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:32:38.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.544682+0000","last_change":"2023-12-24T18:51:59.565113+0000","last_active":"2023-12-24T18:52:00.544682+0000","last_peered":"2023-12-24T18:52:00.544682+0000","last_clean":"2023-12-24T18:52:00.544682+0000","last_became_active":"2023-12-24T18:51:59.564760+0000","last_became_peered":"2023-12-24T18:51:59.564760+0000","last_unstale":"2023-12-24T18:52:00.544682+0000","last_undegraded":"2023-12-24T18:52:00.544682+0000","last_fullsized":"2023-12-24T18:52:00.544682+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:00.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.573848+0000","last_change":"2023-12-24T18:52:00.563547+0000","last_active":"2023-12-24T18:52:00.573848+0000","last_peered":"2023-12-24T18:52:00.573848+0000","last_clean":"2023-12-24T18:52:00.573848+0000","last_became_active":"2023-12-24T18:52:00.563170+0000","last_became_peered":"2023-12-24T18:52:00.563170+0000","last_unstale":"2023-12-24T18:52:00.573848+0000","last_undegraded":"2023-12-24T18:52:00.573848+0000","last_fullsized":"2023-12-24T18:52:00.573848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:57:07.005934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541426+0000","last_change":"2023-12-24T18:51:59.562638+0000","last_active":"2023-12-24T18:52:00.541426+0000","last_peered":"2023-12-24T18:52:00.541426+0000","last_clean":"2023-12-24T18:52:00.541426+0000","last_became_active":"2023-12-24T18:51:59.562343+0000","last_became_peered":"2023-12-24T18:51:59.562343+0000","last_unstale":"2023-12-24T18:52:00.541426+0000","last_undegraded":"2023-12-24T18:52:00.541426+0000","last_fullsized":"2023-12-24T18:52:00.541426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:38.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.553042+0000","last_change":"2023-12-24T18:52:00.549045+0000","last_active":"2023-12-24T18:52:00.553042+0000","last_peered":"2023-12-24T18:52:00.553042+0000","last_clean":"2023-12-24T18:52:00.553042+0000","last_became_active":"2023-12-24T18:52:00.548766+0000","last_became_peered":"2023-12-24T18:52:00.548766+0000","last_unstale":"2023-12-24T18:52:00.553042+0000","last_undegraded":"2023-12-24T18:52:00.553042+0000","last_fullsized":"2023-12-24T18:52:00.553042+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:44:29.885069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.533318+0000","last_change":"2023-12-24T18:51:59.558150+0000","last_active":"2023-12-24T18:52:00.533318+0000","last_peered":"2023-12-24T18:52:00.533318+0000","last_clean":"2023-12-24T18:52:00.533318+0000","last_became_active":"2023-12-24T18:51:59.557796+0000","last_became_peered":"2023-12-24T18:51:59.557796+0000","last_unstale":"2023-12-24T18:52:00.533318+0000","last_undegraded":"2023-12-24T18:52:00.533318+0000","last_fullsized":"2023-12-24T18:52:00.533318+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:21:27.849190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.557046+0000","last_change":"2023-12-24T18:52:00.554275+0000","last_active":"2023-12-24T18:52:00.557046+0000","last_peered":"2023-12-24T18:52:00.557046+0000","last_clean":"2023-12-24T18:52:00.557046+0000","last_became_active":"2023-12-24T18:52:00.553218+0000","last_became_peered":"2023-12-24T18:52:00.553218+0000","last_unstale":"2023-12-24T18:52:00.557046+0000","last_undegraded":"2023-12-24T18:52:00.557046+0000","last_fullsized":"2023-12-24T18:52:00.557046+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:29.884462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.535757+0000","last_change":"2023-12-24T18:51:59.561581+0000","last_active":"2023-12-24T18:52:00.535757+0000","last_peered":"2023-12-24T18:52:00.535757+0000","last_clean":"2023-12-24T18:52:00.535757+0000","last_became_active":"2023-12-24T18:51:59.559809+0000","last_became_peered":"2023-12-24T18:51:59.559809+0000","last_unstale":"2023-12-24T18:52:00.535757+0000","last_undegraded":"2023-12-24T18:52:00.535757+0000","last_fullsized":"2023-12-24T18:52:00.535757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:20.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.572125+0000","last_change":"2023-12-24T18:52:00.571033+0000","last_active":"2023-12-24T18:52:00.572125+0000","last_peered":"2023-12-24T18:52:00.572125+0000","last_clean":"2023-12-24T18:52:00.572125+0000","last_became_active":"2023-12-24T18:52:00.570672+0000","last_became_peered":"2023-12-24T18:52:00.570672+0000","last_unstale":"2023-12-24T18:52:00.572125+0000","last_undegraded":"2023-12-24T18:52:00.572125+0000","last_fullsized":"2023-12-24T18:52:00.572125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:24.718254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.537177+0000","last_change":"2023-12-24T18:51:59.552749+0000","last_active":"2023-12-24T18:52:00.537177+0000","last_peered":"2023-12-24T18:52:00.537177+0000","last_clean":"2023-12-24T18:52:00.537177+0000","last_became_active":"2023-12-24T18:51:59.552333+0000","last_became_peered":"2023-12-24T18:51:59.552333+0000","last_unstale":"2023-12-24T18:52:00.537177+0000","last_undegraded":"2023-12-24T18:52:00.537177+0000","last_fullsized":"2023-12-24T18:52:00.537177+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:42.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.569740+0000","last_change":"2023-12-24T18:52:00.565285+0000","last_active":"2023-12-24T18:52:00.569740+0000","last_peered":"2023-12-24T18:52:00.569740+0000","last_clean":"2023-12-24T18:52:00.569740+0000","last_became_active":"2023-12-24T18:52:00.561876+0000","last_became_peered":"2023-12-24T18:52:00.561876+0000","last_unstale":"2023-12-24T18:52:00.569740+0000","last_undegraded":"2023-12-24T18:52:00.569740+0000","last_fullsized":"2023-12-24T18:52:00.569740+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:52:48.763063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.546993+0000","last_change":"2023-12-24T18:51:59.568249+0000","last_active":"2023-12-24T18:52:00.546993+0000","last_peered":"2023-12-24T18:52:00.546993+0000","last_clean":"2023-12-24T18:52:00.546993+0000","last_became_active":"2023-12-24T18:51:59.565524+0000","last_became_peered":"2023-12-24T18:51:59.565524+0000","last_unstale":"2023-12-24T18:52:00.546993+0000","last_undegraded":"2023-12-24T18:52:00.546993+0000","last_fullsized":"2023-12-24T18:52:00.546993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:02:28.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.564200+0000","last_change":"2023-12-24T18:52:00.562853+0000","last_active":"2023-12-24T18:52:00.564200+0000","last_peered":"2023-12-24T18:52:00.564200+0000","last_clean":"2023-12-24T18:52:00.564200+0000","last_became_active":"2023-12-24T18:52:00.562558+0000","last_became_peered":"2023-12-24T18:52:00.562558+0000","last_unstale":"2023-12-24T18:52:00.564200+0000","last_undegraded":"2023-12-24T18:52:00.564200+0000","last_fullsized":"2023-12-24T18:52:00.564200+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:59.519750+0000","last_clean_scrub_stamp":"2023-12-24T18:51:59.519750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:47.013152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.552006+0000","last_change":"2023-12-24T18:51:59.556251+0000","last_active":"2023-12-24T18:52:00.552006+0000","last_peered":"2023-12-24T18:52:00.552006+0000","last_clean":"2023-12-24T18:52:00.552006+0000","last_became_active":"2023-12-24T18:51:59.555893+0000","last_became_peered":"2023-12-24T18:51:59.555893+0000","last_unstale":"2023-12-24T18:52:00.552006+0000","last_undegraded":"2023-12-24T18:52:00.552006+0000","last_fullsized":"2023-12-24T18:52:00.552006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:51:58.505618+0000","last_clean_scrub_stamp":"2023-12-24T18:51:58.505618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:34.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":459,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-12-24T18:52:00.541591+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:52:00.541591+0000","last_peered":"2023-12-24T18:52:00.541591+0000","last_clean":"2023-12-24T18:52:00.541591+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:52:00.541591+0000","last_undegraded":"2023-12-24T18:52:00.541591+0000","last_fullsized":"2023-12-24T18:52:00.541591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311308,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060532,"statfs":{"total":96636764160,"available":96317984768,"internally_reserved":0,"allocated":1773568,"data_stored":1183638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.329}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.47},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":1.385}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.53}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.038}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":1.0149999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.2689999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306640,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065200,"statfs":{"total":96636764160,"available":96322764800,"internally_reserved":0,"allocated":1187840,"data_stored":594784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6220000000000001,"5min":1.788,"15min":1.788},"last":1.196},{"interface":"front","average":{"1min":1.22,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1120000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1279999999999999,"15min":1.1599999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6060000000000001,"5min":1.667,"15min":1.667},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.21,"5min":1.2050000000000001,"15min":1.1990000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.599,"5min":1.7390000000000001,"15min":1.748},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1499999999999999,"15min":1.1659999999999999},"min":{"1min":0.72899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4610000000000001,"5min":1.542,"15min":3.609},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.232,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.5640000000000001,"5min":1.794,"15min":2.0259999999999998},"last":0.92100000000000004}]},{"osd":3,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2509999999999999,"15min":1.26},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.655,"5min":1.6659999999999999,"15min":1.867},"last":1.228},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":0.73799999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"max":{"1min":1.4330000000000001,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.3140000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1870000000000001,"15min":1.202},"min":{"1min":0.67300000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.5129999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.274,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.65200000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.0470000000000002},"last":1.1659999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.2,"15min":1.2290000000000001},"min":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":4.2779999999999996},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3320000000000001,"15min":1.351},"min":{"1min":0.85999999999999999,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":1.669,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.264}]},{"osd":7,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3740000000000001,"15min":1.3919999999999999},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.73999999999999999},"max":{"1min":1.9950000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.29},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":0.97599999999999998,"5min":0.80800000000000005,"15min":0.58799999999999997},"max":{"1min":1.536,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302536,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069304,"statfs":{"total":96636764160,"available":96326967296,"internally_reserved":0,"allocated":1179648,"data_stored":593282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.1479999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.25}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.77600000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.341},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":0.877}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.1160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302552,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069288,"statfs":{"total":96636764160,"available":96326950912,"internally_reserved":0,"allocated":1196032,"data_stored":594888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":1.038}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":1.494},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.355}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.206},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.534}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":1.323},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":1.0860000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.169},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.4339999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":1.379},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2869999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.23},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.575}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306632,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065208,"statfs":{"total":96636764160,"available":96322772992,"internally_reserved":0,"allocated":1179648,"data_stored":593802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.119}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.7649999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.2809999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":1.5}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":1.6659999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.569},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":1.5389999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":1.369},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.4039999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310736,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061104,"statfs":{"total":96636764160,"available":96318570496,"internally_reserved":0,"allocated":1187840,"data_stored":593962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":0.629},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":1.1779999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":0.96399999999999997}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":0.80800000000000005}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":1.224},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.4610000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.286},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.0800000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.5129999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302540,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069300,"statfs":{"total":96636764160,"available":96326963200,"internally_reserved":0,"allocated":1183744,"data_stored":593360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":0.83699999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.046}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.1990000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":1.014},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.1499999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.115}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.3},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.284}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.349},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.4199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307208,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064632,"statfs":{"total":96636764160,"available":96322183168,"internally_reserved":0,"allocated":1769472,"data_stored":1183616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":0.629},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.0169999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.349}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.0620000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":0.86199999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:10.116 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:52:10.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:52:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.333+0000 7f6192e0c700 1 Processor -- start 2023-12-24T18:52:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.333+0000 7f6192e0c700 1 -- start start 2023-12-24T18:52:10.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6192e0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f618c159020 0x7f618c0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6192e0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6192e0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c0caa60 con 0x7f618c158c50 2023-12-24T18:52:10.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6192e0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c0af430 con 0x7f618c159020 2023-12-24T18:52:10.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6192e0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c159450 con 0x7f618c0cccd0 2023-12-24T18:52:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6191609700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f618c159020 0x7f618c0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f619260b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f619260b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:41400/0 (socket says 172.21.15.50:41400) 2023-12-24T18:52:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f619260b700 1 -- 172.21.15.50:0/2378057883 learned_addr learned my addr 172.21.15.50:0/2378057883 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.337+0000 7f6191e0a700 1 --1- 172.21.15.50:0/2378057883 >> v1:172.21.15.82:6789/0 conn(0x7f618c158c50 0x7f618c0caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:55916/0 (socket says 172.21.15.50:55916) 2023-12-24T18:52:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f619260b700 1 -- 172.21.15.50:0/2378057883 >> v2:172.21.15.50:3300/0 conn(0x7f618c159020 msgr2=0x7f618c0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f619260b700 1 --2- 172.21.15.50:0/2378057883 >> v2:172.21.15.50:3300/0 conn(0x7f618c159020 0x7f618c0cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f619260b700 1 -- 172.21.15.50:0/2378057883 >> v1:172.21.15.82:6789/0 conn(0x7f618c158c50 legacy=0x7f618c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f619260b700 1 -- 172.21.15.50:0/2378057883 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0cee80 con 0x7f618c0cccd0 2023-12-24T18:52:10.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f619260b700 1 --2- 172.21.15.50:0/2378057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6184009f20 tx=0x7f6184009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a010be90d6815dd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6190e08700 1 -- 172.21.15.50:0/2378057883 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400e070 con 0x7f618c0cccd0 2023-12-24T18:52:10.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6190e08700 1 -- 172.21.15.50:0/2378057883 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400b9d0 con 0x7f618c0cccd0 2023-12-24T18:52:10.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6190e08700 1 -- 172.21.15.50:0/2378057883 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61840092e0 con 0x7f618c0cccd0 2023-12-24T18:52:10.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 -- 172.21.15.50:0/2378057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 msgr2=0x7f618c0afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2378057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6184009f20 tx=0x7f6184009840 comp rx=0 tx=0).stop 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 -- 172.21.15.50:0/2378057883 shutdown_connections 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2378057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c0cccd0 0x7f618c0afd30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2378057883 >> v2:172.21.15.50:3300/0 conn(0x7f618c159020 0x7f618c0cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 -- 172.21.15.50:0/2378057883 >> 172.21.15.50:0/2378057883 conn(0x7f618c0670b0 msgr2=0x7f618c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 -- 172.21.15.50:0/2378057883 shutdown_connections 2023-12-24T18:52:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.341+0000 7f6192e0c700 1 -- 172.21.15.50:0/2378057883 wait complete. 2023-12-24T18:52:10.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.345+0000 7f6192e0c700 1 Processor -- start 2023-12-24T18:52:10.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.345+0000 7f6192e0c700 1 -- start start 2023-12-24T18:52:10.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c158c50 0x7f618c16d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c159020 0x7f618c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0b4790 con 0x7f618c0cccd0 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c16dcd0 con 0x7f618c158c50 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c16dfb0 con 0x7f618c159020 2023-12-24T18:52:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34906/0 (socket says 172.21.15.50:34906) 2023-12-24T18:52:10.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191609700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c158c50 0x7f618c16d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 -- 172.21.15.50:0/2945151387 learned_addr learned my addr 172.21.15.50:0/2945151387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:10.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f619260b700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c159020 0x7f618c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 -- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c159020 msgr2=0x7f618c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c159020 0x7f618c15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 -- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c158c50 msgr2=0x7f618c16d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c158c50 0x7f618c16d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 -- 172.21.15.50:0/2945151387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184009ae0 con 0x7f618c0cccd0 2023-12-24T18:52:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6191e0a700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f618800c7c0 tx=0x7f6188007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188005a70 con 0x7f618c0cccd0 2023-12-24T18:52:10.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188005bd0 con 0x7f618c0cccd0 2023-12-24T18:52:10.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c16e290 con 0x7f618c0cccd0 2023-12-24T18:52:10.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880070d0 con 0x7f618c0cccd0 2023-12-24T18:52:10.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.349+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c16d9c0 con 0x7f618c0cccd0 2023-12-24T18:52:10.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.353+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c04be40 con 0x7f618c0cccd0 2023-12-24T18:52:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.353+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6188007480 con 0x7f618c0cccd0 2023-12-24T18:52:10.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.357+0000 7f6181ffb700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 0x7f6170062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.357+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f618807bee0 con 0x7f618c0cccd0 2023-12-24T18:52:10.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.357+0000 7f6191609700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 0x7f6170062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.357+0000 7f6191609700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 0x7f6170062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f618c067730 tx=0x7f617c0091a0 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.361+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f618804c170 con 0x7f618c0cccd0 2023-12-24T18:52:10.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.597+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f618c0cdd20 con 0x7f618c0cccd0 2023-12-24T18:52:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.605+0000 7f6181ffb700 1 -- 172.21.15.50:0/2945151387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f618804f790 con 0x7f618c0cccd0 2023-12-24T18:52:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 msgr2=0x7f6170062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 0x7f6170062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f618c067730 tx=0x7f617c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 msgr2=0x7f618c0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f618800c7c0 tx=0x7f6188007f70 comp rx=0 tx=0).stop 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 shutdown_connections 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6170060550 0x7f6170062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f618c159020 0x7f618c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c158c50 0x7f618c16d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 --2- 172.21.15.50:0/2945151387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f618c0cccd0 0x7f618c0c3e10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 >> 172.21.15.50:0/2945151387 conn(0x7f618c0670b0 msgr2=0x7f618c1582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 shutdown_connections 2023-12-24T18:52:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.609+0000 7f6192e0c700 1 -- 172.21.15.50:0/2945151387 wait complete. 2023-12-24T18:52:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:52:10.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.809+0000 7f9df2745700 1 Processor -- start 2023-12-24T18:52:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.809+0000 7f9df2745700 1 -- start start 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9df2745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9dec159bc0 0x7f9dec159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9df2745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dec06bce0 0x7f9dec0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9df2745700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec06b850 con 0x7f9dec0ab040 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9df2745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec06ac40 con 0x7f9dec06bce0 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9df2745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec06af20 con 0x7f9dec159bc0 2023-12-24T18:52:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dec06bce0 0x7f9dec0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dec06bce0 0x7f9dec0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34912/0 (socket says 172.21.15.50:34912) 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 -- 172.21.15.50:0/1550575117 learned_addr learned my addr 172.21.15.50:0/1550575117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9debfff700 1 --2- 172.21.15.50:0/1550575117 >> v2:172.21.15.82:3300/0 conn(0x7f9dec159bc0 0x7f9dec159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 -- 172.21.15.50:0/1550575117 >> v2:172.21.15.82:3300/0 conn(0x7f9dec159bc0 msgr2=0x7f9dec159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 --2- 172.21.15.50:0/1550575117 >> v2:172.21.15.82:3300/0 conn(0x7f9dec159bc0 0x7f9dec159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 -- 172.21.15.50:0/1550575117 >> v1:172.21.15.82:6789/0 conn(0x7f9dec0ab040 legacy=0x7f9dec0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 -- 172.21.15.50:0/1550575117 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec06b200 con 0x7f9dec06bce0 2023-12-24T18:52:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deb7fe700 1 --2- 172.21.15.50:0/1550575117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec06bce0 0x7f9dec0aab00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9dec069ce0 tx=0x7f9de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1186a7d278cd8dfa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deaffd700 1 -- 172.21.15.50:0/1550575117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009e70 con 0x7f9dec06bce0 2023-12-24T18:52:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deaffd700 1 -- 172.21.15.50:0/1550575117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000b860 con 0x7f9dec06bce0 2023-12-24T18:52:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.813+0000 7f9deaffd700 1 -- 172.21.15.50:0/1550575117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000bc00 con 0x7f9dec06bce0 2023-12-24T18:52:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- 172.21.15.50:0/1550575117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec06bce0 msgr2=0x7f9dec0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 --2- 172.21.15.50:0/1550575117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec06bce0 0x7f9dec0aab00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9dec069ce0 tx=0x7f9de0009250 comp rx=0 tx=0).stop 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- 172.21.15.50:0/1550575117 shutdown_connections 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 --2- 172.21.15.50:0/1550575117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec06bce0 0x7f9dec0aab00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 --2- 172.21.15.50:0/1550575117 >> v2:172.21.15.82:3300/0 conn(0x7f9dec159bc0 0x7f9dec159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- 172.21.15.50:0/1550575117 >> 172.21.15.50:0/1550575117 conn(0x7f9dec0cbba0 msgr2=0x7f9dec0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- 172.21.15.50:0/1550575117 shutdown_connections 2023-12-24T18:52:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- 172.21.15.50:0/1550575117 wait complete. 2023-12-24T18:52:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 Processor -- start 2023-12-24T18:52:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.817+0000 7f9df2745700 1 -- start start 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9dec06bce0 0x7f9dec141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec159bc0 0x7f9dec0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec169640 con 0x7f9dec0ab040 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1424c0 con 0x7f9dec159bc0 2023-12-24T18:52:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0af220 con 0x7f9dec06bce0 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34916/0 (socket says 172.21.15.50:34916) 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 -- 172.21.15.50:0/670730284 learned_addr learned my addr 172.21.15.50:0/670730284 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9debfff700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9dec06bce0 0x7f9dec141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df0ce2700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec159bc0 0x7f9dec0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 -- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9dec06bce0 msgr2=0x7f9dec141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9dec06bce0 0x7f9dec141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 -- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec159bc0 msgr2=0x7f9dec0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec159bc0 0x7f9dec0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 -- 172.21.15.50:0/670730284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00094f0 con 0x7f9dec0ab040 2023-12-24T18:52:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9deb7fe700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011420 con 0x7f9dec0ab040 2023-12-24T18:52:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00115a0 con 0x7f9dec0ab040 2023-12-24T18:52:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec169e90 con 0x7f9dec0ab040 2023-12-24T18:52:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011960 con 0x7f9dec0ab040 2023-12-24T18:52:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.821+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec16dba0 con 0x7f9dec0ab040 2023-12-24T18:52:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.825+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec0aefa0 con 0x7f9dec0ab040 2023-12-24T18:52:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.825+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9de00253f0 con 0x7f9dec0ab040 2023-12-24T18:52:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.829+0000 7f9dd3fff700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 0x7f9dd8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.829+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f9de007e4d0 con 0x7f9dec0ab040 2023-12-24T18:52:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.829+0000 7f9debfff700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 0x7f9dd8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.829+0000 7f9debfff700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 0x7f9dd8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009d40 tx=0x7f9ddc008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:10.833+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9de004e760 con 0x7f9dec0ab040 2023-12-24T18:52:11.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.045+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dec06b510 con 0x7f9dec0ab040 2023-12-24T18:52:11.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.045+0000 7f9dd3fff700 1 -- 172.21.15.50:0/670730284 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f9de0051d80 con 0x7f9dec0ab040 2023-12-24T18:52:11.047 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:11.047 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 msgr2=0x7f9dd8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 0x7f9dd8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009d40 tx=0x7f9ddc008040 comp rx=0 tx=0).stop 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 msgr2=0x7f9dec16d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 shutdown_connections 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f9dd8060550 0x7f9dd8062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec159bc0 0x7f9dec0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dec0ab040 0x7f9dec16d660 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 --2- 172.21.15.50:0/670730284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9dec06bce0 0x7f9dec141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 >> 172.21.15.50:0/670730284 conn(0x7f9dec0cbba0 msgr2=0x7f9dec0c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 shutdown_connections 2023-12-24T18:52:11.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.049+0000 7f9df2745700 1 -- 172.21.15.50:0/670730284 wait complete. 2023-12-24T18:52:11.055 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:11.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:52:00.007856+0000', 'modified': '2023-12-24T18:52:03.581610+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6834}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6834': {'gid': 6834, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6837/2320390789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6835', 'nonce': 2320390789}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 2320390789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:52:11.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:52:11.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T18:52:11.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.649+0000 7f592f2f0700 1 Processor -- start 2023-12-24T18:52:11.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.649+0000 7f592f2f0700 1 -- start start 2023-12-24T18:52:11.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59280c9810 0x7f59280c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5928158b70 0x7f5928158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592806bf00 con 0x7f59280c8970 2023-12-24T18:52:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280ac2a0 con 0x7f59280c9810 2023-12-24T18:52:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592f2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592806ba70 con 0x7f5928158b70 2023-12-24T18:52:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592c88b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59280c9810 0x7f59280c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592c88b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34928/0 (socket says 172.21.15.50:34928) 2023-12-24T18:52:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d88d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5928158b70 0x7f5928158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592c88b700 1 -- 172.21.15.50:0/655782016 learned_addr learned my addr 172.21.15.50:0/655782016 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 -- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5928158b70 msgr2=0x7f5928158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 --2- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5928158b70 0x7f5928158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 -- 172.21.15.50:0/655782016 >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 msgr2=0x7f59280abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 --2- 172.21.15.50:0/655782016 >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592d08c700 1 -- 172.21.15.50:0/655782016 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592806b140 con 0x7f59280c9810 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.653+0000 7f592c88b700 1 --2- 172.21.15.50:0/655782016 >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:11.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.657+0000 7f592d08c700 1 --2- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c9810 0x7f59280c9be0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f592806a6d0 tx=0x7f59240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0e0b152bbc47ae server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f591ffff700 1 -- 172.21.15.50:0/655782016 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924011630 con 0x7f59280c9810 2023-12-24T18:52:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f591ffff700 1 -- 172.21.15.50:0/655782016 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59240117b0 con 0x7f59280c9810 2023-12-24T18:52:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f591ffff700 1 -- 172.21.15.50:0/655782016 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924011b70 con 0x7f59280c9810 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 -- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c9810 msgr2=0x7f59280c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 --2- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c9810 0x7f59280c9be0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f592806a6d0 tx=0x7f59240091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 -- 172.21.15.50:0/655782016 shutdown_connections 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 --2- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5928158b70 0x7f5928158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 --2- 172.21.15.50:0/655782016 >> v2:172.21.15.50:3300/0 conn(0x7f59280c8970 0x7f59280abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 --2- 172.21.15.50:0/655782016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c9810 0x7f59280c9be0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 -- 172.21.15.50:0/655782016 >> 172.21.15.50:0/655782016 conn(0x7f59280ccf30 msgr2=0x7f59280c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 -- 172.21.15.50:0/655782016 shutdown_connections 2023-12-24T18:52:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.661+0000 7f592f2f0700 1 -- 172.21.15.50:0/655782016 wait complete. 2023-12-24T18:52:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.665+0000 7f592f2f0700 1 Processor -- start 2023-12-24T18:52:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.665+0000 7f592f2f0700 1 -- start start 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 0x7f59281547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 0x7f59280aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b1b10 con 0x7f5928158b70 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b0f40 con 0x7f59280c8970 2023-12-24T18:52:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b11e0 con 0x7f59280c9810 2023-12-24T18:52:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34938/0 (socket says 172.21.15.50:34938) 2023-12-24T18:52:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 -- 172.21.15.50:0/4199955121 learned_addr learned my addr 172.21.15.50:0/4199955121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592c88b700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 0x7f59280aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d08c700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 0x7f59281547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 -- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 msgr2=0x7f59280aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 0x7f59280aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 -- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 msgr2=0x7f59281547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 0x7f59281547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 -- 172.21.15.50:0/4199955121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180094f0 con 0x7f5928158b70 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592c88b700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 0x7f59280aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d08c700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 0x7f59281547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592d88d700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5920009df0 tx=0x7f592000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f591d7fa700 1 -- 172.21.15.50:0/4199955121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000cb50 con 0x7f5928158b70 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f591d7fa700 1 -- 172.21.15.50:0/4199955121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000f040 con 0x7f5928158b70 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f591d7fa700 1 -- 172.21.15.50:0/4199955121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920014480 con 0x7f5928158b70 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5924009420 con 0x7f5928158b70 2023-12-24T18:52:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.669+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280b17a0 con 0x7f5928158b70 2023-12-24T18:52:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f591d7fa700 1 -- 172.21.15.50:0/4199955121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5920014830 con 0x7f5928158b70 2023-12-24T18:52:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f591d7fa700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 0x7f590c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f591d7fa700 1 -- 172.21.15.50:0/4199955121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f592007d7c0 con 0x7f5928158b70 2023-12-24T18:52:11.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f592d08c700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 0x7f590c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f59315d9740 1 Processor -- start 2023-12-24T18:52:11.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.677+0000 7f59315d9740 1 -- start start 2023-12-24T18:52:11.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d08c700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 0x7f590c062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f592806a6d0 tx=0x7f5924017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x210bae0 0x2388f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x2389440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b6f30 con 0x2156790 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b2ed0 con 0x210b710 2023-12-24T18:52:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x22790b0 con 0x210bae0 2023-12-24T18:52:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34952/0 (socket says 172.21.15.50:34952) 2023-12-24T18:52:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 -- 172.21.15.50:0/541358009 learned_addr learned my addr 172.21.15.50:0/541358009 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592c88b700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x2389440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d08c700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x210bae0 0x2388f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 -- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x210bae0 msgr2=0x2388f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x210bae0 0x2388f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 -- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 msgr2=0x2389440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x2389440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 -- 172.21.15.50:0/541358009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21579e0 con 0x2156790 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592c88b700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x2389440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f592d88d700 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f592004dc10 tx=0x7f592007b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a8401b0773a1a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59127fc700 1 -- 172.21.15.50:0/541358009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920066070 con 0x2156790 2023-12-24T18:52:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59127fc700 1 -- 172.21.15.50:0/541358009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920051710 con 0x2156790 2023-12-24T18:52:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59127fc700 1 -- 172.21.15.50:0/541358009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592004fab0 con 0x2156790 2023-12-24T18:52:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- 172.21.15.50:0/541358009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 msgr2=0x2389980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f592004dc10 tx=0x7f592007b8e0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- 172.21.15.50:0/541358009 shutdown_connections 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2156790 0x2389980 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x2389440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 --2- 172.21.15.50:0/541358009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x210bae0 0x2388f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.681+0000 7f59315d9740 1 -- 172.21.15.50:0/541358009 >> 172.21.15.50:0/541358009 conn(0x210beb0 msgr2=0x2345930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- 172.21.15.50:0/541358009 shutdown_connections 2023-12-24T18:52:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- 172.21.15.50:0/541358009 wait complete. 2023-12-24T18:52:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- start start 2023-12-24T18:52:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 Processor -- start 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x238d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x236ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2278d50 con 0x210bae0 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2251970 con 0x210b710 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2261e00 con 0x2156790 2023-12-24T18:52:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f59315d9740 10 client.0 _ll_register_callbacks cb 0x22fc6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:52:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34962/0 (socket says 172.21.15.50:34962) 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 -- 172.21.15.50:0/3952116750 learned_addr learned my addr 172.21.15.50:0/3952116750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592d88d700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x236ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592d08c700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x238d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 -- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 msgr2=0x236ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x236ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 -- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 msgr2=0x238d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x238d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.685+0000 7f592c88b700 1 -- 172.21.15.50:0/3952116750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280b17a0 con 0x210bae0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f592c88b700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f59180136f0 tx=0x7f5918008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22401a0333d7b44c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918016670 con 0x210bae0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2251cc0 con 0x210bae0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f59180167d0 con 0x210bae0 2023-12-24T18:52:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5918016ba0 con 0x210bae0 2023-12-24T18:52:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 10 client.7002 fetch_fsmap learned FSMap version 44 2023-12-24T18:52:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x2281370 con 0x210bae0 2023-12-24T18:52:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2251cc0 con 0x210bae0 2023-12-24T18:52:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5918016d00 con 0x210bae0 2023-12-24T18:52:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 10 client.7002 fetch_fsmap finished waiting for FSMap version 44 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 10 client.7002 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 20 client.7002 populate_metadata read hostname 'smithi050' 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2370250 0x23986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 4 client.7002 mds_command: new command op to 6834 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 --> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22553e0 con 0x2370250 2023-12-24T18:52:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f592d08c700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2370250 0x23986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f592d08c700 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2370250 0x23986b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e438596ece19567 server_cookie=20bee8a3283d5a4 in_seq=0 out_seq=0 2023-12-24T18:52:11.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.689+0000 7f59077fe700 10 client.7002 ms_handle_connect on v2:172.21.15.50:6835/2320390789 2023-12-24T18:52:11.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59077fe700 1 -- 172.21.15.50:0/3952116750 <== mds.0 v2:172.21.15.50:6835/2320390789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x22553e0 con 0x2370250 2023-12-24T18:52:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59077fe700 10 client.7002 handle_command_reply: tid=0 2023-12-24T18:52:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 client.7002 shutdown 2023-12-24T18:52:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 msgr2=0x238dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f59180136f0 tx=0x7f5918008040 comp rx=0 tx=0).stop 2023-12-24T18:52:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 shutdown_connections 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x236ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2370250 0x23986b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210bae0 0x238dad0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 --2- 172.21.15.50:0/3952116750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210b710 0x238d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 >> 172.21.15.50:0/3952116750 conn(0x210beb0 msgr2=0x233df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59077fe700 0 client.7002 ms_handle_reset on v2:172.21.15.50:6835/2320390789 2023-12-24T18:52:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 shutdown_connections 2023-12-24T18:52:11.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 1 -- 172.21.15.50:0/3952116750 wait complete. 2023-12-24T18:52:11.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.693+0000 7f59315d9740 20 client.7002 trim_cache size 0 max 16384 2023-12-24T18:52:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.713+0000 7f59315d9740 1 Processor -- start 2023-12-24T18:52:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.713+0000 7f59315d9740 1 -- start start 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x236e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23886e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2340ea0 con 0x210b710 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b5590 con 0x210bae0 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2286040 con 0x2156790 2023-12-24T18:52:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34976/0 (socket says 172.21.15.50:34976) 2023-12-24T18:52:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 -- 172.21.15.50:0/2799427112 learned_addr learned my addr 172.21.15.50:0/2799427112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592c88b700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x236e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d88d700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 -- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 msgr2=0x23886e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23886e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 -- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 msgr2=0x236e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x236e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 -- 172.21.15.50:0/2799427112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2267d80 con 0x210b710 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d88d700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f592d08c700 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5924013000 tx=0x7f5924029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70350e33959c30ba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f5912ffd700 1 -- 172.21.15.50:0/2799427112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924020070 con 0x210b710 2023-12-24T18:52:11.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f5912ffd700 1 -- 172.21.15.50:0/2799427112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592402d070 con 0x210b710 2023-12-24T18:52:11.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.717+0000 7f5912ffd700 1 -- 172.21.15.50:0/2799427112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592401a780 con 0x210b710 2023-12-24T18:52:11.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- 172.21.15.50:0/2799427112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 msgr2=0x236dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5924013000 tx=0x7f5924029040 comp rx=0 tx=0).stop 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- 172.21.15.50:0/2799427112 shutdown_connections 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x236e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 --2- 172.21.15.50:0/2799427112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x236dce0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- 172.21.15.50:0/2799427112 >> 172.21.15.50:0/2799427112 conn(0x210beb0 msgr2=0x233f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- 172.21.15.50:0/2799427112 shutdown_connections 2023-12-24T18:52:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- 172.21.15.50:0/2799427112 wait complete. 2023-12-24T18:52:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 -- start start 2023-12-24T18:52:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.721+0000 7f59315d9740 1 Processor -- start 2023-12-24T18:52:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x23e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2253b80 con 0x210b710 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b69d0 con 0x210bae0 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2109430 con 0x2156790 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 10 client.0 _ll_register_callbacks cb 0x20d79d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34990/0 (socket says 172.21.15.50:34990) 2023-12-24T18:52:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 -- 172.21.15.50:0/1411874737 learned_addr learned my addr 172.21.15.50:0/1411874737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592c88b700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x23e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d88d700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 -- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 msgr2=0x23424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 -- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 msgr2=0x23e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x23e33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 -- 172.21.15.50:0/1411874737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592806b140 con 0x210b710 2023-12-24T18:52:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f592d08c700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5924006d60 tx=0x7f5924035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89e6cc7af793880 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59077fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:52:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924020040 con 0x210b710 2023-12-24T18:52:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f592401ae00 con 0x210b710 2023-12-24T18:52:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5928151a90 con 0x210b710 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.725+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59240346c0 con 0x210b710 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 10 client.7008 fetch_fsmap learned FSMap version 44 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x225c130 con 0x210b710 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928151a90 con 0x210b710 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5924046d20 con 0x210b710 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 10 client.7008 fetch_fsmap finished waiting for FSMap version 44 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 10 client.7008 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 20 client.7008 populate_metadata read hostname 'smithi050' 2023-12-24T18:52:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2342e80 0x2343250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 4 client.7008 mds_command: new command op to 6834 tid=0[{"prefix": "status"}] 2023-12-24T18:52:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 --> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f5920051710 con 0x2342e80 2023-12-24T18:52:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f592c88b700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2342e80 0x2343250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 10 client.7008 ms_handle_connect on v2:172.21.15.50:6835/2320390789 2023-12-24T18:52:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f592c88b700 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2342e80 0x2343250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8df6cc4654097f server_cookie=f6efa41982424b4d in_seq=0 out_seq=0 2023-12-24T18:52:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 1 -- 172.21.15.50:0/1411874737 <== mds.0 v2:172.21.15.50:6835/2320390789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f5920051710 con 0x2342e80 2023-12-24T18:52:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 10 client.7008 handle_command_reply: tid=0 2023-12-24T18:52:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 client.7008 shutdown 2023-12-24T18:52:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 msgr2=0x23e2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5924006d60 tx=0x7f5924035000 comp rx=0 tx=0).stop 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 shutdown_connections 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x2156790 0x23424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x210bae0 0x23e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:6835/2320390789,v1:172.21.15.50:6837/2320390789] conn(0x2342e80 0x2343250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 --2- 172.21.15.50:0/1411874737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x210b710 0x23e2eb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 >> 172.21.15.50:0/1411874737 conn(0x210beb0 msgr2=0x236c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59077fe700 0 client.7008 ms_handle_reset on v2:172.21.15.50:6835/2320390789 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 shutdown_connections 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.729+0000 7f59315d9740 1 -- 172.21.15.50:0/1411874737 wait complete. 2023-12-24T18:52:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f59315d9740 20 client.7008 trim_cache size 0 max 16384 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6834, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.184102594000001, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 44, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 96, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 96, 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.109773126 2023-12-24T18:52:11.735 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:52:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 msgr2=0x7f590c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 0x7f590c062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f592806a6d0 tx=0x7f5924017000 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 msgr2=0x7f592815ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5920009df0 tx=0x7f592000b040 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 shutdown_connections 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f590c060550 0x7f590c062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928158b70 0x7f592815ef00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59280c9810 0x7f59280aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 --2- 172.21.15.50:0/4199955121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59280c8970 0x7f59281547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 >> 172.21.15.50:0/4199955121 conn(0x7f59280ccf30 msgr2=0x7f5928157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 shutdown_connections 2023-12-24T18:52:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.733+0000 7f592f2f0700 1 -- 172.21.15.50:0/4199955121 wait complete. 2023-12-24T18:52:11.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:52:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 Processor -- start 2023-12-24T18:52:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 -- start start 2023-12-24T18:52:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46a80ae100 0x7f46a8161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a806c4d0 con 0x7f46a806c820 2023-12-24T18:52:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a806c1f0 con 0x7f46a81611b0 2023-12-24T18:52:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ae20c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a80ab5e0 con 0x7f46a80ae100 2023-12-24T18:52:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ada0b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46a806c820 0x7f46a80ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53702/0 (socket says 172.21.15.50:53702) 2023-12-24T18:52:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.925+0000 7f46ada0b700 1 -- 172.21.15.50:0/1796255403 learned_addr learned my addr 172.21.15.50:0/1796255403 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46aca09700 1 --2- 172.21.15.50:0/1796255403 >> v2:172.21.15.50:3300/0 conn(0x7f46a80ae100 0x7f46a8161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308168415 0 0) 0x7f46a0001490 con 0x7f46a806c820 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694003570 con 0x7f46a806c820 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46aca09700 1 -- 172.21.15.50:0/1796255403 >> v1:172.21.15.82:6789/0 conn(0x7f46a81611b0 legacy=0x7f46a806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212281011 0 0) 0x7f46a806c1f0 con 0x7f46a81611b0 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46aca09700 1 -- 172.21.15.50:0/1796255403 >> v1:172.21.15.50:6789/0 conn(0x7f46a806c820 legacy=0x7f46a80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46aca09700 1 -- 172.21.15.50:0/1796255403 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80ab8c0 con 0x7f46a80ae100 2023-12-24T18:52:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46aca09700 1 --2- 172.21.15.50:0/1796255403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a80ae100 0x7f46a8161580 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f46980098e0 tx=0x7f46980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58083231a444d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800b640 con 0x7f46a80ae100 2023-12-24T18:52:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800b7a0 con 0x7f46a80ae100 2023-12-24T18:52:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f469ffff700 1 -- 172.21.15.50:0/1796255403 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800bb40 con 0x7f46a80ae100 2023-12-24T18:52:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46ae20c700 1 -- 172.21.15.50:0/1796255403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a80ae100 msgr2=0x7f46a8161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46ae20c700 1 --2- 172.21.15.50:0/1796255403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a80ae100 0x7f46a8161580 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f46980098e0 tx=0x7f46980091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46ae20c700 1 -- 172.21.15.50:0/1796255403 shutdown_connections 2023-12-24T18:52:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46ae20c700 1 --2- 172.21.15.50:0/1796255403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a80ae100 0x7f46a8161580 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.929+0000 7f46ae20c700 1 -- 172.21.15.50:0/1796255403 >> 172.21.15.50:0/1796255403 conn(0x7f46a8067b80 msgr2=0x7f46a80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.933+0000 7f46ae20c700 1 -- 172.21.15.50:0/1796255403 shutdown_connections 2023-12-24T18:52:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.933+0000 7f46ae20c700 1 -- 172.21.15.50:0/1796255403 wait complete. 2023-12-24T18:52:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.933+0000 7f46ae20c700 1 Processor -- start 2023-12-24T18:52:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 -- start start 2023-12-24T18:52:11.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46a806c820 0x7f46a816e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 0x7f46a80a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a816fbd0 con 0x7f46a81611b0 2023-12-24T18:52:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a816e7e0 con 0x7f46a80ae100 2023-12-24T18:52:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ae20c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80a9f10 con 0x7f46a806c820 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35002/0 (socket says 172.21.15.50:35002) 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 -- 172.21.15.50:0/2136214349 learned_addr learned my addr 172.21.15.50:0/2136214349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46aca09700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 0x7f46a80a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ad20a700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46a806c820 0x7f46a816e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 -- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46a806c820 msgr2=0x7f46a816e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46a806c820 0x7f46a816e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 -- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 msgr2=0x7f46a80a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 0x7f46a80a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 -- 172.21.15.50:0/2136214349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009420 con 0x7f46a81611b0 2023-12-24T18:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46aca09700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 0x7f46a80a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.937+0000 7f46ada0b700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f46a000cc40 tx=0x7f46a0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000a8b0 con 0x7f46a81611b0 2023-12-24T18:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000aa10 con 0x7f46a81611b0 2023-12-24T18:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000ad90 con 0x7f46a81611b0 2023-12-24T18:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a816efc0 con 0x7f46a81611b0 2023-12-24T18:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a816f580 con 0x7f46a81611b0 2023-12-24T18:52:11.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.941+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a816fd40 con 0x7f46a81611b0 2023-12-24T18:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.945+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f46a0007300 con 0x7f46a81611b0 2023-12-24T18:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.945+0000 7f469d7fa700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 0x7f468c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.945+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f46a007ccb0 con 0x7f46a81611b0 2023-12-24T18:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.945+0000 7f46ad20a700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 0x7f468c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.949+0000 7f46ad20a700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 0x7f468c062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46a4007fd0 tx=0x7f46a4007d30 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:11.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:11.953+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f46a004cfc0 con 0x7f46a81611b0 2023-12-24T18:52:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.165+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46a806c4d0 con 0x7f46a81611b0 2023-12-24T18:52:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.165+0000 7f469d7fa700 1 -- 172.21.15.50:0/2136214349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f46a806c4d0 con 0x7f46a81611b0 2023-12-24T18:52:12.168 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 msgr2=0x7f468c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 0x7f468c062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46a4007fd0 tx=0x7f46a4007d30 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 msgr2=0x7f46a80aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f46a000cc40 tx=0x7f46a0001a30 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 shutdown_connections 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f468c060550 0x7f468c062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a81611b0 0x7f46a80aed10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46a80ae100 0x7f46a80a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 --2- 172.21.15.50:0/2136214349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46a806c820 0x7f46a816e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 >> 172.21.15.50:0/2136214349 conn(0x7f46a8067b80 msgr2=0x7f46a8157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:12.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 shutdown_connections 2023-12-24T18:52:12.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:12.169+0000 7f46ae20c700 1 -- 172.21.15.50:0/2136214349 wait complete. 2023-12-24T18:52:12.190 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:52:12.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:52:12.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:52:12.190 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:52:12.191 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:12.191 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:52:12.191 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:52:12.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:52:12.191 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.191 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.214 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41478sec preferred_lft 41478sec 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:52:12.215 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:52:12.216 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:52:12.217 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:12.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.218 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:52:12.304 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:52:12.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.308 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:52:12.370 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:52:12.370 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:52:12.371 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:52:12.371 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:52:12.371 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:52:12.371 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:52:12.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.371 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:52:12.371 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:52:12.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:52:12.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:52:12.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:52:12.372 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:52:12.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.518 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:52:12.536 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:52:12.536 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:52:12.537 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:12.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:52:12.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:52:12.619 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:12.678 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:12.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:52:12.679 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:12.740 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:52:12.740 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:52:12.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:12.862 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:12.863 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:52:12.887 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:12.887 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:52:12.887 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:52:12.887 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:52:12.887 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:52:12.892 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:52:12.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:12.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:12.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:52:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.149+0000 7fc3c108e700 1 Processor -- start 2023-12-24T18:52:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.149+0000 7fc3c108e700 1 -- start start 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c108e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c108e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3bc06d8c0 0x7fc3bc0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c108e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc06b640 con 0x7fc3bc06a580 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c108e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc159710 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c108e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b5e10 con 0x7fc3bc158e00 2023-12-24T18:52:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c088d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3bc06a580 0x7fc3bc06c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53704/0 (socket says 172.21.15.50:53704) 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3c088d700 1 -- 172.21.15.50:0/1661853927 learned_addr learned my addr 172.21.15.50:0/1661853927 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3bc06d8c0 0x7fc3bc0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bbfff700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3baffd700 1 -- 172.21.15.50:0/1661853927 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990270108 0 0) 0x7fc3bc06b640 con 0x7fc3bc06a580 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3baffd700 1 -- 172.21.15.50:0/1661853927 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a4003570 con 0x7fc3bc06a580 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 -- 172.21.15.50:0/1661853927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 msgr2=0x7fc3bc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 -- 172.21.15.50:0/1661853927 >> v1:172.21.15.50:6789/0 conn(0x7fc3bc06a580 legacy=0x7fc3bc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 -- 172.21.15.50:0/1661853927 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc06b8e0 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bbfff700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3bb7fe700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc0b3ad0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00098e0 tx=0x7fc3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179c81d4e9ade071 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3baffd700 1 -- 172.21.15.50:0/1661853927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0011630 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3baffd700 1 -- 172.21.15.50:0/1661853927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0011790 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.153+0000 7fc3baffd700 1 -- 172.21.15.50:0/1661853927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0011b30 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- 172.21.15.50:0/1661853927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06d8c0 msgr2=0x7fc3bc0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc0b3ad0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00098e0 tx=0x7fc3b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- 172.21.15.50:0/1661853927 shutdown_connections 2023-12-24T18:52:13.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc0b3ad0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- 172.21.15.50:0/1661853927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- 172.21.15.50:0/1661853927 >> 172.21.15.50:0/1661853927 conn(0x7fc3bc067b80 msgr2=0x7fc3bc0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:13.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- 172.21.15.50:0/1661853927 shutdown_connections 2023-12-24T18:52:13.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- 172.21.15.50:0/1661853927 wait complete. 2023-12-24T18:52:13.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 Processor -- start 2023-12-24T18:52:13.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- start start 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc14dab0 con 0x7fc3bc06a580 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc15bcd0 con 0x7fc3bc06d8c0 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.157+0000 7fc3c108e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc15b0c0 con 0x7fc3bc158e00 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35022/0 (socket says 172.21.15.50:35022) 2023-12-24T18:52:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 -- 172.21.15.50:0/3474277215 learned_addr learned my addr 172.21.15.50:0/3474277215 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3c088d700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bb7fe700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 -- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 msgr2=0x7fc3bc15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 -- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3bc06d8c0 msgr2=0x7fc3bc15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 -- 172.21.15.50:0/3474277215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac009420 con 0x7fc3bc06a580 2023-12-24T18:52:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3bbfff700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00ec80 tx=0x7fc3ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac00c9d0 con 0x7fc3bc06a580 2023-12-24T18:52:13.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac00cb30 con 0x7fc3bc06a580 2023-12-24T18:52:13.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac00ceb0 con 0x7fc3bc06a580 2023-12-24T18:52:13.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b0009420 con 0x7fc3bc06a580 2023-12-24T18:52:13.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc15b680 con 0x7fc3bc06a580 2023-12-24T18:52:13.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.161+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc15ae10 con 0x7fc3bc06a580 2023-12-24T18:52:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.165+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc3ac013680 con 0x7fc3bc06a580 2023-12-24T18:52:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.165+0000 7fc3a3fff700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 0x7fc3a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.165+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fc3ac07ceb0 con 0x7fc3bc06a580 2023-12-24T18:52:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.165+0000 7fc3bb7fe700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 0x7fc3a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.169+0000 7fc3bb7fe700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 0x7fc3a8062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00091e0 tx=0x7fc3b0017000 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.173+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3ac04d140 con 0x7fc3bc06a580 2023-12-24T18:52:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.369+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3bc04be40 con 0x7fc3a8060550 2023-12-24T18:52:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3a3fff700 1 -- 172.21.15.50:0/3474277215 <== mgr.6639 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc3bc04be40 con 0x7fc3a8060550 2023-12-24T18:52:13.374 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:52:13.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:13.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:52:13.374 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:13.374 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 msgr2=0x7fc3a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 0x7fc3a8062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00091e0 tx=0x7fc3b0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 msgr2=0x7fc3bc14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00ec80 tx=0x7fc3ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 shutdown_connections 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fc3a8060550 0x7fc3a8062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3bc158e00 0x7fc3bc15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3bc06d8c0 0x7fc3bc15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 --2- 172.21.15.50:0/3474277215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06a580 0x7fc3bc14d570 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 >> 172.21.15.50:0/3474277215 conn(0x7fc3bc067b80 msgr2=0x7fc3bc0b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 shutdown_connections 2023-12-24T18:52:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.373+0000 7fc3c108e700 1 -- 172.21.15.50:0/3474277215 wait complete. 2023-12-24T18:52:13.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:52:13.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.577+0000 7f364359e700 1 Processor -- start 2023-12-24T18:52:13.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.577+0000 7f364359e700 1 -- start start 2023-12-24T18:52:13.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3644158c40 0x7f36440cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f364406d450 0x7f36440ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364406a580 con 0x7f36440cc780 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36440cd110 con 0x7f364406d450 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364406a7d0 con 0x7f3644158c40 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f364406d450 0x7f36440ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f364406d450 0x7f36440ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35032/0 (socket says 172.21.15.50:35032) 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 -- 172.21.15.50:0/2697827060 learned_addr learned my addr 172.21.15.50:0/2697827060 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:13.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f364259c700 1 --2- 172.21.15.50:0/2697827060 >> v2:172.21.15.82:3300/0 conn(0x7f3644158c40 0x7f36440cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 -- 172.21.15.50:0/2697827060 >> v2:172.21.15.82:3300/0 conn(0x7f3644158c40 msgr2=0x7f36440cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:13.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 --2- 172.21.15.50:0/2697827060 >> v2:172.21.15.82:3300/0 conn(0x7f3644158c40 0x7f36440cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 -- 172.21.15.50:0/2697827060 >> v1:172.21.15.82:6789/0 conn(0x7f36440cc780 legacy=0x7f364406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 -- 172.21.15.50:0/2697827060 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364406aab0 con 0x7f364406d450 2023-12-24T18:52:13.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3642d9d700 1 --2- 172.21.15.50:0/2697827060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f364406d450 0x7f36440ccbd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3644069f90 tx=0x7f363c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80535d63c11d1fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3641d9b700 1 -- 172.21.15.50:0/2697827060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c009e70 con 0x7f364406d450 2023-12-24T18:52:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3641d9b700 1 -- 172.21.15.50:0/2697827060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00b860 con 0x7f364406d450 2023-12-24T18:52:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.581+0000 7f3641d9b700 1 -- 172.21.15.50:0/2697827060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00bc00 con 0x7f364406d450 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- 172.21.15.50:0/2697827060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f364406d450 msgr2=0x7f36440ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- 172.21.15.50:0/2697827060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f364406d450 0x7f36440ccbd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3644069f90 tx=0x7f363c009250 comp rx=0 tx=0).stop 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- 172.21.15.50:0/2697827060 shutdown_connections 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- 172.21.15.50:0/2697827060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f364406d450 0x7f36440ccbd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- 172.21.15.50:0/2697827060 >> v2:172.21.15.82:3300/0 conn(0x7f3644158c40 0x7f36440cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- 172.21.15.50:0/2697827060 >> 172.21.15.50:0/2697827060 conn(0x7f36440d0800 msgr2=0x7f36440b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:13.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- 172.21.15.50:0/2697827060 shutdown_connections 2023-12-24T18:52:13.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- 172.21.15.50:0/2697827060 wait complete. 2023-12-24T18:52:13.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 Processor -- start 2023-12-24T18:52:13.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- start start 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 0x7f3644143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36440cc780 0x7f364415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644143d70 con 0x7f3644158c40 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364416a5c0 con 0x7f364406d450 2023-12-24T18:52:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f364359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364416a000 con 0x7f36440cc780 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.585+0000 7f3642d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35038/0 (socket says 172.21.15.50:35038) 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 -- 172.21.15.50:0/1235642920 learned_addr learned my addr 172.21.15.50:0/1235642920 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f364259c700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 0x7f3644143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3639d9b700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36440cc780 0x7f364415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 -- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36440cc780 msgr2=0x7f364415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36440cc780 0x7f364415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 -- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 msgr2=0x7f3644143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 0x7f3644143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 -- 172.21.15.50:0/1235642920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0094f0 con 0x7f3644158c40 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f364259c700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 0x7f3644143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f3642d9d700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f363c009290 tx=0x7f363c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011420 con 0x7f3644158c40 2023-12-24T18:52:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0115a0 con 0x7f3644158c40 2023-12-24T18:52:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011960 con 0x7f3644158c40 2023-12-24T18:52:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364416a2e0 con 0x7f3644158c40 2023-12-24T18:52:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364415a3f0 con 0x7f3644158c40 2023-12-24T18:52:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.589+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364415a610 con 0x7f3644158c40 2023-12-24T18:52:13.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.593+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 38) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f363c011cd0 con 0x7f3644158c40 2023-12-24T18:52:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.593+0000 7f363affd700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 0x7f3624062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.593+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f363c07e4e0 con 0x7f3644158c40 2023-12-24T18:52:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.593+0000 7f364259c700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 0x7f3624062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:13.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.593+0000 7f364259c700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 0x7f3624062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3634009ce0 tx=0x7f3634008040 comp rx=0 tx=0).ready entity=mgr.6639 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.601+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f363c04e7b0 con 0x7f3644158c40 2023-12-24T18:52:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:13.813+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f364404be40 con 0x7f3644158c40 2023-12-24T18:52:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.697+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 39) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f363c04eb80 con 0x7f3644158c40 2023-12-24T18:52:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.697+0000 7f363affd700 1 -- 172.21.15.50:0/1235642920 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7f363c0253f0 con 0x7f3644158c40 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 msgr2=0x7f3624062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 0x7f3624062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3634009ce0 tx=0x7f3634008040 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 msgr2=0x7f3644169690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f363c009290 tx=0x7f363c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 shutdown_connections 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f3624060550 0x7f3624062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3644158c40 0x7f3644169690 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36440cc780 0x7f364415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 --2- 172.21.15.50:0/1235642920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364406d450 0x7f3644143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 >> 172.21.15.50:0/1235642920 conn(0x7f36440d0800 msgr2=0x7f3644157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 shutdown_connections 2023-12-24T18:52:14.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.701+0000 7f364359e700 1 -- 172.21.15.50:0/1235642920 wait complete. 2023-12-24T18:52:14.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:52:14.878 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:14.874+0000 7f11432f3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:14.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 Processor -- start 2023-12-24T18:52:14.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 -- start start 2023-12-24T18:52:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0cbc158e00 0x7f0cbc0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cbc06c820 0x7f0cbc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc0b3fd0 con 0x7f0cbc06a710 2023-12-24T18:52:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0b33c0 con 0x7f0cbc06c820 2023-12-24T18:52:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.889+0000 7f0cc1878700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0b36a0 con 0x7f0cbc158e00 2023-12-24T18:52:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0cbc158e00 0x7f0cbc0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cbc06a710 0x7f0cbc06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53728/0 (socket says 172.21.15.50:53728) 2023-12-24T18:52:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbb7fe700 1 -- 172.21.15.50:0/2343625746 learned_addr learned my addr 172.21.15.50:0/2343625746 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cb27fc700 1 --2- 172.21.15.50:0/2343625746 >> v2:172.21.15.50:3300/0 conn(0x7f0cbc06c820 0x7f0cbc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2343625746 >> v2:172.21.15.50:3300/0 conn(0x7f0cbc06c820 msgr2=0x7f0cbc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 --2- 172.21.15.50:0/2343625746 >> v2:172.21.15.50:3300/0 conn(0x7f0cbc06c820 0x7f0cbc0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2343625746 >> v1:172.21.15.50:6789/0 conn(0x7f0cbc06a710 legacy=0x7f0cbc06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2343625746 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0b3980 con 0x7f0cbc158e00 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cbaffd700 1 --2- 172.21.15.50:0/2343625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc0b2de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc06f8c0 tx=0x7f0cac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237748984aa16b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cba7fc700 1 -- 172.21.15.50:0/2343625746 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac011630 con 0x7f0cbc158e00 2023-12-24T18:52:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cba7fc700 1 -- 172.21.15.50:0/2343625746 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac011790 con 0x7f0cbc158e00 2023-12-24T18:52:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cba7fc700 1 -- 172.21.15.50:0/2343625746 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac011b30 con 0x7f0cbc158e00 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 -- 172.21.15.50:0/2343625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 msgr2=0x7f0cbc0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2343625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc0b2de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc06f8c0 tx=0x7f0cac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 -- 172.21.15.50:0/2343625746 shutdown_connections 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2343625746 >> v2:172.21.15.50:3300/0 conn(0x7f0cbc06c820 0x7f0cbc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2343625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc0b2de0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 -- 172.21.15.50:0/2343625746 >> 172.21.15.50:0/2343625746 conn(0x7f0cbc067b80 msgr2=0x7f0cbc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 -- 172.21.15.50:0/2343625746 shutdown_connections 2023-12-24T18:52:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.893+0000 7f0cc1878700 1 -- 172.21.15.50:0/2343625746 wait complete. 2023-12-24T18:52:14.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.897+0000 7f0cc1878700 1 Processor -- start 2023-12-24T18:52:14.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.897+0000 7f0cc1878700 1 -- start start 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.897+0000 7f0cc1878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cbc06c820 0x7f0cbc14b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc168e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc1513c0 con 0x7f0cbc06a710 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc156020 con 0x7f0cbc158e00 2023-12-24T18:52:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc14b920 con 0x7f0cbc06c820 2023-12-24T18:52:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35064/0 (socket says 172.21.15.50:35064) 2023-12-24T18:52:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2861372925 learned_addr learned my addr 172.21.15.50:0/2861372925 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbb7fe700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cb27fc700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cbc06c820 0x7f0cbc14b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cbc06c820 msgr2=0x7f0cbc14b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cbc06c820 0x7f0cbc14b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 msgr2=0x7f0cbc168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 -- 172.21.15.50:0/2861372925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac009420 con 0x7f0cbc06a710 2023-12-24T18:52:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cbaffd700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0b37e0 tx=0x7f0cac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac000d10 con 0x7f0cbc06a710 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac011b10 con 0x7f0cbc06a710 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc1504f0 con 0x7f0cbc06a710 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac025640 con 0x7f0cbc06a710 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc150ab0 con 0x7f0cbc06a710 2023-12-24T18:52:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.901+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc0652e0 con 0x7f0cbc06a710 2023-12-24T18:52:14.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.905+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 39) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f0cac025a30 con 0x7f0cbc06a710 2023-12-24T18:52:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.905+0000 7f0cb37fe700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 0x7f0c9c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:14.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.905+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f0cac07e230 con 0x7f0cbc06a710 2023-12-24T18:52:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.905+0000 7f0cb27fc700 1 -- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 msgr2=0x7f0c9c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.905+0000 7f0cb27fc700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 0x7f0c9c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:14.909 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:14.905+0000 7fd6ad510000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:14.913+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cac04e560 con 0x7f0cbc06a710 2023-12-24T18:52:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.085+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0cbc15d1a0 con 0x7f0cbc06a710 2023-12-24T18:52:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.093+0000 7f0cb37fe700 1 -- 172.21.15.50:0/2861372925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0cac051b80 con 0x7f0cbc06a710 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 msgr2=0x7f0c9c062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 0x7f0c9c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 msgr2=0x7f0cbc150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0b37e0 tx=0x7f0cac017000 comp rx=0 tx=0).stop 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 shutdown_connections 2023-12-24T18:52:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0c9c0605a0 0x7f0c9c062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc158e00 0x7f0cbc168e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cbc06c820 0x7f0cbc14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 --2- 172.21.15.50:0/2861372925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cbc06a710 0x7f0cbc150e80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 >> 172.21.15.50:0/2861372925 conn(0x7f0cbc067b80 msgr2=0x7f0cbc15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 shutdown_connections 2023-12-24T18:52:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.097+0000 7f0cc1878700 1 -- 172.21.15.50:0/2861372925 wait complete. 2023-12-24T18:52:15.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:52:15.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.297+0000 7f7d4c8e3700 1 Processor -- start 2023-12-24T18:52:15.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.297+0000 7f7d4c8e3700 1 -- start start 2023-12-24T18:52:15.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d4c8e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d48158c40 0x7f7d480cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d4c8e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d480cc780 0x7f7d480ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d4c8e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4806a580 con 0x7f7d4806cd40 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d4c8e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d480cd110 con 0x7f7d48158c40 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d4c8e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4806a7d0 con 0x7f7d480cc780 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d48158c40 0x7f7d480cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d48158c40 0x7f7d480cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35076/0 (socket says 172.21.15.50:35076) 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 -- 172.21.15.50:0/1415473174 learned_addr learned my addr 172.21.15.50:0/1415473174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:15.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d46ffd700 1 --2- 172.21.15.50:0/1415473174 >> v2:172.21.15.82:3300/0 conn(0x7f7d480cc780 0x7f7d480ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 -- 172.21.15.50:0/1415473174 >> v2:172.21.15.82:3300/0 conn(0x7f7d480cc780 msgr2=0x7f7d480ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 --2- 172.21.15.50:0/1415473174 >> v2:172.21.15.82:3300/0 conn(0x7f7d480cc780 0x7f7d480ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 -- 172.21.15.50:0/1415473174 >> v1:172.21.15.82:6789/0 conn(0x7f7d4806cd40 legacy=0x7f7d4806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 -- 172.21.15.50:0/1415473174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4806aab0 con 0x7f7d48158c40 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d477fe700 1 --2- 172.21.15.50:0/1415473174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d48158c40 0x7f7d480cf500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7d48069010 tx=0x7f7d38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e49a21032f599 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d467fc700 1 -- 172.21.15.50:0/1415473174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800b860 con 0x7f7d48158c40 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d467fc700 1 -- 172.21.15.50:0/1415473174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3800b9c0 con 0x7f7d48158c40 2023-12-24T18:52:15.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.301+0000 7f7d467fc700 1 -- 172.21.15.50:0/1415473174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800bd60 con 0x7f7d48158c40 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/1415473174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d48158c40 msgr2=0x7f7d480cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/1415473174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d48158c40 0x7f7d480cf500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7d48069010 tx=0x7f7d38009250 comp rx=0 tx=0).stop 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/1415473174 shutdown_connections 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/1415473174 >> v2:172.21.15.82:3300/0 conn(0x7f7d480cc780 0x7f7d480ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/1415473174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d48158c40 0x7f7d480cf500 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/1415473174 >> 172.21.15.50:0/1415473174 conn(0x7f7d480d0800 msgr2=0x7f7d480b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/1415473174 shutdown_connections 2023-12-24T18:52:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/1415473174 wait complete. 2023-12-24T18:52:15.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 Processor -- start 2023-12-24T18:52:15.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 -- start start 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d4806cd40 0x7f7d480c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.305+0000 7f7d4c8e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d48158c40 0x7f7d4815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48142d60 con 0x7f7d480cc780 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d480c5580 con 0x7f7d48158c40 2023-12-24T18:52:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d480c63e0 con 0x7f7d4806cd40 2023-12-24T18:52:15.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d4806cd40 0x7f7d480c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35090/0 (socket says 172.21.15.50:35090) 2023-12-24T18:52:15.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 -- 172.21.15.50:0/831157320 learned_addr learned my addr 172.21.15.50:0/831157320 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:15.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d47fff700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d48158c40 0x7f7d4815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 -- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d4806cd40 msgr2=0x7f7d480c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d4806cd40 0x7f7d480c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 -- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d48158c40 msgr2=0x7f7d4815d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d48158c40 0x7f7d4815d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 -- 172.21.15.50:0/831157320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380094f0 con 0x7f7d480cc780 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d46ffd700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00d8c0 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0125f0 con 0x7f7d480cc780 2023-12-24T18:52:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d480c57d0 con 0x7f7d480cc780 2023-12-24T18:52:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c012750 con 0x7f7d480cc780 2023-12-24T18:52:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c012af0 con 0x7f7d480cc780 2023-12-24T18:52:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d480c5d90 con 0x7f7d480cc780 2023-12-24T18:52:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.309+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4804be40 con 0x7f7d480cc780 2023-12-24T18:52:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.313+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 39) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f7d3c01e460 con 0x7f7d480cc780 2023-12-24T18:52:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.313+0000 7f7d2f7fe700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 0x7f7d34062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.313+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f7d3c07d180 con 0x7f7d480cc780 2023-12-24T18:52:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.313+0000 7f7d477fe700 1 -- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 msgr2=0x7f7d34062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.313+0000 7f7d477fe700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 0x7f7d34062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.321+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d3c04d410 con 0x7f7d480cc780 2023-12-24T18:52:15.427 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:15.422+0000 7f11432f3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:15.481 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:15.477+0000 7fd6ad510000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.497+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7d4806ad90 con 0x7f7d480cc780 2023-12-24T18:52:15.500 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:15.494+0000 7f11432f3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:15.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.505+0000 7f7d2f7fe700 1 -- 172.21.15.50:0/831157320 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7d3c050a30 con 0x7f7d480cc780 2023-12-24T18:52:15.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 msgr2=0x7f7d34062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 0x7f7d34062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 msgr2=0x7f7d48142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00d8c0 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 shutdown_connections 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f7d340605a0 0x7f7d34062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d48158c40 0x7f7d4815d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d480cc780 0x7f7d48142820 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 --2- 172.21.15.50:0/831157320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d4806cd40 0x7f7d480c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 >> 172.21.15.50:0/831157320 conn(0x7f7d480d0800 msgr2=0x7f7d480b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 shutdown_connections 2023-12-24T18:52:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.509+0000 7f7d4c8e3700 1 -- 172.21.15.50:0/831157320 wait complete. 2023-12-24T18:52:15.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-12-24T18:52:15.585 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:15.557+0000 7fd6ad510000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:15.638 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:15.634+0000 7f11432f3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:15.706 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:15.705+0000 7fd6ad510000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.745+0000 7f73f546e700 1 Processor -- start 2023-12-24T18:52:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.745+0000 7f73f546e700 1 -- start start 2023-12-24T18:52:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73f546e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 0x7f73f0157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73f546e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73f00ca3a0 0x7f73f00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73f546e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00c8eb0 con 0x7f73f00c9f50 2023-12-24T18:52:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73f546e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00c9190 con 0x7f73f00ca3a0 2023-12-24T18:52:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73f546e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00c9470 con 0x7f73f0156c80 2023-12-24T18:52:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73f00ca3a0 0x7f73f00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ee7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73f00c9f50 0x7f73f006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53744/0 (socket says 172.21.15.50:53744) 2023-12-24T18:52:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73f00ca3a0 0x7f73f00b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35102/0 (socket says 172.21.15.50:35102) 2023-12-24T18:52:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 -- 172.21.15.50:0/2312599715 learned_addr learned my addr 172.21.15.50:0/2312599715 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73eeffd700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 0x7f73f0157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 -- 172.21.15.50:0/2312599715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 msgr2=0x7f73f0157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 0x7f73f0157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 -- 172.21.15.50:0/2312599715 >> v1:172.21.15.50:6789/0 conn(0x7f73f00c9f50 legacy=0x7f73f006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 -- 172.21.15.50:0/2312599715 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00c9750 con 0x7f73f00ca3a0 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73eeffd700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 0x7f73f0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.749+0000 7f73ef7fe700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f00ca3a0 0x7f73f00b0c30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f73e80099b0 tx=0x7f73e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b699a14c65f58e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73edffb700 1 -- 172.21.15.50:0/2312599715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8009ea0 con 0x7f73f00ca3a0 2023-12-24T18:52:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73edffb700 1 -- 172.21.15.50:0/2312599715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e800b860 con 0x7f73f00ca3a0 2023-12-24T18:52:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73edffb700 1 -- 172.21.15.50:0/2312599715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800bc00 con 0x7f73f00ca3a0 2023-12-24T18:52:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 -- 172.21.15.50:0/2312599715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f00ca3a0 msgr2=0x7f73f00b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f00ca3a0 0x7f73f00b0c30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f73e80099b0 tx=0x7f73e8009250 comp rx=0 tx=0).stop 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 -- 172.21.15.50:0/2312599715 shutdown_connections 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f00ca3a0 0x7f73f00b0c30 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 --2- 172.21.15.50:0/2312599715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f0156c80 0x7f73f0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 -- 172.21.15.50:0/2312599715 >> 172.21.15.50:0/2312599715 conn(0x7f73f0069d90 msgr2=0x7f73f00cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 -- 172.21.15.50:0/2312599715 shutdown_connections 2023-12-24T18:52:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.753+0000 7f73f546e700 1 -- 172.21.15.50:0/2312599715 wait complete. 2023-12-24T18:52:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 Processor -- start 2023-12-24T18:52:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 -- start start 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f00c9f50 0x7f73f0169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f00ca3a0 0x7f73f00c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f0156c80 0x7f73f0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f015d910 con 0x7f73f0156c80 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01697d0 con 0x7f73f00c9f50 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73f546e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f015cd00 con 0x7f73f00ca3a0 2023-12-24T18:52:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f0156c80 0x7f73f0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f0156c80 0x7f73f0155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35112/0 (socket says 172.21.15.50:35112) 2023-12-24T18:52:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 -- 172.21.15.50:0/439512151 learned_addr learned my addr 172.21.15.50:0/439512151 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f00c9f50 0x7f73f0169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ee7fc700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f00ca3a0 0x7f73f00c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f00ca3a0 msgr2=0x7f73f00c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f00ca3a0 0x7f73f00c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f00c9f50 msgr2=0x7f73f0169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f00c9f50 0x7f73f0169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0009a20 con 0x7f73f0156c80 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ee7fc700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73f00ca3a0 0x7f73f00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73ef7fe700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f0156c80 0x7f73f0155090 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f73f006c210 tx=0x7f73e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.757+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800bb20 con 0x7f73f0156c80 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8025420 con 0x7f73f0156c80 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80257c0 con 0x7f73f0156c80 2023-12-24T18:52:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73f546e700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e80094f0 con 0x7f73f0156c80 2023-12-24T18:52:15.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73f546e700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f015d2c0 con 0x7f73f0156c80 2023-12-24T18:52:15.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73f546e700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f015dac0 con 0x7f73f0156c80 2023-12-24T18:52:15.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.761+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 39) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f73e8023070 con 0x7f73f0156c80 2023-12-24T18:52:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.765+0000 7f73d6ffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.765+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f73e807e260 con 0x7f73f0156c80 2023-12-24T18:52:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.765+0000 7f73eeffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:15.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.765+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:15.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.769+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f73f015dac0 con 0x7f73f0156c80 2023-12-24T18:52:15.899 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:15.894+0000 7f11432f3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.961+0000 7f73f546e700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f73f0071060 con 0x7f73dc0605a0 2023-12-24T18:52:15.966 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:15.962+0000 7f11432f3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:15.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.969+0000 7f73eeffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:15.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:15.969+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:15.985 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:15.981+0000 7fd6ad510000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:16.061 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:16.057+0000 7fd6ad510000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:16.178 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:16.174+0000 7f11432f3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:16.264 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:16.258+0000 7f11432f3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:16.282 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:16.281+0000 7fd6ad510000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:16.348 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:16.342+0000 7f11432f3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:16.363 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:16.361+0000 7fd6ad510000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:16.373+0000 7f73eeffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:16.373+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:52:16.450 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:16.449+0000 7fd6ad510000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:16.757 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:16.754+0000 7f11432f3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:16.836 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:16.833+0000 7fd6ad510000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:16.930 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:16.926+0000 7f11432f3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:17.010 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.005+0000 7fd6ad510000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:17.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:17.177+0000 7f73eeffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:17.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:17.177+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:52:17.310 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:17.306+0000 7f11432f3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:17.370 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.369+0000 7fd6ad510000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:17.543 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:17.538+0000 7f11432f3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:17.599 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.597+0000 7fd6ad510000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:17.633 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:17.626+0000 7f11432f3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:17.691 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.689+0000 7fd6ad510000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:17.713 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:17.706+0000 7f11432f3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:17.773 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.769+0000 7fd6ad510000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:17.794 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:17.790+0000 7f11432f3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:17.851 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:17.849+0000 7fd6ad510000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:18.030 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:18.026+0000 7f11432f3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:18.072 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:18.069+0000 7fd6ad510000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:18.122 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:18.118+0000 7f11432f3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:18.155 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:18.153+0000 7fd6ad510000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:18.210 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:18.206+0000 7f11432f3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:18.248 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:18.245+0000 7fd6ad510000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:18.411 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:18.406+0000 7f11432f3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:18.448 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:18.445+0000 7fd6ad510000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:18.502 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:18.498+0000 7f11432f3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:18.536 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:18.533+0000 7fd6ad510000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:18.780+0000 7f73eeffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:18.780+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:52:19.239 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:19.234+0000 7f11432f3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:19.275 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.272+0000 7fd6ad510000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:19.288+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 40) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f73e804e8c0 con 0x7f73f0156c80 2023-12-24T18:52:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:19.288+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 msgr2=0x7f73dc062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:19.288+0000 7f73d6ffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:19.472 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66fbea700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.472 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66fbea700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66fbea700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66fbea700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66fbea700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66cbe4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66cbe4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.474 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66cbe4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.474 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66cbe4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:19.474 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:19.468+0000 7fd66cbe4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:20.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.304+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 41) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f73e8067820 con 0x7f73f0156c80 2023-12-24T18:52:20.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.304+0000 7f73d6ffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.304+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 --> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f73f0071060 con 0x7f73dc0605a0 2023-12-24T18:52:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.308+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.308+0000 7f73eeffd700 1 --2- 172.21.15.50:0/439512151 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f73dc0605a0 0x7f73dc0629d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73f00c51a0 tx=0x7f73e000b040 comp rx=0 tx=0).ready entity=mgr.7041 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:20.327 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:20.320+0000 7fd677bfa700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-12-24T18:52:20.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.320+0000 7f73d6ffd700 1 -- 172.21.15.50:0/439512151 <== mgr.7041 v2:172.21.15.50:6834/33814 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f73f0071060 con 0x7f73dc0605a0 2023-12-24T18:52:20.327 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-12-24T18:52:20.333 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-24T18:52:20.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:52:20.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.496+0000 7fbc784a5700 1 Processor -- start 2023-12-24T18:52:20.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 -- start start 2023-12-24T18:52:20.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f530 0x7fbc700ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc7006de10 0x7fbc700ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc700c93e0 con 0x7fbc7013f900 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700ca220 con 0x7fbc7006de10 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc784a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700c9610 con 0x7fbc7013f530 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc75a40700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc7013f900 0x7fbc7006d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60806/0 (socket says 172.21.15.50:60806) 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc75a40700 1 -- 172.21.15.50:0/3339294421 learned_addr learned my addr 172.21.15.50:0/3339294421 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc76a42700 1 --2- 172.21.15.50:0/3339294421 >> v2:172.21.15.82:3300/0 conn(0x7fbc7006de10 0x7fbc700ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.500+0000 7fbc76241700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f530 0x7fbc700ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc7523f700 1 -- 172.21.15.50:0/3339294421 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624724234 0 0) 0x7fbc700c93e0 con 0x7fbc7013f900 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc7523f700 1 -- 172.21.15.50:0/3339294421 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5c003570 con 0x7fbc7013f900 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc76a42700 1 -- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f530 msgr2=0x7fbc700ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc76a42700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f530 0x7fbc700ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc76a42700 1 -- 172.21.15.50:0/3339294421 >> v1:172.21.15.50:6789/0 conn(0x7fbc7013f900 legacy=0x7fbc7006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc76a42700 1 -- 172.21.15.50:0/3339294421 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc700c98f0 con 0x7fbc7006de10 2023-12-24T18:52:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc76a42700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7006de10 0x7fbc700ada10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009e60 tx=0x7fbc68009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5751bb4890779c9f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc7523f700 1 -- 172.21.15.50:0/3339294421 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800e070 con 0x7fbc7006de10 2023-12-24T18:52:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc7523f700 1 -- 172.21.15.50:0/3339294421 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6800bab0 con 0x7fbc7006de10 2023-12-24T18:52:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc7523f700 1 -- 172.21.15.50:0/3339294421 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800be70 con 0x7fbc7006de10 2023-12-24T18:52:20.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 -- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7006de10 msgr2=0x7fbc700ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:20.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7006de10 0x7fbc700ada10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009e60 tx=0x7fbc68009780 comp rx=0 tx=0).stop 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 -- 172.21.15.50:0/3339294421 shutdown_connections 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7006de10 0x7fbc700ada10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 --2- 172.21.15.50:0/3339294421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f530 0x7fbc700ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 -- 172.21.15.50:0/3339294421 >> 172.21.15.50:0/3339294421 conn(0x7fbc70067b80 msgr2=0x7fbc700cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 -- 172.21.15.50:0/3339294421 shutdown_connections 2023-12-24T18:52:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.504+0000 7fbc784a5700 1 -- 172.21.15.50:0/3339294421 wait complete. 2023-12-24T18:52:20.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.508+0000 7fbc784a5700 1 Processor -- start 2023-12-24T18:52:20.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.508+0000 7fbc784a5700 1 -- start start 2023-12-24T18:52:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7013f530 0x7fbc700c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f900 0x7fbc7015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700c56c0 con 0x7fbc7006de10 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700c59a0 con 0x7fbc7013f530 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700c5c80 con 0x7fbc7013f900 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33412/0 (socket says 172.21.15.50:33412) 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 -- 172.21.15.50:0/1753459191 learned_addr learned my addr 172.21.15.50:0/1753459191 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:20.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76a42700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f900 0x7fbc7015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc75a40700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7013f530 0x7fbc700c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 -- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f900 msgr2=0x7fbc7015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f900 0x7fbc7015cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 -- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7013f530 msgr2=0x7fbc700c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7013f530 0x7fbc700c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 -- 172.21.15.50:0/1753459191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68009a20 con 0x7fbc7006de10 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc76241700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ec80 tx=0x7fbc6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009690 con 0x7fbc7006de10 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00c850 con 0x7fbc7006de10 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00cc10 con 0x7fbc7006de10 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc700c5f60 con 0x7fbc7006de10 2023-12-24T18:52:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.512+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc700c6760 con 0x7fbc7006de10 2023-12-24T18:52:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.516+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc700652e0 con 0x7fbc7006de10 2023-12-24T18:52:20.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.516+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 41) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fbc6c013470 con 0x7fbc7006de10 2023-12-24T18:52:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.516+0000 7fbc667fc700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 0x7fbc540628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.516+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fbc6c07cac0 con 0x7fbc7006de10 2023-12-24T18:52:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.520+0000 7fbc75a40700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 0x7fbc540628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.520+0000 7fbc75a40700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 0x7fbc540628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc7015d9c0 tx=0x7fbc60009040 comp rx=0 tx=0).ready entity=mgr.7041 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.524+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc6c04ced0 con 0x7fbc7006de10 2023-12-24T18:52:20.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:20.728+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fbc700c9bd0 con 0x7fbc7006de10 2023-12-24T18:52:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.316+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fbc6c04d2a0 con 0x7fbc7006de10 2023-12-24T18:52:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.320+0000 7fbc667fc700 1 -- 172.21.15.50:0/1753459191 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v42) v1 ==== 93+0+0 (secure 0 0 0) 0x7fbc6c050960 con 0x7fbc7006de10 2023-12-24T18:52:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 msgr2=0x7fbc540628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 0x7fbc540628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc7015d9c0 tx=0x7fbc60009040 comp rx=0 tx=0).stop 2023-12-24T18:52:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 msgr2=0x7fbc701326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ec80 tx=0x7fbc6c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 shutdown_connections 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbc540603f0 0x7fbc540628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc7013f900 0x7fbc7015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7013f530 0x7fbc700c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 --2- 172.21.15.50:0/1753459191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7006de10 0x7fbc701326d0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 >> 172.21.15.50:0/1753459191 conn(0x7fbc70067b80 msgr2=0x7fbc700ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 shutdown_connections 2023-12-24T18:52:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.324+0000 7fbc784a5700 1 -- 172.21.15.50:0/1753459191 wait complete. 2023-12-24T18:52:21.351 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:52:21.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:52:21.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:52:21.428 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:52:21.428 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:52:21.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:52:21.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:21.489 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:52:21.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:21.490 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:52:21.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:21.507 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:21.501+0000 7fdaa535b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:21.534 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:21.528+0000 7f611ebc6000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.692+0000 7f7a1f46b700 1 Processor -- start 2023-12-24T18:52:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.692+0000 7f7a1f46b700 1 -- start start 2023-12-24T18:52:21.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a180cb6d0 0x7f7a18157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180b1410 0x7f7a180b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a181581f0 con 0x7f7a180cbaa0 2023-12-24T18:52:21.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a180b1df0 con 0x7f7a180cb6d0 2023-12-24T18:52:21.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1815ac60 con 0x7f7a180b1410 2023-12-24T18:52:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1dc68700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a180cbaa0 0x7f7a180ca9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60828/0 (socket says 172.21.15.50:60828) 2023-12-24T18:52:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1dc68700 1 -- 172.21.15.50:0/2664493990 learned_addr learned my addr 172.21.15.50:0/2664493990 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1ec6a700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180b1410 0x7f7a180b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2664493990 >> v2:172.21.15.82:3300/0 conn(0x7f7a180cb6d0 0x7f7a18157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1d467700 1 -- 172.21.15.50:0/2664493990 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284890141 0 0) 0x7f7a181581f0 con 0x7f7a180cbaa0 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1d467700 1 -- 172.21.15.50:0/2664493990 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a04003570 con 0x7f7a180cbaa0 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 -- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180b1410 msgr2=0x7f7a180b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180b1410 0x7f7a180b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 -- 172.21.15.50:0/2664493990 >> v1:172.21.15.50:6789/0 conn(0x7f7a180cbaa0 legacy=0x7f7a180ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 -- 172.21.15.50:0/2664493990 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1815af40 con 0x7f7a180cb6d0 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a18157cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098e0 tx=0x7f7a140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec122f4d8ba3a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1d467700 1 -- 172.21.15.50:0/2664493990 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011630 con 0x7f7a180cb6d0 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1d467700 1 -- 172.21.15.50:0/2664493990 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14011790 con 0x7f7a180cb6d0 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1d467700 1 -- 172.21.15.50:0/2664493990 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011b30 con 0x7f7a180cb6d0 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 msgr2=0x7f7a18157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.696+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a18157cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098e0 tx=0x7f7a140091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2664493990 shutdown_connections 2023-12-24T18:52:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180b1410 0x7f7a180b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2664493990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a18157cb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2664493990 >> 172.21.15.50:0/2664493990 conn(0x7f7a180ccd90 msgr2=0x7f7a180add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2664493990 shutdown_connections 2023-12-24T18:52:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2664493990 wait complete. 2023-12-24T18:52:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 Processor -- start 2023-12-24T18:52:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- start start 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a180c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 0x7f7a18152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18153d00 con 0x7f7a180b1410 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181530f0 con 0x7f7a180cb6d0 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1f46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181533d0 con 0x7f7a180cbaa0 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1e469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1e469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33428/0 (socket says 172.21.15.50:33428) 2023-12-24T18:52:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1e469700 1 -- 172.21.15.50:0/2769113588 learned_addr learned my addr 172.21.15.50:0/2769113588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1dc68700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a180c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1ec6a700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 0x7f7a18152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.700+0000 7f7a1e469700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 msgr2=0x7f7a18152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 0x7f7a18152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1e469700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 msgr2=0x7f7a180c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a180c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1e469700 1 -- 172.21.15.50:0/2769113588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009420 con 0x7f7a180b1410 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1dc68700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a180c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1ec6a700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 0x7f7a18152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1e469700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a180b2090 tx=0x7f7a14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011b10 con 0x7f7a180b1410 2023-12-24T18:52:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a140253f0 con 0x7f7a180b1410 2023-12-24T18:52:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a181536b0 con 0x7f7a180b1410 2023-12-24T18:52:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140257b0 con 0x7f7a180b1410 2023-12-24T18:52:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a181546d0 con 0x7f7a180b1410 2023-12-24T18:52:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.704+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1804be40 con 0x7f7a180b1410 2023-12-24T18:52:21.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.708+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f7a14025b60 con 0x7f7a180b1410 2023-12-24T18:52:21.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.708+0000 7f7a0e7fc700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 0x7f79fc062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:21.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.708+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f7a1407e670 con 0x7f7a180b1410 2023-12-24T18:52:21.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.708+0000 7f7a1dc68700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 msgr2=0x7f79fc062c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:21.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.708+0000 7f7a1dc68700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 0x7f79fc062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:21.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.712+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a1404e580 con 0x7f7a180b1410 2023-12-24T18:52:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.912+0000 7f7a1dc68700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 msgr2=0x7f79fc062c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.912+0000 7f7a1dc68700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 0x7f79fc062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.920+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a18063690 con 0x7f7a180b1410 2023-12-24T18:52:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a0e7fc700 1 -- 172.21.15.50:0/2769113588 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f7a14051ba0 con 0x7f7a180b1410 2023-12-24T18:52:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:21.926 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 msgr2=0x7f79fc062c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 0x7f79fc062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 msgr2=0x7f7a18154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a180b2090 tx=0x7f7a14017000 comp rx=0 tx=0).stop 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 shutdown_connections 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f79fc060780 0x7f79fc062c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a180cbaa0 0x7f7a18152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a180cb6d0 0x7f7a180c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 --2- 172.21.15.50:0/2769113588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180b1410 0x7f7a18154190 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 >> 172.21.15.50:0/2769113588 conn(0x7f7a180ccd90 msgr2=0x7f7a1815a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 shutdown_connections 2023-12-24T18:52:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:21.924+0000 7f7a1f46b700 1 -- 172.21.15.50:0/2769113588 wait complete. 2023-12-24T18:52:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:21.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:22.053 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.045+0000 7fdaa535b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:22.096 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.092+0000 7f611ebc6000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:22.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 Processor -- start 2023-12-24T18:52:22.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 -- start start 2023-12-24T18:52:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8e4154b60 0x7ff8e40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e406aca0 0x7ff8e406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e406c820 con 0x7ff8e40c6d00 2023-12-24T18:52:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e406b960 con 0x7ff8e4154b60 2023-12-24T18:52:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e9a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e406bc40 con 0x7ff8e406aca0 2023-12-24T18:52:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8e4154b60 0x7ff8e40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8e4154b60 0x7ff8e40c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:58972/0 (socket says 172.21.15.50:58972) 2023-12-24T18:52:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/978773428 learned_addr learned my addr 172.21.15.50:0/978773428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e3fff700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e406aca0 0x7ff8e406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.112+0000 7ff8e37fe700 1 --1- 172.21.15.50:0/978773428 >> v1:172.21.15.82:6789/0 conn(0x7ff8e40c6d00 0x7ff8e4154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49430/0 (socket says 172.21.15.50:49430) 2023-12-24T18:52:22.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e406aca0 msgr2=0x7ff8e406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:22.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e2ffd700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e406aca0 0x7ff8e406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/978773428 >> v1:172.21.15.82:6789/0 conn(0x7ff8e40c6d00 legacy=0x7ff8e4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/978773428 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e406bf20 con 0x7ff8e4154b60 2023-12-24T18:52:22.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e2ffd700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4154b60 0x7ff8e40c70d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80099b0 tx=0x7ff8d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cea010e7a300f2f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e27fc700 1 -- 172.21.15.50:0/978773428 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8009ea0 con 0x7ff8e4154b60 2023-12-24T18:52:22.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e27fc700 1 -- 172.21.15.50:0/978773428 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800b860 con 0x7ff8e4154b60 2023-12-24T18:52:22.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e27fc700 1 -- 172.21.15.50:0/978773428 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800bc00 con 0x7ff8e4154b60 2023-12-24T18:52:22.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4154b60 msgr2=0x7ff8e40c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4154b60 0x7ff8e40c70d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80099b0 tx=0x7ff8d8009250 comp rx=0 tx=0).stop 2023-12-24T18:52:22.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/978773428 shutdown_connections 2023-12-24T18:52:22.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e406aca0 0x7ff8e406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/978773428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4154b60 0x7ff8e40c70d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/978773428 >> 172.21.15.50:0/978773428 conn(0x7ff8e40cbba0 msgr2=0x7ff8e40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:22.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/978773428 shutdown_connections 2023-12-24T18:52:22.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.116+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/978773428 wait complete. 2023-12-24T18:52:22.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 Processor -- start 2023-12-24T18:52:22.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 -- start start 2023-12-24T18:52:22.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e406aca0 0x7ff8e40af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e4154b60 0x7ff8e40b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40af9d0 con 0x7ff8e4154b60 2023-12-24T18:52:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40a8e20 con 0x7ff8e406aca0 2023-12-24T18:52:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e9a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40a9100 con 0x7ff8e40c6d00 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42330/0 (socket says 172.21.15.50:42330) 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e406aca0 0x7ff8e40af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/1330214205 learned_addr learned my addr 172.21.15.50:0/1330214205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e3fff700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e4154b60 0x7ff8e40b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e406aca0 msgr2=0x7ff8e40af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e406aca0 0x7ff8e40af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e4154b60 msgr2=0x7ff8e40b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e4154b60 0x7ff8e40b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 -- 172.21.15.50:0/1330214205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80094f0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.120+0000 7ff8e2ffd700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4069da0 tx=0x7ff8d8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8000d10 con 0x7ff8e40c6d00 2023-12-24T18:52:22.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800bbe0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011670 con 0x7ff8e40c6d00 2023-12-24T18:52:22.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e40a93e0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e40a99a0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e40a9bc0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.124+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7ff8d8011aa0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.129 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.125+0000 7fdaa535b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:22.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.128+0000 7ff8cb7fe700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 0x7ff8d0062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.128+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7ff8d807e670 con 0x7ff8e40c6d00 2023-12-24T18:52:22.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.128+0000 7ff8e37fe700 1 -- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 msgr2=0x7ff8d0062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:22.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.128+0000 7ff8e37fe700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 0x7ff8d0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.136+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8d804e580 con 0x7ff8e40c6d00 2023-12-24T18:52:22.185 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.180+0000 7f611ebc6000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:22.262 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.257+0000 7fdaa535b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.312+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e40652e0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.316+0000 7ff8cb7fe700 1 -- 172.21.15.50:0/1330214205 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16449 (secure 0 0 0) 0x7ff8d8051ba0 con 0x7ff8e40c6d00 2023-12-24T18:52:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:22.320 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:19.280638+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3016225528":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/2317434603":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/3156373303":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/4243454490":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6834/33814":"2023-12-25T18:52:19.280568+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 msgr2=0x7ff8d0062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 0x7ff8d0062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 msgr2=0x7ff8e40ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4069da0 tx=0x7ff8d8017000 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 shutdown_connections 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff8d0060700 0x7ff8d0062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e4154b60 0x7ff8e40b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8e40c6d00 0x7ff8e40ca850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 --2- 172.21.15.50:0/1330214205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e406aca0 0x7ff8e40af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 >> 172.21.15.50:0/1330214205 conn(0x7ff8e40cbba0 msgr2=0x7ff8e4153720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 shutdown_connections 2023-12-24T18:52:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.320+0000 7ff8e9a6e700 1 -- 172.21.15.50:0/1330214205 wait complete. 2023-12-24T18:52:22.339 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.336+0000 7f611ebc6000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:22.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:51:57.597375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:51:59.074957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:52:22.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:52:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 Processor -- start 2023-12-24T18:52:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 -- start start 2023-12-24T18:52:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f059c0c6000 0x7f059c0acc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f059c154e40 0x7f059c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0ad140 con 0x7f059c0c6000 2023-12-24T18:52:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c06ce70 con 0x7f059c154e40 2023-12-24T18:52:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.516+0000 7f05a220c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0ad360 con 0x7f059c1591d0 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f059c0c6000 0x7f059c0acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f059c0c6000 0x7f059c0acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33446/0 (socket says 172.21.15.50:33446) 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 -- 172.21.15.50:0/472392932 learned_addr learned my addr 172.21.15.50:0/472392932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a1a0b700 1 --2- 172.21.15.50:0/472392932 >> v2:172.21.15.82:3300/0 conn(0x7f059c154e40 0x7f059c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a120a700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 -- 172.21.15.50:0/472392932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 msgr2=0x7f059c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 -- 172.21.15.50:0/472392932 >> v2:172.21.15.82:3300/0 conn(0x7f059c154e40 msgr2=0x7f059c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 --2- 172.21.15.50:0/472392932 >> v2:172.21.15.82:3300/0 conn(0x7f059c154e40 0x7f059c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 -- 172.21.15.50:0/472392932 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0ad640 con 0x7f059c0c6000 2023-12-24T18:52:22.524 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.517+0000 7fdaa535b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a0a09700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c0c6000 0x7f059c0acc00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f059c0ca170 tx=0x7f058c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedcd6c02dbe6cb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f0593fff700 1 -- 172.21.15.50:0/472392932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c009ea0 con 0x7f059c0c6000 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f0593fff700 1 -- 172.21.15.50:0/472392932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00b820 con 0x7f059c0c6000 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f0593fff700 1 -- 172.21.15.50:0/472392932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00bbc0 con 0x7f059c0c6000 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 -- 172.21.15.50:0/472392932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c0c6000 msgr2=0x7f059c0acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c0c6000 0x7f059c0acc00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f059c0ca170 tx=0x7f058c009250 comp rx=0 tx=0).stop 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 -- 172.21.15.50:0/472392932 shutdown_connections 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 --2- 172.21.15.50:0/472392932 >> v2:172.21.15.82:3300/0 conn(0x7f059c154e40 0x7f059c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c0c6000 0x7f059c0acc00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 --2- 172.21.15.50:0/472392932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 -- 172.21.15.50:0/472392932 >> 172.21.15.50:0/472392932 conn(0x7f059c067250 msgr2=0x7f059c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 -- 172.21.15.50:0/472392932 shutdown_connections 2023-12-24T18:52:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.520+0000 7f05a220c700 1 -- 172.21.15.50:0/472392932 wait complete. 2023-12-24T18:52:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.524+0000 7f05a220c700 1 Processor -- start 2023-12-24T18:52:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.524+0000 7f05a220c700 1 -- start start 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f059c0c6000 0x7f059c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c16a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1559e0 con 0x7f059c154e40 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c14c750 con 0x7f059c0c6000 2023-12-24T18:52:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c156f80 con 0x7f059c1591d0 2023-12-24T18:52:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33456/0 (socket says 172.21.15.50:33456) 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 -- 172.21.15.50:0/2212902886 learned_addr learned my addr 172.21.15.50:0/2212902886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a120a700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f059c0c6000 0x7f059c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a1a0b700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c16a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 -- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 msgr2=0x7f059c16a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c16a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 -- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f059c0c6000 msgr2=0x7f059c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f059c0c6000 0x7f059c1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 -- 172.21.15.50:0/2212902886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0094f0 con 0x7f059c154e40 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a0a09700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f058c0094c0 tx=0x7f058c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c000d10 con 0x7f059c154e40 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00bba0 con 0x7f059c154e40 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c011650 con 0x7f059c154e40 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c155390 con 0x7f059c154e40 2023-12-24T18:52:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.528+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0b0810 con 0x7f059c154e40 2023-12-24T18:52:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c155b90 con 0x7f059c154e40 2023-12-24T18:52:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f058c011a80 con 0x7f059c154e40 2023-12-24T18:52:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05917fa700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 0x7f0580062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05a120a700 1 -- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 msgr2=0x7f0580062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f058c07e730 con 0x7f059c154e40 2023-12-24T18:52:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.532+0000 7f05a120a700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 0x7f0580062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.540+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f059c155b90 con 0x7f059c154e40 2023-12-24T18:52:22.596 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.589+0000 7fdaa535b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:22.624 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.620+0000 7f611ebc6000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:22.701 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.696+0000 7f611ebc6000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.712+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f059c155b90 con 0x7f059c154e40 2023-12-24T18:52:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.712+0000 7f05917fa700 1 -- 172.21.15.50:0/2212902886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f059c155b90 con 0x7f059c154e40 2023-12-24T18:52:22.716 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:52:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 msgr2=0x7f0580062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 0x7f0580062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 msgr2=0x7f059c0b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f058c0094c0 tx=0x7f058c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 shutdown_connections 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f0580060700 0x7f0580062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f059c1591d0 0x7f059c16a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059c154e40 0x7f059c0b02d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 --2- 172.21.15.50:0/2212902886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f059c0c6000 0x7f059c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 >> 172.21.15.50:0/2212902886 conn(0x7f059c067250 msgr2=0x7f059c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 shutdown_connections 2023-12-24T18:52:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.716+0000 7f05a220c700 1 -- 172.21.15.50:0/2212902886 wait complete. 2023-12-24T18:52:22.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:52:22.813 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.805+0000 7fdaa535b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:22.901 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.893+0000 7fdaa535b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.912+0000 7f5e45c2e700 1 Processor -- start 2023-12-24T18:52:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.912+0000 7f5e45c2e700 1 -- start start 2023-12-24T18:52:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e45c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e40158e00 0x7f5e400b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e45c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e400b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e45c2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400b3fd0 con 0x7f5e4006c820 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e45c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400b33c0 con 0x7f5e40158e00 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e45c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400b36a0 con 0x7f5e4006ae20 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e400b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e40158e00 0x7f5e400b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5e4006c820 0x7f5e4006a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49442/0 (socket says 172.21.15.50:49442) 2023-12-24T18:52:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3effd700 1 -- 172.21.15.50:0/2613443014 learned_addr learned my addr 172.21.15.50:0/2613443014 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 -- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 msgr2=0x7f5e400b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 --2- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e400b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 -- 172.21.15.50:0/2613443014 >> v1:172.21.15.82:6789/0 conn(0x7f5e4006c820 legacy=0x7f5e4006a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 -- 172.21.15.50:0/2613443014 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400b3980 con 0x7f5e40158e00 2023-12-24T18:52:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3e7fc700 1 -- 172.21.15.50:0/2613443014 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243848852 0 0) 0x7f5e400b3fd0 con 0x7f5e4006c820 2023-12-24T18:52:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3f7fe700 1 --2- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40158e00 0x7f5e400b2de0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098e0 tx=0x7f5e300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d533dd4d2b5a75e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3e7fc700 1 -- 172.21.15.50:0/2613443014 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000b640 con 0x7f5e40158e00 2023-12-24T18:52:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3e7fc700 1 -- 172.21.15.50:0/2613443014 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000b7a0 con 0x7f5e40158e00 2023-12-24T18:52:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.916+0000 7f5e3e7fc700 1 -- 172.21.15.50:0/2613443014 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000bb40 con 0x7f5e40158e00 2023-12-24T18:52:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40158e00 msgr2=0x7f5e400b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40158e00 0x7f5e400b2de0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098e0 tx=0x7f5e300091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2613443014 shutdown_connections 2023-12-24T18:52:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e400b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2613443014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40158e00 0x7f5e400b2de0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2613443014 >> 172.21.15.50:0/2613443014 conn(0x7f5e40067b80 msgr2=0x7f5e400cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2613443014 shutdown_connections 2023-12-24T18:52:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.920+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2613443014 wait complete. 2023-12-24T18:52:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 Processor -- start 2023-12-24T18:52:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 -- start start 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e4013c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4014abc0 con 0x7f5e40158e00 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4014b3f0 con 0x7f5e4006c820 2023-12-24T18:52:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e45c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4013cf20 con 0x7f5e4006ae20 2023-12-24T18:52:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e4013c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:59000/0 (socket says 172.21.15.50:59000) 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e4013c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42364/0 (socket says 172.21.15.50:42364) 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3effd700 1 -- 172.21.15.50:0/2883193259 learned_addr learned my addr 172.21.15.50:0/2883193259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33464/0 (socket says 172.21.15.50:33464) 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 -- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 msgr2=0x7f5e4013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e4013c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 -- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 msgr2=0x7f5e4014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3ffff700 1 -- 172.21.15.50:0/2883193259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009420 con 0x7f5e40158e00 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.924+0000 7f5e3effd700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e3ffff700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006b220 tx=0x7f5e3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800c890 con 0x7f5e40158e00 2023-12-24T18:52:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800f040 con 0x7f5e40158e00 2023-12-24T18:52:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4015e8c0 con 0x7f5e40158e00 2023-12-24T18:52:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800cc60 con 0x7f5e40158e00 2023-12-24T18:52:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4014b080 con 0x7f5e40158e00 2023-12-24T18:52:22.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.928+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4014b560 con 0x7f5e40158e00 2023-12-24T18:52:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.932+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f5e38014690 con 0x7f5e40158e00 2023-12-24T18:52:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.932+0000 7f5e277fe700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 0x7f5e2c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.932+0000 7f5e3f7fe700 1 -- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 msgr2=0x7f5e2c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.932+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f5e3807d960 con 0x7f5e40158e00 2023-12-24T18:52:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.932+0000 7f5e3f7fe700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 0x7f5e2c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:22.941 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:22.940+0000 7f611ebc6000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:22.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:22.940+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e3804d800 con 0x7f5e40158e00 2023-12-24T18:52:22.992 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:22.985+0000 7fdaa535b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:23.032 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:23.028+0000 7f611ebc6000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:23.119 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:23.116+0000 7f611ebc6000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:23.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.120+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e400652e0 con 0x7f5e40158e00 2023-12-24T18:52:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.120+0000 7f5e277fe700 1 -- 172.21.15.50:0/2883193259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e38018020 con 0x7f5e40158e00 2023-12-24T18:52:23.125 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:52:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 msgr2=0x7f5e2c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 0x7f5e2c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 msgr2=0x7f5e40152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006b220 tx=0x7f5e3800b040 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 shutdown_connections 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5e2c060700 0x7f5e2c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e40158e00 0x7f5e40152860 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006c820 0x7f5e4014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 --2- 172.21.15.50:0/2883193259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e4006ae20 0x7f5e4013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 >> 172.21.15.50:0/2883193259 conn(0x7f5e40067b80 msgr2=0x7f5e4015b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.124+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 shutdown_connections 2023-12-24T18:52:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.128+0000 7f5e45c2e700 1 -- 172.21.15.50:0/2883193259 wait complete. 2023-12-24T18:52:23.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:52:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.308+0000 7ff0c106e700 1 Processor -- start 2023-12-24T18:52:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.308+0000 7ff0c106e700 1 -- start start 2023-12-24T18:52:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0c106e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0c106e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0bc06c820 0x7ff0bc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0c106e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0b3fd0 con 0x7ff0bc158e00 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0c106e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0b33c0 con 0x7ff0bc06c820 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0c106e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0b36a0 con 0x7ff0bc06ae20 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0bad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff0bc158e00 0x7ff0bc06a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49446/0 (socket says 172.21.15.50:49446) 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0bad9d700 1 -- 172.21.15.50:0/2241273691 learned_addr learned my addr 172.21.15.50:0/2241273691 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0bb59e700 1 --2- 172.21.15.50:0/2241273691 >> v2:172.21.15.82:3300/0 conn(0x7ff0bc06c820 0x7ff0bc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 -- 172.21.15.50:0/2241273691 >> v2:172.21.15.82:3300/0 conn(0x7ff0bc06c820 msgr2=0x7ff0bc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 --2- 172.21.15.50:0/2241273691 >> v2:172.21.15.82:3300/0 conn(0x7ff0bc06c820 0x7ff0bc0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 -- 172.21.15.50:0/2241273691 >> v1:172.21.15.82:6789/0 conn(0x7ff0bc158e00 legacy=0x7ff0bc06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 -- 172.21.15.50:0/2241273691 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0b3980 con 0x7ff0bc06ae20 2023-12-24T18:52:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.312+0000 7ff0ba59c700 1 --2- 172.21.15.50:0/2241273691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc0b2de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098e0 tx=0x7ff0b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ace09286e40256b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:23.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0b9d9b700 1 -- 172.21.15.50:0/2241273691 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000b640 con 0x7ff0bc06ae20 2023-12-24T18:52:23.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0b9d9b700 1 -- 172.21.15.50:0/2241273691 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b000b7a0 con 0x7ff0bc06ae20 2023-12-24T18:52:23.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0b9d9b700 1 -- 172.21.15.50:0/2241273691 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000bb40 con 0x7ff0bc06ae20 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 -- 172.21.15.50:0/2241273691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 msgr2=0x7ff0bc0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 --2- 172.21.15.50:0/2241273691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc0b2de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098e0 tx=0x7ff0b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 -- 172.21.15.50:0/2241273691 shutdown_connections 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 --2- 172.21.15.50:0/2241273691 >> v2:172.21.15.82:3300/0 conn(0x7ff0bc06c820 0x7ff0bc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 --2- 172.21.15.50:0/2241273691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc0b2de0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 -- 172.21.15.50:0/2241273691 >> 172.21.15.50:0/2241273691 conn(0x7ff0bc067b80 msgr2=0x7ff0bc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 -- 172.21.15.50:0/2241273691 shutdown_connections 2023-12-24T18:52:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.320+0000 7ff0c106e700 1 -- 172.21.15.50:0/2241273691 wait complete. 2023-12-24T18:52:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 Processor -- start 2023-12-24T18:52:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 -- start start 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 0x7ff0bc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc13ef40 con 0x7ff0bc06c820 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0a88d0 con 0x7ff0bc158e00 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0c106e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0a9450 con 0x7ff0bc06ae20 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33468/0 (socket says 172.21.15.50:33468) 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0ba59c700 1 -- 172.21.15.50:0/3944566329 learned_addr learned my addr 172.21.15.50:0/3944566329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0bb59e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 0x7ff0bc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0bad9d700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0ba59c700 1 -- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 msgr2=0x7ff0bc13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.324+0000 7ff0ba59c700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc13ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0ba59c700 1 -- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 msgr2=0x7ff0bc157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0ba59c700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 0x7ff0bc157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0ba59c700 1 -- 172.21.15.50:0/3944566329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009420 con 0x7ff0bc06c820 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0bb59e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 0x7ff0bc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0ba59c700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0b37e0 tx=0x7ff0b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b001bb70 con 0x7ff0bc06c820 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b001bcd0 con 0x7ff0bc06c820 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc0a8b20 con 0x7ff0bc06c820 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0011670 con 0x7ff0bc06c820 2023-12-24T18:52:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0a90e0 con 0x7ff0bc06c820 2023-12-24T18:52:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.328+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc0a95e0 con 0x7ff0bc06c820 2023-12-24T18:52:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.332+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7ff0b0011a20 con 0x7ff0bc06c820 2023-12-24T18:52:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.332+0000 7ff0a2ffd700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 0x7ff0a8062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.332+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7ff0b007e250 con 0x7ff0bc06c820 2023-12-24T18:52:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.332+0000 7ff0bad9d700 1 -- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 msgr2=0x7ff0a8062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.332+0000 7ff0bad9d700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 0x7ff0a8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.336+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff0b004e160 con 0x7ff0bc06c820 2023-12-24T18:52:23.405 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:23.401+0000 7fdaa535b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.508+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0bc0652e0 con 0x7ff0bc06c820 2023-12-24T18:52:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0a2ffd700 1 -- 172.21.15.50:0/3944566329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0b0051780 con 0x7ff0bc06c820 2023-12-24T18:52:23.514 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 msgr2=0x7ff0a8062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 0x7ff0a8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 msgr2=0x7ff0bc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0b37e0 tx=0x7ff0b0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 shutdown_connections 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7ff0a8060700 0x7ff0a8062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0bc158e00 0x7ff0bc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0bc06c820 0x7ff0bc157140 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 --2- 172.21.15.50:0/3944566329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0bc06ae20 0x7ff0bc13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 >> 172.21.15.50:0/3944566329 conn(0x7ff0bc067b80 msgr2=0x7ff0bc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 shutdown_connections 2023-12-24T18:52:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.512+0000 7ff0c106e700 1 -- 172.21.15.50:0/3944566329 wait complete. 2023-12-24T18:52:23.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:23.546 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:23.544+0000 7f611ebc6000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:23.583 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:23.577+0000 7fdaa535b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 Processor -- start 2023-12-24T18:52:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 -- start start 2023-12-24T18:52:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 0x7feca81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca806b640 con 0x7feca806d8c0 2023-12-24T18:52:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca8159710 con 0x7feca80b41e0 2023-12-24T18:52:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecaee8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80b5e10 con 0x7feca8158e00 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecad68b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feca806d8c0 0x7feca80b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecad68b700 1 -- 172.21.15.50:0/966775149 learned_addr learned my addr 172.21.15.50:0/966775149 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecade8c700 1 --2- 172.21.15.50:0/966775149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 0x7feca81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.696+0000 7fecae68d700 1 --2- 172.21.15.50:0/966775149 >> v2:172.21.15.82:3300/0 conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856569901 0 0) 0x7feca806b640 con 0x7feca806d8c0 2023-12-24T18:52:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec94003570 con 0x7feca806d8c0 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecade8c700 1 -- 172.21.15.50:0/966775149 >> v2:172.21.15.82:3300/0 conn(0x7feca80b41e0 msgr2=0x7feca8159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecade8c700 1 --2- 172.21.15.50:0/966775149 >> v2:172.21.15.82:3300/0 conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecade8c700 1 -- 172.21.15.50:0/966775149 >> v1:172.21.15.50:6789/0 conn(0x7feca806d8c0 legacy=0x7feca80b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354434803 0 0) 0x7fec94003570 con 0x7feca806d8c0 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecade8c700 1 -- 172.21.15.50:0/966775149 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca806b8e0 con 0x7feca8158e00 2023-12-24T18:52:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecade8c700 1 --2- 172.21.15.50:0/966775149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 0x7feca81591d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feca40098e0 tx=0x7feca40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1022e5fe88862b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98001470 con 0x7feca8158e00 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4011420 con 0x7feca8158e00 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecace8a700 1 -- 172.21.15.50:0/966775149 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40117c0 con 0x7feca8158e00 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- 172.21.15.50:0/966775149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 msgr2=0x7feca81591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 --2- 172.21.15.50:0/966775149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 0x7feca81591d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feca40098e0 tx=0x7feca40091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- 172.21.15.50:0/966775149 shutdown_connections 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 --2- 172.21.15.50:0/966775149 >> v2:172.21.15.82:3300/0 conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 --2- 172.21.15.50:0/966775149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca8158e00 0x7feca81591d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- 172.21.15.50:0/966775149 >> 172.21.15.50:0/966775149 conn(0x7feca8067b80 msgr2=0x7feca80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- 172.21.15.50:0/966775149 shutdown_connections 2023-12-24T18:52:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- 172.21.15.50:0/966775149 wait complete. 2023-12-24T18:52:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 Processor -- start 2023-12-24T18:52:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.700+0000 7fecaee8e700 1 -- start start 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca806d8c0 0x7feca8144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80ab750 con 0x7feca8158e00 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80ae140 con 0x7feca80b41e0 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80aae20 con 0x7feca806d8c0 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33482/0 (socket says 172.21.15.50:33482) 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 -- 172.21.15.50:0/1624181419 learned_addr learned my addr 172.21.15.50:0/1624181419 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecade8c700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca806d8c0 0x7feca8144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecad68b700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca806d8c0 msgr2=0x7feca8144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca806d8c0 0x7feca8144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca80b41e0 msgr2=0x7feca8159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 -- 172.21.15.50:0/1624181419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009420 con 0x7feca8158e00 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecae68d700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7feca0009e90 tx=0x7feca000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000cc20 con 0x7feca8158e00 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000f040 con 0x7feca8158e00 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80ab100 con 0x7feca8158e00 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0014480 con 0x7feca8158e00 2023-12-24T18:52:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.704+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca8145190 con 0x7feca8158e00 2023-12-24T18:52:23.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80ab900 con 0x7feca8158e00 2023-12-24T18:52:23.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7feca0014830 con 0x7feca8158e00 2023-12-24T18:52:23.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fec9dffb700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 0x7fec8c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:23.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fecade8c700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 msgr2=0x7fec8c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:23.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7feca007dca0 con 0x7feca8158e00 2023-12-24T18:52:23.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.708+0000 7fecade8c700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 0x7fec8c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:23.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.712+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feca80ab900 con 0x7feca8158e00 2023-12-24T18:52:23.729 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:23.724+0000 7f611ebc6000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:23.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.912+0000 7fecade8c700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 msgr2=0x7fec8c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:23.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.912+0000 7fecade8c700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 0x7fec8c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.940+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feca804be40 con 0x7feca8158e00 2023-12-24T18:52:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.940+0000 7fec9dffb700 1 -- 172.21.15.50:0/1624181419 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7feca0018090 con 0x7feca8158e00 2023-12-24T18:52:23.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:23.946 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 msgr2=0x7fec8c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 0x7fec8c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 msgr2=0x7feca80abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7feca0009e90 tx=0x7feca000b040 comp rx=0 tx=0).stop 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 shutdown_connections 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fec8c060700 0x7fec8c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca8158e00 0x7feca80abbe0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca80b41e0 0x7feca8159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 --2- 172.21.15.50:0/1624181419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca806d8c0 0x7feca8144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 >> 172.21.15.50:0/1624181419 conn(0x7feca8067b80 msgr2=0x7feca80b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 shutdown_connections 2023-12-24T18:52:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:23.948+0000 7fecaee8e700 1 -- 172.21.15.50:0/1624181419 wait complete. 2023-12-24T18:52:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:23.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:23.972 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:23.965+0000 7fdaa535b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:24.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.120+0000 7f611ebc6000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.172+0000 7fe9db59e700 1 Processor -- start 2023-12-24T18:52:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.172+0000 7fe9db59e700 1 -- start start 2023-12-24T18:52:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.172+0000 7fe9db59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9dc0ad220 0x7fe9dc0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.172+0000 7fe9db59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc06e110 con 0x7fe9dc155e20 2023-12-24T18:52:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.172+0000 7fe9db59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc06bb40 con 0x7fe9dc06afa0 2023-12-24T18:52:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9db59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc06be20 con 0x7fe9dc0ad220 2023-12-24T18:52:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9dad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9dc155e20 0x7fe9dc0aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60860/0 (socket says 172.21.15.50:60860) 2023-12-24T18:52:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9dad9d700 1 -- 172.21.15.50:0/989316746 learned_addr learned my addr 172.21.15.50:0/989316746 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9da59c700 1 --2- 172.21.15.50:0/989316746 >> v2:172.21.15.50:3300/0 conn(0x7fe9dc0ad220 0x7fe9dc0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517700126 0 0) 0x7fe9dc06e110 con 0x7fe9dc155e20 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c4005780 con 0x7fe9dc155e20 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9da59c700 1 -- 172.21.15.50:0/989316746 >> v1:172.21.15.82:6789/0 conn(0x7fe9dc06afa0 legacy=0x7fe9dc155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380278285 0 0) 0x7fe9dc06bb40 con 0x7fe9dc06afa0 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9da59c700 1 -- 172.21.15.50:0/989316746 >> v1:172.21.15.50:6789/0 conn(0x7fe9dc155e20 legacy=0x7fe9dc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9da59c700 1 -- 172.21.15.50:0/989316746 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0af740 con 0x7fe9dc0ad220 2023-12-24T18:52:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9da59c700 1 --2- 172.21.15.50:0/989316746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc0ad5f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098e0 tx=0x7fe9cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96024aed89039691 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00b640 con 0x7fe9dc0ad220 2023-12-24T18:52:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00b7a0 con 0x7fe9dc0ad220 2023-12-24T18:52:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9d959a700 1 -- 172.21.15.50:0/989316746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00bb40 con 0x7fe9dc0ad220 2023-12-24T18:52:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9db59e700 1 -- 172.21.15.50:0/989316746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc0ad220 msgr2=0x7fe9dc0ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.176+0000 7fe9db59e700 1 --2- 172.21.15.50:0/989316746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc0ad5f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098e0 tx=0x7fe9cc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 -- 172.21.15.50:0/989316746 shutdown_connections 2023-12-24T18:52:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 --2- 172.21.15.50:0/989316746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc0ad5f0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 -- 172.21.15.50:0/989316746 >> 172.21.15.50:0/989316746 conn(0x7fe9dc067b80 msgr2=0x7fe9dc0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 -- 172.21.15.50:0/989316746 shutdown_connections 2023-12-24T18:52:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 -- 172.21.15.50:0/989316746 wait complete. 2023-12-24T18:52:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 Processor -- start 2023-12-24T18:52:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.180+0000 7fe9db59e700 1 -- start start 2023-12-24T18:52:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9dc06afa0 0x7fe9dc1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1596a0 con 0x7fe9dc155e20 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc158e00 con 0x7fe9dc0ad220 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1590e0 con 0x7fe9dc06afa0 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33510/0 (socket says 172.21.15.50:33510) 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 -- 172.21.15.50:0/2929907165 learned_addr learned my addr 172.21.15.50:0/2929907165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9da59c700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9dc06afa0 0x7fe9dc1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9d9d9b700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9dc06afa0 msgr2=0x7fe9dc1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9dc06afa0 0x7fe9dc1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0ad220 msgr2=0x7fe9dc150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 -- 172.21.15.50:0/2929907165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc009420 con 0x7fe9dc155e20 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9dad9d700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4001460 tx=0x7fe9d4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400a950 con 0x7fe9dc155e20 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d400aab0 con 0x7fe9dc155e20 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc1593c0 con 0x7fe9dc155e20 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400ae30 con 0x7fe9dc155e20 2023-12-24T18:52:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.184+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc149b20 con 0x7fe9dc155e20 2023-12-24T18:52:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.188+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0c4c00 con 0x7fe9dc155e20 2023-12-24T18:52:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.188+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fe9d4007300 con 0x7fe9dc155e20 2023-12-24T18:52:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.188+0000 7fe9ca7fc700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 0x7fe9bc062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.192+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fe9d407d350 con 0x7fe9dc155e20 2023-12-24T18:52:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.192+0000 7fe9da59c700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 msgr2=0x7fe9bc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.192+0000 7fe9da59c700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 0x7fe9bc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.192+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe9dc0c4c00 con 0x7fe9dc155e20 2023-12-24T18:52:24.212 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.205+0000 7fdaa535b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:24.308 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.301+0000 7fdaa535b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:24.392 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.385+0000 7fdaa535b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:24.396 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.392+0000 7f611ebc6000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.396+0000 7fe9da59c700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 msgr2=0x7fe9bc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.396+0000 7fe9da59c700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 0x7fe9bc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:24.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.400+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9dc0c4c00 con 0x7fe9dc155e20 2023-12-24T18:52:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.400+0000 7fe9ca7fc700 1 -- 172.21.15.50:0/2929907165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16449 (secure 0 0 0) 0x7fe9dc0c4c00 con 0x7fe9dc155e20 2023-12-24T18:52:24.406 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:24.406 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:19.280638+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3016225528":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/2317434603":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/3156373303":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/4243454490":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6834/33814":"2023-12-25T18:52:19.280568+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 msgr2=0x7fe9bc062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 0x7fe9bc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 msgr2=0x7fe9dc151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4001460 tx=0x7fe9d4001a40 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 shutdown_connections 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fe9bc060700 0x7fe9bc062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9dc155e20 0x7fe9dc151490 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0ad220 0x7fe9dc150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 --2- 172.21.15.50:0/2929907165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9dc06afa0 0x7fe9dc1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 >> 172.21.15.50:0/2929907165 conn(0x7fe9dc067b80 msgr2=0x7fe9dc0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 shutdown_connections 2023-12-24T18:52:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.404+0000 7fe9db59e700 1 -- 172.21.15.50:0/2929907165 wait complete. 2023-12-24T18:52:24.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:52:24.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:24.480 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.473+0000 7fdaa535b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:24.493 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.488+0000 7f611ebc6000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:24.580 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.576+0000 7f611ebc6000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 Processor -- start 2023-12-24T18:52:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 -- start start 2023-12-24T18:52:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ba40b41e0 0x7f5ba4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba406b640 con 0x7f5ba406d8c0 2023-12-24T18:52:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba4159710 con 0x7f5ba40b41e0 2023-12-24T18:52:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba8d23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40b5e10 con 0x7f5ba4158e00 2023-12-24T18:52:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba37fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ba40b41e0 0x7f5ba4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba2ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5ba406d8c0 0x7f5ba40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49464/0 (socket says 172.21.15.50:49464) 2023-12-24T18:52:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba2ffd700 1 -- 172.21.15.50:0/2897837563 learned_addr learned my addr 172.21.15.50:0/2897837563 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.584+0000 7f5ba37fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42430/0 (socket says 172.21.15.50:42430) 2023-12-24T18:52:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba27fc700 1 -- 172.21.15.50:0/2897837563 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354806715 0 0) 0x7f5ba406b640 con 0x7f5ba406d8c0 2023-12-24T18:52:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba27fc700 1 -- 172.21.15.50:0/2897837563 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8c003570 con 0x7f5ba406d8c0 2023-12-24T18:52:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba3fff700 1 -- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 msgr2=0x7f5ba41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba3fff700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba3fff700 1 -- 172.21.15.50:0/2897837563 >> v1:172.21.15.82:6789/0 conn(0x7f5ba406d8c0 legacy=0x7f5ba40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba3fff700 1 -- 172.21.15.50:0/2897837563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba406b8e0 con 0x7f5ba40b41e0 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba37fe700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba3fff700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40b41e0 0x7f5ba4159e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009e60 tx=0x7f5b9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47ca88d764cee52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba27fc700 1 -- 172.21.15.50:0/2897837563 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00e070 con 0x7f5ba40b41e0 2023-12-24T18:52:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba27fc700 1 -- 172.21.15.50:0/2897837563 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c00bab0 con 0x7f5ba40b41e0 2023-12-24T18:52:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba27fc700 1 -- 172.21.15.50:0/2897837563 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00be70 con 0x7f5ba40b41e0 2023-12-24T18:52:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40b41e0 msgr2=0x7f5ba4159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40b41e0 0x7f5ba4159e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009e60 tx=0x7f5b9c009780 comp rx=0 tx=0).stop 2023-12-24T18:52:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2897837563 shutdown_connections 2023-12-24T18:52:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40b41e0 0x7f5ba4159e30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2897837563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba4158e00 0x7f5ba41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2897837563 >> 172.21.15.50:0/2897837563 conn(0x7f5ba4067b80 msgr2=0x7f5ba40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2897837563 shutdown_connections 2023-12-24T18:52:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.588+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2897837563 wait complete. 2023-12-24T18:52:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 Processor -- start 2023-12-24T18:52:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 -- start start 2023-12-24T18:52:24.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba40b41e0 0x7f5ba41691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 0x7f5ba415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40acae0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41408b0 con 0x7f5ba4158e00 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba8d23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40af560 con 0x7f5ba40b41e0 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33516/0 (socket says 172.21.15.50:33516) 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 -- 172.21.15.50:0/2036403467 learned_addr learned my addr 172.21.15.50:0/2036403467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba2ffd700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba40b41e0 0x7f5ba41691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba3fff700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 0x7f5ba415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba40b41e0 msgr2=0x7f5ba41691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba40b41e0 0x7f5ba41691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 msgr2=0x7f5ba415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.592+0000 7f5ba37fe700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 0x7f5ba415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba37fe700 1 -- 172.21.15.50:0/2036403467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009420 con 0x7f5ba406d8c0 2023-12-24T18:52:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba3fff700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 0x7f5ba415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba37fe700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400ec80 tx=0x7f5b940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400c9d0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400cb30 con 0x7f5ba406d8c0 2023-12-24T18:52:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c009a20 con 0x7f5ba406d8c0 2023-12-24T18:52:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400ceb0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba40ac770 con 0x7f5ba406d8c0 2023-12-24T18:52:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.596+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba40ac2f0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.600+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f5b94013680 con 0x7f5ba406d8c0 2023-12-24T18:52:24.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.600+0000 7f5b8b7fe700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 0x7f5b90062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.600+0000 7f5ba2ffd700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 msgr2=0x7f5b90062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:24.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.600+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f5b9407d1f0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.600+0000 7f5ba2ffd700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 0x7f5b90062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:24.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.608+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5ba40ac2f0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.678 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.676+0000 7f611ebc6000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:24.721 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.713+0000 7fdaa535b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:24.806 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.801+0000 7fdaa535b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:24.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.804+0000 7f5ba2ffd700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 msgr2=0x7f5b90062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:24.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.804+0000 7f5ba2ffd700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 0x7f5b90062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.808+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ba40ac2f0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.808+0000 7f5b8b7fe700 1 -- 172.21.15.50:0/2036403467 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5ba40ac2f0 con 0x7f5ba406d8c0 2023-12-24T18:52:24.814 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 msgr2=0x7f5b90062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 0x7f5b90062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 msgr2=0x7f5ba4140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400ec80 tx=0x7f5b940091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 shutdown_connections 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f5b90060700 0x7f5b90062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba4158e00 0x7f5ba415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5ba40b41e0 0x7f5ba41691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 --2- 172.21.15.50:0/2036403467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba406d8c0 0x7f5ba4140370 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 >> 172.21.15.50:0/2036403467 conn(0x7f5ba4067b80 msgr2=0x7f5ba40a9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 shutdown_connections 2023-12-24T18:52:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.812+0000 7f5ba8d23700 1 -- 172.21.15.50:0/2036403467 wait complete. 2023-12-24T18:52:24.819 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:24.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:24.898 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:24.893+0000 7fdaa535b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:24.907 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.904+0000 7f611ebc6000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.984+0000 7fa26b59e700 1 Processor -- start 2023-12-24T18:52:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.984+0000 7fa26b59e700 1 -- start start 2023-12-24T18:52:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26c158dd0 0x7fa26c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c06c820 con 0x7fa26c0b0310 2023-12-24T18:52:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c06d680 con 0x7fa26c1591a0 2023-12-24T18:52:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c06ca70 con 0x7fa26c158dd0 2023-12-24T18:52:24.991 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:24.988+0000 7f611ebc6000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26c158dd0 0x7fa26c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa269d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa26c1591a0 0x7fa26c06bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49466/0 (socket says 172.21.15.50:49466) 2023-12-24T18:52:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa269d9b700 1 -- 172.21.15.50:0/783978895 learned_addr learned my addr 172.21.15.50:0/783978895 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26ad9d700 1 --1- 172.21.15.50:0/783978895 >> v1:172.21.15.50:6789/0 conn(0x7fa26c0b0310 0x7fa26c0b2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60866/0 (socket says 172.21.15.50:60866) 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26959a700 1 -- 172.21.15.50:0/783978895 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635729029 0 0) 0x7fa26c06d680 con 0x7fa26c1591a0 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26959a700 1 -- 172.21.15.50:0/783978895 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa254003570 con 0x7fa26c1591a0 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26a59c700 1 -- 172.21.15.50:0/783978895 >> v1:172.21.15.82:6789/0 conn(0x7fa26c1591a0 legacy=0x7fa26c06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26a59c700 1 -- 172.21.15.50:0/783978895 >> v1:172.21.15.50:6789/0 conn(0x7fa26c0b0310 legacy=0x7fa26c0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26a59c700 1 -- 172.21.15.50:0/783978895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c06cd50 con 0x7fa26c158dd0 2023-12-24T18:52:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.988+0000 7fa26a59c700 1 --2- 172.21.15.50:0/783978895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c158dd0 0x7fa26c06db10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0098e0 tx=0x7fa25c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b66da9b4d9a8a46 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26959a700 1 -- 172.21.15.50:0/783978895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00b640 con 0x7fa26c158dd0 2023-12-24T18:52:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26959a700 1 -- 172.21.15.50:0/783978895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c00b7a0 con 0x7fa26c158dd0 2023-12-24T18:52:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26959a700 1 -- 172.21.15.50:0/783978895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00bb40 con 0x7fa26c158dd0 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- 172.21.15.50:0/783978895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c158dd0 msgr2=0x7fa26c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 --2- 172.21.15.50:0/783978895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c158dd0 0x7fa26c06db10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0098e0 tx=0x7fa25c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- 172.21.15.50:0/783978895 shutdown_connections 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 --2- 172.21.15.50:0/783978895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c158dd0 0x7fa26c06db10 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- 172.21.15.50:0/783978895 >> 172.21.15.50:0/783978895 conn(0x7fa26c067ae0 msgr2=0x7fa26c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- 172.21.15.50:0/783978895 shutdown_connections 2023-12-24T18:52:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- 172.21.15.50:0/783978895 wait complete. 2023-12-24T18:52:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 Processor -- start 2023-12-24T18:52:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.992+0000 7fa26b59e700 1 -- start start 2023-12-24T18:52:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 0x7fa26c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26c158dd0 0x7fa26c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 0x7fa26c16c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c156f80 con 0x7fa26c1591a0 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c156370 con 0x7fa26c0b0310 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c156650 con 0x7fa26c158dd0 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 0x7fa26c16c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 0x7fa26c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa269d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26c158dd0 0x7fa26c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 0x7fa26c0af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:59080/0 (socket says 172.21.15.50:59080) 2023-12-24T18:52:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26a59c700 1 -- 172.21.15.50:0/2708715342 learned_addr learned my addr 172.21.15.50:0/2708715342 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:25.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26c158dd0 msgr2=0x7fa26c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26c158dd0 0x7fa26c155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 msgr2=0x7fa26c0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 0x7fa26c0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 -- 172.21.15.50:0/2708715342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c009420 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26ad9d700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 0x7fa26c16c140 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa26400cba0 tx=0x7fa2640019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264005df0 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400a5d0 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400a950 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c156930 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:24.996+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c156050 con 0x7fa26c1591a0 2023-12-24T18:52:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c16a0d0 con 0x7fa26c1591a0 2023-12-24T18:52:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fa26400ad00 con 0x7fa26c1591a0 2023-12-24T18:52:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa25a7fc700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 0x7fa24c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fa26407ce10 con 0x7fa26c1591a0 2023-12-24T18:52:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa26a59c700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 msgr2=0x7fa24c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.000+0000 7fa26a59c700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 0x7fa24c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.008+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa26c16a0d0 con 0x7fa26c1591a0 2023-12-24T18:52:25.094 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:25.092+0000 7f611ebc6000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:25.102 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:25.097+0000 7fdaa535b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:25.194 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:25.189+0000 7fdaa535b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:25.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.204+0000 7fa26a59c700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 msgr2=0x7fa24c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:25.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.204+0000 7fa26a59c700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 0x7fa24c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.212+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa26c16a0d0 con 0x7fa26c1591a0 2023-12-24T18:52:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.212+0000 7fa25a7fc700 1 -- 172.21.15.50:0/2708715342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa26c16a0d0 con 0x7fa26c1591a0 2023-12-24T18:52:25.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:25.217 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:00.007856+0000","modified":"2023-12-24T18:52:03.581610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2320390789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2320390789},{"type":"v1","addr":"172.21.15.50:6837","nonce":2320390789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 msgr2=0x7fa24c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 0x7fa24c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 msgr2=0x7fa26c16c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 0x7fa26c16c140 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa26400cba0 tx=0x7fa2640019b0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 shutdown_connections 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fa24c060700 0x7fa24c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c1591a0 0x7fa26c16c140 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26c158dd0 0x7fa26c155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 --2- 172.21.15.50:0/2708715342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c0b0310 0x7fa26c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 >> 172.21.15.50:0/2708715342 conn(0x7fa26c067ae0 msgr2=0x7fa26c0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:25.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 shutdown_connections 2023-12-24T18:52:25.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.220+0000 7fa26b59e700 1 -- 172.21.15.50:0/2708715342 wait complete. 2023-12-24T18:52:25.224 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-12-24T18:52:25.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:25.315 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:25.312+0000 7f611ebc6000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:25.402 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:25.400+0000 7f611ebc6000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.448+0000 7fbd47878700 1 Processor -- start 2023-12-24T18:52:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.448+0000 7fbd47878700 1 -- start start 2023-12-24T18:52:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd47878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd400ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd47878700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4006a6a0 con 0x7fbd4013f920 2023-12-24T18:52:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd47878700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400cb8a0 con 0x7fbd4013f550 2023-12-24T18:52:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd47878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4006a960 con 0x7fbd400cb3c0 2023-12-24T18:52:25.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd44e13700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbd4013f920 0x7fbd4006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60870/0 (socket says 172.21.15.50:60870) 2023-12-24T18:52:25.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd44e13700 1 -- 172.21.15.50:0/1061141010 learned_addr learned my addr 172.21.15.50:0/1061141010 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:25.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd45e15700 1 --2- 172.21.15.50:0/1061141010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd400ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066189821 0 0) 0x7fbd4006a6a0 con 0x7fbd4013f920 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c003570 con 0x7fbd4013f920 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476366924 0 0) 0x7fbd400cb8a0 con 0x7fbd4013f550 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd4006a6a0 con 0x7fbd4013f550 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd45e15700 1 -- 172.21.15.50:0/1061141010 >> v1:172.21.15.82:6789/0 conn(0x7fbd4013f550 legacy=0x7fbd4006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd45e15700 1 -- 172.21.15.50:0/1061141010 >> v1:172.21.15.50:6789/0 conn(0x7fbd4013f920 legacy=0x7fbd4006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd45e15700 1 -- 172.21.15.50:0/1061141010 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4006ac40 con 0x7fbd400cb3c0 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd45e15700 1 --2- 172.21.15.50:0/1061141010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd400ab5e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009e90 tx=0x7fbd38009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a23d8ee465ecad83 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.452+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800e070 con 0x7fbd400cb3c0 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800bb80 con 0x7fbd400cb3c0 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd37fff700 1 -- 172.21.15.50:0/1061141010 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38012430 con 0x7fbd400cb3c0 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- 172.21.15.50:0/1061141010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 msgr2=0x7fbd400ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 --2- 172.21.15.50:0/1061141010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd400ab5e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009e90 tx=0x7fbd38009780 comp rx=0 tx=0).stop 2023-12-24T18:52:25.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- 172.21.15.50:0/1061141010 shutdown_connections 2023-12-24T18:52:25.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 --2- 172.21.15.50:0/1061141010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd400ab5e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- 172.21.15.50:0/1061141010 >> 172.21.15.50:0/1061141010 conn(0x7fbd400cbba0 msgr2=0x7fbd400cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:25.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- 172.21.15.50:0/1061141010 shutdown_connections 2023-12-24T18:52:25.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- 172.21.15.50:0/1061141010 wait complete. 2023-12-24T18:52:25.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 Processor -- start 2023-12-24T18:52:25.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.456+0000 7fbd47878700 1 -- start start 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd4016a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4013f550 0x7fbd4016c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c3bf0 con 0x7fbd4013f920 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400aec30 con 0x7fbd4013f550 2023-12-24T18:52:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400aef10 con 0x7fbd400cb3c0 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd44e13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4013f550 0x7fbd4016c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33538/0 (socket says 172.21.15.50:33538) 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 -- 172.21.15.50:0/3052289689 learned_addr learned my addr 172.21.15.50:0/3052289689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45614700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd4016a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 -- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 msgr2=0x7fbd4016a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd4016a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 -- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4013f550 msgr2=0x7fbd4016c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4013f550 0x7fbd4016c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 -- 172.21.15.50:0/3052289689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009a20 con 0x7fbd4013f920 2023-12-24T18:52:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd45e15700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd4006a150 tx=0x7fbd38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3801b420 con 0x7fbd4013f920 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3801b5a0 con 0x7fbd4013f920 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd400af1f0 con 0x7fbd4013f920 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3801b960 con 0x7fbd4013f920 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.460+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd400c4ae0 con 0x7fbd4013f920 2023-12-24T18:52:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd400c5e90 con 0x7fbd4013f920 2023-12-24T18:52:25.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fbd3801bd50 con 0x7fbd4013f920 2023-12-24T18:52:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd357fa700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 0x7fbd24062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fbd3807edc0 con 0x7fbd4013f920 2023-12-24T18:52:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd45614700 1 -- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 msgr2=0x7fbd24062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.464+0000 7fbd45614700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 0x7fbd24062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:25.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.472+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd400c5e90 con 0x7fbd4013f920 2023-12-24T18:52:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.648+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd400c5e90 con 0x7fbd4013f920 2023-12-24T18:52:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.652+0000 7fbd357fa700 1 -- 172.21.15.50:0/3052289689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16449 (secure 0 0 0) 0x7fbd400c5e90 con 0x7fbd4013f920 2023-12-24T18:52:25.655 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:25.655 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:19.280638+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:51:57.597375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-24T18:51:59.074957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3016225528":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/2317434603":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/3156373303":"2023-12-25T18:52:19.280568+0000","172.21.15.50:0/4243454490":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:19.280568+0000","172.21.15.50:6834/33814":"2023-12-25T18:52:19.280568+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 msgr2=0x7fbd24062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 0x7fbd24062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 msgr2=0x7fbd400c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd4006a150 tx=0x7fbd38019000 comp rx=0 tx=0).stop 2023-12-24T18:52:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 shutdown_connections 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7fbd24060730 0x7fbd24062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd4013f920 0x7fbd400c45a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4013f550 0x7fbd4016c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 --2- 172.21.15.50:0/3052289689 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd400cb3c0 0x7fbd4016a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 >> 172.21.15.50:0/3052289689 conn(0x7fbd400cbba0 msgr2=0x7fbd400adc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 shutdown_connections 2023-12-24T18:52:25.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.656+0000 7fbd47878700 1 -- 172.21.15.50:0/3052289689 wait complete. 2023-12-24T18:52:25.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:52:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.852+0000 7f619aa2e700 1 Processor -- start 2023-12-24T18:52:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.852+0000 7f619aa2e700 1 -- start start 2023-12-24T18:52:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f619aa2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61940c6d00 0x7f61940c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f619aa2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 0x7f619406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f619aa2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619406c820 con 0x7f6194154450 2023-12-24T18:52:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f619aa2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619406b960 con 0x7f61940c6d00 2023-12-24T18:52:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f619aa2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619406bc40 con 0x7f619406aca0 2023-12-24T18:52:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61940c6d00 0x7f61940c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61940c6d00 0x7f61940c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33542/0 (socket says 172.21.15.50:33542) 2023-12-24T18:52:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 -- 172.21.15.50:0/2036208071 learned_addr learned my addr 172.21.15.50:0/2036208071 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6198fcb700 1 --2- 172.21.15.50:0/2036208071 >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 0x7f619406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 -- 172.21.15.50:0/2036208071 >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 msgr2=0x7f619406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 --2- 172.21.15.50:0/2036208071 >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 0x7f619406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 -- 172.21.15.50:0/2036208071 >> v1:172.21.15.82:6789/0 conn(0x7f6194154450 legacy=0x7f61941548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 -- 172.21.15.50:0/2036208071 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619406bf20 con 0x7f61940c6d00 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6198fcb700 1 --2- 172.21.15.50:0/2036208071 >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 0x7f619406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.856+0000 7f6193fff700 1 --2- 172.21.15.50:0/2036208071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940c6d00 0x7f61940c70d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6194069f60 tx=0x7f6184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbf9fe9543ccc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f6192ffd700 1 -- 172.21.15.50:0/2036208071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400b860 con 0x7f61940c6d00 2023-12-24T18:52:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f6192ffd700 1 -- 172.21.15.50:0/2036208071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400b9c0 con 0x7f61940c6d00 2023-12-24T18:52:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f6192ffd700 1 -- 172.21.15.50:0/2036208071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400bd60 con 0x7f61940c6d00 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 -- 172.21.15.50:0/2036208071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940c6d00 msgr2=0x7f61940c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 --2- 172.21.15.50:0/2036208071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940c6d00 0x7f61940c70d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6194069f60 tx=0x7f6184009250 comp rx=0 tx=0).stop 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 -- 172.21.15.50:0/2036208071 shutdown_connections 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 --2- 172.21.15.50:0/2036208071 >> v2:172.21.15.82:3300/0 conn(0x7f619406aca0 0x7f619406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 --2- 172.21.15.50:0/2036208071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940c6d00 0x7f61940c70d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 -- 172.21.15.50:0/2036208071 >> 172.21.15.50:0/2036208071 conn(0x7f61940cbba0 msgr2=0x7f61940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 -- 172.21.15.50:0/2036208071 shutdown_connections 2023-12-24T18:52:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.860+0000 7f619aa2e700 1 -- 172.21.15.50:0/2036208071 wait complete. 2023-12-24T18:52:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 Processor -- start 2023-12-24T18:52:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 -- start start 2023-12-24T18:52:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61940c6d00 0x7f6194169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6194154450 0x7f61940af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940b0a20 con 0x7f619406aca0 2023-12-24T18:52:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194169d60 con 0x7f61940c6d00 2023-12-24T18:52:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f619aa2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940ac080 con 0x7f6194154450 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f6193fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f6193fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33550/0 (socket says 172.21.15.50:33550) 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f6193fff700 1 -- 172.21.15.50:0/4128735976 learned_addr learned my addr 172.21.15.50:0/4128735976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f61937fe700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61940c6d00 0x7f6194169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.864+0000 7f6198fcb700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6194154450 0x7f61940af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6194154450 msgr2=0x7f61940af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6194154450 0x7f61940af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61940c6d00 msgr2=0x7f6194169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61940c6d00 0x7f6194169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 -- 172.21.15.50:0/4128735976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840094f0 con 0x7f619406aca0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f6193fff700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6184009290 tx=0x7f6184017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184026480 con 0x7f619406aca0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618401f070 con 0x7f619406aca0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61940ac360 con 0x7f619406aca0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184026850 con 0x7f619406aca0 2023-12-24T18:52:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6194169710 con 0x7f619406aca0 2023-12-24T18:52:25.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.868+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61940ac840 con 0x7f619406aca0 2023-12-24T18:52:25.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.872+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 42) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f618401a430 con 0x7f619406aca0 2023-12-24T18:52:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.872+0000 7f617bfff700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 0x7f6180062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.872+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f6184021070 con 0x7f619406aca0 2023-12-24T18:52:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.872+0000 7f61937fe700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 msgr2=0x7f6180062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.872+0000 7f61937fe700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 0x7f6180062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:25.880+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f618404ed10 con 0x7f619406aca0 2023-12-24T18:52:25.954 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:25.949+0000 7fdaa535b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.076+0000 7f61937fe700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 msgr2=0x7f6180062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6834/33814 2023-12-24T18:52:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.076+0000 7f61937fe700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 0x7f6180062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.100+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f61940652e0 con 0x7f619406aca0 2023-12-24T18:52:26.103 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:52:26.100+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:52:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.108+0000 7f617bfff700 1 -- 172.21.15.50:0/4128735976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6184015020 con 0x7f619406aca0 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 msgr2=0x7f6180062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 0x7f6180062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 msgr2=0x7f619416a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6184009290 tx=0x7f6184017000 comp rx=0 tx=0).stop 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 shutdown_connections 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:6834/33814,v1:172.21.15.50:6836/33814] conn(0x7f6180060700 0x7f6180062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6194154450 0x7f61940af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61940c6d00 0x7f6194169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 --2- 172.21.15.50:0/4128735976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619406aca0 0x7f619416a1f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 >> 172.21.15.50:0/4128735976 conn(0x7f61940cbba0 msgr2=0x7f61940c2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 shutdown_connections 2023-12-24T18:52:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.112+0000 7f619aa2e700 1 -- 172.21.15.50:0/4128735976 wait complete. 2023-12-24T18:52:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:52:26.119 INFO:tasks.ceph.mds.c.smithi050.stderr: -1181> 2023-12-24T18:52:06.517+0000 7f7c28688700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:52:26.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:52:26.164 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:52:26.236 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.232+0000 7f611ebc6000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:26.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.296+0000 7fb45b2a5700 1 Processor -- start 2023-12-24T18:52:26.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.296+0000 7fb45b2a5700 1 -- start start 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 0x7fb454068e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4541591e0 0x7fb454069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb45406e340 0x7fb45406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45406f380 con 0x7fb454158e10 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540cb040 con 0x7fb4541591e0 2023-12-24T18:52:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb45b2a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45406f0a0 con 0x7fb45406e340 2023-12-24T18:52:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4541591e0 0x7fb454069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb459041700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 0x7fb454068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4541591e0 0x7fb454069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:59156/0 (socket says 172.21.15.50:59156) 2023-12-24T18:52:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 -- 172.21.15.50:0/1890686234 learned_addr learned my addr 172.21.15.50:0/1890686234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb459842700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb45406e340 0x7fb45406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 -- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb45406e340 msgr2=0x7fb45406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb45406e340 0x7fb45406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 -- 172.21.15.50:0/1890686234 >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 msgr2=0x7fb454068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 --2- 172.21.15.50:0/1890686234 >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 0x7fb454068e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb458840700 1 -- 172.21.15.50:0/1890686234 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540ca9f0 con 0x7fb4541591e0 2023-12-24T18:52:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.300+0000 7fb459041700 1 --2- 172.21.15.50:0/1890686234 >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 0x7fb454068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb458840700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4541591e0 0x7fb454069390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ca750 tx=0x7fb444009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f344a5be72c4ce8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb44bfff700 1 -- 172.21.15.50:0/1890686234 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400b640 con 0x7fb4541591e0 2023-12-24T18:52:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb44bfff700 1 -- 172.21.15.50:0/1890686234 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400b7a0 con 0x7fb4541591e0 2023-12-24T18:52:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb44bfff700 1 -- 172.21.15.50:0/1890686234 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400bb60 con 0x7fb4541591e0 2023-12-24T18:52:26.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 -- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4541591e0 msgr2=0x7fb454069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:26.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4541591e0 0x7fb454069390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ca750 tx=0x7fb444009250 comp rx=0 tx=0).stop 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 -- 172.21.15.50:0/1890686234 shutdown_connections 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4541591e0 0x7fb454069390 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/1890686234 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb45406e340 0x7fb45406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/1890686234 >> v2:172.21.15.50:3300/0 conn(0x7fb454158e10 0x7fb454068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 -- 172.21.15.50:0/1890686234 >> 172.21.15.50:0/1890686234 conn(0x7fb4540ccc80 msgr2=0x7fb4540cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 -- 172.21.15.50:0/1890686234 shutdown_connections 2023-12-24T18:52:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.304+0000 7fb45b2a5700 1 -- 172.21.15.50:0/1890686234 wait complete. 2023-12-24T18:52:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 Processor -- start 2023-12-24T18:52:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 -- start start 2023-12-24T18:52:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb454158e10 0x7fb4540b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4541591e0 0x7fb45416bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b2a80 con 0x7fb4541591e0 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540ad4a0 con 0x7fb45406e340 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb45b2a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540ac890 con 0x7fb454158e10 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb458840700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb454158e10 0x7fb4540b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb459041700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb459041700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:59164/0 (socket says 172.21.15.50:59164) 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb459041700 1 -- 172.21.15.50:0/404617698 learned_addr learned my addr 172.21.15.50:0/404617698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.308+0000 7fb459842700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4541591e0 0x7fb45416bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 -- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb454158e10 msgr2=0x7fb4540b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb454158e10 0x7fb4540b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 -- 172.21.15.50:0/404617698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4541591e0 msgr2=0x7fb45416bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4541591e0 0x7fb45416bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 -- 172.21.15.50:0/404617698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450009a20 con 0x7fb45406e340 2023-12-24T18:52:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb459041700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c170 tx=0x7fb45000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000ccb0 con 0x7fb45406e340 2023-12-24T18:52:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45000f040 con 0x7fb45406e340 2023-12-24T18:52:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450014480 con 0x7fb45406e340 2023-12-24T18:52:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4440094f0 con 0x7fb45406e340 2023-12-24T18:52:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4540ace50 con 0x7fb45406e340 2023-12-24T18:52:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.312+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4540652e0 con 0x7fb45406e340 2023-12-24T18:52:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.316+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 79672+0+0 (secure 0 0 0) 0x7fb4500147f0 con 0x7fb45406e340 2023-12-24T18:52:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.316+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7046+0+0 (secure 0 0 0) 0x7fb45007d680 con 0x7fb45406e340 2023-12-24T18:52:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.324+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb45004da00 con 0x7fb45406e340 2023-12-24T18:52:26.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e56cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e56cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e56cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e56cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e56cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.356 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e9ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.356 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e9ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.356 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e9ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.356 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e9ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.356 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:26.352+0000 7f60e9ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:26.544+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb4540cacd0 con 0x7fb45406e340 2023-12-24T18:52:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.116+0000 7fb4497fa700 1 -- 172.21.15.50:0/404617698 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb450051020 con 0x7fb45406e340 2023-12-24T18:52:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 msgr2=0x7fb4540ac190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c170 tx=0x7fb45000b040 comp rx=0 tx=0).stop 2023-12-24T18:52:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 shutdown_connections 2023-12-24T18:52:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4541591e0 0x7fb45416bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb454158e10 0x7fb4540b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 --2- 172.21.15.50:0/404617698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb45406e340 0x7fb4540ac190 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 >> 172.21.15.50:0/404617698 conn(0x7fb4540ccc80 msgr2=0x7fb4541566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 shutdown_connections 2023-12-24T18:52:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.120+0000 7fb45b2a5700 1 -- 172.21.15.50:0/404617698 wait complete. 2023-12-24T18:52:27.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:52:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.380+0000 7fa5a342e700 1 Processor -- start 2023-12-24T18:52:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.380+0000 7fa5a342e700 1 -- start start 2023-12-24T18:52:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa59c0c8070 0x7fa59c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 0x7fa59c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa59c0aef80 0x7fa59c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c0af450 con 0x7fa59c0aef80 2023-12-24T18:52:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c0af730 con 0x7fa59c0c8070 2023-12-24T18:52:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a342e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0afa10 con 0x7fa59c0c8440 2023-12-24T18:52:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a11ca700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa59c0c8070 0x7fa59c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a09c9700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 0x7fa59c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.384+0000 7fa5a19cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa59c0aef80 0x7fa59c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a09c9700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 0x7fa59c0b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42620/0 (socket says 172.21.15.50:42620) 2023-12-24T18:52:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a09c9700 1 -- 172.21.15.50:0/3041372087 learned_addr learned my addr 172.21.15.50:0/3041372087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3041372087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 msgr2=0x7fa59c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3041372087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 0x7fa59c0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3041372087 >> v2:172.21.15.82:3300/0 conn(0x7fa59c0c8070 msgr2=0x7fa59c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3041372087 >> v2:172.21.15.82:3300/0 conn(0x7fa59c0c8070 0x7fa59c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3041372087 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0afcf0 con 0x7fa59c0aef80 2023-12-24T18:52:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3041372087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0aef80 0x7fa59c0b0e80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa59c068ba0 tx=0x7fa594009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9449e522ae3f4c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa593fff700 1 -- 172.21.15.50:0/3041372087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400e070 con 0x7fa59c0aef80 2023-12-24T18:52:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa593fff700 1 -- 172.21.15.50:0/3041372087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59400bab0 con 0x7fa59c0aef80 2023-12-24T18:52:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa593fff700 1 -- 172.21.15.50:0/3041372087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400be50 con 0x7fa59c0aef80 2023-12-24T18:52:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.388+0000 7fa5a342e700 1 -- 172.21.15.50:0/3041372087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0aef80 msgr2=0x7fa59c0b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3041372087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0aef80 0x7fa59c0b0e80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa59c068ba0 tx=0x7fa594009780 comp rx=0 tx=0).stop 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 -- 172.21.15.50:0/3041372087 shutdown_connections 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3041372087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0aef80 0x7fa59c0b0e80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3041372087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8440 0x7fa59c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3041372087 >> v2:172.21.15.82:3300/0 conn(0x7fa59c0c8070 0x7fa59c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 -- 172.21.15.50:0/3041372087 >> 172.21.15.50:0/3041372087 conn(0x7fa59c067b80 msgr2=0x7fa59c0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 -- 172.21.15.50:0/3041372087 shutdown_connections 2023-12-24T18:52:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 -- 172.21.15.50:0/3041372087 wait complete. 2023-12-24T18:52:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 Processor -- start 2023-12-24T18:52:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.392+0000 7fa5a342e700 1 -- start start 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c0aef80 0x7fa59c140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 0x7fa59c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c155f00 con 0x7fa59c0c8440 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c140c40 con 0x7fa59c0aef80 2023-12-24T18:52:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c14e950 con 0x7fa59c0c8070 2023-12-24T18:52:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a09c9700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 0x7fa59c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33688/0 (socket says 172.21.15.50:33688) 2023-12-24T18:52:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3485216651 learned_addr learned my addr 172.21.15.50:0/3485216651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a11ca700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c0aef80 0x7fa59c140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 msgr2=0x7fa59c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 0x7fa59c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c0aef80 msgr2=0x7fa59c140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c0aef80 0x7fa59c140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 -- 172.21.15.50:0/3485216651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594009a20 con 0x7fa59c0c8440 2023-12-24T18:52:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a09c9700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 0x7fa59c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a19cb700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa594013000 tx=0x7fa594019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594007040 con 0x7fa59c0c8440 2023-12-24T18:52:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594012d80 con 0x7fa59c0c8440 2023-12-24T18:52:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594026640 con 0x7fa59c0c8440 2023-12-24T18:52:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c155940 con 0x7fa59c0c8440 2023-12-24T18:52:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.396+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c14e5e0 con 0x7fa59c0c8440 2023-12-24T18:52:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.400+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c071060 con 0x7fa59c0c8440 2023-12-24T18:52:27.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.400+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 44) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fa5940269b0 con 0x7fa59c0c8440 2023-12-24T18:52:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.404+0000 7fa5917fa700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 0x7fa580062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.404+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7046+0+0 (secure 0 0 0) 0x7fa59407e500 con 0x7fa59c0c8440 2023-12-24T18:52:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.404+0000 7fa5a11ca700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 0x7fa580062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.404+0000 7fa5a11ca700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 0x7fa580062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa59c1565c0 tx=0x7fa5980091a0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.412+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa59404e790 con 0x7fa59c0c8440 2023-12-24T18:52:27.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:27.592+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa59c157570 con 0x7fa59c0c8440 2023-12-24T18:52:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.340+0000 7fa5917fa700 1 -- 172.21.15.50:0/3485216651 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa594051db0 con 0x7fa59c0c8440 2023-12-24T18:52:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 msgr2=0x7fa580062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 0x7fa580062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa59c1565c0 tx=0x7fa5980091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 msgr2=0x7fa59c06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa594013000 tx=0x7fa594019000 comp rx=0 tx=0).stop 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 shutdown_connections 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa5800603a0 0x7fa580062850 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa59c1565c0 tx=0x7fa5980091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c0c8440 0x7fa59c06cc00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa59c0c8070 0x7fa59c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 --2- 172.21.15.50:0/3485216651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c0aef80 0x7fa59c140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 >> 172.21.15.50:0/3485216651 conn(0x7fa59c067b80 msgr2=0x7fa59c06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 shutdown_connections 2023-12-24T18:52:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.344+0000 7fa5a342e700 1 -- 172.21.15.50:0/3485216651 wait complete. 2023-12-24T18:52:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:52:28.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:52:28.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.536+0000 7fddfdef0700 1 Processor -- start 2023-12-24T18:52:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.536+0000 7fddfdef0700 1 -- start start 2023-12-24T18:52:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddfdef0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8156b50 0x7fddf815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddfdef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf80b4230 0x7fddf806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddfdef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf806d4d0 con 0x7fddf806db90 2023-12-24T18:52:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddfdef0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80b4960 con 0x7fddf8156b50 2023-12-24T18:52:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddfdef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815a620 con 0x7fddf80b4230 2023-12-24T18:52:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8156b50 0x7fddf815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8156b50 0x7fddf815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33692/0 (socket says 172.21.15.50:33692) 2023-12-24T18:52:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 -- 172.21.15.50:0/213399865 learned_addr learned my addr 172.21.15.50:0/213399865 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf7fff700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf80b4230 0x7fddf806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 -- 172.21.15.50:0/213399865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf80b4230 msgr2=0x7fddf806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf80b4230 0x7fddf806a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 -- 172.21.15.50:0/213399865 >> v1:172.21.15.82:6789/0 conn(0x7fddf806db90 legacy=0x7fddf80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf67fc700 1 -- 172.21.15.50:0/213399865 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618898522 0 0) 0x7fddf806d4d0 con 0x7fddf806db90 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 -- 172.21.15.50:0/213399865 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf806c8c0 con 0x7fddf8156b50 2023-12-24T18:52:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf77fe700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8156b50 0x7fddf815a0e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fdde80099b0 tx=0x7fdde8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb4eb3280cb2a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:28.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf67fc700 1 -- 172.21.15.50:0/213399865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8009ea0 con 0x7fddf8156b50 2023-12-24T18:52:28.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf67fc700 1 -- 172.21.15.50:0/213399865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde800b860 con 0x7fddf8156b50 2023-12-24T18:52:28.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.540+0000 7fddf67fc700 1 -- 172.21.15.50:0/213399865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800bc00 con 0x7fddf8156b50 2023-12-24T18:52:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- 172.21.15.50:0/213399865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8156b50 msgr2=0x7fddf815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8156b50 0x7fddf815a0e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fdde80099b0 tx=0x7fdde8009250 comp rx=0 tx=0).stop 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- 172.21.15.50:0/213399865 shutdown_connections 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf80b4230 0x7fddf806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 --2- 172.21.15.50:0/213399865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8156b50 0x7fddf815a0e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- 172.21.15.50:0/213399865 >> 172.21.15.50:0/213399865 conn(0x7fddf8067b40 msgr2=0x7fddf80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- 172.21.15.50:0/213399865 shutdown_connections 2023-12-24T18:52:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- 172.21.15.50:0/213399865 wait complete. 2023-12-24T18:52:28.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 Processor -- start 2023-12-24T18:52:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.544+0000 7fddfdef0700 1 -- start start 2023-12-24T18:52:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf806db90 0x7fddf8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 0x7fddf8152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8153bb0 con 0x7fddf80b4230 2023-12-24T18:52:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8151170 con 0x7fddf8156b50 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf814d3f0 con 0x7fddf806db90 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33708/0 (socket says 172.21.15.50:33708) 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 -- 172.21.15.50:0/2659639069 learned_addr learned my addr 172.21.15.50:0/2659639069 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf77fe700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf806db90 0x7fddf8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf7fff700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 0x7fddf8152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 -- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf806db90 msgr2=0x7fddf8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf806db90 0x7fddf8151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 -- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 msgr2=0x7fddf8152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 0x7fddf8152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 -- 172.21.15.50:0/2659639069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80094f0 con 0x7fddf80b4230 2023-12-24T18:52:28.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf7fff700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 0x7fddf8152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddf6ffd700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c7e0 tx=0x7fddec007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011590 con 0x7fddf80b4230 2023-12-24T18:52:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0116f0 con 0x7fddf80b4230 2023-12-24T18:52:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011ab0 con 0x7fddf80b4230 2023-12-24T18:52:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf81538d0 con 0x7fddf80b4230 2023-12-24T18:52:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.548+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf8150e00 con 0x7fddf80b4230 2023-12-24T18:52:28.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.552+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8151320 con 0x7fddf80b4230 2023-12-24T18:52:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.552+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fddec01c460 con 0x7fddf80b4230 2023-12-24T18:52:28.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.556+0000 7fdddf7fe700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 0x7fdde4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:28.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.556+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fddec07c760 con 0x7fddf80b4230 2023-12-24T18:52:28.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.556+0000 7fddf77fe700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 0x7fdde4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:28.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.556+0000 7fddf77fe700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 0x7fdde4062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdde80099b0 tx=0x7fdde8017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:28.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.564+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddf8151320 con 0x7fddf80b4230 2023-12-24T18:52:28.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:52:28.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:52:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:28.732+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fddf81512e0 con 0x7fddf80b4230 2023-12-24T18:52:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.652+0000 7fdddf7fe700 1 -- 172.21.15.50:0/2659639069 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7fddec050460 con 0x7fddf80b4230 2023-12-24T18:52:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 msgr2=0x7fdde4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 0x7fdde4062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdde80099b0 tx=0x7fdde8017000 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 msgr2=0x7fddf814b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c7e0 tx=0x7fddec007de0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 shutdown_connections 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdde4060550 0x7fdde4062a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf8156b50 0x7fddf8152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80b4230 0x7fddf814b250 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 --2- 172.21.15.50:0/2659639069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddf806db90 0x7fddf8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 >> 172.21.15.50:0/2659639069 conn(0x7fddf8067b40 msgr2=0x7fddf8158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 shutdown_connections 2023-12-24T18:52:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.656+0000 7fddfdef0700 1 -- 172.21.15.50:0/2659639069 wait complete. 2023-12-24T18:52:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:52:29.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:52:29.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.848+0000 7ff0bb363700 1 Processor -- start 2023-12-24T18:52:29.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.848+0000 7ff0bb363700 1 -- start start 2023-12-24T18:52:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bb363700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0b40c7530 0x7ff0b40ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bb363700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b40c6090 con 0x7ff0b40c8ee0 2023-12-24T18:52:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bb363700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b40adab0 con 0x7ff0b4155ab0 2023-12-24T18:52:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bb363700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b40add90 con 0x7ff0b40c7530 2023-12-24T18:52:29.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b9b60700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff0b40c8ee0 0x7ff0b40acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46478/0 (socket says 172.21.15.50:46478) 2023-12-24T18:52:29.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b9b60700 1 -- 172.21.15.50:0/1289644982 learned_addr learned my addr 172.21.15.50:0/1289644982 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:29.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bab62700 1 --2- 172.21.15.50:0/1289644982 >> v2:172.21.15.82:3300/0 conn(0x7ff0b40c7530 0x7ff0b40ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715688145 0 0) 0x7ff0b40c6090 con 0x7ff0b40c8ee0 2023-12-24T18:52:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a0003570 con 0x7ff0b40c8ee0 2023-12-24T18:52:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76202850 0 0) 0x7ff0b40adab0 con 0x7ff0b4155ab0 2023-12-24T18:52:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b40c6090 con 0x7ff0b4155ab0 2023-12-24T18:52:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bab62700 1 -- 172.21.15.50:0/1289644982 >> v1:172.21.15.82:6789/0 conn(0x7ff0b4155ab0 legacy=0x7ff0b40c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bab62700 1 -- 172.21.15.50:0/1289644982 >> v1:172.21.15.50:6789/0 conn(0x7ff0b40c8ee0 legacy=0x7ff0b40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.852+0000 7ff0bab62700 1 -- 172.21.15.50:0/1289644982 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40ae070 con 0x7ff0b40c7530 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bab62700 1 --2- 172.21.15.50:0/1289644982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c7530 0x7ff0b40ad450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009e60 tx=0x7ff0ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a577abc2146549 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00e070 con 0x7ff0b40c7530 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00bab0 con 0x7ff0b40c7530 2023-12-24T18:52:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0b935f700 1 -- 172.21.15.50:0/1289644982 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00be70 con 0x7ff0b40c7530 2023-12-24T18:52:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 -- 172.21.15.50:0/1289644982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c7530 msgr2=0x7ff0b40ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1289644982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c7530 0x7ff0b40ad450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009e60 tx=0x7ff0ac009780 comp rx=0 tx=0).stop 2023-12-24T18:52:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 -- 172.21.15.50:0/1289644982 shutdown_connections 2023-12-24T18:52:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1289644982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c7530 0x7ff0b40ad450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 -- 172.21.15.50:0/1289644982 >> 172.21.15.50:0/1289644982 conn(0x7ff0b4067250 msgr2=0x7ff0b4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 -- 172.21.15.50:0/1289644982 shutdown_connections 2023-12-24T18:52:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.856+0000 7ff0bb363700 1 -- 172.21.15.50:0/1289644982 wait complete. 2023-12-24T18:52:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 Processor -- start 2023-12-24T18:52:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 -- start start 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0b40c7530 0x7ff0b4169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 0x7ff0b40c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40ae870 con 0x7ff0b4155ab0 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40af3f0 con 0x7ff0b40c8ee0 2023-12-24T18:52:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.860+0000 7ff0bb363700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40af880 con 0x7ff0b40c7530 2023-12-24T18:52:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0b9b60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 0x7ff0b40c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44066/0 (socket says 172.21.15.50:44066) 2023-12-24T18:52:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 -- 172.21.15.50:0/1256846178 learned_addr learned my addr 172.21.15.50:0/1256846178 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0ba361700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0b40c7530 0x7ff0b4169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 -- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0b40c7530 msgr2=0x7ff0b4169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0b40c7530 0x7ff0b4169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 -- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 msgr2=0x7ff0b40c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 0x7ff0b40c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 -- 172.21.15.50:0/1256846178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac009a20 con 0x7ff0b4155ab0 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0b9b60700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 0x7ff0b40c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bab62700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b610 tx=0x7ff0ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac012de0 con 0x7ff0b4155ab0 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac026480 con 0x7ff0b4155ab0 2023-12-24T18:52:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac026840 con 0x7ff0b4155ab0 2023-12-24T18:52:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40aeac0 con 0x7ff0b4155ab0 2023-12-24T18:52:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.864+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b40af080 con 0x7ff0b4155ab0 2023-12-24T18:52:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff0ac01c400 con 0x7ff0b4155ab0 2023-12-24T18:52:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b404be40 con 0x7ff0b4155ab0 2023-12-24T18:52:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0aa7fc700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 0x7ff098062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7ff0ac07e890 con 0x7ff0b4155ab0 2023-12-24T18:52:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0ba361700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 0x7ff098062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.868+0000 7ff0ba361700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 0x7ff098062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0007d50 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:29.872+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff0ac04ebf0 con 0x7ff0b4155ab0 2023-12-24T18:52:30.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.044+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff0b40af530 con 0x7ff0b4155ab0 2023-12-24T18:52:30.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.056+0000 7ff0aa7fc700 1 -- 172.21.15.50:0/1256846178 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff0ac052210 con 0x7ff0b4155ab0 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 msgr2=0x7ff098062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 0x7ff098062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0007d50 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 msgr2=0x7ff0b40c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b610 tx=0x7ff0ac019000 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 shutdown_connections 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff098060550 0x7ff098062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b4155ab0 0x7ff0b40c19f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0b40c8ee0 0x7ff0b40c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 --2- 172.21.15.50:0/1256846178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0b40c7530 0x7ff0b4169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 >> 172.21.15.50:0/1256846178 conn(0x7ff0b4067250 msgr2=0x7ff0b40c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:30.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 shutdown_connections 2023-12-24T18:52:30.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.060+0000 7ff0bb363700 1 -- 172.21.15.50:0/1256846178 wait complete. 2023-12-24T18:52:30.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:52:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 Processor -- start 2023-12-24T18:52:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 -- start start 2023-12-24T18:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb390158c40 0x7fb3900cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb39006d450 0x7fb3900ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39006a580 con 0x7fb3900cc780 2023-12-24T18:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cd110 con 0x7fb390158c40 2023-12-24T18:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb394923700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39006a7d0 con 0x7fb39006d450 2023-12-24T18:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb38effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb3900cc780 0x7fb39006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46494/0 (socket says 172.21.15.50:46494) 2023-12-24T18:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb38effd700 1 -- 172.21.15.50:0/2458108140 learned_addr learned my addr 172.21.15.50:0/2458108140 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.260+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/2458108140 >> v2:172.21.15.50:3300/0 conn(0x7fb390158c40 0x7fb3900cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38ffff700 1 --2- 172.21.15.50:0/2458108140 >> v2:172.21.15.82:3300/0 conn(0x7fb39006d450 0x7fb3900ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38e7fc700 1 -- 172.21.15.50:0/2458108140 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073691793 0 0) 0x7fb39006a580 con 0x7fb3900cc780 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38e7fc700 1 -- 172.21.15.50:0/2458108140 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb378003570 con 0x7fb3900cc780 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38f7fe700 1 -- 172.21.15.50:0/2458108140 >> v2:172.21.15.82:3300/0 conn(0x7fb39006d450 msgr2=0x7fb3900ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/2458108140 >> v2:172.21.15.82:3300/0 conn(0x7fb39006d450 0x7fb3900ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38f7fe700 1 -- 172.21.15.50:0/2458108140 >> v1:172.21.15.50:6789/0 conn(0x7fb3900cc780 legacy=0x7fb39006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38f7fe700 1 -- 172.21.15.50:0/2458108140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39006aab0 con 0x7fb390158c40 2023-12-24T18:52:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/2458108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb390158c40 0x7fb3900cf500 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc710 tx=0x7fb3800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d6abe71606425e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38e7fc700 1 -- 172.21.15.50:0/2458108140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380011630 con 0x7fb390158c40 2023-12-24T18:52:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38e7fc700 1 -- 172.21.15.50:0/2458108140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3800117b0 con 0x7fb390158c40 2023-12-24T18:52:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb38e7fc700 1 -- 172.21.15.50:0/2458108140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380011b70 con 0x7fb390158c40 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 -- 172.21.15.50:0/2458108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb390158c40 msgr2=0x7fb3900cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 --2- 172.21.15.50:0/2458108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb390158c40 0x7fb3900cf500 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc710 tx=0x7fb3800091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 -- 172.21.15.50:0/2458108140 shutdown_connections 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 --2- 172.21.15.50:0/2458108140 >> v2:172.21.15.82:3300/0 conn(0x7fb39006d450 0x7fb3900ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 --2- 172.21.15.50:0/2458108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb390158c40 0x7fb3900cf500 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 -- 172.21.15.50:0/2458108140 >> 172.21.15.50:0/2458108140 conn(0x7fb3900d0800 msgr2=0x7fb3900b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 -- 172.21.15.50:0/2458108140 shutdown_connections 2023-12-24T18:52:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.264+0000 7fb394923700 1 -- 172.21.15.50:0/2458108140 wait complete. 2023-12-24T18:52:30.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.268+0000 7fb394923700 1 Processor -- start 2023-12-24T18:52:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.268+0000 7fb394923700 1 -- start start 2023-12-24T18:52:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb39006d450 0x7fb390153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 0x7fb390159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c7ec0 con 0x7fb3900cc780 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390154230 con 0x7fb390158c40 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c8ce0 con 0x7fb39006d450 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44090/0 (socket says 172.21.15.50:44090) 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 -- 172.21.15.50:0/1248336360 learned_addr learned my addr 172.21.15.50:0/1248336360 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb39006d450 0x7fb390153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38ffff700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 0x7fb390159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 -- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb39006d450 msgr2=0x7fb390153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb39006d450 0x7fb390153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 -- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 msgr2=0x7fb390159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 0x7fb390159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 -- 172.21.15.50:0/1248336360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380009420 con 0x7fb3900cc780 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38ffff700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 0x7fb390159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb38effd700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c7f0 tx=0x7fb384007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384005b30 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384005c90 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3900c80d0 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384007340 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3900c8690 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.272+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3900c8e70 con 0x7fb3900cc780 2023-12-24T18:52:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.276+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb38401b400 con 0x7fb3900cc780 2023-12-24T18:52:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.276+0000 7fb3777fe700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 0x7fb37c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.276+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fb38407c590 con 0x7fb3900cc780 2023-12-24T18:52:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.276+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 0x7fb37c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.280+0000 7fb38f7fe700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 0x7fb37c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc710 tx=0x7fb380017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.284+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb38404c990 con 0x7fb3900cc780 2023-12-24T18:52:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.464+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb39004be40 con 0x7fb3900cc780 2023-12-24T18:52:30.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.476+0000 7fb3777fe700 1 -- 172.21.15.50:0/1248336360 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb3840076f0 con 0x7fb3900cc780 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 msgr2=0x7fb37c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 0x7fb37c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cc710 tx=0x7fb380017000 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 msgr2=0x7fb3900c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c7f0 tx=0x7fb384007e00 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 shutdown_connections 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb37c060550 0x7fb37c062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390158c40 0x7fb390159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900cc780 0x7fb3900c9170 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 --2- 172.21.15.50:0/1248336360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb39006d450 0x7fb390153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 >> 172.21.15.50:0/1248336360 conn(0x7fb3900d0800 msgr2=0x7fb3900cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 shutdown_connections 2023-12-24T18:52:30.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.480+0000 7fb394923700 1 -- 172.21.15.50:0/1248336360 wait complete. 2023-12-24T18:52:30.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:52:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 Processor -- start 2023-12-24T18:52:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 -- start start 2023-12-24T18:52:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe4b4160720 0x7fe4b406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b406ae10 0x7fe4b415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b415e960 con 0x7fe4b4160af0 2023-12-24T18:52:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b41600a0 con 0x7fe4b406ae10 2023-12-24T18:52:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.672+0000 7fe4bc0cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b415dd50 con 0x7fe4b4160720 2023-12-24T18:52:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b406ae10 0x7fe4b415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b9668700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe4b4160af0 0x7fe4b406a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41188/0 (socket says 172.21.15.50:41188) 2023-12-24T18:52:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b9668700 1 -- 172.21.15.50:0/1780781623 learned_addr learned my addr 172.21.15.50:0/1780781623 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b9e69700 1 --2- 172.21.15.50:0/1780781623 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4160720 0x7fe4b406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/1780781623 >> v2:172.21.15.50:3300/0 conn(0x7fe4b406ae10 0x7fe4b415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44098/0 (socket says 172.21.15.50:44098) 2023-12-24T18:52:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b8e67700 1 -- 172.21.15.50:0/1780781623 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11212906 0 0) 0x7fe4b415e960 con 0x7fe4b4160af0 2023-12-24T18:52:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b8e67700 1 -- 172.21.15.50:0/1780781623 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a0003570 con 0x7fe4b4160af0 2023-12-24T18:52:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 -- 172.21.15.50:0/1780781623 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4160720 msgr2=0x7fe4b406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/1780781623 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4160720 0x7fe4b406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 -- 172.21.15.50:0/1780781623 >> v1:172.21.15.82:6789/0 conn(0x7fe4b4160af0 legacy=0x7fe4b406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 -- 172.21.15.50:0/1780781623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b415e030 con 0x7fe4b406ae10 2023-12-24T18:52:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/1780781623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406ae10 0x7fe4b415edf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40cc740 tx=0x7fe4ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8504b3e7dba1987 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b8e67700 1 -- 172.21.15.50:0/1780781623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00e070 con 0x7fe4b406ae10 2023-12-24T18:52:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b8e67700 1 -- 172.21.15.50:0/1780781623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00bab0 con 0x7fe4b406ae10 2023-12-24T18:52:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.676+0000 7fe4b8e67700 1 -- 172.21.15.50:0/1780781623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00be70 con 0x7fe4b406ae10 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/1780781623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406ae10 msgr2=0x7fe4b415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/1780781623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406ae10 0x7fe4b415edf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40cc740 tx=0x7fe4ac009780 comp rx=0 tx=0).stop 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/1780781623 shutdown_connections 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/1780781623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406ae10 0x7fe4b415edf0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/1780781623 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4160720 0x7fe4b406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/1780781623 >> 172.21.15.50:0/1780781623 conn(0x7fe4b4067b80 msgr2=0x7fe4b40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/1780781623 shutdown_connections 2023-12-24T18:52:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.680+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/1780781623 wait complete. 2023-12-24T18:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 Processor -- start 2023-12-24T18:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 -- start start 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b406ae10 0x7fe4b4158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b4160720 0x7fe4b4154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4154670 con 0x7fe4b4160af0 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b41554b0 con 0x7fe4b406ae10 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4bc0cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4155e80 con 0x7fe4b4160720 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44104/0 (socket says 172.21.15.50:44104) 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 -- 172.21.15.50:0/3065392644 learned_addr learned my addr 172.21.15.50:0/3065392644 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4b9e69700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b406ae10 0x7fe4b4158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4b9668700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b4160720 0x7fe4b4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 -- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b4160720 msgr2=0x7fe4b4154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b4160720 0x7fe4b4154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 -- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b406ae10 msgr2=0x7fe4b4158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b406ae10 0x7fe4b4158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 -- 172.21.15.50:0/3065392644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac009a20 con 0x7fe4b4160af0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.684+0000 7fe4ba66a700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4069b20 tx=0x7fe4ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac012e80 con 0x7fe4b4160af0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac027470 con 0x7fe4b4160af0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac027810 con 0x7fe4b4160af0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b41548a0 con 0x7fe4b4160af0 2023-12-24T18:52:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b4154e60 con 0x7fe4b4160af0 2023-12-24T18:52:30.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b4155640 con 0x7fe4b4160af0 2023-12-24T18:52:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.688+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe4ac024070 con 0x7fe4b4160af0 2023-12-24T18:52:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.692+0000 7fe4a9ffb700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.692+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fe4ac07f430 con 0x7fe4b4160af0 2023-12-24T18:52:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.692+0000 7fe4b9e69700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.692+0000 7fe4b9e69700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 0x7fe498062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4152dd0 tx=0x7fe4b00091a0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.700+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4ac04f830 con 0x7fe4b4160af0 2023-12-24T18:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.872+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe4b415e310 con 0x7fe4b4160af0 2023-12-24T18:52:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.880+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/3065392644 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe4ac052e50 con 0x7fe4b4160af0 2023-12-24T18:52:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 msgr2=0x7fe498062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 0x7fe498062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4152dd0 tx=0x7fe4b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 msgr2=0x7fe4b4155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4069b20 tx=0x7fe4ac019000 comp rx=0 tx=0).stop 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 shutdown_connections 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4160af0 0x7fe4b4155940 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b4160720 0x7fe4b4154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 --2- 172.21.15.50:0/3065392644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b406ae10 0x7fe4b4158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 >> 172.21.15.50:0/3065392644 conn(0x7fe4b4067b80 msgr2=0x7fe4b40ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 shutdown_connections 2023-12-24T18:52:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:30.884+0000 7fe4bc0cd700 1 -- 172.21.15.50:0/3065392644 wait complete. 2023-12-24T18:52:30.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-12-24T18:52:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 Processor -- start 2023-12-24T18:52:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 -- start start 2023-12-24T18:52:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18480c6d00 0x7f18480c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1848154450 0x7f18481548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f184806aca0 0x7f184806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184806c820 con 0x7f1848154450 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1848154de0 con 0x7f184806aca0 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f184d425700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184806b960 con 0x7f18480c6d00 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.068+0000 7f18467fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1848154450 0x7f18481548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1848154450 0x7f18481548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44112/0 (socket says 172.21.15.50:44112) 2023-12-24T18:52:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 -- 172.21.15.50:0/1295360668 learned_addr learned my addr 172.21.15.50:0/1295360668 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18477fe700 1 --2- 172.21.15.50:0/1295360668 >> v2:172.21.15.82:3300/0 conn(0x7f184806aca0 0x7f184806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f1846ffd700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18480c6d00 0x7f18480c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 -- 172.21.15.50:0/1295360668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18480c6d00 msgr2=0x7f18480c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18480c6d00 0x7f18480c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 -- 172.21.15.50:0/1295360668 >> v2:172.21.15.82:3300/0 conn(0x7f184806aca0 msgr2=0x7f184806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 --2- 172.21.15.50:0/1295360668 >> v2:172.21.15.82:3300/0 conn(0x7f184806aca0 0x7f184806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 -- 172.21.15.50:0/1295360668 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184806bc40 con 0x7f1848154450 2023-12-24T18:52:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f18467fc700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1848154450 0x7f18481548a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f18480c6480 tx=0x7f183c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5217705db97f541 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f1845ffb700 1 -- 172.21.15.50:0/1295360668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00b860 con 0x7f1848154450 2023-12-24T18:52:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f1845ffb700 1 -- 172.21.15.50:0/1295360668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00b9c0 con 0x7f1848154450 2023-12-24T18:52:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f1845ffb700 1 -- 172.21.15.50:0/1295360668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00bd60 con 0x7f1848154450 2023-12-24T18:52:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 -- 172.21.15.50:0/1295360668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1848154450 msgr2=0x7f18481548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1848154450 0x7f18481548a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f18480c6480 tx=0x7f183c009250 comp rx=0 tx=0).stop 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 -- 172.21.15.50:0/1295360668 shutdown_connections 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 --2- 172.21.15.50:0/1295360668 >> v2:172.21.15.82:3300/0 conn(0x7f184806aca0 0x7f184806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1848154450 0x7f18481548a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 --2- 172.21.15.50:0/1295360668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18480c6d00 0x7f18480c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 -- 172.21.15.50:0/1295360668 >> 172.21.15.50:0/1295360668 conn(0x7f18480cbba0 msgr2=0x7f18480cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 -- 172.21.15.50:0/1295360668 shutdown_connections 2023-12-24T18:52:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.072+0000 7f184d425700 1 -- 172.21.15.50:0/1295360668 wait complete. 2023-12-24T18:52:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 Processor -- start 2023-12-24T18:52:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 -- start start 2023-12-24T18:52:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18480c6d00 0x7f1848169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1848154450 0x7f184816a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481522b0 con 0x7f184806aca0 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184816a050 con 0x7f18480c6d00 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f184d425700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480cb820 con 0x7f1848154450 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f1846ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f1846ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44128/0 (socket says 172.21.15.50:44128) 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.076+0000 7f1846ffd700 1 -- 172.21.15.50:0/696727368 learned_addr learned my addr 172.21.15.50:0/696727368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f18467fc700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18480c6d00 0x7f1848169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f18477fe700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1848154450 0x7f184816a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 -- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1848154450 msgr2=0x7f184816a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1848154450 0x7f184816a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 -- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18480c6d00 msgr2=0x7f1848169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18480c6d00 0x7f1848169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 -- 172.21.15.50:0/696727368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0094f0 con 0x7f184806aca0 2023-12-24T18:52:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f1846ffd700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f183800d890 tx=0x7f1838008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380125f0 con 0x7f184806aca0 2023-12-24T18:52:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18480a93a0 con 0x7f184806aca0 2023-12-24T18:52:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838012770 con 0x7f184806aca0 2023-12-24T18:52:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838012b30 con 0x7f184806aca0 2023-12-24T18:52:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481697b0 con 0x7f184806aca0 2023-12-24T18:52:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.080+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18480652e0 con 0x7f184806aca0 2023-12-24T18:52:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.084+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f183801e460 con 0x7f184806aca0 2023-12-24T18:52:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.084+0000 7f182effd700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 0x7f1834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.084+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7f183807cfa0 con 0x7f184806aca0 2023-12-24T18:52:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.084+0000 7f18467fc700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 0x7f1834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.088+0000 7f18467fc700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 0x7f1834062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18480c6480 tx=0x7f183c017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.092+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18380acbe0 con 0x7f184806aca0 2023-12-24T18:52:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.328+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f184806bf20 con 0x7f184806aca0 2023-12-24T18:52:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.660+0000 7f182effd700 1 -- 172.21.15.50:0/696727368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v611) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1838050ba0 con 0x7f184806aca0 2023-12-24T18:52:31.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 msgr2=0x7f1834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 0x7f1834062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18480c6480 tx=0x7f183c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:31.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 msgr2=0x7f18480cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f183800d890 tx=0x7f1838008040 comp rx=0 tx=0).stop 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 shutdown_connections 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1834060550 0x7f1834062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1848154450 0x7f184816a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18480c6d00 0x7f1848169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 --2- 172.21.15.50:0/696727368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f184806aca0 0x7f18480cb2e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 >> 172.21.15.50:0/696727368 conn(0x7f18480cbba0 msgr2=0x7f1848156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 shutdown_connections 2023-12-24T18:52:31.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.664+0000 7f184d425700 1 -- 172.21.15.50:0/696727368 wait complete. 2023-12-24T18:52:31.691 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-12-24T18:52:31.691 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-12-24T18:52:31.691 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:52:31.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-12-24T18:52:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.856+0000 7f09394f0700 1 Processor -- start 2023-12-24T18:52:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.856+0000 7f09394f0700 1 -- start start 2023-12-24T18:52:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09394f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f093406ab80 0x7f093406b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09394f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093406cd10 con 0x7f093406a7b0 2023-12-24T18:52:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09394f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093406b920 con 0x7f0934159cf0 2023-12-24T18:52:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09394f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340ad4e0 con 0x7f093406ab80 2023-12-24T18:52:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f0932ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f093406a7b0 0x7f09340ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46498/0 (socket says 172.21.15.50:46498) 2023-12-24T18:52:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f0932ffd700 1 -- 172.21.15.50:0/1117024271 learned_addr learned my addr 172.21.15.50:0/1117024271 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1117024271 >> v2:172.21.15.82:3300/0 conn(0x7f093406ab80 0x7f093406b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09327fc700 1 -- 172.21.15.50:0/1117024271 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637899539 0 0) 0x7f093406cd10 con 0x7f093406a7b0 2023-12-24T18:52:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09327fc700 1 -- 172.21.15.50:0/1117024271 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0920003570 con 0x7f093406a7b0 2023-12-24T18:52:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f092a7fc700 1 -- 172.21.15.50:0/1117024271 >> v1:172.21.15.82:6789/0 conn(0x7f0934159cf0 legacy=0x7f093406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f092a7fc700 1 -- 172.21.15.50:0/1117024271 >> v1:172.21.15.50:6789/0 conn(0x7f093406a7b0 legacy=0x7f09340ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f092a7fc700 1 -- 172.21.15.50:0/1117024271 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093406bc00 con 0x7f093406ab80 2023-12-24T18:52:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1117024271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406ab80 0x7f093406b2d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e60 tx=0x7f091c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e3ecfa1827c9e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09327fc700 1 -- 172.21.15.50:0/1117024271 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00e070 con 0x7f093406ab80 2023-12-24T18:52:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09327fc700 1 -- 172.21.15.50:0/1117024271 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00bb60 con 0x7f093406ab80 2023-12-24T18:52:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.860+0000 7f09327fc700 1 -- 172.21.15.50:0/1117024271 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c012430 con 0x7f093406ab80 2023-12-24T18:52:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- 172.21.15.50:0/1117024271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406ab80 msgr2=0x7f093406b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 --2- 172.21.15.50:0/1117024271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406ab80 0x7f093406b2d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e60 tx=0x7f091c009780 comp rx=0 tx=0).stop 2023-12-24T18:52:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- 172.21.15.50:0/1117024271 shutdown_connections 2023-12-24T18:52:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 --2- 172.21.15.50:0/1117024271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406ab80 0x7f093406b2d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- 172.21.15.50:0/1117024271 >> 172.21.15.50:0/1117024271 conn(0x7f0934067b40 msgr2=0x7f09340cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- 172.21.15.50:0/1117024271 shutdown_connections 2023-12-24T18:52:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- 172.21.15.50:0/1117024271 wait complete. 2023-12-24T18:52:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 Processor -- start 2023-12-24T18:52:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.864+0000 7f09394f0700 1 -- start start 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0934159cf0 0x7f093406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934156590 con 0x7f093406ab80 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c8110 con 0x7f093406a7b0 2023-12-24T18:52:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c6640 con 0x7f0934159cf0 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:60576/0 (socket says 172.21.15.50:60576) 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 -- 172.21.15.50:0/1406591434 learned_addr learned my addr 172.21.15.50:0/1406591434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09337fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0934159cf0 0x7f093406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44132/0 (socket says 172.21.15.50:44132) 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 -- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0934159cf0 msgr2=0x7f093406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0934159cf0 0x7f093406d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 -- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 msgr2=0x7f09341472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 -- 172.21.15.50:0/1406591434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009a20 con 0x7f093406a7b0 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f0932ffd700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f092400c7c0 tx=0x7f0924007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924005cd0 con 0x7f093406a7b0 2023-12-24T18:52:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0924005e30 con 0x7f093406a7b0 2023-12-24T18:52:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924007320 con 0x7f093406a7b0 2023-12-24T18:52:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340c6920 con 0x7f093406a7b0 2023-12-24T18:52:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.868+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09340c6ee0 con 0x7f093406a7b0 2023-12-24T18:52:31.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.872+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093404be40 con 0x7f093406a7b0 2023-12-24T18:52:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.872+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0924007690 con 0x7f093406a7b0 2023-12-24T18:52:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.872+0000 7f092b7fe700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 0x7f0914062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.872+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7f092407c090 con 0x7f093406a7b0 2023-12-24T18:52:31.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.872+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 0x7f0914062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:31.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.876+0000 7f092a7fc700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 0x7f0914062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c019000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:31.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:31.880+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f092404c3f0 con 0x7f093406a7b0 2023-12-24T18:52:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.108+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f0934151890 con 0x7f093406a7b0 2023-12-24T18:52:32.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.668+0000 7f092b7fe700 1 -- 172.21.15.50:0/1406591434 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v612) v1 ==== 186+0+0 (secure 0 0 0) 0x7f0924017100 con 0x7f093406a7b0 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 msgr2=0x7f0914062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 0x7f0914062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c019000 comp rx=0 tx=0).stop 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 msgr2=0x7f09340c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f092400c7c0 tx=0x7f0924007e00 comp rx=0 tx=0).stop 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 shutdown_connections 2023-12-24T18:52:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0914060550 0x7f0914062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0934159cf0 0x7f093406d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093406ab80 0x7f09341472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 --2- 172.21.15.50:0/1406591434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093406a7b0 0x7f09340c7bd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 >> 172.21.15.50:0/1406591434 conn(0x7f0934067b40 msgr2=0x7f09340c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 shutdown_connections 2023-12-24T18:52:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.676+0000 7f09394f0700 1 -- 172.21.15.50:0/1406591434 wait complete. 2023-12-24T18:52:32.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:52:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 Processor -- start 2023-12-24T18:52:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 -- start start 2023-12-24T18:52:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 0x7fc4ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0cb040 con 0x7fc4ec158e10 2023-12-24T18:52:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec06f0a0 con 0x7fc4ec1591e0 2023-12-24T18:52:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.888+0000 7fc4f2145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec06f380 con 0x7fc4ec069560 2023-12-24T18:52:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eaffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 0x7fc4ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc4ec158e10 0x7fc4ec068e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46512/0 (socket says 172.21.15.50:46512) 2023-12-24T18:52:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eb7fe700 1 -- 172.21.15.50:0/2630294841 learned_addr learned my addr 172.21.15.50:0/2630294841 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4ebfff700 1 --1- 172.21.15.50:0/2630294841 >> v1:172.21.15.82:6789/0 conn(0x7fc4ec1591e0 0x7fc4ec06e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41210/0 (socket says 172.21.15.50:41210) 2023-12-24T18:52:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eaffd700 1 -- 172.21.15.50:0/2630294841 >> v1:172.21.15.82:6789/0 conn(0x7fc4ec1591e0 legacy=0x7fc4ec06e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eaffd700 1 -- 172.21.15.50:0/2630294841 >> v1:172.21.15.50:6789/0 conn(0x7fc4ec158e10 legacy=0x7fc4ec068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4ea7fc700 1 -- 172.21.15.50:0/2630294841 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698005554 0 0) 0x7fc4ec0cb040 con 0x7fc4ec158e10 2023-12-24T18:52:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eaffd700 1 -- 172.21.15.50:0/2630294841 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0ca9f0 con 0x7fc4ec069560 2023-12-24T18:52:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4eaffd700 1 --2- 172.21.15.50:0/2630294841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 0x7fc4ec06e340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00098c0 tx=0x7fc4e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83620c1aa68b6178 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4ea7fc700 1 -- 172.21.15.50:0/2630294841 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0009e60 con 0x7fc4ec069560 2023-12-24T18:52:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4ea7fc700 1 -- 172.21.15.50:0/2630294841 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000b7e0 con 0x7fc4ec069560 2023-12-24T18:52:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4ea7fc700 1 -- 172.21.15.50:0/2630294841 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000bb80 con 0x7fc4ec069560 2023-12-24T18:52:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4f2145700 1 -- 172.21.15.50:0/2630294841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 msgr2=0x7fc4ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4f2145700 1 --2- 172.21.15.50:0/2630294841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 0x7fc4ec06e340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00098c0 tx=0x7fc4e00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4f2145700 1 -- 172.21.15.50:0/2630294841 shutdown_connections 2023-12-24T18:52:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4f2145700 1 --2- 172.21.15.50:0/2630294841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec069560 0x7fc4ec06e340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.892+0000 7fc4f2145700 1 -- 172.21.15.50:0/2630294841 >> 172.21.15.50:0/2630294841 conn(0x7fc4ec0ccc80 msgr2=0x7fc4ec0cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.896+0000 7fc4f2145700 1 -- 172.21.15.50:0/2630294841 shutdown_connections 2023-12-24T18:52:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.896+0000 7fc4f2145700 1 -- 172.21.15.50:0/2630294841 wait complete. 2023-12-24T18:52:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.896+0000 7fc4f2145700 1 Processor -- start 2023-12-24T18:52:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.896+0000 7fc4f2145700 1 -- start start 2023-12-24T18:52:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 0x7fc4ec0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec1591e0 0x7fc4ec157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec169580 con 0x7fc4ec069560 2023-12-24T18:52:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec169860 con 0x7fc4ec1591e0 2023-12-24T18:52:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec169b40 con 0x7fc4ec158e10 2023-12-24T18:52:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44134/0 (socket says 172.21.15.50:44134) 2023-12-24T18:52:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 -- 172.21.15.50:0/3151773418 learned_addr learned my addr 172.21.15.50:0/3151773418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eaffd700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 0x7fc4ec0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4ebfff700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec1591e0 0x7fc4ec157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 -- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 msgr2=0x7fc4ec0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 0x7fc4ec0a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 -- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec1591e0 msgr2=0x7fc4ec157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec1591e0 0x7fc4ec157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 -- 172.21.15.50:0/3151773418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0009420 con 0x7fc4ec069560 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eaffd700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 0x7fc4ec0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4eb7fe700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c810 tx=0x7fc4dc007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc005b30 con 0x7fc4ec069560 2023-12-24T18:52:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc005c90 con 0x7fc4ec069560 2023-12-24T18:52:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec169e20 con 0x7fc4ec069560 2023-12-24T18:52:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc007320 con 0x7fc4ec069560 2023-12-24T18:52:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.900+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec169230 con 0x7fc4ec069560 2023-12-24T18:52:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.904+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec0652e0 con 0x7fc4ec069560 2023-12-24T18:52:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.904+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc4dc01b400 con 0x7fc4ec069560 2023-12-24T18:52:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.904+0000 7fc4d37fe700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 0x7fc4d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.904+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7fc4dc07c5a0 con 0x7fc4ec069560 2023-12-24T18:52:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.904+0000 7fc4eaffd700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 0x7fc4d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.908+0000 7fc4eaffd700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 0x7fc4d8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00030c0 tx=0x7fc4e0016000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:32.912+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4dc04c9a0 con 0x7fc4ec069560 2023-12-24T18:52:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.084+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4ec1696c0 con 0x7fc4ec069560 2023-12-24T18:52:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.092+0000 7fc4d37fe700 1 -- 172.21.15.50:0/3151773418 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc4ec1696c0 con 0x7fc4ec069560 2023-12-24T18:52:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 msgr2=0x7fc4d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 0x7fc4d8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00030c0 tx=0x7fc4e0016000 comp rx=0 tx=0).stop 2023-12-24T18:52:33.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 msgr2=0x7fc4ec16bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c810 tx=0x7fc4dc007e60 comp rx=0 tx=0).stop 2023-12-24T18:52:33.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 shutdown_connections 2023-12-24T18:52:33.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc4d8060550 0x7fc4d8062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec1591e0 0x7fc4ec157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4ec158e10 0x7fc4ec0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 --2- 172.21.15.50:0/3151773418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ec069560 0x7fc4ec16bee0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 >> 172.21.15.50:0/3151773418 conn(0x7fc4ec0ccc80 msgr2=0x7fc4ec1557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 shutdown_connections 2023-12-24T18:52:33.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.096+0000 7fc4f2145700 1 -- 172.21.15.50:0/3151773418 wait complete. 2023-12-24T18:52:33.120 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:52:33.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:52:33.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:52:33.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:52:33.214 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:52:33.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:33.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 Processor -- start 2023-12-24T18:52:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 -- start start 2023-12-24T18:52:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5810159030 0x7f5810159400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f581006e150 0x7f581015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58100c8e50 con 0x7f58100c9b80 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100c96f0 con 0x7f581006e150 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f5815c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581015dc30 con 0x7f5810159030 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f580ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f581006e150 0x7f581015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f580effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58100c9b80 0x7f581006da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46524/0 (socket says 172.21.15.50:46524) 2023-12-24T18:52:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f580effd700 1 -- 172.21.15.50:0/2439307269 learned_addr learned my addr 172.21.15.50:0/2439307269 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.388+0000 7f580f7fe700 1 --2- 172.21.15.50:0/2439307269 >> v2:172.21.15.82:3300/0 conn(0x7f5810159030 0x7f5810159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580e7fc700 1 -- 172.21.15.50:0/2439307269 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067196773 0 0) 0x7f58100c8e50 con 0x7f58100c9b80 2023-12-24T18:52:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580e7fc700 1 -- 172.21.15.50:0/2439307269 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8003570 con 0x7f58100c9b80 2023-12-24T18:52:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580ffff700 1 -- 172.21.15.50:0/2439307269 >> v2:172.21.15.82:3300/0 conn(0x7f5810159030 msgr2=0x7f5810159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580ffff700 1 --2- 172.21.15.50:0/2439307269 >> v2:172.21.15.82:3300/0 conn(0x7f5810159030 0x7f5810159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580ffff700 1 -- 172.21.15.50:0/2439307269 >> v1:172.21.15.50:6789/0 conn(0x7f58100c9b80 legacy=0x7f581006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580ffff700 1 -- 172.21.15.50:0/2439307269 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100c90a0 con 0x7f581006e150 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580ffff700 1 --2- 172.21.15.50:0/2439307269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581006e150 0x7f581015cf00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f581006aeb0 tx=0x7f5808009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777f63b0bad826fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580e7fc700 1 -- 172.21.15.50:0/2439307269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800e070 con 0x7f581006e150 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580e7fc700 1 -- 172.21.15.50:0/2439307269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580800bab0 con 0x7f581006e150 2023-12-24T18:52:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f580e7fc700 1 -- 172.21.15.50:0/2439307269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800be70 con 0x7f581006e150 2023-12-24T18:52:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 -- 172.21.15.50:0/2439307269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581006e150 msgr2=0x7f581015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2439307269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581006e150 0x7f581015cf00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f581006aeb0 tx=0x7f5808009780 comp rx=0 tx=0).stop 2023-12-24T18:52:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 -- 172.21.15.50:0/2439307269 shutdown_connections 2023-12-24T18:52:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2439307269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581006e150 0x7f581015cf00 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2439307269 >> v2:172.21.15.82:3300/0 conn(0x7f5810159030 0x7f5810159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 -- 172.21.15.50:0/2439307269 >> 172.21.15.50:0/2439307269 conn(0x7f581006c1f0 msgr2=0x7f5810067850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 -- 172.21.15.50:0/2439307269 shutdown_connections 2023-12-24T18:52:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.392+0000 7f5815c2e700 1 -- 172.21.15.50:0/2439307269 wait complete. 2023-12-24T18:52:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 Processor -- start 2023-12-24T18:52:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 -- start start 2023-12-24T18:52:33.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 0x7f58100aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58100c9b80 0x7f58100c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b2000 con 0x7f5810159030 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b1b70 con 0x7f58100c9b80 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f5815c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b0c80 con 0x7f581006e150 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f580ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f580ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44142/0 (socket says 172.21.15.50:44142) 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f580ffff700 1 -- 172.21.15.50:0/2940717656 learned_addr learned my addr 172.21.15.50:0/2940717656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f580f7fe700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 0x7f58100aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.396+0000 7f580effd700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58100c9b80 0x7f58100c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 -- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 msgr2=0x7f58100aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 0x7f58100aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 -- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58100c9b80 msgr2=0x7f58100c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58100c9b80 0x7f58100c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 -- 172.21.15.50:0/2940717656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808009a20 con 0x7f5810159030 2023-12-24T18:52:33.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580f7fe700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 0x7f58100aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:33.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f580ffff700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f58080099f0 tx=0x7f5808019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808027470 con 0x7f5810159030 2023-12-24T18:52:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58080275f0 con 0x7f5810159030 2023-12-24T18:52:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080279b0 con 0x7f5810159030 2023-12-24T18:52:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58100b0f60 con 0x7f5810159030 2023-12-24T18:52:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58100b1520 con 0x7f5810159030 2023-12-24T18:52:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.400+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58100b1d20 con 0x7f5810159030 2023-12-24T18:52:33.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.404+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5808024070 con 0x7f5810159030 2023-12-24T18:52:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.404+0000 7f57f77fe700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 0x7f57fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.404+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7f580807f420 con 0x7f5810159030 2023-12-24T18:52:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.404+0000 7f580f7fe700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 0x7f57fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.404+0000 7f580f7fe700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 0x7f57fc062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5800009cd0 tx=0x7f5800008040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.408+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f580804f780 con 0x7f5810159030 2023-12-24T18:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.616+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58100652e0 con 0x7f5810159030 2023-12-24T18:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f57f77fe700 1 -- 172.21.15.50:0/2940717656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f580802cde0 con 0x7f5810159030 2023-12-24T18:52:33.622 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:33.623 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/128615066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":128615066},{"type":"v1","addr":"172.21.15.82:6833","nonce":128615066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3746326249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3746326249},{"type":"v1","addr":"172.21.15.82:6835","nonce":3746326249}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4152618704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4152618704},{"type":"v1","addr":"172.21.15.50:6833","nonce":4152618704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":7194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3877714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3877714820},{"type":"v1","addr":"172.21.15.50:6835","nonce":3877714820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2023-12-24T18:52:33.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 msgr2=0x7f57fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 0x7f57fc062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5800009cd0 tx=0x7f5800008040 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 msgr2=0x7f58101569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f58080099f0 tx=0x7f5808019000 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 shutdown_connections 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f57fc060550 0x7f57fc062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810159030 0x7f58101569f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58100c9b80 0x7f58100c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 --2- 172.21.15.50:0/2940717656 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581006e150 0x7f58100aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.620+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 >> 172.21.15.50:0/2940717656 conn(0x7f581006c1f0 msgr2=0x7f581006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.624+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 shutdown_connections 2023-12-24T18:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.624+0000 7f5815c2e700 1 -- 172.21.15.50:0/2940717656 wait complete. 2023-12-24T18:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2023-12-24T18:52:33.650 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:52:33.650 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:52:33.650 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:52:33.650 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:52:33.651 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:52:33.651 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:52:33.651 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:52:33.651 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:52:33.651 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:52:33.651 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:52:33.651 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:52:33.651 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:52:33.652 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:52:33.652 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:52:33.652 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:52:33.652 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:52:33.669 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:52:33.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:52:33.671 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:52:33.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:52:33.681 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:52:33.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:52:33.682 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:52:33.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:52:33.724 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:52:33.724 DEBUG:teuthology.parallel:result is None 2023-12-24T18:52:33.730 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:52:33.730 DEBUG:teuthology.parallel:result is None 2023-12-24T18:52:33.734 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:52:33.734 DEBUG:teuthology.parallel:result is None 2023-12-24T18:52:33.737 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:52:33.738 DEBUG:teuthology.parallel:result is None 2023-12-24T18:52:33.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:52:33.844 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:52:33.851 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:52:33.852 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:52:33.852 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:52:33.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.904+0000 7ff906123700 1 Processor -- start 2023-12-24T18:52:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 -- start start 2023-12-24T18:52:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9000b41e0 0x7ff9001591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 0x7ff900159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90006b640 con 0x7ff900158e00 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff900159710 con 0x7ff9000b41e0 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff906123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000b5e10 con 0x7ff90006d8c0 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff904920700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9000b41e0 0x7ff9001591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff905922700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 0x7ff900159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff905121700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff900158e00 0x7ff9000b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41244/0 (socket says 172.21.15.50:41244) 2023-12-24T18:52:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff905121700 1 -- 172.21.15.50:0/53352768 learned_addr learned my addr 172.21.15.50:0/53352768 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff8f7fff700 1 -- 172.21.15.50:0/53352768 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583100887 0 0) 0x7ff90006b640 con 0x7ff900158e00 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff8f7fff700 1 -- 172.21.15.50:0/53352768 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ec003570 con 0x7ff900158e00 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff904920700 1 -- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 msgr2=0x7ff900159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff904920700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 0x7ff900159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff904920700 1 -- 172.21.15.50:0/53352768 >> v1:172.21.15.82:6789/0 conn(0x7ff900158e00 legacy=0x7ff9000b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.908+0000 7ff904920700 1 -- 172.21.15.50:0/53352768 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90006b8e0 con 0x7ff9000b41e0 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff905922700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 0x7ff900159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff904920700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9000b41e0 0x7ff9001591d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00098e0 tx=0x7ff8f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883f3d753ebcfa1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff8f7fff700 1 -- 172.21.15.50:0/53352768 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0011630 con 0x7ff9000b41e0 2023-12-24T18:52:33.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff8f7fff700 1 -- 172.21.15.50:0/53352768 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0011790 con 0x7ff9000b41e0 2023-12-24T18:52:33.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff8f7fff700 1 -- 172.21.15.50:0/53352768 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0011b30 con 0x7ff9000b41e0 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 -- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9000b41e0 msgr2=0x7ff9001591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9000b41e0 0x7ff9001591d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00098e0 tx=0x7ff8f00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 -- 172.21.15.50:0/53352768 shutdown_connections 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff90006d8c0 0x7ff900159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 --2- 172.21.15.50:0/53352768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9000b41e0 0x7ff9001591d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 -- 172.21.15.50:0/53352768 >> 172.21.15.50:0/53352768 conn(0x7ff900067b80 msgr2=0x7ff9000b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 -- 172.21.15.50:0/53352768 shutdown_connections 2023-12-24T18:52:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.912+0000 7ff906123700 1 -- 172.21.15.50:0/53352768 wait complete. 2023-12-24T18:52:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 Processor -- start 2023-12-24T18:52:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 -- start start 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9000b41e0 0x7ff9000c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff900158e00 0x7ff9000b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000b0660 con 0x7ff90006d8c0 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9001550f0 con 0x7ff900158e00 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.916+0000 7ff906123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000c8680 con 0x7ff9000b41e0 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44174/0 (socket says 172.21.15.50:44174) 2023-12-24T18:52:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 -- 172.21.15.50:0/3600493105 learned_addr learned my addr 172.21.15.50:0/3600493105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905922700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff900158e00 0x7ff9000b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff904920700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9000b41e0 0x7ff9000c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 -- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9000b41e0 msgr2=0x7ff9000c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9000b41e0 0x7ff9000c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 -- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff900158e00 msgr2=0x7ff9000b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff900158e00 0x7ff9000b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 -- 172.21.15.50:0/3600493105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f8009a20 con 0x7ff90006d8c0 2023-12-24T18:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff905121700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0011e0 tx=0x7ff8fc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc005b30 con 0x7ff90006d8c0 2023-12-24T18:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc005c90 con 0x7ff90006d8c0 2023-12-24T18:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007320 con 0x7ff90006d8c0 2023-12-24T18:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f0009420 con 0x7ff90006d8c0 2023-12-24T18:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9000afa50 con 0x7ff90006d8c0 2023-12-24T18:52:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.920+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90004be40 con 0x7ff90006d8c0 2023-12-24T18:52:33.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.924+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff8fc007690 con 0x7ff90006d8c0 2023-12-24T18:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.924+0000 7ff8f57fa700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 0x7ff8e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.924+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6194+0+0 (secure 0 0 0) 0x7ff8fc07bd70 con 0x7ff90006d8c0 2023-12-24T18:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.924+0000 7ff904920700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 0x7ff8e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.928+0000 7ff904920700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 0x7ff8e4062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b45e0 tx=0x7ff8f0017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:33.932+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8fc04c190 con 0x7ff90006d8c0 2023-12-24T18:52:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.116+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff90006bbc0 con 0x7ff90006d8c0 2023-12-24T18:52:34.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.692+0000 7ff8f57fa700 1 -- 172.21.15.50:0/3600493105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff8fc04f7b0 con 0x7ff90006d8c0 2023-12-24T18:52:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 msgr2=0x7ff8e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 0x7ff8e4062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b45e0 tx=0x7ff8f0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 msgr2=0x7ff900154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0011e0 tx=0x7ff8fc007df0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 shutdown_connections 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff8e4060580 0x7ff8e4062a30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff900158e00 0x7ff9000b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9000b41e0 0x7ff9000c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 --2- 172.21.15.50:0/3600493105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90006d8c0 0x7ff900154bb0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 >> 172.21.15.50:0/3600493105 conn(0x7ff900067b80 msgr2=0x7ff9000a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 shutdown_connections 2023-12-24T18:52:34.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.696+0000 7ff906123700 1 -- 172.21.15.50:0/3600493105 wait complete. 2023-12-24T18:52:34.702 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:52:34.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:52:34.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 Processor -- start 2023-12-24T18:52:34.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 -- start start 2023-12-24T18:52:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91600aeef0 0x7f91600cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f91600a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 0x7f91600c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600c8750 con 0x7f91600aeef0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600aac50 con 0x7f91600aa4f0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9165bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600aaf30 con 0x7f91600cced0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9164bca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91600aeef0 0x7f91600cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9164bca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91600aeef0 0x7f91600cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44182/0 (socket says 172.21.15.50:44182) 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.896+0000 7f9164bca700 1 -- 172.21.15.50:0/3794347922 learned_addr learned my addr 172.21.15.50:0/3794347922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f915ffff700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f91600a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f91653cb700 1 --2- 172.21.15.50:0/3794347922 >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 0x7f91600c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 -- 172.21.15.50:0/3794347922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 msgr2=0x7f91600a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f91600a9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 -- 172.21.15.50:0/3794347922 >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 msgr2=0x7f91600c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 --2- 172.21.15.50:0/3794347922 >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 0x7f91600c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 -- 172.21.15.50:0/3794347922 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600ab210 con 0x7f91600aeef0 2023-12-24T18:52:34.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f91653cb700 1 --2- 172.21.15.50:0/3794347922 >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 0x7f91600c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9164bca700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600cc990 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f916006a140 tx=0x7f9154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ba387108b6dd0c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f915f7fe700 1 -- 172.21.15.50:0/3794347922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400b860 con 0x7f91600aeef0 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f915f7fe700 1 -- 172.21.15.50:0/3794347922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400b9c0 con 0x7f91600aeef0 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f915f7fe700 1 -- 172.21.15.50:0/3794347922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400bd60 con 0x7f91600aeef0 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 -- 172.21.15.50:0/3794347922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 msgr2=0x7f91600cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600cc990 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f916006a140 tx=0x7f9154009250 comp rx=0 tx=0).stop 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 -- 172.21.15.50:0/3794347922 shutdown_connections 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3794347922 >> v2:172.21.15.82:3300/0 conn(0x7f91600aa4f0 0x7f91600c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f91600a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3794347922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600cc990 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 -- 172.21.15.50:0/3794347922 >> 172.21.15.50:0/3794347922 conn(0x7f91600af9b0 msgr2=0x7f91600afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 -- 172.21.15.50:0/3794347922 shutdown_connections 2023-12-24T18:52:34.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.900+0000 7f9165bcc700 1 -- 172.21.15.50:0/3794347922 wait complete. 2023-12-24T18:52:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.904+0000 7f9165bcc700 1 Processor -- start 2023-12-24T18:52:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.904+0000 7f9165bcc700 1 -- start start 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91600aa4f0 0x7f91600c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f9160144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600c4780 con 0x7f91600aeef0 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600c7120 con 0x7f91600aa4f0 2023-12-24T18:52:34.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9165bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600c1da0 con 0x7f91600cced0 2023-12-24T18:52:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44192/0 (socket says 172.21.15.50:44192) 2023-12-24T18:52:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 -- 172.21.15.50:0/3985834539 learned_addr learned my addr 172.21.15.50:0/3985834539 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f9164bca700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91600aa4f0 0x7f91600c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f91653cb700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f9160144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 -- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 msgr2=0x7f9160144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f9160144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 -- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91600aa4f0 msgr2=0x7f91600c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91600aa4f0 0x7f91600c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 -- 172.21.15.50:0/3985834539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540094f0 con 0x7f91600aeef0 2023-12-24T18:52:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915ffff700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d890 tx=0x7f914c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0125f0 con 0x7f91600aeef0 2023-12-24T18:52:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.908+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c012770 con 0x7f91600aeef0 2023-12-24T18:52:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.912+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91600c41c0 con 0x7f91600aeef0 2023-12-24T18:52:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.912+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c012b30 con 0x7f91600aeef0 2023-12-24T18:52:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.912+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91600c1a30 con 0x7f91600aeef0 2023-12-24T18:52:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.912+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600c1890 con 0x7f91600aeef0 2023-12-24T18:52:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.912+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f914c01e460 con 0x7f91600aeef0 2023-12-24T18:52:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.916+0000 7f915cff9700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 0x7f9144062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.916+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f914c07cd00 con 0x7f91600aeef0 2023-12-24T18:52:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.916+0000 7f9164bca700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 0x7f9144062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.916+0000 7f9164bca700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 0x7f9144062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f916006a140 tx=0x7f9154017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:34.920+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f91600c1890 con 0x7f91600aeef0 2023-12-24T18:52:35.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.152+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91600c1890 con 0x7f91600aeef0 2023-12-24T18:52:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.152+0000 7f915cff9700 1 -- 172.21.15.50:0/3985834539 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91600c1890 con 0x7f91600aeef0 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:52:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:52:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:52:35.169 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:52:35.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 msgr2=0x7f9144062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 0x7f9144062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f916006a140 tx=0x7f9154017000 comp rx=0 tx=0).stop 2023-12-24T18:52:35.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 msgr2=0x7f91600c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d890 tx=0x7f914c008040 comp rx=0 tx=0).stop 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 shutdown_connections 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9144060550 0x7f9144062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91600cced0 0x7f9160144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91600aeef0 0x7f91600c6be0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 --2- 172.21.15.50:0/3985834539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91600aa4f0 0x7f91600c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 >> 172.21.15.50:0/3985834539 conn(0x7f91600af9b0 msgr2=0x7f91601563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 shutdown_connections 2023-12-24T18:52:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.156+0000 7f9165bcc700 1 -- 172.21.15.50:0/3985834539 wait complete. 2023-12-24T18:52:35.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.336+0000 7f8b9dd85700 1 Processor -- start 2023-12-24T18:52:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.336+0000 7f8b9dd85700 1 -- start start 2023-12-24T18:52:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b98156670 0x7f8b980688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 0x7f8b9806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063880 0x7f8b9806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b98156a40 con 0x7f8b98156670 2023-12-24T18:52:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9806d670 con 0x7f8b98063430 2023-12-24T18:52:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b9dd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981561e0 con 0x7f8b98063880 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b98156670 0x7f8b980688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b98156670 0x7f8b980688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44200/0 (socket says 172.21.15.50:44200) 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 -- 172.21.15.50:0/3998371896 learned_addr learned my addr 172.21.15.50:0/3998371896 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b96ffd700 1 --2- 172.21.15.50:0/3998371896 >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 0x7f8b9806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b97fff700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063880 0x7f8b9806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 -- 172.21.15.50:0/3998371896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063880 msgr2=0x7f8b9806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063880 0x7f8b9806cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 -- 172.21.15.50:0/3998371896 >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 msgr2=0x7f8b9806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 --2- 172.21.15.50:0/3998371896 >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 0x7f8b9806c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 -- 172.21.15.50:0/3998371896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9806e010 con 0x7f8b98156670 2023-12-24T18:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b96ffd700 1 --2- 172.21.15.50:0/3998371896 >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 0x7f8b9806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b977fe700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b980688d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b23f0 tx=0x7f8b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540a5812961049a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b967fc700 1 -- 172.21.15.50:0/3998371896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800b860 con 0x7f8b98156670 2023-12-24T18:52:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b967fc700 1 -- 172.21.15.50:0/3998371896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800b9c0 con 0x7f8b98156670 2023-12-24T18:52:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.340+0000 7f8b967fc700 1 -- 172.21.15.50:0/3998371896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800bd60 con 0x7f8b98156670 2023-12-24T18:52:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 -- 172.21.15.50:0/3998371896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 msgr2=0x7f8b980688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b980688d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b23f0 tx=0x7f8b88009250 comp rx=0 tx=0).stop 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 -- 172.21.15.50:0/3998371896 shutdown_connections 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/3998371896 >> v2:172.21.15.82:3300/0 conn(0x7f8b98063430 0x7f8b9806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063880 0x7f8b9806cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/3998371896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b980688d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 -- 172.21.15.50:0/3998371896 >> 172.21.15.50:0/3998371896 conn(0x7f8b980c8e60 msgr2=0x7f8b980c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 -- 172.21.15.50:0/3998371896 shutdown_connections 2023-12-24T18:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.344+0000 7f8b9dd85700 1 -- 172.21.15.50:0/3998371896 wait complete. 2023-12-24T18:52:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 Processor -- start 2023-12-24T18:52:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 -- start start 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063430 0x7f8b98157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98063880 0x7f8b9816d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980af220 con 0x7f8b98156670 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9816e200 con 0x7f8b98063880 2023-12-24T18:52:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b9dd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9816e4e0 con 0x7f8b98063430 2023-12-24T18:52:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44212/0 (socket says 172.21.15.50:44212) 2023-12-24T18:52:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 -- 172.21.15.50:0/2830249387 learned_addr learned my addr 172.21.15.50:0/2830249387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b96ffd700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98063880 0x7f8b9816d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b977fe700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063430 0x7f8b98157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 -- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063430 msgr2=0x7f8b98157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063430 0x7f8b98157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 -- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98063880 msgr2=0x7f8b9816d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98063880 0x7f8b9816d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.348+0000 7f8b97fff700 1 -- 172.21.15.50:0/2830249387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880094f0 con 0x7f8b98156670 2023-12-24T18:52:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b97fff700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009fa0 tx=0x7f8b90009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000ebc0 con 0x7f8b98156670 2023-12-24T18:52:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000ed20 con 0x7f8b98156670 2023-12-24T18:52:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90014670 con 0x7f8b98156670 2023-12-24T18:52:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9816e7c0 con 0x7f8b98156670 2023-12-24T18:52:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9816de80 con 0x7f8b98156670 2023-12-24T18:52:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980652e0 con 0x7f8b98156670 2023-12-24T18:52:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.352+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8b900149e0 con 0x7f8b98156670 2023-12-24T18:52:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.356+0000 7f8b7f7fe700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 0x7f8b84062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.356+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f8b9007cd00 con 0x7f8b98156670 2023-12-24T18:52:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.356+0000 7f8b977fe700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 0x7f8b84062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.356+0000 7f8b977fe700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 0x7f8b84062a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b23f0 tx=0x7f8b88019000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.360+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b9004d370 con 0x7f8b98156670 2023-12-24T18:52:35.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.536+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b98155880 con 0x7f8b98156670 2023-12-24T18:52:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.536+0000 7f8b7f7fe700 1 -- 172.21.15.50:0/2830249387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+12865 (secure 0 0 0) 0x7f8b90050990 con 0x7f8b98156670 2023-12-24T18:52:35.542 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:35.542 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":105,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:34.708652+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 msgr2=0x7f8b84062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 0x7f8b84062a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b980b23f0 tx=0x7f8b88019000 comp rx=0 tx=0).stop 2023-12-24T18:52:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 msgr2=0x7f8b9814b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009fa0 tx=0x7f8b90009900 comp rx=0 tx=0).stop 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 shutdown_connections 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8b84060580 0x7f8b84062a30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b98156670 0x7f8b9814b770 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98063880 0x7f8b9816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 --2- 172.21.15.50:0/2830249387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b98063430 0x7f8b98157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 >> 172.21.15.50:0/2830249387 conn(0x7f8b980c8e60 msgr2=0x7f8b9806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:35.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 shutdown_connections 2023-12-24T18:52:35.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.544+0000 7f8b9dd85700 1 -- 172.21.15.50:0/2830249387 wait complete. 2023-12-24T18:52:35.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:52:35.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.744+0000 7f51a26f0700 1 Processor -- start 2023-12-24T18:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.744+0000 7f51a26f0700 1 -- start start 2023-12-24T18:52:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a26f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f519c159070 0x7f519c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a26f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c06b5c0 con 0x7f519c06cf30 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a26f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c06a9b0 con 0x7f519c0ca850 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a26f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c06ac90 con 0x7f519c159070 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a0c8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f519c06cf30 0x7f519c0b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46554/0 (socket says 172.21.15.50:46554) 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f51a0c8d700 1 -- 172.21.15.50:0/2870272540 learned_addr learned my addr 172.21.15.50:0/2870272540 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519bfff700 1 --2- 172.21.15.50:0/2870272540 >> v2:172.21.15.82:3300/0 conn(0x7f519c159070 0x7f519c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844497069 0 0) 0x7f519c06a9b0 con 0x7f519c0ca850 2023-12-24T18:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5184003570 con 0x7f519c0ca850 2023-12-24T18:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495923634 0 0) 0x7f519c06b5c0 con 0x7f519c06cf30 2023-12-24T18:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c06a9b0 con 0x7f519c06cf30 2023-12-24T18:52:35.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519bfff700 1 -- 172.21.15.50:0/2870272540 >> v1:172.21.15.82:6789/0 conn(0x7f519c0ca850 legacy=0x7f519c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519bfff700 1 -- 172.21.15.50:0/2870272540 >> v1:172.21.15.50:6789/0 conn(0x7f519c06cf30 legacy=0x7f519c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.748+0000 7f519bfff700 1 -- 172.21.15.50:0/2870272540 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c06af70 con 0x7f519c159070 2023-12-24T18:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f519bfff700 1 --2- 172.21.15.50:0/2870272540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c0cb690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098e0 tx=0x7f518c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=526cea5d8f6b346 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011630 con 0x7f519c159070 2023-12-24T18:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c011790 con 0x7f519c159070 2023-12-24T18:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f519affd700 1 -- 172.21.15.50:0/2870272540 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011b30 con 0x7f519c159070 2023-12-24T18:52:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 -- 172.21.15.50:0/2870272540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 msgr2=0x7f519c0cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 --2- 172.21.15.50:0/2870272540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c0cb690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098e0 tx=0x7f518c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 -- 172.21.15.50:0/2870272540 shutdown_connections 2023-12-24T18:52:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 --2- 172.21.15.50:0/2870272540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c0cb690 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 -- 172.21.15.50:0/2870272540 >> 172.21.15.50:0/2870272540 conn(0x7f519c067b50 msgr2=0x7f519c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 -- 172.21.15.50:0/2870272540 shutdown_connections 2023-12-24T18:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 -- 172.21.15.50:0/2870272540 wait complete. 2023-12-24T18:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.752+0000 7f51a26f0700 1 Processor -- start 2023-12-24T18:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- start start 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 0x7f519c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c168e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c16a7f0 con 0x7f519c0ca850 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c8bd0 con 0x7f519c159070 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c16a1a0 con 0x7f519c06cf30 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44228/0 (socket says 172.21.15.50:44228) 2023-12-24T18:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 -- 172.21.15.50:0/182577229 learned_addr learned my addr 172.21.15.50:0/182577229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a0c8d700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519bfff700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 0x7f519c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 -- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 msgr2=0x7f519c0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 0x7f519c0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 -- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 msgr2=0x7f519c168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 -- 172.21.15.50:0/182577229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c009420 con 0x7f519c0ca850 2023-12-24T18:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519bfff700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 0x7f519c0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f519b7fe700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f519000c790 tx=0x7f5190007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190011590 con 0x7f519c0ca850 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190011710 con 0x7f519c0ca850 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c16a480 con 0x7f519c0ca850 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190011ad0 con 0x7f519c0ca850 2023-12-24T18:52:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.756+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c157e30 con 0x7f519c0ca850 2023-12-24T18:52:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.760+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c16a000 con 0x7f519c0ca850 2023-12-24T18:52:35.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.760+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5190012420 con 0x7f519c0ca850 2023-12-24T18:52:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.764+0000 7f5183fff700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.764+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f519007c3b0 con 0x7f519c0ca850 2023-12-24T18:52:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.764+0000 7f519bfff700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.764+0000 7f519bfff700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 0x7f5188062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f518c0093f0 tx=0x7f518c017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.768+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f519c16a000 con 0x7f519c0ca850 2023-12-24T18:52:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.940+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f519c16a000 con 0x7f519c0ca850 2023-12-24T18:52:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.940+0000 7f5183fff700 1 -- 172.21.15.50:0/182577229 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7f519c16a000 con 0x7f519c0ca850 2023-12-24T18:52:35.945 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:52:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 msgr2=0x7f5188062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 0x7f5188062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f518c0093f0 tx=0x7f518c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 msgr2=0x7f519c0c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f519000c790 tx=0x7f5190007eb0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 shutdown_connections 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5188060550 0x7f5188062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f519c159070 0x7f519c168e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f519c0ca850 0x7f519c0c83a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 --2- 172.21.15.50:0/182577229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f519c06cf30 0x7f519c0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.944+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 >> 172.21.15.50:0/182577229 conn(0x7f519c067b50 msgr2=0x7f519c1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.948+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 shutdown_connections 2023-12-24T18:52:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:35.948+0000 7f51a26f0700 1 -- 172.21.15.50:0/182577229 wait complete. 2023-12-24T18:52:35.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:52:36.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.136+0000 7f15e0ecd700 1 Processor -- start 2023-12-24T18:52:36.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 -- start start 2023-12-24T18:52:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15dc1592d0 0x7f15dc06ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc0c54d0 0x7f15dc0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15dc15d660 con 0x7f15dc06a760 2023-12-24T18:52:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15dc15cda0 con 0x7f15dc1592d0 2023-12-24T18:52:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.140+0000 7f15e0ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc15d010 con 0x7f15dc0c54d0 2023-12-24T18:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15da59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f15dc06a760 0x7f15dc158bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46570/0 (socket says 172.21.15.50:46570) 2023-12-24T18:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15dc1592d0 0x7f15dc06ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15da59c700 1 -- 172.21.15.50:0/2712400088 learned_addr learned my addr 172.21.15.50:0/2712400088 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15dad9d700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc0c54d0 0x7f15dc0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 -- 172.21.15.50:0/2712400088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc0c54d0 msgr2=0x7f15dc0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc0c54d0 0x7f15dc0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 -- 172.21.15.50:0/2712400088 >> v1:172.21.15.50:6789/0 conn(0x7f15dc06a760 legacy=0x7f15dc158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 -- 172.21.15.50:0/2712400088 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc15d2f0 con 0x7f15dc1592d0 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d959a700 1 -- 172.21.15.50:0/2712400088 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438356968 0 0) 0x7f15dc15d660 con 0x7f15dc06a760 2023-12-24T18:52:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d9d9b700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc06ab30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f15d00098e0 tx=0x7f15d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaba422b29bbc3b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d959a700 1 -- 172.21.15.50:0/2712400088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d000b640 con 0x7f15dc1592d0 2023-12-24T18:52:36.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d959a700 1 -- 172.21.15.50:0/2712400088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d000b7a0 con 0x7f15dc1592d0 2023-12-24T18:52:36.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15d959a700 1 -- 172.21.15.50:0/2712400088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d000bb40 con 0x7f15dc1592d0 2023-12-24T18:52:36.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 -- 172.21.15.50:0/2712400088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 msgr2=0x7f15dc06ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc06ab30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f15d00098e0 tx=0x7f15d00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 -- 172.21.15.50:0/2712400088 shutdown_connections 2023-12-24T18:52:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc0c54d0 0x7f15dc0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/2712400088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc06ab30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.144+0000 7f15e0ecd700 1 -- 172.21.15.50:0/2712400088 >> 172.21.15.50:0/2712400088 conn(0x7f15dc067b80 msgr2=0x7f15dc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- 172.21.15.50:0/2712400088 shutdown_connections 2023-12-24T18:52:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- 172.21.15.50:0/2712400088 wait complete. 2023-12-24T18:52:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 Processor -- start 2023-12-24T18:52:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- start start 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 0x7f15dc0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 0x7f15dc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0cea20 con 0x7f15dc1592d0 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0b2f80 con 0x7f15dc0c54d0 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15e0ecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0b3260 con 0x7f15dc06a760 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44242/0 (socket says 172.21.15.50:44242) 2023-12-24T18:52:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 -- 172.21.15.50:0/3992222050 learned_addr learned my addr 172.21.15.50:0/3992222050 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15da59c700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 0x7f15dc0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 -- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 msgr2=0x7f15dc0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 0x7f15dc0cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15d9d9b700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 0x7f15dc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.148+0000 7f15dad9d700 1 -- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 msgr2=0x7f15dc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15dad9d700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 0x7f15dc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15dad9d700 1 -- 172.21.15.50:0/3992222050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009420 con 0x7f15dc1592d0 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15da59c700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 0x7f15dc0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15d9d9b700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 0x7f15dc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15dad9d700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009e90 tx=0x7f15d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400cc20 con 0x7f15dc1592d0 2023-12-24T18:52:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400f040 con 0x7f15dc1592d0 2023-12-24T18:52:36.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc0b3540 con 0x7f15dc1592d0 2023-12-24T18:52:36.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4014480 con 0x7f15dc1592d0 2023-12-24T18:52:36.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc0b3b00 con 0x7f15dc1592d0 2023-12-24T18:52:36.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc0b3cf0 con 0x7f15dc1592d0 2023-12-24T18:52:36.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.152+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f15d4014830 con 0x7f15dc1592d0 2023-12-24T18:52:36.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.156+0000 7f15ca7fc700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 0x7f15bc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.156+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f15d407d150 con 0x7f15dc1592d0 2023-12-24T18:52:36.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.156+0000 7f15da59c700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 0x7f15bc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.156+0000 7f15da59c700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 0x7f15bc062a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15cc001840 tx=0x7f15cc009040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.164+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f15d40511d0 con 0x7f15dc1592d0 2023-12-24T18:52:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.340+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15dc0652e0 con 0x7f15dc1592d0 2023-12-24T18:52:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.340+0000 7f15ca7fc700 1 -- 172.21.15.50:0/3992222050 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+65 (secure 0 0 0) 0x7f15d4050d60 con 0x7f15dc1592d0 2023-12-24T18:52:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:36.345 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:52:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:52:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:52:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:36.346 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:52:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 msgr2=0x7f15bc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 0x7f15bc062a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15cc001840 tx=0x7f15cc009040 comp rx=0 tx=0).stop 2023-12-24T18:52:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 msgr2=0x7f15dc0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009e90 tx=0x7f15d400b040 comp rx=0 tx=0).stop 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 shutdown_connections 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f15bc060580 0x7f15bc062a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15dc1592d0 0x7f15dc0c96d0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15dc0c54d0 0x7f15dc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 --2- 172.21.15.50:0/3992222050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15dc06a760 0x7f15dc0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 >> 172.21.15.50:0/3992222050 conn(0x7f15dc067b80 msgr2=0x7f15dc06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 shutdown_connections 2023-12-24T18:52:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.344+0000 7f15e0ecd700 1 -- 172.21.15.50:0/3992222050 wait complete. 2023-12-24T18:52:36.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:52:36.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:52:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.540+0000 7fea55278700 1 Processor -- start 2023-12-24T18:52:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 -- start start 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea5015c3d0 0x7fea5015d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 0x7fea500cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5006b6b0 con 0x7fea5015c7a0 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5006c250 con 0x7fea5015c3d0 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea55278700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500cba20 con 0x7fea500cb2b0 2023-12-24T18:52:36.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea5015c3d0 0x7fea5015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea5015c3d0 0x7fea5015d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44254/0 (socket says 172.21.15.50:44254) 2023-12-24T18:52:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.544+0000 7fea4effd700 1 -- 172.21.15.50:0/2014622040 learned_addr learned my addr 172.21.15.50:0/2014622040 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4effd700 1 -- 172.21.15.50:0/2014622040 >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 msgr2=0x7fea500cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:36.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4f7fe700 1 --2- 172.21.15.50:0/2014622040 >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 0x7fea500cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4effd700 1 --2- 172.21.15.50:0/2014622040 >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 0x7fea500cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4effd700 1 -- 172.21.15.50:0/2014622040 >> v1:172.21.15.50:6789/0 conn(0x7fea5015c7a0 legacy=0x7fea5006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4effd700 1 -- 172.21.15.50:0/2014622040 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5006ad80 con 0x7fea5015c3d0 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4f7fe700 1 --2- 172.21.15.50:0/2014622040 >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 0x7fea500cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4effd700 1 --2- 172.21.15.50:0/2014622040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5015d810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fea5006b620 tx=0x7fea40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e871a54f58989b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4dffb700 1 -- 172.21.15.50:0/2014622040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000b860 con 0x7fea5015c3d0 2023-12-24T18:52:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4dffb700 1 -- 172.21.15.50:0/2014622040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000b9c0 con 0x7fea5015c3d0 2023-12-24T18:52:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea4dffb700 1 -- 172.21.15.50:0/2014622040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000bd60 con 0x7fea5015c3d0 2023-12-24T18:52:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 -- 172.21.15.50:0/2014622040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 msgr2=0x7fea5015d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 --2- 172.21.15.50:0/2014622040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5015d810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fea5006b620 tx=0x7fea40009250 comp rx=0 tx=0).stop 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 -- 172.21.15.50:0/2014622040 shutdown_connections 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 --2- 172.21.15.50:0/2014622040 >> v2:172.21.15.82:3300/0 conn(0x7fea500cb2b0 0x7fea500cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 --2- 172.21.15.50:0/2014622040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5015d810 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 -- 172.21.15.50:0/2014622040 >> 172.21.15.50:0/2014622040 conn(0x7fea500670b0 msgr2=0x7fea500674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 -- 172.21.15.50:0/2014622040 shutdown_connections 2023-12-24T18:52:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.548+0000 7fea55278700 1 -- 172.21.15.50:0/2014622040 wait complete. 2023-12-24T18:52:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 Processor -- start 2023-12-24T18:52:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 -- start start 2023-12-24T18:52:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea500cb2b0 0x7fea500c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5015c7a0 0x7fea50166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500c9230 con 0x7fea5015c3d0 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5016a980 con 0x7fea500cb2b0 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea55278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500c86b0 con 0x7fea5015c7a0 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44258/0 (socket says 172.21.15.50:44258) 2023-12-24T18:52:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 -- 172.21.15.50:0/218577727 learned_addr learned my addr 172.21.15.50:0/218577727 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4f7fe700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5015c7a0 0x7fea50166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4effd700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea500cb2b0 0x7fea500c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 -- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5015c7a0 msgr2=0x7fea50166ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5015c7a0 0x7fea50166ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 -- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea500cb2b0 msgr2=0x7fea500c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea500cb2b0 0x7fea500c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.552+0000 7fea4e7fc700 1 -- 172.21.15.50:0/218577727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400094f0 con 0x7fea5015c3d0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea4e7fc700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c5c0 tx=0x7fea4400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44011590 con 0x7fea5015c3d0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44011710 con 0x7fea5015c3d0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44011ad0 con 0x7fea5015c3d0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea500c8990 con 0x7fea5015c3d0 2023-12-24T18:52:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea500c8f50 con 0x7fea5015c3d0 2023-12-24T18:52:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.556+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea500a88e0 con 0x7fea5015c3d0 2023-12-24T18:52:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.560+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fea4401b3b0 con 0x7fea5015c3d0 2023-12-24T18:52:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.560+0000 7fea36ffd700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 0x7fea3c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.560+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fea4407bd40 con 0x7fea5015c3d0 2023-12-24T18:52:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.560+0000 7fea4effd700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 0x7fea3c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.564+0000 7fea4effd700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 0x7fea3c062ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea5006b620 tx=0x7fea40017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.568+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea500a88e0 con 0x7fea5015c3d0 2023-12-24T18:52:36.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:36.744+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea500a88e0 con 0x7fea5015c3d0 2023-12-24T18:52:37.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.716+0000 7fea36ffd700 1 -- 172.21.15.50:0/218577727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea500a88e0 con 0x7fea5015c3d0 2023-12-24T18:52:37.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 msgr2=0x7fea3c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 0x7fea3c062ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea5006b620 tx=0x7fea40017000 comp rx=0 tx=0).stop 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 msgr2=0x7fea5016a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c5c0 tx=0x7fea4400c980 comp rx=0 tx=0).stop 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 shutdown_connections 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea3c060620 0x7fea3c062ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5015c7a0 0x7fea50166ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5015c3d0 0x7fea5016a440 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 --2- 172.21.15.50:0/218577727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea500cb2b0 0x7fea500c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.724+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 >> 172.21.15.50:0/218577727 conn(0x7fea500670b0 msgr2=0x7fea5015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:37.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.728+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 shutdown_connections 2023-12-24T18:52:37.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.728+0000 7fea55278700 1 -- 172.21.15.50:0/218577727 wait complete. 2023-12-24T18:52:37.733 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:52:37.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:52:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 Processor -- start 2023-12-24T18:52:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 -- start start 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa8158db0 0x7faaa8159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa80a9290 0x7faaa80a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 0x7faaa806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa806b0c0 con 0x7faaa80a9290 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa806cca0 con 0x7faaa806a700 2023-12-24T18:52:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaadecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa80a9cc0 con 0x7faaa8158db0 2023-12-24T18:52:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faa9effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa80a9290 0x7faaa80a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faa9effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaa80a9290 0x7faaa80a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44262/0 (socket says 172.21.15.50:44262) 2023-12-24T18:52:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faa9effd700 1 -- 172.21.15.50:0/2303289003 learned_addr learned my addr 172.21.15.50:0/2303289003 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaa7fff700 1 --2- 172.21.15.50:0/2303289003 >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 0x7faaa806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.916+0000 7faaa77fe700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa8158db0 0x7faaa8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 -- 172.21.15.50:0/2303289003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa8158db0 msgr2=0x7faaa8159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa8158db0 0x7faaa8159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 -- 172.21.15.50:0/2303289003 >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 msgr2=0x7faaa806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 --2- 172.21.15.50:0/2303289003 >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 0x7faaa806ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 -- 172.21.15.50:0/2303289003 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80a9fa0 con 0x7faaa80a9290 2023-12-24T18:52:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaa7fff700 1 --2- 172.21.15.50:0/2303289003 >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 0x7faaa806ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faa9effd700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa80a9290 0x7faaa80a96e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faaa806c820 tx=0x7faa98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246ae6503ac22bc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaa6ffd700 1 -- 172.21.15.50:0/2303289003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800b640 con 0x7faaa80a9290 2023-12-24T18:52:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaa6ffd700 1 -- 172.21.15.50:0/2303289003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800b7a0 con 0x7faaa80a9290 2023-12-24T18:52:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaa6ffd700 1 -- 172.21.15.50:0/2303289003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800bb60 con 0x7faaa80a9290 2023-12-24T18:52:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 -- 172.21.15.50:0/2303289003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa80a9290 msgr2=0x7faaa80a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa80a9290 0x7faaa80a96e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faaa806c820 tx=0x7faa98009250 comp rx=0 tx=0).stop 2023-12-24T18:52:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 -- 172.21.15.50:0/2303289003 shutdown_connections 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 --2- 172.21.15.50:0/2303289003 >> v2:172.21.15.82:3300/0 conn(0x7faaa806a700 0x7faaa806ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa80a9290 0x7faaa80a96e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 --2- 172.21.15.50:0/2303289003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa8158db0 0x7faaa8159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 -- 172.21.15.50:0/2303289003 >> 172.21.15.50:0/2303289003 conn(0x7faaa8067b80 msgr2=0x7faaa80cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 -- 172.21.15.50:0/2303289003 shutdown_connections 2023-12-24T18:52:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.920+0000 7faaadecd700 1 -- 172.21.15.50:0/2303289003 wait complete. 2023-12-24T18:52:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.924+0000 7faaadecd700 1 Processor -- start 2023-12-24T18:52:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.924+0000 7faaadecd700 1 -- start start 2023-12-24T18:52:37.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa806a700 0x7faaa8169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 0x7faaa816c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa816c690 con 0x7faaa8158db0 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8154d00 con 0x7faaa80a9290 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8153e50 con 0x7faaa806a700 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44272/0 (socket says 172.21.15.50:44272) 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 -- 172.21.15.50:0/3968268620 learned_addr learned my addr 172.21.15.50:0/3968268620 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa77fe700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa806a700 0x7faaa8169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faa9effd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 0x7faaa816c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 -- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa806a700 msgr2=0x7faaa8169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa806a700 0x7faaa8169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 -- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 msgr2=0x7faaa816c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 0x7faaa816c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 -- 172.21.15.50:0/3968268620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009420 con 0x7faaa8158db0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faa9effd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 0x7faaa816c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaa7fff700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7faaa000ec80 tx=0x7faaa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000c850 con 0x7faaa8158db0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000c9b0 con 0x7faaa8158db0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000cd70 con 0x7faaa8158db0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa980094f0 con 0x7faaa8158db0 2023-12-24T18:52:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.928+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa81543d0 con 0x7faaa8158db0 2023-12-24T18:52:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.932+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa80652e0 con 0x7faaa8158db0 2023-12-24T18:52:37.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.932+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faaa0013680 con 0x7faaa8158db0 2023-12-24T18:52:37.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.932+0000 7faa9ffff700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:37.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.936+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5919+0+0 (secure 0 0 0) 0x7faaa007d120 con 0x7faaa8158db0 2023-12-24T18:52:37.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.936+0000 7faaa77fe700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:37.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.936+0000 7faaa77fe700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 0x7faa88062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa90009fd0 tx=0x7faa9000b040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:37.940+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faaa004d6c0 con 0x7faaa8158db0 2023-12-24T18:52:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.112+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faaa806c930 con 0x7faaa8158db0 2023-12-24T18:52:38.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.732+0000 7faa9ffff700 1 -- 172.21.15.50:0/3968268620 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7faaa0050ce0 con 0x7faaa8158db0 2023-12-24T18:52:38.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 msgr2=0x7faa88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:38.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 0x7faa88062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa90009fd0 tx=0x7faa9000b040 comp rx=0 tx=0).stop 2023-12-24T18:52:38.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 msgr2=0x7faaa8156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:38.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7faaa000ec80 tx=0x7faaa00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 shutdown_connections 2023-12-24T18:52:38.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.740+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faa88060550 0x7faa88062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.744+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa8158db0 0x7faaa8156780 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.744+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa80a9290 0x7faaa816c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.744+0000 7faaadecd700 1 --2- 172.21.15.50:0/3968268620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faaa806a700 0x7faaa8169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.744+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 >> 172.21.15.50:0/3968268620 conn(0x7faaa8067b80 msgr2=0x7faaa80af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.748+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 shutdown_connections 2023-12-24T18:52:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.748+0000 7faaadecd700 1 -- 172.21.15.50:0/3968268620 wait complete. 2023-12-24T18:52:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:52:38.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:52:38.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.948+0000 7f49af00c700 1 Processor -- start 2023-12-24T18:52:38.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.948+0000 7f49af00c700 1 -- start start 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a8156ab0 0x7f49a8156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49a80adb50 0x7f49a80adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a815b5a0 con 0x7f49a8156ab0 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80c9150 con 0x7f49a80adb50 2023-12-24T18:52:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a815a990 con 0x7f49a80c87d0 2023-12-24T18:52:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a8156ab0 0x7f49a8156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a8156ab0 0x7f49a8156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44282/0 (socket says 172.21.15.50:44282) 2023-12-24T18:52:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 -- 172.21.15.50:0/2673981038 learned_addr learned my addr 172.21.15.50:0/2673981038 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae80b700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ad809700 1 --2- 172.21.15.50:0/2673981038 >> v2:172.21.15.82:3300/0 conn(0x7f49a80adb50 0x7f49a80adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 -- 172.21.15.50:0/2673981038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 msgr2=0x7f49a80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 -- 172.21.15.50:0/2673981038 >> v2:172.21.15.82:3300/0 conn(0x7f49a80adb50 msgr2=0x7f49a80adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 --2- 172.21.15.50:0/2673981038 >> v2:172.21.15.82:3300/0 conn(0x7f49a80adb50 0x7f49a80adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 -- 172.21.15.50:0/2673981038 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a815ac70 con 0x7f49a8156ab0 2023-12-24T18:52:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ae00a700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a8156ab0 0x7f49a8156e80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f49a8067fa0 tx=0x7f49a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd222ce4c8dd4a74 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ad008700 1 -- 172.21.15.50:0/2673981038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400b640 con 0x7f49a8156ab0 2023-12-24T18:52:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ad008700 1 -- 172.21.15.50:0/2673981038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a400b7a0 con 0x7f49a8156ab0 2023-12-24T18:52:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49ad008700 1 -- 172.21.15.50:0/2673981038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400bb60 con 0x7f49a8156ab0 2023-12-24T18:52:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 -- 172.21.15.50:0/2673981038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a8156ab0 msgr2=0x7f49a8156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.952+0000 7f49af00c700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a8156ab0 0x7f49a8156e80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f49a8067fa0 tx=0x7f49a4009250 comp rx=0 tx=0).stop 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- 172.21.15.50:0/2673981038 shutdown_connections 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- 172.21.15.50:0/2673981038 >> v2:172.21.15.82:3300/0 conn(0x7f49a80adb50 0x7f49a80adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- 172.21.15.50:0/2673981038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a8156ab0 0x7f49a8156e80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- 172.21.15.50:0/2673981038 >> 172.21.15.50:0/2673981038 conn(0x7f49a8067250 msgr2=0x7f49a8067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- 172.21.15.50:0/2673981038 shutdown_connections 2023-12-24T18:52:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- 172.21.15.50:0/2673981038 wait complete. 2023-12-24T18:52:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 Processor -- start 2023-12-24T18:52:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- start start 2023-12-24T18:52:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49a8156ab0 0x7f49a81598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80b0180 con 0x7f49a80adb50 2023-12-24T18:52:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80af570 con 0x7f49a8156ab0 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.956+0000 7f49af00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80af850 con 0x7f49a80c87d0 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44286/0 (socket says 172.21.15.50:44286) 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 -- 172.21.15.50:0/3113294767 learned_addr learned my addr 172.21.15.50:0/3113294767 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae80b700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49a8156ab0 0x7f49a81598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ad809700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 -- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 msgr2=0x7f49a80ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 -- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49a8156ab0 msgr2=0x7f49a81598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49a8156ab0 0x7f49a81598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 -- 172.21.15.50:0/3113294767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40094f0 con 0x7f49a80adb50 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ad809700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49ae00a700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f49a80c9450 tx=0x7f49a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4000d10 con 0x7f49a80adb50 2023-12-24T18:52:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a400bb20 con 0x7f49a80adb50 2023-12-24T18:52:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4011670 con 0x7f49a80adb50 2023-12-24T18:52:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80afb30 con 0x7f49a80adb50 2023-12-24T18:52:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a8157fc0 con 0x7f49a80adb50 2023-12-24T18:52:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.960+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a804be40 con 0x7f49a80adb50 2023-12-24T18:52:38.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.964+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f49a40119e0 con 0x7f49a80adb50 2023-12-24T18:52:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.964+0000 7f499e7fc700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 0x7f498c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.964+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6301+0+0 (secure 0 0 0) 0x7f49a407e920 con 0x7f49a80adb50 2023-12-24T18:52:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.964+0000 7f49ad809700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 0x7f498c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.968+0000 7f49ad809700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 0x7f498c062a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f49a8168650 tx=0x7f499800f040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:38.972+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49a404ed20 con 0x7f49a80adb50 2023-12-24T18:52:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.184+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f49a815af50 con 0x7f49a80adb50 2023-12-24T18:52:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.752+0000 7f499e7fc700 1 -- 172.21.15.50:0/3113294767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v49) v1 ==== 174+0+0 (secure 0 0 0) 0x7f49a40522c0 con 0x7f49a80adb50 2023-12-24T18:52:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.768+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 msgr2=0x7f498c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.768+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 0x7f498c062a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f49a8168650 tx=0x7f499800f040 comp rx=0 tx=0).stop 2023-12-24T18:52:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.768+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 msgr2=0x7f49a8157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.768+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f49a80c9450 tx=0x7f49a4017000 comp rx=0 tx=0).stop 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 shutdown_connections 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f498c060580 0x7f498c062a30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49a8156ab0 0x7f49a81598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49a80c87d0 0x7f49a80ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 --2- 172.21.15.50:0/3113294767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a80adb50 0x7f49a8157a80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 >> 172.21.15.50:0/3113294767 conn(0x7f49a8067250 msgr2=0x7f49a8155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 shutdown_connections 2023-12-24T18:52:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.772+0000 7f49af00c700 1 -- 172.21.15.50:0/3113294767 wait complete. 2023-12-24T18:52:39.779 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 13 and data pool 14 2023-12-24T18:52:39.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:39.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.964+0000 7fb9a2678700 1 Processor -- start 2023-12-24T18:52:39.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.964+0000 7fb9a2678700 1 -- start start 2023-12-24T18:52:39.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 0x7fb99c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb99c0cd740 0x7fb99c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c0cc6a0 con 0x7fb99c15abe0 2023-12-24T18:52:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c06e1e0 con 0x7fb99c0cc1a0 2023-12-24T18:52:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0cdbe0 con 0x7fb99c0cd740 2023-12-24T18:52:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 0x7fb99c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb99c0cd740 0x7fb99c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb99c0cd740 0x7fb99c159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:58230/0 (socket says 172.21.15.50:58230) 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 -- 172.21.15.50:0/2362762000 learned_addr learned my addr 172.21.15.50:0/2362762000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99bfff700 1 --1- 172.21.15.50:0/2362762000 >> v1:172.21.15.82:6789/0 conn(0x7fb99c15abe0 0x7fb99c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51574/0 (socket says 172.21.15.50:51574) 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 -- 172.21.15.50:0/2362762000 >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 msgr2=0x7fb99c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 --2- 172.21.15.50:0/2362762000 >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 0x7fb99c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 -- 172.21.15.50:0/2362762000 >> v1:172.21.15.82:6789/0 conn(0x7fb99c15abe0 legacy=0x7fb99c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 -- 172.21.15.50:0/2362762000 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0cc980 con 0x7fb99c0cd740 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99affd700 1 -- 172.21.15.50:0/2362762000 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259106020 0 0) 0x7fb99c0cc6a0 con 0x7fb99c15abe0 2023-12-24T18:52:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99b7fe700 1 --2- 172.21.15.50:0/2362762000 >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 0x7fb99c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:39.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a0c15700 1 --2- 172.21.15.50:0/2362762000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c0cd740 0x7fb99c159cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb99c06c640 tx=0x7fb994009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a02529ad4f2a524 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:39.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99affd700 1 -- 172.21.15.50:0/2362762000 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400e070 con 0x7fb99c0cd740 2023-12-24T18:52:39.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99affd700 1 -- 172.21.15.50:0/2362762000 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99400ba20 con 0x7fb99c0cd740 2023-12-24T18:52:39.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb99affd700 1 -- 172.21.15.50:0/2362762000 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9940092e0 con 0x7fb99c0cd740 2023-12-24T18:52:39.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- 172.21.15.50:0/2362762000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c0cd740 msgr2=0x7fb99c159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2362762000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c0cd740 0x7fb99c159cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb99c06c640 tx=0x7fb994009840 comp rx=0 tx=0).stop 2023-12-24T18:52:39.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- 172.21.15.50:0/2362762000 shutdown_connections 2023-12-24T18:52:39.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2362762000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c0cd740 0x7fb99c159cf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2362762000 >> v2:172.21.15.50:3300/0 conn(0x7fb99c0cc1a0 0x7fb99c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- 172.21.15.50:0/2362762000 >> 172.21.15.50:0/2362762000 conn(0x7fb99c0cdd90 msgr2=0x7fb99c0ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:39.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- 172.21.15.50:0/2362762000 shutdown_connections 2023-12-24T18:52:39.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 -- 172.21.15.50:0/2362762000 wait complete. 2023-12-24T18:52:39.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.968+0000 7fb9a2678700 1 Processor -- start 2023-12-24T18:52:39.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- start start 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 0x7fb99c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c15abe0 0x7fb99c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c5ce0 con 0x7fb99c0cd740 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c66b0 con 0x7fb99c15abe0 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c50d0 con 0x7fb99c0cc1a0 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43894/0 (socket says 172.21.15.50:43894) 2023-12-24T18:52:39.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 -- 172.21.15.50:0/2128035703 learned_addr learned my addr 172.21.15.50:0/2128035703 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:39.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99bfff700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 0x7fb99c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a0c15700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c15abe0 0x7fb99c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 -- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 msgr2=0x7fb99c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 0x7fb99c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 -- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c15abe0 msgr2=0x7fb99c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c15abe0 0x7fb99c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 -- 172.21.15.50:0/2128035703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009420 con 0x7fb99c0cd740 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99bfff700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 0x7fb99c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb99b7fe700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ec80 tx=0x7fb9900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000c920 con 0x7fb99c0cd740 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000ca80 con 0x7fb99c0cd740 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb994009ae0 con 0x7fb99c0cd740 2023-12-24T18:52:39.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000ce00 con 0x7fb99c0cd740 2023-12-24T18:52:39.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c0c5690 con 0x7fb99c0cd740 2023-12-24T18:52:39.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.976+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c0652e0 con 0x7fb99c0cd740 2023-12-24T18:52:39.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.980+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb990013680 con 0x7fb99c0cd740 2023-12-24T18:52:39.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.980+0000 7fb983fff700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 0x7fb988062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:39.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.980+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fb99007ce60 con 0x7fb99c0cd740 2023-12-24T18:52:39.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.980+0000 7fb99bfff700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 0x7fb988062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:39.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.980+0000 7fb99bfff700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 0x7fb988062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb99c15fe10 tx=0x7fb98c007ef0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:39.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:39.988+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb99004d0f0 con 0x7fb99c0cd740 2023-12-24T18:52:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.168+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99c0ccc60 con 0x7fb99c0cd740 2023-12-24T18:52:40.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.168+0000 7fb983fff700 1 -- 172.21.15.50:0/2128035703 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16106 (secure 0 0 0) 0x7fb990050710 con 0x7fb99c0cd740 2023-12-24T18:52:40.172 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:40.173 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":108,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:39.191765+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:40.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 msgr2=0x7fb988062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 0x7fb988062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb99c15fe10 tx=0x7fb98c007ef0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 msgr2=0x7fb99c0c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ec80 tx=0x7fb9900091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 shutdown_connections 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb988060550 0x7fb988062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb99c15abe0 0x7fb99c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb99c0cd740 0x7fb99c0c7040 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 --2- 172.21.15.50:0/2128035703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb99c0cc1a0 0x7fb99c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 >> 172.21.15.50:0/2128035703 conn(0x7fb99c0cdd90 msgr2=0x7fb99c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 shutdown_connections 2023-12-24T18:52:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.176+0000 7fb9a2678700 1 -- 172.21.15.50:0/2128035703 wait complete. 2023-12-24T18:52:40.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:40.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.364+0000 7f48ced45700 1 Processor -- start 2023-12-24T18:52:40.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 -- start start 2023-12-24T18:52:40.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48c80ca3a0 0x7f48c80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48c806ae10 0x7f48c815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c806ca50 con 0x7f48c806b290 2023-12-24T18:52:40.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c80c6980 con 0x7f48c80ca3a0 2023-12-24T18:52:40.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.368+0000 7f48ced45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c806b7f0 con 0x7f48c806ae10 2023-12-24T18:52:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48c80ca3a0 0x7f48c80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48c7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48c806ae10 0x7f48c815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48c80ca3a0 0x7f48c80ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43908/0 (socket says 172.21.15.50:43908) 2023-12-24T18:52:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48cd2e2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48c806b290 0x7f48c8160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51582/0 (socket says 172.21.15.50:51582) 2023-12-24T18:52:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 -- 172.21.15.50:0/1328563968 learned_addr learned my addr 172.21.15.50:0/1328563968 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 -- 172.21.15.50:0/1328563968 >> v2:172.21.15.82:3300/0 conn(0x7f48c806ae10 msgr2=0x7f48c815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 --2- 172.21.15.50:0/1328563968 >> v2:172.21.15.82:3300/0 conn(0x7f48c806ae10 0x7f48c815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 -- 172.21.15.50:0/1328563968 >> v1:172.21.15.82:6789/0 conn(0x7f48c806b290 legacy=0x7f48c8160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 -- 172.21.15.50:0/1328563968 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c806bad0 con 0x7f48c80ca3a0 2023-12-24T18:52:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ccae1700 1 --2- 172.21.15.50:0/1328563968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80ca770 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f48c80cccb0 tx=0x7f48bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4681251c778bc7b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48c77fe700 1 -- 172.21.15.50:0/1328563968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc009e70 con 0x7f48c80ca3a0 2023-12-24T18:52:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48c77fe700 1 -- 172.21.15.50:0/1328563968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc00b860 con 0x7f48c80ca3a0 2023-12-24T18:52:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48c77fe700 1 -- 172.21.15.50:0/1328563968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00bc20 con 0x7f48c80ca3a0 2023-12-24T18:52:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 -- 172.21.15.50:0/1328563968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 msgr2=0x7f48c80ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 --2- 172.21.15.50:0/1328563968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80ca770 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f48c80cccb0 tx=0x7f48bc009250 comp rx=0 tx=0).stop 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 -- 172.21.15.50:0/1328563968 shutdown_connections 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 --2- 172.21.15.50:0/1328563968 >> v2:172.21.15.82:3300/0 conn(0x7f48c806ae10 0x7f48c815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 --2- 172.21.15.50:0/1328563968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80ca770 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 -- 172.21.15.50:0/1328563968 >> 172.21.15.50:0/1328563968 conn(0x7f48c80cbba0 msgr2=0x7f48c80cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 -- 172.21.15.50:0/1328563968 shutdown_connections 2023-12-24T18:52:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.372+0000 7f48ced45700 1 -- 172.21.15.50:0/1328563968 wait complete. 2023-12-24T18:52:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 Processor -- start 2023-12-24T18:52:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 -- start start 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c806b290 0x7f48c815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c815bda0 con 0x7f48c80ca3a0 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c815b190 con 0x7f48c806b290 2023-12-24T18:52:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ced45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c815b470 con 0x7f48c806ae10 2023-12-24T18:52:40.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48cd2e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ccae1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ccae1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44418/0 (socket says 172.21.15.50:44418) 2023-12-24T18:52:40.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48ccae1700 1 -- 172.21.15.50:0/3834747099 learned_addr learned my addr 172.21.15.50:0/3834747099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:40.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.376+0000 7f48c7fff700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c806b290 0x7f48c815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 -- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c806b290 msgr2=0x7f48c815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c806b290 0x7f48c815a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 -- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 msgr2=0x7f48c80b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 -- 172.21.15.50:0/3834747099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0094f0 con 0x7f48c806ae10 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ccae1700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f48c8069fe0 tx=0x7f48bc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc01f070 con 0x7f48c806ae10 2023-12-24T18:52:40.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc002f30 con 0x7f48c806ae10 2023-12-24T18:52:40.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c815b750 con 0x7f48c806ae10 2023-12-24T18:52:40.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00b9d0 con 0x7f48c806ae10 2023-12-24T18:52:40.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c81492d0 con 0x7f48c806ae10 2023-12-24T18:52:40.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.380+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c815bf10 con 0x7f48c806ae10 2023-12-24T18:52:40.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.384+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f48bc023070 con 0x7f48c806ae10 2023-12-24T18:52:40.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.384+0000 7f48c4ff9700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 0x7f48ac062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.384+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f48bc07dfc0 con 0x7f48c806ae10 2023-12-24T18:52:40.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.384+0000 7f48c7fff700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 0x7f48ac062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.384+0000 7f48c7fff700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 0x7f48ac062b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48c815a3c0 tx=0x7f48b40091a0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.392+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48bc04e390 con 0x7f48c806ae10 2023-12-24T18:52:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.572+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c80652e0 con 0x7f48c806ae10 2023-12-24T18:52:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.572+0000 7f48c4ff9700 1 -- 172.21.15.50:0/3834747099 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16106 (secure 0 0 0) 0x7f48bc051970 con 0x7f48c806ae10 2023-12-24T18:52:40.573 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:40.574 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":108,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:39.191765+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.576+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 msgr2=0x7f48ac062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.576+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 0x7f48ac062b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48c815a3c0 tx=0x7f48b40091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.576+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 msgr2=0x7f48c8148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.576+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f48c8069fe0 tx=0x7f48bc017000 comp rx=0 tx=0).stop 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 shutdown_connections 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f48ac0606a0 0x7f48ac062b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48c80ca3a0 0x7f48c80b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c806b290 0x7f48c815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 --2- 172.21.15.50:0/3834747099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48c806ae10 0x7f48c8148d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 >> 172.21.15.50:0/3834747099 conn(0x7f48c80cbba0 msgr2=0x7f48c8157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 shutdown_connections 2023-12-24T18:52:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.580+0000 7f48ced45700 1 -- 172.21.15.50:0/3834747099 wait complete. 2023-12-24T18:52:40.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:52:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.772+0000 7f755aa8e700 1 Processor -- start 2023-12-24T18:52:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.772+0000 7f755aa8e700 1 -- start start 2023-12-24T18:52:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755aa8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7554158c40 0x7f75540cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755aa8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f75540ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755aa8e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755406a580 con 0x7f755406cd40 2023-12-24T18:52:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755aa8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540cd110 con 0x7f7554158c40 2023-12-24T18:52:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755aa8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755406a7d0 con 0x7f75540cc780 2023-12-24T18:52:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755a28d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f755406cd40 0x7f755406d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44034/0 (socket says 172.21.15.50:44034) 2023-12-24T18:52:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755a28d700 1 -- 172.21.15.50:0/2000565826 learned_addr learned my addr 172.21.15.50:0/2000565826 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2000565826 >> v2:172.21.15.82:3300/0 conn(0x7f7554158c40 0x7f75540cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f755928b700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f75540ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7558a8a700 1 -- 172.21.15.50:0/2000565826 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225422801 0 0) 0x7f755406a580 con 0x7f755406cd40 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7558a8a700 1 -- 172.21.15.50:0/2000565826 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7540003570 con 0x7f755406cd40 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 -- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 msgr2=0x7f75540ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f75540ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 -- 172.21.15.50:0/2000565826 >> v1:172.21.15.50:6789/0 conn(0x7f755406cd40 legacy=0x7f755406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 -- 172.21.15.50:0/2000565826 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755406aab0 con 0x7f7554158c40 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.776+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7554158c40 0x7f75540cf500 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7550009e60 tx=0x7f7550009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d14bd3304d12fd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f7558a8a700 1 -- 172.21.15.50:0/2000565826 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000e070 con 0x7f7554158c40 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f7558a8a700 1 -- 172.21.15.50:0/2000565826 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000bab0 con 0x7f7554158c40 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f7558a8a700 1 -- 172.21.15.50:0/2000565826 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000be30 con 0x7f7554158c40 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 -- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7554158c40 msgr2=0x7f75540cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7554158c40 0x7f75540cf500 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7550009e60 tx=0x7f7550009780 comp rx=0 tx=0).stop 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 -- 172.21.15.50:0/2000565826 shutdown_connections 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f75540ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2000565826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7554158c40 0x7f75540cf500 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 -- 172.21.15.50:0/2000565826 >> 172.21.15.50:0/2000565826 conn(0x7f75540d0800 msgr2=0x7f75540b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 -- 172.21.15.50:0/2000565826 shutdown_connections 2023-12-24T18:52:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 -- 172.21.15.50:0/2000565826 wait complete. 2023-12-24T18:52:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.780+0000 7f755aa8e700 1 Processor -- start 2023-12-24T18:52:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 -- start start 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f755406cd40 0x7f75540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f7554152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cbf80 con 0x7f7554158c40 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755415a110 con 0x7f755406cd40 2023-12-24T18:52:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cbcb0 con 0x7f75540cc780 2023-12-24T18:52:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43922/0 (socket says 172.21.15.50:43922) 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 -- 172.21.15.50:0/2181611754 learned_addr learned my addr 172.21.15.50:0/2181611754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f755406cd40 0x7f75540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755928b700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f7554152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 -- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 msgr2=0x7f7554152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f7554152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 -- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f755406cd40 msgr2=0x7f75540cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f755406cd40 0x7f75540cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 -- 172.21.15.50:0/2181611754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550009a20 con 0x7f7554158c40 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755a28d700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c790 tx=0x7f754c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c005c00 con 0x7f7554158c40 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c005d60 con 0x7f7554158c40 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755415c1a0 con 0x7f7554158c40 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.784+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0072e0 con 0x7f7554158c40 2023-12-24T18:52:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.788+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755415c760 con 0x7f7554158c40 2023-12-24T18:52:40.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.788+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755404be40 con 0x7f7554158c40 2023-12-24T18:52:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.788+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f754c012400 con 0x7f7554158c40 2023-12-24T18:52:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.792+0000 7f7549ffb700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 0x7f7538062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.792+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f754c07beb0 con 0x7f7554158c40 2023-12-24T18:52:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.792+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 0x7f7538062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.792+0000 7f7559a8c700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 0x7f7538062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75500097c0 tx=0x7f7550019000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:40.796+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f754c049be0 con 0x7f7554158c40 2023-12-24T18:52:41.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.004+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f755415a250 con 0x7f7554158c40 2023-12-24T18:52:41.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.768+0000 7f7549ffb700 1 -- 172.21.15.50:0/2181611754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 118+0+0 (secure 0 0 0) 0x7f754c04c160 con 0x7f7554158c40 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 msgr2=0x7f7538062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 0x7f7538062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75500097c0 tx=0x7f7550019000 comp rx=0 tx=0).stop 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 msgr2=0x7f75540c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c790 tx=0x7f754c007dd0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 shutdown_connections 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7538060550 0x7f7538062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554158c40 0x7f75540c6b30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75540cc780 0x7f7554152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 --2- 172.21.15.50:0/2181611754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f755406cd40 0x7f75540cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 >> 172.21.15.50:0/2181611754 conn(0x7f75540d0800 msgr2=0x7f7554156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 shutdown_connections 2023-12-24T18:52:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.772+0000 7f755aa8e700 1 -- 172.21.15.50:0/2181611754 wait complete. 2023-12-24T18:52:41.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:52:41.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.968+0000 7f4012fc5700 1 Processor -- start 2023-12-24T18:52:41.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.968+0000 7f4012fc5700 1 -- start start 2023-12-24T18:52:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4012fc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4012fc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f400c06ae10 0x7f400c0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4012fc5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c06cca0 con 0x7f400c0a9290 2023-12-24T18:52:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4012fc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0a9cc0 con 0x7f400c06ae10 2023-12-24T18:52:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4012fc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0a9fa0 con 0x7f400c158db0 2023-12-24T18:52:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44458/0 (socket says 172.21.15.50:44458) 2023-12-24T18:52:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 -- 172.21.15.50:0/4140421428 learned_addr learned my addr 172.21.15.50:0/4140421428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4011562700 1 --2- 172.21.15.50:0/4140421428 >> v2:172.21.15.82:3300/0 conn(0x7f400c06ae10 0x7f400c0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 -- 172.21.15.50:0/4140421428 >> v2:172.21.15.82:3300/0 conn(0x7f400c06ae10 msgr2=0x7f400c0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 --2- 172.21.15.50:0/4140421428 >> v2:172.21.15.82:3300/0 conn(0x7f400c06ae10 0x7f400c0a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 -- 172.21.15.50:0/4140421428 >> v1:172.21.15.82:6789/0 conn(0x7f400c0a9290 legacy=0x7f400c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 -- 172.21.15.50:0/4140421428 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c06c930 con 0x7f400c158db0 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f4010d61700 1 --2- 172.21.15.50:0/4140421428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40080099e0 tx=0x7f4008009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f7bb6d4c88ad67 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.972+0000 7f40037fe700 1 -- 172.21.15.50:0/4140421428 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800b820 con 0x7f400c158db0 2023-12-24T18:52:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f40037fe700 1 -- 172.21.15.50:0/4140421428 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800b980 con 0x7f400c158db0 2023-12-24T18:52:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f40037fe700 1 -- 172.21.15.50:0/4140421428 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800bd20 con 0x7f400c158db0 2023-12-24T18:52:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- 172.21.15.50:0/4140421428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 msgr2=0x7f400c159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 --2- 172.21.15.50:0/4140421428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40080099e0 tx=0x7f4008009250 comp rx=0 tx=0).stop 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- 172.21.15.50:0/4140421428 shutdown_connections 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 --2- 172.21.15.50:0/4140421428 >> v2:172.21.15.82:3300/0 conn(0x7f400c06ae10 0x7f400c0a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 --2- 172.21.15.50:0/4140421428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c159180 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- 172.21.15.50:0/4140421428 >> 172.21.15.50:0/4140421428 conn(0x7f400c067b80 msgr2=0x7f400c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- 172.21.15.50:0/4140421428 shutdown_connections 2023-12-24T18:52:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- 172.21.15.50:0/4140421428 wait complete. 2023-12-24T18:52:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 Processor -- start 2023-12-24T18:52:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.976+0000 7f4012fc5700 1 -- start start 2023-12-24T18:52:41.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c06ae10 0x7f400c13ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 0x7f400c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c155a50 con 0x7f400c0a9290 2023-12-24T18:52:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c154eb0 con 0x7f400c06ae10 2023-12-24T18:52:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c155120 con 0x7f400c158db0 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4003fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 0x7f400c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4003fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 0x7f400c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43936/0 (socket says 172.21.15.50:43936) 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4003fff700 1 -- 172.21.15.50:0/3946908127 learned_addr learned my addr 172.21.15.50:0/3946908127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4010d61700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c06ae10 0x7f400c13ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 -- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c06ae10 msgr2=0x7f400c13ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c06ae10 0x7f400c13ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 -- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 msgr2=0x7f400c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 0x7f400c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 -- 172.21.15.50:0/3946908127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080094f0 con 0x7f400c158db0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4011562700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c06d670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f400400ec90 tx=0x7f400400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400c890 con 0x7f400c158db0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400400f040 con 0x7f400c158db0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400cc60 con 0x7f400c158db0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.980+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c155400 con 0x7f400c158db0 2023-12-24T18:52:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.984+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c140480 con 0x7f400c158db0 2023-12-24T18:52:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.984+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c155c00 con 0x7f400c158db0 2023-12-24T18:52:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.984+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4004014480 con 0x7f400c158db0 2023-12-24T18:52:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.988+0000 7f4000ff9700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 0x7f3ff8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.988+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f400407d4c0 con 0x7f400c158db0 2023-12-24T18:52:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.988+0000 7f4010d61700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 0x7f3ff8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.988+0000 7f4010d61700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 0x7f3ff8062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f40080099e0 tx=0x7f4008017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:41.992+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f400c155c00 con 0x7f400c158db0 2023-12-24T18:52:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.200+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f400c155c00 con 0x7f400c158db0 2023-12-24T18:52:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.780+0000 7f4000ff9700 1 -- 172.21.15.50:0/3946908127 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 122+0+0 (secure 0 0 0) 0x7f400c155c00 con 0x7f400c158db0 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 msgr2=0x7f3ff8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 0x7f3ff8062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f40080099e0 tx=0x7f4008017000 comp rx=0 tx=0).stop 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 msgr2=0x7f400c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c06d670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f400400ec90 tx=0x7f400400b040 comp rx=0 tx=0).stop 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 shutdown_connections 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3ff8060550 0x7f3ff8062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f400c158db0 0x7f400c06d670 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400c0a9290 0x7f400c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 --2- 172.21.15.50:0/3946908127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c06ae10 0x7f400c13ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 >> 172.21.15.50:0/3946908127 conn(0x7f400c067b80 msgr2=0x7f400c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 shutdown_connections 2023-12-24T18:52:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.784+0000 7f4012fc5700 1 -- 172.21.15.50:0/3946908127 wait complete. 2023-12-24T18:52:42.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 Processor -- start 2023-12-24T18:52:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 -- start start 2023-12-24T18:52:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 0x7fd90006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90006d1a0 con 0x7fd90006cd60 2023-12-24T18:52:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90006ab60 con 0x7fd90015c710 2023-12-24T18:52:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.976+0000 7fd904985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000afb80 con 0x7fd90006a5a0 2023-12-24T18:52:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd90006cd60 0x7fd9000b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44044/0 (socket says 172.21.15.50:44044) 2023-12-24T18:52:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fe59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd90015c710 0x7fd9000cb4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51594/0 (socket says 172.21.15.50:51594) 2023-12-24T18:52:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fed9d700 1 -- 172.21.15.50:0/1512607230 learned_addr learned my addr 172.21.15.50:0/1512607230 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fdd9b700 1 --2- 172.21.15.50:0/1512607230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 0x7fd90006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454583928 0 0) 0x7fd90006ab60 con 0x7fd90015c710 2023-12-24T18:52:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e8003570 con 0x7fd90015c710 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255800865 0 0) 0x7fd90006d1a0 con 0x7fd90006cd60 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90006ab60 con 0x7fd90006cd60 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3767289169 0 0) 0x7fd90006ab60 con 0x7fd90006cd60 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fdd9b700 1 -- 172.21.15.50:0/1512607230 >> v1:172.21.15.82:6789/0 conn(0x7fd90015c710 legacy=0x7fd9000cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fdd9b700 1 -- 172.21.15.50:0/1512607230 >> v1:172.21.15.50:6789/0 conn(0x7fd90006cd60 legacy=0x7fd9000b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fdd9b700 1 -- 172.21.15.50:0/1512607230 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90006ae40 con 0x7fd90006a5a0 2023-12-24T18:52:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fdd9b700 1 --2- 172.21.15.50:0/1512607230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 0x7fd90006c820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009910 tx=0x7fd8f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9860fb4c2ca33176 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:42.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8001810 con 0x7fd90006a5a0 2023-12-24T18:52:42.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f4011420 con 0x7fd90006a5a0 2023-12-24T18:52:42.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.980+0000 7fd8fd59a700 1 -- 172.21.15.50:0/1512607230 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40117c0 con 0x7fd90006a5a0 2023-12-24T18:52:42.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 -- 172.21.15.50:0/1512607230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 msgr2=0x7fd90006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 --2- 172.21.15.50:0/1512607230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 0x7fd90006c820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009910 tx=0x7fd8f40091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 -- 172.21.15.50:0/1512607230 shutdown_connections 2023-12-24T18:52:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 --2- 172.21.15.50:0/1512607230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006a5a0 0x7fd90006c820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 -- 172.21.15.50:0/1512607230 >> 172.21.15.50:0/1512607230 conn(0x7fd900067b20 msgr2=0x7fd9000cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 -- 172.21.15.50:0/1512607230 shutdown_connections 2023-12-24T18:52:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 -- 172.21.15.50:0/1512607230 wait complete. 2023-12-24T18:52:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.984+0000 7fd904985700 1 Processor -- start 2023-12-24T18:52:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 -- start start 2023-12-24T18:52:42.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006cd60 0x7fd90014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd90015c710 0x7fd9000b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90016a0c0 con 0x7fd90006a5a0 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c6890 con 0x7fd90015c710 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900157c70 con 0x7fd90006cd60 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43942/0 (socket says 172.21.15.50:43942) 2023-12-24T18:52:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 -- 172.21.15.50:0/95792590 learned_addr learned my addr 172.21.15.50:0/95792590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fed9d700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd90015c710 0x7fd9000b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fdd9b700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006cd60 0x7fd90014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 -- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006cd60 msgr2=0x7fd90014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006cd60 0x7fd90014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 -- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd90015c710 msgr2=0x7fd9000b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd90015c710 0x7fd9000b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 -- 172.21.15.50:0/95792590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4009420 con 0x7fd90006a5a0 2023-12-24T18:52:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8fe59c700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c590 tx=0x7fd8f0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0005b40 con 0x7fd90006a5a0 2023-12-24T18:52:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005ca0 con 0x7fd90006a5a0 2023-12-24T18:52:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.988+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90014b910 con 0x7fd90006a5a0 2023-12-24T18:52:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.992+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0007320 con 0x7fd90006a5a0 2023-12-24T18:52:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.992+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd900169790 con 0x7fd90006a5a0 2023-12-24T18:52:42.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.992+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9000652e0 con 0x7fd90006a5a0 2023-12-24T18:52:42.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.992+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd8f001b3b0 con 0x7fd90006a5a0 2023-12-24T18:52:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.996+0000 7fd8ee7fc700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 0x7fd8e0062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.996+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd8f007be20 con 0x7fd90006a5a0 2023-12-24T18:52:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.996+0000 7fd8fdd9b700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 0x7fd8e0062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:42.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:42.996+0000 7fd8fdd9b700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 0x7fd8e0062b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40030c0 tx=0x7fd8f4016000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.004+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd8f004c130 con 0x7fd90006a5a0 2023-12-24T18:52:43.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.216+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90006beb0 con 0x7fd90006a5a0 2023-12-24T18:52:43.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.216+0000 7fd8ee7fc700 1 -- 172.21.15.50:0/95792590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fd8f004f750 con 0x7fd90006a5a0 2023-12-24T18:52:43.216 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:52:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 msgr2=0x7fd8e0062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 0x7fd8e0062b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40030c0 tx=0x7fd8f4016000 comp rx=0 tx=0).stop 2023-12-24T18:52:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 msgr2=0x7fd9000c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c590 tx=0x7fd8f0007dc0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 shutdown_connections 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd8e0060650 0x7fd8e0062b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd90015c710 0x7fd9000b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd90006cd60 0x7fd90014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 --2- 172.21.15.50:0/95792590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd90006a5a0 0x7fd9000c6350 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 >> 172.21.15.50:0/95792590 conn(0x7fd900067b20 msgr2=0x7fd9000cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 shutdown_connections 2023-12-24T18:52:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.220+0000 7fd904985700 1 -- 172.21.15.50:0/95792590 wait complete. 2023-12-24T18:52:43.221 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:52:43.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:52:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.412+0000 7f9cb8bcc700 1 Processor -- start 2023-12-24T18:52:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.412+0000 7f9cb8bcc700 1 -- start start 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cb4158cd0 0x7f9cb41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 0x7f9cb40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406afb0 0x7f9cb406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb406c510 con 0x7f9cb4158cd0 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40a9c80 con 0x7f9cb406c0c0 2023-12-24T18:52:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb8bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40a8e10 con 0x7f9cb406afb0 2023-12-24T18:52:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cb4158cd0 0x7f9cb41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cb4158cd0 0x7f9cb41590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43952/0 (socket says 172.21.15.50:43952) 2023-12-24T18:52:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1122436583 learned_addr learned my addr 172.21.15.50:0/1122436583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9caaffd700 1 --2- 172.21.15.50:0/1122436583 >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 0x7f9cb40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb3fff700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406afb0 0x7f9cb406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1122436583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406afb0 msgr2=0x7f9cb406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406afb0 0x7f9cb406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1122436583 >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 msgr2=0x7f9cb40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/1122436583 >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 0x7f9cb40a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1122436583 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb406b900 con 0x7f9cb4158cd0 2023-12-24T18:52:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9caaffd700 1 --2- 172.21.15.50:0/1122436583 >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 0x7f9cb40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41590a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b1b40 tx=0x7f9ca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfadd8b89e622a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb2ffd700 1 -- 172.21.15.50:0/1122436583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400b820 con 0x7f9cb4158cd0 2023-12-24T18:52:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb2ffd700 1 -- 172.21.15.50:0/1122436583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400b980 con 0x7f9cb4158cd0 2023-12-24T18:52:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.416+0000 7f9cb2ffd700 1 -- 172.21.15.50:0/1122436583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400bd20 con 0x7f9cb4158cd0 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/1122436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 msgr2=0x7f9cb41590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41590a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b1b40 tx=0x7f9ca4009250 comp rx=0 tx=0).stop 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/1122436583 shutdown_connections 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/1122436583 >> v2:172.21.15.82:3300/0 conn(0x7f9cb406c0c0 0x7f9cb40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406afb0 0x7f9cb406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/1122436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41590a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/1122436583 >> 172.21.15.50:0/1122436583 conn(0x7f9cb4067b80 msgr2=0x7f9cb40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/1122436583 shutdown_connections 2023-12-24T18:52:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/1122436583 wait complete. 2023-12-24T18:52:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.420+0000 7f9cb8bcc700 1 Processor -- start 2023-12-24T18:52:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 -- start start 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb406afb0 0x7f9cb40acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406c0c0 0x7f9cb40ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40adb70 con 0x7f9cb4158cd0 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40ade50 con 0x7f9cb406afb0 2023-12-24T18:52:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4156990 con 0x7f9cb406c0c0 2023-12-24T18:52:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43954/0 (socket says 172.21.15.50:43954) 2023-12-24T18:52:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 -- 172.21.15.50:0/3022744777 learned_addr learned my addr 172.21.15.50:0/3022744777 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb406afb0 0x7f9cb40acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9caaffd700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406c0c0 0x7f9cb40ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 -- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406c0c0 msgr2=0x7f9cb40ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406c0c0 0x7f9cb40ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 -- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb406afb0 msgr2=0x7f9cb40acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb406afb0 0x7f9cb40acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 -- 172.21.15.50:0/3022744777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca40094f0 con 0x7f9cb4158cd0 2023-12-24T18:52:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb3fff700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9cac007f20 tx=0x7f9cac009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00eb90 con 0x7f9cb4158cd0 2023-12-24T18:52:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00ed10 con 0x7f9cb4158cd0 2023-12-24T18:52:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4156c70 con 0x7f9cb4158cd0 2023-12-24T18:52:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.424+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac014670 con 0x7f9cb4158cd0 2023-12-24T18:52:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.428+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40ad700 con 0x7f9cb4158cd0 2023-12-24T18:52:43.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.428+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb41567d0 con 0x7f9cb4158cd0 2023-12-24T18:52:43.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.428+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9cac0149e0 con 0x7f9cb4158cd0 2023-12-24T18:52:43.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.432+0000 7f9cabfff700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 0x7f9c94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.432+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f9cac07d050 con 0x7f9cb4158cd0 2023-12-24T18:52:43.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.432+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 0x7f9c94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.432+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 0x7f9c94062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b1b40 tx=0x7f9ca4017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.436+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9cac04d380 con 0x7f9cb4158cd0 2023-12-24T18:52:43.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.612+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cb4156e00 con 0x7f9cb4158cd0 2023-12-24T18:52:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.616+0000 7f9cabfff700 1 -- 172.21.15.50:0/3022744777 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16093 (secure 0 0 0) 0x7f9cac0509a0 con 0x7f9cb4158cd0 2023-12-24T18:52:43.616 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:43.616 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:52:40.738021+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 msgr2=0x7f9c94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 0x7f9c94062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b1b40 tx=0x7f9ca4017000 comp rx=0 tx=0).stop 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 msgr2=0x7f9cb41691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9cac007f20 tx=0x7f9cac009860 comp rx=0 tx=0).stop 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 shutdown_connections 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9c94060550 0x7f9c94062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4158cd0 0x7f9cb41691e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb406c0c0 0x7f9cb40ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 --2- 172.21.15.50:0/3022744777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb406afb0 0x7f9cb40acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 >> 172.21.15.50:0/3022744777 conn(0x7f9cb4067b80 msgr2=0x7f9cb40aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 shutdown_connections 2023-12-24T18:52:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.620+0000 7f9cb8bcc700 1 -- 172.21.15.50:0/3022744777 wait complete. 2023-12-24T18:52:43.640 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:52:43.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 Processor -- start 2023-12-24T18:52:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 -- start start 2023-12-24T18:52:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 0x7f0a80159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a800ca110 0x7f0a800ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800caab0 con 0x7f0a8006bce0 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8006b850 con 0x7f0a800ca110 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a86ea5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8006ac40 con 0x7f0a80159bc0 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a85442700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a800ca110 0x7f0a800ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a85442700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a800ca110 0x7f0a800ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43956/0 (socket says 172.21.15.50:43956) 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a85442700 1 -- 172.21.15.50:0/1374411862 learned_addr learned my addr 172.21.15.50:0/1374411862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.804+0000 7f0a84c41700 1 --2- 172.21.15.50:0/1374411862 >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 0x7f0a80159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a777fe700 1 -- 172.21.15.50:0/1374411862 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716381396 0 0) 0x7f0a70001110 con 0x7f0a8006bce0 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a85442700 1 -- 172.21.15.50:0/1374411862 >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 msgr2=0x7f0a80159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a85442700 1 --2- 172.21.15.50:0/1374411862 >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 0x7f0a80159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a85442700 1 -- 172.21.15.50:0/1374411862 >> v1:172.21.15.50:6789/0 conn(0x7f0a8006bce0 legacy=0x7f0a800aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a85442700 1 -- 172.21.15.50:0/1374411862 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8006af20 con 0x7f0a800ca110 2023-12-24T18:52:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a84c41700 1 --2- 172.21.15.50:0/1374411862 >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 0x7f0a80159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a85442700 1 --2- 172.21.15.50:0/1374411862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800ca110 0x7f0a800ca570 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0a80069ce0 tx=0x7f0a78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffadd79fddc978 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a777fe700 1 -- 172.21.15.50:0/1374411862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78009e70 con 0x7f0a800ca110 2023-12-24T18:52:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a777fe700 1 -- 172.21.15.50:0/1374411862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800b860 con 0x7f0a800ca110 2023-12-24T18:52:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a777fe700 1 -- 172.21.15.50:0/1374411862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800bc00 con 0x7f0a800ca110 2023-12-24T18:52:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 -- 172.21.15.50:0/1374411862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800ca110 msgr2=0x7f0a800ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/1374411862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800ca110 0x7f0a800ca570 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0a80069ce0 tx=0x7f0a78009250 comp rx=0 tx=0).stop 2023-12-24T18:52:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 -- 172.21.15.50:0/1374411862 shutdown_connections 2023-12-24T18:52:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/1374411862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800ca110 0x7f0a800ca570 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/1374411862 >> v2:172.21.15.82:3300/0 conn(0x7f0a80159bc0 0x7f0a80159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 -- 172.21.15.50:0/1374411862 >> 172.21.15.50:0/1374411862 conn(0x7f0a800cbba0 msgr2=0x7f0a800cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 -- 172.21.15.50:0/1374411862 shutdown_connections 2023-12-24T18:52:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.808+0000 7f0a86ea5700 1 -- 172.21.15.50:0/1374411862 wait complete. 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 Processor -- start 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 -- start start 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a800ca110 0x7f0a801571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 0x7f0a8015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a80157ff0 con 0x7f0a80159bc0 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015aaa0 con 0x7f0a800ca110 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.812+0000 7f0a86ea5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800ae350 con 0x7f0a8006bce0 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a85442700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 0x7f0a8015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44528/0 (socket says 172.21.15.50:44528) 2023-12-24T18:52:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 -- 172.21.15.50:0/31648858 learned_addr learned my addr 172.21.15.50:0/31648858 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:43.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a77fff700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a800ca110 0x7f0a801571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 -- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a800ca110 msgr2=0x7f0a801571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a800ca110 0x7f0a801571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 -- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 msgr2=0x7f0a8015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 0x7f0a8015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 -- 172.21.15.50:0/31648858 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c009a20 con 0x7f0a8006bce0 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a85442700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 0x7f0a8015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a84c41700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c1a0 tx=0x7f0a7c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00cce0 con 0x7f0a8006bce0 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00f040 con 0x7f0a8006bce0 2023-12-24T18:52:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c014690 con 0x7f0a8006bce0 2023-12-24T18:52:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a780094f0 con 0x7f0a8006bce0 2023-12-24T18:52:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.816+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a80157d10 con 0x7f0a8006bce0 2023-12-24T18:52:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800652e0 con 0x7f0a8006bce0 2023-12-24T18:52:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0a7c014a00 con 0x7f0a8006bce0 2023-12-24T18:52:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a74ff9700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 0x7f0a6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f0a7c07d860 con 0x7f0a8006bce0 2023-12-24T18:52:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a77fff700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 0x7f0a6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.820+0000 7f0a77fff700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 0x7f0a6c062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a80149380 tx=0x7f0a70007ec0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:43.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:43.832+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0a7c04daf0 con 0x7f0a8006bce0 2023-12-24T18:52:44.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.004+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a8006b200 con 0x7f0a6c060550 2023-12-24T18:52:44.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.024+0000 7f0a74ff9700 1 -- 172.21.15.50:0/31648858 <== mgr.7128 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271943 (secure 0 0 0) 0x7f0a8006b200 con 0x7f0a6c060550 2023-12-24T18:52:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 msgr2=0x7f0a6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 0x7f0a6c062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a80149380 tx=0x7f0a70007ec0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 msgr2=0x7f0a800ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c1a0 tx=0x7f0a7c00b040 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 shutdown_connections 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0a6c060550 0x7f0a6c062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a80159bc0 0x7f0a8015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a800ca110 0x7f0a801571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 --2- 172.21.15.50:0/31648858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0a8006bce0 0x7f0a800ade10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 >> 172.21.15.50:0/31648858 conn(0x7f0a800cbba0 msgr2=0x7f0a800a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 shutdown_connections 2023-12-24T18:52:44.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.032+0000 7f0a86ea5700 1 -- 172.21.15.50:0/31648858 wait complete. 2023-12-24T18:52:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:44.054 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:52:42.271435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2451016,"kb_used_data":11272,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752523704,"statfs":{"total":773094113280,"available":770584272896,"internally_reserved":0,"allocated":11542528,"data_stored":6406280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550170"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:38.721462+0000","last_change":"2023-12-24T18:52:38.721462+0000","last_active":"2023-12-24T18:52:38.721462+0000","last_peered":"2023-12-24T18:52:38.721462+0000","last_clean":"2023-12-24T18:52:38.721462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:38.721462+0000","last_undegraded":"2023-12-24T18:52:38.721462+0000","last_fullsized":"2023-12-24T18:52:38.721462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:52:37.704632+0000","last_change":"2023-12-24T18:52:37.704632+0000","last_active":"2023-12-24T18:52:37.704632+0000","last_peered":"2023-12-24T18:52:37.704632+0000","last_clean":"2023-12-24T18:52:37.704632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:52:37.704632+0000","last_undegraded":"2023-12-24T18:52:37.704632+0000","last_fullsized":"2023-12-24T18:52:37.704632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":541,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-24T18:52:29.663806+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:52:29.663806+0000","last_peered":"2023-12-24T18:52:29.663806+0000","last_clean":"2023-12-24T18:52:29.663806+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:52:29.663806+0000","last_undegraded":"2023-12-24T18:52:29.663806+0000","last_fullsized":"2023-12-24T18:52:29.663806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311420,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060420,"statfs":{"total":96636764160,"available":96317870080,"internally_reserved":0,"allocated":1888256,"data_stored":1243561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.0609999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.302}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":1.46},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":1.3340000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.2470000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.218}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":1.1850000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.587}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306744,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065096,"statfs":{"total":96636764160,"available":96322658304,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6220000000000001,"5min":1.788,"15min":1.788},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.607}]},{"osd":1,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1279999999999999,"15min":1.1599999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6060000000000001,"5min":1.667,"15min":1.667},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.2050000000000001,"15min":1.1990000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.599,"5min":1.7390000000000001,"15min":1.748},"last":1.2669999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1499999999999999,"15min":1.1659999999999999},"min":{"1min":0.72899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4610000000000001,"5min":1.542,"15min":3.609},"last":1.552},{"interface":"front","average":{"1min":1.117,"5min":1.232,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.5640000000000001,"5min":1.794,"15min":2.0259999999999998},"last":1.343}]},{"osd":3,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2509999999999999,"15min":1.26},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.655,"5min":1.6659999999999999,"15min":1.867},"last":1.407},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":0.73799999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"max":{"1min":1.4330000000000001,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":1.2230000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1870000000000001,"15min":1.202},"min":{"1min":0.67300000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.5129999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.274,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.65200000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.0470000000000002},"last":1.502}]},{"osd":5,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.2,"15min":1.2290000000000001},"min":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":4.2779999999999996},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3320000000000001,"15min":1.351},"min":{"1min":0.85999999999999999,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":1.669,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3740000000000001,"15min":1.3919999999999999},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.73999999999999999},"max":{"1min":1.9950000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":0.97599999999999998,"5min":0.80800000000000005,"15min":0.58799999999999997},"max":{"1min":1.536,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":1.698}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":1.169},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":1.321}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0409999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":0.78700000000000003}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.86399999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":1.294}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.236},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.127}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.86899999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.92900000000000005}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":0.85299999999999998}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.016}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":0.95199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306744,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065096,"statfs":{"total":96636764160,"available":96322658304,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.131}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3859999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.0780000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":1.407},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":1.5029999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":1.8859999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.958},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":1.5369999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":1.631},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.5800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":310840,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061000,"statfs":{"total":96636764160,"available":96318464000,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":1.304}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":1.155}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":1.206},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":1.2669999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.758}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.605}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.405}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.669}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":653193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.4119999999999999,"5min":1.8149999999999999,"15min":4.149},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.103,"15min":1.135},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.58899999999999997},"max":{"1min":1.468,"5min":1.6419999999999999,"15min":4.0830000000000002},"last":1.2609999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.95499999999999996,"15min":0.95299999999999996},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.3879999999999999,"5min":1.494,"15min":3.7829999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1240000000000001,"15min":1.139},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5660000000000001,"5min":1.7410000000000001,"15min":4.2240000000000002},"last":1.2310000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.276,"15min":1.27},"min":{"1min":0.73899999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.823,"5min":1.915,"15min":4.1849999999999996},"last":1.127},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9410000000000001,"5min":2.3290000000000002,"15min":4.1200000000000001},"last":1.091}]},{"osd":4,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.274,"15min":1.2589999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.724,"5min":1.724,"15min":3.2629999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.048,"5min":2.3130000000000002,"15min":4.1020000000000003},"last":1.3440000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4039999999999999,"15min":1.403},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7250000000000001,"5min":1.9790000000000001,"15min":4.4009999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3660000000000001,"15min":1.3779999999999999},"min":{"1min":0.97799999999999998,"5min":0.96199999999999997,"15min":0.871},"max":{"1min":1.8140000000000001,"5min":1.8340000000000001,"15min":2.637},"last":1.151}]},{"osd":6,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5169999999999999,"15min":1.5129999999999999},"min":{"1min":1.0620000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.911,"5min":2.3860000000000001,"15min":4.0229999999999997},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.4770000000000001,"15min":1.486},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8879999999999999,"5min":2.1749999999999998,"15min":4.4480000000000004},"last":1.377}]},{"osd":7,"last update":"Sun Dec 24 18:51:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.526,"15min":1.5389999999999999},"min":{"1min":1.0549999999999999,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":2.0219999999999998,"5min":2.3540000000000001,"15min":4.3470000000000004},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.863,"5min":1.9710000000000001,"15min":2.798},"last":1.294}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":1888256,"data_stored":1243561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":1.101}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.2010000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.371}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.256},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.288}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.446},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.794}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.347},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.4870000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.724},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:44.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:52:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.268+0000 7f857e8f0700 1 Processor -- start 2023-12-24T18:52:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.268+0000 7f857e8f0700 1 -- start start 2023-12-24T18:52:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85780ca3a0 0x7f85780ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f857806ae10 0x7f857815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857806ca50 con 0x7f857806b290 2023-12-24T18:52:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780c6980 con 0x7f857806ae10 2023-12-24T18:52:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857806b7f0 con 0x7f85780ca3a0 2023-12-24T18:52:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f857806ae10 0x7f857815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857ce8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f857806b290 0x7f8578160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44064/0 (socket says 172.21.15.50:44064) 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857ce8d700 1 -- 172.21.15.50:0/712481041 learned_addr learned my addr 172.21.15.50:0/712481041 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8577fff700 1 --2- 172.21.15.50:0/712481041 >> v2:172.21.15.82:3300/0 conn(0x7f85780ca3a0 0x7f85780ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8576ffd700 1 -- 172.21.15.50:0/712481041 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684946932 0 0) 0x7f857806ca50 con 0x7f857806b290 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8576ffd700 1 -- 172.21.15.50:0/712481041 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003570 con 0x7f857806b290 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 -- 172.21.15.50:0/712481041 >> v2:172.21.15.82:3300/0 conn(0x7f85780ca3a0 msgr2=0x7f85780ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 --2- 172.21.15.50:0/712481041 >> v2:172.21.15.82:3300/0 conn(0x7f85780ca3a0 0x7f85780ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 -- 172.21.15.50:0/712481041 >> v1:172.21.15.50:6789/0 conn(0x7f857806b290 legacy=0x7f8578160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 -- 172.21.15.50:0/712481041 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857806bad0 con 0x7f857806ae10 2023-12-24T18:52:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f85777fe700 1 --2- 172.21.15.50:0/712481041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806ae10 0x7f857815aa50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8578069ce0 tx=0x7f856c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2bd815ea437bb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8576ffd700 1 -- 172.21.15.50:0/712481041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c011630 con 0x7f857806ae10 2023-12-24T18:52:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8576ffd700 1 -- 172.21.15.50:0/712481041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c011790 con 0x7f857806ae10 2023-12-24T18:52:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f8576ffd700 1 -- 172.21.15.50:0/712481041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c011b10 con 0x7f857806ae10 2023-12-24T18:52:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- 172.21.15.50:0/712481041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806ae10 msgr2=0x7f857815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 --2- 172.21.15.50:0/712481041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806ae10 0x7f857815aa50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8578069ce0 tx=0x7f856c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- 172.21.15.50:0/712481041 shutdown_connections 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 --2- 172.21.15.50:0/712481041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806ae10 0x7f857815aa50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 --2- 172.21.15.50:0/712481041 >> v2:172.21.15.82:3300/0 conn(0x7f85780ca3a0 0x7f85780ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.272+0000 7f857e8f0700 1 -- 172.21.15.50:0/712481041 >> 172.21.15.50:0/712481041 conn(0x7f85780cbba0 msgr2=0x7f85780cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.276+0000 7f857e8f0700 1 -- 172.21.15.50:0/712481041 shutdown_connections 2023-12-24T18:52:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.276+0000 7f857e8f0700 1 -- 172.21.15.50:0/712481041 wait complete. 2023-12-24T18:52:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.276+0000 7f857e8f0700 1 Processor -- start 2023-12-24T18:52:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.276+0000 7f857e8f0700 1 -- start start 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.276+0000 7f857e8f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 0x7f8578146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 0x7f857816d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780aeab0 con 0x7f857806b290 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780aed90 con 0x7f857806ae10 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781612e0 con 0x7f85780ca3a0 2023-12-24T18:52:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43986/0 (socket says 172.21.15.50:43986) 2023-12-24T18:52:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 -- 172.21.15.50:0/2691699872 learned_addr learned my addr 172.21.15.50:0/2691699872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f8577fff700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 0x7f8578146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857ce8d700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 0x7f857816d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 -- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 msgr2=0x7f857816d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 0x7f857816d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 -- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 msgr2=0x7f8578146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 0x7f8578146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 -- 172.21.15.50:0/2691699872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009420 con 0x7f857806b290 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f8577fff700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 0x7f8578146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857ce8d700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 0x7f857816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f85777fe700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f856c009f50 tx=0x7f856c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c011900 con 0x7f857806b290 2023-12-24T18:52:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c011a60 con 0x7f857806b290 2023-12-24T18:52:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8578161580 con 0x7f857806b290 2023-12-24T18:52:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c026680 con 0x7f857806b290 2023-12-24T18:52:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.280+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781472b0 con 0x7f857806b290 2023-12-24T18:52:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.284+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780652e0 con 0x7f857806b290 2023-12-24T18:52:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.284+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f856c023030 con 0x7f857806b290 2023-12-24T18:52:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.284+0000 7f855ffff700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 0x7f8564062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.284+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f856c07e290 con 0x7f857806b290 2023-12-24T18:52:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.284+0000 7f8577fff700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 0x7f8564062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.288+0000 7f8577fff700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 0x7f8564062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8568006fd0 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.292+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f856c04e5a0 con 0x7f857806b290 2023-12-24T18:52:44.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.464+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f857806bdb0 con 0x7f8564060550 2023-12-24T18:52:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.476+0000 7f855ffff700 1 -- 172.21.15.50:0/2691699872 <== mgr.7128 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287149 (secure 0 0 0) 0x7f857806bdb0 con 0x7f8564060550 2023-12-24T18:52:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 msgr2=0x7f8564062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 0x7f8564062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8568006fd0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 msgr2=0x7f857815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f856c009f50 tx=0x7f856c017000 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 shutdown_connections 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8564060550 0x7f8564062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85780ca3a0 0x7f857816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857806b290 0x7f857815ebb0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 --2- 172.21.15.50:0/2691699872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f857806ae10 0x7f8578146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 >> 172.21.15.50:0/2691699872 conn(0x7f85780cbba0 msgr2=0x7f85780c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 shutdown_connections 2023-12-24T18:52:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.484+0000 7f857e8f0700 1 -- 172.21.15.50:0/2691699872 wait complete. 2023-12-24T18:52:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:52:44.506 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:52:44.271995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451416,"kb_used_data":11672,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752523304,"statfs":{"total":773094113280,"available":770583863296,"internally_reserved":0,"allocated":11952128,"data_stored":6606180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001734"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.774357+0000","last_change":"2023-12-24T18:52:39.774357+0000","last_active":"2023-12-24T18:52:39.774357+0000","last_peered":"2023-12-24T18:52:39.774357+0000","last_clean":"2023-12-24T18:52:39.774357+0000","last_became_active":"2023-12-24T18:52:39.774058+0000","last_became_peered":"2023-12-24T18:52:39.774058+0000","last_unstale":"2023-12-24T18:52:39.774357+0000","last_undegraded":"2023-12-24T18:52:39.774357+0000","last_fullsized":"2023-12-24T18:52:39.774357+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:17:57.557662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.759791+0000","last_change":"2023-12-24T18:52:39.759791+0000","last_active":"2023-12-24T18:52:39.759791+0000","last_peered":"2023-12-24T18:52:39.759791+0000","last_clean":"2023-12-24T18:52:39.759791+0000","last_became_active":"2023-12-24T18:52:39.759479+0000","last_became_peered":"2023-12-24T18:52:39.759479+0000","last_unstale":"2023-12-24T18:52:39.759791+0000","last_undegraded":"2023-12-24T18:52:39.759791+0000","last_fullsized":"2023-12-24T18:52:39.759791+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:11.602957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.760731+0000","last_change":"2023-12-24T18:52:39.760731+0000","last_active":"2023-12-24T18:52:39.760731+0000","last_peered":"2023-12-24T18:52:39.760731+0000","last_clean":"2023-12-24T18:52:39.760731+0000","last_became_active":"2023-12-24T18:52:39.760384+0000","last_became_peered":"2023-12-24T18:52:39.760384+0000","last_unstale":"2023-12-24T18:52:39.760731+0000","last_undegraded":"2023-12-24T18:52:39.760731+0000","last_fullsized":"2023-12-24T18:52:39.760731+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:47.230077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790031+0000","last_change":"2023-12-24T18:52:39.790031+0000","last_active":"2023-12-24T18:52:39.790031+0000","last_peered":"2023-12-24T18:52:39.790031+0000","last_clean":"2023-12-24T18:52:39.790031+0000","last_became_active":"2023-12-24T18:52:39.788865+0000","last_became_peered":"2023-12-24T18:52:39.788865+0000","last_unstale":"2023-12-24T18:52:39.790031+0000","last_undegraded":"2023-12-24T18:52:39.790031+0000","last_fullsized":"2023-12-24T18:52:39.790031+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:33.380549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.757791+0000","last_change":"2023-12-24T18:52:39.754615+0000","last_active":"2023-12-24T18:52:39.757791+0000","last_peered":"2023-12-24T18:52:39.757791+0000","last_clean":"2023-12-24T18:52:39.757791+0000","last_became_active":"2023-12-24T18:52:39.754256+0000","last_became_peered":"2023-12-24T18:52:39.754256+0000","last_unstale":"2023-12-24T18:52:39.757791+0000","last_undegraded":"2023-12-24T18:52:39.757791+0000","last_fullsized":"2023-12-24T18:52:39.757791+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:32:09.630591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790831+0000","last_change":"2023-12-24T18:52:39.790831+0000","last_active":"2023-12-24T18:52:39.790831+0000","last_peered":"2023-12-24T18:52:39.790831+0000","last_clean":"2023-12-24T18:52:39.790831+0000","last_became_active":"2023-12-24T18:52:39.790537+0000","last_became_peered":"2023-12-24T18:52:39.790537+0000","last_unstale":"2023-12-24T18:52:39.790831+0000","last_undegraded":"2023-12-24T18:52:39.790831+0000","last_fullsized":"2023-12-24T18:52:39.790831+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:51:28.586575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789427+0000","last_change":"2023-12-24T18:52:39.785165+0000","last_active":"2023-12-24T18:52:39.789427+0000","last_peered":"2023-12-24T18:52:39.789427+0000","last_clean":"2023-12-24T18:52:39.789427+0000","last_became_active":"2023-12-24T18:52:39.784787+0000","last_became_peered":"2023-12-24T18:52:39.784787+0000","last_unstale":"2023-12-24T18:52:39.789427+0000","last_undegraded":"2023-12-24T18:52:39.789427+0000","last_fullsized":"2023-12-24T18:52:39.789427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:51.872751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789876+0000","last_change":"2023-12-24T18:52:39.789876+0000","last_active":"2023-12-24T18:52:39.789876+0000","last_peered":"2023-12-24T18:52:39.789876+0000","last_clean":"2023-12-24T18:52:39.789876+0000","last_became_active":"2023-12-24T18:52:39.789255+0000","last_became_peered":"2023-12-24T18:52:39.789255+0000","last_unstale":"2023-12-24T18:52:39.789876+0000","last_undegraded":"2023-12-24T18:52:39.789876+0000","last_fullsized":"2023-12-24T18:52:39.789876+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:47.421304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.766000+0000","last_change":"2023-12-24T18:52:39.760053+0000","last_active":"2023-12-24T18:52:39.766000+0000","last_peered":"2023-12-24T18:52:39.766000+0000","last_clean":"2023-12-24T18:52:39.766000+0000","last_became_active":"2023-12-24T18:52:39.759767+0000","last_became_peered":"2023-12-24T18:52:39.759767+0000","last_unstale":"2023-12-24T18:52:39.766000+0000","last_undegraded":"2023-12-24T18:52:39.766000+0000","last_fullsized":"2023-12-24T18:52:39.766000+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:36.254304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.792860+0000","last_change":"2023-12-24T18:52:39.786871+0000","last_active":"2023-12-24T18:52:39.792860+0000","last_peered":"2023-12-24T18:52:39.792860+0000","last_clean":"2023-12-24T18:52:39.792860+0000","last_became_active":"2023-12-24T18:52:39.786563+0000","last_became_peered":"2023-12-24T18:52:39.786563+0000","last_unstale":"2023-12-24T18:52:39.792860+0000","last_undegraded":"2023-12-24T18:52:39.792860+0000","last_fullsized":"2023-12-24T18:52:39.792860+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:53:32.005851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.778342+0000","last_change":"2023-12-24T18:52:39.776096+0000","last_active":"2023-12-24T18:52:39.778342+0000","last_peered":"2023-12-24T18:52:39.778342+0000","last_clean":"2023-12-24T18:52:39.778342+0000","last_became_active":"2023-12-24T18:52:39.775812+0000","last_became_peered":"2023-12-24T18:52:39.775812+0000","last_unstale":"2023-12-24T18:52:39.778342+0000","last_undegraded":"2023-12-24T18:52:39.778342+0000","last_fullsized":"2023-12-24T18:52:39.778342+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:02.407175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.760210+0000","last_change":"2023-12-24T18:52:39.757017+0000","last_active":"2023-12-24T18:52:39.760210+0000","last_peered":"2023-12-24T18:52:39.760210+0000","last_clean":"2023-12-24T18:52:39.760210+0000","last_became_active":"2023-12-24T18:52:39.756709+0000","last_became_peered":"2023-12-24T18:52:39.756709+0000","last_unstale":"2023-12-24T18:52:39.760210+0000","last_undegraded":"2023-12-24T18:52:39.760210+0000","last_fullsized":"2023-12-24T18:52:39.760210+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:56.823189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.784700+0000","last_change":"2023-12-24T18:52:39.784700+0000","last_active":"2023-12-24T18:52:39.784700+0000","last_peered":"2023-12-24T18:52:39.784700+0000","last_clean":"2023-12-24T18:52:39.784700+0000","last_became_active":"2023-12-24T18:52:39.784394+0000","last_became_peered":"2023-12-24T18:52:39.784394+0000","last_unstale":"2023-12-24T18:52:39.784700+0000","last_undegraded":"2023-12-24T18:52:39.784700+0000","last_fullsized":"2023-12-24T18:52:39.784700+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:52.987309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789460+0000","last_change":"2023-12-24T18:52:39.787556+0000","last_active":"2023-12-24T18:52:39.789460+0000","last_peered":"2023-12-24T18:52:39.789460+0000","last_clean":"2023-12-24T18:52:39.789460+0000","last_became_active":"2023-12-24T18:52:39.787168+0000","last_became_peered":"2023-12-24T18:52:39.787168+0000","last_unstale":"2023-12-24T18:52:39.789460+0000","last_undegraded":"2023-12-24T18:52:39.789460+0000","last_fullsized":"2023-12-24T18:52:39.789460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:58.229619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790039+0000","last_change":"2023-12-24T18:52:39.790039+0000","last_active":"2023-12-24T18:52:39.790039+0000","last_peered":"2023-12-24T18:52:39.790039+0000","last_clean":"2023-12-24T18:52:39.790039+0000","last_became_active":"2023-12-24T18:52:39.789714+0000","last_became_peered":"2023-12-24T18:52:39.789714+0000","last_unstale":"2023-12-24T18:52:39.790039+0000","last_undegraded":"2023-12-24T18:52:39.790039+0000","last_fullsized":"2023-12-24T18:52:39.790039+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:08.549406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.781398+0000","last_change":"2023-12-24T18:52:39.781398+0000","last_active":"2023-12-24T18:52:39.781398+0000","last_peered":"2023-12-24T18:52:39.781398+0000","last_clean":"2023-12-24T18:52:39.781398+0000","last_became_active":"2023-12-24T18:52:39.781123+0000","last_became_peered":"2023-12-24T18:52:39.781123+0000","last_unstale":"2023-12-24T18:52:39.781398+0000","last_undegraded":"2023-12-24T18:52:39.781398+0000","last_fullsized":"2023-12-24T18:52:39.781398+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:05.167839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789455+0000","last_change":"2023-12-24T18:52:39.789455+0000","last_active":"2023-12-24T18:52:39.789455+0000","last_peered":"2023-12-24T18:52:39.789455+0000","last_clean":"2023-12-24T18:52:39.789455+0000","last_became_active":"2023-12-24T18:52:39.789120+0000","last_became_peered":"2023-12-24T18:52:39.789120+0000","last_unstale":"2023-12-24T18:52:39.789455+0000","last_undegraded":"2023-12-24T18:52:39.789455+0000","last_fullsized":"2023-12-24T18:52:39.789455+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:17:07.375999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.768975+0000","last_change":"2023-12-24T18:52:39.768975+0000","last_active":"2023-12-24T18:52:39.768975+0000","last_peered":"2023-12-24T18:52:39.768975+0000","last_clean":"2023-12-24T18:52:39.768975+0000","last_became_active":"2023-12-24T18:52:39.768623+0000","last_became_peered":"2023-12-24T18:52:39.768623+0000","last_unstale":"2023-12-24T18:52:39.768975+0000","last_undegraded":"2023-12-24T18:52:39.768975+0000","last_fullsized":"2023-12-24T18:52:39.768975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:21:04.439762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.787654+0000","last_change":"2023-12-24T18:52:39.785094+0000","last_active":"2023-12-24T18:52:39.787654+0000","last_peered":"2023-12-24T18:52:39.787654+0000","last_clean":"2023-12-24T18:52:39.787654+0000","last_became_active":"2023-12-24T18:52:39.784762+0000","last_became_peered":"2023-12-24T18:52:39.784762+0000","last_unstale":"2023-12-24T18:52:39.787654+0000","last_undegraded":"2023-12-24T18:52:39.787654+0000","last_fullsized":"2023-12-24T18:52:39.787654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:04.366300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790269+0000","last_change":"2023-12-24T18:52:39.790269+0000","last_active":"2023-12-24T18:52:39.790269+0000","last_peered":"2023-12-24T18:52:39.790269+0000","last_clean":"2023-12-24T18:52:39.790269+0000","last_became_active":"2023-12-24T18:52:39.787521+0000","last_became_peered":"2023-12-24T18:52:39.787521+0000","last_unstale":"2023-12-24T18:52:39.790269+0000","last_undegraded":"2023-12-24T18:52:39.790269+0000","last_fullsized":"2023-12-24T18:52:39.790269+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:51.872751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.766386+0000","last_change":"2023-12-24T18:52:39.764708+0000","last_active":"2023-12-24T18:52:39.766386+0000","last_peered":"2023-12-24T18:52:39.766386+0000","last_clean":"2023-12-24T18:52:39.766386+0000","last_became_active":"2023-12-24T18:52:39.764403+0000","last_became_peered":"2023-12-24T18:52:39.764403+0000","last_unstale":"2023-12-24T18:52:39.766386+0000","last_undegraded":"2023-12-24T18:52:39.766386+0000","last_fullsized":"2023-12-24T18:52:39.766386+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.788259+0000","last_change":"2023-12-24T18:52:39.786046+0000","last_active":"2023-12-24T18:52:39.788259+0000","last_peered":"2023-12-24T18:52:39.788259+0000","last_clean":"2023-12-24T18:52:39.788259+0000","last_became_active":"2023-12-24T18:52:39.785692+0000","last_became_peered":"2023-12-24T18:52:39.785692+0000","last_unstale":"2023-12-24T18:52:39.788259+0000","last_undegraded":"2023-12-24T18:52:39.788259+0000","last_fullsized":"2023-12-24T18:52:39.788259+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:48.582045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789166+0000","last_change":"2023-12-24T18:52:39.787729+0000","last_active":"2023-12-24T18:52:39.789166+0000","last_peered":"2023-12-24T18:52:39.789166+0000","last_clean":"2023-12-24T18:52:39.789166+0000","last_became_active":"2023-12-24T18:52:39.785224+0000","last_became_peered":"2023-12-24T18:52:39.785224+0000","last_unstale":"2023-12-24T18:52:39.789166+0000","last_undegraded":"2023-12-24T18:52:39.789166+0000","last_fullsized":"2023-12-24T18:52:39.789166+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:23:41.263307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.762032+0000","last_change":"2023-12-24T18:52:39.762032+0000","last_active":"2023-12-24T18:52:39.762032+0000","last_peered":"2023-12-24T18:52:39.762032+0000","last_clean":"2023-12-24T18:52:39.762032+0000","last_became_active":"2023-12-24T18:52:39.760427+0000","last_became_peered":"2023-12-24T18:52:39.760427+0000","last_unstale":"2023-12-24T18:52:39.762032+0000","last_undegraded":"2023-12-24T18:52:39.762032+0000","last_fullsized":"2023-12-24T18:52:39.762032+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:28.905394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.759129+0000","last_change":"2023-12-24T18:52:39.759129+0000","last_active":"2023-12-24T18:52:39.759129+0000","last_peered":"2023-12-24T18:52:39.759129+0000","last_clean":"2023-12-24T18:52:39.759129+0000","last_became_active":"2023-12-24T18:52:39.758324+0000","last_became_peered":"2023-12-24T18:52:39.758324+0000","last_unstale":"2023-12-24T18:52:39.759129+0000","last_undegraded":"2023-12-24T18:52:39.759129+0000","last_fullsized":"2023-12-24T18:52:39.759129+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:58.229619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.778350+0000","last_change":"2023-12-24T18:52:39.776647+0000","last_active":"2023-12-24T18:52:39.778350+0000","last_peered":"2023-12-24T18:52:39.778350+0000","last_clean":"2023-12-24T18:52:39.778350+0000","last_became_active":"2023-12-24T18:52:39.776324+0000","last_became_peered":"2023-12-24T18:52:39.776324+0000","last_unstale":"2023-12-24T18:52:39.778350+0000","last_undegraded":"2023-12-24T18:52:39.778350+0000","last_fullsized":"2023-12-24T18:52:39.778350+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:11.602957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.762889+0000","last_change":"2023-12-24T18:52:39.757424+0000","last_active":"2023-12-24T18:52:39.762889+0000","last_peered":"2023-12-24T18:52:39.762889+0000","last_clean":"2023-12-24T18:52:39.762889+0000","last_became_active":"2023-12-24T18:52:39.757150+0000","last_became_peered":"2023-12-24T18:52:39.757150+0000","last_unstale":"2023-12-24T18:52:39.762889+0000","last_undegraded":"2023-12-24T18:52:39.762889+0000","last_fullsized":"2023-12-24T18:52:39.762889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:47:45.623030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.789273+0000","last_change":"2023-12-24T18:52:39.789273+0000","last_active":"2023-12-24T18:52:39.789273+0000","last_peered":"2023-12-24T18:52:39.789273+0000","last_clean":"2023-12-24T18:52:39.789273+0000","last_became_active":"2023-12-24T18:52:39.784924+0000","last_became_peered":"2023-12-24T18:52:39.784924+0000","last_unstale":"2023-12-24T18:52:39.789273+0000","last_undegraded":"2023-12-24T18:52:39.789273+0000","last_fullsized":"2023-12-24T18:52:39.789273+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:11:01.655499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773372+0000","last_change":"2023-12-24T18:52:39.767956+0000","last_active":"2023-12-24T18:52:39.773372+0000","last_peered":"2023-12-24T18:52:39.773372+0000","last_clean":"2023-12-24T18:52:39.773372+0000","last_became_active":"2023-12-24T18:52:39.767691+0000","last_became_peered":"2023-12-24T18:52:39.767691+0000","last_unstale":"2023-12-24T18:52:39.773372+0000","last_undegraded":"2023-12-24T18:52:39.773372+0000","last_fullsized":"2023-12-24T18:52:39.773372+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:30:38.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.766168+0000","last_change":"2023-12-24T18:52:39.760594+0000","last_active":"2023-12-24T18:52:39.766168+0000","last_peered":"2023-12-24T18:52:39.766168+0000","last_clean":"2023-12-24T18:52:39.766168+0000","last_became_active":"2023-12-24T18:52:39.759169+0000","last_became_peered":"2023-12-24T18:52:39.759169+0000","last_unstale":"2023-12-24T18:52:39.766168+0000","last_undegraded":"2023-12-24T18:52:39.766168+0000","last_fullsized":"2023-12-24T18:52:39.766168+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:46.443736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.785933+0000","last_change":"2023-12-24T18:52:39.785933+0000","last_active":"2023-12-24T18:52:39.785933+0000","last_peered":"2023-12-24T18:52:39.785933+0000","last_clean":"2023-12-24T18:52:39.785933+0000","last_became_active":"2023-12-24T18:52:39.785562+0000","last_became_peered":"2023-12-24T18:52:39.785562+0000","last_unstale":"2023-12-24T18:52:39.785933+0000","last_undegraded":"2023-12-24T18:52:39.785933+0000","last_fullsized":"2023-12-24T18:52:39.785933+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:48.582045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.778858+0000","last_change":"2023-12-24T18:52:39.778858+0000","last_active":"2023-12-24T18:52:39.778858+0000","last_peered":"2023-12-24T18:52:39.778858+0000","last_clean":"2023-12-24T18:52:39.778858+0000","last_became_active":"2023-12-24T18:52:39.778485+0000","last_became_peered":"2023-12-24T18:52:39.778485+0000","last_unstale":"2023-12-24T18:52:39.778858+0000","last_undegraded":"2023-12-24T18:52:39.778858+0000","last_fullsized":"2023-12-24T18:52:39.778858+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:20:01.457947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.770938+0000","last_change":"2023-12-24T18:52:39.770938+0000","last_active":"2023-12-24T18:52:39.770938+0000","last_peered":"2023-12-24T18:52:39.770938+0000","last_clean":"2023-12-24T18:52:39.770938+0000","last_became_active":"2023-12-24T18:52:39.770488+0000","last_became_peered":"2023-12-24T18:52:39.770488+0000","last_unstale":"2023-12-24T18:52:39.770938+0000","last_undegraded":"2023-12-24T18:52:39.770938+0000","last_fullsized":"2023-12-24T18:52:39.770938+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:31:07.287985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.782596+0000","last_change":"2023-12-24T18:52:38.763490+0000","last_active":"2023-12-24T18:52:39.782596+0000","last_peered":"2023-12-24T18:52:39.782596+0000","last_clean":"2023-12-24T18:52:39.782596+0000","last_became_active":"2023-12-24T18:52:38.763194+0000","last_became_peered":"2023-12-24T18:52:38.763194+0000","last_unstale":"2023-12-24T18:52:39.782596+0000","last_undegraded":"2023-12-24T18:52:39.782596+0000","last_fullsized":"2023-12-24T18:52:39.782596+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:50.831958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.775582+0000","last_change":"2023-12-24T18:52:39.775582+0000","last_active":"2023-12-24T18:52:39.775582+0000","last_peered":"2023-12-24T18:52:39.775582+0000","last_clean":"2023-12-24T18:52:39.775582+0000","last_became_active":"2023-12-24T18:52:39.775247+0000","last_became_peered":"2023-12-24T18:52:39.775247+0000","last_unstale":"2023-12-24T18:52:39.775582+0000","last_undegraded":"2023-12-24T18:52:39.775582+0000","last_fullsized":"2023-12-24T18:52:39.775582+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:34:43.690306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773176+0000","last_change":"2023-12-24T18:52:38.748382+0000","last_active":"2023-12-24T18:52:39.773176+0000","last_peered":"2023-12-24T18:52:39.773176+0000","last_clean":"2023-12-24T18:52:39.773176+0000","last_became_active":"2023-12-24T18:52:38.747994+0000","last_became_peered":"2023-12-24T18:52:38.747994+0000","last_unstale":"2023-12-24T18:52:39.773176+0000","last_undegraded":"2023-12-24T18:52:39.773176+0000","last_fullsized":"2023-12-24T18:52:39.773176+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:53.668050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.792712+0000","last_change":"2023-12-24T18:52:39.788559+0000","last_active":"2023-12-24T18:52:39.792712+0000","last_peered":"2023-12-24T18:52:39.792712+0000","last_clean":"2023-12-24T18:52:39.792712+0000","last_became_active":"2023-12-24T18:52:39.788211+0000","last_became_peered":"2023-12-24T18:52:39.788211+0000","last_unstale":"2023-12-24T18:52:39.792712+0000","last_undegraded":"2023-12-24T18:52:39.792712+0000","last_fullsized":"2023-12-24T18:52:39.792712+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:04.366300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.778066+0000","last_change":"2023-12-24T18:52:38.762472+0000","last_active":"2023-12-24T18:52:39.778066+0000","last_peered":"2023-12-24T18:52:39.778066+0000","last_clean":"2023-12-24T18:52:39.778066+0000","last_became_active":"2023-12-24T18:52:38.762172+0000","last_became_peered":"2023-12-24T18:52:38.762172+0000","last_unstale":"2023-12-24T18:52:39.778066+0000","last_undegraded":"2023-12-24T18:52:39.778066+0000","last_fullsized":"2023-12-24T18:52:39.778066+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:48.032216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.771805+0000","last_change":"2023-12-24T18:52:39.771805+0000","last_active":"2023-12-24T18:52:39.771805+0000","last_peered":"2023-12-24T18:52:39.771805+0000","last_clean":"2023-12-24T18:52:39.771805+0000","last_became_active":"2023-12-24T18:52:39.771492+0000","last_became_peered":"2023-12-24T18:52:39.771492+0000","last_unstale":"2023-12-24T18:52:39.771805+0000","last_undegraded":"2023-12-24T18:52:39.771805+0000","last_fullsized":"2023-12-24T18:52:39.771805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:47.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790542+0000","last_change":"2023-12-24T18:52:38.765908+0000","last_active":"2023-12-24T18:52:39.790542+0000","last_peered":"2023-12-24T18:52:39.790542+0000","last_clean":"2023-12-24T18:52:39.790542+0000","last_became_active":"2023-12-24T18:52:38.765573+0000","last_became_peered":"2023-12-24T18:52:38.765573+0000","last_unstale":"2023-12-24T18:52:39.790542+0000","last_undegraded":"2023-12-24T18:52:39.790542+0000","last_fullsized":"2023-12-24T18:52:39.790542+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:23.470457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790729+0000","last_change":"2023-12-24T18:52:39.790729+0000","last_active":"2023-12-24T18:52:39.790729+0000","last_peered":"2023-12-24T18:52:39.790729+0000","last_clean":"2023-12-24T18:52:39.790729+0000","last_became_active":"2023-12-24T18:52:39.789170+0000","last_became_peered":"2023-12-24T18:52:39.789170+0000","last_unstale":"2023-12-24T18:52:39.790729+0000","last_undegraded":"2023-12-24T18:52:39.790729+0000","last_fullsized":"2023-12-24T18:52:39.790729+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:30:38.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773071+0000","last_change":"2023-12-24T18:52:38.749466+0000","last_active":"2023-12-24T18:52:39.773071+0000","last_peered":"2023-12-24T18:52:39.773071+0000","last_clean":"2023-12-24T18:52:39.773071+0000","last_became_active":"2023-12-24T18:52:38.749172+0000","last_became_peered":"2023-12-24T18:52:38.749172+0000","last_unstale":"2023-12-24T18:52:39.773071+0000","last_undegraded":"2023-12-24T18:52:39.773071+0000","last_fullsized":"2023-12-24T18:52:39.773071+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:23:40.246476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.766305+0000","last_change":"2023-12-24T18:52:39.763943+0000","last_active":"2023-12-24T18:52:39.766305+0000","last_peered":"2023-12-24T18:52:39.766305+0000","last_clean":"2023-12-24T18:52:39.766305+0000","last_became_active":"2023-12-24T18:52:39.763618+0000","last_became_peered":"2023-12-24T18:52:39.763618+0000","last_unstale":"2023-12-24T18:52:39.766305+0000","last_undegraded":"2023-12-24T18:52:39.766305+0000","last_fullsized":"2023-12-24T18:52:39.766305+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:54.684881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"108'1","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.767201+0000","last_change":"2023-12-24T18:52:38.765843+0000","last_active":"2023-12-24T18:52:39.767201+0000","last_peered":"2023-12-24T18:52:39.767201+0000","last_clean":"2023-12-24T18:52:39.767201+0000","last_became_active":"2023-12-24T18:52:38.765527+0000","last_became_peered":"2023-12-24T18:52:38.765527+0000","last_unstale":"2023-12-24T18:52:39.767201+0000","last_undegraded":"2023-12-24T18:52:39.767201+0000","last_fullsized":"2023-12-24T18:52:39.767201+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:15.729336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.791459+0000","last_change":"2023-12-24T18:52:39.791459+0000","last_active":"2023-12-24T18:52:39.791459+0000","last_peered":"2023-12-24T18:52:39.791459+0000","last_clean":"2023-12-24T18:52:39.791459+0000","last_became_active":"2023-12-24T18:52:39.791193+0000","last_became_peered":"2023-12-24T18:52:39.791193+0000","last_unstale":"2023-12-24T18:52:39.791459+0000","last_undegraded":"2023-12-24T18:52:39.791459+0000","last_fullsized":"2023-12-24T18:52:39.791459+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:53:34.460114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.767929+0000","last_change":"2023-12-24T18:52:38.757965+0000","last_active":"2023-12-24T18:52:38.767929+0000","last_peered":"2023-12-24T18:52:38.767929+0000","last_clean":"2023-12-24T18:52:38.767929+0000","last_became_active":"2023-12-24T18:52:38.757651+0000","last_became_peered":"2023-12-24T18:52:38.757651+0000","last_unstale":"2023-12-24T18:52:38.767929+0000","last_undegraded":"2023-12-24T18:52:38.767929+0000","last_fullsized":"2023-12-24T18:52:38.767929+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:34.341732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.771424+0000","last_change":"2023-12-24T18:52:39.771424+0000","last_active":"2023-12-24T18:52:39.771424+0000","last_peered":"2023-12-24T18:52:39.771424+0000","last_clean":"2023-12-24T18:52:39.771424+0000","last_became_active":"2023-12-24T18:52:39.771132+0000","last_became_peered":"2023-12-24T18:52:39.771132+0000","last_unstale":"2023-12-24T18:52:39.771424+0000","last_undegraded":"2023-12-24T18:52:39.771424+0000","last_fullsized":"2023-12-24T18:52:39.771424+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:58.996409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.756273+0000","last_change":"2023-12-24T18:52:38.762129+0000","last_active":"2023-12-24T18:52:39.756273+0000","last_peered":"2023-12-24T18:52:39.756273+0000","last_clean":"2023-12-24T18:52:39.756273+0000","last_became_active":"2023-12-24T18:52:38.761827+0000","last_became_peered":"2023-12-24T18:52:38.761827+0000","last_unstale":"2023-12-24T18:52:39.756273+0000","last_undegraded":"2023-12-24T18:52:39.756273+0000","last_fullsized":"2023-12-24T18:52:39.756273+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:34:07.979650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.761063+0000","last_change":"2023-12-24T18:52:39.754806+0000","last_active":"2023-12-24T18:52:39.761063+0000","last_peered":"2023-12-24T18:52:39.761063+0000","last_clean":"2023-12-24T18:52:39.761063+0000","last_became_active":"2023-12-24T18:52:39.754383+0000","last_became_peered":"2023-12-24T18:52:39.754383+0000","last_unstale":"2023-12-24T18:52:39.761063+0000","last_undegraded":"2023-12-24T18:52:39.761063+0000","last_fullsized":"2023-12-24T18:52:39.761063+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:43.806966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.761365+0000","last_change":"2023-12-24T18:52:38.759990+0000","last_active":"2023-12-24T18:52:38.761365+0000","last_peered":"2023-12-24T18:52:38.761365+0000","last_clean":"2023-12-24T18:52:38.761365+0000","last_became_active":"2023-12-24T18:52:38.759674+0000","last_became_peered":"2023-12-24T18:52:38.759674+0000","last_unstale":"2023-12-24T18:52:38.761365+0000","last_undegraded":"2023-12-24T18:52:38.761365+0000","last_fullsized":"2023-12-24T18:52:38.761365+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:32.363719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773490+0000","last_change":"2023-12-24T18:52:39.768004+0000","last_active":"2023-12-24T18:52:39.773490+0000","last_peered":"2023-12-24T18:52:39.773490+0000","last_clean":"2023-12-24T18:52:39.773490+0000","last_became_active":"2023-12-24T18:52:39.767141+0000","last_became_peered":"2023-12-24T18:52:39.767141+0000","last_unstale":"2023-12-24T18:52:39.773490+0000","last_undegraded":"2023-12-24T18:52:39.773490+0000","last_fullsized":"2023-12-24T18:52:39.773490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.768682+0000","last_change":"2023-12-24T18:52:38.765090+0000","last_active":"2023-12-24T18:52:38.768682+0000","last_peered":"2023-12-24T18:52:38.768682+0000","last_clean":"2023-12-24T18:52:38.768682+0000","last_became_active":"2023-12-24T18:52:38.764654+0000","last_became_peered":"2023-12-24T18:52:38.764654+0000","last_unstale":"2023-12-24T18:52:38.768682+0000","last_undegraded":"2023-12-24T18:52:38.768682+0000","last_fullsized":"2023-12-24T18:52:38.768682+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:01.390344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773333+0000","last_change":"2023-12-24T18:52:39.773333+0000","last_active":"2023-12-24T18:52:39.773333+0000","last_peered":"2023-12-24T18:52:39.773333+0000","last_clean":"2023-12-24T18:52:39.773333+0000","last_became_active":"2023-12-24T18:52:39.773031+0000","last_became_peered":"2023-12-24T18:52:39.773031+0000","last_unstale":"2023-12-24T18:52:39.773333+0000","last_undegraded":"2023-12-24T18:52:39.773333+0000","last_fullsized":"2023-12-24T18:52:39.773333+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:23.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.779938+0000","last_change":"2023-12-24T18:52:38.762961+0000","last_active":"2023-12-24T18:52:39.779938+0000","last_peered":"2023-12-24T18:52:39.779938+0000","last_clean":"2023-12-24T18:52:39.779938+0000","last_became_active":"2023-12-24T18:52:38.762691+0000","last_became_peered":"2023-12-24T18:52:38.762691+0000","last_unstale":"2023-12-24T18:52:39.779938+0000","last_undegraded":"2023-12-24T18:52:39.779938+0000","last_fullsized":"2023-12-24T18:52:39.779938+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:59.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.784924+0000","last_change":"2023-12-24T18:52:39.784924+0000","last_active":"2023-12-24T18:52:39.784924+0000","last_peered":"2023-12-24T18:52:39.784924+0000","last_clean":"2023-12-24T18:52:39.784924+0000","last_became_active":"2023-12-24T18:52:39.784617+0000","last_became_peered":"2023-12-24T18:52:39.784617+0000","last_unstale":"2023-12-24T18:52:39.784924+0000","last_undegraded":"2023-12-24T18:52:39.784924+0000","last_fullsized":"2023-12-24T18:52:39.784924+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:43.806966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"108'6","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.785055+0000","last_change":"2023-12-24T18:52:38.763130+0000","last_active":"2023-12-24T18:52:39.785055+0000","last_peered":"2023-12-24T18:52:39.785055+0000","last_clean":"2023-12-24T18:52:39.785055+0000","last_became_active":"2023-12-24T18:52:38.762864+0000","last_became_peered":"2023-12-24T18:52:38.762864+0000","last_unstale":"2023-12-24T18:52:39.785055+0000","last_undegraded":"2023-12-24T18:52:39.785055+0000","last_fullsized":"2023-12-24T18:52:39.785055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:34.341732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.790062+0000","last_change":"2023-12-24T18:52:39.790062+0000","last_active":"2023-12-24T18:52:39.790062+0000","last_peered":"2023-12-24T18:52:39.790062+0000","last_clean":"2023-12-24T18:52:39.790062+0000","last_became_active":"2023-12-24T18:52:39.789519+0000","last_became_peered":"2023-12-24T18:52:39.789519+0000","last_unstale":"2023-12-24T18:52:39.790062+0000","last_undegraded":"2023-12-24T18:52:39.790062+0000","last_fullsized":"2023-12-24T18:52:39.790062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:49.049047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.780068+0000","last_change":"2023-12-24T18:52:38.762340+0000","last_active":"2023-12-24T18:52:39.780068+0000","last_peered":"2023-12-24T18:52:39.780068+0000","last_clean":"2023-12-24T18:52:39.780068+0000","last_became_active":"2023-12-24T18:52:38.761986+0000","last_became_peered":"2023-12-24T18:52:38.761986+0000","last_unstale":"2023-12-24T18:52:39.780068+0000","last_undegraded":"2023-12-24T18:52:39.780068+0000","last_fullsized":"2023-12-24T18:52:39.780068+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:40.976371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.757817+0000","last_change":"2023-12-24T18:52:39.755162+0000","last_active":"2023-12-24T18:52:39.757817+0000","last_peered":"2023-12-24T18:52:39.757817+0000","last_clean":"2023-12-24T18:52:39.757817+0000","last_became_active":"2023-12-24T18:52:39.754816+0000","last_became_peered":"2023-12-24T18:52:39.754816+0000","last_unstale":"2023-12-24T18:52:39.757817+0000","last_undegraded":"2023-12-24T18:52:39.757817+0000","last_fullsized":"2023-12-24T18:52:39.757817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:51.872751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.769829+0000","last_change":"2023-12-24T18:52:38.765051+0000","last_active":"2023-12-24T18:52:38.769829+0000","last_peered":"2023-12-24T18:52:38.769829+0000","last_clean":"2023-12-24T18:52:38.769829+0000","last_became_active":"2023-12-24T18:52:38.764772+0000","last_became_peered":"2023-12-24T18:52:38.764772+0000","last_unstale":"2023-12-24T18:52:38.769829+0000","last_undegraded":"2023-12-24T18:52:38.769829+0000","last_fullsized":"2023-12-24T18:52:38.769829+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:27.266176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.795311+0000","last_change":"2023-12-24T18:52:39.789509+0000","last_active":"2023-12-24T18:52:39.795311+0000","last_peered":"2023-12-24T18:52:39.795311+0000","last_clean":"2023-12-24T18:52:39.795311+0000","last_became_active":"2023-12-24T18:52:39.789206+0000","last_became_peered":"2023-12-24T18:52:39.789206+0000","last_unstale":"2023-12-24T18:52:39.795311+0000","last_undegraded":"2023-12-24T18:52:39.795311+0000","last_fullsized":"2023-12-24T18:52:39.795311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:01.011678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.770573+0000","last_change":"2023-12-24T18:52:38.767949+0000","last_active":"2023-12-24T18:52:38.770573+0000","last_peered":"2023-12-24T18:52:38.770573+0000","last_clean":"2023-12-24T18:52:38.770573+0000","last_became_active":"2023-12-24T18:52:38.763066+0000","last_became_peered":"2023-12-24T18:52:38.763066+0000","last_unstale":"2023-12-24T18:52:38.770573+0000","last_undegraded":"2023-12-24T18:52:38.770573+0000","last_fullsized":"2023-12-24T18:52:38.770573+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:35.566343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.754803+0000","last_change":"2023-12-24T18:52:39.751631+0000","last_active":"2023-12-24T18:52:39.754803+0000","last_peered":"2023-12-24T18:52:39.754803+0000","last_clean":"2023-12-24T18:52:39.754803+0000","last_became_active":"2023-12-24T18:52:39.751211+0000","last_became_peered":"2023-12-24T18:52:39.751211+0000","last_unstale":"2023-12-24T18:52:39.754803+0000","last_undegraded":"2023-12-24T18:52:39.754803+0000","last_fullsized":"2023-12-24T18:52:39.754803+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:27.125102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"108'8","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.793832+0000","last_change":"2023-12-24T18:52:38.763541+0000","last_active":"2023-12-24T18:52:39.793832+0000","last_peered":"2023-12-24T18:52:39.793832+0000","last_clean":"2023-12-24T18:52:39.793832+0000","last_became_active":"2023-12-24T18:52:38.763192+0000","last_became_peered":"2023-12-24T18:52:38.763192+0000","last_unstale":"2023-12-24T18:52:39.793832+0000","last_undegraded":"2023-12-24T18:52:39.793832+0000","last_fullsized":"2023-12-24T18:52:39.793832+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:51.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.770751+0000","last_change":"2023-12-24T18:52:39.770751+0000","last_active":"2023-12-24T18:52:39.770751+0000","last_peered":"2023-12-24T18:52:39.770751+0000","last_clean":"2023-12-24T18:52:39.770751+0000","last_became_active":"2023-12-24T18:52:39.770119+0000","last_became_peered":"2023-12-24T18:52:39.770119+0000","last_unstale":"2023-12-24T18:52:39.770751+0000","last_undegraded":"2023-12-24T18:52:39.770751+0000","last_fullsized":"2023-12-24T18:52:39.770751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:35.968032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.778237+0000","last_change":"2023-12-24T18:52:38.755485+0000","last_active":"2023-12-24T18:52:39.778237+0000","last_peered":"2023-12-24T18:52:39.778237+0000","last_clean":"2023-12-24T18:52:39.778237+0000","last_became_active":"2023-12-24T18:52:38.755124+0000","last_became_peered":"2023-12-24T18:52:38.755124+0000","last_unstale":"2023-12-24T18:52:39.778237+0000","last_undegraded":"2023-12-24T18:52:39.778237+0000","last_fullsized":"2023-12-24T18:52:39.778237+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:59.913938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.763241+0000","last_change":"2023-12-24T18:52:39.760057+0000","last_active":"2023-12-24T18:52:39.763241+0000","last_peered":"2023-12-24T18:52:39.763241+0000","last_clean":"2023-12-24T18:52:39.763241+0000","last_became_active":"2023-12-24T18:52:39.759769+0000","last_became_peered":"2023-12-24T18:52:39.759769+0000","last_unstale":"2023-12-24T18:52:39.763241+0000","last_undegraded":"2023-12-24T18:52:39.763241+0000","last_fullsized":"2023-12-24T18:52:39.763241+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:52:47.969269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.777737+0000","last_change":"2023-12-24T18:52:38.760978+0000","last_active":"2023-12-24T18:52:39.777737+0000","last_peered":"2023-12-24T18:52:39.777737+0000","last_clean":"2023-12-24T18:52:39.777737+0000","last_became_active":"2023-12-24T18:52:38.760143+0000","last_became_peered":"2023-12-24T18:52:38.760143+0000","last_unstale":"2023-12-24T18:52:39.777737+0000","last_undegraded":"2023-12-24T18:52:39.777737+0000","last_fullsized":"2023-12-24T18:52:39.777737+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:32.363719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.756778+0000","last_change":"2023-12-24T18:52:39.750415+0000","last_active":"2023-12-24T18:52:39.756778+0000","last_peered":"2023-12-24T18:52:39.756778+0000","last_clean":"2023-12-24T18:52:39.756778+0000","last_became_active":"2023-12-24T18:52:39.750093+0000","last_became_peered":"2023-12-24T18:52:39.750093+0000","last_unstale":"2023-12-24T18:52:39.756778+0000","last_undegraded":"2023-12-24T18:52:39.756778+0000","last_fullsized":"2023-12-24T18:52:39.756778+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:25.741162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.785305+0000","last_change":"2023-12-24T18:52:38.751491+0000","last_active":"2023-12-24T18:52:39.785305+0000","last_peered":"2023-12-24T18:52:39.785305+0000","last_clean":"2023-12-24T18:52:39.785305+0000","last_became_active":"2023-12-24T18:52:38.751207+0000","last_became_peered":"2023-12-24T18:52:38.751207+0000","last_unstale":"2023-12-24T18:52:39.785305+0000","last_undegraded":"2023-12-24T18:52:39.785305+0000","last_fullsized":"2023-12-24T18:52:39.785305+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:36.808890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.795391+0000","last_change":"2023-12-24T18:52:39.795391+0000","last_active":"2023-12-24T18:52:39.795391+0000","last_peered":"2023-12-24T18:52:39.795391+0000","last_clean":"2023-12-24T18:52:39.795391+0000","last_became_active":"2023-12-24T18:52:39.795094+0000","last_became_peered":"2023-12-24T18:52:39.795094+0000","last_unstale":"2023-12-24T18:52:39.795391+0000","last_undegraded":"2023-12-24T18:52:39.795391+0000","last_fullsized":"2023-12-24T18:52:39.795391+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:56:55.705100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"108'2","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.792991+0000","last_change":"2023-12-24T18:52:38.767326+0000","last_active":"2023-12-24T18:52:39.792991+0000","last_peered":"2023-12-24T18:52:39.792991+0000","last_clean":"2023-12-24T18:52:39.792991+0000","last_became_active":"2023-12-24T18:52:38.767060+0000","last_became_peered":"2023-12-24T18:52:38.767060+0000","last_unstale":"2023-12-24T18:52:39.792991+0000","last_undegraded":"2023-12-24T18:52:39.792991+0000","last_fullsized":"2023-12-24T18:52:39.792991+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:48.032216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.759670+0000","last_change":"2023-12-24T18:52:39.759670+0000","last_active":"2023-12-24T18:52:39.759670+0000","last_peered":"2023-12-24T18:52:39.759670+0000","last_clean":"2023-12-24T18:52:39.759670+0000","last_became_active":"2023-12-24T18:52:39.759377+0000","last_became_peered":"2023-12-24T18:52:39.759377+0000","last_unstale":"2023-12-24T18:52:39.759670+0000","last_undegraded":"2023-12-24T18:52:39.759670+0000","last_fullsized":"2023-12-24T18:52:39.759670+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.743473+0000","last_change":"2023-12-24T18:52:38.769487+0000","last_active":"2023-12-24T18:52:39.743473+0000","last_peered":"2023-12-24T18:52:39.743473+0000","last_clean":"2023-12-24T18:52:39.743473+0000","last_became_active":"2023-12-24T18:52:38.769193+0000","last_became_peered":"2023-12-24T18:52:38.769193+0000","last_unstale":"2023-12-24T18:52:39.743473+0000","last_undegraded":"2023-12-24T18:52:39.743473+0000","last_fullsized":"2023-12-24T18:52:39.743473+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:54.950758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.786914+0000","last_change":"2023-12-24T18:52:39.786914+0000","last_active":"2023-12-24T18:52:39.786914+0000","last_peered":"2023-12-24T18:52:39.786914+0000","last_clean":"2023-12-24T18:52:39.786914+0000","last_became_active":"2023-12-24T18:52:39.786566+0000","last_became_peered":"2023-12-24T18:52:39.786566+0000","last_unstale":"2023-12-24T18:52:39.786914+0000","last_undegraded":"2023-12-24T18:52:39.786914+0000","last_fullsized":"2023-12-24T18:52:39.786914+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:04.366300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.769934+0000","last_change":"2023-12-24T18:52:38.769242+0000","last_active":"2023-12-24T18:52:38.769934+0000","last_peered":"2023-12-24T18:52:38.769934+0000","last_clean":"2023-12-24T18:52:38.769934+0000","last_became_active":"2023-12-24T18:52:38.769009+0000","last_became_peered":"2023-12-24T18:52:38.769009+0000","last_unstale":"2023-12-24T18:52:38.769934+0000","last_undegraded":"2023-12-24T18:52:38.769934+0000","last_fullsized":"2023-12-24T18:52:38.769934+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:34:07.979650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.766593+0000","last_change":"2023-12-24T18:52:39.766593+0000","last_active":"2023-12-24T18:52:39.766593+0000","last_peered":"2023-12-24T18:52:39.766593+0000","last_clean":"2023-12-24T18:52:39.766593+0000","last_became_active":"2023-12-24T18:52:39.766276+0000","last_became_peered":"2023-12-24T18:52:39.766276+0000","last_unstale":"2023-12-24T18:52:39.766593+0000","last_undegraded":"2023-12-24T18:52:39.766593+0000","last_fullsized":"2023-12-24T18:52:39.766593+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:23:04.820847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.744278+0000","last_change":"2023-12-24T18:52:38.762649+0000","last_active":"2023-12-24T18:52:39.744278+0000","last_peered":"2023-12-24T18:52:39.744278+0000","last_clean":"2023-12-24T18:52:39.744278+0000","last_became_active":"2023-12-24T18:52:38.762358+0000","last_became_peered":"2023-12-24T18:52:38.762358+0000","last_unstale":"2023-12-24T18:52:39.744278+0000","last_undegraded":"2023-12-24T18:52:39.744278+0000","last_fullsized":"2023-12-24T18:52:39.744278+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:14.148133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.769033+0000","last_change":"2023-12-24T18:52:39.766845+0000","last_active":"2023-12-24T18:52:39.769033+0000","last_peered":"2023-12-24T18:52:39.769033+0000","last_clean":"2023-12-24T18:52:39.769033+0000","last_became_active":"2023-12-24T18:52:39.764982+0000","last_became_peered":"2023-12-24T18:52:39.764982+0000","last_unstale":"2023-12-24T18:52:39.769033+0000","last_undegraded":"2023-12-24T18:52:39.769033+0000","last_fullsized":"2023-12-24T18:52:39.769033+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:52.859687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.776966+0000","last_change":"2023-12-24T18:52:38.758846+0000","last_active":"2023-12-24T18:52:39.776966+0000","last_peered":"2023-12-24T18:52:39.776966+0000","last_clean":"2023-12-24T18:52:39.776966+0000","last_became_active":"2023-12-24T18:52:38.758520+0000","last_became_peered":"2023-12-24T18:52:38.758520+0000","last_unstale":"2023-12-24T18:52:39.776966+0000","last_undegraded":"2023-12-24T18:52:39.776966+0000","last_fullsized":"2023-12-24T18:52:39.776966+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:56:37.304990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.775661+0000","last_change":"2023-12-24T18:52:39.775661+0000","last_active":"2023-12-24T18:52:39.775661+0000","last_peered":"2023-12-24T18:52:39.775661+0000","last_clean":"2023-12-24T18:52:39.775661+0000","last_became_active":"2023-12-24T18:52:39.775300+0000","last_became_peered":"2023-12-24T18:52:39.775300+0000","last_unstale":"2023-12-24T18:52:39.775661+0000","last_undegraded":"2023-12-24T18:52:39.775661+0000","last_fullsized":"2023-12-24T18:52:39.775661+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:09:30.060262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.744221+0000","last_change":"2023-12-24T18:52:38.760348+0000","last_active":"2023-12-24T18:52:39.744221+0000","last_peered":"2023-12-24T18:52:39.744221+0000","last_clean":"2023-12-24T18:52:39.744221+0000","last_became_active":"2023-12-24T18:52:38.759896+0000","last_became_peered":"2023-12-24T18:52:38.759896+0000","last_unstale":"2023-12-24T18:52:39.744221+0000","last_undegraded":"2023-12-24T18:52:39.744221+0000","last_fullsized":"2023-12-24T18:52:39.744221+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:53.848619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.773120+0000","last_change":"2023-12-24T18:52:39.773120+0000","last_active":"2023-12-24T18:52:39.773120+0000","last_peered":"2023-12-24T18:52:39.773120+0000","last_clean":"2023-12-24T18:52:39.773120+0000","last_became_active":"2023-12-24T18:52:39.772374+0000","last_became_peered":"2023-12-24T18:52:39.772374+0000","last_unstale":"2023-12-24T18:52:39.773120+0000","last_undegraded":"2023-12-24T18:52:39.773120+0000","last_fullsized":"2023-12-24T18:52:39.773120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:26.107470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.743712+0000","last_change":"2023-12-24T18:52:38.763958+0000","last_active":"2023-12-24T18:52:39.743712+0000","last_peered":"2023-12-24T18:52:39.743712+0000","last_clean":"2023-12-24T18:52:39.743712+0000","last_became_active":"2023-12-24T18:52:38.763636+0000","last_became_peered":"2023-12-24T18:52:38.763636+0000","last_unstale":"2023-12-24T18:52:39.743712+0000","last_undegraded":"2023-12-24T18:52:39.743712+0000","last_fullsized":"2023-12-24T18:52:39.743712+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:52:46.952439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.760891+0000","last_change":"2023-12-24T18:52:39.760891+0000","last_active":"2023-12-24T18:52:39.760891+0000","last_peered":"2023-12-24T18:52:39.760891+0000","last_clean":"2023-12-24T18:52:39.760891+0000","last_became_active":"2023-12-24T18:52:39.760564+0000","last_became_peered":"2023-12-24T18:52:39.760564+0000","last_unstale":"2023-12-24T18:52:39.760891+0000","last_undegraded":"2023-12-24T18:52:39.760891+0000","last_fullsized":"2023-12-24T18:52:39.760891+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:32:09.630591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.749598+0000","last_change":"2023-12-24T18:52:38.745714+0000","last_active":"2023-12-24T18:52:39.749598+0000","last_peered":"2023-12-24T18:52:39.749598+0000","last_clean":"2023-12-24T18:52:39.749598+0000","last_became_active":"2023-12-24T18:52:38.745203+0000","last_became_peered":"2023-12-24T18:52:38.745203+0000","last_unstale":"2023-12-24T18:52:39.749598+0000","last_undegraded":"2023-12-24T18:52:39.749598+0000","last_fullsized":"2023-12-24T18:52:39.749598+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:45.770416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.767712+0000","last_change":"2023-12-24T18:52:39.766451+0000","last_active":"2023-12-24T18:52:39.767712+0000","last_peered":"2023-12-24T18:52:39.767712+0000","last_clean":"2023-12-24T18:52:39.767712+0000","last_became_active":"2023-12-24T18:52:39.766092+0000","last_became_peered":"2023-12-24T18:52:39.766092+0000","last_unstale":"2023-12-24T18:52:39.767712+0000","last_undegraded":"2023-12-24T18:52:39.767712+0000","last_fullsized":"2023-12-24T18:52:39.767712+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:59.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.762216+0000","last_change":"2023-12-24T18:52:38.759404+0000","last_active":"2023-12-24T18:52:38.762216+0000","last_peered":"2023-12-24T18:52:38.762216+0000","last_clean":"2023-12-24T18:52:38.762216+0000","last_became_active":"2023-12-24T18:52:38.759070+0000","last_became_peered":"2023-12-24T18:52:38.759070+0000","last_unstale":"2023-12-24T18:52:38.762216+0000","last_undegraded":"2023-12-24T18:52:38.762216+0000","last_fullsized":"2023-12-24T18:52:38.762216+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:10.638152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.774730+0000","last_change":"2023-12-24T18:52:39.774730+0000","last_active":"2023-12-24T18:52:39.774730+0000","last_peered":"2023-12-24T18:52:39.774730+0000","last_clean":"2023-12-24T18:52:39.774730+0000","last_became_active":"2023-12-24T18:52:39.772814+0000","last_became_peered":"2023-12-24T18:52:39.772814+0000","last_unstale":"2023-12-24T18:52:39.774730+0000","last_undegraded":"2023-12-24T18:52:39.774730+0000","last_fullsized":"2023-12-24T18:52:39.774730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:09:44.164816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.758900+0000","last_change":"2023-12-24T18:52:38.758001+0000","last_active":"2023-12-24T18:52:38.758900+0000","last_peered":"2023-12-24T18:52:38.758900+0000","last_clean":"2023-12-24T18:52:38.758900+0000","last_became_active":"2023-12-24T18:52:38.757694+0000","last_became_peered":"2023-12-24T18:52:38.757694+0000","last_unstale":"2023-12-24T18:52:38.758900+0000","last_undegraded":"2023-12-24T18:52:38.758900+0000","last_fullsized":"2023-12-24T18:52:38.758900+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:03:57.979578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.788655+0000","last_change":"2023-12-24T18:52:39.785950+0000","last_active":"2023-12-24T18:52:39.788655+0000","last_peered":"2023-12-24T18:52:39.788655+0000","last_clean":"2023-12-24T18:52:39.788655+0000","last_became_active":"2023-12-24T18:52:39.785672+0000","last_became_peered":"2023-12-24T18:52:39.785672+0000","last_unstale":"2023-12-24T18:52:39.788655+0000","last_undegraded":"2023-12-24T18:52:39.788655+0000","last_fullsized":"2023-12-24T18:52:39.788655+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:37.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.749036+0000","last_change":"2023-12-24T18:52:38.743919+0000","last_active":"2023-12-24T18:52:39.749036+0000","last_peered":"2023-12-24T18:52:39.749036+0000","last_clean":"2023-12-24T18:52:39.749036+0000","last_became_active":"2023-12-24T18:52:38.743553+0000","last_became_peered":"2023-12-24T18:52:38.743553+0000","last_unstale":"2023-12-24T18:52:39.749036+0000","last_undegraded":"2023-12-24T18:52:39.749036+0000","last_fullsized":"2023-12-24T18:52:39.749036+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:08.069095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.781929+0000","last_change":"2023-12-24T18:52:39.781929+0000","last_active":"2023-12-24T18:52:39.781929+0000","last_peered":"2023-12-24T18:52:39.781929+0000","last_clean":"2023-12-24T18:52:39.781929+0000","last_became_active":"2023-12-24T18:52:39.781652+0000","last_became_peered":"2023-12-24T18:52:39.781652+0000","last_unstale":"2023-12-24T18:52:39.781929+0000","last_undegraded":"2023-12-24T18:52:39.781929+0000","last_fullsized":"2023-12-24T18:52:39.781929+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:15.606274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.756397+0000","last_change":"2023-12-24T18:52:38.766020+0000","last_active":"2023-12-24T18:52:39.756397+0000","last_peered":"2023-12-24T18:52:39.756397+0000","last_clean":"2023-12-24T18:52:39.756397+0000","last_became_active":"2023-12-24T18:52:38.765692+0000","last_became_peered":"2023-12-24T18:52:38.765692+0000","last_unstale":"2023-12-24T18:52:39.756397+0000","last_undegraded":"2023-12-24T18:52:39.756397+0000","last_fullsized":"2023-12-24T18:52:39.756397+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:07.167434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.792688+0000","last_change":"2023-12-24T18:52:39.786626+0000","last_active":"2023-12-24T18:52:39.792688+0000","last_peered":"2023-12-24T18:52:39.792688+0000","last_clean":"2023-12-24T18:52:39.792688+0000","last_became_active":"2023-12-24T18:52:39.784945+0000","last_became_peered":"2023-12-24T18:52:39.784945+0000","last_unstale":"2023-12-24T18:52:39.792688+0000","last_undegraded":"2023-12-24T18:52:39.792688+0000","last_fullsized":"2023-12-24T18:52:39.792688+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:38.721462+0000","last_clean_scrub_stamp":"2023-12-24T18:52:38.721462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:32:09.630591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-24T18:52:38.769554+0000","last_change":"2023-12-24T18:52:38.764898+0000","last_active":"2023-12-24T18:52:38.769554+0000","last_peered":"2023-12-24T18:52:38.769554+0000","last_clean":"2023-12-24T18:52:38.769554+0000","last_became_active":"2023-12-24T18:52:38.763863+0000","last_became_peered":"2023-12-24T18:52:38.763863+0000","last_unstale":"2023-12-24T18:52:38.769554+0000","last_undegraded":"2023-12-24T18:52:38.769554+0000","last_fullsized":"2023-12-24T18:52:38.769554+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:52:37.704632+0000","last_clean_scrub_stamp":"2023-12-24T18:52:37.704632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:53.668050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":545,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-24T18:52:39.756501+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:52:39.756501+0000","last_peered":"2023-12-24T18:52:39.756501+0000","last_clean":"2023-12-24T18:52:39.756501+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:52:39.756501+0000","last_undegraded":"2023-12-24T18:52:39.756501+0000","last_fullsized":"2023-12-24T18:52:39.756501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311476,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060364,"statfs":{"total":96636764160,"available":96317812736,"internally_reserved":0,"allocated":1945600,"data_stored":1271520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":2.4159999999999999},"last":1.45},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.175},"min":{"1min":0.69799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5409999999999999,"5min":1.756,"15min":2.0710000000000002},"last":1.075}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.879,"5min":0.72299999999999998,"15min":0.59099999999999997},"max":{"1min":1.3660000000000001,"5min":1.5349999999999999,"15min":1.669},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1950000000000001,"15min":1.216},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7230000000000001,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5609999999999999,"5min":1.625,"15min":1.704},"last":1.556},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2270000000000001,"15min":1.2250000000000001},"min":{"1min":0.90300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.395,"5min":1.6799999999999999,"15min":1.893},"last":0.85999999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2809999999999999,"15min":1.286},"min":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.024},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":1.0089999999999999,"5min":0.86199999999999999,"15min":0.83099999999999996},"max":{"1min":1.514,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.2090000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.80600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.526,"5min":1.8109999999999999,"15min":2.1099999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.875,"5min":0.75900000000000001,"15min":0.70699999999999996},"max":{"1min":1.6699999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.665}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.59899999999999998},"max":{"1min":1.4590000000000001,"5min":1.8440000000000001,"15min":2.1589999999999998},"last":1.508},{"interface":"front","average":{"1min":1.365,"5min":1.347,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.879,"5min":1.9590000000000001,"15min":2.403},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4370000000000001,"15min":1.425},"min":{"1min":0.99399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8420000000000001,"5min":1.956,"15min":2.4889999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.429,"15min":1.423},"min":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":2.2069999999999999},"last":1.917}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306812,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065028,"statfs":{"total":96636764160,"available":96322588672,"internally_reserved":0,"allocated":1363968,"data_stored":683208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.68999999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6220000000000001,"5min":1.788,"15min":1.788},"last":4.6550000000000002},{"interface":"front","average":{"1min":1.22,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.748,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":4.6790000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1279999999999999,"15min":1.1599999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6060000000000001,"5min":1.667,"15min":1.667},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.2050000000000001,"15min":1.1990000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.599,"5min":1.7390000000000001,"15min":1.748},"last":3.081}]},{"osd":2,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1499999999999999,"15min":1.1659999999999999},"min":{"1min":0.72899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4610000000000001,"5min":1.542,"15min":3.609},"last":2.173},{"interface":"front","average":{"1min":1.117,"5min":1.232,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.5640000000000001,"5min":1.794,"15min":2.0259999999999998},"last":1.6759999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2509999999999999,"15min":1.26},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.655,"5min":1.6659999999999999,"15min":1.867},"last":4.6120000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":0.73799999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"max":{"1min":1.4330000000000001,"5min":1.6910000000000001,"15min":3.8540000000000001},"last":2.1120000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1870000000000001,"15min":1.202},"min":{"1min":0.67300000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.5129999999999999,"5min":1.8919999999999999,"15min":2.6880000000000002},"last":3.1459999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.274,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.65200000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":3.0470000000000002},"last":1.472}]},{"osd":5,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.2,"15min":1.2290000000000001},"min":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":4.2779999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3320000000000001,"15min":1.351},"min":{"1min":0.85999999999999999,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":1.669,"5min":1.9810000000000001,"15min":4.2080000000000002},"last":1.7130000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3740000000000001,"15min":1.3919999999999999},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.73999999999999999},"max":{"1min":1.9950000000000001,"5min":2.1709999999999998,"15min":3.3679999999999999},"last":1.52},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.367,"15min":1.3879999999999999},"min":{"1min":0.97599999999999998,"5min":0.80800000000000005,"15min":0.58799999999999997},"max":{"1min":1.536,"5min":1.9319999999999999,"15min":4.4610000000000003},"last":2.0350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":1331200,"data_stored":674112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1930000000000001,"15min":1.1890000000000001},"min":{"1min":0.75,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5149999999999999,"5min":1.609,"15min":1.752},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2929999999999999,"15min":1.2989999999999999},"min":{"1min":0.755,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4610000000000001,"5min":1.839,"15min":2.73},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.117,"15min":1.1399999999999999},"min":{"1min":0.84899999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.486,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1759999999999999,"15min":1.1459999999999999},"min":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.56299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.212},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.53900000000000003},"max":{"1min":1.6319999999999999,"5min":1.744,"15min":1.744},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.244,"15min":1.222},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5129999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.2629999999999999},"min":{"1min":0.93799999999999994,"5min":0.876,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.9299999999999999,"15min":2.8159999999999998},"last":1.121},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2929999999999999,"15min":1.2969999999999999},"min":{"1min":0.878,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6459999999999999,"5min":1.786,"15min":2.1389999999999998},"last":1.0940000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.173,"15min":1.135},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":2.202},"last":1.036},{"interface":"front","average":{"1min":1.415,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.76900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.978,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.0660000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2609999999999999,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":2.3959999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.3080000000000001,"15min":1.306},"min":{"1min":1.069,"5min":0.874,"15min":0.67700000000000005},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.6280000000000001},"last":1.216}]},{"osd":7,"last update":"Sun Dec 24 18:51:52 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93300000000000005,"5min":0.88,"15min":0.872},"max":{"1min":1.573,"5min":2.0089999999999999,"15min":2.879},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.395,"15min":1.4099999999999999},"min":{"1min":0.93600000000000005,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.738,"5min":1.889,"15min":2.2429999999999999},"last":1.163}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1351680,"data_stored":681256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.74399999999999999,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.486},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.216,"15min":1.242},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.518,"5min":1.621,"15min":1.6879999999999999},"last":1.571}]},{"osd":1,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.109,"15min":1.1479999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.9830000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.153,"15min":1.1279999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.48799999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.0389999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.63600000000000001},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.379},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2869999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1719999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.61299999999999999},"max":{"1min":1.464,"5min":1.714,"15min":1.736},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77400000000000002},"max":{"1min":1.522,"5min":1.7490000000000001,"15min":1.839},"last":1.016}]},{"osd":5,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2669999999999999,"15min":1.2490000000000001},"min":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.58099999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.298,"15min":1.304},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.831,"15min":2.3029999999999999},"last":1.2729999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6240000000000001,"5min":1.823,"15min":1.881},"last":1.452},{"interface":"front","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3240000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.909,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3520000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3180000000000001,"15min":1.296},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.587,"5min":1.8600000000000001,"15min":2.161},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.3979999999999999},"min":{"1min":0.747,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.714,"5min":1.877,"15min":1.9359999999999999},"last":1.1180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306780,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065060,"statfs":{"total":96636764160,"available":96322621440,"internally_reserved":0,"allocated":1331200,"data_stored":674112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.46000000000000002},"max":{"1min":1.8180000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2509999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0049999999999999,"15min":1.012},"min":{"1min":0.499,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":1.405,"5min":1.635,"15min":1.635},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.194,"15min":1.1910000000000001},"min":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5489999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.59499999999999997},"max":{"1min":1.5249999999999999,"5min":1.6279999999999999,"15min":1.6779999999999999},"last":0.999},{"interface":"front","average":{"1min":1.073,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.65700000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3799999999999999,"5min":1.6559999999999999,"15min":1.875},"last":1.0269999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.256,"15min":1.244},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.571,"5min":1.7609999999999999,"15min":1.766},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.66300000000000003},"max":{"1min":1.476,"5min":1.724,"15min":1.9710000000000001},"last":1.286}]},{"osd":5,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3919999999999999},"min":{"1min":1.0129999999999999,"5min":0.84499999999999997,"15min":0.84299999999999997},"max":{"1min":1.589,"5min":1.837,"15min":2.1739999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.88400000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5940000000000001,"5min":2.137,"15min":2.1539999999999999},"last":1.4039999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.4750000000000001,"15min":1.482},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.92200000000000004},"max":{"1min":1.581,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.4079999999999999,"15min":1.405},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.665,"5min":1.861,"15min":2.3730000000000002},"last":1.9530000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4530000000000001,"15min":1.4510000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.79500000000000004},"max":{"1min":1.752,"5min":1.9490000000000001,"15min":2.4460000000000002},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4990000000000001,"15min":1.51},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.85799999999999998},"max":{"1min":1.7470000000000001,"5min":1.887,"15min":2.3149999999999999},"last":1.454}]}]},{"osd":2,"up_from":13,"seq":55834575045,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310888,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060952,"statfs":{"total":96636764160,"available":96318414848,"internally_reserved":0,"allocated":1343488,"data_stored":681096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94099999999999995,"15min":0.93600000000000005},"min":{"1min":0.58599999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.8420000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.071,"15min":1.077},"min":{"1min":0.627,"5min":0.50900000000000001,"15min":0.442},"max":{"1min":1.377,"5min":1.4970000000000001,"15min":2.1459999999999999},"last":0.90400000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.46200000000000002},"max":{"1min":1.2490000000000001,"5min":1.78,"15min":1.78},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2949999999999999,"5min":1.976,"15min":1.976},"last":1.0269999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.095,"15min":1.137},"min":{"1min":0.78900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.3049999999999999,"5min":1.625,"15min":2.6579999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0569999999999999,"15min":1.083},"min":{"1min":0.69099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2829999999999999,"5min":1.6819999999999999,"15min":2.524},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2909999999999999,"15min":1.3300000000000001},"min":{"1min":1.0740000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6379999999999999,"5min":1.657,"15min":3.1480000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.995,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.798,"5min":1.798,"15min":2.8740000000000001},"last":1.252}]},{"osd":5,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2889999999999999,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.851,"5min":1.851,"15min":3.093},"last":1.139},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.355,"15min":1.3740000000000001},"min":{"1min":0.94199999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7070000000000001,"5min":1.8580000000000001,"15min":3.0139999999999998},"last":1.1910000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3919999999999999,"15min":1.421},"min":{"1min":1.0209999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":3.589},"last":1.421},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.385,"15min":1.423},"min":{"1min":0.95199999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.885,"5min":1.9870000000000001,"15min":3.5129999999999999},"last":1.2270000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4470000000000001,"15min":1.4790000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":3.242},"last":1.284},{"interface":"front","average":{"1min":1.448,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":1.099,"5min":0.84999999999999998,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8859999999999999,"15min":3.8029999999999999},"last":1.3440000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":674182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.98899999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.3779999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1,"5min":1.081,"15min":1.111},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5109999999999999,"5min":1.6419999999999999,"15min":1.829},"last":1.002}]},{"osd":2,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":0.93100000000000005},"min":{"1min":0.69999999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.494,"15min":1.5349999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.58899999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.502,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.747}]},{"osd":3,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.278,"15min":1.2470000000000001},"min":{"1min":0.88600000000000001,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5640000000000001,"5min":1.915,"15min":1.9810000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1359999999999999,"15min":1.0880000000000001},"min":{"1min":0.629,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4419999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.2370000000000001},"min":{"1min":0.89600000000000002,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.4830000000000001,"5min":1.724,"15min":1.724},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.4319999999999999,"15min":1.405},"min":{"1min":1,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6830000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.93999999999999995}]},{"osd":5,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3999999999999999,"15min":1.3740000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.6850000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.377,"15min":1.359},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.778,"5min":1.8340000000000001,"15min":2.0089999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.518,"15min":1.4850000000000001},"min":{"1min":1.2150000000000001,"5min":1.0469999999999999,"15min":0.90600000000000003},"max":{"1min":1.7490000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.472,"15min":1.4570000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7929999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.391}]},{"osd":7,"last update":"Sun Dec 24 18:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.5229999999999999,"15min":1.5109999999999999},"min":{"1min":1.159,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":1.9359999999999999,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.4750000000000001,"15min":1.4610000000000001},"min":{"1min":0.94499999999999995,"5min":0.876,"15min":0.876},"max":{"1min":1.8280000000000001,"5min":1.9710000000000001,"15min":2.1160000000000001},"last":1.2709999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307384,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064456,"statfs":{"total":96636764160,"available":96322002944,"internally_reserved":0,"allocated":1949696,"data_stored":1266694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.68700000000000006,"5min":0.47499999999999998,"15min":0.372},"max":{"1min":1.3009999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.69899999999999995,"5min":0.53100000000000003,"15min":0.40799999999999997},"max":{"1min":1.5700000000000001,"5min":1.631,"15min":1.746},"last":0.91100000000000003}]},{"osd":2,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0549999999999999,"15min":1.054},"min":{"1min":0.878,"5min":0.627,"15min":0.627},"max":{"1min":1.536,"5min":1.7,"15min":1.7},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":0.78400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.631,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.341}]},{"osd":3,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0029999999999999,"15min":1.0249999999999999},"min":{"1min":0.75900000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.79,"15min":1.819},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.2390000000000001},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.53600000000000003},"max":{"1min":1.643,"5min":1.929,"15min":1.929},"last":1.3779999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.353,"15min":1.3500000000000001},"min":{"1min":0.92000000000000004,"5min":0.82699999999999996,"15min":0.71799999999999997},"max":{"1min":1.8120000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.417},{"interface":"front","average":{"1min":1.274,"5min":1.258,"15min":1.2949999999999999},"min":{"1min":0.93600000000000005,"5min":0.80800000000000005,"15min":0.78300000000000003},"max":{"1min":1.5780000000000001,"5min":1.651,"15min":1.762},"last":1.042}]},{"osd":5,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3819999999999999,"15min":1.4019999999999999},"min":{"1min":1.0900000000000001,"5min":0.85499999999999998,"15min":0.83099999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.391},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":0.66000000000000003},"max":{"1min":1.978,"5min":2.2280000000000002,"15min":2.3010000000000002},"last":1.27}]},{"osd":6,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.323,"15min":1.3720000000000001},"min":{"1min":1.01,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0779999999999998},"last":1.244},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.4850000000000001,"15min":1.496},"min":{"1min":1.147,"5min":1.024,"15min":0.77000000000000002},"max":{"1min":2.0750000000000002,"5min":2.1579999999999999,"15min":2.23},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.476,"15min":1.492},"min":{"1min":1.151,"5min":1.006,"15min":0.67500000000000004},"max":{"1min":2.1040000000000001,"5min":2.8980000000000001,"15min":3.262},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.4159999999999999,"15min":1.4650000000000001},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.917,"5min":2.3279999999999998,"15min":3.2149999999999999},"last":1.1739999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:52:44.510 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:52:44.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:52:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 Processor -- start 2023-12-24T18:52:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 -- start start 2023-12-24T18:52:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3154160720 0x7f315406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3154160af0 0x7f315406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315406b0b0 con 0x7f315406ac40 2023-12-24T18:52:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315415e960 con 0x7f3154160720 2023-12-24T18:52:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.736+0000 7f315bd05700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315415fe00 con 0x7f3154160af0 2023-12-24T18:52:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3154160af0 0x7f315406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f3159aa1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3154160720 0x7f315406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315a2a2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f315406ac40 0x7f3154161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51606/0 (socket says 172.21.15.50:51606) 2023-12-24T18:52:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315a2a2700 1 -- 172.21.15.50:0/4218112939 learned_addr learned my addr 172.21.15.50:0/4218112939 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 -- 172.21.15.50:0/4218112939 >> v2:172.21.15.50:3300/0 conn(0x7f3154160720 msgr2=0x7f315406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 --2- 172.21.15.50:0/4218112939 >> v2:172.21.15.50:3300/0 conn(0x7f3154160720 0x7f315406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 -- 172.21.15.50:0/4218112939 >> v1:172.21.15.82:6789/0 conn(0x7f315406ac40 legacy=0x7f3154161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 -- 172.21.15.50:0/4218112939 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31541600a0 con 0x7f3154160af0 2023-12-24T18:52:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f31592a0700 1 --2- 172.21.15.50:0/4218112939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160af0 0x7f315406a700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3154069b50 tx=0x7f31440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe1d76348819636 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f3158a9f700 1 -- 172.21.15.50:0/4218112939 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144011630 con 0x7f3154160af0 2023-12-24T18:52:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f3158a9f700 1 -- 172.21.15.50:0/4218112939 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144011790 con 0x7f3154160af0 2023-12-24T18:52:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f3158a9f700 1 -- 172.21.15.50:0/4218112939 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144011b30 con 0x7f3154160af0 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 -- 172.21.15.50:0/4218112939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160af0 msgr2=0x7f315406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 --2- 172.21.15.50:0/4218112939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160af0 0x7f315406a700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3154069b50 tx=0x7f31440091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 -- 172.21.15.50:0/4218112939 shutdown_connections 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 --2- 172.21.15.50:0/4218112939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160af0 0x7f315406a700 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 --2- 172.21.15.50:0/4218112939 >> v2:172.21.15.50:3300/0 conn(0x7f3154160720 0x7f315406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 -- 172.21.15.50:0/4218112939 >> 172.21.15.50:0/4218112939 conn(0x7f3154067b80 msgr2=0x7f31540cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 -- 172.21.15.50:0/4218112939 shutdown_connections 2023-12-24T18:52:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.740+0000 7f315bd05700 1 -- 172.21.15.50:0/4218112939 wait complete. 2023-12-24T18:52:44.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 Processor -- start 2023-12-24T18:52:44.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 -- start start 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3154160af0 0x7f3154162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c6420 con 0x7f3154160af0 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c6160 con 0x7f3154160720 2023-12-24T18:52:44.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.744+0000 7f315bd05700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c1e80 con 0x7f315406ac40 2023-12-24T18:52:44.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3159aa1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:58352/0 (socket says 172.21.15.50:58352) 2023-12-24T18:52:44.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3159aa1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44544/0 (socket says 172.21.15.50:44544) 2023-12-24T18:52:44.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 -- 172.21.15.50:0/2659547655 learned_addr learned my addr 172.21.15.50:0/2659547655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f315a2a2700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3154160af0 0x7f3154162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 -- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 msgr2=0x7f315415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 -- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3154160af0 msgr2=0x7f3154162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3154160af0 0x7f3154162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 -- 172.21.15.50:0/2659547655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144009420 con 0x7f3154160720 2023-12-24T18:52:44.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3159aa1700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f31592a0700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f315415ff40 tx=0x7f3144017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144000d10 con 0x7f3154160720 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144011b10 con 0x7f3154160720 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144023660 con 0x7f3154160720 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540c15e0 con 0x7f3154160720 2023-12-24T18:52:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540c1ba0 con 0x7f3154160720 2023-12-24T18:52:44.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.748+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31540652e0 con 0x7f3154160720 2023-12-24T18:52:44.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.752+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f31440193b0 con 0x7f3154160720 2023-12-24T18:52:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.752+0000 7f3149ffb700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 0x7f3138062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.752+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f314407e3b0 con 0x7f3154160720 2023-12-24T18:52:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.752+0000 7f3159aa1700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 0x7f3138062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:44.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.756+0000 7f3159aa1700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 0x7f3138062ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3150011480 tx=0x7f31500091a0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.760+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f314404e780 con 0x7f3154160720 2023-12-24T18:52:44.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:44.992+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f315415dd50 con 0x7f3154160720 2023-12-24T18:52:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f3149ffb700 1 -- 172.21.15.50:0/2659547655 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f31440150e0 con 0x7f3154160720 2023-12-24T18:52:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 msgr2=0x7f3138062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 0x7f3138062ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3150011480 tx=0x7f31500091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 msgr2=0x7f3154161ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f315415ff40 tx=0x7f3144017000 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 shutdown_connections 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3138060620 0x7f3138062ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3154160af0 0x7f3154162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3154160720 0x7f3154161ee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 --2- 172.21.15.50:0/2659547655 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f315406ac40 0x7f315415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.008+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 >> 172.21.15.50:0/2659547655 conn(0x7f3154067b80 msgr2=0x7f315415cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.012+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 shutdown_connections 2023-12-24T18:52:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.012+0000 7f315bd05700 1 -- 172.21.15.50:0/2659547655 wait complete. 2023-12-24T18:52:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:52:45.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:52:45.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 Processor -- start 2023-12-24T18:52:45.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 -- start start 2023-12-24T18:52:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f4006c820 0x7f2f400ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f400b0460 con 0x7f2f4015a2d0 2023-12-24T18:52:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4006d8c0 con 0x7f2f4006c820 2023-12-24T18:52:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f44c16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400afc60 con 0x7f2f400adc90 2023-12-24T18:52:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f3f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f4015a2d0 0x7f2f400ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51614/0 (socket says 172.21.15.50:51614) 2023-12-24T18:52:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f3f7fe700 1 -- 172.21.15.50:0/3446026233 learned_addr learned my addr 172.21.15.50:0/3446026233 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44548/0 (socket says 172.21.15.50:44548) 2023-12-24T18:52:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.184+0000 7f2f36ffd700 1 --2- 172.21.15.50:0/3446026233 >> v2:172.21.15.82:3300/0 conn(0x7f2f4006c820 0x7f2f400ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3ffff700 1 -- 172.21.15.50:0/3446026233 >> v2:172.21.15.82:3300/0 conn(0x7f2f4006c820 msgr2=0x7f2f400ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3ffff700 1 --2- 172.21.15.50:0/3446026233 >> v2:172.21.15.82:3300/0 conn(0x7f2f4006c820 0x7f2f400ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3ffff700 1 -- 172.21.15.50:0/3446026233 >> v1:172.21.15.82:6789/0 conn(0x7f2f4015a2d0 legacy=0x7f2f400ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3effd700 1 -- 172.21.15.50:0/3446026233 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405084714 0 0) 0x7f2f400b0460 con 0x7f2f4015a2d0 2023-12-24T18:52:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3ffff700 1 -- 172.21.15.50:0/3446026233 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4006a5c0 con 0x7f2f400adc90 2023-12-24T18:52:45.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3ffff700 1 --2- 172.21.15.50:0/3446026233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009e60 tx=0x7f2f38009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2024c16119952d4f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:45.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3effd700 1 -- 172.21.15.50:0/3446026233 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800e070 con 0x7f2f400adc90 2023-12-24T18:52:45.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3effd700 1 -- 172.21.15.50:0/3446026233 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800bb60 con 0x7f2f400adc90 2023-12-24T18:52:45.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f3effd700 1 -- 172.21.15.50:0/3446026233 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38012430 con 0x7f2f400adc90 2023-12-24T18:52:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 -- 172.21.15.50:0/3446026233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 msgr2=0x7f2f40160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3446026233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009e60 tx=0x7f2f38009780 comp rx=0 tx=0).stop 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 -- 172.21.15.50:0/3446026233 shutdown_connections 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3446026233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f400adc90 0x7f2f40160990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3446026233 >> v2:172.21.15.82:3300/0 conn(0x7f2f4006c820 0x7f2f400ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 -- 172.21.15.50:0/3446026233 >> 172.21.15.50:0/3446026233 conn(0x7f2f40067b80 msgr2=0x7f2f400cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 -- 172.21.15.50:0/3446026233 shutdown_connections 2023-12-24T18:52:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.188+0000 7f2f44c16700 1 -- 172.21.15.50:0/3446026233 wait complete. 2023-12-24T18:52:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 Processor -- start 2023-12-24T18:52:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 -- start start 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4006c820 0x7f2f4014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4015a2d0 0x7f2f40151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40138130 con 0x7f2f400adc90 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40151b90 con 0x7f2f4006c820 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.192+0000 7f2f44c16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40151dd0 con 0x7f2f4015a2d0 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44002/0 (socket says 172.21.15.50:44002) 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 -- 172.21.15.50:0/3746117315 learned_addr learned my addr 172.21.15.50:0/3746117315 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f3f7fe700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4006c820 0x7f2f4014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f3ffff700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4015a2d0 0x7f2f40151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 -- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4015a2d0 msgr2=0x7f2f40151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4015a2d0 0x7f2f40151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 -- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4006c820 msgr2=0x7f2f4014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4006c820 0x7f2f4014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 -- 172.21.15.50:0/3746117315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009a20 con 0x7f2f400adc90 2023-12-24T18:52:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f36ffd700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800ecb0 tx=0x7f2f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800c7f0 con 0x7f2f400adc90 2023-12-24T18:52:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800c950 con 0x7f2f400adc90 2023-12-24T18:52:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f40152040 con 0x7f2f400adc90 2023-12-24T18:52:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800ccf0 con 0x7f2f400adc90 2023-12-24T18:52:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4014b940 con 0x7f2f400adc90 2023-12-24T18:52:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.196+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4004be40 con 0x7f2f400adc90 2023-12-24T18:52:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.200+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2f28013680 con 0x7f2f400adc90 2023-12-24T18:52:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.200+0000 7f2f37fff700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 0x7f2f20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.200+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f2f2807cc10 con 0x7f2f400adc90 2023-12-24T18:52:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.200+0000 7f2f3f7fe700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 0x7f2f20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.204+0000 7f2f3f7fe700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 0x7f2f20062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f30007160 tx=0x7f2f30007f50 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.208+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f2804cf20 con 0x7f2f400adc90 2023-12-24T18:52:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.420+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f4015ae60 con 0x7f2f400adc90 2023-12-24T18:52:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f37fff700 1 -- 172.21.15.50:0/3746117315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f2f28050540 con 0x7f2f400adc90 2023-12-24T18:52:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:45.423 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 msgr2=0x7f2f20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 0x7f2f20062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f30007160 tx=0x7f2f30007f50 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 msgr2=0x7f2f40151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800ecb0 tx=0x7f2f280091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.424+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 shutdown_connections 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2f20060550 0x7f2f20062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4015a2d0 0x7f2f40151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400adc90 0x7f2f40151110 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 --2- 172.21.15.50:0/3746117315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4006c820 0x7f2f4014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 >> 172.21.15.50:0/3746117315 conn(0x7f2f40067b80 msgr2=0x7f2f40156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 shutdown_connections 2023-12-24T18:52:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:45.428+0000 7f2f44c16700 1 -- 172.21.15.50:0/3746117315 wait complete. 2023-12-24T18:52:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:52:45.700 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-24T18:52:45.700+0000 7f738c7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:52:45.849 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:52:39.193083+0000', 'modified': '2023-12-24T18:52:42.767460+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7320}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7320': {'gid': 7320, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/664091337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 664091337}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 664091337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:52:45.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:52:45.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T18:52:46.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 Processor -- start 2023-12-24T18:52:46.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 -- start start 2023-12-24T18:52:46.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93b40ccdd0 0x7f93b40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b406d890 con 0x7f93b40cc980 2023-12-24T18:52:46.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b406ca30 con 0x7f93b415c860 2023-12-24T18:52:46.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.024+0000 7f93bc185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b406cc80 con 0x7f93b40ccdd0 2023-12-24T18:52:46.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b9720700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93b40cc980 0x7f93b40b00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44068/0 (socket says 172.21.15.50:44068) 2023-12-24T18:52:46.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93ba722700 1 --2- 172.21.15.50:0/1314213285 >> v2:172.21.15.82:3300/0 conn(0x7f93b40ccdd0 0x7f93b40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b9720700 1 -- 172.21.15.50:0/1314213285 learned_addr learned my addr 172.21.15.50:0/1314213285 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:46.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b8f1f700 1 -- 172.21.15.50:0/1314213285 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801016913 0 0) 0x7f93b406ca30 con 0x7f93b415c860 2023-12-24T18:52:46.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93ba722700 1 -- 172.21.15.50:0/1314213285 >> v1:172.21.15.82:6789/0 conn(0x7f93b415c860 legacy=0x7f93b406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93ba722700 1 -- 172.21.15.50:0/1314213285 >> v1:172.21.15.50:6789/0 conn(0x7f93b40cc980 legacy=0x7f93b40b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93ba722700 1 -- 172.21.15.50:0/1314213285 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b406cf60 con 0x7f93b40ccdd0 2023-12-24T18:52:46.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93ba722700 1 --2- 172.21.15.50:0/1314213285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40b07e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0098e0 tx=0x7f93ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4785b5c118a99cc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b8f1f700 1 -- 172.21.15.50:0/1314213285 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac009e80 con 0x7f93b40ccdd0 2023-12-24T18:52:46.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b8f1f700 1 -- 172.21.15.50:0/1314213285 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00b760 con 0x7f93b40ccdd0 2023-12-24T18:52:46.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.028+0000 7f93b8f1f700 1 -- 172.21.15.50:0/1314213285 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00bae0 con 0x7f93b40ccdd0 2023-12-24T18:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- 172.21.15.50:0/1314213285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 msgr2=0x7f93b40b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 --2- 172.21.15.50:0/1314213285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40b07e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0098e0 tx=0x7f93ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- 172.21.15.50:0/1314213285 shutdown_connections 2023-12-24T18:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 --2- 172.21.15.50:0/1314213285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40b07e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- 172.21.15.50:0/1314213285 >> 172.21.15.50:0/1314213285 conn(0x7f93b40670b0 msgr2=0x7f93b40674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- 172.21.15.50:0/1314213285 shutdown_connections 2023-12-24T18:52:46.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- 172.21.15.50:0/1314213285 wait complete. 2023-12-24T18:52:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 Processor -- start 2023-12-24T18:52:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.032+0000 7f93bc185700 1 -- start start 2023-12-24T18:52:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93b415c860 0x7f93b40c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4156670 con 0x7f93b40cc980 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40b3ef0 con 0x7f93b40ccdd0 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40b4a00 con 0x7f93b415c860 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44004/0 (socket says 172.21.15.50:44004) 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 -- 172.21.15.50:0/2960525394 learned_addr learned my addr 172.21.15.50:0/2960525394 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9720700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93ba722700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93b415c860 0x7f93b40c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 -- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93b415c860 msgr2=0x7f93b40c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93b415c860 0x7f93b40c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 -- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 msgr2=0x7f93b40c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 -- 172.21.15.50:0/2960525394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac009420 con 0x7f93b40cc980 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9720700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c930 tx=0x7f93b00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93a9ffb700 1 -- 172.21.15.50:0/2960525394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0012630 con 0x7f93b40cc980 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93a9ffb700 1 -- 172.21.15.50:0/2960525394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00127d0 con 0x7f93b40cc980 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b40b4ce0 con 0x7f93b40cc980 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93a9ffb700 1 -- 172.21.15.50:0/2960525394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0012b90 con 0x7f93b40cc980 2023-12-24T18:52:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.036+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b40b52a0 con 0x7f93b40cc980 2023-12-24T18:52:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.040+0000 7f93a9ffb700 1 -- 172.21.15.50:0/2960525394 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f93b0003030 con 0x7f93b40cc980 2023-12-24T18:52:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93a9ffb700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 0x7f9398062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93a9ffb700 1 -- 172.21.15.50:0/2960525394 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f93b007ca80 con 0x7f93b40cc980 2023-12-24T18:52:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93b9720700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 0x7f9398062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93b9720700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 0x7f9398062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93be47e740 1 Processor -- start 2023-12-24T18:52:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93be47e740 1 -- start start 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93be47e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.044+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2348440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x2348980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2275f30 con 0x20caae0 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2271ed0 con 0x2115790 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x22380b0 con 0x20ca710 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44018/0 (socket says 172.21.15.50:44018) 2023-12-24T18:52:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 -- 172.21.15.50:0/625913733 learned_addr learned my addr 172.21.15.50:0/625913733 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9720700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2348440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93ba722700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x2348980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 -- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 msgr2=0x2348440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2348440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 -- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 msgr2=0x2348980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x2348980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 -- 172.21.15.50:0/625913733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21169e0 con 0x20caae0 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9720700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2348440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93ba722700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x2348980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93b9f21700 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f93b00506d0 tx=0x7f93b007aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4ffb6608c540b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f939effd700 1 -- 172.21.15.50:0/625913733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00509d0 con 0x20caae0 2023-12-24T18:52:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f939effd700 1 -- 172.21.15.50:0/625913733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0069070 con 0x20caae0 2023-12-24T18:52:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f939effd700 1 -- 172.21.15.50:0/625913733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b004eb10 con 0x20caae0 2023-12-24T18:52:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- 172.21.15.50:0/625913733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 msgr2=0x2347f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f93b00506d0 tx=0x7f93b007aba0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- 172.21.15.50:0/625913733 shutdown_connections 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x2348980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2348440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 --2- 172.21.15.50:0/625913733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x2347f00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- 172.21.15.50:0/625913733 >> 172.21.15.50:0/625913733 conn(0x20caeb0 msgr2=0x2304930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- 172.21.15.50:0/625913733 shutdown_connections 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- 172.21.15.50:0/625913733 wait complete. 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.048+0000 7f93be47e740 1 -- start start 2023-12-24T18:52:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 Processor -- start 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20ca710 0x234c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20caae0 0x234c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2237d50 con 0x2115790 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2210970 con 0x20ca710 2023-12-24T18:52:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x21ae430 con 0x20caae0 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93be47e740 10 client.0 _ll_register_callbacks cb 0x22bb6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44032/0 (socket says 172.21.15.50:44032) 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 -- 172.21.15.50:0/2291132729 learned_addr learned my addr 172.21.15.50:0/2291132729 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93b9720700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20caae0 0x234c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20ca710 0x234c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 -- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20caae0 msgr2=0x234c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20caae0 0x234c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 -- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20ca710 msgr2=0x234c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20ca710 0x234c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.052+0000 7f93ba722700 1 -- 172.21.15.50:0/2291132729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b40b52a0 con 0x2115790 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93ba722700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0091e0 tx=0x7f93ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87f83947534c70c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac022070 con 0x2115790 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2210cc0 con 0x2115790 2023-12-24T18:52:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f93ac027d80 con 0x2115790 2023-12-24T18:52:46.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93ac01c8f0 con 0x2115790 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 10 client.7443 fetch_fsmap learned FSMap version 53 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x2240370 con 0x2115790 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2210cc0 con 0x2115790 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f93ac018070 con 0x2115790 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 10 client.7443 fetch_fsmap finished waiting for FSMap version 53 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 10 client.7443 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 20 client.7443 populate_metadata read hostname 'smithi050' 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x232f360 0x23574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 4 client.7443 mds_command: new command op to 7320 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:52:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 --> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22143e0 con 0x232f360 2023-12-24T18:52:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x232f360 0x23574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x232f360 0x23574a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc897037542aabb8 server_cookie=a55753b1fb14fe3e in_seq=0 out_seq=0 2023-12-24T18:52:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.056+0000 7f9393fff700 10 client.7443 ms_handle_connect on v2:172.21.15.50:6834/664091337 2023-12-24T18:52:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f9393fff700 1 -- 172.21.15.50:0/2291132729 <== mds.0 v2:172.21.15.50:6834/664091337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x22143e0 con 0x232f360 2023-12-24T18:52:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f9393fff700 10 client.7443 handle_command_reply: tid=0 2023-12-24T18:52:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 client.7443 shutdown 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 msgr2=0x232dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0091e0 tx=0x7f93ac016000 comp rx=0 tx=0).stop 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 shutdown_connections 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x232f360 0x23574a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x232dcb0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20caae0 0x234c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f9393fff700 0 client.7443 ms_handle_reset on v2:172.21.15.50:6834/664091337 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 --2- 172.21.15.50:0/2291132729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20ca710 0x234c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 >> 172.21.15.50:0/2291132729 conn(0x20caeb0 msgr2=0x22fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 shutdown_connections 2023-12-24T18:52:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 1 -- 172.21.15.50:0/2291132729 wait complete. 2023-12-24T18:52:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.060+0000 7f93be47e740 20 client.7443 trim_cache size 0 max 16384 2023-12-24T18:52:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.080+0000 7f93be47e740 1 Processor -- start 2023-12-24T18:52:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.080+0000 7f93be47e740 1 -- start start 2023-12-24T18:52:46.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.080+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x232b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.080+0000 7f93be47e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.080+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x22fead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93be47e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x226f890 con 0x20caae0 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x22759d0 con 0x2115790 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x2212b80 con 0x20ca710 2023-12-24T18:52:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9f21700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x232b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44040/0 (socket says 172.21.15.50:44040) 2023-12-24T18:52:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 -- 172.21.15.50:0/3957357467 learned_addr learned my addr 172.21.15.50:0/3957357467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93ba722700 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x22fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 -- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 msgr2=0x232b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x232b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 -- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 msgr2=0x22fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x22fead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 -- 172.21.15.50:0/3957357467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2226d80 con 0x20caae0 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93ba722700 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x22fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f93b9720700 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f93b40ca4b0 tx=0x7f93a4017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd275a33d0c1dbc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f939f7fe700 1 -- 172.21.15.50:0/3957357467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4007740 con 0x20caae0 2023-12-24T18:52:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f939f7fe700 1 -- 172.21.15.50:0/3957357467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a401b030 con 0x20caae0 2023-12-24T18:52:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.084+0000 7f939f7fe700 1 -- 172.21.15.50:0/3957357467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e860 con 0x20caae0 2023-12-24T18:52:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- 172.21.15.50:0/3957357467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 msgr2=0x232bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f93b40ca4b0 tx=0x7f93a4017040 comp rx=0 tx=0).stop 2023-12-24T18:52:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- 172.21.15.50:0/3957357467 shutdown_connections 2023-12-24T18:52:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2115790 0x22fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x20caae0 0x232bcc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- 172.21.15.50:0/3957357467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x232b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- 172.21.15.50:0/3957357467 >> 172.21.15.50:0/3957357467 conn(0x20caeb0 msgr2=0x23477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- 172.21.15.50:0/3957357467 shutdown_connections 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- 172.21.15.50:0/3957357467 wait complete. 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 -- start start 2023-12-24T18:52:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 Processor -- start 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2301670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.088+0000 7f93be47e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20caae0 0x2301bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2249d60 con 0x2115790 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2238b00 con 0x20caae0 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x22c86d0 con 0x20ca710 2023-12-24T18:52:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 10 client.0 _ll_register_callbacks cb 0x20969d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44050/0 (socket says 172.21.15.50:44050) 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 -- 172.21.15.50:0/2920199038 learned_addr learned my addr 172.21.15.50:0/2920199038 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2301670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93b9720700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20caae0 0x2301bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 -- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 msgr2=0x2301670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2301670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 -- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20caae0 msgr2=0x2301bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20caae0 0x2301bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 -- 172.21.15.50:0/2920199038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a400f040 con 0x2115790 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93ba722700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f93ac003010 tx=0x7f93ac022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a344c77d63fdf38 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac038450 con 0x2115790 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93b4156ae0 con 0x2115790 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f93ac000e40 con 0x2115790 2023-12-24T18:52:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93ac0387c0 con 0x2115790 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 10 client.7449 fetch_fsmap learned FSMap version 53 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x221b130 con 0x2115790 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b4156ae0 con 0x2115790 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f93ac036070 con 0x2115790 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 10 client.7449 fetch_fsmap finished waiting for FSMap version 53 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 10 client.7449 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 20 client.7449 populate_metadata read hostname 'smithi050' 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x23a72e0 0x23a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 4 client.7449 mds_command: new command op to 7320 tid=0[{"prefix": "status"}] 2023-12-24T18:52:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.092+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 --> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f93b0069070 con 0x23a72e0 2023-12-24T18:52:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x23a72e0 0x23a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93b9f21700 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x23a72e0 0x23a96c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df101cbc39603949 server_cookie=a74cfe29c2536d4b in_seq=0 out_seq=0 2023-12-24T18:52:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f9393fff700 10 client.7449 ms_handle_connect on v2:172.21.15.50:6834/664091337 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f9393fff700 1 -- 172.21.15.50:0/2920199038 <== mds.0 v2:172.21.15.50:6834/664091337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7f93b0069070 con 0x23a72e0 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f9393fff700 10 client.7449 handle_command_reply: tid=0 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 client.7449 shutdown 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 msgr2=0x23020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f93ac003010 tx=0x7f93ac022000 comp rx=0 tx=0).stop 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 shutdown_connections 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:6834/664091337,v1:172.21.15.50:6835/664091337] conn(0x23a72e0 0x23a96c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2115790 0x23020f0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x20caae0 0x2301bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 --2- 172.21.15.50:0/2920199038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x20ca710 0x2301670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f9393fff700 0 client.7449 ms_handle_reset on v2:172.21.15.50:6834/664091337 2023-12-24T18:52:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 >> 172.21.15.50:0/2920199038 conn(0x20caeb0 msgr2=0x22fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 shutdown_connections 2023-12-24T18:52:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 1 -- 172.21.15.50:0/2920199038 wait complete. 2023-12-24T18:52:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.096+0000 7f93be47e740 20 client.7449 trim_cache size 0 max 16384 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7320, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.342818995, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 53, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 109, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 109, 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.237444311999999 2023-12-24T18:52:46.098 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:52:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 msgr2=0x7f9398062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 0x7f9398062a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).stop 2023-12-24T18:52:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 msgr2=0x7f93b40b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c930 tx=0x7f93b00016b0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 shutdown_connections 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9398060580 0x7f9398062a30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93b415c860 0x7f93b40c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b40ccdd0 0x7f93b40c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 --2- 172.21.15.50:0/2960525394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93b40cc980 0x7f93b40b4370 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 >> 172.21.15.50:0/2960525394 conn(0x7f93b40670b0 msgr2=0x7f93b40cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 shutdown_connections 2023-12-24T18:52:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.100+0000 7f93bc185700 1 -- 172.21.15.50:0/2960525394 wait complete. 2023-12-24T18:52:46.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:52:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.284+0000 7f302c816700 1 Processor -- start 2023-12-24T18:52:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.284+0000 7f302c816700 1 -- start start 2023-12-24T18:52:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f302c816700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f30281591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f302c816700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30280b41e0 0x7f3028159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f302c816700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302806b640 con 0x7f302806d8c0 2023-12-24T18:52:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f302c816700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3028159710 con 0x7f30280b41e0 2023-12-24T18:52:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f302c816700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b5e10 con 0x7f3028158e00 2023-12-24T18:52:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f3026ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f302806d8c0 0x7f30280b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44084/0 (socket says 172.21.15.50:44084) 2023-12-24T18:52:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f3026ffd700 1 -- 172.21.15.50:0/2440438556 learned_addr learned my addr 172.21.15.50:0/2440438556 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f3027fff700 1 --2- 172.21.15.50:0/2440438556 >> v2:172.21.15.82:3300/0 conn(0x7f30280b41e0 0x7f3028159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.288+0000 7f30277fe700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f30281591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f3027fff700 1 -- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 msgr2=0x7f30281591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f3027fff700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f30281591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f3027fff700 1 -- 172.21.15.50:0/2440438556 >> v1:172.21.15.50:6789/0 conn(0x7f302806d8c0 legacy=0x7f30280b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f3027fff700 1 -- 172.21.15.50:0/2440438556 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302806b8e0 con 0x7f30280b41e0 2023-12-24T18:52:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f30267fc700 1 -- 172.21.15.50:0/2440438556 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500308678 0 0) 0x7f302806b640 con 0x7f302806d8c0 2023-12-24T18:52:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f3027fff700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30280b41e0 0x7f3028159e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3020009e60 tx=0x7f3020009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b00555379c4cf2c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f30267fc700 1 -- 172.21.15.50:0/2440438556 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000e070 con 0x7f30280b41e0 2023-12-24T18:52:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f30267fc700 1 -- 172.21.15.50:0/2440438556 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000bb60 con 0x7f30280b41e0 2023-12-24T18:52:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f30267fc700 1 -- 172.21.15.50:0/2440438556 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020012430 con 0x7f30280b41e0 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 -- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30280b41e0 msgr2=0x7f3028159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30280b41e0 0x7f3028159e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3020009e60 tx=0x7f3020009780 comp rx=0 tx=0).stop 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 -- 172.21.15.50:0/2440438556 shutdown_connections 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30280b41e0 0x7f3028159e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 --2- 172.21.15.50:0/2440438556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f30281591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 -- 172.21.15.50:0/2440438556 >> 172.21.15.50:0/2440438556 conn(0x7f3028067b80 msgr2=0x7f30280b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 -- 172.21.15.50:0/2440438556 shutdown_connections 2023-12-24T18:52:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.292+0000 7f302c816700 1 -- 172.21.15.50:0/2440438556 wait complete. 2023-12-24T18:52:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.296+0000 7f302c816700 1 Processor -- start 2023-12-24T18:52:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.296+0000 7f302c816700 1 -- start start 2023-12-24T18:52:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 0x7f30280ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 0x7f3028168e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f3028154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b0c70 con 0x7f30280b41e0 2023-12-24T18:52:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30281693d0 con 0x7f302806d8c0 2023-12-24T18:52:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028169e80 con 0x7f3028158e00 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f3026ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 0x7f3028168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 0x7f30280ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f3026ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 0x7f3028168e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44064/0 (socket says 172.21.15.50:44064) 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f3026ffd700 1 -- 172.21.15.50:0/293659102 learned_addr learned my addr 172.21.15.50:0/293659102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f3027fff700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f3028154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 -- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 msgr2=0x7f3028154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f3028154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 -- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 msgr2=0x7f3028168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 0x7f3028168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 -- 172.21.15.50:0/293659102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020009a20 con 0x7f302806d8c0 2023-12-24T18:52:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f30277fe700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 0x7f30280ac170 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f301800e930 tx=0x7f30180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018013680 con 0x7f302806d8c0 2023-12-24T18:52:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30180137e0 con 0x7f302806d8c0 2023-12-24T18:52:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3028155150 con 0x7f302806d8c0 2023-12-24T18:52:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018013b80 con 0x7f302806d8c0 2023-12-24T18:52:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.300+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30281695e0 con 0x7f302806d8c0 2023-12-24T18:52:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.304+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028064950 con 0x7f302806d8c0 2023-12-24T18:52:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.304+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f30180123d0 con 0x7f302806d8c0 2023-12-24T18:52:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.308+0000 7f300f7fe700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 0x7f3014062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:46.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.308+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f301807c8d0 con 0x7f302806d8c0 2023-12-24T18:52:46.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.308+0000 7f3026ffd700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 0x7f3014062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:46.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.308+0000 7f3026ffd700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 0x7f3014062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f302815faf0 tx=0x7f301c007df0 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:46.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.312+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3028064950 con 0x7f302806d8c0 2023-12-24T18:52:46.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.524+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3028155150 con 0x7f302806d8c0 2023-12-24T18:52:46.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.524+0000 7f300f7fe700 1 -- 172.21.15.50:0/293659102 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3028155150 con 0x7f302806d8c0 2023-12-24T18:52:46.524 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:52:46.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 msgr2=0x7f3014062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 0x7f3014062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f302815faf0 tx=0x7f301c007df0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 msgr2=0x7f30280ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 0x7f30280ac170 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f301800e930 tx=0x7f30180091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 shutdown_connections 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3014060620 0x7f3014062ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3028158e00 0x7f3028154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30280b41e0 0x7f3028168e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 --2- 172.21.15.50:0/293659102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302806d8c0 0x7f30280ac170 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 >> 172.21.15.50:0/293659102 conn(0x7f3028067b80 msgr2=0x7f30280a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 shutdown_connections 2023-12-24T18:52:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:46.528+0000 7f302c816700 1 -- 172.21.15.50:0/293659102 wait complete. 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:52:46.550 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:46.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.551 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:52:46.573 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:52:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:52:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:52:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41444sec preferred_lft 41444sec 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:52:46.576 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.576 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:52:46.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.577 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:52:46.657 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:52:46.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.660 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:52:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:52:46.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.727 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:52:46.728 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:52:46.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:52:46.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:52:46.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:52:46.728 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:52:46.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.861 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:52:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:52:46.884 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:52:46.885 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:46.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:46.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:52:46.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:52:46.973 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:47.039 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:52:47.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:52:47.039 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:47.099 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:52:47.100 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:52:47.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:47.222 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:47.222 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:52:47.248 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:52:47.248 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:52:47.248 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:52:47.248 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:52:47.248 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:52:47.254 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:52:47.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:52:47.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:52:47.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:52:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.504+0000 7f1564acd700 1 Processor -- start 2023-12-24T18:52:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.504+0000 7f1564acd700 1 -- start start 2023-12-24T18:52:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f1564acd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1560159bc0 0x7f1560159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f1564acd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f156006bce0 0x7f15600aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f1564acd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156006b850 con 0x7f15600ab040 2023-12-24T18:52:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f1564acd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156006ac40 con 0x7f156006bce0 2023-12-24T18:52:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f1564acd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156006af20 con 0x7f1560159bc0 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.508+0000 7f155dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f156006bce0 0x7f15600aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f156006bce0 0x7f15600aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44076/0 (socket says 172.21.15.50:44076) 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 -- 172.21.15.50:0/1094822835 learned_addr learned my addr 172.21.15.50:0/1094822835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155e59c700 1 --2- 172.21.15.50:0/1094822835 >> v2:172.21.15.82:3300/0 conn(0x7f1560159bc0 0x7f1560159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 -- 172.21.15.50:0/1094822835 >> v2:172.21.15.82:3300/0 conn(0x7f1560159bc0 msgr2=0x7f1560159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:47.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 --2- 172.21.15.50:0/1094822835 >> v2:172.21.15.82:3300/0 conn(0x7f1560159bc0 0x7f1560159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 -- 172.21.15.50:0/1094822835 >> v1:172.21.15.82:6789/0 conn(0x7f15600ab040 legacy=0x7f15600ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155d59a700 1 -- 172.21.15.50:0/1094822835 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044791063 0 0) 0x7f156006b850 con 0x7f15600ab040 2023-12-24T18:52:47.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 -- 172.21.15.50:0/1094822835 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156006b200 con 0x7f156006bce0 2023-12-24T18:52:47.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155dd9b700 1 --2- 172.21.15.50:0/1094822835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f156006bce0 0x7f15600aab00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1560069ce0 tx=0x7f1554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6093c495b1caa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155d59a700 1 -- 172.21.15.50:0/1094822835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554009e70 con 0x7f156006bce0 2023-12-24T18:52:47.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155d59a700 1 -- 172.21.15.50:0/1094822835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400b860 con 0x7f156006bce0 2023-12-24T18:52:47.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f155d59a700 1 -- 172.21.15.50:0/1094822835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400bc00 con 0x7f156006bce0 2023-12-24T18:52:47.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 -- 172.21.15.50:0/1094822835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f156006bce0 msgr2=0x7f15600aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 --2- 172.21.15.50:0/1094822835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f156006bce0 0x7f15600aab00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1560069ce0 tx=0x7f1554009250 comp rx=0 tx=0).stop 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 -- 172.21.15.50:0/1094822835 shutdown_connections 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 --2- 172.21.15.50:0/1094822835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f156006bce0 0x7f15600aab00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 --2- 172.21.15.50:0/1094822835 >> v2:172.21.15.82:3300/0 conn(0x7f1560159bc0 0x7f1560159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 -- 172.21.15.50:0/1094822835 >> 172.21.15.50:0/1094822835 conn(0x7f15600cbba0 msgr2=0x7f15600cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 -- 172.21.15.50:0/1094822835 shutdown_connections 2023-12-24T18:52:47.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.512+0000 7f1564acd700 1 -- 172.21.15.50:0/1094822835 wait complete. 2023-12-24T18:52:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.516+0000 7f1564acd700 1 Processor -- start 2023-12-24T18:52:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.516+0000 7f1564acd700 1 -- start start 2023-12-24T18:52:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15600ab040 0x7f1560152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560159bc0 0x7f1560156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600a8d60 con 0x7f1560159bc0 2023-12-24T18:52:47.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600a9040 con 0x7f156006bce0 2023-12-24T18:52:47.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600a9320 con 0x7f15600ab040 2023-12-24T18:52:47.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:58468/0 (socket says 172.21.15.50:58468) 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 -- 172.21.15.50:0/3168491987 learned_addr learned my addr 172.21.15.50:0/3168491987 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155ed9d700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560159bc0 0x7f1560156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155dd9b700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15600ab040 0x7f1560152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 -- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15600ab040 msgr2=0x7f1560152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15600ab040 0x7f1560152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 -- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560159bc0 msgr2=0x7f1560156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560159bc0 0x7f1560156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 -- 172.21.15.50:0/3168491987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540094f0 con 0x7f156006bce0 2023-12-24T18:52:47.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f155e59c700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f155000ec80 tx=0x7f15500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155000c850 con 0x7f156006bce0 2023-12-24T18:52:47.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155000c9b0 con 0x7f156006bce0 2023-12-24T18:52:47.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600a9600 con 0x7f156006bce0 2023-12-24T18:52:47.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155000cd50 con 0x7f156006bce0 2023-12-24T18:52:47.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.520+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1560153350 con 0x7f156006bce0 2023-12-24T18:52:47.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.524+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156006b9e0 con 0x7f156006bce0 2023-12-24T18:52:47.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.524+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1550013680 con 0x7f156006bce0 2023-12-24T18:52:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.524+0000 7f154e7fc700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 0x7f1540062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.524+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f155007cd90 con 0x7f156006bce0 2023-12-24T18:52:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.528+0000 7f155dd9b700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 0x7f1540062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.528+0000 7f155dd9b700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 0x7f1540062ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1560069ce0 tx=0x7f1554017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.532+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f155004d020 con 0x7f156006bce0 2023-12-24T18:52:47.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.728+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f15600652e0 con 0x7f1540060600 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.728+0000 7f154e7fc700 1 -- 172.21.15.50:0/3168491987 <== mgr.7128 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f15600652e0 con 0x7f1540060600 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:52:47.729 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 msgr2=0x7f1540062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 0x7f1540062ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1560069ce0 tx=0x7f1554017000 comp rx=0 tx=0).stop 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 msgr2=0x7f156015d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f155000ec80 tx=0x7f15500091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 shutdown_connections 2023-12-24T18:52:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1540060600 0x7f1540062ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560159bc0 0x7f1560156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15600ab040 0x7f1560152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 --2- 172.21.15.50:0/3168491987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156006bce0 0x7f156015d540 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 >> 172.21.15.50:0/3168491987 conn(0x7f15600cbba0 msgr2=0x7f15600cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 shutdown_connections 2023-12-24T18:52:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.736+0000 7f1564acd700 1 -- 172.21.15.50:0/3168491987 wait complete. 2023-12-24T18:52:47.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:52:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.920+0000 7f0bc9a8e700 1 Processor -- start 2023-12-24T18:52:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.920+0000 7f0bc9a8e700 1 -- start start 2023-12-24T18:52:47.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.920+0000 7f0bc9a8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bc4159020 0x7f0bc40cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.920+0000 7f0bc9a8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bc40cccd0 0x7f0bc40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc9a8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40caa60 con 0x7f0bc4158c50 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc9a8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc40af430 con 0x7f0bc4159020 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc9a8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc4159450 con 0x7f0bc40cccd0 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc8a8c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0bc4158c50 0x7f0bc40caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51652/0 (socket says 172.21.15.50:51652) 2023-12-24T18:52:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc8a8c700 1 -- 172.21.15.50:0/2518008315 learned_addr learned my addr 172.21.15.50:0/2518008315 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/2518008315 >> v2:172.21.15.50:3300/0 conn(0x7f0bc4159020 0x7f0bc40cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc928d700 1 --2- 172.21.15.50:0/2518008315 >> v2:172.21.15.82:3300/0 conn(0x7f0bc40cccd0 0x7f0bc40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc37fe700 1 -- 172.21.15.50:0/2518008315 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170926096 0 0) 0x7f0bc40caa60 con 0x7f0bc4158c50 2023-12-24T18:52:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc37fe700 1 -- 172.21.15.50:0/2518008315 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb4003570 con 0x7f0bc4158c50 2023-12-24T18:52:47.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 -- 172.21.15.50:0/2518008315 >> v2:172.21.15.82:3300/0 conn(0x7f0bc40cccd0 msgr2=0x7f0bc40afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:47.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/2518008315 >> v2:172.21.15.82:3300/0 conn(0x7f0bc40cccd0 0x7f0bc40afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 -- 172.21.15.50:0/2518008315 >> v1:172.21.15.82:6789/0 conn(0x7f0bc4158c50 legacy=0x7f0bc40caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 -- 172.21.15.50:0/2518008315 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40cd100 con 0x7f0bc4159020 2023-12-24T18:52:47.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/2518008315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc4159020 0x7f0bc40cc790 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40afaf0 tx=0x7f0bb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658fb07f62dbb221 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc37fe700 1 -- 172.21.15.50:0/2518008315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011630 con 0x7f0bc4159020 2023-12-24T18:52:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc37fe700 1 -- 172.21.15.50:0/2518008315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb00117b0 con 0x7f0bc4159020 2023-12-24T18:52:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.924+0000 7f0bc37fe700 1 -- 172.21.15.50:0/2518008315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011b70 con 0x7f0bc4159020 2023-12-24T18:52:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/2518008315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc4159020 msgr2=0x7f0bc40cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/2518008315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc4159020 0x7f0bc40cc790 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40afaf0 tx=0x7f0bb00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/2518008315 shutdown_connections 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/2518008315 >> v2:172.21.15.82:3300/0 conn(0x7f0bc40cccd0 0x7f0bc40afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/2518008315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc4159020 0x7f0bc40cc790 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/2518008315 >> 172.21.15.50:0/2518008315 conn(0x7f0bc40670b0 msgr2=0x7f0bc40674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/2518008315 shutdown_connections 2023-12-24T18:52:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/2518008315 wait complete. 2023-12-24T18:52:47.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 Processor -- start 2023-12-24T18:52:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- start start 2023-12-24T18:52:47.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 0x7f0bc40c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0bc4159020 0x7f0bc40c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4169f60 con 0x7f0bc40cccd0 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40b1540 con 0x7f0bc4158c50 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc9a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4169c80 con 0x7f0bc4159020 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc8a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc8a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44100/0 (socket says 172.21.15.50:44100) 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.928+0000 7f0bc8a8c700 1 -- 172.21.15.50:0/1838483221 learned_addr learned my addr 172.21.15.50:0/1838483221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 0x7f0bc40c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc928d700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0bc4159020 0x7f0bc40c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 -- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0bc4159020 msgr2=0x7f0bc40c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0bc4159020 0x7f0bc40c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 -- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 msgr2=0x7f0bc40c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 0x7f0bc40c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 -- 172.21.15.50:0/1838483221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009420 con 0x7f0bc40cccd0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 0x7f0bc40c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc8a8c700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c7c0 tx=0x7f0bb8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8005b30 con 0x7f0bc40cccd0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8005c90 con 0x7f0bc40cccd0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8007340 con 0x7f0bc40cccd0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc40b0ef0 con 0x7f0bc40cccd0 2023-12-24T18:52:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc40c9ae0 con 0x7f0bc40cccd0 2023-12-24T18:52:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.932+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc40b0d50 con 0x7f0bc40cccd0 2023-12-24T18:52:47.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.936+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 45) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0bb801b400 con 0x7f0bc40cccd0 2023-12-24T18:52:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.936+0000 7f0bc0ff9700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 0x7f0ba8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.936+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f0bb807c5c0 con 0x7f0bc40cccd0 2023-12-24T18:52:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.936+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 0x7f0ba8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.936+0000 7f0bc3fff700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 0x7f0ba8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40afaf0 tx=0x7f0bb0017000 comp rx=0 tx=0).ready entity=mgr.7128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:47.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:47.940+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0bc40b0d50 con 0x7f0bc40cccd0 2023-12-24T18:52:48.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.152+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0bc40b0d50 con 0x7f0bc40cccd0 2023-12-24T18:52:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.224+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 46) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f0bb804cd40 con 0x7f0bc40cccd0 2023-12-24T18:52:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.224+0000 7f0bc0ff9700 1 -- 172.21.15.50:0/1838483221 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v46) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0bb8049240 con 0x7f0bc40cccd0 2023-12-24T18:52:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 msgr2=0x7f0ba8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 0x7f0ba8062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40afaf0 tx=0x7f0bb0017000 comp rx=0 tx=0).stop 2023-12-24T18:52:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 msgr2=0x7f0bc415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c7c0 tx=0x7f0bb8007e00 comp rx=0 tx=0).stop 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 shutdown_connections 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0ba8060550 0x7f0ba8062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0bc4159020 0x7f0bc40c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bc4158c50 0x7f0bc40c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 --2- 172.21.15.50:0/1838483221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc40cccd0 0x7f0bc415a990 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 >> 172.21.15.50:0/1838483221 conn(0x7f0bc40670b0 msgr2=0x7f0bc40cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 shutdown_connections 2023-12-24T18:52:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.228+0000 7f0bc9a8e700 1 -- 172.21.15.50:0/1838483221 wait complete. 2023-12-24T18:52:48.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:52:48.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 Processor -- start 2023-12-24T18:52:48.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 -- start start 2023-12-24T18:52:48.407 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:48.401+0000 7f909fbc8000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bf0158c50 0x7f6bf0159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6bf00caef0 0x7f6bf00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00af430 con 0x7f6bf00caef0 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00cd150 con 0x7f6bf0158c50 2023-12-24T18:52:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bef59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00caa60 con 0x7f6bf00cc790 2023-12-24T18:52:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6beed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bee59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bf0158c50 0x7f6bf0159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6beed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:44650/0 (socket says 172.21.15.50:44650) 2023-12-24T18:52:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6beed9d700 1 -- 172.21.15.50:0/3132980671 learned_addr learned my addr 172.21.15.50:0/3132980671 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.408+0000 7f6bedd9b700 1 --2- 172.21.15.50:0/3132980671 >> v2:172.21.15.50:3300/0 conn(0x7f6bf00caef0 0x7f6bf00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 -- 172.21.15.50:0/3132980671 >> v2:172.21.15.82:3300/0 conn(0x7f6bf0158c50 msgr2=0x7f6bf0159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 --2- 172.21.15.50:0/3132980671 >> v2:172.21.15.82:3300/0 conn(0x7f6bf0158c50 0x7f6bf0159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 -- 172.21.15.50:0/3132980671 >> v2:172.21.15.50:3300/0 conn(0x7f6bf00caef0 msgr2=0x7f6bf00cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 --2- 172.21.15.50:0/3132980671 >> v2:172.21.15.50:3300/0 conn(0x7f6bf00caef0 0x7f6bf00cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 -- 172.21.15.50:0/3132980671 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00cee80 con 0x7f6bf00cc790 2023-12-24T18:52:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6beed9d700 1 --2- 172.21.15.50:0/3132980671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bf006dcf0 tx=0x7f6be8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1234bd4bc01cf04c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bed59a700 1 -- 172.21.15.50:0/3132980671 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800e070 con 0x7f6bf00cc790 2023-12-24T18:52:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bed59a700 1 -- 172.21.15.50:0/3132980671 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800b970 con 0x7f6bf00cc790 2023-12-24T18:52:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bed59a700 1 -- 172.21.15.50:0/3132980671 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80092e0 con 0x7f6bf00cc790 2023-12-24T18:52:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 -- 172.21.15.50:0/3132980671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 msgr2=0x7f6bf00ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 --2- 172.21.15.50:0/3132980671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bf006dcf0 tx=0x7f6be8009840 comp rx=0 tx=0).stop 2023-12-24T18:52:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 -- 172.21.15.50:0/3132980671 shutdown_connections 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 --2- 172.21.15.50:0/3132980671 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf00ccc10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 --2- 172.21.15.50:0/3132980671 >> v2:172.21.15.50:3300/0 conn(0x7f6bf00caef0 0x7f6bf00cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 --2- 172.21.15.50:0/3132980671 >> v2:172.21.15.82:3300/0 conn(0x7f6bf0158c50 0x7f6bf0159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 -- 172.21.15.50:0/3132980671 >> 172.21.15.50:0/3132980671 conn(0x7f6bf00670b0 msgr2=0x7f6bf00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 -- 172.21.15.50:0/3132980671 shutdown_connections 2023-12-24T18:52:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.412+0000 7f6bef59e700 1 -- 172.21.15.50:0/3132980671 wait complete. 2023-12-24T18:52:48.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 Processor -- start 2023-12-24T18:52:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 -- start start 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf0158c50 0x7f6bf015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0156d80 con 0x7f6bf00caef0 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0157060 con 0x7f6bf0158c50 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bef59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0157340 con 0x7f6bf00cc790 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44158/0 (socket says 172.21.15.50:44158) 2023-12-24T18:52:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 -- 172.21.15.50:0/637639048 learned_addr learned my addr 172.21.15.50:0/637639048 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6beed9d700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf0158c50 0x7f6bf015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bedd9b700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 -- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 msgr2=0x7f6bf015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 -- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf0158c50 msgr2=0x7f6bf015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf0158c50 0x7f6bf015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.416+0000 7f6bee59c700 1 -- 172.21.15.50:0/637639048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009ae0 con 0x7f6bf00caef0 2023-12-24T18:52:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bee59c700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6be000e930 tx=0x7f6be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0013680 con 0x7f6bf00caef0 2023-12-24T18:52:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00137e0 con 0x7f6bf00caef0 2023-12-24T18:52:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0013b80 con 0x7f6bf00caef0 2023-12-24T18:52:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf0157620 con 0x7f6bf00caef0 2023-12-24T18:52:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00c3e20 con 0x7f6bf00caef0 2023-12-24T18:52:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0158360 con 0x7f6bf00caef0 2023-12-24T18:52:48.421 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:48.420+0000 7ff3a1f61000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:52:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.420+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 46) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f6be000c3e0 con 0x7f6bf00caef0 2023-12-24T18:52:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.424+0000 7f6bde7fc700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 0x7f6bd0062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.424+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f6be007cc00 con 0x7f6bf00caef0 2023-12-24T18:52:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.424+0000 7f6bedd9b700 1 -- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 msgr2=0x7f6bd0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.424+0000 7f6bedd9b700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 0x7f6bd0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.428+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6be0083080 con 0x7f6bf00caef0 2023-12-24T18:52:48.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.596+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6bf00ca230 con 0x7f6bf00caef0 2023-12-24T18:52:48.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.608+0000 7f6bde7fc700 1 -- 172.21.15.50:0/637639048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6bf00ca230 con 0x7f6bf00caef0 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 msgr2=0x7f6bd0062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 0x7f6bd0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 msgr2=0x7f6bf0157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6be000e930 tx=0x7f6be00091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 shutdown_connections 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bd00605a0 0x7f6bd0062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf0158c50 0x7f6bf015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6bf00cc790 0x7f6bf015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.612+0000 7f6bef59e700 1 --2- 172.21.15.50:0/637639048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bf00caef0 0x7f6bf0157e20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.616+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 >> 172.21.15.50:0/637639048 conn(0x7f6bf00670b0 msgr2=0x7f6bf00afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.616+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 shutdown_connections 2023-12-24T18:52:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.616+0000 7f6bef59e700 1 -- 172.21.15.50:0/637639048 wait complete. 2023-12-24T18:52:48.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:52:48.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.812+0000 7f5b6f278700 1 Processor -- start 2023-12-24T18:52:48.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.812+0000 7f5b6f278700 1 -- start start 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6f278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b6806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6f278700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680cd680 con 0x7f5b680cf8a0 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6f278700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680cca70 con 0x7f5b6806ae10 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6f278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68159640 con 0x7f5b680cf4d0 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6c813700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b680cf8a0 0x7f5b6806a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44098/0 (socket says 172.21.15.50:44098) 2023-12-24T18:52:48.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6c813700 1 -- 172.21.15.50:0/2351734069 learned_addr learned my addr 172.21.15.50:0/2351734069 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:48.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6d014700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b6806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821989596 0 0) 0x7f5b680cd680 con 0x7f5b680cf8a0 2023-12-24T18:52:48.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b54003570 con 0x7f5b680cf8a0 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469636657 0 0) 0x7f5b680cca70 con 0x7f5b6806ae10 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b680cd680 con 0x7f5b6806ae10 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789853369 0 0) 0x7f5b54003570 con 0x7f5b680cf8a0 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 msgr2=0x7f5b6806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b6806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 >> v1:172.21.15.82:6789/0 conn(0x7f5b6806ae10 legacy=0x7f5b680cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680ccd50 con 0x7f5b680cf8a0 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f5b58001470 con 0x7f5b680cf8a0 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6d014700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b6806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:52:48.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 >> v1:172.21.15.50:6789/0 conn(0x7f5b680cf8a0 legacy=0x7f5b6806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b54003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b54004160 0x7f5b54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68159640 con 0x7f5b54004d50 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5400bba0 con 0x7f5b54004160 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5400bd60 con 0x7f5b680cf4d0 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6d815700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6d014700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b54003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.816+0000 7f5b6c813700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b54004160 0x7f5b54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 -- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 msgr2=0x7f5b54003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680cf4d0 0x7f5b54003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 -- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b54004160 msgr2=0x7f5b54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b54004160 0x7f5b54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 -- 172.21.15.50:0/2351734069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b64009420 con 0x7f5b54004d50 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b540051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806b210 tx=0x7f5b600017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f31412df8992c02 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60001ab0 con 0x7f5b54004d50 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6000c8b0 con 0x7f5b54004d50 2023-12-24T18:52:48.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b5ffff700 1 -- 172.21.15.50:0/2351734069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000cc50 con 0x7f5b54004d50 2023-12-24T18:52:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 -- 172.21.15.50:0/2351734069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 msgr2=0x7f5b540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 --2- 172.21.15.50:0/2351734069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b540051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806b210 tx=0x7f5b600017a0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6d815700 1 -- 172.21.15.50:0/2351734069 reap_dead start 2023-12-24T18:52:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 -- 172.21.15.50:0/2351734069 shutdown_connections 2023-12-24T18:52:48.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 -- 172.21.15.50:0/2351734069 >> 172.21.15.50:0/2351734069 conn(0x7f5b68067b30 msgr2=0x7f5b680cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:48.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 -- 172.21.15.50:0/2351734069 shutdown_connections 2023-12-24T18:52:48.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.820+0000 7f5b6f278700 1 -- 172.21.15.50:0/2351734069 wait complete. 2023-12-24T18:52:48.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 Processor -- start 2023-12-24T18:52:48.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 -- start start 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 0x7f5b6814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680c8700 0x7f5b680c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6816d9b0 con 0x7f5b54004d50 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c90b0 con 0x7f5b680ca8a0 2023-12-24T18:52:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6f278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680cbc20 con 0x7f5b680c8700 2023-12-24T18:52:48.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44180/0 (socket says 172.21.15.50:44180) 2023-12-24T18:52:48.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 -- 172.21.15.50:0/1011267316 learned_addr learned my addr 172.21.15.50:0/1011267316 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:48.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6c813700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 0x7f5b6814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d815700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680c8700 0x7f5b680c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 -- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680c8700 msgr2=0x7f5b680c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680c8700 0x7f5b680c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 -- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 msgr2=0x7f5b6814a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 0x7f5b6814a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 -- 172.21.15.50:0/1011267316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680cc0b0 con 0x7f5b54004d50 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6c813700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 0x7f5b6814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.824+0000 7f5b6d014700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5b64011d70 tx=0x7f5b640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400fcd0 con 0x7f5b54004d50 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6400fe30 con 0x7f5b54004d50 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64014670 con 0x7f5b54004d50 2023-12-24T18:52:48.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b680cb010 con 0x7f5b54004d50 2023-12-24T18:52:48.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b680cb5d0 con 0x7f5b54004d50 2023-12-24T18:52:48.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b680652e0 con 0x7f5b54004d50 2023-12-24T18:52:48.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.828+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 46) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f5b64014a60 con 0x7f5b54004d50 2023-12-24T18:52:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.832+0000 7f5b5d7fa700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 0x7f5b4c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.832+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f5b64018030 con 0x7f5b54004d50 2023-12-24T18:52:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.832+0000 7f5b6c813700 1 -- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 msgr2=0x7f5b4c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.832+0000 7f5b6c813700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 0x7f5b4c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:48.840+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b6404da70 con 0x7f5b54004d50 2023-12-24T18:52:48.954 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:48.949+0000 7f909fbc8000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:49.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.008+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5b680cd030 con 0x7f5b54004d50 2023-12-24T18:52:49.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b5d7fa700 1 -- 172.21.15.50:0/1011267316 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5b64051090 con 0x7f5b54004d50 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 msgr2=0x7f5b4c062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 0x7f5b4c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 msgr2=0x7f5b6816d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5b64011d70 tx=0x7f5b640091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 shutdown_connections 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b4c0605a0 0x7f5b4c062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b680c8700 0x7f5b680c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b680ca8a0 0x7f5b6814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 --2- 172.21.15.50:0/1011267316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b54004d50 0x7f5b6816d470 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 >> 172.21.15.50:0/1011267316 conn(0x7f5b68067b30 msgr2=0x7f5b68158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:49.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 shutdown_connections 2023-12-24T18:52:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.016+0000 7f5b6f278700 1 -- 172.21.15.50:0/1011267316 wait complete. 2023-12-24T18:52:49.028 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.028+0000 7ff3a1f61000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:52:49.031 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.025+0000 7f909fbc8000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:49.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-12-24T18:52:49.103 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.104+0000 7ff3a1f61000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:52:49.179 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.173+0000 7f909fbc8000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.212+0000 7fb2f9dc5700 1 Processor -- start 2023-12-24T18:52:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 -- start start 2023-12-24T18:52:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2f41594d0 0x7fb2f40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f40cb550 con 0x7fb2f4159100 2023-12-24T18:52:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f4068800 con 0x7fb2f41594d0 2023-12-24T18:52:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.216+0000 7fb2f9dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4068ae0 con 0x7fb2f40cb130 2023-12-24T18:52:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2f41594d0 0x7fb2f40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2f4159100 0x7fb2f40c7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44102/0 (socket says 172.21.15.50:44102) 2023-12-24T18:52:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f37fe700 1 -- 172.21.15.50:0/2820562291 learned_addr learned my addr 172.21.15.50:0/2820562291 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f3fff700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2820562291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 msgr2=0x7fb2f406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:52:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2820562291 >> v1:172.21.15.50:6789/0 conn(0x7fb2f4159100 legacy=0x7fb2f40c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2820562291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4068dc0 con 0x7fb2f41594d0 2023-12-24T18:52:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f27fc700 1 -- 172.21.15.50:0/2820562291 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368672185 0 0) 0x7fb2f40cb550 con 0x7fb2f4159100 2023-12-24T18:52:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f41594d0 0x7fb2f40cabf0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80098e0 tx=0x7fb2e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845d6d6e920380c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f27fc700 1 -- 172.21.15.50:0/2820562291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800b640 con 0x7fb2f41594d0 2023-12-24T18:52:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f27fc700 1 -- 172.21.15.50:0/2820562291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800b7a0 con 0x7fb2f41594d0 2023-12-24T18:52:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f27fc700 1 -- 172.21.15.50:0/2820562291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bb40 con 0x7fb2f41594d0 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/2820562291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f41594d0 msgr2=0x7fb2f40cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f41594d0 0x7fb2f40cabf0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80098e0 tx=0x7fb2e80091a0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/2820562291 shutdown_connections 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/2820562291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f41594d0 0x7fb2f40cabf0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/2820562291 >> 172.21.15.50:0/2820562291 conn(0x7fb2f40ccf90 msgr2=0x7fb2f40c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:49.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/2820562291 shutdown_connections 2023-12-24T18:52:49.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.220+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/2820562291 wait complete. 2023-12-24T18:52:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 Processor -- start 2023-12-24T18:52:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 -- start start 2023-12-24T18:52:49.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 0x7fb2f4156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f415a580 con 0x7fb2f4159100 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40b0fa0 con 0x7fb2f41594d0 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.224+0000 7fb2f9dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40b1280 con 0x7fb2f40cb130 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44198/0 (socket says 172.21.15.50:44198) 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/800965907 learned_addr learned my addr 172.21.15.50:0/800965907 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f3fff700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 0x7fb2f4156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 msgr2=0x7fb2f414dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f414dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 msgr2=0x7fb2f4156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 0x7fb2f4156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8009420 con 0x7fb2f4159100 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f3fff700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 0x7fb2f4156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c33b0 tx=0x7fb2e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bb20 con 0x7fb2f4159100 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8011420 con 0x7fb2f4159100 2023-12-24T18:52:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f40b1560 con 0x7fb2f4159100 2023-12-24T18:52:49.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80117c0 con 0x7fb2f4159100 2023-12-24T18:52:49.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f40b1b20 con 0x7fb2f4159100 2023-12-24T18:52:49.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.228+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f40b1d10 con 0x7fb2f4159100 2023-12-24T18:52:49.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.232+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 46) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fb2e8011b70 con 0x7fb2f4159100 2023-12-24T18:52:49.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.232+0000 7fb2db7fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:49.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.232+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fb2e807e130 con 0x7fb2f4159100 2023-12-24T18:52:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.232+0000 7fb2f37fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.232+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:52:49.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.240+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2e804e3c0 con 0x7fb2f4159100 2023-12-24T18:52:49.260 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.260+0000 7ff3a1f61000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.432+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2f4071060 con 0x7fb2e00605a0 2023-12-24T18:52:49.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.436+0000 7fb2f37fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:49.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.436+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:52:49.453 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.449+0000 7f909fbc8000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:49.533 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.525+0000 7f909fbc8000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:49.548 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.548+0000 7ff3a1f61000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:52:49.625 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.624+0000 7ff3a1f61000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:49.762 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.757+0000 7f909fbc8000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.840+0000 7fb2f37fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:49.840+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:52:49.845 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.841+0000 7f909fbc8000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:49.861 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.860+0000 7ff3a1f61000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:52:49.947 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:49.948+0000 7ff3a1f61000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:52:49.949 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:49.941+0000 7f909fbc8000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:50.044 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:50.044+0000 7ff3a1f61000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:52:50.362 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:50.357+0000 7f909fbc8000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:50.462 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:50.460+0000 7ff3a1f61000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:52:50.533 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:50.525+0000 7f909fbc8000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:50.638 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:50.636+0000 7ff3a1f61000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:52:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:50.644+0000 7fb2f37fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:50.644+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:52:50.907 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:50.901+0000 7f909fbc8000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:51.028 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.028+0000 7ff3a1f61000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:52:51.131 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.125+0000 7f909fbc8000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:51.224 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.217+0000 7f909fbc8000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:51.253 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.252+0000 7ff3a1f61000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:52:51.296 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.289+0000 7f909fbc8000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:51.348 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.348+0000 7ff3a1f61000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:52:51.379 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.373+0000 7f909fbc8000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:51.425 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.424+0000 7ff3a1f61000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:52:51.508 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.508+0000 7ff3a1f61000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:52:51.594 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.589+0000 7f909fbc8000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:51.673 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.669+0000 7f909fbc8000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:51.736 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.736+0000 7ff3a1f61000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:52:51.767 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.761+0000 7f909fbc8000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:51.816 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.816+0000 7ff3a1f61000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:52:51.902 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:51.900+0000 7ff3a1f61000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:52:51.949 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:51.941+0000 7f909fbc8000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:52.035 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:52.029+0000 7f909fbc8000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:52.096 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:52.096+0000 7ff3a1f61000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:52:52.183 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:52.184+0000 7ff3a1f61000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:52:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.248+0000 7fb2f37fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:52:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.248+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:52:52.744 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:52:52.737+0000 7f909fbc8000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.808+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 47) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fb2e804e790 con 0x7fb2f4159100 2023-12-24T18:52:52.912 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:52.912+0000 7ff3a1f61000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:52:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.928+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 48) v1 ==== 79689+0+0 (secure 0 0 0) 0x7fb2e8055570 con 0x7fb2f4159100 2023-12-24T18:52:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.928+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e0062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:52:52.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:52.928+0000 7fb2db7fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e0062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:53.116 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff36226c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.116 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff36226c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.116 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff36226c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.116 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff36226c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.116 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff36226c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff360a69700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff360a69700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff360a69700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff360a69700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:52:53.116+0000 7ff360a69700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:52:53.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:53.940+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 49) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fb2e804f060 con 0x7fb2f4159100 2023-12-24T18:52:53.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:53.940+0000 7fb2db7fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e00629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:53.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:53.944+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2f4071060 con 0x7fb2e00605a0 2023-12-24T18:52:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:53.944+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e00629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:53.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:53.952+0000 7fb2f37fe700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e00629d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40011e0 tx=0x7fb2e4009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:54.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.064+0000 7fb2db7fe700 1 -- 172.21.15.50:0/800965907 <== mgr.7479 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb2f4071060 con 0x7fb2e00605a0 2023-12-24T18:52:54.063 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /bad-path 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 msgr2=0x7fb2e00629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e00629d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40011e0 tx=0x7fb2e4009040 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 msgr2=0x7fb2f41562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c33b0 tx=0x7fb2e8017000 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 shutdown_connections 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2e00605a0 0x7fb2e00629d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f41594d0 0x7fb2f4156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f4159100 0x7fb2f41562c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 --2- 172.21.15.50:0/800965907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2f40cb130 0x7fb2f414dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 >> 172.21.15.50:0/800965907 conn(0x7fb2f40ccf90 msgr2=0x7fb2f406ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 shutdown_connections 2023-12-24T18:52:54.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.068+0000 7fb2f9dc5700 1 -- 172.21.15.50:0/800965907 wait complete. 2023-12-24T18:52:54.095 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-12-24T18:52:54.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-12-24T18:52:54.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.284+0000 7ff388b63700 1 Processor -- start 2023-12-24T18:52:54.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.284+0000 7ff388b63700 1 -- start start 2023-12-24T18:52:54.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff388b63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3840c88a0 0x7ff3840c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:54.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff388b63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840c9670 con 0x7ff3840b1a40 2023-12-24T18:52:54.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff388b63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840c9360 con 0x7ff3840c9b00 2023-12-24T18:52:54.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff388b63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff384158340 con 0x7ff3840c88a0 2023-12-24T18:52:54.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff382ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff3840b1a40 0x7ff384158500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43934/0 (socket says 172.21.15.50:43934) 2023-12-24T18:52:54.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff382ffd700 1 -- 172.21.15.50:0/1897202947 learned_addr learned my addr 172.21.15.50:0/1897202947 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:52:54.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3837fe700 1 --2- 172.21.15.50:0/1897202947 >> v2:172.21.15.50:3300/0 conn(0x7ff3840c88a0 0x7ff3840c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:54.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3827fc700 1 -- 172.21.15.50:0/1897202947 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331445192 0 0) 0x7ff3840c9670 con 0x7ff3840b1a40 2023-12-24T18:52:54.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3827fc700 1 -- 172.21.15.50:0/1897202947 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003570 con 0x7ff3840b1a40 2023-12-24T18:52:54.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3837fe700 1 -- 172.21.15.50:0/1897202947 >> v1:172.21.15.82:6789/0 conn(0x7ff3840c9b00 legacy=0x7ff3840ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3837fe700 1 -- 172.21.15.50:0/1897202947 >> v1:172.21.15.50:6789/0 conn(0x7ff3840b1a40 legacy=0x7ff384158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3837fe700 1 -- 172.21.15.50:0/1897202947 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384157aa0 con 0x7ff3840c88a0 2023-12-24T18:52:54.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.288+0000 7ff3837fe700 1 --2- 172.21.15.50:0/1897202947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3840c8c70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff374009e60 tx=0x7ff374009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec4f9d2d0c8e9dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:54.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff3827fc700 1 -- 172.21.15.50:0/1897202947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37400e070 con 0x7ff3840c88a0 2023-12-24T18:52:54.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff3827fc700 1 -- 172.21.15.50:0/1897202947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37400bb60 con 0x7ff3840c88a0 2023-12-24T18:52:54.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff3827fc700 1 -- 172.21.15.50:0/1897202947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374012430 con 0x7ff3840c88a0 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 -- 172.21.15.50:0/1897202947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 msgr2=0x7ff3840c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 --2- 172.21.15.50:0/1897202947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3840c8c70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff374009e60 tx=0x7ff374009780 comp rx=0 tx=0).stop 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 -- 172.21.15.50:0/1897202947 shutdown_connections 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 --2- 172.21.15.50:0/1897202947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3840c8c70 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 -- 172.21.15.50:0/1897202947 >> 172.21.15.50:0/1897202947 conn(0x7ff3840af9b0 msgr2=0x7ff3840afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 -- 172.21.15.50:0/1897202947 shutdown_connections 2023-12-24T18:52:54.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 -- 172.21.15.50:0/1897202947 wait complete. 2023-12-24T18:52:54.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.292+0000 7ff388b63700 1 Processor -- start 2023-12-24T18:52:54.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- start start 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3840b1a40 0x7ff384154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3840c9b00 0x7ff384159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384169ec0 con 0x7ff3840c88a0 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841692f0 con 0x7ff3840c9b00 2023-12-24T18:52:54.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff384169590 con 0x7ff3840b1a40 2023-12-24T18:52:54.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:54.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33774/0 (socket says 172.21.15.50:33774) 2023-12-24T18:52:54.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 -- 172.21.15.50:0/1606455836 learned_addr learned my addr 172.21.15.50:0/1606455836 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:52:54.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff383fff700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3840c9b00 0x7ff384159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff3837fe700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3840b1a40 0x7ff384154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 -- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3840b1a40 msgr2=0x7ff384154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3840b1a40 0x7ff384154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 -- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3840c9b00 msgr2=0x7ff384159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3840c9b00 0x7ff384159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 -- 172.21.15.50:0/1606455836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009a20 con 0x7ff3840c88a0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff382ffd700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c590 tx=0x7ff378007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378005b30 con 0x7ff3840c88a0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378005cb0 con 0x7ff3840c88a0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff384169870 con 0x7ff3840c88a0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378007320 con 0x7ff3840c88a0 2023-12-24T18:52:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.296+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff384155420 con 0x7ff3840c88a0 2023-12-24T18:52:54.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.300+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840c91c0 con 0x7ff3840c88a0 2023-12-24T18:52:54.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.300+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 49) v1 ==== 79816+0+0 (secure 0 0 0) 0x7ff37801b3b0 con 0x7ff3840c88a0 2023-12-24T18:52:54.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.304+0000 7ff36b7fe700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 0x7ff3700628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:52:54.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.304+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6659+0+0 (secure 0 0 0) 0x7ff37807bcf0 con 0x7ff3840c88a0 2023-12-24T18:52:54.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.304+0000 7ff3837fe700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 0x7ff3700628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:52:54.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.304+0000 7ff3837fe700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 0x7ff3700628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097c0 tx=0x7ff374019000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:52:54.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.312+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff3840c91c0 con 0x7ff3840c88a0 2023-12-24T18:52:54.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.516+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3840c91c0 con 0x7ff3700603f0 2023-12-24T18:52:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.532+0000 7ff36b7fe700 1 -- 172.21.15.50:0/1606455836 <== mgr.7479 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7ff3840c91c0 con 0x7ff3700603f0 2023-12-24T18:52:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:52:54.534 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:52:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.536+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 msgr2=0x7ff3700628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.536+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 0x7ff3700628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097c0 tx=0x7ff374019000 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.536+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 msgr2=0x7ff3841596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.536+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c590 tx=0x7ff378007e00 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.536+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 shutdown_connections 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff3700603f0 0x7ff3700628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3840c9b00 0x7ff384159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3840c88a0 0x7ff3841596c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 --2- 172.21.15.50:0/1606455836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3840b1a40 0x7ff384154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 >> 172.21.15.50:0/1606455836 conn(0x7ff3840af9b0 msgr2=0x7ff384158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:52:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 shutdown_connections 2023-12-24T18:52:54.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:52:54.540+0000 7ff388b63700 1 -- 172.21.15.50:0/1606455836 wait complete. 2023-12-24T18:52:54.559 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:52:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-12-24T18:52:58.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:52:58.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:53:00.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:00.083+0000 7ff35324e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:53:00.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:00.083+0000 7ff35324e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:53:00.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:00.083+0000 7ff35324e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:53:00.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:00.083+0000 7ff35324e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:53:00.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:00.083+0000 7ff35324e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:53:28.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:53:28.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:53:54.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-12-24T18:53:54.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.746+0000 7f2f084f0700 1 Processor -- start 2023-12-24T18:53:54.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.746+0000 7f2f084f0700 1 -- start start 2023-12-24T18:53:54.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f0015b6e0 0x7f2f0006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0015b250 con 0x7f2f00154820 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f000ae550 con 0x7f2f000b1460 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f00158470 con 0x7f2f0015b6e0 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0628c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f00154820 0x7f2f000b0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60276/0 (socket says 172.21.15.50:60276) 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f06a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f0015b6e0 0x7f2f0006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0628c700 1 -- 172.21.15.50:0/1783752173 learned_addr learned my addr 172.21.15.50:0/1783752173 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:54.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0528a700 1 -- 172.21.15.50:0/1783752173 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960383685 0 0) 0x7f2f0015b250 con 0x7f2f00154820 2023-12-24T18:53:54.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0528a700 1 -- 172.21.15.50:0/1783752173 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eec003570 con 0x7f2f00154820 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f06a8d700 1 -- 172.21.15.50:0/1783752173 >> v1:172.21.15.82:6789/0 conn(0x7f2f000b1460 legacy=0x7f2f001574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f06a8d700 1 -- 172.21.15.50:0/1783752173 >> v1:172.21.15.50:6789/0 conn(0x7f2f00154820 legacy=0x7f2f000b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f06a8d700 1 -- 172.21.15.50:0/1783752173 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00158190 con 0x7f2f0015b6e0 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f06a8d700 1 --2- 172.21.15.50:0/1783752173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0015b6e0 0x7f2f0006c820 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009e60 tx=0x7f2ef8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4093b882436f98 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0528a700 1 -- 172.21.15.50:0/1783752173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800e070 con 0x7f2f0015b6e0 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0528a700 1 -- 172.21.15.50:0/1783752173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800bb60 con 0x7f2f0015b6e0 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f0528a700 1 -- 172.21.15.50:0/1783752173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8012430 con 0x7f2f0015b6e0 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 -- 172.21.15.50:0/1783752173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0015b6e0 msgr2=0x7f2f0006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.750+0000 7f2f084f0700 1 --2- 172.21.15.50:0/1783752173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0015b6e0 0x7f2f0006c820 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009e60 tx=0x7f2ef8009780 comp rx=0 tx=0).stop 2023-12-24T18:53:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 -- 172.21.15.50:0/1783752173 shutdown_connections 2023-12-24T18:53:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 --2- 172.21.15.50:0/1783752173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0015b6e0 0x7f2f0006c820 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 -- 172.21.15.50:0/1783752173 >> 172.21.15.50:0/1783752173 conn(0x7f2f00067b80 msgr2=0x7f2f000ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 -- 172.21.15.50:0/1783752173 shutdown_connections 2023-12-24T18:53:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 -- 172.21.15.50:0/1783752173 wait complete. 2023-12-24T18:53:54.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 Processor -- start 2023-12-24T18:53:54.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.754+0000 7f2f084f0700 1 -- start start 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f00154820 0x7f2f0016bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0015b6e0 0x7f2f000a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000c6af0 con 0x7f2f000b1460 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000a5d70 con 0x7f2f0015b6e0 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000a5a90 con 0x7f2f00154820 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53878/0 (socket says 172.21.15.50:53878) 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 -- 172.21.15.50:0/180597170 learned_addr learned my addr 172.21.15.50:0/180597170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f06a8d700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0015b6e0 0x7f2f000a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f05a8b700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f00154820 0x7f2f0016bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 -- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f00154820 msgr2=0x7f2f0016bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f00154820 0x7f2f0016bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 -- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0015b6e0 msgr2=0x7f2f000a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0015b6e0 0x7f2f000a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 -- 172.21.15.50:0/180597170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009a20 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f0628c700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c7c0 tx=0x7f2efc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc005b30 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc005c90 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f000c6d90 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc007300 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.758+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0016c520 con 0x7f2f000b1460 2023-12-24T18:53:54.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.762+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f000c6950 con 0x7f2f000b1460 2023-12-24T18:53:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.762+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 51) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f2efc01b3b0 con 0x7f2f000b1460 2023-12-24T18:53:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.766+0000 7f2ef67fc700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 0x7f2ee4062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.766+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f2efc07c670 con 0x7f2f000b1460 2023-12-24T18:53:54.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.766+0000 7f2f05a8b700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 0x7f2ee4062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.766+0000 7f2f05a8b700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 0x7f2ee4062c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f001590d0 tx=0x7f2ef0007ec0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:54.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.774+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f000c6950 con 0x7f2f000b1460 2023-12-24T18:53:54.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.970+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f000c6950 con 0x7f2ee40607e0 2023-12-24T18:53:54.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.986+0000 7f2ef67fc700 1 -- 172.21.15.50:0/180597170 <== mgr.7479 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f2f000c6950 con 0x7f2ee40607e0 2023-12-24T18:53:54.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:54.988 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:52:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-12-24T18:53:54.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 msgr2=0x7f2ee4062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 0x7f2ee4062c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f001590d0 tx=0x7f2ef0007ec0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 msgr2=0x7f2f001692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c7c0 tx=0x7f2efc007e00 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 shutdown_connections 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2ee40607e0 0x7f2ee4062c90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0015b6e0 0x7f2f000a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f00154820 0x7f2f0016bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 --2- 172.21.15.50:0/180597170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f000b1460 0x7f2f001692e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 >> 172.21.15.50:0/180597170 conn(0x7f2f00067b80 msgr2=0x7f2f00153700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 shutdown_connections 2023-12-24T18:53:54.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:54.990+0000 7f2f084f0700 1 -- 172.21.15.50:0/180597170 wait complete. 2023-12-24T18:53:55.016 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:52:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-12-24T18:53:55.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-12-24T18:53:55.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 Processor -- start 2023-12-24T18:53:55.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 -- start start 2023-12-24T18:53:55.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf2c15c3d0 0x7fbf2c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c0cb2b0 0x7fbf2c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c06b6b0 con 0x7fbf2c15c7a0 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c06c250 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf326f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0cba20 con 0x7fbf2c0cb2b0 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.186+0000 7fbf2bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf2c15c3d0 0x7fbf2c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf2c15c3d0 0x7fbf2c15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53880/0 (socket says 172.21.15.50:53880) 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf2c15c7a0 0x7fbf2c06bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60292/0 (socket says 172.21.15.50:60292) 2023-12-24T18:53:55.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 -- 172.21.15.50:0/1347806321 learned_addr learned my addr 172.21.15.50:0/1347806321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf30c8d700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c0cb2b0 0x7fbf2c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 -- 172.21.15.50:0/1347806321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c0cb2b0 msgr2=0x7fbf2c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c0cb2b0 0x7fbf2c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 -- 172.21.15.50:0/1347806321 >> v1:172.21.15.50:6789/0 conn(0x7fbf2c15c7a0 legacy=0x7fbf2c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 -- 172.21.15.50:0/1347806321 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c06ad80 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2bfff700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c15d810 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0099b0 tx=0x7fbf1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e44ff848edbd0a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2affd700 1 -- 172.21.15.50:0/1347806321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00b860 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2affd700 1 -- 172.21.15.50:0/1347806321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00b9c0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf2affd700 1 -- 172.21.15.50:0/1347806321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00bd60 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 -- 172.21.15.50:0/1347806321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 msgr2=0x7fbf2c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c15d810 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0099b0 tx=0x7fbf1c009250 comp rx=0 tx=0).stop 2023-12-24T18:53:55.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 -- 172.21.15.50:0/1347806321 shutdown_connections 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c0cb2b0 0x7fbf2c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 --2- 172.21.15.50:0/1347806321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c15d810 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 -- 172.21.15.50:0/1347806321 >> 172.21.15.50:0/1347806321 conn(0x7fbf2c0670b0 msgr2=0x7fbf2c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 -- 172.21.15.50:0/1347806321 shutdown_connections 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.190+0000 7fbf326f0700 1 -- 172.21.15.50:0/1347806321 wait complete. 2023-12-24T18:53:55.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 Processor -- start 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 -- start start 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf2c0cb2b0 0x7fbf2c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c15c7a0 0x7fbf2c0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c16dae0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0c5a00 con 0x7fbf2c0cb2b0 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf326f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c16ced0 con 0x7fbf2c15c7a0 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53886/0 (socket says 172.21.15.50:53886) 2023-12-24T18:53:55.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 -- 172.21.15.50:0/2510175207 learned_addr learned my addr 172.21.15.50:0/2510175207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:55.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf30c8d700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c15c7a0 0x7fbf2c0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2bfff700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf2c0cb2b0 0x7fbf2c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 -- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c15c7a0 msgr2=0x7fbf2c0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c15c7a0 0x7fbf2c0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 -- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf2c0cb2b0 msgr2=0x7fbf2c159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf2c0cb2b0 0x7fbf2c159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.194+0000 7fbf2b7fe700 1 -- 172.21.15.50:0/2510175207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0094f0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf2b7fe700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c7c0 tx=0x7fbf20007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20005a70 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf20005bf0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c16d1b0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200070d0 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c16d770 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c071060 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.198+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 51) v1 ==== 80194+0+0 (secure 0 0 0) 0x7fbf20007480 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.202+0000 7fbf13fff700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 0x7fbf18062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.202+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fbf2007c320 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.202+0000 7fbf2bfff700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 0x7fbf18062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.202+0000 7fbf2bfff700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 0x7fbf18062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0099b0 tx=0x7fbf1c017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.210+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf2004c250 con 0x7fbf2c15c3d0 2023-12-24T18:53:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.406+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf2c0b00e0 con 0x7fbf180607e0 2023-12-24T18:53:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.538+0000 7fbf13fff700 1 -- 172.21.15.50:0/2510175207 <== mgr.7479 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fbf2c0b00e0 con 0x7fbf180607e0 2023-12-24T18:53:55.540 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /bad-path 2023-12-24T18:53:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 msgr2=0x7fbf18062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 0x7fbf18062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0099b0 tx=0x7fbf1c017000 comp rx=0 tx=0).stop 2023-12-24T18:53:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 msgr2=0x7fbf2c0c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c7c0 tx=0x7fbf20007f70 comp rx=0 tx=0).stop 2023-12-24T18:53:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 shutdown_connections 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbf180607e0 0x7fbf18062c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf2c15c7a0 0x7fbf2c0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf2c15c3d0 0x7fbf2c0c6550 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 --2- 172.21.15.50:0/2510175207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf2c0cb2b0 0x7fbf2c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 >> 172.21.15.50:0/2510175207 conn(0x7fbf2c0670b0 msgr2=0x7fbf2c15a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 shutdown_connections 2023-12-24T18:53:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.542+0000 7fbf326f0700 1 -- 172.21.15.50:0/2510175207 wait complete. 2023-12-24T18:53:55.569 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-12-24T18:53:55.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:53:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 Processor -- start 2023-12-24T18:53:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 -- start start 2023-12-24T18:53:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6040156ab0 0x7f6040156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 0x7f60400adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400c87d0 0x7f60400c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604015b5a0 con 0x7f6040156ab0 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400c9150 con 0x7f60400adb50 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.742+0000 7f6046ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604015a990 con 0x7f60400c87d0 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6040156ab0 0x7f6040156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f60454e0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 0x7f60400adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f60454e0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 0x7f60400adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:52448/0 (socket says 172.21.15.50:52448) 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f60454e0700 1 -- 172.21.15.50:0/3494743323 learned_addr learned my addr 172.21.15.50:0/3494743323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f60464e2700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400c87d0 0x7f60400c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 -- 172.21.15.50:0/3494743323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400c87d0 msgr2=0x7f60400c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400c87d0 0x7f60400c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 -- 172.21.15.50:0/3494743323 >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 msgr2=0x7f60400adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 --2- 172.21.15.50:0/3494743323 >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 0x7f60400adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 -- 172.21.15.50:0/3494743323 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604015ac70 con 0x7f6040156ab0 2023-12-24T18:53:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6045ce1700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f6040156e80 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6040067fa0 tx=0x7f603c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f423b324d704567 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6044cdf700 1 -- 172.21.15.50:0/3494743323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c011630 con 0x7f6040156ab0 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6044cdf700 1 -- 172.21.15.50:0/3494743323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c011790 con 0x7f6040156ab0 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6044cdf700 1 -- 172.21.15.50:0/3494743323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c011b30 con 0x7f6040156ab0 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6046ce3700 1 -- 172.21.15.50:0/3494743323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 msgr2=0x7f6040156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.746+0000 7f6046ce3700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f6040156e80 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6040067fa0 tx=0x7f603c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 -- 172.21.15.50:0/3494743323 shutdown_connections 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 --2- 172.21.15.50:0/3494743323 >> v2:172.21.15.82:3300/0 conn(0x7f60400adb50 0x7f60400adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400c87d0 0x7f60400c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 --2- 172.21.15.50:0/3494743323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f6040156e80 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 -- 172.21.15.50:0/3494743323 >> 172.21.15.50:0/3494743323 conn(0x7f6040067250 msgr2=0x7f6040067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 -- 172.21.15.50:0/3494743323 shutdown_connections 2023-12-24T18:53:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 -- 172.21.15.50:0/3494743323 wait complete. 2023-12-24T18:53:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.750+0000 7f6046ce3700 1 Processor -- start 2023-12-24T18:53:55.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 -- start start 2023-12-24T18:53:55.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400adb50 0x7f60401576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60400c87d0 0x7f60400afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040158350 con 0x7f6040156ab0 2023-12-24T18:53:55.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c4410 con 0x7f60400c87d0 2023-12-24T18:53:55.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6046ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6040158070 con 0x7f60400adb50 2023-12-24T18:53:55.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53900/0 (socket says 172.21.15.50:53900) 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 -- 172.21.15.50:0/2261612592 learned_addr learned my addr 172.21.15.50:0/2261612592 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6045ce1700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400adb50 0x7f60401576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60454e0700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60400c87d0 0x7f60400afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 -- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400adb50 msgr2=0x7f60401576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400adb50 0x7f60401576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 -- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60400c87d0 msgr2=0x7f60400afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60400c87d0 0x7f60400afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 -- 172.21.15.50:0/2261612592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c009420 con 0x7f6040156ab0 2023-12-24T18:53:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f60464e2700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6038009fa0 tx=0x7f6038009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.754+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800ebc0 con 0x7f6040156ab0 2023-12-24T18:53:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.758+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800ed20 con 0x7f6040156ab0 2023-12-24T18:53:55.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.758+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038014670 con 0x7f6040156ab0 2023-12-24T18:53:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.758+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400c3dc0 con 0x7f6040156ab0 2023-12-24T18:53:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.758+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6040157c10 con 0x7f6040156ab0 2023-12-24T18:53:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.758+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6040157e30 con 0x7f6040156ab0 2023-12-24T18:53:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.762+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 51) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f60380149e0 con 0x7f6040156ab0 2023-12-24T18:53:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.762+0000 7f6035ffb700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 0x7f6024062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.762+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f603807d5e0 con 0x7f6040156ab0 2023-12-24T18:53:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.762+0000 7f6045ce1700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 0x7f6024062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.762+0000 7f6045ce1700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 0x7f6024062c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f603c0093f0 tx=0x7f603c017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.770+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6040157e30 con 0x7f6040156ab0 2023-12-24T18:53:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:55.982+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6040157e30 con 0x7f6040156ab0 2023-12-24T18:53:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.078+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f603804d8c0 con 0x7f6040156ab0 2023-12-24T18:53:56.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.078+0000 7f6035ffb700 1 -- 172.21.15.50:0/2261612592 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v52) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6038009a40 con 0x7f6040156ab0 2023-12-24T18:53:56.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 msgr2=0x7f6024062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 0x7f6024062c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f603c0093f0 tx=0x7f603c017000 comp rx=0 tx=0).stop 2023-12-24T18:53:56.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 msgr2=0x7f604016d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6038009fa0 tx=0x7f6038009900 comp rx=0 tx=0).stop 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 shutdown_connections 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60240607e0 0x7f6024062c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6040156ab0 0x7f604016d200 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60400c87d0 0x7f60400afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 --2- 172.21.15.50:0/2261612592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60400adb50 0x7f60401576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 >> 172.21.15.50:0/2261612592 conn(0x7f6040067250 msgr2=0x7f604006a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 shutdown_connections 2023-12-24T18:53:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.082+0000 7f6046ce3700 1 -- 172.21.15.50:0/2261612592 wait complete. 2023-12-24T18:53:56.104 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:53:56.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:53:56.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:53:56.185 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:53:56.186 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:53:56.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:53:56.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:53:56.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:53:56.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:53:56.232 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:53:56.265 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:56.259+0000 7f0e866de000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:53:56.295 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:56.294+0000 7f96bcef3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:53:56.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:53:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.498+0000 7fe6ba345700 1 Processor -- start 2023-12-24T18:53:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.498+0000 7fe6ba345700 1 -- start start 2023-12-24T18:53:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6ba345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 0x7fe6b406ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6ba345700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b415d660 con 0x7fe6b406a760 2023-12-24T18:53:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6ba345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b415cda0 con 0x7fe6b40c54d0 2023-12-24T18:53:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6ba345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b415d010 con 0x7fe6b41592d0 2023-12-24T18:53:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6b406a760 0x7fe6b4158bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60312/0 (socket says 172.21.15.50:60312) 2023-12-24T18:53:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b3fff700 1 -- 172.21.15.50:0/357041775 learned_addr learned my addr 172.21.15.50:0/357041775 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b37fe700 1 --2- 172.21.15.50:0/357041775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 0x7fe6b406ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b37fe700 1 -- 172.21.15.50:0/357041775 >> v1:172.21.15.82:6789/0 conn(0x7fe6b40c54d0 legacy=0x7fe6b40c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b37fe700 1 -- 172.21.15.50:0/357041775 >> v1:172.21.15.50:6789/0 conn(0x7fe6b406a760 legacy=0x7fe6b4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b37fe700 1 -- 172.21.15.50:0/357041775 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b415d2f0 con 0x7fe6b41592d0 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b2ffd700 1 -- 172.21.15.50:0/357041775 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631324937 0 0) 0x7fe6b415cda0 con 0x7fe6b40c54d0 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b37fe700 1 --2- 172.21.15.50:0/357041775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 0x7fe6b406ab30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009910 tx=0x7fe6a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60311ed4f0fbd53 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b2ffd700 1 -- 172.21.15.50:0/357041775 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800b860 con 0x7fe6b41592d0 2023-12-24T18:53:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b2ffd700 1 -- 172.21.15.50:0/357041775 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a800b9c0 con 0x7fe6b41592d0 2023-12-24T18:53:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.502+0000 7fe6b2ffd700 1 -- 172.21.15.50:0/357041775 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800bd60 con 0x7fe6b41592d0 2023-12-24T18:53:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- 172.21.15.50:0/357041775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 msgr2=0x7fe6b406ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 --2- 172.21.15.50:0/357041775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 0x7fe6b406ab30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009910 tx=0x7fe6a80091a0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- 172.21.15.50:0/357041775 shutdown_connections 2023-12-24T18:53:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 --2- 172.21.15.50:0/357041775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b41592d0 0x7fe6b406ab30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- 172.21.15.50:0/357041775 >> 172.21.15.50:0/357041775 conn(0x7fe6b4067b80 msgr2=0x7fe6b40cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- 172.21.15.50:0/357041775 shutdown_connections 2023-12-24T18:53:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- 172.21.15.50:0/357041775 wait complete. 2023-12-24T18:53:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 Processor -- start 2023-12-24T18:53:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- start start 2023-12-24T18:53:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b406a760 0x7fe6b416c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b41592d0 0x7fe6b40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40b5d40 con 0x7fe6b40c54d0 2023-12-24T18:53:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c7ec0 con 0x7fe6b41592d0 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.506+0000 7fe6ba345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40b5130 con 0x7fe6b406a760 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53920/0 (socket says 172.21.15.50:53920) 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 -- 172.21.15.50:0/4133371126 learned_addr learned my addr 172.21.15.50:0/4133371126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b88e2700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b41592d0 0x7fe6b40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b3fff700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b406a760 0x7fe6b416c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b406a760 msgr2=0x7fe6b416c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b406a760 0x7fe6b416c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b41592d0 msgr2=0x7fe6b40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b41592d0 0x7fe6b40b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 -- 172.21.15.50:0/4133371126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8009420 con 0x7fe6b40c54d0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6b37fe700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4069960 tx=0x7fe6a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801f070 con 0x7fe6b40c54d0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8002f70 con 0x7fe6b40c54d0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b40b5410 con 0x7fe6b40c54d0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8025420 con 0x7fe6b40c54d0 2023-12-24T18:53:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b40b59d0 con 0x7fe6b40c54d0 2023-12-24T18:53:56.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.510+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b40652e0 con 0x7fe6b40c54d0 2023-12-24T18:53:56.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.514+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fe6a8023070 con 0x7fe6b40c54d0 2023-12-24T18:53:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.514+0000 7fe69bfff700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 0x7fe6a0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.514+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fe6a807e380 con 0x7fe6b40c54d0 2023-12-24T18:53:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.514+0000 7fe6b3fff700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 msgr2=0x7fe6a0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.514+0000 7fe6b3fff700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 0x7fe6a0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.522+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6a804e210 con 0x7fe6b40c54d0 2023-12-24T18:53:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.718+0000 7fe6b3fff700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 msgr2=0x7fe6a0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.718+0000 7fe6b3fff700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 0x7fe6a0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:53:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.726+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6b40d0d30 con 0x7fe6b40c54d0 2023-12-24T18:53:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe69bfff700 1 -- 172.21.15.50:0/4133371126 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe6a8051830 con 0x7fe6b40c54d0 2023-12-24T18:53:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:56.730 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 msgr2=0x7fe6a0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 0x7fe6a0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 msgr2=0x7fe6b40b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4069960 tx=0x7fe6a8017000 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 shutdown_connections 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060790 0x7fe6a0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b41592d0 0x7fe6b40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b40c54d0 0x7fe6b40b45e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 --2- 172.21.15.50:0/4133371126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6b406a760 0x7fe6b416c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.730+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 >> 172.21.15.50:0/4133371126 conn(0x7fe6b4067b80 msgr2=0x7fe6b40cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:56.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.734+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 shutdown_connections 2023-12-24T18:53:56.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.734+0000 7fe6ba345700 1 -- 172.21.15.50:0/4133371126 wait complete. 2023-12-24T18:53:56.739 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:53:56.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:53:56.811 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:56.807+0000 7f0e866de000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:53:56.892 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:56.887+0000 7f0e866de000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:53:56.896 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:56.894+0000 7f96bcef3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:53:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.922+0000 7faf1bef0700 1 Processor -- start 2023-12-24T18:53:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.926+0000 7faf1bef0700 1 -- start start 2023-12-24T18:53:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.926+0000 7faf1bef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 0x7faf14159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1406b850 con 0x7faf1406bce0 2023-12-24T18:53:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1406ac40 con 0x7faf140ca110 2023-12-24T18:53:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1406af20 con 0x7faf14159bc0 2023-12-24T18:53:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1948b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf1406bce0 0x7faf140aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60316/0 (socket says 172.21.15.50:60316) 2023-12-24T18:53:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1948b700 1 -- 172.21.15.50:0/1845183138 learned_addr learned my addr 172.21.15.50:0/1845183138 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf19c8c700 1 --2- 172.21.15.50:0/1845183138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 0x7faf14159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf18c8a700 1 -- 172.21.15.50:0/1845183138 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019228837 0 0) 0x7faf1406b850 con 0x7faf1406bce0 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf18c8a700 1 -- 172.21.15.50:0/1845183138 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf00003570 con 0x7faf1406bce0 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf19c8c700 1 -- 172.21.15.50:0/1845183138 >> v1:172.21.15.82:6789/0 conn(0x7faf140ca110 legacy=0x7faf1406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf19c8c700 1 -- 172.21.15.50:0/1845183138 >> v1:172.21.15.50:6789/0 conn(0x7faf1406bce0 legacy=0x7faf140aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf19c8c700 1 -- 172.21.15.50:0/1845183138 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1406b200 con 0x7faf14159bc0 2023-12-24T18:53:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf19c8c700 1 --2- 172.21.15.50:0/1845183138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 0x7faf14159f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf10009910 tx=0x7faf100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b42f8a246cb833 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf18c8a700 1 -- 172.21.15.50:0/1845183138 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000b680 con 0x7faf14159bc0 2023-12-24T18:53:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf18c8a700 1 -- 172.21.15.50:0/1845183138 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000b7e0 con 0x7faf14159bc0 2023-12-24T18:53:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf18c8a700 1 -- 172.21.15.50:0/1845183138 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000bba0 con 0x7faf14159bc0 2023-12-24T18:53:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- 172.21.15.50:0/1845183138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 msgr2=0x7faf14159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1845183138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 0x7faf14159f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf10009910 tx=0x7faf100091a0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- 172.21.15.50:0/1845183138 shutdown_connections 2023-12-24T18:53:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1845183138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf14159bc0 0x7faf14159f90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.930+0000 7faf1bef0700 1 -- 172.21.15.50:0/1845183138 >> 172.21.15.50:0/1845183138 conn(0x7faf140cbba0 msgr2=0x7faf140cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:56.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.934+0000 7faf1bef0700 1 -- 172.21.15.50:0/1845183138 shutdown_connections 2023-12-24T18:53:56.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.934+0000 7faf1bef0700 1 -- 172.21.15.50:0/1845183138 wait complete. 2023-12-24T18:53:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.934+0000 7faf1bef0700 1 Processor -- start 2023-12-24T18:53:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.934+0000 7faf1bef0700 1 -- start start 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf1406bce0 0x7faf140b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf140ca110 0x7faf140c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140af5f0 con 0x7faf14159bc0 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140c3ba0 con 0x7faf1406bce0 2023-12-24T18:53:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140aa490 con 0x7faf140ca110 2023-12-24T18:53:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1948b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf140ca110 0x7faf140c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf19c8c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf1406bce0 0x7faf140b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53926/0 (socket says 172.21.15.50:53926) 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 -- 172.21.15.50:0/1592846898 learned_addr learned my addr 172.21.15.50:0/1592846898 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 -- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf140ca110 msgr2=0x7faf140c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf140ca110 0x7faf140c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 -- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf1406bce0 msgr2=0x7faf140b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf1406bce0 0x7faf140b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 -- 172.21.15.50:0/1592846898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009420 con 0x7faf14159bc0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1a48d700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c8e0 tx=0x7faf0c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c012630 con 0x7faf14159bc0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c012790 con 0x7faf14159bc0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf140aa770 con 0x7faf14159bc0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c012b50 con 0x7faf14159bc0 2023-12-24T18:53:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.938+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf14156490 con 0x7faf14159bc0 2023-12-24T18:53:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.942+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf140af760 con 0x7faf14159bc0 2023-12-24T18:53:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.942+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7faf0c01a3a0 con 0x7faf14159bc0 2023-12-24T18:53:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.946+0000 7faf09ffb700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 0x7faef8062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.946+0000 7faf19c8c700 1 -- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 msgr2=0x7faef8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.946+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7faf0c07d0e0 con 0x7faf14159bc0 2023-12-24T18:53:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.946+0000 7faf19c8c700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 0x7faef8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:56.950+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf140af760 con 0x7faf14159bc0 2023-12-24T18:53:56.976 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:56.974+0000 7f96bcef3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:53:57.035 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.031+0000 7f0e866de000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:53:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.122+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf140af760 con 0x7faf14159bc0 2023-12-24T18:53:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.126+0000 7faf09ffb700 1 -- 172.21.15.50:0/1592846898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16651 (secure 0 0 0) 0x7faf140af760 con 0x7faf14159bc0 2023-12-24T18:53:57.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:57.127 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":112,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:53:54.034353+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/87016676":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1623465615":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1236084802":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/830023472":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6837/33814":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:52.917291+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 msgr2=0x7faef8062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 0x7faef8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 msgr2=0x7faf140a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00c8e0 tx=0x7faf0c001710 comp rx=0 tx=0).stop 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 shutdown_connections 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faef8060790 0x7faef8062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf14159bc0 0x7faf140a91a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf140ca110 0x7faf140c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 --2- 172.21.15.50:0/1592846898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf1406bce0 0x7faf140b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 >> 172.21.15.50:0/1592846898 conn(0x7faf140cbba0 msgr2=0x7faf14159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 shutdown_connections 2023-12-24T18:53:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.130+0000 7faf1bef0700 1 -- 172.21.15.50:0/1592846898 wait complete. 2023-12-24T18:53:57.131 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.130+0000 7f96bcef3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:53:57.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:52:36.811573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:52:38.182270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:53:57.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:53:57.316 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.311+0000 7f0e866de000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:53:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.318+0000 7fd3902ae700 1 Processor -- start 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd3902ae700 1 -- start start 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd3902ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3880ac870 0x7fd3880acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd3902ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3881673a0 con 0x7fd3881662d0 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd3902ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd388166790 con 0x7fd38806a700 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd3902ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38806d8f0 con 0x7fd3880ac870 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd38e04a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3880ac870 0x7fd3880acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd38d849700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3881662d0 0x7fd38806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60326/0 (socket says 172.21.15.50:60326) 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd38d849700 1 -- 172.21.15.50:0/1043079069 learned_addr learned my addr 172.21.15.50:0/1043079069 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.322+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121874793 0 0) 0x7fd3881673a0 con 0x7fd3881662d0 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd374003550 con 0x7fd3881662d0 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190461552 0 0) 0x7fd388166790 con 0x7fd38806a700 2023-12-24T18:53:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3881673a0 con 0x7fd38806a700 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38e04a700 1 -- 172.21.15.50:0/1043079069 >> v1:172.21.15.82:6789/0 conn(0x7fd38806a700 legacy=0x7fd3880860e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38e04a700 1 -- 172.21.15.50:0/1043079069 >> v1:172.21.15.50:6789/0 conn(0x7fd3881662d0 legacy=0x7fd38806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38e04a700 1 -- 172.21.15.50:0/1043079069 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388166a70 con 0x7fd3880ac870 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38e04a700 1 --2- 172.21.15.50:0/1043079069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3880ac870 0x7fd3880acc40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd3840095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294ddc55c8421ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400c640 con 0x7fd3880ac870 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400c7a0 con 0x7fd3880ac870 2023-12-24T18:53:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.326+0000 7fd38d048700 1 -- 172.21.15.50:0/1043079069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400cb60 con 0x7fd3880ac870 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- 172.21.15.50:0/1043079069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3880ac870 msgr2=0x7fd3880acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 --2- 172.21.15.50:0/1043079069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3880ac870 0x7fd3880acc40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd3840095f0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- 172.21.15.50:0/1043079069 shutdown_connections 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 --2- 172.21.15.50:0/1043079069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3880ac870 0x7fd3880acc40 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- 172.21.15.50:0/1043079069 >> 172.21.15.50:0/1043079069 conn(0x7fd388067b30 msgr2=0x7fd3880cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- 172.21.15.50:0/1043079069 shutdown_connections 2023-12-24T18:53:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- 172.21.15.50:0/1043079069 wait complete. 2023-12-24T18:53:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 Processor -- start 2023-12-24T18:53:57.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.330+0000 7fd3902ae700 1 -- start start 2023-12-24T18:53:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd38806a700 0x7fd3880b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 0x7fd3880b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388152b50 con 0x7fd3881662d0 2023-12-24T18:53:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388152220 con 0x7fd3880ac870 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd388152500 con 0x7fd38806a700 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53946/0 (socket says 172.21.15.50:53946) 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 -- 172.21.15.50:0/3211410731 learned_addr learned my addr 172.21.15.50:0/3211410731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38d849700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 0x7fd3880b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e04a700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd38806a700 0x7fd3880b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 -- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd38806a700 msgr2=0x7fd3880b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd38806a700 0x7fd3880b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 -- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 msgr2=0x7fd3880b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 0x7fd3880b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 -- 172.21.15.50:0/3211410731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840091e0 con 0x7fd3881662d0 2023-12-24T18:53:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38d849700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 0x7fd3880b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd38e84b700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c860 tx=0x7fd380002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380002030 con 0x7fd3881662d0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3800021b0 con 0x7fd3881662d0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380012630 con 0x7fd3881662d0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3881527e0 con 0x7fd3881662d0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.334+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3880c1020 con 0x7fd3881662d0 2023-12-24T18:53:57.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.338+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388152d00 con 0x7fd3881662d0 2023-12-24T18:53:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.338+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fd380012a20 con 0x7fd3881662d0 2023-12-24T18:53:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.338+0000 7fd37e7fc700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 0x7fd36c062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.338+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fd38007cff0 con 0x7fd3881662d0 2023-12-24T18:53:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.338+0000 7fd38e04a700 1 -- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 msgr2=0x7fd36c062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.342+0000 7fd38e04a700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 0x7fd36c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:57.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.342+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd388152d00 con 0x7fd3881662d0 2023-12-24T18:53:57.396 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.391+0000 7f0e866de000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:53:57.417 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.414+0000 7f96bcef3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:53:57.497 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.494+0000 7f96bcef3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:53:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.510+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3880652e0 con 0x7fd3881662d0 2023-12-24T18:53:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.510+0000 7fd37e7fc700 1 -- 172.21.15.50:0/3211410731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd38004cdb0 con 0x7fd3881662d0 2023-12-24T18:53:57.514 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:53:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 msgr2=0x7fd36c062c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 0x7fd36c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 msgr2=0x7fd3880c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c860 tx=0x7fd380002700 comp rx=0 tx=0).stop 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 shutdown_connections 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd36c0607c0 0x7fd36c062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3881662d0 0x7fd3880c0940 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3880ac870 0x7fd3880b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 --2- 172.21.15.50:0/3211410731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd38806a700 0x7fd3880b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 >> 172.21.15.50:0/3211410731 conn(0x7fd388067b30 msgr2=0x7fd3880af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 shutdown_connections 2023-12-24T18:53:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.514+0000 7fd3902ae700 1 -- 172.21.15.50:0/3211410731 wait complete. 2023-12-24T18:53:57.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:53:57.620 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.615+0000 7f0e866de000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:53:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.698+0000 7f77576cd700 1 Processor -- start 2023-12-24T18:53:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.698+0000 7f77576cd700 1 -- start start 2023-12-24T18:53:57.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f77576cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77500cc340 0x7f77501562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f77576cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 0x7f77500692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f77576cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500697f0 con 0x7f7750150600 2023-12-24T18:53:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f77576cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775006dca0 con 0x7f77500cc340 2023-12-24T18:53:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f77576cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7750156c00 con 0x7f7750068e50 2023-12-24T18:53:57.705 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.699+0000 7f0e866de000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:53:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7754c68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77500cc340 0x7f77501562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7755469700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7750150600 0x7f7750157510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:37204/0 (socket says 172.21.15.50:37204) 2023-12-24T18:53:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7755469700 1 -- 172.21.15.50:0/3891063480 learned_addr learned my addr 172.21.15.50:0/3891063480 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7755c6a700 1 --2- 172.21.15.50:0/3891063480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 0x7f77500692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7747fff700 1 -- 172.21.15.50:0/3891063480 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140264551 0 0) 0x7f774c001110 con 0x7f7750150600 2023-12-24T18:53:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7755c6a700 1 -- 172.21.15.50:0/3891063480 >> v2:172.21.15.50:3300/0 conn(0x7f77500cc340 msgr2=0x7f77501562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.702+0000 7f7755c6a700 1 --2- 172.21.15.50:0/3891063480 >> v2:172.21.15.50:3300/0 conn(0x7f77500cc340 0x7f77501562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7755c6a700 1 -- 172.21.15.50:0/3891063480 >> v1:172.21.15.82:6789/0 conn(0x7f7750150600 legacy=0x7f7750157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7755c6a700 1 -- 172.21.15.50:0/3891063480 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750156ee0 con 0x7f7750068e50 2023-12-24T18:53:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7755c6a700 1 --2- 172.21.15.50:0/3891063480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 0x7f77500692b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7748009e60 tx=0x7f7748009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4673512d611f4d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7747fff700 1 -- 172.21.15.50:0/3891063480 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800e070 con 0x7f7750068e50 2023-12-24T18:53:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7747fff700 1 -- 172.21.15.50:0/3891063480 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800bb60 con 0x7f7750068e50 2023-12-24T18:53:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f7747fff700 1 -- 172.21.15.50:0/3891063480 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748012430 con 0x7f7750068e50 2023-12-24T18:53:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 -- 172.21.15.50:0/3891063480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 msgr2=0x7f77500692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 --2- 172.21.15.50:0/3891063480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 0x7f77500692b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7748009e60 tx=0x7f7748009780 comp rx=0 tx=0).stop 2023-12-24T18:53:57.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 -- 172.21.15.50:0/3891063480 shutdown_connections 2023-12-24T18:53:57.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 --2- 172.21.15.50:0/3891063480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750068e50 0x7f77500692b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 --2- 172.21.15.50:0/3891063480 >> v2:172.21.15.50:3300/0 conn(0x7f77500cc340 0x7f77501562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 -- 172.21.15.50:0/3891063480 >> 172.21.15.50:0/3891063480 conn(0x7f77500ccc80 msgr2=0x7f77500cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:57.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.706+0000 7f77576cd700 1 -- 172.21.15.50:0/3891063480 shutdown_connections 2023-12-24T18:53:57.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.710+0000 7f77576cd700 1 -- 172.21.15.50:0/3891063480 wait complete. 2023-12-24T18:53:57.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.710+0000 7f77576cd700 1 Processor -- start 2023-12-24T18:53:57.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.710+0000 7f77576cd700 1 -- start start 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 0x7f7750152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 0x7f77500cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501530c0 con 0x7f7750068e50 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750152820 con 0x7f77500cc340 2023-12-24T18:53:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f77576cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7750152b00 con 0x7f7750150600 2023-12-24T18:53:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53956/0 (socket says 172.21.15.50:53956) 2023-12-24T18:53:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 -- 172.21.15.50:0/2523440789 learned_addr learned my addr 172.21.15.50:0/2523440789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7754c68700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 0x7f7750152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755c6a700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 0x7f77500cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:57.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 -- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 msgr2=0x7f77500cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 0x7f77500cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 -- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 msgr2=0x7f7750152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 0x7f7750152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 -- 172.21.15.50:0/2523440789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748009a20 con 0x7f7750068e50 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7754c68700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 0x7f7750152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755c6a700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 0x7f77500cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.714+0000 7f7755469700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c810 tx=0x7f774c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c005b30 con 0x7f7750068e50 2023-12-24T18:53:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c005c90 con 0x7f7750068e50 2023-12-24T18:53:57.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c007300 con 0x7f7750068e50 2023-12-24T18:53:57.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750152de0 con 0x7f7750068e50 2023-12-24T18:53:57.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7750169020 con 0x7f7750068e50 2023-12-24T18:53:57.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500652e0 con 0x7f7750068e50 2023-12-24T18:53:57.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.718+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f774c01b3b0 con 0x7f7750068e50 2023-12-24T18:53:57.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.722+0000 7f77457fa700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 0x7f7734062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:57.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.722+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f774c07c330 con 0x7f7750068e50 2023-12-24T18:53:57.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.722+0000 7f7754c68700 1 -- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 msgr2=0x7f7734062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:57.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.722+0000 7f7754c68700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 0x7f7734062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.726+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f774c04c1c0 con 0x7f7750068e50 2023-12-24T18:53:57.751 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.750+0000 7f96bcef3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:53:57.795 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:57.791+0000 7f0e866de000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:53:57.845 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.842+0000 7f96bcef3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:53:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.898+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77500697f0 con 0x7f7750068e50 2023-12-24T18:53:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.898+0000 7f77457fa700 1 -- 172.21.15.50:0/2523440789 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77500697f0 con 0x7f7750068e50 2023-12-24T18:53:57.899 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 msgr2=0x7f7734062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 0x7f7734062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 msgr2=0x7f7750151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c810 tx=0x7f774c007c50 comp rx=0 tx=0).stop 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 shutdown_connections 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7734060790 0x7f7734062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7750150600 0x7f77500cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500cc340 0x7f7750152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 --2- 172.21.15.50:0/2523440789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7750068e50 0x7f7750151cd0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 >> 172.21.15.50:0/2523440789 conn(0x7f77500ccc80 msgr2=0x7f7750157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 shutdown_connections 2023-12-24T18:53:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:57.902+0000 7f77576cd700 1 -- 172.21.15.50:0/2523440789 wait complete. 2023-12-24T18:53:57.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:53:57.940 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:57.938+0000 7f96bcef3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:53:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.086+0000 7fb624e16700 1 Processor -- start 2023-12-24T18:53:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb624e16700 1 -- start start 2023-12-24T18:53:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb624e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 0x7fb62015a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb624e16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200abf90 con 0x7fb6200b2660 2023-12-24T18:53:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb624e16700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200ac270 con 0x7fb6201536f0 2023-12-24T18:53:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb624e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6200b2ae0 con 0x7fb620153320 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb61f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 0x7fb62015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb61ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6200b2660 0x7fb6200690f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60328/0 (socket says 172.21.15.50:60328) 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb61ffff700 1 -- 172.21.15.50:0/682139758 learned_addr learned my addr 172.21.15.50:0/682139758 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.090+0000 7fb61effd700 1 --1- 172.21.15.50:0/682139758 >> v1:172.21.15.82:6789/0 conn(0x7fb6201536f0 0x7fb6200ab740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:37214/0 (socket says 172.21.15.50:37214) 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61f7fe700 1 -- 172.21.15.50:0/682139758 >> v1:172.21.15.82:6789/0 conn(0x7fb6201536f0 legacy=0x7fb6200ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61f7fe700 1 -- 172.21.15.50:0/682139758 >> v1:172.21.15.50:6789/0 conn(0x7fb6200b2660 legacy=0x7fb6200690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61e7fc700 1 -- 172.21.15.50:0/682139758 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252840961 0 0) 0x7fb6200abf90 con 0x7fb6200b2660 2023-12-24T18:53:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61f7fe700 1 -- 172.21.15.50:0/682139758 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620159800 con 0x7fb620153320 2023-12-24T18:53:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61f7fe700 1 --2- 172.21.15.50:0/682139758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 0x7fb62015a000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb610009910 tx=0x7fb6100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcaa26765ae13497 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61e7fc700 1 -- 172.21.15.50:0/682139758 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000b860 con 0x7fb620153320 2023-12-24T18:53:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61e7fc700 1 -- 172.21.15.50:0/682139758 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000b9c0 con 0x7fb620153320 2023-12-24T18:53:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb61e7fc700 1 -- 172.21.15.50:0/682139758 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000bd60 con 0x7fb620153320 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 -- 172.21.15.50:0/682139758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 msgr2=0x7fb62015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 --2- 172.21.15.50:0/682139758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 0x7fb62015a000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb610009910 tx=0x7fb6100091a0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 -- 172.21.15.50:0/682139758 shutdown_connections 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 --2- 172.21.15.50:0/682139758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb620153320 0x7fb62015a000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 -- 172.21.15.50:0/682139758 >> 172.21.15.50:0/682139758 conn(0x7fb6200ccb70 msgr2=0x7fb6200ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 -- 172.21.15.50:0/682139758 shutdown_connections 2023-12-24T18:53:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.094+0000 7fb624e16700 1 -- 172.21.15.50:0/682139758 wait complete. 2023-12-24T18:53:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 Processor -- start 2023-12-24T18:53:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 -- start start 2023-12-24T18:53:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 0x7fb62015ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb620153320 0x7fb620154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 0x7fb6200ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62013ce60 con 0x7fb6201536f0 2023-12-24T18:53:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62016aa30 con 0x7fb620153320 2023-12-24T18:53:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb624e16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201556f0 con 0x7fb6200b2660 2023-12-24T18:53:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 0x7fb6200ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 0x7fb6200ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53958/0 (socket says 172.21.15.50:53958) 2023-12-24T18:53:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61ffff700 1 -- 172.21.15.50:0/1723920013 learned_addr learned my addr 172.21.15.50:0/1723920013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 0x7fb62015ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61effd700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb620153320 0x7fb620154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 -- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb620153320 msgr2=0x7fb620154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb620153320 0x7fb620154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 -- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 msgr2=0x7fb6200ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 0x7fb6200ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 -- 172.21.15.50:0/1723920013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009420 con 0x7fb6200b2660 2023-12-24T18:53:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb61f7fe700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 0x7fb62015ff50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb610016000 tx=0x7fb610017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.098+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61001f070 con 0x7fb6200b2660 2023-12-24T18:53:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610002f70 con 0x7fb6200b2660 2023-12-24T18:53:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6201559d0 con 0x7fb6200b2660 2023-12-24T18:53:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610025420 con 0x7fb6200b2660 2023-12-24T18:53:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62016a6c0 con 0x7fb6200b2660 2023-12-24T18:53:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62004be40 con 0x7fb6200b2660 2023-12-24T18:53:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.102+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fb610023070 con 0x7fb6200b2660 2023-12-24T18:53:58.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.106+0000 7fb6077fe700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 0x7fb60c062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.106+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fb61007dff0 con 0x7fb6200b2660 2023-12-24T18:53:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.106+0000 7fb61effd700 1 -- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 msgr2=0x7fb60c062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.106+0000 7fb61effd700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 0x7fb60c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:58.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.114+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb61004de80 con 0x7fb6200b2660 2023-12-24T18:53:58.204 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:58.199+0000 7f0e866de000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:53:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.290+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb620159540 con 0x7fb6200b2660 2023-12-24T18:53:58.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.290+0000 7fb6077fe700 1 -- 172.21.15.50:0/1723920013 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6100514a0 con 0x7fb6200b2660 2023-12-24T18:53:58.292 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 msgr2=0x7fb60c062c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 0x7fb60c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 msgr2=0x7fb62015ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 0x7fb62015ff50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb610016000 tx=0x7fb610017000 comp rx=0 tx=0).stop 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 shutdown_connections 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb60c0607c0 0x7fb60c062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6201536f0 0x7fb6200ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb620153320 0x7fb620154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 --2- 172.21.15.50:0/1723920013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6200b2660 0x7fb62015ff50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 >> 172.21.15.50:0/1723920013 conn(0x7fb6200ccb70 msgr2=0x7fb6200ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 shutdown_connections 2023-12-24T18:53:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.294+0000 7fb624e16700 1 -- 172.21.15.50:0/1723920013 wait complete. 2023-12-24T18:53:58.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:53:58.369 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:58.366+0000 7f96bcef3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:53:58.376 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:58.371+0000 7f0e866de000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:53:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 Processor -- start 2023-12-24T18:53:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 -- start start 2023-12-24T18:53:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f800c1551f0 0x7f800c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f800c06d0b0 0x7f800c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c155fe0 con 0x7f800c156470 2023-12-24T18:53:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06da20 con 0x7f800c1551f0 2023-12-24T18:53:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.514+0000 7f8012985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06b0f0 con 0x7f800c06d0b0 2023-12-24T18:53:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f800c1551f0 0x7f800c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f800c1551f0 0x7f800c1555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53966/0 (socket says 172.21.15.50:53966) 2023-12-24T18:53:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 -- 172.21.15.50:0/1757362479 learned_addr learned my addr 172.21.15.50:0/1757362479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8010f22700 1 --2- 172.21.15.50:0/1757362479 >> v2:172.21.15.82:3300/0 conn(0x7f800c06d0b0 0x7f800c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 -- 172.21.15.50:0/1757362479 >> v2:172.21.15.82:3300/0 conn(0x7f800c06d0b0 msgr2=0x7f800c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 --2- 172.21.15.50:0/1757362479 >> v2:172.21.15.82:3300/0 conn(0x7f800c06d0b0 0x7f800c06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 -- 172.21.15.50:0/1757362479 >> v1:172.21.15.50:6789/0 conn(0x7f800c156470 legacy=0x7f800c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 -- 172.21.15.50:0/1757362479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c06b3d0 con 0x7f800c1551f0 2023-12-24T18:53:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800bfff700 1 --2- 172.21.15.50:0/1757362479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1555c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f800c15a180 tx=0x7f7ffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23000aefa39c5eee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800affd700 1 -- 172.21.15.50:0/1757362479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc009e70 con 0x7f800c1551f0 2023-12-24T18:53:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800affd700 1 -- 172.21.15.50:0/1757362479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00b860 con 0x7f800c1551f0 2023-12-24T18:53:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f800affd700 1 -- 172.21.15.50:0/1757362479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00bc00 con 0x7f800c1551f0 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 -- 172.21.15.50:0/1757362479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 msgr2=0x7f800c1555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 --2- 172.21.15.50:0/1757362479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1555c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f800c15a180 tx=0x7f7ffc009250 comp rx=0 tx=0).stop 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 -- 172.21.15.50:0/1757362479 shutdown_connections 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 --2- 172.21.15.50:0/1757362479 >> v2:172.21.15.82:3300/0 conn(0x7f800c06d0b0 0x7f800c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 --2- 172.21.15.50:0/1757362479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1555c0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 -- 172.21.15.50:0/1757362479 >> 172.21.15.50:0/1757362479 conn(0x7f800c0cbba0 msgr2=0x7f800c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 -- 172.21.15.50:0/1757362479 shutdown_connections 2023-12-24T18:53:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.518+0000 7f8012985700 1 -- 172.21.15.50:0/1757362479 wait complete. 2023-12-24T18:53:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 Processor -- start 2023-12-24T18:53:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 -- start start 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c156470 0x7f800c0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c151670 con 0x7f800c1551f0 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c151910 con 0x7f800c156470 2023-12-24T18:53:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8012985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c151bf0 con 0x7f800c06d0b0 2023-12-24T18:53:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f800bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f800bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:33302/0 (socket says 172.21.15.50:33302) 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f800bfff700 1 -- 172.21.15.50:0/3488856443 learned_addr learned my addr 172.21.15.50:0/3488856443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f800b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.522+0000 7f8010f22700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c156470 0x7f800c0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c156470 msgr2=0x7f800c0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c156470 0x7f800c0c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 msgr2=0x7f800c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 -- 172.21.15.50:0/3488856443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0094f0 con 0x7f800c06d0b0 2023-12-24T18:53:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f800bfff700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f800c069fe0 tx=0x7f7ffc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00bbe0 con 0x7f800c06d0b0 2023-12-24T18:53:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc011420 con 0x7f800c06d0b0 2023-12-24T18:53:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c151ed0 con 0x7f800c06d0b0 2023-12-24T18:53:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0117c0 con 0x7f800c06d0b0 2023-12-24T18:53:58.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c1526d0 con 0x7f800c06d0b0 2023-12-24T18:53:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c0652e0 con 0x7f800c06d0b0 2023-12-24T18:53:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.526+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f7ffc011bf0 con 0x7f800c06d0b0 2023-12-24T18:53:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.530+0000 7f7ff3fff700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 0x7f7ff8062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.530+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f7ffc07e400 con 0x7f800c06d0b0 2023-12-24T18:53:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.530+0000 7f800b7fe700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 msgr2=0x7f7ff8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.530+0000 7f800b7fe700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 0x7f7ff8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.538+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ffc04e290 con 0x7f800c06d0b0 2023-12-24T18:53:58.556 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:58.554+0000 7f96bcef3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:53:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.734+0000 7f800b7fe700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 msgr2=0x7f7ff8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.734+0000 7f800b7fe700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 0x7f7ff8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:53:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.750+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f800c151d30 con 0x7f800c06d0b0 2023-12-24T18:53:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.750+0000 7f7ff3fff700 1 -- 172.21.15.50:0/3488856443 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f800c151d30 con 0x7f800c06d0b0 2023-12-24T18:53:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:58.753 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 msgr2=0x7f7ff8062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 0x7f7ff8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 msgr2=0x7f800c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f800c069fe0 tx=0x7f7ffc017000 comp rx=0 tx=0).stop 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 shutdown_connections 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7ff8060790 0x7f7ff8062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c156470 0x7f800c0c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c1551f0 0x7f800c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 --2- 172.21.15.50:0/3488856443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06d0b0 0x7f800c1424e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 >> 172.21.15.50:0/3488856443 conn(0x7f800c0cbba0 msgr2=0x7f800c0c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 shutdown_connections 2023-12-24T18:53:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.754+0000 7f8012985700 1 -- 172.21.15.50:0/3488856443 wait complete. 2023-12-24T18:53:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:53:58.762 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:58.759+0000 7f0e866de000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:53:58.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:53:58.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:53:58.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:53:58.957 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:58.958+0000 7f96bcef3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:53:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.978+0000 7f8087323700 1 Processor -- start 2023-12-24T18:53:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.978+0000 7f8087323700 1 -- start start 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8087323700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8080158cd0 0x7f80801590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8087323700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f808006b6c0 0x7f80800a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8087323700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800a9c80 con 0x7f808006c0c0 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8087323700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808006c510 con 0x7f808006b6c0 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8087323700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80800a8e10 con 0x7f8080158cd0 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f808006b6c0 0x7f80800a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8085b20700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f808006c0c0 0x7f808006afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:37222/0 (socket says 172.21.15.50:37222) 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8085b20700 1 -- 172.21.15.50:0/351860295 learned_addr learned my addr 172.21.15.50:0/351860295 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086321700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8080158cd0 0x7f80801590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 -- 172.21.15.50:0/351860295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8080158cd0 msgr2=0x7f80801590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8080158cd0 0x7f80801590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 -- 172.21.15.50:0/351860295 >> v1:172.21.15.82:6789/0 conn(0x7f808006c0c0 legacy=0x7f808006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f808531f700 1 -- 172.21.15.50:0/351860295 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200099632 0 0) 0x7f80800a9c80 con 0x7f808006c0c0 2023-12-24T18:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 -- 172.21.15.50:0/351860295 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800a9070 con 0x7f808006b6c0 2023-12-24T18:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f8086b22700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f808006b6c0 0x7f80800a88d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8078009e60 tx=0x7f8078009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bfceac3035c464 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f808531f700 1 -- 172.21.15.50:0/351860295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807800e070 con 0x7f808006b6c0 2023-12-24T18:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f808531f700 1 -- 172.21.15.50:0/351860295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807800bb60 con 0x7f808006b6c0 2023-12-24T18:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.982+0000 7f808531f700 1 -- 172.21.15.50:0/351860295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078012430 con 0x7f808006b6c0 2023-12-24T18:53:58.986 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:58.983+0000 7f0e866de000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:53:58.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- 172.21.15.50:0/351860295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f808006b6c0 msgr2=0x7f80800a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f808006b6c0 0x7f80800a88d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8078009e60 tx=0x7f8078009780 comp rx=0 tx=0).stop 2023-12-24T18:53:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- 172.21.15.50:0/351860295 shutdown_connections 2023-12-24T18:53:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f808006b6c0 0x7f80800a88d0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 --2- 172.21.15.50:0/351860295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8080158cd0 0x7f80801590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- 172.21.15.50:0/351860295 >> 172.21.15.50:0/351860295 conn(0x7f8080067b80 msgr2=0x7f80800cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- 172.21.15.50:0/351860295 shutdown_connections 2023-12-24T18:53:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- 172.21.15.50:0/351860295 wait complete. 2023-12-24T18:53:58.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 Processor -- start 2023-12-24T18:53:58.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.986+0000 7f8087323700 1 -- start start 2023-12-24T18:53:58.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f808006b6c0 0x7f8080149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808006c0c0 0x7f808015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808016cbc0 con 0x7f8080158cd0 2023-12-24T18:53:58.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080155a90 con 0x7f808006c0c0 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808015c020 con 0x7f808006b6c0 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54008/0 (socket says 172.21.15.50:54008) 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 -- 172.21.15.50:0/991581876 learned_addr learned my addr 172.21.15.50:0/991581876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8085b20700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808006c0c0 0x7f808015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086321700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f808006b6c0 0x7f8080149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 -- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f808006b6c0 msgr2=0x7f8080149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f808006b6c0 0x7f8080149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 -- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808006c0c0 msgr2=0x7f808015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808006c0c0 0x7f808015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 -- 172.21.15.50:0/991581876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078009a20 con 0x7f8080158cd0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8086b22700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8078013000 tx=0x7f8078019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078012ea0 con 0x7f8080158cd0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8078027470 con 0x7f8080158cd0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078027830 con 0x7f8080158cd0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.990+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808016c570 con 0x7f8080158cd0 2023-12-24T18:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.994+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80801499b0 con 0x7f8080158cd0 2023-12-24T18:53:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.994+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808016c3d0 con 0x7f8080158cd0 2023-12-24T18:53:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.994+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f8078024070 con 0x7f8080158cd0 2023-12-24T18:53:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.998+0000 7f80767fc700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 0x7f8064062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.998+0000 7f8086321700 1 -- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 msgr2=0x7f8064062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.998+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f807807f6d0 con 0x7f8080158cd0 2023-12-24T18:53:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:58.998+0000 7f8086321700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 0x7f8064062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.002+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f808016c3d0 con 0x7f8080158cd0 2023-12-24T18:53:59.079 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.075+0000 7f0e866de000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:53:59.161 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.155+0000 7f0e866de000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:53:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.178+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f808016c3d0 con 0x7f8080158cd0 2023-12-24T18:53:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.178+0000 7f80767fc700 1 -- 172.21.15.50:0/991581876 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f808016c3d0 con 0x7f8080158cd0 2023-12-24T18:53:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:59.182 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":112,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:53:54.034353+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/87016676":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1623465615":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1236084802":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/830023472":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6837/33814":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:52.917291+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 msgr2=0x7f8064062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 0x7f8064062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 msgr2=0x7f808015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8078013000 tx=0x7f8078019000 comp rx=0 tx=0).stop 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 shutdown_connections 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8064060790 0x7f8064062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080158cd0 0x7f808015b980 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808006c0c0 0x7f808015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 --2- 172.21.15.50:0/991581876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f808006b6c0 0x7f8080149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 >> 172.21.15.50:0/991581876 conn(0x7f8080067b80 msgr2=0x7f80800ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 shutdown_connections 2023-12-24T18:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.182+0000 7f8087323700 1 -- 172.21.15.50:0/991581876 wait complete. 2023-12-24T18:53:59.207 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:53:59.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:53:59.208 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.206+0000 7f96bcef3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:53:59.250 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.247+0000 7f0e866de000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:53:59.308 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.306+0000 7f96bcef3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:53:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.370+0000 7f7d9faae700 1 Processor -- start 2023-12-24T18:53:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.370+0000 7f7d9faae700 1 -- start start 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980ca3a0 0x7f7d980ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806ae10 0x7f7d9815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9806ca50 con 0x7f7d9806b260 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980c6980 con 0x7f7d980ca3a0 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9806b7f0 con 0x7f7d9806ae10 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980ca3a0 0x7f7d980ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d049700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806ae10 0x7f7d9815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980ca3a0 0x7f7d980ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50006/0 (socket says 172.21.15.50:50006) 2023-12-24T18:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 -- 172.21.15.50:0/3225643830 learned_addr learned my addr 172.21.15.50:0/3225643830 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 -- 172.21.15.50:0/3225643830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806ae10 msgr2=0x7f7d9815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 --2- 172.21.15.50:0/3225643830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806ae10 0x7f7d9815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 -- 172.21.15.50:0/3225643830 >> v1:172.21.15.82:6789/0 conn(0x7f7d9806b260 legacy=0x7f7d98160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 -- 172.21.15.50:0/3225643830 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9806bad0 con 0x7f7d980ca3a0 2023-12-24T18:53:59.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9c848700 1 -- 172.21.15.50:0/3225643830 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008184852 0 0) 0x7f7d9806ca50 con 0x7f7d9806b260 2023-12-24T18:53:59.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9d84a700 1 --2- 172.21.15.50:0/3225643830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d980ca770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009f20 tx=0x7f7d94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d5cb2d8ec55799 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:59.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9c848700 1 -- 172.21.15.50:0/3225643830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400e070 con 0x7f7d980ca3a0 2023-12-24T18:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9c848700 1 -- 172.21.15.50:0/3225643830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400b9d0 con 0x7f7d980ca3a0 2023-12-24T18:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9c848700 1 -- 172.21.15.50:0/3225643830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940092e0 con 0x7f7d980ca3a0 2023-12-24T18:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 -- 172.21.15.50:0/3225643830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 msgr2=0x7f7d980ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.374+0000 7f7d9faae700 1 --2- 172.21.15.50:0/3225643830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d980ca770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009f20 tx=0x7f7d94009840 comp rx=0 tx=0).stop 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 -- 172.21.15.50:0/3225643830 shutdown_connections 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 --2- 172.21.15.50:0/3225643830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806ae10 0x7f7d9815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 --2- 172.21.15.50:0/3225643830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d980ca770 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 -- 172.21.15.50:0/3225643830 >> 172.21.15.50:0/3225643830 conn(0x7f7d980cbba0 msgr2=0x7f7d980cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 -- 172.21.15.50:0/3225643830 shutdown_connections 2023-12-24T18:53:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 -- 172.21.15.50:0/3225643830 wait complete. 2023-12-24T18:53:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 Processor -- start 2023-12-24T18:53:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.378+0000 7f7d9faae700 1 -- start start 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 0x7f7d981605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 0x7f7d9815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98160af0 con 0x7f7d980ca3a0 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98160120 con 0x7f7d9806ae10 2023-12-24T18:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9815f510 con 0x7f7d9806b260 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9e04b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 0x7f7d981605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9e04b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50016/0 (socket says 172.21.15.50:50016) 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9e04b700 1 -- 172.21.15.50:0/977831235 learned_addr learned my addr 172.21.15.50:0/977831235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d049700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 0x7f7d9815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 msgr2=0x7f7d9815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 0x7f7d9815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 msgr2=0x7f7d9815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 -- 172.21.15.50:0/977831235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94009ae0 con 0x7f7d9806ae10 2023-12-24T18:53:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9e04b700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:53:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d049700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 0x7f7d9815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:53:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9d84a700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 0x7f7d981605b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ccb90 tx=0x7f7d94018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94007760 con 0x7f7d9806ae10 2023-12-24T18:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d940078e0 con 0x7f7d9806ae10 2023-12-24T18:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94007ca0 con 0x7f7d9806ae10 2023-12-24T18:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9815f7f0 con 0x7f7d9806ae10 2023-12-24T18:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.382+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9815fdb0 con 0x7f7d9806ae10 2023-12-24T18:53:59.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d980652e0 con 0x7f7d9806ae10 2023-12-24T18:53:59.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f7d9401c410 con 0x7f7d9806ae10 2023-12-24T18:53:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d8dffb700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 0x7f7d7c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f7d9407e8e0 con 0x7f7d9806ae10 2023-12-24T18:53:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d9d049700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 msgr2=0x7f7d7c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.386+0000 7f7d9d049700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 0x7f7d7c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:59.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.394+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d9404e660 con 0x7f7d9806ae10 2023-12-24T18:53:59.397 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.394+0000 7f96bcef3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:53:59.485 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.482+0000 7f96bcef3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:53:59.487 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.483+0000 7f0e866de000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:53:59.570 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.567+0000 7f0e866de000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:53:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.590+0000 7f7d9d049700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 msgr2=0x7f7d7c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:59.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.590+0000 7f7d9d049700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 0x7f7d7c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:53:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.602+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d9806bdb0 con 0x7f7d9806ae10 2023-12-24T18:53:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.606+0000 7f7d8dffb700 1 -- 172.21.15.50:0/977831235 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f7d94051c80 con 0x7f7d9806ae10 2023-12-24T18:53:59.606 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:53:59.606 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:53:59.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 msgr2=0x7f7d7c062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:53:59.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 0x7f7d7c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 msgr2=0x7f7d981605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 0x7f7d981605b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ccb90 tx=0x7f7d94018000 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 shutdown_connections 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d7c060790 0x7f7d7c062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980ca3a0 0x7f7d9815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d9806b260 0x7f7d9815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 --2- 172.21.15.50:0/977831235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d9806ae10 0x7f7d981605b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 >> 172.21.15.50:0/977831235 conn(0x7f7d980cbba0 msgr2=0x7f7d980c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 shutdown_connections 2023-12-24T18:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.610+0000 7f7d9faae700 1 -- 172.21.15.50:0/977831235 wait complete. 2023-12-24T18:53:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:53:59.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:53:59.659 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.655+0000 7f0e866de000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:53:59.730 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.730+0000 7f96bcef3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:53:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 Processor -- start 2023-12-24T18:53:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 -- start start 2023-12-24T18:53:59.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 0x7f9bd41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd406b640 con 0x7f9bd406d8c0 2023-12-24T18:53:59.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd40b5e10 con 0x7f9bd40b41e0 2023-12-24T18:53:59.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd8dcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4159710 con 0x7f9bd4158e00 2023-12-24T18:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9bd406d8c0 0x7f9bd40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45204/0 (socket says 172.21.15.50:45204) 2023-12-24T18:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd2ffd700 1 -- 172.21.15.50:0/3532204145 learned_addr learned my addr 172.21.15.50:0/3532204145 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/3532204145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 0x7f9bd41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460360108 0 0) 0x7f9bd406b640 con 0x7f9bd406d8c0 2023-12-24T18:53:59.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.798+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc003570 con 0x7f9bd406d8c0 2023-12-24T18:53:59.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788665876 0 0) 0x7f9bd40b5e10 con 0x7f9bd40b41e0 2023-12-24T18:53:59.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd406b640 con 0x7f9bd40b41e0 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165010377 0 0) 0x7f9bbc003570 con 0x7f9bd406d8c0 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd37fe700 1 -- 172.21.15.50:0/3532204145 >> v1:172.21.15.82:6789/0 conn(0x7f9bd40b41e0 legacy=0x7f9bd4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd37fe700 1 -- 172.21.15.50:0/3532204145 >> v1:172.21.15.50:6789/0 conn(0x7f9bd406d8c0 legacy=0x7f9bd40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd37fe700 1 -- 172.21.15.50:0/3532204145 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd406b8e0 con 0x7f9bd4158e00 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/3532204145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 0x7f9bd41591d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009910 tx=0x7f9bc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60464b07ccb831aa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8001470 con 0x7f9bd4158e00 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4011420 con 0x7f9bd4158e00 2023-12-24T18:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd27fc700 1 -- 172.21.15.50:0/3532204145 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40117a0 con 0x7f9bd4158e00 2023-12-24T18:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/3532204145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 msgr2=0x7f9bd41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/3532204145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 0x7f9bd41591d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009910 tx=0x7f9bc40091a0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/3532204145 shutdown_connections 2023-12-24T18:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/3532204145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd4158e00 0x7f9bd41591d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/3532204145 >> 172.21.15.50:0/3532204145 conn(0x7f9bd4067b80 msgr2=0x7f9bd40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:53:59.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/3532204145 shutdown_connections 2023-12-24T18:53:59.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.802+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/3532204145 wait complete. 2023-12-24T18:53:59.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 Processor -- start 2023-12-24T18:53:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 -- start start 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 0x7f9bd408ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 0x7f9bd40b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd408a980 con 0x7f9bd40b41e0 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4089d70 con 0x7f9bd4158e00 2023-12-24T18:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd8dcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd408a050 con 0x7f9bd406d8c0 2023-12-24T18:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50028/0 (socket says 172.21.15.50:50028) 2023-12-24T18:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 -- 172.21.15.50:0/1681882131 learned_addr learned my addr 172.21.15.50:0/1681882131 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 0x7f9bd408ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd3fff700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 0x7f9bd40b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 msgr2=0x7f9bd408ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 0x7f9bd408ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 msgr2=0x7f9bd40b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 0x7f9bd40b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd2ffd700 1 -- 172.21.15.50:0/1681882131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4009420 con 0x7f9bd40b41e0 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 0x7f9bd408ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.806+0000 7f9bd3fff700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 0x7f9bd40b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bd2ffd700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800cb60 tx=0x7f9bc8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8007e90 con 0x7f9bd40b41e0 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8007360 con 0x7f9bd40b41e0 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8004830 con 0x7f9bd40b41e0 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd408a330 con 0x7f9bd40b41e0 2023-12-24T18:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd40d0af0 con 0x7f9bd40b41e0 2023-12-24T18:53:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.810+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd408ab30 con 0x7f9bd40b41e0 2023-12-24T18:53:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.814+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f9bc8004ba0 con 0x7f9bd40b41e0 2023-12-24T18:53:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.818+0000 7f9bbb7fe700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 0x7f9bc0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:53:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.818+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f9bc807c400 con 0x7f9bd40b41e0 2023-12-24T18:53:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.818+0000 7f9bd37fe700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 msgr2=0x7f9bc0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:53:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.818+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 0x7f9bc0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:53:59.820 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.818+0000 7f96bcef3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:53:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:53:59.822+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9bd408ab30 con 0x7f9bd40b41e0 2023-12-24T18:53:59.881 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.875+0000 7f0e866de000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:53:59.917 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:53:59.914+0000 7f96bcef3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:53:59.974 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:53:59.971+0000 7f0e866de000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:54:00.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.022+0000 7f9bd37fe700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 msgr2=0x7f9bc0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:00.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.022+0000 7f9bd37fe700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 0x7f9bc0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:54:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.026+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bd404be40 con 0x7f9bd40b41e0 2023-12-24T18:54:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.026+0000 7f9bbb7fe700 1 -- 172.21.15.50:0/1681882131 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f9bc804c310 con 0x7f9bd40b41e0 2023-12-24T18:54:00.028 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:00.028 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:52:39.193083+0000","modified":"2023-12-24T18:52:42.767460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/664091337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":664091337},{"type":"v1","addr":"172.21.15.50:6835","nonce":664091337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 msgr2=0x7f9bc0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 0x7f9bc0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 msgr2=0x7f9bd40d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800cb60 tx=0x7f9bc8001ad0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 shutdown_connections 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9bc0060790 0x7f9bc0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd4158e00 0x7f9bd40b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd40b41e0 0x7f9bd40d05b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 --2- 172.21.15.50:0/1681882131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9bd406d8c0 0x7f9bd408ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 >> 172.21.15.50:0/1681882131 conn(0x7f9bd4067b80 msgr2=0x7f9bd40a96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 shutdown_connections 2023-12-24T18:54:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.030+0000 7f9bd8dcc700 1 -- 172.21.15.50:0/1681882131 wait complete. 2023-12-24T18:54:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-12-24T18:54:00.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:54:00.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:00.178+0000 7f96bcef3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:54:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 Processor -- start 2023-12-24T18:54:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 -- start start 2023-12-24T18:54:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d00158e70 0x7f8d000cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d000c9f40 0x7f8d000680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000686e0 con 0x7f8d000cc6a0 2023-12-24T18:54:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000ccb20 con 0x7f8d000c9f40 2023-12-24T18:54:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8d04ccd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000689c0 con 0x7f8d00158e70 2023-12-24T18:54:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8cfe59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d00158e70 0x7f8d000cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d00158e70 0x7f8d000cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:60298/0 (socket says 172.21.15.50:60298) 2023-12-24T18:54:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2298719223 learned_addr learned my addr 172.21.15.50:0/2298719223 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.214+0000 7f8cfed9d700 1 --2- 172.21.15.50:0/2298719223 >> v2:172.21.15.50:3300/0 conn(0x7f8d000c9f40 0x7f8d000680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cf7fff700 1 --1- 172.21.15.50:0/2298719223 >> v1:172.21.15.82:6789/0 conn(0x7f8d000cc6a0 0x7f8d000679b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:33692/0 (socket says 172.21.15.50:33692) 2023-12-24T18:54:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2298719223 >> v2:172.21.15.50:3300/0 conn(0x7f8d000c9f40 msgr2=0x7f8d000680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 --2- 172.21.15.50:0/2298719223 >> v2:172.21.15.50:3300/0 conn(0x7f8d000c9f40 0x7f8d000680c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2298719223 >> v1:172.21.15.82:6789/0 conn(0x7f8d000cc6a0 legacy=0x7f8d000679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfdd9b700 1 -- 172.21.15.50:0/2298719223 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791193189 0 0) 0x7f8d000686e0 con 0x7f8d000cc6a0 2023-12-24T18:54:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2298719223 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00068ca0 con 0x7f8d00158e70 2023-12-24T18:54:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfe59c700 1 --2- 172.21.15.50:0/2298719223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d00158e70 0x7f8d000cc160 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d00064a90 tx=0x7f8cf0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15e6730141a2700 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfdd9b700 1 -- 172.21.15.50:0/2298719223 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0009e70 con 0x7f8d00158e70 2023-12-24T18:54:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfdd9b700 1 -- 172.21.15.50:0/2298719223 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000b860 con 0x7f8d00158e70 2023-12-24T18:54:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8cfdd9b700 1 -- 172.21.15.50:0/2298719223 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000bc20 con 0x7f8d00158e70 2023-12-24T18:54:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2298719223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d00158e70 msgr2=0x7f8d000cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2298719223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d00158e70 0x7f8d000cc160 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d00064a90 tx=0x7f8cf0009250 comp rx=0 tx=0).stop 2023-12-24T18:54:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2298719223 shutdown_connections 2023-12-24T18:54:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2298719223 >> v2:172.21.15.50:3300/0 conn(0x7f8d000c9f40 0x7f8d000680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2298719223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d00158e70 0x7f8d000cc160 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2298719223 >> 172.21.15.50:0/2298719223 conn(0x7f8d000cdd80 msgr2=0x7f8d000ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2298719223 shutdown_connections 2023-12-24T18:54:00.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.218+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2298719223 wait complete. 2023-12-24T18:54:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.222+0000 7f8d04ccd700 1 Processor -- start 2023-12-24T18:54:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.222+0000 7f8d04ccd700 1 -- start start 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000cc6a0 0x7f8d000b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00158e70 0x7f8d000b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00159b70 con 0x7f8d000c9f40 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b24b0 con 0x7f8d000cc6a0 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00159240 con 0x7f8d00158e70 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50046/0 (socket says 172.21.15.50:50046) 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2332143326 learned_addr learned my addr 172.21.15.50:0/2332143326 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cf7fff700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000cc6a0 0x7f8d000b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfed9d700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00158e70 0x7f8d000b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00158e70 msgr2=0x7f8d000b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00158e70 0x7f8d000b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000cc6a0 msgr2=0x7f8d000b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000cc6a0 0x7f8d000b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 -- 172.21.15.50:0/2332143326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00094f0 con 0x7f8d000c9f40 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cfe59c700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fd0 tx=0x7f8cf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf001f070 con 0x7f8d000c9f40 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000b9d0 con 0x7f8d000c9f40 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0011420 con 0x7f8d000c9f40 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d00159520 con 0x7f8d000c9f40 2023-12-24T18:54:00.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.226+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d000b1710 con 0x7f8d000c9f40 2023-12-24T18:54:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.230+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d000652e0 con 0x7f8d000c9f40 2023-12-24T18:54:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.230+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f8cf00117f0 con 0x7f8d000c9f40 2023-12-24T18:54:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.234+0000 7f8cf67fc700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 0x7f8ce0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.234+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f8cf007e290 con 0x7f8d000c9f40 2023-12-24T18:54:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.234+0000 7f8cf7fff700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 msgr2=0x7f8ce0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.234+0000 7f8cf7fff700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 0x7f8ce0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.238+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8cf004e1a0 con 0x7f8d000c9f40 2023-12-24T18:54:00.282 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:00.282+0000 7f96bcef3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:54:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.438+0000 7f8cf7fff700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 msgr2=0x7f8ce0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.438+0000 7f8cf7fff700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 0x7f8ce0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:54:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.490+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d00068f80 con 0x7f8d000c9f40 2023-12-24T18:54:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.490+0000 7f8cf67fc700 1 -- 172.21.15.50:0/2332143326 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f8cf00517c0 con 0x7f8d000c9f40 2023-12-24T18:54:00.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:00.493 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":112,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:53:54.034353+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:52:36.811573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-24T18:52:38.182270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/87016676":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1623465615":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/1236084802":"2023-12-25T18:52:52.917291+0000","172.21.15.50:0/830023472":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6837/33814":"2023-12-25T18:52:52.917291+0000","172.21.15.50:6836/33814":"2023-12-25T18:52:52.917291+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:54:00.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 msgr2=0x7f8ce0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:00.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 0x7f8ce0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 msgr2=0x7f8d00153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fd0 tx=0x7f8cf0017000 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 shutdown_connections 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8ce0060790 0x7f8ce0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00158e70 0x7f8d000b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000cc6a0 0x7f8d000b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 --2- 172.21.15.50:0/2332143326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d000c9f40 0x7f8d00153950 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 >> 172.21.15.50:0/2332143326 conn(0x7f8d000cdd80 msgr2=0x7f8d00155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.494+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 shutdown_connections 2023-12-24T18:54:00.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.498+0000 7f8d04ccd700 1 -- 172.21.15.50:0/2332143326 wait complete. 2023-12-24T18:54:00.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:54:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 Processor -- start 2023-12-24T18:54:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 -- start start 2023-12-24T18:54:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 0x7fd440159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44006ba80 con 0x7fd4400ce750 2023-12-24T18:54:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44006bd60 con 0x7fd440159a20 2023-12-24T18:54:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.686+0000 7fd444d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44006c040 con 0x7fd44006b540 2023-12-24T18:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:39452/0 (socket says 172.21.15.50:39452) 2023-12-24T18:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2855809116 learned_addr learned my addr 172.21.15.50:0/2855809116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43ed9d700 1 --2- 172.21.15.50:0/2855809116 >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 0x7fd440159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2855809116 >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 msgr2=0x7fd440159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2855809116 >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 0x7fd440159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2855809116 >> v1:172.21.15.82:6789/0 conn(0x7fd4400ce750 legacy=0x7fd44006ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2855809116 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44006c320 con 0x7fd44006b540 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43ed9d700 1 --2- 172.21.15.50:0/2855809116 >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 0x7fd440159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2855809116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4340099b0 tx=0x7fd434009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d159973b5c7037 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43d59a700 1 -- 172.21.15.50:0/2855809116 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400b860 con 0x7fd44006b540 2023-12-24T18:54:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43d59a700 1 -- 172.21.15.50:0/2855809116 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400b9c0 con 0x7fd44006b540 2023-12-24T18:54:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd43d59a700 1 -- 172.21.15.50:0/2855809116 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bd60 con 0x7fd44006b540 2023-12-24T18:54:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 -- 172.21.15.50:0/2855809116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 msgr2=0x7fd4400ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 --2- 172.21.15.50:0/2855809116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4340099b0 tx=0x7fd434009250 comp rx=0 tx=0).stop 2023-12-24T18:54:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 -- 172.21.15.50:0/2855809116 shutdown_connections 2023-12-24T18:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 --2- 172.21.15.50:0/2855809116 >> v2:172.21.15.50:3300/0 conn(0x7fd440159a20 0x7fd440159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 --2- 172.21.15.50:0/2855809116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44006b540 0x7fd4400ceb20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 -- 172.21.15.50:0/2855809116 >> 172.21.15.50:0/2855809116 conn(0x7fd4400cffb0 msgr2=0x7fd4400d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 -- 172.21.15.50:0/2855809116 shutdown_connections 2023-12-24T18:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.690+0000 7fd444d85700 1 -- 172.21.15.50:0/2855809116 wait complete. 2023-12-24T18:54:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 Processor -- start 2023-12-24T18:54:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 -- start start 2023-12-24T18:54:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 0x7fd4400c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd440159a20 0x7fd440155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd440153c30 con 0x7fd44006b540 2023-12-24T18:54:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401584e0 con 0x7fd440159a20 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.694+0000 7fd444d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401587c0 con 0x7fd4400ce750 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43e59c700 1 -- 172.21.15.50:0/2004581004 learned_addr learned my addr 172.21.15.50:0/2004581004 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 0x7fd4400c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43ed9d700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd440159a20 0x7fd440155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd440159a20 msgr2=0x7fd440155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd440159a20 0x7fd440155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 msgr2=0x7fd4400c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 -- 172.21.15.50:0/2004581004 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340094f0 con 0x7fd4400ce750 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43e59c700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd43dd9b700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 0x7fd4400c7060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4400cda50 tx=0x7fd434017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434011d70 con 0x7fd4400ce750 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43401f070 con 0x7fd4400ce750 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340266d0 con 0x7fd4400ce750 2023-12-24T18:54:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd440153e80 con 0x7fd4400ce750 2023-12-24T18:54:00.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.698+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4400c9a10 con 0x7fd4400ce750 2023-12-24T18:54:00.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.702+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440154300 con 0x7fd4400ce750 2023-12-24T18:54:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.702+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 52) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fd434026a40 con 0x7fd4400ce750 2023-12-24T18:54:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.702+0000 7fd42e7fc700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 0x7fd420062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.702+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fd434021070 con 0x7fd4400ce750 2023-12-24T18:54:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.702+0000 7fd43e59c700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 msgr2=0x7fd420062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.706+0000 7fd43e59c700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 0x7fd420062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.710+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd43404eae0 con 0x7fd4400ce750 2023-12-24T18:54:00.734 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:00.731+0000 7f0e866de000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:54:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.910+0000 7fd43e59c700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 msgr2=0x7fd420062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.910+0000 7fd43e59c700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 0x7fd420062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:54:00.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.922+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd4400652e0 con 0x7fd4400ce750 2023-12-24T18:54:00.924 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:54:00.922+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:54:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.934+0000 7fd42e7fc700 1 -- 172.21.15.50:0/2004581004 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd43402b090 con 0x7fd4400ce750 2023-12-24T18:54:00.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 msgr2=0x7fd420062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:00.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 0x7fd420062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 msgr2=0x7fd4400c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:00.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 0x7fd4400c7060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4400cda50 tx=0x7fd434017000 comp rx=0 tx=0).stop 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 shutdown_connections 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd420060790 0x7fd420062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd440159a20 0x7fd440155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4400ce750 0x7fd4400c7060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 --2- 172.21.15.50:0/2004581004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44006b540 0x7fd4400c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 >> 172.21.15.50:0/2004581004 conn(0x7fd4400cffb0 msgr2=0x7fd4400c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 shutdown_connections 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:00.938+0000 7fd444d85700 1 -- 172.21.15.50:0/2004581004 wait complete. 2023-12-24T18:54:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:54:00.948 INFO:tasks.ceph.mds.a.smithi050.stderr: -5839> 2023-12-24T18:52:45.700+0000 7f738c7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:54:00.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:54:00.996 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.110+0000 7f614e123700 1 Processor -- start 2023-12-24T18:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.110+0000 7f614e123700 1 -- start start 2023-12-24T18:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614e123700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6148156e80 0x7f61480c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614e123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61480c8d10 0x7f61480c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614e123700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614815b5a0 con 0x7f6148156ab0 2023-12-24T18:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614e123700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480c9150 con 0x7f6148156e80 2023-12-24T18:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614e123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614815a990 con 0x7f61480c8d10 2023-12-24T18:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614d121700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6148156ab0 0x7f61480adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45206/0 (socket says 172.21.15.50:45206) 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614d121700 1 -- 172.21.15.50:0/2059407238 learned_addr learned my addr 172.21.15.50:0/2059407238 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 --2- 172.21.15.50:0/2059407238 >> v2:172.21.15.82:3300/0 conn(0x7f6148156e80 0x7f61480c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614d922700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61480c8d10 0x7f61480c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 -- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61480c8d10 msgr2=0x7f61480c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61480c8d10 0x7f61480c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 -- 172.21.15.50:0/2059407238 >> v1:172.21.15.50:6789/0 conn(0x7f6148156ab0 legacy=0x7f61480adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f613ffff700 1 -- 172.21.15.50:0/2059407238 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455561885 0 0) 0x7f614815b5a0 con 0x7f6148156ab0 2023-12-24T18:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 -- 172.21.15.50:0/2059407238 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614815ac70 con 0x7f6148156e80 2023-12-24T18:54:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f614c920700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156e80 0x7f61480c87d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f61380098e0 tx=0x7f61380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c5fe6a466f2505 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f613ffff700 1 -- 172.21.15.50:0/2059407238 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138009e80 con 0x7f6148156e80 2023-12-24T18:54:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f613ffff700 1 -- 172.21.15.50:0/2059407238 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800b860 con 0x7f6148156e80 2023-12-24T18:54:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.114+0000 7f613ffff700 1 -- 172.21.15.50:0/2059407238 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800bbe0 con 0x7f6148156e80 2023-12-24T18:54:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 -- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156e80 msgr2=0x7f61480c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156e80 0x7f61480c87d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f61380098e0 tx=0x7f61380091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 -- 172.21.15.50:0/2059407238 shutdown_connections 2023-12-24T18:54:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61480c8d10 0x7f61480c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 --2- 172.21.15.50:0/2059407238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156e80 0x7f61480c87d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 -- 172.21.15.50:0/2059407238 >> 172.21.15.50:0/2059407238 conn(0x7f6148067250 msgr2=0x7f6148067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 -- 172.21.15.50:0/2059407238 shutdown_connections 2023-12-24T18:54:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.118+0000 7f614e123700 1 -- 172.21.15.50:0/2059407238 wait complete. 2023-12-24T18:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 Processor -- start 2023-12-24T18:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- start start 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156ab0 0x7f6148154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 0x7f6148155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614806b820 con 0x7f61480c8d10 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614815d7e0 con 0x7f6148156ab0 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614815cf80 con 0x7f6148156e80 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50076/0 (socket says 172.21.15.50:50076) 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 -- 172.21.15.50:0/715020816 learned_addr learned my addr 172.21.15.50:0/715020816 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614c920700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156ab0 0x7f6148154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d922700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 0x7f6148155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 -- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 msgr2=0x7f6148155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 0x7f6148155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 -- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156ab0 msgr2=0x7f6148154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156ab0 0x7f6148154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 -- 172.21.15.50:0/715020816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138009420 con 0x7f61480c8d10 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d922700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 0x7f6148155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614d121700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f614400c810 tx=0x7f6144007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144005b30 con 0x7f61480c8d10 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144005c90 con 0x7f61480c8d10 2023-12-24T18:54:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614815d220 con 0x7f61480c8d10 2023-12-24T18:54:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144007300 con 0x7f61480c8d10 2023-12-24T18:54:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.122+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614806b4b0 con 0x7f61480c8d10 2023-12-24T18:54:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.126+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614804be40 con 0x7f61480c8d10 2023-12-24T18:54:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.126+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 53) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f614401b400 con 0x7f61480c8d10 2023-12-24T18:54:01.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.126+0000 7f613d7fa700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 0x7f612c062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:01.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.130+0000 7f614c920700 1 -- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 msgr2=0x7f612c062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:01.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.130+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6861+0+0 (secure 0 0 0) 0x7f614407cb90 con 0x7f61480c8d10 2023-12-24T18:54:01.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.130+0000 7f614c920700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 0x7f612c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.130+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f614404ca00 con 0x7f61480c8d10 2023-12-24T18:54:01.179 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.178+0000 7f96bcef3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:54:01.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.190+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 54) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f614404cdd0 con 0x7f61480c8d10 2023-12-24T18:54:01.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.190+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 msgr2=0x7f612c062c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:01.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.190+0000 7f613d7fa700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 0x7f612c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.292 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f9687de4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f9687de4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f9687de4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f9687de4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f9687de4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f96865e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f96865e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f96865e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.293 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f96865e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.294 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:01.290+0000 7f96865e1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:01.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.374+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61480ad410 con 0x7f61480c8d10 2023-12-24T18:54:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.934+0000 7f613d7fa700 1 -- 172.21.15.50:0/715020816 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6144078a70 con 0x7f61480c8d10 2023-12-24T18:54:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 msgr2=0x7f614814bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f614400c810 tx=0x7f6144007df0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 shutdown_connections 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f612c0607c0 0x7f612c062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6148156e80 0x7f6148155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6148156ab0 0x7f6148154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 --2- 172.21.15.50:0/715020816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61480c8d10 0x7f614814bbf0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 >> 172.21.15.50:0/715020816 conn(0x7f6148067250 msgr2=0x7f61480c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 shutdown_connections 2023-12-24T18:54:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:01.938+0000 7f614e123700 1 -- 172.21.15.50:0/715020816 wait complete. 2023-12-24T18:54:01.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:54:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.182+0000 7fc249ae3700 1 Processor -- start 2023-12-24T18:54:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.182+0000 7fc249ae3700 1 -- start start 2023-12-24T18:54:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc249ae3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2440c5c90 0x7fc244163f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc249ae3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24406b5b0 con 0x7fc24406a4a0 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc249ae3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440cbb40 con 0x7fc244159080 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc249ae3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24415dbd0 con 0x7fc2440c5c90 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc243fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc24406a4a0 0x7fc2440c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45210/0 (socket says 172.21.15.50:45210) 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc243fff700 1 -- 172.21.15.50:0/2326315280 learned_addr learned my addr 172.21.15.50:0/2326315280 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2492e2700 1 --2- 172.21.15.50:0/2326315280 >> v2:172.21.15.50:3300/0 conn(0x7fc2440c5c90 0x7fc244163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2492e2700 1 -- 172.21.15.50:0/2326315280 >> v1:172.21.15.82:6789/0 conn(0x7fc244159080 legacy=0x7fc24406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2492e2700 1 -- 172.21.15.50:0/2326315280 >> v1:172.21.15.50:6789/0 conn(0x7fc24406a4a0 legacy=0x7fc2440c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2437fe700 1 -- 172.21.15.50:0/2326315280 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531033745 0 0) 0x7fc2440cbb40 con 0x7fc244159080 2023-12-24T18:54:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2492e2700 1 -- 172.21.15.50:0/2326315280 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24406a9a0 con 0x7fc2440c5c90 2023-12-24T18:54:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.186+0000 7fc2492e2700 1 --2- 172.21.15.50:0/2326315280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2440c5c90 0x7fc244163f70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009e60 tx=0x7fc23c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431f3eece43c814f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc2437fe700 1 -- 172.21.15.50:0/2326315280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00e070 con 0x7fc2440c5c90 2023-12-24T18:54:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc2437fe700 1 -- 172.21.15.50:0/2326315280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c00bc30 con 0x7fc2440c5c90 2023-12-24T18:54:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc2437fe700 1 -- 172.21.15.50:0/2326315280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c012430 con 0x7fc2440c5c90 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 -- 172.21.15.50:0/2326315280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2440c5c90 msgr2=0x7fc244163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 --2- 172.21.15.50:0/2326315280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2440c5c90 0x7fc244163f70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009e60 tx=0x7fc23c009780 comp rx=0 tx=0).stop 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 -- 172.21.15.50:0/2326315280 shutdown_connections 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 --2- 172.21.15.50:0/2326315280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2440c5c90 0x7fc244163f70 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 -- 172.21.15.50:0/2326315280 >> 172.21.15.50:0/2326315280 conn(0x7fc244067b80 msgr2=0x7fc2440cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 -- 172.21.15.50:0/2326315280 shutdown_connections 2023-12-24T18:54:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.190+0000 7fc249ae3700 1 -- 172.21.15.50:0/2326315280 wait complete. 2023-12-24T18:54:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 Processor -- start 2023-12-24T18:54:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 -- start start 2023-12-24T18:54:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc24406a4a0 0x7fc2441528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2440c5c90 0x7fc2440b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441525f0 con 0x7fc244159080 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b32f0 con 0x7fc2440c5c90 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc249ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b35d0 con 0x7fc24406a4a0 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50198/0 (socket says 172.21.15.50:50198) 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 -- 172.21.15.50:0/179977072 learned_addr learned my addr 172.21.15.50:0/179977072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc248ae1700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc24406a4a0 0x7fc2441528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc243fff700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2440c5c90 0x7fc2440b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 -- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc24406a4a0 msgr2=0x7fc2441528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc24406a4a0 0x7fc2441528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 -- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2440c5c90 msgr2=0x7fc2440b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2440c5c90 0x7fc2440b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.194+0000 7fc2492e2700 1 -- 172.21.15.50:0/179977072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009a20 con 0x7fc244159080 2023-12-24T18:54:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.198+0000 7fc2492e2700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc23c013000 tx=0x7fc23c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c012e80 con 0x7fc244159080 2023-12-24T18:54:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c01d630 con 0x7fc244159080 2023-12-24T18:54:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c01d9b0 con 0x7fc244159080 2023-12-24T18:54:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440b38b0 con 0x7fc244159080 2023-12-24T18:54:02.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24415a2b0 con 0x7fc244159080 2023-12-24T18:54:02.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.206+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24415a110 con 0x7fc244159080 2023-12-24T18:54:02.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.210+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 55) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fc23c024070 con 0x7fc244159080 2023-12-24T18:54:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.210+0000 7fc240ff9700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 0x7fc228062950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.210+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 7205+0+0 (secure 0 0 0) 0x7fc23c07f620 con 0x7fc244159080 2023-12-24T18:54:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.210+0000 7fc248ae1700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 0x7fc228062950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.214+0000 7fc248ae1700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 0x7fc228062950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc238009af0 tx=0x7fc238009060 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.214+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc23c04f910 con 0x7fc244159080 2023-12-24T18:54:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:02.386+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc24415a110 con 0x7fc244159080 2023-12-24T18:54:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.218+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc23c003040 con 0x7fc244159080 2023-12-24T18:54:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.222+0000 7fc240ff9700 1 -- 172.21.15.50:0/179977072 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc23c053110 con 0x7fc244159080 2023-12-24T18:54:03.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 msgr2=0x7fc228062950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 0x7fc228062950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc238009af0 tx=0x7fc238009060 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 msgr2=0x7fc24414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc23c013000 tx=0x7fc23c019000 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 shutdown_connections 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc2280604a0 0x7fc228062950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244159080 0x7fc24414c790 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2440c5c90 0x7fc2440b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 --2- 172.21.15.50:0/179977072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc24406a4a0 0x7fc2441528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 >> 172.21.15.50:0/179977072 conn(0x7fc244067b80 msgr2=0x7fc2440cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 shutdown_connections 2023-12-24T18:54:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.226+0000 7fc249ae3700 1 -- 172.21.15.50:0/179977072 wait complete. 2023-12-24T18:54:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:54:03.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:54:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.418+0000 7f2393acd700 1 Processor -- start 2023-12-24T18:54:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.418+0000 7f2393acd700 1 -- start start 2023-12-24T18:54:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2393acd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f238c1591a0 0x7f238c0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2393acd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c06a730 con 0x7f238c0aa080 2023-12-24T18:54:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2393acd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c06beb0 con 0x7f238c0a8fe0 2023-12-24T18:54:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2393acd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c06d760 con 0x7f238c1591a0 2023-12-24T18:54:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2391068700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f238c0aa080 0x7f238c0a88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45224/0 (socket says 172.21.15.50:45224) 2023-12-24T18:54:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2391068700 1 -- 172.21.15.50:0/881548676 learned_addr learned my addr 172.21.15.50:0/881548676 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2391869700 1 --2- 172.21.15.50:0/881548676 >> v2:172.21.15.82:3300/0 conn(0x7f238c1591a0 0x7f238c0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651695021 0 0) 0x7f238c06a730 con 0x7f238c0aa080 2023-12-24T18:54:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2378003570 con 0x7f238c0aa080 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779421420 0 0) 0x7f2378003570 con 0x7f238c0aa080 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 >> v2:172.21.15.82:3300/0 conn(0x7f238c1591a0 msgr2=0x7f238c0a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 --2- 172.21.15.50:0/881548676 >> v2:172.21.15.82:3300/0 conn(0x7f238c1591a0 0x7f238c0a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 >> v1:172.21.15.82:6789/0 conn(0x7f238c0a8fe0 legacy=0x7f238c162d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c06da40 con 0x7f238c0aa080 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f237c001470 con 0x7f238c0aa080 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 >> v1:172.21.15.50:6789/0 conn(0x7f238c0aa080 legacy=0x7f238c0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 0x7f2378003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2378004810 0x7f2378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23780051c0 0x7f237800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c06d760 con 0x7f2378003a60 2023-12-24T18:54:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237800c050 con 0x7f23780051c0 2023-12-24T18:54:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237800c210 con 0x7f2378004810 2023-12-24T18:54:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2391869700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 0x7f2378003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f2391068700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2378004810 0x7f2378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.422+0000 7f239206a700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23780051c0 0x7f237800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 -- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2378004810 msgr2=0x7f2378004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2378004810 0x7f2378004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 -- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23780051c0 msgr2=0x7f237800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23780051c0 0x7f237800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f239206a700 1 -- 172.21.15.50:0/881548676 reap_dead start 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 -- 172.21.15.50:0/881548676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378003570 con 0x7f2378003a60 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2391869700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 0x7f2378003e30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2388009c00 tx=0x7f23880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39bf952bbae506b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800e710 con 0x7f2378003a60 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800e870 con 0x7f2378003a60 2023-12-24T18:54:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2390867700 1 -- 172.21.15.50:0/881548676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800ec30 con 0x7f2378003a60 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 -- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 msgr2=0x7f2378003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 0x7f2378003e30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2388009c00 tx=0x7f23880091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 -- 172.21.15.50:0/881548676 shutdown_connections 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 --2- 172.21.15.50:0/881548676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2378003a60 0x7f2378003e30 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 -- 172.21.15.50:0/881548676 >> 172.21.15.50:0/881548676 conn(0x7f238c067b80 msgr2=0x7f238c0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 -- 172.21.15.50:0/881548676 shutdown_connections 2023-12-24T18:54:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.426+0000 7f2393acd700 1 -- 172.21.15.50:0/881548676 wait complete. 2023-12-24T18:54:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.430+0000 7f2393acd700 1 Processor -- start 2023-12-24T18:54:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.430+0000 7f2393acd700 1 -- start start 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2378003a60 0x7f238c14a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f238c16ca90 0x7f238c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c14b400 con 0x7f238c0ad620 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0adfd0 con 0x7f2378003a60 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c14dcf0 con 0x7f238c16ca90 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50222/0 (socket says 172.21.15.50:50222) 2023-12-24T18:54:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 -- 172.21.15.50:0/3300071994 learned_addr learned my addr 172.21.15.50:0/3300071994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2391869700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2378003a60 0x7f238c14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2391068700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f238c16ca90 0x7f238c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 -- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f238c16ca90 msgr2=0x7f238c14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f238c16ca90 0x7f238c14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 -- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2378003a60 msgr2=0x7f238c14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2378003a60 0x7f238c14a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 -- 172.21.15.50:0/3300071994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c14ce40 con 0x7f238c0ad620 2023-12-24T18:54:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f239206a700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f238c0a93e0 tx=0x7f23840016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400eec0 con 0x7f238c0ad620 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238400c780 con 0x7f238c0ad620 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400cb40 con 0x7f238c0ad620 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.434+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c14d0e0 con 0x7f238c0ad620 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.438+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c14d6a0 con 0x7f238c0ad620 2023-12-24T18:54:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.438+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c071060 con 0x7f238c0ad620 2023-12-24T18:54:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.438+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f238401d460 con 0x7f238c0ad620 2023-12-24T18:54:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.442+0000 7f2381ffb700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 0x7f2370062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.442+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6767+0+0 (secure 0 0 0) 0x7f238407c9d0 con 0x7f238c0ad620 2023-12-24T18:54:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.442+0000 7f2391869700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 0x7f2370062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.442+0000 7f2391869700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 0x7f2370062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f23880091e0 tx=0x7f238801a000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.446+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f238404cb80 con 0x7f238c0ad620 2023-12-24T18:54:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:03.626+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f238c06dd20 con 0x7f238c0ad620 2023-12-24T18:54:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.222+0000 7f2381ffb700 1 -- 172.21.15.50:0/3300071994 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7f23840501a0 con 0x7f238c0ad620 2023-12-24T18:54:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 msgr2=0x7f2370062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 0x7f2370062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f23880091e0 tx=0x7f238801a000 comp rx=0 tx=0).stop 2023-12-24T18:54:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 msgr2=0x7f238c0ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f238c0a93e0 tx=0x7f23840016d0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 shutdown_connections 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2370060550 0x7f2370062a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238c0ad620 0x7f238c0ada90 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f238c16ca90 0x7f238c14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 --2- 172.21.15.50:0/3300071994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2378003a60 0x7f238c14a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 >> 172.21.15.50:0/3300071994 conn(0x7f238c067b80 msgr2=0x7f238c0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 shutdown_connections 2023-12-24T18:54:04.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.234+0000 7f2393acd700 1 -- 172.21.15.50:0/3300071994 wait complete. 2023-12-24T18:54:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:54:04.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:54:04.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.430+0000 7f7254c78700 1 Processor -- start 2023-12-24T18:54:04.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.430+0000 7f7254c78700 1 -- start start 2023-12-24T18:54:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f7254c78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72500abfe0 0x7f7250156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f7254c78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500c9cf0 0x7f72500ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f7254c78700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725006eec0 con 0x7f72500abc10 2023-12-24T18:54:04.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f7254c78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7250157400 con 0x7f72500abfe0 2023-12-24T18:54:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f7254c78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725006f1a0 con 0x7f72500c9cf0 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f724dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72500abfe0 0x7f7250156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f724dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72500abfe0 0x7f7250156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50228/0 (socket says 172.21.15.50:50228) 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f724dd9b700 1 -- 172.21.15.50:0/2675345925 learned_addr learned my addr 172.21.15.50:0/2675345925 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f724ed9d700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500c9cf0 0x7f72500ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.434+0000 7f724e59c700 1 --1- 172.21.15.50:0/2675345925 >> v1:172.21.15.82:6789/0 conn(0x7f72500abc10 0x7f725006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:33730/0 (socket says 172.21.15.50:33730) 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724dd9b700 1 -- 172.21.15.50:0/2675345925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500c9cf0 msgr2=0x7f72500ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724dd9b700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500c9cf0 0x7f72500ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724dd9b700 1 -- 172.21.15.50:0/2675345925 >> v1:172.21.15.82:6789/0 conn(0x7f72500abc10 legacy=0x7f725006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724dd9b700 1 -- 172.21.15.50:0/2675345925 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500c97d0 con 0x7f72500abfe0 2023-12-24T18:54:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724dd9b700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500abfe0 0x7f7250156ec0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f72440099b0 tx=0x7f7244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886c32804d20707a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724d59a700 1 -- 172.21.15.50:0/2675345925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244009ea0 con 0x7f72500abfe0 2023-12-24T18:54:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724d59a700 1 -- 172.21.15.50:0/2675345925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724400b860 con 0x7f72500abfe0 2023-12-24T18:54:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f724d59a700 1 -- 172.21.15.50:0/2675345925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724400bc00 con 0x7f72500abfe0 2023-12-24T18:54:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 -- 172.21.15.50:0/2675345925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500abfe0 msgr2=0x7f7250156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500abfe0 0x7f7250156ec0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f72440099b0 tx=0x7f7244009250 comp rx=0 tx=0).stop 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 -- 172.21.15.50:0/2675345925 shutdown_connections 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500c9cf0 0x7f72500ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 --2- 172.21.15.50:0/2675345925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500abfe0 0x7f7250156ec0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 -- 172.21.15.50:0/2675345925 >> 172.21.15.50:0/2675345925 conn(0x7f72500afb40 msgr2=0x7f72500aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 -- 172.21.15.50:0/2675345925 shutdown_connections 2023-12-24T18:54:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.438+0000 7f7254c78700 1 -- 172.21.15.50:0/2675345925 wait complete. 2023-12-24T18:54:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 Processor -- start 2023-12-24T18:54:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 -- start start 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500abc10 0x7f72500ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72500abfe0 0x7f7250096c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500aeca0 con 0x7f72500c9cf0 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500ae2d0 con 0x7f72500abfe0 2023-12-24T18:54:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f7254c78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500ad6c0 con 0x7f72500abc10 2023-12-24T18:54:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f724ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f724ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50240/0 (socket says 172.21.15.50:50240) 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f724ed9d700 1 -- 172.21.15.50:0/662959061 learned_addr learned my addr 172.21.15.50:0/662959061 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f724e59c700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500abc10 0x7f72500ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.442+0000 7f724dd9b700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72500abfe0 0x7f7250096c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 -- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500abc10 msgr2=0x7f72500ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500abc10 0x7f72500ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 -- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72500abfe0 msgr2=0x7f7250096c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72500abfe0 0x7f7250096c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 -- 172.21.15.50:0/662959061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440094f0 con 0x7f72500c9cf0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f724ed9d700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7248009df0 tx=0x7f724800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800caa0 con 0x7f72500c9cf0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800f040 con 0x7f72500c9cf0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500ad9a0 con 0x7f72500c9cf0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800ce70 con 0x7f72500c9cf0 2023-12-24T18:54:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72500adf60 con 0x7f72500c9cf0 2023-12-24T18:54:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.446+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500ae440 con 0x7f72500c9cf0 2023-12-24T18:54:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.450+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7248014690 con 0x7f72500c9cf0 2023-12-24T18:54:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.450+0000 7f723e7fc700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 0x7f7230062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.450+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f724807d4e0 con 0x7f72500c9cf0 2023-12-24T18:54:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.450+0000 7f724e59c700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 0x7f7230062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.450+0000 7f724e59c700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 0x7f7230062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7240004f40 tx=0x7f7240007eb0 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.454+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7248051350 con 0x7f72500c9cf0 2023-12-24T18:54:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.638+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f72500652e0 con 0x7f72500c9cf0 2023-12-24T18:54:04.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.646+0000 7f723e7fc700 1 -- 172.21.15.50:0/662959061 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v37) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7248050ee0 con 0x7f72500c9cf0 2023-12-24T18:54:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 msgr2=0x7f7230062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 0x7f7230062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7240004f40 tx=0x7f7240007eb0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 msgr2=0x7f7250097170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7248009df0 tx=0x7f724800b040 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 shutdown_connections 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7230060550 0x7f7230062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72500c9cf0 0x7f7250097170 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72500abfe0 0x7f7250096c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 --2- 172.21.15.50:0/662959061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72500abc10 0x7f72500ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.650+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 >> 172.21.15.50:0/662959061 conn(0x7f72500afb40 msgr2=0x7f72500aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.654+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 shutdown_connections 2023-12-24T18:54:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.654+0000 7f7254c78700 1 -- 172.21.15.50:0/662959061 wait complete. 2023-12-24T18:54:04.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:54:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 Processor -- start 2023-12-24T18:54:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 -- start start 2023-12-24T18:54:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff48c156ab0 0x7ff48c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c15b5a0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c15a990 con 0x7ff48c156ab0 2023-12-24T18:54:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4919cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c15ac70 con 0x7ff48c0adb50 2023-12-24T18:54:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff48c156ab0 0x7ff48c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff48c156ab0 0x7ff48c156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50248/0 (socket says 172.21.15.50:50248) 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 -- 172.21.15.50:0/3130695502 learned_addr learned my addr 172.21.15.50:0/3130695502 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff483fff700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 -- 172.21.15.50:0/3130695502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 msgr2=0x7ff48c0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 -- 172.21.15.50:0/3130695502 >> v1:172.21.15.82:6789/0 conn(0x7ff48c0c87d0 legacy=0x7ff48c0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff4909ca700 1 -- 172.21.15.50:0/3130695502 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c15af50 con 0x7ff48c156ab0 2023-12-24T18:54:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.850+0000 7ff483fff700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4909ca700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c156ab0 0x7ff48c156e80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff4880099b0 tx=0x7ff488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4032ed2ea05bf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4837fe700 1 -- 172.21.15.50:0/3130695502 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488009ea0 con 0x7ff48c156ab0 2023-12-24T18:54:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4837fe700 1 -- 172.21.15.50:0/3130695502 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48800b860 con 0x7ff48c156ab0 2023-12-24T18:54:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4837fe700 1 -- 172.21.15.50:0/3130695502 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800bc00 con 0x7ff48c156ab0 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 -- 172.21.15.50:0/3130695502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c156ab0 msgr2=0x7ff48c156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c156ab0 0x7ff48c156e80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff4880099b0 tx=0x7ff488009250 comp rx=0 tx=0).stop 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 -- 172.21.15.50:0/3130695502 shutdown_connections 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 --2- 172.21.15.50:0/3130695502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c156ab0 0x7ff48c156e80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 -- 172.21.15.50:0/3130695502 >> 172.21.15.50:0/3130695502 conn(0x7ff48c067250 msgr2=0x7ff48c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 -- 172.21.15.50:0/3130695502 shutdown_connections 2023-12-24T18:54:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.854+0000 7ff4919cc700 1 -- 172.21.15.50:0/3130695502 wait complete. 2023-12-24T18:54:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 Processor -- start 2023-12-24T18:54:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 -- start start 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 0x7ff48c0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0af1b0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0c5a30 con 0x7ff48c156ab0 2023-12-24T18:54:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4919cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0b1270 con 0x7ff48c0adb50 2023-12-24T18:54:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50264/0 (socket says 172.21.15.50:50264) 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 -- 172.21.15.50:0/368492632 learned_addr learned my addr 172.21.15.50:0/368492632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4909ca700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4911cb700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 0x7ff48c0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 -- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 msgr2=0x7ff48c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 -- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 msgr2=0x7ff48c0c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 0x7ff48c0c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff483fff700 1 -- 172.21.15.50:0/368492632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009420 con 0x7ff48c0c87d0 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.858+0000 7ff4911cb700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 0x7ff48c0c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff483fff700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00ec80 tx=0x7ff47c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00c8f0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ca50 con 0x7ff48c0c87d0 2023-12-24T18:54:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880094f0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00cdd0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0c53e0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c04be40 con 0x7ff48c0c87d0 2023-12-24T18:54:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.862+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff47c013680 con 0x7ff48c0c87d0 2023-12-24T18:54:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.866+0000 7ff480ff9700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 0x7ff478062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.866+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7ff47c07d0d0 con 0x7ff48c0c87d0 2023-12-24T18:54:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.866+0000 7ff4909ca700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 0x7ff478062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.866+0000 7ff4909ca700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 0x7ff478062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4880099b0 tx=0x7ff488017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:04.874+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff47c04d410 con 0x7ff48c0c87d0 2023-12-24T18:54:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.046+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff48c063830 con 0x7ff48c0c87d0 2023-12-24T18:54:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.054+0000 7ff480ff9700 1 -- 172.21.15.50:0/368492632 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff47c050a30 con 0x7ff48c0c87d0 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 msgr2=0x7ff478062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 0x7ff478062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4880099b0 tx=0x7ff488017000 comp rx=0 tx=0).stop 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 msgr2=0x7ff48c0c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00ec80 tx=0x7ff47c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 shutdown_connections 2023-12-24T18:54:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff478060550 0x7ff478062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c156ab0 0x7ff48c0c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0c87d0 0x7ff48c0c2a70 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 --2- 172.21.15.50:0/368492632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff48c0adb50 0x7ff48c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 >> 172.21.15.50:0/368492632 conn(0x7ff48c067250 msgr2=0x7ff48c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 shutdown_connections 2023-12-24T18:54:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.058+0000 7ff4919cc700 1 -- 172.21.15.50:0/368492632 wait complete. 2023-12-24T18:54:05.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:54:05.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.250+0000 7fceb359e700 1 Processor -- start 2023-12-24T18:54:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.250+0000 7fceb359e700 1 -- start start 2023-12-24T18:54:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fceb4156ab0 0x7fceb4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb40adb50 0x7fceb40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb415b5a0 con 0x7fceb40c87d0 2023-12-24T18:54:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb415a990 con 0x7fceb4156ab0 2023-12-24T18:54:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415ac70 con 0x7fceb40adb50 2023-12-24T18:54:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fceb4156ab0 0x7fceb4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fceb40c87d0 0x7fceb40ab750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45230/0 (socket says 172.21.15.50:45230) 2023-12-24T18:54:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb2d9d700 1 -- 172.21.15.50:0/3291792564 learned_addr learned my addr 172.21.15.50:0/3291792564 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fcea9d9b700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb40adb50 0x7fceb40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb1d9b700 1 -- 172.21.15.50:0/3291792564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744301569 0 0) 0x7fceb415b5a0 con 0x7fceb40c87d0 2023-12-24T18:54:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb1d9b700 1 -- 172.21.15.50:0/3291792564 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003570 con 0x7fceb40c87d0 2023-12-24T18:54:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb259c700 1 -- 172.21.15.50:0/3291792564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb40adb50 msgr2=0x7fceb40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb259c700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb40adb50 0x7fceb40adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb259c700 1 -- 172.21.15.50:0/3291792564 >> v1:172.21.15.50:6789/0 conn(0x7fceb40c87d0 legacy=0x7fceb40ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.254+0000 7fceb259c700 1 -- 172.21.15.50:0/3291792564 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb415af50 con 0x7fceb4156ab0 2023-12-24T18:54:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb259c700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb4156ab0 0x7fceb4156e80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcea40098e0 tx=0x7fcea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9188fb67aa41033e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb1d9b700 1 -- 172.21.15.50:0/3291792564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4011630 con 0x7fceb4156ab0 2023-12-24T18:54:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb1d9b700 1 -- 172.21.15.50:0/3291792564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4011790 con 0x7fceb4156ab0 2023-12-24T18:54:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb1d9b700 1 -- 172.21.15.50:0/3291792564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4011b30 con 0x7fceb4156ab0 2023-12-24T18:54:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 -- 172.21.15.50:0/3291792564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb4156ab0 msgr2=0x7fceb4156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb4156ab0 0x7fceb4156e80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcea40098e0 tx=0x7fcea40091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 -- 172.21.15.50:0/3291792564 shutdown_connections 2023-12-24T18:54:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb40adb50 0x7fceb40adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 --2- 172.21.15.50:0/3291792564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb4156ab0 0x7fceb4156e80 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 -- 172.21.15.50:0/3291792564 >> 172.21.15.50:0/3291792564 conn(0x7fceb4067250 msgr2=0x7fceb4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 -- 172.21.15.50:0/3291792564 shutdown_connections 2023-12-24T18:54:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.258+0000 7fceb359e700 1 -- 172.21.15.50:0/3291792564 wait complete. 2023-12-24T18:54:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 Processor -- start 2023-12-24T18:54:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 -- start start 2023-12-24T18:54:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 0x7fceb4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb4156ab0 0x7fceb40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415a0a0 con 0x7fceb40c87d0 2023-12-24T18:54:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40b08e0 con 0x7fceb40adb50 2023-12-24T18:54:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fceb359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40b0bc0 con 0x7fceb4156ab0 2023-12-24T18:54:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fcea9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fcea9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50282/0 (socket says 172.21.15.50:50282) 2023-12-24T18:54:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.262+0000 7fcea9d9b700 1 -- 172.21.15.50:0/1259187137 learned_addr learned my addr 172.21.15.50:0/1259187137 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb259c700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 0x7fceb4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb2d9d700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb4156ab0 0x7fceb40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 -- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb4156ab0 msgr2=0x7fceb40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb4156ab0 0x7fceb40c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 -- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 msgr2=0x7fceb4159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 0x7fceb4159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 -- 172.21.15.50:0/1259187137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009420 con 0x7fceb40c87d0 2023-12-24T18:54:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb259c700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 0x7fceb4159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fcea9d9b700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00ec80 tx=0x7fce9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00c9d0 con 0x7fceb40c87d0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c00cb30 con 0x7fceb40c87d0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c013470 con 0x7fceb40c87d0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb40b0ea0 con 0x7fceb40c87d0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40b1460 con 0x7fceb40c87d0 2023-12-24T18:54:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.266+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb404be40 con 0x7fceb40c87d0 2023-12-24T18:54:05.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.270+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fce9c013820 con 0x7fceb40c87d0 2023-12-24T18:54:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.270+0000 7fceaaffd700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 0x7fce94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.270+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fce9c07cdc0 con 0x7fceb40c87d0 2023-12-24T18:54:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.270+0000 7fceb259c700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 0x7fce94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.270+0000 7fceb259c700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 0x7fce94062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcea40091e0 tx=0x7fcea4017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.278+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fce9c04d100 con 0x7fceb40c87d0 2023-12-24T18:54:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.446+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fceb406a8e0 con 0x7fceb40c87d0 2023-12-24T18:54:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.458+0000 7fceaaffd700 1 -- 172.21.15.50:0/1259187137 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce9c050720 con 0x7fceb40c87d0 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 msgr2=0x7fce94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 0x7fce94062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcea40091e0 tx=0x7fcea4017000 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 msgr2=0x7fceb40a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00ec80 tx=0x7fce9c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 shutdown_connections 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fce94060550 0x7fce94062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fceb4156ab0 0x7fceb40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb40c87d0 0x7fceb40a9b70 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 --2- 172.21.15.50:0/1259187137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb40adb50 0x7fceb4159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 >> 172.21.15.50:0/1259187137 conn(0x7fceb4067250 msgr2=0x7fceb40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 shutdown_connections 2023-12-24T18:54:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.462+0000 7fceb359e700 1 -- 172.21.15.50:0/1259187137 wait complete. 2023-12-24T18:54:05.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-12-24T18:54:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.658+0000 7ff91c984700 1 Processor -- start 2023-12-24T18:54:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.658+0000 7ff91c984700 1 -- start start 2023-12-24T18:54:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91c984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9180cc9d0 0x7ff9180ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91c984700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91806b280 con 0x7ff918152fd0 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91c984700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180cef00 con 0x7ff9180ce390 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91c984700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91806a6b0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff918152fd0 0x7ff918153470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45244/0 (socket says 172.21.15.50:45244) 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff91659c700 1 -- 172.21.15.50:0/1466556687 learned_addr learned my addr 172.21.15.50:0/1466556687 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff916d9d700 1 --2- 172.21.15.50:0/1466556687 >> v2:172.21.15.82:3300/0 conn(0x7ff9180cc9d0 0x7ff9180ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486023321 0 0) 0x7ff91806b280 con 0x7ff918152fd0 2023-12-24T18:54:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff900003570 con 0x7ff918152fd0 2023-12-24T18:54:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003264520 0 0) 0x7ff9180cef00 con 0x7ff9180ce390 2023-12-24T18:54:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff916d9d700 1 -- 172.21.15.50:0/1466556687 >> v1:172.21.15.82:6789/0 conn(0x7ff9180ce390 legacy=0x7ff9180ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff916d9d700 1 -- 172.21.15.50:0/1466556687 >> v1:172.21.15.50:6789/0 conn(0x7ff918152fd0 legacy=0x7ff918153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff916d9d700 1 -- 172.21.15.50:0/1466556687 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91806a950 con 0x7ff9180cc9d0 2023-12-24T18:54:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.662+0000 7ff916d9d700 1 --2- 172.21.15.50:0/1466556687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9180cc9d0 0x7ff9180ccda0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff9080098e0 tx=0x7ff9080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fe4416865a98de server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90800b640 con 0x7ff9180cc9d0 2023-12-24T18:54:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90800b7a0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff915d9b700 1 -- 172.21.15.50:0/1466556687 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90800bb40 con 0x7ff9180cc9d0 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 -- 172.21.15.50:0/1466556687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9180cc9d0 msgr2=0x7ff9180ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 --2- 172.21.15.50:0/1466556687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9180cc9d0 0x7ff9180ccda0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff9080098e0 tx=0x7ff9080091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 -- 172.21.15.50:0/1466556687 shutdown_connections 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 --2- 172.21.15.50:0/1466556687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9180cc9d0 0x7ff9180ccda0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 -- 172.21.15.50:0/1466556687 >> 172.21.15.50:0/1466556687 conn(0x7ff9180670b0 msgr2=0x7ff9180674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 -- 172.21.15.50:0/1466556687 shutdown_connections 2023-12-24T18:54:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.666+0000 7ff91c984700 1 -- 172.21.15.50:0/1466556687 wait complete. 2023-12-24T18:54:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 Processor -- start 2023-12-24T18:54:05.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 -- start start 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9180ce390 0x7ff918169500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 0x7ff9181396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c84c0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918169d30 con 0x7ff918152fd0 2023-12-24T18:54:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91c984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91816a010 con 0x7ff9180ce390 2023-12-24T18:54:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50294/0 (socket says 172.21.15.50:50294) 2023-12-24T18:54:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 -- 172.21.15.50:0/92409734 learned_addr learned my addr 172.21.15.50:0/92409734 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91759e700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 0x7ff9181396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91659c700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9180ce390 0x7ff918169500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 -- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9180ce390 msgr2=0x7ff918169500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9180ce390 0x7ff918169500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 -- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 msgr2=0x7ff9181396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 0x7ff9181396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 -- 172.21.15.50:0/92409734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908009420 con 0x7ff9180cc9d0 2023-12-24T18:54:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff91759e700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 0x7ff9181396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.670+0000 7ff916d9d700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c6c10 tx=0x7ff908017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90801f070 con 0x7ff9180cc9d0 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908002f70 con 0x7ff9180cc9d0 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91816a2f0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90800bb40 con 0x7ff9180cc9d0 2023-12-24T18:54:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180c80e0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91804be40 con 0x7ff9180cc9d0 2023-12-24T18:54:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.674+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff908011630 con 0x7ff9180cc9d0 2023-12-24T18:54:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.678+0000 7ff8feffd700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 0x7ff904062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.678+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7ff90807dce0 con 0x7ff9180cc9d0 2023-12-24T18:54:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.678+0000 7ff91659c700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 0x7ff904062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:05.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.678+0000 7ff91659c700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 0x7ff904062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c6fa0 tx=0x7ff90c009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:05.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.682+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff90804e020 con 0x7ff9180cc9d0 2023-12-24T18:54:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:05.914+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7ff91806ac30 con 0x7ff9180cc9d0 2023-12-24T18:54:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.234+0000 7ff8feffd700 1 -- 172.21.15.50:0/92409734 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v674) v1 ==== 183+0+0 (secure 0 0 0) 0x7ff908051640 con 0x7ff9180cc9d0 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 msgr2=0x7ff904062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 0x7ff904062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c6fa0 tx=0x7ff90c009040 comp rx=0 tx=0).stop 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 msgr2=0x7ff91816d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c6c10 tx=0x7ff908017000 comp rx=0 tx=0).stop 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 shutdown_connections 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff904060550 0x7ff904062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff918152fd0 0x7ff9181396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9180ce390 0x7ff918169500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 --2- 172.21.15.50:0/92409734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9180cc9d0 0x7ff91816d680 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 >> 172.21.15.50:0/92409734 conn(0x7ff9180670b0 msgr2=0x7ff91814f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 shutdown_connections 2023-12-24T18:54:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.238+0000 7ff91c984700 1 -- 172.21.15.50:0/92409734 wait complete. 2023-12-24T18:54:06.266 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-12-24T18:54:06.267 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-12-24T18:54:06.267 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:54:06.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-12-24T18:54:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.438+0000 7f52d120c700 1 Processor -- start 2023-12-24T18:54:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.438+0000 7f52d120c700 1 -- start start 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52d120c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc158e00 0x7f52cc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52d120c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52d120c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc06b640 con 0x7f52cc06a580 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52d120c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc159710 con 0x7f52cc06d8c0 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52d120c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0b5e10 con 0x7f52cc158e00 2023-12-24T18:54:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50308/0 (socket says 172.21.15.50:50308) 2023-12-24T18:54:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 -- 172.21.15.50:0/3971391217 learned_addr learned my addr 172.21.15.50:0/3971391217 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52cbfff700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc158e00 0x7f52cc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 -- 172.21.15.50:0/3971391217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc158e00 msgr2=0x7f52cc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc158e00 0x7f52cc1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 -- 172.21.15.50:0/3971391217 >> v1:172.21.15.50:6789/0 conn(0x7f52cc06a580 legacy=0x7f52cc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 -- 172.21.15.50:0/3971391217 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc06b8e0 con 0x7f52cc06d8c0 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52c37fe700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f52b40099b0 tx=0x7f52b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3835309577746b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52cb7fe700 1 -- 172.21.15.50:0/3971391217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400b860 con 0x7f52cc06d8c0 2023-12-24T18:54:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52cb7fe700 1 -- 172.21.15.50:0/3971391217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400b9c0 con 0x7f52cc06d8c0 2023-12-24T18:54:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.442+0000 7f52cb7fe700 1 -- 172.21.15.50:0/3971391217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400bd60 con 0x7f52cc06d8c0 2023-12-24T18:54:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- 172.21.15.50:0/3971391217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc06d8c0 msgr2=0x7f52cc0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f52b40099b0 tx=0x7f52b4009250 comp rx=0 tx=0).stop 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- 172.21.15.50:0/3971391217 shutdown_connections 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc06d8c0 0x7f52cc0b3ad0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 --2- 172.21.15.50:0/3971391217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc158e00 0x7f52cc1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- 172.21.15.50:0/3971391217 >> 172.21.15.50:0/3971391217 conn(0x7f52cc067b80 msgr2=0x7f52cc0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- 172.21.15.50:0/3971391217 shutdown_connections 2023-12-24T18:54:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- 172.21.15.50:0/3971391217 wait complete. 2023-12-24T18:54:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 Processor -- start 2023-12-24T18:54:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.446+0000 7f52d120c700 1 -- start start 2023-12-24T18:54:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52cc06a580 0x7f52cc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc06d8c0 0x7f52cc140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc15bb10 con 0x7f52cc158e00 2023-12-24T18:54:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc15bdf0 con 0x7f52cc06a580 2023-12-24T18:54:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc15c0d0 con 0x7f52cc06d8c0 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50320/0 (socket says 172.21.15.50:50320) 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 -- 172.21.15.50:0/2134867107 learned_addr learned my addr 172.21.15.50:0/2134867107 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52c37fe700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc06d8c0 0x7f52cc140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52cbfff700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52cc06a580 0x7f52cc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 -- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc06d8c0 msgr2=0x7f52cc140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc06d8c0 0x7f52cc140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 -- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52cc06a580 msgr2=0x7f52cc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52cc06a580 0x7f52cc15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 -- 172.21.15.50:0/2134867107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40094f0 con 0x7f52cc158e00 2023-12-24T18:54:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d0a0b700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f52c400c910 tx=0x7f52c4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:06.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4006ba0 con 0x7f52cc158e00 2023-12-24T18:54:06.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4006d20 con 0x7f52cc158e00 2023-12-24T18:54:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4012880 con 0x7f52cc158e00 2023-12-24T18:54:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc15c3b0 con 0x7f52cc158e00 2023-12-24T18:54:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.450+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc15d0f0 con 0x7f52cc158e00 2023-12-24T18:54:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.454+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc15d340 con 0x7f52cc158e00 2023-12-24T18:54:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.454+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f52c4012c30 con 0x7f52cc158e00 2023-12-24T18:54:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.454+0000 7f52c8ff9700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 0x7f52ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.454+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f52c407c7b0 con 0x7f52cc158e00 2023-12-24T18:54:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.458+0000 7f52cbfff700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 0x7f52ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:06.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.458+0000 7f52cbfff700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 0x7f52ac062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f52bc006fd0 tx=0x7f52bc008040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.462+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52cc15d340 con 0x7f52cc158e00 2023-12-24T18:54:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:06.690+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f52cc15d340 con 0x7f52cc158e00 2023-12-24T18:54:07.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.234+0000 7f52c8ff9700 1 -- 172.21.15.50:0/2134867107 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v675) v1 ==== 151+0+0 (secure 0 0 0) 0x7f52cc15d340 con 0x7f52cc158e00 2023-12-24T18:54:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 msgr2=0x7f52ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 0x7f52ac062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f52bc006fd0 tx=0x7f52bc008040 comp rx=0 tx=0).stop 2023-12-24T18:54:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 msgr2=0x7f52cc15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f52c400c910 tx=0x7f52c4001710 comp rx=0 tx=0).stop 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 shutdown_connections 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f52ac060550 0x7f52ac062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52cc158e00 0x7f52cc15d530 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52cc06d8c0 0x7f52cc140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 --2- 172.21.15.50:0/2134867107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52cc06a580 0x7f52cc15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 >> 172.21.15.50:0/2134867107 conn(0x7f52cc067b80 msgr2=0x7f52cc0a9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 shutdown_connections 2023-12-24T18:54:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.242+0000 7f52d120c700 1 -- 172.21.15.50:0/2134867107 wait complete. 2023-12-24T18:54:07.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:54:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.446+0000 7f91ae745700 1 Processor -- start 2023-12-24T18:54:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.446+0000 7f91ae745700 1 -- start start 2023-12-24T18:54:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f91ae745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91a80b4430 0x7f91a806a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f91ae745700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a806bd70 con 0x7f91a806ac50 2023-12-24T18:54:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f91ae745700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a806b070 con 0x7f91a815d1d0 2023-12-24T18:54:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f91ae745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a806c9c0 con 0x7f91a80b4430 2023-12-24T18:54:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f919f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91a80b4430 0x7f91a806a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f919f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91a80b4430 0x7f91a806a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50324/0 (socket says 172.21.15.50:50324) 2023-12-24T18:54:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.450+0000 7f919f7fe700 1 -- 172.21.15.50:0/341192666 learned_addr learned my addr 172.21.15.50:0/341192666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f919f7fe700 1 -- 172.21.15.50:0/341192666 >> v1:172.21.15.82:6789/0 conn(0x7f91a815d1d0 legacy=0x7f91a80b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f919f7fe700 1 -- 172.21.15.50:0/341192666 >> v1:172.21.15.50:6789/0 conn(0x7f91a806ac50 legacy=0x7f91a806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f919f7fe700 1 -- 172.21.15.50:0/341192666 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a806cca0 con 0x7f91a80b4430 2023-12-24T18:54:07.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f919f7fe700 1 --2- 172.21.15.50:0/341192666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a80b4430 0x7f91a806a710 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f91900099b0 tx=0x7f9190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e9ab5fea3eb356 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91a77fe700 1 -- 172.21.15.50:0/341192666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000b860 con 0x7f91a80b4430 2023-12-24T18:54:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91a77fe700 1 -- 172.21.15.50:0/341192666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000b9c0 con 0x7f91a80b4430 2023-12-24T18:54:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91a77fe700 1 -- 172.21.15.50:0/341192666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000bd60 con 0x7f91a80b4430 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 -- 172.21.15.50:0/341192666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a80b4430 msgr2=0x7f91a806a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 --2- 172.21.15.50:0/341192666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a80b4430 0x7f91a806a710 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f91900099b0 tx=0x7f9190009250 comp rx=0 tx=0).stop 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 -- 172.21.15.50:0/341192666 shutdown_connections 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 --2- 172.21.15.50:0/341192666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a80b4430 0x7f91a806a710 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 -- 172.21.15.50:0/341192666 >> 172.21.15.50:0/341192666 conn(0x7f91a8067b80 msgr2=0x7f91a80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 -- 172.21.15.50:0/341192666 shutdown_connections 2023-12-24T18:54:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.454+0000 7f91ae745700 1 -- 172.21.15.50:0/341192666 wait complete. 2023-12-24T18:54:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 Processor -- start 2023-12-24T18:54:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 -- start start 2023-12-24T18:54:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91a806ac50 0x7f91a814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91a80b4430 0x7f91a8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a814fe60 con 0x7f91a815d1d0 2023-12-24T18:54:07.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8162f70 con 0x7f91a80b4430 2023-12-24T18:54:07.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91ae745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a81620c0 con 0x7f91a806ac50 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50332/0 (socket says 172.21.15.50:50332) 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 -- 172.21.15.50:0/3747440249 learned_addr learned my addr 172.21.15.50:0/3747440249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91a7fff700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91a806ac50 0x7f91a814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f919f7fe700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91a80b4430 0x7f91a8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 -- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91a806ac50 msgr2=0x7f91a814f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91a806ac50 0x7f91a814f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 -- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91a80b4430 msgr2=0x7f91a8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91a80b4430 0x7f91a8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 -- 172.21.15.50:0/3747440249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900094f0 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.458+0000 7f91acce2700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c4c0 tx=0x7f91a0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0011590 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0011710 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0011ad0 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a8162360 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a8162920 con 0x7f91a815d1d0 2023-12-24T18:54:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a80652e0 con 0x7f91a815d1d0 2023-12-24T18:54:07.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.462+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f91a001b3b0 con 0x7f91a815d1d0 2023-12-24T18:54:07.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.466+0000 7f91a4ff9700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 0x7f9188062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.466+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f91a007be60 con 0x7f91a815d1d0 2023-12-24T18:54:07.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.466+0000 7f91a7fff700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 0x7f9188062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.466+0000 7f91a7fff700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 0x7f9188062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9198007fd0 tx=0x7f9198009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.474+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f91a004c240 con 0x7f91a815d1d0 2023-12-24T18:54:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.650+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91a80d0490 con 0x7f91a815d1d0 2023-12-24T18:54:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.658+0000 7f91a4ff9700 1 -- 172.21.15.50:0/3747440249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f91a0017020 con 0x7f91a815d1d0 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 msgr2=0x7f9188062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 0x7f9188062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9198007fd0 tx=0x7f9198009040 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 msgr2=0x7f91a8153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c4c0 tx=0x7f91a0007f50 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 shutdown_connections 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9188060550 0x7f9188062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a815d1d0 0x7f91a8153720 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91a80b4430 0x7f91a8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 --2- 172.21.15.50:0/3747440249 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91a806ac50 0x7f91a814f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 >> 172.21.15.50:0/3747440249 conn(0x7f91a8067b80 msgr2=0x7f91a8152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 shutdown_connections 2023-12-24T18:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.662+0000 7f91ae745700 1 -- 172.21.15.50:0/3747440249 wait complete. 2023-12-24T18:54:07.684 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:54:07.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:54:07.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:54:07.770 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:54:07.771 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:54:07.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:54:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.938+0000 7f76bc62e700 1 Processor -- start 2023-12-24T18:54:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.938+0000 7f76bc62e700 1 -- start start 2023-12-24T18:54:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76bc62e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76b4154b60 0x7f76b40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76bc62e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 0x7f76b406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76bc62e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b406c820 con 0x7f76b40c6d00 2023-12-24T18:54:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76bc62e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406b960 con 0x7f76b4154b60 2023-12-24T18:54:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76bc62e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b406bc40 con 0x7f76b406aca0 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76ba3ca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f76b40c6d00 0x7f76b4154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45256/0 (socket says 172.21.15.50:45256) 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76ba3ca700 1 -- 172.21.15.50:0/4077816207 learned_addr learned my addr 172.21.15.50:0/4077816207 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/4077816207 >> v2:172.21.15.50:3300/0 conn(0x7f76b4154b60 0x7f76b40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76babcb700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 0x7f76b406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b93c8700 1 -- 172.21.15.50:0/4077816207 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023124487 0 0) 0x7f76b406c820 con 0x7f76b40c6d00 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b93c8700 1 -- 172.21.15.50:0/4077816207 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a0003570 con 0x7f76b40c6d00 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 -- 172.21.15.50:0/4077816207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 msgr2=0x7f76b406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 0x7f76b406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 -- 172.21.15.50:0/4077816207 >> v1:172.21.15.50:6789/0 conn(0x7f76b40c6d00 legacy=0x7f76b4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 -- 172.21.15.50:0/4077816207 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b406bf20 con 0x7f76b4154b60 2023-12-24T18:54:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76babcb700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 0x7f76b406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4154b60 0x7f76b40c70d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f76a40098e0 tx=0x7f76a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930a0da825e74cee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b93c8700 1 -- 172.21.15.50:0/4077816207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400b640 con 0x7f76b4154b60 2023-12-24T18:54:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.942+0000 7f76b93c8700 1 -- 172.21.15.50:0/4077816207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400b7a0 con 0x7f76b4154b60 2023-12-24T18:54:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76b93c8700 1 -- 172.21.15.50:0/4077816207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400bb40 con 0x7f76b4154b60 2023-12-24T18:54:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 -- 172.21.15.50:0/4077816207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4154b60 msgr2=0x7f76b40c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4154b60 0x7f76b40c70d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f76a40098e0 tx=0x7f76a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 -- 172.21.15.50:0/4077816207 shutdown_connections 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b406aca0 0x7f76b406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 --2- 172.21.15.50:0/4077816207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4154b60 0x7f76b40c70d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 -- 172.21.15.50:0/4077816207 >> 172.21.15.50:0/4077816207 conn(0x7f76b40cbba0 msgr2=0x7f76b40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 -- 172.21.15.50:0/4077816207 shutdown_connections 2023-12-24T18:54:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 -- 172.21.15.50:0/4077816207 wait complete. 2023-12-24T18:54:07.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.946+0000 7f76bc62e700 1 Processor -- start 2023-12-24T18:54:07.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- start start 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b406aca0 0x7f76b40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b4154b60 0x7f76b4169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4169b00 con 0x7f76b40c6d00 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4153f00 con 0x7f76b406aca0 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40aeab0 con 0x7f76b4154b60 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50338/0 (socket says 172.21.15.50:50338) 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 -- 172.21.15.50:0/3453762468 learned_addr learned my addr 172.21.15.50:0/3453762468 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76ba3ca700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b406aca0 0x7f76b40af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76babcb700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b4154b60 0x7f76b4169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 -- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b4154b60 msgr2=0x7f76b4169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b4154b60 0x7f76b4169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 -- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b406aca0 msgr2=0x7f76b40af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b406aca0 0x7f76b40af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 -- 172.21.15.50:0/3453762468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009420 con 0x7f76b40c6d00 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76b9bc9700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f76b4069da0 tx=0x7f76a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a401bda0 con 0x7f76b40c6d00 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4011420 con 0x7f76b40c6d00 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40aed70 con 0x7f76b40c6d00 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40117e0 con 0x7f76b40c6d00 2023-12-24T18:54:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.950+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b4169790 con 0x7f76b40c6d00 2023-12-24T18:54:07.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.954+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b41695e0 con 0x7f76b40c6d00 2023-12-24T18:54:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.954+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f76a4011b50 con 0x7f76b40c6d00 2023-12-24T18:54:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.954+0000 7f76aa7fc700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 0x7f7698062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.954+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f76a407dfe0 con 0x7f76b40c6d00 2023-12-24T18:54:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.958+0000 7f76ba3ca700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 0x7f7698062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:07.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.958+0000 7f76ba3ca700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 0x7f7698062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76b00058d0 tx=0x7f76b0009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:07.962+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f76a404e3c0 con 0x7f76b40c6d00 2023-12-24T18:54:08.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.174+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76b40652e0 con 0x7f76b40c6d00 2023-12-24T18:54:08.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.174+0000 7f76aa7fc700 1 -- 172.21.15.50:0/3453762468 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f76a4015de0 con 0x7f76b40c6d00 2023-12-24T18:54:08.177 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:08.177 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4264813054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4264813054},{"type":"v1","addr":"172.21.15.50:6833","nonce":4264813054}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/2310187236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2310187236},{"type":"v1","addr":"172.21.15.82:6834","nonce":2310187236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1212149966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1212149966},{"type":"v1","addr":"172.21.15.82:6835","nonce":1212149966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7674,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/254347841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":254347841},{"type":"v1","addr":"172.21.15.50:6835","nonce":254347841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[]} 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 msgr2=0x7f7698062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 0x7f7698062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76b00058d0 tx=0x7f76b0009040 comp rx=0 tx=0).stop 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 msgr2=0x7f76b4152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f76b4069da0 tx=0x7f76a4017000 comp rx=0 tx=0).stop 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 shutdown_connections 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7698060550 0x7f7698062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76b4154b60 0x7f76b4169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40c6d00 0x7f76b4152e60 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 --2- 172.21.15.50:0/3453762468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b406aca0 0x7f76b40af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 >> 172.21.15.50:0/3453762468 conn(0x7f76b40cbba0 msgr2=0x7f76b406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 shutdown_connections 2023-12-24T18:54:08.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.178+0000 7f76bc62e700 1 -- 172.21.15.50:0/3453762468 wait complete. 2023-12-24T18:54:08.183 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 55 2023-12-24T18:54:08.203 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:54:08.203 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:54:08.204 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:54:08.204 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:54:08.204 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:54:08.204 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:54:08.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:54:08.204 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:54:08.204 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:54:08.204 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:54:08.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:54:08.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:54:08.205 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:54:08.205 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:54:08.205 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:54:08.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:54:08.224 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:54:08.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:54:08.226 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:54:08.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:54:08.230 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:54:08.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:54:08.231 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:54:08.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:54:08.273 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:54:08.274 DEBUG:teuthology.parallel:result is None 2023-12-24T18:54:08.277 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:54:08.277 DEBUG:teuthology.parallel:result is None 2023-12-24T18:54:08.283 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:54:08.284 DEBUG:teuthology.parallel:result is None 2023-12-24T18:54:08.286 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:54:08.286 DEBUG:teuthology.parallel:result is None 2023-12-24T18:54:08.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:54:08.387 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:54:08.393 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:54:08.395 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:54:08.396 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:54:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.450+0000 7f7b1b2f0700 1 Processor -- start 2023-12-24T18:54:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.450+0000 7f7b1b2f0700 1 -- start start 2023-12-24T18:54:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b140ce750 0x7f7b140ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b14159a20 0x7f7b14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1406ba80 con 0x7f7b1406ae30 2023-12-24T18:54:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1406bd60 con 0x7f7b14159a20 2023-12-24T18:54:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1406c040 con 0x7f7b140ce750 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b14159a20 0x7f7b14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b14159a20 0x7f7b14159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50364/0 (socket says 172.21.15.50:50364) 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 -- 172.21.15.50:0/1427493628 learned_addr learned my addr 172.21.15.50:0/1427493628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1908c700 1 --2- 172.21.15.50:0/1427493628 >> v2:172.21.15.82:3300/0 conn(0x7f7b140ce750 0x7f7b140ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 -- 172.21.15.50:0/1427493628 >> v2:172.21.15.82:3300/0 conn(0x7f7b140ce750 msgr2=0x7f7b140ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 --2- 172.21.15.50:0/1427493628 >> v2:172.21.15.82:3300/0 conn(0x7f7b140ce750 0x7f7b140ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 -- 172.21.15.50:0/1427493628 >> v1:172.21.15.50:6789/0 conn(0x7f7b1406ae30 legacy=0x7f7b1406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 -- 172.21.15.50:0/1427493628 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1406c320 con 0x7f7b14159a20 2023-12-24T18:54:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1988d700 1 --2- 172.21.15.50:0/1427493628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b14159a20 0x7f7b14159ec0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cda50 tx=0x7f7b0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d01fd34c75ecef server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1427493628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00e070 con 0x7f7b14159a20 2023-12-24T18:54:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1427493628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c00ba50 con 0x7f7b14159a20 2023-12-24T18:54:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1427493628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0092e0 con 0x7f7b14159a20 2023-12-24T18:54:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/1427493628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b14159a20 msgr2=0x7f7b14159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/1427493628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b14159a20 0x7f7b14159ec0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cda50 tx=0x7f7b0c009840 comp rx=0 tx=0).stop 2023-12-24T18:54:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/1427493628 shutdown_connections 2023-12-24T18:54:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/1427493628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b14159a20 0x7f7b14159ec0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/1427493628 >> v2:172.21.15.82:3300/0 conn(0x7f7b140ce750 0x7f7b140ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.454+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/1427493628 >> 172.21.15.50:0/1427493628 conn(0x7f7b140cffb0 msgr2=0x7f7b140d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.458+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/1427493628 shutdown_connections 2023-12-24T18:54:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.458+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/1427493628 wait complete. 2023-12-24T18:54:08.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.458+0000 7f7b1b2f0700 1 Processor -- start 2023-12-24T18:54:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.458+0000 7f7b1b2f0700 1 -- start start 2023-12-24T18:54:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1406ae30 0x7f7b140c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 0x7f7b141574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14157080 con 0x7f7b140ce750 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140c8510 con 0x7f7b1406ae30 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140c87f0 con 0x7f7b14159a20 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50370/0 (socket says 172.21.15.50:50370) 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 -- 172.21.15.50:0/3016437912 learned_addr learned my addr 172.21.15.50:0/3016437912 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1908c700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1406ae30 0x7f7b140c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1988d700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 0x7f7b141574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 -- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 msgr2=0x7f7b141574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 0x7f7b141574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 -- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1406ae30 msgr2=0x7f7b140c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1406ae30 0x7f7b140c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 -- 172.21.15.50:0/3016437912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009ae0 con 0x7f7b140ce750 2023-12-24T18:54:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1988d700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 0x7f7b141574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1888b700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c7c0 tx=0x7f7b04007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04011590 con 0x7f7b140ce750 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04011710 con 0x7f7b140ce750 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04011ad0 con 0x7f7b140ce750 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.462+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b140c8ad0 con 0x7f7b140ce750 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.466+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b140c9090 con 0x7f7b140ce750 2023-12-24T18:54:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.466+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b140c92b0 con 0x7f7b140ce750 2023-12-24T18:54:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.466+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7b0401a360 con 0x7f7b140ce750 2023-12-24T18:54:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.470+0000 7f7b097fa700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 0x7f7af8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.470+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f7b0407b9f0 con 0x7f7b140ce750 2023-12-24T18:54:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.470+0000 7f7b1908c700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 0x7f7af8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:08.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.470+0000 7f7b1908c700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 0x7f7af8062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.474+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7b0404bd30 con 0x7f7b140ce750 2023-12-24T18:54:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:08.662+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7b140652e0 con 0x7f7b140ce750 2023-12-24T18:54:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.746+0000 7f7b097fa700 1 -- 172.21.15.50:0/3016437912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b0404f350 con 0x7f7b140ce750 2023-12-24T18:54:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 msgr2=0x7f7af8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 0x7f7af8062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2023-12-24T18:54:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 msgr2=0x7f7b14169b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c7c0 tx=0x7f7b04007f50 comp rx=0 tx=0).stop 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 shutdown_connections 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7af8060550 0x7f7af8062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b14159a20 0x7f7b141574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b140ce750 0x7f7b14169b40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 --2- 172.21.15.50:0/3016437912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1406ae30 0x7f7b140c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 >> 172.21.15.50:0/3016437912 conn(0x7f7b140cffb0 msgr2=0x7f7b140c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.750+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 shutdown_connections 2023-12-24T18:54:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.754+0000 7f7b1b2f0700 1 -- 172.21.15.50:0/3016437912 wait complete. 2023-12-24T18:54:09.756 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:54:09.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:54:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.942+0000 7f25254ae700 1 Processor -- start 2023-12-24T18:54:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 -- start start 2023-12-24T18:54:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f920 0x7f25200ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25200cb3c0 0x7f252006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252006c090 con 0x7f252013f550 2023-12-24T18:54:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252006a6a0 con 0x7f25200cb3c0 2023-12-24T18:54:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f25254ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200cb8a0 con 0x7f252013f920 2023-12-24T18:54:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f252013f550 0x7f252006b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36614/0 (socket says 172.21.15.50:36614) 2023-12-24T18:54:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251effd700 1 -- 172.21.15.50:0/1963770395 learned_addr learned my addr 172.21.15.50:0/1963770395 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251f7fe700 1 --2- 172.21.15.50:0/1963770395 >> v2:172.21.15.50:3300/0 conn(0x7f25200cb3c0 0x7f252006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f2517fff700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f920 0x7f25200ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251f7fe700 1 -- 172.21.15.50:0/1963770395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f920 msgr2=0x7f25200ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251f7fe700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f920 0x7f25200ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251f7fe700 1 -- 172.21.15.50:0/1963770395 >> v1:172.21.15.50:6789/0 conn(0x7f252013f550 legacy=0x7f252006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.946+0000 7f251f7fe700 1 -- 172.21.15.50:0/1963770395 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252006a960 con 0x7f25200cb3c0 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f251f7fe700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f252006bb50 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd26bda580425825 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f251e7fc700 1 -- 172.21.15.50:0/1963770395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e070 con 0x7f25200cb3c0 2023-12-24T18:54:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f251e7fc700 1 -- 172.21.15.50:0/1963770395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800bc30 con 0x7f25200cb3c0 2023-12-24T18:54:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f251e7fc700 1 -- 172.21.15.50:0/1963770395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518012430 con 0x7f25200cb3c0 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 -- 172.21.15.50:0/1963770395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 msgr2=0x7f252006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f252006bb50 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518009780 comp rx=0 tx=0).stop 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 -- 172.21.15.50:0/1963770395 shutdown_connections 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f252006bb50 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 --2- 172.21.15.50:0/1963770395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f920 0x7f25200ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 -- 172.21.15.50:0/1963770395 >> 172.21.15.50:0/1963770395 conn(0x7f25200cbba0 msgr2=0x7f25200cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 -- 172.21.15.50:0/1963770395 shutdown_connections 2023-12-24T18:54:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.950+0000 7f25254ae700 1 -- 172.21.15.50:0/1963770395 wait complete. 2023-12-24T18:54:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 Processor -- start 2023-12-24T18:54:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 -- start start 2023-12-24T18:54:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f550 0x7f25200c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252013f920 0x7f25201576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520157170 con 0x7f25200cb3c0 2023-12-24T18:54:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520156560 con 0x7f252013f920 2023-12-24T18:54:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f25254ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520156840 con 0x7f252013f550 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252013f920 0x7f25201576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36748/0 (socket says 172.21.15.50:36748) 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 -- 172.21.15.50:0/3740498649 learned_addr learned my addr 172.21.15.50:0/3740498649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f2517fff700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f550 0x7f25200c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 -- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f550 msgr2=0x7f25200c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f550 0x7f25200c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 -- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252013f920 msgr2=0x7f25201576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252013f920 0x7f25201576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 -- 172.21.15.50:0/3740498649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009a20 con 0x7f25200cb3c0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.954+0000 7f251effd700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f251000c7c0 tx=0x7f2510007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510005b30 con 0x7f25200cb3c0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510005c90 con 0x7f25200cb3c0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2520156b20 con 0x7f25200cb3c0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510004a80 con 0x7f25200cb3c0 2023-12-24T18:54:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200aec70 con 0x7f25200cb3c0 2023-12-24T18:54:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200652e0 con 0x7f25200cb3c0 2023-12-24T18:54:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.958+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f25100070d0 con 0x7f25200cb3c0 2023-12-24T18:54:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.962+0000 7f2516ffd700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 0x7f2500062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.962+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f251007baa0 con 0x7f25200cb3c0 2023-12-24T18:54:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.962+0000 7f2517fff700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 0x7f2500062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.962+0000 7f2517fff700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 0x7f2500062a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25200b1ab0 tx=0x7f2508008040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:09.970+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2510049be0 con 0x7f25200cb3c0 2023-12-24T18:54:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.194+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f25201596b0 con 0x7f25200cb3c0 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.194+0000 7f2516ffd700 1 -- 172.21.15.50:0/3740498649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f251004c130 con 0x7f25200cb3c0 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:54:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:54:10.198 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.199 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.201 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.202 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:54:10.203 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.204 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:54:10.205 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:54:10.206 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:54:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.208 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:54:10.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:54:10.210 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 msgr2=0x7f2500062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 0x7f2500062a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25200b1ab0 tx=0x7f2508008040 comp rx=0 tx=0).stop 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 msgr2=0x7f25200c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f251000c7c0 tx=0x7f2510007f70 comp rx=0 tx=0).stop 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 shutdown_connections 2023-12-24T18:54:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2500060550 0x7f2500062a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252013f920 0x7f25201576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f252013f550 0x7f25200c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 --2- 172.21.15.50:0/3740498649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25200cb3c0 0x7f25200c9750 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 >> 172.21.15.50:0/3740498649 conn(0x7f25200cbba0 msgr2=0x7f252013e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 shutdown_connections 2023-12-24T18:54:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.202+0000 7f25254ae700 1 -- 172.21.15.50:0/3740498649 wait complete. 2023-12-24T18:54:10.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:54:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.382+0000 7fc4756ae700 1 Processor -- start 2023-12-24T18:54:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.382+0000 7fc4756ae700 1 -- start start 2023-12-24T18:54:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc4756ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 0x7fc4700ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc4756ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47006a6a0 con 0x7fc47013f920 2023-12-24T18:54:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc4756ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700cb8a0 con 0x7fc4700cb3c0 2023-12-24T18:54:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc4756ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47006a960 con 0x7fc47013f550 2023-12-24T18:54:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc47013f920 0x7fc47006b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36620/0 (socket says 172.21.15.50:36620) 2023-12-24T18:54:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46e7fc700 1 -- 172.21.15.50:0/3518248778 learned_addr learned my addr 172.21.15.50:0/3518248778 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46effd700 1 --2- 172.21.15.50:0/3518248778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 0x7fc4700ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46dffb700 1 -- 172.21.15.50:0/3518248778 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360952459 0 0) 0x7fc47006a6a0 con 0x7fc47013f920 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46dffb700 1 -- 172.21.15.50:0/3518248778 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc458003570 con 0x7fc47013f920 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46effd700 1 -- 172.21.15.50:0/3518248778 >> v1:172.21.15.82:6789/0 conn(0x7fc4700cb3c0 legacy=0x7fc47006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46effd700 1 -- 172.21.15.50:0/3518248778 >> v1:172.21.15.50:6789/0 conn(0x7fc47013f920 legacy=0x7fc47006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46effd700 1 -- 172.21.15.50:0/3518248778 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47006ac40 con 0x7fc47013f550 2023-12-24T18:54:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46effd700 1 --2- 172.21.15.50:0/3518248778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 0x7fc4700ab5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc460009910 tx=0x7fc4600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd4aab7c8d5f0d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46dffb700 1 -- 172.21.15.50:0/3518248778 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000b680 con 0x7fc47013f550 2023-12-24T18:54:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46dffb700 1 -- 172.21.15.50:0/3518248778 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46000b7e0 con 0x7fc47013f550 2023-12-24T18:54:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.386+0000 7fc46dffb700 1 -- 172.21.15.50:0/3518248778 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000bba0 con 0x7fc47013f550 2023-12-24T18:54:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- 172.21.15.50:0/3518248778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 msgr2=0x7fc4700ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 --2- 172.21.15.50:0/3518248778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 0x7fc4700ab5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc460009910 tx=0x7fc4600091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- 172.21.15.50:0/3518248778 shutdown_connections 2023-12-24T18:54:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 --2- 172.21.15.50:0/3518248778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc47013f550 0x7fc4700ab5e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- 172.21.15.50:0/3518248778 >> 172.21.15.50:0/3518248778 conn(0x7fc4700cbba0 msgr2=0x7fc4700cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- 172.21.15.50:0/3518248778 shutdown_connections 2023-12-24T18:54:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- 172.21.15.50:0/3518248778 wait complete. 2023-12-24T18:54:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 Processor -- start 2023-12-24T18:54:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.390+0000 7fc4756ae700 1 -- start start 2023-12-24T18:54:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4700cb3c0 0x7fc470157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47013f920 0x7fc4700af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701591e0 con 0x7fc47013f550 2023-12-24T18:54:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470158140 con 0x7fc47013f920 2023-12-24T18:54:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc470158420 con 0x7fc4700cb3c0 2023-12-24T18:54:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36762/0 (socket says 172.21.15.50:36762) 2023-12-24T18:54:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 -- 172.21.15.50:0/2531416125 learned_addr learned my addr 172.21.15.50:0/2531416125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46effd700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4700cb3c0 0x7fc470157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46f7fe700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47013f920 0x7fc4700af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 -- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4700cb3c0 msgr2=0x7fc470157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4700cb3c0 0x7fc470157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 -- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47013f920 msgr2=0x7fc4700af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47013f920 0x7fc4700af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 -- 172.21.15.50:0/2531416125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc460009420 con 0x7fc47013f550 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc46e7fc700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c590 tx=0x7fc464007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464005b30 con 0x7fc47013f550 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464005cb0 con 0x7fc47013f550 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464007320 con 0x7fc47013f550 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.394+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470158700 con 0x7fc47013f550 2023-12-24T18:54:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.398+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc470158cc0 con 0x7fc47013f550 2023-12-24T18:54:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.398+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470158ee0 con 0x7fc47013f550 2023-12-24T18:54:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.398+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc46401b3b0 con 0x7fc47013f550 2023-12-24T18:54:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.402+0000 7fc456ffd700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.402+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fc46407bd70 con 0x7fc47013f550 2023-12-24T18:54:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.402+0000 7fc46effd700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.402+0000 7fc46effd700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 0x7fc45c062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4600093f0 tx=0x7fc460017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.406+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc46404c360 con 0x7fc47013f550 2023-12-24T18:54:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.582+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4700652e0 con 0x7fc47013f550 2023-12-24T18:54:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc456ffd700 1 -- 172.21.15.50:0/2531416125 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+12873 (secure 0 0 0) 0x7fc464017020 con 0x7fc47013f550 2023-12-24T18:54:10.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:10.587 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":121,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:09.741269+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 msgr2=0x7fc45c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 0x7fc45c062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4600093f0 tx=0x7fc460017000 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 msgr2=0x7fc4700aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c590 tx=0x7fc464007e00 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 shutdown_connections 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47013f920 0x7fc4700af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc47013f550 0x7fc4700aecc0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 --2- 172.21.15.50:0/2531416125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4700cb3c0 0x7fc470157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 >> 172.21.15.50:0/2531416125 conn(0x7fc4700cbba0 msgr2=0x7fc4700ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 shutdown_connections 2023-12-24T18:54:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.586+0000 7fc4756ae700 1 -- 172.21.15.50:0/2531416125 wait complete. 2023-12-24T18:54:10.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:54:10.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:54:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.778+0000 7fb24cc4c700 1 Processor -- start 2023-12-24T18:54:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.778+0000 7fb24cc4c700 1 -- start start 2023-12-24T18:54:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb24cc4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 0x7fb2480c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb24cc4c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2480c9ea0 con 0x7fb2480bebc0 2023-12-24T18:54:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb24cc4c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24815d840 con 0x7fb2480ab920 2023-12-24T18:54:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb24cc4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb248161780 con 0x7fb2480c8ee0 2023-12-24T18:54:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb2477fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2480bebc0 0x7fb248160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36630/0 (socket says 172.21.15.50:36630) 2023-12-24T18:54:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb246ffd700 1 --1- 172.21.15.50:0/1858085158 >> v1:172.21.15.82:6789/0 conn(0x7fb2480ab920 0x7fb2480c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34094/0 (socket says 172.21.15.50:34094) 2023-12-24T18:54:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb2477fe700 1 -- 172.21.15.50:0/1858085158 learned_addr learned my addr 172.21.15.50:0/1858085158 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.782+0000 7fb247fff700 1 --2- 172.21.15.50:0/1858085158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 0x7fb2480c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685092806 0 0) 0x7fb24815d840 con 0x7fb2480ab920 2023-12-24T18:54:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb230003570 con 0x7fb2480ab920 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117386771 0 0) 0x7fb2480c9ea0 con 0x7fb2480bebc0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb24815d840 con 0x7fb2480bebc0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb247fff700 1 -- 172.21.15.50:0/1858085158 >> v1:172.21.15.82:6789/0 conn(0x7fb2480ab920 legacy=0x7fb2480c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb247fff700 1 -- 172.21.15.50:0/1858085158 >> v1:172.21.15.50:6789/0 conn(0x7fb2480bebc0 legacy=0x7fb248160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb247fff700 1 -- 172.21.15.50:0/1858085158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb248161a60 con 0x7fb2480c8ee0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb247fff700 1 --2- 172.21.15.50:0/1858085158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 0x7fb2480c6f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb240009e90 tx=0x7fb240009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe0d4e343ef5d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000e070 con 0x7fb2480c8ee0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24000bb80 con 0x7fb2480c8ee0 2023-12-24T18:54:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb2467fc700 1 -- 172.21.15.50:0/1858085158 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240012430 con 0x7fb2480c8ee0 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 -- 172.21.15.50:0/1858085158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 msgr2=0x7fb2480c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/1858085158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 0x7fb2480c6f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb240009e90 tx=0x7fb240009780 comp rx=0 tx=0).stop 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 -- 172.21.15.50:0/1858085158 shutdown_connections 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/1858085158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480c8ee0 0x7fb2480c6f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 -- 172.21.15.50:0/1858085158 >> 172.21.15.50:0/1858085158 conn(0x7fb248067250 msgr2=0x7fb248067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 -- 172.21.15.50:0/1858085158 shutdown_connections 2023-12-24T18:54:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.786+0000 7fb24cc4c700 1 -- 172.21.15.50:0/1858085158 wait complete. 2023-12-24T18:54:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 Processor -- start 2023-12-24T18:54:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 -- start start 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2480bebc0 0x7fb2480ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2480c8ee0 0x7fb248158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24816de90 con 0x7fb2480bebc0 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480abd40 con 0x7fb2480c8ee0 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb24cc4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480ac020 con 0x7fb2480ab920 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:35488/0 (socket says 172.21.15.50:35488) 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 -- 172.21.15.50:0/2453112215 learned_addr learned my addr 172.21.15.50:0/2453112215 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb246ffd700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2480bebc0 0x7fb2480ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb247fff700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2480c8ee0 0x7fb248158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 -- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2480c8ee0 msgr2=0x7fb248158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2480c8ee0 0x7fb248158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 -- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2480bebc0 msgr2=0x7fb2480ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2480bebc0 0x7fb2480ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.790+0000 7fb2477fe700 1 -- 172.21.15.50:0/2453112215 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240009a20 con 0x7fb2480ab920 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb2477fe700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c7c0 tx=0x7fb238007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238005b30 con 0x7fb2480ab920 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238005cb0 con 0x7fb2480ab920 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238007320 con 0x7fb2480ab920 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2480ac300 con 0x7fb2480ab920 2023-12-24T18:54:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2480ac8c0 con 0x7fb2480ab920 2023-12-24T18:54:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.794+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2480c2780 con 0x7fb2480ab920 2023-12-24T18:54:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.798+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb23801b3b0 con 0x7fb2480ab920 2023-12-24T18:54:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.798+0000 7fb22f7fe700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 0x7fb234062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.798+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fb23807bcb0 con 0x7fb2480ab920 2023-12-24T18:54:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.798+0000 7fb246ffd700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 0x7fb234062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.798+0000 7fb246ffd700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 0x7fb234062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb24806db10 tx=0x7fb23c007d40 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:10.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.806+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2480c2780 con 0x7fb2480ab920 2023-12-24T18:54:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.978+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2480c2780 con 0x7fb2480ab920 2023-12-24T18:54:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb22f7fe700 1 -- 172.21.15.50:0/2453112215 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2380170a0 con 0x7fb2480ab920 2023-12-24T18:54:10.982 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 msgr2=0x7fb234062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 0x7fb234062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb24806db10 tx=0x7fb23c007d40 comp rx=0 tx=0).stop 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 msgr2=0x7fb24816d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c7c0 tx=0x7fb238007e00 comp rx=0 tx=0).stop 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 shutdown_connections 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb234060550 0x7fb234062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2480c8ee0 0x7fb248158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2480bebc0 0x7fb2480ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 --2- 172.21.15.50:0/2453112215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2480ab920 0x7fb24816d950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 >> 172.21.15.50:0/2453112215 conn(0x7fb248067250 msgr2=0x7fb24806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 shutdown_connections 2023-12-24T18:54:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:10.982+0000 7fb24cc4c700 1 -- 172.21.15.50:0/2453112215 wait complete. 2023-12-24T18:54:11.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:54:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.162+0000 7fcd89585700 1 Processor -- start 2023-12-24T18:54:11.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.162+0000 7fcd89585700 1 -- start start 2023-12-24T18:54:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd8406a7b0 0x7fcd8406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 0x7fcd8415a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8406cd10 con 0x7fcd8406b2d0 2023-12-24T18:54:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840ad4e0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8415a690 con 0x7fcd84159cf0 2023-12-24T18:54:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd8406a7b0 0x7fcd8406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd8406a7b0 0x7fcd8406ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36784/0 (socket says 172.21.15.50:36784) 2023-12-24T18:54:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 -- 172.21.15.50:0/3724829134 learned_addr learned my addr 172.21.15.50:0/3724829134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd837fe700 1 --2- 172.21.15.50:0/3724829134 >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 0x7fcd8415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 -- 172.21.15.50:0/3724829134 >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 msgr2=0x7fcd8415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 --2- 172.21.15.50:0/3724829134 >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 0x7fcd8415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 -- 172.21.15.50:0/3724829134 >> v1:172.21.15.50:6789/0 conn(0x7fcd8406b2d0 legacy=0x7fcd840ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 -- 172.21.15.50:0/3724829134 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8406e1b0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd837fe700 1 --2- 172.21.15.50:0/3724829134 >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 0x7fcd8415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd82ffd700 1 --2- 172.21.15.50:0/3724829134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd8406ab80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcd840b1c00 tx=0x7fcd74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e888ffdb52a00fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd827fc700 1 -- 172.21.15.50:0/3724829134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400b860 con 0x7fcd8406a7b0 2023-12-24T18:54:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd827fc700 1 -- 172.21.15.50:0/3724829134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400b9c0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd827fc700 1 -- 172.21.15.50:0/3724829134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400bd60 con 0x7fcd8406a7b0 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 -- 172.21.15.50:0/3724829134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 msgr2=0x7fcd8406ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.166+0000 7fcd89585700 1 --2- 172.21.15.50:0/3724829134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd8406ab80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcd840b1c00 tx=0x7fcd74009250 comp rx=0 tx=0).stop 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 -- 172.21.15.50:0/3724829134 shutdown_connections 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 --2- 172.21.15.50:0/3724829134 >> v2:172.21.15.82:3300/0 conn(0x7fcd84159cf0 0x7fcd8415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 --2- 172.21.15.50:0/3724829134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd8406ab80 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 -- 172.21.15.50:0/3724829134 >> 172.21.15.50:0/3724829134 conn(0x7fcd84067b40 msgr2=0x7fcd840cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 -- 172.21.15.50:0/3724829134 shutdown_connections 2023-12-24T18:54:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 -- 172.21.15.50:0/3724829134 wait complete. 2023-12-24T18:54:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 Processor -- start 2023-12-24T18:54:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.170+0000 7fcd89585700 1 -- start start 2023-12-24T18:54:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd8406b2d0 0x7fcd84156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd84159cf0 0x7fcd84147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84156a30 con 0x7fcd8406a7b0 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84156d10 con 0x7fcd8406b2d0 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84156ff0 con 0x7fcd84159cf0 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36800/0 (socket says 172.21.15.50:36800) 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 -- 172.21.15.50:0/1252920910 learned_addr learned my addr 172.21.15.50:0/1252920910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd837fe700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd84159cf0 0x7fcd84147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd7a7fc700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd8406b2d0 0x7fcd84156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 -- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd84159cf0 msgr2=0x7fcd84147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd84159cf0 0x7fcd84147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 -- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd8406b2d0 msgr2=0x7fcd84156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd8406b2d0 0x7fcd84156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 -- 172.21.15.50:0/1252920910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740094f0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd82ffd700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009290 tx=0x7fcd74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74026480 con 0x7fcd8406a7b0 2023-12-24T18:54:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7401f070 con 0x7fcd8406a7b0 2023-12-24T18:54:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd840af750 con 0x7fcd8406a7b0 2023-12-24T18:54:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74026850 con 0x7fcd8406a7b0 2023-12-24T18:54:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.174+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841479d0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.178+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8404be40 con 0x7fcd8406a7b0 2023-12-24T18:54:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.178+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcd7401a430 con 0x7fcd8406a7b0 2023-12-24T18:54:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.178+0000 7fcd7b7fe700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 0x7fcd64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.178+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fcd74021070 con 0x7fcd8406a7b0 2023-12-24T18:54:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.182+0000 7fcd7a7fc700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 0x7fcd64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.182+0000 7fcd7a7fc700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 0x7fcd64062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd840af600 tx=0x7fcd6c007ec0 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.186+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd7404ebd0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcd840cc500 con 0x7fcd8406a7b0 2023-12-24T18:54:11.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd7b7fe700 1 -- 172.21.15.50:0/1252920910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcd740521f0 con 0x7fcd8406a7b0 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:11.367 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:54:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 msgr2=0x7fcd64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 0x7fcd64062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd840af600 tx=0x7fcd6c007ec0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 msgr2=0x7fcd84158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009290 tx=0x7fcd74017000 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 shutdown_connections 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd64060550 0x7fcd64062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd84159cf0 0x7fcd84147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd8406b2d0 0x7fcd84156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 --2- 172.21.15.50:0/1252920910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8406a7b0 0x7fcd84158810 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.366+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 >> 172.21.15.50:0/1252920910 conn(0x7fcd84067b40 msgr2=0x7fcd840c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.370+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 shutdown_connections 2023-12-24T18:54:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.370+0000 7fcd89585700 1 -- 172.21.15.50:0/1252920910 wait complete. 2023-12-24T18:54:11.393 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:54:11.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:54:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.574+0000 7f8c357c5700 1 Processor -- start 2023-12-24T18:54:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.574+0000 7f8c357c5700 1 -- start start 2023-12-24T18:54:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c357c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c30156b50 0x7f8c3015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c357c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c3006db90 0x7f8c300b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c357c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3006d4d0 con 0x7f8c300b4060 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c357c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300b44e0 con 0x7f8c3006db90 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c357c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300b4960 con 0x7f8c30156b50 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c3006db90 0x7f8c300b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c3006db90 0x7f8c300b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36810/0 (socket says 172.21.15.50:36810) 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/1180520760 learned_addr learned my addr 172.21.15.50:0/1180520760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2effd700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c30156b50 0x7f8c3015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/1180520760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c30156b50 msgr2=0x7f8c3015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c30156b50 0x7f8c3015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/1180520760 >> v1:172.21.15.82:6789/0 conn(0x7f8c300b4060 legacy=0x7f8c3015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/1180520760 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3015a620 con 0x7f8c3006db90 2023-12-24T18:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2e7fc700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006db90 0x7f8c300b3b20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8c240099b0 tx=0x7f8c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608b7bfb48c4f2d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2dffb700 1 -- 172.21.15.50:0/1180520760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400b860 con 0x7f8c3006db90 2023-12-24T18:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2dffb700 1 -- 172.21.15.50:0/1180520760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400b9c0 con 0x7f8c3006db90 2023-12-24T18:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.578+0000 7f8c2dffb700 1 -- 172.21.15.50:0/1180520760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400bd60 con 0x7f8c3006db90 2023-12-24T18:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- 172.21.15.50:0/1180520760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006db90 msgr2=0x7f8c300b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006db90 0x7f8c300b3b20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8c240099b0 tx=0x7f8c24009250 comp rx=0 tx=0).stop 2023-12-24T18:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- 172.21.15.50:0/1180520760 shutdown_connections 2023-12-24T18:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006db90 0x7f8c300b3b20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 --2- 172.21.15.50:0/1180520760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c30156b50 0x7f8c3015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- 172.21.15.50:0/1180520760 >> 172.21.15.50:0/1180520760 conn(0x7f8c30067b40 msgr2=0x7f8c300b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- 172.21.15.50:0/1180520760 shutdown_connections 2023-12-24T18:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- 172.21.15.50:0/1180520760 wait complete. 2023-12-24T18:54:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 Processor -- start 2023-12-24T18:54:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.582+0000 7f8c357c5700 1 -- start start 2023-12-24T18:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c3006db90 0x7f8c3016a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 0x7f8c30144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300af890 con 0x7f8c300b4060 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30145050 con 0x7f8c30156b50 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300aeec0 con 0x7f8c3006db90 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36816/0 (socket says 172.21.15.50:36816) 2023-12-24T18:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/2615655066 learned_addr learned my addr 172.21.15.50:0/2615655066 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2effd700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c3006db90 0x7f8c3016a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2f7fe700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 0x7f8c30144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c3006db90 msgr2=0x7f8c3016a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c3006db90 0x7f8c3016a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 msgr2=0x7f8c30144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 0x7f8c30144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 -- 172.21.15.50:0/2615655066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240094f0 con 0x7f8c300b4060 2023-12-24T18:54:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2f7fe700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 0x7f8c30144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c2e7fc700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8c30068030 tx=0x7f8c24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24024440 con 0x7f8c300b4060 2023-12-24T18:54:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240245c0 con 0x7f8c300b4060 2023-12-24T18:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24024980 con 0x7f8c300b4060 2023-12-24T18:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c300ae2b0 con 0x7f8c300b4060 2023-12-24T18:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.586+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c300ae870 con 0x7f8c300b4060 2023-12-24T18:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.590+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300af050 con 0x7f8c300b4060 2023-12-24T18:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.590+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8c2401a420 con 0x7f8c300b4060 2023-12-24T18:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.594+0000 7f8c16ffd700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 0x7f8c1c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.594+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f8c2407e4e0 con 0x7f8c300b4060 2023-12-24T18:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.594+0000 7f8c2effd700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 0x7f8c1c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.594+0000 7f8c2effd700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 0x7f8c1c062a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c20006fd0 tx=0x7f8c20008040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.598+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c2404ead0 con 0x7f8c300b4060 2023-12-24T18:54:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:11.766+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8c30071060 con 0x7f8c300b4060 2023-12-24T18:54:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.282+0000 7f8c16ffd700 1 -- 172.21.15.50:0/2615655066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8c2407ce60 con 0x7f8c300b4060 2023-12-24T18:54:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 msgr2=0x7f8c1c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 0x7f8c1c062a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c20006fd0 tx=0x7f8c20008040 comp rx=0 tx=0).stop 2023-12-24T18:54:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 msgr2=0x7f8c300af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8c30068030 tx=0x7f8c24017000 comp rx=0 tx=0).stop 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 shutdown_connections 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8c1c0605d0 0x7f8c1c062a80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c30156b50 0x7f8c30144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c300b4060 0x7f8c300af350 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 --2- 172.21.15.50:0/2615655066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c3006db90 0x7f8c3016a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 >> 172.21.15.50:0/2615655066 conn(0x7f8c30067b40 msgr2=0x7f8c301553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 shutdown_connections 2023-12-24T18:54:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.290+0000 7f8c357c5700 1 -- 172.21.15.50:0/2615655066 wait complete. 2023-12-24T18:54:12.297 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:54:12.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:54:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.490+0000 7f3f26c2e700 1 Processor -- start 2023-12-24T18:54:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.490+0000 7f3f26c2e700 1 -- start start 2023-12-24T18:54:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f26c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f20158e00 0x7f3f200b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f26c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 0x7f3f200b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f26c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200b3fd0 con 0x7f3f2006a710 2023-12-24T18:54:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f26c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200b33c0 con 0x7f3f20158e00 2023-12-24T18:54:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f26c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200b36a0 con 0x7f3f2006c820 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f251cb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f2006a710 0x7f3f201591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36650/0 (socket says 172.21.15.50:36650) 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f251cb700 1 -- 172.21.15.50:0/2816736262 learned_addr learned my addr 172.21.15.50:0/2816736262 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.494+0000 7f3f249ca700 1 --2- 172.21.15.50:0/2816736262 >> v2:172.21.15.82:3300/0 conn(0x7f3f20158e00 0x7f3f200b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 --2- 172.21.15.50:0/2816736262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 0x7f3f200b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102269273 0 0) 0x7f3f200b3fd0 con 0x7f3f2006a710 2023-12-24T18:54:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f10003570 con 0x7f3f2006a710 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716944639 0 0) 0x7f3f10003570 con 0x7f3f2006a710 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 -- 172.21.15.50:0/2816736262 >> v2:172.21.15.82:3300/0 conn(0x7f3f20158e00 msgr2=0x7f3f200b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 --2- 172.21.15.50:0/2816736262 >> v2:172.21.15.82:3300/0 conn(0x7f3f20158e00 0x7f3f200b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 -- 172.21.15.50:0/2816736262 >> v1:172.21.15.50:6789/0 conn(0x7f3f2006a710 legacy=0x7f3f201591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 -- 172.21.15.50:0/2816736262 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200b3980 con 0x7f3f2006c820 2023-12-24T18:54:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1ffff700 1 --2- 172.21.15.50:0/2816736262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 0x7f3f200b4460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661fbb7c421e56d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:12.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180017f0 con 0x7f3f2006c820 2023-12-24T18:54:12.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c011420 con 0x7f3f2006c820 2023-12-24T18:54:12.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f1f7fe700 1 -- 172.21.15.50:0/2816736262 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0117c0 con 0x7f3f2006c820 2023-12-24T18:54:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2816736262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 msgr2=0x7f3f200b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2816736262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 0x7f3f200b4460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2816736262 shutdown_connections 2023-12-24T18:54:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2816736262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006c820 0x7f3f200b4460 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2816736262 >> v2:172.21.15.82:3300/0 conn(0x7f3f20158e00 0x7f3f200b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.498+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2816736262 >> 172.21.15.50:0/2816736262 conn(0x7f3f20067b80 msgr2=0x7f3f200cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2816736262 shutdown_connections 2023-12-24T18:54:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2816736262 wait complete. 2023-12-24T18:54:12.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 Processor -- start 2023-12-24T18:54:12.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- start start 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 0x7f3f2015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 0x7f3f200ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20158e00 0x7f3f200ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200ad420 con 0x7f3f2006c820 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200ac960 con 0x7f3f20158e00 2023-12-24T18:54:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f26c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200acdf0 con 0x7f3f2006a710 2023-12-24T18:54:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.502+0000 7f3f1ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 0x7f3f200ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 0x7f3f2015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f1ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 0x7f3f200ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36820/0 (socket says 172.21.15.50:36820) 2023-12-24T18:54:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f251cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20158e00 0x7f3f200ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f1ffff700 1 -- 172.21.15.50:0/2739615514 learned_addr learned my addr 172.21.15.50:0/2739615514 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 -- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20158e00 msgr2=0x7f3f200ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20158e00 0x7f3f200ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 -- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 msgr2=0x7f3f200ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 0x7f3f200ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 -- 172.21.15.50:0/2739615514 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c009420 con 0x7f3f2006a710 2023-12-24T18:54:12.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f249ca700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 0x7f3f2015f330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400ea50 tx=0x7f3f140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400ee90 con 0x7f3f2006a710 2023-12-24T18:54:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400c7f0 con 0x7f3f2006a710 2023-12-24T18:54:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400cb90 con 0x7f3f2006a710 2023-12-24T18:54:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f200abd50 con 0x7f3f2006a710 2023-12-24T18:54:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200ac310 con 0x7f3f2006a710 2023-12-24T18:54:12.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.506+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f200652e0 con 0x7f3f2006a710 2023-12-24T18:54:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.510+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3f14013470 con 0x7f3f2006a710 2023-12-24T18:54:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.510+0000 7f3f1cff9700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 0x7f3f04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.510+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f3f1407ce40 con 0x7f3f2006a710 2023-12-24T18:54:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.510+0000 7f3f1ffff700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 0x7f3f04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.514+0000 7f3f1ffff700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 0x7f3f04062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006c010 tx=0x7f3f0c016000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.522+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f1404d2c0 con 0x7f3f2006a710 2023-12-24T18:54:12.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:12.698+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3f2015c800 con 0x7f3f2006a710 2023-12-24T18:54:13.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.302+0000 7f3f1cff9700 1 -- 172.21.15.50:0/2739615514 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3f140508e0 con 0x7f3f2006a710 2023-12-24T18:54:13.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.314+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 msgr2=0x7f3f04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.314+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 0x7f3f04062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006c010 tx=0x7f3f0c016000 comp rx=0 tx=0).stop 2023-12-24T18:54:13.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.314+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 msgr2=0x7f3f2015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.314+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 0x7f3f2015f330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400ea50 tx=0x7f3f140091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 shutdown_connections 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3f04060550 0x7f3f04062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20158e00 0x7f3f200ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2006c820 0x7f3f200ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 --2- 172.21.15.50:0/2739615514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f2006a710 0x7f3f2015f330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 >> 172.21.15.50:0/2739615514 conn(0x7f3f20067b80 msgr2=0x7f3f20153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 shutdown_connections 2023-12-24T18:54:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.318+0000 7f3f26c2e700 1 -- 172.21.15.50:0/2739615514 wait complete. 2023-12-24T18:54:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:54:13.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:54:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 Processor -- start 2023-12-24T18:54:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 -- start start 2023-12-24T18:54:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3500c8ee0 0x7fd350161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35015b5a0 con 0x7fd350156e80 2023-12-24T18:54:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35015a990 con 0x7fd350156ab0 2023-12-24T18:54:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.522+0000 7fd35728e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35015ac70 con 0x7fd3500c8ee0 2023-12-24T18:54:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3500c8ee0 0x7fd350161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35628c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd350156ab0 0x7fd3500adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34122/0 (socket says 172.21.15.50:34122) 2023-12-24T18:54:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3500c8ee0 0x7fd350161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36822/0 (socket says 172.21.15.50:36822) 2023-12-24T18:54:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35628c700 1 -- 172.21.15.50:0/584397724 learned_addr learned my addr 172.21.15.50:0/584397724 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 -- 172.21.15.50:0/584397724 >> v1:172.21.15.82:6789/0 conn(0x7fd350156ab0 legacy=0x7fd3500adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 -- 172.21.15.50:0/584397724 >> v1:172.21.15.50:6789/0 conn(0x7fd350156e80 legacy=0x7fd3500c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 -- 172.21.15.50:0/584397724 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35015af50 con 0x7fd3500c8ee0 2023-12-24T18:54:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35528a700 1 -- 172.21.15.50:0/584397724 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586737486 0 0) 0x7fd35015a990 con 0x7fd350156ab0 2023-12-24T18:54:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd356a8d700 1 --2- 172.21.15.50:0/584397724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500c8ee0 0x7fd350161c30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd348009e60 tx=0x7fd348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0adb4029556a65a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35528a700 1 -- 172.21.15.50:0/584397724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800e070 con 0x7fd3500c8ee0 2023-12-24T18:54:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35528a700 1 -- 172.21.15.50:0/584397724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800bc30 con 0x7fd3500c8ee0 2023-12-24T18:54:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35528a700 1 -- 172.21.15.50:0/584397724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348012430 con 0x7fd3500c8ee0 2023-12-24T18:54:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35728e700 1 -- 172.21.15.50:0/584397724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500c8ee0 msgr2=0x7fd350161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35728e700 1 --2- 172.21.15.50:0/584397724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500c8ee0 0x7fd350161c30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd348009e60 tx=0x7fd348009780 comp rx=0 tx=0).stop 2023-12-24T18:54:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35728e700 1 -- 172.21.15.50:0/584397724 shutdown_connections 2023-12-24T18:54:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35728e700 1 --2- 172.21.15.50:0/584397724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500c8ee0 0x7fd350161c30 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.526+0000 7fd35728e700 1 -- 172.21.15.50:0/584397724 >> 172.21.15.50:0/584397724 conn(0x7fd350067250 msgr2=0x7fd350067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 -- 172.21.15.50:0/584397724 shutdown_connections 2023-12-24T18:54:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 -- 172.21.15.50:0/584397724 wait complete. 2023-12-24T18:54:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 Processor -- start 2023-12-24T18:54:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 -- start start 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3500c8ee0 0x7fd3500c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd350156e80 0x7fd35014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3501504e0 con 0x7fd350156ab0 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.530+0000 7fd35728e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd350169740 con 0x7fd3500c8ee0 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd35728e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35016a2c0 con 0x7fd350156e80 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36830/0 (socket says 172.21.15.50:36830) 2023-12-24T18:54:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 -- 172.21.15.50:0/2146264245 learned_addr learned my addr 172.21.15.50:0/2146264245 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd35628c700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3500c8ee0 0x7fd3500c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd356a8d700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd350156e80 0x7fd35014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 -- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd350156e80 msgr2=0x7fd35014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd350156e80 0x7fd35014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 -- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3500c8ee0 msgr2=0x7fd3500c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3500c8ee0 0x7fd3500c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 -- 172.21.15.50:0/2146264245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009a20 con 0x7fd350156ab0 2023-12-24T18:54:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd355a8b700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c4e0 tx=0x7fd34000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340011590 con 0x7fd350156ab0 2023-12-24T18:54:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340011710 con 0x7fd350156ab0 2023-12-24T18:54:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340011ad0 con 0x7fd350156ab0 2023-12-24T18:54:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd350169990 con 0x7fd350156ab0 2023-12-24T18:54:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.534+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd350169f50 con 0x7fd350156ab0 2023-12-24T18:54:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.538+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35016a430 con 0x7fd350156ab0 2023-12-24T18:54:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.538+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd34001b3b0 con 0x7fd350156ab0 2023-12-24T18:54:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.538+0000 7fd3467fc700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 0x7fd334062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.538+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6301+0+0 (secure 0 0 0) 0x7fd34007be60 con 0x7fd350156ab0 2023-12-24T18:54:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.538+0000 7fd35628c700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 0x7fd334062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.542+0000 7fd35628c700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 0x7fd334062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd35006c570 tx=0x7fd34c007d30 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.546+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd34004c160 con 0x7fd350156ab0 2023-12-24T18:54:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:13.758+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd35004be40 con 0x7fd350156ab0 2023-12-24T18:54:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.726+0000 7fd3467fc700 1 -- 172.21.15.50:0/2146264245 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v57) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd34004f780 con 0x7fd350156ab0 2023-12-24T18:54:14.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 msgr2=0x7fd334062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 0x7fd334062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd35006c570 tx=0x7fd34c007d30 comp rx=0 tx=0).stop 2023-12-24T18:54:14.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 msgr2=0x7fd3500c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c4e0 tx=0x7fd34000c7f0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 shutdown_connections 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd334060550 0x7fd334062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd350156e80 0x7fd35014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd350156ab0 0x7fd3500c22d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 --2- 172.21.15.50:0/2146264245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3500c8ee0 0x7fd3500c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 >> 172.21.15.50:0/2146264245 conn(0x7fd350067250 msgr2=0x7fd3500aaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 shutdown_connections 2023-12-24T18:54:14.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.730+0000 7fd35728e700 1 -- 172.21.15.50:0/2146264245 wait complete. 2023-12-24T18:54:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 15 and data pool 16 2023-12-24T18:54:14.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:54:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.926+0000 7f84bb0e3700 1 Processor -- start 2023-12-24T18:54:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.926+0000 7f84bb0e3700 1 -- start start 2023-12-24T18:54:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84bb0e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b415b570 0x7f84b415a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84bb0e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b415ae90 0x7f84b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84bb0e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b406cc30 con 0x7f84b41548b0 2023-12-24T18:54:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84bb0e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b415b2b0 con 0x7f84b415ae90 2023-12-24T18:54:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84bb0e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b15f0 con 0x7f84b415b570 2023-12-24T18:54:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b415ae90 0x7f84b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b98e0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b415b570 0x7f84b415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84b415ae90 0x7f84b406d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36834/0 (socket says 172.21.15.50:36834) 2023-12-24T18:54:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 -- 172.21.15.50:0/1659589450 learned_addr learned my addr 172.21.15.50:0/1659589450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b90df700 1 -- 172.21.15.50:0/1659589450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646060412 0 0) 0x7f84b406cc30 con 0x7f84b41548b0 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b90df700 1 -- 172.21.15.50:0/1659589450 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a0003570 con 0x7f84b41548b0 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 -- 172.21.15.50:0/1659589450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b415b570 msgr2=0x7f84b415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 --2- 172.21.15.50:0/1659589450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b415b570 0x7f84b415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 -- 172.21.15.50:0/1659589450 >> v1:172.21.15.50:6789/0 conn(0x7f84b41548b0 legacy=0x7f84b40ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 -- 172.21.15.50:0/1659589450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40cd3d0 con 0x7f84b415ae90 2023-12-24T18:54:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84ba8e2700 1 --2- 172.21.15.50:0/1659589450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b406d0c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009f20 tx=0x7f84ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ef2e21b3c23412 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b90df700 1 -- 172.21.15.50:0/1659589450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00e070 con 0x7f84b415ae90 2023-12-24T18:54:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b90df700 1 -- 172.21.15.50:0/1659589450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00b970 con 0x7f84b415ae90 2023-12-24T18:54:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.930+0000 7f84b90df700 1 -- 172.21.15.50:0/1659589450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0092e0 con 0x7f84b415ae90 2023-12-24T18:54:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1659589450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 msgr2=0x7f84b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1659589450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b406d0c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009f20 tx=0x7f84ac009840 comp rx=0 tx=0).stop 2023-12-24T18:54:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1659589450 shutdown_connections 2023-12-24T18:54:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1659589450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b406d0c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1659589450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b415b570 0x7f84b415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1659589450 >> 172.21.15.50:0/1659589450 conn(0x7f84b40cdc30 msgr2=0x7f84b40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1659589450 shutdown_connections 2023-12-24T18:54:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.934+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1659589450 wait complete. 2023-12-24T18:54:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 Processor -- start 2023-12-24T18:54:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 -- start start 2023-12-24T18:54:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b41548b0 0x7f84b414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b415b570 0x7f84b416c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41518f0 con 0x7f84b415ae90 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4151bd0 con 0x7f84b415b570 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84bb0e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4151eb0 con 0x7f84b41548b0 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36842/0 (socket says 172.21.15.50:36842) 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 -- 172.21.15.50:0/1074286171 learned_addr learned my addr 172.21.15.50:0/1074286171 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84ba8e2700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b415b570 0x7f84b416c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84ba0e1700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b41548b0 0x7f84b414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 -- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b41548b0 msgr2=0x7f84b414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b41548b0 0x7f84b414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 -- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b415b570 msgr2=0x7f84b416c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b415b570 0x7f84b416c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 -- 172.21.15.50:0/1074286171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac009ae0 con 0x7f84b415ae90 2023-12-24T18:54:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.938+0000 7f84b98e0700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f84a400e930 tx=0x7f84a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400eed0 con 0x7f84b415ae90 2023-12-24T18:54:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400c850 con 0x7f84b415ae90 2023-12-24T18:54:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b4152190 con 0x7f84b415ae90 2023-12-24T18:54:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400cbf0 con 0x7f84b415ae90 2023-12-24T18:54:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4152470 con 0x7f84b415ae90 2023-12-24T18:54:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.942+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b404be40 con 0x7f84b415ae90 2023-12-24T18:54:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.946+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f84a4013470 con 0x7f84b415ae90 2023-12-24T18:54:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.946+0000 7f84aa7fc700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 0x7f8498062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.946+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f84a407d500 con 0x7f84b415ae90 2023-12-24T18:54:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.946+0000 7f84ba0e1700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 0x7f8498062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.950+0000 7f84ba0e1700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 0x7f8498062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84b40b0790 tx=0x7f84b0009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:14.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:14.950+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84a404d810 con 0x7f84b415ae90 2023-12-24T18:54:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.126+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84b40cd6b0 con 0x7f84b415ae90 2023-12-24T18:54:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.126+0000 7f84aa7fc700 1 -- 172.21.15.50:0/1074286171 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16106 (secure 0 0 0) 0x7f84a4050e30 con 0x7f84b415ae90 2023-12-24T18:54:15.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:15.129 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":124,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:13.764547+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:54:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 msgr2=0x7f8498062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 0x7f8498062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84b40b0790 tx=0x7f84b0009040 comp rx=0 tx=0).stop 2023-12-24T18:54:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 msgr2=0x7f84b416bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f84a400e930 tx=0x7f84a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 shutdown_connections 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8498060550 0x7f8498062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b415b570 0x7f84b416c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b415ae90 0x7f84b416bd20 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 --2- 172.21.15.50:0/1074286171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84b41548b0 0x7f84b414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 >> 172.21.15.50:0/1074286171 conn(0x7f84b40cdc30 msgr2=0x7f84b40685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 shutdown_connections 2023-12-24T18:54:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.130+0000 7f84bb0e3700 1 -- 172.21.15.50:0/1074286171 wait complete. 2023-12-24T18:54:15.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:54:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 Processor -- start 2023-12-24T18:54:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 -- start start 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17500caf40 0x7f17500cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 0x7f1750156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175015a4d0 con 0x7f17500caf40 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750159610 con 0x7f17500cd0d0 2023-12-24T18:54:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f1754944700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500cc8e0 con 0x7f175006cd30 2023-12-24T18:54:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17500caf40 0x7f17500cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17500caf40 0x7f17500cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36852/0 (socket says 172.21.15.50:36852) 2023-12-24T18:54:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 -- 172.21.15.50:0/3211410221 learned_addr learned my addr 172.21.15.50:0/3211410221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174f59e700 1 --2- 172.21.15.50:0/3211410221 >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 0x7f1750156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174e59c700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 -- 172.21.15.50:0/3211410221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 msgr2=0x7f17500ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 -- 172.21.15.50:0/3211410221 >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 msgr2=0x7f1750156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 --2- 172.21.15.50:0/3211410221 >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 0x7f1750156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 -- 172.21.15.50:0/3211410221 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501598c0 con 0x7f17500caf40 2023-12-24T18:54:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174f59e700 1 --2- 172.21.15.50:0/3211410221 >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 0x7f1750156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.322+0000 7f174ed9d700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f17500cb310 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f17400099b0 tx=0x7f1740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dcfdcb65c339ba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f174dd9b700 1 -- 172.21.15.50:0/3211410221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000b640 con 0x7f17500caf40 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f174dd9b700 1 -- 172.21.15.50:0/3211410221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000b7a0 con 0x7f17500caf40 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f174dd9b700 1 -- 172.21.15.50:0/3211410221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000bb40 con 0x7f17500caf40 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 -- 172.21.15.50:0/3211410221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 msgr2=0x7f17500cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f17500cb310 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f17400099b0 tx=0x7f1740009250 comp rx=0 tx=0).stop 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 -- 172.21.15.50:0/3211410221 shutdown_connections 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 --2- 172.21.15.50:0/3211410221 >> v2:172.21.15.82:3300/0 conn(0x7f17500cd0d0 0x7f1750156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 --2- 172.21.15.50:0/3211410221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f17500cb310 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 -- 172.21.15.50:0/3211410221 >> 172.21.15.50:0/3211410221 conn(0x7f17500670b0 msgr2=0x7f17500674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 -- 172.21.15.50:0/3211410221 shutdown_connections 2023-12-24T18:54:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.326+0000 7f1754944700 1 -- 172.21.15.50:0/3211410221 wait complete. 2023-12-24T18:54:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 Processor -- start 2023-12-24T18:54:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 -- start start 2023-12-24T18:54:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f1750155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 0x7f175015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b5350 con 0x7f17500caf40 2023-12-24T18:54:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b44c0 con 0x7f1750155c50 2023-12-24T18:54:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f1754944700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500c9fd0 con 0x7f175006cd30 2023-12-24T18:54:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:35574/0 (socket says 172.21.15.50:35574) 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 -- 172.21.15.50:0/441299158 learned_addr learned my addr 172.21.15.50:0/441299158 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f1750155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174f59e700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 0x7f175015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 -- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 msgr2=0x7f175015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 0x7f175015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 -- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 msgr2=0x7f1750155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f1750155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 -- 172.21.15.50:0/441299158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748009a20 con 0x7f175006cd30 2023-12-24T18:54:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174f59e700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 0x7f175015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.330+0000 7f174ed9d700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1750067bc0 tx=0x7f1740017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000bb20 con 0x7f175006cd30 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740000c90 con 0x7f175006cd30 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17400094f0 con 0x7f175006cd30 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011630 con 0x7f175006cd30 2023-12-24T18:54:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17500b4740 con 0x7f175006cd30 2023-12-24T18:54:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17500af120 con 0x7f175006cd30 2023-12-24T18:54:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.334+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1740011a60 con 0x7f175006cd30 2023-12-24T18:54:15.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.338+0000 7f1736ffd700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 0x7f173c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.338+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f174007dff0 con 0x7f175006cd30 2023-12-24T18:54:15.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.338+0000 7f174e59c700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 0x7f173c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.338+0000 7f174e59c700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 0x7f173c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17500c99a0 tx=0x7f17440091a0 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.346+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f17500af120 con 0x7f175006cd30 2023-12-24T18:54:15.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.526+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17500af120 con 0x7f175006cd30 2023-12-24T18:54:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.530+0000 7f1736ffd700 1 -- 172.21.15.50:0/441299158 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16093 (secure 0 0 0) 0x7f17500af120 con 0x7f175006cd30 2023-12-24T18:54:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:15.531 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":125,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:15.303873+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:54:15.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 msgr2=0x7f173c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 0x7f173c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17500c99a0 tx=0x7f17440091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 msgr2=0x7f17500b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1750067bc0 tx=0x7f1740017000 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 shutdown_connections 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f173c060550 0x7f173c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1750155c50 0x7f175015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17500caf40 0x7f1750155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 --2- 172.21.15.50:0/441299158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f175006cd30 0x7f17500b57e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 >> 172.21.15.50:0/441299158 conn(0x7f17500670b0 msgr2=0x7f17500d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 shutdown_connections 2023-12-24T18:54:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.534+0000 7f1754944700 1 -- 172.21.15.50:0/441299158 wait complete. 2023-12-24T18:54:15.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:54:15.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.730+0000 7f351cc6e700 1 Processor -- start 2023-12-24T18:54:15.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.730+0000 7f351cc6e700 1 -- start start 2023-12-24T18:54:15.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351cc6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35181565a0 0x7f3518156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351cc6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180aca80 con 0x7f3518153070 2023-12-24T18:54:15.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351cc6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518156a40 con 0x7f35181571c0 2023-12-24T18:54:15.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351cc6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518159870 con 0x7f35181565a0 2023-12-24T18:54:15.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3518153070 0x7f35181590b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36664/0 (socket says 172.21.15.50:36664) 2023-12-24T18:54:15.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f351659c700 1 -- 172.21.15.50:0/2263076764 learned_addr learned my addr 172.21.15.50:0/2263076764 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:15.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.734+0000 7f3515d9b700 1 --2- 172.21.15.50:0/2263076764 >> v2:172.21.15.82:3300/0 conn(0x7f35181565a0 0x7f3518156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351559a700 1 -- 172.21.15.50:0/2263076764 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574971928 0 0) 0x7f35180aca80 con 0x7f3518153070 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351559a700 1 -- 172.21.15.50:0/2263076764 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3500003570 con 0x7f3518153070 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f3515d9b700 1 -- 172.21.15.50:0/2263076764 >> v1:172.21.15.82:6789/0 conn(0x7f35181571c0 legacy=0x7f351806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f3515d9b700 1 -- 172.21.15.50:0/2263076764 >> v1:172.21.15.50:6789/0 conn(0x7f3518153070 legacy=0x7f35181590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f3515d9b700 1 -- 172.21.15.50:0/2263076764 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518159b50 con 0x7f35181565a0 2023-12-24T18:54:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f3515d9b700 1 --2- 172.21.15.50:0/2263076764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518156c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f350c0098e0 tx=0x7f350c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9324f94c7470b3a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351559a700 1 -- 172.21.15.50:0/2263076764 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00b640 con 0x7f35181565a0 2023-12-24T18:54:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351559a700 1 -- 172.21.15.50:0/2263076764 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00b7a0 con 0x7f35181565a0 2023-12-24T18:54:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351559a700 1 -- 172.21.15.50:0/2263076764 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00bb40 con 0x7f35181565a0 2023-12-24T18:54:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 -- 172.21.15.50:0/2263076764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 msgr2=0x7f3518156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 --2- 172.21.15.50:0/2263076764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518156c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f350c0098e0 tx=0x7f350c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 -- 172.21.15.50:0/2263076764 shutdown_connections 2023-12-24T18:54:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 --2- 172.21.15.50:0/2263076764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518156c80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 -- 172.21.15.50:0/2263076764 >> 172.21.15.50:0/2263076764 conn(0x7f3518067b80 msgr2=0x7f35180cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 -- 172.21.15.50:0/2263076764 shutdown_connections 2023-12-24T18:54:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.738+0000 7f351cc6e700 1 -- 172.21.15.50:0/2263076764 wait complete. 2023-12-24T18:54:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 Processor -- start 2023-12-24T18:54:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 -- start start 2023-12-24T18:54:15.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35181571c0 0x7f3518157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b1870 con 0x7f3518153070 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518158260 con 0x7f35181565a0 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351cc6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180c5800 con 0x7f35181571c0 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36868/0 (socket says 172.21.15.50:36868) 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 -- 172.21.15.50:0/1164832035 learned_addr learned my addr 172.21.15.50:0/1164832035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f3515d9b700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f3516d9d700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35181571c0 0x7f3518157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 -- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35181571c0 msgr2=0x7f3518157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35181571c0 0x7f3518157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 -- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 msgr2=0x7f3518157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 -- 172.21.15.50:0/1164832035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009420 con 0x7f3518153070 2023-12-24T18:54:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.742+0000 7f351659c700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f350800c7c0 tx=0x7f3508007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508005cd0 con 0x7f3518153070 2023-12-24T18:54:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508005e30 con 0x7f3518153070 2023-12-24T18:54:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35180c5ae0 con 0x7f3518153070 2023-12-24T18:54:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508007320 con 0x7f3518153070 2023-12-24T18:54:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35180c60a0 con 0x7f3518153070 2023-12-24T18:54:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35180c6290 con 0x7f3518153070 2023-12-24T18:54:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.746+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f350801b3b0 con 0x7f3518153070 2023-12-24T18:54:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.750+0000 7f35067fc700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.750+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f350807c1c0 con 0x7f3518153070 2023-12-24T18:54:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.750+0000 7f3515d9b700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.750+0000 7f3515d9b700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 0x7f34f8062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f350c0093f0 tx=0x7f350c017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.754+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f350804c450 con 0x7f3518153070 2023-12-24T18:54:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:15.958+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35180652e0 con 0x7f3518153070 2023-12-24T18:54:16.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.750+0000 7f35067fc700 1 -- 172.21.15.50:0/1164832035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7f350804fa70 con 0x7f3518153070 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 msgr2=0x7f34f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 0x7f34f8062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f350c0093f0 tx=0x7f350c017000 comp rx=0 tx=0).stop 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 msgr2=0x7f3518141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f350800c7c0 tx=0x7f3508007e00 comp rx=0 tx=0).stop 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 shutdown_connections 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34f8060550 0x7f34f8062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35181571c0 0x7f3518157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35181565a0 0x7f3518157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 --2- 172.21.15.50:0/1164832035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518153070 0x7f3518141570 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 >> 172.21.15.50:0/1164832035 conn(0x7f3518067b80 msgr2=0x7f3518154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:16.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 shutdown_connections 2023-12-24T18:54:16.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.754+0000 7f351cc6e700 1 -- 172.21.15.50:0/1164832035 wait complete. 2023-12-24T18:54:16.779 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:54:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.953+0000 7f667c8ef700 1 Processor -- start 2023-12-24T18:54:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.953+0000 7f667c8ef700 1 -- start start 2023-12-24T18:54:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667c8ef700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6678158c40 0x7f66780cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667c8ef700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667806a580 con 0x7f667806d450 2023-12-24T18:54:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667c8ef700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667806a7d0 con 0x7f66780cc780 2023-12-24T18:54:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667c8ef700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667806aab0 con 0x7f6678158c40 2023-12-24T18:54:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667759e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f667806d450 0x7f6678159010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36668/0 (socket says 172.21.15.50:36668) 2023-12-24T18:54:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f667759e700 1 -- 172.21.15.50:0/1537438712 learned_addr learned my addr 172.21.15.50:0/1537438712 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6676d9d700 1 --2- 172.21.15.50:0/1537438712 >> v2:172.21.15.82:3300/0 conn(0x7f6678158c40 0x7f66780cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962096471 0 0) 0x7f667806a580 con 0x7f667806d450 2023-12-24T18:54:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6660003570 con 0x7f667806d450 2023-12-24T18:54:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263834165 0 0) 0x7f6660003570 con 0x7f667806d450 2023-12-24T18:54:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 >> v2:172.21.15.82:3300/0 conn(0x7f6678158c40 msgr2=0x7f66780cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 --2- 172.21.15.50:0/1537438712 >> v2:172.21.15.82:3300/0 conn(0x7f6678158c40 0x7f66780cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 >> v1:172.21.15.82:6789/0 conn(0x7f66780cc780 legacy=0x7f667806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667806ad90 con 0x7f667806d450 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f66700017f0 con 0x7f667806d450 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 >> v1:172.21.15.50:6789/0 conn(0x7f667806d450 legacy=0x7f6678159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.957+0000 7f6675d9b700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 0x7f6660003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6660004810 0x7f6660004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66600051c0 0x7f666000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667806aab0 con 0x7f6660003a60 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666000c050 con 0x7f6660004810 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666000c210 con 0x7f66600051c0 2023-12-24T18:54:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 0x7f6660003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667659c700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6660004810 0x7f6660004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667759e700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66600051c0 0x7f666000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 -- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66600051c0 msgr2=0x7f666000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66600051c0 0x7f666000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 -- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6660004810 msgr2=0x7f6660004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6660004810 0x7f6660004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 -- 172.21.15.50:0/1537438712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660003570 con 0x7f6660003a60 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667759e700 1 -- 172.21.15.50:0/1537438712 reap_dead start 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6676d9d700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 0x7f6660003e30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c00 tx=0x7f66680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4222ae195d1e68a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800e710 con 0x7f6660003a60 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800e870 con 0x7f6660003a60 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f6675d9b700 1 -- 172.21.15.50:0/1537438712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800ec30 con 0x7f6660003a60 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 -- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 msgr2=0x7f6660003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 0x7f6660003e30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c00 tx=0x7f66680091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 -- 172.21.15.50:0/1537438712 shutdown_connections 2023-12-24T18:54:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 --2- 172.21.15.50:0/1537438712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6660003a60 0x7f6660003e30 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 -- 172.21.15.50:0/1537438712 >> 172.21.15.50:0/1537438712 conn(0x7f66780d0800 msgr2=0x7f66780b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 -- 172.21.15.50:0/1537438712 shutdown_connections 2023-12-24T18:54:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.961+0000 7f667c8ef700 1 -- 172.21.15.50:0/1537438712 wait complete. 2023-12-24T18:54:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 Processor -- start 2023-12-24T18:54:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 -- start start 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6660003a60 0x7f6678155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6678153cc0 0x7f66780ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667816a600 con 0x7f66781557b0 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678154140 con 0x7f6678153cc0 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667c8ef700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6678169cd0 con 0x7f6660003a60 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36888/0 (socket says 172.21.15.50:36888) 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.965+0000 7f667659c700 1 -- 172.21.15.50:0/100157879 learned_addr learned my addr 172.21.15.50:0/100157879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f6676d9d700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6660003a60 0x7f6678155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667759e700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6678153cc0 0x7f66780ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 -- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6660003a60 msgr2=0x7f6678155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6660003a60 0x7f6678155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 -- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6678153cc0 msgr2=0x7f66780ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6678153cc0 0x7f66780ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 -- 172.21.15.50:0/100157879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678169fb0 con 0x7f66781557b0 2023-12-24T18:54:16.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667659c700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f666c002bb0 tx=0x7f666c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:16.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00f870 con 0x7f66781557b0 2023-12-24T18:54:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00f9d0 con 0x7f66781557b0 2023-12-24T18:54:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00fd90 con 0x7f66781557b0 2023-12-24T18:54:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667816a290 con 0x7f66781557b0 2023-12-24T18:54:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66780ca910 con 0x7f66781557b0 2023-12-24T18:54:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.969+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667816a770 con 0x7f66781557b0 2023-12-24T18:54:16.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.973+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f666c013600 con 0x7f66781557b0 2023-12-24T18:54:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.973+0000 7f665effd700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 0x7f6664062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.973+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f666c07d180 con 0x7f66781557b0 2023-12-24T18:54:16.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.973+0000 7f6676d9d700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 0x7f6664062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:16.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.977+0000 7f6676d9d700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 0x7f6664062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66680091e0 tx=0x7f666801a000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:16.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:16.981+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f666c04d410 con 0x7f66781557b0 2023-12-24T18:54:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.197+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f667804be40 con 0x7f66781557b0 2023-12-24T18:54:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.757+0000 7f665effd700 1 -- 172.21.15.50:0/100157879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) v1 ==== 122+0+0 (secure 0 0 0) 0x7f666c050a30 con 0x7f66781557b0 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 msgr2=0x7f6664062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 0x7f6664062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66680091e0 tx=0x7f666801a000 comp rx=0 tx=0).stop 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 msgr2=0x7f6678153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f666c002bb0 tx=0x7f666c007d10 comp rx=0 tx=0).stop 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 shutdown_connections 2023-12-24T18:54:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6664060550 0x7f6664062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6678153cc0 0x7f66780ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66781557b0 0x7f6678153780 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 --2- 172.21.15.50:0/100157879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6660003a60 0x7f6678155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 >> 172.21.15.50:0/100157879 conn(0x7f66780d0800 msgr2=0x7f66780b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 shutdown_connections 2023-12-24T18:54:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.765+0000 7f667c8ef700 1 -- 172.21.15.50:0/100157879 wait complete. 2023-12-24T18:54:17.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:54:17.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.949+0000 7fb763af0700 1 Processor -- start 2023-12-24T18:54:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.949+0000 7fb763af0700 1 -- start start 2023-12-24T18:54:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb763af0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb75c159bc0 0x7fb75c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb763af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb763af0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c06b850 con 0x7fb75c06bce0 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb763af0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0caaf0 con 0x7fb75c159bc0 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb763af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c06ac40 con 0x7fb75c0ca110 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76208d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76208d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:35624/0 (socket says 172.21.15.50:35624) 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76208d700 1 -- 172.21.15.50:0/1507704985 learned_addr learned my addr 172.21.15.50:0/1507704985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76188c700 1 --2- 172.21.15.50:0/1507704985 >> v2:172.21.15.82:3300/0 conn(0x7fb75c159bc0 0x7fb75c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76088a700 1 -- 172.21.15.50:0/1507704985 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061272356 0 0) 0x7fb75c06b850 con 0x7fb75c06bce0 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76088a700 1 -- 172.21.15.50:0/1507704985 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb748003570 con 0x7fb75c06bce0 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76208d700 1 -- 172.21.15.50:0/1507704985 >> v2:172.21.15.82:3300/0 conn(0x7fb75c159bc0 msgr2=0x7fb75c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.953+0000 7fb76208d700 1 --2- 172.21.15.50:0/1507704985 >> v2:172.21.15.82:3300/0 conn(0x7fb75c159bc0 0x7fb75c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76208d700 1 -- 172.21.15.50:0/1507704985 >> v1:172.21.15.82:6789/0 conn(0x7fb75c06bce0 legacy=0x7fb75c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76208d700 1 -- 172.21.15.50:0/1507704985 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c06af20 con 0x7fb75c0ca110 2023-12-24T18:54:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76208d700 1 --2- 172.21.15.50:0/1507704985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7540099b0 tx=0x7fb754009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfeb0cd2018b4bc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76088a700 1 -- 172.21.15.50:0/1507704985 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400b680 con 0x7fb75c0ca110 2023-12-24T18:54:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76088a700 1 -- 172.21.15.50:0/1507704985 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400b7e0 con 0x7fb75c0ca110 2023-12-24T18:54:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb76088a700 1 -- 172.21.15.50:0/1507704985 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400bb80 con 0x7fb75c0ca110 2023-12-24T18:54:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 -- 172.21.15.50:0/1507704985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 msgr2=0x7fb75c0ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 --2- 172.21.15.50:0/1507704985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7540099b0 tx=0x7fb754009250 comp rx=0 tx=0).stop 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 -- 172.21.15.50:0/1507704985 shutdown_connections 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 --2- 172.21.15.50:0/1507704985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c0ca110 0x7fb75c0ca5b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 --2- 172.21.15.50:0/1507704985 >> v2:172.21.15.82:3300/0 conn(0x7fb75c159bc0 0x7fb75c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 -- 172.21.15.50:0/1507704985 >> 172.21.15.50:0/1507704985 conn(0x7fb75c0cbba0 msgr2=0x7fb75c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 -- 172.21.15.50:0/1507704985 shutdown_connections 2023-12-24T18:54:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.957+0000 7fb763af0700 1 -- 172.21.15.50:0/1507704985 wait complete. 2023-12-24T18:54:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.961+0000 7fb763af0700 1 Processor -- start 2023-12-24T18:54:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.961+0000 7fb763af0700 1 -- start start 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c06bce0 0x7fb75c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 0x7fb75c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0b00a0 con 0x7fb75c0ca110 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c156d20 con 0x7fb75c159bc0 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0af490 con 0x7fb75c06bce0 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36892/0 (socket says 172.21.15.50:36892) 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 -- 172.21.15.50:0/976615646 learned_addr learned my addr 172.21.15.50:0/976615646 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76208d700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 0x7fb75c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76188c700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c06bce0 0x7fb75c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 -- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c06bce0 msgr2=0x7fb75c1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c06bce0 0x7fb75c1567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 -- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 msgr2=0x7fb75c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 0x7fb75c15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 -- 172.21.15.50:0/976615646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540094f0 con 0x7fb75c0ca110 2023-12-24T18:54:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76208d700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 0x7fb75c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb76108b700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c580 tx=0x7fb74c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c010510 con 0x7fb75c0ca110 2023-12-24T18:54:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c010670 con 0x7fb75c0ca110 2023-12-24T18:54:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c010a30 con 0x7fb75c0ca110 2023-12-24T18:54:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0af770 con 0x7fb75c0ca110 2023-12-24T18:54:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.965+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0afd30 con 0x7fb75c0ca110 2023-12-24T18:54:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.969+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c0b0210 con 0x7fb75c0ca110 2023-12-24T18:54:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.969+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb74c01b400 con 0x7fb75c0ca110 2023-12-24T18:54:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.969+0000 7fb751ffb700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 0x7fb740062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.973+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fb74c07c5d0 con 0x7fb75c0ca110 2023-12-24T18:54:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.973+0000 7fb76188c700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 0x7fb740062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.973+0000 7fb76188c700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 0x7fb740062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb75800f570 tx=0x7fb75800b040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:17.977+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb74c04c900 con 0x7fb75c0ca110 2023-12-24T18:54:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.185+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb75c0652e0 con 0x7fb75c0ca110 2023-12-24T18:54:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.185+0000 7fb751ffb700 1 -- 172.21.15.50:0/976615646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb74c04ff20 con 0x7fb75c0ca110 2023-12-24T18:54:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:18.188 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 msgr2=0x7fb740062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 0x7fb740062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb75800f570 tx=0x7fb75800b040 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 msgr2=0x7fb75c0aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c580 tx=0x7fb74c007e10 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 shutdown_connections 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb740060550 0x7fb740062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75c159bc0 0x7fb75c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb75c0ca110 0x7fb75c0aeab0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 --2- 172.21.15.50:0/976615646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75c06bce0 0x7fb75c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 >> 172.21.15.50:0/976615646 conn(0x7fb75c0cbba0 msgr2=0x7fb75c0c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 shutdown_connections 2023-12-24T18:54:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.189+0000 7fb763af0700 1 -- 172.21.15.50:0/976615646 wait complete. 2023-12-24T18:54:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:54:18.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:54:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 Processor -- start 2023-12-24T18:54:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 -- start start 2023-12-24T18:54:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2600677c0 0x7fa2600af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa260159b60 con 0x7fa260153760 2023-12-24T18:54:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa260159810 con 0x7fa2600acb10 2023-12-24T18:54:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa26682e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600ad060 con 0x7fa2600677c0 2023-12-24T18:54:18.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa264dcb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2600677c0 0x7fa2600af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa25ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa260153760 0x7fa260159ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36684/0 (socket says 172.21.15.50:36684) 2023-12-24T18:54:18.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa25ffff700 1 -- 172.21.15.50:0/1274793584 learned_addr learned my addr 172.21.15.50:0/1274793584 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:18.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.385+0000 7fa264dcb700 1 --2- 172.21.15.50:0/1274793584 >> v2:172.21.15.50:3300/0 conn(0x7fa2600677c0 0x7fa2600af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36898/0 (socket says 172.21.15.50:36898) 2023-12-24T18:54:18.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa264dcb700 1 -- 172.21.15.50:0/1274793584 >> v1:172.21.15.82:6789/0 conn(0x7fa2600acb10 legacy=0x7fa2600670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa264dcb700 1 -- 172.21.15.50:0/1274793584 >> v1:172.21.15.50:6789/0 conn(0x7fa260153760 legacy=0x7fa260159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa264dcb700 1 -- 172.21.15.50:0/1274793584 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600ad340 con 0x7fa2600677c0 2023-12-24T18:54:18.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa264dcb700 1 --2- 172.21.15.50:0/1274793584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2600677c0 0x7fa2600af0a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa258009de0 tx=0x7fa258009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b07a69dda79b31c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa25f7fe700 1 -- 172.21.15.50:0/1274793584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800e070 con 0x7fa2600677c0 2023-12-24T18:54:18.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa25f7fe700 1 -- 172.21.15.50:0/1274793584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800bbb0 con 0x7fa2600677c0 2023-12-24T18:54:18.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa25f7fe700 1 -- 172.21.15.50:0/1274793584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258012430 con 0x7fa2600677c0 2023-12-24T18:54:18.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 -- 172.21.15.50:0/1274793584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2600677c0 msgr2=0x7fa2600af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 --2- 172.21.15.50:0/1274793584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2600677c0 0x7fa2600af0a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa258009de0 tx=0x7fa258009780 comp rx=0 tx=0).stop 2023-12-24T18:54:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 -- 172.21.15.50:0/1274793584 shutdown_connections 2023-12-24T18:54:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 --2- 172.21.15.50:0/1274793584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2600677c0 0x7fa2600af0a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 -- 172.21.15.50:0/1274793584 >> 172.21.15.50:0/1274793584 conn(0x7fa26006dd00 msgr2=0x7fa2600ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 -- 172.21.15.50:0/1274793584 shutdown_connections 2023-12-24T18:54:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.389+0000 7fa26682e700 1 -- 172.21.15.50:0/1274793584 wait complete. 2023-12-24T18:54:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 Processor -- start 2023-12-24T18:54:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 -- start start 2023-12-24T18:54:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2600677c0 0x7fa26014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2600acb10 0x7fa260156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014c4d0 con 0x7fa260153760 2023-12-24T18:54:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260068d70 con 0x7fa2600acb10 2023-12-24T18:54:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa26682e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa260068790 con 0x7fa2600677c0 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36906/0 (socket says 172.21.15.50:36906) 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 -- 172.21.15.50:0/2691537163 learned_addr learned my addr 172.21.15.50:0/2691537163 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa25ffff700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2600677c0 0x7fa26014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa257fff700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2600acb10 0x7fa260156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 -- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2600677c0 msgr2=0x7fa26014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2600677c0 0x7fa26014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 -- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2600acb10 msgr2=0x7fa260156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2600acb10 0x7fa260156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.393+0000 7fa264dcb700 1 -- 172.21.15.50:0/2691537163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009a20 con 0x7fa260153760 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa264dcb700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa25800b6c0 tx=0x7fa258018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580124b0 con 0x7fa260153760 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258021070 con 0x7fa260153760 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258026430 con 0x7fa260153760 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26015e730 con 0x7fa260153760 2023-12-24T18:54:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260069200 con 0x7fa260153760 2023-12-24T18:54:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600685e0 con 0x7fa260153760 2023-12-24T18:54:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.397+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa258023030 con 0x7fa260153760 2023-12-24T18:54:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.401+0000 7fa25cff9700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 0x7fa240062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.401+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fa25807ec70 con 0x7fa260153760 2023-12-24T18:54:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.401+0000 7fa25ffff700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 0x7fa240062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.401+0000 7fa25ffff700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 0x7fa240062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2600ade60 tx=0x7fa250009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.405+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa25804efa0 con 0x7fa260153760 2023-12-24T18:54:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.585+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa260068f00 con 0x7fa260153760 2023-12-24T18:54:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa25cff9700 1 -- 172.21.15.50:0/2691537163 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16093 (secure 0 0 0) 0x7fa2580525c0 con 0x7fa260153760 2023-12-24T18:54:18.590 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:18.591 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":125,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:15.303873+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 msgr2=0x7fa240062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 0x7fa240062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2600ade60 tx=0x7fa250009040 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 msgr2=0x7fa260152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa25800b6c0 tx=0x7fa258018000 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 shutdown_connections 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa240060550 0x7fa240062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa260153760 0x7fa260152130 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2600acb10 0x7fa260156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 --2- 172.21.15.50:0/2691537163 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2600677c0 0x7fa26014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 >> 172.21.15.50:0/2691537163 conn(0x7fa26006dd00 msgr2=0x7fa2600ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 shutdown_connections 2023-12-24T18:54:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.589+0000 7fa26682e700 1 -- 172.21.15.50:0/2691537163 wait complete. 2023-12-24T18:54:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:54:18.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:54:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 Processor -- start 2023-12-24T18:54:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 -- start start 2023-12-24T18:54:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30c006aca0 0x7f30c006b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c006c820 con 0x7f30c00c6d00 2023-12-24T18:54:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c006b960 con 0x7f30c006aca0 2023-12-24T18:54:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.773+0000 7f30c6d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c006bc40 con 0x7f30c0154b60 2023-12-24T18:54:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:35648/0 (socket says 172.21.15.50:35648) 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 -- 172.21.15.50:0/4175092096 learned_addr learned my addr 172.21.15.50:0/4175092096 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c4b21700 1 --1- 172.21.15.50:0/4175092096 >> v1:172.21.15.50:6789/0 conn(0x7f30c00c6d00 0x7f30c0154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36692/0 (socket says 172.21.15.50:36692) 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c5322700 1 --2- 172.21.15.50:0/4175092096 >> v2:172.21.15.82:3300/0 conn(0x7f30c006aca0 0x7f30c006b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 -- 172.21.15.50:0/4175092096 >> v2:172.21.15.82:3300/0 conn(0x7f30c006aca0 msgr2=0x7f30c006b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 --2- 172.21.15.50:0/4175092096 >> v2:172.21.15.82:3300/0 conn(0x7f30c006aca0 0x7f30c006b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 -- 172.21.15.50:0/4175092096 >> v1:172.21.15.50:6789/0 conn(0x7f30c00c6d00 legacy=0x7f30c0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 -- 172.21.15.50:0/4175092096 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c006bf20 con 0x7f30c0154b60 2023-12-24T18:54:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bffff700 1 --2- 172.21.15.50:0/4175092096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0099b0 tx=0x7f30ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4247157188afdb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bf7fe700 1 -- 172.21.15.50:0/4175092096 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac009ea0 con 0x7f30c0154b60 2023-12-24T18:54:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bf7fe700 1 -- 172.21.15.50:0/4175092096 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00b860 con 0x7f30c0154b60 2023-12-24T18:54:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30bf7fe700 1 -- 172.21.15.50:0/4175092096 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00bc00 con 0x7f30c0154b60 2023-12-24T18:54:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 -- 172.21.15.50:0/4175092096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 msgr2=0x7f30c00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 --2- 172.21.15.50:0/4175092096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0099b0 tx=0x7f30ac009250 comp rx=0 tx=0).stop 2023-12-24T18:54:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 -- 172.21.15.50:0/4175092096 shutdown_connections 2023-12-24T18:54:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 --2- 172.21.15.50:0/4175092096 >> v2:172.21.15.82:3300/0 conn(0x7f30c006aca0 0x7f30c006b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 --2- 172.21.15.50:0/4175092096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c0154b60 0x7f30c00c70d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 -- 172.21.15.50:0/4175092096 >> 172.21.15.50:0/4175092096 conn(0x7f30c00cbba0 msgr2=0x7f30c00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 -- 172.21.15.50:0/4175092096 shutdown_connections 2023-12-24T18:54:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.777+0000 7f30c6d85700 1 -- 172.21.15.50:0/4175092096 wait complete. 2023-12-24T18:54:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.781+0000 7f30c6d85700 1 Processor -- start 2023-12-24T18:54:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.781+0000 7f30c6d85700 1 -- start start 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 0x7f30c016a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 0x7f30c00ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00aa770 con 0x7f30c006aca0 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c9770 con 0x7f30c0154b60 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00ca2f0 con 0x7f30c00c6d00 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36922/0 (socket says 172.21.15.50:36922) 2023-12-24T18:54:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 -- 172.21.15.50:0/2796735478 learned_addr learned my addr 172.21.15.50:0/2796735478 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c5322700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 0x7f30c00ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30bffff700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 0x7f30c016a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 -- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 msgr2=0x7f30c016a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 0x7f30c016a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 -- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 msgr2=0x7f30c00ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 0x7f30c00ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 -- 172.21.15.50:0/2796735478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0094f0 con 0x7f30c006aca0 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c5322700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 0x7f30c00ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30bffff700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 0x7f30c016a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c4b21700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c7f0 tx=0x7f30b4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4005a70 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4005bf0 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c016a430 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40070f0 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.785+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00c9f80 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.789+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c00652e0 con 0x7f30c006aca0 2023-12-24T18:54:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.789+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f30b4007460 con 0x7f30c006aca0 2023-12-24T18:54:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.789+0000 7f30bcff9700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 0x7f30a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.793+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f30b407c560 con 0x7f30c006aca0 2023-12-24T18:54:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.793+0000 7f30bffff700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 0x7f30a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.793+0000 7f30bffff700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 0x7f30a4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0099b0 tx=0x7f30ac017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.797+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f30b404c870 con 0x7f30c006aca0 2023-12-24T18:54:18.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.965+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30c00ca430 con 0x7f30a4060550 2023-12-24T18:54:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.977+0000 7f30bcff9700 1 -- 172.21.15.50:0/2796735478 <== mgr.7599 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275619 (secure 0 0 0) 0x7f30ac00b9d0 con 0x7f30a4060550 2023-12-24T18:54:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 msgr2=0x7f30a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 0x7f30a4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0099b0 tx=0x7f30ac017000 comp rx=0 tx=0).stop 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 msgr2=0x7f30c0151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c7f0 tx=0x7f30b4007f70 comp rx=0 tx=0).stop 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 shutdown_connections 2023-12-24T18:54:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f30a4060550 0x7f30a4062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c0154b60 0x7f30c00ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30c00c6d00 0x7f30c016a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 --2- 172.21.15.50:0/2796735478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c006aca0 0x7f30c0151e50 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.981+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 >> 172.21.15.50:0/2796735478 conn(0x7f30c00cbba0 msgr2=0x7f30c00abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.985+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 shutdown_connections 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:18.985+0000 7f30c6d85700 1 -- 172.21.15.50:0/2796735478 wait complete. 2023-12-24T18:54:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:54:19.005 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:54:17.214008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":363,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2456816,"kb_used_data":12976,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752517904,"statfs":{"total":773094113280,"available":770578333696,"internally_reserved":0,"allocated":13287424,"data_stored":7340426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929483"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343535+0000","last_change":"2023-12-24T18:54:14.338706+0000","last_active":"2023-12-24T18:54:14.343535+0000","last_peered":"2023-12-24T18:54:14.343535+0000","last_clean":"2023-12-24T18:54:14.343535+0000","last_became_active":"2023-12-24T18:54:14.338085+0000","last_became_peered":"2023-12-24T18:54:14.338085+0000","last_unstale":"2023-12-24T18:54:14.343535+0000","last_undegraded":"2023-12-24T18:54:14.343535+0000","last_fullsized":"2023-12-24T18:54:14.343535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:55.474280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343287+0000","last_change":"2023-12-24T18:54:14.338176+0000","last_active":"2023-12-24T18:54:14.343287+0000","last_peered":"2023-12-24T18:54:14.343287+0000","last_clean":"2023-12-24T18:54:14.343287+0000","last_became_active":"2023-12-24T18:54:14.337726+0000","last_became_peered":"2023-12-24T18:54:14.337726+0000","last_unstale":"2023-12-24T18:54:14.343287+0000","last_undegraded":"2023-12-24T18:54:14.343287+0000","last_fullsized":"2023-12-24T18:54:14.343287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:22.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343834+0000","last_change":"2023-12-24T18:54:14.334443+0000","last_active":"2023-12-24T18:54:14.343834+0000","last_peered":"2023-12-24T18:54:14.343834+0000","last_clean":"2023-12-24T18:54:14.343834+0000","last_became_active":"2023-12-24T18:54:14.333782+0000","last_became_peered":"2023-12-24T18:54:14.333782+0000","last_unstale":"2023-12-24T18:54:14.343834+0000","last_undegraded":"2023-12-24T18:54:14.343834+0000","last_fullsized":"2023-12-24T18:54:14.343834+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:15.839116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.334153+0000","last_change":"2023-12-24T18:54:14.329608+0000","last_active":"2023-12-24T18:54:14.334153+0000","last_peered":"2023-12-24T18:54:14.334153+0000","last_clean":"2023-12-24T18:54:14.334153+0000","last_became_active":"2023-12-24T18:54:14.329326+0000","last_became_peered":"2023-12-24T18:54:14.329326+0000","last_unstale":"2023-12-24T18:54:14.334153+0000","last_undegraded":"2023-12-24T18:54:14.334153+0000","last_fullsized":"2023-12-24T18:54:14.334153+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:49.421142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343433+0000","last_change":"2023-12-24T18:54:14.338520+0000","last_active":"2023-12-24T18:54:14.343433+0000","last_peered":"2023-12-24T18:54:14.343433+0000","last_clean":"2023-12-24T18:54:14.343433+0000","last_became_active":"2023-12-24T18:54:14.337802+0000","last_became_peered":"2023-12-24T18:54:14.337802+0000","last_unstale":"2023-12-24T18:54:14.343433+0000","last_undegraded":"2023-12-24T18:54:14.343433+0000","last_fullsized":"2023-12-24T18:54:14.343433+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:26.297105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343213+0000","last_change":"2023-12-24T18:54:14.337999+0000","last_active":"2023-12-24T18:54:14.343213+0000","last_peered":"2023-12-24T18:54:14.343213+0000","last_clean":"2023-12-24T18:54:14.343213+0000","last_became_active":"2023-12-24T18:54:14.337361+0000","last_became_peered":"2023-12-24T18:54:14.337361+0000","last_unstale":"2023-12-24T18:54:14.343213+0000","last_undegraded":"2023-12-24T18:54:14.343213+0000","last_fullsized":"2023-12-24T18:54:14.343213+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:55.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340084+0000","last_change":"2023-12-24T18:54:14.328397+0000","last_active":"2023-12-24T18:54:14.340084+0000","last_peered":"2023-12-24T18:54:14.340084+0000","last_clean":"2023-12-24T18:54:14.340084+0000","last_became_active":"2023-12-24T18:54:14.327141+0000","last_became_peered":"2023-12-24T18:54:14.327141+0000","last_unstale":"2023-12-24T18:54:14.340084+0000","last_undegraded":"2023-12-24T18:54:14.340084+0000","last_fullsized":"2023-12-24T18:54:14.340084+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:43:49.400091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.345183+0000","last_change":"2023-12-24T18:54:14.339750+0000","last_active":"2023-12-24T18:54:14.345183+0000","last_peered":"2023-12-24T18:54:14.345183+0000","last_clean":"2023-12-24T18:54:14.345183+0000","last_became_active":"2023-12-24T18:54:14.335977+0000","last_became_peered":"2023-12-24T18:54:14.335977+0000","last_unstale":"2023-12-24T18:54:14.345183+0000","last_undegraded":"2023-12-24T18:54:14.345183+0000","last_fullsized":"2023-12-24T18:54:14.345183+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:04:46.460004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"124'4","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.744693+0000","last_change":"2023-12-24T18:54:13.327509+0000","last_active":"2023-12-24T18:54:14.744693+0000","last_peered":"2023-12-24T18:54:14.744693+0000","last_clean":"2023-12-24T18:54:14.744693+0000","last_became_active":"2023-12-24T18:54:13.327168+0000","last_became_peered":"2023-12-24T18:54:13.327168+0000","last_unstale":"2023-12-24T18:54:14.744693+0000","last_undegraded":"2023-12-24T18:54:14.744693+0000","last_fullsized":"2023-12-24T18:54:14.744693+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:23.383623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347310+0000","last_change":"2023-12-24T18:54:14.342681+0000","last_active":"2023-12-24T18:54:14.347310+0000","last_peered":"2023-12-24T18:54:14.347310+0000","last_clean":"2023-12-24T18:54:14.347310+0000","last_became_active":"2023-12-24T18:54:14.342396+0000","last_became_peered":"2023-12-24T18:54:14.342396+0000","last_unstale":"2023-12-24T18:54:14.347310+0000","last_undegraded":"2023-12-24T18:54:14.347310+0000","last_fullsized":"2023-12-24T18:54:14.347310+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:34.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340566+0000","last_change":"2023-12-24T18:54:14.331661+0000","last_active":"2023-12-24T18:54:14.340566+0000","last_peered":"2023-12-24T18:54:14.340566+0000","last_clean":"2023-12-24T18:54:14.340566+0000","last_became_active":"2023-12-24T18:54:14.331271+0000","last_became_peered":"2023-12-24T18:54:14.331271+0000","last_unstale":"2023-12-24T18:54:14.340566+0000","last_undegraded":"2023-12-24T18:54:14.340566+0000","last_fullsized":"2023-12-24T18:54:14.340566+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:40.612401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347018+0000","last_change":"2023-12-24T18:54:14.340238+0000","last_active":"2023-12-24T18:54:14.347018+0000","last_peered":"2023-12-24T18:54:14.347018+0000","last_clean":"2023-12-24T18:54:14.347018+0000","last_became_active":"2023-12-24T18:54:14.339791+0000","last_became_peered":"2023-12-24T18:54:14.339791+0000","last_unstale":"2023-12-24T18:54:14.347018+0000","last_undegraded":"2023-12-24T18:54:14.347018+0000","last_fullsized":"2023-12-24T18:54:14.347018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:28:56.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.319643+0000","last_change":"2023-12-24T18:54:13.334975+0000","last_active":"2023-12-24T18:54:14.319643+0000","last_peered":"2023-12-24T18:54:14.319643+0000","last_clean":"2023-12-24T18:54:14.319643+0000","last_became_active":"2023-12-24T18:54:13.334689+0000","last_became_peered":"2023-12-24T18:54:13.334689+0000","last_unstale":"2023-12-24T18:54:14.319643+0000","last_undegraded":"2023-12-24T18:54:14.319643+0000","last_fullsized":"2023-12-24T18:54:14.319643+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:03.650927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340342+0000","last_change":"2023-12-24T18:54:14.329593+0000","last_active":"2023-12-24T18:54:14.340342+0000","last_peered":"2023-12-24T18:54:14.340342+0000","last_clean":"2023-12-24T18:54:14.340342+0000","last_became_active":"2023-12-24T18:54:14.329316+0000","last_became_peered":"2023-12-24T18:54:14.329316+0000","last_unstale":"2023-12-24T18:54:14.340342+0000","last_undegraded":"2023-12-24T18:54:14.340342+0000","last_fullsized":"2023-12-24T18:54:14.340342+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:29.498198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.328143+0000","last_change":"2023-12-24T18:54:13.332270+0000","last_active":"2023-12-24T18:54:14.328143+0000","last_peered":"2023-12-24T18:54:14.328143+0000","last_clean":"2023-12-24T18:54:14.328143+0000","last_became_active":"2023-12-24T18:54:13.331565+0000","last_became_peered":"2023-12-24T18:54:13.331565+0000","last_unstale":"2023-12-24T18:54:14.328143+0000","last_undegraded":"2023-12-24T18:54:14.328143+0000","last_fullsized":"2023-12-24T18:54:14.328143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:06.292781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.320006+0000","last_change":"2023-12-24T18:54:13.333358+0000","last_active":"2023-12-24T18:54:14.320006+0000","last_peered":"2023-12-24T18:54:14.320006+0000","last_clean":"2023-12-24T18:54:14.320006+0000","last_became_active":"2023-12-24T18:54:13.333005+0000","last_became_peered":"2023-12-24T18:54:13.333005+0000","last_unstale":"2023-12-24T18:54:14.320006+0000","last_undegraded":"2023-12-24T18:54:14.320006+0000","last_fullsized":"2023-12-24T18:54:14.320006+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:45.723233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343553+0000","last_change":"2023-12-24T18:54:14.338899+0000","last_active":"2023-12-24T18:54:14.343553+0000","last_peered":"2023-12-24T18:54:14.343553+0000","last_clean":"2023-12-24T18:54:14.343553+0000","last_became_active":"2023-12-24T18:54:14.337369+0000","last_became_peered":"2023-12-24T18:54:14.337369+0000","last_unstale":"2023-12-24T18:54:14.343553+0000","last_undegraded":"2023-12-24T18:54:14.343553+0000","last_fullsized":"2023-12-24T18:54:14.343553+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:30.353839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340848+0000","last_change":"2023-12-24T18:54:14.332277+0000","last_active":"2023-12-24T18:54:14.340848+0000","last_peered":"2023-12-24T18:54:14.340848+0000","last_clean":"2023-12-24T18:54:14.340848+0000","last_became_active":"2023-12-24T18:54:14.331933+0000","last_became_peered":"2023-12-24T18:54:14.331933+0000","last_unstale":"2023-12-24T18:54:14.340848+0000","last_undegraded":"2023-12-24T18:54:14.340848+0000","last_fullsized":"2023-12-24T18:54:14.340848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:06:16.231679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342863+0000","last_change":"2023-12-24T18:54:14.337098+0000","last_active":"2023-12-24T18:54:14.342863+0000","last_peered":"2023-12-24T18:54:14.342863+0000","last_clean":"2023-12-24T18:54:14.342863+0000","last_became_active":"2023-12-24T18:54:14.336795+0000","last_became_peered":"2023-12-24T18:54:14.336795+0000","last_unstale":"2023-12-24T18:54:14.342863+0000","last_undegraded":"2023-12-24T18:54:14.342863+0000","last_fullsized":"2023-12-24T18:54:14.342863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:02.717499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.330799+0000","last_change":"2023-12-24T18:54:14.321665+0000","last_active":"2023-12-24T18:54:14.330799+0000","last_peered":"2023-12-24T18:54:14.330799+0000","last_clean":"2023-12-24T18:54:14.330799+0000","last_became_active":"2023-12-24T18:54:14.321335+0000","last_became_peered":"2023-12-24T18:54:14.321335+0000","last_unstale":"2023-12-24T18:54:14.330799+0000","last_undegraded":"2023-12-24T18:54:14.330799+0000","last_fullsized":"2023-12-24T18:54:14.330799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:46:28.903975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340609+0000","last_change":"2023-12-24T18:54:14.331959+0000","last_active":"2023-12-24T18:54:14.340609+0000","last_peered":"2023-12-24T18:54:14.340609+0000","last_clean":"2023-12-24T18:54:14.340609+0000","last_became_active":"2023-12-24T18:54:14.331651+0000","last_became_peered":"2023-12-24T18:54:14.331651+0000","last_unstale":"2023-12-24T18:54:14.340609+0000","last_undegraded":"2023-12-24T18:54:14.340609+0000","last_fullsized":"2023-12-24T18:54:14.340609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:02:04.321877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.328253+0000","last_change":"2023-12-24T18:54:13.326369+0000","last_active":"2023-12-24T18:54:14.328253+0000","last_peered":"2023-12-24T18:54:14.328253+0000","last_clean":"2023-12-24T18:54:14.328253+0000","last_became_active":"2023-12-24T18:54:13.326093+0000","last_became_peered":"2023-12-24T18:54:13.326093+0000","last_unstale":"2023-12-24T18:54:14.328253+0000","last_undegraded":"2023-12-24T18:54:14.328253+0000","last_fullsized":"2023-12-24T18:54:14.328253+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:28:55.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329963+0000","last_change":"2023-12-24T18:54:14.323642+0000","last_active":"2023-12-24T18:54:14.329963+0000","last_peered":"2023-12-24T18:54:14.329963+0000","last_clean":"2023-12-24T18:54:14.329963+0000","last_became_active":"2023-12-24T18:54:14.323321+0000","last_became_peered":"2023-12-24T18:54:14.323321+0000","last_unstale":"2023-12-24T18:54:14.329963+0000","last_undegraded":"2023-12-24T18:54:14.329963+0000","last_fullsized":"2023-12-24T18:54:14.329963+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:07.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:13.285003+0000","last_change":"2023-12-24T18:54:13.285003+0000","last_active":"2023-12-24T18:54:13.285003+0000","last_peered":"2023-12-24T18:54:13.285003+0000","last_clean":"2023-12-24T18:54:13.285003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:13.285003+0000","last_undegraded":"2023-12-24T18:54:13.285003+0000","last_fullsized":"2023-12-24T18:54:13.285003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:54:12.269400+0000","last_change":"2023-12-24T18:54:12.269400+0000","last_active":"2023-12-24T18:54:12.269400+0000","last_peered":"2023-12-24T18:54:12.269400+0000","last_clean":"2023-12-24T18:54:12.269400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:54:12.269400+0000","last_undegraded":"2023-12-24T18:54:12.269400+0000","last_fullsized":"2023-12-24T18:54:12.269400+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"114'227","reported_seq":631,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T18:54:09.042679+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:54:09.042679+0000","last_peered":"2023-12-24T18:54:09.042679+0000","last_clean":"2023-12-24T18:54:09.042679+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:54:09.042679+0000","last_undegraded":"2023-12-24T18:54:09.042679+0000","last_fullsized":"2023-12-24T18:54:09.042679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575060,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311620,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060220,"statfs":{"total":96636764160,"available":96317665280,"internally_reserved":0,"allocated":2093056,"data_stored":1353954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.119,"15min":1.1299999999999999},"min":{"1min":0.76300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.784},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.147,"15min":1.167},"min":{"1min":0.90300000000000002,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.6910000000000001,"5min":1.756,"15min":1.756},"last":1.639}]},{"osd":1,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.115,"15min":1.133},"min":{"1min":0.90600000000000003,"5min":0.82099999999999995,"15min":0.72299999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.92500000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.518,"5min":1.7230000000000001,"15min":1.8129999999999999},"last":1.3500000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1919999999999999,"15min":1.2050000000000001},"min":{"1min":0.80000000000000004,"5min":0.63,"15min":0.59299999999999997},"max":{"1min":1.55,"5min":1.5620000000000001,"15min":1.625},"last":1.03},{"interface":"front","average":{"1min":1.228,"5min":1.1899999999999999,"15min":1.216},"min":{"1min":0.88200000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.54,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.4219999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2589999999999999,"15min":1.276},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.264,"15min":1.282},"min":{"1min":0.99299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5840000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.94899999999999995}]},{"osd":4,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.202,"15min":1.167},"min":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.7230000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.512},{"interface":"front","average":{"1min":1.147,"5min":1.246,"15min":1.2589999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"max":{"1min":1.6719999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.325}]},{"osd":5,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2669999999999999,"15min":1.2729999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5549999999999999,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.575},{"interface":"front","average":{"1min":1.365,"5min":1.3400000000000001,"15min":1.3260000000000001},"min":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.7549999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.4139999999999999},"min":{"1min":1.0529999999999999,"5min":0.99399999999999999,"15min":0.86399999999999999},"max":{"1min":1.637,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.8100000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.3999999999999999,"15min":1.415},"min":{"1min":0.93000000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7190000000000001,"5min":1.917,"15min":1.917},"last":1.615}]}]},{"osd":6,"up_from":13,"seq":55834575060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306944,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064896,"statfs":{"total":96636764160,"available":96322453504,"internally_reserved":0,"allocated":1499136,"data_stored":763586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2529999999999999},"min":{"1min":0.84799999999999998,"5min":0.68400000000000005,"15min":0.47799999999999998},"max":{"1min":1.905,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.375,"15min":1.3220000000000001},"min":{"1min":0.84099999999999997,"5min":0.79700000000000004,"15min":0.71299999999999997},"max":{"1min":3.097,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":0.78300000000000003}]},{"osd":1,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.143,"15min":1.1639999999999999},"min":{"1min":0.89500000000000002,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.659,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2370000000000001,"15min":1.2070000000000001},"min":{"1min":0.83599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0230000000000001,"5min":3.081,"15min":3.081},"last":1.2230000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.147,"15min":1.1599999999999999},"min":{"1min":0.78500000000000003,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5649999999999999,"5min":2.173,"15min":2.173},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.2589999999999999,"15min":1.238},"min":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":1.3979999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.3240000000000001,"15min":1.2809999999999999},"min":{"1min":0.84699999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":4.3710000000000004,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.363},{"interface":"front","average":{"1min":1.323,"5min":1.296,"15min":1.2589999999999999},"min":{"1min":1.0549999999999999,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":2,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.323}]},{"osd":4,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.181},"min":{"1min":0.747,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.77,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.298,"15min":1.238},"min":{"1min":0.71499999999999997,"5min":0.66500000000000004,"15min":0.65200000000000002},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2070000000000001,"15min":1.2},"min":{"1min":0.84599999999999997,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.105},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.3859999999999999,"15min":1.3380000000000001},"min":{"1min":0.94099999999999995,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":4.2169999999999996,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.4910000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.4079999999999999,"15min":1.3660000000000001},"min":{"1min":1.1120000000000001,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.474},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.393,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.4319999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302848,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068992,"statfs":{"total":96636764160,"available":96326647808,"internally_reserved":0,"allocated":1499136,"data_stored":763586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.169,"15min":1.1970000000000001},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5049999999999999,"5min":1.609,"15min":1.752},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3,"15min":1.302},"min":{"1min":0.629,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.839,"15min":1.859},"last":0.83399999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.113,"15min":1.1459999999999999},"min":{"1min":0.98399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.476,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1539999999999999},"min":{"1min":0.80000000000000004,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":1.409,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":2.077}]},{"osd":2,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.224,"15min":1.2090000000000001},"min":{"1min":0.82999999999999996,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.2210000000000001,"15min":1.23},"min":{"1min":0.99299999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4279999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.411}]},{"osd":3,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.90400000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7170000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.194},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.276,"15min":1.304},"min":{"1min":1.008,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5600000000000001,"5min":1.706,"15min":1.786},"last":1.079}]},{"osd":4,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1679999999999999,"15min":1.143},"min":{"1min":0.91300000000000003,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.546,"5min":1.861,"15min":1.861},"last":2.1829999999999998},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.248},"min":{"1min":0.83799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.597,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.8460000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.25,"15min":1.272},"min":{"1min":0.87,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.673,"5min":1.861,"15min":1.909},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.276,"15min":1.2989999999999999},"min":{"1min":0.90600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5920000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":2.3140000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.383,"15min":1.389},"min":{"1min":1.0649999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.659,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.768},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.407},"min":{"1min":0.97499999999999998,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.617,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.53}]}]},{"osd":4,"up_from":13,"seq":55834575061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306944,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064896,"statfs":{"total":96636764160,"available":96322453504,"internally_reserved":0,"allocated":1499136,"data_stored":763586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.73899999999999999,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.607,"5min":1.835,"15min":1.835},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.88300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.8640000000000001}]},{"osd":1,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.123,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.4650000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5029999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.333}]},{"osd":2,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2949999999999999,"15min":1.302},"min":{"1min":0.88400000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5900000000000001,"5min":1.952,"15min":1.952},"last":1.55},{"interface":"front","average":{"1min":1.335,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":1.0549999999999999,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":1.6140000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.712}]},{"osd":3,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1759999999999999,"15min":1.1779999999999999},"min":{"1min":0.91200000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6439999999999999,"5min":1.714,"15min":1.736},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2629999999999999,"15min":1.2749999999999999},"min":{"1min":0.94199999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.839},"last":0.97199999999999998}]},{"osd":5,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.252,"15min":1.2490000000000001},"min":{"1min":0.79700000000000004,"5min":0.64300000000000002,"15min":0.623},"max":{"1min":1.5189999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3200000000000001,"15min":1.3029999999999999},"min":{"1min":0.77400000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6739999999999999,"5min":1.831,"15min":1.8640000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.85099999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.714,"5min":1.823,"15min":1.881},"last":1.405},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.335,"15min":1.3169999999999999},"min":{"1min":0.98099999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6020000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.319,"15min":1.2969999999999999},"min":{"1min":0.92500000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.6419999999999999,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.4219999999999999,"15min":1.397},"min":{"1min":1.0549999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8220000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.8300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306984,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064856,"statfs":{"total":96636764160,"available":96322412544,"internally_reserved":0,"allocated":1540096,"data_stored":785059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3300000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.143,"15min":1.093},"min":{"1min":0.86799999999999999,"5min":0.61799999999999999,"15min":0.46000000000000002},"max":{"1min":1.3620000000000001,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.181}]},{"osd":1,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.996,"15min":1.022},"min":{"1min":0.68100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1699999999999999,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.571,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.2350000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0800000000000001,"15min":1.103},"min":{"1min":0.80200000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.468,"5min":2.363,"15min":2.363},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.1559999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5129999999999999,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":1.04}]},{"osd":4,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.276,"15min":1.2609999999999999},"min":{"1min":0.875,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.6579999999999999,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.331},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3100000000000001,"15min":1.3320000000000001},"min":{"1min":0.80500000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6910000000000001,"5min":2.944,"15min":2.944},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3680000000000001,"15min":1.387},"min":{"1min":1.147,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8300000000000001,"5min":2.516,"15min":2.516},"last":1.585},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4550000000000001,"15min":1.4319999999999999},"min":{"1min":1.0680000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.786,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.3879999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.462,"15min":1.466},"min":{"1min":1.056,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.6120000000000001,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.53},{"interface":"front","average":{"1min":1.292,"5min":1.423,"15min":1.411},"min":{"1min":0.86599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5489999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5}]},{"osd":7,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.4630000000000001,"15min":1.452},"min":{"1min":1.0469999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.6599999999999999,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.625},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4990000000000001,"15min":1.5129999999999999},"min":{"1min":1.1899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.8080000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.7030000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311040,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060800,"statfs":{"total":96636764160,"available":96318259200,"internally_reserved":0,"allocated":1499136,"data_stored":763586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.59099999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.204,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.64800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.397,"5min":1.4970000000000001,"15min":1.5229999999999999},"last":0.876}]},{"osd":1,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89100000000000001,"15min":0.89800000000000002},"min":{"1min":0.68100000000000005,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.6830000000000001,"5min":1.78,"15min":1.78},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.976,"15min":1.976},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.081,"15min":1.1259999999999999},"min":{"1min":0.86199999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.5609999999999999,"5min":1.6459999999999999,"15min":1.778},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.78800000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4430000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.27,"15min":1.3029999999999999},"min":{"1min":0.86299999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6639999999999999,"5min":1.7370000000000001,"15min":1.764},"last":1.101},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.286,"15min":1.2869999999999999},"min":{"1min":0.92500000000000004,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5800000000000001,"5min":1.798,"15min":1.798},"last":1.0640000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.294,"15min":1.2829999999999999},"min":{"1min":0.96499999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.5469999999999999,"5min":2.069,"15min":2.069},"last":1.151},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3500000000000001,"15min":1.359},"min":{"1min":1.0740000000000001,"5min":0.85199999999999998,"15min":0.82999999999999996},"max":{"1min":1.645,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.202}]},{"osd":6,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.389,"15min":1.397},"min":{"1min":1.0649999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9199999999999999,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.234},{"interface":"front","average":{"1min":1.403,"5min":1.3879999999999999,"15min":1.3959999999999999},"min":{"1min":1.1180000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8899999999999999,"5min":1.9870000000000001,"15min":2.093},"last":1.2929999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4450000000000001,"15min":1.4530000000000001},"min":{"1min":0.98999999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.722,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.452,"15min":1.464},"min":{"1min":1.0189999999999999,"5min":0.84999999999999998,"15min":0.84299999999999997},"max":{"1min":1.8169999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.381}]}]},{"osd":1,"up_from":13,"seq":55834575060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302848,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068992,"statfs":{"total":96636764160,"available":96326647808,"internally_reserved":0,"allocated":1499136,"data_stored":763586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.464,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.075,"15min":1.1180000000000001},"min":{"1min":0.86799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.528,"5min":1.6419999999999999,"15min":1.829},"last":1.2769999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.626,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.383,"5min":1.494,"15min":1.5349999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.101,"15min":1.115},"min":{"1min":0.626,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5069999999999999,"5min":1.73,"15min":1.7410000000000001},"last":0.94199999999999995}]},{"osd":3,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.248,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4059999999999999,"5min":1.823,"15min":1.9810000000000001},"last":1.202},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.119,"15min":1.089},"min":{"1min":0.66100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.502,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":1.0289999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.228},"min":{"1min":0.82499999999999996,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.4590000000000001,"5min":1.724,"15min":1.724},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.399},"min":{"1min":0.93999999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6299999999999999,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.1419999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.389,"15min":1.3779999999999999},"min":{"1min":1.1539999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8320000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":1.052,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.488,"5min":1.8340000000000001,"15min":2.0089999999999999},"last":0.998}]},{"osd":6,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.502,"15min":1.48},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7390000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.444,"15min":1.4530000000000001},"min":{"1min":1.0549999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.746,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.2230000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.5069999999999999,"15min":1.5129999999999999},"min":{"1min":1.254,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":1.73,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.327},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.46,"15min":1.4550000000000001},"min":{"1min":1.1759999999999999,"5min":0.876,"15min":0.876},"max":{"1min":1.5960000000000001,"5min":1.9710000000000001,"15min":2.1160000000000001},"last":1.173}]}]},{"osd":0,"up_from":13,"seq":55834575061,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307588,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064252,"statfs":{"total":96636764160,"available":96321794048,"internally_reserved":0,"allocated":2158592,"data_stored":1383483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.45900000000000002,"15min":0.372},"max":{"1min":1.3899999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.56200000000000006,"15min":0.40799999999999997},"max":{"1min":1.349,"5min":1.631,"15min":1.746},"last":1.242}]},{"osd":2,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.056,"15min":1.046},"min":{"1min":0.71799999999999997,"5min":0.629,"15min":0.627},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.7},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.071,"15min":1.1180000000000001},"min":{"1min":0.78700000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.375,"5min":1.631,"15min":2.8130000000000002},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":1.018},"min":{"1min":0.67500000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.369,"5min":1.5289999999999999,"15min":1.819},"last":1.04},{"interface":"front","average":{"1min":1.23,"5min":1.214,"15min":1.2290000000000001},"min":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.163}]},{"osd":4,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.335,"15min":1.345},"min":{"1min":1.0309999999999999,"5min":0.82699999999999996,"15min":0.72599999999999998},"max":{"1min":1.655,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2370000000000001,"15min":1.2789999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.78300000000000003},"max":{"1min":1.5189999999999999,"5min":1.651,"15min":1.762},"last":0.92600000000000005}]},{"osd":5,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3799999999999999},"min":{"1min":1.044,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.641,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.377},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3520000000000001,"15min":1.397},"min":{"1min":1.0449999999999999,"5min":0.95699999999999996,"15min":0.66000000000000003},"max":{"1min":1.843,"5min":1.978,"15min":2.2280000000000002},"last":1.129}]},{"osd":6,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3240000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":2.0779999999999998},"last":1.115},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.47},"min":{"1min":1.1120000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.746,"5min":2.0750000000000002,"15min":2.23},"last":1.2849999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":1.133,"5min":1.006,"15min":0.89400000000000002},"max":{"1min":1.978,"5min":2.262,"15min":2.8980000000000001},"last":1.474},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.3979999999999999,"15min":1.4399999999999999},"min":{"1min":1.071,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.895,"5min":1.917,"15min":2.3279999999999998},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:54:19.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:54:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.229+0000 7fe2c6f45700 1 Processor -- start 2023-12-24T18:54:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.229+0000 7fe2c6f45700 1 -- start start 2023-12-24T18:54:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c6f45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2c0158e10 0x7fe2c015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c6f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b3c90 0x7fe2c006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c6f45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c006d5c0 con 0x7fe2c00b1ba0 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c6f45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00b49c0 con 0x7fe2c0158e10 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c6f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c006d040 con 0x7fe2c00b3c90 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2c0158e10 0x7fe2c015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2c0158e10 0x7fe2c015d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36936/0 (socket says 172.21.15.50:36936) 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 -- 172.21.15.50:0/3373438373 learned_addr learned my addr 172.21.15.50:0/3373438373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2bffff700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b3c90 0x7fe2c006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 -- 172.21.15.50:0/3373438373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b3c90 msgr2=0x7fe2c006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b3c90 0x7fe2c006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 -- 172.21.15.50:0/3373438373 >> v1:172.21.15.82:6789/0 conn(0x7fe2c00b1ba0 legacy=0x7fe2c006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 -- 172.21.15.50:0/3373438373 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c006df90 con 0x7fe2c0158e10 2023-12-24T18:54:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2c4ce1700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c015d6d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40099b0 tx=0x7fe2b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250554a0edd982d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.233+0000 7fe2bf7fe700 1 -- 172.21.15.50:0/3373438373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4009ea0 con 0x7fe2c0158e10 2023-12-24T18:54:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2bf7fe700 1 -- 172.21.15.50:0/3373438373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400b860 con 0x7fe2c0158e10 2023-12-24T18:54:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2bf7fe700 1 -- 172.21.15.50:0/3373438373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bc00 con 0x7fe2c0158e10 2023-12-24T18:54:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- 172.21.15.50:0/3373438373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 msgr2=0x7fe2c015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c015d6d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40099b0 tx=0x7fe2b4009250 comp rx=0 tx=0).stop 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- 172.21.15.50:0/3373438373 shutdown_connections 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b3c90 0x7fe2c006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/3373438373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c015d6d0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- 172.21.15.50:0/3373438373 >> 172.21.15.50:0/3373438373 conn(0x7fe2c00670b0 msgr2=0x7fe2c00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- 172.21.15.50:0/3373438373 shutdown_connections 2023-12-24T18:54:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- 172.21.15.50:0/3373438373 wait complete. 2023-12-24T18:54:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 Processor -- start 2023-12-24T18:54:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.237+0000 7fe2c6f45700 1 -- start start 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b1ba0 0x7fe2c0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00b3c90 0x7fe2c00aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c01471c0 con 0x7fe2c0158e10 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015a380 con 0x7fe2c00b3c90 2023-12-24T18:54:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015a940 con 0x7fe2c00b1ba0 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36944/0 (socket says 172.21.15.50:36944) 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 -- 172.21.15.50:0/35369275 learned_addr learned my addr 172.21.15.50:0/35369275 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c4ce1700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b1ba0 0x7fe2c0146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2bffff700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00b3c90 0x7fe2c00aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 -- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b1ba0 msgr2=0x7fe2c0146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b1ba0 0x7fe2c0146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 -- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00b3c90 msgr2=0x7fe2c00aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00b3c90 0x7fe2c00aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 -- 172.21.15.50:0/35369275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40094f0 con 0x7fe2c0158e10 2023-12-24T18:54:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c54e2700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c8e0 tx=0x7fe2b8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012630 con 0x7fe2c0158e10 2023-12-24T18:54:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8012790 con 0x7fe2c0158e10 2023-12-24T18:54:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012b50 con 0x7fe2c0158e10 2023-12-24T18:54:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00a9750 con 0x7fe2c0158e10 2023-12-24T18:54:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.241+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c015a5d0 con 0x7fe2c0158e10 2023-12-24T18:54:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.245+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c015aaf0 con 0x7fe2c0158e10 2023-12-24T18:54:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.245+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe2b801a3a0 con 0x7fe2c0158e10 2023-12-24T18:54:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.245+0000 7fe2bcff9700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 0x7fe2a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.245+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fe2b807cc50 con 0x7fe2c0158e10 2023-12-24T18:54:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.249+0000 7fe2c4ce1700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 0x7fe2a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.249+0000 7fe2c4ce1700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 0x7fe2a4062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40099b0 tx=0x7fe2b4017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.253+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe2c015aaf0 con 0x7fe2c0158e10 2023-12-24T18:54:19.265 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-12-24T18:54:19.265+0000 7f626a5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:54:19.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.425+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2c015aab0 con 0x7fe2a4060550 2023-12-24T18:54:19.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.437+0000 7fe2bcff9700 1 -- 172.21.15.50:0/35369275 <== mgr.7599 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286993 (secure 0 0 0) 0x7fe2c015aab0 con 0x7fe2a4060550 2023-12-24T18:54:19.443 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 msgr2=0x7fe2a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 0x7fe2a4062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40099b0 tx=0x7fe2b4017000 comp rx=0 tx=0).stop 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 msgr2=0x7fe2c00aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c8e0 tx=0x7fe2b8001710 comp rx=0 tx=0).stop 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 shutdown_connections 2023-12-24T18:54:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe2a4060550 0x7fe2a4062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c0158e10 0x7fe2c00aa900 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00b3c90 0x7fe2c00aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 --2- 172.21.15.50:0/35369275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00b1ba0 0x7fe2c0146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 >> 172.21.15.50:0/35369275 conn(0x7fe2c00670b0 msgr2=0x7fe2c00b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 shutdown_connections 2023-12-24T18:54:19.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.445+0000 7fe2c6f45700 1 -- 172.21.15.50:0/35369275 wait complete. 2023-12-24T18:54:19.450 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:54:19.469 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T18:54:19.214579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2457136,"kb_used_data":13296,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752517584,"statfs":{"total":773094113280,"available":770578006016,"internally_reserved":0,"allocated":13615104,"data_stored":7503292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001912"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343535+0000","last_change":"2023-12-24T18:54:14.338706+0000","last_active":"2023-12-24T18:54:14.343535+0000","last_peered":"2023-12-24T18:54:14.343535+0000","last_clean":"2023-12-24T18:54:14.343535+0000","last_became_active":"2023-12-24T18:54:14.338085+0000","last_became_peered":"2023-12-24T18:54:14.338085+0000","last_unstale":"2023-12-24T18:54:14.343535+0000","last_undegraded":"2023-12-24T18:54:14.343535+0000","last_fullsized":"2023-12-24T18:54:14.343535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:55.474280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.337112+0000","last_change":"2023-12-24T18:54:14.333676+0000","last_active":"2023-12-24T18:54:14.337112+0000","last_peered":"2023-12-24T18:54:14.337112+0000","last_clean":"2023-12-24T18:54:14.337112+0000","last_became_active":"2023-12-24T18:54:14.332484+0000","last_became_peered":"2023-12-24T18:54:14.332484+0000","last_unstale":"2023-12-24T18:54:14.337112+0000","last_undegraded":"2023-12-24T18:54:14.337112+0000","last_fullsized":"2023-12-24T18:54:14.337112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:51:33.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343287+0000","last_change":"2023-12-24T18:54:14.338176+0000","last_active":"2023-12-24T18:54:14.343287+0000","last_peered":"2023-12-24T18:54:14.343287+0000","last_clean":"2023-12-24T18:54:14.343287+0000","last_became_active":"2023-12-24T18:54:14.337726+0000","last_became_peered":"2023-12-24T18:54:14.337726+0000","last_unstale":"2023-12-24T18:54:14.343287+0000","last_undegraded":"2023-12-24T18:54:14.343287+0000","last_fullsized":"2023-12-24T18:54:14.343287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:22.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343834+0000","last_change":"2023-12-24T18:54:14.334443+0000","last_active":"2023-12-24T18:54:14.343834+0000","last_peered":"2023-12-24T18:54:14.343834+0000","last_clean":"2023-12-24T18:54:14.343834+0000","last_became_active":"2023-12-24T18:54:14.333782+0000","last_became_peered":"2023-12-24T18:54:14.333782+0000","last_unstale":"2023-12-24T18:54:14.343834+0000","last_undegraded":"2023-12-24T18:54:14.343834+0000","last_fullsized":"2023-12-24T18:54:14.343834+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:15.839116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.348347+0000","last_change":"2023-12-24T18:54:14.347337+0000","last_active":"2023-12-24T18:54:14.348347+0000","last_peered":"2023-12-24T18:54:14.348347+0000","last_clean":"2023-12-24T18:54:14.348347+0000","last_became_active":"2023-12-24T18:54:14.345122+0000","last_became_peered":"2023-12-24T18:54:14.345122+0000","last_unstale":"2023-12-24T18:54:14.348347+0000","last_undegraded":"2023-12-24T18:54:14.348347+0000","last_fullsized":"2023-12-24T18:54:14.348347+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:10:56.320111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.337374+0000","last_change":"2023-12-24T18:54:14.334015+0000","last_active":"2023-12-24T18:54:14.337374+0000","last_peered":"2023-12-24T18:54:14.337374+0000","last_clean":"2023-12-24T18:54:14.337374+0000","last_became_active":"2023-12-24T18:54:14.333034+0000","last_became_peered":"2023-12-24T18:54:14.333034+0000","last_unstale":"2023-12-24T18:54:14.337374+0000","last_undegraded":"2023-12-24T18:54:14.337374+0000","last_fullsized":"2023-12-24T18:54:14.337374+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:03:46.661981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.341114+0000","last_change":"2023-12-24T18:54:14.339402+0000","last_active":"2023-12-24T18:54:14.341114+0000","last_peered":"2023-12-24T18:54:14.341114+0000","last_clean":"2023-12-24T18:54:14.341114+0000","last_became_active":"2023-12-24T18:54:14.334708+0000","last_became_peered":"2023-12-24T18:54:14.334708+0000","last_unstale":"2023-12-24T18:54:14.341114+0000","last_undegraded":"2023-12-24T18:54:14.341114+0000","last_fullsized":"2023-12-24T18:54:14.341114+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:42:03.543323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347567+0000","last_change":"2023-12-24T18:54:14.344155+0000","last_active":"2023-12-24T18:54:14.347567+0000","last_peered":"2023-12-24T18:54:14.347567+0000","last_clean":"2023-12-24T18:54:14.347567+0000","last_became_active":"2023-12-24T18:54:14.337008+0000","last_became_peered":"2023-12-24T18:54:14.337008+0000","last_unstale":"2023-12-24T18:54:14.347567+0000","last_undegraded":"2023-12-24T18:54:14.347567+0000","last_fullsized":"2023-12-24T18:54:14.347567+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:37.569183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329823+0000","last_change":"2023-12-24T18:54:14.328083+0000","last_active":"2023-12-24T18:54:14.329823+0000","last_peered":"2023-12-24T18:54:14.329823+0000","last_clean":"2023-12-24T18:54:14.329823+0000","last_became_active":"2023-12-24T18:54:14.327785+0000","last_became_peered":"2023-12-24T18:54:14.327785+0000","last_unstale":"2023-12-24T18:54:14.329823+0000","last_undegraded":"2023-12-24T18:54:14.329823+0000","last_fullsized":"2023-12-24T18:54:14.329823+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:59:03.865582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.341556+0000","last_change":"2023-12-24T18:54:14.334898+0000","last_active":"2023-12-24T18:54:14.341556+0000","last_peered":"2023-12-24T18:54:14.341556+0000","last_clean":"2023-12-24T18:54:14.341556+0000","last_became_active":"2023-12-24T18:54:14.334525+0000","last_became_peered":"2023-12-24T18:54:14.334525+0000","last_unstale":"2023-12-24T18:54:14.341556+0000","last_undegraded":"2023-12-24T18:54:14.341556+0000","last_fullsized":"2023-12-24T18:54:14.341556+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:27.522264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329071+0000","last_change":"2023-12-24T18:54:14.327875+0000","last_active":"2023-12-24T18:54:14.329071+0000","last_peered":"2023-12-24T18:54:14.329071+0000","last_clean":"2023-12-24T18:54:14.329071+0000","last_became_active":"2023-12-24T18:54:14.326436+0000","last_became_peered":"2023-12-24T18:54:14.326436+0000","last_unstale":"2023-12-24T18:54:14.329071+0000","last_undegraded":"2023-12-24T18:54:14.329071+0000","last_fullsized":"2023-12-24T18:54:14.329071+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:09.670824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340662+0000","last_change":"2023-12-24T18:54:14.331010+0000","last_active":"2023-12-24T18:54:14.340662+0000","last_peered":"2023-12-24T18:54:14.340662+0000","last_clean":"2023-12-24T18:54:14.340662+0000","last_became_active":"2023-12-24T18:54:14.330366+0000","last_became_peered":"2023-12-24T18:54:14.330366+0000","last_unstale":"2023-12-24T18:54:14.340662+0000","last_undegraded":"2023-12-24T18:54:14.340662+0000","last_fullsized":"2023-12-24T18:54:14.340662+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:27:42.462158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.334153+0000","last_change":"2023-12-24T18:54:14.329608+0000","last_active":"2023-12-24T18:54:14.334153+0000","last_peered":"2023-12-24T18:54:14.334153+0000","last_clean":"2023-12-24T18:54:14.334153+0000","last_became_active":"2023-12-24T18:54:14.329326+0000","last_became_peered":"2023-12-24T18:54:14.329326+0000","last_unstale":"2023-12-24T18:54:14.334153+0000","last_undegraded":"2023-12-24T18:54:14.334153+0000","last_fullsized":"2023-12-24T18:54:14.334153+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:49.421142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343229+0000","last_change":"2023-12-24T18:54:14.342176+0000","last_active":"2023-12-24T18:54:14.343229+0000","last_peered":"2023-12-24T18:54:14.343229+0000","last_clean":"2023-12-24T18:54:14.343229+0000","last_became_active":"2023-12-24T18:54:14.340448+0000","last_became_peered":"2023-12-24T18:54:14.340448+0000","last_unstale":"2023-12-24T18:54:14.343229+0000","last_undegraded":"2023-12-24T18:54:14.343229+0000","last_fullsized":"2023-12-24T18:54:14.343229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:27.809189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340055+0000","last_change":"2023-12-24T18:54:14.336420+0000","last_active":"2023-12-24T18:54:14.340055+0000","last_peered":"2023-12-24T18:54:14.340055+0000","last_clean":"2023-12-24T18:54:14.340055+0000","last_became_active":"2023-12-24T18:54:14.336107+0000","last_became_peered":"2023-12-24T18:54:14.336107+0000","last_unstale":"2023-12-24T18:54:14.340055+0000","last_undegraded":"2023-12-24T18:54:14.340055+0000","last_fullsized":"2023-12-24T18:54:14.340055+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:40:23.384869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340482+0000","last_change":"2023-12-24T18:54:14.335142+0000","last_active":"2023-12-24T18:54:14.340482+0000","last_peered":"2023-12-24T18:54:14.340482+0000","last_clean":"2023-12-24T18:54:14.340482+0000","last_became_active":"2023-12-24T18:54:14.334853+0000","last_became_peered":"2023-12-24T18:54:14.334853+0000","last_unstale":"2023-12-24T18:54:14.340482+0000","last_undegraded":"2023-12-24T18:54:14.340482+0000","last_fullsized":"2023-12-24T18:54:14.340482+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:01.140223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343433+0000","last_change":"2023-12-24T18:54:14.338520+0000","last_active":"2023-12-24T18:54:14.343433+0000","last_peered":"2023-12-24T18:54:14.343433+0000","last_clean":"2023-12-24T18:54:14.343433+0000","last_became_active":"2023-12-24T18:54:14.337802+0000","last_became_peered":"2023-12-24T18:54:14.337802+0000","last_unstale":"2023-12-24T18:54:14.343433+0000","last_undegraded":"2023-12-24T18:54:14.343433+0000","last_fullsized":"2023-12-24T18:54:14.343433+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:26.297105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.338428+0000","last_change":"2023-12-24T18:54:14.334324+0000","last_active":"2023-12-24T18:54:14.338428+0000","last_peered":"2023-12-24T18:54:14.338428+0000","last_clean":"2023-12-24T18:54:14.338428+0000","last_became_active":"2023-12-24T18:54:14.333859+0000","last_became_peered":"2023-12-24T18:54:14.333859+0000","last_unstale":"2023-12-24T18:54:14.338428+0000","last_undegraded":"2023-12-24T18:54:14.338428+0000","last_fullsized":"2023-12-24T18:54:14.338428+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:10:47.530600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343213+0000","last_change":"2023-12-24T18:54:14.337999+0000","last_active":"2023-12-24T18:54:14.343213+0000","last_peered":"2023-12-24T18:54:14.343213+0000","last_clean":"2023-12-24T18:54:14.343213+0000","last_became_active":"2023-12-24T18:54:14.337361+0000","last_became_peered":"2023-12-24T18:54:14.337361+0000","last_unstale":"2023-12-24T18:54:14.343213+0000","last_undegraded":"2023-12-24T18:54:14.343213+0000","last_fullsized":"2023-12-24T18:54:14.343213+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:55.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340683+0000","last_change":"2023-12-24T18:54:14.331201+0000","last_active":"2023-12-24T18:54:14.340683+0000","last_peered":"2023-12-24T18:54:14.340683+0000","last_clean":"2023-12-24T18:54:14.340683+0000","last_became_active":"2023-12-24T18:54:14.330725+0000","last_became_peered":"2023-12-24T18:54:14.330725+0000","last_unstale":"2023-12-24T18:54:14.340683+0000","last_undegraded":"2023-12-24T18:54:14.340683+0000","last_fullsized":"2023-12-24T18:54:14.340683+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:20.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.333590+0000","last_change":"2023-12-24T18:54:14.331597+0000","last_active":"2023-12-24T18:54:14.333590+0000","last_peered":"2023-12-24T18:54:14.333590+0000","last_clean":"2023-12-24T18:54:14.333590+0000","last_became_active":"2023-12-24T18:54:14.331230+0000","last_became_peered":"2023-12-24T18:54:14.331230+0000","last_unstale":"2023-12-24T18:54:14.333590+0000","last_undegraded":"2023-12-24T18:54:14.333590+0000","last_fullsized":"2023-12-24T18:54:14.333590+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:51:43.348008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.341847+0000","last_change":"2023-12-24T18:54:14.334686+0000","last_active":"2023-12-24T18:54:14.341847+0000","last_peered":"2023-12-24T18:54:14.341847+0000","last_clean":"2023-12-24T18:54:14.341847+0000","last_became_active":"2023-12-24T18:54:14.334372+0000","last_became_peered":"2023-12-24T18:54:14.334372+0000","last_unstale":"2023-12-24T18:54:14.341847+0000","last_undegraded":"2023-12-24T18:54:14.341847+0000","last_fullsized":"2023-12-24T18:54:14.341847+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:33:06.104759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340084+0000","last_change":"2023-12-24T18:54:14.328397+0000","last_active":"2023-12-24T18:54:14.340084+0000","last_peered":"2023-12-24T18:54:14.340084+0000","last_clean":"2023-12-24T18:54:14.340084+0000","last_became_active":"2023-12-24T18:54:14.327141+0000","last_became_peered":"2023-12-24T18:54:14.327141+0000","last_unstale":"2023-12-24T18:54:14.340084+0000","last_undegraded":"2023-12-24T18:54:14.340084+0000","last_fullsized":"2023-12-24T18:54:14.340084+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:43:49.400091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.346422+0000","last_change":"2023-12-24T18:54:14.343320+0000","last_active":"2023-12-24T18:54:14.346422+0000","last_peered":"2023-12-24T18:54:14.346422+0000","last_clean":"2023-12-24T18:54:14.346422+0000","last_became_active":"2023-12-24T18:54:14.342816+0000","last_became_peered":"2023-12-24T18:54:14.342816+0000","last_unstale":"2023-12-24T18:54:14.346422+0000","last_undegraded":"2023-12-24T18:54:14.346422+0000","last_fullsized":"2023-12-24T18:54:14.346422+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:18.960707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340752+0000","last_change":"2023-12-24T18:54:14.330871+0000","last_active":"2023-12-24T18:54:14.340752+0000","last_peered":"2023-12-24T18:54:14.340752+0000","last_clean":"2023-12-24T18:54:14.340752+0000","last_became_active":"2023-12-24T18:54:14.330569+0000","last_became_peered":"2023-12-24T18:54:14.330569+0000","last_unstale":"2023-12-24T18:54:14.340752+0000","last_undegraded":"2023-12-24T18:54:14.340752+0000","last_fullsized":"2023-12-24T18:54:14.340752+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:30:46.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.324340+0000","last_change":"2023-12-24T18:54:14.318949+0000","last_active":"2023-12-24T18:54:14.324340+0000","last_peered":"2023-12-24T18:54:14.324340+0000","last_clean":"2023-12-24T18:54:14.324340+0000","last_became_active":"2023-12-24T18:54:14.318659+0000","last_became_peered":"2023-12-24T18:54:14.318659+0000","last_unstale":"2023-12-24T18:54:14.324340+0000","last_undegraded":"2023-12-24T18:54:14.324340+0000","last_fullsized":"2023-12-24T18:54:14.324340+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:39.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.338883+0000","last_change":"2023-12-24T18:54:14.335586+0000","last_active":"2023-12-24T18:54:14.338883+0000","last_peered":"2023-12-24T18:54:14.338883+0000","last_clean":"2023-12-24T18:54:14.338883+0000","last_became_active":"2023-12-24T18:54:14.333486+0000","last_became_peered":"2023-12-24T18:54:14.333486+0000","last_unstale":"2023-12-24T18:54:14.338883+0000","last_undegraded":"2023-12-24T18:54:14.338883+0000","last_fullsized":"2023-12-24T18:54:14.338883+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:25.424403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.326545+0000","last_change":"2023-12-24T18:54:14.322567+0000","last_active":"2023-12-24T18:54:14.326545+0000","last_peered":"2023-12-24T18:54:14.326545+0000","last_clean":"2023-12-24T18:54:14.326545+0000","last_became_active":"2023-12-24T18:54:14.322254+0000","last_became_peered":"2023-12-24T18:54:14.322254+0000","last_unstale":"2023-12-24T18:54:14.326545+0000","last_undegraded":"2023-12-24T18:54:14.326545+0000","last_fullsized":"2023-12-24T18:54:14.326545+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:31:47.935438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.348311+0000","last_change":"2023-12-24T18:54:14.345895+0000","last_active":"2023-12-24T18:54:14.348311+0000","last_peered":"2023-12-24T18:54:14.348311+0000","last_clean":"2023-12-24T18:54:14.348311+0000","last_became_active":"2023-12-24T18:54:14.338767+0000","last_became_peered":"2023-12-24T18:54:14.338767+0000","last_unstale":"2023-12-24T18:54:14.348311+0000","last_undegraded":"2023-12-24T18:54:14.348311+0000","last_fullsized":"2023-12-24T18:54:14.348311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:59.570978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329515+0000","last_change":"2023-12-24T18:54:14.320666+0000","last_active":"2023-12-24T18:54:14.329515+0000","last_peered":"2023-12-24T18:54:14.329515+0000","last_clean":"2023-12-24T18:54:14.329515+0000","last_became_active":"2023-12-24T18:54:14.320317+0000","last_became_peered":"2023-12-24T18:54:14.320317+0000","last_unstale":"2023-12-24T18:54:14.329515+0000","last_undegraded":"2023-12-24T18:54:14.329515+0000","last_fullsized":"2023-12-24T18:54:14.329515+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:12:50.182016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343518+0000","last_change":"2023-12-24T18:54:14.341273+0000","last_active":"2023-12-24T18:54:14.343518+0000","last_peered":"2023-12-24T18:54:14.343518+0000","last_clean":"2023-12-24T18:54:14.343518+0000","last_became_active":"2023-12-24T18:54:14.340022+0000","last_became_peered":"2023-12-24T18:54:14.340022+0000","last_unstale":"2023-12-24T18:54:14.343518+0000","last_undegraded":"2023-12-24T18:54:14.343518+0000","last_fullsized":"2023-12-24T18:54:14.343518+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:28:09.317406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.318590+0000","last_change":"2023-12-24T18:54:14.317420+0000","last_active":"2023-12-24T18:54:14.318590+0000","last_peered":"2023-12-24T18:54:14.318590+0000","last_clean":"2023-12-24T18:54:14.318590+0000","last_became_active":"2023-12-24T18:54:14.317002+0000","last_became_peered":"2023-12-24T18:54:14.317002+0000","last_unstale":"2023-12-24T18:54:14.318590+0000","last_undegraded":"2023-12-24T18:54:14.318590+0000","last_fullsized":"2023-12-24T18:54:14.318590+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:12:38.257482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.345183+0000","last_change":"2023-12-24T18:54:14.339750+0000","last_active":"2023-12-24T18:54:14.345183+0000","last_peered":"2023-12-24T18:54:14.345183+0000","last_clean":"2023-12-24T18:54:14.345183+0000","last_became_active":"2023-12-24T18:54:14.335977+0000","last_became_peered":"2023-12-24T18:54:14.335977+0000","last_unstale":"2023-12-24T18:54:14.345183+0000","last_undegraded":"2023-12-24T18:54:14.345183+0000","last_fullsized":"2023-12-24T18:54:14.345183+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:04:46.460004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"124'4","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.744693+0000","last_change":"2023-12-24T18:54:13.327509+0000","last_active":"2023-12-24T18:54:14.744693+0000","last_peered":"2023-12-24T18:54:14.744693+0000","last_clean":"2023-12-24T18:54:14.744693+0000","last_became_active":"2023-12-24T18:54:13.327168+0000","last_became_peered":"2023-12-24T18:54:13.327168+0000","last_unstale":"2023-12-24T18:54:14.744693+0000","last_undegraded":"2023-12-24T18:54:14.744693+0000","last_fullsized":"2023-12-24T18:54:14.744693+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:23.383623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342330+0000","last_change":"2023-12-24T18:54:14.340072+0000","last_active":"2023-12-24T18:54:14.342330+0000","last_peered":"2023-12-24T18:54:14.342330+0000","last_clean":"2023-12-24T18:54:14.342330+0000","last_became_active":"2023-12-24T18:54:14.339767+0000","last_became_peered":"2023-12-24T18:54:14.339767+0000","last_unstale":"2023-12-24T18:54:14.342330+0000","last_undegraded":"2023-12-24T18:54:14.342330+0000","last_fullsized":"2023-12-24T18:54:14.342330+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:02.263214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.742589+0000","last_change":"2023-12-24T18:54:13.331517+0000","last_active":"2023-12-24T18:54:14.742589+0000","last_peered":"2023-12-24T18:54:14.742589+0000","last_clean":"2023-12-24T18:54:14.742589+0000","last_became_active":"2023-12-24T18:54:13.331071+0000","last_became_peered":"2023-12-24T18:54:13.331071+0000","last_unstale":"2023-12-24T18:54:14.742589+0000","last_undegraded":"2023-12-24T18:54:14.742589+0000","last_fullsized":"2023-12-24T18:54:14.742589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:55.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342568+0000","last_change":"2023-12-24T18:54:14.333302+0000","last_active":"2023-12-24T18:54:14.342568+0000","last_peered":"2023-12-24T18:54:14.342568+0000","last_clean":"2023-12-24T18:54:14.342568+0000","last_became_active":"2023-12-24T18:54:14.333014+0000","last_became_peered":"2023-12-24T18:54:14.333014+0000","last_unstale":"2023-12-24T18:54:14.342568+0000","last_undegraded":"2023-12-24T18:54:14.342568+0000","last_fullsized":"2023-12-24T18:54:14.342568+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:12:49.421142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.740776+0000","last_change":"2023-12-24T18:54:13.323677+0000","last_active":"2023-12-24T18:54:14.740776+0000","last_peered":"2023-12-24T18:54:14.740776+0000","last_clean":"2023-12-24T18:54:14.740776+0000","last_became_active":"2023-12-24T18:54:13.323362+0000","last_became_peered":"2023-12-24T18:54:13.323362+0000","last_unstale":"2023-12-24T18:54:14.740776+0000","last_undegraded":"2023-12-24T18:54:14.740776+0000","last_fullsized":"2023-12-24T18:54:14.740776+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:26.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.333696+0000","last_change":"2023-12-24T18:54:14.330695+0000","last_active":"2023-12-24T18:54:14.333696+0000","last_peered":"2023-12-24T18:54:14.333696+0000","last_clean":"2023-12-24T18:54:14.333696+0000","last_became_active":"2023-12-24T18:54:14.330413+0000","last_became_peered":"2023-12-24T18:54:14.330413+0000","last_unstale":"2023-12-24T18:54:14.333696+0000","last_undegraded":"2023-12-24T18:54:14.333696+0000","last_fullsized":"2023-12-24T18:54:14.333696+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:10:56.320111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.744931+0000","last_change":"2023-12-24T18:54:13.337465+0000","last_active":"2023-12-24T18:54:14.744931+0000","last_peered":"2023-12-24T18:54:14.744931+0000","last_clean":"2023-12-24T18:54:14.744931+0000","last_became_active":"2023-12-24T18:54:13.337040+0000","last_became_peered":"2023-12-24T18:54:13.337040+0000","last_unstale":"2023-12-24T18:54:14.744931+0000","last_undegraded":"2023-12-24T18:54:14.744931+0000","last_fullsized":"2023-12-24T18:54:14.744931+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:59:02.849979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347310+0000","last_change":"2023-12-24T18:54:14.342681+0000","last_active":"2023-12-24T18:54:14.347310+0000","last_peered":"2023-12-24T18:54:14.347310+0000","last_clean":"2023-12-24T18:54:14.347310+0000","last_became_active":"2023-12-24T18:54:14.342396+0000","last_became_peered":"2023-12-24T18:54:14.342396+0000","last_unstale":"2023-12-24T18:54:14.347310+0000","last_undegraded":"2023-12-24T18:54:14.347310+0000","last_fullsized":"2023-12-24T18:54:14.347310+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:25:34.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.741956+0000","last_change":"2023-12-24T18:54:13.330726+0000","last_active":"2023-12-24T18:54:14.741956+0000","last_peered":"2023-12-24T18:54:14.741956+0000","last_clean":"2023-12-24T18:54:14.741956+0000","last_became_active":"2023-12-24T18:54:13.330409+0000","last_became_peered":"2023-12-24T18:54:13.330409+0000","last_unstale":"2023-12-24T18:54:14.741956+0000","last_undegraded":"2023-12-24T18:54:14.741956+0000","last_fullsized":"2023-12-24T18:54:14.741956+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:34.264067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340566+0000","last_change":"2023-12-24T18:54:14.331661+0000","last_active":"2023-12-24T18:54:14.340566+0000","last_peered":"2023-12-24T18:54:14.340566+0000","last_clean":"2023-12-24T18:54:14.340566+0000","last_became_active":"2023-12-24T18:54:14.331271+0000","last_became_peered":"2023-12-24T18:54:14.331271+0000","last_unstale":"2023-12-24T18:54:14.340566+0000","last_undegraded":"2023-12-24T18:54:14.340566+0000","last_fullsized":"2023-12-24T18:54:14.340566+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:40.612401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.743185+0000","last_change":"2023-12-24T18:54:13.327122+0000","last_active":"2023-12-24T18:54:14.743185+0000","last_peered":"2023-12-24T18:54:14.743185+0000","last_clean":"2023-12-24T18:54:14.743185+0000","last_became_active":"2023-12-24T18:54:13.326766+0000","last_became_peered":"2023-12-24T18:54:13.326766+0000","last_unstale":"2023-12-24T18:54:14.743185+0000","last_undegraded":"2023-12-24T18:54:14.743185+0000","last_fullsized":"2023-12-24T18:54:14.743185+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:20.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329350+0000","last_change":"2023-12-24T18:54:14.322741+0000","last_active":"2023-12-24T18:54:14.329350+0000","last_peered":"2023-12-24T18:54:14.329350+0000","last_clean":"2023-12-24T18:54:14.329350+0000","last_became_active":"2023-12-24T18:54:14.322429+0000","last_became_peered":"2023-12-24T18:54:14.322429+0000","last_unstale":"2023-12-24T18:54:14.329350+0000","last_undegraded":"2023-12-24T18:54:14.329350+0000","last_fullsized":"2023-12-24T18:54:14.329350+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:20.695781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.309154+0000","last_change":"2023-12-24T18:54:13.318536+0000","last_active":"2023-12-24T18:54:14.309154+0000","last_peered":"2023-12-24T18:54:14.309154+0000","last_clean":"2023-12-24T18:54:14.309154+0000","last_became_active":"2023-12-24T18:54:13.318222+0000","last_became_peered":"2023-12-24T18:54:13.318222+0000","last_unstale":"2023-12-24T18:54:14.309154+0000","last_undegraded":"2023-12-24T18:54:14.309154+0000","last_fullsized":"2023-12-24T18:54:14.309154+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:00.124620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347018+0000","last_change":"2023-12-24T18:54:14.340238+0000","last_active":"2023-12-24T18:54:14.347018+0000","last_peered":"2023-12-24T18:54:14.347018+0000","last_clean":"2023-12-24T18:54:14.347018+0000","last_became_active":"2023-12-24T18:54:14.339791+0000","last_became_peered":"2023-12-24T18:54:14.339791+0000","last_unstale":"2023-12-24T18:54:14.347018+0000","last_undegraded":"2023-12-24T18:54:14.347018+0000","last_fullsized":"2023-12-24T18:54:14.347018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:28:56.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.319643+0000","last_change":"2023-12-24T18:54:13.334975+0000","last_active":"2023-12-24T18:54:14.319643+0000","last_peered":"2023-12-24T18:54:14.319643+0000","last_clean":"2023-12-24T18:54:14.319643+0000","last_became_active":"2023-12-24T18:54:13.334689+0000","last_became_peered":"2023-12-24T18:54:13.334689+0000","last_unstale":"2023-12-24T18:54:14.319643+0000","last_undegraded":"2023-12-24T18:54:14.319643+0000","last_fullsized":"2023-12-24T18:54:14.319643+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:03.650927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340342+0000","last_change":"2023-12-24T18:54:14.329593+0000","last_active":"2023-12-24T18:54:14.340342+0000","last_peered":"2023-12-24T18:54:14.340342+0000","last_clean":"2023-12-24T18:54:14.340342+0000","last_became_active":"2023-12-24T18:54:14.329316+0000","last_became_peered":"2023-12-24T18:54:14.329316+0000","last_unstale":"2023-12-24T18:54:14.340342+0000","last_undegraded":"2023-12-24T18:54:14.340342+0000","last_fullsized":"2023-12-24T18:54:14.340342+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:29.498198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.313863+0000","last_change":"2023-12-24T18:54:13.322515+0000","last_active":"2023-12-24T18:54:14.313863+0000","last_peered":"2023-12-24T18:54:14.313863+0000","last_clean":"2023-12-24T18:54:14.313863+0000","last_became_active":"2023-12-24T18:54:13.321934+0000","last_became_peered":"2023-12-24T18:54:13.321934+0000","last_unstale":"2023-12-24T18:54:14.313863+0000","last_undegraded":"2023-12-24T18:54:14.313863+0000","last_fullsized":"2023-12-24T18:54:14.313863+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:08.655221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.336414+0000","last_change":"2023-12-24T18:54:14.333336+0000","last_active":"2023-12-24T18:54:14.336414+0000","last_peered":"2023-12-24T18:54:14.336414+0000","last_clean":"2023-12-24T18:54:14.336414+0000","last_became_active":"2023-12-24T18:54:14.333030+0000","last_became_peered":"2023-12-24T18:54:14.333030+0000","last_unstale":"2023-12-24T18:54:14.336414+0000","last_undegraded":"2023-12-24T18:54:14.336414+0000","last_fullsized":"2023-12-24T18:54:14.336414+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:33:12.830049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.328143+0000","last_change":"2023-12-24T18:54:13.332270+0000","last_active":"2023-12-24T18:54:14.328143+0000","last_peered":"2023-12-24T18:54:14.328143+0000","last_clean":"2023-12-24T18:54:14.328143+0000","last_became_active":"2023-12-24T18:54:13.331565+0000","last_became_peered":"2023-12-24T18:54:13.331565+0000","last_unstale":"2023-12-24T18:54:14.328143+0000","last_undegraded":"2023-12-24T18:54:14.328143+0000","last_fullsized":"2023-12-24T18:54:14.328143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:06.292781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.348319+0000","last_change":"2023-12-24T18:54:14.346256+0000","last_active":"2023-12-24T18:54:14.348319+0000","last_peered":"2023-12-24T18:54:14.348319+0000","last_clean":"2023-12-24T18:54:14.348319+0000","last_became_active":"2023-12-24T18:54:14.337603+0000","last_became_peered":"2023-12-24T18:54:14.337603+0000","last_unstale":"2023-12-24T18:54:14.348319+0000","last_undegraded":"2023-12-24T18:54:14.348319+0000","last_fullsized":"2023-12-24T18:54:14.348319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:19.302517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"124'3","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.740826+0000","last_change":"2023-12-24T18:54:13.329503+0000","last_active":"2023-12-24T18:54:14.740826+0000","last_peered":"2023-12-24T18:54:14.740826+0000","last_clean":"2023-12-24T18:54:14.740826+0000","last_became_active":"2023-12-24T18:54:13.328735+0000","last_became_peered":"2023-12-24T18:54:13.328735+0000","last_unstale":"2023-12-24T18:54:14.740826+0000","last_undegraded":"2023-12-24T18:54:14.740826+0000","last_fullsized":"2023-12-24T18:54:14.740826+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:26.506662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342150+0000","last_change":"2023-12-24T18:54:14.338908+0000","last_active":"2023-12-24T18:54:14.342150+0000","last_peered":"2023-12-24T18:54:14.342150+0000","last_clean":"2023-12-24T18:54:14.342150+0000","last_became_active":"2023-12-24T18:54:14.338640+0000","last_became_peered":"2023-12-24T18:54:14.338640+0000","last_unstale":"2023-12-24T18:54:14.342150+0000","last_undegraded":"2023-12-24T18:54:14.342150+0000","last_fullsized":"2023-12-24T18:54:14.342150+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:12:46.197890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"124'6","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.744743+0000","last_change":"2023-12-24T18:54:13.324643+0000","last_active":"2023-12-24T18:54:14.744743+0000","last_peered":"2023-12-24T18:54:14.744743+0000","last_clean":"2023-12-24T18:54:14.744743+0000","last_became_active":"2023-12-24T18:54:13.323865+0000","last_became_peered":"2023-12-24T18:54:13.323865+0000","last_unstale":"2023-12-24T18:54:14.744743+0000","last_undegraded":"2023-12-24T18:54:14.744743+0000","last_fullsized":"2023-12-24T18:54:14.744743+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:43.094509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.335966+0000","last_change":"2023-12-24T18:54:14.331302+0000","last_active":"2023-12-24T18:54:14.335966+0000","last_peered":"2023-12-24T18:54:14.335966+0000","last_clean":"2023-12-24T18:54:14.335966+0000","last_became_active":"2023-12-24T18:54:14.330983+0000","last_became_peered":"2023-12-24T18:54:14.330983+0000","last_unstale":"2023-12-24T18:54:14.335966+0000","last_undegraded":"2023-12-24T18:54:14.335966+0000","last_fullsized":"2023-12-24T18:54:14.335966+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:27.809189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.743005+0000","last_change":"2023-12-24T18:54:13.335097+0000","last_active":"2023-12-24T18:54:14.743005+0000","last_peered":"2023-12-24T18:54:14.743005+0000","last_clean":"2023-12-24T18:54:14.743005+0000","last_became_active":"2023-12-24T18:54:13.334744+0000","last_became_peered":"2023-12-24T18:54:13.334744+0000","last_unstale":"2023-12-24T18:54:14.743005+0000","last_undegraded":"2023-12-24T18:54:14.743005+0000","last_fullsized":"2023-12-24T18:54:14.743005+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:43.387992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.326653+0000","last_change":"2023-12-24T18:54:14.323640+0000","last_active":"2023-12-24T18:54:14.326653+0000","last_peered":"2023-12-24T18:54:14.326653+0000","last_clean":"2023-12-24T18:54:14.326653+0000","last_became_active":"2023-12-24T18:54:14.323381+0000","last_became_peered":"2023-12-24T18:54:14.323381+0000","last_unstale":"2023-12-24T18:54:14.326653+0000","last_undegraded":"2023-12-24T18:54:14.326653+0000","last_fullsized":"2023-12-24T18:54:14.326653+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:09:05.565145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.320006+0000","last_change":"2023-12-24T18:54:13.333358+0000","last_active":"2023-12-24T18:54:14.320006+0000","last_peered":"2023-12-24T18:54:14.320006+0000","last_clean":"2023-12-24T18:54:14.320006+0000","last_became_active":"2023-12-24T18:54:13.333005+0000","last_became_peered":"2023-12-24T18:54:13.333005+0000","last_unstale":"2023-12-24T18:54:14.320006+0000","last_undegraded":"2023-12-24T18:54:14.320006+0000","last_fullsized":"2023-12-24T18:54:14.320006+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:45.723233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.327210+0000","last_change":"2023-12-24T18:54:14.324319+0000","last_active":"2023-12-24T18:54:14.327210+0000","last_peered":"2023-12-24T18:54:14.327210+0000","last_clean":"2023-12-24T18:54:14.327210+0000","last_became_active":"2023-12-24T18:54:14.322439+0000","last_became_peered":"2023-12-24T18:54:14.322439+0000","last_unstale":"2023-12-24T18:54:14.327210+0000","last_undegraded":"2023-12-24T18:54:14.327210+0000","last_fullsized":"2023-12-24T18:54:14.327210+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:01:23.839802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.310923+0000","last_change":"2023-12-24T18:54:13.333253+0000","last_active":"2023-12-24T18:54:14.310923+0000","last_peered":"2023-12-24T18:54:14.310923+0000","last_clean":"2023-12-24T18:54:14.310923+0000","last_became_active":"2023-12-24T18:54:13.330613+0000","last_became_peered":"2023-12-24T18:54:13.330613+0000","last_unstale":"2023-12-24T18:54:14.310923+0000","last_undegraded":"2023-12-24T18:54:14.310923+0000","last_fullsized":"2023-12-24T18:54:14.310923+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:40.902341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.343553+0000","last_change":"2023-12-24T18:54:14.338899+0000","last_active":"2023-12-24T18:54:14.343553+0000","last_peered":"2023-12-24T18:54:14.343553+0000","last_clean":"2023-12-24T18:54:14.343553+0000","last_became_active":"2023-12-24T18:54:14.337369+0000","last_became_peered":"2023-12-24T18:54:14.337369+0000","last_unstale":"2023-12-24T18:54:14.343553+0000","last_undegraded":"2023-12-24T18:54:14.343553+0000","last_fullsized":"2023-12-24T18:54:14.343553+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:35:30.353839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"124'8","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.743703+0000","last_change":"2023-12-24T18:54:13.321196+0000","last_active":"2023-12-24T18:54:14.743703+0000","last_peered":"2023-12-24T18:54:14.743703+0000","last_clean":"2023-12-24T18:54:14.743703+0000","last_became_active":"2023-12-24T18:54:13.320862+0000","last_became_peered":"2023-12-24T18:54:13.320862+0000","last_unstale":"2023-12-24T18:54:14.743703+0000","last_undegraded":"2023-12-24T18:54:14.743703+0000","last_fullsized":"2023-12-24T18:54:14.743703+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:40:22.369266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.333490+0000","last_change":"2023-12-24T18:54:14.329325+0000","last_active":"2023-12-24T18:54:14.333490+0000","last_peered":"2023-12-24T18:54:14.333490+0000","last_clean":"2023-12-24T18:54:14.333490+0000","last_became_active":"2023-12-24T18:54:14.329020+0000","last_became_peered":"2023-12-24T18:54:14.329020+0000","last_unstale":"2023-12-24T18:54:14.333490+0000","last_undegraded":"2023-12-24T18:54:14.333490+0000","last_fullsized":"2023-12-24T18:54:14.333490+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:58:44.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.742700+0000","last_change":"2023-12-24T18:54:13.323986+0000","last_active":"2023-12-24T18:54:14.742700+0000","last_peered":"2023-12-24T18:54:14.742700+0000","last_clean":"2023-12-24T18:54:14.742700+0000","last_became_active":"2023-12-24T18:54:13.323470+0000","last_became_peered":"2023-12-24T18:54:13.323470+0000","last_unstale":"2023-12-24T18:54:14.742700+0000","last_undegraded":"2023-12-24T18:54:14.742700+0000","last_fullsized":"2023-12-24T18:54:14.742700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:26.788249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329059+0000","last_change":"2023-12-24T18:54:14.326452+0000","last_active":"2023-12-24T18:54:14.329059+0000","last_peered":"2023-12-24T18:54:14.329059+0000","last_clean":"2023-12-24T18:54:14.329059+0000","last_became_active":"2023-12-24T18:54:14.325958+0000","last_became_peered":"2023-12-24T18:54:14.325958+0000","last_unstale":"2023-12-24T18:54:14.329059+0000","last_undegraded":"2023-12-24T18:54:14.329059+0000","last_fullsized":"2023-12-24T18:54:14.329059+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:44.403595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.742323+0000","last_change":"2023-12-24T18:54:13.329740+0000","last_active":"2023-12-24T18:54:14.742323+0000","last_peered":"2023-12-24T18:54:14.742323+0000","last_clean":"2023-12-24T18:54:14.742323+0000","last_became_active":"2023-12-24T18:54:13.329157+0000","last_became_peered":"2023-12-24T18:54:13.329157+0000","last_unstale":"2023-12-24T18:54:14.742323+0000","last_undegraded":"2023-12-24T18:54:14.742323+0000","last_fullsized":"2023-12-24T18:54:14.742323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:17.945104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.346561+0000","last_change":"2023-12-24T18:54:14.341995+0000","last_active":"2023-12-24T18:54:14.346561+0000","last_peered":"2023-12-24T18:54:14.346561+0000","last_clean":"2023-12-24T18:54:14.346561+0000","last_became_active":"2023-12-24T18:54:14.341638+0000","last_became_peered":"2023-12-24T18:54:14.341638+0000","last_unstale":"2023-12-24T18:54:14.346561+0000","last_undegraded":"2023-12-24T18:54:14.346561+0000","last_fullsized":"2023-12-24T18:54:14.346561+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:51:31.077237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.324829+0000","last_change":"2023-12-24T18:54:13.318169+0000","last_active":"2023-12-24T18:54:14.324829+0000","last_peered":"2023-12-24T18:54:14.324829+0000","last_clean":"2023-12-24T18:54:14.324829+0000","last_became_active":"2023-12-24T18:54:13.317061+0000","last_became_peered":"2023-12-24T18:54:13.317061+0000","last_unstale":"2023-12-24T18:54:14.324829+0000","last_undegraded":"2023-12-24T18:54:14.324829+0000","last_fullsized":"2023-12-24T18:54:14.324829+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:19.745218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340848+0000","last_change":"2023-12-24T18:54:14.332277+0000","last_active":"2023-12-24T18:54:14.340848+0000","last_peered":"2023-12-24T18:54:14.340848+0000","last_clean":"2023-12-24T18:54:14.340848+0000","last_became_active":"2023-12-24T18:54:14.331933+0000","last_became_peered":"2023-12-24T18:54:14.331933+0000","last_unstale":"2023-12-24T18:54:14.340848+0000","last_undegraded":"2023-12-24T18:54:14.340848+0000","last_fullsized":"2023-12-24T18:54:14.340848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:06:16.231679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.741904+0000","last_change":"2023-12-24T18:54:13.320348+0000","last_active":"2023-12-24T18:54:14.741904+0000","last_peered":"2023-12-24T18:54:14.741904+0000","last_clean":"2023-12-24T18:54:14.741904+0000","last_became_active":"2023-12-24T18:54:13.319930+0000","last_became_peered":"2023-12-24T18:54:13.319930+0000","last_unstale":"2023-12-24T18:54:14.741904+0000","last_undegraded":"2023-12-24T18:54:14.741904+0000","last_fullsized":"2023-12-24T18:54:14.741904+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:31.731387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342863+0000","last_change":"2023-12-24T18:54:14.337098+0000","last_active":"2023-12-24T18:54:14.342863+0000","last_peered":"2023-12-24T18:54:14.342863+0000","last_clean":"2023-12-24T18:54:14.342863+0000","last_became_active":"2023-12-24T18:54:14.336795+0000","last_became_peered":"2023-12-24T18:54:14.336795+0000","last_unstale":"2023-12-24T18:54:14.342863+0000","last_undegraded":"2023-12-24T18:54:14.342863+0000","last_fullsized":"2023-12-24T18:54:14.342863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:02.717499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.310263+0000","last_change":"2023-12-24T18:54:13.331953+0000","last_active":"2023-12-24T18:54:14.310263+0000","last_peered":"2023-12-24T18:54:14.310263+0000","last_clean":"2023-12-24T18:54:14.310263+0000","last_became_active":"2023-12-24T18:54:13.330644+0000","last_became_peered":"2023-12-24T18:54:13.330644+0000","last_unstale":"2023-12-24T18:54:14.310263+0000","last_undegraded":"2023-12-24T18:54:14.310263+0000","last_fullsized":"2023-12-24T18:54:14.310263+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:13:57.464823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.330799+0000","last_change":"2023-12-24T18:54:14.321665+0000","last_active":"2023-12-24T18:54:14.330799+0000","last_peered":"2023-12-24T18:54:14.330799+0000","last_clean":"2023-12-24T18:54:14.330799+0000","last_became_active":"2023-12-24T18:54:14.321335+0000","last_became_peered":"2023-12-24T18:54:14.321335+0000","last_unstale":"2023-12-24T18:54:14.330799+0000","last_undegraded":"2023-12-24T18:54:14.330799+0000","last_fullsized":"2023-12-24T18:54:14.330799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:46:28.903975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.309210+0000","last_change":"2023-12-24T18:54:13.333136+0000","last_active":"2023-12-24T18:54:14.309210+0000","last_peered":"2023-12-24T18:54:14.309210+0000","last_clean":"2023-12-24T18:54:14.309210+0000","last_became_active":"2023-12-24T18:54:13.332776+0000","last_became_peered":"2023-12-24T18:54:13.332776+0000","last_unstale":"2023-12-24T18:54:14.309210+0000","last_undegraded":"2023-12-24T18:54:14.309210+0000","last_fullsized":"2023-12-24T18:54:14.309210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:57.577205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342344+0000","last_change":"2023-12-24T18:54:14.340217+0000","last_active":"2023-12-24T18:54:14.342344+0000","last_peered":"2023-12-24T18:54:14.342344+0000","last_clean":"2023-12-24T18:54:14.342344+0000","last_became_active":"2023-12-24T18:54:14.337233+0000","last_became_peered":"2023-12-24T18:54:14.337233+0000","last_unstale":"2023-12-24T18:54:14.342344+0000","last_undegraded":"2023-12-24T18:54:14.342344+0000","last_fullsized":"2023-12-24T18:54:14.342344+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:44:05.330673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.311619+0000","last_change":"2023-12-24T18:54:13.322220+0000","last_active":"2023-12-24T18:54:14.311619+0000","last_peered":"2023-12-24T18:54:14.311619+0000","last_clean":"2023-12-24T18:54:14.311619+0000","last_became_active":"2023-12-24T18:54:13.320466+0000","last_became_peered":"2023-12-24T18:54:13.320466+0000","last_unstale":"2023-12-24T18:54:14.311619+0000","last_undegraded":"2023-12-24T18:54:14.311619+0000","last_fullsized":"2023-12-24T18:54:14.311619+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:57.138764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340609+0000","last_change":"2023-12-24T18:54:14.331959+0000","last_active":"2023-12-24T18:54:14.340609+0000","last_peered":"2023-12-24T18:54:14.340609+0000","last_clean":"2023-12-24T18:54:14.340609+0000","last_became_active":"2023-12-24T18:54:14.331651+0000","last_became_peered":"2023-12-24T18:54:14.331651+0000","last_unstale":"2023-12-24T18:54:14.340609+0000","last_undegraded":"2023-12-24T18:54:14.340609+0000","last_fullsized":"2023-12-24T18:54:14.340609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:02:04.321877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.742373+0000","last_change":"2023-12-24T18:54:13.338780+0000","last_active":"2023-12-24T18:54:14.742373+0000","last_peered":"2023-12-24T18:54:14.742373+0000","last_clean":"2023-12-24T18:54:14.742373+0000","last_became_active":"2023-12-24T18:54:13.337932+0000","last_became_peered":"2023-12-24T18:54:13.337932+0000","last_unstale":"2023-12-24T18:54:14.742373+0000","last_undegraded":"2023-12-24T18:54:14.742373+0000","last_fullsized":"2023-12-24T18:54:14.742373+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:19.680179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.341152+0000","last_change":"2023-12-24T18:54:14.331499+0000","last_active":"2023-12-24T18:54:14.341152+0000","last_peered":"2023-12-24T18:54:14.341152+0000","last_clean":"2023-12-24T18:54:14.341152+0000","last_became_active":"2023-12-24T18:54:14.331191+0000","last_became_peered":"2023-12-24T18:54:14.331191+0000","last_unstale":"2023-12-24T18:54:14.341152+0000","last_undegraded":"2023-12-24T18:54:14.341152+0000","last_fullsized":"2023-12-24T18:54:14.341152+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:59.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.328253+0000","last_change":"2023-12-24T18:54:13.326369+0000","last_active":"2023-12-24T18:54:14.328253+0000","last_peered":"2023-12-24T18:54:14.328253+0000","last_clean":"2023-12-24T18:54:14.328253+0000","last_became_active":"2023-12-24T18:54:13.326093+0000","last_became_peered":"2023-12-24T18:54:13.326093+0000","last_unstale":"2023-12-24T18:54:14.328253+0000","last_undegraded":"2023-12-24T18:54:14.328253+0000","last_fullsized":"2023-12-24T18:54:14.328253+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:28:55.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.329963+0000","last_change":"2023-12-24T18:54:14.323642+0000","last_active":"2023-12-24T18:54:14.329963+0000","last_peered":"2023-12-24T18:54:14.329963+0000","last_clean":"2023-12-24T18:54:14.329963+0000","last_became_active":"2023-12-24T18:54:14.323321+0000","last_became_peered":"2023-12-24T18:54:14.323321+0000","last_unstale":"2023-12-24T18:54:14.329963+0000","last_undegraded":"2023-12-24T18:54:14.329963+0000","last_fullsized":"2023-12-24T18:54:14.329963+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:07.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.312421+0000","last_change":"2023-12-24T18:54:13.324184+0000","last_active":"2023-12-24T18:54:14.312421+0000","last_peered":"2023-12-24T18:54:14.312421+0000","last_clean":"2023-12-24T18:54:14.312421+0000","last_became_active":"2023-12-24T18:54:13.323810+0000","last_became_peered":"2023-12-24T18:54:13.323810+0000","last_unstale":"2023-12-24T18:54:14.312421+0000","last_undegraded":"2023-12-24T18:54:14.312421+0000","last_fullsized":"2023-12-24T18:54:14.312421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:39.506603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340206+0000","last_change":"2023-12-24T18:54:14.339115+0000","last_active":"2023-12-24T18:54:14.340206+0000","last_peered":"2023-12-24T18:54:14.340206+0000","last_clean":"2023-12-24T18:54:14.340206+0000","last_became_active":"2023-12-24T18:54:14.338787+0000","last_became_peered":"2023-12-24T18:54:14.338787+0000","last_unstale":"2023-12-24T18:54:14.340206+0000","last_undegraded":"2023-12-24T18:54:14.340206+0000","last_fullsized":"2023-12-24T18:54:14.340206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:25:58.649035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.330426+0000","last_change":"2023-12-24T18:54:13.333742+0000","last_active":"2023-12-24T18:54:14.330426+0000","last_peered":"2023-12-24T18:54:14.330426+0000","last_clean":"2023-12-24T18:54:14.330426+0000","last_became_active":"2023-12-24T18:54:13.332773+0000","last_became_peered":"2023-12-24T18:54:13.332773+0000","last_unstale":"2023-12-24T18:54:14.330426+0000","last_undegraded":"2023-12-24T18:54:14.330426+0000","last_fullsized":"2023-12-24T18:54:14.330426+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:31:46.919835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347609+0000","last_change":"2023-12-24T18:54:14.344249+0000","last_active":"2023-12-24T18:54:14.347609+0000","last_peered":"2023-12-24T18:54:14.347609+0000","last_clean":"2023-12-24T18:54:14.347609+0000","last_became_active":"2023-12-24T18:54:14.337478+0000","last_became_peered":"2023-12-24T18:54:14.337478+0000","last_unstale":"2023-12-24T18:54:14.347609+0000","last_undegraded":"2023-12-24T18:54:14.347609+0000","last_fullsized":"2023-12-24T18:54:14.347609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:40.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.309871+0000","last_change":"2023-12-24T18:54:13.319612+0000","last_active":"2023-12-24T18:54:14.309871+0000","last_peered":"2023-12-24T18:54:14.309871+0000","last_clean":"2023-12-24T18:54:14.309871+0000","last_became_active":"2023-12-24T18:54:13.319290+0000","last_became_peered":"2023-12-24T18:54:13.319290+0000","last_unstale":"2023-12-24T18:54:14.309871+0000","last_undegraded":"2023-12-24T18:54:14.309871+0000","last_fullsized":"2023-12-24T18:54:14.309871+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:51:30.061635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.347877+0000","last_change":"2023-12-24T18:54:14.345016+0000","last_active":"2023-12-24T18:54:14.347877+0000","last_peered":"2023-12-24T18:54:14.347877+0000","last_clean":"2023-12-24T18:54:14.347877+0000","last_became_active":"2023-12-24T18:54:14.338239+0000","last_became_peered":"2023-12-24T18:54:14.338239+0000","last_unstale":"2023-12-24T18:54:14.347877+0000","last_undegraded":"2023-12-24T18:54:14.347877+0000","last_fullsized":"2023-12-24T18:54:14.347877+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:12.259846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.311194+0000","last_change":"2023-12-24T18:54:13.328646+0000","last_active":"2023-12-24T18:54:14.311194+0000","last_peered":"2023-12-24T18:54:14.311194+0000","last_clean":"2023-12-24T18:54:14.311194+0000","last_became_active":"2023-12-24T18:54:13.328352+0000","last_became_peered":"2023-12-24T18:54:13.328352+0000","last_unstale":"2023-12-24T18:54:14.311194+0000","last_undegraded":"2023-12-24T18:54:14.311194+0000","last_fullsized":"2023-12-24T18:54:14.311194+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:44.413169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.340793+0000","last_change":"2023-12-24T18:54:14.339869+0000","last_active":"2023-12-24T18:54:14.340793+0000","last_peered":"2023-12-24T18:54:14.340793+0000","last_clean":"2023-12-24T18:54:14.340793+0000","last_became_active":"2023-12-24T18:54:14.339517+0000","last_became_peered":"2023-12-24T18:54:14.339517+0000","last_unstale":"2023-12-24T18:54:14.340793+0000","last_undegraded":"2023-12-24T18:54:14.340793+0000","last_fullsized":"2023-12-24T18:54:14.340793+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:09.670824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.309410+0000","last_change":"2023-12-24T18:54:13.323917+0000","last_active":"2023-12-24T18:54:14.309410+0000","last_peered":"2023-12-24T18:54:14.309410+0000","last_clean":"2023-12-24T18:54:14.309410+0000","last_became_active":"2023-12-24T18:54:13.323612+0000","last_became_peered":"2023-12-24T18:54:13.323612+0000","last_unstale":"2023-12-24T18:54:14.309410+0000","last_undegraded":"2023-12-24T18:54:14.309410+0000","last_fullsized":"2023-12-24T18:54:14.309410+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:39:35.037395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.342259+0000","last_change":"2023-12-24T18:54:14.340635+0000","last_active":"2023-12-24T18:54:14.342259+0000","last_peered":"2023-12-24T18:54:14.342259+0000","last_clean":"2023-12-24T18:54:14.342259+0000","last_became_active":"2023-12-24T18:54:14.340342+0000","last_became_peered":"2023-12-24T18:54:14.340342+0000","last_unstale":"2023-12-24T18:54:14.342259+0000","last_undegraded":"2023-12-24T18:54:14.342259+0000","last_fullsized":"2023-12-24T18:54:14.342259+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:36:54.693186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.311856+0000","last_change":"2023-12-24T18:54:13.332260+0000","last_active":"2023-12-24T18:54:14.311856+0000","last_peered":"2023-12-24T18:54:14.311856+0000","last_clean":"2023-12-24T18:54:14.311856+0000","last_became_active":"2023-12-24T18:54:13.331196+0000","last_became_peered":"2023-12-24T18:54:13.331196+0000","last_unstale":"2023-12-24T18:54:14.311856+0000","last_undegraded":"2023-12-24T18:54:14.311856+0000","last_fullsized":"2023-12-24T18:54:14.311856+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:16.256153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.338916+0000","last_change":"2023-12-24T18:54:14.335899+0000","last_active":"2023-12-24T18:54:14.338916+0000","last_peered":"2023-12-24T18:54:14.338916+0000","last_clean":"2023-12-24T18:54:14.338916+0000","last_became_active":"2023-12-24T18:54:14.335012+0000","last_became_peered":"2023-12-24T18:54:14.335012+0000","last_unstale":"2023-12-24T18:54:14.338916+0000","last_undegraded":"2023-12-24T18:54:14.338916+0000","last_fullsized":"2023-12-24T18:54:14.338916+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:13.285003+0000","last_clean_scrub_stamp":"2023-12-24T18:54:13.285003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:49:01.140223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.742612+0000","last_change":"2023-12-24T18:54:13.330974+0000","last_active":"2023-12-24T18:54:14.742612+0000","last_peered":"2023-12-24T18:54:14.742612+0000","last_clean":"2023-12-24T18:54:14.742612+0000","last_became_active":"2023-12-24T18:54:13.330628+0000","last_became_peered":"2023-12-24T18:54:13.330628+0000","last_unstale":"2023-12-24T18:54:14.742612+0000","last_undegraded":"2023-12-24T18:54:14.742612+0000","last_fullsized":"2023-12-24T18:54:14.742612+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:54:12.269400+0000","last_clean_scrub_stamp":"2023-12-24T18:54:12.269400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:32:23.647776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"114'227","reported_seq":635,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-12-24T18:54:14.325646+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:54:14.325646+0000","last_peered":"2023-12-24T18:54:14.325646+0000","last_clean":"2023-12-24T18:54:14.325646+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:54:14.325646+0000","last_undegraded":"2023-12-24T18:54:14.325646+0000","last_fullsized":"2023-12-24T18:54:14.325646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311664,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060176,"statfs":{"total":96636764160,"available":96317620224,"internally_reserved":0,"allocated":2138112,"data_stored":1375033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.119,"15min":1.1299999999999999},"min":{"1min":0.76300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.784},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.147,"15min":1.167},"min":{"1min":0.90300000000000002,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.6910000000000001,"5min":1.756,"15min":1.756},"last":1.639}]},{"osd":1,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.115,"15min":1.133},"min":{"1min":0.90600000000000003,"5min":0.82099999999999995,"15min":0.72299999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.92500000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.518,"5min":1.7230000000000001,"15min":1.8129999999999999},"last":1.3500000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1919999999999999,"15min":1.2050000000000001},"min":{"1min":0.80000000000000004,"5min":0.63,"15min":0.59299999999999997},"max":{"1min":1.55,"5min":1.5620000000000001,"15min":1.625},"last":1.03},{"interface":"front","average":{"1min":1.228,"5min":1.1899999999999999,"15min":1.216},"min":{"1min":0.88200000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.54,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.4219999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2589999999999999,"15min":1.276},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.264,"15min":1.282},"min":{"1min":0.99299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5840000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.94899999999999995}]},{"osd":4,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.202,"15min":1.167},"min":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.7230000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.512},{"interface":"front","average":{"1min":1.147,"5min":1.246,"15min":1.2589999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"max":{"1min":1.6719999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.325}]},{"osd":5,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2669999999999999,"15min":1.2729999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5549999999999999,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.575},{"interface":"front","average":{"1min":1.365,"5min":1.3400000000000001,"15min":1.3260000000000001},"min":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.68600000000000005},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.7549999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:53:50 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.4139999999999999},"min":{"1min":1.0529999999999999,"5min":0.99399999999999999,"15min":0.86399999999999999},"max":{"1min":1.637,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.8100000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.3999999999999999,"15min":1.415},"min":{"1min":0.93000000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7190000000000001,"5min":1.917,"15min":1.917},"last":1.615}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307012,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064828,"statfs":{"total":96636764160,"available":96322383872,"internally_reserved":0,"allocated":1568768,"data_stored":793601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2529999999999999},"min":{"1min":0.84799999999999998,"5min":0.68400000000000005,"15min":0.47799999999999998},"max":{"1min":1.905,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.375,"15min":1.3220000000000001},"min":{"1min":0.84099999999999997,"5min":0.79700000000000004,"15min":0.71299999999999997},"max":{"1min":3.097,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.272}]},{"osd":1,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.143,"15min":1.1639999999999999},"min":{"1min":0.89500000000000002,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.659,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2370000000000001,"15min":1.2070000000000001},"min":{"1min":0.83599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0230000000000001,"5min":3.081,"15min":3.081},"last":0.93799999999999994}]},{"osd":2,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.147,"15min":1.1599999999999999},"min":{"1min":0.78500000000000003,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5649999999999999,"5min":2.173,"15min":2.173},"last":1.091},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.2589999999999999,"15min":1.238},"min":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":1.5620000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.3240000000000001,"15min":1.2809999999999999},"min":{"1min":0.84699999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":4.3710000000000004,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.135},{"interface":"front","average":{"1min":1.323,"5min":1.296,"15min":1.2589999999999999},"min":{"1min":1.0549999999999999,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":2,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.216}]},{"osd":4,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2050000000000001,"15min":1.181},"min":{"1min":0.747,"5min":0.55900000000000005,"15min":0.53100000000000003},"max":{"1min":1.77,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.298,"15min":1.238},"min":{"1min":0.71499999999999997,"5min":0.66500000000000004,"15min":0.65200000000000002},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.373}]},{"osd":5,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2070000000000001,"15min":1.2},"min":{"1min":0.84599999999999997,"5min":0.73099999999999998,"15min":0.59399999999999997},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.409},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.3859999999999999,"15min":1.3380000000000001},"min":{"1min":0.94099999999999995,"5min":0.76200000000000001,"15min":0.622},"max":{"1min":4.2169999999999996,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.681}]},{"osd":7,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.4079999999999999,"15min":1.3660000000000001},"min":{"1min":1.1120000000000001,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.393,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.5269999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575062,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302896,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068944,"statfs":{"total":96636764160,"available":96326598656,"internally_reserved":0,"allocated":1548288,"data_stored":791489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.169,"15min":1.1970000000000001},"min":{"1min":0.56999999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5049999999999999,"5min":1.609,"15min":1.752},"last":1.363},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3,"15min":1.302},"min":{"1min":0.629,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.839,"15min":1.859},"last":1.4279999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.113,"15min":1.1459999999999999},"min":{"1min":0.98399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.476,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.379},{"interface":"front","average":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1539999999999999},"min":{"1min":0.80000000000000004,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":1.409,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.292}]},{"osd":2,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.224,"15min":1.2090000000000001},"min":{"1min":0.82999999999999996,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.012},{"interface":"front","average":{"1min":1.258,"5min":1.2210000000000001,"15min":1.23},"min":{"1min":0.99299999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4279999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0660000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.90400000000000003,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7170000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.276,"15min":1.304},"min":{"1min":1.008,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5600000000000001,"5min":1.706,"15min":1.786},"last":1.254}]},{"osd":4,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1679999999999999,"15min":1.143},"min":{"1min":0.91300000000000003,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.546,"5min":1.861,"15min":1.861},"last":1.165},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.248},"min":{"1min":0.83799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.597,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.1220000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.25,"15min":1.272},"min":{"1min":0.87,"5min":0.76400000000000001,"15min":0.61699999999999999},"max":{"1min":1.673,"5min":1.861,"15min":1.909},"last":1.466},{"interface":"front","average":{"1min":1.252,"5min":1.276,"15min":1.2989999999999999},"min":{"1min":0.90600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5920000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.96899999999999997}]},{"osd":7,"last update":"Sun Dec 24 18:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.383,"15min":1.389},"min":{"1min":1.0649999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.659,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.407},"min":{"1min":0.97499999999999998,"5min":0.92700000000000005,"15min":0.64600000000000002},"max":{"1min":1.617,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.522}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307000,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064840,"statfs":{"total":96636764160,"available":96322396160,"internally_reserved":0,"allocated":1556480,"data_stored":791581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.73899999999999999,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.607,"5min":1.835,"15min":1.835},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.88300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.0409999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.123,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.4650000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5029999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2949999999999999,"15min":1.302},"min":{"1min":0.88400000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5900000000000001,"5min":1.952,"15min":1.952},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":1.0549999999999999,"5min":0.73299999999999998,"15min":0.69699999999999995},"max":{"1min":1.6140000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2350000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1759999999999999,"15min":1.1779999999999999},"min":{"1min":0.91200000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6439999999999999,"5min":1.714,"15min":1.736},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2629999999999999,"15min":1.2749999999999999},"min":{"1min":0.94199999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.839},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.252,"15min":1.2490000000000001},"min":{"1min":0.79700000000000004,"5min":0.64300000000000002,"15min":0.623},"max":{"1min":1.5189999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.298},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3200000000000001,"15min":1.3029999999999999},"min":{"1min":0.77400000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6739999999999999,"5min":1.831,"15min":1.8640000000000001},"last":0.878}]},{"osd":6,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.85099999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.714,"5min":1.823,"15min":1.881},"last":1.333},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.335,"15min":1.3169999999999999},"min":{"1min":0.98099999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6020000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3839999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:53:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.319,"15min":1.2969999999999999},"min":{"1min":0.92500000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.6419999999999999,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.4219999999999999,"15min":1.397},"min":{"1min":1.0549999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8220000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.4019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306984,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064856,"statfs":{"total":96636764160,"available":96322412544,"internally_reserved":0,"allocated":1540096,"data_stored":785059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3300000000000001,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.143,"15min":1.093},"min":{"1min":0.86799999999999999,"5min":0.61799999999999999,"15min":0.46000000000000002},"max":{"1min":1.3620000000000001,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.181}]},{"osd":1,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.996,"15min":1.022},"min":{"1min":0.68100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1699999999999999,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.571,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.2350000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0800000000000001,"15min":1.103},"min":{"1min":0.80200000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.468,"5min":2.363,"15min":2.363},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.1559999999999999,"15min":1.1599999999999999},"min":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5129999999999999,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":1.04}]},{"osd":4,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.276,"15min":1.2609999999999999},"min":{"1min":0.875,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.6579999999999999,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.331},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3100000000000001,"15min":1.3320000000000001},"min":{"1min":0.80500000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6910000000000001,"5min":2.944,"15min":2.944},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3680000000000001,"15min":1.387},"min":{"1min":1.147,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8300000000000001,"5min":2.516,"15min":2.516},"last":1.585},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4550000000000001,"15min":1.4319999999999999},"min":{"1min":1.0680000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.786,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.3879999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.462,"15min":1.466},"min":{"1min":1.056,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.6120000000000001,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.53},{"interface":"front","average":{"1min":1.292,"5min":1.423,"15min":1.411},"min":{"1min":0.86599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5489999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5}]},{"osd":7,"last update":"Sun Dec 24 18:53:45 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.4630000000000001,"15min":1.452},"min":{"1min":1.0469999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.6599999999999999,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.625},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4990000000000001,"15min":1.5129999999999999},"min":{"1min":1.1899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.8080000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.7030000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311092,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060748,"statfs":{"total":96636764160,"available":96318205952,"internally_reserved":0,"allocated":1552384,"data_stored":791523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.59099999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.204,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.64800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.397,"5min":1.4970000000000001,"15min":1.5229999999999999},"last":0.876}]},{"osd":1,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89100000000000001,"15min":0.89800000000000002},"min":{"1min":0.68100000000000005,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.6830000000000001,"5min":1.78,"15min":1.78},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.976,"15min":1.976},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.081,"15min":1.1259999999999999},"min":{"1min":0.86199999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.5609999999999999,"5min":1.6459999999999999,"15min":1.778},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.78800000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4430000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.27,"15min":1.3029999999999999},"min":{"1min":0.86299999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6639999999999999,"5min":1.7370000000000001,"15min":1.764},"last":1.101},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.286,"15min":1.2869999999999999},"min":{"1min":0.92500000000000004,"5min":0.78500000000000003,"15min":0.78400000000000003},"max":{"1min":1.5800000000000001,"5min":1.798,"15min":1.798},"last":1.0640000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.294,"15min":1.2829999999999999},"min":{"1min":0.96499999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.5469999999999999,"5min":2.069,"15min":2.069},"last":1.151},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3500000000000001,"15min":1.359},"min":{"1min":1.0740000000000001,"5min":0.85199999999999998,"15min":0.82999999999999996},"max":{"1min":1.645,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.202}]},{"osd":6,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.389,"15min":1.397},"min":{"1min":1.0649999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.9199999999999999,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.234},{"interface":"front","average":{"1min":1.403,"5min":1.3879999999999999,"15min":1.3959999999999999},"min":{"1min":1.1180000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8899999999999999,"5min":1.9870000000000001,"15min":2.093},"last":1.2929999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:53:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4450000000000001,"15min":1.4530000000000001},"min":{"1min":0.98999999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.722,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.452,"15min":1.464},"min":{"1min":1.0189999999999999,"5min":0.84999999999999998,"15min":0.84299999999999997},"max":{"1min":1.8169999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.381}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302900,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068940,"statfs":{"total":96636764160,"available":96326594560,"internally_reserved":0,"allocated":1552384,"data_stored":791523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.464,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.075,"15min":1.1180000000000001},"min":{"1min":0.86799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.528,"5min":1.6419999999999999,"15min":1.829},"last":1.2729999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.626,"5min":0.57399999999999995,"15min":0.57099999999999995},"max":{"1min":1.383,"5min":1.494,"15min":1.5349999999999999},"last":1.04},{"interface":"front","average":{"1min":1.054,"5min":1.101,"15min":1.115},"min":{"1min":0.626,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5069999999999999,"5min":1.73,"15min":1.7410000000000001},"last":1.2150000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.248,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4059999999999999,"5min":1.823,"15min":1.9810000000000001},"last":1.385},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.119,"15min":1.089},"min":{"1min":0.66100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.502,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":0.88900000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.228},"min":{"1min":0.82499999999999996,"5min":0.746,"15min":0.64100000000000001},"max":{"1min":1.4590000000000001,"5min":1.724,"15min":1.724},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.399},"min":{"1min":0.93999999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6299999999999999,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.6120000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.389,"15min":1.3779999999999999},"min":{"1min":1.1539999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8320000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":1.052,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.488,"5min":1.8340000000000001,"15min":2.0089999999999999},"last":1.4299999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.502,"15min":1.48},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7390000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.921},{"interface":"front","average":{"1min":1.381,"5min":1.444,"15min":1.4530000000000001},"min":{"1min":1.0549999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.746,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.819}]},{"osd":7,"last update":"Sun Dec 24 18:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.5069999999999999,"15min":1.5129999999999999},"min":{"1min":1.254,"5min":0.92100000000000004,"15min":0.754},"max":{"1min":1.73,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":2.0099999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.46,"15min":1.4550000000000001},"min":{"1min":1.1759999999999999,"5min":0.876,"15min":0.876},"max":{"1min":1.5960000000000001,"5min":1.9710000000000001,"15min":2.1160000000000001},"last":1.6559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575061,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307588,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064252,"statfs":{"total":96636764160,"available":96321794048,"internally_reserved":0,"allocated":2158592,"data_stored":1383483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.45900000000000002,"15min":0.372},"max":{"1min":1.3899999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.56200000000000006,"15min":0.40799999999999997},"max":{"1min":1.349,"5min":1.631,"15min":1.746},"last":1.242}]},{"osd":2,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.056,"15min":1.046},"min":{"1min":0.71799999999999997,"5min":0.629,"15min":0.627},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.7},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.071,"15min":1.1180000000000001},"min":{"1min":0.78700000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.375,"5min":1.631,"15min":2.8130000000000002},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":1.018},"min":{"1min":0.67500000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.369,"5min":1.5289999999999999,"15min":1.819},"last":1.04},{"interface":"front","average":{"1min":1.23,"5min":1.214,"15min":1.2290000000000001},"min":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.163}]},{"osd":4,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.335,"15min":1.345},"min":{"1min":1.0309999999999999,"5min":0.82699999999999996,"15min":0.72599999999999998},"max":{"1min":1.655,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2370000000000001,"15min":1.2789999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.78300000000000003},"max":{"1min":1.5189999999999999,"5min":1.651,"15min":1.762},"last":0.92600000000000005}]},{"osd":5,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3799999999999999},"min":{"1min":1.044,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.641,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.377},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3520000000000001,"15min":1.397},"min":{"1min":1.0449999999999999,"5min":0.95699999999999996,"15min":0.66000000000000003},"max":{"1min":1.843,"5min":1.978,"15min":2.2280000000000002},"last":1.129}]},{"osd":6,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3240000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":2.0779999999999998},"last":1.115},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.47},"min":{"1min":1.1120000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.746,"5min":2.0750000000000002,"15min":2.23},"last":1.2849999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":1.133,"5min":1.006,"15min":0.89400000000000002},"max":{"1min":1.978,"5min":2.262,"15min":2.8980000000000001},"last":1.474},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.3979999999999999,"15min":1.4399999999999999},"min":{"1min":1.071,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.895,"5min":1.917,"15min":2.3279999999999998},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:54:19.475 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:54:19.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:54:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.689+0000 7f41f7345700 1 Processor -- start 2023-12-24T18:54:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 -- start start 2023-12-24T18:54:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41f00cf8a0 0x7f41f006a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 0x7f41f00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00cd680 con 0x7f41f00cf4d0 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f0159640 con 0x7f41f00cf8a0 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.693+0000 7f41f7345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f006b080 con 0x7f41f006ac40 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41f00cf8a0 0x7f41f006a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f58e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 0x7f41f00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f58e2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 0x7f41f00cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:39486/0 (socket says 172.21.15.50:39486) 2023-12-24T18:54:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f58e2700 1 -- 172.21.15.50:0/1759172782 learned_addr learned my addr 172.21.15.50:0/1759172782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 -- 172.21.15.50:0/1759172782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 msgr2=0x7f41f00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 --2- 172.21.15.50:0/1759172782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 0x7f41f00cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 -- 172.21.15.50:0/1759172782 >> v1:172.21.15.82:6789/0 conn(0x7f41f00cf4d0 legacy=0x7f41f006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 -- 172.21.15.50:0/1759172782 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f006d8f0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f48e0700 1 --2- 172.21.15.50:0/1759172782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f006a700 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f41e00098e0 tx=0x7f41e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9af04ed7c243db server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41e7fff700 1 -- 172.21.15.50:0/1759172782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b640 con 0x7f41f00cf8a0 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41e7fff700 1 -- 172.21.15.50:0/1759172782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000b7a0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41e7fff700 1 -- 172.21.15.50:0/1759172782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000bb40 con 0x7f41f00cf8a0 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 -- 172.21.15.50:0/1759172782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 msgr2=0x7f41f006a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 --2- 172.21.15.50:0/1759172782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f006a700 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f41e00098e0 tx=0x7f41e00091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 -- 172.21.15.50:0/1759172782 shutdown_connections 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 --2- 172.21.15.50:0/1759172782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f006ac40 0x7f41f00cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 --2- 172.21.15.50:0/1759172782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f006a700 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 -- 172.21.15.50:0/1759172782 >> 172.21.15.50:0/1759172782 conn(0x7f41f0067b30 msgr2=0x7f41f00cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.697+0000 7f41f7345700 1 -- 172.21.15.50:0/1759172782 shutdown_connections 2023-12-24T18:54:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.701+0000 7f41f7345700 1 -- 172.21.15.50:0/1759172782 wait complete. 2023-12-24T18:54:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.701+0000 7f41f7345700 1 Processor -- start 2023-12-24T18:54:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.701+0000 7f41f7345700 1 -- start start 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41f006ac40 0x7f41f0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 0x7f41f00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015d890 con 0x7f41f00cf8a0 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015db30 con 0x7f41f006ac40 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015ddd0 con 0x7f41f00cf4d0 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35492/0 (socket says 172.21.15.50:35492) 2023-12-24T18:54:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 -- 172.21.15.50:0/2494019743 learned_addr learned my addr 172.21.15.50:0/2494019743 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f48e0700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 0x7f41f00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f50e1700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41f006ac40 0x7f41f0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 -- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 msgr2=0x7f41f00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 0x7f41f00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 -- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41f006ac40 msgr2=0x7f41f0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41f006ac40 0x7f41f0159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 -- 172.21.15.50:0/2494019743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009420 con 0x7f41f00cf8a0 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f48e0700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 0x7f41f00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f58e2700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009e50 tx=0x7f41e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800ca10 con 0x7f41f00cf8a0 2023-12-24T18:54:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e800f040 con 0x7f41f00cf8a0 2023-12-24T18:54:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800cdc0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f015e0b0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.705+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00b4aa0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.709+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f015e5b0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.709+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f41e8014650 con 0x7f41f00cf8a0 2023-12-24T18:54:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.709+0000 7f41e57fa700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 0x7f41d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.709+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f41e807d1d0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.709+0000 7f41f50e1700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 0x7f41d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.713+0000 7f41f50e1700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 0x7f41d4062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41ec003860 tx=0x7f41ec009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.717+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41e804d500 con 0x7f41f00cf8a0 2023-12-24T18:54:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.953+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f41f00652e0 con 0x7f41f00cf8a0 2023-12-24T18:54:19.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.965+0000 7f41e57fa700 1 -- 172.21.15.50:0/2494019743 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f41e8050b20 con 0x7f41f00cf8a0 2023-12-24T18:54:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 msgr2=0x7f41d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 0x7f41d4062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41ec003860 tx=0x7f41ec009040 comp rx=0 tx=0).stop 2023-12-24T18:54:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 msgr2=0x7f41f015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009e50 tx=0x7f41e800b040 comp rx=0 tx=0).stop 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 shutdown_connections 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f41d4060550 0x7f41d4062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f00cf8a0 0x7f41f015b960 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41f00cf4d0 0x7f41f00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 --2- 172.21.15.50:0/2494019743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41f006ac40 0x7f41f0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 >> 172.21.15.50:0/2494019743 conn(0x7f41f0067b30 msgr2=0x7f41f015ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 shutdown_connections 2023-12-24T18:54:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:19.969+0000 7f41f7345700 1 -- 172.21.15.50:0/2494019743 wait complete. 2023-12-24T18:54:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:54:19.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:54:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.153+0000 7f5b0b0f0700 1 Processor -- start 2023-12-24T18:54:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.153+0000 7f5b0b0f0700 1 -- start start 2023-12-24T18:54:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b0b0f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b04159bc0 0x7f5b04159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b0b0f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b0406bce0 0x7f5b040aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b0b0f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406b850 con 0x7f5b040ab040 2023-12-24T18:54:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b0b0f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0406ac40 con 0x7f5b0406bce0 2023-12-24T18:54:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b0b0f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0406af20 con 0x7f5b04159bc0 2023-12-24T18:54:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b0406bce0 0x7f5b040aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b0406bce0 0x7f5b040aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35496/0 (socket says 172.21.15.50:35496) 2023-12-24T18:54:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 -- 172.21.15.50:0/3479747448 learned_addr learned my addr 172.21.15.50:0/3479747448 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5b08e8c700 1 --2- 172.21.15.50:0/3479747448 >> v2:172.21.15.82:3300/0 conn(0x7f5b04159bc0 0x7f5b04159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 -- 172.21.15.50:0/3479747448 >> v2:172.21.15.82:3300/0 conn(0x7f5b04159bc0 msgr2=0x7f5b04159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:20.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 --2- 172.21.15.50:0/3479747448 >> v2:172.21.15.82:3300/0 conn(0x7f5b04159bc0 0x7f5b04159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 -- 172.21.15.50:0/3479747448 >> v1:172.21.15.82:6789/0 conn(0x7f5b040ab040 legacy=0x7f5b040ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:20.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 -- 172.21.15.50:0/3479747448 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0406b200 con 0x7f5b0406bce0 2023-12-24T18:54:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afbfff700 1 --2- 172.21.15.50:0/3479747448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0406bce0 0x7f5b040aab00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5b04069ce0 tx=0x7f5af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b24faa204f218cb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afb7fe700 1 -- 172.21.15.50:0/3479747448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400b860 con 0x7f5b0406bce0 2023-12-24T18:54:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afb7fe700 1 -- 172.21.15.50:0/3479747448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b9c0 con 0x7f5b0406bce0 2023-12-24T18:54:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.157+0000 7f5afb7fe700 1 -- 172.21.15.50:0/3479747448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400bd60 con 0x7f5b0406bce0 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/3479747448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0406bce0 msgr2=0x7f5b040aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/3479747448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0406bce0 0x7f5b040aab00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5b04069ce0 tx=0x7f5af4009250 comp rx=0 tx=0).stop 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/3479747448 shutdown_connections 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/3479747448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0406bce0 0x7f5b040aab00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/3479747448 >> v2:172.21.15.82:3300/0 conn(0x7f5b04159bc0 0x7f5b04159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/3479747448 >> 172.21.15.50:0/3479747448 conn(0x7f5b040cbba0 msgr2=0x7f5b040cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/3479747448 shutdown_connections 2023-12-24T18:54:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/3479747448 wait complete. 2023-12-24T18:54:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.161+0000 7f5b0b0f0700 1 Processor -- start 2023-12-24T18:54:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 -- start start 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0406bce0 0x7f5b04154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 0x7f5b040ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416eac0 con 0x7f5b04159bc0 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040acf80 con 0x7f5b0406bce0 2023-12-24T18:54:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0b0f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416d930 con 0x7f5b040ab040 2023-12-24T18:54:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35512/0 (socket says 172.21.15.50:35512) 2023-12-24T18:54:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0968d700 1 -- 172.21.15.50:0/2345425790 learned_addr learned my addr 172.21.15.50:0/2345425790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 0x7f5b040ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b08e8c700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0406bce0 0x7f5b04154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 -- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0406bce0 msgr2=0x7f5b04154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0406bce0 0x7f5b04154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 -- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 msgr2=0x7f5b0415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 -- 172.21.15.50:0/2345425790 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40094f0 con 0x7f5b040ab040 2023-12-24T18:54:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5b0968d700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.165+0000 7f5afbfff700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 0x7f5b040ad410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b0406a9d0 tx=0x7f5af4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4024440 con 0x7f5b040ab040 2023-12-24T18:54:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af40245a0 con 0x7f5b040ab040 2023-12-24T18:54:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b040ac690 con 0x7f5b040ab040 2023-12-24T18:54:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4024940 con 0x7f5b040ab040 2023-12-24T18:54:20.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0416e7e0 con 0x7f5b040ab040 2023-12-24T18:54:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.169+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040ad110 con 0x7f5b040ab040 2023-12-24T18:54:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.173+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5af401a420 con 0x7f5b040ab040 2023-12-24T18:54:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.173+0000 7f5af8ff9700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 0x7f5af0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.173+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f5af407e760 con 0x7f5b040ab040 2023-12-24T18:54:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.173+0000 7f5b08e8c700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 0x7f5af0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.173+0000 7f5b08e8c700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 0x7f5af0062ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b04170fe0 tx=0x7f5b00009850 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.181+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5af404ea70 con 0x7f5b040ab040 2023-12-24T18:54:20.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.389+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b0406b4e0 con 0x7f5b040ab040 2023-12-24T18:54:20.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.389+0000 7f5af8ff9700 1 -- 172.21.15.50:0/2345425790 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5af4052090 con 0x7f5b040ab040 2023-12-24T18:54:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:20.392 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 msgr2=0x7f5af0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 0x7f5af0062ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b04170fe0 tx=0x7f5b00009850 comp rx=0 tx=0).stop 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 msgr2=0x7f5b040ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 0x7f5b040ad410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b0406a9d0 tx=0x7f5af4017000 comp rx=0 tx=0).stop 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 shutdown_connections 2023-12-24T18:54:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5af0060620 0x7f5af0062ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b04159bc0 0x7f5b0415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5b040ab040 0x7f5b040ad410 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 --2- 172.21.15.50:0/2345425790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0406bce0 0x7f5b04154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 >> 172.21.15.50:0/2345425790 conn(0x7f5b040cbba0 msgr2=0x7f5b04156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 shutdown_connections 2023-12-24T18:54:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.393+0000 7f5b0b0f0700 1 -- 172.21.15.50:0/2345425790 wait complete. 2023-12-24T18:54:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:54:20.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:54:13.765359+0000', 'modified': '2023-12-24T18:54:17.749184+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7806}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7806': {'gid': 7806, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3068804503', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3068804503}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3068804503}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:54:20.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:54:20.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T18:54:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:20.997+0000 7fd328985700 1 Processor -- start 2023-12-24T18:54:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 -- start start 2023-12-24T18:54:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd32406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 0x7fd3240b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3240af280 0x7fd3240af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3240afc00 con 0x7fd3240af280 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32406cd70 con 0x7fd32406c820 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.001+0000 7fd328985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32406d050 con 0x7fd324155cd0 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd321d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 0x7fd3240b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3240af280 0x7fd3240af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd321d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 0x7fd3240b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51504/0 (socket says 172.21.15.50:51504) 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd32259c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd32406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd321d9b700 1 -- 172.21.15.50:0/2586099235 learned_addr learned my addr 172.21.15.50:0/2586099235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 -- 172.21.15.50:0/2586099235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 msgr2=0x7fd32406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 --2- 172.21.15.50:0/2586099235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd32406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 -- 172.21.15.50:0/2586099235 >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 msgr2=0x7fd3240b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 --2- 172.21.15.50:0/2586099235 >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 0x7fd3240b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 -- 172.21.15.50:0/2586099235 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32406d330 con 0x7fd3240af280 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd322d9d700 1 --2- 172.21.15.50:0/2586099235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd3240af6c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a380 tx=0x7fd31c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0c52471faabc91 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd32159a700 1 -- 172.21.15.50:0/2586099235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00e070 con 0x7fd3240af280 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd32159a700 1 -- 172.21.15.50:0/2586099235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c00bab0 con 0x7fd3240af280 2023-12-24T18:54:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd32159a700 1 -- 172.21.15.50:0/2586099235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00be70 con 0x7fd3240af280 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 -- 172.21.15.50:0/2586099235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 msgr2=0x7fd3240af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 --2- 172.21.15.50:0/2586099235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd3240af6c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a380 tx=0x7fd31c009780 comp rx=0 tx=0).stop 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 -- 172.21.15.50:0/2586099235 shutdown_connections 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 --2- 172.21.15.50:0/2586099235 >> v2:172.21.15.82:3300/0 conn(0x7fd32406c820 0x7fd3240b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 --2- 172.21.15.50:0/2586099235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd3240af6c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 --2- 172.21.15.50:0/2586099235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd32406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 -- 172.21.15.50:0/2586099235 >> 172.21.15.50:0/2586099235 conn(0x7fd3240670b0 msgr2=0x7fd324067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 -- 172.21.15.50:0/2586099235 shutdown_connections 2023-12-24T18:54:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.005+0000 7fd328985700 1 -- 172.21.15.50:0/2586099235 wait complete. 2023-12-24T18:54:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 Processor -- start 2023-12-24T18:54:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 -- start start 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32406c820 0x7fd324165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd3240adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324168d90 con 0x7fd3240af280 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241647f0 con 0x7fd32406c820 2023-12-24T18:54:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd328985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324164d70 con 0x7fd324155cd0 2023-12-24T18:54:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35524/0 (socket says 172.21.15.50:35524) 2023-12-24T18:54:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 -- 172.21.15.50:0/765414969 learned_addr learned my addr 172.21.15.50:0/765414969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd322d9d700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd3240adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd32259c700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32406c820 0x7fd324165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 -- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 msgr2=0x7fd3240adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd3240adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 -- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32406c820 msgr2=0x7fd324165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32406c820 0x7fd324165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.009+0000 7fd321d9b700 1 -- 172.21.15.50:0/765414969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c009a20 con 0x7fd3240af280 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd321d9b700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd318010e90 tx=0x7fd31800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd3127fc700 1 -- 172.21.15.50:0/765414969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318011450 con 0x7fd3240af280 2023-12-24T18:54:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd3127fc700 1 -- 172.21.15.50:0/765414969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3180115b0 con 0x7fd3240af280 2023-12-24T18:54:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3241687d0 con 0x7fd3240af280 2023-12-24T18:54:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd3127fc700 1 -- 172.21.15.50:0/765414969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318011930 con 0x7fd3240af280 2023-12-24T18:54:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.013+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd324164a00 con 0x7fd3240af280 2023-12-24T18:54:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd3127fc700 1 -- 172.21.15.50:0/765414969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd318011d20 con 0x7fd3240af280 2023-12-24T18:54:21.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd3127fc700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 0x7fd304062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd3127fc700 1 -- 172.21.15.50:0/765414969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd31807f770 con 0x7fd3240af280 2023-12-24T18:54:21.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd32259c700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 0x7fd304062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd32ac60740 1 Processor -- start 2023-12-24T18:54:21.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd32259c700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 0x7fd304062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd314009d40 tx=0x7fd314008040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.017+0000 7fd32ac60740 1 -- start start 2023-12-24T18:54:21.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1a7c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 0x1a7c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a9f30 con 0x17feae0 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a5ed0 con 0x17fe710 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x196c0b0 con 0x1849790 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35528/0 (socket says 172.21.15.50:35528) 2023-12-24T18:54:21.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 -- 172.21.15.50:0/2188837944 learned_addr learned my addr 172.21.15.50:0/2188837944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd321d9b700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1a7c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd322d9d700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 0x1a7c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 -- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 msgr2=0x1a7c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 0x1a7c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 -- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 msgr2=0x1a7c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1a7c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 -- 172.21.15.50:0/2188837944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x184a9e0 con 0x17feae0 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd322d9d700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 0x1a7c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32259c700 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd314009620 tx=0x7fd314018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef388dbf16f7b2d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd3037fe700 1 -- 172.21.15.50:0/2188837944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011e60 con 0x17feae0 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd3037fe700 1 -- 172.21.15.50:0/2188837944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314015c60 con 0x17feae0 2023-12-24T18:54:21.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd3037fe700 1 -- 172.21.15.50:0/2188837944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314021650 con 0x17feae0 2023-12-24T18:54:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- 172.21.15.50:0/2188837944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 msgr2=0x1a7bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd314009620 tx=0x7fd314018000 comp rx=0 tx=0).stop 2023-12-24T18:54:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- 172.21.15.50:0/2188837944 shutdown_connections 2023-12-24T18:54:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1849790 0x1a7c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1a7c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 --2- 172.21.15.50:0/2188837944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a7bf00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- 172.21.15.50:0/2188837944 >> 172.21.15.50:0/2188837944 conn(0x17feeb0 msgr2=0x1a38930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- 172.21.15.50:0/2188837944 shutdown_connections 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.021+0000 7fd32ac60740 1 -- 172.21.15.50:0/2188837944 wait complete. 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.025+0000 7fd32ac60740 1 -- start start 2023-12-24T18:54:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.025+0000 7fd32ac60740 1 Processor -- start 2023-12-24T18:54:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a80300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 0x1a61cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x196bd50 con 0x17feae0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1944970 con 0x1849790 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x194f510 con 0x17fe710 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 10 client.0 _ll_register_callbacks cb 0x19ef6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35530/0 (socket says 172.21.15.50:35530) 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 -- 172.21.15.50:0/1330574089 learned_addr learned my addr 172.21.15.50:0/1330574089 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32259c700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a80300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd322d9d700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 0x1a61cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 -- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 msgr2=0x1a80300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a80300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 -- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 msgr2=0x1a61cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 0x1a61cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 -- 172.21.15.50:0/1330574089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd314011a10 con 0x17feae0 2023-12-24T18:54:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd322d9d700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 0x1a61cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:21.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd321d9b700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd3180533c0 tx=0x7fd31807d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980c70acd1438084 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31805a6a0 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd318051a60 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1944cc0 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd318052dc0 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 10 client.7938 fetch_fsmap learned FSMap version 61 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x1974370 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31807d030 con 0x17feae0 2023-12-24T18:54:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd31805a210 con 0x17feae0 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 10 client.7938 fetch_fsmap finished waiting for FSMap version 61 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 10 client.7938 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 20 client.7938 populate_metadata read hostname 'smithi050' 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a63220 0x1a8b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 4 client.7938 mds_command: new command op to 7806 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.029+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 --> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19483e0 con 0x1a63220 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32259c700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a63220 0x1a8b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32259c700 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a63220 0x1a8b4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ebe1d9cac1d4e2a server_cookie=1cf41f05ca716916 in_seq=0 out_seq=0 2023-12-24T18:54:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd300ff9700 10 client.7938 ms_handle_connect on v2:172.21.15.50:6834/3068804503 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd300ff9700 1 -- 172.21.15.50:0/1330574089 <== mds.0 v2:172.21.15.50:6834/3068804503 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x19483e0 con 0x1a63220 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd300ff9700 10 client.7938 handle_command_reply: tid=0 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 client.7938 shutdown 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 msgr2=0x1a80840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd3180533c0 tx=0x7fd31807d890 comp rx=0 tx=0).stop 2023-12-24T18:54:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 shutdown_connections 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1849790 0x1a61cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17feae0 0x1a80840 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a63220 0x1a8b4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 --2- 172.21.15.50:0/1330574089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a80300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 >> 172.21.15.50:0/1330574089 conn(0x17feeb0 msgr2=0x1a30f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd300ff9700 0 client.7938 ms_handle_reset on v2:172.21.15.50:6834/3068804503 2023-12-24T18:54:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 shutdown_connections 2023-12-24T18:54:21.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.033+0000 7fd32ac60740 1 -- 172.21.15.50:0/1330574089 wait complete. 2023-12-24T18:54:21.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.037+0000 7fd32ac60740 20 client.7938 trim_cache size 0 max 16384 2023-12-24T18:54:21.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 Processor -- start 2023-12-24T18:54:21.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 -- start start 2023-12-24T18:54:21.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a60ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1a5f780 0x1a5fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x18777c0 con 0x1849790 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a99d0 con 0x1a5f780 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x19a3890 con 0x17fe710 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35540/0 (socket says 172.21.15.50:35540) 2023-12-24T18:54:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 -- 172.21.15.50:0/3628336584 learned_addr learned my addr 172.21.15.50:0/3628336584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd322d9d700 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1a5f780 0x1a5fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd32259c700 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a60ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 -- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 msgr2=0x1a60ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a60ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 -- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1a5f780 msgr2=0x1a5fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1a5f780 0x1a5fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 -- 172.21.15.50:0/3628336584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x195ad80 con 0x1849790 2023-12-24T18:54:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.057+0000 7fd321d9b700 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd31800b960 tx=0x7fd318067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51c33fd48c486be server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd303fff700 1 -- 172.21.15.50:0/3628336584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318052dc0 con 0x1849790 2023-12-24T18:54:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd303fff700 1 -- 172.21.15.50:0/3628336584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31807d040 con 0x1849790 2023-12-24T18:54:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd303fff700 1 -- 172.21.15.50:0/3628336584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31805a6a0 con 0x1849790 2023-12-24T18:54:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- 172.21.15.50:0/3628336584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 msgr2=0x1a61220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd31800b960 tx=0x7fd318067000 comp rx=0 tx=0).stop 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- 172.21.15.50:0/3628336584 shutdown_connections 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1a5f780 0x1a5fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1a61220 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 --2- 172.21.15.50:0/3628336584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x17fe710 0x1a60ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- 172.21.15.50:0/3628336584 >> 172.21.15.50:0/3628336584 conn(0x17feeb0 msgr2=0x1a7f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- 172.21.15.50:0/3628336584 shutdown_connections 2023-12-24T18:54:21.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- 172.21.15.50:0/3628336584 wait complete. 2023-12-24T18:54:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 -- start start 2023-12-24T18:54:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.061+0000 7fd32ac60740 1 Processor -- start 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1ada4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1a5f780 0x1a352b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1974800 con 0x1849790 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x196f400 con 0x17fe710 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1957550 con 0x1a5f780 2023-12-24T18:54:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32ac60740 10 client.0 _ll_register_callbacks cb 0x17ca9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:54:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35542/0 (socket says 172.21.15.50:35542) 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 -- 172.21.15.50:0/275131582 learned_addr learned my addr 172.21.15.50:0/275131582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd32259c700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1ada4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd322d9d700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1a5f780 0x1a352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 -- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1a5f780 msgr2=0x1a352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1a5f780 0x1a352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 -- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 msgr2=0x1ada4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1ada4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.065+0000 7fd321d9b700 1 -- 172.21.15.50:0/275131582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1974370 con 0x1849790 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd321d9b700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318056070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c02c6696457b228 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:54:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318053490 con 0x1849790 2023-12-24T18:54:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fd31805a6a0 con 0x1849790 2023-12-24T18:54:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3240a46c0 con 0x1849790 2023-12-24T18:54:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd318052dc0 con 0x1849790 2023-12-24T18:54:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 10 client.7944 fetch_fsmap learned FSMap version 61 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x194f130 con 0x1849790 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3240a46c0 con 0x1849790 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd318076d20 con 0x1849790 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 10 client.7944 fetch_fsmap finished waiting for FSMap version 61 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 10 client.7944 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 20 client.7944 populate_metadata read hostname 'smithi050' 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a35c40 0x1a36010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 4 client.7944 mds_command: new command op to 7806 tid=0[{"prefix": "status"}] 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 --> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd314015c60 con 0x1a35c40 2023-12-24T18:54:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32259c700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a35c40 0x1a36010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd32259c700 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a35c40 0x1a36010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7aad687834609c server_cookie=c34ccddec18fb6a2 in_seq=0 out_seq=0 2023-12-24T18:54:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.069+0000 7fd300ff9700 10 client.7944 ms_handle_connect on v2:172.21.15.50:6834/3068804503 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd300ff9700 1 -- 172.21.15.50:0/275131582 <== mds.0 v2:172.21.15.50:6834/3068804503 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fd314015c60 con 0x1a35c40 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd300ff9700 10 client.7944 handle_command_reply: tid=0 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 client.7944 shutdown 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 msgr2=0x1adaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318056070 comp rx=0 tx=0).stop 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 shutdown_connections 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:6834/3068804503,v1:172.21.15.50:6835/3068804503] conn(0x1a35c40 0x1a36010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1a5f780 0x1a352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1849790 0x1adaa10 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 --2- 172.21.15.50:0/275131582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x17fe710 0x1ada4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd300ff9700 0 client.7944 ms_handle_reset on v2:172.21.15.50:6834/3068804503 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 >> 172.21.15.50:0/275131582 conn(0x17feeb0 msgr2=0x1a7ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 shutdown_connections 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 1 -- 172.21.15.50:0/275131582 wait complete. 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd32ac60740 20 client.7944 trim_cache size 0 max 16384 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7806, 2023-12-24T18:54:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.3507369599999999, 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 61, 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 125, 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 125, 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.671719741 2023-12-24T18:54:21.077 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:54:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 msgr2=0x7fd304062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 0x7fd304062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd314009d40 tx=0x7fd314008040 comp rx=0 tx=0).stop 2023-12-24T18:54:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 msgr2=0x7fd324167df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd318010e90 tx=0x7fd31800b4f0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 shutdown_connections 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd304060550 0x7fd304062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd324155cd0 0x7fd3240adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3240af280 0x7fd324167df0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 --2- 172.21.15.50:0/765414969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32406c820 0x7fd324165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 >> 172.21.15.50:0/765414969 conn(0x7fd3240670b0 msgr2=0x7fd324152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 shutdown_connections 2023-12-24T18:54:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.073+0000 7fd328985700 1 -- 172.21.15.50:0/765414969 wait complete. 2023-12-24T18:54:21.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:54:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.261+0000 7efdbfb45700 1 Processor -- start 2023-12-24T18:54:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.261+0000 7efdbfb45700 1 -- start start 2023-12-24T18:54:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbfb45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efdb80ca3a0 0x7efdb80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbfb45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdb815b160 0x7efdb806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbfb45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb806ca50 con 0x7efdb806ae10 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbfb45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb80c6980 con 0x7efdb815b160 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbfb45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb806b7f0 con 0x7efdb80ca3a0 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdb815b160 0x7efdb806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdb815b160 0x7efdb806cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35554/0 (socket says 172.21.15.50:35554) 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 -- 172.21.15.50:0/2357759351 learned_addr learned my addr 172.21.15.50:0/2357759351 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbd8e1700 1 --2- 172.21.15.50:0/2357759351 >> v2:172.21.15.82:3300/0 conn(0x7efdb80ca3a0 0x7efdb80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 -- 172.21.15.50:0/2357759351 >> v2:172.21.15.82:3300/0 conn(0x7efdb80ca3a0 msgr2=0x7efdb80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 --2- 172.21.15.50:0/2357759351 >> v2:172.21.15.82:3300/0 conn(0x7efdb80ca3a0 0x7efdb80ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 -- 172.21.15.50:0/2357759351 >> v1:172.21.15.50:6789/0 conn(0x7efdb806ae10 legacy=0x7efdb815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 -- 172.21.15.50:0/2357759351 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb806bad0 con 0x7efdb815b160 2023-12-24T18:54:21.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.265+0000 7efdbe0e2700 1 --2- 172.21.15.50:0/2357759351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb815b160 0x7efdb806cee0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7efdb8069ce0 tx=0x7efdb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c737d795297d075 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbc8df700 1 -- 172.21.15.50:0/2357759351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000e070 con 0x7efdb815b160 2023-12-24T18:54:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbc8df700 1 -- 172.21.15.50:0/2357759351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb000ba20 con 0x7efdb815b160 2023-12-24T18:54:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbc8df700 1 -- 172.21.15.50:0/2357759351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00092e0 con 0x7efdb815b160 2023-12-24T18:54:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 -- 172.21.15.50:0/2357759351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb815b160 msgr2=0x7efdb806cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 --2- 172.21.15.50:0/2357759351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb815b160 0x7efdb806cee0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7efdb8069ce0 tx=0x7efdb0009840 comp rx=0 tx=0).stop 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 -- 172.21.15.50:0/2357759351 shutdown_connections 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 --2- 172.21.15.50:0/2357759351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb815b160 0x7efdb806cee0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 --2- 172.21.15.50:0/2357759351 >> v2:172.21.15.82:3300/0 conn(0x7efdb80ca3a0 0x7efdb80ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 -- 172.21.15.50:0/2357759351 >> 172.21.15.50:0/2357759351 conn(0x7efdb80cbba0 msgr2=0x7efdb80cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 -- 172.21.15.50:0/2357759351 shutdown_connections 2023-12-24T18:54:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 -- 172.21.15.50:0/2357759351 wait complete. 2023-12-24T18:54:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.269+0000 7efdbfb45700 1 Processor -- start 2023-12-24T18:54:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- start start 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 0x7efdb81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 0x7efdb81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c8af0 con 0x7efdb806ae10 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8171750 con 0x7efdb815b160 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8170bd0 con 0x7efdb80ca3a0 2023-12-24T18:54:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35562/0 (socket says 172.21.15.50:35562) 2023-12-24T18:54:21.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 -- 172.21.15.50:0/1153360871 learned_addr learned my addr 172.21.15.50:0/1153360871 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd0e0700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 0x7efdb81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbe0e2700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 0x7efdb81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 -- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 msgr2=0x7efdb81591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 0x7efdb81591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 -- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 msgr2=0x7efdb81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 0x7efdb81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 -- 172.21.15.50:0/1153360871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009ae0 con 0x7efdb806ae10 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbe0e2700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 0x7efdb81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd0e0700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 0x7efdb81591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:54:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbd8e1700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7efdb400ec80 tx=0x7efdb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb400c9d0 con 0x7efdb806ae10 2023-12-24T18:54:21.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb400cb30 con 0x7efdb806ae10 2023-12-24T18:54:21.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8170eb0 con 0x7efdb806ae10 2023-12-24T18:54:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4013470 con 0x7efdb806ae10 2023-12-24T18:54:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.273+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8171470 con 0x7efdb806ae10 2023-12-24T18:54:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.277+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb80652e0 con 0x7efdb806ae10 2023-12-24T18:54:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.277+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efdb4013820 con 0x7efdb806ae10 2023-12-24T18:54:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.281+0000 7efdadffb700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 0x7efd9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.281+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7efdb407ce10 con 0x7efdb806ae10 2023-12-24T18:54:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.281+0000 7efdbd0e0700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 0x7efd9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.281+0000 7efdbd0e0700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 0x7efd9c062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdb80c2810 tx=0x7efda8009040 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:21.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.285+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efdb4080030 con 0x7efdb806ae10 2023-12-24T18:54:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.497+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efdb806bdb0 con 0x7efdb806ae10 2023-12-24T18:54:21.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.497+0000 7efdadffb700 1 -- 172.21.15.50:0/1153360871 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) v1 ==== 53+0+73 (secure 0 0 0) 0x7efdb404d0a0 con 0x7efdb806ae10 2023-12-24T18:54:21.499 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 msgr2=0x7efd9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 0x7efd9c062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdb80c2810 tx=0x7efda8009040 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 msgr2=0x7efdb80c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7efdb400ec80 tx=0x7efdb40091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 shutdown_connections 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd9c060550 0x7efd9c062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb815b160 0x7efdb81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb80ca3a0 0x7efdb81591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 --2- 172.21.15.50:0/1153360871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdb806ae10 0x7efdb80c85b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 >> 172.21.15.50:0/1153360871 conn(0x7efdb80cbba0 msgr2=0x7efdb80cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 shutdown_connections 2023-12-24T18:54:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:21.501+0000 7efdbfb45700 1 -- 172.21.15.50:0/1153360871 wait complete. 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:54:21.527 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:54:21.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.528 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:54:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41349sec preferred_lft 41349sec 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:54:21.549 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:54:21.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:54:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.551 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:54:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:54:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:54:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:54:21.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.552 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:54:21.632 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:54:21.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.638 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:54:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:54:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:54:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:54:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:54:21.707 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:54:21.707 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:54:21.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:54:21.708 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:54:21.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.842 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:54:21.861 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:54:21.861 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:54:21.862 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:54:21.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:21.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:54:21.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:54:21.947 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:54:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:54:22.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:54:22.008 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:54:22.066 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:54:22.066 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:54:22.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:54:22.197 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:54:22.197 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:54:22.224 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:54:22.224 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:54:22.225 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:54:22.225 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:54:22.225 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:54:22.229 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:54:22.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:54:22.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:54:22.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:54:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.469+0000 7f19ed745700 1 Processor -- start 2023-12-24T18:54:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.469+0000 7f19ed745700 1 -- start start 2023-12-24T18:54:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19ed745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e80ab8e0 0x7f19e80abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19ed745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19e80b0e00 0x7f19e8158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19ed745700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e806e760 con 0x7f19e806ebf0 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19ed745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e806f040 con 0x7f19e80b0e00 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19ed745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e806db70 con 0x7f19e80ab8e0 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.473+0000 7f19e77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19e80b0e00 0x7f19e8158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19dffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f19e806ebf0 0x7f19e80b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:58512/0 (socket says 172.21.15.50:58512) 2023-12-24T18:54:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e6ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e80ab8e0 0x7f19e80abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19dffff700 1 -- 172.21.15.50:0/490788583 learned_addr learned my addr 172.21.15.50:0/490788583 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e77fe700 1 -- 172.21.15.50:0/490788583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e80ab8e0 msgr2=0x7f19e80abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e77fe700 1 --2- 172.21.15.50:0/490788583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e80ab8e0 0x7f19e80abcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e77fe700 1 -- 172.21.15.50:0/490788583 >> v1:172.21.15.82:6789/0 conn(0x7f19e806ebf0 legacy=0x7f19e80b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e77fe700 1 -- 172.21.15.50:0/490788583 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e806de30 con 0x7f19e80b0e00 2023-12-24T18:54:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e77fe700 1 --2- 172.21.15.50:0/490788583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80b0e00 0x7f19e8158b50 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e60 tx=0x7f19e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e38b9f8c3908da1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e67fc700 1 -- 172.21.15.50:0/490788583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000e070 con 0x7f19e80b0e00 2023-12-24T18:54:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e67fc700 1 -- 172.21.15.50:0/490788583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e000bb60 con 0x7f19e80b0e00 2023-12-24T18:54:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19e67fc700 1 -- 172.21.15.50:0/490788583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0012430 con 0x7f19e80b0e00 2023-12-24T18:54:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 -- 172.21.15.50:0/490788583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80b0e00 msgr2=0x7f19e8158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 --2- 172.21.15.50:0/490788583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80b0e00 0x7f19e8158b50 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e60 tx=0x7f19e0009780 comp rx=0 tx=0).stop 2023-12-24T18:54:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 -- 172.21.15.50:0/490788583 shutdown_connections 2023-12-24T18:54:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 --2- 172.21.15.50:0/490788583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80b0e00 0x7f19e8158b50 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 --2- 172.21.15.50:0/490788583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e80ab8e0 0x7f19e80abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 -- 172.21.15.50:0/490788583 >> 172.21.15.50:0/490788583 conn(0x7f19e80677c0 msgr2=0x7f19e8067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 -- 172.21.15.50:0/490788583 shutdown_connections 2023-12-24T18:54:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.477+0000 7f19ed745700 1 -- 172.21.15.50:0/490788583 wait complete. 2023-12-24T18:54:22.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 Processor -- start 2023-12-24T18:54:22.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 -- start start 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e806ebf0 0x7f19e80c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 0x7f19e81401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8151650 con 0x7f19e80ab8e0 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80c63c0 con 0x7f19e80b0e00 2023-12-24T18:54:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19ed745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8151bb0 con 0x7f19e806ebf0 2023-12-24T18:54:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35574/0 (socket says 172.21.15.50:35574) 2023-12-24T18:54:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 -- 172.21.15.50:0/1833364512 learned_addr learned my addr 172.21.15.50:0/1833364512 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19e6ffd700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e806ebf0 0x7f19e80c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19e77fe700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 0x7f19e81401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 -- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e806ebf0 msgr2=0x7f19e80c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e806ebf0 0x7f19e80c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 -- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 msgr2=0x7f19e81401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 0x7f19e81401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19dffff700 1 -- 172.21.15.50:0/1833364512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0009a20 con 0x7f19e80ab8e0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.481+0000 7f19e77fe700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 0x7f19e81401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19dffff700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c7c0 tx=0x7f19d0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0005b30 con 0x7f19e80ab8e0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0005c90 con 0x7f19e80ab8e0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80c6890 con 0x7f19e80ab8e0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0004a80 con 0x7f19e80ab8e0 2023-12-24T18:54:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80c6de0 con 0x7f19e80ab8e0 2023-12-24T18:54:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.485+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e80652e0 con 0x7f19e80ab8e0 2023-12-24T18:54:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.489+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f19d00070d0 con 0x7f19e80ab8e0 2023-12-24T18:54:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.489+0000 7f19deffd700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.489+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f19d007be60 con 0x7f19e80ab8e0 2023-12-24T18:54:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.489+0000 7f19e6ffd700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.489+0000 7f19e6ffd700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 0x7f19c8062a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009db0 tx=0x7f19d80091a0 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.493+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19d0049be0 con 0x7f19e80ab8e0 2023-12-24T18:54:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.697+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e806e180 con 0x7f19c8060580 2023-12-24T18:54:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19deffd700 1 -- 172.21.15.50:0/1833364512 <== mgr.7599 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f19e806e180 con 0x7f19c8060580 2023-12-24T18:54:22.703 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:54:22.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:54:22.703 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:54:22.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:54:22.703 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:54:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 msgr2=0x7f19c8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 0x7f19c8062a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009db0 tx=0x7f19d80091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 msgr2=0x7f19e8152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c7c0 tx=0x7f19d0007f70 comp rx=0 tx=0).stop 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 shutdown_connections 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f19c8060580 0x7f19c8062a30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19e80b0e00 0x7f19e81401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19e80ab8e0 0x7f19e8152040 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 --2- 172.21.15.50:0/1833364512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19e806ebf0 0x7f19e80c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.701+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 >> 172.21.15.50:0/1833364512 conn(0x7f19e80677c0 msgr2=0x7f19e80ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.705+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 shutdown_connections 2023-12-24T18:54:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.705+0000 7f19ed745700 1 -- 172.21.15.50:0/1833364512 wait complete. 2023-12-24T18:54:22.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:54:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 Processor -- start 2023-12-24T18:54:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 -- start start 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98c40cbb10 0x7f98c40cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c4067440 con 0x7f98c4159050 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c4067fc0 con 0x7f98c40cbb10 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c8b23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40c8a20 con 0x7f98c4158c80 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98c40cbb10 0x7f98c40cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c37fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98c40cbb10 0x7f98c40cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51590/0 (socket says 172.21.15.50:51590) 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 -- 172.21.15.50:0/2802870471 learned_addr learned my addr 172.21.15.50:0/2802870471 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 -- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 msgr2=0x7f98c40c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 --2- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 -- 172.21.15.50:0/2802870471 >> v1:172.21.15.82:6789/0 conn(0x7f98c4159050 legacy=0x7f98c415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.905+0000 7f98c2ffd700 1 -- 172.21.15.50:0/2802870471 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4067690 con 0x7f98c40cbb10 2023-12-24T18:54:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c2ffd700 1 --2- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c40cbb10 0x7f98c40cc1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f98b80099b0 tx=0x7f98b8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e34b3fed35d9a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c27fc700 1 -- 172.21.15.50:0/2802870471 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8009ea0 con 0x7f98c40cbb10 2023-12-24T18:54:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c27fc700 1 -- 172.21.15.50:0/2802870471 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800b860 con 0x7f98c40cbb10 2023-12-24T18:54:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c27fc700 1 -- 172.21.15.50:0/2802870471 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800bc00 con 0x7f98c40cbb10 2023-12-24T18:54:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 -- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c40cbb10 msgr2=0x7f98c40cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c40cbb10 0x7f98c40cc1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f98b80099b0 tx=0x7f98b8009250 comp rx=0 tx=0).stop 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 -- 172.21.15.50:0/2802870471 shutdown_connections 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c40cbb10 0x7f98c40cc1c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2802870471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 -- 172.21.15.50:0/2802870471 >> 172.21.15.50:0/2802870471 conn(0x7f98c4069d90 msgr2=0x7f98c40cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 -- 172.21.15.50:0/2802870471 shutdown_connections 2023-12-24T18:54:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.909+0000 7f98c8b23700 1 -- 172.21.15.50:0/2802870471 wait complete. 2023-12-24T18:54:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 Processor -- start 2023-12-24T18:54:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 -- start start 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c4159050 0x7f98c40c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40aeb20 con 0x7f98c40cbb10 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4151e00 con 0x7f98c4159050 2023-12-24T18:54:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c8b23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40b0df0 con 0x7f98c4158c80 2023-12-24T18:54:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35588/0 (socket says 172.21.15.50:35588) 2023-12-24T18:54:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 -- 172.21.15.50:0/2145853699 learned_addr learned my addr 172.21.15.50:0/2145853699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c2ffd700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c3fff700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c4159050 0x7f98c40c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 -- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 msgr2=0x7f98c40aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 -- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c4159050 msgr2=0x7f98c40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c4159050 0x7f98c40c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.913+0000 7f98c37fe700 1 -- 172.21.15.50:0/2145853699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80094f0 con 0x7f98c40cbb10 2023-12-24T18:54:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98c37fe700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f98b400ec80 tx=0x7f98b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400c850 con 0x7f98c40cbb10 2023-12-24T18:54:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b400c9b0 con 0x7f98c40cbb10 2023-12-24T18:54:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40b10d0 con 0x7f98c40cbb10 2023-12-24T18:54:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400cd50 con 0x7f98c40cbb10 2023-12-24T18:54:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c40b1460 con 0x7f98c40cbb10 2023-12-24T18:54:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.917+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40af390 con 0x7f98c40cbb10 2023-12-24T18:54:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.921+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 56) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f98b4013680 con 0x7f98c40cbb10 2023-12-24T18:54:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.921+0000 7f98ab7fe700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 0x7f98b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.921+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f98b407ccb0 con 0x7f98c40cbb10 2023-12-24T18:54:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.921+0000 7f98c2ffd700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 0x7f98b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.921+0000 7f98c2ffd700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 0x7f98b0062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f98b80099b0 tx=0x7f98b8017000 comp rx=0 tx=0).ready entity=mgr.7599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:22.929+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f98b404cfe0 con 0x7f98c40cbb10 2023-12-24T18:54:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.141+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f98c404be40 con 0x7f98c40cbb10 2023-12-24T18:54:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.813+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 57) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f98b404d3b0 con 0x7f98c40cbb10 2023-12-24T18:54:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.813+0000 7f98ab7fe700 1 -- 172.21.15.50:0/2145853699 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v57) v1 ==== 92+0+0 (secure 0 0 0) 0x7f98b4050a70 con 0x7f98c40cbb10 2023-12-24T18:54:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 msgr2=0x7f98b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 0x7f98b0062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f98b80099b0 tx=0x7f98b8017000 comp rx=0 tx=0).stop 2023-12-24T18:54:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 msgr2=0x7f98c41518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f98b400ec80 tx=0x7f98b40091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 shutdown_connections 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f98b0060550 0x7f98b0062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98c4159050 0x7f98c40c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98c4158c80 0x7f98c40aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 --2- 172.21.15.50:0/2145853699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98c40cbb10 0x7f98c41518c0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 >> 172.21.15.50:0/2145853699 conn(0x7f98c4069d90 msgr2=0x7f98c4152240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 shutdown_connections 2023-12-24T18:54:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:23.817+0000 7f98c8b23700 1 -- 172.21.15.50:0/2145853699 wait complete. 2023-12-24T18:54:23.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:54:23.997 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:23.991+0000 7f42bdb6c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:54:24.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.005+0000 7fe0b842e700 1 Processor -- start 2023-12-24T18:54:24.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.005+0000 7fe0b842e700 1 -- start start 2023-12-24T18:54:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b00cf8a0 0x7fe0b006a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0b006ac40 0x7fe0b00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b006b0a0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b0159640 con 0x7fe0b006ac40 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00cd680 con 0x7fe0b00cf8a0 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0b006ac40 0x7fe0b00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0b006ac40 0x7fe0b00cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35612/0 (socket says 172.21.15.50:35612) 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 -- 172.21.15.50:0/3999729039 learned_addr learned my addr 172.21.15.50:0/3999729039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b61ca700 1 --1- 172.21.15.50:0/3999729039 >> v1:172.21.15.50:6789/0 conn(0x7fe0b00cf4d0 0x7fe0b006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57310/0 (socket says 172.21.15.50:57310) 2023-12-24T18:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b59c9700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b00cf8a0 0x7fe0b006a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 -- 172.21.15.50:0/3999729039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b00cf8a0 msgr2=0x7fe0b006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b00cf8a0 0x7fe0b006a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 -- 172.21.15.50:0/3999729039 >> v1:172.21.15.50:6789/0 conn(0x7fe0b00cf4d0 legacy=0x7fe0b006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 -- 172.21.15.50:0/3999729039 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b006d8f0 con 0x7fe0b006ac40 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b69cb700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b006ac40 0x7fe0b00cdb10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009f20 tx=0x7fe0a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a3066a4168b42f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b51c8700 1 -- 172.21.15.50:0/3999729039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800e070 con 0x7fe0b006ac40 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b51c8700 1 -- 172.21.15.50:0/3999729039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800ba80 con 0x7fe0b006ac40 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b51c8700 1 -- 172.21.15.50:0/3999729039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80092e0 con 0x7fe0b006ac40 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 -- 172.21.15.50:0/3999729039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b006ac40 msgr2=0x7fe0b00cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.009+0000 7fe0b842e700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b006ac40 0x7fe0b00cdb10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009f20 tx=0x7fe0a8009840 comp rx=0 tx=0).stop 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 -- 172.21.15.50:0/3999729039 shutdown_connections 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b006ac40 0x7fe0b00cdb10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 --2- 172.21.15.50:0/3999729039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b00cf8a0 0x7fe0b006a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 -- 172.21.15.50:0/3999729039 >> 172.21.15.50:0/3999729039 conn(0x7fe0b0067b30 msgr2=0x7fe0b00cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 -- 172.21.15.50:0/3999729039 shutdown_connections 2023-12-24T18:54:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 -- 172.21.15.50:0/3999729039 wait complete. 2023-12-24T18:54:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 Processor -- start 2023-12-24T18:54:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.013+0000 7fe0b842e700 1 -- start start 2023-12-24T18:54:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b006ac40 0x7fe0b013e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 0x7fe0b015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b015d1b0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b015aaa0 con 0x7fe0b00cf8a0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0159ed0 con 0x7fe0b006ac40 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35628/0 (socket says 172.21.15.50:35628) 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 -- 172.21.15.50:0/1348514741 learned_addr learned my addr 172.21.15.50:0/1348514741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b69cb700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 0x7fe0b015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b61ca700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b006ac40 0x7fe0b013e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b006ac40 msgr2=0x7fe0b013e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b006ac40 0x7fe0b013e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 msgr2=0x7fe0b015cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 0x7fe0b015cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 -- 172.21.15.50:0/1348514741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009ae0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b69cb700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 0x7fe0b015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b59c9700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0006b00 tx=0x7fe0a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00125f0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0012770 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0012b30 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b015a170 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.017+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b015a730 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b00cc6b0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 57) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fe0a001e460 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0a67fc700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 0x7fe094062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0b61ca700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 msgr2=0x7fe094062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7fe0a007cfe0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.021+0000 7fe0b61ca700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 0x7fe094062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:24.028 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:24.025+0000 7f2a190eb000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:54:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.029+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0a004d2d0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.225+0000 7fe0b61ca700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 msgr2=0x7fe094062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.225+0000 7fe0b61ca700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 0x7fe094062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:54:24.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.373+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe0b015ac10 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.381+0000 7fe0a67fc700 1 -- 172.21.15.50:0/1348514741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe0a00508f0 con 0x7fe0b00cf4d0 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.385+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 msgr2=0x7fe094062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.385+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 0x7fe094062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.385+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 msgr2=0x7fe0b015c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.385+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0006b00 tx=0x7fe0a0008040 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 shutdown_connections 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0940605a0 0x7fe094062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b00cf8a0 0x7fe0b015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b00cf4d0 0x7fe0b015c730 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 --2- 172.21.15.50:0/1348514741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0b006ac40 0x7fe0b013e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 >> 172.21.15.50:0/1348514741 conn(0x7fe0b0067b30 msgr2=0x7fe0b01517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 shutdown_connections 2023-12-24T18:54:24.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.389+0000 7fe0b842e700 1 -- 172.21.15.50:0/1348514741 wait complete. 2023-12-24T18:54:24.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:54:24.528 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:24.523+0000 7f42bdb6c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:54:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.569+0000 7f3c9d2e3700 1 Processor -- start 2023-12-24T18:54:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.569+0000 7f3c9d2e3700 1 -- start start 2023-12-24T18:54:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9d2e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9d2e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c980b03b0 0x7f3c9806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9d2e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c980b0830 con 0x7f3c98156ba0 2023-12-24T18:54:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9d2e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9815cac0 con 0x7f3c980b03b0 2023-12-24T18:54:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9d2e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9815d980 con 0x7f3c9815d510 2023-12-24T18:54:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c97fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c98156ba0 0x7f3c98159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57314/0 (socket says 172.21.15.50:57314) 2023-12-24T18:54:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c97fff700 1 -- 172.21.15.50:0/4158131231 learned_addr learned my addr 172.21.15.50:0/4158131231 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c977fe700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9cae2700 1 --2- 172.21.15.50:0/4158131231 >> v2:172.21.15.82:3300/0 conn(0x7f3c980b03b0 0x7f3c9806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c96ffd700 1 -- 172.21.15.50:0/4158131231 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302800861 0 0) 0x7f3c88001110 con 0x7f3c98156ba0 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c96ffd700 1 -- 172.21.15.50:0/4158131231 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c80003570 con 0x7f3c98156ba0 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9cae2700 1 -- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 msgr2=0x7f3c980afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9cae2700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9cae2700 1 -- 172.21.15.50:0/4158131231 >> v1:172.21.15.50:6789/0 conn(0x7f3c98156ba0 legacy=0x7f3c98159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c9cae2700 1 -- 172.21.15.50:0/4158131231 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c98159f80 con 0x7f3c980b03b0 2023-12-24T18:54:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.573+0000 7f3c977fe700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9cae2700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c9806ae30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009e60 tx=0x7f3c90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d2e0e9600ee953 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c96ffd700 1 -- 172.21.15.50:0/4158131231 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000e070 con 0x7f3c980b03b0 2023-12-24T18:54:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c96ffd700 1 -- 172.21.15.50:0/4158131231 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9000bab0 con 0x7f3c980b03b0 2023-12-24T18:54:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c96ffd700 1 -- 172.21.15.50:0/4158131231 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000be70 con 0x7f3c980b03b0 2023-12-24T18:54:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 msgr2=0x7f3c9806ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c9806ae30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009e60 tx=0x7f3c90009780 comp rx=0 tx=0).stop 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/4158131231 shutdown_connections 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c9806ae30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/4158131231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/4158131231 >> 172.21.15.50:0/4158131231 conn(0x7f3c98068510 msgr2=0x7f3c980add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/4158131231 shutdown_connections 2023-12-24T18:54:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.577+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/4158131231 wait complete. 2023-12-24T18:54:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 Processor -- start 2023-12-24T18:54:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 -- start start 2023-12-24T18:54:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c980adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980c2d20 con 0x7f3c98156ba0 2023-12-24T18:54:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980c5e20 con 0x7f3c980b03b0 2023-12-24T18:54:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9d2e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980ae220 con 0x7f3c9815d510 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c97fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c980adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35632/0 (socket says 172.21.15.50:35632) 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c977fe700 1 -- 172.21.15.50:0/1087837590 learned_addr learned my addr 172.21.15.50:0/1087837590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.581+0000 7f3c9cae2700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 -- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 msgr2=0x7f3c980c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 -- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 msgr2=0x7f3c980adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c980adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 -- 172.21.15.50:0/1087837590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c009420 con 0x7f3c98156ba0 2023-12-24T18:54:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c97fff700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c980adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c977fe700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00ecb0 tx=0x7f3c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00c850 con 0x7f3c98156ba0 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c00c9b0 con 0x7f3c98156ba0 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c90009a20 con 0x7f3c98156ba0 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00cd30 con 0x7f3c98156ba0 2023-12-24T18:54:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9816dc90 con 0x7f3c98156ba0 2023-12-24T18:54:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.585+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9804be40 con 0x7f3c98156ba0 2023-12-24T18:54:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.589+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 57) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f3c8c013680 con 0x7f3c98156ba0 2023-12-24T18:54:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.589+0000 7f3c7ffff700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 0x7f3c84062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.589+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f3c8c07cd60 con 0x7f3c98156ba0 2023-12-24T18:54:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.589+0000 7f3c97fff700 1 -- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 msgr2=0x7f3c84062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.589+0000 7f3c97fff700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 0x7f3c84062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:24.597 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:24.591+0000 7f42bdb6c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:54:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.597+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3c8c050a80 con 0x7f3c98156ba0 2023-12-24T18:54:24.741 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:24.735+0000 7f42bdb6c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:54:24.756 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:24.753+0000 7f2a190eb000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:54:24.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.773+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f3c9815a260 con 0x7f3c98156ba0 2023-12-24T18:54:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.785+0000 7f3c7ffff700 1 -- 172.21.15.50:0/1087837590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3c8c050610 con 0x7f3c98156ba0 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 msgr2=0x7f3c84062a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 0x7f3c84062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 msgr2=0x7f3c980c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00ecb0 tx=0x7f3c8c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 shutdown_connections 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3c840605d0 0x7f3c84062a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c9815d510 0x7f3c980c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98156ba0 0x7f3c980c5240 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 --2- 172.21.15.50:0/1087837590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c980b03b0 0x7f3c980adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 >> 172.21.15.50:0/1087837590 conn(0x7f3c98068510 msgr2=0x7f3c98155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 shutdown_connections 2023-12-24T18:54:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:24.789+0000 7f3c9d2e3700 1 -- 172.21.15.50:0/1087837590 wait complete. 2023-12-24T18:54:24.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:24.813 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T18:54:24.839 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:24.837+0000 7f2a190eb000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:54:24.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-12-24T18:54:24.993 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:24.989+0000 7f2a190eb000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:54:25.029 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.023+0000 7f42bdb6c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:54:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 Processor -- start 2023-12-24T18:54:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 -- start start 2023-12-24T18:54:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f790c15c3d0 0x7f790c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c06b6b0 con 0x7f790c0cb2b0 2023-12-24T18:54:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c0cba20 con 0x7f790c15c7a0 2023-12-24T18:54:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f791206e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c06c250 con 0x7f790c15c3d0 2023-12-24T18:54:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f790bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f790c0cb2b0 0x7f790c0cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57330/0 (socket says 172.21.15.50:57330) 2023-12-24T18:54:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f790bfff700 1 -- 172.21.15.50:0/1773614118 learned_addr learned my addr 172.21.15.50:0/1773614118 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.061+0000 7f790b7fe700 1 --2- 172.21.15.50:0/1773614118 >> v2:172.21.15.82:3300/0 conn(0x7f790c15c3d0 0x7f790c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280732798 0 0) 0x7f790c06b6b0 con 0x7f790c0cb2b0 2023-12-24T18:54:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f4003570 con 0x7f790c0cb2b0 2023-12-24T18:54:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874885662 0 0) 0x7f790c0cba20 con 0x7f790c15c7a0 2023-12-24T18:54:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c06b6b0 con 0x7f790c15c7a0 2023-12-24T18:54:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790b7fe700 1 -- 172.21.15.50:0/1773614118 >> v1:172.21.15.82:6789/0 conn(0x7f790c15c7a0 legacy=0x7f790c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790b7fe700 1 -- 172.21.15.50:0/1773614118 >> v1:172.21.15.50:6789/0 conn(0x7f790c0cb2b0 legacy=0x7f790c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790b7fe700 1 -- 172.21.15.50:0/1773614118 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c06ad80 con 0x7f790c15c3d0 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790b7fe700 1 --2- 172.21.15.50:0/1773614118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c15c3d0 0x7f790c15d810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e8bdcaf065d1139 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011630 con 0x7f790c15c3d0 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc011790 con 0x7f790c15c3d0 2023-12-24T18:54:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f790a7fc700 1 -- 172.21.15.50:0/1773614118 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011b30 con 0x7f790c15c3d0 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 -- 172.21.15.50:0/1773614118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c15c3d0 msgr2=0x7f790c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 --2- 172.21.15.50:0/1773614118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c15c3d0 0x7f790c15d810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 -- 172.21.15.50:0/1773614118 shutdown_connections 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 --2- 172.21.15.50:0/1773614118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c15c3d0 0x7f790c15d810 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 -- 172.21.15.50:0/1773614118 >> 172.21.15.50:0/1773614118 conn(0x7f790c0670b0 msgr2=0x7f790c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 -- 172.21.15.50:0/1773614118 shutdown_connections 2023-12-24T18:54:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.065+0000 7f791206e700 1 -- 172.21.15.50:0/1773614118 wait complete. 2023-12-24T18:54:25.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 Processor -- start 2023-12-24T18:54:25.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 -- start start 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c0cb2b0 0x7f790c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0af640 0x7f790c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c90d0 con 0x7f790c15c7a0 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c93b0 con 0x7f790c0cb2b0 2023-12-24T18:54:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f791206e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c9690 con 0x7f790c0af640 2023-12-24T18:54:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f790affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f790affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35642/0 (socket says 172.21.15.50:35642) 2023-12-24T18:54:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f790affd700 1 -- 172.21.15.50:0/46474783 learned_addr learned my addr 172.21.15.50:0/46474783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c0cb2b0 0x7f790c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.069+0000 7f790bfff700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0af640 0x7f790c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0af640 msgr2=0x7f790c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0af640 0x7f790c0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c0cb2b0 msgr2=0x7f790c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c0cb2b0 0x7f790c0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc009420 con 0x7f790c15c7a0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f790affd700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f790000c790 tx=0x7f7900007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900010510 con 0x7f790c15c7a0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900010670 con 0x7f790c15c7a0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0c9970 con 0x7f790c15c7a0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900010a10 con 0x7f790c15c7a0 2023-12-24T18:54:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0c8de0 con 0x7f790c15c7a0 2023-12-24T18:54:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.073+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c071060 con 0x7f790c15c7a0 2023-12-24T18:54:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.077+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 57) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f790001b3b0 con 0x7f790c15c7a0 2023-12-24T18:54:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.077+0000 7f78f37fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.077+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f790007c400 con 0x7f790c15c7a0 2023-12-24T18:54:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.077+0000 7f790b7fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.077+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:54:25.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.081+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f790004c690 con 0x7f790c15c7a0 2023-12-24T18:54:25.104 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.099+0000 7f42bdb6c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:54:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.281+0000 7f790b7fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.281+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:54:25.335 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.331+0000 7f42bdb6c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:54:25.345 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:25.341+0000 7f2a190eb000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:54:25.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.369+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f790c06a930 con 0x7f78f80605a0 2023-12-24T18:54:25.423 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:25.421+0000 7f2a190eb000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:54:25.424 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.419+0000 7f42bdb6c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:54:25.510 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.507+0000 7f42bdb6c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:54:25.655 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:25.653+0000 7f2a190eb000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:54:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.685+0000 7f790b7fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:25.685+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:54:25.742 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:25.741+0000 7f2a190eb000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:54:25.836 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:25.833+0000 7f2a190eb000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:54:25.914 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:25.911+0000 7f42bdb6c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:54:26.092 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.087+0000 7f42bdb6c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:54:26.260 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:26.257+0000 7f2a190eb000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:54:26.433 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:26.429+0000 7f2a190eb000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:54:26.465 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.459+0000 7f42bdb6c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:54:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:26.489+0000 7f790b7fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:26.489+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:54:26.671 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.667+0000 7f42bdb6c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:54:26.761 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.755+0000 7f42bdb6c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:54:26.831 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:26.829+0000 7f2a190eb000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:54:26.835 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.831+0000 7f42bdb6c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:54:26.912 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:26.907+0000 7f42bdb6c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:54:27.058 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.057+0000 7f2a190eb000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:54:27.130 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:27.127+0000 7f42bdb6c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:54:27.151 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.149+0000 7f2a190eb000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:54:27.208 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:27.203+0000 7f42bdb6c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:54:27.242 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.237+0000 7f2a190eb000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:54:27.296 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:27.291+0000 7f42bdb6c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:54:27.328 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.325+0000 7f2a190eb000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:54:27.503 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:27.499+0000 7f42bdb6c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:54:27.569 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.565+0000 7f2a190eb000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:54:27.594 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:27.591+0000 7f42bdb6c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:54:27.660 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.657+0000 7f2a190eb000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:54:27.751 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.749+0000 7f2a190eb000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:54:27.952 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:27.949+0000 7f2a190eb000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:54:28.039 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.037+0000 7f2a190eb000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:54:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.093+0000 7f790b7fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:54:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.093+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:54:28.315 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:54:28.311+0000 7f42bdb6c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:54:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.381+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 58) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f790004ca60 con 0x7f790c15c7a0 2023-12-24T18:54:28.791 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.789+0000 7f2a190eb000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.805+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 59) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f7900056ea0 con 0x7f790c15c7a0 2023-12-24T18:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.805+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f8062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:28.805+0000 7f78f37fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:28.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:54:28.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29db6d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29db6d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29db6d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29db6d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29db6d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29d8ed3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29d8ed3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.984 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29d8ed3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.985 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29d8ed3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:28.985 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:54:28.981+0000 7f29d8ed3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:54:29.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.813+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 60) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f790004d330 con 0x7f790c15c7a0 2023-12-24T18:54:29.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.813+0000 7f78f37fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f80629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:29.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.813+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f790c06a930 con 0x7f78f80605a0 2023-12-24T18:54:29.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.817+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f80629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:29.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.821+0000 7f790b7fe700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f80629d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f790c0684a0 tx=0x7f78fc017000 comp rx=0 tx=0).ready entity=mgr.7974 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:29.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.925+0000 7f78f37fe700 1 -- 172.21.15.50:0/46474783 <== mgr.7974 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f790c06a930 con 0x7f78f80605a0 2023-12-24T18:54:29.928 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T18:54:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 msgr2=0x7f78f80629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f80629d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f790c0684a0 tx=0x7f78fc017000 comp rx=0 tx=0).stop 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 msgr2=0x7f790c0c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f790000c790 tx=0x7f7900007e10 comp rx=0 tx=0).stop 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 shutdown_connections 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f78f80605a0 0x7f78f80629d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0af640 0x7f790c0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f790c15c7a0 0x7f790c0c88a0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:29.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 --2- 172.21.15.50:0/46474783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c0cb2b0 0x7f790c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 >> 172.21.15.50:0/46474783 conn(0x7f790c0670b0 msgr2=0x7f790c15b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 shutdown_connections 2023-12-24T18:54:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:29.929+0000 7f791206e700 1 -- 172.21.15.50:0/46474783 wait complete. 2023-12-24T18:54:29.956 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T18:54:29.957 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-12-24-18_55_00 in ~31s... 2023-12-24T18:54:29.957 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-12-24T18:54:29.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-12-24T18:54:30.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.137+0000 7f3b2682e700 1 Processor -- start 2023-12-24T18:54:30.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.137+0000 7f3b2682e700 1 -- start start 2023-12-24T18:54:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b2682e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 0x7f3b2015d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b2682e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 0x7f3b200cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b2682e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2006b6b0 con 0x7f3b2015c7a0 2023-12-24T18:54:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b2682e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2006c250 con 0x7f3b2015c3d0 2023-12-24T18:54:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b2682e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200cba20 con 0x7f3b200cb2b0 2023-12-24T18:54:30.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b1ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 0x7f3b2015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b24dcb700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 0x7f3b200cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b177fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3b2015c7a0 0x7f3b2006bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40512/0 (socket says 172.21.15.50:40512) 2023-12-24T18:54:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b177fe700 1 -- 172.21.15.50:0/2051598160 learned_addr learned my addr 172.21.15.50:0/2051598160 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b1f7fe700 1 -- 172.21.15.50:0/2051598160 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559854861 0 0) 0x7f3b2006b6b0 con 0x7f3b2015c7a0 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b1f7fe700 1 -- 172.21.15.50:0/2051598160 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003570 con 0x7f3b2015c7a0 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b24dcb700 1 -- 172.21.15.50:0/2051598160 >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 msgr2=0x7f3b2015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b24dcb700 1 --2- 172.21.15.50:0/2051598160 >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 0x7f3b2015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b24dcb700 1 -- 172.21.15.50:0/2051598160 >> v1:172.21.15.82:6789/0 conn(0x7f3b2015c7a0 legacy=0x7f3b2006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b24dcb700 1 -- 172.21.15.50:0/2051598160 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2006ad80 con 0x7f3b200cb2b0 2023-12-24T18:54:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.141+0000 7f3b1ffff700 1 --2- 172.21.15.50:0/2051598160 >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 0x7f3b2015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:54:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b24dcb700 1 --2- 172.21.15.50:0/2051598160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 0x7f3b200cc870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009e60 tx=0x7f3b18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af669de336778db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b1f7fe700 1 -- 172.21.15.50:0/2051598160 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800e070 con 0x7f3b200cb2b0 2023-12-24T18:54:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b1f7fe700 1 -- 172.21.15.50:0/2051598160 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1800bab0 con 0x7f3b200cb2b0 2023-12-24T18:54:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b1f7fe700 1 -- 172.21.15.50:0/2051598160 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800be70 con 0x7f3b200cb2b0 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 -- 172.21.15.50:0/2051598160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 msgr2=0x7f3b200cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2051598160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 0x7f3b200cc870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009e60 tx=0x7f3b18009780 comp rx=0 tx=0).stop 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 -- 172.21.15.50:0/2051598160 shutdown_connections 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2051598160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b200cb2b0 0x7f3b200cc870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2051598160 >> v2:172.21.15.82:3300/0 conn(0x7f3b2015c3d0 0x7f3b2015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 -- 172.21.15.50:0/2051598160 >> 172.21.15.50:0/2051598160 conn(0x7f3b200670b0 msgr2=0x7f3b200674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 -- 172.21.15.50:0/2051598160 shutdown_connections 2023-12-24T18:54:30.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.145+0000 7f3b2682e700 1 -- 172.21.15.50:0/2051598160 wait complete. 2023-12-24T18:54:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 Processor -- start 2023-12-24T18:54:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 -- start start 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b2015c3d0 0x7f3b200c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b2015c7a0 0x7f3b200c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201580f0 con 0x7f3b200cb2b0 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200c85b0 con 0x7f3b2015c7a0 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b2682e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2008ad80 con 0x7f3b2015c3d0 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b1ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b1ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36268/0 (socket says 172.21.15.50:36268) 2023-12-24T18:54:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.149+0000 7f3b1ffff700 1 -- 172.21.15.50:0/2508057744 learned_addr learned my addr 172.21.15.50:0/2508057744 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:54:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b24dcb700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b2015c7a0 0x7f3b200c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b177fe700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b2015c3d0 0x7f3b200c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 -- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b2015c3d0 msgr2=0x7f3b200c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b2015c3d0 0x7f3b200c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 -- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b2015c7a0 msgr2=0x7f3b200c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b2015c7a0 0x7f3b200c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 -- 172.21.15.50:0/2508057744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009420 con 0x7f3b200cb2b0 2023-12-24T18:54:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1ffff700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000ecb0 tx=0x7f3b100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000c920 con 0x7f3b200cb2b0 2023-12-24T18:54:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1000ca80 con 0x7f3b200cb2b0 2023-12-24T18:54:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b18009a20 con 0x7f3b200cb2b0 2023-12-24T18:54:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000ce00 con 0x7f3b200cb2b0 2023-12-24T18:54:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.153+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b200c79a0 con 0x7f3b200cb2b0 2023-12-24T18:54:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20071060 con 0x7f3b200cb2b0 2023-12-24T18:54:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 60) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f3b10013680 con 0x7f3b200cb2b0 2023-12-24T18:54:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b1cff9700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 0x7f3b040628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:54:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f3b1007cae0 con 0x7f3b200cb2b0 2023-12-24T18:54:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b177fe700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 0x7f3b040628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:54:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.157+0000 7f3b177fe700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 0x7f3b040628d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b200c7030 tx=0x7f3b08009040 comp rx=0 tx=0).ready entity=mgr.7974 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:54:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.165+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3b1004cfc0 con 0x7f3b200cb2b0 2023-12-24T18:54:30.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.365+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b200cbd70 con 0x7f3b04060420 2023-12-24T18:54:30.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.381+0000 7f3b1cff9700 1 -- 172.21.15.50:0/2508057744 <== mgr.7974 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f3b200cbd70 con 0x7f3b04060420 2023-12-24T18:54:30.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:54:30.383 INFO:teuthology.orchestra.run.smithi050.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-12-24T18:54:30.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 msgr2=0x7f3b040628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 0x7f3b040628d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b200c7030 tx=0x7f3b08009040 comp rx=0 tx=0).stop 2023-12-24T18:54:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 msgr2=0x7f3b2008a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:54:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000ecb0 tx=0x7f3b100091a0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 shutdown_connections 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3b04060420 0x7f3b040628d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b2015c7a0 0x7f3b200c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3b2015c3d0 0x7f3b200c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 --2- 172.21.15.50:0/2508057744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b200cb2b0 0x7f3b2008a840 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 >> 172.21.15.50:0/2508057744 conn(0x7f3b200670b0 msgr2=0x7f3b200b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 shutdown_connections 2023-12-24T18:54:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:54:30.385+0000 7f3b2682e700 1 -- 172.21.15.50:0/2508057744 wait complete. 2023-12-24T18:54:30.407 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-12-24T18:54:30.407 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-12-24T18:54:30.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:30.408 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:30.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:30.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:30.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:31.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:31.432 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:31.458 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:31.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:31.459 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:32.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:32.459 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:32.479 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:32.479 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:32.479 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:33.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:33.480 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:33.505 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:33.505 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:33.505 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:34.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:34.506 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:34.533 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:34.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:34.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:35.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:35.534 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:35.561 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:35.561 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:35.561 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:36.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:36.562 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:36.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:36.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:36.588 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:37.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:37.590 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:37.617 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:37.617 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:37.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:38.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:38.618 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:38.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:38.643 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:38.644 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:39.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:39.645 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:39.672 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:39.673 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:39.673 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:40.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:40.674 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:40.699 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:40.699 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:40.699 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:41.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:41.700 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:41.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:41.727 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:41.727 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:42.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:42.728 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:42.755 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:42.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:42.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:43.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:43.756 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:43.782 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:43.782 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:43.782 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:44.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:44.784 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:44.810 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:44.810 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:44.810 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:45.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:45.811 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:45.839 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:45.839 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:45.839 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:46.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:46.841 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:46.867 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:46.867 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:46.867 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:47.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:47.869 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:47.894 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:47.894 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:47.894 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:48.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:48.895 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:48.919 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:48.919 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:48.919 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:49.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:49.921 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:49.947 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:49.947 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:49.947 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:50.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:50.948 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:50.969 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:50.969 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:50.969 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:51.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:51.970 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:51.996 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:51.996 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:51.996 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:52.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:52.997 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:53.022 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:53.023 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:53.023 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:54.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:54.026 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:54.046 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:54.046 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:54.046 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:55.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:55.048 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:55.075 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:55.075 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:55.075 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:56.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:56.076 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:56.102 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:56.102 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:56.102 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:57.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:57.104 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:57.129 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:57.130 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:57.130 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:58.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:58.131 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:58.155 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:58.155 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:58.155 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:54:59.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:54:59.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:54:59.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:54:59.156 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:54:59.182 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:54:59.182 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:54:59.182 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:55:00.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:00.184 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:55:00.211 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T18:55:00.211 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T18:55:00.211 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:55:00.950 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:00.948+0000 7f29cbeb9700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:00.950 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:00.948+0000 7f29cbeb9700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:00.950 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:00.948+0000 7f29cbeb9700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:00.950 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:00.948+0000 7f29cbeb9700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:00.950 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:00.948+0000 7f29cbeb9700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:01.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:01.212 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:55:01.237 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_55_00_UTC 2023-12-24T18:55:01.239 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-18_55_00_UTC'} 2023-12-24T18:55:01.239 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-12-24-18_55_00_UTC'} 2023-12-24T18:55:01.239 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T18:55:01.240 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-12-24-18_55_00_UTC'] 2023-12-24T18:55:01.240 DEBUG:tasks.cephfs.test_snap_schedules:exec=1703444069.9569874, now = 1703444101.2400806, timo = 31 2023-12-24T18:55:02.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-12-24T18:55:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.416+0000 7f3bcef45700 1 Processor -- start 2023-12-24T18:55:02.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.416+0000 7f3bcef45700 1 -- start start 2023-12-24T18:55:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcef45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcef45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3bc806c820 0x7f3bc80c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcef45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc806b3e0 con 0x7f3bc806db90 2023-12-24T18:55:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcef45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc806bf80 con 0x7f3bc806c820 2023-12-24T18:55:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcef45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc806a7d0 con 0x7f3bc815d210 2023-12-24T18:55:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bbffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bc806db90 0x7f3bc806b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36606/0 (socket says 172.21.15.50:36606) 2023-12-24T18:55:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bbffff700 1 -- 172.21.15.50:0/1774026298 learned_addr learned my addr 172.21.15.50:0/1774026298 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bcd4e2700 1 --2- 172.21.15.50:0/1774026298 >> v2:172.21.15.50:3300/0 conn(0x7f3bc806c820 0x7f3bc80c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.420+0000 7f3bccce1700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bbf7fe700 1 -- 172.21.15.50:0/1774026298 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705697942 0 0) 0x7f3bc806b3e0 con 0x7f3bc806db90 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bbf7fe700 1 -- 172.21.15.50:0/1774026298 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb0003570 con 0x7f3bc806db90 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcd4e2700 1 -- 172.21.15.50:0/1774026298 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 msgr2=0x7f3bc815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcd4e2700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcd4e2700 1 -- 172.21.15.50:0/1774026298 >> v1:172.21.15.50:6789/0 conn(0x7f3bc806db90 legacy=0x7f3bc806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcd4e2700 1 -- 172.21.15.50:0/1774026298 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc806aab0 con 0x7f3bc806c820 2023-12-24T18:55:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcd4e2700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80c8640 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009e60 tx=0x7f3bc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45bb22f8eb39d04 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bbf7fe700 1 -- 172.21.15.50:0/1774026298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000e070 con 0x7f3bc806c820 2023-12-24T18:55:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bbf7fe700 1 -- 172.21.15.50:0/1774026298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000bab0 con 0x7f3bc806c820 2023-12-24T18:55:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bbf7fe700 1 -- 172.21.15.50:0/1774026298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000be50 con 0x7f3bc806c820 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 -- 172.21.15.50:0/1774026298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 msgr2=0x7f3bc80c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80c8640 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009e60 tx=0x7f3bc0009780 comp rx=0 tx=0).stop 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 -- 172.21.15.50:0/1774026298 shutdown_connections 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80c8640 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 --2- 172.21.15.50:0/1774026298 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 -- 172.21.15.50:0/1774026298 >> 172.21.15.50:0/1774026298 conn(0x7f3bc8067b80 msgr2=0x7f3bc80ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 -- 172.21.15.50:0/1774026298 shutdown_connections 2023-12-24T18:55:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.424+0000 7f3bcef45700 1 -- 172.21.15.50:0/1774026298 wait complete. 2023-12-24T18:55:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 Processor -- start 2023-12-24T18:55:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 -- start start 2023-12-24T18:55:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc806db90 0x7f3bc816dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc80c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80aca20 con 0x7f3bc806c820 2023-12-24T18:55:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80acd00 con 0x7f3bc806db90 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcef45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80acfe0 con 0x7f3bc815d210 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38022/0 (socket says 172.21.15.50:38022) 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 -- 172.21.15.50:0/2466754774 learned_addr learned my addr 172.21.15.50:0/2466754774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcd4e2700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc80c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bbffff700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc806db90 0x7f3bc816dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 -- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 msgr2=0x7f3bc80c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc80c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 -- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc806db90 msgr2=0x7f3bc816dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc806db90 0x7f3bc816dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bccce1700 1 -- 172.21.15.50:0/2466754774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009a20 con 0x7f3bc806c820 2023-12-24T18:55:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.428+0000 7f3bcd4e2700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc80c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bccce1700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e930 tx=0x7f3bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400eed0 con 0x7f3bc806c820 2023-12-24T18:55:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400c850 con 0x7f3bc806c820 2023-12-24T18:55:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80ad2c0 con 0x7f3bc806c820 2023-12-24T18:55:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400cbf0 con 0x7f3bc806c820 2023-12-24T18:55:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc816e0e0 con 0x7f3bc806c820 2023-12-24T18:55:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.432+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8071060 con 0x7f3bc806c820 2023-12-24T18:55:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.436+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 61) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f3bc4013470 con 0x7f3bc806c820 2023-12-24T18:55:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.436+0000 7f3bbcff9700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 0x7f3bb4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.436+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f3bc407d1a0 con 0x7f3bc806c820 2023-12-24T18:55:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.436+0000 7f3bbffff700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 0x7f3bb4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.440+0000 7f3bbffff700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 0x7f3bb4062c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3bc815ac40 tx=0x7f3bb8009040 comp rx=0 tx=0).ready entity=mgr.7974 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.444+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3bc404d0b0 con 0x7f3bc806c820 2023-12-24T18:55:02.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.640+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc806ad90 con 0x7f3bb4060750 2023-12-24T18:55:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.756+0000 7f3bbcff9700 1 -- 172.21.15.50:0/2466754774 <== mgr.7974 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3bc806ad90 con 0x7f3bb4060750 2023-12-24T18:55:02.761 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path snap_test_dir1 2023-12-24T18:55:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 msgr2=0x7f3bb4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 0x7f3bb4062c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3bc815ac40 tx=0x7f3bb8009040 comp rx=0 tx=0).stop 2023-12-24T18:55:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 msgr2=0x7f3bc80adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e930 tx=0x7f3bc40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 shutdown_connections 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3bb4060750 0x7f3bb4062c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3bc815d210 0x7f3bc80c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc806db90 0x7f3bc816dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 --2- 172.21.15.50:0/2466754774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bc806c820 0x7f3bc80adac0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 >> 172.21.15.50:0/2466754774 conn(0x7f3bc8067b80 msgr2=0x7f3bc8155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 shutdown_connections 2023-12-24T18:55:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:02.760+0000 7f3bcef45700 1 -- 172.21.15.50:0/2466754774 wait complete. 2023-12-24T18:55:02.788 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-12-24T18:55:02.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:02.789 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T18:55:02.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_55_00_UTC 2023-12-24T18:55:02.811 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_55_00_UTC 2023-12-24T18:55:02.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:02.812 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_55_00_UTC) 2023-12-24T18:55:02.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:02.887 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T18:55:02.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T18:55:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.180+0000 7f2c3346e700 1 Processor -- start 2023-12-24T18:55:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.180+0000 7f2c3346e700 1 -- start start 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c3346e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c2c06ae10 0x7f2c2c1683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c3346e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c15e960 con 0x7f2c2c160af0 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c3346e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c15fe00 con 0x7f2c2c160720 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c3346e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c1600a0 con 0x7f2c2c06ae10 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c30a09700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2c2c160af0 0x7f2c2c06a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36622/0 (socket says 172.21.15.50:36622) 2023-12-24T18:55:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c30a09700 1 -- 172.21.15.50:0/2328948501 learned_addr learned my addr 172.21.15.50:0/2328948501 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c31a0b700 1 --2- 172.21.15.50:0/2328948501 >> v2:172.21.15.82:3300/0 conn(0x7f2c2c06ae10 0x7f2c2c1683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c23fff700 1 -- 172.21.15.50:0/2328948501 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966619971 0 0) 0x7f2c2c15e960 con 0x7f2c2c160af0 2023-12-24T18:55:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c23fff700 1 -- 172.21.15.50:0/2328948501 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c18003570 con 0x7f2c2c160af0 2023-12-24T18:55:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c31a0b700 1 -- 172.21.15.50:0/2328948501 >> v1:172.21.15.82:6789/0 conn(0x7f2c2c160720 legacy=0x7f2c2c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c31a0b700 1 -- 172.21.15.50:0/2328948501 >> v1:172.21.15.50:6789/0 conn(0x7f2c2c160af0 legacy=0x7f2c2c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c31a0b700 1 -- 172.21.15.50:0/2328948501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c15dd50 con 0x7f2c2c06ae10 2023-12-24T18:55:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.184+0000 7f2c31a0b700 1 --2- 172.21.15.50:0/2328948501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c1683a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009e60 tx=0x7f2c24009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ced34a4be995c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c23fff700 1 -- 172.21.15.50:0/2328948501 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400e070 con 0x7f2c2c06ae10 2023-12-24T18:55:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c23fff700 1 -- 172.21.15.50:0/2328948501 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400bb60 con 0x7f2c2c06ae10 2023-12-24T18:55:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c23fff700 1 -- 172.21.15.50:0/2328948501 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24012430 con 0x7f2c2c06ae10 2023-12-24T18:55:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 -- 172.21.15.50:0/2328948501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 msgr2=0x7f2c2c1683a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 --2- 172.21.15.50:0/2328948501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c1683a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009e60 tx=0x7f2c24009780 comp rx=0 tx=0).stop 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 -- 172.21.15.50:0/2328948501 shutdown_connections 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 --2- 172.21.15.50:0/2328948501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c1683a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 -- 172.21.15.50:0/2328948501 >> 172.21.15.50:0/2328948501 conn(0x7f2c2c067b80 msgr2=0x7f2c2c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 -- 172.21.15.50:0/2328948501 shutdown_connections 2023-12-24T18:55:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.188+0000 7f2c3346e700 1 -- 172.21.15.50:0/2328948501 wait complete. 2023-12-24T18:55:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 Processor -- start 2023-12-24T18:55:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 -- start start 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c13f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c160720 0x7f2c2c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c16e6d0 con 0x7f2c2c160af0 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c156e30 con 0x7f2c2c06ae10 2023-12-24T18:55:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3346e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c156180 con 0x7f2c2c160720 2023-12-24T18:55:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c31a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c31a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38028/0 (socket says 172.21.15.50:38028) 2023-12-24T18:55:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c31a0b700 1 -- 172.21.15.50:0/299927946 learned_addr learned my addr 172.21.15.50:0/299927946 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c3120a700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c13f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.192+0000 7f2c30a09700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c160720 0x7f2c2c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 -- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c160720 msgr2=0x7f2c2c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c160720 0x7f2c2c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 -- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 msgr2=0x7f2c2c13f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c13f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 -- 172.21.15.50:0/299927946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24009a20 con 0x7f2c2c160af0 2023-12-24T18:55:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c31a0b700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c069b20 tx=0x7f2c24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24027470 con 0x7f2c2c160af0 2023-12-24T18:55:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c24027630 con 0x7f2c2c160af0 2023-12-24T18:55:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c156460 con 0x7f2c2c160af0 2023-12-24T18:55:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c240279f0 con 0x7f2c2c160af0 2023-12-24T18:55:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c156ac0 con 0x7f2c2c160af0 2023-12-24T18:55:03.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.196+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c156fe0 con 0x7f2c2c160af0 2023-12-24T18:55:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.200+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 62) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f2c24024070 con 0x7f2c2c160af0 2023-12-24T18:55:03.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.200+0000 7f2c217fa700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 0x7f2c10062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:03.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.200+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f2c2407f660 con 0x7f2c2c160af0 2023-12-24T18:55:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.200+0000 7f2c3120a700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 0x7f2c10062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.204+0000 7f2c3120a700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 0x7f2c10062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c161c00 tx=0x7f2c28009040 comp rx=0 tx=0).ready entity=mgr.7974 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:03.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.208+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c2c156fe0 con 0x7f2c2c160af0 2023-12-24T18:55:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.424+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2c2c159b00 con 0x7f2c2c160af0 2023-12-24T18:55:03.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.920+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f2c24003040 con 0x7f2c2c160af0 2023-12-24T18:55:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.920+0000 7f2c217fa700 1 -- 172.21.15.50:0/299927946 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v63) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2c2404f560 con 0x7f2c2c160af0 2023-12-24T18:55:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 msgr2=0x7f2c10062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 0x7f2c10062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c161c00 tx=0x7f2c28009040 comp rx=0 tx=0).stop 2023-12-24T18:55:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 msgr2=0x7f2c2c16e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c069b20 tx=0x7f2c24019000 comp rx=0 tx=0).stop 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 shutdown_connections 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2c100607e0 0x7f2c10062c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c2c160af0 0x7f2c2c16e190 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c160720 0x7f2c2c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 --2- 172.21.15.50:0/299927946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ae10 0x7f2c2c13f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 >> 172.21.15.50:0/299927946 conn(0x7f2c2c067b80 msgr2=0x7f2c2c152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 shutdown_connections 2023-12-24T18:55:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:03.924+0000 7f2c3346e700 1 -- 172.21.15.50:0/299927946 wait complete. 2023-12-24T18:55:03.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:55:03.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:55:03.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:55:04.023 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:55:04.023 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T18:55:04.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:04.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T18:55:04.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T18:55:04.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:04.077 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T18:55:04.122 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:04.118+0000 7f2f759d0000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:55:04.128 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:04.120+0000 7f7d3befe000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:55:04.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.352+0000 7f2e0a3c5700 1 Processor -- start 2023-12-24T18:55:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.352+0000 7f2e0a3c5700 1 -- start start 2023-12-24T18:55:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e040c96d0 0x7f2e040b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 0x7f2e040b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0415b2a0 con 0x7f2e04154830 2023-12-24T18:55:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e040c9040 con 0x7f2e040c96d0 2023-12-24T18:55:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040c9eb0 con 0x7f2e0415b730 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e040c96d0 0x7f2e040b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e040c96d0 0x7f2e040b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38048/0 (socket says 172.21.15.50:38048) 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 -- 172.21.15.50:0/1906964974 learned_addr learned my addr 172.21.15.50:0/1906964974 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e08962700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 0x7f2e040b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 -- 172.21.15.50:0/1906964974 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 msgr2=0x7f2e040b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 0x7f2e040b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 -- 172.21.15.50:0/1906964974 >> v1:172.21.15.50:6789/0 conn(0x7f2e04154830 legacy=0x7f2e04157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 -- 172.21.15.50:0/1906964974 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040c9bd0 con 0x7f2e040c96d0 2023-12-24T18:55:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e08962700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 0x7f2e040b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e037fe700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e040c96d0 0x7f2e040b1da0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2df80099b0 tx=0x7f2df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255caa3637e37f3b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e02ffd700 1 -- 172.21.15.50:0/1906964974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800b860 con 0x7f2e040c96d0 2023-12-24T18:55:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e02ffd700 1 -- 172.21.15.50:0/1906964974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b9c0 con 0x7f2e040c96d0 2023-12-24T18:55:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e02ffd700 1 -- 172.21.15.50:0/1906964974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800bd60 con 0x7f2e040c96d0 2023-12-24T18:55:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/1906964974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e040c96d0 msgr2=0x7f2e040b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e040c96d0 0x7f2e040b1da0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2df80099b0 tx=0x7f2df8009250 comp rx=0 tx=0).stop 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/1906964974 shutdown_connections 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e0415b730 0x7f2e040b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/1906964974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e040c96d0 0x7f2e040b1da0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/1906964974 >> 172.21.15.50:0/1906964974 conn(0x7f2e040677c0 msgr2=0x7f2e04067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/1906964974 shutdown_connections 2023-12-24T18:55:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.356+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/1906964974 wait complete. 2023-12-24T18:55:04.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 Processor -- start 2023-12-24T18:55:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 -- start start 2023-12-24T18:55:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e040c96d0 0x7f2e040aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0415b730 0x7f2e0416cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04158770 con 0x7f2e04154830 2023-12-24T18:55:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040ab310 con 0x7f2e0415b730 2023-12-24T18:55:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.360+0000 7f2e0a3c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04158160 con 0x7f2e040c96d0 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38054/0 (socket says 172.21.15.50:38054) 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e03fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e040c96d0 0x7f2e040aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 -- 172.21.15.50:0/2325085960 learned_addr learned my addr 172.21.15.50:0/2325085960 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e08962700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0415b730 0x7f2e0416cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e040c96d0 msgr2=0x7f2e040aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e040c96d0 0x7f2e040aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0415b730 msgr2=0x7f2e0416cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0415b730 0x7f2e0416cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 -- 172.21.15.50:0/2325085960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80094f0 con 0x7f2e04154830 2023-12-24T18:55:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e037fe700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009290 tx=0x7f2df8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8011e00 con 0x7f2e04154830 2023-12-24T18:55:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df801f070 con 0x7f2e04154830 2023-12-24T18:55:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80266d0 con 0x7f2e04154830 2023-12-24T18:55:04.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040a9930 con 0x7f2e04154830 2023-12-24T18:55:04.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.364+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04158400 con 0x7f2e04154830 2023-12-24T18:55:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04157fc0 con 0x7f2e04154830 2023-12-24T18:55:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f2df8026a40 con 0x7f2e04154830 2023-12-24T18:55:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2debfff700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 0x7f2df0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f2df8021070 con 0x7f2e04154830 2023-12-24T18:55:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2e03fff700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 msgr2=0x7f2df0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.368+0000 7f2e03fff700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 0x7f2df0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.376+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2e04157fc0 con 0x7f2e04154830 2023-12-24T18:55:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.572+0000 7f2e03fff700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 msgr2=0x7f2df0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.572+0000 7f2e03fff700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 0x7f2df0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:04.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e04157fc0 con 0x7f2e04154830 2023-12-24T18:55:04.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2debfff700 1 -- 172.21.15.50:0/2325085960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2e04157fc0 con 0x7f2e04154830 2023-12-24T18:55:04.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:04.591 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 msgr2=0x7f2df0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 0x7f2df0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 msgr2=0x7f2e041466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009290 tx=0x7f2df8017000 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 shutdown_connections 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2df0060790 0x7f2df0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0415b730 0x7f2e0416cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e04154830 0x7f2e041466e0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 --2- 172.21.15.50:0/2325085960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e040c96d0 0x7f2e040aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.588+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 >> 172.21.15.50:0/2325085960 conn(0x7f2e040677c0 msgr2=0x7f2e04153730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:04.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.592+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 shutdown_connections 2023-12-24T18:55:04.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.592+0000 7f2e0a3c5700 1 -- 172.21.15.50:0/2325085960 wait complete. 2023-12-24T18:55:04.596 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:55:04.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:04.646 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:04.642+0000 7f2f759d0000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:55:04.700 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:04.696+0000 7f7d3befe000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:55:04.722 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:04.718+0000 7f2f759d0000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:55:04.776 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:04.772+0000 7f7d3befe000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:55:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.776+0000 7f8a455c5700 1 Processor -- start 2023-12-24T18:55:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.776+0000 7f8a455c5700 1 -- start start 2023-12-24T18:55:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a455c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a400b1ad0 0x7f8a4006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a455c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a400ae8c0 0x7f8a4006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a455c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4015b860 con 0x7f8a4006d140 2023-12-24T18:55:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a455c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4015ac50 con 0x7f8a400ae8c0 2023-12-24T18:55:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a455c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4015af30 con 0x7f8a400b1ad0 2023-12-24T18:55:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a400b1ad0 0x7f8a4006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a400ae8c0 0x7f8a4006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a400b1ad0 0x7f8a4006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51238/0 (socket says 172.21.15.50:51238) 2023-12-24T18:55:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 -- 172.21.15.50:0/3179136403 learned_addr learned my addr 172.21.15.50:0/3179136403 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 -- 172.21.15.50:0/3179136403 >> v2:172.21.15.50:3300/0 conn(0x7f8a400ae8c0 msgr2=0x7f8a4006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 --2- 172.21.15.50:0/3179136403 >> v2:172.21.15.50:3300/0 conn(0x7f8a400ae8c0 0x7f8a4006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 -- 172.21.15.50:0/3179136403 >> v1:172.21.15.82:6789/0 conn(0x7f8a4006d140 legacy=0x7f8a400b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.780+0000 7f8a3e7fc700 1 -- 172.21.15.50:0/3179136403 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4015b210 con 0x7f8a400b1ad0 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a3e7fc700 1 --2- 172.21.15.50:0/3179136403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400b1ad0 0x7f8a4006d510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8a400ca7c0 tx=0x7f8a34009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b830a15220b5f98 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a3dffb700 1 -- 172.21.15.50:0/3179136403 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34009e70 con 0x7f8a400b1ad0 2023-12-24T18:55:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a3dffb700 1 -- 172.21.15.50:0/3179136403 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3400b860 con 0x7f8a400b1ad0 2023-12-24T18:55:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a3dffb700 1 -- 172.21.15.50:0/3179136403 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400bc00 con 0x7f8a400b1ad0 2023-12-24T18:55:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 -- 172.21.15.50:0/3179136403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400b1ad0 msgr2=0x7f8a4006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 --2- 172.21.15.50:0/3179136403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400b1ad0 0x7f8a4006d510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8a400ca7c0 tx=0x7f8a34009250 comp rx=0 tx=0).stop 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 -- 172.21.15.50:0/3179136403 shutdown_connections 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 --2- 172.21.15.50:0/3179136403 >> v2:172.21.15.50:3300/0 conn(0x7f8a400ae8c0 0x7f8a4006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 --2- 172.21.15.50:0/3179136403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400b1ad0 0x7f8a4006d510 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 -- 172.21.15.50:0/3179136403 >> 172.21.15.50:0/3179136403 conn(0x7f8a4006ae30 msgr2=0x7f8a400adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 -- 172.21.15.50:0/3179136403 shutdown_connections 2023-12-24T18:55:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.784+0000 7f8a455c5700 1 -- 172.21.15.50:0/3179136403 wait complete. 2023-12-24T18:55:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 Processor -- start 2023-12-24T18:55:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 -- start start 2023-12-24T18:55:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a4006d140 0x7f8a40141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 0x7f8a401546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 0x7f8a40152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400abcd0 con 0x7f8a400b1ad0 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401424f0 con 0x7f8a400ae8c0 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a455c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4015a920 con 0x7f8a4006d140 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a3f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 0x7f8a40152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.788+0000 7f8a3e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 0x7f8a401546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 0x7f8a401546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51250/0 (socket says 172.21.15.50:51250) 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3e7fc700 1 -- 172.21.15.50:0/1196453475 learned_addr learned my addr 172.21.15.50:0/1196453475 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3effd700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a4006d140 0x7f8a40141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 -- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a4006d140 msgr2=0x7f8a40141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a4006d140 0x7f8a40141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 -- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 msgr2=0x7f8a401546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 0x7f8a401546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 -- 172.21.15.50:0/1196453475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340094f0 con 0x7f8a400b1ad0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a3f7fe700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 0x7f8a40152690 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800b200 tx=0x7f8a3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38015070 con 0x7f8a400b1ad0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3800bd40 con 0x7f8a400b1ad0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38019640 con 0x7f8a400b1ad0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a400abf20 con 0x7f8a400b1ad0 2023-12-24T18:55:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a400ac4e0 con 0x7f8a400b1ad0 2023-12-24T18:55:04.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.792+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4004be40 con 0x7f8a400b1ad0 2023-12-24T18:55:04.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.796+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f8a380199f0 con 0x7f8a400b1ad0 2023-12-24T18:55:04.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.800+0000 7f8a26ffd700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 0x7f8a2c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:04.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.800+0000 7f8a3effd700 1 -- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 msgr2=0x7f8a2c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:04.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.800+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f8a38081770 con 0x7f8a400b1ad0 2023-12-24T18:55:04.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.800+0000 7f8a3effd700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 0x7f8a2c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.804+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8a38051560 con 0x7f8a400b1ad0 2023-12-24T18:55:04.858 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:04.854+0000 7f2f759d0000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:04.940 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:04.936+0000 7f7d3befe000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:04.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.984+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a4015b4f0 con 0x7f8a400b1ad0 2023-12-24T18:55:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.984+0000 7f8a26ffd700 1 -- 172.21.15.50:0/1196453475 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16459 (secure 0 0 0) 0x7f8a38054b80 con 0x7f8a400b1ad0 2023-12-24T18:55:04.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:04.989 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":126,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:28.796323+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/862400766":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/3959562728":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/2441810003":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/4062947908":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6837/33814":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6836/33814":"2023-12-25T18:54:28.796263+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 msgr2=0x7f8a2c062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 0x7f8a2c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 msgr2=0x7f8a40152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 0x7f8a40152690 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800b200 tx=0x7f8a3800b040 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 shutdown_connections 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a2c060790 0x7f8a2c062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a400b1ad0 0x7f8a40152690 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a400ae8c0 0x7f8a401546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 --2- 172.21.15.50:0/1196453475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a4006d140 0x7f8a40141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 >> 172.21.15.50:0/1196453475 conn(0x7f8a4006ae30 msgr2=0x7f8a401551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 shutdown_connections 2023-12-24T18:55:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:04.988+0000 7f8a455c5700 1 -- 172.21.15.50:0/1196453475 wait complete. 2023-12-24T18:55:05.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:54:11.834496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:54:12.761835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T18:55:05.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:55:05.111 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.106+0000 7f2f759d0000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:55:05.182 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.178+0000 7f2f759d0000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:05.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.180+0000 7f54d0878700 1 Processor -- start 2023-12-24T18:55:05.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.180+0000 7f54d0878700 1 -- start start 2023-12-24T18:55:05.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54d0878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc158e00 0x7f54cc0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54d0878700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54cc06ae20 0x7f54cc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54d0878700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc0b3fd0 con 0x7f54cc06c820 2023-12-24T18:55:05.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54d0878700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0b33c0 con 0x7f54cc06ae20 2023-12-24T18:55:05.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54d0878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0b36a0 con 0x7f54cc158e00 2023-12-24T18:55:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc158e00 0x7f54cc0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54cad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54cc06ae20 0x7f54cc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54c9d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f54cc06c820 0x7f54cc06a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:58356/0 (socket says 172.21.15.50:58356) 2023-12-24T18:55:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54c9d9b700 1 -- 172.21.15.50:0/4096795784 learned_addr learned my addr 172.21.15.50:0/4096795784 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54cad9d700 1 -- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc158e00 msgr2=0x7f54cc0b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54cad9d700 1 --2- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc158e00 0x7f54cc0b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54cad9d700 1 -- 172.21.15.50:0/4096795784 >> v1:172.21.15.82:6789/0 conn(0x7f54cc06c820 legacy=0x7f54cc06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54cad9d700 1 -- 172.21.15.50:0/4096795784 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0b3980 con 0x7f54cc06ae20 2023-12-24T18:55:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.184+0000 7f54c959a700 1 -- 172.21.15.50:0/4096795784 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75955388 0 0) 0x7f54cc0b3fd0 con 0x7f54cc06c820 2023-12-24T18:55:05.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54cad9d700 1 --2- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc06ae20 0x7f54cc0b4460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009e60 tx=0x7f54c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d74e33e742e8c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54c959a700 1 -- 172.21.15.50:0/4096795784 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400e070 con 0x7f54cc06ae20 2023-12-24T18:55:05.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54c959a700 1 -- 172.21.15.50:0/4096795784 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400bb60 con 0x7f54cc06ae20 2023-12-24T18:55:05.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54c959a700 1 -- 172.21.15.50:0/4096795784 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4012430 con 0x7f54cc06ae20 2023-12-24T18:55:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 -- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc06ae20 msgr2=0x7f54cc0b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 --2- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc06ae20 0x7f54cc0b4460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009e60 tx=0x7f54c4009780 comp rx=0 tx=0).stop 2023-12-24T18:55:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 -- 172.21.15.50:0/4096795784 shutdown_connections 2023-12-24T18:55:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 --2- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc06ae20 0x7f54cc0b4460 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 --2- 172.21.15.50:0/4096795784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc158e00 0x7f54cc0b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 -- 172.21.15.50:0/4096795784 >> 172.21.15.50:0/4096795784 conn(0x7f54cc067b80 msgr2=0x7f54cc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 -- 172.21.15.50:0/4096795784 shutdown_connections 2023-12-24T18:55:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.188+0000 7f54d0878700 1 -- 172.21.15.50:0/4096795784 wait complete. 2023-12-24T18:55:05.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 Processor -- start 2023-12-24T18:55:05.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 -- start start 2023-12-24T18:55:05.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc06c820 0x7f54cc14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 0x7f54cc14aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14ee00 con 0x7f54cc06ae20 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14f0e0 con 0x7f54cc158e00 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54d0878700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14f3c0 con 0x7f54cc06c820 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54cad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 0x7f54cc14aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38062/0 (socket says 172.21.15.50:38062) 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 -- 172.21.15.50:0/626487925 learned_addr learned my addr 172.21.15.50:0/626487925 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54c9d9b700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc06c820 0x7f54cc14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 -- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc06c820 msgr2=0x7f54cc14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc06c820 0x7f54cc14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 -- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 msgr2=0x7f54cc14aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 0x7f54cc14aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 -- 172.21.15.50:0/626487925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4009a20 con 0x7f54cc06ae20 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54cad9d700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 0x7f54cc14aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.192+0000 7f54ca59c700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00ec80 tx=0x7f54bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00c850 con 0x7f54cc06ae20 2023-12-24T18:55:05.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00c9b0 con 0x7f54cc06ae20 2023-12-24T18:55:05.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc14f6a0 con 0x7f54cc06ae20 2023-12-24T18:55:05.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00cd50 con 0x7f54cc06ae20 2023-12-24T18:55:05.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc14eb10 con 0x7f54cc06ae20 2023-12-24T18:55:05.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc0652e0 con 0x7f54cc06ae20 2023-12-24T18:55:05.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.196+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f54bc013680 con 0x7f54cc06ae20 2023-12-24T18:55:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.200+0000 7f54ba7fc700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 0x7f54ac062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.200+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f54bc07d1a0 con 0x7f54cc06ae20 2023-12-24T18:55:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.200+0000 7f54c9d9b700 1 -- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 msgr2=0x7f54ac062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.200+0000 7f54c9d9b700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 0x7f54ac062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.204+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f54bc04d0a0 con 0x7f54cc06ae20 2023-12-24T18:55:05.237 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:05.232+0000 7f7d3befe000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:55:05.323 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:05.320+0000 7f7d3befe000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:05.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.376+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54cc15c1f0 con 0x7f54cc06ae20 2023-12-24T18:55:05.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.380+0000 7f54ba7fc700 1 -- 172.21.15.50:0/626487925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54bc0506c0 con 0x7f54cc06ae20 2023-12-24T18:55:05.382 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:55:05.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 msgr2=0x7f54ac062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:05.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 0x7f54ac062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 msgr2=0x7f54cc14e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00ec80 tx=0x7f54bc0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 shutdown_connections 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f54ac060790 0x7f54ac062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc158e00 0x7f54cc14aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54cc06c820 0x7f54cc14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 --2- 172.21.15.50:0/626487925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54cc06ae20 0x7f54cc14e090 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 >> 172.21.15.50:0/626487925 conn(0x7f54cc067b80 msgr2=0x7f54cc15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 shutdown_connections 2023-12-24T18:55:05.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.384+0000 7f54d0878700 1 -- 172.21.15.50:0/626487925 wait complete. 2023-12-24T18:55:05.389 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.386+0000 7f2f759d0000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:55:05.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T18:55:05.472 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.466+0000 7f2f759d0000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:55:05.553 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.546+0000 7f2f759d0000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:55:05.558 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:05.556+0000 7f7d3befe000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:55:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.576+0000 7fc203fff700 1 Processor -- start 2023-12-24T18:55:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.576+0000 7fc203fff700 1 -- start start 2023-12-24T18:55:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc203fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2040cc780 0x7fc2040ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc203fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc20406cd40 0x7fc20406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc203fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20406a580 con 0x7fc204158c40 2023-12-24T18:55:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc203fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040cd110 con 0x7fc2040cc780 2023-12-24T18:55:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc203fff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20406d700 con 0x7fc20406cd40 2023-12-24T18:55:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2040cc780 0x7fc2040ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2040cc780 0x7fc2040ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38076/0 (socket says 172.21.15.50:38076) 2023-12-24T18:55:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 -- 172.21.15.50:0/487824254 learned_addr learned my addr 172.21.15.50:0/487824254 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2037fe700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc20406cd40 0x7fc20406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 -- 172.21.15.50:0/487824254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc20406cd40 msgr2=0x7fc20406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc20406cd40 0x7fc20406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 -- 172.21.15.50:0/487824254 >> v1:172.21.15.82:6789/0 conn(0x7fc204158c40 legacy=0x7fc2040cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 -- 172.21.15.50:0/487824254 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20406a7d0 con 0x7fc2040cc780 2023-12-24T18:55:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc2027fc700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2040cc780 0x7fc2040ccbd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80099b0 tx=0x7fc1f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5f7a801b4a9e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc201ffb700 1 -- 172.21.15.50:0/487824254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800b860 con 0x7fc2040cc780 2023-12-24T18:55:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc201ffb700 1 -- 172.21.15.50:0/487824254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800b9c0 con 0x7fc2040cc780 2023-12-24T18:55:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.580+0000 7fc201ffb700 1 -- 172.21.15.50:0/487824254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800bd60 con 0x7fc2040cc780 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- 172.21.15.50:0/487824254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2040cc780 msgr2=0x7fc2040ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2040cc780 0x7fc2040ccbd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80099b0 tx=0x7fc1f8009250 comp rx=0 tx=0).stop 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- 172.21.15.50:0/487824254 shutdown_connections 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc20406cd40 0x7fc20406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 --2- 172.21.15.50:0/487824254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2040cc780 0x7fc2040ccbd0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- 172.21.15.50:0/487824254 >> 172.21.15.50:0/487824254 conn(0x7fc2040d0800 msgr2=0x7fc2040b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- 172.21.15.50:0/487824254 shutdown_connections 2023-12-24T18:55:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- 172.21.15.50:0/487824254 wait complete. 2023-12-24T18:55:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 Processor -- start 2023-12-24T18:55:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.584+0000 7fc203fff700 1 -- start start 2023-12-24T18:55:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2040cc780 0x7fc20416d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc204158c40 0x7fc20416e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20415c700 con 0x7fc20406cd40 2023-12-24T18:55:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2041531a0 con 0x7fc204158c40 2023-12-24T18:55:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20416d9d0 con 0x7fc2040cc780 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38084/0 (socket says 172.21.15.50:38084) 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 -- 172.21.15.50:0/3903639570 learned_addr learned my addr 172.21.15.50:0/3903639570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc2037fe700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc204158c40 0x7fc20416e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc2027fc700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2040cc780 0x7fc20416d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 -- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2040cc780 msgr2=0x7fc20416d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2040cc780 0x7fc20416d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 -- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc204158c40 msgr2=0x7fc20416e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc204158c40 0x7fc20416e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 -- 172.21.15.50:0/3903639570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80094f0 con 0x7fc20406cd40 2023-12-24T18:55:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc202ffd700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c4e0 tx=0x7fc1f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4011590 con 0x7fc20406cd40 2023-12-24T18:55:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f4011710 con 0x7fc20406cd40 2023-12-24T18:55:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4011ad0 con 0x7fc20406cd40 2023-12-24T18:55:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20416f200 con 0x7fc20406cd40 2023-12-24T18:55:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.588+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20416f7c0 con 0x7fc20406cd40 2023-12-24T18:55:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.592+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20404be40 con 0x7fc20406cd40 2023-12-24T18:55:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.592+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fc1f401b3b0 con 0x7fc20406cd40 2023-12-24T18:55:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.596+0000 7fc1eaffd700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 0x7fc1f0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.596+0000 7fc2027fc700 1 -- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 msgr2=0x7fc1f0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.596+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fc1f407c340 con 0x7fc20406cd40 2023-12-24T18:55:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.596+0000 7fc2027fc700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 0x7fc1f0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:05.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.600+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc1f404c240 con 0x7fc20406cd40 2023-12-24T18:55:05.650 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:05.644+0000 7f7d3befe000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:55:05.743 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:05.740+0000 7f7d3befe000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:55:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.772+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc20406aab0 con 0x7fc20406cd40 2023-12-24T18:55:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.772+0000 7fc1eaffd700 1 -- 172.21.15.50:0/3903639570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1f404f860 con 0x7fc20406cd40 2023-12-24T18:55:05.778 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T18:55:05.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 msgr2=0x7fc1f0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:05.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 0x7fc1f0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 msgr2=0x7fc20416b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c4e0 tx=0x7fc1f400c7f0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 shutdown_connections 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc1f0060790 0x7fc1f0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc204158c40 0x7fc20416e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2040cc780 0x7fc20416d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 --2- 172.21.15.50:0/3903639570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc20406cd40 0x7fc20416b790 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 >> 172.21.15.50:0/3903639570 conn(0x7fc2040d0800 msgr2=0x7fc204155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 shutdown_connections 2023-12-24T18:55:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.776+0000 7fc203fff700 1 -- 172.21.15.50:0/3903639570 wait complete. 2023-12-24T18:55:05.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T18:55:05.922 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:05.918+0000 7f2f759d0000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:55:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.964+0000 7fe83982e700 1 Processor -- start 2023-12-24T18:55:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.964+0000 7fe83982e700 1 -- start start 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe83982e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 0x7fe8340b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe83982e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe83406c820 0x7fe8340b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe83982e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8340b3fd0 con 0x7fe834158e00 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe83982e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340b33c0 con 0x7fe83406c820 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe83982e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340b36a0 con 0x7fe83406ae20 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe832ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe834158e00 0x7fe83406a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36642/0 (socket says 172.21.15.50:36642) 2023-12-24T18:55:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe832ffd700 1 -- 172.21.15.50:0/1548011327 learned_addr learned my addr 172.21.15.50:0/1548011327 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 --2- 172.21.15.50:0/1548011327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 0x7fe8340b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8337fe700 1 --2- 172.21.15.50:0/1548011327 >> v2:172.21.15.82:3300/0 conn(0x7fe83406c820 0x7fe8340b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe831ffb700 1 -- 172.21.15.50:0/1548011327 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524025339 0 0) 0x7fe8340b3fd0 con 0x7fe834158e00 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 -- 172.21.15.50:0/1548011327 >> v2:172.21.15.82:3300/0 conn(0x7fe83406c820 msgr2=0x7fe8340b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 --2- 172.21.15.50:0/1548011327 >> v2:172.21.15.82:3300/0 conn(0x7fe83406c820 0x7fe8340b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 -- 172.21.15.50:0/1548011327 >> v1:172.21.15.50:6789/0 conn(0x7fe834158e00 legacy=0x7fe83406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 -- 172.21.15.50:0/1548011327 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340b3980 con 0x7fe83406ae20 2023-12-24T18:55:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe8327fc700 1 --2- 172.21.15.50:0/1548011327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 0x7fe8340b2de0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8280098e0 tx=0x7fe8280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695e67dc44714deb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe831ffb700 1 -- 172.21.15.50:0/1548011327 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800b640 con 0x7fe83406ae20 2023-12-24T18:55:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe831ffb700 1 -- 172.21.15.50:0/1548011327 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82800b7a0 con 0x7fe83406ae20 2023-12-24T18:55:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.968+0000 7fe831ffb700 1 -- 172.21.15.50:0/1548011327 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800bb40 con 0x7fe83406ae20 2023-12-24T18:55:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- 172.21.15.50:0/1548011327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 msgr2=0x7fe8340b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 --2- 172.21.15.50:0/1548011327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 0x7fe8340b2de0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8280098e0 tx=0x7fe8280091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- 172.21.15.50:0/1548011327 shutdown_connections 2023-12-24T18:55:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 --2- 172.21.15.50:0/1548011327 >> v2:172.21.15.82:3300/0 conn(0x7fe83406c820 0x7fe8340b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 --2- 172.21.15.50:0/1548011327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe83406ae20 0x7fe8340b2de0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- 172.21.15.50:0/1548011327 >> 172.21.15.50:0/1548011327 conn(0x7fe834067b80 msgr2=0x7fe8340cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- 172.21.15.50:0/1548011327 shutdown_connections 2023-12-24T18:55:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- 172.21.15.50:0/1548011327 wait complete. 2023-12-24T18:55:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 Processor -- start 2023-12-24T18:55:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.972+0000 7fe83982e700 1 -- start start 2023-12-24T18:55:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83406c820 0x7fe83414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe834158e00 0x7fe83414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834156530 con 0x7fe83406ae20 2023-12-24T18:55:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341481c0 con 0x7fe83406c820 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe834156200 con 0x7fe834158e00 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38100/0 (socket says 172.21.15.50:38100) 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe8327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83406c820 0x7fe83414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 -- 172.21.15.50:0/2527647452 learned_addr learned my addr 172.21.15.50:0/2527647452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe8337fe700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe834158e00 0x7fe83414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 -- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe834158e00 msgr2=0x7fe83414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe834158e00 0x7fe83414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 -- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83406c820 msgr2=0x7fe83414aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83406c820 0x7fe83414aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 -- 172.21.15.50:0/2527647452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009420 con 0x7fe83406ae20 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe832ffd700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c7e0 tx=0x7fe824007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824005b30 con 0x7fe83406ae20 2023-12-24T18:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824005c90 con 0x7fe83406ae20 2023-12-24T18:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824007300 con 0x7fe83406ae20 2023-12-24T18:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83416a240 con 0x7fe83406ae20 2023-12-24T18:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.976+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83414da40 con 0x7fe83406ae20 2023-12-24T18:55:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8340652e0 con 0x7fe83406ae20 2023-12-24T18:55:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fe82401b3b0 con 0x7fe83406ae20 2023-12-24T18:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe81affd700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 0x7fe820062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fe82407c490 con 0x7fe83406ae20 2023-12-24T18:55:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe8327fc700 1 -- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 msgr2=0x7fe820062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.980+0000 7fe8327fc700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 0x7fe820062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:05.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:05.988+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe82404c360 con 0x7fe83406ae20 2023-12-24T18:55:06.094 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.090+0000 7f2f759d0000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:55:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.164+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe83415c180 con 0x7fe83406ae20 2023-12-24T18:55:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.164+0000 7fe81affd700 1 -- 172.21.15.50:0/2527647452 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe824001d60 con 0x7fe83406ae20 2023-12-24T18:55:06.167 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T18:55:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 msgr2=0x7fe820062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 0x7fe820062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 msgr2=0x7fe834169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c7e0 tx=0x7fe824007df0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 shutdown_connections 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe820060790 0x7fe820062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe834158e00 0x7fe83414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83406c820 0x7fe83414aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 --2- 172.21.15.50:0/2527647452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83406ae20 0x7fe834169d00 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 >> 172.21.15.50:0/2527647452 conn(0x7fe834067b80 msgr2=0x7fe8341596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 shutdown_connections 2023-12-24T18:55:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.168+0000 7fe83982e700 1 -- 172.21.15.50:0/2527647452 wait complete. 2023-12-24T18:55:06.175 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:06.172+0000 7f7d3befe000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:55:06.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:06.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.344+0000 7f7d248f0700 1 Processor -- start 2023-12-24T18:55:06.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.344+0000 7f7d248f0700 1 -- start start 2023-12-24T18:55:06.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d200b1ba0 0x7f7d200b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d200b41d0 con 0x7f7d20158e10 2023-12-24T18:55:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d200b49c0 con 0x7f7d200b1ba0 2023-12-24T18:55:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2006d040 con 0x7f7d2015d6d0 2023-12-24T18:55:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d20158e10 0x7f7d2006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36654/0 (socket says 172.21.15.50:36654) 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1e59c700 1 -- 172.21.15.50:0/3315017201 learned_addr learned my addr 172.21.15.50:0/3315017201 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 --2- 172.21.15.50:0/3315017201 >> v2:172.21.15.50:3300/0 conn(0x7f7d200b1ba0 0x7f7d200b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1dd9b700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 -- 172.21.15.50:0/3315017201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 msgr2=0x7f7d200b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 -- 172.21.15.50:0/3315017201 >> v1:172.21.15.50:6789/0 conn(0x7f7d20158e10 legacy=0x7f7d2006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 -- 172.21.15.50:0/3315017201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2006d5c0 con 0x7f7d200b1ba0 2023-12-24T18:55:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1ed9d700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d200b1ba0 0x7f7d200b2020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009e60 tx=0x7f7d18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a0027df58b028f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1d59a700 1 -- 172.21.15.50:0/3315017201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800e070 con 0x7f7d200b1ba0 2023-12-24T18:55:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1d59a700 1 -- 172.21.15.50:0/3315017201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1800bb60 con 0x7f7d200b1ba0 2023-12-24T18:55:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d1d59a700 1 -- 172.21.15.50:0/3315017201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18012430 con 0x7f7d200b1ba0 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 -- 172.21.15.50:0/3315017201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d200b1ba0 msgr2=0x7f7d200b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.348+0000 7f7d248f0700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d200b1ba0 0x7f7d200b2020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009e60 tx=0x7f7d18009780 comp rx=0 tx=0).stop 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- 172.21.15.50:0/3315017201 shutdown_connections 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d200b1ba0 0x7f7d200b2020 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 --2- 172.21.15.50:0/3315017201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- 172.21.15.50:0/3315017201 >> 172.21.15.50:0/3315017201 conn(0x7f7d200670b0 msgr2=0x7f7d200674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- 172.21.15.50:0/3315017201 shutdown_connections 2023-12-24T18:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- 172.21.15.50:0/3315017201 wait complete. 2023-12-24T18:55:06.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d3befe000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:55:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 Processor -- start 2023-12-24T18:55:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- start start 2023-12-24T18:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 0x7f7d20151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2015b3d0 con 0x7f7d20158e10 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d201520b0 con 0x7f7d200b1ba0 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.352+0000 7f7d248f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200ac580 con 0x7f7d2015d6d0 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38104/0 (socket says 172.21.15.50:38104) 2023-12-24T18:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 -- 172.21.15.50:0/2622637900 learned_addr learned my addr 172.21.15.50:0/2622637900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1e59c700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 0x7f7d20151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1ed9d700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 msgr2=0x7f7d200a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 msgr2=0x7f7d20151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 0x7f7d20151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 -- 172.21.15.50:0/2622637900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18009a20 con 0x7f7d20158e10 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1e59c700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 0x7f7d20151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1ed9d700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d1dd9b700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e930 tx=0x7f7d140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400eed0 con 0x7f7d20158e10 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400c850 con 0x7f7d20158e10 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2015b670 con 0x7f7d20158e10 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400cbf0 con 0x7f7d20158e10 2023-12-24T18:55:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d200aab50 con 0x7f7d20158e10 2023-12-24T18:55:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.356+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2015baf0 con 0x7f7d20158e10 2023-12-24T18:55:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.360+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f7d14013470 con 0x7f7d20158e10 2023-12-24T18:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.360+0000 7f7d0e7fc700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 0x7f7d00062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.360+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f7d1407d190 con 0x7f7d20158e10 2023-12-24T18:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.360+0000 7f7d1e59c700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 msgr2=0x7f7d00062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.360+0000 7f7d1e59c700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 0x7f7d00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.368+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d1404d090 con 0x7f7d20158e10 2023-12-24T18:55:06.463 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.458+0000 7f2f759d0000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:55:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.564+0000 7f7d1e59c700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 msgr2=0x7f7d00062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.564+0000 7f7d1e59c700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 0x7f7d00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:06.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.580+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d200652e0 con 0x7f7d20158e10 2023-12-24T18:55:06.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.580+0000 7f7d0e7fc700 1 -- 172.21.15.50:0/2622637900 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7d140506b0 con 0x7f7d20158e10 2023-12-24T18:55:06.584 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:06.584 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 msgr2=0x7f7d00062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 0x7f7d00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 msgr2=0x7f7d200abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e930 tx=0x7f7d140091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 shutdown_connections 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d00060790 0x7f7d00062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2015d6d0 0x7f7d200a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d20158e10 0x7f7d200abab0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 --2- 172.21.15.50:0/2622637900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d200b1ba0 0x7f7d20151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 >> 172.21.15.50:0/2622637900 conn(0x7f7d200670b0 msgr2=0x7f7d20067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 shutdown_connections 2023-12-24T18:55:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.584+0000 7f7d248f0700 1 -- 172.21.15.50:0/2622637900 wait complete. 2023-12-24T18:55:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:55:06.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:06.687 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.682+0000 7f2f759d0000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:06.756 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:06.752+0000 7f7d3befe000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:55:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 Processor -- start 2023-12-24T18:55:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 -- start start 2023-12-24T18:55:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7b015a2d0 0x7ff7b00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 0x7ff7b00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00b0460 con 0x7ff7b00adc90 2023-12-24T18:55:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b006d8c0 con 0x7ff7b015a2d0 2023-12-24T18:55:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7b4a16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00afc60 con 0x7ff7b006c820 2023-12-24T18:55:06.777 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.770+0000 7f2f759d0000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:55:06.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7affff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7b00adc90 0x7ff7b00b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36656/0 (socket says 172.21.15.50:36656) 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7affff700 1 -- 172.21.15.50:0/1678726510 learned_addr learned my addr 172.21.15.50:0/1678726510 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7af7fe700 1 --2- 172.21.15.50:0/1678726510 >> v2:172.21.15.82:3300/0 conn(0x7ff7b015a2d0 0x7ff7b00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/1678726510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 0x7ff7b00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7ae7fc700 1 -- 172.21.15.50:0/1678726510 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271223841 0 0) 0x7ff7b00b0460 con 0x7ff7b00adc90 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.772+0000 7ff7ae7fc700 1 -- 172.21.15.50:0/1678726510 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff798003570 con 0x7ff7b00adc90 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7aeffd700 1 -- 172.21.15.50:0/1678726510 >> v2:172.21.15.82:3300/0 conn(0x7ff7b015a2d0 msgr2=0x7ff7b00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/1678726510 >> v2:172.21.15.82:3300/0 conn(0x7ff7b015a2d0 0x7ff7b00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7aeffd700 1 -- 172.21.15.50:0/1678726510 >> v1:172.21.15.50:6789/0 conn(0x7ff7b00adc90 legacy=0x7ff7b00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7aeffd700 1 -- 172.21.15.50:0/1678726510 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00ae100 con 0x7ff7b006c820 2023-12-24T18:55:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/1678726510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 0x7ff7b00ad750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098e0 tx=0x7ff7a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d74c1e2830968 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7ae7fc700 1 -- 172.21.15.50:0/1678726510 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4011630 con 0x7ff7b006c820 2023-12-24T18:55:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7ae7fc700 1 -- 172.21.15.50:0/1678726510 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4011790 con 0x7ff7b006c820 2023-12-24T18:55:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7ae7fc700 1 -- 172.21.15.50:0/1678726510 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4011b30 con 0x7ff7b006c820 2023-12-24T18:55:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 -- 172.21.15.50:0/1678726510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 msgr2=0x7ff7b00ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/1678726510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 0x7ff7b00ad750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098e0 tx=0x7ff7a40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 -- 172.21.15.50:0/1678726510 shutdown_connections 2023-12-24T18:55:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/1678726510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b006c820 0x7ff7b00ad750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/1678726510 >> v2:172.21.15.82:3300/0 conn(0x7ff7b015a2d0 0x7ff7b00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 -- 172.21.15.50:0/1678726510 >> 172.21.15.50:0/1678726510 conn(0x7ff7b0067b80 msgr2=0x7ff7b00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:06.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 -- 172.21.15.50:0/1678726510 shutdown_connections 2023-12-24T18:55:06.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.776+0000 7ff7b4a16700 1 -- 172.21.15.50:0/1678726510 wait complete. 2023-12-24T18:55:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 Processor -- start 2023-12-24T18:55:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 -- start start 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 0x7ff7b014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b015a2d0 0x7ff7b01559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b014f500 con 0x7ff7b00adc90 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0150340 con 0x7ff7b006c820 2023-12-24T18:55:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7b4a16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b014f730 con 0x7ff7b015a2d0 2023-12-24T18:55:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38118/0 (socket says 172.21.15.50:38118) 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 -- 172.21.15.50:0/4101351135 learned_addr learned my addr 172.21.15.50:0/4101351135 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7af7fe700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 0x7ff7b014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7affff700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b015a2d0 0x7ff7b01559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 -- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b015a2d0 msgr2=0x7ff7b01559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b015a2d0 0x7ff7b01559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 -- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 msgr2=0x7ff7b014bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 0x7ff7b014bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.780+0000 7ff7aeffd700 1 -- 172.21.15.50:0/4101351135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4009420 con 0x7ff7b00adc90 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7af7fe700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 0x7ff7b014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7aeffd700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff7b006d870 tx=0x7ff7a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4011900 con 0x7ff7b00adc90 2023-12-24T18:55:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4011a60 con 0x7ff7b00adc90 2023-12-24T18:55:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4025640 con 0x7ff7b00adc90 2023-12-24T18:55:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b014fa10 con 0x7ff7b00adc90 2023-12-24T18:55:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b014ffd0 con 0x7ff7b00adc90 2023-12-24T18:55:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.784+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b01504b0 con 0x7ff7b00adc90 2023-12-24T18:55:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.788+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7ff7a4025a30 con 0x7ff7b00adc90 2023-12-24T18:55:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.788+0000 7ff7977fe700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 0x7ff79c062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.788+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7ff7a407e590 con 0x7ff7b00adc90 2023-12-24T18:55:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.788+0000 7ff7af7fe700 1 -- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 msgr2=0x7ff79c062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.788+0000 7ff7af7fe700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 0x7ff79c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:06.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.796+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff7a404e530 con 0x7ff7b00adc90 2023-12-24T18:55:06.854 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.850+0000 7f2f759d0000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:55:06.936 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:06.930+0000 7f2f759d0000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:55:06.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.968+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b004be40 con 0x7ff7b00adc90 2023-12-24T18:55:06.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.968+0000 7ff7977fe700 1 -- 172.21.15.50:0/4101351135 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16459 (secure 0 0 0) 0x7ff7a4051b50 con 0x7ff7b00adc90 2023-12-24T18:55:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:06.974 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":126,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:28.796323+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/862400766":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/3959562728":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/2441810003":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/4062947908":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6837/33814":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6836/33814":"2023-12-25T18:54:28.796263+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 msgr2=0x7ff79c062c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 0x7ff79c062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 msgr2=0x7ff7b0155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff7b006d870 tx=0x7ff7a4017000 comp rx=0 tx=0).stop 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 shutdown_connections 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff79c0607c0 0x7ff79c062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7b015a2d0 0x7ff7b01559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00adc90 0x7ff7b0155480 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 --2- 172.21.15.50:0/4101351135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7b006c820 0x7ff7b014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 >> 172.21.15.50:0/4101351135 conn(0x7ff7b0067b80 msgr2=0x7ff7b014da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 shutdown_connections 2023-12-24T18:55:06.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:06.972+0000 7ff7b4a16700 1 -- 172.21.15.50:0/4101351135 wait complete. 2023-12-24T18:55:06.997 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T18:55:06.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:07.005 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.000+0000 7f7d3befe000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:07.106 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.104+0000 7f7d3befe000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:55:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.160+0000 7f67db6f0700 1 Processor -- start 2023-12-24T18:55:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.160+0000 7f67db6f0700 1 -- start start 2023-12-24T18:55:07.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67db6f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d406def0 0x7f67d4168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67db6f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d406ca50 con 0x7f67d40ca3a0 2023-12-24T18:55:07.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67db6f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d406b520 con 0x7f67d40ca770 2023-12-24T18:55:07.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67db6f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40c6980 con 0x7f67d406def0 2023-12-24T18:55:07.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d948c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67d40ca3a0 0x7f67d406ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36670/0 (socket says 172.21.15.50:36670) 2023-12-24T18:55:07.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d948c700 1 -- 172.21.15.50:0/2940988283 learned_addr learned my addr 172.21.15.50:0/2940988283 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:07.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d9c8d700 1 --2- 172.21.15.50:0/2940988283 >> v2:172.21.15.50:3300/0 conn(0x7f67d406def0 0x7f67d4168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603192601 0 0) 0x7f67d406ca50 con 0x7f67d40ca3a0 2023-12-24T18:55:07.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c0003570 con 0x7f67d40ca3a0 2023-12-24T18:55:07.169 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:07.162+0000 7f2f759d0000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:07.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674564469 0 0) 0x7f67d406b520 con 0x7f67d40ca770 2023-12-24T18:55:07.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d406ca50 con 0x7f67d40ca770 2023-12-24T18:55:07.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d9c8d700 1 -- 172.21.15.50:0/2940988283 >> v1:172.21.15.82:6789/0 conn(0x7f67d40ca770 legacy=0x7f67d415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d9c8d700 1 -- 172.21.15.50:0/2940988283 >> v1:172.21.15.50:6789/0 conn(0x7f67d40ca3a0 legacy=0x7f67d406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.164+0000 7f67d9c8d700 1 -- 172.21.15.50:0/2940988283 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d406b7f0 con 0x7f67d406def0 2023-12-24T18:55:07.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67d9c8d700 1 --2- 172.21.15.50:0/2940988283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d406def0 0x7f67d4168380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009e90 tx=0x7f67cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641b2b00d6e0f5b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:07.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00e070 con 0x7f67d406def0 2023-12-24T18:55:07.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00bb90 con 0x7f67d406def0 2023-12-24T18:55:07.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67cbfff700 1 -- 172.21.15.50:0/2940988283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc012430 con 0x7f67d406def0 2023-12-24T18:55:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 -- 172.21.15.50:0/2940988283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d406def0 msgr2=0x7f67d4168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 --2- 172.21.15.50:0/2940988283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d406def0 0x7f67d4168380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009e90 tx=0x7f67cc009780 comp rx=0 tx=0).stop 2023-12-24T18:55:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 -- 172.21.15.50:0/2940988283 shutdown_connections 2023-12-24T18:55:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 --2- 172.21.15.50:0/2940988283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d406def0 0x7f67d4168380 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 -- 172.21.15.50:0/2940988283 >> 172.21.15.50:0/2940988283 conn(0x7f67d40cbba0 msgr2=0x7f67d40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:07.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 -- 172.21.15.50:0/2940988283 shutdown_connections 2023-12-24T18:55:07.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.168+0000 7f67db6f0700 1 -- 172.21.15.50:0/2940988283 wait complete. 2023-12-24T18:55:07.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 Processor -- start 2023-12-24T18:55:07.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 -- start start 2023-12-24T18:55:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d406def0 0x7f67d416d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d40ca770 0x7f67d416e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d416e5f0 con 0x7f67d40ca3a0 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d416dd50 con 0x7f67d406def0 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d416e030 con 0x7f67d40ca770 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38126/0 (socket says 172.21.15.50:38126) 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 -- 172.21.15.50:0/1796099528 learned_addr learned my addr 172.21.15.50:0/1796099528 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d9c8d700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d40ca770 0x7f67d416e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d948c700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d406def0 0x7f67d416d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d40ca770 msgr2=0x7f67d416e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d40ca770 0x7f67d416e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d406def0 msgr2=0x7f67d416d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d406def0 0x7f67d416d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 -- 172.21.15.50:0/1796099528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc009a20 con 0x7f67d40ca3a0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67d8c8b700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c580 tx=0x7f67c4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4010510 con 0x7f67d40ca3a0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c4010670 con 0x7f67d40ca3a0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4010a30 con 0x7f67d40ca3a0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.172+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d416e310 con 0x7f67d40ca3a0 2023-12-24T18:55:07.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d416ed60 con 0x7f67d40ca3a0 2023-12-24T18:55:07.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d40652e0 con 0x7f67d40ca3a0 2023-12-24T18:55:07.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f67c401b400 con 0x7f67d40ca3a0 2023-12-24T18:55:07.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67c97fa700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 0x7f67b8062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f67c407cbe0 con 0x7f67d40ca3a0 2023-12-24T18:55:07.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67d948c700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 msgr2=0x7f67b8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:07.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.176+0000 7f67d948c700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 0x7f67b8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.188+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f67c404cae0 con 0x7f67d40ca3a0 2023-12-24T18:55:07.195 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.192+0000 7f7d3befe000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:55:07.247 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:07.242+0000 7f2f759d0000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:55:07.285 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.280+0000 7f7d3befe000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:55:07.340 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:07.334+0000 7f2f759d0000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:55:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.380+0000 7f67d948c700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 msgr2=0x7f67b8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.380+0000 7f67d948c700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 0x7f67b8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.400+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67d406bad0 con 0x7f67d40ca3a0 2023-12-24T18:55:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.400+0000 7f67c97fa700 1 -- 172.21.15.50:0/1796099528 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f67c4050100 con 0x7f67d40ca3a0 2023-12-24T18:55:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:07.404 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 msgr2=0x7f67b8062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 0x7f67b8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 msgr2=0x7f67d40c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c580 tx=0x7f67c4007e10 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 shutdown_connections 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f67b8060790 0x7f67b8062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d40ca770 0x7f67d416e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ca3a0 0x7f67d40c5530 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 --2- 172.21.15.50:0/1796099528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d406def0 0x7f67d416d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 >> 172.21.15.50:0/1796099528 conn(0x7f67d40cbba0 msgr2=0x7f67d40c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 shutdown_connections 2023-12-24T18:55:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.404+0000 7f67db6f0700 1 -- 172.21.15.50:0/1796099528 wait complete. 2023-12-24T18:55:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:55:07.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:07.528 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.524+0000 7f7d3befe000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:07.541 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:07.534+0000 7f2f759d0000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:55:07.619 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.616+0000 7f7d3befe000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:55:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 Processor -- start 2023-12-24T18:55:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 -- start start 2023-12-24T18:55:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd20158e10 0x7fcd2015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd200b1ba0 0x7fcd200b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2006d5c0 con 0x7fcd200b3c90 2023-12-24T18:55:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200b49c0 con 0x7fcd200b1ba0 2023-12-24T18:55:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd264cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2006d040 con 0x7fcd20158e10 2023-12-24T18:55:07.633 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:07.630+0000 7f2f759d0000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:55:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.628+0000 7fcd24a6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd200b1ba0 0x7fcd200b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd177fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcd200b3c90 0x7fcd2006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:58384/0 (socket says 172.21.15.50:58384) 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd177fe700 1 -- 172.21.15.50:0/992224758 learned_addr learned my addr 172.21.15.50:0/992224758 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1ffff700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd20158e10 0x7fcd2015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1f7fe700 1 -- 172.21.15.50:0/992224758 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737866456 0 0) 0x7fcd2006d5c0 con 0x7fcd200b3c90 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1f7fe700 1 -- 172.21.15.50:0/992224758 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c003570 con 0x7fcd200b3c90 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd24a6a700 1 -- 172.21.15.50:0/992224758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd20158e10 msgr2=0x7fcd2015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd24a6a700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd20158e10 0x7fcd2015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd24a6a700 1 -- 172.21.15.50:0/992224758 >> v1:172.21.15.82:6789/0 conn(0x7fcd200b3c90 legacy=0x7fcd2006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd24a6a700 1 -- 172.21.15.50:0/992224758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2015a1f0 con 0x7fcd200b1ba0 2023-12-24T18:55:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd24a6a700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b1ba0 0x7fcd200b2020 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcd180098e0 tx=0x7fcd180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87930dd770cd6a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1f7fe700 1 -- 172.21.15.50:0/992224758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18011630 con 0x7fcd200b1ba0 2023-12-24T18:55:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1f7fe700 1 -- 172.21.15.50:0/992224758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18011790 con 0x7fcd200b1ba0 2023-12-24T18:55:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd1f7fe700 1 -- 172.21.15.50:0/992224758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18011b30 con 0x7fcd200b1ba0 2023-12-24T18:55:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 -- 172.21.15.50:0/992224758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b1ba0 msgr2=0x7fcd200b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b1ba0 0x7fcd200b2020 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcd180098e0 tx=0x7fcd180091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 -- 172.21.15.50:0/992224758 shutdown_connections 2023-12-24T18:55:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b1ba0 0x7fcd200b2020 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 --2- 172.21.15.50:0/992224758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd20158e10 0x7fcd2015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 -- 172.21.15.50:0/992224758 >> 172.21.15.50:0/992224758 conn(0x7fcd200670b0 msgr2=0x7fcd200674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 -- 172.21.15.50:0/992224758 shutdown_connections 2023-12-24T18:55:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.632+0000 7fcd264cd700 1 -- 172.21.15.50:0/992224758 wait complete. 2023-12-24T18:55:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.636+0000 7fcd264cd700 1 Processor -- start 2023-12-24T18:55:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.636+0000 7fcd264cd700 1 -- start start 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd200b1ba0 0x7fcd20150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20158e10 0x7fcd2015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2016a040 con 0x7fcd200b3c90 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015b4e0 con 0x7fcd20158e10 2023-12-24T18:55:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015b7c0 con 0x7fcd200b1ba0 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38138/0 (socket says 172.21.15.50:38138) 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd200b1ba0 0x7fcd20150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 -- 172.21.15.50:0/2179727534 learned_addr learned my addr 172.21.15.50:0/2179727534 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd24a6a700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20158e10 0x7fcd2015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd200b1ba0 msgr2=0x7fcd20150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd200b1ba0 0x7fcd20150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20158e10 msgr2=0x7fcd2015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20158e10 0x7fcd2015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 -- 172.21.15.50:0/2179727534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009420 con 0x7fcd200b3c90 2023-12-24T18:55:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd177fe700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c7c0 tx=0x7fcd08007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08005cd0 con 0x7fcd200b3c90 2023-12-24T18:55:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08005e30 con 0x7fcd200b3c90 2023-12-24T18:55:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08007320 con 0x7fcd200b3c90 2023-12-24T18:55:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.640+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2015baa0 con 0x7fcd200b3c90 2023-12-24T18:55:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.644+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2015c060 con 0x7fcd200b3c90 2023-12-24T18:55:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.644+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2015c280 con 0x7fcd200b3c90 2023-12-24T18:55:07.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.644+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fcd0801b3b0 con 0x7fcd200b3c90 2023-12-24T18:55:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.648+0000 7fcd1cff9700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 0x7fcd00062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.648+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7fcd0807c630 con 0x7fcd200b3c90 2023-12-24T18:55:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.648+0000 7fcd1ffff700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 msgr2=0x7fcd00062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.648+0000 7fcd1ffff700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 0x7fcd00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.652+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd0804c530 con 0x7fcd200b3c90 2023-12-24T18:55:07.743 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.740+0000 7f7d3befe000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:55:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.852+0000 7fcd1ffff700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 msgr2=0x7fcd00062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.852+0000 7fcd1ffff700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 0x7fcd00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.868+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd200652e0 con 0x7fcd200b3c90 2023-12-24T18:55:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.868+0000 7fcd1cff9700 1 -- 172.21.15.50:0/2179727534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fcd0804fb50 con 0x7fcd200b3c90 2023-12-24T18:55:07.874 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:07.874 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:54:13.765359+0000","modified":"2023-12-24T18:54:17.749184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3068804503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3068804503},{"type":"v1","addr":"172.21.15.50:6835","nonce":3068804503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 msgr2=0x7fcd00062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 0x7fcd00062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 msgr2=0x7fcd20169b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c7c0 tx=0x7fcd08007e00 comp rx=0 tx=0).stop 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 shutdown_connections 2023-12-24T18:55:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcd00060790 0x7fcd00062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20158e10 0x7fcd2015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd200b3c90 0x7fcd20169b00 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 --2- 172.21.15.50:0/2179727534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd200b1ba0 0x7fcd20150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 >> 172.21.15.50:0/2179727534 conn(0x7fcd200670b0 msgr2=0x7fcd20067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 shutdown_connections 2023-12-24T18:55:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:07.872+0000 7fcd264cd700 1 -- 172.21.15.50:0/2179727534 wait complete. 2023-12-24T18:55:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-12-24T18:55:07.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:07.964 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:07.960+0000 7f7d3befe000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:55:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.052+0000 7f5927eae700 1 Processor -- start 2023-12-24T18:55:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.052+0000 7f5927eae700 1 -- start start 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59200ca770 0x7f592015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f592015af90 0x7f592006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592006ca50 con 0x7f59200ca3a0 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200c6980 con 0x7f59200ca770 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592015b410 con 0x7f592015af90 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59200ca770 0x7f592015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59200ca770 0x7f592015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38140/0 (socket says 172.21.15.50:38140) 2023-12-24T18:55:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 -- 172.21.15.50:0/3670596009 learned_addr learned my addr 172.21.15.50:0/3670596009 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f592644b700 1 --2- 172.21.15.50:0/3670596009 >> v2:172.21.15.82:3300/0 conn(0x7f592015af90 0x7f592006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 -- 172.21.15.50:0/3670596009 >> v2:172.21.15.82:3300/0 conn(0x7f592015af90 msgr2=0x7f592006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 --2- 172.21.15.50:0/3670596009 >> v2:172.21.15.82:3300/0 conn(0x7f592015af90 0x7f592006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 -- 172.21.15.50:0/3670596009 >> v1:172.21.15.50:6789/0 conn(0x7f59200ca3a0 legacy=0x7f592006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 -- 172.21.15.50:0/3670596009 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592006b520 con 0x7f59200ca770 2023-12-24T18:55:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5925449700 1 --2- 172.21.15.50:0/3670596009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f592015aa50 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f59200c6210 tx=0x7f5910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735cc8e0d39ef29e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5924c48700 1 -- 172.21.15.50:0/3670596009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000b860 con 0x7f59200ca770 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5924c48700 1 -- 172.21.15.50:0/3670596009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591000b9c0 con 0x7f59200ca770 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5924c48700 1 -- 172.21.15.50:0/3670596009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000bd80 con 0x7f59200ca770 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 -- 172.21.15.50:0/3670596009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 msgr2=0x7f592015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.056+0000 7f5927eae700 1 --2- 172.21.15.50:0/3670596009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f592015aa50 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f59200c6210 tx=0x7f5910009250 comp rx=0 tx=0).stop 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 -- 172.21.15.50:0/3670596009 shutdown_connections 2023-12-24T18:55:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 --2- 172.21.15.50:0/3670596009 >> v2:172.21.15.82:3300/0 conn(0x7f592015af90 0x7f592006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 --2- 172.21.15.50:0/3670596009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f592015aa50 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 -- 172.21.15.50:0/3670596009 >> 172.21.15.50:0/3670596009 conn(0x7f59200cbba0 msgr2=0x7f59200cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 -- 172.21.15.50:0/3670596009 shutdown_connections 2023-12-24T18:55:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 -- 172.21.15.50:0/3670596009 wait complete. 2023-12-24T18:55:08.064 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f7d3befe000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:55:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 Processor -- start 2023-12-24T18:55:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.060+0000 7f5927eae700 1 -- start start 2023-12-24T18:55:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 0x7f59200b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 0x7f59200c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200b0f60 con 0x7f59200ca770 2023-12-24T18:55:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592016e690 con 0x7f592015af90 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200b09a0 con 0x7f59200ca3a0 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38148/0 (socket says 172.21.15.50:38148) 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 -- 172.21.15.50:0/233916662 learned_addr learned my addr 172.21.15.50:0/233916662 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925c4a700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 0x7f59200b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f592644b700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 0x7f59200c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 -- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 msgr2=0x7f59200b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 0x7f59200b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 -- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 msgr2=0x7f59200c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 0x7f59200c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 -- 172.21.15.50:0/233916662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100094f0 con 0x7f59200ca770 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925c4a700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 0x7f59200b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f592644b700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 0x7f59200c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5925449700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591001f070 con 0x7f59200ca770 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910002f30 con 0x7f59200ca770 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200b0c80 con 0x7f59200ca770 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011c40 con 0x7f59200ca770 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.064+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5920156b90 con 0x7f59200ca770 2023-12-24T18:55:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920170d30 con 0x7f59200ca770 2023-12-24T18:55:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f5910023070 con 0x7f59200ca770 2023-12-24T18:55:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5915ffb700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 0x7f5904062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f591007e320 con 0x7f59200ca770 2023-12-24T18:55:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5925c4a700 1 -- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 msgr2=0x7f5904062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.068+0000 7f5925c4a700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 0x7f5904062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.076+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5920170d30 con 0x7f59200ca770 2023-12-24T18:55:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.252+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5920170d30 con 0x7f59200ca770 2023-12-24T18:55:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.252+0000 7f5915ffb700 1 -- 172.21.15.50:0/233916662 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16459 (secure 0 0 0) 0x7f5920170d30 con 0x7f59200ca770 2023-12-24T18:55:08.257 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:08.257 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":126,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:54:28.796323+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:54:11.834496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-24T18:54:12.761835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/862400766":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/3959562728":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/2441810003":"2023-12-25T18:54:28.796263+0000","172.21.15.50:0/4062947908":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6837/33814":"2023-12-25T18:54:28.796263+0000","172.21.15.50:6836/33814":"2023-12-25T18:54:28.796263+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 msgr2=0x7f5904062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 0x7f5904062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 msgr2=0x7f5920156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910017000 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 shutdown_connections 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5904060790 0x7f5904062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592015af90 0x7f59200c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59200ca770 0x7f5920156330 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 --2- 172.21.15.50:0/233916662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59200ca3a0 0x7f59200b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 >> 172.21.15.50:0/233916662 conn(0x7f59200cbba0 msgr2=0x7f59200c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 shutdown_connections 2023-12-24T18:55:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.256+0000 7f5927eae700 1 -- 172.21.15.50:0/233916662 wait complete. 2023-12-24T18:55:08.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T18:55:08.368 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:08.362+0000 7f2f759d0000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:55:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.448+0000 7f6cc6a8e700 1 Processor -- start 2023-12-24T18:55:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.448+0000 7f6cc6a8e700 1 -- start start 2023-12-24T18:55:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc6a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc00b41e0 0x7f6cc01591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc6a8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc006d8c0 0x7f6cc0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc6a8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc006b640 con 0x7f6cc0158e00 2023-12-24T18:55:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc6a8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc0159710 con 0x7f6cc006d8c0 2023-12-24T18:55:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc6a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00b5e10 con 0x7f6cc00b41e0 2023-12-24T18:55:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.452+0000 7f6cc628d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc006d8c0 0x7f6cc0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc5a8c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6cc0158e00 0x7f6cc00b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc5a8c700 1 -- 172.21.15.50:0/394954483 learned_addr learned my addr 172.21.15.50:0/394954483 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc528b700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc00b41e0 0x7f6cc01591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc628d700 1 -- 172.21.15.50:0/394954483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc00b41e0 msgr2=0x7f6cc01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc628d700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc00b41e0 0x7f6cc01591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc628d700 1 -- 172.21.15.50:0/394954483 >> v1:172.21.15.82:6789/0 conn(0x7f6cc0158e00 legacy=0x7f6cc00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc628d700 1 -- 172.21.15.50:0/394954483 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc006b8e0 con 0x7f6cc006d8c0 2023-12-24T18:55:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc628d700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006d8c0 0x7f6cc0159e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009e60 tx=0x7f6cb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603909fe809bca03 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc4a8a700 1 -- 172.21.15.50:0/394954483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800e070 con 0x7f6cc006d8c0 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc4a8a700 1 -- 172.21.15.50:0/394954483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800bb60 con 0x7f6cc006d8c0 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc4a8a700 1 -- 172.21.15.50:0/394954483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8012430 con 0x7f6cc006d8c0 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/394954483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006d8c0 msgr2=0x7f6cc0159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006d8c0 0x7f6cc0159e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009e60 tx=0x7f6cb8009780 comp rx=0 tx=0).stop 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/394954483 shutdown_connections 2023-12-24T18:55:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc006d8c0 0x7f6cc0159e30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/394954483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc00b41e0 0x7f6cc01591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/394954483 >> 172.21.15.50:0/394954483 conn(0x7f6cc0067b80 msgr2=0x7f6cc00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/394954483 shutdown_connections 2023-12-24T18:55:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.456+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/394954483 wait complete. 2023-12-24T18:55:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 Processor -- start 2023-12-24T18:55:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 -- start start 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006d8c0 0x7f6cc0154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 0x7f6cc00abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00ac220 con 0x7f6cc0158e00 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00b15c0 con 0x7f6cc00b41e0 2023-12-24T18:55:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc6a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00b09b0 con 0x7f6cc006d8c0 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc628d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc528b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 0x7f6cc00abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc528b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 0x7f6cc00abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:51388/0 (socket says 172.21.15.50:51388) 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc628d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38174/0 (socket says 172.21.15.50:38174) 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc528b700 1 -- 172.21.15.50:0/3391177070 learned_addr learned my addr 172.21.15.50:0/3391177070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.460+0000 7f6cc5a8c700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006d8c0 0x7f6cc0154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006d8c0 msgr2=0x7f6cc0154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006d8c0 0x7f6cc0154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 msgr2=0x7f6cc00abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 0x7f6cc00abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 -- 172.21.15.50:0/3391177070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8009a20 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc628d700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8016000 tx=0x7f6cb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8027470 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb80275f0 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80279b0 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc00b0c90 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc00b1250 con 0x7f6cc0158e00 2023-12-24T18:55:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc00b1750 con 0x7f6cc0158e00 2023-12-24T18:55:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.464+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 63) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f6cb8024070 con 0x7f6cc0158e00 2023-12-24T18:55:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.468+0000 7f6cb5ffb700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 0x7f6ca4062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.468+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f6cb807f880 con 0x7f6cc0158e00 2023-12-24T18:55:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.468+0000 7f6cc5a8c700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 msgr2=0x7f6ca4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.468+0000 7f6cc5a8c700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 0x7f6ca4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.472+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6cb804f820 con 0x7f6cc0158e00 2023-12-24T18:55:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.672+0000 7f6cc5a8c700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 msgr2=0x7f6ca4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.672+0000 7f6cc5a8c700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 0x7f6ca4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.684+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cc004be40 con 0x7f6cc0158e00 2023-12-24T18:55:08.687 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T18:55:08.684+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T18:55:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.696+0000 7f6cb5ffb700 1 -- 172.21.15.50:0/3391177070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6cb8052e40 con 0x7f6cc0158e00 2023-12-24T18:55:08.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 msgr2=0x7f6ca4062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 0x7f6ca4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 msgr2=0x7f6cc00ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8016000 tx=0x7f6cb8019000 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 shutdown_connections 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6ca4060790 0x7f6ca4062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc0158e00 0x7f6cc00ac550 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc00b41e0 0x7f6cc00abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 --2- 172.21.15.50:0/3391177070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cc006d8c0 0x7f6cc0154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 >> 172.21.15.50:0/3391177070 conn(0x7f6cc0067b80 msgr2=0x7f6cc01560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 shutdown_connections 2023-12-24T18:55:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.700+0000 7f6cc6a8e700 1 -- 172.21.15.50:0/3391177070 wait complete. 2023-12-24T18:55:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T18:55:08.714 INFO:tasks.ceph.mds.c.smithi050.stderr: -6344> 2023-12-24T18:54:19.265+0000 7f626a5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:55:08.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T18:55:08.782 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:55:08.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.880+0000 7f505759e700 1 Processor -- start 2023-12-24T18:55:08.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.880+0000 7f505759e700 1 -- start start 2023-12-24T18:55:08.886 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:08.884+0000 7f7d3befe000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:55:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.884+0000 7f505759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50580cc780 0x7f50580ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505806a580 con 0x7f5058158c40 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580cd110 con 0x7f505806cd40 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505806a7d0 con 0x7f50580cc780 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f5055d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50580cc780 0x7f50580ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5058158c40 0x7f50580cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36694/0 (socket says 172.21.15.50:36694) 2023-12-24T18:55:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505659c700 1 -- 172.21.15.50:0/1853449095 learned_addr learned my addr 172.21.15.50:0/1853449095 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f5055d9b700 1 -- 172.21.15.50:0/1853449095 >> v1:172.21.15.82:6789/0 conn(0x7f505806cd40 legacy=0x7f505806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f5055d9b700 1 -- 172.21.15.50:0/1853449095 >> v1:172.21.15.50:6789/0 conn(0x7f5058158c40 legacy=0x7f50580cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f5055d9b700 1 -- 172.21.15.50:0/1853449095 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505806aab0 con 0x7f50580cc780 2023-12-24T18:55:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f5055d9b700 1 --2- 172.21.15.50:0/1853449095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50580cc780 0x7f50580ccbd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098e0 tx=0x7f504c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9baff3ba0b188e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505559a700 1 -- 172.21.15.50:0/1853449095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c009e80 con 0x7f50580cc780 2023-12-24T18:55:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505559a700 1 -- 172.21.15.50:0/1853449095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00b860 con 0x7f50580cc780 2023-12-24T18:55:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505559a700 1 -- 172.21.15.50:0/1853449095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00bbe0 con 0x7f50580cc780 2023-12-24T18:55:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505759e700 1 -- 172.21.15.50:0/1853449095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50580cc780 msgr2=0x7f50580ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.888+0000 7f505759e700 1 --2- 172.21.15.50:0/1853449095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50580cc780 0x7f50580ccbd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098e0 tx=0x7f504c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 -- 172.21.15.50:0/1853449095 shutdown_connections 2023-12-24T18:55:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 --2- 172.21.15.50:0/1853449095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50580cc780 0x7f50580ccbd0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 -- 172.21.15.50:0/1853449095 >> 172.21.15.50:0/1853449095 conn(0x7f50580d0800 msgr2=0x7f50580b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 -- 172.21.15.50:0/1853449095 shutdown_connections 2023-12-24T18:55:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 -- 172.21.15.50:0/1853449095 wait complete. 2023-12-24T18:55:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 Processor -- start 2023-12-24T18:55:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.892+0000 7f505759e700 1 -- start start 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50580cc780 0x7f50580ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5058158c40 0x7f50580c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580c6500 con 0x7f505806cd40 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580c5a70 con 0x7f50580cc780 2023-12-24T18:55:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50580ca5d0 con 0x7f5058158c40 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38206/0 (socket says 172.21.15.50:38206) 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 -- 172.21.15.50:0/2240930396 learned_addr learned my addr 172.21.15.50:0/2240930396 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f5055d9b700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50580cc780 0x7f50580ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f5056d9d700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5058158c40 0x7f50580c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 -- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5058158c40 msgr2=0x7f50580c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5058158c40 0x7f50580c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 -- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50580cc780 msgr2=0x7f50580ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50580cc780 0x7f50580ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 -- 172.21.15.50:0/2240930396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c009420 con 0x7f505806cd40 2023-12-24T18:55:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.896+0000 7f505659c700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7c0 tx=0x7f5048007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048005b30 con 0x7f505806cd40 2023-12-24T18:55:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048005c90 con 0x7f505806cd40 2023-12-24T18:55:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50580c5c60 con 0x7f505806cd40 2023-12-24T18:55:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048004a80 con 0x7f505806cd40 2023-12-24T18:55:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50580c6220 con 0x7f505806cd40 2023-12-24T18:55:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505804be40 con 0x7f505806cd40 2023-12-24T18:55:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.904+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 64) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f50480070d0 con 0x7f505806cd40 2023-12-24T18:55:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.908+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7117+0+0 (secure 0 0 0) 0x7f504807bca0 con 0x7f505806cd40 2023-12-24T18:55:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:08.912+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f504804bfe0 con 0x7f505806cd40 2023-12-24T18:55:09.011 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d03e5c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.012 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d03e5c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.012 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d03e5c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.012 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d03e5c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.012 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d03e5c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.012 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d07663700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.013 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d07663700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.013 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d07663700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.013 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d07663700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.013 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:09.008+0000 7f7d07663700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.148+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f505806ad90 con 0x7f505806cd40 2023-12-24T18:55:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.748+0000 7f50467fc700 1 -- 172.21.15.50:0/2240930396 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f504804f600 con 0x7f505806cd40 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 msgr2=0x7f50580c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7c0 tx=0x7f5048007f70 comp rx=0 tx=0).stop 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 shutdown_connections 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5058158c40 0x7f50580c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50580cc780 0x7f50580ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 --2- 172.21.15.50:0/2240930396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f505806cd40 0x7f50580c5530 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 >> 172.21.15.50:0/2240930396 conn(0x7f50580d0800 msgr2=0x7f50580b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 shutdown_connections 2023-12-24T18:55:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.752+0000 7f505759e700 1 -- 172.21.15.50:0/2240930396 wait complete. 2023-12-24T18:55:09.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T18:55:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 Processor -- start 2023-12-24T18:55:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 -- start start 2023-12-24T18:55:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd60156c30 0x7efd600af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600ad770 con 0x7efd60156860 2023-12-24T18:55:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6006d2e0 con 0x7efd600aff00 2023-12-24T18:55:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd6628e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6006d5c0 con 0x7efd60156c30 2023-12-24T18:55:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.956+0000 7efd64a8b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd60156c30 0x7efd600af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6528c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd60156860 0x7efd6006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43420/0 (socket says 172.21.15.50:43420) 2023-12-24T18:55:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd64a8b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd60156c30 0x7efd600af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43302/0 (socket says 172.21.15.50:43302) 2023-12-24T18:55:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6528c700 1 -- 172.21.15.50:0/1554821107 learned_addr learned my addr 172.21.15.50:0/1554821107 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd64a8b700 1 -- 172.21.15.50:0/1554821107 >> v1:172.21.15.82:6789/0 conn(0x7efd600aff00 legacy=0x7efd600ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd64a8b700 1 -- 172.21.15.50:0/1554821107 >> v1:172.21.15.50:6789/0 conn(0x7efd60156860 legacy=0x7efd6006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd64a8b700 1 -- 172.21.15.50:0/1554821107 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6006d8a0 con 0x7efd60156c30 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd57fff700 1 -- 172.21.15.50:0/1554821107 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122649340 0 0) 0x7efd600ad770 con 0x7efd60156860 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd64a8b700 1 --2- 172.21.15.50:0/1554821107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd60156c30 0x7efd600af9c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7efd500098e0 tx=0x7efd500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190724dee3ef20c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd57fff700 1 -- 172.21.15.50:0/1554821107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50009e80 con 0x7efd60156c30 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd57fff700 1 -- 172.21.15.50:0/1554821107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000b860 con 0x7efd60156c30 2023-12-24T18:55:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd57fff700 1 -- 172.21.15.50:0/1554821107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000bbe0 con 0x7efd60156c30 2023-12-24T18:55:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 -- 172.21.15.50:0/1554821107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd60156c30 msgr2=0x7efd600af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 --2- 172.21.15.50:0/1554821107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd60156c30 0x7efd600af9c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7efd500098e0 tx=0x7efd500091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 -- 172.21.15.50:0/1554821107 shutdown_connections 2023-12-24T18:55:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 --2- 172.21.15.50:0/1554821107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd60156c30 0x7efd600af9c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 -- 172.21.15.50:0/1554821107 >> 172.21.15.50:0/1554821107 conn(0x7efd60069d50 msgr2=0x7efd600cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 -- 172.21.15.50:0/1554821107 shutdown_connections 2023-12-24T18:55:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 -- 172.21.15.50:0/1554821107 wait complete. 2023-12-24T18:55:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.960+0000 7efd6628e700 1 Processor -- start 2023-12-24T18:55:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 -- start start 2023-12-24T18:55:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 0x7efd600c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 0x7efd601552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd60156c30 0x7efd60068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c6380 con 0x7efd600aff00 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c2900 con 0x7efd60156860 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c65d0 con 0x7efd60156c30 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6528c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 0x7efd600c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6528c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 0x7efd600c2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43310/0 (socket says 172.21.15.50:43310) 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 0x7efd601552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6528c700 1 -- 172.21.15.50:0/1620851751 learned_addr learned my addr 172.21.15.50:0/1620851751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd65a8d700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd60156c30 0x7efd60068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 -- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd60156c30 msgr2=0x7efd60068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd60156c30 0x7efd60068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 -- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 msgr2=0x7efd600c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 0x7efd600c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 -- 172.21.15.50:0/1620851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009420 con 0x7efd60156860 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd64a8b700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 0x7efd601552a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd50016000 tx=0x7efd50017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5001f070 con 0x7efd60156860 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50000c90 con 0x7efd60156860 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd600c68b0 con 0x7efd60156860 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.964+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50025420 con 0x7efd60156860 2023-12-24T18:55:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.968+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600c2580 con 0x7efd60156860 2023-12-24T18:55:09.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.968+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd600c6db0 con 0x7efd60156860 2023-12-24T18:55:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.968+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 79799+0+0 (secure 0 0 0) 0x7efd50023070 con 0x7efd60156860 2023-12-24T18:55:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.972+0000 7efd557fa700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 0x7efd44062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:09.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.972+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7117+0+0 (secure 0 0 0) 0x7efd5007dc70 con 0x7efd60156860 2023-12-24T18:55:09.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.972+0000 7efd6528c700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 0x7efd44062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.972+0000 7efd6528c700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 0x7efd44062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd5c007fd0 tx=0x7efd5c007d90 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:09.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:09.980+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd5004dec0 con 0x7efd60156860 2023-12-24T18:55:10.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.160+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd6004be40 con 0x7efd60156860 2023-12-24T18:55:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.976+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efd5004e290 con 0x7efd60156860 2023-12-24T18:55:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.976+0000 7efd557fa700 1 -- 172.21.15.50:0/1620851751 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7efd50060120 con 0x7efd60156860 2023-12-24T18:55:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.980+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 msgr2=0x7efd44062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.980+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 0x7efd44062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd5c007fd0 tx=0x7efd5c007d90 comp rx=0 tx=0).stop 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.980+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 msgr2=0x7efd601552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.980+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 0x7efd601552a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd50016000 tx=0x7efd50017000 comp rx=0 tx=0).stop 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 shutdown_connections 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efd440603a0 0x7efd44062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd60156c30 0x7efd60068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd60156860 0x7efd601552a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 --2- 172.21.15.50:0/1620851751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600aff00 0x7efd600c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 >> 172.21.15.50:0/1620851751 conn(0x7efd60069d50 msgr2=0x7efd600c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 shutdown_connections 2023-12-24T18:55:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:10.984+0000 7efd6628e700 1 -- 172.21.15.50:0/1620851751 wait complete. 2023-12-24T18:55:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T18:55:11.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T18:55:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.176+0000 7f337d46b700 1 Processor -- start 2023-12-24T18:55:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.176+0000 7f337d46b700 1 -- start start 2023-12-24T18:55:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f337d46b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3378158ea0 0x7f3378159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f337d46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f337815d730 0x7f337806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f337d46b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337815db80 con 0x7f33780c5570 2023-12-24T18:55:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f337d46b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337806aba0 con 0x7f3378158ea0 2023-12-24T18:55:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f337d46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337806ae80 con 0x7f337815d730 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3378158ea0 0x7f3378159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f33777fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f337815d730 0x7f337806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3378158ea0 0x7f3378159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48452/0 (socket says 172.21.15.50:48452) 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 -- 172.21.15.50:0/1559770487 learned_addr learned my addr 172.21.15.50:0/1559770487 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 -- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f337815d730 msgr2=0x7f337806a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 --2- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f337815d730 0x7f337806a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 -- 172.21.15.50:0/1559770487 >> v1:172.21.15.82:6789/0 conn(0x7f33780c5570 legacy=0x7f337806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 -- 172.21.15.50:0/1559770487 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337806b160 con 0x7f3378158ea0 2023-12-24T18:55:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3376ffd700 1 -- 172.21.15.50:0/1559770487 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034473752 0 0) 0x7f337815db80 con 0x7f33780c5570 2023-12-24T18:55:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3377fff700 1 --2- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3378158ea0 0x7f3378159270 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f33680099b0 tx=0x7f3368009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63fe599c0f8a297 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3376ffd700 1 -- 172.21.15.50:0/1559770487 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368009ea0 con 0x7f3378158ea0 2023-12-24T18:55:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3376ffd700 1 -- 172.21.15.50:0/1559770487 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336800b860 con 0x7f3378158ea0 2023-12-24T18:55:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.180+0000 7f3376ffd700 1 -- 172.21.15.50:0/1559770487 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800bc00 con 0x7f3378158ea0 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3378158ea0 msgr2=0x7f3378159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 --2- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3378158ea0 0x7f3378159270 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f33680099b0 tx=0x7f3368009250 comp rx=0 tx=0).stop 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- 172.21.15.50:0/1559770487 shutdown_connections 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 --2- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f337815d730 0x7f337806a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 --2- 172.21.15.50:0/1559770487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3378158ea0 0x7f3378159270 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- 172.21.15.50:0/1559770487 >> 172.21.15.50:0/1559770487 conn(0x7f3378067b30 msgr2=0x7f33780cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- 172.21.15.50:0/1559770487 shutdown_connections 2023-12-24T18:55:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- 172.21.15.50:0/1559770487 wait complete. 2023-12-24T18:55:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 Processor -- start 2023-12-24T18:55:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.184+0000 7f337d46b700 1 -- start start 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3378158ea0 0x7f3378156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337815d730 0x7f33780b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3378154fe0 con 0x7f33780c5570 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3378155ea0 con 0x7f337815d730 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3378155290 con 0x7f3378158ea0 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43316/0 (socket says 172.21.15.50:43316) 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 -- 172.21.15.50:0/1817430356 learned_addr learned my addr 172.21.15.50:0/1817430356 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337cc6a700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337815d730 0x7f33780b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f33777fe700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3378158ea0 0x7f3378156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 -- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3378158ea0 msgr2=0x7f3378156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3378158ea0 0x7f3378156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 -- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337815d730 msgr2=0x7f33780b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337815d730 0x7f33780b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 -- 172.21.15.50:0/1817430356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680094f0 con 0x7f33780c5570 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f3377fff700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3378063520 tx=0x7f3368017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800bbe0 con 0x7f33780c5570 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368011420 con 0x7f33780c5570 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3378155570 con 0x7f33780c5570 2023-12-24T18:55:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680117c0 con 0x7f33780c5570 2023-12-24T18:55:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.188+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3378155b30 con 0x7f33780c5570 2023-12-24T18:55:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.192+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337804be40 con 0x7f33780c5570 2023-12-24T18:55:11.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.192+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3368011bb0 con 0x7f33780c5570 2023-12-24T18:55:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.196+0000 7f335ffff700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 0x7f3364062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.196+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f336807e0a0 con 0x7f33780c5570 2023-12-24T18:55:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.196+0000 7f33777fe700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 0x7f3364062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.196+0000 7f33777fe700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 0x7f3364062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33780c9130 tx=0x7f336c008040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.200+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f336804e340 con 0x7f33780c5570 2023-12-24T18:55:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.372+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33780d09f0 con 0x7f33780c5570 2023-12-24T18:55:11.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.980+0000 7f335ffff700 1 -- 172.21.15.50:0/1817430356 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3368011e60 con 0x7f33780c5570 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 msgr2=0x7f3364062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 0x7f3364062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33780c9130 tx=0x7f336c008040 comp rx=0 tx=0).stop 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 msgr2=0x7f3378154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3378063520 tx=0x7f3368017000 comp rx=0 tx=0).stop 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 shutdown_connections 2023-12-24T18:55:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3364060550 0x7f3364062a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337815d730 0x7f33780b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3378158ea0 0x7f3378156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 --2- 172.21.15.50:0/1817430356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780c5570 0x7f3378154aa0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 >> 172.21.15.50:0/1817430356 conn(0x7f3378067b30 msgr2=0x7f33780cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 shutdown_connections 2023-12-24T18:55:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:11.984+0000 7f337d46b700 1 -- 172.21.15.50:0/1817430356 wait complete. 2023-12-24T18:55:11.992 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T18:55:12.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T18:55:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 Processor -- start 2023-12-24T18:55:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 -- start start 2023-12-24T18:55:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f159c06df10 0x7f159c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06a630 0x7f159c0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c159b30 con 0x7f159c158e00 2023-12-24T18:55:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c06b560 con 0x7f159c06df10 2023-12-24T18:55:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.188+0000 7f15a18a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c06afa0 con 0x7f159c06a630 2023-12-24T18:55:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f159c06df10 0x7f159c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06a630 0x7f159c0670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f159c06df10 0x7f159c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43326/0 (socket says 172.21.15.50:43326) 2023-12-24T18:55:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 -- 172.21.15.50:0/443532645 learned_addr learned my addr 172.21.15.50:0/443532645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f1599ffb700 1 -- 172.21.15.50:0/443532645 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799028135 0 0) 0x7f159c159b30 con 0x7f159c158e00 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f1599ffb700 1 -- 172.21.15.50:0/443532645 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1584003570 con 0x7f159c158e00 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 -- 172.21.15.50:0/443532645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06a630 msgr2=0x7f159c0670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 --2- 172.21.15.50:0/443532645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06a630 0x7f159c0670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 -- 172.21.15.50:0/443532645 >> v1:172.21.15.82:6789/0 conn(0x7f159c158e00 legacy=0x7f159c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 -- 172.21.15.50:0/443532645 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c06b280 con 0x7f159c06df10 2023-12-24T18:55:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f159a7fc700 1 --2- 172.21.15.50:0/443532645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c06df10 0x7f159c1591d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f15900099b0 tx=0x7f1590009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2905b72dcb07a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f1599ffb700 1 -- 172.21.15.50:0/443532645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000b680 con 0x7f159c06df10 2023-12-24T18:55:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f1599ffb700 1 -- 172.21.15.50:0/443532645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000b7e0 con 0x7f159c06df10 2023-12-24T18:55:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f1599ffb700 1 -- 172.21.15.50:0/443532645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000bb80 con 0x7f159c06df10 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 -- 172.21.15.50:0/443532645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c06df10 msgr2=0x7f159c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 --2- 172.21.15.50:0/443532645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c06df10 0x7f159c1591d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f15900099b0 tx=0x7f1590009250 comp rx=0 tx=0).stop 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 -- 172.21.15.50:0/443532645 shutdown_connections 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 --2- 172.21.15.50:0/443532645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06a630 0x7f159c0670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 --2- 172.21.15.50:0/443532645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c06df10 0x7f159c1591d0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.192+0000 7f15a18a5700 1 -- 172.21.15.50:0/443532645 >> 172.21.15.50:0/443532645 conn(0x7f159c0cfe40 msgr2=0x7f159c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.196+0000 7f15a18a5700 1 -- 172.21.15.50:0/443532645 shutdown_connections 2023-12-24T18:55:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.196+0000 7f15a18a5700 1 -- 172.21.15.50:0/443532645 wait complete. 2023-12-24T18:55:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.196+0000 7f15a18a5700 1 Processor -- start 2023-12-24T18:55:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.196+0000 7f15a18a5700 1 -- start start 2023-12-24T18:55:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 0x7f159c0ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06df10 0x7f159c0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0b0670 con 0x7f159c158e00 2023-12-24T18:55:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0afa60 con 0x7f159c06a630 2023-12-24T18:55:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0afd40 con 0x7f159c06df10 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43330/0 (socket says 172.21.15.50:43330) 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 -- 172.21.15.50:0/1230909876 learned_addr learned my addr 172.21.15.50:0/1230909876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159a7fc700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06df10 0x7f159c0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159affd700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 0x7f159c0ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 -- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06df10 msgr2=0x7f159c0aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06df10 0x7f159c0aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 -- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 msgr2=0x7f159c0ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 0x7f159c0ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 -- 172.21.15.50:0/1230909876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900094f0 con 0x7f159c158e00 2023-12-24T18:55:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159affd700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 0x7f159c0ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f159b7fe700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1594009e90 tx=0x7f159400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400cc20 con 0x7f159c158e00 2023-12-24T18:55:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400f040 con 0x7f159c158e00 2023-12-24T18:55:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c0b0020 con 0x7f159c158e00 2023-12-24T18:55:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.200+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594014480 con 0x7f159c158e00 2023-12-24T18:55:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.204+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c0acf00 con 0x7f159c158e00 2023-12-24T18:55:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.204+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c0b07e0 con 0x7f159c158e00 2023-12-24T18:55:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.204+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1594014830 con 0x7f159c158e00 2023-12-24T18:55:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.208+0000 7f1582ffd700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 0x7f1588062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.208+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f159407d4a0 con 0x7f159c158e00 2023-12-24T18:55:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.208+0000 7f159affd700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 0x7f1588062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.208+0000 7f159affd700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 0x7f1588062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f158c0038f0 tx=0x7f158c009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.212+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1594051250 con 0x7f159c158e00 2023-12-24T18:55:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.388+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f159c04be40 con 0x7f159c158e00 2023-12-24T18:55:12.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.396+0000 7f1582ffd700 1 -- 172.21.15.50:0/1230909876 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v43) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1594050de0 con 0x7f159c158e00 2023-12-24T18:55:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 msgr2=0x7f1588062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 0x7f1588062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f158c0038f0 tx=0x7f158c009040 comp rx=0 tx=0).stop 2023-12-24T18:55:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 msgr2=0x7f159c1463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1594009e90 tx=0x7f159400b040 comp rx=0 tx=0).stop 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 shutdown_connections 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1588060580 0x7f1588062a30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f159c158e00 0x7f159c1463c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f159c06df10 0x7f159c0aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 --2- 172.21.15.50:0/1230909876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f159c06a630 0x7f159c0ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 >> 172.21.15.50:0/1230909876 conn(0x7f159c0cfe40 msgr2=0x7f159c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 shutdown_connections 2023-12-24T18:55:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.400+0000 7f15a18a5700 1 -- 172.21.15.50:0/1230909876 wait complete. 2023-12-24T18:55:12.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T18:55:12.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.608+0000 7f298484c700 1 Processor -- start 2023-12-24T18:55:12.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.608+0000 7f298484c700 1 -- start start 2023-12-24T18:55:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f298484c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29800cc780 0x7f29800ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f298484c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f298006cd40 0x7f298006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f298484c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298006a580 con 0x7f2980158c40 2023-12-24T18:55:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f298484c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800cd110 con 0x7f298006cd40 2023-12-24T18:55:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f298484c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298006d700 con 0x7f29800cc780 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f298006cd40 0x7f298006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2980158c40 0x7f29800cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:45254/0 (socket says 172.21.15.50:45254) 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297f7fe700 1 -- 172.21.15.50:0/1542539399 learned_addr learned my addr 172.21.15.50:0/1542539399 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297effd700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29800cc780 0x7f29800ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297e7fc700 1 -- 172.21.15.50:0/1542539399 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274279159 0 0) 0x7f298006a580 con 0x7f2980158c40 2023-12-24T18:55:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 -- 172.21.15.50:0/1542539399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29800cc780 msgr2=0x7f29800ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29800cc780 0x7f29800ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 -- 172.21.15.50:0/1542539399 >> v1:172.21.15.82:6789/0 conn(0x7f2980158c40 legacy=0x7f29800cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 -- 172.21.15.50:0/1542539399 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298006a7d0 con 0x7f298006cd40 2023-12-24T18:55:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297ffff700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298006cd40 0x7f298006d1c0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2978009e60 tx=0x7f2978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946035291f05bc97 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297e7fc700 1 -- 172.21.15.50:0/1542539399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800e070 con 0x7f298006cd40 2023-12-24T18:55:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297e7fc700 1 -- 172.21.15.50:0/1542539399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800bb60 con 0x7f298006cd40 2023-12-24T18:55:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.612+0000 7f297e7fc700 1 -- 172.21.15.50:0/1542539399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978012430 con 0x7f298006cd40 2023-12-24T18:55:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- 172.21.15.50:0/1542539399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298006cd40 msgr2=0x7f298006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298006cd40 0x7f298006d1c0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2978009e60 tx=0x7f2978009780 comp rx=0 tx=0).stop 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- 172.21.15.50:0/1542539399 shutdown_connections 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298006cd40 0x7f298006d1c0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 --2- 172.21.15.50:0/1542539399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29800cc780 0x7f29800ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- 172.21.15.50:0/1542539399 >> 172.21.15.50:0/1542539399 conn(0x7f29800d0800 msgr2=0x7f29800b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- 172.21.15.50:0/1542539399 shutdown_connections 2023-12-24T18:55:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- 172.21.15.50:0/1542539399 wait complete. 2023-12-24T18:55:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 Processor -- start 2023-12-24T18:55:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 -- start start 2023-12-24T18:55:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.616+0000 7f298484c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f298006cd40 0x7f2980152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2980158c40 0x7f2980157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980168d70 con 0x7f29800cc780 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298015ad90 con 0x7f2980158c40 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298015a180 con 0x7f298006cd40 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43352/0 (socket says 172.21.15.50:43352) 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 -- 172.21.15.50:0/147569229 learned_addr learned my addr 172.21.15.50:0/147569229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297ffff700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2980158c40 0x7f2980157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297f7fe700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f298006cd40 0x7f2980152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 -- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f298006cd40 msgr2=0x7f2980152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f298006cd40 0x7f2980152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 -- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2980158c40 msgr2=0x7f2980157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2980158c40 0x7f2980157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 -- 172.21.15.50:0/147569229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009a20 con 0x7f29800cc780 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f297effd700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f297400ecb0 tx=0x7f29740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400c850 con 0x7f29800cc780 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297400c9b0 con 0x7f29800cc780 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298015a460 con 0x7f29800cc780 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400cd50 con 0x7f29800cc780 2023-12-24T18:55:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.620+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298015aa20 con 0x7f29800cc780 2023-12-24T18:55:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.624+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298004be40 con 0x7f29800cc780 2023-12-24T18:55:12.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.624+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2974013680 con 0x7f29800cc780 2023-12-24T18:55:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.624+0000 7f29677fe700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 0x7f296c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.624+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f297407ccc0 con 0x7f29800cc780 2023-12-24T18:55:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.628+0000 7f297f7fe700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 0x7f296c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:12.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.628+0000 7f297f7fe700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 0x7f296c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2970007fd0 tx=0x7f2970007d30 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.632+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2974083080 con 0x7f29800cc780 2023-12-24T18:55:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.804+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f298015aed0 con 0x7f29800cc780 2023-12-24T18:55:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.812+0000 7f29677fe700 1 -- 172.21.15.50:0/147569229 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7f297404cfe0 con 0x7f29800cc780 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.816+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 msgr2=0x7f296c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.816+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 0x7f296c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2970007fd0 tx=0x7f2970007d30 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.816+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 msgr2=0x7f298015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.816+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f297400ecb0 tx=0x7f29740091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 shutdown_connections 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f296c060550 0x7f296c062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2980158c40 0x7f2980157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800cc780 0x7f298015be40 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 --2- 172.21.15.50:0/147569229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f298006cd40 0x7f2980152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 >> 172.21.15.50:0/147569229 conn(0x7f29800d0800 msgr2=0x7f29801531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 shutdown_connections 2023-12-24T18:55:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:12.820+0000 7f298484c700 1 -- 172.21.15.50:0/147569229 wait complete. 2023-12-24T18:55:12.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T18:55:13.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.000+0000 7efca6eae700 1 Processor -- start 2023-12-24T18:55:13.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 -- start start 2023-12-24T18:55:13.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efca00c8880 0x7efca006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efca00c9190 0x7efca00675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca006db30 con 0x7efca00c8880 2023-12-24T18:55:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca00c9b60 con 0x7efca00c9190 2023-12-24T18:55:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efca6eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca006cf20 con 0x7efca00cb980 2023-12-24T18:55:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:54618/0 (socket says 172.21.15.50:54618) 2023-12-24T18:55:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.004+0000 7efc9ffff700 1 -- 172.21.15.50:0/1006357772 learned_addr learned my addr 172.21.15.50:0/1006357772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca544b700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.82:3300/0 conn(0x7efca00c9190 0x7efca00675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca4c4a700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.50:3300/0 conn(0x7efca00c8880 0x7efca006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 -- 172.21.15.50:0/1006357772 >> v2:172.21.15.82:3300/0 conn(0x7efca00c9190 msgr2=0x7efca00675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.82:3300/0 conn(0x7efca00c9190 0x7efca00675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 -- 172.21.15.50:0/1006357772 >> v2:172.21.15.50:3300/0 conn(0x7efca00c8880 msgr2=0x7efca006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.50:3300/0 conn(0x7efca00c8880 0x7efca006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 -- 172.21.15.50:0/1006357772 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca006d200 con 0x7efca00cb980 2023-12-24T18:55:13.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9ffff700 1 --2- 172.21.15.50:0/1006357772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efca00b08b0 tx=0x7efc8c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dae9df4cf7bfcf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9f7fe700 1 -- 172.21.15.50:0/1006357772 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00b640 con 0x7efca00cb980 2023-12-24T18:55:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9f7fe700 1 -- 172.21.15.50:0/1006357772 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00b7a0 con 0x7efca00cb980 2023-12-24T18:55:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efc9f7fe700 1 -- 172.21.15.50:0/1006357772 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00bb60 con 0x7efca00cb980 2023-12-24T18:55:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 -- 172.21.15.50:0/1006357772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 msgr2=0x7efca00c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 --2- 172.21.15.50:0/1006357772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efca00b08b0 tx=0x7efc8c009250 comp rx=0 tx=0).stop 2023-12-24T18:55:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 -- 172.21.15.50:0/1006357772 shutdown_connections 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.82:3300/0 conn(0x7efca00c9190 0x7efca00675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 --2- 172.21.15.50:0/1006357772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00c8c50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 --2- 172.21.15.50:0/1006357772 >> v2:172.21.15.50:3300/0 conn(0x7efca00c8880 0x7efca006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.008+0000 7efca6eae700 1 -- 172.21.15.50:0/1006357772 >> 172.21.15.50:0/1006357772 conn(0x7efca00cddb0 msgr2=0x7efca00ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.012+0000 7efca6eae700 1 -- 172.21.15.50:0/1006357772 shutdown_connections 2023-12-24T18:55:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.012+0000 7efca6eae700 1 -- 172.21.15.50:0/1006357772 wait complete. 2023-12-24T18:55:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.012+0000 7efca6eae700 1 Processor -- start 2023-12-24T18:55:13.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.012+0000 7efca6eae700 1 -- start start 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 0x7efca015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca015cc30 con 0x7efca00c8880 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca015dad0 con 0x7efca00c9190 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca015c950 con 0x7efca00cb980 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43384/0 (socket says 172.21.15.50:43384) 2023-12-24T18:55:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 -- 172.21.15.50:0/2194521832 learned_addr learned my addr 172.21.15.50:0/2194521832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efc9ffff700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 0x7efca015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca544b700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 -- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 msgr2=0x7efca00b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 -- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 msgr2=0x7efca015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 0x7efca015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 -- 172.21.15.50:0/2194521832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0094f0 con 0x7efca00c8880 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efc9ffff700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 0x7efca015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca4c4a700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e930 tx=0x7efc940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9400eed0 con 0x7efca00c8880 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9400c850 con 0x7efca00c8880 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca00b1cc0 con 0x7efca00c8880 2023-12-24T18:55:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9400cbf0 con 0x7efca00c8880 2023-12-24T18:55:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.016+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca00b2280 con 0x7efca00c8880 2023-12-24T18:55:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.020+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca00b1b20 con 0x7efca00c8880 2023-12-24T18:55:13.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.020+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efc94013470 con 0x7efca00c8880 2023-12-24T18:55:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.020+0000 7efc9cff9700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 0x7efc84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.020+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7efc9407cc90 con 0x7efca00c8880 2023-12-24T18:55:13.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.024+0000 7efc9ffff700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 0x7efc84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.024+0000 7efc9ffff700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 0x7efc84062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efca00b08b0 tx=0x7efc8c017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.028+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efca00b1b20 con 0x7efca00c8880 2023-12-24T18:55:13.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.200+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efca00b1b20 con 0x7efca00c8880 2023-12-24T18:55:13.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.208+0000 7efc9cff9700 1 -- 172.21.15.50:0/2194521832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7efca00b1b20 con 0x7efca00c8880 2023-12-24T18:55:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 msgr2=0x7efc84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 0x7efc84062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efca00b08b0 tx=0x7efc8c017000 comp rx=0 tx=0).stop 2023-12-24T18:55:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 msgr2=0x7efca0143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7efc9400e930 tx=0x7efc940091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 shutdown_connections 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc84060550 0x7efc84062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca00cb980 0x7efca00b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca00c9190 0x7efca015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 --2- 172.21.15.50:0/2194521832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca00c8880 0x7efca0143a80 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 >> 172.21.15.50:0/2194521832 conn(0x7efca00cddb0 msgr2=0x7efca00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 shutdown_connections 2023-12-24T18:55:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.212+0000 7efca6eae700 1 -- 172.21.15.50:0/2194521832 wait complete. 2023-12-24T18:55:13.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-12-24T18:55:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 Processor -- start 2023-12-24T18:55:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 -- start start 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd4806c820 0x7fbd480ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd480adc90 0x7fbd48160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd480b0460 con 0x7fbd4815a2d0 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4806d8c0 con 0x7fbd4806c820 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd4c84c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480afc60 con 0x7fbd480adc90 2023-12-24T18:55:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd477fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbd4815a2d0 0x7fbd480ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43424/0 (socket says 172.21.15.50:43424) 2023-12-24T18:55:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd477fe700 1 -- 172.21.15.50:0/2036835958 learned_addr learned my addr 172.21.15.50:0/2036835958 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd3ffff700 1 --2- 172.21.15.50:0/2036835958 >> v2:172.21.15.50:3300/0 conn(0x7fbd4806c820 0x7fbd480ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83054441 0 0) 0x7fbd480b0460 con 0x7fbd4815a2d0 2023-12-24T18:55:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003570 con 0x7fbd4815a2d0 2023-12-24T18:55:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.396+0000 7fbd47fff700 1 --2- 172.21.15.50:0/2036835958 >> v2:172.21.15.82:3300/0 conn(0x7fbd480adc90 0x7fbd48160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454353105 0 0) 0x7fbd34003570 con 0x7fbd4815a2d0 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 >> v2:172.21.15.82:3300/0 conn(0x7fbd480adc90 msgr2=0x7fbd48160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 --2- 172.21.15.50:0/2036835958 >> v2:172.21.15.82:3300/0 conn(0x7fbd480adc90 0x7fbd48160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 >> v2:172.21.15.50:3300/0 conn(0x7fbd4806c820 msgr2=0x7fbd480ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 --2- 172.21.15.50:0/2036835958 >> v2:172.21.15.50:3300/0 conn(0x7fbd4806c820 0x7fbd480ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4806a5c0 con 0x7fbd4815a2d0 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fbd38001470 con 0x7fbd4815a2d0 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 >> v1:172.21.15.50:6789/0 conn(0x7fbd4815a2d0 legacy=0x7fbd480ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 0x7fbd34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34004810 0x7fbd34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd340051c0 0x7fbd3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4806d8c0 con 0x7fbd34004810 2023-12-24T18:55:13.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480afc60 con 0x7fbd34003a60 2023-12-24T18:55:13.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3400c050 con 0x7fbd340051c0 2023-12-24T18:55:13.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 0x7fbd34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd3ffff700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34004810 0x7fbd34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd47fff700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd340051c0 0x7fbd3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 -- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd340051c0 msgr2=0x7fbd3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd340051c0 0x7fbd3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 -- 172.21.15.50:0/2036835958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34004810 msgr2=0x7fbd34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34004810 0x7fbd34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 -- 172.21.15.50:0/2036835958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34003570 con 0x7fbd34003a60 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd47fff700 1 -- 172.21.15.50:0/2036835958 reap_dead start 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd477fe700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 0x7fbd34003e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c3c0 tx=0x7fbd38001e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3730a8a0da5bdd73 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800cc90 con 0x7fbd34003a60 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800ce30 con 0x7fbd34003a60 2023-12-24T18:55:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd46ffd700 1 -- 172.21.15.50:0/2036835958 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38005b70 con 0x7fbd34003a60 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd4c84c700 1 -- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 msgr2=0x7fbd34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.400+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 0x7fbd34003e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c3c0 tx=0x7fbd38001e90 comp rx=0 tx=0).stop 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 -- 172.21.15.50:0/2036835958 shutdown_connections 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/2036835958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd34003a60 0x7fbd34003e70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 -- 172.21.15.50:0/2036835958 >> 172.21.15.50:0/2036835958 conn(0x7fbd48067b80 msgr2=0x7fbd480cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 -- 172.21.15.50:0/2036835958 shutdown_connections 2023-12-24T18:55:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 -- 172.21.15.50:0/2036835958 wait complete. 2023-12-24T18:55:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 Processor -- start 2023-12-24T18:55:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.404+0000 7fbd4c84c700 1 -- start start 2023-12-24T18:55:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd48152e90 0x7fbd480ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 0x7fbd48158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48154010 con 0x7fbd34003a60 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4814bb20 con 0x7fbd48152e90 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48153400 con 0x7fbd48168de0 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43404/0 (socket says 172.21.15.50:43404) 2023-12-24T18:55:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 -- 172.21.15.50:0/3599308169 learned_addr learned my addr 172.21.15.50:0/3599308169 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd3ffff700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd48152e90 0x7fbd480ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd47fff700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 0x7fbd48158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 -- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 msgr2=0x7fbd48158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 0x7fbd48158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 -- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd48152e90 msgr2=0x7fbd480ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd48152e90 0x7fbd480ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 -- 172.21.15.50:0/3599308169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd481536e0 con 0x7fbd34003a60 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd47fff700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 0x7fbd48158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd477fe700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fbd38007d10 tx=0x7fbd38015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380072e0 con 0x7fbd34003a60 2023-12-24T18:55:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd38007440 con 0x7fbd34003a60 2023-12-24T18:55:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd481539c0 con 0x7fbd34003a60 2023-12-24T18:55:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380077e0 con 0x7fbd34003a60 2023-12-24T18:55:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.408+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd480ad8b0 con 0x7fbd34003a60 2023-12-24T18:55:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4804be40 con 0x7fbd34003a60 2023-12-24T18:55:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbd3801e640 con 0x7fbd34003a60 2023-12-24T18:55:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd3f7fe700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 0x7fbd28062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fbd3807d5d0 con 0x7fbd34003a60 2023-12-24T18:55:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd3ffff700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 0x7fbd28062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.412+0000 7fbd3ffff700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 0x7fbd28062a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd30006dc0 tx=0x7fbd30008040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.416+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd3804d8f0 con 0x7fbd34003a60 2023-12-24T18:55:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.648+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fbd48156f40 con 0x7fbd34003a60 2023-12-24T18:55:13.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.988+0000 7fbd3f7fe700 1 -- 172.21.15.50:0/3599308169 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v722) v1 ==== 148+0+0 (secure 0 0 0) 0x7fbd38050f10 con 0x7fbd34003a60 2023-12-24T18:55:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 msgr2=0x7fbd28062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 0x7fbd28062a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd30006dc0 tx=0x7fbd30008040 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 msgr2=0x7fbd4814b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fbd38007d10 tx=0x7fbd38015000 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 shutdown_connections 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbd28060580 0x7fbd28062a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd48168de0 0x7fbd48158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd48152e90 0x7fbd480ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 --2- 172.21.15.50:0/3599308169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd34003a60 0x7fbd4814b5e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 >> 172.21.15.50:0/3599308169 conn(0x7fbd48067b80 msgr2=0x7fbd480a9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 shutdown_connections 2023-12-24T18:55:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:13.992+0000 7fbd4c84c700 1 -- 172.21.15.50:0/3599308169 wait complete. 2023-12-24T18:55:14.018 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-12-24T18:55:14.019 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-12-24T18:55:14.019 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T18:55:14.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-12-24T18:55:14.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.188+0000 7f5071b45700 1 Processor -- start 2023-12-24T18:55:14.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.188+0000 7f5071b45700 1 -- start start 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 0x7f506c15b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f506c154590 0x7f506c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c06e1f0 con 0x7f506c154590 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0cc020 con 0x7f506c15ac50 2023-12-24T18:55:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5071b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c154f20 con 0x7f506c06cbe0 2023-12-24T18:55:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f506c154590 0x7f506c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f506c154590 0x7f506c1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43414/0 (socket says 172.21.15.50:43414) 2023-12-24T18:55:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 -- 172.21.15.50:0/3757508446 learned_addr learned my addr 172.21.15.50:0/3757508446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506b7fe700 1 --2- 172.21.15.50:0/3757508446 >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 0x7f506c15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506bfff700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 -- 172.21.15.50:0/3757508446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 msgr2=0x7f506c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 -- 172.21.15.50:0/3757508446 >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 msgr2=0x7f506c15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 --2- 172.21.15.50:0/3757508446 >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 0x7f506c15b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 -- 172.21.15.50:0/3757508446 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c06d950 con 0x7f506c154590 2023-12-24T18:55:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506b7fe700 1 --2- 172.21.15.50:0/3757508446 >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 0x7f506c15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f5063fff700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c154590 0x7f506c1549e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f506c06bf70 tx=0x7f5054009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3749cc52c04f64 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506affd700 1 -- 172.21.15.50:0/3757508446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400b640 con 0x7f506c154590 2023-12-24T18:55:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506affd700 1 -- 172.21.15.50:0/3757508446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400b7a0 con 0x7f506c154590 2023-12-24T18:55:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.192+0000 7f506affd700 1 -- 172.21.15.50:0/3757508446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400bb40 con 0x7f506c154590 2023-12-24T18:55:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 -- 172.21.15.50:0/3757508446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c154590 msgr2=0x7f506c1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c154590 0x7f506c1549e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f506c06bf70 tx=0x7f5054009250 comp rx=0 tx=0).stop 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 -- 172.21.15.50:0/3757508446 shutdown_connections 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 --2- 172.21.15.50:0/3757508446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c154590 0x7f506c1549e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 --2- 172.21.15.50:0/3757508446 >> v2:172.21.15.82:3300/0 conn(0x7f506c15ac50 0x7f506c15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 -- 172.21.15.50:0/3757508446 >> 172.21.15.50:0/3757508446 conn(0x7f506c0cdd80 msgr2=0x7f506c0ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 -- 172.21.15.50:0/3757508446 shutdown_connections 2023-12-24T18:55:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.196+0000 7f5071b45700 1 -- 172.21.15.50:0/3757508446 wait complete. 2023-12-24T18:55:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 Processor -- start 2023-12-24T18:55:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 -- start start 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506c154590 0x7f506c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 0x7f506c169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c1522d0 con 0x7f506c15ac50 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0c5e00 con 0x7f506c154590 2023-12-24T18:55:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5071b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0c60e0 con 0x7f506c06cbe0 2023-12-24T18:55:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f506b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f506bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 0x7f506c169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f506b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:54664/0 (socket says 172.21.15.50:54664) 2023-12-24T18:55:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f506b7fe700 1 -- 172.21.15.50:0/2008125238 learned_addr learned my addr 172.21.15.50:0/2008125238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.200+0000 7f5063fff700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506c154590 0x7f506c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 -- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506c154590 msgr2=0x7f506c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506c154590 0x7f506c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 -- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 msgr2=0x7f506c169180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 0x7f506c169180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 -- 172.21.15.50:0/2008125238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009420 con 0x7f506c06cbe0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506bfff700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 0x7f506c169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f506b7fe700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ecb0 tx=0x7f505c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00c920 con 0x7f506c06cbe0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c00ca80 con 0x7f506c06cbe0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00ce00 con 0x7f506c06cbe0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50540094f0 con 0x7f506c06cbe0 2023-12-24T18:55:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0c66a0 con 0x7f506c06cbe0 2023-12-24T18:55:14.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.204+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0652e0 con 0x7f506c06cbe0 2023-12-24T18:55:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.208+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f505c013680 con 0x7f506c06cbe0 2023-12-24T18:55:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.208+0000 7f50637fe700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 0x7f504c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:14.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.208+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f505c07cd30 con 0x7f506c06cbe0 2023-12-24T18:55:14.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.208+0000 7f5063fff700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 0x7f504c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:14.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.212+0000 7f5063fff700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 0x7f504c062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f506c06bf70 tx=0x7f5054017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:14.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.216+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f505c04d050 con 0x7f506c06cbe0 2023-12-24T18:55:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.456+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f506c06dc30 con 0x7f506c06cbe0 2023-12-24T18:55:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:14.996+0000 7f50637fe700 1 -- 172.21.15.50:0/2008125238 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v723) v1 ==== 181+0+0 (secure 0 0 0) 0x7f505c050670 con 0x7f506c06cbe0 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 msgr2=0x7f504c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 0x7f504c062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f506c06bf70 tx=0x7f5054017000 comp rx=0 tx=0).stop 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 msgr2=0x7f506c0ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ecb0 tx=0x7f505c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 shutdown_connections 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f504c060550 0x7f504c062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f506c15ac50 0x7f506c169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506c154590 0x7f506c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 --2- 172.21.15.50:0/2008125238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f506c06cbe0 0x7f506c0ce6a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 >> 172.21.15.50:0/2008125238 conn(0x7f506c0cdd80 msgr2=0x7f506c153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 shutdown_connections 2023-12-24T18:55:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.004+0000 7f5071b45700 1 -- 172.21.15.50:0/2008125238 wait complete. 2023-12-24T18:55:15.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T18:55:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.204+0000 7fe4bbe6e700 1 Processor -- start 2023-12-24T18:55:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.204+0000 7fe4bbe6e700 1 -- start start 2023-12-24T18:55:15.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4bbe6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe4b4159070 0x7fe4b40cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4bbe6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b406cf30 0x7fe4b406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4bbe6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b406b5c0 con 0x7fe4b40ca850 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4bbe6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b406a9b0 con 0x7fe4b406cf30 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4bbe6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b406ac90 con 0x7fe4b4159070 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4b9409700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe4b40ca850 0x7fe4b406c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43440/0 (socket says 172.21.15.50:43440) 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4b9409700 1 -- 172.21.15.50:0/4270372737 learned_addr learned my addr 172.21.15.50:0/4270372737 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/4270372737 >> v2:172.21.15.50:3300/0 conn(0x7fe4b406cf30 0x7fe4b406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4b9c0a700 1 --2- 172.21.15.50:0/4270372737 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4159070 0x7fe4b40cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4ba40b700 1 -- 172.21.15.50:0/4270372737 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4159070 msgr2=0x7fe4b40cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/4270372737 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4159070 0x7fe4b40cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.208+0000 7fe4ba40b700 1 -- 172.21.15.50:0/4270372737 >> v1:172.21.15.50:6789/0 conn(0x7fe4b40ca850 legacy=0x7fe4b406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4b8c08700 1 -- 172.21.15.50:0/4270372737 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792316920 0 0) 0x7fe4b406b5c0 con 0x7fe4b40ca850 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4ba40b700 1 -- 172.21.15.50:0/4270372737 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b406af70 con 0x7fe4b406cf30 2023-12-24T18:55:15.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/4270372737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406cf30 0x7fe4b406ba50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4068000 tx=0x7fe4ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48a99289c72c596 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4b8c08700 1 -- 172.21.15.50:0/4270372737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00e070 con 0x7fe4b406cf30 2023-12-24T18:55:15.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4b8c08700 1 -- 172.21.15.50:0/4270372737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00bb60 con 0x7fe4b406cf30 2023-12-24T18:55:15.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4b8c08700 1 -- 172.21.15.50:0/4270372737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac012430 con 0x7fe4b406cf30 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/4270372737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406cf30 msgr2=0x7fe4b406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/4270372737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406cf30 0x7fe4b406ba50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4068000 tx=0x7fe4ac009780 comp rx=0 tx=0).stop 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/4270372737 shutdown_connections 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/4270372737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b406cf30 0x7fe4b406ba50 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/4270372737 >> v2:172.21.15.82:3300/0 conn(0x7fe4b4159070 0x7fe4b40cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/4270372737 >> 172.21.15.50:0/4270372737 conn(0x7fe4b4067b50 msgr2=0x7fe4b40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/4270372737 shutdown_connections 2023-12-24T18:55:15.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.212+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/4270372737 wait complete. 2023-12-24T18:55:15.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 Processor -- start 2023-12-24T18:55:15.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 -- start start 2023-12-24T18:55:15.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b40ca850 0x7fe4b40c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4169b50 con 0x7fe4b4159070 2023-12-24T18:55:15.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4144f40 con 0x7fe4b40ca850 2023-12-24T18:55:15.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4bbe6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40b4d60 con 0x7fe4b406cf30 2023-12-24T18:55:15.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4ba40b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4b9c0a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4ba40b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43448/0 (socket says 172.21.15.50:43448) 2023-12-24T18:55:15.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4b9c0a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:54672/0 (socket says 172.21.15.50:54672) 2023-12-24T18:55:15.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4ba40b700 1 -- 172.21.15.50:0/1169377090 learned_addr learned my addr 172.21.15.50:0/1169377090 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:15.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.216+0000 7fe4b9409700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b40ca850 0x7fe4b40c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 -- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 msgr2=0x7fe4b4144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 -- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b40ca850 msgr2=0x7fe4b40c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b40ca850 0x7fe4b40c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 -- 172.21.15.50:0/1169377090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac009a20 con 0x7fe4b4159070 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4b9c0a700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:15.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4ba40b700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0097c0 tx=0x7fe4ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac012e60 con 0x7fe4b4159070 2023-12-24T18:55:15.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac027470 con 0x7fe4b4159070 2023-12-24T18:55:15.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4169870 con 0x7fe4b4159070 2023-12-24T18:55:15.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac027810 con 0x7fe4b4159070 2023-12-24T18:55:15.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.220+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b40b49f0 con 0x7fe4b4159070 2023-12-24T18:55:15.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.224+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b40b4ef0 con 0x7fe4b4159070 2023-12-24T18:55:15.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.224+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe4ac024070 con 0x7fe4b4159070 2023-12-24T18:55:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.228+0000 7fe4a9ffb700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 0x7fe498062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.228+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fe4ac07efb0 con 0x7fe4b4159070 2023-12-24T18:55:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.228+0000 7fe4b9c0a700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 0x7fe498062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.228+0000 7fe4b9c0a700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 0x7fe498062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0011480 tx=0x7fe4b00091a0 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.232+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4ac04f2d0 con 0x7fe4b4159070 2023-12-24T18:55:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.404+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe4b40652e0 con 0x7fe4b4159070 2023-12-24T18:55:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.416+0000 7fe4a9ffb700 1 -- 172.21.15.50:0/1169377090 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe4ac0528f0 con 0x7fe4b4159070 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 msgr2=0x7fe498062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 0x7fe498062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0011480 tx=0x7fe4b00091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 msgr2=0x7fe4b40c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0097c0 tx=0x7fe4ac019000 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 shutdown_connections 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe498060580 0x7fe498062a30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b4159070 0x7fe4b40c5330 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b40ca850 0x7fe4b40c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 --2- 172.21.15.50:0/1169377090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4b406cf30 0x7fe4b4144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 >> 172.21.15.50:0/1169377090 conn(0x7fe4b4067b50 msgr2=0x7fe4b406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 shutdown_connections 2023-12-24T18:55:15.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.420+0000 7fe4bbe6e700 1 -- 172.21.15.50:0/1169377090 wait complete. 2023-12-24T18:55:15.445 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T18:55:15.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:55:15.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T18:55:15.540 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T18:55:15.540 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T18:55:15.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:15.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 Processor -- start 2023-12-24T18:55:15.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 -- start start 2023-12-24T18:55:15.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac7415a2d0 0x7fac740ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac7406c820 0x7fac740ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac740adc90 0x7fac740b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7406d8c0 con 0x7fac7406c820 2023-12-24T18:55:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740afc60 con 0x7fac740adc90 2023-12-24T18:55:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740b0460 con 0x7fac7415a2d0 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac71d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac7406c820 0x7fac740ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac71d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac7406c820 0x7fac740ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43450/0 (socket says 172.21.15.50:43450) 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac71d9b700 1 -- 172.21.15.50:0/2188540577 learned_addr learned my addr 172.21.15.50:0/2188540577 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac7259c700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac7415a2d0 0x7fac740ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.708+0000 7fac72d9d700 1 --2- 172.21.15.50:0/2188540577 >> v2:172.21.15.82:3300/0 conn(0x7fac740adc90 0x7fac740b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 -- 172.21.15.50:0/2188540577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac7415a2d0 msgr2=0x7fac740ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac7415a2d0 0x7fac740ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 -- 172.21.15.50:0/2188540577 >> v2:172.21.15.82:3300/0 conn(0x7fac740adc90 msgr2=0x7fac740b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2188540577 >> v2:172.21.15.82:3300/0 conn(0x7fac740adc90 0x7fac740b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 -- 172.21.15.50:0/2188540577 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740ae100 con 0x7fac7406c820 2023-12-24T18:55:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac740ad750 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fac7406a390 tx=0x7fac68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7167e6fef6a30c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7159a700 1 -- 172.21.15.50:0/2188540577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800b640 con 0x7fac7406c820 2023-12-24T18:55:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7159a700 1 -- 172.21.15.50:0/2188540577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800b7a0 con 0x7fac7406c820 2023-12-24T18:55:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7159a700 1 -- 172.21.15.50:0/2188540577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800bb60 con 0x7fac7406c820 2023-12-24T18:55:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 -- 172.21.15.50:0/2188540577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 msgr2=0x7fac740ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac740ad750 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fac7406a390 tx=0x7fac68009250 comp rx=0 tx=0).stop 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 -- 172.21.15.50:0/2188540577 shutdown_connections 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 --2- 172.21.15.50:0/2188540577 >> v2:172.21.15.82:3300/0 conn(0x7fac740adc90 0x7fac740b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac740ad750 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 --2- 172.21.15.50:0/2188540577 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac7415a2d0 0x7fac740ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 -- 172.21.15.50:0/2188540577 >> 172.21.15.50:0/2188540577 conn(0x7fac74067b80 msgr2=0x7fac740cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 -- 172.21.15.50:0/2188540577 shutdown_connections 2023-12-24T18:55:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.712+0000 7fac7359e700 1 -- 172.21.15.50:0/2188540577 wait complete. 2023-12-24T18:55:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 Processor -- start 2023-12-24T18:55:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 -- start start 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac740adc90 0x7fac7416abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac7415a2d0 0x7fac740a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740a5f20 con 0x7fac7406c820 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74152c90 con 0x7fac7415a2d0 2023-12-24T18:55:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.716+0000 7fac7359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7416a1a0 con 0x7fac740adc90 2023-12-24T18:55:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43454/0 (socket says 172.21.15.50:43454) 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 -- 172.21.15.50:0/2764578100 learned_addr learned my addr 172.21.15.50:0/2764578100 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac740adc90 0x7fac7416abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac72d9d700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac7415a2d0 0x7fac740a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 -- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac740adc90 msgr2=0x7fac7416abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac740adc90 0x7fac7416abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 -- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac7415a2d0 msgr2=0x7fac740a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac7415a2d0 0x7fac740a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 -- 172.21.15.50:0/2764578100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac680094f0 con 0x7fac7406c820 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7259c700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fac6400e980 tx=0x7fac640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64013680 con 0x7fac7406c820 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac640137e0 con 0x7fac7406c820 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac740a6110 con 0x7fac7406c820 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64013ba0 con 0x7fac7406c820 2023-12-24T18:55:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7416a3f0 con 0x7fac7406c820 2023-12-24T18:55:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.720+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74063fe0 con 0x7fac7406c820 2023-12-24T18:55:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.724+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fac640123d0 con 0x7fac7406c820 2023-12-24T18:55:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.724+0000 7fac627fc700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 0x7fac54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.724+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fac6407cbb0 con 0x7fac7406c820 2023-12-24T18:55:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.724+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 0x7fac54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:15.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.728+0000 7fac71d9b700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 0x7fac54062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac7406a390 tx=0x7fac68017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.732+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fac74063fe0 con 0x7fac7406c820 2023-12-24T18:55:15.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac7404be40 con 0x7fac7406c820 2023-12-24T18:55:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac627fc700 1 -- 172.21.15.50:0/2764578100 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fac64017de0 con 0x7fac7406c820 2023-12-24T18:55:15.943 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:15.943 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3798314491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3798314491},{"type":"v1","addr":"172.21.15.82:6835","nonce":3798314491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1321821992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1321821992},{"type":"v1","addr":"172.21.15.50:6833","nonce":1321821992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1347446395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1347446395},{"type":"v1","addr":"172.21.15.82:6833","nonce":1347446395}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/841186947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":841186947},{"type":"v1","addr":"172.21.15.50:6835","nonce":841186947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-12-24T18:55:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 msgr2=0x7fac54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 0x7fac54062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac7406a390 tx=0x7fac68017000 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 msgr2=0x7fac74152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fac6400e980 tx=0x7fac640091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 shutdown_connections 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fac54060550 0x7fac54062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac7415a2d0 0x7fac740a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.940+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac740adc90 0x7fac7416abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.944+0000 7fac7359e700 1 --2- 172.21.15.50:0/2764578100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac7406c820 0x7fac74152370 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.944+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 >> 172.21.15.50:0/2764578100 conn(0x7fac74067b80 msgr2=0x7fac74154840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.944+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 shutdown_connections 2023-12-24T18:55:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:15.944+0000 7fac7359e700 1 -- 172.21.15.50:0/2764578100 wait complete. 2023-12-24T18:55:15.948 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 63 2023-12-24T18:55:15.967 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T18:55:15.968 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T18:55:15.968 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T18:55:15.968 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:55:15.968 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T18:55:15.968 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T18:55:15.968 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T18:55:15.968 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:55:15.969 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T18:55:15.969 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T18:55:15.969 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T18:55:15.969 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:55:15.969 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T18:55:15.969 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T18:55:15.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T18:55:15.969 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T18:55:15.986 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T18:55:15.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T18:55:15.990 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T18:55:15.990 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T18:55:15.991 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T18:55:15.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T18:55:15.993 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T18:55:15.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T18:55:16.043 INFO:tasks.ceph.mds.a:Started 2023-12-24T18:55:16.044 DEBUG:teuthology.parallel:result is None 2023-12-24T18:55:16.047 INFO:tasks.ceph.mds.b:Started 2023-12-24T18:55:16.047 DEBUG:teuthology.parallel:result is None 2023-12-24T18:55:16.048 INFO:tasks.ceph.mds.c:Started 2023-12-24T18:55:16.048 DEBUG:teuthology.parallel:result is None 2023-12-24T18:55:16.053 INFO:tasks.ceph.mds.d:Started 2023-12-24T18:55:16.053 DEBUG:teuthology.parallel:result is None 2023-12-24T18:55:16.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T18:55:16.154 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T18:55:16.159 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T18:55:16.160 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T18:55:16.172 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T18:55:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.216+0000 7fd7999c5700 1 Processor -- start 2023-12-24T18:55:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.216+0000 7fd7999c5700 1 -- start start 2023-12-24T18:55:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7999c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7940b1ad0 0x7fd79406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7999c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7940ae8c0 0x7fd79406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7999c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79415b860 con 0x7fd79406d140 2023-12-24T18:55:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7999c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79415ac50 con 0x7fd7940ae8c0 2023-12-24T18:55:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7999c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79415af30 con 0x7fd7940b1ad0 2023-12-24T18:55:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7927fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7940b1ad0 0x7fd79406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd792ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd79406d140 0x7fd7940b13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:45264/0 (socket says 172.21.15.50:45264) 2023-12-24T18:55:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd792ffd700 1 -- 172.21.15.50:0/2955423016 learned_addr learned my addr 172.21.15.50:0/2955423016 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd7937fe700 1 --2- 172.21.15.50:0/2955423016 >> v2:172.21.15.50:3300/0 conn(0x7fd7940ae8c0 0x7fd79406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.220+0000 7fd791ffb700 1 -- 172.21.15.50:0/2955423016 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167522581 0 0) 0x7fd79415b860 con 0x7fd79406d140 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7927fc700 1 -- 172.21.15.50:0/2955423016 >> v2:172.21.15.50:3300/0 conn(0x7fd7940ae8c0 msgr2=0x7fd79406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7927fc700 1 --2- 172.21.15.50:0/2955423016 >> v2:172.21.15.50:3300/0 conn(0x7fd7940ae8c0 0x7fd79406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7927fc700 1 -- 172.21.15.50:0/2955423016 >> v1:172.21.15.82:6789/0 conn(0x7fd79406d140 legacy=0x7fd7940b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7927fc700 1 -- 172.21.15.50:0/2955423016 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79415b210 con 0x7fd7940b1ad0 2023-12-24T18:55:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7927fc700 1 --2- 172.21.15.50:0/2955423016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7940b1ad0 0x7fd79406d510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ca7c0 tx=0x7fd7880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df88628367f9cbb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:16.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd791ffb700 1 -- 172.21.15.50:0/2955423016 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800b6b0 con 0x7fd7940b1ad0 2023-12-24T18:55:16.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd791ffb700 1 -- 172.21.15.50:0/2955423016 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78800b810 con 0x7fd7940b1ad0 2023-12-24T18:55:16.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd791ffb700 1 -- 172.21.15.50:0/2955423016 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800bbb0 con 0x7fd7940b1ad0 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 -- 172.21.15.50:0/2955423016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7940b1ad0 msgr2=0x7fd79406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 --2- 172.21.15.50:0/2955423016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7940b1ad0 0x7fd79406d510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ca7c0 tx=0x7fd7880091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 -- 172.21.15.50:0/2955423016 shutdown_connections 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 --2- 172.21.15.50:0/2955423016 >> v2:172.21.15.50:3300/0 conn(0x7fd7940ae8c0 0x7fd79406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 --2- 172.21.15.50:0/2955423016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7940b1ad0 0x7fd79406d510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 -- 172.21.15.50:0/2955423016 >> 172.21.15.50:0/2955423016 conn(0x7fd79406ae30 msgr2=0x7fd7940adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:16.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 -- 172.21.15.50:0/2955423016 shutdown_connections 2023-12-24T18:55:16.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.224+0000 7fd7999c5700 1 -- 172.21.15.50:0/2955423016 wait complete. 2023-12-24T18:55:16.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.228+0000 7fd7999c5700 1 Processor -- start 2023-12-24T18:55:16.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.228+0000 7fd7999c5700 1 -- start start 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 0x7fd794150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7940ae8c0 0x7fd794156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794169ca0 con 0x7fd7940b1ad0 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940b0280 con 0x7fd79406d140 2023-12-24T18:55:16.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941528f0 con 0x7fd7940ae8c0 2023-12-24T18:55:16.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43516/0 (socket says 172.21.15.50:43516) 2023-12-24T18:55:16.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 -- 172.21.15.50:0/1537783405 learned_addr learned my addr 172.21.15.50:0/1537783405 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:16.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd792ffd700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 0x7fd794150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7927fc700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7940ae8c0 0x7fd794156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 -- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7940ae8c0 msgr2=0x7fd794156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7940ae8c0 0x7fd794156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 -- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 msgr2=0x7fd794150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 0x7fd794150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 -- 172.21.15.50:0/1537783405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788009420 con 0x7fd7940b1ad0 2023-12-24T18:55:16.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd792ffd700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 0x7fd794150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7937fe700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009fa0 tx=0x7fd78c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00ed20 con 0x7fd7940b1ad0 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00ee80 con 0x7fd7940b1ad0 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c014670 con 0x7fd7940b1ad0 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794152bd0 con 0x7fd7940b1ad0 2023-12-24T18:55:16.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.232+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940aff10 con 0x7fd7940b1ad0 2023-12-24T18:55:16.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.236+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7940ca410 con 0x7fd7940b1ad0 2023-12-24T18:55:16.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.236+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd78c0149e0 con 0x7fd7940b1ad0 2023-12-24T18:55:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.240+0000 7fd77affd700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 0x7fd780062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.240+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fd78c07d230 con 0x7fd7940b1ad0 2023-12-24T18:55:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.240+0000 7fd792ffd700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 0x7fd780062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.240+0000 7fd792ffd700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 0x7fd780062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd784009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.248+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7940ca410 con 0x7fd7940b1ad0 2023-12-24T18:55:16.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:16.436+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd7940ca410 con 0x7fd7940b1ad0 2023-12-24T18:55:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.024+0000 7fd77affd700 1 -- 172.21.15.50:0/1537783405 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd7940ca410 con 0x7fd7940b1ad0 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 msgr2=0x7fd780062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 0x7fd780062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd784009040 comp rx=0 tx=0).stop 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 msgr2=0x7fd794156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009fa0 tx=0x7fd78c009900 comp rx=0 tx=0).stop 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 shutdown_connections 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd780060550 0x7fd780062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7940b1ad0 0x7fd794156b70 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7940ae8c0 0x7fd794156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 --2- 172.21.15.50:0/1537783405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79406d140 0x7fd794150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 >> 172.21.15.50:0/1537783405 conn(0x7fd79406ae30 msgr2=0x7fd7940cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 shutdown_connections 2023-12-24T18:55:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.028+0000 7fd7999c5700 1 -- 172.21.15.50:0/1537783405 wait complete. 2023-12-24T18:55:17.032 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T18:55:17.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T18:55:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.212+0000 7fdad2e2e700 1 Processor -- start 2023-12-24T18:55:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.212+0000 7fdad2e2e700 1 -- start start 2023-12-24T18:55:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad2e2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad2e2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdacc06aca0 0x7fdacc06b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad2e2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc06c820 con 0x7fdacc154450 2023-12-24T18:55:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad2e2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc06b960 con 0x7fdacc06aca0 2023-12-24T18:55:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad2e2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc06bc40 con 0x7fdacc0c6d00 2023-12-24T18:55:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad0bca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdacc06aca0 0x7fdacc06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad0bca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:54738/0 (socket says 172.21.15.50:54738) 2023-12-24T18:55:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad0bca700 1 -- 172.21.15.50:0/3262618662 learned_addr learned my addr 172.21.15.50:0/3262618662 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacbfff700 1 --1- 172.21.15.50:0/3262618662 >> v1:172.21.15.82:6789/0 conn(0x7fdacc154450 0x7fdacc1548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:45276/0 (socket says 172.21.15.50:45276) 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacb7fe700 1 -- 172.21.15.50:0/3262618662 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472920876 0 0) 0x7fdacc06c820 con 0x7fdacc154450 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacb7fe700 1 -- 172.21.15.50:0/3262618662 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdabc003570 con 0x7fdacc154450 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 -- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 msgr2=0x7fdacc0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 -- 172.21.15.50:0/3262618662 >> v1:172.21.15.82:6789/0 conn(0x7fdacc154450 legacy=0x7fdacc1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 -- 172.21.15.50:0/3262618662 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc06bf20 con 0x7fdacc06aca0 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad0bca700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdad13cb700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc06aca0 0x7fdacc06b100 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098e0 tx=0x7fdac40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8db696916b388 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacb7fe700 1 -- 172.21.15.50:0/3262618662 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011630 con 0x7fdacc06aca0 2023-12-24T18:55:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacb7fe700 1 -- 172.21.15.50:0/3262618662 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4011790 con 0x7fdacc06aca0 2023-12-24T18:55:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.216+0000 7fdacb7fe700 1 -- 172.21.15.50:0/3262618662 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011b30 con 0x7fdacc06aca0 2023-12-24T18:55:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 -- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc06aca0 msgr2=0x7fdacc06b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc06aca0 0x7fdacc06b100 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098e0 tx=0x7fdac40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 -- 172.21.15.50:0/3262618662 shutdown_connections 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc06aca0 0x7fdacc06b100 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/3262618662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc0c6d00 0x7fdacc0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 -- 172.21.15.50:0/3262618662 >> 172.21.15.50:0/3262618662 conn(0x7fdacc0cbba0 msgr2=0x7fdacc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 -- 172.21.15.50:0/3262618662 shutdown_connections 2023-12-24T18:55:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 -- 172.21.15.50:0/3262618662 wait complete. 2023-12-24T18:55:17.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.220+0000 7fdad2e2e700 1 Processor -- start 2023-12-24T18:55:17.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 -- start start 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc06aca0 0x7fdacc0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0c6d00 0x7fdacc157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0aeff0 con 0x7fdacc154450 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc156bf0 con 0x7fdacc0c6d00 2023-12-24T18:55:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad2e2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1575c0 con 0x7fdacc06aca0 2023-12-24T18:55:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43518/0 (socket says 172.21.15.50:43518) 2023-12-24T18:55:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 -- 172.21.15.50:0/2614761951 learned_addr learned my addr 172.21.15.50:0/2614761951 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad0bca700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc06aca0 0x7fdacc0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdacbfff700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0c6d00 0x7fdacc157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 -- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc06aca0 msgr2=0x7fdacc0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc06aca0 0x7fdacc0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 -- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0c6d00 msgr2=0x7fdacc157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0c6d00 0x7fdacc157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.224+0000 7fdad13cb700 1 -- 172.21.15.50:0/2614761951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009ae0 con 0x7fdacc154450 2023-12-24T18:55:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdad13cb700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdacc069da0 tx=0x7fdac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40253f0 con 0x7fdacc154450 2023-12-24T18:55:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4025570 con 0x7fdacc154450 2023-12-24T18:55:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac4009420 con 0x7fdacc154450 2023-12-24T18:55:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4025930 con 0x7fdacc154450 2023-12-24T18:55:17.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc1562c0 con 0x7fdacc154450 2023-12-24T18:55:17.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.228+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc156d80 con 0x7fdacc154450 2023-12-24T18:55:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.232+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdac4025d20 con 0x7fdacc154450 2023-12-24T18:55:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.232+0000 7fdac8ff9700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.232+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5577+0+0 (secure 0 0 0) 0x7fdac407e110 con 0x7fdacc154450 2023-12-24T18:55:17.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.232+0000 7fdad0bca700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.232+0000 7fdad0bca700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 0x7fdab0062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdacc155b60 tx=0x7fdac000b040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.240+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdac404e780 con 0x7fdacc154450 2023-12-24T18:55:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.468+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdacc0652e0 con 0x7fdacc154450 2023-12-24T18:55:17.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.468+0000 7fdac8ff9700 1 -- 172.21.15.50:0/2614761951 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdac4051da0 con 0x7fdacc154450 2023-12-24T18:55:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T18:55:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T18:55:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T18:55:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T18:55:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T18:55:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T18:55:17.489 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:55:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 msgr2=0x7fdab0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 0x7fdab0062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdacc155b60 tx=0x7fdac000b040 comp rx=0 tx=0).stop 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 msgr2=0x7fdacc145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdacc069da0 tx=0x7fdac4017000 comp rx=0 tx=0).stop 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 shutdown_connections 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc154450 0x7fdacc145640 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0c6d00 0x7fdacc157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 --2- 172.21.15.50:0/2614761951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdacc06aca0 0x7fdacc0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 >> 172.21.15.50:0/2614761951 conn(0x7fdacc0cbba0 msgr2=0x7fdacc159530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 shutdown_connections 2023-12-24T18:55:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.472+0000 7fdad2e2e700 1 -- 172.21.15.50:0/2614761951 wait complete. 2023-12-24T18:55:17.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 Processor -- start 2023-12-24T18:55:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 -- start start 2023-12-24T18:55:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f502415d260 0x7f502406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406b1d0 con 0x7f502406bba0 2023-12-24T18:55:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406a5c0 con 0x7f502415d260 2023-12-24T18:55:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502b8ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502406a8a0 con 0x7f5024161cc0 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f5029e4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f5028e49700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f5029e4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43524/0 (socket says 172.21.15.50:43524) 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f5028e49700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:54752/0 (socket says 172.21.15.50:54752) 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f5029e4b700 1 -- 172.21.15.50:0/3183661692 learned_addr learned my addr 172.21.15.50:0/3183661692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.672+0000 7f502964a700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.82:3300/0 conn(0x7f502415d260 0x7f502406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 -- 172.21.15.50:0/3183661692 >> v2:172.21.15.82:3300/0 conn(0x7f502415d260 msgr2=0x7f502406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.82:3300/0 conn(0x7f502415d260 0x7f502406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 -- 172.21.15.50:0/3183661692 >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 msgr2=0x7f50240c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 -- 172.21.15.50:0/3183661692 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502406ab80 con 0x7f5024161cc0 2023-12-24T18:55:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5029e4b700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f5028e49700 1 --2- 172.21.15.50:0/3183661692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50240c9630 tx=0x7f50140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baeb53ac73da00b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f501bfff700 1 -- 172.21.15.50:0/3183661692 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014011630 con 0x7f5024161cc0 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f501bfff700 1 -- 172.21.15.50:0/3183661692 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50140117b0 con 0x7f5024161cc0 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f501bfff700 1 -- 172.21.15.50:0/3183661692 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014011b70 con 0x7f5024161cc0 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 -- 172.21.15.50:0/3183661692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 msgr2=0x7f502406b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 --2- 172.21.15.50:0/3183661692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50240c9630 tx=0x7f50140091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 -- 172.21.15.50:0/3183661692 shutdown_connections 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.50:3300/0 conn(0x7f502406bba0 0x7f50240c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 --2- 172.21.15.50:0/3183661692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5024161cc0 0x7f502406b660 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 --2- 172.21.15.50:0/3183661692 >> v2:172.21.15.82:3300/0 conn(0x7f502415d260 0x7f502406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 -- 172.21.15.50:0/3183661692 >> 172.21.15.50:0/3183661692 conn(0x7f5024067b50 msgr2=0x7f50240cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 -- 172.21.15.50:0/3183661692 shutdown_connections 2023-12-24T18:55:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.676+0000 7f502b8ae700 1 -- 172.21.15.50:0/3183661692 wait complete. 2023-12-24T18:55:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 Processor -- start 2023-12-24T18:55:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 -- start start 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f502415d260 0x7f5024157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 0x7f502415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502415e330 con 0x7f502406bba0 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502415d760 con 0x7f5024161cc0 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502b8ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502415da00 con 0x7f502415d260 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502964a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502964a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43540/0 (socket says 172.21.15.50:43540) 2023-12-24T18:55:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.680+0000 7f502964a700 1 -- 172.21.15.50:0/2693819344 learned_addr learned my addr 172.21.15.50:0/2693819344 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f5028e49700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f502415d260 0x7f5024157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f5029e4b700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 0x7f502415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 -- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f502415d260 msgr2=0x7f5024157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f502415d260 0x7f5024157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 -- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 msgr2=0x7f502415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 0x7f502415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 -- 172.21.15.50:0/2693819344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009ae0 con 0x7f502406bba0 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f5029e4b700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 0x7f502415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502964a700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f502000ec80 tx=0x7f50200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000c9d0 con 0x7f502406bba0 2023-12-24T18:55:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000cb30 con 0x7f502406bba0 2023-12-24T18:55:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020013470 con 0x7f502406bba0 2023-12-24T18:55:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5014009420 con 0x7f502406bba0 2023-12-24T18:55:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502415dfc0 con 0x7f502406bba0 2023-12-24T18:55:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.684+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50240652e0 con 0x7f502406bba0 2023-12-24T18:55:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.688+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5020013820 con 0x7f502406bba0 2023-12-24T18:55:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.688+0000 7f50197fa700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 0x7f5008062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.688+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f502007cb30 con 0x7f502406bba0 2023-12-24T18:55:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.688+0000 7f5028e49700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 0x7f5008062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.692+0000 7f5028e49700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 0x7f5008062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50240c9630 tx=0x7f5014017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:17.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.696+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f502004d100 con 0x7f502406bba0 2023-12-24T18:55:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.872+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f502406ae60 con 0x7f502406bba0 2023-12-24T18:55:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.872+0000 7f50197fa700 1 -- 172.21.15.50:0/2693819344 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12918 (secure 0 0 0) 0x7f5020050720 con 0x7f502406bba0 2023-12-24T18:55:17.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:17.876 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":134,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:55:17.035927+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 msgr2=0x7f5008062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 0x7f5008062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50240c9630 tx=0x7f5014017000 comp rx=0 tx=0).stop 2023-12-24T18:55:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 msgr2=0x7f50240c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f502000ec80 tx=0x7f50200091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 shutdown_connections 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5008060550 0x7f5008062a00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5024161cc0 0x7f502415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f502415d260 0x7f5024157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 --2- 172.21.15.50:0/2693819344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f502406bba0 0x7f50240c2db0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 >> 172.21.15.50:0/2693819344 conn(0x7f5024067b50 msgr2=0x7f50240c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 shutdown_connections 2023-12-24T18:55:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:17.876+0000 7f502b8ae700 1 -- 172.21.15.50:0/2693819344 wait complete. 2023-12-24T18:55:17.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T18:55:17.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T18:55:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 Processor -- start 2023-12-24T18:55:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 -- start start 2023-12-24T18:55:18.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2140c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2140bef90 0x7ff2140c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140c9ea0 con 0x7ff2140bebc0 2023-12-24T18:55:18.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21415d840 con 0x7ff2140bef90 2023-12-24T18:55:18.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.068+0000 7ff219a0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff214161780 con 0x7ff2140ab920 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2140c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff218a0a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2140bebc0 0x7ff214160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43458/0 (socket says 172.21.15.50:43458) 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff218a0a700 1 -- 172.21.15.50:0/2916732363 learned_addr learned my addr 172.21.15.50:0/2916732363 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff21920b700 1 --2- 172.21.15.50:0/2916732363 >> v2:172.21.15.82:3300/0 conn(0x7ff2140bef90 0x7ff2140c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff2137fe700 1 -- 172.21.15.50:0/2916732363 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545849898 0 0) 0x7ff2140c9ea0 con 0x7ff2140bebc0 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff2137fe700 1 -- 172.21.15.50:0/2916732363 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff204003570 con 0x7ff2140bebc0 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 -- 172.21.15.50:0/2916732363 >> v2:172.21.15.82:3300/0 conn(0x7ff2140bef90 msgr2=0x7ff2140c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 --2- 172.21.15.50:0/2916732363 >> v2:172.21.15.82:3300/0 conn(0x7ff2140bef90 0x7ff2140c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 -- 172.21.15.50:0/2916732363 >> v1:172.21.15.50:6789/0 conn(0x7ff2140bebc0 legacy=0x7ff214160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 -- 172.21.15.50:0/2916732363 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214161a60 con 0x7ff2140ab920 2023-12-24T18:55:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff213fff700 1 --2- 172.21.15.50:0/2916732363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2140c6f50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098e0 tx=0x7ff2000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f201977cc4fe8b82 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff2137fe700 1 -- 172.21.15.50:0/2916732363 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200011630 con 0x7ff2140ab920 2023-12-24T18:55:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff2137fe700 1 -- 172.21.15.50:0/2916732363 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200011790 con 0x7ff2140ab920 2023-12-24T18:55:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff2137fe700 1 -- 172.21.15.50:0/2916732363 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200011b30 con 0x7ff2140ab920 2023-12-24T18:55:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 -- 172.21.15.50:0/2916732363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 msgr2=0x7ff2140c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 --2- 172.21.15.50:0/2916732363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2140c6f50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098e0 tx=0x7ff2000091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 -- 172.21.15.50:0/2916732363 shutdown_connections 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 --2- 172.21.15.50:0/2916732363 >> v2:172.21.15.82:3300/0 conn(0x7ff2140bef90 0x7ff2140c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 --2- 172.21.15.50:0/2916732363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2140c6f50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 -- 172.21.15.50:0/2916732363 >> 172.21.15.50:0/2916732363 conn(0x7ff214067250 msgr2=0x7ff214067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.072+0000 7ff219a0c700 1 -- 172.21.15.50:0/2916732363 shutdown_connections 2023-12-24T18:55:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.076+0000 7ff219a0c700 1 -- 172.21.15.50:0/2916732363 wait complete. 2023-12-24T18:55:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.076+0000 7ff219a0c700 1 Processor -- start 2023-12-24T18:55:18.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.076+0000 7ff219a0c700 1 -- start start 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2141589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2140bef90 0x7ff2140c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140acdb0 con 0x7ff2140bebc0 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140ac130 con 0x7ff2140bef90 2023-12-24T18:55:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff219a0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140ac410 con 0x7ff2140ab920 2023-12-24T18:55:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43554/0 (socket says 172.21.15.50:43554) 2023-12-24T18:55:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 -- 172.21.15.50:0/1218086622 learned_addr learned my addr 172.21.15.50:0/1218086622 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff218a0a700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2141589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff21920b700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2140bef90 0x7ff2140c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 -- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 msgr2=0x7ff2141589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2141589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 -- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2140bef90 msgr2=0x7ff2140c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2140bef90 0x7ff2140c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 -- 172.21.15.50:0/1218086622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009420 con 0x7ff2140bebc0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.080+0000 7ff213fff700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7ff200013000 tx=0x7ff200017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200011900 con 0x7ff2140bebc0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200011a60 con 0x7ff2140bebc0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200023620 con 0x7ff2140bebc0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140ac6f0 con 0x7ff2140bebc0 2023-12-24T18:55:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140abdc0 con 0x7ff2140bebc0 2023-12-24T18:55:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214063300 con 0x7ff2140bebc0 2023-12-24T18:55:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.084+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff20002c3b0 con 0x7ff2140bebc0 2023-12-24T18:55:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.088+0000 7ff210ff9700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 0x7ff1f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.088+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5577+0+0 (secure 0 0 0) 0x7ff20007da90 con 0x7ff2140bebc0 2023-12-24T18:55:18.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.088+0000 7ff218a0a700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 0x7ff1f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.088+0000 7ff218a0a700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 0x7ff1f8062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff208007fd0 tx=0x7ff208009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.096+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff214063300 con 0x7ff2140bebc0 2023-12-24T18:55:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.268+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff214063300 con 0x7ff2140bebc0 2023-12-24T18:55:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.268+0000 7ff210ff9700 1 -- 172.21.15.50:0/1218086622 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff214063300 con 0x7ff2140bebc0 2023-12-24T18:55:18.271 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 msgr2=0x7ff1f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 0x7ff1f8062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff208007fd0 tx=0x7ff208009040 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 msgr2=0x7ff2140c16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7ff200013000 tx=0x7ff200017000 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 shutdown_connections 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff1f8060580 0x7ff1f8062a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2140bef90 0x7ff2140c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140bebc0 0x7ff2140c16b0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 --2- 172.21.15.50:0/1218086622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2140ab920 0x7ff2141589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 >> 172.21.15.50:0/1218086622 conn(0x7ff214067250 msgr2=0x7ff21406d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 shutdown_connections 2023-12-24T18:55:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.272+0000 7ff219a0c700 1 -- 172.21.15.50:0/1218086622 wait complete. 2023-12-24T18:55:18.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T18:55:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.472+0000 7f1b18f63700 1 Processor -- start 2023-12-24T18:55:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.472+0000 7f1b18f63700 1 -- start start 2023-12-24T18:55:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b140caf40 0x7f1b140cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 0x7f1b14156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1415a4d0 con 0x7f1b1406cd30 2023-12-24T18:55:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b14157030 con 0x7f1b140caf40 2023-12-24T18:55:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b14159610 con 0x7f1b14156690 2023-12-24T18:55:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b140caf40 0x7f1b140cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b12ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1b1406cd30 0x7f1b140ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43462/0 (socket says 172.21.15.50:43462) 2023-12-24T18:55:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b12ffd700 1 -- 172.21.15.50:0/1820216766 learned_addr learned my addr 172.21.15.50:0/1820216766 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b13fff700 1 --2- 172.21.15.50:0/1820216766 >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 0x7f1b14156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 -- 172.21.15.50:0/1820216766 >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 msgr2=0x7f1b14156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 --2- 172.21.15.50:0/1820216766 >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 0x7f1b14156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 -- 172.21.15.50:0/1820216766 >> v1:172.21.15.50:6789/0 conn(0x7f1b1406cd30 legacy=0x7f1b140ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b127fc700 1 -- 172.21.15.50:0/1820216766 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045045848 0 0) 0x7f1b1415a4d0 con 0x7f1b1406cd30 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 -- 172.21.15.50:0/1820216766 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140cd2a0 con 0x7f1b140caf40 2023-12-24T18:55:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b13fff700 1 --2- 172.21.15.50:0/1820216766 >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 0x7f1b14156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b137fe700 1 --2- 172.21.15.50:0/1820216766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b140caf40 0x7f1b140cb310 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e81edaace2fa290 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b127fc700 1 -- 172.21.15.50:0/1820216766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04009e80 con 0x7f1b140caf40 2023-12-24T18:55:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b127fc700 1 -- 172.21.15.50:0/1820216766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400b820 con 0x7f1b140caf40 2023-12-24T18:55:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b127fc700 1 -- 172.21.15.50:0/1820216766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400bba0 con 0x7f1b140caf40 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- 172.21.15.50:0/1820216766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b140caf40 msgr2=0x7f1b140cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1820216766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b140caf40 0x7f1b140cb310 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- 172.21.15.50:0/1820216766 shutdown_connections 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1820216766 >> v2:172.21.15.82:3300/0 conn(0x7f1b14156690 0x7f1b14156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1820216766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b140caf40 0x7f1b140cb310 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- 172.21.15.50:0/1820216766 >> 172.21.15.50:0/1820216766 conn(0x7f1b140670b0 msgr2=0x7f1b140674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- 172.21.15.50:0/1820216766 shutdown_connections 2023-12-24T18:55:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.476+0000 7f1b18f63700 1 -- 172.21.15.50:0/1820216766 wait complete. 2023-12-24T18:55:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 Processor -- start 2023-12-24T18:55:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 -- start start 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b140caf40 0x7f1b140b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b14156690 0x7f1b141554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140b3130 con 0x7f1b1406cd30 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140b3410 con 0x7f1b140caf40 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b18f63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140b36f0 con 0x7f1b14156690 2023-12-24T18:55:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43570/0 (socket says 172.21.15.50:43570) 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b137fe700 1 -- 172.21.15.50:0/1257266843 learned_addr learned my addr 172.21.15.50:0/1257266843 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b13fff700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b14156690 0x7f1b141554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.480+0000 7f1b12ffd700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b140caf40 0x7f1b140b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 -- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b14156690 msgr2=0x7f1b141554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b14156690 0x7f1b141554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 -- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b140caf40 msgr2=0x7f1b140b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b140caf40 0x7f1b140b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 -- 172.21.15.50:0/1257266843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04009420 con 0x7f1b1406cd30 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b137fe700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1b14067bc0 tx=0x7f1b04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400bba0 con 0x7f1b1406cd30 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04000c90 con 0x7f1b1406cd30 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011670 con 0x7f1b1406cd30 2023-12-24T18:55:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b140b39d0 con 0x7f1b1406cd30 2023-12-24T18:55:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b141699b0 con 0x7f1b1406cd30 2023-12-24T18:55:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.484+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1404be40 con 0x7f1b1406cd30 2023-12-24T18:55:18.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.488+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1b040119e0 con 0x7f1b1406cd30 2023-12-24T18:55:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.488+0000 7f1afb7fe700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 0x7f1b00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.488+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f1b0407dff0 con 0x7f1b1406cd30 2023-12-24T18:55:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.488+0000 7f1b12ffd700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 0x7f1b00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.492+0000 7f1b12ffd700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 0x7f1b00062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b14166630 tx=0x7f1b08007d30 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.496+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b040adbe0 con 0x7f1b1406cd30 2023-12-24T18:55:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.672+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1b1406bca0 con 0x7f1b1406cd30 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.672+0000 7f1afb7fe700 1 -- 172.21.15.50:0/1257266843 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1b04015090 con 0x7f1b1406cd30 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:18.675 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 msgr2=0x7f1b00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 0x7f1b00062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b14166630 tx=0x7f1b08007d30 comp rx=0 tx=0).stop 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 msgr2=0x7f1b14169470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1b14067bc0 tx=0x7f1b04017000 comp rx=0 tx=0).stop 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 shutdown_connections 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1b00060550 0x7f1b00062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b14156690 0x7f1b141554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b140caf40 0x7f1b140b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 --2- 172.21.15.50:0/1257266843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1406cd30 0x7f1b14169470 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 >> 172.21.15.50:0/1257266843 conn(0x7f1b140670b0 msgr2=0x7f1b14067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 shutdown_connections 2023-12-24T18:55:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.676+0000 7f1b18f63700 1 -- 172.21.15.50:0/1257266843 wait complete. 2023-12-24T18:55:18.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T18:55:18.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T18:55:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.864+0000 7fea2dc8e700 1 Processor -- start 2023-12-24T18:55:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.864+0000 7fea2dc8e700 1 -- start start 2023-12-24T18:55:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2dc8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea2806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2dc8e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28069310 con 0x7fea2806dd70 2023-12-24T18:55:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2dc8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2806e1c0 con 0x7fea280681a0 2023-12-24T18:55:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2dc8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280ca770 con 0x7fea2815c210 2023-12-24T18:55:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea27fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea2806dd70 0x7fea28067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43470/0 (socket says 172.21.15.50:43470) 2023-12-24T18:55:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea27fff700 1 -- 172.21.15.50:0/1068780501 learned_addr learned my addr 172.21.15.50:0/1068780501 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909890891 0 0) 0x7fea28069310 con 0x7fea2806dd70 2023-12-24T18:55:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea18003570 con 0x7fea2806dd70 2023-12-24T18:55:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea2806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3398831931 0 0) 0x7fea18003570 con 0x7fea2806dd70 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 msgr2=0x7fea2806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea2806d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 >> v1:172.21.15.82:6789/0 conn(0x7fea280681a0 legacy=0x7fea280c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28068700 con 0x7fea2806dd70 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fea14001470 con 0x7fea2806dd70 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 >> v1:172.21.15.50:6789/0 conn(0x7fea2806dd70 legacy=0x7fea28067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea18003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea180040c0 0x7fea18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18004da0 0x7fea180051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280ca770 con 0x7fea18004da0 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1800bc70 con 0x7fea180040c0 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1800be30 con 0x7fea2815c210 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.868+0000 7fea2d48d700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18004da0 0x7fea180051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea27fff700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea180040c0 0x7fea18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea18003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 -- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 msgr2=0x7fea18003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea18003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 -- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea180040c0 msgr2=0x7fea18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea180040c0 0x7fea18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 -- 172.21.15.50:0/1068780501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18003570 con 0x7fea18004da0 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea27fff700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea180040c0 0x7fea18004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2815c210 0x7fea18003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18004da0 0x7fea180051f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fea20001fc0 tx=0x7fea20001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a8b4c5816cb58 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20001950 con 0x7fea18004da0 2023-12-24T18:55:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000c8b0 con 0x7fea18004da0 2023-12-24T18:55:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea277fe700 1 -- 172.21.15.50:0/1068780501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000cc50 con 0x7fea18004da0 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 -- 172.21.15.50:0/1068780501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18004da0 msgr2=0x7fea180051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/1068780501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18004da0 0x7fea180051f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fea20001fc0 tx=0x7fea20001640 comp rx=0 tx=0).stop 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2d48d700 1 -- 172.21.15.50:0/1068780501 reap_dead start 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 -- 172.21.15.50:0/1068780501 shutdown_connections 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 -- 172.21.15.50:0/1068780501 >> 172.21.15.50:0/1068780501 conn(0x7fea2806ad60 msgr2=0x7fea2806b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 -- 172.21.15.50:0/1068780501 shutdown_connections 2023-12-24T18:55:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.872+0000 7fea2dc8e700 1 -- 172.21.15.50:0/1068780501 wait complete. 2023-12-24T18:55:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 Processor -- start 2023-12-24T18:55:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 -- start start 2023-12-24T18:55:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28158490 0x7fea280c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 0x7fea280affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280c7390 con 0x7fea28144a40 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea28159920 con 0x7fea28158490 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2dc8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea28144e10 con 0x7fea280c6f20 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2cc8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2cc8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43590/0 (socket says 172.21.15.50:43590) 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.876+0000 7fea2cc8c700 1 -- 172.21.15.50:0/125131103 learned_addr learned my addr 172.21.15.50:0/125131103 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2d48d700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 0x7fea280affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea27fff700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28158490 0x7fea280c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 -- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 msgr2=0x7fea280affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 0x7fea280affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 -- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28158490 msgr2=0x7fea280c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28158490 0x7fea280c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 -- 172.21.15.50:0/125131103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28158d10 con 0x7fea28144a40 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2d48d700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 0x7fea280affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2cc8c700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00e8a0 tx=0x7fea1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c013410 con 0x7fea28144a40 2023-12-24T18:55:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c013570 con 0x7fea28144a40 2023-12-24T18:55:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c013930 con 0x7fea28144a40 2023-12-24T18:55:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea28158ff0 con 0x7fea28144a40 2023-12-24T18:55:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281595b0 con 0x7fea28144a40 2023-12-24T18:55:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.880+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2804be40 con 0x7fea28144a40 2023-12-24T18:55:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.884+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fea1c013ca0 con 0x7fea28144a40 2023-12-24T18:55:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.884+0000 7fea24ff9700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 0x7fea0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.884+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5577+0+0 (secure 0 0 0) 0x7fea1c07c860 con 0x7fea28144a40 2023-12-24T18:55:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.884+0000 7fea27fff700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 0x7fea0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.884+0000 7fea27fff700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 0x7fea0c062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea14000e10 tx=0x7fea14009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:18.896+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea1c04ce40 con 0x7fea28144a40 2023-12-24T18:55:19.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:19.076+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea2806bb60 con 0x7fea28144a40 2023-12-24T18:55:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.040+0000 7fea24ff9700 1 -- 172.21.15.50:0/125131103 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea1c050460 con 0x7fea28144a40 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 msgr2=0x7fea0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 0x7fea0c062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea14000e10 tx=0x7fea14009040 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 msgr2=0x7fea2815a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00e8a0 tx=0x7fea1c008040 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 shutdown_connections 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea0c060550 0x7fea0c062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea280c6f20 0x7fea280affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28158490 0x7fea280c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 --2- 172.21.15.50:0/125131103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea28144a40 0x7fea2815a920 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.044+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 >> 172.21.15.50:0/125131103 conn(0x7fea2806ad60 msgr2=0x7fea28062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.048+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 shutdown_connections 2023-12-24T18:55:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.048+0000 7fea2dc8e700 1 -- 172.21.15.50:0/125131103 wait complete. 2023-12-24T18:55:20.051 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T18:55:20.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T18:55:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.244+0000 7f08f5185700 1 Processor -- start 2023-12-24T18:55:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.244+0000 7f08f5185700 1 -- start start 2023-12-24T18:55:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08f5185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 0x7f08f006a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08f5185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08f006dd90 0x7f08f006ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08f5185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00b3b90 con 0x7f08f0158dd0 2023-12-24T18:55:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08f5185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b4730 con 0x7f08f006dd90 2023-12-24T18:55:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08f5185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00b5e80 con 0x7f08f01591a0 2023-12-24T18:55:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08eed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08f0158dd0 0x7f08f00b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50904/0 (socket says 172.21.15.50:50904) 2023-12-24T18:55:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08eed9d700 1 -- 172.21.15.50:0/3638464818 learned_addr learned my addr 172.21.15.50:0/3638464818 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 --2- 172.21.15.50:0/3638464818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 0x7f08f006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ef59e700 1 --2- 172.21.15.50:0/3638464818 >> v2:172.21.15.82:3300/0 conn(0x7f08f006dd90 0x7f08f006ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 -- 172.21.15.50:0/3638464818 >> v2:172.21.15.82:3300/0 conn(0x7f08f006dd90 msgr2=0x7f08f006ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 --2- 172.21.15.50:0/3638464818 >> v2:172.21.15.82:3300/0 conn(0x7f08f006dd90 0x7f08f006ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 -- 172.21.15.50:0/3638464818 >> v1:172.21.15.50:6789/0 conn(0x7f08f0158dd0 legacy=0x7f08f00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 -- 172.21.15.50:0/3638464818 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00b2f80 con 0x7f08f01591a0 2023-12-24T18:55:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08edd9b700 1 -- 172.21.15.50:0/3638464818 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140788617 0 0) 0x7f08f00b3b90 con 0x7f08f0158dd0 2023-12-24T18:55:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08ee59c700 1 --2- 172.21.15.50:0/3638464818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 0x7f08f006a730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098e0 tx=0x7f08e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f9e7f45bf19ff8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.248+0000 7f08edd9b700 1 -- 172.21.15.50:0/3638464818 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400b640 con 0x7f08f01591a0 2023-12-24T18:55:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08edd9b700 1 -- 172.21.15.50:0/3638464818 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400b7a0 con 0x7f08f01591a0 2023-12-24T18:55:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08edd9b700 1 -- 172.21.15.50:0/3638464818 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bb40 con 0x7f08f01591a0 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 -- 172.21.15.50:0/3638464818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 msgr2=0x7f08f006a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 --2- 172.21.15.50:0/3638464818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 0x7f08f006a730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098e0 tx=0x7f08e40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 -- 172.21.15.50:0/3638464818 shutdown_connections 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 --2- 172.21.15.50:0/3638464818 >> v2:172.21.15.82:3300/0 conn(0x7f08f006dd90 0x7f08f006ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 --2- 172.21.15.50:0/3638464818 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f01591a0 0x7f08f006a730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 -- 172.21.15.50:0/3638464818 >> 172.21.15.50:0/3638464818 conn(0x7f08f0067b20 msgr2=0x7f08f00cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 -- 172.21.15.50:0/3638464818 shutdown_connections 2023-12-24T18:55:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.252+0000 7f08f5185700 1 -- 172.21.15.50:0/3638464818 wait complete. 2023-12-24T18:55:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 Processor -- start 2023-12-24T18:55:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 -- start start 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 0x7f08f014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f0158dd0 0x7f08f0169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01506e0 con 0x7f08f01591a0 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f015b930 con 0x7f08f0158dd0 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08f5185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f015aea0 con 0x7f08f006dd90 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53564/0 (socket says 172.21.15.50:53564) 2023-12-24T18:55:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 -- 172.21.15.50:0/3792677526 learned_addr learned my addr 172.21.15.50:0/3792677526 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08eed9d700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 0x7f08f014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ee59c700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f0158dd0 0x7f08f0169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 -- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 msgr2=0x7f08f014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 0x7f08f014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 -- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f0158dd0 msgr2=0x7f08f0169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f0158dd0 0x7f08f0169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 -- 172.21.15.50:0/3792677526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009420 con 0x7f08f01591a0 2023-12-24T18:55:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08eed9d700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 0x7f08f014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.256+0000 7f08ef59e700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009ef0 tx=0x7f08e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800cb70 con 0x7f08f01591a0 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800f040 con 0x7f08f01591a0 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8014480 con 0x7f08f01591a0 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0150120 con 0x7f08f01591a0 2023-12-24T18:55:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f015b5c0 con 0x7f08f01591a0 2023-12-24T18:55:20.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.260+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f015baa0 con 0x7f08f01591a0 2023-12-24T18:55:20.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.264+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f08e8014830 con 0x7f08f01591a0 2023-12-24T18:55:20.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.264+0000 7f08d6ffd700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 0x7f08dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:20.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.264+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5947+0+0 (secure 0 0 0) 0x7f08e807da10 con 0x7f08f01591a0 2023-12-24T18:55:20.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.264+0000 7f08eed9d700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 0x7f08dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:20.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.264+0000 7f08eed9d700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 0x7f08dc062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f08e0007fd0 tx=0x7f08e0007d30 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.272+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f08e804df90 con 0x7f08f01591a0 2023-12-24T18:55:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:20.452+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f08f00652e0 con 0x7f08f01591a0 2023-12-24T18:55:21.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.060+0000 7f08d6ffd700 1 -- 172.21.15.50:0/3792677526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f08e80515b0 con 0x7f08f01591a0 2023-12-24T18:55:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.064+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 msgr2=0x7f08dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.064+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 0x7f08dc062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f08e0007fd0 tx=0x7f08e0007d30 comp rx=0 tx=0).stop 2023-12-24T18:55:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.064+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 msgr2=0x7f08f0157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.064+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009ef0 tx=0x7f08e800b040 comp rx=0 tx=0).stop 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 shutdown_connections 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08dc060550 0x7f08dc062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08f01591a0 0x7f08f0157bc0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f0158dd0 0x7f08f0169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 --2- 172.21.15.50:0/3792677526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08f006dd90 0x7f08f014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 >> 172.21.15.50:0/3792677526 conn(0x7f08f0067b20 msgr2=0x7f08f00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 shutdown_connections 2023-12-24T18:55:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.068+0000 7f08f5185700 1 -- 172.21.15.50:0/3792677526 wait complete. 2023-12-24T18:55:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T18:55:21.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T18:55:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.268+0000 7fd8698e3700 1 Processor -- start 2023-12-24T18:55:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.268+0000 7fd8698e3700 1 -- start start 2023-12-24T18:55:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8698e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd864158c40 0x7fd8640cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8698e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd86406d450 0x7fd8640ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8698e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406a580 con 0x7fd8640cc780 2023-12-24T18:55:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8698e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8640cd110 con 0x7fd864158c40 2023-12-24T18:55:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8698e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86406a7d0 con 0x7fd86406d450 2023-12-24T18:55:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd864158c40 0x7fd8640cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd864158c40 0x7fd8640cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53576/0 (socket says 172.21.15.50:53576) 2023-12-24T18:55:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 -- 172.21.15.50:0/2713061885 learned_addr learned my addr 172.21.15.50:0/2713061885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8690e2700 1 --2- 172.21.15.50:0/2713061885 >> v2:172.21.15.82:3300/0 conn(0x7fd86406d450 0x7fd8640ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 -- 172.21.15.50:0/2713061885 >> v2:172.21.15.82:3300/0 conn(0x7fd86406d450 msgr2=0x7fd8640ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 --2- 172.21.15.50:0/2713061885 >> v2:172.21.15.82:3300/0 conn(0x7fd86406d450 0x7fd8640ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 -- 172.21.15.50:0/2713061885 >> v1:172.21.15.82:6789/0 conn(0x7fd8640cc780 legacy=0x7fd86406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.272+0000 7fd8688e1700 1 -- 172.21.15.50:0/2713061885 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86406aab0 con 0x7fd864158c40 2023-12-24T18:55:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8688e1700 1 --2- 172.21.15.50:0/2713061885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd864158c40 0x7fd8640cf500 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd8640cc710 tx=0x7fd858009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5987a4464a46f250 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8637fe700 1 -- 172.21.15.50:0/2713061885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800b860 con 0x7fd864158c40 2023-12-24T18:55:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8637fe700 1 -- 172.21.15.50:0/2713061885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800b9c0 con 0x7fd864158c40 2023-12-24T18:55:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8637fe700 1 -- 172.21.15.50:0/2713061885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800bd60 con 0x7fd864158c40 2023-12-24T18:55:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 -- 172.21.15.50:0/2713061885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd864158c40 msgr2=0x7fd8640cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 --2- 172.21.15.50:0/2713061885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd864158c40 0x7fd8640cf500 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd8640cc710 tx=0x7fd858009250 comp rx=0 tx=0).stop 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 -- 172.21.15.50:0/2713061885 shutdown_connections 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 --2- 172.21.15.50:0/2713061885 >> v2:172.21.15.82:3300/0 conn(0x7fd86406d450 0x7fd8640ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 --2- 172.21.15.50:0/2713061885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd864158c40 0x7fd8640cf500 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 -- 172.21.15.50:0/2713061885 >> 172.21.15.50:0/2713061885 conn(0x7fd8640d0800 msgr2=0x7fd8640b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 -- 172.21.15.50:0/2713061885 shutdown_connections 2023-12-24T18:55:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.276+0000 7fd8698e3700 1 -- 172.21.15.50:0/2713061885 wait complete. 2023-12-24T18:55:21.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 Processor -- start 2023-12-24T18:55:21.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 -- start start 2023-12-24T18:55:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd86406d450 0x7fd864087340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 0x7fd864171660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864170e80 con 0x7fd8640cc780 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86416e0d0 con 0x7fd86406d450 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8698e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86416e3b0 con 0x7fd864158c40 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53580/0 (socket says 172.21.15.50:53580) 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 -- 172.21.15.50:0/3041715931 learned_addr learned my addr 172.21.15.50:0/3041715931 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8688e1700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd86406d450 0x7fd864087340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8690e2700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 0x7fd864171660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 -- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 msgr2=0x7fd864171660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 0x7fd864171660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 -- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd86406d450 msgr2=0x7fd864087340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd86406d450 0x7fd864087340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd863fff700 1 -- 172.21.15.50:0/3041715931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580094f0 con 0x7fd8640cc780 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.280+0000 7fd8690e2700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 0x7fd864171660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd863fff700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c590 tx=0x7fd85000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011590 con 0x7fd8640cc780 2023-12-24T18:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd850011710 con 0x7fd8640cc780 2023-12-24T18:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011ad0 con 0x7fd8640cc780 2023-12-24T18:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86416e690 con 0x7fd8640cc780 2023-12-24T18:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86416ddc0 con 0x7fd8640cc780 2023-12-24T18:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.284+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86404be40 con 0x7fd8640cc780 2023-12-24T18:55:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.288+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd85001b3b0 con 0x7fd8640cc780 2023-12-24T18:55:21.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.288+0000 7fd860ff9700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 0x7fd848062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:21.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.288+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6329+0+0 (secure 0 0 0) 0x7fd85007bfa0 con 0x7fd8640cc780 2023-12-24T18:55:21.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.288+0000 7fd8688e1700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 0x7fd848062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.292+0000 7fd8688e1700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 0x7fd848062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8640cc710 tx=0x7fd858017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.296+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd85004c280 con 0x7fd8640cc780 2023-12-24T18:55:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:21.504+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd86406ad90 con 0x7fd8640cc780 2023-12-24T18:55:22.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.088+0000 7fd860ff9700 1 -- 172.21.15.50:0/3041715931 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd850017020 con 0x7fd8640cc780 2023-12-24T18:55:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.092+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 msgr2=0x7fd848062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.092+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 0x7fd848062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8640cc710 tx=0x7fd858017000 comp rx=0 tx=0).stop 2023-12-24T18:55:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.092+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 msgr2=0x7fd86416d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.092+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c590 tx=0x7fd85000c8a0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 shutdown_connections 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd848060550 0x7fd848062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd864158c40 0x7fd864171660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8640cc780 0x7fd86416d880 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 --2- 172.21.15.50:0/3041715931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd86406d450 0x7fd864087340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 >> 172.21.15.50:0/3041715931 conn(0x7fd8640d0800 msgr2=0x7fd864062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.096+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 shutdown_connections 2023-12-24T18:55:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.100+0000 7fd8698e3700 1 -- 172.21.15.50:0/3041715931 wait complete. 2023-12-24T18:55:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 17 and data pool 18 2023-12-24T18:55:22.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:22.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.296+0000 7f8c10984700 1 Processor -- start 2023-12-24T18:55:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.300+0000 7f8c10984700 1 -- start start 2023-12-24T18:55:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.300+0000 7f8c10984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8c0c161580 0x7f8c0c0ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.300+0000 7f8c10984700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c06c4d0 con 0x7f8c0c0ae100 2023-12-24T18:55:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.300+0000 7f8c10984700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c06c1f0 con 0x7f8c0c1611b0 2023-12-24T18:55:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.300+0000 7f8c10984700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0ab5e0 con 0x7f8c0c161580 2023-12-24T18:55:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c0c0ae100 0x7f8c0c06c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50916/0 (socket says 172.21.15.50:50916) 2023-12-24T18:55:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0a59c700 1 -- 172.21.15.50:0/10659122 learned_addr learned my addr 172.21.15.50:0/10659122 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0b59e700 1 --2- 172.21.15.50:0/10659122 >> v2:172.21.15.82:3300/0 conn(0x7f8c0c161580 0x7f8c0c0ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5106438 0 0) 0x7f8c00001110 con 0x7f8c0c0ae100 2023-12-24T18:55:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf4003570 con 0x7f8c0c0ae100 2023-12-24T18:55:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166321003 0 0) 0x7f8c0c06c1f0 con 0x7f8c0c1611b0 2023-12-24T18:55:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c00001110 con 0x7f8c0c1611b0 2023-12-24T18:55:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0b59e700 1 -- 172.21.15.50:0/10659122 >> v1:172.21.15.82:6789/0 conn(0x7f8c0c1611b0 legacy=0x7f8c0c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0b59e700 1 -- 172.21.15.50:0/10659122 >> v1:172.21.15.50:6789/0 conn(0x7f8c0c0ae100 legacy=0x7f8c0c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0b59e700 1 -- 172.21.15.50:0/10659122 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0ab8c0 con 0x7f8c0c161580 2023-12-24T18:55:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c0b59e700 1 --2- 172.21.15.50:0/10659122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c161580 0x7f8c0c0ac0c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009e60 tx=0x7f8c04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2837aec41e877d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400e070 con 0x7f8c0c161580 2023-12-24T18:55:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400bab0 con 0x7f8c0c161580 2023-12-24T18:55:22.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.304+0000 7f8c09d9b700 1 -- 172.21.15.50:0/10659122 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400be30 con 0x7f8c0c161580 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 -- 172.21.15.50:0/10659122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c161580 msgr2=0x7f8c0c0ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 --2- 172.21.15.50:0/10659122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c161580 0x7f8c0c0ac0c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009e60 tx=0x7f8c04009780 comp rx=0 tx=0).stop 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 -- 172.21.15.50:0/10659122 shutdown_connections 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 --2- 172.21.15.50:0/10659122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c161580 0x7f8c0c0ac0c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 -- 172.21.15.50:0/10659122 >> 172.21.15.50:0/10659122 conn(0x7f8c0c067b80 msgr2=0x7f8c0c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 -- 172.21.15.50:0/10659122 shutdown_connections 2023-12-24T18:55:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.308+0000 7f8c10984700 1 -- 172.21.15.50:0/10659122 wait complete. 2023-12-24T18:55:22.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 Processor -- start 2023-12-24T18:55:22.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 -- start start 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c0c0ae100 0x7f8c0c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c1611b0 0x7f8c0c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c171a10 con 0x7f8c0c161580 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c156ce0 con 0x7f8c0c1611b0 2023-12-24T18:55:22.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c10984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b0180 con 0x7f8c0c0ae100 2023-12-24T18:55:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53596/0 (socket says 172.21.15.50:53596) 2023-12-24T18:55:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 -- 172.21.15.50:0/1722100485 learned_addr learned my addr 172.21.15.50:0/1722100485 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0ad9d700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c0c0ae100 0x7f8c0c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0a59c700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c1611b0 0x7f8c0c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 -- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c0c0ae100 msgr2=0x7f8c0c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c0c0ae100 0x7f8c0c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 -- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c1611b0 msgr2=0x7f8c0c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c1611b0 0x7f8c0c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.312+0000 7f8c0b59e700 1 -- 172.21.15.50:0/1722100485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009a20 con 0x7f8c0c161580 2023-12-24T18:55:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8c0b59e700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0c95c0 tx=0x7f8c04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04012d20 con 0x7f8c0c161580 2023-12-24T18:55:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040263f0 con 0x7f8c0c161580 2023-12-24T18:55:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c0afb90 con 0x7f8c0c161580 2023-12-24T18:55:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040267b0 con 0x7f8c0c161580 2023-12-24T18:55:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c1714d0 con 0x7f8c0c161580 2023-12-24T18:55:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.316+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c171850 con 0x7f8c0c161580 2023-12-24T18:55:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.320+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8c04026b20 con 0x7f8c0c161580 2023-12-24T18:55:22.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.320+0000 7f8bf2ffd700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 0x7f8bf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.320+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f8c0407e9e0 con 0x7f8c0c161580 2023-12-24T18:55:22.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.320+0000 7f8c0ad9d700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 0x7f8bf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.320+0000 7f8c0ad9d700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 0x7f8bf8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc007fd0 tx=0x7f8bfc007d30 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.328+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c0404ec60 con 0x7f8c0c161580 2023-12-24T18:55:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.500+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c0c0b02c0 con 0x7f8c0c161580 2023-12-24T18:55:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/1722100485 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16151 (secure 0 0 0) 0x7f8c04052280 con 0x7f8c0c161580 2023-12-24T18:55:22.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:22.503 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:55:21.507527+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 msgr2=0x7f8bf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 0x7f8bf8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc007fd0 tx=0x7f8bfc007d30 comp rx=0 tx=0).stop 2023-12-24T18:55:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 msgr2=0x7f8c0c170ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0c95c0 tx=0x7f8c04019000 comp rx=0 tx=0).stop 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 shutdown_connections 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8bf8060550 0x7f8bf8062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c161580 0x7f8c0c170ae0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0c1611b0 0x7f8c0c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 --2- 172.21.15.50:0/1722100485 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c0c0ae100 0x7f8c0c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 >> 172.21.15.50:0/1722100485 conn(0x7f8c0c067b80 msgr2=0x7f8c0c15bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 shutdown_connections 2023-12-24T18:55:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.504+0000 7f8c10984700 1 -- 172.21.15.50:0/1722100485 wait complete. 2023-12-24T18:55:22.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.696+0000 7fbb6d5cc700 1 Processor -- start 2023-12-24T18:55:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.696+0000 7fbb6d5cc700 1 -- start start 2023-12-24T18:55:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6d5cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb680ade60 0x7fbb681619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6d5cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680b0460 con 0x7fbb6815a2d0 2023-12-24T18:55:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6d5cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6806a5c0 con 0x7fbb6806c820 2023-12-24T18:55:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6d5cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6806d8c0 con 0x7fbb680ade60 2023-12-24T18:55:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb67fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb6815a2d0 0x7fbb680ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50928/0 (socket says 172.21.15.50:50928) 2023-12-24T18:55:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb67fff700 1 -- 172.21.15.50:0/2506007641 learned_addr learned my addr 172.21.15.50:0/2506007641 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6cdcb700 1 --2- 172.21.15.50:0/2506007641 >> v2:172.21.15.50:3300/0 conn(0x7fbb680ade60 0x7fbb681619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551323661 0 0) 0x7fbb680b0460 con 0x7fbb6815a2d0 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb54003570 con 0x7fbb6815a2d0 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721364124 0 0) 0x7fbb6806a5c0 con 0x7fbb6806c820 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb680b0460 con 0x7fbb6806c820 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043093165 0 0) 0x7fbb54003570 con 0x7fbb6815a2d0 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6cdcb700 1 -- 172.21.15.50:0/2506007641 >> v1:172.21.15.82:6789/0 conn(0x7fbb6806c820 legacy=0x7fbb680ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6cdcb700 1 -- 172.21.15.50:0/2506007641 >> v1:172.21.15.50:6789/0 conn(0x7fbb6815a2d0 legacy=0x7fbb680ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6cdcb700 1 -- 172.21.15.50:0/2506007641 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6806ccb0 con 0x7fbb680ade60 2023-12-24T18:55:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb6cdcb700 1 --2- 172.21.15.50:0/2506007641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb681619a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e60 tx=0x7fbb60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d780fe5b4d9136e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000e070 con 0x7fbb680ade60 2023-12-24T18:55:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.700+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6000b7a0 con 0x7fbb680ade60 2023-12-24T18:55:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb677fe700 1 -- 172.21.15.50:0/2506007641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58001470 con 0x7fbb680ade60 2023-12-24T18:55:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/2506007641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 msgr2=0x7fbb681619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/2506007641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb681619a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e60 tx=0x7fbb60009780 comp rx=0 tx=0).stop 2023-12-24T18:55:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/2506007641 shutdown_connections 2023-12-24T18:55:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/2506007641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb681619a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/2506007641 >> 172.21.15.50:0/2506007641 conn(0x7fbb68067b80 msgr2=0x7fbb680cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/2506007641 shutdown_connections 2023-12-24T18:55:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.704+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/2506007641 wait complete. 2023-12-24T18:55:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 Processor -- start 2023-12-24T18:55:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 -- start start 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb6806c820 0x7fbb68154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6815a2d0 0x7fbb680acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680cae30 con 0x7fbb680ade60 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815aad0 con 0x7fbb6815a2d0 2023-12-24T18:55:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6d5cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680abef0 con 0x7fbb6806c820 2023-12-24T18:55:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53614/0 (socket says 172.21.15.50:53614) 2023-12-24T18:55:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb5f7fe700 1 -- 172.21.15.50:0/1203194033 learned_addr learned my addr 172.21.15.50:0/1203194033 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb67fff700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb6806c820 0x7fbb68154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.708+0000 7fbb6cdcb700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6815a2d0 0x7fbb680acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 -- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb6806c820 msgr2=0x7fbb68154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb6806c820 0x7fbb68154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 -- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6815a2d0 msgr2=0x7fbb680acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6815a2d0 0x7fbb680acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 -- 172.21.15.50:0/1203194033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60009a20 con 0x7fbb680ade60 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb5f7fe700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7c0 tx=0x7fbb50007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50010510 con 0x7fbb680ade60 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50010670 con 0x7fbb680ade60 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb680ac160 con 0x7fbb680ade60 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50010a10 con 0x7fbb680ade60 2023-12-24T18:55:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb680ac720 con 0x7fbb680ade60 2023-12-24T18:55:22.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.712+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6804be40 con 0x7fbb680ade60 2023-12-24T18:55:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.716+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbb5001b3b0 con 0x7fbb680ade60 2023-12-24T18:55:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.716+0000 7fbb64ff9700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 0x7fbb48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.716+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fbb5007c330 con 0x7fbb680ade60 2023-12-24T18:55:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.716+0000 7fbb67fff700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 0x7fbb48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.716+0000 7fbb67fff700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 0x7fbb48062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb580011e0 tx=0x7fbb58001960 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.720+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb5004c670 con 0x7fbb680ade60 2023-12-24T18:55:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.896+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb681574d0 con 0x7fbb680ade60 2023-12-24T18:55:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.896+0000 7fbb64ff9700 1 -- 172.21.15.50:0/1203194033 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16151 (secure 0 0 0) 0x7fbb50017090 con 0x7fbb680ade60 2023-12-24T18:55:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:22.897 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:55:21.507527+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 msgr2=0x7fbb48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 0x7fbb48062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb580011e0 tx=0x7fbb58001960 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 msgr2=0x7fbb680cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7c0 tx=0x7fbb50007e10 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 shutdown_connections 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb48060550 0x7fbb48062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6815a2d0 0x7fbb680acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb680ade60 0x7fbb680cb260 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 --2- 172.21.15.50:0/1203194033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb6806c820 0x7fbb68154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 >> 172.21.15.50:0/1203194033 conn(0x7fbb68067b80 msgr2=0x7fbb6806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 shutdown_connections 2023-12-24T18:55:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:22.900+0000 7fbb6d5cc700 1 -- 172.21.15.50:0/1203194033 wait complete. 2023-12-24T18:55:22.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T18:55:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.088+0000 7faf654e3700 1 Processor -- start 2023-12-24T18:55:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.088+0000 7faf654e3700 1 -- start start 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf654e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf60159020 0x7faf60068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf654e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf60069300 0x7faf600c8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf654e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf600c92c0 con 0x7faf600c8b90 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf654e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6006e390 con 0x7faf60069300 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf654e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf60069750 con 0x7faf60159020 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf64ce2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf600c8b90 0x7faf60159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50934/0 (socket says 172.21.15.50:50934) 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf64ce2700 1 -- 172.21.15.50:0/3624997711 learned_addr learned my addr 172.21.15.50:0/3624997711 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 --2- 172.21.15.50:0/3624997711 >> v2:172.21.15.82:3300/0 conn(0x7faf60159020 0x7faf60068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5f7fe700 1 --2- 172.21.15.50:0/3624997711 >> v2:172.21.15.50:3300/0 conn(0x7faf60069300 0x7faf600c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5effd700 1 -- 172.21.15.50:0/3624997711 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029621271 0 0) 0x7faf600c92c0 con 0x7faf600c8b90 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5effd700 1 -- 172.21.15.50:0/3624997711 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf48003570 con 0x7faf600c8b90 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 -- 172.21.15.50:0/3624997711 >> v2:172.21.15.50:3300/0 conn(0x7faf60069300 msgr2=0x7faf600c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 --2- 172.21.15.50:0/3624997711 >> v2:172.21.15.50:3300/0 conn(0x7faf60069300 0x7faf600c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 -- 172.21.15.50:0/3624997711 >> v1:172.21.15.50:6789/0 conn(0x7faf600c8b90 legacy=0x7faf60159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 -- 172.21.15.50:0/3624997711 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6006e820 con 0x7faf60159020 2023-12-24T18:55:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.092+0000 7faf5ffff700 1 --2- 172.21.15.50:0/3624997711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60159020 0x7faf60068dc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faf60067360 tx=0x7faf500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b670ed96063b37b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf5effd700 1 -- 172.21.15.50:0/3624997711 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50011630 con 0x7faf60159020 2023-12-24T18:55:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf5effd700 1 -- 172.21.15.50:0/3624997711 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf500117b0 con 0x7faf60159020 2023-12-24T18:55:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf5effd700 1 -- 172.21.15.50:0/3624997711 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50011b70 con 0x7faf60159020 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- 172.21.15.50:0/3624997711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60159020 msgr2=0x7faf60068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 --2- 172.21.15.50:0/3624997711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60159020 0x7faf60068dc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faf60067360 tx=0x7faf500091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- 172.21.15.50:0/3624997711 shutdown_connections 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 --2- 172.21.15.50:0/3624997711 >> v2:172.21.15.50:3300/0 conn(0x7faf60069300 0x7faf600c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 --2- 172.21.15.50:0/3624997711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60159020 0x7faf60068dc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- 172.21.15.50:0/3624997711 >> 172.21.15.50:0/3624997711 conn(0x7faf600ccad0 msgr2=0x7faf600cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- 172.21.15.50:0/3624997711 shutdown_connections 2023-12-24T18:55:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- 172.21.15.50:0/3624997711 wait complete. 2023-12-24T18:55:23.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 Processor -- start 2023-12-24T18:55:23.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.096+0000 7faf654e3700 1 -- start start 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60069300 0x7faf600b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 0x7faf60147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6013f010 con 0x7faf60159020 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60147ac0 con 0x7faf60069300 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600b2630 con 0x7faf600c8b90 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf5f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 0x7faf60147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf5ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60069300 0x7faf600b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53622/0 (socket says 172.21.15.50:53622) 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf5f7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 0x7faf60147580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:52758/0 (socket says 172.21.15.50:52758) 2023-12-24T18:55:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 -- 172.21.15.50:0/615743251 learned_addr learned my addr 172.21.15.50:0/615743251 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 -- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 msgr2=0x7faf60147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 0x7faf60147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 -- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60069300 msgr2=0x7faf600b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60069300 0x7faf600b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 -- 172.21.15.50:0/615743251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50009420 con 0x7faf60159020 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf64ce2700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7faf58001460 tx=0x7faf58001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800a890 con 0x7faf60159020 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5800a9f0 con 0x7faf60159020 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800ad70 con 0x7faf60159020 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf60146aa0 con 0x7faf60159020 2023-12-24T18:55:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60147060 con 0x7faf60159020 2023-12-24T18:55:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.104+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6004be40 con 0x7faf60159020 2023-12-24T18:55:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.104+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faf58007300 con 0x7faf60159020 2023-12-24T18:55:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.108+0000 7faf47fff700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 0x7faf4c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.108+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7faf5807ce80 con 0x7faf60159020 2023-12-24T18:55:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.108+0000 7faf5ffff700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 0x7faf4c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.108+0000 7faf5ffff700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 0x7faf4c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf60067360 tx=0x7faf50017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:23.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.116+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf5804d180 con 0x7faf60159020 2023-12-24T18:55:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:23.328+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faf6006ef10 con 0x7faf60159020 2023-12-24T18:55:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.096+0000 7faf47fff700 1 -- 172.21.15.50:0/615743251 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7faf580507a0 con 0x7faf60159020 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.096+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 msgr2=0x7faf4c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.096+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 0x7faf4c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf60067360 tx=0x7faf50017000 comp rx=0 tx=0).stop 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.096+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 msgr2=0x7faf600ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.096+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7faf58001460 tx=0x7faf58001ae0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 shutdown_connections 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7faf4c060550 0x7faf4c062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf60159020 0x7faf600ca650 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf600c8b90 0x7faf60147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 --2- 172.21.15.50:0/615743251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf60069300 0x7faf600b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 >> 172.21.15.50:0/615743251 conn(0x7faf600ccad0 msgr2=0x7faf600c1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 shutdown_connections 2023-12-24T18:55:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.100+0000 7faf654e3700 1 -- 172.21.15.50:0/615743251 wait complete. 2023-12-24T18:55:24.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T18:55:24.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.300+0000 7f910c385700 1 Processor -- start 2023-12-24T18:55:24.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.304+0000 7f910c385700 1 -- start start 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910c385700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 0x7f910406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910c385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f910406ac40 0x7f91040cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910c385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91040cd680 con 0x7f91040cf4d0 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910c385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9104159640 con 0x7f910406ac40 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910c385700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910406d8f0 con 0x7f91040cf8a0 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f910406ac40 0x7f91040cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a121700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f91040cf4d0 0x7f910406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50950/0 (socket says 172.21.15.50:50950) 2023-12-24T18:55:24.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a121700 1 -- 172.21.15.50:0/2789777160 learned_addr learned my addr 172.21.15.50:0/2789777160 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:24.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f9109920700 1 --2- 172.21.15.50:0/2789777160 >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 0x7f910406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443375933 0 0) 0x7f91040cd680 con 0x7f91040cf4d0 2023-12-24T18:55:24.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f0003570 con 0x7f91040cf4d0 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 -- 172.21.15.50:0/2789777160 >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 msgr2=0x7f910406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 --2- 172.21.15.50:0/2789777160 >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 0x7f910406a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437679765 0 0) 0x7f90f0003570 con 0x7f91040cf4d0 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 -- 172.21.15.50:0/2789777160 >> v1:172.21.15.50:6789/0 conn(0x7f91040cf4d0 legacy=0x7f910406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 -- 172.21.15.50:0/2789777160 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910406b030 con 0x7f910406ac40 2023-12-24T18:55:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f9109920700 1 --2- 172.21.15.50:0/2789777160 >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 0x7f910406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910a922700 1 --2- 172.21.15.50:0/2789777160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910406ac40 0x7f91040cdb10 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f9104069290 tx=0x7f90fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f06bec74bc925d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.308+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00e070 con 0x7f910406ac40 2023-12-24T18:55:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00b7a0 con 0x7f910406ac40 2023-12-24T18:55:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910911f700 1 -- 172.21.15.50:0/2789777160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100001470 con 0x7f910406ac40 2023-12-24T18:55:24.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- 172.21.15.50:0/2789777160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910406ac40 msgr2=0x7f91040cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 --2- 172.21.15.50:0/2789777160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910406ac40 0x7f91040cdb10 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f9104069290 tx=0x7f90fc009780 comp rx=0 tx=0).stop 2023-12-24T18:55:24.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- 172.21.15.50:0/2789777160 shutdown_connections 2023-12-24T18:55:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 --2- 172.21.15.50:0/2789777160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910406ac40 0x7f91040cdb10 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 --2- 172.21.15.50:0/2789777160 >> v2:172.21.15.82:3300/0 conn(0x7f91040cf8a0 0x7f910406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- 172.21.15.50:0/2789777160 >> 172.21.15.50:0/2789777160 conn(0x7f9104067b30 msgr2=0x7f91040cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- 172.21.15.50:0/2789777160 shutdown_connections 2023-12-24T18:55:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- 172.21.15.50:0/2789777160 wait complete. 2023-12-24T18:55:24.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 Processor -- start 2023-12-24T18:55:24.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 -- start start 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.312+0000 7f910c385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910406ac40 0x7f9104143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 0x7f910415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91040cc4d0 con 0x7f91040cf8a0 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91040cb8c0 con 0x7f910406ac40 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040cbba0 con 0x7f91040cf4d0 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53632/0 (socket says 172.21.15.50:53632) 2023-12-24T18:55:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 -- 172.21.15.50:0/2860799921 learned_addr learned my addr 172.21.15.50:0/2860799921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a121700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910406ac40 0x7f9104143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f9109920700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 0x7f910415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 -- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 msgr2=0x7f910415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 0x7f910415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 -- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910406ac40 msgr2=0x7f9104143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910406ac40 0x7f9104143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 -- 172.21.15.50:0/2860799921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4009420 con 0x7f91040cf8a0 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f9109920700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 0x7f910415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910a922700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f91040b5fe0 tx=0x7f90fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc012c20 con 0x7f91040cf8a0 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc012da0 con 0x7f91040cf8a0 2023-12-24T18:55:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc009a20 con 0x7f91040cf8a0 2023-12-24T18:55:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0266b0 con 0x7f91040cf8a0 2023-12-24T18:55:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91040cc160 con 0x7f91040cf8a0 2023-12-24T18:55:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.316+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91040652e0 con 0x7f91040cf8a0 2023-12-24T18:55:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.320+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f90fc01d420 con 0x7f91040cf8a0 2023-12-24T18:55:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.320+0000 7f90fa7fc700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 0x7f90e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.320+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f90fc07ec60 con 0x7f91040cf8a0 2023-12-24T18:55:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.320+0000 7f910a121700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 0x7f90e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.324+0000 7f910a121700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 0x7f90e8062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91000011e0 tx=0x7f9100001aa0 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.328+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f90fc04eee0 con 0x7f91040cf8a0 2023-12-24T18:55:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:24.536+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9104169f10 con 0x7f91040cf8a0 2023-12-24T18:55:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.108+0000 7f90fa7fc700 1 -- 172.21.15.50:0/2860799921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f90fc052500 con 0x7f91040cf8a0 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 msgr2=0x7f90e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 0x7f90e8062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91000011e0 tx=0x7f9100001aa0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 msgr2=0x7f910415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f91040b5fe0 tx=0x7f90fc018000 comp rx=0 tx=0).stop 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 shutdown_connections 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f90e8060550 0x7f90e8062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040cf8a0 0x7f910415d5d0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f91040cf4d0 0x7f910415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 --2- 172.21.15.50:0/2860799921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910406ac40 0x7f9104143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 >> 172.21.15.50:0/2860799921 conn(0x7f9104067b30 msgr2=0x7f9104158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 shutdown_connections 2023-12-24T18:55:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.112+0000 7f910c385700 1 -- 172.21.15.50:0/2860799921 wait complete. 2023-12-24T18:55:25.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 Processor -- start 2023-12-24T18:55:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 -- start start 2023-12-24T18:55:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4dc0ca770 0x7fa4dc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4dc15af90 0x7fa4dc06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc06ca50 con 0x7fa4dc0ca3a0 2023-12-24T18:55:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c6980 con 0x7fa4dc0ca770 2023-12-24T18:55:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e3545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc15b410 con 0x7fa4dc15af90 2023-12-24T18:55:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e0ae0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4dc0ca770 0x7fa4dc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e0ae0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa4dc0ca770 0x7fa4dc15aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53642/0 (socket says 172.21.15.50:53642) 2023-12-24T18:55:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.312+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/1036933670 learned_addr learned my addr 172.21.15.50:0/1036933670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e1ae2700 1 --2- 172.21.15.50:0/1036933670 >> v2:172.21.15.82:3300/0 conn(0x7fa4dc15af90 0x7fa4dc06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/1036933670 >> v2:172.21.15.82:3300/0 conn(0x7fa4dc15af90 msgr2=0x7fa4dc06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e0ae0700 1 --2- 172.21.15.50:0/1036933670 >> v2:172.21.15.82:3300/0 conn(0x7fa4dc15af90 0x7fa4dc06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/1036933670 >> v1:172.21.15.82:6789/0 conn(0x7fa4dc0ca3a0 legacy=0x7fa4dc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/1036933670 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc06b520 con 0x7fa4dc0ca770 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e0ae0700 1 --2- 172.21.15.50:0/1036933670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc15aa50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0c6210 tx=0x7fa4cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a73b3feba8f9ca0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1036933670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc009e70 con 0x7fa4dc0ca770 2023-12-24T18:55:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1036933670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00b860 con 0x7fa4dc0ca770 2023-12-24T18:55:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1036933670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00bc20 con 0x7fa4dc0ca770 2023-12-24T18:55:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 -- 172.21.15.50:0/1036933670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 msgr2=0x7fa4dc15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 --2- 172.21.15.50:0/1036933670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc15aa50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0c6210 tx=0x7fa4cc009250 comp rx=0 tx=0).stop 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 -- 172.21.15.50:0/1036933670 shutdown_connections 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 --2- 172.21.15.50:0/1036933670 >> v2:172.21.15.82:3300/0 conn(0x7fa4dc15af90 0x7fa4dc06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 --2- 172.21.15.50:0/1036933670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc15aa50 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 -- 172.21.15.50:0/1036933670 >> 172.21.15.50:0/1036933670 conn(0x7fa4dc0cbba0 msgr2=0x7fa4dc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 -- 172.21.15.50:0/1036933670 shutdown_connections 2023-12-24T18:55:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.316+0000 7fa4e3545700 1 -- 172.21.15.50:0/1036933670 wait complete. 2023-12-24T18:55:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.320+0000 7fa4e3545700 1 Processor -- start 2023-12-24T18:55:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.320+0000 7fa4e3545700 1 -- start start 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0ca3a0 0x7fa4dc0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4dc15af90 0x7fa4dc1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c3330 con 0x7fa4dc0ca770 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c5b90 con 0x7fa4dc0ca3a0 2023-12-24T18:55:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc171230 con 0x7fa4dc15af90 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53644/0 (socket says 172.21.15.50:53644) 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/4048269373 learned_addr learned my addr 172.21.15.50:0/4048269373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e12e1700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0ca3a0 0x7fa4dc0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e1ae2700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4dc15af90 0x7fa4dc1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4dc15af90 msgr2=0x7fa4dc1620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4dc15af90 0x7fa4dc1620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0ca3a0 msgr2=0x7fa4dc0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0ca3a0 0x7fa4dc0c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 -- 172.21.15.50:0/4048269373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0094f0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e0ae0700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc069fe0 tx=0x7fa4cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc01f070 con 0x7fa4dc0ca770 2023-12-24T18:55:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc000bc0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00bc20 con 0x7fa4dc0ca770 2023-12-24T18:55:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc171510 con 0x7fa4dc0ca770 2023-12-24T18:55:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.324+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc171ad0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.328+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0652e0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.328+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa4cc023070 con 0x7fa4dc0ca770 2023-12-24T18:55:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.328+0000 7fa4d17fa700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 0x7fa4c0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.328+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fa4cc07de60 con 0x7fa4dc0ca770 2023-12-24T18:55:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.332+0000 7fa4e12e1700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 0x7fa4c0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.332+0000 7fa4e12e1700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 0x7fa4c0062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8003860 tx=0x7fa4d8009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.336+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa4cc04e0e0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.544+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4dc06b7f0 con 0x7fa4dc0ca770 2023-12-24T18:55:25.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.544+0000 7fa4d17fa700 1 -- 172.21.15.50:0/4048269373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa4cc015090 con 0x7fa4dc0ca770 2023-12-24T18:55:25.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:25.545 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T18:55:25.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 msgr2=0x7fa4c0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 0x7fa4c0062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8003860 tx=0x7fa4d8009040 comp rx=0 tx=0).stop 2023-12-24T18:55:25.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 msgr2=0x7fa4dc155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc069fe0 tx=0x7fa4cc017000 comp rx=0 tx=0).stop 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 shutdown_connections 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa4c0060580 0x7fa4c0062a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4dc15af90 0x7fa4dc1620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4dc0ca770 0x7fa4dc155400 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 --2- 172.21.15.50:0/4048269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0ca3a0 0x7fa4dc0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 >> 172.21.15.50:0/4048269373 conn(0x7fa4dc0cbba0 msgr2=0x7fa4dc15da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:25.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 shutdown_connections 2023-12-24T18:55:25.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.548+0000 7fa4e3545700 1 -- 172.21.15.50:0/4048269373 wait complete. 2023-12-24T18:55:25.551 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T18:55:25.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T18:55:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.736+0000 7f607baf0700 1 Processor -- start 2023-12-24T18:55:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.736+0000 7f607baf0700 1 -- start start 2023-12-24T18:55:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 0x7f60740ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f607415b160 0x7f607406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607406ca50 con 0x7f607406ae10 2023-12-24T18:55:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740c6980 con 0x7f607415b160 2023-12-24T18:55:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607406b7f0 con 0x7f60740ca3a0 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607908b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f607406ae10 0x7f607415aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50964/0 (socket says 172.21.15.50:50964) 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607908b700 1 -- 172.21.15.50:0/1947470775 learned_addr learned my addr 172.21.15.50:0/1947470775 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607a08d700 1 --2- 172.21.15.50:0/1947470775 >> v2:172.21.15.50:3300/0 conn(0x7f607415b160 0x7f607406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 --2- 172.21.15.50:0/1947470775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 0x7f60740ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607888a700 1 -- 172.21.15.50:0/1947470775 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990880019 0 0) 0x7f607406ca50 con 0x7f607406ae10 2023-12-24T18:55:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607888a700 1 -- 172.21.15.50:0/1947470775 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6060003570 con 0x7f607406ae10 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 -- 172.21.15.50:0/1947470775 >> v2:172.21.15.50:3300/0 conn(0x7f607415b160 msgr2=0x7f607406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 --2- 172.21.15.50:0/1947470775 >> v2:172.21.15.50:3300/0 conn(0x7f607415b160 0x7f607406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 -- 172.21.15.50:0/1947470775 >> v1:172.21.15.50:6789/0 conn(0x7f607406ae10 legacy=0x7f607415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 -- 172.21.15.50:0/1947470775 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607406bad0 con 0x7f60740ca3a0 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607988c700 1 --2- 172.21.15.50:0/1947470775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 0x7f60740ca770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e60 tx=0x7f6070009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa949d315b95e4c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607888a700 1 -- 172.21.15.50:0/1947470775 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000e070 con 0x7f60740ca3a0 2023-12-24T18:55:25.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607888a700 1 -- 172.21.15.50:0/1947470775 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000bab0 con 0x7f60740ca3a0 2023-12-24T18:55:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607888a700 1 -- 172.21.15.50:0/1947470775 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000be50 con 0x7f60740ca3a0 2023-12-24T18:55:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 -- 172.21.15.50:0/1947470775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 msgr2=0x7f60740ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.740+0000 7f607baf0700 1 --2- 172.21.15.50:0/1947470775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 0x7f60740ca770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e60 tx=0x7f6070009780 comp rx=0 tx=0).stop 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 -- 172.21.15.50:0/1947470775 shutdown_connections 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 --2- 172.21.15.50:0/1947470775 >> v2:172.21.15.50:3300/0 conn(0x7f607415b160 0x7f607406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 --2- 172.21.15.50:0/1947470775 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60740ca3a0 0x7f60740ca770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 -- 172.21.15.50:0/1947470775 >> 172.21.15.50:0/1947470775 conn(0x7f60740cbba0 msgr2=0x7f60740cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 -- 172.21.15.50:0/1947470775 shutdown_connections 2023-12-24T18:55:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 -- 172.21.15.50:0/1947470775 wait complete. 2023-12-24T18:55:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 Processor -- start 2023-12-24T18:55:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.744+0000 7f607baf0700 1 -- start start 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 0x7f6074150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 0x7f60740b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740afe20 con 0x7f60740ca3a0 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740c4960 con 0x7f607406ae10 2023-12-24T18:55:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740c4c40 con 0x7f607415b160 2023-12-24T18:55:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53660/0 (socket says 172.21.15.50:53660) 2023-12-24T18:55:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 -- 172.21.15.50:0/257802859 learned_addr learned my addr 172.21.15.50:0/257802859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607988c700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 0x7f6074150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 -- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 msgr2=0x7f60740b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607a08d700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 0x7f60740b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 0x7f60740b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 -- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 msgr2=0x7f6074150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 0x7f6074150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 -- 172.21.15.50:0/257802859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009a20 con 0x7f60740ca3a0 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607988c700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 0x7f6074150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607a08d700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 0x7f60740b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607908b700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f606400c7c0 tx=0x7f6064007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064005b30 con 0x7f60740ca3a0 2023-12-24T18:55:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064005c90 con 0x7f60740ca3a0 2023-12-24T18:55:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740c4f20 con 0x7f60740ca3a0 2023-12-24T18:55:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064007340 con 0x7f60740ca3a0 2023-12-24T18:55:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.748+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60740c1fc0 con 0x7f60740ca3a0 2023-12-24T18:55:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.752+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60740c22a0 con 0x7f60740ca3a0 2023-12-24T18:55:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.752+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f606401b400 con 0x7f60740ca3a0 2023-12-24T18:55:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.756+0000 7f6069ffb700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 0x7f6058062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.756+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f606407c670 con 0x7f60740ca3a0 2023-12-24T18:55:25.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.756+0000 7f607988c700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 0x7f6058062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:25.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.756+0000 7f607988c700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 0x7f6058062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e60 tx=0x7f6070019000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.760+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f606404c970 con 0x7f60740ca3a0 2023-12-24T18:55:25.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.936+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60740652e0 con 0x7f60740ca3a0 2023-12-24T18:55:25.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.936+0000 7f6069ffb700 1 -- 172.21.15.50:0/257802859 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16138 (secure 0 0 0) 0x7f606404ff90 con 0x7f60740ca3a0 2023-12-24T18:55:25.936 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:25.937 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":138,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T18:55:23.061909+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T18:55:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 msgr2=0x7f6058062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 0x7f6058062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e60 tx=0x7f6070019000 comp rx=0 tx=0).stop 2023-12-24T18:55:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 msgr2=0x7f6074151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f606400c7c0 tx=0x7f6064007e00 comp rx=0 tx=0).stop 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 shutdown_connections 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6058060550 0x7f6058062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f607415b160 0x7f60740b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740ca3a0 0x7f6074151330 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 --2- 172.21.15.50:0/257802859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607406ae10 0x7f6074150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 >> 172.21.15.50:0/257802859 conn(0x7f60740cbba0 msgr2=0x7f6074151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 shutdown_connections 2023-12-24T18:55:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:25.940+0000 7f607baf0700 1 -- 172.21.15.50:0/257802859 wait complete. 2023-12-24T18:55:25.959 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T18:55:25.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:55:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.132+0000 7f4954cf0700 1 Processor -- start 2023-12-24T18:55:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.132+0000 7f4954cf0700 1 -- start start 2023-12-24T18:55:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f4954cf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f495015d6d0 0x7f49500b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f4954cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 0x7f49500b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f4954cf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500b41d0 con 0x7f4950158e10 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f4954cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500b49c0 con 0x7f49500b1ba0 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f4954cf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495006d040 con 0x7f495015d6d0 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 0x7f49500b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f495015d6d0 0x7f49500b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f495015d6d0 0x7f49500b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:60782/0 (socket says 172.21.15.50:60782) 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 -- 172.21.15.50:0/3023785813 learned_addr learned my addr 172.21.15.50:0/3023785813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494e59c700 1 --1- 172.21.15.50:0/3023785813 >> v1:172.21.15.82:6789/0 conn(0x7f4950158e10 0x7f495006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:48626/0 (socket says 172.21.15.50:48626) 2023-12-24T18:55:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 -- 172.21.15.50:0/3023785813 >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 msgr2=0x7f49500b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 --2- 172.21.15.50:0/3023785813 >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 0x7f49500b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 -- 172.21.15.50:0/3023785813 >> v1:172.21.15.82:6789/0 conn(0x7f4950158e10 legacy=0x7f495006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494dd9b700 1 -- 172.21.15.50:0/3023785813 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495006d5c0 con 0x7f495015d6d0 2023-12-24T18:55:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.136+0000 7f494ed9d700 1 --2- 172.21.15.50:0/3023785813 >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 0x7f49500b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f494dd9b700 1 --2- 172.21.15.50:0/3023785813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500b3c90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f49500694f0 tx=0x7f4944009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1447dfd7a452513f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f494d59a700 1 -- 172.21.15.50:0/3023785813 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944009e70 con 0x7f495015d6d0 2023-12-24T18:55:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f494d59a700 1 -- 172.21.15.50:0/3023785813 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400b860 con 0x7f495015d6d0 2023-12-24T18:55:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f494d59a700 1 -- 172.21.15.50:0/3023785813 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400bc00 con 0x7f495015d6d0 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 -- 172.21.15.50:0/3023785813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 msgr2=0x7f49500b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 --2- 172.21.15.50:0/3023785813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500b3c90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f49500694f0 tx=0x7f4944009250 comp rx=0 tx=0).stop 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 -- 172.21.15.50:0/3023785813 shutdown_connections 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 --2- 172.21.15.50:0/3023785813 >> v2:172.21.15.50:3300/0 conn(0x7f49500b1ba0 0x7f49500b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 --2- 172.21.15.50:0/3023785813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500b3c90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 -- 172.21.15.50:0/3023785813 >> 172.21.15.50:0/3023785813 conn(0x7f49500670b0 msgr2=0x7f49500674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 -- 172.21.15.50:0/3023785813 shutdown_connections 2023-12-24T18:55:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.140+0000 7f4954cf0700 1 -- 172.21.15.50:0/3023785813 wait complete. 2023-12-24T18:55:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 Processor -- start 2023-12-24T18:55:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 -- start start 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4950158e10 0x7f4950087620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950089020 con 0x7f49500b1ba0 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950148010 con 0x7f495015d6d0 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f4954cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4950171290 con 0x7f4950158e10 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f494e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f494e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53686/0 (socket says 172.21.15.50:53686) 2023-12-24T18:55:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.144+0000 7f494e59c700 1 -- 172.21.15.50:0/2606657583 learned_addr learned my addr 172.21.15.50:0/2606657583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494ed9d700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494dd9b700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4950158e10 0x7f4950087620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 -- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4950158e10 msgr2=0x7f4950087620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4950158e10 0x7f4950087620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 -- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 msgr2=0x7f49500afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 -- 172.21.15.50:0/2606657583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009a20 con 0x7f49500b1ba0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f494e59c700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f494000c7c0 tx=0x7f4940007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940005a70 con 0x7f49500b1ba0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940005bd0 con 0x7f49500b1ba0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400070d0 con 0x7f49500b1ba0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440094f0 con 0x7f49500b1ba0 2023-12-24T18:55:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4950171850 con 0x7f49500b1ba0 2023-12-24T18:55:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.148+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500652e0 con 0x7f49500b1ba0 2023-12-24T18:55:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.152+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4940007440 con 0x7f49500b1ba0 2023-12-24T18:55:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.152+0000 7f493e7fc700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 0x7f4930062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.152+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f494007c050 con 0x7f49500b1ba0 2023-12-24T18:55:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.152+0000 7f494dd9b700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 0x7f4930062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.156+0000 7f494dd9b700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 0x7f4930062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49500694f0 tx=0x7f4944017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.160+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f494004c370 con 0x7f49500b1ba0 2023-12-24T18:55:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.328+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f495006ca20 con 0x7f4930060550 2023-12-24T18:55:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.344+0000 7f493e7fc700 1 -- 172.21.15.50:0/2606657583 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271532 (secure 0 0 0) 0x7f495006ca20 con 0x7f4930060550 2023-12-24T18:55:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.352+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 msgr2=0x7f4930062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.352+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 0x7f4930062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49500694f0 tx=0x7f4944017000 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 msgr2=0x7f4950147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f494000c7c0 tx=0x7f4940007f30 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 shutdown_connections 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4930060550 0x7f4930062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f495015d6d0 0x7f49500afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4950158e10 0x7f4950087620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 --2- 172.21.15.50:0/2606657583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49500b1ba0 0x7f4950147ad0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 >> 172.21.15.50:0/2606657583 conn(0x7f49500670b0 msgr2=0x7f4950155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 shutdown_connections 2023-12-24T18:55:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.356+0000 7f4954cf0700 1 -- 172.21.15.50:0/2606657583 wait complete. 2023-12-24T18:55:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:55:26.377 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:55:24.931583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2462120,"kb_used_data":14184,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752512600,"statfs":{"total":773094113280,"available":770572902400,"internally_reserved":0,"allocated":14524416,"data_stored":7999576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.889411"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":718,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-12-24T18:55:12.514517+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:55:12.514517+0000","last_peered":"2023-12-24T18:55:12.514517+0000","last_clean":"2023-12-24T18:55:12.514517+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:55:12.514517+0000","last_undegraded":"2023-12-24T18:55:12.514517+0000","last_fullsized":"2023-12-24T18:55:12.514517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2260992,"data_stored":1442723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1279999999999999},"min":{"1min":0.79800000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4790000000000001,"5min":1.6579999999999999,"15min":1.784},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.657,"5min":1.6910000000000001,"15min":1.756},"last":0.95399999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.127,"15min":1.133},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5009999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.105},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.8129999999999999},"last":1.149}]},{"osd":2,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.2050000000000001},"min":{"1min":0.89600000000000002,"5min":0.64800000000000002,"15min":0.59299999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.625},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.579,"5min":1.595,"15min":1.6799999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.264,"15min":1.2769999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.71399999999999997},"max":{"1min":1.5429999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.173},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5780000000000001,"5min":1.623,"15min":2.1859999999999999},"last":0.88500000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.165},"min":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.595,"5min":1.7450000000000001,"15min":1.8109999999999999},"last":1.075},{"interface":"front","average":{"1min":1.167,"5min":1.2170000000000001,"15min":1.26},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.661,"5min":1.6719999999999999,"15min":2.1160000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2529999999999999,"15min":1.2709999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.59899999999999998},"max":{"1min":1.575,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.004},{"interface":"front","average":{"1min":1.323,"5min":1.3360000000000001,"15min":1.3240000000000001},"min":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.68600000000000005},"max":{"1min":1.837,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4099999999999999,"15min":1.4059999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9019999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.242},{"interface":"front","average":{"1min":1.337,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.748,"5min":1.917,"15min":1.917},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2629999999999999,"15min":1.2509999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.47799999999999998},"max":{"1min":1.4670000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.343},{"interface":"front","average":{"1min":1.306,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.71299999999999997},"max":{"1min":1.4810000000000001,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.0569999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.86099999999999999,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.4299999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.238,"15min":1.216},"min":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6000000000000001,"5min":3.081,"15min":3.081},"last":1.246}]},{"osd":2,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.82399999999999995,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5449999999999999,"5min":2.173,"15min":2.173},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2430000000000001,"15min":1.24},"min":{"1min":0.83099999999999996,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.6819999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":1.4390000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3380000000000001,"15min":1.282},"min":{"1min":1.0700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5329999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.286,"15min":1.266},"min":{"1min":0.88800000000000001,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":1.5149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.125}]},{"osd":4,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1990000000000001,"15min":1.1819999999999999},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.53100000000000003},"max":{"1min":1.6299999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.274,"15min":1.238},"min":{"1min":0.82999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.595,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.173}]},{"osd":5,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.1930000000000001},"min":{"1min":0.95699999999999996,"5min":0.73399999999999999,"15min":0.59399999999999997},"max":{"1min":1.409,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.476},{"interface":"front","average":{"1min":1.306,"5min":1.383,"15min":1.339},"min":{"1min":0.75,"5min":0.75,"15min":0.622},"max":{"1min":1.76,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.526}]},{"osd":7,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.409,"15min":1.3660000000000001},"min":{"1min":1.038,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":1.9830000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.409},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.363},"min":{"1min":1.107,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":1.611,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303012,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.155,"15min":1.1890000000000001},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.2989999999999999},"min":{"1min":0.81000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.839,"15min":1.859},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.159,"15min":1.159},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.091}]},{"osd":2,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.202},"min":{"1min":0.875,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.226},"min":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.72199999999999998},"max":{"1min":1.5629999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2270000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.876,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4610000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.276,"15min":1.296},"min":{"1min":0.879,"5min":0.78700000000000003,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.706,"15min":1.786},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.141},"min":{"1min":0.75600000000000001,"5min":0.65000000000000002,"15min":0.50600000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.278,"15min":1.246},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.57699999999999996},"max":{"1min":1.8460000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.3959999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.298,"15min":1.2709999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.61699999999999999},"max":{"1min":1.7170000000000001,"5min":1.861,"15min":1.909},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.85599999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472}]},{"osd":7,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.383,"15min":1.379},"min":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.9099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.3959999999999999,"15min":1.3999999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.64600000000000002},"max":{"1min":1.796,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.149}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2030000000000001,"15min":1.198},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.7070000000000001,"5min":1.835,"15min":1.835},"last":0.995},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.246},"min":{"1min":0.91600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.145,"15min":1.145},"min":{"1min":0.86899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.748},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4950000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.294},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.55,"5min":1.952,"15min":1.952},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.29,"15min":1.2989999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.76,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.627}]},{"osd":3,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.76000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.141},{"interface":"front","average":{"1min":1.121,"5min":1.216,"15min":1.2629999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.675,"5min":1.7669999999999999,"15min":1.839},"last":1.0980000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.623},"max":{"1min":2.0019999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.286},{"interface":"front","average":{"1min":1.216,"5min":1.286,"15min":1.296},"min":{"1min":0.753,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.6419999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2529999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6779999999999999,"5min":1.823,"15min":1.881},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8100000000000001,"5min":1.909,"15min":2.0760000000000001},"last":1.407}]},{"osd":7,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2769999999999999,"15min":1.2889999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.7250000000000001,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.84099999999999997,"5min":0.747,"15min":0.71399999999999997},"max":{"1min":1.8300000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94999999999999996,"15min":0.94799999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.266,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.093},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.46000000000000002},"max":{"1min":1.492,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.92600000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.57099999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.569,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.145,"15min":1.1870000000000001},"min":{"1min":0.66600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.103}]},{"osd":2,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.081,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8560000000000001,"5min":2.363,"15min":2.363},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6240000000000001,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":1.046}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.258},"min":{"1min":0.83399999999999996,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.609,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.323,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.319,"5min":2.944,"15min":2.944},"last":1.159}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.391,"15min":1.3899999999999999},"min":{"1min":1.0629999999999999,"5min":0.86799999999999999,"15min":0.84499999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.427},"min":{"1min":1.042,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.895,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.2609999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4399999999999999,"15min":1.4610000000000001},"min":{"1min":1.111,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.841,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.405,"15min":1.411},"min":{"1min":1.04,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8029999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.125}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4510000000000001,"15min":1.454},"min":{"1min":1.131,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.883,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.206},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"min":{"1min":1.075,"5min":0.755,"15min":0.755},"max":{"1min":2.4430000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311204,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060636,"statfs":{"total":96636764160,"available":96318091264,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64800000000000002,"5min":0.501,"15min":0.34499999999999997},"max":{"1min":1.1910000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.62},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.056,"15min":1.0609999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.50900000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5229999999999999},"last":1.042}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.57599999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5620000000000001,"5min":1.6519999999999999,"15min":1.976},"last":1.208}]},{"osd":3,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.127,"15min":1.137},"min":{"1min":0.77600000000000002,"5min":0.71099999999999997,"15min":0.441},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.095},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0629999999999999,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.48299999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.4359999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.306,"15min":1.3080000000000001},"min":{"1min":1.101,"5min":0.86299999999999999,"15min":0.68899999999999995},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.3169999999999999,"15min":1.29},"min":{"1min":1.0309999999999999,"5min":0.92500000000000004,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":1.798,"15min":1.798},"last":1.24}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.325,"15min":1.2869999999999999},"min":{"1min":1.01,"5min":0.83699999999999997,"15min":0.496},"max":{"1min":1.748,"5min":2.069,"15min":2.069},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3759999999999999,"15min":1.365},"min":{"1min":1.044,"5min":0.94199999999999995,"15min":0.82999999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.3779999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.4019999999999999},"min":{"1min":1.2010000000000001,"5min":1.0209999999999999,"15min":0.72399999999999998},"max":{"1min":1.718,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.581},{"interface":"front","average":{"1min":1.478,"5min":1.429,"15min":1.401},"min":{"1min":1.1419999999999999,"5min":0.95199999999999996,"15min":0.71599999999999997},"max":{"1min":1.841,"5min":1.9319999999999999,"15min":2.093},"last":1.617}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4770000000000001,"15min":1.4570000000000001},"min":{"1min":1.2270000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.512},{"interface":"front","average":{"1min":1.532,"5min":1.4870000000000001,"15min":1.472},"min":{"1min":1.2729999999999999,"5min":0.94999999999999996,"15min":0.84999999999999998},"max":{"1min":1.879,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.3149999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51000000000000001},"max":{"1min":1.3200000000000001,"5min":1.663,"15min":1.8149999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.202,"5min":1.095,"15min":1.123},"min":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.829},"last":1.026}]},{"osd":2,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"max":{"1min":1.498,"5min":1.498,"15min":1.5349999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.115},"min":{"1min":0.63800000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.486,"5min":1.73,"15min":1.7410000000000001},"last":1.294}]},{"osd":3,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.262,"15min":1.254},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.595,"5min":1.823,"15min":1.915},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.111,"15min":1.093},"min":{"1min":0.753,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6839999999999999,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":1.153}]},{"osd":4,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.92400000000000004,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":1.724},"last":1.27},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.413,"15min":1.405},"min":{"1min":1.089,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9179999999999999,"5min":2.1930000000000001,"15min":2.3130000000000002},"last":1.3999999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.385},"min":{"1min":1.0840000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.621,"5min":1.887,"15min":1.9790000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.3520000000000001,"15min":1.353},"min":{"1min":0.99399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.786,"5min":1.8140000000000001,"15min":2.0089999999999999},"last":1.2170000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.5,"15min":1.49},"min":{"1min":1.21,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0249999999999999,"5min":2.1269999999999998,"15min":2.3860000000000001},"last":1.486},{"interface":"front","average":{"1min":1.526,"5min":1.4550000000000001,"15min":1.4630000000000001},"min":{"1min":1.2230000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":2.1749999999999998},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.516,"15min":1.5229999999999999},"min":{"1min":1.1739999999999999,"5min":1.0549999999999999,"15min":0.754},"max":{"1min":2.0099999999999998,"5min":2.0219999999999998,"15min":2.3540000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.472,"15min":1.4610000000000001},"min":{"1min":1.133,"5min":0.876,"15min":0.876},"max":{"1min":1.897,"5min":1.919,"15min":2.1160000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2260992,"data_stored":1442723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.206,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.216},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.069,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.629,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.5649999999999999,"15min":1.7},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0720000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.58099999999999996},"max":{"1min":1.4379999999999999,"5min":1.631,"15min":2.8130000000000002},"last":1.0920000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.69699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.528},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2250000000000001,"15min":1.234},"min":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6200000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.1499999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.335,"15min":1.345},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6359999999999999,"5min":1.8120000000000001,"15min":2.0009999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.2789999999999999},"min":{"1min":0.84999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.762},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.391,"15min":1.3839999999999999},"min":{"1min":1.1639999999999999,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.798,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.298},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3640000000000001,"15min":1.399},"min":{"1min":1.115,"5min":0.95699999999999996,"15min":0.95499999999999996},"max":{"1min":1.7909999999999999,"5min":1.978,"15min":2.2280000000000002},"last":1.423}]},{"osd":6,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.97299999999999998,"15min":0.69599999999999995},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":2.0779999999999998},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.9350000000000001,"5min":2.0750000000000002,"15min":2.23},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":1.022,"5min":1.0189999999999999,"15min":1.006},"max":{"1min":1.847,"5min":2.262,"15min":2.8980000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.419,"15min":1.4330000000000001},"min":{"1min":1.155,"5min":0.94899999999999995,"15min":0.72399999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.3279999999999998},"last":1.661}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:55:26.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:55:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.596+0000 7fe39fb85700 1 Processor -- start 2023-12-24T18:55:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.596+0000 7fe39fb85700 1 -- start start 2023-12-24T18:55:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39fb85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe39806b540 0x7fe3980ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39fb85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe398159a20 0x7fe398159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39fb85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39806ba80 con 0x7fe3980ce750 2023-12-24T18:55:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39fb85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39806bd60 con 0x7fe398159a20 2023-12-24T18:55:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39fb85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39806c040 con 0x7fe39806b540 2023-12-24T18:55:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe398159a20 0x7fe398159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe398159a20 0x7fe398159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53694/0 (socket says 172.21.15.50:53694) 2023-12-24T18:55:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39d120700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe39806b540 0x7fe3980ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39d921700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe3980ce750 0x7fe39806ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:48628/0 (socket says 172.21.15.50:48628) 2023-12-24T18:55:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 -- 172.21.15.50:0/1489779118 learned_addr learned my addr 172.21.15.50:0/1489779118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 -- 172.21.15.50:0/1489779118 >> v2:172.21.15.82:3300/0 conn(0x7fe39806b540 msgr2=0x7fe3980ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 --2- 172.21.15.50:0/1489779118 >> v2:172.21.15.82:3300/0 conn(0x7fe39806b540 0x7fe3980ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 -- 172.21.15.50:0/1489779118 >> v1:172.21.15.82:6789/0 conn(0x7fe3980ce750 legacy=0x7fe39806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 -- 172.21.15.50:0/1489779118 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39806c320 con 0x7fe398159a20 2023-12-24T18:55:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39e122700 1 --2- 172.21.15.50:0/1489779118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe398159a20 0x7fe398159ec0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe39806a9b0 tx=0x7fe390009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de26d36a1582e36 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39c91f700 1 -- 172.21.15.50:0/1489779118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000e070 con 0x7fe398159a20 2023-12-24T18:55:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39c91f700 1 -- 172.21.15.50:0/1489779118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000ba20 con 0x7fe398159a20 2023-12-24T18:55:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.600+0000 7fe39c91f700 1 -- 172.21.15.50:0/1489779118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900092e0 con 0x7fe398159a20 2023-12-24T18:55:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 -- 172.21.15.50:0/1489779118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe398159a20 msgr2=0x7fe398159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 --2- 172.21.15.50:0/1489779118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe398159a20 0x7fe398159ec0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe39806a9b0 tx=0x7fe390009840 comp rx=0 tx=0).stop 2023-12-24T18:55:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 -- 172.21.15.50:0/1489779118 shutdown_connections 2023-12-24T18:55:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 --2- 172.21.15.50:0/1489779118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe398159a20 0x7fe398159ec0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 --2- 172.21.15.50:0/1489779118 >> v2:172.21.15.82:3300/0 conn(0x7fe39806b540 0x7fe3980ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 -- 172.21.15.50:0/1489779118 >> 172.21.15.50:0/1489779118 conn(0x7fe3980cffb0 msgr2=0x7fe3980d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 -- 172.21.15.50:0/1489779118 shutdown_connections 2023-12-24T18:55:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.604+0000 7fe39fb85700 1 -- 172.21.15.50:0/1489779118 wait complete. 2023-12-24T18:55:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 Processor -- start 2023-12-24T18:55:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 -- start start 2023-12-24T18:55:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe39806b540 0x7fe398144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe398159a20 0x7fe3980c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981573f0 con 0x7fe3980ce750 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981567e0 con 0x7fe398159a20 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39fb85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe398156ac0 con 0x7fe39806b540 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d120700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d120700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53696/0 (socket says 172.21.15.50:53696) 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d120700 1 -- 172.21.15.50:0/4264180094 learned_addr learned my addr 172.21.15.50:0/4264180094 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39e122700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe398159a20 0x7fe3980c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d921700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe39806b540 0x7fe398144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d120700 1 -- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe39806b540 msgr2=0x7fe398144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.608+0000 7fe39d120700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe39806b540 0x7fe398144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39d120700 1 -- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe398159a20 msgr2=0x7fe3980c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39d120700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe398159a20 0x7fe3980c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39d120700 1 -- 172.21.15.50:0/4264180094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390009ae0 con 0x7fe3980ce750 2023-12-24T18:55:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39d120700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe38800ec50 tx=0x7fe3880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800c850 con 0x7fe3980ce750 2023-12-24T18:55:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800c9b0 con 0x7fe3980ce750 2023-12-24T18:55:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800cd70 con 0x7fe3980ce750 2023-12-24T18:55:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398156da0 con 0x7fe3980ce750 2023-12-24T18:55:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe398157f20 con 0x7fe3980ce750 2023-12-24T18:55:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.612+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3980652e0 con 0x7fe3980ce750 2023-12-24T18:55:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.616+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe388013680 con 0x7fe3980ce750 2023-12-24T18:55:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.616+0000 7fe38dffb700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 0x7fe37c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.616+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fe38807ccf0 con 0x7fe3980ce750 2023-12-24T18:55:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.620+0000 7fe39d921700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 0x7fe37c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.620+0000 7fe39d921700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 0x7fe37c062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe394004fd0 tx=0x7fe394007eb0 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:26.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.624+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe38804cf70 con 0x7fe3980ce750 2023-12-24T18:55:26.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.804+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe398157530 con 0x7fe37c060550 2023-12-24T18:55:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.820+0000 7fe38dffb700 1 -- 172.21.15.50:0/4264180094 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271532 (secure 0 0 0) 0x7fe398157530 con 0x7fe37c060550 2023-12-24T18:55:26.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 msgr2=0x7fe37c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 0x7fe37c062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe394004fd0 tx=0x7fe394007eb0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 msgr2=0x7fe398155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe38800ec50 tx=0x7fe3880091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 shutdown_connections 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe37c060550 0x7fe37c062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe398159a20 0x7fe3980c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3980ce750 0x7fe398155d10 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 --2- 172.21.15.50:0/4264180094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe39806b540 0x7fe398144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 >> 172.21.15.50:0/4264180094 conn(0x7fe3980cffb0 msgr2=0x7fe39806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 shutdown_connections 2023-12-24T18:55:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:26.828+0000 7fe39fb85700 1 -- 172.21.15.50:0/4264180094 wait complete. 2023-12-24T18:55:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:55:26.848 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T18:55:24.931583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2462120,"kb_used_data":14184,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752512600,"statfs":{"total":773094113280,"available":770572902400,"internally_reserved":0,"allocated":14524416,"data_stored":7999576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.889411"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:21.041170+0000","last_change":"2023-12-24T18:55:21.041170+0000","last_active":"2023-12-24T18:55:21.041170+0000","last_peered":"2023-12-24T18:55:21.041170+0000","last_clean":"2023-12-24T18:55:21.041170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:21.041170+0000","last_undegraded":"2023-12-24T18:55:21.041170+0000","last_fullsized":"2023-12-24T18:55:21.041170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T18:55:20.026751+0000","last_change":"2023-12-24T18:55:20.026751+0000","last_active":"2023-12-24T18:55:20.026751+0000","last_peered":"2023-12-24T18:55:20.026751+0000","last_clean":"2023-12-24T18:55:20.026751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T18:55:20.026751+0000","last_undegraded":"2023-12-24T18:55:20.026751+0000","last_fullsized":"2023-12-24T18:55:20.026751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":718,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-12-24T18:55:12.514517+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:55:12.514517+0000","last_peered":"2023-12-24T18:55:12.514517+0000","last_clean":"2023-12-24T18:55:12.514517+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:55:12.514517+0000","last_undegraded":"2023-12-24T18:55:12.514517+0000","last_fullsized":"2023-12-24T18:55:12.514517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2260992,"data_stored":1442723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1279999999999999},"min":{"1min":0.79800000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4790000000000001,"5min":1.6579999999999999,"15min":1.784},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.657,"5min":1.6910000000000001,"15min":1.756},"last":0.95399999999999996}]},{"osd":1,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.127,"15min":1.133},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5009999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.105},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.8129999999999999},"last":1.149}]},{"osd":2,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.2050000000000001},"min":{"1min":0.89600000000000002,"5min":0.64800000000000002,"15min":0.59299999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.625},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.579,"5min":1.595,"15min":1.6799999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.264,"15min":1.2769999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.71399999999999997},"max":{"1min":1.5429999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.173},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5780000000000001,"5min":1.623,"15min":2.1859999999999999},"last":0.88500000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.165},"min":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.595,"5min":1.7450000000000001,"15min":1.8109999999999999},"last":1.075},{"interface":"front","average":{"1min":1.167,"5min":1.2170000000000001,"15min":1.26},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.661,"5min":1.6719999999999999,"15min":2.1160000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2529999999999999,"15min":1.2709999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.59899999999999998},"max":{"1min":1.575,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.004},{"interface":"front","average":{"1min":1.323,"5min":1.3360000000000001,"15min":1.3240000000000001},"min":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.68600000000000005},"max":{"1min":1.837,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4099999999999999,"15min":1.4059999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9019999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.242},{"interface":"front","average":{"1min":1.337,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.748,"5min":1.917,"15min":1.917},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2629999999999999,"15min":1.2509999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.47799999999999998},"max":{"1min":1.4670000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.343},{"interface":"front","average":{"1min":1.306,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.71299999999999997},"max":{"1min":1.4810000000000001,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.0569999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.86099999999999999,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.4299999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.238,"15min":1.216},"min":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6000000000000001,"5min":3.081,"15min":3.081},"last":1.246}]},{"osd":2,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.82399999999999995,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5449999999999999,"5min":2.173,"15min":2.173},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2430000000000001,"15min":1.24},"min":{"1min":0.83099999999999996,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.6819999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":1.4390000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3380000000000001,"15min":1.282},"min":{"1min":1.0700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5329999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.286,"15min":1.266},"min":{"1min":0.88800000000000001,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":1.5149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.125}]},{"osd":4,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1990000000000001,"15min":1.1819999999999999},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.53100000000000003},"max":{"1min":1.6299999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.274,"15min":1.238},"min":{"1min":0.82999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.595,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.173}]},{"osd":5,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.1930000000000001},"min":{"1min":0.95699999999999996,"5min":0.73399999999999999,"15min":0.59399999999999997},"max":{"1min":1.409,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.476},{"interface":"front","average":{"1min":1.306,"5min":1.383,"15min":1.339},"min":{"1min":0.75,"5min":0.75,"15min":0.622},"max":{"1min":1.76,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.526}]},{"osd":7,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.409,"15min":1.3660000000000001},"min":{"1min":1.038,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":1.9830000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.409},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.363},"min":{"1min":1.107,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":1.611,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303012,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.155,"15min":1.1890000000000001},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.2989999999999999},"min":{"1min":0.81000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.839,"15min":1.859},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.159,"15min":1.159},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.091}]},{"osd":2,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.202},"min":{"1min":0.875,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.226},"min":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.72199999999999998},"max":{"1min":1.5629999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2270000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.876,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4610000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.276,"15min":1.296},"min":{"1min":0.879,"5min":0.78700000000000003,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.706,"15min":1.786},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.141},"min":{"1min":0.75600000000000001,"5min":0.65000000000000002,"15min":0.50600000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.278,"15min":1.246},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.57699999999999996},"max":{"1min":1.8460000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.3959999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.298,"15min":1.2709999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.61699999999999999},"max":{"1min":1.7170000000000001,"5min":1.861,"15min":1.909},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.85599999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.472}]},{"osd":7,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.383,"15min":1.379},"min":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.9099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.3959999999999999,"15min":1.3999999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.64600000000000002},"max":{"1min":1.796,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.149}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2030000000000001,"15min":1.198},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.7070000000000001,"5min":1.835,"15min":1.835},"last":0.995},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.246},"min":{"1min":0.91600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.145,"15min":1.145},"min":{"1min":0.86899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.748},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4950000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.294},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.55,"5min":1.952,"15min":1.952},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.29,"15min":1.2989999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.76,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.627}]},{"osd":3,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.76000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.141},{"interface":"front","average":{"1min":1.121,"5min":1.216,"15min":1.2629999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.675,"5min":1.7669999999999999,"15min":1.839},"last":1.0980000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.623},"max":{"1min":2.0019999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.286},{"interface":"front","average":{"1min":1.216,"5min":1.286,"15min":1.296},"min":{"1min":0.753,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.6419999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2529999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6779999999999999,"5min":1.823,"15min":1.881},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8100000000000001,"5min":1.909,"15min":2.0760000000000001},"last":1.407}]},{"osd":7,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2769999999999999,"15min":1.2889999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.7250000000000001,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.84099999999999997,"5min":0.747,"15min":0.71399999999999997},"max":{"1min":1.8300000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94999999999999996,"15min":0.94799999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.266,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.093},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.46000000000000002},"max":{"1min":1.492,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.92600000000000005}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.57099999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.569,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.145,"15min":1.1870000000000001},"min":{"1min":0.66600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.103}]},{"osd":2,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.081,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8560000000000001,"5min":2.363,"15min":2.363},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6240000000000001,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":1.046}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.258},"min":{"1min":0.83399999999999996,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.609,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.323,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.319,"5min":2.944,"15min":2.944},"last":1.159}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.391,"15min":1.3899999999999999},"min":{"1min":1.0629999999999999,"5min":0.86799999999999999,"15min":0.84499999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.427},"min":{"1min":1.042,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.895,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.2609999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4399999999999999,"15min":1.4610000000000001},"min":{"1min":1.111,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.841,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.405,"15min":1.411},"min":{"1min":1.04,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8029999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.125}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4510000000000001,"15min":1.454},"min":{"1min":1.131,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.883,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.206},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"min":{"1min":1.075,"5min":0.755,"15min":0.755},"max":{"1min":2.4430000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311204,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060636,"statfs":{"total":96636764160,"available":96318091264,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64800000000000002,"5min":0.501,"15min":0.34499999999999997},"max":{"1min":1.1910000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.62},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.056,"15min":1.0609999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.50900000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5229999999999999},"last":1.042}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.57599999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5620000000000001,"5min":1.6519999999999999,"15min":1.976},"last":1.208}]},{"osd":3,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.127,"15min":1.137},"min":{"1min":0.77600000000000002,"5min":0.71099999999999997,"15min":0.441},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.095},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0629999999999999,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.48299999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.4359999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.306,"15min":1.3080000000000001},"min":{"1min":1.101,"5min":0.86299999999999999,"15min":0.68899999999999995},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.3169999999999999,"15min":1.29},"min":{"1min":1.0309999999999999,"5min":0.92500000000000004,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":1.798,"15min":1.798},"last":1.24}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.325,"15min":1.2869999999999999},"min":{"1min":1.01,"5min":0.83699999999999997,"15min":0.496},"max":{"1min":1.748,"5min":2.069,"15min":2.069},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3759999999999999,"15min":1.365},"min":{"1min":1.044,"5min":0.94199999999999995,"15min":0.82999999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.3779999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.4019999999999999},"min":{"1min":1.2010000000000001,"5min":1.0209999999999999,"15min":0.72399999999999998},"max":{"1min":1.718,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.581},{"interface":"front","average":{"1min":1.478,"5min":1.429,"15min":1.401},"min":{"1min":1.1419999999999999,"5min":0.95199999999999996,"15min":0.71599999999999997},"max":{"1min":1.841,"5min":1.9319999999999999,"15min":2.093},"last":1.617}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4770000000000001,"15min":1.4570000000000001},"min":{"1min":1.2270000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.512},{"interface":"front","average":{"1min":1.532,"5min":1.4870000000000001,"15min":1.472},"min":{"1min":1.2729999999999999,"5min":0.94999999999999996,"15min":0.84999999999999998},"max":{"1min":1.879,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.3149999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307108,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1667072,"data_stored":852355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51000000000000001},"max":{"1min":1.3200000000000001,"5min":1.663,"15min":1.8149999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.202,"5min":1.095,"15min":1.123},"min":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.829},"last":1.026}]},{"osd":2,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"max":{"1min":1.498,"5min":1.498,"15min":1.5349999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.115},"min":{"1min":0.63800000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.486,"5min":1.73,"15min":1.7410000000000001},"last":1.294}]},{"osd":3,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.262,"15min":1.254},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.595,"5min":1.823,"15min":1.915},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.111,"15min":1.093},"min":{"1min":0.753,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6839999999999999,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":1.153}]},{"osd":4,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.92400000000000004,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":1.724},"last":1.27},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.413,"15min":1.405},"min":{"1min":1.089,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9179999999999999,"5min":2.1930000000000001,"15min":2.3130000000000002},"last":1.3999999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.385},"min":{"1min":1.0840000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.621,"5min":1.887,"15min":1.9790000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.3520000000000001,"15min":1.353},"min":{"1min":0.99399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.786,"5min":1.8140000000000001,"15min":2.0089999999999999},"last":1.2170000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.5,"15min":1.49},"min":{"1min":1.21,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0249999999999999,"5min":2.1269999999999998,"15min":2.3860000000000001},"last":1.486},{"interface":"front","average":{"1min":1.526,"5min":1.4550000000000001,"15min":1.4630000000000001},"min":{"1min":1.2230000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":2.1749999999999998},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.516,"15min":1.5229999999999999},"min":{"1min":1.1739999999999999,"5min":1.0549999999999999,"15min":0.754},"max":{"1min":2.0099999999999998,"5min":2.0219999999999998,"15min":2.3540000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.472,"15min":1.4610000000000001},"min":{"1min":1.133,"5min":0.876,"15min":0.876},"max":{"1min":1.897,"5min":1.919,"15min":2.1160000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2260992,"data_stored":1442723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.206,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.216},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.069,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.629,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.5649999999999999,"15min":1.7},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0720000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.58099999999999996},"max":{"1min":1.4379999999999999,"5min":1.631,"15min":2.8130000000000002},"last":1.0920000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.69699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.528},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2250000000000001,"15min":1.234},"min":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6200000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.1499999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.335,"15min":1.345},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6359999999999999,"5min":1.8120000000000001,"15min":2.0009999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.2789999999999999},"min":{"1min":0.84999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.762},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.391,"15min":1.3839999999999999},"min":{"1min":1.1639999999999999,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.798,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.298},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3640000000000001,"15min":1.399},"min":{"1min":1.115,"5min":0.95699999999999996,"15min":0.95499999999999996},"max":{"1min":1.7909999999999999,"5min":1.978,"15min":2.2280000000000002},"last":1.423}]},{"osd":6,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.97299999999999998,"15min":0.69599999999999995},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":2.0779999999999998},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.9350000000000001,"5min":2.0750000000000002,"15min":2.23},"last":1.508}]},{"osd":7,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":1.022,"5min":1.0189999999999999,"15min":1.006},"max":{"1min":1.847,"5min":2.262,"15min":2.8980000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.419,"15min":1.4330000000000001},"min":{"1min":1.155,"5min":0.94899999999999995,"15min":0.72399999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.3279999999999998},"last":1.661}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:55:26.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:55:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.064+0000 7f445d3c5700 1 Processor -- start 2023-12-24T18:55:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.064+0000 7f445d3c5700 1 -- start start 2023-12-24T18:55:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.064+0000 7f445d3c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44581570b0 0x7f445815b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.064+0000 7f445d3c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f445806d440 0x7f44580670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.064+0000 7f445d3c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458158490 con 0x7f445806c820 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580accb0 con 0x7f445806d440 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445815bad0 con 0x7f44581570b0 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f4457fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f445806c820 0x7f445806cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50968/0 (socket says 172.21.15.50:50968) 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f4457fff700 1 -- 172.21.15.50:0/3435009009 learned_addr learned my addr 172.21.15.50:0/3435009009 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f445806d440 0x7f44580670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f4456ffd700 1 --2- 172.21.15.50:0/3435009009 >> v2:172.21.15.82:3300/0 conn(0x7f44581570b0 0x7f445815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 -- 172.21.15.50:0/3435009009 >> v2:172.21.15.82:3300/0 conn(0x7f44581570b0 msgr2=0x7f445815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 --2- 172.21.15.50:0/3435009009 >> v2:172.21.15.82:3300/0 conn(0x7f44581570b0 0x7f445815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f44567fc700 1 -- 172.21.15.50:0/3435009009 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216783999 0 0) 0x7f4458158490 con 0x7f445806c820 2023-12-24T18:55:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 -- 172.21.15.50:0/3435009009 >> v1:172.21.15.50:6789/0 conn(0x7f445806c820 legacy=0x7f445806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 -- 172.21.15.50:0/3435009009 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580af6d0 con 0x7f445806d440 2023-12-24T18:55:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f444e7fc700 1 --2- 172.21.15.50:0/3435009009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f445806d440 0x7f44580670b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4458158770 tx=0x7f44400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0853d8475075ed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f44567fc700 1 -- 172.21.15.50:0/3435009009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011630 con 0x7f445806d440 2023-12-24T18:55:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f44567fc700 1 -- 172.21.15.50:0/3435009009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440011790 con 0x7f445806d440 2023-12-24T18:55:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f44567fc700 1 -- 172.21.15.50:0/3435009009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011b30 con 0x7f445806d440 2023-12-24T18:55:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- 172.21.15.50:0/3435009009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f445806d440 msgr2=0x7f44580670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3435009009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f445806d440 0x7f44580670b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4458158770 tx=0x7f44400091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- 172.21.15.50:0/3435009009 shutdown_connections 2023-12-24T18:55:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3435009009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f445806d440 0x7f44580670b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3435009009 >> v2:172.21.15.82:3300/0 conn(0x7f44581570b0 0x7f445815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- 172.21.15.50:0/3435009009 >> 172.21.15.50:0/3435009009 conn(0x7f44580c9da0 msgr2=0x7f44580ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.068+0000 7f445d3c5700 1 -- 172.21.15.50:0/3435009009 shutdown_connections 2023-12-24T18:55:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.072+0000 7f445d3c5700 1 -- 172.21.15.50:0/3435009009 wait complete. 2023-12-24T18:55:27.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.072+0000 7f445d3c5700 1 Processor -- start 2023-12-24T18:55:27.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.072+0000 7f445d3c5700 1 -- start start 2023-12-24T18:55:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445806c820 0x7f4458150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f445806d440 0x7f445815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4458151240 con 0x7f44581570b0 2023-12-24T18:55:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4458159c30 con 0x7f445806c820 2023-12-24T18:55:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4458159f10 con 0x7f445806d440 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53716/0 (socket says 172.21.15.50:53716) 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 -- 172.21.15.50:0/3552382406 learned_addr learned my addr 172.21.15.50:0/3552382406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4456ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445806c820 0x7f4458150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f444e7fc700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f445806d440 0x7f445815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 -- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f445806d440 msgr2=0x7f445815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f445806d440 0x7f445815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 -- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445806c820 msgr2=0x7f4458150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445806c820 0x7f4458150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 -- 172.21.15.50:0/3552382406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440009420 con 0x7f44581570b0 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f4457fff700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f4450007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450005b30 con 0x7f44581570b0 2023-12-24T18:55:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450005c90 con 0x7f44581570b0 2023-12-24T18:55:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450007320 con 0x7f44581570b0 2023-12-24T18:55:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445815a1f0 con 0x7f44581570b0 2023-12-24T18:55:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.076+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445815db20 con 0x7f44581570b0 2023-12-24T18:55:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.080+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44580652e0 con 0x7f44581570b0 2023-12-24T18:55:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.080+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4450007690 con 0x7f44581570b0 2023-12-24T18:55:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.080+0000 7f444f7fe700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 0x7f4438062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.080+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f445007bef0 con 0x7f44581570b0 2023-12-24T18:55:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.080+0000 7f4456ffd700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 0x7f4438062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.084+0000 7f4456ffd700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 0x7f4438062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4448009fd0 tx=0x7f444800b040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.088+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f445004c170 con 0x7f44581570b0 2023-12-24T18:55:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.260+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f445815dd10 con 0x7f4438060550 2023-12-24T18:55:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.268+0000 7f444f7fe700 1 -- 172.21.15.50:0/3552382406 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286623 (secure 0 0 0) 0x7f445815dd10 con 0x7f4438060550 2023-12-24T18:55:27.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 msgr2=0x7f4438062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 0x7f4438062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4448009fd0 tx=0x7f444800b040 comp rx=0 tx=0).stop 2023-12-24T18:55:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 msgr2=0x7f4458157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f4450007d30 comp rx=0 tx=0).stop 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 shutdown_connections 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4438060550 0x7f4438062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44581570b0 0x7f4458157480 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f445806d440 0x7f445815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 --2- 172.21.15.50:0/3552382406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445806c820 0x7f4458150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 >> 172.21.15.50:0/3552382406 conn(0x7f44580c9da0 msgr2=0x7f44580ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 shutdown_connections 2023-12-24T18:55:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.276+0000 7f445d3c5700 1 -- 172.21.15.50:0/3552382406 wait complete. 2023-12-24T18:55:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:55:27.297 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:55:26.932208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2462568,"kb_used_data":14632,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752512152,"statfs":{"total":773094113280,"available":770572443648,"internally_reserved":0,"allocated":14983168,"data_stored":8228308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001914"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091134+0000","last_change":"2023-12-24T18:55:22.083017+0000","last_active":"2023-12-24T18:55:22.091134+0000","last_peered":"2023-12-24T18:55:22.091134+0000","last_clean":"2023-12-24T18:55:22.091134+0000","last_became_active":"2023-12-24T18:55:22.082692+0000","last_became_peered":"2023-12-24T18:55:22.082692+0000","last_unstale":"2023-12-24T18:55:22.091134+0000","last_undegraded":"2023-12-24T18:55:22.091134+0000","last_fullsized":"2023-12-24T18:55:22.091134+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114053+0000","last_change":"2023-12-24T18:55:22.112246+0000","last_active":"2023-12-24T18:55:22.114053+0000","last_peered":"2023-12-24T18:55:22.114053+0000","last_clean":"2023-12-24T18:55:22.114053+0000","last_became_active":"2023-12-24T18:55:22.111949+0000","last_became_peered":"2023-12-24T18:55:22.111949+0000","last_unstale":"2023-12-24T18:55:22.114053+0000","last_undegraded":"2023-12-24T18:55:22.114053+0000","last_fullsized":"2023-12-24T18:55:22.114053+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:31.071346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086980+0000","last_change":"2023-12-24T18:55:22.082723+0000","last_active":"2023-12-24T18:55:22.086980+0000","last_peered":"2023-12-24T18:55:22.086980+0000","last_clean":"2023-12-24T18:55:22.086980+0000","last_became_active":"2023-12-24T18:55:22.081679+0000","last_became_peered":"2023-12-24T18:55:22.081679+0000","last_unstale":"2023-12-24T18:55:22.086980+0000","last_undegraded":"2023-12-24T18:55:22.086980+0000","last_fullsized":"2023-12-24T18:55:22.086980+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:49.889577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112852+0000","last_change":"2023-12-24T18:55:22.109421+0000","last_active":"2023-12-24T18:55:22.112852+0000","last_peered":"2023-12-24T18:55:22.112852+0000","last_clean":"2023-12-24T18:55:22.112852+0000","last_became_active":"2023-12-24T18:55:22.107483+0000","last_became_peered":"2023-12-24T18:55:22.107483+0000","last_unstale":"2023-12-24T18:55:22.112852+0000","last_undegraded":"2023-12-24T18:55:22.112852+0000","last_fullsized":"2023-12-24T18:55:22.112852+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099342+0000","last_change":"2023-12-24T18:55:22.092712+0000","last_active":"2023-12-24T18:55:22.099342+0000","last_peered":"2023-12-24T18:55:22.099342+0000","last_clean":"2023-12-24T18:55:22.099342+0000","last_became_active":"2023-12-24T18:55:22.092251+0000","last_became_peered":"2023-12-24T18:55:22.092251+0000","last_unstale":"2023-12-24T18:55:22.099342+0000","last_undegraded":"2023-12-24T18:55:22.099342+0000","last_fullsized":"2023-12-24T18:55:22.099342+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103428+0000","last_change":"2023-12-24T18:55:22.095881+0000","last_active":"2023-12-24T18:55:22.103428+0000","last_peered":"2023-12-24T18:55:22.103428+0000","last_clean":"2023-12-24T18:55:22.103428+0000","last_became_active":"2023-12-24T18:55:22.095575+0000","last_became_peered":"2023-12-24T18:55:22.095575+0000","last_unstale":"2023-12-24T18:55:22.103428+0000","last_undegraded":"2023-12-24T18:55:22.103428+0000","last_fullsized":"2023-12-24T18:55:22.103428+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:58.633265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113823+0000","last_change":"2023-12-24T18:55:22.112865+0000","last_active":"2023-12-24T18:55:22.113823+0000","last_peered":"2023-12-24T18:55:22.113823+0000","last_clean":"2023-12-24T18:55:22.113823+0000","last_became_active":"2023-12-24T18:55:22.112359+0000","last_became_peered":"2023-12-24T18:55:22.112359+0000","last_unstale":"2023-12-24T18:55:22.113823+0000","last_undegraded":"2023-12-24T18:55:22.113823+0000","last_fullsized":"2023-12-24T18:55:22.113823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:52.465621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094622+0000","last_change":"2023-12-24T18:55:22.093499+0000","last_active":"2023-12-24T18:55:22.094622+0000","last_peered":"2023-12-24T18:55:22.094622+0000","last_clean":"2023-12-24T18:55:22.094622+0000","last_became_active":"2023-12-24T18:55:22.093219+0000","last_became_peered":"2023-12-24T18:55:22.093219+0000","last_unstale":"2023-12-24T18:55:22.094622+0000","last_undegraded":"2023-12-24T18:55:22.094622+0000","last_fullsized":"2023-12-24T18:55:22.094622+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:12.445913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112816+0000","last_change":"2023-12-24T18:55:22.108390+0000","last_active":"2023-12-24T18:55:22.112816+0000","last_peered":"2023-12-24T18:55:22.112816+0000","last_clean":"2023-12-24T18:55:22.112816+0000","last_became_active":"2023-12-24T18:55:22.108113+0000","last_became_peered":"2023-12-24T18:55:22.108113+0000","last_unstale":"2023-12-24T18:55:22.112816+0000","last_undegraded":"2023-12-24T18:55:22.112816+0000","last_fullsized":"2023-12-24T18:55:22.112816+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102718+0000","last_change":"2023-12-24T18:55:22.098867+0000","last_active":"2023-12-24T18:55:22.102718+0000","last_peered":"2023-12-24T18:55:22.102718+0000","last_clean":"2023-12-24T18:55:22.102718+0000","last_became_active":"2023-12-24T18:55:22.098508+0000","last_became_peered":"2023-12-24T18:55:22.098508+0000","last_unstale":"2023-12-24T18:55:22.102718+0000","last_undegraded":"2023-12-24T18:55:22.102718+0000","last_fullsized":"2023-12-24T18:55:22.102718+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.095928+0000","last_change":"2023-12-24T18:55:22.090850+0000","last_active":"2023-12-24T18:55:22.095928+0000","last_peered":"2023-12-24T18:55:22.095928+0000","last_clean":"2023-12-24T18:55:22.095928+0000","last_became_active":"2023-12-24T18:55:22.090432+0000","last_became_peered":"2023-12-24T18:55:22.090432+0000","last_unstale":"2023-12-24T18:55:22.095928+0000","last_undegraded":"2023-12-24T18:55:22.095928+0000","last_fullsized":"2023-12-24T18:55:22.095928+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:10.980398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105117+0000","last_change":"2023-12-24T18:55:22.097961+0000","last_active":"2023-12-24T18:55:22.105117+0000","last_peered":"2023-12-24T18:55:22.105117+0000","last_clean":"2023-12-24T18:55:22.105117+0000","last_became_active":"2023-12-24T18:55:22.097659+0000","last_became_peered":"2023-12-24T18:55:22.097659+0000","last_unstale":"2023-12-24T18:55:22.105117+0000","last_undegraded":"2023-12-24T18:55:22.105117+0000","last_fullsized":"2023-12-24T18:55:22.105117+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:22.550396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099312+0000","last_change":"2023-12-24T18:55:22.091869+0000","last_active":"2023-12-24T18:55:22.099312+0000","last_peered":"2023-12-24T18:55:22.099312+0000","last_clean":"2023-12-24T18:55:22.099312+0000","last_became_active":"2023-12-24T18:55:22.091590+0000","last_became_peered":"2023-12-24T18:55:22.091590+0000","last_unstale":"2023-12-24T18:55:22.099312+0000","last_undegraded":"2023-12-24T18:55:22.099312+0000","last_fullsized":"2023-12-24T18:55:22.099312+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086865+0000","last_change":"2023-12-24T18:55:22.081815+0000","last_active":"2023-12-24T18:55:22.086865+0000","last_peered":"2023-12-24T18:55:22.086865+0000","last_clean":"2023-12-24T18:55:22.086865+0000","last_became_active":"2023-12-24T18:55:22.081251+0000","last_became_peered":"2023-12-24T18:55:22.081251+0000","last_unstale":"2023-12-24T18:55:22.086865+0000","last_undegraded":"2023-12-24T18:55:22.086865+0000","last_fullsized":"2023-12-24T18:55:22.086865+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.498552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091900+0000","last_change":"2023-12-24T18:55:22.084008+0000","last_active":"2023-12-24T18:55:22.091900+0000","last_peered":"2023-12-24T18:55:22.091900+0000","last_clean":"2023-12-24T18:55:22.091900+0000","last_became_active":"2023-12-24T18:55:22.083743+0000","last_became_peered":"2023-12-24T18:55:22.083743+0000","last_unstale":"2023-12-24T18:55:22.091900+0000","last_undegraded":"2023-12-24T18:55:22.091900+0000","last_fullsized":"2023-12-24T18:55:22.091900+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:00.554365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102901+0000","last_change":"2023-12-24T18:55:22.093244+0000","last_active":"2023-12-24T18:55:22.102901+0000","last_peered":"2023-12-24T18:55:22.102901+0000","last_clean":"2023-12-24T18:55:22.102901+0000","last_became_active":"2023-12-24T18:55:22.092185+0000","last_became_peered":"2023-12-24T18:55:22.092185+0000","last_unstale":"2023-12-24T18:55:22.102901+0000","last_undegraded":"2023-12-24T18:55:22.102901+0000","last_fullsized":"2023-12-24T18:55:22.102901+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:17.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094478+0000","last_change":"2023-12-24T18:55:22.090536+0000","last_active":"2023-12-24T18:55:22.094478+0000","last_peered":"2023-12-24T18:55:22.094478+0000","last_clean":"2023-12-24T18:55:22.094478+0000","last_became_active":"2023-12-24T18:55:22.090221+0000","last_became_peered":"2023-12-24T18:55:22.090221+0000","last_unstale":"2023-12-24T18:55:22.094478+0000","last_undegraded":"2023-12-24T18:55:22.094478+0000","last_fullsized":"2023-12-24T18:55:22.094478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110632+0000","last_change":"2023-12-24T18:55:22.107207+0000","last_active":"2023-12-24T18:55:22.110632+0000","last_peered":"2023-12-24T18:55:22.110632+0000","last_clean":"2023-12-24T18:55:22.110632+0000","last_became_active":"2023-12-24T18:55:22.106749+0000","last_became_peered":"2023-12-24T18:55:22.106749+0000","last_unstale":"2023-12-24T18:55:22.110632+0000","last_undegraded":"2023-12-24T18:55:22.110632+0000","last_fullsized":"2023-12-24T18:55:22.110632+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:04.443236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107987+0000","last_change":"2023-12-24T18:55:22.106093+0000","last_active":"2023-12-24T18:55:22.107987+0000","last_peered":"2023-12-24T18:55:22.107987+0000","last_clean":"2023-12-24T18:55:22.107987+0000","last_became_active":"2023-12-24T18:55:22.104437+0000","last_became_peered":"2023-12-24T18:55:22.104437+0000","last_unstale":"2023-12-24T18:55:22.107987+0000","last_undegraded":"2023-12-24T18:55:22.107987+0000","last_fullsized":"2023-12-24T18:55:22.107987+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:25.551673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112160+0000","last_change":"2023-12-24T18:55:22.108502+0000","last_active":"2023-12-24T18:55:22.112160+0000","last_peered":"2023-12-24T18:55:22.112160+0000","last_clean":"2023-12-24T18:55:22.112160+0000","last_became_active":"2023-12-24T18:55:22.104525+0000","last_became_peered":"2023-12-24T18:55:22.104525+0000","last_unstale":"2023-12-24T18:55:22.112160+0000","last_undegraded":"2023-12-24T18:55:22.112160+0000","last_fullsized":"2023-12-24T18:55:22.112160+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:37.861628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114252+0000","last_change":"2023-12-24T18:55:22.111595+0000","last_active":"2023-12-24T18:55:22.114252+0000","last_peered":"2023-12-24T18:55:22.114252+0000","last_clean":"2023-12-24T18:55:22.114252+0000","last_became_active":"2023-12-24T18:55:22.111288+0000","last_became_peered":"2023-12-24T18:55:22.111288+0000","last_unstale":"2023-12-24T18:55:22.114252+0000","last_undegraded":"2023-12-24T18:55:22.114252+0000","last_fullsized":"2023-12-24T18:55:22.114252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096049+0000","last_change":"2023-12-24T18:55:22.089964+0000","last_active":"2023-12-24T18:55:22.096049+0000","last_peered":"2023-12-24T18:55:22.096049+0000","last_clean":"2023-12-24T18:55:22.096049+0000","last_became_active":"2023-12-24T18:55:22.089396+0000","last_became_peered":"2023-12-24T18:55:22.089396+0000","last_unstale":"2023-12-24T18:55:22.096049+0000","last_undegraded":"2023-12-24T18:55:22.096049+0000","last_fullsized":"2023-12-24T18:55:22.096049+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:24.956216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112906+0000","last_change":"2023-12-24T18:55:22.109309+0000","last_active":"2023-12-24T18:55:22.112906+0000","last_peered":"2023-12-24T18:55:22.112906+0000","last_clean":"2023-12-24T18:55:22.112906+0000","last_became_active":"2023-12-24T18:55:22.108929+0000","last_became_peered":"2023-12-24T18:55:22.108929+0000","last_unstale":"2023-12-24T18:55:22.112906+0000","last_undegraded":"2023-12-24T18:55:22.112906+0000","last_fullsized":"2023-12-24T18:55:22.112906+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087186+0000","last_change":"2023-12-24T18:55:22.081876+0000","last_active":"2023-12-24T18:55:22.087186+0000","last_peered":"2023-12-24T18:55:22.087186+0000","last_clean":"2023-12-24T18:55:22.087186+0000","last_became_active":"2023-12-24T18:55:22.081133+0000","last_became_peered":"2023-12-24T18:55:22.081133+0000","last_unstale":"2023-12-24T18:55:22.087186+0000","last_undegraded":"2023-12-24T18:55:22.087186+0000","last_fullsized":"2023-12-24T18:55:22.087186+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087176+0000","last_change":"2023-12-24T18:55:22.081279+0000","last_active":"2023-12-24T18:55:22.087176+0000","last_peered":"2023-12-24T18:55:22.087176+0000","last_clean":"2023-12-24T18:55:22.087176+0000","last_became_active":"2023-12-24T18:55:22.080959+0000","last_became_peered":"2023-12-24T18:55:22.080959+0000","last_unstale":"2023-12-24T18:55:22.087176+0000","last_undegraded":"2023-12-24T18:55:22.087176+0000","last_fullsized":"2023-12-24T18:55:22.087176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090180+0000","last_change":"2023-12-24T18:55:22.087221+0000","last_active":"2023-12-24T18:55:22.090180+0000","last_peered":"2023-12-24T18:55:22.090180+0000","last_clean":"2023-12-24T18:55:22.090180+0000","last_became_active":"2023-12-24T18:55:22.086349+0000","last_became_peered":"2023-12-24T18:55:22.086349+0000","last_unstale":"2023-12-24T18:55:22.090180+0000","last_undegraded":"2023-12-24T18:55:22.090180+0000","last_fullsized":"2023-12-24T18:55:22.090180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:21.724651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107969+0000","last_change":"2023-12-24T18:55:22.105591+0000","last_active":"2023-12-24T18:55:22.107969+0000","last_peered":"2023-12-24T18:55:22.107969+0000","last_clean":"2023-12-24T18:55:22.107969+0000","last_became_active":"2023-12-24T18:55:22.104742+0000","last_became_peered":"2023-12-24T18:55:22.104742+0000","last_unstale":"2023-12-24T18:55:22.107969+0000","last_undegraded":"2023-12-24T18:55:22.107969+0000","last_fullsized":"2023-12-24T18:55:22.107969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:12.278808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110795+0000","last_change":"2023-12-24T18:55:22.108278+0000","last_active":"2023-12-24T18:55:22.110795+0000","last_peered":"2023-12-24T18:55:22.110795+0000","last_clean":"2023-12-24T18:55:22.110795+0000","last_became_active":"2023-12-24T18:55:22.107831+0000","last_became_peered":"2023-12-24T18:55:22.107831+0000","last_unstale":"2023-12-24T18:55:22.110795+0000","last_undegraded":"2023-12-24T18:55:22.110795+0000","last_fullsized":"2023-12-24T18:55:22.110795+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:10:42.035310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080470+0000","last_change":"2023-12-24T18:55:22.077989+0000","last_active":"2023-12-24T18:55:22.080470+0000","last_peered":"2023-12-24T18:55:22.080470+0000","last_clean":"2023-12-24T18:55:22.080470+0000","last_became_active":"2023-12-24T18:55:22.077364+0000","last_became_peered":"2023-12-24T18:55:22.077364+0000","last_unstale":"2023-12-24T18:55:22.080470+0000","last_undegraded":"2023-12-24T18:55:22.080470+0000","last_fullsized":"2023-12-24T18:55:22.080470+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:38.019473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.092730+0000","last_change":"2023-12-24T18:55:22.090142+0000","last_active":"2023-12-24T18:55:22.092730+0000","last_peered":"2023-12-24T18:55:22.092730+0000","last_clean":"2023-12-24T18:55:22.092730+0000","last_became_active":"2023-12-24T18:55:22.089768+0000","last_became_peered":"2023-12-24T18:55:22.089768+0000","last_unstale":"2023-12-24T18:55:22.092730+0000","last_undegraded":"2023-12-24T18:55:22.092730+0000","last_fullsized":"2023-12-24T18:55:22.092730+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:52.560469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080590+0000","last_change":"2023-12-24T18:55:22.074056+0000","last_active":"2023-12-24T18:55:22.080590+0000","last_peered":"2023-12-24T18:55:22.080590+0000","last_clean":"2023-12-24T18:55:22.080590+0000","last_became_active":"2023-12-24T18:55:22.073635+0000","last_became_peered":"2023-12-24T18:55:22.073635+0000","last_unstale":"2023-12-24T18:55:22.080590+0000","last_undegraded":"2023-12-24T18:55:22.080590+0000","last_fullsized":"2023-12-24T18:55:22.080590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087285+0000","last_change":"2023-12-24T18:55:22.082068+0000","last_active":"2023-12-24T18:55:22.087285+0000","last_peered":"2023-12-24T18:55:22.087285+0000","last_clean":"2023-12-24T18:55:22.087285+0000","last_became_active":"2023-12-24T18:55:22.081589+0000","last_became_peered":"2023-12-24T18:55:22.081589+0000","last_unstale":"2023-12-24T18:55:22.087285+0000","last_undegraded":"2023-12-24T18:55:22.087285+0000","last_fullsized":"2023-12-24T18:55:22.087285+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.101677+0000","last_change":"2023-12-24T18:55:22.098708+0000","last_active":"2023-12-24T18:55:22.101677+0000","last_peered":"2023-12-24T18:55:22.101677+0000","last_clean":"2023-12-24T18:55:22.101677+0000","last_became_active":"2023-12-24T18:55:22.097844+0000","last_became_peered":"2023-12-24T18:55:22.097844+0000","last_unstale":"2023-12-24T18:55:22.101677+0000","last_undegraded":"2023-12-24T18:55:22.101677+0000","last_fullsized":"2023-12-24T18:55:22.101677+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"137'4","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112266+0000","last_change":"2023-12-24T18:55:21.078556+0000","last_active":"2023-12-24T18:55:22.112266+0000","last_peered":"2023-12-24T18:55:22.112266+0000","last_clean":"2023-12-24T18:55:22.112266+0000","last_became_active":"2023-12-24T18:55:21.078243+0000","last_became_peered":"2023-12-24T18:55:21.078243+0000","last_unstale":"2023-12-24T18:55:22.112266+0000","last_undegraded":"2023-12-24T18:55:22.112266+0000","last_fullsized":"2023-12-24T18:55:22.112266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:31.247726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102861+0000","last_change":"2023-12-24T18:55:22.096073+0000","last_active":"2023-12-24T18:55:22.102861+0000","last_peered":"2023-12-24T18:55:22.102861+0000","last_clean":"2023-12-24T18:55:22.102861+0000","last_became_active":"2023-12-24T18:55:22.095765+0000","last_became_peered":"2023-12-24T18:55:22.095765+0000","last_unstale":"2023-12-24T18:55:22.102861+0000","last_undegraded":"2023-12-24T18:55:22.102861+0000","last_fullsized":"2023-12-24T18:55:22.102861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:14.716443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108913+0000","last_change":"2023-12-24T18:55:21.071673+0000","last_active":"2023-12-24T18:55:22.108913+0000","last_peered":"2023-12-24T18:55:22.108913+0000","last_clean":"2023-12-24T18:55:22.108913+0000","last_became_active":"2023-12-24T18:55:21.071340+0000","last_became_peered":"2023-12-24T18:55:21.071340+0000","last_unstale":"2023-12-24T18:55:22.108913+0000","last_undegraded":"2023-12-24T18:55:22.108913+0000","last_fullsized":"2023-12-24T18:55:22.108913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:03.369622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105355+0000","last_change":"2023-12-24T18:55:22.100535+0000","last_active":"2023-12-24T18:55:22.105355+0000","last_peered":"2023-12-24T18:55:22.105355+0000","last_clean":"2023-12-24T18:55:22.105355+0000","last_became_active":"2023-12-24T18:55:22.100187+0000","last_became_peered":"2023-12-24T18:55:22.100187+0000","last_unstale":"2023-12-24T18:55:22.105355+0000","last_undegraded":"2023-12-24T18:55:22.105355+0000","last_fullsized":"2023-12-24T18:55:22.105355+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114325+0000","last_change":"2023-12-24T18:55:21.085927+0000","last_active":"2023-12-24T18:55:22.114325+0000","last_peered":"2023-12-24T18:55:22.114325+0000","last_clean":"2023-12-24T18:55:22.114325+0000","last_became_active":"2023-12-24T18:55:21.085672+0000","last_became_peered":"2023-12-24T18:55:21.085672+0000","last_unstale":"2023-12-24T18:55:22.114325+0000","last_undegraded":"2023-12-24T18:55:22.114325+0000","last_fullsized":"2023-12-24T18:55:22.114325+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:25.047607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114161+0000","last_change":"2023-12-24T18:55:22.111081+0000","last_active":"2023-12-24T18:55:22.114161+0000","last_peered":"2023-12-24T18:55:22.114161+0000","last_clean":"2023-12-24T18:55:22.114161+0000","last_became_active":"2023-12-24T18:55:22.110268+0000","last_became_peered":"2023-12-24T18:55:22.110268+0000","last_unstale":"2023-12-24T18:55:22.114161+0000","last_undegraded":"2023-12-24T18:55:22.114161+0000","last_fullsized":"2023-12-24T18:55:22.114161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111424+0000","last_change":"2023-12-24T18:55:21.093576+0000","last_active":"2023-12-24T18:55:22.111424+0000","last_peered":"2023-12-24T18:55:22.111424+0000","last_clean":"2023-12-24T18:55:22.111424+0000","last_became_active":"2023-12-24T18:55:21.093271+0000","last_became_peered":"2023-12-24T18:55:21.093271+0000","last_unstale":"2023-12-24T18:55:22.111424+0000","last_undegraded":"2023-12-24T18:55:22.111424+0000","last_fullsized":"2023-12-24T18:55:22.111424+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:27.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091588+0000","last_change":"2023-12-24T18:55:22.088606+0000","last_active":"2023-12-24T18:55:22.091588+0000","last_peered":"2023-12-24T18:55:22.091588+0000","last_clean":"2023-12-24T18:55:22.091588+0000","last_became_active":"2023-12-24T18:55:22.088167+0000","last_became_peered":"2023-12-24T18:55:22.088167+0000","last_unstale":"2023-12-24T18:55:22.091588+0000","last_undegraded":"2023-12-24T18:55:22.091588+0000","last_fullsized":"2023-12-24T18:55:22.091588+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106353+0000","last_change":"2023-12-24T18:55:21.077860+0000","last_active":"2023-12-24T18:55:22.106353+0000","last_peered":"2023-12-24T18:55:22.106353+0000","last_clean":"2023-12-24T18:55:22.106353+0000","last_became_active":"2023-12-24T18:55:21.077560+0000","last_became_peered":"2023-12-24T18:55:21.077560+0000","last_unstale":"2023-12-24T18:55:22.106353+0000","last_undegraded":"2023-12-24T18:55:22.106353+0000","last_fullsized":"2023-12-24T18:55:22.106353+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:19.605707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091923+0000","last_change":"2023-12-24T18:55:22.086080+0000","last_active":"2023-12-24T18:55:22.091923+0000","last_peered":"2023-12-24T18:55:22.091923+0000","last_clean":"2023-12-24T18:55:22.091923+0000","last_became_active":"2023-12-24T18:55:22.085793+0000","last_became_peered":"2023-12-24T18:55:22.085793+0000","last_unstale":"2023-12-24T18:55:22.091923+0000","last_undegraded":"2023-12-24T18:55:22.091923+0000","last_fullsized":"2023-12-24T18:55:22.091923+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110592+0000","last_change":"2023-12-24T18:55:21.096106+0000","last_active":"2023-12-24T18:55:22.110592+0000","last_peered":"2023-12-24T18:55:22.110592+0000","last_clean":"2023-12-24T18:55:22.110592+0000","last_became_active":"2023-12-24T18:55:21.095622+0000","last_became_peered":"2023-12-24T18:55:21.095622+0000","last_unstale":"2023-12-24T18:55:22.110592+0000","last_undegraded":"2023-12-24T18:55:22.110592+0000","last_fullsized":"2023-12-24T18:55:22.110592+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:44.695064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.093641+0000","last_change":"2023-12-24T18:55:22.092058+0000","last_active":"2023-12-24T18:55:22.093641+0000","last_peered":"2023-12-24T18:55:22.093641+0000","last_clean":"2023-12-24T18:55:22.093641+0000","last_became_active":"2023-12-24T18:55:22.091562+0000","last_became_peered":"2023-12-24T18:55:22.091562+0000","last_unstale":"2023-12-24T18:55:22.093641+0000","last_undegraded":"2023-12-24T18:55:22.093641+0000","last_fullsized":"2023-12-24T18:55:22.093641+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:09.744429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.066544+0000","last_change":"2023-12-24T18:55:21.081847+0000","last_active":"2023-12-24T18:55:22.066544+0000","last_peered":"2023-12-24T18:55:22.066544+0000","last_clean":"2023-12-24T18:55:22.066544+0000","last_became_active":"2023-12-24T18:55:21.081568+0000","last_became_peered":"2023-12-24T18:55:21.081568+0000","last_unstale":"2023-12-24T18:55:22.066544+0000","last_undegraded":"2023-12-24T18:55:22.066544+0000","last_fullsized":"2023-12-24T18:55:22.066544+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.104032+0000","last_change":"2023-12-24T18:55:22.099474+0000","last_active":"2023-12-24T18:55:22.104032+0000","last_peered":"2023-12-24T18:55:22.104032+0000","last_clean":"2023-12-24T18:55:22.104032+0000","last_became_active":"2023-12-24T18:55:22.099082+0000","last_became_peered":"2023-12-24T18:55:22.099082+0000","last_unstale":"2023-12-24T18:55:22.104032+0000","last_undegraded":"2023-12-24T18:55:22.104032+0000","last_fullsized":"2023-12-24T18:55:22.104032+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084932+0000","last_change":"2023-12-24T18:55:21.090167+0000","last_active":"2023-12-24T18:55:22.084932+0000","last_peered":"2023-12-24T18:55:22.084932+0000","last_clean":"2023-12-24T18:55:22.084932+0000","last_became_active":"2023-12-24T18:55:21.089757+0000","last_became_peered":"2023-12-24T18:55:21.089757+0000","last_unstale":"2023-12-24T18:55:22.084932+0000","last_undegraded":"2023-12-24T18:55:22.084932+0000","last_fullsized":"2023-12-24T18:55:22.084932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:08.730010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109721+0000","last_change":"2023-12-24T18:55:22.106757+0000","last_active":"2023-12-24T18:55:22.109721+0000","last_peered":"2023-12-24T18:55:22.109721+0000","last_clean":"2023-12-24T18:55:22.109721+0000","last_became_active":"2023-12-24T18:55:22.104989+0000","last_became_peered":"2023-12-24T18:55:22.104989+0000","last_unstale":"2023-12-24T18:55:22.109721+0000","last_undegraded":"2023-12-24T18:55:22.109721+0000","last_fullsized":"2023-12-24T18:55:22.109721+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:18:39.833762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073236+0000","last_change":"2023-12-24T18:55:21.088939+0000","last_active":"2023-12-24T18:55:22.073236+0000","last_peered":"2023-12-24T18:55:22.073236+0000","last_clean":"2023-12-24T18:55:22.073236+0000","last_became_active":"2023-12-24T18:55:21.088650+0000","last_became_peered":"2023-12-24T18:55:21.088650+0000","last_unstale":"2023-12-24T18:55:22.073236+0000","last_undegraded":"2023-12-24T18:55:22.073236+0000","last_fullsized":"2023-12-24T18:55:22.073236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:27.843279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077335+0000","last_change":"2023-12-24T18:55:22.073146+0000","last_active":"2023-12-24T18:55:22.077335+0000","last_peered":"2023-12-24T18:55:22.077335+0000","last_clean":"2023-12-24T18:55:22.077335+0000","last_became_active":"2023-12-24T18:55:22.072836+0000","last_became_peered":"2023-12-24T18:55:22.072836+0000","last_unstale":"2023-12-24T18:55:22.077335+0000","last_undegraded":"2023-12-24T18:55:22.077335+0000","last_fullsized":"2023-12-24T18:55:22.077335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067679+0000","last_change":"2023-12-24T18:55:21.080495+0000","last_active":"2023-12-24T18:55:22.067679+0000","last_peered":"2023-12-24T18:55:22.067679+0000","last_clean":"2023-12-24T18:55:22.067679+0000","last_became_active":"2023-12-24T18:55:21.080225+0000","last_became_peered":"2023-12-24T18:55:21.080225+0000","last_unstale":"2023-12-24T18:55:22.067679+0000","last_undegraded":"2023-12-24T18:55:22.067679+0000","last_fullsized":"2023-12-24T18:55:22.067679+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:58.331073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087164+0000","last_change":"2023-12-24T18:55:22.082161+0000","last_active":"2023-12-24T18:55:22.087164+0000","last_peered":"2023-12-24T18:55:22.087164+0000","last_clean":"2023-12-24T18:55:22.087164+0000","last_became_active":"2023-12-24T18:55:22.081880+0000","last_became_peered":"2023-12-24T18:55:22.081880+0000","last_unstale":"2023-12-24T18:55:22.087164+0000","last_undegraded":"2023-12-24T18:55:22.087164+0000","last_fullsized":"2023-12-24T18:55:22.087164+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:51:30.650282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"137'3","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113033+0000","last_change":"2023-12-24T18:55:21.078641+0000","last_active":"2023-12-24T18:55:22.113033+0000","last_peered":"2023-12-24T18:55:22.113033+0000","last_clean":"2023-12-24T18:55:22.113033+0000","last_became_active":"2023-12-24T18:55:21.078366+0000","last_became_peered":"2023-12-24T18:55:21.078366+0000","last_unstale":"2023-12-24T18:55:22.113033+0000","last_undegraded":"2023-12-24T18:55:22.113033+0000","last_fullsized":"2023-12-24T18:55:22.113033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080845+0000","last_change":"2023-12-24T18:55:22.074643+0000","last_active":"2023-12-24T18:55:22.080845+0000","last_peered":"2023-12-24T18:55:22.080845+0000","last_clean":"2023-12-24T18:55:22.080845+0000","last_became_active":"2023-12-24T18:55:22.074330+0000","last_became_peered":"2023-12-24T18:55:22.074330+0000","last_unstale":"2023-12-24T18:55:22.080845+0000","last_undegraded":"2023-12-24T18:55:22.080845+0000","last_fullsized":"2023-12-24T18:55:22.080845+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"137'6","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.117411+0000","last_change":"2023-12-24T18:55:21.092377+0000","last_active":"2023-12-24T18:55:22.117411+0000","last_peered":"2023-12-24T18:55:22.117411+0000","last_clean":"2023-12-24T18:55:22.117411+0000","last_became_active":"2023-12-24T18:55:21.092084+0000","last_became_peered":"2023-12-24T18:55:21.092084+0000","last_unstale":"2023-12-24T18:55:22.117411+0000","last_undegraded":"2023-12-24T18:55:22.117411+0000","last_fullsized":"2023-12-24T18:55:22.117411+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:17.053903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077597+0000","last_change":"2023-12-24T18:55:22.073910+0000","last_active":"2023-12-24T18:55:22.077597+0000","last_peered":"2023-12-24T18:55:22.077597+0000","last_clean":"2023-12-24T18:55:22.077597+0000","last_became_active":"2023-12-24T18:55:22.073616+0000","last_became_peered":"2023-12-24T18:55:22.073616+0000","last_unstale":"2023-12-24T18:55:22.077597+0000","last_undegraded":"2023-12-24T18:55:22.077597+0000","last_fullsized":"2023-12-24T18:55:22.077597+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:06.863671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114401+0000","last_change":"2023-12-24T18:55:21.089113+0000","last_active":"2023-12-24T18:55:22.114401+0000","last_peered":"2023-12-24T18:55:22.114401+0000","last_clean":"2023-12-24T18:55:22.114401+0000","last_became_active":"2023-12-24T18:55:21.088760+0000","last_became_peered":"2023-12-24T18:55:21.088760+0000","last_unstale":"2023-12-24T18:55:22.114401+0000","last_undegraded":"2023-12-24T18:55:22.114401+0000","last_fullsized":"2023-12-24T18:55:22.114401+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:58.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108628+0000","last_change":"2023-12-24T18:55:22.107529+0000","last_active":"2023-12-24T18:55:22.108628+0000","last_peered":"2023-12-24T18:55:22.108628+0000","last_clean":"2023-12-24T18:55:22.108628+0000","last_became_active":"2023-12-24T18:55:22.107153+0000","last_became_peered":"2023-12-24T18:55:22.107153+0000","last_unstale":"2023-12-24T18:55:22.108628+0000","last_undegraded":"2023-12-24T18:55:22.108628+0000","last_fullsized":"2023-12-24T18:55:22.108628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:14.470699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.068686+0000","last_change":"2023-12-24T18:55:21.093874+0000","last_active":"2023-12-24T18:55:22.068686+0000","last_peered":"2023-12-24T18:55:22.068686+0000","last_clean":"2023-12-24T18:55:22.068686+0000","last_became_active":"2023-12-24T18:55:21.093482+0000","last_became_peered":"2023-12-24T18:55:21.093482+0000","last_unstale":"2023-12-24T18:55:22.068686+0000","last_undegraded":"2023-12-24T18:55:22.068686+0000","last_fullsized":"2023-12-24T18:55:22.068686+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:41.481631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090075+0000","last_change":"2023-12-24T18:55:22.086343+0000","last_active":"2023-12-24T18:55:22.090075+0000","last_peered":"2023-12-24T18:55:22.090075+0000","last_clean":"2023-12-24T18:55:22.090075+0000","last_became_active":"2023-12-24T18:55:22.086016+0000","last_became_peered":"2023-12-24T18:55:22.086016+0000","last_unstale":"2023-12-24T18:55:22.090075+0000","last_undegraded":"2023-12-24T18:55:22.090075+0000","last_fullsized":"2023-12-24T18:55:22.090075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:16:32.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067600+0000","last_change":"2023-12-24T18:55:21.080310+0000","last_active":"2023-12-24T18:55:22.067600+0000","last_peered":"2023-12-24T18:55:22.067600+0000","last_clean":"2023-12-24T18:55:22.067600+0000","last_became_active":"2023-12-24T18:55:21.080025+0000","last_became_peered":"2023-12-24T18:55:21.080025+0000","last_unstale":"2023-12-24T18:55:22.067600+0000","last_undegraded":"2023-12-24T18:55:22.067600+0000","last_fullsized":"2023-12-24T18:55:22.067600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:54.924873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102862+0000","last_change":"2023-12-24T18:55:22.095747+0000","last_active":"2023-12-24T18:55:22.102862+0000","last_peered":"2023-12-24T18:55:22.102862+0000","last_clean":"2023-12-24T18:55:22.102862+0000","last_became_active":"2023-12-24T18:55:22.094908+0000","last_became_peered":"2023-12-24T18:55:22.094908+0000","last_unstale":"2023-12-24T18:55:22.102862+0000","last_undegraded":"2023-12-24T18:55:22.102862+0000","last_fullsized":"2023-12-24T18:55:22.102862+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109827+0000","last_change":"2023-12-24T18:55:21.076718+0000","last_active":"2023-12-24T18:55:22.109827+0000","last_peered":"2023-12-24T18:55:22.109827+0000","last_clean":"2023-12-24T18:55:22.109827+0000","last_became_active":"2023-12-24T18:55:21.075930+0000","last_became_peered":"2023-12-24T18:55:21.075930+0000","last_unstale":"2023-12-24T18:55:22.109827+0000","last_undegraded":"2023-12-24T18:55:22.109827+0000","last_fullsized":"2023-12-24T18:55:22.109827+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:32.534509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.083446+0000","last_change":"2023-12-24T18:55:22.081394+0000","last_active":"2023-12-24T18:55:22.083446+0000","last_peered":"2023-12-24T18:55:22.083446+0000","last_clean":"2023-12-24T18:55:22.083446+0000","last_became_active":"2023-12-24T18:55:22.080887+0000","last_became_peered":"2023-12-24T18:55:22.080887+0000","last_unstale":"2023-12-24T18:55:22.083446+0000","last_undegraded":"2023-12-24T18:55:22.083446+0000","last_fullsized":"2023-12-24T18:55:22.083446+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:04.496969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111798+0000","last_change":"2023-12-24T18:55:21.087219+0000","last_active":"2023-12-24T18:55:22.111798+0000","last_peered":"2023-12-24T18:55:22.111798+0000","last_clean":"2023-12-24T18:55:22.111798+0000","last_became_active":"2023-12-24T18:55:21.083119+0000","last_became_peered":"2023-12-24T18:55:21.083119+0000","last_unstale":"2023-12-24T18:55:22.111798+0000","last_undegraded":"2023-12-24T18:55:22.111798+0000","last_fullsized":"2023-12-24T18:55:22.111798+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:37.748882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106095+0000","last_change":"2023-12-24T18:55:22.102404+0000","last_active":"2023-12-24T18:55:22.106095+0000","last_peered":"2023-12-24T18:55:22.106095+0000","last_clean":"2023-12-24T18:55:22.106095+0000","last_became_active":"2023-12-24T18:55:22.102077+0000","last_became_peered":"2023-12-24T18:55:22.102077+0000","last_unstale":"2023-12-24T18:55:22.106095+0000","last_undegraded":"2023-12-24T18:55:22.106095+0000","last_fullsized":"2023-12-24T18:55:22.106095+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:01.214425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114407+0000","last_change":"2023-12-24T18:55:21.082395+0000","last_active":"2023-12-24T18:55:22.114407+0000","last_peered":"2023-12-24T18:55:22.114407+0000","last_clean":"2023-12-24T18:55:22.114407+0000","last_became_active":"2023-12-24T18:55:21.082059+0000","last_became_peered":"2023-12-24T18:55:21.082059+0000","last_unstale":"2023-12-24T18:55:22.114407+0000","last_undegraded":"2023-12-24T18:55:22.114407+0000","last_fullsized":"2023-12-24T18:55:22.114407+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:00.946201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103131+0000","last_change":"2023-12-24T18:55:22.095134+0000","last_active":"2023-12-24T18:55:22.103131+0000","last_peered":"2023-12-24T18:55:22.103131+0000","last_clean":"2023-12-24T18:55:22.103131+0000","last_became_active":"2023-12-24T18:55:22.093865+0000","last_became_peered":"2023-12-24T18:55:22.093865+0000","last_unstale":"2023-12-24T18:55:22.103131+0000","last_undegraded":"2023-12-24T18:55:22.103131+0000","last_fullsized":"2023-12-24T18:55:22.103131+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089216+0000","last_change":"2023-12-24T18:55:21.090898+0000","last_active":"2023-12-24T18:55:22.089216+0000","last_peered":"2023-12-24T18:55:22.089216+0000","last_clean":"2023-12-24T18:55:22.089216+0000","last_became_active":"2023-12-24T18:55:21.090572+0000","last_became_peered":"2023-12-24T18:55:21.090572+0000","last_unstale":"2023-12-24T18:55:22.089216+0000","last_undegraded":"2023-12-24T18:55:22.089216+0000","last_fullsized":"2023-12-24T18:55:22.089216+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109238+0000","last_change":"2023-12-24T18:55:22.103413+0000","last_active":"2023-12-24T18:55:22.109238+0000","last_peered":"2023-12-24T18:55:22.109238+0000","last_clean":"2023-12-24T18:55:22.109238+0000","last_became_active":"2023-12-24T18:55:22.103088+0000","last_became_peered":"2023-12-24T18:55:22.103088+0000","last_unstale":"2023-12-24T18:55:22.109238+0000","last_undegraded":"2023-12-24T18:55:22.109238+0000","last_fullsized":"2023-12-24T18:55:22.109238+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:49.143382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114661+0000","last_change":"2023-12-24T18:55:21.086800+0000","last_active":"2023-12-24T18:55:22.114661+0000","last_peered":"2023-12-24T18:55:22.114661+0000","last_clean":"2023-12-24T18:55:22.114661+0000","last_became_active":"2023-12-24T18:55:21.086450+0000","last_became_peered":"2023-12-24T18:55:21.086450+0000","last_unstale":"2023-12-24T18:55:22.114661+0000","last_undegraded":"2023-12-24T18:55:22.114661+0000","last_fullsized":"2023-12-24T18:55:22.114661+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:51.546049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.076738+0000","last_change":"2023-12-24T18:55:22.075399+0000","last_active":"2023-12-24T18:55:22.076738+0000","last_peered":"2023-12-24T18:55:22.076738+0000","last_clean":"2023-12-24T18:55:22.076738+0000","last_became_active":"2023-12-24T18:55:22.075027+0000","last_became_peered":"2023-12-24T18:55:22.075027+0000","last_unstale":"2023-12-24T18:55:22.076738+0000","last_undegraded":"2023-12-24T18:55:22.076738+0000","last_fullsized":"2023-12-24T18:55:22.076738+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:42.735862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.082579+0000","last_change":"2023-12-24T18:55:21.079827+0000","last_active":"2023-12-24T18:55:22.082579+0000","last_peered":"2023-12-24T18:55:22.082579+0000","last_clean":"2023-12-24T18:55:22.082579+0000","last_became_active":"2023-12-24T18:55:21.079474+0000","last_became_peered":"2023-12-24T18:55:21.079474+0000","last_unstale":"2023-12-24T18:55:22.082579+0000","last_undegraded":"2023-12-24T18:55:22.082579+0000","last_fullsized":"2023-12-24T18:55:22.082579+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084963+0000","last_change":"2023-12-24T18:55:22.081573+0000","last_active":"2023-12-24T18:55:22.084963+0000","last_peered":"2023-12-24T18:55:22.084963+0000","last_clean":"2023-12-24T18:55:22.084963+0000","last_became_active":"2023-12-24T18:55:22.081244+0000","last_became_peered":"2023-12-24T18:55:22.081244+0000","last_unstale":"2023-12-24T18:55:22.084963+0000","last_undegraded":"2023-12-24T18:55:22.084963+0000","last_fullsized":"2023-12-24T18:55:22.084963+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:05.875441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067527+0000","last_change":"2023-12-24T18:55:21.095311+0000","last_active":"2023-12-24T18:55:22.067527+0000","last_peered":"2023-12-24T18:55:22.067527+0000","last_clean":"2023-12-24T18:55:22.067527+0000","last_became_active":"2023-12-24T18:55:21.094916+0000","last_became_peered":"2023-12-24T18:55:21.094916+0000","last_unstale":"2023-12-24T18:55:22.067527+0000","last_undegraded":"2023-12-24T18:55:22.067527+0000","last_fullsized":"2023-12-24T18:55:22.067527+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:18.728361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.081891+0000","last_change":"2023-12-24T18:55:22.076037+0000","last_active":"2023-12-24T18:55:22.081891+0000","last_peered":"2023-12-24T18:55:22.081891+0000","last_clean":"2023-12-24T18:55:22.081891+0000","last_became_active":"2023-12-24T18:55:22.075733+0000","last_became_peered":"2023-12-24T18:55:22.075733+0000","last_unstale":"2023-12-24T18:55:22.081891+0000","last_undegraded":"2023-12-24T18:55:22.081891+0000","last_fullsized":"2023-12-24T18:55:22.081891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079588+0000","last_change":"2023-12-24T18:55:21.085933+0000","last_active":"2023-12-24T18:55:22.079588+0000","last_peered":"2023-12-24T18:55:22.079588+0000","last_clean":"2023-12-24T18:55:22.079588+0000","last_became_active":"2023-12-24T18:55:21.085671+0000","last_became_peered":"2023-12-24T18:55:21.085671+0000","last_unstale":"2023-12-24T18:55:22.079588+0000","last_undegraded":"2023-12-24T18:55:22.079588+0000","last_fullsized":"2023-12-24T18:55:22.079588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:58:27.345947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105096+0000","last_change":"2023-12-24T18:55:22.096700+0000","last_active":"2023-12-24T18:55:22.105096+0000","last_peered":"2023-12-24T18:55:22.105096+0000","last_clean":"2023-12-24T18:55:22.105096+0000","last_became_active":"2023-12-24T18:55:22.095715+0000","last_became_peered":"2023-12-24T18:55:22.095715+0000","last_unstale":"2023-12-24T18:55:22.105096+0000","last_undegraded":"2023-12-24T18:55:22.105096+0000","last_fullsized":"2023-12-24T18:55:22.105096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:32:20.931474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110182+0000","last_change":"2023-12-24T18:55:21.085062+0000","last_active":"2023-12-24T18:55:22.110182+0000","last_peered":"2023-12-24T18:55:22.110182+0000","last_clean":"2023-12-24T18:55:22.110182+0000","last_became_active":"2023-12-24T18:55:21.081179+0000","last_became_peered":"2023-12-24T18:55:21.081179+0000","last_unstale":"2023-12-24T18:55:22.110182+0000","last_undegraded":"2023-12-24T18:55:22.110182+0000","last_fullsized":"2023-12-24T18:55:22.110182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:04.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096943+0000","last_change":"2023-12-24T18:55:22.093633+0000","last_active":"2023-12-24T18:55:22.096943+0000","last_peered":"2023-12-24T18:55:22.096943+0000","last_clean":"2023-12-24T18:55:22.096943+0000","last_became_active":"2023-12-24T18:55:22.093326+0000","last_became_peered":"2023-12-24T18:55:22.093326+0000","last_unstale":"2023-12-24T18:55:22.096943+0000","last_undegraded":"2023-12-24T18:55:22.096943+0000","last_fullsized":"2023-12-24T18:55:22.096943+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.135298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073095+0000","last_change":"2023-12-24T18:55:21.088707+0000","last_active":"2023-12-24T18:55:22.073095+0000","last_peered":"2023-12-24T18:55:22.073095+0000","last_clean":"2023-12-24T18:55:22.073095+0000","last_became_active":"2023-12-24T18:55:21.088283+0000","last_became_peered":"2023-12-24T18:55:21.088283+0000","last_unstale":"2023-12-24T18:55:22.073095+0000","last_undegraded":"2023-12-24T18:55:22.073095+0000","last_fullsized":"2023-12-24T18:55:22.073095+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:03.351199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114104+0000","last_change":"2023-12-24T18:55:22.110551+0000","last_active":"2023-12-24T18:55:22.114104+0000","last_peered":"2023-12-24T18:55:22.114104+0000","last_clean":"2023-12-24T18:55:22.114104+0000","last_became_active":"2023-12-24T18:55:22.107498+0000","last_became_peered":"2023-12-24T18:55:22.107498+0000","last_unstale":"2023-12-24T18:55:22.114104+0000","last_undegraded":"2023-12-24T18:55:22.114104+0000","last_fullsized":"2023-12-24T18:55:22.114104+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073231+0000","last_change":"2023-12-24T18:55:21.088766+0000","last_active":"2023-12-24T18:55:22.073231+0000","last_peered":"2023-12-24T18:55:22.073231+0000","last_clean":"2023-12-24T18:55:22.073231+0000","last_became_active":"2023-12-24T18:55:21.088307+0000","last_became_peered":"2023-12-24T18:55:21.088307+0000","last_unstale":"2023-12-24T18:55:22.073231+0000","last_undegraded":"2023-12-24T18:55:22.073231+0000","last_fullsized":"2023-12-24T18:55:22.073231+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:44.220353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.085396+0000","last_change":"2023-12-24T18:55:22.082688+0000","last_active":"2023-12-24T18:55:22.085396+0000","last_peered":"2023-12-24T18:55:22.085396+0000","last_clean":"2023-12-24T18:55:22.085396+0000","last_became_active":"2023-12-24T18:55:22.082325+0000","last_became_peered":"2023-12-24T18:55:22.082325+0000","last_unstale":"2023-12-24T18:55:22.085396+0000","last_undegraded":"2023-12-24T18:55:22.085396+0000","last_fullsized":"2023-12-24T18:55:22.085396+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:06.468022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089664+0000","last_change":"2023-12-24T18:55:21.084343+0000","last_active":"2023-12-24T18:55:22.089664+0000","last_peered":"2023-12-24T18:55:22.089664+0000","last_clean":"2023-12-24T18:55:22.089664+0000","last_became_active":"2023-12-24T18:55:21.082198+0000","last_became_peered":"2023-12-24T18:55:21.082198+0000","last_unstale":"2023-12-24T18:55:22.089664+0000","last_undegraded":"2023-12-24T18:55:22.089664+0000","last_fullsized":"2023-12-24T18:55:22.089664+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:55.640665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102924+0000","last_change":"2023-12-24T18:55:22.093372+0000","last_active":"2023-12-24T18:55:22.102924+0000","last_peered":"2023-12-24T18:55:22.102924+0000","last_clean":"2023-12-24T18:55:22.102924+0000","last_became_active":"2023-12-24T18:55:22.093060+0000","last_became_peered":"2023-12-24T18:55:22.093060+0000","last_unstale":"2023-12-24T18:55:22.102924+0000","last_undegraded":"2023-12-24T18:55:22.102924+0000","last_fullsized":"2023-12-24T18:55:22.102924+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:41.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080358+0000","last_change":"2023-12-24T18:55:21.069946+0000","last_active":"2023-12-24T18:55:22.080358+0000","last_peered":"2023-12-24T18:55:22.080358+0000","last_clean":"2023-12-24T18:55:22.080358+0000","last_became_active":"2023-12-24T18:55:21.069437+0000","last_became_peered":"2023-12-24T18:55:21.069437+0000","last_unstale":"2023-12-24T18:55:22.080358+0000","last_undegraded":"2023-12-24T18:55:22.080358+0000","last_fullsized":"2023-12-24T18:55:22.080358+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:12.873055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084365+0000","last_change":"2023-12-24T18:55:22.080923+0000","last_active":"2023-12-24T18:55:22.084365+0000","last_peered":"2023-12-24T18:55:22.084365+0000","last_clean":"2023-12-24T18:55:22.084365+0000","last_became_active":"2023-12-24T18:55:22.077821+0000","last_became_peered":"2023-12-24T18:55:22.077821+0000","last_unstale":"2023-12-24T18:55:22.084365+0000","last_undegraded":"2023-12-24T18:55:22.084365+0000","last_fullsized":"2023-12-24T18:55:22.084365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:43.292012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080960+0000","last_change":"2023-12-24T18:55:21.078650+0000","last_active":"2023-12-24T18:55:22.080960+0000","last_peered":"2023-12-24T18:55:22.080960+0000","last_clean":"2023-12-24T18:55:22.080960+0000","last_became_active":"2023-12-24T18:55:21.077562+0000","last_became_peered":"2023-12-24T18:55:21.077562+0000","last_unstale":"2023-12-24T18:55:22.080960+0000","last_undegraded":"2023-12-24T18:55:22.080960+0000","last_fullsized":"2023-12-24T18:55:22.080960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:13.456279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114040+0000","last_change":"2023-12-24T18:55:22.110134+0000","last_active":"2023-12-24T18:55:22.114040+0000","last_peered":"2023-12-24T18:55:22.114040+0000","last_clean":"2023-12-24T18:55:22.114040+0000","last_became_active":"2023-12-24T18:55:22.109510+0000","last_became_peered":"2023-12-24T18:55:22.109510+0000","last_unstale":"2023-12-24T18:55:22.114040+0000","last_undegraded":"2023-12-24T18:55:22.114040+0000","last_fullsized":"2023-12-24T18:55:22.114040+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084580+0000","last_change":"2023-12-24T18:55:21.089745+0000","last_active":"2023-12-24T18:55:22.084580+0000","last_peered":"2023-12-24T18:55:22.084580+0000","last_clean":"2023-12-24T18:55:22.084580+0000","last_became_active":"2023-12-24T18:55:21.089430+0000","last_became_peered":"2023-12-24T18:55:21.089430+0000","last_unstale":"2023-12-24T18:55:22.084580+0000","last_undegraded":"2023-12-24T18:55:22.084580+0000","last_fullsized":"2023-12-24T18:55:22.084580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:22.484132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099335+0000","last_change":"2023-12-24T18:55:22.095115+0000","last_active":"2023-12-24T18:55:22.099335+0000","last_peered":"2023-12-24T18:55:22.099335+0000","last_clean":"2023-12-24T18:55:22.099335+0000","last_became_active":"2023-12-24T18:55:22.094790+0000","last_became_peered":"2023-12-24T18:55:22.094790+0000","last_unstale":"2023-12-24T18:55:22.099335+0000","last_undegraded":"2023-12-24T18:55:22.099335+0000","last_fullsized":"2023-12-24T18:55:22.099335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:30.865777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079705+0000","last_change":"2023-12-24T18:55:21.080958+0000","last_active":"2023-12-24T18:55:22.079705+0000","last_peered":"2023-12-24T18:55:22.079705+0000","last_clean":"2023-12-24T18:55:22.079705+0000","last_became_active":"2023-12-24T18:55:21.080584+0000","last_became_peered":"2023-12-24T18:55:21.080584+0000","last_unstale":"2023-12-24T18:55:22.079705+0000","last_undegraded":"2023-12-24T18:55:22.079705+0000","last_fullsized":"2023-12-24T18:55:22.079705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:38:38.451864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114170+0000","last_change":"2023-12-24T18:55:22.111324+0000","last_active":"2023-12-24T18:55:22.114170+0000","last_peered":"2023-12-24T18:55:22.114170+0000","last_clean":"2023-12-24T18:55:22.114170+0000","last_became_active":"2023-12-24T18:55:22.110834+0000","last_became_peered":"2023-12-24T18:55:22.110834+0000","last_unstale":"2023-12-24T18:55:22.114170+0000","last_undegraded":"2023-12-24T18:55:22.114170+0000","last_fullsized":"2023-12-24T18:55:22.114170+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"137'8","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.116399+0000","last_change":"2023-12-24T18:55:21.081128+0000","last_active":"2023-12-24T18:55:22.116399+0000","last_peered":"2023-12-24T18:55:22.116399+0000","last_clean":"2023-12-24T18:55:22.116399+0000","last_became_active":"2023-12-24T18:55:21.080859+0000","last_became_peered":"2023-12-24T18:55:21.080859+0000","last_unstale":"2023-12-24T18:55:22.116399+0000","last_undegraded":"2023-12-24T18:55:22.116399+0000","last_fullsized":"2023-12-24T18:55:22.116399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:06.937406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":722,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079898+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:55:22.079898+0000","last_peered":"2023-12-24T18:55:22.079898+0000","last_clean":"2023-12-24T18:55:22.079898+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:55:22.079898+0000","last_undegraded":"2023-12-24T18:55:22.079898+0000","last_fullsized":"2023-12-24T18:55:22.079898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311848,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059992,"statfs":{"total":96636764160,"available":96317431808,"internally_reserved":0,"allocated":2326528,"data_stored":1471486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1279999999999999},"min":{"1min":0.79800000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4790000000000001,"5min":1.6579999999999999,"15min":1.784},"last":1.53},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.657,"5min":1.6910000000000001,"15min":1.756},"last":1.397}]},{"osd":1,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.127,"15min":1.133},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5009999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.8129999999999999},"last":1.6020000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.2050000000000001},"min":{"1min":0.89600000000000002,"5min":0.64800000000000002,"15min":0.59299999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.625},"last":1.331},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.579,"5min":1.595,"15min":1.6799999999999999},"last":1.02}]},{"osd":3,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.264,"15min":1.2769999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.71399999999999997},"max":{"1min":1.5429999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5780000000000001,"5min":1.623,"15min":2.1859999999999999},"last":1.5660000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.165},"min":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.595,"5min":1.7450000000000001,"15min":1.8109999999999999},"last":1.23},{"interface":"front","average":{"1min":1.167,"5min":1.2170000000000001,"15min":1.26},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.661,"5min":1.6719999999999999,"15min":2.1160000000000001},"last":1.7509999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2529999999999999,"15min":1.2709999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.59899999999999998},"max":{"1min":1.575,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3360000000000001,"15min":1.3240000000000001},"min":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.68600000000000005},"max":{"1min":1.837,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.96199999999999997}]},{"osd":6,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4099999999999999,"15min":1.4059999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9019999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.748,"5min":1.917,"15min":1.917},"last":1.1899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2629999999999999,"15min":1.2509999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.47799999999999998},"max":{"1min":1.4670000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.71299999999999997},"max":{"1min":1.4810000000000001,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.468}]},{"osd":1,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.86099999999999999,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.4299999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.238,"15min":1.216},"min":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6000000000000001,"5min":3.081,"15min":3.081},"last":0.96299999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.82399999999999995,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5449999999999999,"5min":2.173,"15min":2.173},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.25,"5min":1.2430000000000001,"15min":1.24},"min":{"1min":0.83099999999999996,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.6819999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.89600000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3380000000000001,"15min":1.282},"min":{"1min":1.0700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5329999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.353},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.286,"15min":1.266},"min":{"1min":0.88800000000000001,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":1.5149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1930000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1990000000000001,"15min":1.1819999999999999},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.53100000000000003},"max":{"1min":1.6299999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.145},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.274,"15min":1.238},"min":{"1min":0.82999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.595,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.242}]},{"osd":5,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.1930000000000001},"min":{"1min":0.95699999999999996,"5min":0.73399999999999999,"15min":0.59399999999999997},"max":{"1min":1.409,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.383,"15min":1.339},"min":{"1min":0.75,"5min":0.75,"15min":0.622},"max":{"1min":1.76,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.2809999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.409,"15min":1.3660000000000001},"min":{"1min":1.038,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":1.9830000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.363},"min":{"1min":1.107,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":1.611,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303068,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068772,"statfs":{"total":96636764160,"available":96326422528,"internally_reserved":0,"allocated":1724416,"data_stored":880530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.155,"15min":1.1890000000000001},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.248},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.2989999999999999},"min":{"1min":0.81000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.839,"15min":1.859},"last":1.224}]},{"osd":1,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.286},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.159,"15min":1.159},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.446}]},{"osd":2,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.202},"min":{"1min":0.875,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.226},"min":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.72199999999999998},"max":{"1min":1.5629999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2030000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.876,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4610000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.276,"15min":1.296},"min":{"1min":0.879,"5min":0.78700000000000003,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.706,"15min":1.786},"last":1.415}]},{"osd":4,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.141},"min":{"1min":0.75600000000000001,"5min":0.65000000000000002,"15min":0.50600000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.123},{"interface":"front","average":{"1min":1.254,"5min":1.278,"15min":1.246},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.57699999999999996},"max":{"1min":1.8460000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.298,"15min":1.2709999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.61699999999999999},"max":{"1min":1.7170000000000001,"5min":1.861,"15min":1.909},"last":1.091},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.85599999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3700000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.383,"15min":1.379},"min":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.9099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.395},{"interface":"front","average":{"1min":1.393,"5min":1.3959999999999999,"15min":1.3999999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.64600000000000002},"max":{"1min":1.796,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.4870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":881906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2030000000000001,"15min":1.198},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.7070000000000001,"5min":1.835,"15min":1.835},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.246},"min":{"1min":0.91600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.242}]},{"osd":1,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.145,"15min":1.145},"min":{"1min":0.86899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4950000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.4450000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.294},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.55,"5min":1.952,"15min":1.952},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.29,"15min":1.2989999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.76,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.387}]},{"osd":3,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.76000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.038},{"interface":"front","average":{"1min":1.121,"5min":1.216,"15min":1.2629999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.675,"5min":1.7669999999999999,"15min":1.839},"last":1.347}]},{"osd":5,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.623},"max":{"1min":2.0019999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.292},{"interface":"front","average":{"1min":1.216,"5min":1.286,"15min":1.296},"min":{"1min":0.753,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89300000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2529999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6779999999999999,"5min":1.823,"15min":1.881},"last":1.274},{"interface":"front","average":{"1min":1.282,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8100000000000001,"5min":1.909,"15min":2.0760000000000001},"last":1.5129999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2769999999999999,"15min":1.2889999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.7250000000000001,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.84099999999999997,"5min":0.747,"15min":0.71399999999999997},"max":{"1min":1.8300000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.474}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307172,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064668,"statfs":{"total":96636764160,"available":96322220032,"internally_reserved":0,"allocated":1732608,"data_stored":881940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94999999999999996,"15min":0.94799999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.266,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.093},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.46000000000000002},"max":{"1min":1.492,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.94499999999999995}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.57099999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.569,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.117,"5min":1.145,"15min":1.1870000000000001},"min":{"1min":0.66600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.081,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8560000000000001,"5min":2.363,"15min":2.363},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6240000000000001,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.258},"min":{"1min":0.83399999999999996,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.609,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.121},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.323,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.319,"5min":2.944,"15min":2.944},"last":1.4370000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.391,"15min":1.3899999999999999},"min":{"1min":1.0629999999999999,"5min":0.86799999999999999,"15min":0.84499999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.427},"min":{"1min":1.042,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.895,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.476}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4399999999999999,"15min":1.4610000000000001},"min":{"1min":1.111,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.841,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.405,"15min":1.411},"min":{"1min":1.04,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8029999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4510000000000001,"15min":1.454},"min":{"1min":1.131,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.883,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"min":{"1min":1.075,"5min":0.755,"15min":0.755},"max":{"1min":2.4430000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.5009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575075,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":880370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64800000000000002,"5min":0.501,"15min":0.34499999999999997},"max":{"1min":1.1910000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.056,"15min":1.0609999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.50900000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5229999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.57599999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5620000000000001,"5min":1.6519999999999999,"15min":1.976},"last":0.77400000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.127,"15min":1.137},"min":{"1min":0.77600000000000002,"5min":0.71099999999999997,"15min":0.441},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0629999999999999,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.48299999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.95499999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.306,"15min":1.3080000000000001},"min":{"1min":1.101,"5min":0.86299999999999999,"15min":0.68899999999999995},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.222},{"interface":"front","average":{"1min":1.302,"5min":1.3169999999999999,"15min":1.29},"min":{"1min":1.0309999999999999,"5min":0.92500000000000004,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":1.798,"15min":1.798},"last":1.099}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.325,"15min":1.2869999999999999},"min":{"1min":1.01,"5min":0.83699999999999997,"15min":0.496},"max":{"1min":1.748,"5min":2.069,"15min":2.069},"last":1.677},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3759999999999999,"15min":1.365},"min":{"1min":1.044,"5min":0.94199999999999995,"15min":0.82999999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.526}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.4019999999999999},"min":{"1min":1.2010000000000001,"5min":1.0209999999999999,"15min":0.72399999999999998},"max":{"1min":1.718,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.167},{"interface":"front","average":{"1min":1.478,"5min":1.429,"15min":1.401},"min":{"1min":1.1419999999999999,"5min":0.95199999999999996,"15min":0.71599999999999997},"max":{"1min":1.841,"5min":1.9319999999999999,"15min":2.093},"last":1.538}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4770000000000001,"15min":1.4570000000000001},"min":{"1min":1.2270000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.651},{"interface":"front","average":{"1min":1.532,"5min":1.4870000000000001,"15min":1.472},"min":{"1min":1.2729999999999999,"5min":0.94999999999999996,"15min":0.84999999999999998},"max":{"1min":1.879,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51000000000000001},"max":{"1min":1.3200000000000001,"5min":1.663,"15min":1.8149999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.095,"15min":1.123},"min":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.829},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"max":{"1min":1.498,"5min":1.498,"15min":1.5349999999999999},"last":1.123},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.115},"min":{"1min":0.63800000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.486,"5min":1.73,"15min":1.7410000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.262,"15min":1.254},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.595,"5min":1.823,"15min":1.915},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.111,"15min":1.093},"min":{"1min":0.753,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6839999999999999,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":1.036}]},{"osd":4,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.92400000000000004,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":1.724},"last":1.008},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.413,"15min":1.405},"min":{"1min":1.089,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9179999999999999,"5min":2.1930000000000001,"15min":2.3130000000000002},"last":1.216}]},{"osd":5,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.385},"min":{"1min":1.0840000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.621,"5min":1.887,"15min":1.9790000000000001},"last":1.401},{"interface":"front","average":{"1min":1.365,"5min":1.3520000000000001,"15min":1.353},"min":{"1min":0.99399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.786,"5min":1.8140000000000001,"15min":2.0089999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.5,"15min":1.49},"min":{"1min":1.21,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0249999999999999,"5min":2.1269999999999998,"15min":2.3860000000000001},"last":1.288},{"interface":"front","average":{"1min":1.526,"5min":1.4550000000000001,"15min":1.4630000000000001},"min":{"1min":1.2230000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":2.1749999999999998},"last":1.101}]},{"osd":7,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.516,"15min":1.5229999999999999},"min":{"1min":1.1739999999999999,"5min":1.0549999999999999,"15min":0.754},"max":{"1min":2.0099999999999998,"5min":2.0219999999999998,"15min":2.3540000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.472,"15min":1.4610000000000001},"min":{"1min":1.133,"5min":0.876,"15min":0.876},"max":{"1min":1.897,"5min":1.919,"15min":2.1160000000000001},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1470760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.206,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.204}]},{"osd":2,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.069,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.629,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.5649999999999999,"15min":1.7},"last":1.258},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0720000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.58099999999999996},"max":{"1min":1.4379999999999999,"5min":1.631,"15min":2.8130000000000002},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.69699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.468},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2250000000000001,"15min":1.234},"min":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6200000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.407}]},{"osd":4,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.335,"15min":1.345},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6359999999999999,"5min":1.8120000000000001,"15min":2.0009999999999999},"last":1.504},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.2789999999999999},"min":{"1min":0.84999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.762},"last":1.3480000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.391,"15min":1.3839999999999999},"min":{"1min":1.1639999999999999,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.798,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.71},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3640000000000001,"15min":1.399},"min":{"1min":1.115,"5min":0.95699999999999996,"15min":0.95499999999999996},"max":{"1min":1.7909999999999999,"5min":1.978,"15min":2.2280000000000002},"last":1.8069999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.97299999999999998,"15min":0.69599999999999995},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":2.0779999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.9350000000000001,"5min":2.0750000000000002,"15min":2.23},"last":1.585}]},{"osd":7,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":1.022,"5min":1.0189999999999999,"15min":1.006},"max":{"1min":1.847,"5min":2.262,"15min":2.8980000000000001},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.419,"15min":1.4330000000000001},"min":{"1min":1.155,"5min":0.94899999999999995,"15min":0.72399999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.3279999999999998},"last":1.766}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:55:27.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T18:55:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 Processor -- start 2023-12-24T18:55:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 -- start start 2023-12-24T18:55:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11b80c8870 0x7f11b80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11b80c7430 0x7f11b806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b815da30 con 0x7f11b80c6fc0 2023-12-24T18:55:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b815ce20 con 0x7f11b80c8870 2023-12-24T18:55:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bfe2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b815d100 con 0x7f11b80c7430 2023-12-24T18:55:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bd3c9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11b80c6fc0 0x7f11b81567c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50974/0 (socket says 172.21.15.50:50974) 2023-12-24T18:55:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bd3c9700 1 -- 172.21.15.50:0/3340735236 learned_addr learned my addr 172.21.15.50:0/3340735236 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11be3cb700 1 --2- 172.21.15.50:0/3340735236 >> v2:172.21.15.82:3300/0 conn(0x7f11b80c7430 0x7f11b806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.508+0000 7f11bdbca700 1 --2- 172.21.15.50:0/3340735236 >> v2:172.21.15.50:3300/0 conn(0x7f11b80c8870 0x7f11b80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bcbc8700 1 -- 172.21.15.50:0/3340735236 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228607901 0 0) 0x7f11b815da30 con 0x7f11b80c6fc0 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bcbc8700 1 -- 172.21.15.50:0/3340735236 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a4003570 con 0x7f11b80c6fc0 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11be3cb700 1 -- 172.21.15.50:0/3340735236 >> v2:172.21.15.50:3300/0 conn(0x7f11b80c8870 msgr2=0x7f11b80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11be3cb700 1 --2- 172.21.15.50:0/3340735236 >> v2:172.21.15.50:3300/0 conn(0x7f11b80c8870 0x7f11b80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11be3cb700 1 -- 172.21.15.50:0/3340735236 >> v1:172.21.15.50:6789/0 conn(0x7f11b80c6fc0 legacy=0x7f11b81567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11be3cb700 1 -- 172.21.15.50:0/3340735236 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b815d3e0 con 0x7f11b80c7430 2023-12-24T18:55:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11be3cb700 1 --2- 172.21.15.50:0/3340735236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c7430 0x7f11b806caa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f11b80c96a0 tx=0x7f11b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10222e17277769d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bcbc8700 1 -- 172.21.15.50:0/3340735236 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000e070 con 0x7f11b80c7430 2023-12-24T18:55:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bcbc8700 1 -- 172.21.15.50:0/3340735236 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000bab0 con 0x7f11b80c7430 2023-12-24T18:55:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bcbc8700 1 -- 172.21.15.50:0/3340735236 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000be70 con 0x7f11b80c7430 2023-12-24T18:55:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 -- 172.21.15.50:0/3340735236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c7430 msgr2=0x7f11b806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/3340735236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c7430 0x7f11b806caa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f11b80c96a0 tx=0x7f11b0009780 comp rx=0 tx=0).stop 2023-12-24T18:55:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 -- 172.21.15.50:0/3340735236 shutdown_connections 2023-12-24T18:55:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/3340735236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c7430 0x7f11b806caa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/3340735236 >> v2:172.21.15.50:3300/0 conn(0x7f11b80c8870 0x7f11b80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 -- 172.21.15.50:0/3340735236 >> 172.21.15.50:0/3340735236 conn(0x7f11b80670b0 msgr2=0x7f11b80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 -- 172.21.15.50:0/3340735236 shutdown_connections 2023-12-24T18:55:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.512+0000 7f11bfe2e700 1 -- 172.21.15.50:0/3340735236 wait complete. 2023-12-24T18:55:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 Processor -- start 2023-12-24T18:55:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 -- start start 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11b80c6fc0 0x7f11b80c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c8870 0x7f11b8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8155f60 con 0x7f11b80c7430 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8153fc0 con 0x7f11b80c8870 2023-12-24T18:55:27.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bfe2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80c0bb0 con 0x7f11b80c6fc0 2023-12-24T18:55:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bd3c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bdbca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11b80c6fc0 0x7f11b80c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bd3c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53728/0 (socket says 172.21.15.50:53728) 2023-12-24T18:55:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11bd3c9700 1 -- 172.21.15.50:0/2360652324 learned_addr learned my addr 172.21.15.50:0/2360652324 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.516+0000 7f11be3cb700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c8870 0x7f11b8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 -- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11b80c6fc0 msgr2=0x7f11b80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11b80c6fc0 0x7f11b80c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 -- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c8870 msgr2=0x7f11b8155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c8870 0x7f11b8155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 -- 172.21.15.50:0/2360652324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009a20 con 0x7f11b80c7430 2023-12-24T18:55:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bd3c9700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f11a800c7c0 tx=0x7f11a8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8005cd0 con 0x7f11b80c7430 2023-12-24T18:55:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a8005e30 con 0x7f11b80c7430 2023-12-24T18:55:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8007320 con 0x7f11b80c7430 2023-12-24T18:55:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b8157460 con 0x7f11b80c7430 2023-12-24T18:55:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8153ce0 con 0x7f11b80c7430 2023-12-24T18:55:27.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.520+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b80c0d20 con 0x7f11b80c7430 2023-12-24T18:55:27.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.524+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f11a801b3b0 con 0x7f11b80c7430 2023-12-24T18:55:27.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.524+0000 7f11adffb700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 0x7f119c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.524+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f11a807c180 con 0x7f11b80c7430 2023-12-24T18:55:27.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.524+0000 7f11bdbca700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 0x7f119c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.528+0000 7f11bdbca700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 0x7f119c062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f11b81570b0 tx=0x7f11b40091a0 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.532+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f11a804c400 con 0x7f11b80c7430 2023-12-24T18:55:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.772+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f11b8071060 con 0x7f11b80c7430 2023-12-24T18:55:27.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.772+0000 7f11adffb700 1 -- 172.21.15.50:0/2360652324 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1017 (secure 0 0 0) 0x7f11a804fa20 con 0x7f11b80c7430 2023-12-24T18:55:27.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:27.771 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1164,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":138,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2521669632,"bytes_avail":770572443648,"bytes_total":773094113280,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8277}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-12-24T18:53:54.965521+0000","services":{}},"progress_events":{}} 2023-12-24T18:55:27.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.772+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 msgr2=0x7f119c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 0x7f119c062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f11b81570b0 tx=0x7f11b40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 msgr2=0x7f11b81554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f11a800c7c0 tx=0x7f11a8007e00 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 shutdown_connections 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f119c060580 0x7f119c062a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b80c8870 0x7f11b8155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11b80c7430 0x7f11b81554e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 --2- 172.21.15.50:0/2360652324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11b80c6fc0 0x7f11b80c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 >> 172.21.15.50:0/2360652324 conn(0x7f11b80670b0 msgr2=0x7f11b806abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 shutdown_connections 2023-12-24T18:55:27.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.776+0000 7f11bfe2e700 1 -- 172.21.15.50:0/2360652324 wait complete. 2023-12-24T18:55:27.794 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T18:55:27.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:55:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.960+0000 7f08c30ae700 1 Processor -- start 2023-12-24T18:55:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.960+0000 7f08c30ae700 1 -- start start 2023-12-24T18:55:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c30ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08bc153460 0x7f08bc0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c30ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08bc0c8c60 0x7f08bc068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c30ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc069880 con 0x7f08bc069460 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c30ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc159970 con 0x7f08bc153460 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c30ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc159c30 con 0x7f08bc0c8c60 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c0e4a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08bc153460 0x7f08bc0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c164b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08bc069460 0x7f08bc0c72f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50978/0 (socket says 172.21.15.50:50978) 2023-12-24T18:55:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c164b700 1 -- 172.21.15.50:0/1748142144 learned_addr learned my addr 172.21.15.50:0/1748142144 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08b3fff700 1 --2- 172.21.15.50:0/1748142144 >> v2:172.21.15.82:3300/0 conn(0x7f08bc0c8c60 0x7f08bc068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08b37fe700 1 -- 172.21.15.50:0/1748142144 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525363537 0 0) 0x7f08bc069880 con 0x7f08bc069460 2023-12-24T18:55:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c0e4a700 1 -- 172.21.15.50:0/1748142144 >> v2:172.21.15.82:3300/0 conn(0x7f08bc0c8c60 msgr2=0x7f08bc068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c0e4a700 1 --2- 172.21.15.50:0/1748142144 >> v2:172.21.15.82:3300/0 conn(0x7f08bc0c8c60 0x7f08bc068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c0e4a700 1 -- 172.21.15.50:0/1748142144 >> v1:172.21.15.50:6789/0 conn(0x7f08bc069460 legacy=0x7f08bc0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.964+0000 7f08c0e4a700 1 -- 172.21.15.50:0/1748142144 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc159f10 con 0x7f08bc153460 2023-12-24T18:55:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c0e4a700 1 --2- 172.21.15.50:0/1748142144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc153460 0x7f08bc0ca880 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0c3ce0 tx=0x7f08b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129402df1c4187e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08b37fe700 1 -- 172.21.15.50:0/1748142144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800e070 con 0x7f08bc153460 2023-12-24T18:55:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08b37fe700 1 -- 172.21.15.50:0/1748142144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b800bb60 con 0x7f08bc153460 2023-12-24T18:55:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08b37fe700 1 -- 172.21.15.50:0/1748142144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8012430 con 0x7f08bc153460 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 -- 172.21.15.50:0/1748142144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc153460 msgr2=0x7f08bc0ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 --2- 172.21.15.50:0/1748142144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc153460 0x7f08bc0ca880 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0c3ce0 tx=0x7f08b8009780 comp rx=0 tx=0).stop 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 -- 172.21.15.50:0/1748142144 shutdown_connections 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 --2- 172.21.15.50:0/1748142144 >> v2:172.21.15.82:3300/0 conn(0x7f08bc0c8c60 0x7f08bc068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 --2- 172.21.15.50:0/1748142144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc153460 0x7f08bc0ca880 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 -- 172.21.15.50:0/1748142144 >> 172.21.15.50:0/1748142144 conn(0x7f08bc0cccb0 msgr2=0x7f08bc0cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 -- 172.21.15.50:0/1748142144 shutdown_connections 2023-12-24T18:55:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 -- 172.21.15.50:0/1748142144 wait complete. 2023-12-24T18:55:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.968+0000 7f08c30ae700 1 Processor -- start 2023-12-24T18:55:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- start start 2023-12-24T18:55:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc069460 0x7f08bc0c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc153460 0x7f08bc0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b10b0 con 0x7f08bc0c8c60 2023-12-24T18:55:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc141f00 con 0x7f08bc069460 2023-12-24T18:55:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b04a0 con 0x7f08bc153460 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53750/0 (socket says 172.21.15.50:53750) 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 -- 172.21.15.50:0/3110899635 learned_addr learned my addr 172.21.15.50:0/3110899635 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c164b700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc153460 0x7f08bc0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c0e4a700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc069460 0x7f08bc0c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 -- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc153460 msgr2=0x7f08bc0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc153460 0x7f08bc0b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 -- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc069460 msgr2=0x7f08bc0c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc069460 0x7f08bc0c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 -- 172.21.15.50:0/3110899635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009a20 con 0x7f08bc0c8c60 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b3fff700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ec80 tx=0x7f08ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00c850 con 0x7f08bc0c8c60 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00c9b0 con 0x7f08bc0c8c60 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00cd50 con 0x7f08bc0c8c60 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0b0780 con 0x7f08bc0c8c60 2023-12-24T18:55:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.972+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0b0d40 con 0x7f08bc0c8c60 2023-12-24T18:55:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.976+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc0b1260 con 0x7f08bc0c8c60 2023-12-24T18:55:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.976+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f08ac013680 con 0x7f08bc0c8c60 2023-12-24T18:55:27.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.980+0000 7f08b0ff9700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 0x7f08a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:27.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.980+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f08ac07cc90 con 0x7f08bc0c8c60 2023-12-24T18:55:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.980+0000 7f08c0e4a700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 0x7f08a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:27.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.980+0000 7f08c0e4a700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 0x7f08a8062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08b8003440 tx=0x7f08b8019000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:27.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:27.984+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f08bc0b1260 con 0x7f08bc0c8c60 2023-12-24T18:55:28.033 INFO:tasks.ceph.mds.d.smithi082.stderr:2023-12-24T18:55:28.029+0000 7fa8487d3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T18:55:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.152+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08bc0652e0 con 0x7f08a8060550 2023-12-24T18:55:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.168+0000 7f08b0ff9700 1 -- 172.21.15.50:0/3110899635 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286623 (secure 0 0 0) 0x7f08bc0652e0 con 0x7f08a8060550 2023-12-24T18:55:28.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 msgr2=0x7f08a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 0x7f08a8062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08b8003440 tx=0x7f08b8019000 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 msgr2=0x7f08bc0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ec80 tx=0x7f08ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 shutdown_connections 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f08a8060550 0x7f08a8062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc153460 0x7f08bc0b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08bc0c8c60 0x7f08bc0afa50 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 --2- 172.21.15.50:0/3110899635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc069460 0x7f08bc0c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.176+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 >> 172.21.15.50:0/3110899635 conn(0x7f08bc0cccb0 msgr2=0x7f08bc1590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.180+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 shutdown_connections 2023-12-24T18:55:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:28.180+0000 7f08c30ae700 1 -- 172.21.15.50:0/3110899635 wait complete. 2023-12-24T18:55:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:55:28.199 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T18:55:26.932208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2462568,"kb_used_data":14632,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752512152,"statfs":{"total":773094113280,"available":770572443648,"internally_reserved":0,"allocated":14983168,"data_stored":8228308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001914"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091134+0000","last_change":"2023-12-24T18:55:22.083017+0000","last_active":"2023-12-24T18:55:22.091134+0000","last_peered":"2023-12-24T18:55:22.091134+0000","last_clean":"2023-12-24T18:55:22.091134+0000","last_became_active":"2023-12-24T18:55:22.082692+0000","last_became_peered":"2023-12-24T18:55:22.082692+0000","last_unstale":"2023-12-24T18:55:22.091134+0000","last_undegraded":"2023-12-24T18:55:22.091134+0000","last_fullsized":"2023-12-24T18:55:22.091134+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114053+0000","last_change":"2023-12-24T18:55:22.112246+0000","last_active":"2023-12-24T18:55:22.114053+0000","last_peered":"2023-12-24T18:55:22.114053+0000","last_clean":"2023-12-24T18:55:22.114053+0000","last_became_active":"2023-12-24T18:55:22.111949+0000","last_became_peered":"2023-12-24T18:55:22.111949+0000","last_unstale":"2023-12-24T18:55:22.114053+0000","last_undegraded":"2023-12-24T18:55:22.114053+0000","last_fullsized":"2023-12-24T18:55:22.114053+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:31.071346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086980+0000","last_change":"2023-12-24T18:55:22.082723+0000","last_active":"2023-12-24T18:55:22.086980+0000","last_peered":"2023-12-24T18:55:22.086980+0000","last_clean":"2023-12-24T18:55:22.086980+0000","last_became_active":"2023-12-24T18:55:22.081679+0000","last_became_peered":"2023-12-24T18:55:22.081679+0000","last_unstale":"2023-12-24T18:55:22.086980+0000","last_undegraded":"2023-12-24T18:55:22.086980+0000","last_fullsized":"2023-12-24T18:55:22.086980+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:49.889577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112852+0000","last_change":"2023-12-24T18:55:22.109421+0000","last_active":"2023-12-24T18:55:22.112852+0000","last_peered":"2023-12-24T18:55:22.112852+0000","last_clean":"2023-12-24T18:55:22.112852+0000","last_became_active":"2023-12-24T18:55:22.107483+0000","last_became_peered":"2023-12-24T18:55:22.107483+0000","last_unstale":"2023-12-24T18:55:22.112852+0000","last_undegraded":"2023-12-24T18:55:22.112852+0000","last_fullsized":"2023-12-24T18:55:22.112852+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099342+0000","last_change":"2023-12-24T18:55:22.092712+0000","last_active":"2023-12-24T18:55:22.099342+0000","last_peered":"2023-12-24T18:55:22.099342+0000","last_clean":"2023-12-24T18:55:22.099342+0000","last_became_active":"2023-12-24T18:55:22.092251+0000","last_became_peered":"2023-12-24T18:55:22.092251+0000","last_unstale":"2023-12-24T18:55:22.099342+0000","last_undegraded":"2023-12-24T18:55:22.099342+0000","last_fullsized":"2023-12-24T18:55:22.099342+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103428+0000","last_change":"2023-12-24T18:55:22.095881+0000","last_active":"2023-12-24T18:55:22.103428+0000","last_peered":"2023-12-24T18:55:22.103428+0000","last_clean":"2023-12-24T18:55:22.103428+0000","last_became_active":"2023-12-24T18:55:22.095575+0000","last_became_peered":"2023-12-24T18:55:22.095575+0000","last_unstale":"2023-12-24T18:55:22.103428+0000","last_undegraded":"2023-12-24T18:55:22.103428+0000","last_fullsized":"2023-12-24T18:55:22.103428+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:58.633265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113823+0000","last_change":"2023-12-24T18:55:22.112865+0000","last_active":"2023-12-24T18:55:22.113823+0000","last_peered":"2023-12-24T18:55:22.113823+0000","last_clean":"2023-12-24T18:55:22.113823+0000","last_became_active":"2023-12-24T18:55:22.112359+0000","last_became_peered":"2023-12-24T18:55:22.112359+0000","last_unstale":"2023-12-24T18:55:22.113823+0000","last_undegraded":"2023-12-24T18:55:22.113823+0000","last_fullsized":"2023-12-24T18:55:22.113823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:52.465621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094622+0000","last_change":"2023-12-24T18:55:22.093499+0000","last_active":"2023-12-24T18:55:22.094622+0000","last_peered":"2023-12-24T18:55:22.094622+0000","last_clean":"2023-12-24T18:55:22.094622+0000","last_became_active":"2023-12-24T18:55:22.093219+0000","last_became_peered":"2023-12-24T18:55:22.093219+0000","last_unstale":"2023-12-24T18:55:22.094622+0000","last_undegraded":"2023-12-24T18:55:22.094622+0000","last_fullsized":"2023-12-24T18:55:22.094622+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:12.445913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112816+0000","last_change":"2023-12-24T18:55:22.108390+0000","last_active":"2023-12-24T18:55:22.112816+0000","last_peered":"2023-12-24T18:55:22.112816+0000","last_clean":"2023-12-24T18:55:22.112816+0000","last_became_active":"2023-12-24T18:55:22.108113+0000","last_became_peered":"2023-12-24T18:55:22.108113+0000","last_unstale":"2023-12-24T18:55:22.112816+0000","last_undegraded":"2023-12-24T18:55:22.112816+0000","last_fullsized":"2023-12-24T18:55:22.112816+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102718+0000","last_change":"2023-12-24T18:55:22.098867+0000","last_active":"2023-12-24T18:55:22.102718+0000","last_peered":"2023-12-24T18:55:22.102718+0000","last_clean":"2023-12-24T18:55:22.102718+0000","last_became_active":"2023-12-24T18:55:22.098508+0000","last_became_peered":"2023-12-24T18:55:22.098508+0000","last_unstale":"2023-12-24T18:55:22.102718+0000","last_undegraded":"2023-12-24T18:55:22.102718+0000","last_fullsized":"2023-12-24T18:55:22.102718+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.095928+0000","last_change":"2023-12-24T18:55:22.090850+0000","last_active":"2023-12-24T18:55:22.095928+0000","last_peered":"2023-12-24T18:55:22.095928+0000","last_clean":"2023-12-24T18:55:22.095928+0000","last_became_active":"2023-12-24T18:55:22.090432+0000","last_became_peered":"2023-12-24T18:55:22.090432+0000","last_unstale":"2023-12-24T18:55:22.095928+0000","last_undegraded":"2023-12-24T18:55:22.095928+0000","last_fullsized":"2023-12-24T18:55:22.095928+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:10.980398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105117+0000","last_change":"2023-12-24T18:55:22.097961+0000","last_active":"2023-12-24T18:55:22.105117+0000","last_peered":"2023-12-24T18:55:22.105117+0000","last_clean":"2023-12-24T18:55:22.105117+0000","last_became_active":"2023-12-24T18:55:22.097659+0000","last_became_peered":"2023-12-24T18:55:22.097659+0000","last_unstale":"2023-12-24T18:55:22.105117+0000","last_undegraded":"2023-12-24T18:55:22.105117+0000","last_fullsized":"2023-12-24T18:55:22.105117+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:22.550396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099312+0000","last_change":"2023-12-24T18:55:22.091869+0000","last_active":"2023-12-24T18:55:22.099312+0000","last_peered":"2023-12-24T18:55:22.099312+0000","last_clean":"2023-12-24T18:55:22.099312+0000","last_became_active":"2023-12-24T18:55:22.091590+0000","last_became_peered":"2023-12-24T18:55:22.091590+0000","last_unstale":"2023-12-24T18:55:22.099312+0000","last_undegraded":"2023-12-24T18:55:22.099312+0000","last_fullsized":"2023-12-24T18:55:22.099312+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086865+0000","last_change":"2023-12-24T18:55:22.081815+0000","last_active":"2023-12-24T18:55:22.086865+0000","last_peered":"2023-12-24T18:55:22.086865+0000","last_clean":"2023-12-24T18:55:22.086865+0000","last_became_active":"2023-12-24T18:55:22.081251+0000","last_became_peered":"2023-12-24T18:55:22.081251+0000","last_unstale":"2023-12-24T18:55:22.086865+0000","last_undegraded":"2023-12-24T18:55:22.086865+0000","last_fullsized":"2023-12-24T18:55:22.086865+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.498552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091900+0000","last_change":"2023-12-24T18:55:22.084008+0000","last_active":"2023-12-24T18:55:22.091900+0000","last_peered":"2023-12-24T18:55:22.091900+0000","last_clean":"2023-12-24T18:55:22.091900+0000","last_became_active":"2023-12-24T18:55:22.083743+0000","last_became_peered":"2023-12-24T18:55:22.083743+0000","last_unstale":"2023-12-24T18:55:22.091900+0000","last_undegraded":"2023-12-24T18:55:22.091900+0000","last_fullsized":"2023-12-24T18:55:22.091900+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:00.554365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102901+0000","last_change":"2023-12-24T18:55:22.093244+0000","last_active":"2023-12-24T18:55:22.102901+0000","last_peered":"2023-12-24T18:55:22.102901+0000","last_clean":"2023-12-24T18:55:22.102901+0000","last_became_active":"2023-12-24T18:55:22.092185+0000","last_became_peered":"2023-12-24T18:55:22.092185+0000","last_unstale":"2023-12-24T18:55:22.102901+0000","last_undegraded":"2023-12-24T18:55:22.102901+0000","last_fullsized":"2023-12-24T18:55:22.102901+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:17.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094478+0000","last_change":"2023-12-24T18:55:22.090536+0000","last_active":"2023-12-24T18:55:22.094478+0000","last_peered":"2023-12-24T18:55:22.094478+0000","last_clean":"2023-12-24T18:55:22.094478+0000","last_became_active":"2023-12-24T18:55:22.090221+0000","last_became_peered":"2023-12-24T18:55:22.090221+0000","last_unstale":"2023-12-24T18:55:22.094478+0000","last_undegraded":"2023-12-24T18:55:22.094478+0000","last_fullsized":"2023-12-24T18:55:22.094478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110632+0000","last_change":"2023-12-24T18:55:22.107207+0000","last_active":"2023-12-24T18:55:22.110632+0000","last_peered":"2023-12-24T18:55:22.110632+0000","last_clean":"2023-12-24T18:55:22.110632+0000","last_became_active":"2023-12-24T18:55:22.106749+0000","last_became_peered":"2023-12-24T18:55:22.106749+0000","last_unstale":"2023-12-24T18:55:22.110632+0000","last_undegraded":"2023-12-24T18:55:22.110632+0000","last_fullsized":"2023-12-24T18:55:22.110632+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:04.443236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107987+0000","last_change":"2023-12-24T18:55:22.106093+0000","last_active":"2023-12-24T18:55:22.107987+0000","last_peered":"2023-12-24T18:55:22.107987+0000","last_clean":"2023-12-24T18:55:22.107987+0000","last_became_active":"2023-12-24T18:55:22.104437+0000","last_became_peered":"2023-12-24T18:55:22.104437+0000","last_unstale":"2023-12-24T18:55:22.107987+0000","last_undegraded":"2023-12-24T18:55:22.107987+0000","last_fullsized":"2023-12-24T18:55:22.107987+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:25.551673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112160+0000","last_change":"2023-12-24T18:55:22.108502+0000","last_active":"2023-12-24T18:55:22.112160+0000","last_peered":"2023-12-24T18:55:22.112160+0000","last_clean":"2023-12-24T18:55:22.112160+0000","last_became_active":"2023-12-24T18:55:22.104525+0000","last_became_peered":"2023-12-24T18:55:22.104525+0000","last_unstale":"2023-12-24T18:55:22.112160+0000","last_undegraded":"2023-12-24T18:55:22.112160+0000","last_fullsized":"2023-12-24T18:55:22.112160+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:37.861628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114252+0000","last_change":"2023-12-24T18:55:22.111595+0000","last_active":"2023-12-24T18:55:22.114252+0000","last_peered":"2023-12-24T18:55:22.114252+0000","last_clean":"2023-12-24T18:55:22.114252+0000","last_became_active":"2023-12-24T18:55:22.111288+0000","last_became_peered":"2023-12-24T18:55:22.111288+0000","last_unstale":"2023-12-24T18:55:22.114252+0000","last_undegraded":"2023-12-24T18:55:22.114252+0000","last_fullsized":"2023-12-24T18:55:22.114252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096049+0000","last_change":"2023-12-24T18:55:22.089964+0000","last_active":"2023-12-24T18:55:22.096049+0000","last_peered":"2023-12-24T18:55:22.096049+0000","last_clean":"2023-12-24T18:55:22.096049+0000","last_became_active":"2023-12-24T18:55:22.089396+0000","last_became_peered":"2023-12-24T18:55:22.089396+0000","last_unstale":"2023-12-24T18:55:22.096049+0000","last_undegraded":"2023-12-24T18:55:22.096049+0000","last_fullsized":"2023-12-24T18:55:22.096049+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:24.956216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112906+0000","last_change":"2023-12-24T18:55:22.109309+0000","last_active":"2023-12-24T18:55:22.112906+0000","last_peered":"2023-12-24T18:55:22.112906+0000","last_clean":"2023-12-24T18:55:22.112906+0000","last_became_active":"2023-12-24T18:55:22.108929+0000","last_became_peered":"2023-12-24T18:55:22.108929+0000","last_unstale":"2023-12-24T18:55:22.112906+0000","last_undegraded":"2023-12-24T18:55:22.112906+0000","last_fullsized":"2023-12-24T18:55:22.112906+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087186+0000","last_change":"2023-12-24T18:55:22.081876+0000","last_active":"2023-12-24T18:55:22.087186+0000","last_peered":"2023-12-24T18:55:22.087186+0000","last_clean":"2023-12-24T18:55:22.087186+0000","last_became_active":"2023-12-24T18:55:22.081133+0000","last_became_peered":"2023-12-24T18:55:22.081133+0000","last_unstale":"2023-12-24T18:55:22.087186+0000","last_undegraded":"2023-12-24T18:55:22.087186+0000","last_fullsized":"2023-12-24T18:55:22.087186+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087176+0000","last_change":"2023-12-24T18:55:22.081279+0000","last_active":"2023-12-24T18:55:22.087176+0000","last_peered":"2023-12-24T18:55:22.087176+0000","last_clean":"2023-12-24T18:55:22.087176+0000","last_became_active":"2023-12-24T18:55:22.080959+0000","last_became_peered":"2023-12-24T18:55:22.080959+0000","last_unstale":"2023-12-24T18:55:22.087176+0000","last_undegraded":"2023-12-24T18:55:22.087176+0000","last_fullsized":"2023-12-24T18:55:22.087176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090180+0000","last_change":"2023-12-24T18:55:22.087221+0000","last_active":"2023-12-24T18:55:22.090180+0000","last_peered":"2023-12-24T18:55:22.090180+0000","last_clean":"2023-12-24T18:55:22.090180+0000","last_became_active":"2023-12-24T18:55:22.086349+0000","last_became_peered":"2023-12-24T18:55:22.086349+0000","last_unstale":"2023-12-24T18:55:22.090180+0000","last_undegraded":"2023-12-24T18:55:22.090180+0000","last_fullsized":"2023-12-24T18:55:22.090180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:21.724651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107969+0000","last_change":"2023-12-24T18:55:22.105591+0000","last_active":"2023-12-24T18:55:22.107969+0000","last_peered":"2023-12-24T18:55:22.107969+0000","last_clean":"2023-12-24T18:55:22.107969+0000","last_became_active":"2023-12-24T18:55:22.104742+0000","last_became_peered":"2023-12-24T18:55:22.104742+0000","last_unstale":"2023-12-24T18:55:22.107969+0000","last_undegraded":"2023-12-24T18:55:22.107969+0000","last_fullsized":"2023-12-24T18:55:22.107969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:12.278808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110795+0000","last_change":"2023-12-24T18:55:22.108278+0000","last_active":"2023-12-24T18:55:22.110795+0000","last_peered":"2023-12-24T18:55:22.110795+0000","last_clean":"2023-12-24T18:55:22.110795+0000","last_became_active":"2023-12-24T18:55:22.107831+0000","last_became_peered":"2023-12-24T18:55:22.107831+0000","last_unstale":"2023-12-24T18:55:22.110795+0000","last_undegraded":"2023-12-24T18:55:22.110795+0000","last_fullsized":"2023-12-24T18:55:22.110795+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:10:42.035310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080470+0000","last_change":"2023-12-24T18:55:22.077989+0000","last_active":"2023-12-24T18:55:22.080470+0000","last_peered":"2023-12-24T18:55:22.080470+0000","last_clean":"2023-12-24T18:55:22.080470+0000","last_became_active":"2023-12-24T18:55:22.077364+0000","last_became_peered":"2023-12-24T18:55:22.077364+0000","last_unstale":"2023-12-24T18:55:22.080470+0000","last_undegraded":"2023-12-24T18:55:22.080470+0000","last_fullsized":"2023-12-24T18:55:22.080470+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:38.019473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.092730+0000","last_change":"2023-12-24T18:55:22.090142+0000","last_active":"2023-12-24T18:55:22.092730+0000","last_peered":"2023-12-24T18:55:22.092730+0000","last_clean":"2023-12-24T18:55:22.092730+0000","last_became_active":"2023-12-24T18:55:22.089768+0000","last_became_peered":"2023-12-24T18:55:22.089768+0000","last_unstale":"2023-12-24T18:55:22.092730+0000","last_undegraded":"2023-12-24T18:55:22.092730+0000","last_fullsized":"2023-12-24T18:55:22.092730+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:52.560469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080590+0000","last_change":"2023-12-24T18:55:22.074056+0000","last_active":"2023-12-24T18:55:22.080590+0000","last_peered":"2023-12-24T18:55:22.080590+0000","last_clean":"2023-12-24T18:55:22.080590+0000","last_became_active":"2023-12-24T18:55:22.073635+0000","last_became_peered":"2023-12-24T18:55:22.073635+0000","last_unstale":"2023-12-24T18:55:22.080590+0000","last_undegraded":"2023-12-24T18:55:22.080590+0000","last_fullsized":"2023-12-24T18:55:22.080590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087285+0000","last_change":"2023-12-24T18:55:22.082068+0000","last_active":"2023-12-24T18:55:22.087285+0000","last_peered":"2023-12-24T18:55:22.087285+0000","last_clean":"2023-12-24T18:55:22.087285+0000","last_became_active":"2023-12-24T18:55:22.081589+0000","last_became_peered":"2023-12-24T18:55:22.081589+0000","last_unstale":"2023-12-24T18:55:22.087285+0000","last_undegraded":"2023-12-24T18:55:22.087285+0000","last_fullsized":"2023-12-24T18:55:22.087285+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.101677+0000","last_change":"2023-12-24T18:55:22.098708+0000","last_active":"2023-12-24T18:55:22.101677+0000","last_peered":"2023-12-24T18:55:22.101677+0000","last_clean":"2023-12-24T18:55:22.101677+0000","last_became_active":"2023-12-24T18:55:22.097844+0000","last_became_peered":"2023-12-24T18:55:22.097844+0000","last_unstale":"2023-12-24T18:55:22.101677+0000","last_undegraded":"2023-12-24T18:55:22.101677+0000","last_fullsized":"2023-12-24T18:55:22.101677+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"137'4","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112266+0000","last_change":"2023-12-24T18:55:21.078556+0000","last_active":"2023-12-24T18:55:22.112266+0000","last_peered":"2023-12-24T18:55:22.112266+0000","last_clean":"2023-12-24T18:55:22.112266+0000","last_became_active":"2023-12-24T18:55:21.078243+0000","last_became_peered":"2023-12-24T18:55:21.078243+0000","last_unstale":"2023-12-24T18:55:22.112266+0000","last_undegraded":"2023-12-24T18:55:22.112266+0000","last_fullsized":"2023-12-24T18:55:22.112266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:31.247726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102861+0000","last_change":"2023-12-24T18:55:22.096073+0000","last_active":"2023-12-24T18:55:22.102861+0000","last_peered":"2023-12-24T18:55:22.102861+0000","last_clean":"2023-12-24T18:55:22.102861+0000","last_became_active":"2023-12-24T18:55:22.095765+0000","last_became_peered":"2023-12-24T18:55:22.095765+0000","last_unstale":"2023-12-24T18:55:22.102861+0000","last_undegraded":"2023-12-24T18:55:22.102861+0000","last_fullsized":"2023-12-24T18:55:22.102861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:14.716443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108913+0000","last_change":"2023-12-24T18:55:21.071673+0000","last_active":"2023-12-24T18:55:22.108913+0000","last_peered":"2023-12-24T18:55:22.108913+0000","last_clean":"2023-12-24T18:55:22.108913+0000","last_became_active":"2023-12-24T18:55:21.071340+0000","last_became_peered":"2023-12-24T18:55:21.071340+0000","last_unstale":"2023-12-24T18:55:22.108913+0000","last_undegraded":"2023-12-24T18:55:22.108913+0000","last_fullsized":"2023-12-24T18:55:22.108913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:03.369622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105355+0000","last_change":"2023-12-24T18:55:22.100535+0000","last_active":"2023-12-24T18:55:22.105355+0000","last_peered":"2023-12-24T18:55:22.105355+0000","last_clean":"2023-12-24T18:55:22.105355+0000","last_became_active":"2023-12-24T18:55:22.100187+0000","last_became_peered":"2023-12-24T18:55:22.100187+0000","last_unstale":"2023-12-24T18:55:22.105355+0000","last_undegraded":"2023-12-24T18:55:22.105355+0000","last_fullsized":"2023-12-24T18:55:22.105355+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114325+0000","last_change":"2023-12-24T18:55:21.085927+0000","last_active":"2023-12-24T18:55:22.114325+0000","last_peered":"2023-12-24T18:55:22.114325+0000","last_clean":"2023-12-24T18:55:22.114325+0000","last_became_active":"2023-12-24T18:55:21.085672+0000","last_became_peered":"2023-12-24T18:55:21.085672+0000","last_unstale":"2023-12-24T18:55:22.114325+0000","last_undegraded":"2023-12-24T18:55:22.114325+0000","last_fullsized":"2023-12-24T18:55:22.114325+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:25.047607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114161+0000","last_change":"2023-12-24T18:55:22.111081+0000","last_active":"2023-12-24T18:55:22.114161+0000","last_peered":"2023-12-24T18:55:22.114161+0000","last_clean":"2023-12-24T18:55:22.114161+0000","last_became_active":"2023-12-24T18:55:22.110268+0000","last_became_peered":"2023-12-24T18:55:22.110268+0000","last_unstale":"2023-12-24T18:55:22.114161+0000","last_undegraded":"2023-12-24T18:55:22.114161+0000","last_fullsized":"2023-12-24T18:55:22.114161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111424+0000","last_change":"2023-12-24T18:55:21.093576+0000","last_active":"2023-12-24T18:55:22.111424+0000","last_peered":"2023-12-24T18:55:22.111424+0000","last_clean":"2023-12-24T18:55:22.111424+0000","last_became_active":"2023-12-24T18:55:21.093271+0000","last_became_peered":"2023-12-24T18:55:21.093271+0000","last_unstale":"2023-12-24T18:55:22.111424+0000","last_undegraded":"2023-12-24T18:55:22.111424+0000","last_fullsized":"2023-12-24T18:55:22.111424+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:27.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091588+0000","last_change":"2023-12-24T18:55:22.088606+0000","last_active":"2023-12-24T18:55:22.091588+0000","last_peered":"2023-12-24T18:55:22.091588+0000","last_clean":"2023-12-24T18:55:22.091588+0000","last_became_active":"2023-12-24T18:55:22.088167+0000","last_became_peered":"2023-12-24T18:55:22.088167+0000","last_unstale":"2023-12-24T18:55:22.091588+0000","last_undegraded":"2023-12-24T18:55:22.091588+0000","last_fullsized":"2023-12-24T18:55:22.091588+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106353+0000","last_change":"2023-12-24T18:55:21.077860+0000","last_active":"2023-12-24T18:55:22.106353+0000","last_peered":"2023-12-24T18:55:22.106353+0000","last_clean":"2023-12-24T18:55:22.106353+0000","last_became_active":"2023-12-24T18:55:21.077560+0000","last_became_peered":"2023-12-24T18:55:21.077560+0000","last_unstale":"2023-12-24T18:55:22.106353+0000","last_undegraded":"2023-12-24T18:55:22.106353+0000","last_fullsized":"2023-12-24T18:55:22.106353+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:19.605707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091923+0000","last_change":"2023-12-24T18:55:22.086080+0000","last_active":"2023-12-24T18:55:22.091923+0000","last_peered":"2023-12-24T18:55:22.091923+0000","last_clean":"2023-12-24T18:55:22.091923+0000","last_became_active":"2023-12-24T18:55:22.085793+0000","last_became_peered":"2023-12-24T18:55:22.085793+0000","last_unstale":"2023-12-24T18:55:22.091923+0000","last_undegraded":"2023-12-24T18:55:22.091923+0000","last_fullsized":"2023-12-24T18:55:22.091923+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110592+0000","last_change":"2023-12-24T18:55:21.096106+0000","last_active":"2023-12-24T18:55:22.110592+0000","last_peered":"2023-12-24T18:55:22.110592+0000","last_clean":"2023-12-24T18:55:22.110592+0000","last_became_active":"2023-12-24T18:55:21.095622+0000","last_became_peered":"2023-12-24T18:55:21.095622+0000","last_unstale":"2023-12-24T18:55:22.110592+0000","last_undegraded":"2023-12-24T18:55:22.110592+0000","last_fullsized":"2023-12-24T18:55:22.110592+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:44.695064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.093641+0000","last_change":"2023-12-24T18:55:22.092058+0000","last_active":"2023-12-24T18:55:22.093641+0000","last_peered":"2023-12-24T18:55:22.093641+0000","last_clean":"2023-12-24T18:55:22.093641+0000","last_became_active":"2023-12-24T18:55:22.091562+0000","last_became_peered":"2023-12-24T18:55:22.091562+0000","last_unstale":"2023-12-24T18:55:22.093641+0000","last_undegraded":"2023-12-24T18:55:22.093641+0000","last_fullsized":"2023-12-24T18:55:22.093641+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:09.744429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.066544+0000","last_change":"2023-12-24T18:55:21.081847+0000","last_active":"2023-12-24T18:55:22.066544+0000","last_peered":"2023-12-24T18:55:22.066544+0000","last_clean":"2023-12-24T18:55:22.066544+0000","last_became_active":"2023-12-24T18:55:21.081568+0000","last_became_peered":"2023-12-24T18:55:21.081568+0000","last_unstale":"2023-12-24T18:55:22.066544+0000","last_undegraded":"2023-12-24T18:55:22.066544+0000","last_fullsized":"2023-12-24T18:55:22.066544+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.104032+0000","last_change":"2023-12-24T18:55:22.099474+0000","last_active":"2023-12-24T18:55:22.104032+0000","last_peered":"2023-12-24T18:55:22.104032+0000","last_clean":"2023-12-24T18:55:22.104032+0000","last_became_active":"2023-12-24T18:55:22.099082+0000","last_became_peered":"2023-12-24T18:55:22.099082+0000","last_unstale":"2023-12-24T18:55:22.104032+0000","last_undegraded":"2023-12-24T18:55:22.104032+0000","last_fullsized":"2023-12-24T18:55:22.104032+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084932+0000","last_change":"2023-12-24T18:55:21.090167+0000","last_active":"2023-12-24T18:55:22.084932+0000","last_peered":"2023-12-24T18:55:22.084932+0000","last_clean":"2023-12-24T18:55:22.084932+0000","last_became_active":"2023-12-24T18:55:21.089757+0000","last_became_peered":"2023-12-24T18:55:21.089757+0000","last_unstale":"2023-12-24T18:55:22.084932+0000","last_undegraded":"2023-12-24T18:55:22.084932+0000","last_fullsized":"2023-12-24T18:55:22.084932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:08.730010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109721+0000","last_change":"2023-12-24T18:55:22.106757+0000","last_active":"2023-12-24T18:55:22.109721+0000","last_peered":"2023-12-24T18:55:22.109721+0000","last_clean":"2023-12-24T18:55:22.109721+0000","last_became_active":"2023-12-24T18:55:22.104989+0000","last_became_peered":"2023-12-24T18:55:22.104989+0000","last_unstale":"2023-12-24T18:55:22.109721+0000","last_undegraded":"2023-12-24T18:55:22.109721+0000","last_fullsized":"2023-12-24T18:55:22.109721+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:18:39.833762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073236+0000","last_change":"2023-12-24T18:55:21.088939+0000","last_active":"2023-12-24T18:55:22.073236+0000","last_peered":"2023-12-24T18:55:22.073236+0000","last_clean":"2023-12-24T18:55:22.073236+0000","last_became_active":"2023-12-24T18:55:21.088650+0000","last_became_peered":"2023-12-24T18:55:21.088650+0000","last_unstale":"2023-12-24T18:55:22.073236+0000","last_undegraded":"2023-12-24T18:55:22.073236+0000","last_fullsized":"2023-12-24T18:55:22.073236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:27.843279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077335+0000","last_change":"2023-12-24T18:55:22.073146+0000","last_active":"2023-12-24T18:55:22.077335+0000","last_peered":"2023-12-24T18:55:22.077335+0000","last_clean":"2023-12-24T18:55:22.077335+0000","last_became_active":"2023-12-24T18:55:22.072836+0000","last_became_peered":"2023-12-24T18:55:22.072836+0000","last_unstale":"2023-12-24T18:55:22.077335+0000","last_undegraded":"2023-12-24T18:55:22.077335+0000","last_fullsized":"2023-12-24T18:55:22.077335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067679+0000","last_change":"2023-12-24T18:55:21.080495+0000","last_active":"2023-12-24T18:55:22.067679+0000","last_peered":"2023-12-24T18:55:22.067679+0000","last_clean":"2023-12-24T18:55:22.067679+0000","last_became_active":"2023-12-24T18:55:21.080225+0000","last_became_peered":"2023-12-24T18:55:21.080225+0000","last_unstale":"2023-12-24T18:55:22.067679+0000","last_undegraded":"2023-12-24T18:55:22.067679+0000","last_fullsized":"2023-12-24T18:55:22.067679+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:58.331073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087164+0000","last_change":"2023-12-24T18:55:22.082161+0000","last_active":"2023-12-24T18:55:22.087164+0000","last_peered":"2023-12-24T18:55:22.087164+0000","last_clean":"2023-12-24T18:55:22.087164+0000","last_became_active":"2023-12-24T18:55:22.081880+0000","last_became_peered":"2023-12-24T18:55:22.081880+0000","last_unstale":"2023-12-24T18:55:22.087164+0000","last_undegraded":"2023-12-24T18:55:22.087164+0000","last_fullsized":"2023-12-24T18:55:22.087164+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:51:30.650282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"137'3","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113033+0000","last_change":"2023-12-24T18:55:21.078641+0000","last_active":"2023-12-24T18:55:22.113033+0000","last_peered":"2023-12-24T18:55:22.113033+0000","last_clean":"2023-12-24T18:55:22.113033+0000","last_became_active":"2023-12-24T18:55:21.078366+0000","last_became_peered":"2023-12-24T18:55:21.078366+0000","last_unstale":"2023-12-24T18:55:22.113033+0000","last_undegraded":"2023-12-24T18:55:22.113033+0000","last_fullsized":"2023-12-24T18:55:22.113033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080845+0000","last_change":"2023-12-24T18:55:22.074643+0000","last_active":"2023-12-24T18:55:22.080845+0000","last_peered":"2023-12-24T18:55:22.080845+0000","last_clean":"2023-12-24T18:55:22.080845+0000","last_became_active":"2023-12-24T18:55:22.074330+0000","last_became_peered":"2023-12-24T18:55:22.074330+0000","last_unstale":"2023-12-24T18:55:22.080845+0000","last_undegraded":"2023-12-24T18:55:22.080845+0000","last_fullsized":"2023-12-24T18:55:22.080845+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"137'6","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.117411+0000","last_change":"2023-12-24T18:55:21.092377+0000","last_active":"2023-12-24T18:55:22.117411+0000","last_peered":"2023-12-24T18:55:22.117411+0000","last_clean":"2023-12-24T18:55:22.117411+0000","last_became_active":"2023-12-24T18:55:21.092084+0000","last_became_peered":"2023-12-24T18:55:21.092084+0000","last_unstale":"2023-12-24T18:55:22.117411+0000","last_undegraded":"2023-12-24T18:55:22.117411+0000","last_fullsized":"2023-12-24T18:55:22.117411+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:17.053903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077597+0000","last_change":"2023-12-24T18:55:22.073910+0000","last_active":"2023-12-24T18:55:22.077597+0000","last_peered":"2023-12-24T18:55:22.077597+0000","last_clean":"2023-12-24T18:55:22.077597+0000","last_became_active":"2023-12-24T18:55:22.073616+0000","last_became_peered":"2023-12-24T18:55:22.073616+0000","last_unstale":"2023-12-24T18:55:22.077597+0000","last_undegraded":"2023-12-24T18:55:22.077597+0000","last_fullsized":"2023-12-24T18:55:22.077597+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:06.863671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114401+0000","last_change":"2023-12-24T18:55:21.089113+0000","last_active":"2023-12-24T18:55:22.114401+0000","last_peered":"2023-12-24T18:55:22.114401+0000","last_clean":"2023-12-24T18:55:22.114401+0000","last_became_active":"2023-12-24T18:55:21.088760+0000","last_became_peered":"2023-12-24T18:55:21.088760+0000","last_unstale":"2023-12-24T18:55:22.114401+0000","last_undegraded":"2023-12-24T18:55:22.114401+0000","last_fullsized":"2023-12-24T18:55:22.114401+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:58.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108628+0000","last_change":"2023-12-24T18:55:22.107529+0000","last_active":"2023-12-24T18:55:22.108628+0000","last_peered":"2023-12-24T18:55:22.108628+0000","last_clean":"2023-12-24T18:55:22.108628+0000","last_became_active":"2023-12-24T18:55:22.107153+0000","last_became_peered":"2023-12-24T18:55:22.107153+0000","last_unstale":"2023-12-24T18:55:22.108628+0000","last_undegraded":"2023-12-24T18:55:22.108628+0000","last_fullsized":"2023-12-24T18:55:22.108628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:14.470699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.068686+0000","last_change":"2023-12-24T18:55:21.093874+0000","last_active":"2023-12-24T18:55:22.068686+0000","last_peered":"2023-12-24T18:55:22.068686+0000","last_clean":"2023-12-24T18:55:22.068686+0000","last_became_active":"2023-12-24T18:55:21.093482+0000","last_became_peered":"2023-12-24T18:55:21.093482+0000","last_unstale":"2023-12-24T18:55:22.068686+0000","last_undegraded":"2023-12-24T18:55:22.068686+0000","last_fullsized":"2023-12-24T18:55:22.068686+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:41.481631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090075+0000","last_change":"2023-12-24T18:55:22.086343+0000","last_active":"2023-12-24T18:55:22.090075+0000","last_peered":"2023-12-24T18:55:22.090075+0000","last_clean":"2023-12-24T18:55:22.090075+0000","last_became_active":"2023-12-24T18:55:22.086016+0000","last_became_peered":"2023-12-24T18:55:22.086016+0000","last_unstale":"2023-12-24T18:55:22.090075+0000","last_undegraded":"2023-12-24T18:55:22.090075+0000","last_fullsized":"2023-12-24T18:55:22.090075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:16:32.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067600+0000","last_change":"2023-12-24T18:55:21.080310+0000","last_active":"2023-12-24T18:55:22.067600+0000","last_peered":"2023-12-24T18:55:22.067600+0000","last_clean":"2023-12-24T18:55:22.067600+0000","last_became_active":"2023-12-24T18:55:21.080025+0000","last_became_peered":"2023-12-24T18:55:21.080025+0000","last_unstale":"2023-12-24T18:55:22.067600+0000","last_undegraded":"2023-12-24T18:55:22.067600+0000","last_fullsized":"2023-12-24T18:55:22.067600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:54.924873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102862+0000","last_change":"2023-12-24T18:55:22.095747+0000","last_active":"2023-12-24T18:55:22.102862+0000","last_peered":"2023-12-24T18:55:22.102862+0000","last_clean":"2023-12-24T18:55:22.102862+0000","last_became_active":"2023-12-24T18:55:22.094908+0000","last_became_peered":"2023-12-24T18:55:22.094908+0000","last_unstale":"2023-12-24T18:55:22.102862+0000","last_undegraded":"2023-12-24T18:55:22.102862+0000","last_fullsized":"2023-12-24T18:55:22.102862+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109827+0000","last_change":"2023-12-24T18:55:21.076718+0000","last_active":"2023-12-24T18:55:22.109827+0000","last_peered":"2023-12-24T18:55:22.109827+0000","last_clean":"2023-12-24T18:55:22.109827+0000","last_became_active":"2023-12-24T18:55:21.075930+0000","last_became_peered":"2023-12-24T18:55:21.075930+0000","last_unstale":"2023-12-24T18:55:22.109827+0000","last_undegraded":"2023-12-24T18:55:22.109827+0000","last_fullsized":"2023-12-24T18:55:22.109827+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:32.534509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.083446+0000","last_change":"2023-12-24T18:55:22.081394+0000","last_active":"2023-12-24T18:55:22.083446+0000","last_peered":"2023-12-24T18:55:22.083446+0000","last_clean":"2023-12-24T18:55:22.083446+0000","last_became_active":"2023-12-24T18:55:22.080887+0000","last_became_peered":"2023-12-24T18:55:22.080887+0000","last_unstale":"2023-12-24T18:55:22.083446+0000","last_undegraded":"2023-12-24T18:55:22.083446+0000","last_fullsized":"2023-12-24T18:55:22.083446+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:04.496969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111798+0000","last_change":"2023-12-24T18:55:21.087219+0000","last_active":"2023-12-24T18:55:22.111798+0000","last_peered":"2023-12-24T18:55:22.111798+0000","last_clean":"2023-12-24T18:55:22.111798+0000","last_became_active":"2023-12-24T18:55:21.083119+0000","last_became_peered":"2023-12-24T18:55:21.083119+0000","last_unstale":"2023-12-24T18:55:22.111798+0000","last_undegraded":"2023-12-24T18:55:22.111798+0000","last_fullsized":"2023-12-24T18:55:22.111798+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:37.748882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106095+0000","last_change":"2023-12-24T18:55:22.102404+0000","last_active":"2023-12-24T18:55:22.106095+0000","last_peered":"2023-12-24T18:55:22.106095+0000","last_clean":"2023-12-24T18:55:22.106095+0000","last_became_active":"2023-12-24T18:55:22.102077+0000","last_became_peered":"2023-12-24T18:55:22.102077+0000","last_unstale":"2023-12-24T18:55:22.106095+0000","last_undegraded":"2023-12-24T18:55:22.106095+0000","last_fullsized":"2023-12-24T18:55:22.106095+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:01.214425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114407+0000","last_change":"2023-12-24T18:55:21.082395+0000","last_active":"2023-12-24T18:55:22.114407+0000","last_peered":"2023-12-24T18:55:22.114407+0000","last_clean":"2023-12-24T18:55:22.114407+0000","last_became_active":"2023-12-24T18:55:21.082059+0000","last_became_peered":"2023-12-24T18:55:21.082059+0000","last_unstale":"2023-12-24T18:55:22.114407+0000","last_undegraded":"2023-12-24T18:55:22.114407+0000","last_fullsized":"2023-12-24T18:55:22.114407+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:00.946201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103131+0000","last_change":"2023-12-24T18:55:22.095134+0000","last_active":"2023-12-24T18:55:22.103131+0000","last_peered":"2023-12-24T18:55:22.103131+0000","last_clean":"2023-12-24T18:55:22.103131+0000","last_became_active":"2023-12-24T18:55:22.093865+0000","last_became_peered":"2023-12-24T18:55:22.093865+0000","last_unstale":"2023-12-24T18:55:22.103131+0000","last_undegraded":"2023-12-24T18:55:22.103131+0000","last_fullsized":"2023-12-24T18:55:22.103131+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089216+0000","last_change":"2023-12-24T18:55:21.090898+0000","last_active":"2023-12-24T18:55:22.089216+0000","last_peered":"2023-12-24T18:55:22.089216+0000","last_clean":"2023-12-24T18:55:22.089216+0000","last_became_active":"2023-12-24T18:55:21.090572+0000","last_became_peered":"2023-12-24T18:55:21.090572+0000","last_unstale":"2023-12-24T18:55:22.089216+0000","last_undegraded":"2023-12-24T18:55:22.089216+0000","last_fullsized":"2023-12-24T18:55:22.089216+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109238+0000","last_change":"2023-12-24T18:55:22.103413+0000","last_active":"2023-12-24T18:55:22.109238+0000","last_peered":"2023-12-24T18:55:22.109238+0000","last_clean":"2023-12-24T18:55:22.109238+0000","last_became_active":"2023-12-24T18:55:22.103088+0000","last_became_peered":"2023-12-24T18:55:22.103088+0000","last_unstale":"2023-12-24T18:55:22.109238+0000","last_undegraded":"2023-12-24T18:55:22.109238+0000","last_fullsized":"2023-12-24T18:55:22.109238+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:49.143382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114661+0000","last_change":"2023-12-24T18:55:21.086800+0000","last_active":"2023-12-24T18:55:22.114661+0000","last_peered":"2023-12-24T18:55:22.114661+0000","last_clean":"2023-12-24T18:55:22.114661+0000","last_became_active":"2023-12-24T18:55:21.086450+0000","last_became_peered":"2023-12-24T18:55:21.086450+0000","last_unstale":"2023-12-24T18:55:22.114661+0000","last_undegraded":"2023-12-24T18:55:22.114661+0000","last_fullsized":"2023-12-24T18:55:22.114661+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:51.546049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.076738+0000","last_change":"2023-12-24T18:55:22.075399+0000","last_active":"2023-12-24T18:55:22.076738+0000","last_peered":"2023-12-24T18:55:22.076738+0000","last_clean":"2023-12-24T18:55:22.076738+0000","last_became_active":"2023-12-24T18:55:22.075027+0000","last_became_peered":"2023-12-24T18:55:22.075027+0000","last_unstale":"2023-12-24T18:55:22.076738+0000","last_undegraded":"2023-12-24T18:55:22.076738+0000","last_fullsized":"2023-12-24T18:55:22.076738+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:42.735862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.082579+0000","last_change":"2023-12-24T18:55:21.079827+0000","last_active":"2023-12-24T18:55:22.082579+0000","last_peered":"2023-12-24T18:55:22.082579+0000","last_clean":"2023-12-24T18:55:22.082579+0000","last_became_active":"2023-12-24T18:55:21.079474+0000","last_became_peered":"2023-12-24T18:55:21.079474+0000","last_unstale":"2023-12-24T18:55:22.082579+0000","last_undegraded":"2023-12-24T18:55:22.082579+0000","last_fullsized":"2023-12-24T18:55:22.082579+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084963+0000","last_change":"2023-12-24T18:55:22.081573+0000","last_active":"2023-12-24T18:55:22.084963+0000","last_peered":"2023-12-24T18:55:22.084963+0000","last_clean":"2023-12-24T18:55:22.084963+0000","last_became_active":"2023-12-24T18:55:22.081244+0000","last_became_peered":"2023-12-24T18:55:22.081244+0000","last_unstale":"2023-12-24T18:55:22.084963+0000","last_undegraded":"2023-12-24T18:55:22.084963+0000","last_fullsized":"2023-12-24T18:55:22.084963+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:05.875441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067527+0000","last_change":"2023-12-24T18:55:21.095311+0000","last_active":"2023-12-24T18:55:22.067527+0000","last_peered":"2023-12-24T18:55:22.067527+0000","last_clean":"2023-12-24T18:55:22.067527+0000","last_became_active":"2023-12-24T18:55:21.094916+0000","last_became_peered":"2023-12-24T18:55:21.094916+0000","last_unstale":"2023-12-24T18:55:22.067527+0000","last_undegraded":"2023-12-24T18:55:22.067527+0000","last_fullsized":"2023-12-24T18:55:22.067527+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:18.728361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.081891+0000","last_change":"2023-12-24T18:55:22.076037+0000","last_active":"2023-12-24T18:55:22.081891+0000","last_peered":"2023-12-24T18:55:22.081891+0000","last_clean":"2023-12-24T18:55:22.081891+0000","last_became_active":"2023-12-24T18:55:22.075733+0000","last_became_peered":"2023-12-24T18:55:22.075733+0000","last_unstale":"2023-12-24T18:55:22.081891+0000","last_undegraded":"2023-12-24T18:55:22.081891+0000","last_fullsized":"2023-12-24T18:55:22.081891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079588+0000","last_change":"2023-12-24T18:55:21.085933+0000","last_active":"2023-12-24T18:55:22.079588+0000","last_peered":"2023-12-24T18:55:22.079588+0000","last_clean":"2023-12-24T18:55:22.079588+0000","last_became_active":"2023-12-24T18:55:21.085671+0000","last_became_peered":"2023-12-24T18:55:21.085671+0000","last_unstale":"2023-12-24T18:55:22.079588+0000","last_undegraded":"2023-12-24T18:55:22.079588+0000","last_fullsized":"2023-12-24T18:55:22.079588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:58:27.345947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105096+0000","last_change":"2023-12-24T18:55:22.096700+0000","last_active":"2023-12-24T18:55:22.105096+0000","last_peered":"2023-12-24T18:55:22.105096+0000","last_clean":"2023-12-24T18:55:22.105096+0000","last_became_active":"2023-12-24T18:55:22.095715+0000","last_became_peered":"2023-12-24T18:55:22.095715+0000","last_unstale":"2023-12-24T18:55:22.105096+0000","last_undegraded":"2023-12-24T18:55:22.105096+0000","last_fullsized":"2023-12-24T18:55:22.105096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:32:20.931474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110182+0000","last_change":"2023-12-24T18:55:21.085062+0000","last_active":"2023-12-24T18:55:22.110182+0000","last_peered":"2023-12-24T18:55:22.110182+0000","last_clean":"2023-12-24T18:55:22.110182+0000","last_became_active":"2023-12-24T18:55:21.081179+0000","last_became_peered":"2023-12-24T18:55:21.081179+0000","last_unstale":"2023-12-24T18:55:22.110182+0000","last_undegraded":"2023-12-24T18:55:22.110182+0000","last_fullsized":"2023-12-24T18:55:22.110182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:04.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096943+0000","last_change":"2023-12-24T18:55:22.093633+0000","last_active":"2023-12-24T18:55:22.096943+0000","last_peered":"2023-12-24T18:55:22.096943+0000","last_clean":"2023-12-24T18:55:22.096943+0000","last_became_active":"2023-12-24T18:55:22.093326+0000","last_became_peered":"2023-12-24T18:55:22.093326+0000","last_unstale":"2023-12-24T18:55:22.096943+0000","last_undegraded":"2023-12-24T18:55:22.096943+0000","last_fullsized":"2023-12-24T18:55:22.096943+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.135298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073095+0000","last_change":"2023-12-24T18:55:21.088707+0000","last_active":"2023-12-24T18:55:22.073095+0000","last_peered":"2023-12-24T18:55:22.073095+0000","last_clean":"2023-12-24T18:55:22.073095+0000","last_became_active":"2023-12-24T18:55:21.088283+0000","last_became_peered":"2023-12-24T18:55:21.088283+0000","last_unstale":"2023-12-24T18:55:22.073095+0000","last_undegraded":"2023-12-24T18:55:22.073095+0000","last_fullsized":"2023-12-24T18:55:22.073095+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:03.351199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114104+0000","last_change":"2023-12-24T18:55:22.110551+0000","last_active":"2023-12-24T18:55:22.114104+0000","last_peered":"2023-12-24T18:55:22.114104+0000","last_clean":"2023-12-24T18:55:22.114104+0000","last_became_active":"2023-12-24T18:55:22.107498+0000","last_became_peered":"2023-12-24T18:55:22.107498+0000","last_unstale":"2023-12-24T18:55:22.114104+0000","last_undegraded":"2023-12-24T18:55:22.114104+0000","last_fullsized":"2023-12-24T18:55:22.114104+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073231+0000","last_change":"2023-12-24T18:55:21.088766+0000","last_active":"2023-12-24T18:55:22.073231+0000","last_peered":"2023-12-24T18:55:22.073231+0000","last_clean":"2023-12-24T18:55:22.073231+0000","last_became_active":"2023-12-24T18:55:21.088307+0000","last_became_peered":"2023-12-24T18:55:21.088307+0000","last_unstale":"2023-12-24T18:55:22.073231+0000","last_undegraded":"2023-12-24T18:55:22.073231+0000","last_fullsized":"2023-12-24T18:55:22.073231+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:44.220353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.085396+0000","last_change":"2023-12-24T18:55:22.082688+0000","last_active":"2023-12-24T18:55:22.085396+0000","last_peered":"2023-12-24T18:55:22.085396+0000","last_clean":"2023-12-24T18:55:22.085396+0000","last_became_active":"2023-12-24T18:55:22.082325+0000","last_became_peered":"2023-12-24T18:55:22.082325+0000","last_unstale":"2023-12-24T18:55:22.085396+0000","last_undegraded":"2023-12-24T18:55:22.085396+0000","last_fullsized":"2023-12-24T18:55:22.085396+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:06.468022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089664+0000","last_change":"2023-12-24T18:55:21.084343+0000","last_active":"2023-12-24T18:55:22.089664+0000","last_peered":"2023-12-24T18:55:22.089664+0000","last_clean":"2023-12-24T18:55:22.089664+0000","last_became_active":"2023-12-24T18:55:21.082198+0000","last_became_peered":"2023-12-24T18:55:21.082198+0000","last_unstale":"2023-12-24T18:55:22.089664+0000","last_undegraded":"2023-12-24T18:55:22.089664+0000","last_fullsized":"2023-12-24T18:55:22.089664+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:55.640665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102924+0000","last_change":"2023-12-24T18:55:22.093372+0000","last_active":"2023-12-24T18:55:22.102924+0000","last_peered":"2023-12-24T18:55:22.102924+0000","last_clean":"2023-12-24T18:55:22.102924+0000","last_became_active":"2023-12-24T18:55:22.093060+0000","last_became_peered":"2023-12-24T18:55:22.093060+0000","last_unstale":"2023-12-24T18:55:22.102924+0000","last_undegraded":"2023-12-24T18:55:22.102924+0000","last_fullsized":"2023-12-24T18:55:22.102924+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:41.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080358+0000","last_change":"2023-12-24T18:55:21.069946+0000","last_active":"2023-12-24T18:55:22.080358+0000","last_peered":"2023-12-24T18:55:22.080358+0000","last_clean":"2023-12-24T18:55:22.080358+0000","last_became_active":"2023-12-24T18:55:21.069437+0000","last_became_peered":"2023-12-24T18:55:21.069437+0000","last_unstale":"2023-12-24T18:55:22.080358+0000","last_undegraded":"2023-12-24T18:55:22.080358+0000","last_fullsized":"2023-12-24T18:55:22.080358+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:12.873055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084365+0000","last_change":"2023-12-24T18:55:22.080923+0000","last_active":"2023-12-24T18:55:22.084365+0000","last_peered":"2023-12-24T18:55:22.084365+0000","last_clean":"2023-12-24T18:55:22.084365+0000","last_became_active":"2023-12-24T18:55:22.077821+0000","last_became_peered":"2023-12-24T18:55:22.077821+0000","last_unstale":"2023-12-24T18:55:22.084365+0000","last_undegraded":"2023-12-24T18:55:22.084365+0000","last_fullsized":"2023-12-24T18:55:22.084365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:43.292012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080960+0000","last_change":"2023-12-24T18:55:21.078650+0000","last_active":"2023-12-24T18:55:22.080960+0000","last_peered":"2023-12-24T18:55:22.080960+0000","last_clean":"2023-12-24T18:55:22.080960+0000","last_became_active":"2023-12-24T18:55:21.077562+0000","last_became_peered":"2023-12-24T18:55:21.077562+0000","last_unstale":"2023-12-24T18:55:22.080960+0000","last_undegraded":"2023-12-24T18:55:22.080960+0000","last_fullsized":"2023-12-24T18:55:22.080960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:13.456279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114040+0000","last_change":"2023-12-24T18:55:22.110134+0000","last_active":"2023-12-24T18:55:22.114040+0000","last_peered":"2023-12-24T18:55:22.114040+0000","last_clean":"2023-12-24T18:55:22.114040+0000","last_became_active":"2023-12-24T18:55:22.109510+0000","last_became_peered":"2023-12-24T18:55:22.109510+0000","last_unstale":"2023-12-24T18:55:22.114040+0000","last_undegraded":"2023-12-24T18:55:22.114040+0000","last_fullsized":"2023-12-24T18:55:22.114040+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084580+0000","last_change":"2023-12-24T18:55:21.089745+0000","last_active":"2023-12-24T18:55:22.084580+0000","last_peered":"2023-12-24T18:55:22.084580+0000","last_clean":"2023-12-24T18:55:22.084580+0000","last_became_active":"2023-12-24T18:55:21.089430+0000","last_became_peered":"2023-12-24T18:55:21.089430+0000","last_unstale":"2023-12-24T18:55:22.084580+0000","last_undegraded":"2023-12-24T18:55:22.084580+0000","last_fullsized":"2023-12-24T18:55:22.084580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:22.484132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099335+0000","last_change":"2023-12-24T18:55:22.095115+0000","last_active":"2023-12-24T18:55:22.099335+0000","last_peered":"2023-12-24T18:55:22.099335+0000","last_clean":"2023-12-24T18:55:22.099335+0000","last_became_active":"2023-12-24T18:55:22.094790+0000","last_became_peered":"2023-12-24T18:55:22.094790+0000","last_unstale":"2023-12-24T18:55:22.099335+0000","last_undegraded":"2023-12-24T18:55:22.099335+0000","last_fullsized":"2023-12-24T18:55:22.099335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:30.865777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079705+0000","last_change":"2023-12-24T18:55:21.080958+0000","last_active":"2023-12-24T18:55:22.079705+0000","last_peered":"2023-12-24T18:55:22.079705+0000","last_clean":"2023-12-24T18:55:22.079705+0000","last_became_active":"2023-12-24T18:55:21.080584+0000","last_became_peered":"2023-12-24T18:55:21.080584+0000","last_unstale":"2023-12-24T18:55:22.079705+0000","last_undegraded":"2023-12-24T18:55:22.079705+0000","last_fullsized":"2023-12-24T18:55:22.079705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:38:38.451864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114170+0000","last_change":"2023-12-24T18:55:22.111324+0000","last_active":"2023-12-24T18:55:22.114170+0000","last_peered":"2023-12-24T18:55:22.114170+0000","last_clean":"2023-12-24T18:55:22.114170+0000","last_became_active":"2023-12-24T18:55:22.110834+0000","last_became_peered":"2023-12-24T18:55:22.110834+0000","last_unstale":"2023-12-24T18:55:22.114170+0000","last_undegraded":"2023-12-24T18:55:22.114170+0000","last_fullsized":"2023-12-24T18:55:22.114170+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"137'8","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.116399+0000","last_change":"2023-12-24T18:55:21.081128+0000","last_active":"2023-12-24T18:55:22.116399+0000","last_peered":"2023-12-24T18:55:22.116399+0000","last_clean":"2023-12-24T18:55:22.116399+0000","last_became_active":"2023-12-24T18:55:21.080859+0000","last_became_peered":"2023-12-24T18:55:21.080859+0000","last_unstale":"2023-12-24T18:55:22.116399+0000","last_undegraded":"2023-12-24T18:55:22.116399+0000","last_fullsized":"2023-12-24T18:55:22.116399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:06.937406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":722,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079898+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:55:22.079898+0000","last_peered":"2023-12-24T18:55:22.079898+0000","last_clean":"2023-12-24T18:55:22.079898+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:55:22.079898+0000","last_undegraded":"2023-12-24T18:55:22.079898+0000","last_fullsized":"2023-12-24T18:55:22.079898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311848,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059992,"statfs":{"total":96636764160,"available":96317431808,"internally_reserved":0,"allocated":2326528,"data_stored":1471486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1279999999999999},"min":{"1min":0.79800000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4790000000000001,"5min":1.6579999999999999,"15min":1.784},"last":1.53},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.657,"5min":1.6910000000000001,"15min":1.756},"last":1.397}]},{"osd":1,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.127,"15min":1.133},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5009999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.8129999999999999},"last":1.6020000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.2050000000000001},"min":{"1min":0.89600000000000002,"5min":0.64800000000000002,"15min":0.59299999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.625},"last":1.331},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.579,"5min":1.595,"15min":1.6799999999999999},"last":1.02}]},{"osd":3,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.264,"15min":1.2769999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.71399999999999997},"max":{"1min":1.5429999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5780000000000001,"5min":1.623,"15min":2.1859999999999999},"last":1.5660000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.165},"min":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.595,"5min":1.7450000000000001,"15min":1.8109999999999999},"last":1.23},{"interface":"front","average":{"1min":1.167,"5min":1.2170000000000001,"15min":1.26},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.661,"5min":1.6719999999999999,"15min":2.1160000000000001},"last":1.7509999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2529999999999999,"15min":1.2709999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.59899999999999998},"max":{"1min":1.575,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3360000000000001,"15min":1.3240000000000001},"min":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.68600000000000005},"max":{"1min":1.837,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.96199999999999997}]},{"osd":6,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4099999999999999,"15min":1.4059999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9019999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.748,"5min":1.917,"15min":1.917},"last":1.1899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2629999999999999,"15min":1.2509999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.47799999999999998},"max":{"1min":1.4670000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.71299999999999997},"max":{"1min":1.4810000000000001,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.468}]},{"osd":1,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.86099999999999999,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.4299999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.238,"15min":1.216},"min":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6000000000000001,"5min":3.081,"15min":3.081},"last":0.96299999999999997}]},{"osd":2,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.82399999999999995,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5449999999999999,"5min":2.173,"15min":2.173},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.25,"5min":1.2430000000000001,"15min":1.24},"min":{"1min":0.83099999999999996,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.6819999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.89600000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3380000000000001,"15min":1.282},"min":{"1min":1.0700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5329999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.353},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.286,"15min":1.266},"min":{"1min":0.88800000000000001,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":1.5149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1930000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1990000000000001,"15min":1.1819999999999999},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.53100000000000003},"max":{"1min":1.6299999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.145},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.274,"15min":1.238},"min":{"1min":0.82999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.595,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.242}]},{"osd":5,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.1930000000000001},"min":{"1min":0.95699999999999996,"5min":0.73399999999999999,"15min":0.59399999999999997},"max":{"1min":1.409,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.383,"15min":1.339},"min":{"1min":0.75,"5min":0.75,"15min":0.622},"max":{"1min":1.76,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.2809999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.409,"15min":1.3660000000000001},"min":{"1min":1.038,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":1.9830000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.363},"min":{"1min":1.107,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":1.611,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303068,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068772,"statfs":{"total":96636764160,"available":96326422528,"internally_reserved":0,"allocated":1724416,"data_stored":880530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.155,"15min":1.1890000000000001},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.248},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.2989999999999999},"min":{"1min":0.81000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.839,"15min":1.859},"last":1.224}]},{"osd":1,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":1.286},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.159,"15min":1.159},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.446}]},{"osd":2,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.202},"min":{"1min":0.875,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.226},"min":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.72199999999999998},"max":{"1min":1.5629999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2030000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.876,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4610000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.276,"15min":1.296},"min":{"1min":0.879,"5min":0.78700000000000003,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.706,"15min":1.786},"last":1.415}]},{"osd":4,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.141},"min":{"1min":0.75600000000000001,"5min":0.65000000000000002,"15min":0.50600000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.123},{"interface":"front","average":{"1min":1.254,"5min":1.278,"15min":1.246},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.57699999999999996},"max":{"1min":1.8460000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.298,"15min":1.2709999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.61699999999999999},"max":{"1min":1.7170000000000001,"5min":1.861,"15min":1.909},"last":1.091},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.85599999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3700000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.383,"15min":1.379},"min":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.9099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.395},{"interface":"front","average":{"1min":1.393,"5min":1.3959999999999999,"15min":1.3999999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.64600000000000002},"max":{"1min":1.796,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.4870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":881906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2030000000000001,"15min":1.198},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.7070000000000001,"5min":1.835,"15min":1.835},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.246},"min":{"1min":0.91600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.242}]},{"osd":1,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.145,"15min":1.145},"min":{"1min":0.86899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4950000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.4450000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.294},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.55,"5min":1.952,"15min":1.952},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.29,"15min":1.2989999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.76,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.387}]},{"osd":3,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.76000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.038},{"interface":"front","average":{"1min":1.121,"5min":1.216,"15min":1.2629999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.675,"5min":1.7669999999999999,"15min":1.839},"last":1.347}]},{"osd":5,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.623},"max":{"1min":2.0019999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.292},{"interface":"front","average":{"1min":1.216,"5min":1.286,"15min":1.296},"min":{"1min":0.753,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89300000000000002}]},{"osd":6,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2529999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6779999999999999,"5min":1.823,"15min":1.881},"last":1.274},{"interface":"front","average":{"1min":1.282,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8100000000000001,"5min":1.909,"15min":2.0760000000000001},"last":1.5129999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2769999999999999,"15min":1.2889999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.7250000000000001,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.84099999999999997,"5min":0.747,"15min":0.71399999999999997},"max":{"1min":1.8300000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.474}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307172,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064668,"statfs":{"total":96636764160,"available":96322220032,"internally_reserved":0,"allocated":1732608,"data_stored":881940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94999999999999996,"15min":0.94799999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.266,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.093},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.46000000000000002},"max":{"1min":1.492,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":0.94499999999999995}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.57099999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.569,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.117,"5min":1.145,"15min":1.1870000000000001},"min":{"1min":0.66600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.081,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8560000000000001,"5min":2.363,"15min":2.363},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6240000000000001,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.258},"min":{"1min":0.83399999999999996,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.609,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":1.121},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.323,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.319,"5min":2.944,"15min":2.944},"last":1.4370000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.391,"15min":1.3899999999999999},"min":{"1min":1.0629999999999999,"5min":0.86799999999999999,"15min":0.84499999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.427},"min":{"1min":1.042,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.895,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.476}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4399999999999999,"15min":1.4610000000000001},"min":{"1min":1.111,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.841,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.405,"15min":1.411},"min":{"1min":1.04,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8029999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4510000000000001,"15min":1.454},"min":{"1min":1.131,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.883,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"min":{"1min":1.075,"5min":0.755,"15min":0.755},"max":{"1min":2.4430000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.5009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575075,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":880370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64800000000000002,"5min":0.501,"15min":0.34499999999999997},"max":{"1min":1.1910000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.056,"15min":1.0609999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.50900000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5229999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.57599999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5620000000000001,"5min":1.6519999999999999,"15min":1.976},"last":0.77400000000000002}]},{"osd":3,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.127,"15min":1.137},"min":{"1min":0.77600000000000002,"5min":0.71099999999999997,"15min":0.441},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0629999999999999,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.48299999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.95499999999999996}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.306,"15min":1.3080000000000001},"min":{"1min":1.101,"5min":0.86299999999999999,"15min":0.68899999999999995},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.222},{"interface":"front","average":{"1min":1.302,"5min":1.3169999999999999,"15min":1.29},"min":{"1min":1.0309999999999999,"5min":0.92500000000000004,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":1.798,"15min":1.798},"last":1.099}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.325,"15min":1.2869999999999999},"min":{"1min":1.01,"5min":0.83699999999999997,"15min":0.496},"max":{"1min":1.748,"5min":2.069,"15min":2.069},"last":1.677},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3759999999999999,"15min":1.365},"min":{"1min":1.044,"5min":0.94199999999999995,"15min":0.82999999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.526}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.4019999999999999},"min":{"1min":1.2010000000000001,"5min":1.0209999999999999,"15min":0.72399999999999998},"max":{"1min":1.718,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.167},{"interface":"front","average":{"1min":1.478,"5min":1.429,"15min":1.401},"min":{"1min":1.1419999999999999,"5min":0.95199999999999996,"15min":0.71599999999999997},"max":{"1min":1.841,"5min":1.9319999999999999,"15min":2.093},"last":1.538}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4770000000000001,"15min":1.4570000000000001},"min":{"1min":1.2270000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.651},{"interface":"front","average":{"1min":1.532,"5min":1.4870000000000001,"15min":1.472},"min":{"1min":1.2729999999999999,"5min":0.94999999999999996,"15min":0.84999999999999998},"max":{"1min":1.879,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51000000000000001},"max":{"1min":1.3200000000000001,"5min":1.663,"15min":1.8149999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.095,"15min":1.123},"min":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.829},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"max":{"1min":1.498,"5min":1.498,"15min":1.5349999999999999},"last":1.123},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.115},"min":{"1min":0.63800000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.486,"5min":1.73,"15min":1.7410000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.262,"15min":1.254},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.595,"5min":1.823,"15min":1.915},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.111,"15min":1.093},"min":{"1min":0.753,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6839999999999999,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":1.036}]},{"osd":4,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.92400000000000004,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":1.724},"last":1.008},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.413,"15min":1.405},"min":{"1min":1.089,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9179999999999999,"5min":2.1930000000000001,"15min":2.3130000000000002},"last":1.216}]},{"osd":5,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.385},"min":{"1min":1.0840000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.621,"5min":1.887,"15min":1.9790000000000001},"last":1.401},{"interface":"front","average":{"1min":1.365,"5min":1.3520000000000001,"15min":1.353},"min":{"1min":0.99399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.786,"5min":1.8140000000000001,"15min":2.0089999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.5,"15min":1.49},"min":{"1min":1.21,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0249999999999999,"5min":2.1269999999999998,"15min":2.3860000000000001},"last":1.288},{"interface":"front","average":{"1min":1.526,"5min":1.4550000000000001,"15min":1.4630000000000001},"min":{"1min":1.2230000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":2.1749999999999998},"last":1.101}]},{"osd":7,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.516,"15min":1.5229999999999999},"min":{"1min":1.1739999999999999,"5min":1.0549999999999999,"15min":0.754},"max":{"1min":2.0099999999999998,"5min":2.0219999999999998,"15min":2.3540000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.472,"15min":1.4610000000000001},"min":{"1min":1.133,"5min":0.876,"15min":0.876},"max":{"1min":1.897,"5min":1.919,"15min":2.1160000000000001},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1470760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.206,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.204}]},{"osd":2,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.069,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.629,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.5649999999999999,"15min":1.7},"last":1.258},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0720000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.58099999999999996},"max":{"1min":1.4379999999999999,"5min":1.631,"15min":2.8130000000000002},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.69699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.468},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2250000000000001,"15min":1.234},"min":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6200000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.407}]},{"osd":4,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.335,"15min":1.345},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6359999999999999,"5min":1.8120000000000001,"15min":2.0009999999999999},"last":1.504},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.2789999999999999},"min":{"1min":0.84999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.762},"last":1.3480000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.391,"15min":1.3839999999999999},"min":{"1min":1.1639999999999999,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.798,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.71},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3640000000000001,"15min":1.399},"min":{"1min":1.115,"5min":0.95699999999999996,"15min":0.95499999999999996},"max":{"1min":1.7909999999999999,"5min":1.978,"15min":2.2280000000000002},"last":1.8069999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.97299999999999998,"15min":0.69599999999999995},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":2.0779999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.9350000000000001,"5min":2.0750000000000002,"15min":2.23},"last":1.585}]},{"osd":7,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":1.022,"5min":1.0189999999999999,"15min":1.006},"max":{"1min":1.847,"5min":2.262,"15min":2.8980000000000001},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.419,"15min":1.4330000000000001},"min":{"1min":1.155,"5min":0.94899999999999995,"15min":0.72399999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.3279999999999998},"last":1.766}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:55:29.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:55:29.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:55:31.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T18:55:31.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 Processor -- start 2023-12-24T18:55:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 -- start start 2023-12-24T18:55:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 0x7efd0406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd04156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0415a4d0 con 0x7efd040caf40 2023-12-24T18:55:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd04157050 con 0x7efd040cb310 2023-12-24T18:55:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.376+0000 7efd0a28e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd04159610 con 0x7efd04156690 2023-12-24T18:55:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd04156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd08a8b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 0x7efd0406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd0928c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd040caf40 0x7efd040ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40182/0 (socket says 172.21.15.50:40182) 2023-12-24T18:55:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd0928c700 1 -- 172.21.15.50:0/3390987196 learned_addr learned my addr 172.21.15.50:0/3390987196 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efcfbfff700 1 -- 172.21.15.50:0/3390987196 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325379673 0 0) 0x7efd0415a4d0 con 0x7efd040caf40 2023-12-24T18:55:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efcfbfff700 1 -- 172.21.15.50:0/3390987196 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0003570 con 0x7efd040caf40 2023-12-24T18:55:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 -- 172.21.15.50:0/3390987196 >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 msgr2=0x7efd0406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 --2- 172.21.15.50:0/3390987196 >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 0x7efd0406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 -- 172.21.15.50:0/3390987196 >> v1:172.21.15.82:6789/0 conn(0x7efd040caf40 legacy=0x7efd040ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 -- 172.21.15.50:0/3390987196 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040cd2a0 con 0x7efd04156690 2023-12-24T18:55:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd08a8b700 1 --2- 172.21.15.50:0/3390987196 >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 0x7efd0406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efd09a8d700 1 --2- 172.21.15.50:0/3390987196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd04156b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009e60 tx=0x7efcfc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56ffd7621155cff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efcfbfff700 1 -- 172.21.15.50:0/3390987196 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00e070 con 0x7efd04156690 2023-12-24T18:55:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efcfbfff700 1 -- 172.21.15.50:0/3390987196 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00bab0 con 0x7efd04156690 2023-12-24T18:55:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.380+0000 7efcfbfff700 1 -- 172.21.15.50:0/3390987196 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00be70 con 0x7efd04156690 2023-12-24T18:55:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 -- 172.21.15.50:0/3390987196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 msgr2=0x7efd04156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 --2- 172.21.15.50:0/3390987196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd04156b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009e60 tx=0x7efcfc009780 comp rx=0 tx=0).stop 2023-12-24T18:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 -- 172.21.15.50:0/3390987196 shutdown_connections 2023-12-24T18:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 --2- 172.21.15.50:0/3390987196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd04156b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 --2- 172.21.15.50:0/3390987196 >> v2:172.21.15.82:3300/0 conn(0x7efd040cb310 0x7efd0406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 -- 172.21.15.50:0/3390987196 >> 172.21.15.50:0/3390987196 conn(0x7efd040670b0 msgr2=0x7efd040674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 -- 172.21.15.50:0/3390987196 shutdown_connections 2023-12-24T18:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 -- 172.21.15.50:0/3390987196 wait complete. 2023-12-24T18:55:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.384+0000 7efd0a28e700 1 Processor -- start 2023-12-24T18:55:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 -- start start 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 0x7efd040b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd0416c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040d0570 con 0x7efd040cb310 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040cf960 con 0x7efd040caf40 2023-12-24T18:55:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0a28e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040cfc40 con 0x7efd04156690 2023-12-24T18:55:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43012/0 (socket says 172.21.15.50:43012) 2023-12-24T18:55:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 -- 172.21.15.50:0/556585579 learned_addr learned my addr 172.21.15.50:0/556585579 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0928c700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 0x7efd040b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd09a8d700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd0416c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 -- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 msgr2=0x7efd0416c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd0416c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 -- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 msgr2=0x7efd040b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 0x7efd040b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd08a8b700 1 -- 172.21.15.50:0/556585579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4009420 con 0x7efd040cb310 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd0928c700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 0x7efd040b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.388+0000 7efd09a8d700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd0416c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efd08a8b700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7efcf400ec80 tx=0x7efcf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400c9d0 con 0x7efd040cb310 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400cb30 con 0x7efd040cb310 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc009a20 con 0x7efd040cb310 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400ceb0 con 0x7efd040cb310 2023-12-24T18:55:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd040d0200 con 0x7efd040cb310 2023-12-24T18:55:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.392+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0404be40 con 0x7efd040cb310 2023-12-24T18:55:31.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.396+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efcf4013680 con 0x7efd040cb310 2023-12-24T18:55:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.396+0000 7efcf97fa700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 0x7efce8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.396+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7efcf407cf30 con 0x7efd040cb310 2023-12-24T18:55:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.396+0000 7efd0928c700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 0x7efce8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.396+0000 7efd0928c700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 0x7efce8062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd000058d0 tx=0x7efd00009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.404+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efcf404d1b0 con 0x7efd040cb310 2023-12-24T18:55:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.572+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd040b2d70 con 0x7efce8060550 2023-12-24T18:55:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.584+0000 7efcf97fa700 1 -- 172.21.15.50:0/556585579 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286614 (secure 0 0 0) 0x7efd040b2d70 con 0x7efce8060550 2023-12-24T18:55:31.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 msgr2=0x7efce8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 0x7efce8062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd000058d0 tx=0x7efd00009040 comp rx=0 tx=0).stop 2023-12-24T18:55:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 msgr2=0x7efd0416c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7efcf400ec80 tx=0x7efcf40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 shutdown_connections 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efce8060550 0x7efce8062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd04156690 0x7efd0416c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd040cb310 0x7efd0416c030 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 --2- 172.21.15.50:0/556585579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd040caf40 0x7efd040b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 >> 172.21.15.50:0/556585579 conn(0x7efd040670b0 msgr2=0x7efd040af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 shutdown_connections 2023-12-24T18:55:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.592+0000 7efd0a28e700 1 -- 172.21.15.50:0/556585579 wait complete. 2023-12-24T18:55:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T18:55:31.611 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-24T18:55:30.933836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2462568,"kb_used_data":14632,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752512152,"statfs":{"total":773094113280,"available":770572443648,"internally_reserved":0,"allocated":14983168,"data_stored":8228308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.866422"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091134+0000","last_change":"2023-12-24T18:55:22.083017+0000","last_active":"2023-12-24T18:55:22.091134+0000","last_peered":"2023-12-24T18:55:22.091134+0000","last_clean":"2023-12-24T18:55:22.091134+0000","last_became_active":"2023-12-24T18:55:22.082692+0000","last_became_peered":"2023-12-24T18:55:22.082692+0000","last_unstale":"2023-12-24T18:55:22.091134+0000","last_undegraded":"2023-12-24T18:55:22.091134+0000","last_fullsized":"2023-12-24T18:55:22.091134+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114053+0000","last_change":"2023-12-24T18:55:22.112246+0000","last_active":"2023-12-24T18:55:22.114053+0000","last_peered":"2023-12-24T18:55:22.114053+0000","last_clean":"2023-12-24T18:55:22.114053+0000","last_became_active":"2023-12-24T18:55:22.111949+0000","last_became_peered":"2023-12-24T18:55:22.111949+0000","last_unstale":"2023-12-24T18:55:22.114053+0000","last_undegraded":"2023-12-24T18:55:22.114053+0000","last_fullsized":"2023-12-24T18:55:22.114053+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:31.071346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086980+0000","last_change":"2023-12-24T18:55:22.082723+0000","last_active":"2023-12-24T18:55:22.086980+0000","last_peered":"2023-12-24T18:55:22.086980+0000","last_clean":"2023-12-24T18:55:22.086980+0000","last_became_active":"2023-12-24T18:55:22.081679+0000","last_became_peered":"2023-12-24T18:55:22.081679+0000","last_unstale":"2023-12-24T18:55:22.086980+0000","last_undegraded":"2023-12-24T18:55:22.086980+0000","last_fullsized":"2023-12-24T18:55:22.086980+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:49.889577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112852+0000","last_change":"2023-12-24T18:55:22.109421+0000","last_active":"2023-12-24T18:55:22.112852+0000","last_peered":"2023-12-24T18:55:22.112852+0000","last_clean":"2023-12-24T18:55:22.112852+0000","last_became_active":"2023-12-24T18:55:22.107483+0000","last_became_peered":"2023-12-24T18:55:22.107483+0000","last_unstale":"2023-12-24T18:55:22.112852+0000","last_undegraded":"2023-12-24T18:55:22.112852+0000","last_fullsized":"2023-12-24T18:55:22.112852+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099342+0000","last_change":"2023-12-24T18:55:22.092712+0000","last_active":"2023-12-24T18:55:22.099342+0000","last_peered":"2023-12-24T18:55:22.099342+0000","last_clean":"2023-12-24T18:55:22.099342+0000","last_became_active":"2023-12-24T18:55:22.092251+0000","last_became_peered":"2023-12-24T18:55:22.092251+0000","last_unstale":"2023-12-24T18:55:22.099342+0000","last_undegraded":"2023-12-24T18:55:22.099342+0000","last_fullsized":"2023-12-24T18:55:22.099342+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103428+0000","last_change":"2023-12-24T18:55:22.095881+0000","last_active":"2023-12-24T18:55:22.103428+0000","last_peered":"2023-12-24T18:55:22.103428+0000","last_clean":"2023-12-24T18:55:22.103428+0000","last_became_active":"2023-12-24T18:55:22.095575+0000","last_became_peered":"2023-12-24T18:55:22.095575+0000","last_unstale":"2023-12-24T18:55:22.103428+0000","last_undegraded":"2023-12-24T18:55:22.103428+0000","last_fullsized":"2023-12-24T18:55:22.103428+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:58.633265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113823+0000","last_change":"2023-12-24T18:55:22.112865+0000","last_active":"2023-12-24T18:55:22.113823+0000","last_peered":"2023-12-24T18:55:22.113823+0000","last_clean":"2023-12-24T18:55:22.113823+0000","last_became_active":"2023-12-24T18:55:22.112359+0000","last_became_peered":"2023-12-24T18:55:22.112359+0000","last_unstale":"2023-12-24T18:55:22.113823+0000","last_undegraded":"2023-12-24T18:55:22.113823+0000","last_fullsized":"2023-12-24T18:55:22.113823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:52.465621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094622+0000","last_change":"2023-12-24T18:55:22.093499+0000","last_active":"2023-12-24T18:55:22.094622+0000","last_peered":"2023-12-24T18:55:22.094622+0000","last_clean":"2023-12-24T18:55:22.094622+0000","last_became_active":"2023-12-24T18:55:22.093219+0000","last_became_peered":"2023-12-24T18:55:22.093219+0000","last_unstale":"2023-12-24T18:55:22.094622+0000","last_undegraded":"2023-12-24T18:55:22.094622+0000","last_fullsized":"2023-12-24T18:55:22.094622+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:12.445913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112816+0000","last_change":"2023-12-24T18:55:22.108390+0000","last_active":"2023-12-24T18:55:22.112816+0000","last_peered":"2023-12-24T18:55:22.112816+0000","last_clean":"2023-12-24T18:55:22.112816+0000","last_became_active":"2023-12-24T18:55:22.108113+0000","last_became_peered":"2023-12-24T18:55:22.108113+0000","last_unstale":"2023-12-24T18:55:22.112816+0000","last_undegraded":"2023-12-24T18:55:22.112816+0000","last_fullsized":"2023-12-24T18:55:22.112816+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102718+0000","last_change":"2023-12-24T18:55:22.098867+0000","last_active":"2023-12-24T18:55:22.102718+0000","last_peered":"2023-12-24T18:55:22.102718+0000","last_clean":"2023-12-24T18:55:22.102718+0000","last_became_active":"2023-12-24T18:55:22.098508+0000","last_became_peered":"2023-12-24T18:55:22.098508+0000","last_unstale":"2023-12-24T18:55:22.102718+0000","last_undegraded":"2023-12-24T18:55:22.102718+0000","last_fullsized":"2023-12-24T18:55:22.102718+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.095928+0000","last_change":"2023-12-24T18:55:22.090850+0000","last_active":"2023-12-24T18:55:22.095928+0000","last_peered":"2023-12-24T18:55:22.095928+0000","last_clean":"2023-12-24T18:55:22.095928+0000","last_became_active":"2023-12-24T18:55:22.090432+0000","last_became_peered":"2023-12-24T18:55:22.090432+0000","last_unstale":"2023-12-24T18:55:22.095928+0000","last_undegraded":"2023-12-24T18:55:22.095928+0000","last_fullsized":"2023-12-24T18:55:22.095928+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:10.980398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105117+0000","last_change":"2023-12-24T18:55:22.097961+0000","last_active":"2023-12-24T18:55:22.105117+0000","last_peered":"2023-12-24T18:55:22.105117+0000","last_clean":"2023-12-24T18:55:22.105117+0000","last_became_active":"2023-12-24T18:55:22.097659+0000","last_became_peered":"2023-12-24T18:55:22.097659+0000","last_unstale":"2023-12-24T18:55:22.105117+0000","last_undegraded":"2023-12-24T18:55:22.105117+0000","last_fullsized":"2023-12-24T18:55:22.105117+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:22.550396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099312+0000","last_change":"2023-12-24T18:55:22.091869+0000","last_active":"2023-12-24T18:55:22.099312+0000","last_peered":"2023-12-24T18:55:22.099312+0000","last_clean":"2023-12-24T18:55:22.099312+0000","last_became_active":"2023-12-24T18:55:22.091590+0000","last_became_peered":"2023-12-24T18:55:22.091590+0000","last_unstale":"2023-12-24T18:55:22.099312+0000","last_undegraded":"2023-12-24T18:55:22.099312+0000","last_fullsized":"2023-12-24T18:55:22.099312+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.086865+0000","last_change":"2023-12-24T18:55:22.081815+0000","last_active":"2023-12-24T18:55:22.086865+0000","last_peered":"2023-12-24T18:55:22.086865+0000","last_clean":"2023-12-24T18:55:22.086865+0000","last_became_active":"2023-12-24T18:55:22.081251+0000","last_became_peered":"2023-12-24T18:55:22.081251+0000","last_unstale":"2023-12-24T18:55:22.086865+0000","last_undegraded":"2023-12-24T18:55:22.086865+0000","last_fullsized":"2023-12-24T18:55:22.086865+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:23.498552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091900+0000","last_change":"2023-12-24T18:55:22.084008+0000","last_active":"2023-12-24T18:55:22.091900+0000","last_peered":"2023-12-24T18:55:22.091900+0000","last_clean":"2023-12-24T18:55:22.091900+0000","last_became_active":"2023-12-24T18:55:22.083743+0000","last_became_peered":"2023-12-24T18:55:22.083743+0000","last_unstale":"2023-12-24T18:55:22.091900+0000","last_undegraded":"2023-12-24T18:55:22.091900+0000","last_fullsized":"2023-12-24T18:55:22.091900+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:00.554365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102901+0000","last_change":"2023-12-24T18:55:22.093244+0000","last_active":"2023-12-24T18:55:22.102901+0000","last_peered":"2023-12-24T18:55:22.102901+0000","last_clean":"2023-12-24T18:55:22.102901+0000","last_became_active":"2023-12-24T18:55:22.092185+0000","last_became_peered":"2023-12-24T18:55:22.092185+0000","last_unstale":"2023-12-24T18:55:22.102901+0000","last_undegraded":"2023-12-24T18:55:22.102901+0000","last_fullsized":"2023-12-24T18:55:22.102901+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:17.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.094478+0000","last_change":"2023-12-24T18:55:22.090536+0000","last_active":"2023-12-24T18:55:22.094478+0000","last_peered":"2023-12-24T18:55:22.094478+0000","last_clean":"2023-12-24T18:55:22.094478+0000","last_became_active":"2023-12-24T18:55:22.090221+0000","last_became_peered":"2023-12-24T18:55:22.090221+0000","last_unstale":"2023-12-24T18:55:22.094478+0000","last_undegraded":"2023-12-24T18:55:22.094478+0000","last_fullsized":"2023-12-24T18:55:22.094478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110632+0000","last_change":"2023-12-24T18:55:22.107207+0000","last_active":"2023-12-24T18:55:22.110632+0000","last_peered":"2023-12-24T18:55:22.110632+0000","last_clean":"2023-12-24T18:55:22.110632+0000","last_became_active":"2023-12-24T18:55:22.106749+0000","last_became_peered":"2023-12-24T18:55:22.106749+0000","last_unstale":"2023-12-24T18:55:22.110632+0000","last_undegraded":"2023-12-24T18:55:22.110632+0000","last_fullsized":"2023-12-24T18:55:22.110632+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:04.443236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107987+0000","last_change":"2023-12-24T18:55:22.106093+0000","last_active":"2023-12-24T18:55:22.107987+0000","last_peered":"2023-12-24T18:55:22.107987+0000","last_clean":"2023-12-24T18:55:22.107987+0000","last_became_active":"2023-12-24T18:55:22.104437+0000","last_became_peered":"2023-12-24T18:55:22.104437+0000","last_unstale":"2023-12-24T18:55:22.107987+0000","last_undegraded":"2023-12-24T18:55:22.107987+0000","last_fullsized":"2023-12-24T18:55:22.107987+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:25.551673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112160+0000","last_change":"2023-12-24T18:55:22.108502+0000","last_active":"2023-12-24T18:55:22.112160+0000","last_peered":"2023-12-24T18:55:22.112160+0000","last_clean":"2023-12-24T18:55:22.112160+0000","last_became_active":"2023-12-24T18:55:22.104525+0000","last_became_peered":"2023-12-24T18:55:22.104525+0000","last_unstale":"2023-12-24T18:55:22.112160+0000","last_undegraded":"2023-12-24T18:55:22.112160+0000","last_fullsized":"2023-12-24T18:55:22.112160+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:37.861628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114252+0000","last_change":"2023-12-24T18:55:22.111595+0000","last_active":"2023-12-24T18:55:22.114252+0000","last_peered":"2023-12-24T18:55:22.114252+0000","last_clean":"2023-12-24T18:55:22.114252+0000","last_became_active":"2023-12-24T18:55:22.111288+0000","last_became_peered":"2023-12-24T18:55:22.111288+0000","last_unstale":"2023-12-24T18:55:22.114252+0000","last_undegraded":"2023-12-24T18:55:22.114252+0000","last_fullsized":"2023-12-24T18:55:22.114252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096049+0000","last_change":"2023-12-24T18:55:22.089964+0000","last_active":"2023-12-24T18:55:22.096049+0000","last_peered":"2023-12-24T18:55:22.096049+0000","last_clean":"2023-12-24T18:55:22.096049+0000","last_became_active":"2023-12-24T18:55:22.089396+0000","last_became_peered":"2023-12-24T18:55:22.089396+0000","last_unstale":"2023-12-24T18:55:22.096049+0000","last_undegraded":"2023-12-24T18:55:22.096049+0000","last_fullsized":"2023-12-24T18:55:22.096049+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:24.956216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112906+0000","last_change":"2023-12-24T18:55:22.109309+0000","last_active":"2023-12-24T18:55:22.112906+0000","last_peered":"2023-12-24T18:55:22.112906+0000","last_clean":"2023-12-24T18:55:22.112906+0000","last_became_active":"2023-12-24T18:55:22.108929+0000","last_became_peered":"2023-12-24T18:55:22.108929+0000","last_unstale":"2023-12-24T18:55:22.112906+0000","last_undegraded":"2023-12-24T18:55:22.112906+0000","last_fullsized":"2023-12-24T18:55:22.112906+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087186+0000","last_change":"2023-12-24T18:55:22.081876+0000","last_active":"2023-12-24T18:55:22.087186+0000","last_peered":"2023-12-24T18:55:22.087186+0000","last_clean":"2023-12-24T18:55:22.087186+0000","last_became_active":"2023-12-24T18:55:22.081133+0000","last_became_peered":"2023-12-24T18:55:22.081133+0000","last_unstale":"2023-12-24T18:55:22.087186+0000","last_undegraded":"2023-12-24T18:55:22.087186+0000","last_fullsized":"2023-12-24T18:55:22.087186+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:14.190205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087176+0000","last_change":"2023-12-24T18:55:22.081279+0000","last_active":"2023-12-24T18:55:22.087176+0000","last_peered":"2023-12-24T18:55:22.087176+0000","last_clean":"2023-12-24T18:55:22.087176+0000","last_became_active":"2023-12-24T18:55:22.080959+0000","last_became_peered":"2023-12-24T18:55:22.080959+0000","last_unstale":"2023-12-24T18:55:22.087176+0000","last_undegraded":"2023-12-24T18:55:22.087176+0000","last_fullsized":"2023-12-24T18:55:22.087176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090180+0000","last_change":"2023-12-24T18:55:22.087221+0000","last_active":"2023-12-24T18:55:22.090180+0000","last_peered":"2023-12-24T18:55:22.090180+0000","last_clean":"2023-12-24T18:55:22.090180+0000","last_became_active":"2023-12-24T18:55:22.086349+0000","last_became_peered":"2023-12-24T18:55:22.086349+0000","last_unstale":"2023-12-24T18:55:22.090180+0000","last_undegraded":"2023-12-24T18:55:22.090180+0000","last_fullsized":"2023-12-24T18:55:22.090180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:21.724651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.107969+0000","last_change":"2023-12-24T18:55:22.105591+0000","last_active":"2023-12-24T18:55:22.107969+0000","last_peered":"2023-12-24T18:55:22.107969+0000","last_clean":"2023-12-24T18:55:22.107969+0000","last_became_active":"2023-12-24T18:55:22.104742+0000","last_became_peered":"2023-12-24T18:55:22.104742+0000","last_unstale":"2023-12-24T18:55:22.107969+0000","last_undegraded":"2023-12-24T18:55:22.107969+0000","last_fullsized":"2023-12-24T18:55:22.107969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:12.278808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110795+0000","last_change":"2023-12-24T18:55:22.108278+0000","last_active":"2023-12-24T18:55:22.110795+0000","last_peered":"2023-12-24T18:55:22.110795+0000","last_clean":"2023-12-24T18:55:22.110795+0000","last_became_active":"2023-12-24T18:55:22.107831+0000","last_became_peered":"2023-12-24T18:55:22.107831+0000","last_unstale":"2023-12-24T18:55:22.110795+0000","last_undegraded":"2023-12-24T18:55:22.110795+0000","last_fullsized":"2023-12-24T18:55:22.110795+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:10:42.035310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080470+0000","last_change":"2023-12-24T18:55:22.077989+0000","last_active":"2023-12-24T18:55:22.080470+0000","last_peered":"2023-12-24T18:55:22.080470+0000","last_clean":"2023-12-24T18:55:22.080470+0000","last_became_active":"2023-12-24T18:55:22.077364+0000","last_became_peered":"2023-12-24T18:55:22.077364+0000","last_unstale":"2023-12-24T18:55:22.080470+0000","last_undegraded":"2023-12-24T18:55:22.080470+0000","last_fullsized":"2023-12-24T18:55:22.080470+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:38.019473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.092730+0000","last_change":"2023-12-24T18:55:22.090142+0000","last_active":"2023-12-24T18:55:22.092730+0000","last_peered":"2023-12-24T18:55:22.092730+0000","last_clean":"2023-12-24T18:55:22.092730+0000","last_became_active":"2023-12-24T18:55:22.089768+0000","last_became_peered":"2023-12-24T18:55:22.089768+0000","last_unstale":"2023-12-24T18:55:22.092730+0000","last_undegraded":"2023-12-24T18:55:22.092730+0000","last_fullsized":"2023-12-24T18:55:22.092730+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:52.560469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080590+0000","last_change":"2023-12-24T18:55:22.074056+0000","last_active":"2023-12-24T18:55:22.080590+0000","last_peered":"2023-12-24T18:55:22.080590+0000","last_clean":"2023-12-24T18:55:22.080590+0000","last_became_active":"2023-12-24T18:55:22.073635+0000","last_became_peered":"2023-12-24T18:55:22.073635+0000","last_unstale":"2023-12-24T18:55:22.080590+0000","last_undegraded":"2023-12-24T18:55:22.080590+0000","last_fullsized":"2023-12-24T18:55:22.080590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:14.731884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087285+0000","last_change":"2023-12-24T18:55:22.082068+0000","last_active":"2023-12-24T18:55:22.087285+0000","last_peered":"2023-12-24T18:55:22.087285+0000","last_clean":"2023-12-24T18:55:22.087285+0000","last_became_active":"2023-12-24T18:55:22.081589+0000","last_became_peered":"2023-12-24T18:55:22.081589+0000","last_unstale":"2023-12-24T18:55:22.087285+0000","last_undegraded":"2023-12-24T18:55:22.087285+0000","last_fullsized":"2023-12-24T18:55:22.087285+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.101677+0000","last_change":"2023-12-24T18:55:22.098708+0000","last_active":"2023-12-24T18:55:22.101677+0000","last_peered":"2023-12-24T18:55:22.101677+0000","last_clean":"2023-12-24T18:55:22.101677+0000","last_became_active":"2023-12-24T18:55:22.097844+0000","last_became_peered":"2023-12-24T18:55:22.097844+0000","last_unstale":"2023-12-24T18:55:22.101677+0000","last_undegraded":"2023-12-24T18:55:22.101677+0000","last_fullsized":"2023-12-24T18:55:22.101677+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"137'4","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.112266+0000","last_change":"2023-12-24T18:55:21.078556+0000","last_active":"2023-12-24T18:55:22.112266+0000","last_peered":"2023-12-24T18:55:22.112266+0000","last_clean":"2023-12-24T18:55:22.112266+0000","last_became_active":"2023-12-24T18:55:21.078243+0000","last_became_peered":"2023-12-24T18:55:21.078243+0000","last_unstale":"2023-12-24T18:55:22.112266+0000","last_undegraded":"2023-12-24T18:55:22.112266+0000","last_fullsized":"2023-12-24T18:55:22.112266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:31.247726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102861+0000","last_change":"2023-12-24T18:55:22.096073+0000","last_active":"2023-12-24T18:55:22.102861+0000","last_peered":"2023-12-24T18:55:22.102861+0000","last_clean":"2023-12-24T18:55:22.102861+0000","last_became_active":"2023-12-24T18:55:22.095765+0000","last_became_peered":"2023-12-24T18:55:22.095765+0000","last_unstale":"2023-12-24T18:55:22.102861+0000","last_undegraded":"2023-12-24T18:55:22.102861+0000","last_fullsized":"2023-12-24T18:55:22.102861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:14.716443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108913+0000","last_change":"2023-12-24T18:55:21.071673+0000","last_active":"2023-12-24T18:55:22.108913+0000","last_peered":"2023-12-24T18:55:22.108913+0000","last_clean":"2023-12-24T18:55:22.108913+0000","last_became_active":"2023-12-24T18:55:21.071340+0000","last_became_peered":"2023-12-24T18:55:21.071340+0000","last_unstale":"2023-12-24T18:55:22.108913+0000","last_undegraded":"2023-12-24T18:55:22.108913+0000","last_fullsized":"2023-12-24T18:55:22.108913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:03.369622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105355+0000","last_change":"2023-12-24T18:55:22.100535+0000","last_active":"2023-12-24T18:55:22.105355+0000","last_peered":"2023-12-24T18:55:22.105355+0000","last_clean":"2023-12-24T18:55:22.105355+0000","last_became_active":"2023-12-24T18:55:22.100187+0000","last_became_peered":"2023-12-24T18:55:22.100187+0000","last_unstale":"2023-12-24T18:55:22.105355+0000","last_undegraded":"2023-12-24T18:55:22.105355+0000","last_fullsized":"2023-12-24T18:55:22.105355+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114325+0000","last_change":"2023-12-24T18:55:21.085927+0000","last_active":"2023-12-24T18:55:22.114325+0000","last_peered":"2023-12-24T18:55:22.114325+0000","last_clean":"2023-12-24T18:55:22.114325+0000","last_became_active":"2023-12-24T18:55:21.085672+0000","last_became_peered":"2023-12-24T18:55:21.085672+0000","last_unstale":"2023-12-24T18:55:22.114325+0000","last_undegraded":"2023-12-24T18:55:22.114325+0000","last_fullsized":"2023-12-24T18:55:22.114325+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:25.047607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114161+0000","last_change":"2023-12-24T18:55:22.111081+0000","last_active":"2023-12-24T18:55:22.114161+0000","last_peered":"2023-12-24T18:55:22.114161+0000","last_clean":"2023-12-24T18:55:22.114161+0000","last_became_active":"2023-12-24T18:55:22.110268+0000","last_became_peered":"2023-12-24T18:55:22.110268+0000","last_unstale":"2023-12-24T18:55:22.114161+0000","last_undegraded":"2023-12-24T18:55:22.114161+0000","last_fullsized":"2023-12-24T18:55:22.114161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111424+0000","last_change":"2023-12-24T18:55:21.093576+0000","last_active":"2023-12-24T18:55:22.111424+0000","last_peered":"2023-12-24T18:55:22.111424+0000","last_clean":"2023-12-24T18:55:22.111424+0000","last_became_active":"2023-12-24T18:55:21.093271+0000","last_became_peered":"2023-12-24T18:55:21.093271+0000","last_unstale":"2023-12-24T18:55:22.111424+0000","last_undegraded":"2023-12-24T18:55:22.111424+0000","last_fullsized":"2023-12-24T18:55:22.111424+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:14:27.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091588+0000","last_change":"2023-12-24T18:55:22.088606+0000","last_active":"2023-12-24T18:55:22.091588+0000","last_peered":"2023-12-24T18:55:22.091588+0000","last_clean":"2023-12-24T18:55:22.091588+0000","last_became_active":"2023-12-24T18:55:22.088167+0000","last_became_peered":"2023-12-24T18:55:22.088167+0000","last_unstale":"2023-12-24T18:55:22.091588+0000","last_undegraded":"2023-12-24T18:55:22.091588+0000","last_fullsized":"2023-12-24T18:55:22.091588+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:38.664301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106353+0000","last_change":"2023-12-24T18:55:21.077860+0000","last_active":"2023-12-24T18:55:22.106353+0000","last_peered":"2023-12-24T18:55:22.106353+0000","last_clean":"2023-12-24T18:55:22.106353+0000","last_became_active":"2023-12-24T18:55:21.077560+0000","last_became_peered":"2023-12-24T18:55:21.077560+0000","last_unstale":"2023-12-24T18:55:22.106353+0000","last_undegraded":"2023-12-24T18:55:22.106353+0000","last_fullsized":"2023-12-24T18:55:22.106353+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:19.605707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.091923+0000","last_change":"2023-12-24T18:55:22.086080+0000","last_active":"2023-12-24T18:55:22.091923+0000","last_peered":"2023-12-24T18:55:22.091923+0000","last_clean":"2023-12-24T18:55:22.091923+0000","last_became_active":"2023-12-24T18:55:22.085793+0000","last_became_peered":"2023-12-24T18:55:22.085793+0000","last_unstale":"2023-12-24T18:55:22.091923+0000","last_undegraded":"2023-12-24T18:55:22.091923+0000","last_fullsized":"2023-12-24T18:55:22.091923+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110592+0000","last_change":"2023-12-24T18:55:21.096106+0000","last_active":"2023-12-24T18:55:22.110592+0000","last_peered":"2023-12-24T18:55:22.110592+0000","last_clean":"2023-12-24T18:55:22.110592+0000","last_became_active":"2023-12-24T18:55:21.095622+0000","last_became_peered":"2023-12-24T18:55:21.095622+0000","last_unstale":"2023-12-24T18:55:22.110592+0000","last_undegraded":"2023-12-24T18:55:22.110592+0000","last_fullsized":"2023-12-24T18:55:22.110592+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:44.695064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.093641+0000","last_change":"2023-12-24T18:55:22.092058+0000","last_active":"2023-12-24T18:55:22.093641+0000","last_peered":"2023-12-24T18:55:22.093641+0000","last_clean":"2023-12-24T18:55:22.093641+0000","last_became_active":"2023-12-24T18:55:22.091562+0000","last_became_peered":"2023-12-24T18:55:22.091562+0000","last_unstale":"2023-12-24T18:55:22.093641+0000","last_undegraded":"2023-12-24T18:55:22.093641+0000","last_fullsized":"2023-12-24T18:55:22.093641+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:09.744429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.066544+0000","last_change":"2023-12-24T18:55:21.081847+0000","last_active":"2023-12-24T18:55:22.066544+0000","last_peered":"2023-12-24T18:55:22.066544+0000","last_clean":"2023-12-24T18:55:22.066544+0000","last_became_active":"2023-12-24T18:55:21.081568+0000","last_became_peered":"2023-12-24T18:55:21.081568+0000","last_unstale":"2023-12-24T18:55:22.066544+0000","last_undegraded":"2023-12-24T18:55:22.066544+0000","last_fullsized":"2023-12-24T18:55:22.066544+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.104032+0000","last_change":"2023-12-24T18:55:22.099474+0000","last_active":"2023-12-24T18:55:22.104032+0000","last_peered":"2023-12-24T18:55:22.104032+0000","last_clean":"2023-12-24T18:55:22.104032+0000","last_became_active":"2023-12-24T18:55:22.099082+0000","last_became_peered":"2023-12-24T18:55:22.099082+0000","last_unstale":"2023-12-24T18:55:22.104032+0000","last_undegraded":"2023-12-24T18:55:22.104032+0000","last_fullsized":"2023-12-24T18:55:22.104032+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084932+0000","last_change":"2023-12-24T18:55:21.090167+0000","last_active":"2023-12-24T18:55:22.084932+0000","last_peered":"2023-12-24T18:55:22.084932+0000","last_clean":"2023-12-24T18:55:22.084932+0000","last_became_active":"2023-12-24T18:55:21.089757+0000","last_became_peered":"2023-12-24T18:55:21.089757+0000","last_unstale":"2023-12-24T18:55:22.084932+0000","last_undegraded":"2023-12-24T18:55:22.084932+0000","last_fullsized":"2023-12-24T18:55:22.084932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:08.730010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109721+0000","last_change":"2023-12-24T18:55:22.106757+0000","last_active":"2023-12-24T18:55:22.109721+0000","last_peered":"2023-12-24T18:55:22.109721+0000","last_clean":"2023-12-24T18:55:22.109721+0000","last_became_active":"2023-12-24T18:55:22.104989+0000","last_became_peered":"2023-12-24T18:55:22.104989+0000","last_unstale":"2023-12-24T18:55:22.109721+0000","last_undegraded":"2023-12-24T18:55:22.109721+0000","last_fullsized":"2023-12-24T18:55:22.109721+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:18:39.833762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073236+0000","last_change":"2023-12-24T18:55:21.088939+0000","last_active":"2023-12-24T18:55:22.073236+0000","last_peered":"2023-12-24T18:55:22.073236+0000","last_clean":"2023-12-24T18:55:22.073236+0000","last_became_active":"2023-12-24T18:55:21.088650+0000","last_became_peered":"2023-12-24T18:55:21.088650+0000","last_unstale":"2023-12-24T18:55:22.073236+0000","last_undegraded":"2023-12-24T18:55:22.073236+0000","last_fullsized":"2023-12-24T18:55:22.073236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:59:27.843279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077335+0000","last_change":"2023-12-24T18:55:22.073146+0000","last_active":"2023-12-24T18:55:22.077335+0000","last_peered":"2023-12-24T18:55:22.077335+0000","last_clean":"2023-12-24T18:55:22.077335+0000","last_became_active":"2023-12-24T18:55:22.072836+0000","last_became_peered":"2023-12-24T18:55:22.072836+0000","last_unstale":"2023-12-24T18:55:22.077335+0000","last_undegraded":"2023-12-24T18:55:22.077335+0000","last_fullsized":"2023-12-24T18:55:22.077335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:55.939293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067679+0000","last_change":"2023-12-24T18:55:21.080495+0000","last_active":"2023-12-24T18:55:22.067679+0000","last_peered":"2023-12-24T18:55:22.067679+0000","last_clean":"2023-12-24T18:55:22.067679+0000","last_became_active":"2023-12-24T18:55:21.080225+0000","last_became_peered":"2023-12-24T18:55:21.080225+0000","last_unstale":"2023-12-24T18:55:22.067679+0000","last_undegraded":"2023-12-24T18:55:22.067679+0000","last_fullsized":"2023-12-24T18:55:22.067679+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:58.331073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.087164+0000","last_change":"2023-12-24T18:55:22.082161+0000","last_active":"2023-12-24T18:55:22.087164+0000","last_peered":"2023-12-24T18:55:22.087164+0000","last_clean":"2023-12-24T18:55:22.087164+0000","last_became_active":"2023-12-24T18:55:22.081880+0000","last_became_peered":"2023-12-24T18:55:22.081880+0000","last_unstale":"2023-12-24T18:55:22.087164+0000","last_undegraded":"2023-12-24T18:55:22.087164+0000","last_fullsized":"2023-12-24T18:55:22.087164+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:51:30.650282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"137'3","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.113033+0000","last_change":"2023-12-24T18:55:21.078641+0000","last_active":"2023-12-24T18:55:22.113033+0000","last_peered":"2023-12-24T18:55:22.113033+0000","last_clean":"2023-12-24T18:55:22.113033+0000","last_became_active":"2023-12-24T18:55:21.078366+0000","last_became_peered":"2023-12-24T18:55:21.078366+0000","last_unstale":"2023-12-24T18:55:22.113033+0000","last_undegraded":"2023-12-24T18:55:22.113033+0000","last_fullsized":"2023-12-24T18:55:22.113033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080845+0000","last_change":"2023-12-24T18:55:22.074643+0000","last_active":"2023-12-24T18:55:22.080845+0000","last_peered":"2023-12-24T18:55:22.080845+0000","last_clean":"2023-12-24T18:55:22.080845+0000","last_became_active":"2023-12-24T18:55:22.074330+0000","last_became_peered":"2023-12-24T18:55:22.074330+0000","last_unstale":"2023-12-24T18:55:22.080845+0000","last_undegraded":"2023-12-24T18:55:22.080845+0000","last_fullsized":"2023-12-24T18:55:22.080845+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:07.951825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"137'6","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.117411+0000","last_change":"2023-12-24T18:55:21.092377+0000","last_active":"2023-12-24T18:55:22.117411+0000","last_peered":"2023-12-24T18:55:22.117411+0000","last_clean":"2023-12-24T18:55:22.117411+0000","last_became_active":"2023-12-24T18:55:21.092084+0000","last_became_peered":"2023-12-24T18:55:21.092084+0000","last_unstale":"2023-12-24T18:55:22.117411+0000","last_undegraded":"2023-12-24T18:55:22.117411+0000","last_fullsized":"2023-12-24T18:55:22.117411+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:17.053903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.077597+0000","last_change":"2023-12-24T18:55:22.073910+0000","last_active":"2023-12-24T18:55:22.077597+0000","last_peered":"2023-12-24T18:55:22.077597+0000","last_clean":"2023-12-24T18:55:22.077597+0000","last_became_active":"2023-12-24T18:55:22.073616+0000","last_became_peered":"2023-12-24T18:55:22.073616+0000","last_unstale":"2023-12-24T18:55:22.077597+0000","last_undegraded":"2023-12-24T18:55:22.077597+0000","last_fullsized":"2023-12-24T18:55:22.077597+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:06.863671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114401+0000","last_change":"2023-12-24T18:55:21.089113+0000","last_active":"2023-12-24T18:55:22.114401+0000","last_peered":"2023-12-24T18:55:22.114401+0000","last_clean":"2023-12-24T18:55:22.114401+0000","last_became_active":"2023-12-24T18:55:21.088760+0000","last_became_peered":"2023-12-24T18:55:21.088760+0000","last_unstale":"2023-12-24T18:55:22.114401+0000","last_undegraded":"2023-12-24T18:55:22.114401+0000","last_fullsized":"2023-12-24T18:55:22.114401+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:58.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.108628+0000","last_change":"2023-12-24T18:55:22.107529+0000","last_active":"2023-12-24T18:55:22.108628+0000","last_peered":"2023-12-24T18:55:22.108628+0000","last_clean":"2023-12-24T18:55:22.108628+0000","last_became_active":"2023-12-24T18:55:22.107153+0000","last_became_peered":"2023-12-24T18:55:22.107153+0000","last_unstale":"2023-12-24T18:55:22.108628+0000","last_undegraded":"2023-12-24T18:55:22.108628+0000","last_fullsized":"2023-12-24T18:55:22.108628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:14.470699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.068686+0000","last_change":"2023-12-24T18:55:21.093874+0000","last_active":"2023-12-24T18:55:22.068686+0000","last_peered":"2023-12-24T18:55:22.068686+0000","last_clean":"2023-12-24T18:55:22.068686+0000","last_became_active":"2023-12-24T18:55:21.093482+0000","last_became_peered":"2023-12-24T18:55:21.093482+0000","last_unstale":"2023-12-24T18:55:22.068686+0000","last_undegraded":"2023-12-24T18:55:22.068686+0000","last_fullsized":"2023-12-24T18:55:22.068686+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:41.481631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.090075+0000","last_change":"2023-12-24T18:55:22.086343+0000","last_active":"2023-12-24T18:55:22.090075+0000","last_peered":"2023-12-24T18:55:22.090075+0000","last_clean":"2023-12-24T18:55:22.090075+0000","last_became_active":"2023-12-24T18:55:22.086016+0000","last_became_peered":"2023-12-24T18:55:22.086016+0000","last_unstale":"2023-12-24T18:55:22.090075+0000","last_undegraded":"2023-12-24T18:55:22.090075+0000","last_fullsized":"2023-12-24T18:55:22.090075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:16:32.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067600+0000","last_change":"2023-12-24T18:55:21.080310+0000","last_active":"2023-12-24T18:55:22.067600+0000","last_peered":"2023-12-24T18:55:22.067600+0000","last_clean":"2023-12-24T18:55:22.067600+0000","last_became_active":"2023-12-24T18:55:21.080025+0000","last_became_peered":"2023-12-24T18:55:21.080025+0000","last_unstale":"2023-12-24T18:55:22.067600+0000","last_undegraded":"2023-12-24T18:55:22.067600+0000","last_fullsized":"2023-12-24T18:55:22.067600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:04:54.924873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102862+0000","last_change":"2023-12-24T18:55:22.095747+0000","last_active":"2023-12-24T18:55:22.102862+0000","last_peered":"2023-12-24T18:55:22.102862+0000","last_clean":"2023-12-24T18:55:22.102862+0000","last_became_active":"2023-12-24T18:55:22.094908+0000","last_became_peered":"2023-12-24T18:55:22.094908+0000","last_unstale":"2023-12-24T18:55:22.102862+0000","last_undegraded":"2023-12-24T18:55:22.102862+0000","last_fullsized":"2023-12-24T18:55:22.102862+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:19.742781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109827+0000","last_change":"2023-12-24T18:55:21.076718+0000","last_active":"2023-12-24T18:55:22.109827+0000","last_peered":"2023-12-24T18:55:22.109827+0000","last_clean":"2023-12-24T18:55:22.109827+0000","last_became_active":"2023-12-24T18:55:21.075930+0000","last_became_peered":"2023-12-24T18:55:21.075930+0000","last_unstale":"2023-12-24T18:55:22.109827+0000","last_undegraded":"2023-12-24T18:55:22.109827+0000","last_fullsized":"2023-12-24T18:55:22.109827+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:32.534509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.083446+0000","last_change":"2023-12-24T18:55:22.081394+0000","last_active":"2023-12-24T18:55:22.083446+0000","last_peered":"2023-12-24T18:55:22.083446+0000","last_clean":"2023-12-24T18:55:22.083446+0000","last_became_active":"2023-12-24T18:55:22.080887+0000","last_became_peered":"2023-12-24T18:55:22.080887+0000","last_unstale":"2023-12-24T18:55:22.083446+0000","last_undegraded":"2023-12-24T18:55:22.083446+0000","last_fullsized":"2023-12-24T18:55:22.083446+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T18:59:04.496969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.111798+0000","last_change":"2023-12-24T18:55:21.087219+0000","last_active":"2023-12-24T18:55:22.111798+0000","last_peered":"2023-12-24T18:55:22.111798+0000","last_clean":"2023-12-24T18:55:22.111798+0000","last_became_active":"2023-12-24T18:55:21.083119+0000","last_became_peered":"2023-12-24T18:55:21.083119+0000","last_unstale":"2023-12-24T18:55:22.111798+0000","last_undegraded":"2023-12-24T18:55:22.111798+0000","last_fullsized":"2023-12-24T18:55:22.111798+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:37.748882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.106095+0000","last_change":"2023-12-24T18:55:22.102404+0000","last_active":"2023-12-24T18:55:22.106095+0000","last_peered":"2023-12-24T18:55:22.106095+0000","last_clean":"2023-12-24T18:55:22.106095+0000","last_became_active":"2023-12-24T18:55:22.102077+0000","last_became_peered":"2023-12-24T18:55:22.102077+0000","last_unstale":"2023-12-24T18:55:22.106095+0000","last_undegraded":"2023-12-24T18:55:22.106095+0000","last_fullsized":"2023-12-24T18:55:22.106095+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:01.214425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114407+0000","last_change":"2023-12-24T18:55:21.082395+0000","last_active":"2023-12-24T18:55:22.114407+0000","last_peered":"2023-12-24T18:55:22.114407+0000","last_clean":"2023-12-24T18:55:22.114407+0000","last_became_active":"2023-12-24T18:55:21.082059+0000","last_became_peered":"2023-12-24T18:55:21.082059+0000","last_unstale":"2023-12-24T18:55:22.114407+0000","last_undegraded":"2023-12-24T18:55:22.114407+0000","last_fullsized":"2023-12-24T18:55:22.114407+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:00.946201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.103131+0000","last_change":"2023-12-24T18:55:22.095134+0000","last_active":"2023-12-24T18:55:22.103131+0000","last_peered":"2023-12-24T18:55:22.103131+0000","last_clean":"2023-12-24T18:55:22.103131+0000","last_became_active":"2023-12-24T18:55:22.093865+0000","last_became_peered":"2023-12-24T18:55:22.093865+0000","last_unstale":"2023-12-24T18:55:22.103131+0000","last_undegraded":"2023-12-24T18:55:22.103131+0000","last_fullsized":"2023-12-24T18:55:22.103131+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:18.068322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089216+0000","last_change":"2023-12-24T18:55:21.090898+0000","last_active":"2023-12-24T18:55:22.089216+0000","last_peered":"2023-12-24T18:55:22.089216+0000","last_clean":"2023-12-24T18:55:22.089216+0000","last_became_active":"2023-12-24T18:55:21.090572+0000","last_became_peered":"2023-12-24T18:55:21.090572+0000","last_unstale":"2023-12-24T18:55:22.089216+0000","last_undegraded":"2023-12-24T18:55:22.089216+0000","last_fullsized":"2023-12-24T18:55:22.089216+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:08.851724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.109238+0000","last_change":"2023-12-24T18:55:22.103413+0000","last_active":"2023-12-24T18:55:22.109238+0000","last_peered":"2023-12-24T18:55:22.109238+0000","last_clean":"2023-12-24T18:55:22.109238+0000","last_became_active":"2023-12-24T18:55:22.103088+0000","last_became_peered":"2023-12-24T18:55:22.103088+0000","last_unstale":"2023-12-24T18:55:22.109238+0000","last_undegraded":"2023-12-24T18:55:22.109238+0000","last_fullsized":"2023-12-24T18:55:22.109238+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:49.143382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114661+0000","last_change":"2023-12-24T18:55:21.086800+0000","last_active":"2023-12-24T18:55:22.114661+0000","last_peered":"2023-12-24T18:55:22.114661+0000","last_clean":"2023-12-24T18:55:22.114661+0000","last_became_active":"2023-12-24T18:55:21.086450+0000","last_became_peered":"2023-12-24T18:55:21.086450+0000","last_unstale":"2023-12-24T18:55:22.114661+0000","last_undegraded":"2023-12-24T18:55:22.114661+0000","last_fullsized":"2023-12-24T18:55:22.114661+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:51.546049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.076738+0000","last_change":"2023-12-24T18:55:22.075399+0000","last_active":"2023-12-24T18:55:22.076738+0000","last_peered":"2023-12-24T18:55:22.076738+0000","last_clean":"2023-12-24T18:55:22.076738+0000","last_became_active":"2023-12-24T18:55:22.075027+0000","last_became_peered":"2023-12-24T18:55:22.075027+0000","last_unstale":"2023-12-24T18:55:22.076738+0000","last_undegraded":"2023-12-24T18:55:22.076738+0000","last_fullsized":"2023-12-24T18:55:22.076738+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:42.735862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.082579+0000","last_change":"2023-12-24T18:55:21.079827+0000","last_active":"2023-12-24T18:55:22.082579+0000","last_peered":"2023-12-24T18:55:22.082579+0000","last_clean":"2023-12-24T18:55:22.082579+0000","last_became_active":"2023-12-24T18:55:21.079474+0000","last_became_peered":"2023-12-24T18:55:21.079474+0000","last_unstale":"2023-12-24T18:55:22.082579+0000","last_undegraded":"2023-12-24T18:55:22.082579+0000","last_fullsized":"2023-12-24T18:55:22.082579+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:54:50.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084963+0000","last_change":"2023-12-24T18:55:22.081573+0000","last_active":"2023-12-24T18:55:22.084963+0000","last_peered":"2023-12-24T18:55:22.084963+0000","last_clean":"2023-12-24T18:55:22.084963+0000","last_became_active":"2023-12-24T18:55:22.081244+0000","last_became_peered":"2023-12-24T18:55:22.081244+0000","last_unstale":"2023-12-24T18:55:22.084963+0000","last_undegraded":"2023-12-24T18:55:22.084963+0000","last_fullsized":"2023-12-24T18:55:22.084963+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:05.875441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.067527+0000","last_change":"2023-12-24T18:55:21.095311+0000","last_active":"2023-12-24T18:55:22.067527+0000","last_peered":"2023-12-24T18:55:22.067527+0000","last_clean":"2023-12-24T18:55:22.067527+0000","last_became_active":"2023-12-24T18:55:21.094916+0000","last_became_peered":"2023-12-24T18:55:21.094916+0000","last_unstale":"2023-12-24T18:55:22.067527+0000","last_undegraded":"2023-12-24T18:55:22.067527+0000","last_fullsized":"2023-12-24T18:55:22.067527+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:18.728361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.081891+0000","last_change":"2023-12-24T18:55:22.076037+0000","last_active":"2023-12-24T18:55:22.081891+0000","last_peered":"2023-12-24T18:55:22.081891+0000","last_clean":"2023-12-24T18:55:22.081891+0000","last_became_active":"2023-12-24T18:55:22.075733+0000","last_became_peered":"2023-12-24T18:55:22.075733+0000","last_unstale":"2023-12-24T18:55:22.081891+0000","last_undegraded":"2023-12-24T18:55:22.081891+0000","last_fullsized":"2023-12-24T18:55:22.081891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079588+0000","last_change":"2023-12-24T18:55:21.085933+0000","last_active":"2023-12-24T18:55:22.079588+0000","last_peered":"2023-12-24T18:55:22.079588+0000","last_clean":"2023-12-24T18:55:22.079588+0000","last_became_active":"2023-12-24T18:55:21.085671+0000","last_became_peered":"2023-12-24T18:55:21.085671+0000","last_unstale":"2023-12-24T18:55:22.079588+0000","last_undegraded":"2023-12-24T18:55:22.079588+0000","last_fullsized":"2023-12-24T18:55:22.079588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:58:27.345947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.105096+0000","last_change":"2023-12-24T18:55:22.096700+0000","last_active":"2023-12-24T18:55:22.105096+0000","last_peered":"2023-12-24T18:55:22.105096+0000","last_clean":"2023-12-24T18:55:22.105096+0000","last_became_active":"2023-12-24T18:55:22.095715+0000","last_became_peered":"2023-12-24T18:55:22.095715+0000","last_unstale":"2023-12-24T18:55:22.105096+0000","last_undegraded":"2023-12-24T18:55:22.105096+0000","last_fullsized":"2023-12-24T18:55:22.105096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:32:20.931474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.110182+0000","last_change":"2023-12-24T18:55:21.085062+0000","last_active":"2023-12-24T18:55:22.110182+0000","last_peered":"2023-12-24T18:55:22.110182+0000","last_clean":"2023-12-24T18:55:22.110182+0000","last_became_active":"2023-12-24T18:55:21.081179+0000","last_became_peered":"2023-12-24T18:55:21.081179+0000","last_unstale":"2023-12-24T18:55:22.110182+0000","last_undegraded":"2023-12-24T18:55:22.110182+0000","last_fullsized":"2023-12-24T18:55:22.110182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:04.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.096943+0000","last_change":"2023-12-24T18:55:22.093633+0000","last_active":"2023-12-24T18:55:22.096943+0000","last_peered":"2023-12-24T18:55:22.096943+0000","last_clean":"2023-12-24T18:55:22.096943+0000","last_became_active":"2023-12-24T18:55:22.093326+0000","last_became_peered":"2023-12-24T18:55:22.093326+0000","last_unstale":"2023-12-24T18:55:22.096943+0000","last_undegraded":"2023-12-24T18:55:22.096943+0000","last_fullsized":"2023-12-24T18:55:22.096943+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.135298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-12-24T18:55:23.295239+0000","last_change":"2023-12-24T18:55:21.088707+0000","last_active":"2023-12-24T18:55:23.295239+0000","last_peered":"2023-12-24T18:55:23.295239+0000","last_clean":"2023-12-24T18:55:23.295239+0000","last_became_active":"2023-12-24T18:55:21.088283+0000","last_became_peered":"2023-12-24T18:55:21.088283+0000","last_unstale":"2023-12-24T18:55:23.295239+0000","last_undegraded":"2023-12-24T18:55:23.295239+0000","last_fullsized":"2023-12-24T18:55:23.295239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:03.351199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114104+0000","last_change":"2023-12-24T18:55:22.110551+0000","last_active":"2023-12-24T18:55:22.114104+0000","last_peered":"2023-12-24T18:55:22.114104+0000","last_clean":"2023-12-24T18:55:22.114104+0000","last_became_active":"2023-12-24T18:55:22.107498+0000","last_became_peered":"2023-12-24T18:55:22.107498+0000","last_unstale":"2023-12-24T18:55:22.114104+0000","last_undegraded":"2023-12-24T18:55:22.114104+0000","last_fullsized":"2023-12-24T18:55:22.114104+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:42:49.885276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.073231+0000","last_change":"2023-12-24T18:55:21.088766+0000","last_active":"2023-12-24T18:55:22.073231+0000","last_peered":"2023-12-24T18:55:22.073231+0000","last_clean":"2023-12-24T18:55:22.073231+0000","last_became_active":"2023-12-24T18:55:21.088307+0000","last_became_peered":"2023-12-24T18:55:21.088307+0000","last_unstale":"2023-12-24T18:55:22.073231+0000","last_undegraded":"2023-12-24T18:55:22.073231+0000","last_fullsized":"2023-12-24T18:55:22.073231+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:44.220353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.085396+0000","last_change":"2023-12-24T18:55:22.082688+0000","last_active":"2023-12-24T18:55:22.085396+0000","last_peered":"2023-12-24T18:55:22.085396+0000","last_clean":"2023-12-24T18:55:22.085396+0000","last_became_active":"2023-12-24T18:55:22.082325+0000","last_became_peered":"2023-12-24T18:55:22.082325+0000","last_unstale":"2023-12-24T18:55:22.085396+0000","last_undegraded":"2023-12-24T18:55:22.085396+0000","last_fullsized":"2023-12-24T18:55:22.085396+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:06.468022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.089664+0000","last_change":"2023-12-24T18:55:21.084343+0000","last_active":"2023-12-24T18:55:22.089664+0000","last_peered":"2023-12-24T18:55:22.089664+0000","last_clean":"2023-12-24T18:55:22.089664+0000","last_became_active":"2023-12-24T18:55:21.082198+0000","last_became_peered":"2023-12-24T18:55:21.082198+0000","last_unstale":"2023-12-24T18:55:22.089664+0000","last_undegraded":"2023-12-24T18:55:22.089664+0000","last_fullsized":"2023-12-24T18:55:22.089664+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:00:55.640665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.102924+0000","last_change":"2023-12-24T18:55:22.093372+0000","last_active":"2023-12-24T18:55:22.102924+0000","last_peered":"2023-12-24T18:55:22.102924+0000","last_clean":"2023-12-24T18:55:22.102924+0000","last_became_active":"2023-12-24T18:55:22.093060+0000","last_became_peered":"2023-12-24T18:55:22.093060+0000","last_unstale":"2023-12-24T18:55:22.102924+0000","last_undegraded":"2023-12-24T18:55:22.102924+0000","last_fullsized":"2023-12-24T18:55:22.102924+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:41.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080358+0000","last_change":"2023-12-24T18:55:21.069946+0000","last_active":"2023-12-24T18:55:22.080358+0000","last_peered":"2023-12-24T18:55:22.080358+0000","last_clean":"2023-12-24T18:55:22.080358+0000","last_became_active":"2023-12-24T18:55:21.069437+0000","last_became_peered":"2023-12-24T18:55:21.069437+0000","last_unstale":"2023-12-24T18:55:22.080358+0000","last_undegraded":"2023-12-24T18:55:22.080358+0000","last_fullsized":"2023-12-24T18:55:22.080358+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:26:12.873055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084365+0000","last_change":"2023-12-24T18:55:22.080923+0000","last_active":"2023-12-24T18:55:22.084365+0000","last_peered":"2023-12-24T18:55:22.084365+0000","last_clean":"2023-12-24T18:55:22.084365+0000","last_became_active":"2023-12-24T18:55:22.077821+0000","last_became_peered":"2023-12-24T18:55:22.077821+0000","last_unstale":"2023-12-24T18:55:22.084365+0000","last_undegraded":"2023-12-24T18:55:22.084365+0000","last_fullsized":"2023-12-24T18:55:22.084365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:30:43.292012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.080960+0000","last_change":"2023-12-24T18:55:21.078650+0000","last_active":"2023-12-24T18:55:22.080960+0000","last_peered":"2023-12-24T18:55:22.080960+0000","last_clean":"2023-12-24T18:55:22.080960+0000","last_became_active":"2023-12-24T18:55:21.077562+0000","last_became_peered":"2023-12-24T18:55:21.077562+0000","last_unstale":"2023-12-24T18:55:22.080960+0000","last_undegraded":"2023-12-24T18:55:22.080960+0000","last_fullsized":"2023-12-24T18:55:22.080960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:55:13.456279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114040+0000","last_change":"2023-12-24T18:55:22.110134+0000","last_active":"2023-12-24T18:55:22.114040+0000","last_peered":"2023-12-24T18:55:22.114040+0000","last_clean":"2023-12-24T18:55:22.114040+0000","last_became_active":"2023-12-24T18:55:22.109510+0000","last_became_peered":"2023-12-24T18:55:22.109510+0000","last_unstale":"2023-12-24T18:55:22.114040+0000","last_undegraded":"2023-12-24T18:55:22.114040+0000","last_fullsized":"2023-12-24T18:55:22.114040+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T19:45:59.986487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.084580+0000","last_change":"2023-12-24T18:55:21.089745+0000","last_active":"2023-12-24T18:55:22.084580+0000","last_peered":"2023-12-24T18:55:22.084580+0000","last_clean":"2023-12-24T18:55:22.084580+0000","last_became_active":"2023-12-24T18:55:21.089430+0000","last_became_peered":"2023-12-24T18:55:21.089430+0000","last_unstale":"2023-12-24T18:55:22.084580+0000","last_undegraded":"2023-12-24T18:55:22.084580+0000","last_fullsized":"2023-12-24T18:55:22.084580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:22.484132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.099335+0000","last_change":"2023-12-24T18:55:22.095115+0000","last_active":"2023-12-24T18:55:22.099335+0000","last_peered":"2023-12-24T18:55:22.099335+0000","last_clean":"2023-12-24T18:55:22.099335+0000","last_became_active":"2023-12-24T18:55:22.094790+0000","last_became_peered":"2023-12-24T18:55:22.094790+0000","last_unstale":"2023-12-24T18:55:22.099335+0000","last_undegraded":"2023-12-24T18:55:22.099335+0000","last_fullsized":"2023-12-24T18:55:22.099335+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:30.865777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079705+0000","last_change":"2023-12-24T18:55:21.080958+0000","last_active":"2023-12-24T18:55:22.079705+0000","last_peered":"2023-12-24T18:55:22.079705+0000","last_clean":"2023-12-24T18:55:22.079705+0000","last_became_active":"2023-12-24T18:55:21.080584+0000","last_became_peered":"2023-12-24T18:55:21.080584+0000","last_unstale":"2023-12-24T18:55:22.079705+0000","last_undegraded":"2023-12-24T18:55:22.079705+0000","last_fullsized":"2023-12-24T18:55:22.079705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:38:38.451864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.114170+0000","last_change":"2023-12-24T18:55:22.111324+0000","last_active":"2023-12-24T18:55:22.114170+0000","last_peered":"2023-12-24T18:55:22.114170+0000","last_clean":"2023-12-24T18:55:22.114170+0000","last_became_active":"2023-12-24T18:55:22.110834+0000","last_became_peered":"2023-12-24T18:55:22.110834+0000","last_unstale":"2023-12-24T18:55:22.114170+0000","last_undegraded":"2023-12-24T18:55:22.114170+0000","last_fullsized":"2023-12-24T18:55:22.114170+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:21.041170+0000","last_clean_scrub_stamp":"2023-12-24T18:55:21.041170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:16:42.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"137'8","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.116399+0000","last_change":"2023-12-24T18:55:21.081128+0000","last_active":"2023-12-24T18:55:22.116399+0000","last_peered":"2023-12-24T18:55:22.116399+0000","last_clean":"2023-12-24T18:55:22.116399+0000","last_became_active":"2023-12-24T18:55:21.080859+0000","last_became_peered":"2023-12-24T18:55:21.080859+0000","last_unstale":"2023-12-24T18:55:22.116399+0000","last_undegraded":"2023-12-24T18:55:22.116399+0000","last_fullsized":"2023-12-24T18:55:22.116399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:55:20.026751+0000","last_clean_scrub_stamp":"2023-12-24T18:55:20.026751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:06.937406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":722,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-24T18:55:22.079898+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T18:55:22.079898+0000","last_peered":"2023-12-24T18:55:22.079898+0000","last_clean":"2023-12-24T18:55:22.079898+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T18:55:22.079898+0000","last_undegraded":"2023-12-24T18:55:22.079898+0000","last_fullsized":"2023-12-24T18:55:22.079898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311848,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059992,"statfs":{"total":96636764160,"available":96317431808,"internally_reserved":0,"allocated":2326528,"data_stored":1471486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1279999999999999},"min":{"1min":0.79800000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4790000000000001,"5min":1.6579999999999999,"15min":1.784},"last":1.498},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.54800000000000004},"max":{"1min":1.657,"5min":1.6910000000000001,"15min":1.756},"last":1.4019999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.127,"15min":1.133},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5009999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.351},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2050000000000001},"min":{"1min":0.84599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.8129999999999999},"last":1.4650000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.2050000000000001},"min":{"1min":0.89600000000000002,"5min":0.64800000000000002,"15min":0.59299999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.625},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.579,"5min":1.595,"15min":1.6799999999999999},"last":1.2689999999999999}]},{"osd":3,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.264,"15min":1.2769999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.71399999999999997},"max":{"1min":1.5429999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5780000000000001,"5min":1.623,"15min":2.1859999999999999},"last":1.5489999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1759999999999999,"15min":1.165},"min":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"max":{"1min":1.595,"5min":1.7450000000000001,"15min":1.8109999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.2170000000000001,"15min":1.26},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.661,"5min":1.6719999999999999,"15min":2.1160000000000001},"last":0.98499999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2529999999999999,"15min":1.2709999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.59899999999999998},"max":{"1min":1.575,"5min":1.6299999999999999,"15min":1.8879999999999999},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3360000000000001,"15min":1.3240000000000001},"min":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.68600000000000005},"max":{"1min":1.837,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.1100000000000001}]},{"osd":6,"last update":"Sun Dec 24 18:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4099999999999999,"15min":1.4059999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.9019999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.333},{"interface":"front","average":{"1min":1.337,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.748,"5min":1.917,"15min":1.917},"last":1.635}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2629999999999999,"15min":1.2509999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.47799999999999998},"max":{"1min":1.4670000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":1.504},{"interface":"front","average":{"1min":1.306,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.71299999999999997},"max":{"1min":1.4810000000000001,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":1.609}]},{"osd":1,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.86099999999999999,"5min":0.58499999999999996,"15min":0.54400000000000004},"max":{"1min":1.4299999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.276},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.238,"15min":1.216},"min":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6000000000000001,"5min":3.081,"15min":3.081},"last":1.0580000000000001}]},{"osd":2,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.82399999999999995,"5min":0.70599999999999996,"15min":0.59699999999999998},"max":{"1min":1.5449999999999999,"5min":2.173,"15min":2.173},"last":1.234},{"interface":"front","average":{"1min":1.25,"5min":1.2430000000000001,"15min":1.24},"min":{"1min":0.83099999999999996,"5min":0.72199999999999998,"15min":0.71799999999999997},"max":{"1min":1.6819999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":1.1870000000000001}]},{"osd":3,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3380000000000001,"15min":1.282},"min":{"1min":1.0700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5329999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.286,"15min":1.266},"min":{"1min":0.88800000000000001,"5min":0.73799999999999999,"15min":0.65500000000000003},"max":{"1min":1.5149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.359}]},{"osd":4,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1990000000000001,"15min":1.1819999999999999},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.53100000000000003},"max":{"1min":1.6299999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.274,"15min":1.238},"min":{"1min":0.82999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.595,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3140000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.1930000000000001},"min":{"1min":0.95699999999999996,"5min":0.73399999999999999,"15min":0.59399999999999997},"max":{"1min":1.409,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.472},{"interface":"front","average":{"1min":1.306,"5min":1.383,"15min":1.339},"min":{"1min":0.75,"5min":0.75,"15min":0.622},"max":{"1min":1.76,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":1.397}]},{"osd":7,"last update":"Sun Dec 24 18:55:04 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.409,"15min":1.3660000000000001},"min":{"1min":1.038,"5min":0.80900000000000005,"15min":0.73999999999999999},"max":{"1min":1.9830000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.363},"min":{"1min":1.107,"5min":0.80200000000000005,"15min":0.58799999999999997},"max":{"1min":1.611,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.4239999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303068,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068772,"statfs":{"total":96636764160,"available":96326422528,"internally_reserved":0,"allocated":1724416,"data_stored":880530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.155,"15min":1.1890000000000001},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.292,"15min":1.2989999999999999},"min":{"1min":0.81000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.839,"15min":1.859},"last":1.143}]},{"osd":1,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.7350000000000001,"15min":1.8029999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.159,"15min":1.159},"min":{"1min":0.83999999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.91300000000000003}]},{"osd":2,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.202},"min":{"1min":0.875,"5min":0.70999999999999996,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.226},"min":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.72199999999999998},"max":{"1min":1.5629999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.98199999999999998}]},{"osd":3,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.876,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4610000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.276,"15min":1.296},"min":{"1min":0.879,"5min":0.78700000000000003,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.706,"15min":1.786},"last":1.1100000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.141},"min":{"1min":0.75600000000000001,"5min":0.65000000000000002,"15min":0.50600000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.278,"15min":1.246},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.57699999999999996},"max":{"1min":1.8460000000000001,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.236}]},{"osd":6,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.298,"15min":1.2709999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.61699999999999999},"max":{"1min":1.7170000000000001,"5min":1.861,"15min":1.909},"last":1.181},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.292,"15min":1.2969999999999999},"min":{"1min":0.85599999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.206}]},{"osd":7,"last update":"Sun Dec 24 18:54:55 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.383,"15min":1.379},"min":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.872},"max":{"1min":1.9099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.351},{"interface":"front","average":{"1min":1.393,"5min":1.3959999999999999,"15min":1.3999999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.64600000000000002},"max":{"1min":1.796,"5min":1.9490000000000001,"15min":2.0939999999999999},"last":1.3260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":881906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2030000000000001,"15min":1.198},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.54000000000000004},"max":{"1min":1.7070000000000001,"5min":1.835,"15min":1.835},"last":1.419},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.246},"min":{"1min":0.91600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4319999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.145,"15min":1.145},"min":{"1min":0.86899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.141,"15min":1.1379999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4950000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.248}]},{"osd":2,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.294},"min":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.55,"5min":1.952,"15min":1.952},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.29,"15min":1.2989999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.76,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.462}]},{"osd":3,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.76000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.522},{"interface":"front","average":{"1min":1.121,"5min":1.216,"15min":1.2629999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.675,"5min":1.7669999999999999,"15min":1.839},"last":1.387}]},{"osd":5,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.623},"max":{"1min":2.0019999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.359},{"interface":"front","average":{"1min":1.216,"5min":1.286,"15min":1.296},"min":{"1min":0.753,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.202}]},{"osd":6,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2529999999999999,"15min":1.2749999999999999},"min":{"1min":0.77900000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6779999999999999,"5min":1.823,"15min":1.881},"last":0.997},{"interface":"front","average":{"1min":1.282,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8100000000000001,"5min":1.909,"15min":2.0760000000000001},"last":1.1140000000000001}]},{"osd":7,"last update":"Sun Dec 24 18:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2769999999999999,"15min":1.2889999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.7250000000000001,"5min":1.8600000000000001,"15min":1.8680000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.84099999999999997,"5min":0.747,"15min":0.71399999999999997},"max":{"1min":1.8300000000000001,"5min":1.877,"15min":1.9359999999999999},"last":1.282}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307172,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064668,"statfs":{"total":96636764160,"available":96322220032,"internally_reserved":0,"allocated":1732608,"data_stored":881940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94999999999999996,"15min":0.94799999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.266,"5min":3.4260000000000002,"15min":3.4260000000000002},"last":1.198},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.093},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.46000000000000002},"max":{"1min":1.492,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.0229999999999999}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.57099999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.569,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.117,"5min":1.145,"15min":1.1870000000000001},"min":{"1min":0.66600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.4279999999999999}]},{"osd":2,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.081,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8560000000000001,"5min":2.363,"15min":2.363},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1319999999999999,"15min":1.159},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6240000000000001,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":1.327}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.258},"min":{"1min":0.83399999999999996,"5min":0.71899999999999997,"15min":0.64600000000000002},"max":{"1min":1.609,"5min":6.8289999999999997,"15min":6.8289999999999997},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.323,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.319,"5min":2.944,"15min":2.944},"last":1.2569999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.391,"15min":1.3899999999999999},"min":{"1min":1.0629999999999999,"5min":0.86799999999999999,"15min":0.84499999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.427},"min":{"1min":1.042,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.895,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":1.629}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4399999999999999,"15min":1.4610000000000001},"min":{"1min":1.111,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.841,"5min":5.4400000000000004,"15min":5.4400000000000004},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.405,"15min":1.411},"min":{"1min":1.04,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8029999999999999,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.0629999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4510000000000001,"15min":1.454},"min":{"1min":1.131,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.883,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"min":{"1min":1.075,"5min":0.755,"15min":0.755},"max":{"1min":2.4430000000000001,"5min":5.3070000000000004,"15min":5.3070000000000004},"last":1.369}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":880370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64800000000000002,"5min":0.501,"15min":0.34499999999999997},"max":{"1min":1.1910000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.056,"15min":1.0609999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.50900000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5229999999999999},"last":0.94599999999999995}]},{"osd":1,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.57599999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3180000000000001,"5min":1.78,"15min":1.78},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.53800000000000003},"max":{"1min":1.5620000000000001,"5min":1.6519999999999999,"15min":1.976},"last":1.024}]},{"osd":3,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.127,"15min":1.137},"min":{"1min":0.77600000000000002,"5min":0.71099999999999997,"15min":0.441},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0629999999999999,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.48299999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.0549999999999999}]},{"osd":4,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.306,"15min":1.3080000000000001},"min":{"1min":1.101,"5min":0.86299999999999999,"15min":0.68899999999999995},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.3169999999999999,"15min":1.29},"min":{"1min":1.0309999999999999,"5min":0.92500000000000004,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":1.798,"15min":1.798},"last":1.2829999999999999}]},{"osd":5,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.325,"15min":1.2869999999999999},"min":{"1min":1.01,"5min":0.83699999999999997,"15min":0.496},"max":{"1min":1.748,"5min":2.069,"15min":2.069},"last":1.373},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.3759999999999999,"15min":1.365},"min":{"1min":1.044,"5min":0.94199999999999995,"15min":0.82999999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.4019999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.4019999999999999},"min":{"1min":1.2010000000000001,"5min":1.0209999999999999,"15min":0.72399999999999998},"max":{"1min":1.718,"5min":1.9970000000000001,"15min":2.0019999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.429,"15min":1.401},"min":{"1min":1.1419999999999999,"5min":0.95199999999999996,"15min":0.71599999999999997},"max":{"1min":1.841,"5min":1.9319999999999999,"15min":2.093},"last":1.5109999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:54:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4770000000000001,"15min":1.4570000000000001},"min":{"1min":1.2270000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.4870000000000001,"15min":1.472},"min":{"1min":1.2729999999999999,"5min":0.94999999999999996,"15min":0.84999999999999998},"max":{"1min":1.879,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.117}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":880392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98799999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51000000000000001},"max":{"1min":1.3200000000000001,"5min":1.663,"15min":1.8149999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.095,"15min":1.123},"min":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.829},"last":1.139}]},{"osd":2,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"max":{"1min":1.498,"5min":1.498,"15min":1.5349999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.115},"min":{"1min":0.63800000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.486,"5min":1.73,"15min":1.7410000000000001},"last":0.876}]},{"osd":3,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.262,"15min":1.254},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.595,"5min":1.823,"15min":1.915},"last":1.218},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.111,"15min":1.093},"min":{"1min":0.753,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6839999999999999,"5min":1.9410000000000001,"15min":2.3290000000000002},"last":0.81599999999999995}]},{"osd":4,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.92400000000000004,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":1.724},"last":1.343},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.413,"15min":1.405},"min":{"1min":1.089,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.9179999999999999,"5min":2.1930000000000001,"15min":2.3130000000000002},"last":1.3100000000000001}]},{"osd":5,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3959999999999999,"15min":1.385},"min":{"1min":1.0840000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.621,"5min":1.887,"15min":1.9790000000000001},"last":1.409},{"interface":"front","average":{"1min":1.365,"5min":1.3520000000000001,"15min":1.353},"min":{"1min":0.99399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.786,"5min":1.8140000000000001,"15min":2.0089999999999999},"last":1.093}]},{"osd":6,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.5,"15min":1.49},"min":{"1min":1.21,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0249999999999999,"5min":2.1269999999999998,"15min":2.3860000000000001},"last":1.452},{"interface":"front","average":{"1min":1.526,"5min":1.4550000000000001,"15min":1.4630000000000001},"min":{"1min":1.2230000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":2.1749999999999998},"last":1.488}]},{"osd":7,"last update":"Sun Dec 24 18:54:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.516,"15min":1.5229999999999999},"min":{"1min":1.1739999999999999,"5min":1.0549999999999999,"15min":0.754},"max":{"1min":2.0099999999999998,"5min":2.0219999999999998,"15min":2.3540000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.472,"15min":1.4610000000000001},"min":{"1min":1.133,"5min":0.876,"15min":0.876},"max":{"1min":1.897,"5min":1.919,"15min":2.1160000000000001},"last":1.1870000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575074,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1470760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.206,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.117},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.069,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.629,"15min":0.627},"max":{"1min":1.5469999999999999,"5min":1.5649999999999999,"15min":1.7},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0720000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.58099999999999996},"max":{"1min":1.4379999999999999,"5min":1.631,"15min":2.8130000000000002},"last":1.377}]},{"osd":3,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.69699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.87},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2250000000000001,"15min":1.234},"min":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6200000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.2410000000000001}]},{"osd":4,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.335,"15min":1.345},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6359999999999999,"5min":1.8120000000000001,"15min":2.0009999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.252,"15min":1.2789999999999999},"min":{"1min":0.84999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.762},"last":1.004}]},{"osd":5,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.391,"15min":1.3839999999999999},"min":{"1min":1.1639999999999999,"5min":0.89800000000000002,"15min":0.85499999999999998},"max":{"1min":1.798,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3640000000000001,"15min":1.399},"min":{"1min":1.115,"5min":0.95699999999999996,"15min":0.95499999999999996},"max":{"1min":1.7909999999999999,"5min":1.978,"15min":2.2280000000000002},"last":1.2749999999999999}]},{"osd":6,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":1.022,"5min":0.97299999999999998,"15min":0.69599999999999995},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":2.0779999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.4530000000000001,"15min":1.4730000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.9350000000000001,"5min":2.0750000000000002,"15min":2.23},"last":1.4279999999999999}]},{"osd":7,"last update":"Sun Dec 24 18:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":1.022,"5min":1.0189999999999999,"15min":1.006},"max":{"1min":1.847,"5min":2.262,"15min":2.8980000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.419,"15min":1.4330000000000001},"min":{"1min":1.155,"5min":0.94899999999999995,"15min":0.72399999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.3279999999999998},"last":1.413}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T18:55:31.616 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T18:55:31.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T18:55:31.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.840+0000 7fcf05c0c700 1 Processor -- start 2023-12-24T18:55:31.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.840+0000 7fcf05c0c700 1 -- start start 2023-12-24T18:55:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcf05c0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf000ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcf05c0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0006a580 con 0x7fcf000cc780 2023-12-24T18:55:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcf05c0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000cd110 con 0x7fcf00158c40 2023-12-24T18:55:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcf05c0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0006a7d0 con 0x7fcf0006d450 2023-12-24T18:55:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcefffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcf000cc780 0x7fcf0006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48580/0 (socket says 172.21.15.50:48580) 2023-12-24T18:55:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcefffff700 1 -- 172.21.15.50:0/678515286 learned_addr learned my addr 172.21.15.50:0/678515286 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.844+0000 7fcf0540b700 1 --2- 172.21.15.50:0/678515286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf000ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fceff7fe700 1 -- 172.21.15.50:0/678515286 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264169691 0 0) 0x7fcf0006a580 con 0x7fcf000cc780 2023-12-24T18:55:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fceff7fe700 1 -- 172.21.15.50:0/678515286 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef0003570 con 0x7fcf000cc780 2023-12-24T18:55:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf0540b700 1 -- 172.21.15.50:0/678515286 >> v1:172.21.15.82:6789/0 conn(0x7fcf00158c40 legacy=0x7fcf000cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf0540b700 1 -- 172.21.15.50:0/678515286 >> v1:172.21.15.50:6789/0 conn(0x7fcf000cc780 legacy=0x7fcf0006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf0540b700 1 -- 172.21.15.50:0/678515286 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0006aab0 con 0x7fcf0006d450 2023-12-24T18:55:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf0540b700 1 --2- 172.21.15.50:0/678515286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf000ccbd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e90 tx=0x7fcef8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec51e8fe39eb17f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fceff7fe700 1 -- 172.21.15.50:0/678515286 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800e070 con 0x7fcf0006d450 2023-12-24T18:55:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fceff7fe700 1 -- 172.21.15.50:0/678515286 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800bc30 con 0x7fcf0006d450 2023-12-24T18:55:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fceff7fe700 1 -- 172.21.15.50:0/678515286 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8012430 con 0x7fcf0006d450 2023-12-24T18:55:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 -- 172.21.15.50:0/678515286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 msgr2=0x7fcf000ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/678515286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf000ccbd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e90 tx=0x7fcef8009780 comp rx=0 tx=0).stop 2023-12-24T18:55:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 -- 172.21.15.50:0/678515286 shutdown_connections 2023-12-24T18:55:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/678515286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf000ccbd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 -- 172.21.15.50:0/678515286 >> 172.21.15.50:0/678515286 conn(0x7fcf000d0800 msgr2=0x7fcf000b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 -- 172.21.15.50:0/678515286 shutdown_connections 2023-12-24T18:55:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.848+0000 7fcf05c0c700 1 -- 172.21.15.50:0/678515286 wait complete. 2023-12-24T18:55:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.852+0000 7fcf05c0c700 1 Processor -- start 2023-12-24T18:55:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.852+0000 7fcf05c0c700 1 -- start start 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf00147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf000cc780 0x7fcf000c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00147dc0 con 0x7fcf00158c40 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000c6bf0 con 0x7fcf000cc780 2023-12-24T18:55:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf05c0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0015a9b0 con 0x7fcf0006d450 2023-12-24T18:55:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43016/0 (socket says 172.21.15.50:43016) 2023-12-24T18:55:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 -- 172.21.15.50:0/4253363194 learned_addr learned my addr 172.21.15.50:0/4253363194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf04c0a700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf00147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcefffff700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf000cc780 0x7fcf000c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 -- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 msgr2=0x7fcf00147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf00147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 -- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf000cc780 msgr2=0x7fcf000c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf000cc780 0x7fcf000c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 -- 172.21.15.50:0/4253363194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009a20 con 0x7fcf00158c40 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.856+0000 7fcf0540b700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcef8013000 tx=0x7fcef8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8027470 con 0x7fcf00158c40 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80275d0 con 0x7fcf00158c40 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8027990 con 0x7fcf00158c40 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf000c5280 con 0x7fcf00158c40 2023-12-24T18:55:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0015a080 con 0x7fcf00158c40 2023-12-24T18:55:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0004be40 con 0x7fcf00158c40 2023-12-24T18:55:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.860+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcef8024070 con 0x7fcf00158c40 2023-12-24T18:55:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.864+0000 7fcefcff9700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 0x7fcee4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.864+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fcef807f280 con 0x7fcf00158c40 2023-12-24T18:55:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.864+0000 7fcf04c0a700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 0x7fcee4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.864+0000 7fcf04c0a700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 0x7fcee4062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcef40039e0 tx=0x7fcef4007ec0 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:31.872+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcef804f500 con 0x7fcf00158c40 2023-12-24T18:55:32.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.104+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcf000cdfc0 con 0x7fcf00158c40 2023-12-24T18:55:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.112+0000 7fcefcff9700 1 -- 172.21.15.50:0/4253363194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcef8052b20 con 0x7fcf00158c40 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 msgr2=0x7fcee4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 0x7fcee4062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcef40039e0 tx=0x7fcef4007ec0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 msgr2=0x7fcf000c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcef8013000 tx=0x7fcef8019000 comp rx=0 tx=0).stop 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 shutdown_connections 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fcee4060550 0x7fcee4062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf00158c40 0x7fcf000c75d0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf000cc780 0x7fcf000c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 --2- 172.21.15.50:0/4253363194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf0006d450 0x7fcf00147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 >> 172.21.15.50:0/4253363194 conn(0x7fcf000d0800 msgr2=0x7fcf0006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 shutdown_connections 2023-12-24T18:55:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.116+0000 7fcf05c0c700 1 -- 172.21.15.50:0/4253363194 wait complete. 2023-12-24T18:55:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T18:55:32.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T18:55:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 Processor -- start 2023-12-24T18:55:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 -- start start 2023-12-24T18:55:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c0c06ae30 0x7f4c0c06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c15a580 con 0x7f4c0c159a20 2023-12-24T18:55:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c06b7e0 con 0x7f4c0c0ce750 2023-12-24T18:55:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.308+0000 7f4c11545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c06ba80 con 0x7f4c0c06ae30 2023-12-24T18:55:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43018/0 (socket says 172.21.15.50:43018) 2023-12-24T18:55:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 -- 172.21.15.50:0/1365811307 learned_addr learned my addr 172.21.15.50:0/1365811307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0a7fc700 1 --2- 172.21.15.50:0/1365811307 >> v2:172.21.15.82:3300/0 conn(0x7f4c0c06ae30 0x7f4c0c06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 -- 172.21.15.50:0/1365811307 >> v2:172.21.15.82:3300/0 conn(0x7f4c0c06ae30 msgr2=0x7f4c0c06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 --2- 172.21.15.50:0/1365811307 >> v2:172.21.15.82:3300/0 conn(0x7f4c0c06ae30 0x7f4c0c06b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 -- 172.21.15.50:0/1365811307 >> v1:172.21.15.82:6789/0 conn(0x7f4c0c159a20 legacy=0x7f4c0c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c09ffb700 1 -- 172.21.15.50:0/1365811307 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946362643 0 0) 0x7f4c0c15a580 con 0x7f4c0c159a20 2023-12-24T18:55:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 -- 172.21.15.50:0/1365811307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c06bd60 con 0x7f4c0c0ce750 2023-12-24T18:55:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c0affd700 1 --2- 172.21.15.50:0/1365811307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06a9b0 tx=0x7f4bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e662437760f123d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c09ffb700 1 -- 172.21.15.50:0/1365811307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc009e70 con 0x7f4c0c0ce750 2023-12-24T18:55:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c09ffb700 1 -- 172.21.15.50:0/1365811307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00b860 con 0x7f4c0c0ce750 2023-12-24T18:55:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c09ffb700 1 -- 172.21.15.50:0/1365811307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00bc00 con 0x7f4c0c0ce750 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 -- 172.21.15.50:0/1365811307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c0ce750 msgr2=0x7f4c0c0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 --2- 172.21.15.50:0/1365811307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06a9b0 tx=0x7f4bfc009250 comp rx=0 tx=0).stop 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 -- 172.21.15.50:0/1365811307 shutdown_connections 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 --2- 172.21.15.50:0/1365811307 >> v2:172.21.15.82:3300/0 conn(0x7f4c0c06ae30 0x7f4c0c06b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 --2- 172.21.15.50:0/1365811307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c0ce750 0x7f4c0c0ceb20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 -- 172.21.15.50:0/1365811307 >> 172.21.15.50:0/1365811307 conn(0x7f4c0c0cffb0 msgr2=0x7f4c0c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 -- 172.21.15.50:0/1365811307 shutdown_connections 2023-12-24T18:55:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.312+0000 7f4c11545700 1 -- 172.21.15.50:0/1365811307 wait complete. 2023-12-24T18:55:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.316+0000 7f4c11545700 1 Processor -- start 2023-12-24T18:55:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.316+0000 7f4c11545700 1 -- start start 2023-12-24T18:55:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c0c06ae30 0x7f4c0c169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c0c0ce750 0x7f4c0c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15c530 con 0x7f4c0c159a20 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15bc00 con 0x7f4c0c06ae30 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15bee0 con 0x7f4c0c0ce750 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43034/0 (socket says 172.21.15.50:43034) 2023-12-24T18:55:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 -- 172.21.15.50:0/2897545167 learned_addr learned my addr 172.21.15.50:0/2897545167 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0affd700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c0c06ae30 0x7f4c0c169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0a7fc700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c0c0ce750 0x7f4c0c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 -- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c0c0ce750 msgr2=0x7f4c0c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c0c0ce750 0x7f4c0c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 -- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c0c06ae30 msgr2=0x7f4c0c169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c0c06ae30 0x7f4c0c169680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 -- 172.21.15.50:0/2897545167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094f0 con 0x7f4c0c159a20 2023-12-24T18:55:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c0b7fe700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c890 tx=0x7f4c04001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04012630 con 0x7f4c0c159a20 2023-12-24T18:55:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040127b0 con 0x7f4c0c159a20 2023-12-24T18:55:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04012b70 con 0x7f4c0c159a20 2023-12-24T18:55:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.320+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c15c1c0 con 0x7f4c0c159a20 2023-12-24T18:55:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.324+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c169bc0 con 0x7f4c0c159a20 2023-12-24T18:55:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.324+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c15c6e0 con 0x7f4c0c159a20 2023-12-24T18:55:32.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.324+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4c04003030 con 0x7f4c0c159a20 2023-12-24T18:55:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.328+0000 7f4bf2ffd700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 0x7f4bf8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.328+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f4c0407c860 con 0x7f4c0c159a20 2023-12-24T18:55:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.328+0000 7f4c0affd700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 0x7f4bf8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.328+0000 7f4c0affd700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 0x7f4bf8062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06a9b0 tx=0x7f4bfc017000 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.332+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c0c15c6e0 con 0x7f4c0c159a20 2023-12-24T18:55:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.544+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c0c0652e0 con 0x7f4c0c159a20 2023-12-24T18:55:32.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.544+0000 7f4bf2ffd700 1 -- 172.21.15.50:0/2897545167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f4c0404cb80 con 0x7f4c0c159a20 2023-12-24T18:55:32.543 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:32.543 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T18:55:32.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 msgr2=0x7f4bf8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 0x7f4bf8062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c06a9b0 tx=0x7f4bfc017000 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 msgr2=0x7f4c0c16cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c890 tx=0x7f4c04001670 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 shutdown_connections 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4bf8060580 0x7f4bf8062a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c0c159a20 0x7f4c0c16cc80 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c0c0ce750 0x7f4c0c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 --2- 172.21.15.50:0/2897545167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c0c06ae30 0x7f4c0c169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:32.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 >> 172.21.15.50:0/2897545167 conn(0x7f4c0c0cffb0 msgr2=0x7f4c0c0c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:32.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 shutdown_connections 2023-12-24T18:55:32.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:32.548+0000 7f4c11545700 1 -- 172.21.15.50:0/2897545167 wait complete. 2023-12-24T18:55:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T18:55:32.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T18:55:21.508345+0000', 'modified': '2023-12-24T18:55:25.094335+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8277': {'gid': 8277, 'name': 'd', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6835/1182389689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 1182389689}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 1182389689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T18:55:32.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T18:55:32.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-24T18:55:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 Processor -- start 2023-12-24T18:55:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 -- start start 2023-12-24T18:55:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2f006b6c0 0x7ff2f01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2f006c0c0 0x7ff2f00a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00a9c80 con 0x7ff2f0158cd0 2023-12-24T18:55:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f006c4f0 con 0x7ff2f006b6c0 2023-12-24T18:55:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f640c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00a8e10 con 0x7ff2f006c0c0 2023-12-24T18:55:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f4c09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2f006b6c0 0x7ff2f01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f540a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2f0158cd0 0x7ff2f006afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48592/0 (socket says 172.21.15.50:48592) 2023-12-24T18:55:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f540a700 1 -- 172.21.15.50:0/3204813567 learned_addr learned my addr 172.21.15.50:0/3204813567 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.156+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3204813567 >> v2:172.21.15.82:3300/0 conn(0x7ff2f006c0c0 0x7ff2f00a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f4c09700 1 -- 172.21.15.50:0/3204813567 >> v2:172.21.15.82:3300/0 conn(0x7ff2f006c0c0 msgr2=0x7ff2f00a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/3204813567 >> v2:172.21.15.82:3300/0 conn(0x7ff2f006c0c0 0x7ff2f00a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f4c09700 1 -- 172.21.15.50:0/3204813567 >> v1:172.21.15.50:6789/0 conn(0x7ff2f0158cd0 legacy=0x7ff2f006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f4c09700 1 -- 172.21.15.50:0/3204813567 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00a9070 con 0x7ff2f006b6c0 2023-12-24T18:55:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/3204813567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f006b6c0 0x7ff2f01590a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ad8e0 tx=0x7ff2e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38faaeba3fe0af28 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2e7fff700 1 -- 172.21.15.50:0/3204813567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011630 con 0x7ff2f006b6c0 2023-12-24T18:55:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2e7fff700 1 -- 172.21.15.50:0/3204813567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0011790 con 0x7ff2f006b6c0 2023-12-24T18:55:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2e7fff700 1 -- 172.21.15.50:0/3204813567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011b30 con 0x7ff2f006b6c0 2023-12-24T18:55:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 -- 172.21.15.50:0/3204813567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f006b6c0 msgr2=0x7ff2f01590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 --2- 172.21.15.50:0/3204813567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f006b6c0 0x7ff2f01590a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ad8e0 tx=0x7ff2e00091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 -- 172.21.15.50:0/3204813567 shutdown_connections 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 --2- 172.21.15.50:0/3204813567 >> v2:172.21.15.82:3300/0 conn(0x7ff2f006c0c0 0x7ff2f00a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 --2- 172.21.15.50:0/3204813567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f006b6c0 0x7ff2f01590a0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 -- 172.21.15.50:0/3204813567 >> 172.21.15.50:0/3204813567 conn(0x7ff2f0067b80 msgr2=0x7ff2f00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 -- 172.21.15.50:0/3204813567 shutdown_connections 2023-12-24T18:55:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.160+0000 7ff2f640c700 1 -- 172.21.15.50:0/3204813567 wait complete. 2023-12-24T18:55:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.164+0000 7ff2f640c700 1 Processor -- start 2023-12-24T18:55:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- start start 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 0x7ff2f014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f006c0c0 0x7ff2f00c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00c4cd0 con 0x7ff2f0158cd0 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0156dc0 con 0x7ff2f006c0c0 2023-12-24T18:55:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01570a0 con 0x7ff2f006b6c0 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43050/0 (socket says 172.21.15.50:43050) 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/1146689430 learned_addr learned my addr 172.21.15.50:0/1146689430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 0x7ff2f014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f006c0c0 0x7ff2f00c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 msgr2=0x7ff2f014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 0x7ff2f014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f006c0c0 msgr2=0x7ff2f00c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f006c0c0 0x7ff2f00c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/1146689430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009420 con 0x7ff2f0158cd0 2023-12-24T18:55:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 0x7ff2f014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009e90 tx=0x7ff2e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2e57fa700 1 -- 172.21.15.50:0/1146689430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800cc20 con 0x7ff2f0158cd0 2023-12-24T18:55:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2e57fa700 1 -- 172.21.15.50:0/1146689430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800f040 con 0x7ff2f0158cd0 2023-12-24T18:55:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2e57fa700 1 -- 172.21.15.50:0/1146689430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8014480 con 0x7ff2f0158cd0 2023-12-24T18:55:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f0157380 con 0x7ff2f0158cd0 2023-12-24T18:55:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.168+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f014d930 con 0x7ff2f0158cd0 2023-12-24T18:55:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2e57fa700 1 -- 172.21.15.50:0/1146689430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff2e8014830 con 0x7ff2f0158cd0 2023-12-24T18:55:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2e57fa700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2e57fa700 1 -- 172.21.15.50:0/1146689430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7ff2e807d530 con 0x7ff2f0158cd0 2023-12-24T18:55:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2f990c740 1 Processor -- start 2023-12-24T18:55:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2f990c740 1 -- start start 2023-12-24T18:55:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.176+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 0x7ff2d4062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001840 tx=0x7ff2ec009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x132cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10af710 0x132d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x125af30 con 0x10fa790 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1256ed0 con 0x10af710 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x121d0b0 con 0x10afae0 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43058/0 (socket says 172.21.15.50:43058) 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3656056022 learned_addr learned my addr 172.21.15.50:0/3656056022 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10af710 0x132d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f540a700 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x132cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 msgr2=0x132cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x132cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10af710 msgr2=0x132d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10af710 0x132d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3656056022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10fb9e0 con 0x10fa790 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c730 tx=0x7ff2e807b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1da3dd256bbfe18 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2da7fc700 1 -- 172.21.15.50:0/3656056022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8051470 con 0x10fa790 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2da7fc700 1 -- 172.21.15.50:0/3656056022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e804f5b0 con 0x10fa790 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2da7fc700 1 -- 172.21.15.50:0/3656056022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e807d0c0 con 0x10fa790 2023-12-24T18:55:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- 172.21.15.50:0/3656056022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 msgr2=0x132d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c730 tx=0x7ff2e807b640 comp rx=0 tx=0).stop 2023-12-24T18:55:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- 172.21.15.50:0/3656056022 shutdown_connections 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x132d980 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10af710 0x132d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3656056022 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x132cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- 172.21.15.50:0/3656056022 >> 172.21.15.50:0/3656056022 conn(0x10afeb0 msgr2=0x12e9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- 172.21.15.50:0/3656056022 shutdown_connections 2023-12-24T18:55:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.180+0000 7ff2f990c740 1 -- 172.21.15.50:0/3656056022 wait complete. 2023-12-24T18:55:33.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 -- start start 2023-12-24T18:55:33.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 Processor -- start 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1331a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x1312cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x121cd50 con 0x10af710 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f5970 con 0x10fa790 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x12566e0 con 0x10afae0 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.184+0000 7ff2f990c740 10 client.0 _ll_register_callbacks cb 0x12a06a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43064/0 (socket says 172.21.15.50:43064) 2023-12-24T18:55:33.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 -- 172.21.15.50:0/1906808676 learned_addr learned my addr 172.21.15.50:0/1906808676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x1312cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1331a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 -- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 msgr2=0x1331a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1331a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 -- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 msgr2=0x1312cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x1312cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 -- 172.21.15.50:0/1906808676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f014d930 con 0x10af710 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f540a700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007400 tx=0x7ff2ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3a0c679d2295bc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00eb70 con 0x10af710 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11f5cc0 con 0x10af710 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7ff2ec023de0 con 0x10af710 2023-12-24T18:55:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2ec00eee0 con 0x10af710 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 10 client.8442 fetch_fsmap learned FSMap version 70 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1225370 con 0x10af710 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11f5cc0 con 0x10af710 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2ec020070 con 0x10af710 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 10 client.8442 fetch_fsmap finished waiting for FSMap version 70 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 10 client.8442 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 20 client.8442 populate_metadata read hostname 'smithi050' 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x133a6a0 0x133ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 4 client.8442 mds_command: new command op to 8277 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T18:55:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 --> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11f93e0 con 0x133a6a0 2023-12-24T18:55:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.188+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x133a6a0 0x133ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x133a6a0 0x133ca80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15d744a17858d33d server_cookie=9f020062fcc93443 in_seq=0 out_seq=0 2023-12-24T18:55:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2cf7fe700 10 client.8442 ms_handle_connect on v2:172.21.15.82:6834/1182389689 2023-12-24T18:55:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/1906808676 <== mds.0 v2:172.21.15.82:6834/1182389689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x11f93e0 con 0x133a6a0 2023-12-24T18:55:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2cf7fe700 10 client.8442 handle_command_reply: tid=0 2023-12-24T18:55:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2f990c740 1 client.8442 shutdown 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 msgr2=0x1331510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.192+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007400 tx=0x7ff2ec013000 comp rx=0 tx=0).stop 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 shutdown_connections 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x133a6a0 0x133ca80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x1312cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1331a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2cf7fe700 0 client.8442 ms_handle_reset on v2:172.21.15.82:6834/1182389689 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 --2- 172.21.15.50:0/1906808676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1331510 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 >> 172.21.15.50:0/1906808676 conn(0x10afeb0 msgr2=0x12e1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 shutdown_connections 2023-12-24T18:55:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 1 -- 172.21.15.50:0/1906808676 wait complete. 2023-12-24T18:55:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.196+0000 7ff2f990c740 20 client.8442 trim_cache size 0 max 16384 2023-12-24T18:55:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 Processor -- start 2023-12-24T18:55:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 -- start start 2023-12-24T18:55:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1311ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1312220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x125a9d0 con 0x10af710 2023-12-24T18:55:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f7b80 con 0x10fa790 2023-12-24T18:55:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x11287c0 con 0x10afae0 2023-12-24T18:55:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:38548/0 (socket says 172.21.15.50:38548) 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3705776064 learned_addr learned my addr 172.21.15.50:0/3705776064 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f4c09700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1312220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.220+0000 7ff2f540a700 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1311ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 msgr2=0x1312220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1312220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3705776064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 msgr2=0x1311ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1311ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3705776064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x120bd80 con 0x10fa790 2023-12-24T18:55:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1312220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80099f0 tx=0x7ff2e8063000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e494933a9a4d3b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2daffd700 1 -- 172.21.15.50:0/3705776064 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8050fb0 con 0x10fa790 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2daffd700 1 -- 172.21.15.50:0/3705776064 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800ca10 con 0x10fa790 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2daffd700 1 -- 172.21.15.50:0/3705776064 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8051470 con 0x10fa790 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 -- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 msgr2=0x12e3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80099f0 tx=0x7ff2e8063000 comp rx=0 tx=0).stop 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 -- 172.21.15.50:0/3705776064 shutdown_connections 2023-12-24T18:55:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10fa790 0x12e3ad0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10afae0 0x1312220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3705776064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10af710 0x1311ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 -- 172.21.15.50:0/3705776064 >> 172.21.15.50:0/3705776064 conn(0x10afeb0 msgr2=0x12e31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 -- 172.21.15.50:0/3705776064 shutdown_connections 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.224+0000 7ff2f990c740 1 -- 172.21.15.50:0/3705776064 wait complete. 2023-12-24T18:55:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 -- start start 2023-12-24T18:55:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 Processor -- start 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10af710 0x138e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10afae0 0x12e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x112c650 con 0x10fa790 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1254890 con 0x10afae0 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x122c550 con 0x10af710 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.228+0000 7ff2f990c740 10 client.0 _ll_register_callbacks cb 0x107b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43086/0 (socket says 172.21.15.50:43086) 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3193914304 learned_addr learned my addr 172.21.15.50:0/3193914304 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f540a700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10af710 0x138e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f4c09700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10afae0 0x12e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10af710 msgr2=0x138e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10af710 0x138e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10afae0 msgr2=0x12e54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10afae0 0x12e54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 -- 172.21.15.50:0/3193914304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10fb9e0 con 0x10fa790 2023-12-24T18:55:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f5c0b700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009e60 tx=0x7ff2e8077040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0447d7e8042428 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8050fb0 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2f00c1690 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7ff2e807b7f0 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e80581d0 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 10 client.8448 fetch_fsmap learned FSMap version 70 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1200130 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f00c1690 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2e807bb00 con 0x10fa790 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 10 client.8448 fetch_fsmap finished waiting for FSMap version 70 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 10 client.8448 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 20 client.8448 populate_metadata read hostname 'smithi050' 2023-12-24T18:55:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x12e63c0 0x12e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 4 client.8448 mds_command: new command op to 8277 tid=0[{"prefix": "status"}] 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 --> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff2e804f5b0 con 0x12e63c0 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.232+0000 7ff2f540a700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x12e63c0 0x12e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2cf7fe700 10 client.8448 ms_handle_connect on v2:172.21.15.82:6834/1182389689 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f540a700 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x12e63c0 0x12e6790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff351c91f2fd11d server_cookie=3664b105bfb1f8d4 in_seq=0 out_seq=0 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2cf7fe700 1 -- 172.21.15.50:0/3193914304 <== mds.0 v2:172.21.15.82:6834/1182389689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x7ff2e804f5b0 con 0x12e63c0 2023-12-24T18:55:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2cf7fe700 10 client.8448 handle_command_reply: tid=0 2023-12-24T18:55:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 client.8448 shutdown 2023-12-24T18:55:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 msgr2=0x12e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009e60 tx=0x7ff2e8077040 comp rx=0 tx=0).stop 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 shutdown_connections 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:6834/1182389689,v1:172.21.15.82:6835/1182389689] conn(0x12e63c0 0x12e6790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10fa790 0x12e5a30 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x10afae0 0x12e54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2cf7fe700 0 client.8448 ms_handle_reset on v2:172.21.15.82:6834/1182389689 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 --2- 172.21.15.50:0/3193914304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x10af710 0x138e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 >> 172.21.15.50:0/3193914304 conn(0x10afeb0 msgr2=0x12e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 shutdown_connections 2023-12-24T18:55:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 1 -- 172.21.15.50:0/3193914304 wait complete. 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f990c740 20 client.8448 trim_cache size 0 max 16384 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8277, 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T18:55:33.237 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.15170303, 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 70, 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 138, 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 138, 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.058914542 2023-12-24T18:55:33.238 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 msgr2=0x7ff2d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 0x7ff2d4062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001840 tx=0x7ff2ec009040 comp rx=0 tx=0).stop 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 msgr2=0x7ff2f00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.236+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009e90 tx=0x7ff2e800b040 comp rx=0 tx=0).stop 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 shutdown_connections 2023-12-24T18:55:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2f0158cd0 0x7ff2f00c2bb0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f006c0c0 0x7ff2f00c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 --2- 172.21.15.50:0/1146689430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2f006b6c0 0x7ff2f014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 >> 172.21.15.50:0/1146689430 conn(0x7ff2f0067b80 msgr2=0x7ff2f00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 shutdown_connections 2023-12-24T18:55:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.240+0000 7ff2f640c700 1 -- 172.21.15.50:0/1146689430 wait complete. 2023-12-24T18:55:33.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T18:55:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.436+0000 7fe6c4585700 1 Processor -- start 2023-12-24T18:55:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.436+0000 7fe6c4585700 1 -- start start 2023-12-24T18:55:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c4585700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6bc154b60 0x7fe6bc0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c4585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc06c820 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c4585700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc06b960 con 0x7fe6bc06aca0 2023-12-24T18:55:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c4585700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc06bc40 con 0x7fe6bc154b60 2023-12-24T18:55:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c2321700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6bc0c6d00 0x7fe6bc154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48596/0 (socket says 172.21.15.50:48596) 2023-12-24T18:55:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c2321700 1 -- 172.21.15.50:0/3430116407 learned_addr learned my addr 172.21.15.50:0/3430116407 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.440+0000 7fe6c1b20700 1 --2- 172.21.15.50:0/3430116407 >> v2:172.21.15.82:3300/0 conn(0x7fe6bc154b60 0x7fe6bc0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c1b20700 1 -- 172.21.15.50:0/3430116407 >> v1:172.21.15.82:6789/0 conn(0x7fe6bc06aca0 legacy=0x7fe6bc06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c131f700 1 -- 172.21.15.50:0/3430116407 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734744579 0 0) 0x7fe6bc06c820 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c1b20700 1 -- 172.21.15.50:0/3430116407 >> v1:172.21.15.50:6789/0 conn(0x7fe6bc0c6d00 legacy=0x7fe6bc154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c1b20700 1 -- 172.21.15.50:0/3430116407 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc06bf20 con 0x7fe6bc154b60 2023-12-24T18:55:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c1b20700 1 --2- 172.21.15.50:0/3430116407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc154b60 0x7fe6bc0c70d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009860 tx=0x7fe6ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb32a61e87a9741e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c131f700 1 -- 172.21.15.50:0/3430116407 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac011630 con 0x7fe6bc154b60 2023-12-24T18:55:33.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c131f700 1 -- 172.21.15.50:0/3430116407 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac011790 con 0x7fe6bc154b60 2023-12-24T18:55:33.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c131f700 1 -- 172.21.15.50:0/3430116407 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac011b50 con 0x7fe6bc154b60 2023-12-24T18:55:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 -- 172.21.15.50:0/3430116407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc154b60 msgr2=0x7fe6bc0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 --2- 172.21.15.50:0/3430116407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc154b60 0x7fe6bc0c70d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009860 tx=0x7fe6ac0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 -- 172.21.15.50:0/3430116407 shutdown_connections 2023-12-24T18:55:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 --2- 172.21.15.50:0/3430116407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc154b60 0x7fe6bc0c70d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 -- 172.21.15.50:0/3430116407 >> 172.21.15.50:0/3430116407 conn(0x7fe6bc0cbba0 msgr2=0x7fe6bc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 -- 172.21.15.50:0/3430116407 shutdown_connections 2023-12-24T18:55:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.444+0000 7fe6c4585700 1 -- 172.21.15.50:0/3430116407 wait complete. 2023-12-24T18:55:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.448+0000 7fe6c4585700 1 Processor -- start 2023-12-24T18:55:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.448+0000 7fe6c4585700 1 -- start start 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 0x7fe6bc0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6bc154b60 0x7fe6bc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0aa4b0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0a98a0 con 0x7fe6bc06aca0 2023-12-24T18:55:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0a9b80 con 0x7fe6bc154b60 2023-12-24T18:55:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43098/0 (socket says 172.21.15.50:43098) 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 -- 172.21.15.50:0/642592000 learned_addr learned my addr 172.21.15.50:0/642592000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c2321700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 0x7fe6bc0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c2b22700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6bc154b60 0x7fe6bc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 -- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6bc154b60 msgr2=0x7fe6bc0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6bc154b60 0x7fe6bc0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 -- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 msgr2=0x7fe6bc0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 0x7fe6bc0a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 -- 172.21.15.50:0/642592000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac009420 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c2321700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 0x7fe6bc0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c1b20700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc069da0 tx=0x7fe6ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac01a450 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac01a5f0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac01a9b0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0a9e60 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.452+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc1520d0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.456+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc0652e0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.456+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe6ac024410 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.460+0000 7fe6b27fc700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 0x7fe6a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.460+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fe6ac07e820 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.460+0000 7fe6c2321700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 0x7fe6a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.460+0000 7fe6c2321700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 0x7fe6a0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80011e0 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.464+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6ac04ebd0 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6bc06c200 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6b27fc700 1 -- 172.21.15.50:0/642592000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6ac029060 con 0x7fe6bc0c6d00 2023-12-24T18:55:33.671 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 msgr2=0x7fe6a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 0x7fe6a0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80011e0 tx=0x7fe6b8009040 comp rx=0 tx=0).stop 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 msgr2=0x7fe6bc151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.672+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc069da0 tx=0x7fe6ac016000 comp rx=0 tx=0).stop 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 shutdown_connections 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe6a0060550 0x7fe6a0062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6bc154b60 0x7fe6bc0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6bc0c6d00 0x7fe6bc151b90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 --2- 172.21.15.50:0/642592000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6bc06aca0 0x7fe6bc0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 >> 172.21.15.50:0/642592000 conn(0x7fe6bc0cbba0 msgr2=0x7fe6bc152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 shutdown_connections 2023-12-24T18:55:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:33.676+0000 7fe6c4585700 1 -- 172.21.15.50:0/642592000 wait complete. 2023-12-24T18:55:33.691 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T18:55:33.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T18:55:33.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T18:55:33.691 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T18:55:33.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T18:55:33.692 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T18:55:33.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T18:55:33.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T18:55:33.692 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:55:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:33.692 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T18:55:33.713 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T18:55:33.714 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41276sec preferred_lft 41276sec 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T18:55:33.715 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T18:55:33.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T18:55:33.717 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T18:55:33.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:33.718 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T18:55:33.799 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T18:55:33.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:33.802 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T18:55:33.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T18:55:33.868 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T18:55:34.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:34.012 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T18:55:34.033 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T18:55:34.033 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T18:55:34.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:55:34.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:34.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T18:55:34.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:55:34.115 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T18:55:34.176 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T18:55:34.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T18:55:34.177 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:55:34.237 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T18:55:34.237 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T18:55:34.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:55:34.367 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:55:34.367 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:55:34.394 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T18:55:34.394 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T18:55:34.394 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T18:55:34.394 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T18:55:34.395 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T18:55:34.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T18:55:34.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T18:55:34.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T18:55:34.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T18:55:34.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.664+0000 7f0fe9d45700 1 Processor -- start 2023-12-24T18:55:34.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.664+0000 7f0fe9d45700 1 -- start start 2023-12-24T18:55:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe9d45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fe40ce750 0x7f0fe40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe9d45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fe4159a20 0x7f0fe4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe9d45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe406ba80 con 0x7f0fe406ae30 2023-12-24T18:55:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe9d45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe406bd60 con 0x7f0fe40ce750 2023-12-24T18:55:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe9d45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe406c040 con 0x7f0fe4159a20 2023-12-24T18:55:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fe40ce750 0x7f0fe40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0fe406ae30 0x7f0fe406b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48604/0 (socket says 172.21.15.50:48604) 2023-12-24T18:55:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe2ffd700 1 -- 172.21.15.50:0/956323036 learned_addr learned my addr 172.21.15.50:0/956323036 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe3fff700 1 --2- 172.21.15.50:0/956323036 >> v2:172.21.15.82:3300/0 conn(0x7f0fe4159a20 0x7f0fe4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe37fe700 1 -- 172.21.15.50:0/956323036 >> v2:172.21.15.82:3300/0 conn(0x7f0fe4159a20 msgr2=0x7f0fe4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:34.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe37fe700 1 --2- 172.21.15.50:0/956323036 >> v2:172.21.15.82:3300/0 conn(0x7f0fe4159a20 0x7f0fe4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe37fe700 1 -- 172.21.15.50:0/956323036 >> v1:172.21.15.50:6789/0 conn(0x7f0fe406ae30 legacy=0x7f0fe406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe37fe700 1 -- 172.21.15.50:0/956323036 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe406c320 con 0x7f0fe40ce750 2023-12-24T18:55:34.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.668+0000 7f0fe27fc700 1 -- 172.21.15.50:0/956323036 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777042122 0 0) 0x7f0fe406ba80 con 0x7f0fe406ae30 2023-12-24T18:55:34.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe37fe700 1 --2- 172.21.15.50:0/956323036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe40ce750 0x7f0fe40ceb20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4153bd0 tx=0x7f0fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6240a6427bc5c3c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe27fc700 1 -- 172.21.15.50:0/956323036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4011630 con 0x7f0fe40ce750 2023-12-24T18:55:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe27fc700 1 -- 172.21.15.50:0/956323036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd4011790 con 0x7f0fe40ce750 2023-12-24T18:55:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe27fc700 1 -- 172.21.15.50:0/956323036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4011b30 con 0x7f0fe40ce750 2023-12-24T18:55:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 -- 172.21.15.50:0/956323036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe40ce750 msgr2=0x7f0fe40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/956323036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe40ce750 0x7f0fe40ceb20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4153bd0 tx=0x7f0fd40091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 -- 172.21.15.50:0/956323036 shutdown_connections 2023-12-24T18:55:34.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/956323036 >> v2:172.21.15.82:3300/0 conn(0x7f0fe4159a20 0x7f0fe4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/956323036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe40ce750 0x7f0fe40ceb20 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 -- 172.21.15.50:0/956323036 >> 172.21.15.50:0/956323036 conn(0x7f0fe40cffb0 msgr2=0x7f0fe40d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:34.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 -- 172.21.15.50:0/956323036 shutdown_connections 2023-12-24T18:55:34.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 -- 172.21.15.50:0/956323036 wait complete. 2023-12-24T18:55:34.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.672+0000 7f0fe9d45700 1 Processor -- start 2023-12-24T18:55:34.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 -- start start 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 0x7f0fe40b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0fe4159a20 0x7f0fe41570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40b27c0 con 0x7f0fe406ae30 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4154d00 con 0x7f0fe40ce750 2023-12-24T18:55:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe9d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40c9b20 con 0x7f0fe4159a20 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43114/0 (socket says 172.21.15.50:43114) 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 -- 172.21.15.50:0/80239366 learned_addr learned my addr 172.21.15.50:0/80239366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe3fff700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0fe4159a20 0x7f0fe41570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe2ffd700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 0x7f0fe40b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 -- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0fe4159a20 msgr2=0x7f0fe41570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0fe4159a20 0x7f0fe41570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 -- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 msgr2=0x7f0fe40b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 0x7f0fe40b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 -- 172.21.15.50:0/80239366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009420 con 0x7f0fe406ae30 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe2ffd700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 0x7f0fe40b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:34.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fe37fe700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4069a70 tx=0x7f0fd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:34.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.676+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4011b10 con 0x7f0fe406ae30 2023-12-24T18:55:34.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd40253f0 con 0x7f0fe406ae30 2023-12-24T18:55:34.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe40c9e00 con 0x7f0fe406ae30 2023-12-24T18:55:34.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4025790 con 0x7f0fe406ae30 2023-12-24T18:55:34.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe4154990 con 0x7f0fe406ae30 2023-12-24T18:55:34.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe40652e0 con 0x7f0fe406ae30 2023-12-24T18:55:34.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.680+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0fd4025b80 con 0x7f0fe406ae30 2023-12-24T18:55:34.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.684+0000 7f0fcb7fe700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 0x7f0fd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:34.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.684+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f0fd407e3d0 con 0x7f0fe406ae30 2023-12-24T18:55:34.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.684+0000 7f0fe2ffd700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 0x7f0fd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:34.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.684+0000 7f0fe2ffd700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 0x7f0fd0062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4159460 tx=0x7f0fd8009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:34.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.692+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0fd404e650 con 0x7f0fe406ae30 2023-12-24T18:55:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.888+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe40cad90 con 0x7f0fd0060550 2023-12-24T18:55:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.892+0000 7f0fcb7fe700 1 -- 172.21.15.50:0/80239366 <== mgr.7978 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0fe40cad90 con 0x7f0fd0060550 2023-12-24T18:55:34.890 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T18:55:34.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T18:55:34.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T18:55:34.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T18:55:34.890 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T18:55:34.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.892+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 msgr2=0x7f0fd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.892+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 0x7f0fd0062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4159460 tx=0x7f0fd8009040 comp rx=0 tx=0).stop 2023-12-24T18:55:34.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.892+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 msgr2=0x7f0fe4151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.892+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4069a70 tx=0x7f0fd4017000 comp rx=0 tx=0).stop 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 shutdown_connections 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0fd0060550 0x7f0fd0062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0fe4159a20 0x7f0fe41570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe40ce750 0x7f0fe40b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 --2- 172.21.15.50:0/80239366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe406ae30 0x7f0fe4151c70 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 >> 172.21.15.50:0/80239366 conn(0x7f0fe40cffb0 msgr2=0x7f0fe406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:34.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 shutdown_connections 2023-12-24T18:55:34.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:34.896+0000 7f0fe9d45700 1 -- 172.21.15.50:0/80239366 wait complete. 2023-12-24T18:55:34.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T18:55:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.080+0000 7f2d4188e700 1 Processor -- start 2023-12-24T18:55:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.080+0000 7f2d4188e700 1 -- start start 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4188e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d3c06cbf0 0x7f2d3c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4188e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0cd380 con 0x7f2d3c06c820 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4188e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0cc770 con 0x7f2d3c15e810 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4188e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c0cca50 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4088c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d3c06c820 0x7f2d3c0cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48614/0 (socket says 172.21.15.50:48614) 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d4088c700 1 -- 172.21.15.50:0/1469849459 learned_addr learned my addr 172.21.15.50:0/1469849459 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d33fff700 1 --2- 172.21.15.50:0/1469849459 >> v2:172.21.15.50:3300/0 conn(0x7f2d3c06cbf0 0x7f2d3c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103589137 0 0) 0x7f2d3c0cd380 con 0x7f2d3c06c820 2023-12-24T18:55:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d24003570 con 0x7f2d3c06c820 2023-12-24T18:55:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791050206 0 0) 0x7f2d3c0cc770 con 0x7f2d3c15e810 2023-12-24T18:55:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d33fff700 1 -- 172.21.15.50:0/1469849459 >> v1:172.21.15.82:6789/0 conn(0x7f2d3c15e810 legacy=0x7f2d3c160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d33fff700 1 -- 172.21.15.50:0/1469849459 >> v1:172.21.15.50:6789/0 conn(0x7f2d3c06c820 legacy=0x7f2d3c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d33fff700 1 -- 172.21.15.50:0/1469849459 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0ccd30 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d33fff700 1 --2- 172.21.15.50:0/1469849459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c06d070 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098e0 tx=0x7f2d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e4857fe262e870 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00b640 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00b7a0 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.084+0000 7f2d337fe700 1 -- 172.21.15.50:0/1469849459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00bb40 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 -- 172.21.15.50:0/1469849459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c06cbf0 msgr2=0x7f2d3c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1469849459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c06d070 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098e0 tx=0x7f2d2c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 -- 172.21.15.50:0/1469849459 shutdown_connections 2023-12-24T18:55:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1469849459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c06d070 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 -- 172.21.15.50:0/1469849459 >> 172.21.15.50:0/1469849459 conn(0x7f2d3c0ca600 msgr2=0x7f2d3c0caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 -- 172.21.15.50:0/1469849459 shutdown_connections 2023-12-24T18:55:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.088+0000 7f2d4188e700 1 -- 172.21.15.50:0/1469849459 wait complete. 2023-12-24T18:55:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 Processor -- start 2023-12-24T18:55:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 -- start start 2023-12-24T18:55:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06c820 0x7f2d3c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c067c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1507a0 con 0x7f2d3c15e810 2023-12-24T18:55:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c068620 con 0x7f2d3c06cbf0 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4188e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c068900 con 0x7f2d3c06c820 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4108d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c067c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4108d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43142/0 (socket says 172.21.15.50:43142) 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4108d700 1 -- 172.21.15.50:0/1485399254 learned_addr learned my addr 172.21.15.50:0/1485399254 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4088c700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06c820 0x7f2d3c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4108d700 1 -- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06c820 msgr2=0x7f2d3c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.092+0000 7f2d4108d700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06c820 0x7f2d3c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4108d700 1 -- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c06cbf0 msgr2=0x7f2d3c067c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4108d700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c067c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4108d700 1 -- 172.21.15.50:0/1485399254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c009420 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4108d700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400c510 tx=0x7f2d34007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34011590 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d340116f0 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c068be0 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34011ab0 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c0c4d40 con 0x7f2d3c15e810 2023-12-24T18:55:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.096+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c0c4f30 con 0x7f2d3c15e810 2023-12-24T18:55:35.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.100+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 66) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2d3401b3b0 con 0x7f2d3c15e810 2023-12-24T18:55:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.100+0000 7f2d30ff9700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.100+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f2d3407bec0 con 0x7f2d3c15e810 2023-12-24T18:55:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.100+0000 7f2d4088c700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.100+0000 7f2d4088c700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 0x7f2d28062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d38005c50 tx=0x7f2d38009040 comp rx=0 tx=0).ready entity=mgr.7978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:35.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.108+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d3404c140 con 0x7f2d3c15e810 2023-12-24T18:55:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:35.324+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2d3c04be40 con 0x7f2d3c15e810 2023-12-24T18:55:36.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.024+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 67) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f2d34080070 con 0x7f2d3c15e810 2023-12-24T18:55:36.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.028+0000 7f2d30ff9700 1 -- 172.21.15.50:0/1485399254 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v67) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2d3404fbd0 con 0x7f2d3c15e810 2023-12-24T18:55:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 msgr2=0x7f2d28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 0x7f2d28062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d38005c50 tx=0x7f2d38009040 comp rx=0 tx=0).stop 2023-12-24T18:55:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 msgr2=0x7f2d3c0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400c510 tx=0x7f2d34007f30 comp rx=0 tx=0).stop 2023-12-24T18:55:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 shutdown_connections 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3c15e810 0x7f2d3c0c5d10 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c06cbf0 0x7f2d3c067c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 --2- 172.21.15.50:0/1485399254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06c820 0x7f2d3c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 >> 172.21.15.50:0/1485399254 conn(0x7f2d3c0ca600 msgr2=0x7f2d3c0adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 shutdown_connections 2023-12-24T18:55:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.032+0000 7f2d4188e700 1 -- 172.21.15.50:0/1485399254 wait complete. 2023-12-24T18:55:36.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T18:55:36.207 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:36.201+0000 7fe364ee2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:55:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.224+0000 7f6fa759e700 1 Processor -- start 2023-12-24T18:55:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.224+0000 7f6fa759e700 1 -- start start 2023-12-24T18:55:36.224 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:36.224+0000 7f0482ee2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fa8158c40 0x7f6fa80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa806a580 con 0x7f6fa806cd40 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80cd110 con 0x7f6fa8158c40 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa806a7d0 con 0x7f6fa80cc780 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fa806cd40 0x7f6fa806d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48620/0 (socket says 172.21.15.50:48620) 2023-12-24T18:55:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa6d9d700 1 -- 172.21.15.50:0/682703331 learned_addr learned my addr 172.21.15.50:0/682703331 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa659c700 1 --2- 172.21.15.50:0/682703331 >> v2:172.21.15.50:3300/0 conn(0x7f6fa8158c40 0x7f6fa80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 --2- 172.21.15.50:0/682703331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 -- 172.21.15.50:0/682703331 >> v2:172.21.15.50:3300/0 conn(0x7f6fa8158c40 msgr2=0x7f6fa80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 --2- 172.21.15.50:0/682703331 >> v2:172.21.15.50:3300/0 conn(0x7f6fa8158c40 0x7f6fa80cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 -- 172.21.15.50:0/682703331 >> v1:172.21.15.50:6789/0 conn(0x7f6fa806cd40 legacy=0x7f6fa806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa559a700 1 -- 172.21.15.50:0/682703331 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563899414 0 0) 0x7f6fa806a580 con 0x7f6fa806cd40 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 -- 172.21.15.50:0/682703331 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa806aab0 con 0x7f6fa80cc780 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa5d9b700 1 --2- 172.21.15.50:0/682703331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa80ccbd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0098e0 tx=0x7f6f9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feca11c38d844625 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa559a700 1 -- 172.21.15.50:0/682703331 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00b640 con 0x7f6fa80cc780 2023-12-24T18:55:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa559a700 1 -- 172.21.15.50:0/682703331 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00b7a0 con 0x7f6fa80cc780 2023-12-24T18:55:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.228+0000 7f6fa559a700 1 -- 172.21.15.50:0/682703331 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00bb40 con 0x7f6fa80cc780 2023-12-24T18:55:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- 172.21.15.50:0/682703331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 msgr2=0x7f6fa80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- 172.21.15.50:0/682703331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa80ccbd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0098e0 tx=0x7f6f9c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- 172.21.15.50:0/682703331 shutdown_connections 2023-12-24T18:55:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- 172.21.15.50:0/682703331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa80ccbd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- 172.21.15.50:0/682703331 >> v2:172.21.15.50:3300/0 conn(0x7f6fa8158c40 0x7f6fa80cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- 172.21.15.50:0/682703331 >> 172.21.15.50:0/682703331 conn(0x7f6fa80d0800 msgr2=0x7f6fa80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- 172.21.15.50:0/682703331 shutdown_connections 2023-12-24T18:55:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- 172.21.15.50:0/682703331 wait complete. 2023-12-24T18:55:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 Processor -- start 2023-12-24T18:55:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- start start 2023-12-24T18:55:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa8158c40 0x7f6fa8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa815c7b0 con 0x7f6fa806cd40 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8169100 con 0x7f6fa8158c40 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.232+0000 7f6fa759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80c5a80 con 0x7f6fa80cc780 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43178/0 (socket says 172.21.15.50:43178) 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 -- 172.21.15.50:0/1729589578 learned_addr learned my addr 172.21.15.50:0/1729589578 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa5d9b700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa6d9d700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa8158c40 0x7f6fa8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 -- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 msgr2=0x7f6fa815c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa815c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 -- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa8158c40 msgr2=0x7f6fa8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa8158c40 0x7f6fa8157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 -- 172.21.15.50:0/1729589578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c009420 con 0x7f6fa806cd40 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa659c700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800e930 tx=0x7f6f980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800eed0 con 0x7f6fa806cd40 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800c850 con 0x7f6fa806cd40 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa80c5d60 con 0x7f6fa806cd40 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800cbf0 con 0x7f6fa806cd40 2023-12-24T18:55:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa80c6320 con 0x7f6fa806cd40 2023-12-24T18:55:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.236+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa804be40 con 0x7f6fa806cd40 2023-12-24T18:55:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.240+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 67) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f6f98013470 con 0x7f6fa806cd40 2023-12-24T18:55:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.240+0000 7f6f967fc700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 0x7f6f88062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.240+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f6f9807cdf0 con 0x7f6fa806cd40 2023-12-24T18:55:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.240+0000 7f6fa5d9b700 1 -- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 msgr2=0x7f6f88062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.240+0000 7f6fa5d9b700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 0x7f6f88062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.248+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6f9804d070 con 0x7f6fa806cd40 2023-12-24T18:55:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.420+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6fa806ad90 con 0x7f6fa806cd40 2023-12-24T18:55:36.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6f967fc700 1 -- 172.21.15.50:0/1729589578 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6f98050690 con 0x7f6fa806cd40 2023-12-24T18:55:36.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 msgr2=0x7f6f88062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:36.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 0x7f6f88062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 msgr2=0x7f6fa80c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800e930 tx=0x7f6f980091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 shutdown_connections 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6f880605a0 0x7f6f88062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fa8158c40 0x7f6fa8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6fa80cc780 0x7f6fa815c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 --2- 172.21.15.50:0/1729589578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa806cd40 0x7f6fa80c5380 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.428+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 >> 172.21.15.50:0/1729589578 conn(0x7f6fa80d0800 msgr2=0x7f6fa80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.432+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 shutdown_connections 2023-12-24T18:55:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.432+0000 7f6fa759e700 1 -- 172.21.15.50:0/1729589578 wait complete. 2023-12-24T18:55:36.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T18:55:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.632+0000 7f34da723700 1 Processor -- start 2023-12-24T18:55:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.632+0000 7f34da723700 1 -- start start 2023-12-24T18:55:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34da723700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34d40addb0 0x7f34d4157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34da723700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d406d2f0 con 0x7f34d41539d0 2023-12-24T18:55:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34da723700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d40c9c70 con 0x7f34d40c9820 2023-12-24T18:55:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34da723700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40c9f00 con 0x7f34d40addb0 2023-12-24T18:55:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9721700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f34d41539d0 0x7f34d41576b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48624/0 (socket says 172.21.15.50:48624) 2023-12-24T18:55:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9721700 1 -- 172.21.15.50:0/1032933231 learned_addr learned my addr 172.21.15.50:0/1032933231 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9f22700 1 --2- 172.21.15.50:0/1032933231 >> v2:172.21.15.50:3300/0 conn(0x7f34d40addb0 0x7f34d4157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9f22700 1 -- 172.21.15.50:0/1032933231 >> v1:172.21.15.82:6789/0 conn(0x7f34d40c9820 legacy=0x7f34d40ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9f22700 1 -- 172.21.15.50:0/1032933231 >> v1:172.21.15.50:6789/0 conn(0x7f34d41539d0 legacy=0x7f34d41576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34cbfff700 1 -- 172.21.15.50:0/1032933231 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215710931 0 0) 0x7f34d406d2f0 con 0x7f34d41539d0 2023-12-24T18:55:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.636+0000 7f34d9f22700 1 -- 172.21.15.50:0/1032933231 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d406c9c0 con 0x7f34d40addb0 2023-12-24T18:55:36.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34d9f22700 1 --2- 172.21.15.50:0/1032933231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d40addb0 0x7f34d4157040 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009e60 tx=0x7f34cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84127e0fa3dcb1ff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:36.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34cbfff700 1 -- 172.21.15.50:0/1032933231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00e070 con 0x7f34d40addb0 2023-12-24T18:55:36.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34cbfff700 1 -- 172.21.15.50:0/1032933231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00bc30 con 0x7f34d40addb0 2023-12-24T18:55:36.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34cbfff700 1 -- 172.21.15.50:0/1032933231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc012430 con 0x7f34d40addb0 2023-12-24T18:55:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 -- 172.21.15.50:0/1032933231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d40addb0 msgr2=0x7f34d4157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 --2- 172.21.15.50:0/1032933231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d40addb0 0x7f34d4157040 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009e60 tx=0x7f34cc009780 comp rx=0 tx=0).stop 2023-12-24T18:55:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 -- 172.21.15.50:0/1032933231 shutdown_connections 2023-12-24T18:55:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 --2- 172.21.15.50:0/1032933231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d40addb0 0x7f34d4157040 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 -- 172.21.15.50:0/1032933231 >> 172.21.15.50:0/1032933231 conn(0x7f34d40c8d40 msgr2=0x7f34d40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 -- 172.21.15.50:0/1032933231 shutdown_connections 2023-12-24T18:55:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.640+0000 7f34da723700 1 -- 172.21.15.50:0/1032933231 wait complete. 2023-12-24T18:55:36.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 Processor -- start 2023-12-24T18:55:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 -- start start 2023-12-24T18:55:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d40addb0 0x7f34d415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d40c9820 0x7f34d41502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d415bae0 con 0x7f34d41539d0 2023-12-24T18:55:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d415b800 con 0x7f34d40c9820 2023-12-24T18:55:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.644+0000 7f34da723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c11a0 con 0x7f34d40addb0 2023-12-24T18:55:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d8f20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d40c9820 0x7f34d41502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43184/0 (socket says 172.21.15.50:43184) 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 -- 172.21.15.50:0/2959938554 learned_addr learned my addr 172.21.15.50:0/2959938554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9721700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d40addb0 0x7f34d415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d40addb0 msgr2=0x7f34d415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d40addb0 0x7f34d415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d40c9820 msgr2=0x7f34d41502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d40c9820 0x7f34d41502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 -- 172.21.15.50:0/2959938554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009a20 con 0x7f34d41539d0 2023-12-24T18:55:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34d9f22700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f34cc013000 tx=0x7f34cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc01b420 con 0x7f34d41539d0 2023-12-24T18:55:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc01b580 con 0x7f34d41539d0 2023-12-24T18:55:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc01b940 con 0x7f34d41539d0 2023-12-24T18:55:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40c1480 con 0x7f34d41539d0 2023-12-24T18:55:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d415a630 con 0x7f34d41539d0 2023-12-24T18:55:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.648+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d404be40 con 0x7f34d41539d0 2023-12-24T18:55:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.652+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 67) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f34cc003020 con 0x7f34d41539d0 2023-12-24T18:55:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.652+0000 7f34c97fa700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 0x7f34b8062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.652+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f34cc07e4d0 con 0x7f34d41539d0 2023-12-24T18:55:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.652+0000 7f34d9721700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 msgr2=0x7f34b8062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.652+0000 7f34d9721700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 0x7f34b8062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.660+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f34cc04e7f0 con 0x7f34d41539d0 2023-12-24T18:55:36.749 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:36.741+0000 7fe364ee2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:55:36.825 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:36.817+0000 7fe364ee2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:55:36.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.856+0000 7f34d9721700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 msgr2=0x7f34b8062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:36.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.856+0000 7f34d9721700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 0x7f34b8062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:36.909 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:36.908+0000 7f0482ee2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T18:55:36.956 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:36.949+0000 7fe364ee2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:36.996+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f34d40637b0 con 0x7f34d41539d0 2023-12-24T18:55:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.004+0000 7f34c97fa700 1 -- 172.21.15.50:0/2959938554 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f34cc051e10 con 0x7f34d41539d0 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 msgr2=0x7f34b8062a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 0x7f34b8062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 msgr2=0x7f34d4151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f34cc013000 tx=0x7f34cc019000 comp rx=0 tx=0).stop 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 shutdown_connections 2023-12-24T18:55:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f34b80605d0 0x7f34b8062a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d41539d0 0x7f34d4151a40 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d40c9820 0x7f34d41502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 --2- 172.21.15.50:0/2959938554 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d40addb0 0x7f34d415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 >> 172.21.15.50:0/2959938554 conn(0x7f34d40c8d40 msgr2=0x7f34d4152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 shutdown_connections 2023-12-24T18:55:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.012+0000 7f34da723700 1 -- 172.21.15.50:0/2959938554 wait complete. 2023-12-24T18:55:37.030 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.032+0000 7f0482ee2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T18:55:37.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T18:55:37.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T18:55:37.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-12-24T18:55:37.178 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.180+0000 7f0482ee2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:37.225 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:37.217+0000 7fe364ee2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:55:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.276+0000 7efc51d45700 1 Processor -- start 2023-12-24T18:55:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.276+0000 7efc51d45700 1 -- start start 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.276+0000 7efc51d45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc4c1591a0 0x7efc4c0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c0a8fe0 0x7efc4c162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c06a730 con 0x7efc4c0aa080 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c06beb0 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c06d760 con 0x7efc4c1591a0 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c0a8fe0 0x7efc4c162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c0a8fe0 0x7efc4c162d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43194/0 (socket says 172.21.15.50:43194) 2023-12-24T18:55:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 -- 172.21.15.50:0/2253277602 learned_addr learned my addr 172.21.15.50:0/2253277602 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/2253277602 >> v2:172.21.15.82:3300/0 conn(0x7efc4c1591a0 0x7efc4c0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 -- 172.21.15.50:0/2253277602 >> v2:172.21.15.82:3300/0 conn(0x7efc4c1591a0 msgr2=0x7efc4c0a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 --2- 172.21.15.50:0/2253277602 >> v2:172.21.15.82:3300/0 conn(0x7efc4c1591a0 0x7efc4c0a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 -- 172.21.15.50:0/2253277602 >> v1:172.21.15.82:6789/0 conn(0x7efc4c0aa080 legacy=0x7efc4c0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 -- 172.21.15.50:0/2253277602 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c06da40 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4bfff700 1 --2- 172.21.15.50:0/2253277602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0a8fe0 0x7efc4c162d00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7efc4c06a1e0 tx=0x7efc44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e5afd1255e7a48 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4affd700 1 -- 172.21.15.50:0/2253277602 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400e070 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4affd700 1 -- 172.21.15.50:0/2253277602 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400ba20 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc4affd700 1 -- 172.21.15.50:0/2253277602 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440092e0 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- 172.21.15.50:0/2253277602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0a8fe0 msgr2=0x7efc4c162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 --2- 172.21.15.50:0/2253277602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0a8fe0 0x7efc4c162d00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7efc4c06a1e0 tx=0x7efc44009840 comp rx=0 tx=0).stop 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- 172.21.15.50:0/2253277602 shutdown_connections 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 --2- 172.21.15.50:0/2253277602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0a8fe0 0x7efc4c162d00 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 --2- 172.21.15.50:0/2253277602 >> v2:172.21.15.82:3300/0 conn(0x7efc4c1591a0 0x7efc4c0a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- 172.21.15.50:0/2253277602 >> 172.21.15.50:0/2253277602 conn(0x7efc4c067b80 msgr2=0x7efc4c0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- 172.21.15.50:0/2253277602 shutdown_connections 2023-12-24T18:55:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.280+0000 7efc51d45700 1 -- 172.21.15.50:0/2253277602 wait complete. 2023-12-24T18:55:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 Processor -- start 2023-12-24T18:55:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 -- start start 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc4c0a8fe0 0x7efc4c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 0x7efc4c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c15d720 con 0x7efc4c0aa080 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c14ac70 con 0x7efc4c1591a0 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c15cdf0 con 0x7efc4c0a8fe0 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43196/0 (socket says 172.21.15.50:43196) 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 -- 172.21.15.50:0/305808773 learned_addr learned my addr 172.21.15.50:0/305808773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc4bfff700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 0x7efc4c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc4c0a8fe0 0x7efc4c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc4c0a8fe0 msgr2=0x7efc4c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc4c0a8fe0 0x7efc4c13d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 msgr2=0x7efc4c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 0x7efc4c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44009ae0 con 0x7efc4c0aa080 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc4bfff700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 0x7efc4c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc42ffd700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c590 tx=0x7efc3400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011590 con 0x7efc4c0aa080 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc340116f0 con 0x7efc4c0aa080 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c15d0d0 con 0x7efc4c0aa080 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.284+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011ab0 con 0x7efc4c0aa080 2023-12-24T18:55:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c13db10 con 0x7efc4c0aa080 2023-12-24T18:55:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c071060 con 0x7efc4c0aa080 2023-12-24T18:55:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 67) v1 ==== 79978+0+0 (secure 0 0 0) 0x7efc3401b3b0 con 0x7efc4c0aa080 2023-12-24T18:55:37.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc43fff700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6429+0+0 (secure 0 0 0) 0x7efc3407c170 con 0x7efc4c0aa080 2023-12-24T18:55:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc4b7fe700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.288+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T18:55:37.298 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:37.293+0000 7fe364ee2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:37.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.300+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efc3404c3f0 con 0x7efc4c0aa080 2023-12-24T18:55:37.476 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.476+0000 7f0482ee2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T18:55:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.492+0000 7efc4b7fe700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.492+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T18:55:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.496+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efc4c15d860 con 0x7efc2c0605a0 2023-12-24T18:55:37.509 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:37.501+0000 7fe364ee2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:55:37.555 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.556+0000 7f0482ee2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:37.592 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:37.585+0000 7fe364ee2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:55:37.678 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:37.673+0000 7fe364ee2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:55:37.786 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.788+0000 7f0482ee2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T18:55:37.877 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.875+0000 7f0482ee2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T18:55:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.895+0000 7efc4b7fe700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:37.895+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T18:55:37.967 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:37.967+0000 7f0482ee2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T18:55:38.048 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.041+0000 7fe364ee2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:55:38.212 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.205+0000 7fe364ee2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:55:38.391 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:38.391+0000 7f0482ee2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T18:55:38.563 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:38.563+0000 7f0482ee2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T18:55:38.582 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.577+0000 7fe364ee2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:55:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:38.699+0000 7efc4b7fe700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:38.699+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T18:55:38.810 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.805+0000 7fe364ee2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:38.907 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.901+0000 7fe364ee2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:55:38.957 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:38.955+0000 7f0482ee2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T18:55:38.988 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:38.981+0000 7fe364ee2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:55:39.070 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.065+0000 7fe364ee2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:55:39.185 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.183+0000 7f0482ee2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T18:55:39.279 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.279+0000 7f0482ee2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T18:55:39.310 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.305+0000 7fe364ee2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:39.355 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.355+0000 7f0482ee2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T18:55:39.395 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.389+0000 7fe364ee2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:55:39.440 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.439+0000 7f0482ee2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T18:55:39.489 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.481+0000 7fe364ee2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:55:39.669 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.667+0000 7f0482ee2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T18:55:39.697 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.689+0000 7fe364ee2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:55:39.748 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.747+0000 7f0482ee2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T18:55:39.787 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:39.781+0000 7fe364ee2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:55:39.836 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:39.835+0000 7f0482ee2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T18:55:40.035 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:40.035+0000 7f0482ee2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T18:55:40.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:40.123+0000 7f0482ee2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T18:55:40.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.303+0000 7efc4b7fe700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T18:55:40.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.303+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T18:55:40.537 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T18:55:40.529+0000 7fe364ee2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:55:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.603+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 68) v1 ==== 79978+0+0 (secure 0 0 0) 0x7efc3404c7c0 con 0x7efc4c0aa080 2023-12-24T18:55:40.871 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:40.871+0000 7f0482ee2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T18:55:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.887+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 69) v1 ==== 79689+0+0 (secure 0 0 0) 0x7efc3406a0e0 con 0x7efc4c0aa080 2023-12-24T18:55:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.887+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T18:55:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:40.887+0000 7efc43fff700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:41.075 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f04465b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.075 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f04465b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.075 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f04465b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.075 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f04465b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.075 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f04465b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f0442daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f0442daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f0442daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f0442daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:55:41.075+0000 7f0442daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:55:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:41.899+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 70) v1 ==== 79816+0+0 (secure 0 0 0) 0x7efc3404d090 con 0x7efc4c0aa080 2023-12-24T18:55:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:41.899+0000 7efc43fff700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:41.899+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efc4c15d860 con 0x7efc2c0605a0 2023-12-24T18:55:41.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:41.903+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:41.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:41.907+0000 7efc4b7fe700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c0629d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0093d0 tx=0x7efc3c0091a0 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.023+0000 7efc43fff700 1 -- 172.21.15.50:0/305808773 <== mgr.8484 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7efc4c15d860 con 0x7efc2c0605a0 2023-12-24T18:55:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1 2023-12-24T18:55:42.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.027+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 msgr2=0x7efc2c0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.027+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c0629d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0093d0 tx=0x7efc3c0091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.027+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 msgr2=0x7efc4c0af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.027+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c590 tx=0x7efc3400c950 comp rx=0 tx=0).stop 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 shutdown_connections 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7efc2c0605a0 0x7efc2c0629d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4c1591a0 0x7efc4c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c0aa080 0x7efc4c0af1b0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 --2- 172.21.15.50:0/305808773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc4c0a8fe0 0x7efc4c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 >> 172.21.15.50:0/305808773 conn(0x7efc4c067b80 msgr2=0x7efc4c0ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 shutdown_connections 2023-12-24T18:55:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.031+0000 7efc51d45700 1 -- 172.21.15.50:0/305808773 wait complete. 2023-12-24T18:55:42.053 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-12-24T18:55:42.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-12-24T18:55:42.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.243+0000 7f13ce2f0700 1 Processor -- start 2023-12-24T18:55:42.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.243+0000 7f13ce2f0700 1 -- start start 2023-12-24T18:55:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13ce2f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13c8160720 0x7f13c806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13ce2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c806ae10 0x7f13c815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13ce2f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c815e960 con 0x7f13c8160af0 2023-12-24T18:55:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13ce2f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c81600a0 con 0x7f13c8160720 2023-12-24T18:55:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13ce2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815dd50 con 0x7f13c806ae10 2023-12-24T18:55:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13c77fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13c8160af0 0x7f13c806a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52338/0 (socket says 172.21.15.50:52338) 2023-12-24T18:55:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13c77fe700 1 -- 172.21.15.50:0/854398116 learned_addr learned my addr 172.21.15.50:0/854398116 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13c7fff700 1 --2- 172.21.15.50:0/854398116 >> v2:172.21.15.50:3300/0 conn(0x7f13c8160720 0x7f13c806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.247+0000 7f13cc88d700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c806ae10 0x7f13c815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c7fff700 1 -- 172.21.15.50:0/854398116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c806ae10 msgr2=0x7f13c815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T18:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c7fff700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c806ae10 0x7f13c815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c7fff700 1 -- 172.21.15.50:0/854398116 >> v1:172.21.15.50:6789/0 conn(0x7f13c8160af0 legacy=0x7f13c806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c6ffd700 1 -- 172.21.15.50:0/854398116 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296143091 0 0) 0x7f13c815e960 con 0x7f13c8160af0 2023-12-24T18:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c7fff700 1 -- 172.21.15.50:0/854398116 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c815e030 con 0x7f13c8160720 2023-12-24T18:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c7fff700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c8160720 0x7f13c806d1e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f13b80098e0 tx=0x7f13b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f7f9fa4c9acb90 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c6ffd700 1 -- 172.21.15.50:0/854398116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800b640 con 0x7f13c8160720 2023-12-24T18:55:42.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c6ffd700 1 -- 172.21.15.50:0/854398116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b800b7a0 con 0x7f13c8160720 2023-12-24T18:55:42.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13c6ffd700 1 -- 172.21.15.50:0/854398116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800bb40 con 0x7f13c8160720 2023-12-24T18:55:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 -- 172.21.15.50:0/854398116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c8160720 msgr2=0x7f13c806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c8160720 0x7f13c806d1e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f13b80098e0 tx=0x7f13b80091a0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 -- 172.21.15.50:0/854398116 shutdown_connections 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c806ae10 0x7f13c815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/854398116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c8160720 0x7f13c806d1e0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 -- 172.21.15.50:0/854398116 >> 172.21.15.50:0/854398116 conn(0x7f13c8067b80 msgr2=0x7f13c80cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 -- 172.21.15.50:0/854398116 shutdown_connections 2023-12-24T18:55:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.251+0000 7f13ce2f0700 1 -- 172.21.15.50:0/854398116 wait complete. 2023-12-24T18:55:42.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.255+0000 7f13ce2f0700 1 Processor -- start 2023-12-24T18:55:42.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.255+0000 7f13ce2f0700 1 -- start start 2023-12-24T18:55:42.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 0x7f13c81568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c8160af0 0x7f13c8156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80af190 con 0x7f13c806ae10 2023-12-24T18:55:42.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8159aa0 con 0x7f13c8160720 2023-12-24T18:55:42.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80af3e0 con 0x7f13c8160af0 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41180/0 (socket says 172.21.15.50:41180) 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 -- 172.21.15.50:0/2077484388 learned_addr learned my addr 172.21.15.50:0/2077484388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13cc88d700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c8160af0 0x7f13c8156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c77fe700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 0x7f13c81568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 -- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c8160af0 msgr2=0x7f13c8156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c8160af0 0x7f13c8156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 -- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 msgr2=0x7f13c81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 0x7f13c81568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 -- 172.21.15.50:0/2077484388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8009420 con 0x7f13c806ae10 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c77fe700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 0x7f13c81568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13c7fff700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f13c8069b20 tx=0x7f13b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800bb20 con 0x7f13c806ae10 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8011420 con 0x7f13c806ae10 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c80af6c0 con 0x7f13c806ae10 2023-12-24T18:55:42.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b80117a0 con 0x7f13c806ae10 2023-12-24T18:55:42.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.259+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c8141640 con 0x7f13c806ae10 2023-12-24T18:55:42.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.263+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c80652e0 con 0x7f13c806ae10 2023-12-24T18:55:42.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.263+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 70) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f13b8011b10 con 0x7f13c806ae10 2023-12-24T18:55:42.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.263+0000 7f13bffff700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 0x7f13a80628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.263+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f13b807dd70 con 0x7f13c806ae10 2023-12-24T18:55:42.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.267+0000 7f13c77fe700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 0x7f13a80628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.267+0000 7f13c77fe700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 0x7f13a80628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f13c806bc30 tx=0x7f13b0009040 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.271+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f13b804e1f0 con 0x7f13c806ae10 2023-12-24T18:55:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.471+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f13c815e310 con 0x7f13a80603f0 2023-12-24T18:55:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.587+0000 7f13bffff700 1 -- 172.21.15.50:0/2077484388 <== mgr.8484 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f13c815e310 con 0x7f13a80603f0 2023-12-24T18:55:42.588 INFO:teuthology.orchestra.run.smithi050.stdout:Retention added to path /snap_test_dir1 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 msgr2=0x7f13a80628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 0x7f13a80628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f13c806bc30 tx=0x7f13b0009040 comp rx=0 tx=0).stop 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 msgr2=0x7f13c8141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f13c8069b20 tx=0x7f13b8017000 comp rx=0 tx=0).stop 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 shutdown_connections 2023-12-24T18:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f13a80603f0 0x7f13a80628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13c8160af0 0x7f13c8156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c8160720 0x7f13c81568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 --2- 172.21.15.50:0/2077484388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13c806ae10 0x7f13c8141100 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 >> 172.21.15.50:0/2077484388 conn(0x7f13c8067b80 msgr2=0x7f13c8155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 shutdown_connections 2023-12-24T18:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.591+0000 7f13ce2f0700 1 -- 172.21.15.50:0/2077484388 wait complete. 2023-12-24T18:55:42.617 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-12-24T18:55:42.617 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-12-24T18:55:42.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-12-24T18:55:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.807+0000 7f046b4e3700 1 Processor -- start 2023-12-24T18:55:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.807+0000 7f046b4e3700 1 -- start start 2023-12-24T18:55:42.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046b4e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 0x7f04640c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046b4e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640c9670 con 0x7f04640b1a40 2023-12-24T18:55:42.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046b4e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640c9360 con 0x7f04640c88a0 2023-12-24T18:55:42.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046b4e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0464158340 con 0x7f04640ca210 2023-12-24T18:55:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f0469ce0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04640b1a40 0x7f04640c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52352/0 (socket says 172.21.15.50:52352) 2023-12-24T18:55:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f0469ce0700 1 -- 172.21.15.50:0/2349216150 learned_addr learned my addr 172.21.15.50:0/2349216150 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T18:55:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046ace2700 1 --2- 172.21.15.50:0/2349216150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 0x7f04640c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919225875 0 0) 0x7f04640c9670 con 0x7f04640b1a40 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0450003570 con 0x7f04640b1a40 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240312568 0 0) 0x7f04640c9360 con 0x7f04640c88a0 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04640c9670 con 0x7f04640c88a0 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046ace2700 1 -- 172.21.15.50:0/2349216150 >> v1:172.21.15.82:6789/0 conn(0x7f04640c88a0 legacy=0x7f0464158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046ace2700 1 -- 172.21.15.50:0/2349216150 >> v1:172.21.15.50:6789/0 conn(0x7f04640b1a40 legacy=0x7f04640c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.811+0000 7f046ace2700 1 -- 172.21.15.50:0/2349216150 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464157aa0 con 0x7f04640ca210 2023-12-24T18:55:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046ace2700 1 --2- 172.21.15.50:0/2349216150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 0x7f04640c8c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f045c009e90 tx=0x7f045c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb514ca53fbcac44 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00e070 con 0x7f04640ca210 2023-12-24T18:55:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00bb80 con 0x7f04640ca210 2023-12-24T18:55:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f04694df700 1 -- 172.21.15.50:0/2349216150 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c012430 con 0x7f04640ca210 2023-12-24T18:55:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 -- 172.21.15.50:0/2349216150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 msgr2=0x7f04640c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 --2- 172.21.15.50:0/2349216150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 0x7f04640c8c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f045c009e90 tx=0x7f045c009780 comp rx=0 tx=0).stop 2023-12-24T18:55:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 -- 172.21.15.50:0/2349216150 shutdown_connections 2023-12-24T18:55:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 --2- 172.21.15.50:0/2349216150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640ca210 0x7f04640c8c70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 -- 172.21.15.50:0/2349216150 >> 172.21.15.50:0/2349216150 conn(0x7f04640af9b0 msgr2=0x7f04640afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 -- 172.21.15.50:0/2349216150 shutdown_connections 2023-12-24T18:55:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.815+0000 7f046b4e3700 1 -- 172.21.15.50:0/2349216150 wait complete. 2023-12-24T18:55:42.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 Processor -- start 2023-12-24T18:55:42.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 -- start start 2023-12-24T18:55:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 0x7f046415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 0x7f04640c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464169d40 con 0x7f04640b1a40 2023-12-24T18:55:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640c6540 con 0x7f046415cf30 2023-12-24T18:55:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046b4e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0464169eb0 con 0x7f04640c88a0 2023-12-24T18:55:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41182/0 (socket says 172.21.15.50:41182) 2023-12-24T18:55:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f0469ce0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 0x7f046415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 -- 172.21.15.50:0/3516049761 learned_addr learned my addr 172.21.15.50:0/3516049761 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T18:55:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046ace2700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 0x7f04640c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 -- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 msgr2=0x7f046415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 0x7f046415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 -- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 msgr2=0x7f04640c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 0x7f04640c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 -- 172.21.15.50:0/3516049761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c009a20 con 0x7f04640b1a40 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f0469ce0700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 0x7f046415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046ace2700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 0x7f04640c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T18:55:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.819+0000 7f046a4e1700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f046000c790 tx=0x7f0460007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460010510 con 0x7f04640b1a40 2023-12-24T18:55:42.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460010670 con 0x7f04640b1a40 2023-12-24T18:55:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460010a10 con 0x7f04640b1a40 2023-12-24T18:55:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046415d3a0 con 0x7f04640b1a40 2023-12-24T18:55:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0464156ff0 con 0x7f04640b1a40 2023-12-24T18:55:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.823+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046404be40 con 0x7f04640b1a40 2023-12-24T18:55:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.827+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 70) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f046001b3b0 con 0x7f04640b1a40 2023-12-24T18:55:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.827+0000 7f045a7fc700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 0x7f0448062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T18:55:42.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.827+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f046007c1b0 con 0x7f04640b1a40 2023-12-24T18:55:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.827+0000 7f0469ce0700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 0x7f0448062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T18:55:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.827+0000 7f0469ce0700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 0x7f0448062970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04641576d0 tx=0x7f0454009040 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T18:55:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.831+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f046004c630 con 0x7f04640b1a40 2023-12-24T18:55:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:42.911+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 71) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f046004ca00 con 0x7f04640b1a40 2023-12-24T18:55:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.039+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04640af1f0 con 0x7f04480604c0 2023-12-24T18:55:43.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.055+0000 7f045a7fc700 1 -- 172.21.15.50:0/3516049761 <== mgr.8484 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f04640af1f0 con 0x7f04480604c0 2023-12-24T18:55:43.055 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T18:55:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-12-24T18:55:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 msgr2=0x7f0448062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 0x7f0448062970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04641576d0 tx=0x7f0454009040 comp rx=0 tx=0).stop 2023-12-24T18:55:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 msgr2=0x7f0464156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T18:55:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f046000c790 tx=0x7f0460007e10 comp rx=0 tx=0).stop 2023-12-24T18:55:43.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 shutdown_connections 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f04480604c0 0x7f0448062970 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046415cf30 0x7f04640c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04640c88a0 0x7f046415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 --2- 172.21.15.50:0/3516049761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640b1a40 0x7f0464156ab0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 >> 172.21.15.50:0/3516049761 conn(0x7f04640af9b0 msgr2=0x7f04641594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 shutdown_connections 2023-12-24T18:55:43.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T18:55:43.059+0000 7f046b4e3700 1 -- 172.21.15.50:0/3516049761 wait complete. 2023-12-24T18:55:43.079 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-12-24T18:55:43.079 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-12-24T18:55:59.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:55:59.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:56:00.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:56:00.611+0000 7f043558f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:56:00.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:56:00.611+0000 7f043558f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:56:00.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:56:00.611+0000 7f043558f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:56:00.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:56:00.611+0000 7f043558f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:56:00.610 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T18:56:00.611+0000 7f043558f700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T18:56:29.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:56:29.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:56:59.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:56:59.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:57:29.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:57:29.468 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:57:59.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:57:59.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:58:29.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:58:29.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:58:59.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:58:59.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:59:29.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:59:29.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:59:59.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T18:59:59.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:00:30.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:00:30.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:01:00.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:01:00.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:01:30.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:01:30.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:02:00.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:02:00.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:02:30.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:02:30.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:03:00.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:03:00.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:03:30.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:03:30.568 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:04:00.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:04:00.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:04:30.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:04:30.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:05:00.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:05:00.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:05:30.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:05:30.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:06:01.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:06:01.016 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:06:31.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:06:31.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:07:01.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:07:01.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:07:31.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:07:31.269 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:08:01.352 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:08:01.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:08:31.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:08:31.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:09:01.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:09:01.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:09:31.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:09:31.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:10:01.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:10:01.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:10:31.808 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:10:31.816 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:11:01.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:11:01.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:11:31.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:11:31.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:12:02.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:12:02.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:12:32.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:12:32.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:13:02.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:13:02.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:13:32.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:13:32.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:14:02.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:14:02.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:14:32.489 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:14:32.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:15:02.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:15:02.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:15:32.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:15:32.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:16:02.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:16:02.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:16:32.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:16:32.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:17:02.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:17:02.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:17:32.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:17:32.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:18:03.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:18:03.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:18:33.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:18:33.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:19:03.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:19:03.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:19:33.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:19:33.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:20:03.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:20:03.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:20:33.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:20:33.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:21:03.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:21:03.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:21:33.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:21:33.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:22:03.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:22:03.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:22:33.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:22:33.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:23:03.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:23:03.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:23:34.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:23:34.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:24:04.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:24:04.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:24:34.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:24:34.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:25:04.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:25:04.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:25:34.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:25:34.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:26:04.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:26:04.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:26:34.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:26:34.541 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:27:04.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:27:04.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:27:34.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:27:34.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:28:04.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:28:04.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:28:34.908 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:28:34.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:29:04.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:29:05.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:29:35.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:29:35.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:30:05.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:30:05.187 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:30:35.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:30:35.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:31:05.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:31:05.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:31:35.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:31:35.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:32:05.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:32:05.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:32:35.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:32:35.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:33:05.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:33:05.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:33:35.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:33:35.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:34:05.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:34:05.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:34:36.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:34:36.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:35:06.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:35:06.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:35:36.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:35:36.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:36:06.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:36:06.301 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:36:36.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:36:36.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:37:06.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:37:06.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:37:36.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:37:36.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:38:06.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:38:06.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:38:36.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:38:36.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:39:07.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:39:07.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:39:37.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:39:37.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:40:07.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:40:07.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:40:37.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:40:37.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:41:07.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:41:07.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:41:37.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:41:37.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:42:07.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:42:07.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:42:37.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:42:38.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:43:08.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:43:08.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:43:38.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:43:38.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:44:08.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:44:08.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:44:38.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:44:38.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:45:08.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:45:08.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:45:38.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:45:38.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:46:08.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:46:08.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:46:38.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:46:38.990 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:47:09.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:47:09.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:47:39.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:47:39.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:48:09.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:48:09.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:48:39.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:48:39.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:49:09.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:49:09.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:49:40.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:49:40.038 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:50:10.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:50:10.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:50:40.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:50:40.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:51:10.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:51:10.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:51:16.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:16.081 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_57_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_58_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_59_01_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_00_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_01_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_02_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_03_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_04_00_UTC 2023-12-24T19:51:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_05_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_06_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_07_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_08_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_09_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_10_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_11_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_12_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_13_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_14_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_15_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_16_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_17_00_UTC 2023-12-24T19:51:16.113 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_18_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_19_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_20_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_21_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_22_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_23_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_24_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_25_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_26_00_UTC 2023-12-24T19:51:16.114 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_27_00_UTC 2023-12-24T19:51:16.115 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_28_00_UTC 2023-12-24T19:51:16.115 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_29_00_UTC 2023-12-24T19:51:16.115 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_30_00_UTC 2023-12-24T19:51:16.115 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_31_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_32_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_33_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_34_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_35_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_36_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_37_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_38_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_39_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_40_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_41_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_42_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_43_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_44_00_UTC 2023-12-24T19:51:16.116 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_45_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_46_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_47_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_48_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_49_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_50_00_UTC 2023-12-24T19:51:16.117 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_51_00_UTC 2023-12-24T19:51:16.118 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-18_57_00_UTC', 'scheduled-2023-12-24-18_58_00_UTC', 'scheduled-2023-12-24-18_59_01_UTC', 'scheduled-2023-12-24-19_00_00_UTC', 'scheduled-2023-12-24-19_01_00_UTC', 'scheduled-2023-12-24-19_02_00_UTC', 'scheduled-2023-12-24-19_03_00_UTC', 'scheduled-2023-12-24-19_04_00_UTC', 'scheduled-2023-12-24-19_05_00_UTC', 'scheduled-2023-12-24-19_06_00_UTC', 'scheduled-2023-12-24-19_07_00_UTC', 'scheduled-2023-12-24-19_08_00_UTC', 'scheduled-2023-12-24-19_09_00_UTC', 'scheduled-2023-12-24-19_10_00_UTC', 'scheduled-2023-12-24-19_11_00_UTC', 'scheduled-2023-12-24-19_12_00_UTC', 'scheduled-2023-12-24-19_13_00_UTC', 'scheduled-2023-12-24-19_14_00_UTC', 'scheduled-2023-12-24-19_15_00_UTC', 'scheduled-2023-12-24-19_16_00_UTC', 'scheduled-2023-12-24-19_17_00_UTC', 'scheduled-2023-12-24-19_18_00_UTC', 'scheduled-2023-12-24-19_19_00_UTC', 'scheduled-2023-12-24-19_20_00_UTC', 'scheduled-2023-12-24-19_21_00_UTC', 'scheduled-2023-12-24-19_22_00_UTC', 'scheduled-2023-12-24-19_23_00_UTC', 'scheduled-2023-12-24-19_24_00_UTC', 'scheduled-2023-12-24-19_25_00_UTC', 'scheduled-2023-12-24-19_26_00_UTC', 'scheduled-2023-12-24-19_27_00_UTC', 'scheduled-2023-12-24-19_28_00_UTC', 'scheduled-2023-12-24-19_29_00_UTC', 'scheduled-2023-12-24-19_30_00_UTC', 'scheduled-2023-12-24-19_31_00_UTC', 'scheduled-2023-12-24-19_32_00_UTC', 'scheduled-2023-12-24-19_33_00_UTC', 'scheduled-2023-12-24-19_34_00_UTC', 'scheduled-2023-12-24-19_35_00_UTC', 'scheduled-2023-12-24-19_36_00_UTC', 'scheduled-2023-12-24-19_37_00_UTC', 'scheduled-2023-12-24-19_38_00_UTC', 'scheduled-2023-12-24-19_39_00_UTC', 'scheduled-2023-12-24-19_40_00_UTC', 'scheduled-2023-12-24-19_41_00_UTC', 'scheduled-2023-12-24-19_42_00_UTC', 'scheduled-2023-12-24-19_43_00_UTC', 'scheduled-2023-12-24-19_44_00_UTC', 'scheduled-2023-12-24-19_45_00_UTC', 'scheduled-2023-12-24-19_46_00_UTC', 'scheduled-2023-12-24-19_47_00_UTC', 'scheduled-2023-12-24-19_48_00_UTC', 'scheduled-2023-12-24-19_49_00_UTC', 'scheduled-2023-12-24-19_50_00_UTC', 'scheduled-2023-12-24-19_51_00_UTC'] 2023-12-24T19:51:16.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-12-24T19:51:16.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.332+0000 7fdac96ae700 1 Processor -- start 2023-12-24T19:51:16.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.332+0000 7fdac96ae700 1 -- start start 2023-12-24T19:51:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac96ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac40cbb80 0x7fdac415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac96ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdac40cbf50 0x7fdac406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac96ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac406b000 con 0x7fdac406da40 2023-12-24T19:51:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac96ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac406d570 con 0x7fdac40cbf50 2023-12-24T19:51:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac96ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406a6d0 con 0x7fdac40cbb80 2023-12-24T19:51:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdac40cbf50 0x7fdac406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdac40cbf50 0x7fdac406b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:58966/0 (socket says 172.21.15.50:58966) 2023-12-24T19:51:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 -- 172.21.15.50:0/1024401539 learned_addr learned my addr 172.21.15.50:0/1024401539 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac37fe700 1 --1- 172.21.15.50:0/1024401539 >> v1:172.21.15.82:6789/0 conn(0x7fdac406da40 0x7fdac406c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:50298/0 (socket says 172.21.15.50:50298) 2023-12-24T19:51:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac2ffd700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac40cbb80 0x7fdac415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 -- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac40cbb80 msgr2=0x7fdac415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac40cbb80 0x7fdac415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 -- 172.21.15.50:0/1024401539 >> v1:172.21.15.82:6789/0 conn(0x7fdac406da40 legacy=0x7fdac406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.336+0000 7fdac27fc700 1 -- 172.21.15.50:0/1024401539 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac406a9b0 con 0x7fdac40cbf50 2023-12-24T19:51:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac27fc700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac406b490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a09a162345fd366 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac1ffb700 1 -- 172.21.15.50:0/1024401539 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8009ea0 con 0x7fdac40cbf50 2023-12-24T19:51:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac1ffb700 1 -- 172.21.15.50:0/1024401539 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800b860 con 0x7fdac40cbf50 2023-12-24T19:51:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac1ffb700 1 -- 172.21.15.50:0/1024401539 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800bc00 con 0x7fdac40cbf50 2023-12-24T19:51:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 -- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 msgr2=0x7fdac406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac406b490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8009250 comp rx=0 tx=0).stop 2023-12-24T19:51:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 -- 172.21.15.50:0/1024401539 shutdown_connections 2023-12-24T19:51:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac406b490 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 --2- 172.21.15.50:0/1024401539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac40cbb80 0x7fdac415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 -- 172.21.15.50:0/1024401539 >> 172.21.15.50:0/1024401539 conn(0x7fdac4067b80 msgr2=0x7fdac40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 -- 172.21.15.50:0/1024401539 shutdown_connections 2023-12-24T19:51:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.340+0000 7fdac96ae700 1 -- 172.21.15.50:0/1024401539 wait complete. 2023-12-24T19:51:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 Processor -- start 2023-12-24T19:51:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 -- start start 2023-12-24T19:51:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac406da40 0x7fdac41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac40b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40b00d0 con 0x7fdac40cbb80 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4157610 con 0x7fdac40cbf50 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac96ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40b4660 con 0x7fdac406da40 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44744/0 (socket says 172.21.15.50:44744) 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 -- 172.21.15.50:0/3005512820 learned_addr learned my addr 172.21.15.50:0/3005512820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac2ffd700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac406da40 0x7fdac41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac37fe700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac40b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 -- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac406da40 msgr2=0x7fdac41570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac406da40 0x7fdac41570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 -- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 msgr2=0x7fdac40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac40b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac27fc700 1 -- 172.21.15.50:0/3005512820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80094f0 con 0x7fdac40cbb80 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.344+0000 7fdac37fe700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac40b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdac27fc700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fdac4068020 tx=0x7fdab8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800bbe0 con 0x7fdac40cbb80 2023-12-24T19:51:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab8011420 con 0x7fdac40cbb80 2023-12-24T19:51:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac40af4c0 con 0x7fdac40cbb80 2023-12-24T19:51:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80117c0 con 0x7fdac40cbb80 2023-12-24T19:51:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac40afa80 con 0x7fdac40cbb80 2023-12-24T19:51:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.348+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40b0240 con 0x7fdac40cbb80 2023-12-24T19:51:16.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.352+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 73) v1 ==== 80092+0+0 (secure 0 0 0) 0x7fdab8011bf0 con 0x7fdac40cbb80 2023-12-24T19:51:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.352+0000 7fdaaaffd700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 0x7fdab0062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.352+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6731+0+0 (secure 0 0 0) 0x7fdab807e6a0 con 0x7fdac40cbb80 2023-12-24T19:51:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.352+0000 7fdac2ffd700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 0x7fdab0062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.352+0000 7fdac2ffd700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 0x7fdab0062b70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009d10 tx=0x7fdab40091a0 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.360+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdab804e6e0 con 0x7fdac40cbb80 2023-12-24T19:51:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.556+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdac404be40 con 0x7fdab00606c0 2023-12-24T19:51:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.572+0000 7fdaaaffd700 1 -- 172.21.15.50:0/3005512820 <== mgr.8484 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fdac404be40 con 0x7fdab00606c0 2023-12-24T19:51:16.574 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:16.575 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:55:41", "first": "2023-12-24T18:56:00", "last": "2023-12-24T19:51:00", "last_pruned": "2023-12-24T19:51:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-12-24T19:51:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 msgr2=0x7fdab0062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 0x7fdab0062b70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009d10 tx=0x7fdab40091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 msgr2=0x7fdac40b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fdac4068020 tx=0x7fdab8017000 comp rx=0 tx=0).stop 2023-12-24T19:51:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 shutdown_connections 2023-12-24T19:51:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fdab00606c0 0x7fdab0062b70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac40cbf50 0x7fdac40b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac40cbb80 0x7fdac40b0560 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 --2- 172.21.15.50:0/3005512820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdac406da40 0x7fdac41570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.576+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 >> 172.21.15.50:0/3005512820 conn(0x7fdac4067b80 msgr2=0x7fdac40c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.580+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 shutdown_connections 2023-12-24T19:51:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.580+0000 7fdac96ae700 1 -- 172.21.15.50:0/3005512820 wait complete. 2023-12-24T19:51:16.602 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T18:55:41", "first": "2023-12-24T18:56:00", "last": "2023-12-24T19:51:00", "last_pruned": "2023-12-24T19:51:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-12-24T19:51:16.602 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T18:55:41', 'first': '2023-12-24T18:56:00', 'last': '2023-12-24T19:51:00', 'last_pruned': '2023-12-24T19:51:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-12-24T19:51:16.603 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-12-24T19:51:16.603 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-12-24T19:51:16.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-12-24T19:51:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.776+0000 7f2afee0c700 1 Processor -- start 2023-12-24T19:51:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.776+0000 7f2afee0c700 1 -- start start 2023-12-24T19:51:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afee0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2af806a4a0 0x7f2af80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afee0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af80c5ac0 0x7f2af80cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afee0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af80c5f20 con 0x7f2af8159080 2023-12-24T19:51:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afee0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af815dbd0 con 0x7f2af806a4a0 2023-12-24T19:51:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afee0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af806b5b0 con 0x7f2af80c5ac0 2023-12-24T19:51:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afd609700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2af806a4a0 0x7f2af80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afd609700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2af806a4a0 0x7f2af80c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44754/0 (socket says 172.21.15.50:44754) 2023-12-24T19:51:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afd609700 1 -- 172.21.15.50:0/3310113051 learned_addr learned my addr 172.21.15.50:0/3310113051 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.780+0000 7f2afe60b700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af80c5ac0 0x7f2af80cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afd609700 1 -- 172.21.15.50:0/3310113051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af80c5ac0 msgr2=0x7f2af80cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afd609700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af80c5ac0 0x7f2af80cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afd609700 1 -- 172.21.15.50:0/3310113051 >> v1:172.21.15.82:6789/0 conn(0x7f2af8159080 legacy=0x7f2af806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afd609700 1 -- 172.21.15.50:0/3310113051 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af806a9a0 con 0x7f2af806a4a0 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afd609700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af806a4a0 0x7f2af80c5580 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80099b0 tx=0x7f2ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5007c5d11cb5754 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afce08700 1 -- 172.21.15.50:0/3310113051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae800b860 con 0x7f2af806a4a0 2023-12-24T19:51:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afce08700 1 -- 172.21.15.50:0/3310113051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae800b9c0 con 0x7f2af806a4a0 2023-12-24T19:51:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afce08700 1 -- 172.21.15.50:0/3310113051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae800bd60 con 0x7f2af806a4a0 2023-12-24T19:51:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 -- 172.21.15.50:0/3310113051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af806a4a0 msgr2=0x7f2af80c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af806a4a0 0x7f2af80c5580 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80099b0 tx=0x7f2ae8009250 comp rx=0 tx=0).stop 2023-12-24T19:51:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 -- 172.21.15.50:0/3310113051 shutdown_connections 2023-12-24T19:51:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af80c5ac0 0x7f2af80cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 --2- 172.21.15.50:0/3310113051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af806a4a0 0x7f2af80c5580 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 -- 172.21.15.50:0/3310113051 >> 172.21.15.50:0/3310113051 conn(0x7f2af8067b80 msgr2=0x7f2af80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 -- 172.21.15.50:0/3310113051 shutdown_connections 2023-12-24T19:51:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.784+0000 7f2afee0c700 1 -- 172.21.15.50:0/3310113051 wait complete. 2023-12-24T19:51:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 Processor -- start 2023-12-24T19:51:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 -- start start 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af806a4a0 0x7f2af815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af8159080 0x7f2af80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814a310 con 0x7f2af80c5ac0 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814abb0 con 0x7f2af806a4a0 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afee0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af815c2d0 con 0x7f2af8159080 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44756/0 (socket says 172.21.15.50:44756) 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 -- 172.21.15.50:0/1809893198 learned_addr learned my addr 172.21.15.50:0/1809893198 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afe60b700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af8159080 0x7f2af80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afde0a700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af806a4a0 0x7f2af815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 -- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af8159080 msgr2=0x7f2af80c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af8159080 0x7f2af80c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 -- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af806a4a0 msgr2=0x7f2af815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af806a4a0 0x7f2af815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 -- 172.21.15.50:0/1809893198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80094f0 con 0x7f2af80c5ac0 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.788+0000 7f2afd609700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2af8064390 tx=0x7f2ae8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011dc0 con 0x7f2af80c5ac0 2023-12-24T19:51:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8024440 con 0x7f2af80c5ac0 2023-12-24T19:51:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af814a560 con 0x7f2af80c5ac0 2023-12-24T19:51:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8024800 con 0x7f2af80c5ac0 2023-12-24T19:51:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af8150b90 con 0x7f2af80c5ac0 2023-12-24T19:51:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.792+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af804be40 con 0x7f2af80c5ac0 2023-12-24T19:51:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.796+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 73) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f2ae801a420 con 0x7f2af80c5ac0 2023-12-24T19:51:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.796+0000 7f2aedffb700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 0x7f2adc062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.796+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6731+0+0 (secure 0 0 0) 0x7f2ae807ec70 con 0x7f2af80c5ac0 2023-12-24T19:51:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.796+0000 7f2afde0a700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 0x7f2adc062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:16.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.796+0000 7f2afde0a700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 0x7f2adc062b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af40016f0 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:16.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:16.804+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ae804ecb0 con 0x7f2af80c5ac0 2023-12-24T19:51:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.019+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2af806e1c0 con 0x7f2adc0606c0 2023-12-24T19:51:17.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.163+0000 7f2aedffb700 1 -- 172.21.15.50:0/1809893198 <== mgr.8484 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7f2af806e1c0 con 0x7f2adc0606c0 2023-12-24T19:51:17.164 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 msgr2=0x7f2adc062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 0x7f2adc062b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af40016f0 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 msgr2=0x7f2af8158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2af8064390 tx=0x7f2ae8017000 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 shutdown_connections 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2adc0606c0 0x7f2adc062b70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af8159080 0x7f2af80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af80c5ac0 0x7f2af8158050 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 --2- 172.21.15.50:0/1809893198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af806a4a0 0x7f2af815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 >> 172.21.15.50:0/1809893198 conn(0x7f2af8067b80 msgr2=0x7f2af80c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 shutdown_connections 2023-12-24T19:51:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:17.167+0000 7f2afee0c700 1 -- 172.21.15.50:0/1809893198 wait complete. 2023-12-24T19:51:17.191 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-12-24T19:51:17.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.191 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T19:51:17.218 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_57_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_58_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-18_59_01_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_00_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_01_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_02_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_03_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_04_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_05_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_06_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_07_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_08_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_09_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_10_00_UTC 2023-12-24T19:51:17.219 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_11_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_12_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_13_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_14_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_15_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_16_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_17_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_18_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_19_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_20_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_21_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_22_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_23_00_UTC 2023-12-24T19:51:17.220 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_24_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_25_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_26_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_27_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_28_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_29_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_30_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_31_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_32_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_33_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_34_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_35_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_36_00_UTC 2023-12-24T19:51:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_37_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_38_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_39_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_40_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_41_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_42_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_43_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_44_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_45_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_46_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_47_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_48_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_49_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_50_00_UTC 2023-12-24T19:51:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_51_00_UTC 2023-12-24T19:51:17.223 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_57_00_UTC 2023-12-24T19:51:17.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.224 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_57_00_UTC) 2023-12-24T19:51:17.302 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_58_00_UTC 2023-12-24T19:51:17.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.302 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_58_00_UTC) 2023-12-24T19:51:17.375 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-18_59_01_UTC 2023-12-24T19:51:17.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.376 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-18_59_01_UTC) 2023-12-24T19:51:17.453 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_00_00_UTC 2023-12-24T19:51:17.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.454 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_00_00_UTC) 2023-12-24T19:51:17.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_01_00_UTC 2023-12-24T19:51:17.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.535 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_01_00_UTC) 2023-12-24T19:51:17.615 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_02_00_UTC 2023-12-24T19:51:17.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.615 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_02_00_UTC) 2023-12-24T19:51:17.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_03_00_UTC 2023-12-24T19:51:17.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.698 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_03_00_UTC) 2023-12-24T19:51:17.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_04_00_UTC 2023-12-24T19:51:17.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.774 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_04_00_UTC) 2023-12-24T19:51:17.848 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_05_00_UTC 2023-12-24T19:51:17.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.849 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_05_00_UTC) 2023-12-24T19:51:17.926 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_06_00_UTC 2023-12-24T19:51:17.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:17.927 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_06_00_UTC) 2023-12-24T19:51:18.002 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_07_00_UTC 2023-12-24T19:51:18.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.003 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_07_00_UTC) 2023-12-24T19:51:18.086 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_08_00_UTC 2023-12-24T19:51:18.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.086 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_08_00_UTC) 2023-12-24T19:51:18.161 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_09_00_UTC 2023-12-24T19:51:18.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.161 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_09_00_UTC) 2023-12-24T19:51:18.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_10_00_UTC 2023-12-24T19:51:18.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.242 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_10_00_UTC) 2023-12-24T19:51:18.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_11_00_UTC 2023-12-24T19:51:18.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.319 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_11_00_UTC) 2023-12-24T19:51:18.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_12_00_UTC 2023-12-24T19:51:18.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.399 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_12_00_UTC) 2023-12-24T19:51:18.474 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_13_00_UTC 2023-12-24T19:51:18.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.474 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_13_00_UTC) 2023-12-24T19:51:18.548 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_14_00_UTC 2023-12-24T19:51:18.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.548 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_14_00_UTC) 2023-12-24T19:51:18.627 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_15_00_UTC 2023-12-24T19:51:18.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.627 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_15_00_UTC) 2023-12-24T19:51:18.704 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_16_00_UTC 2023-12-24T19:51:18.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.704 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_16_00_UTC) 2023-12-24T19:51:18.780 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_17_00_UTC 2023-12-24T19:51:18.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.780 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_17_00_UTC) 2023-12-24T19:51:18.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_18_00_UTC 2023-12-24T19:51:18.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.859 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_18_00_UTC) 2023-12-24T19:51:18.941 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_19_00_UTC 2023-12-24T19:51:18.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:18.941 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_19_00_UTC) 2023-12-24T19:51:19.017 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_20_00_UTC 2023-12-24T19:51:19.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.017 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_20_00_UTC) 2023-12-24T19:51:19.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_21_00_UTC 2023-12-24T19:51:19.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.096 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_21_00_UTC) 2023-12-24T19:51:19.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_22_00_UTC 2023-12-24T19:51:19.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.172 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_22_00_UTC) 2023-12-24T19:51:19.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_23_00_UTC 2023-12-24T19:51:19.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.249 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_23_00_UTC) 2023-12-24T19:51:19.327 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_24_00_UTC 2023-12-24T19:51:19.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.327 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_24_00_UTC) 2023-12-24T19:51:19.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_25_00_UTC 2023-12-24T19:51:19.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.407 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_25_00_UTC) 2023-12-24T19:51:19.487 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_26_00_UTC 2023-12-24T19:51:19.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.487 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_26_00_UTC) 2023-12-24T19:51:19.566 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_27_00_UTC 2023-12-24T19:51:19.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.567 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_27_00_UTC) 2023-12-24T19:51:19.645 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_28_00_UTC 2023-12-24T19:51:19.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.645 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_28_00_UTC) 2023-12-24T19:51:19.723 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_29_00_UTC 2023-12-24T19:51:19.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.723 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_29_00_UTC) 2023-12-24T19:51:19.806 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_30_00_UTC 2023-12-24T19:51:19.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.807 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_30_00_UTC) 2023-12-24T19:51:19.886 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_31_00_UTC 2023-12-24T19:51:19.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.886 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_31_00_UTC) 2023-12-24T19:51:19.959 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_32_00_UTC 2023-12-24T19:51:19.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:19.960 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_32_00_UTC) 2023-12-24T19:51:20.037 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_33_00_UTC 2023-12-24T19:51:20.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_33_00_UTC) 2023-12-24T19:51:20.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_34_00_UTC 2023-12-24T19:51:20.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.114 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_34_00_UTC) 2023-12-24T19:51:20.186 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_35_00_UTC 2023-12-24T19:51:20.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.187 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_35_00_UTC) 2023-12-24T19:51:20.263 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_36_00_UTC 2023-12-24T19:51:20.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.264 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_36_00_UTC) 2023-12-24T19:51:20.345 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_37_00_UTC 2023-12-24T19:51:20.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.345 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_37_00_UTC) 2023-12-24T19:51:20.417 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_38_00_UTC 2023-12-24T19:51:20.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.418 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_38_00_UTC) 2023-12-24T19:51:20.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_39_00_UTC 2023-12-24T19:51:20.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.493 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_39_00_UTC) 2023-12-24T19:51:20.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_40_00_UTC 2023-12-24T19:51:20.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.569 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_40_00_UTC) 2023-12-24T19:51:20.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_41_00_UTC 2023-12-24T19:51:20.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.642 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_41_00_UTC) 2023-12-24T19:51:20.718 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_42_00_UTC 2023-12-24T19:51:20.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.718 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_42_00_UTC) 2023-12-24T19:51:20.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_43_00_UTC 2023-12-24T19:51:20.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.794 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_43_00_UTC) 2023-12-24T19:51:20.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_44_00_UTC 2023-12-24T19:51:20.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:20.868 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_44_00_UTC) 2023-12-24T19:51:20.946 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_45_00_UTC 2023-12-24T19:51:21.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.098 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_45_00_UTC) 2023-12-24T19:51:21.133 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_46_00_UTC 2023-12-24T19:51:21.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.134 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_46_00_UTC) 2023-12-24T19:51:21.211 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_47_00_UTC 2023-12-24T19:51:21.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.211 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_47_00_UTC) 2023-12-24T19:51:21.288 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_48_00_UTC 2023-12-24T19:51:21.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.289 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_48_00_UTC) 2023-12-24T19:51:21.368 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_49_00_UTC 2023-12-24T19:51:21.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.369 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_49_00_UTC) 2023-12-24T19:51:21.460 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_50_00_UTC 2023-12-24T19:51:21.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.460 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_50_00_UTC) 2023-12-24T19:51:21.551 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-19_51_00_UTC 2023-12-24T19:51:21.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.551 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-19_51_00_UTC) 2023-12-24T19:51:21.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:21.641 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T19:51:21.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T19:51:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.987+0000 7f32c6643700 1 Processor -- start 2023-12-24T19:51:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.987+0000 7f32c6643700 1 -- start start 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32c00bebc0 0x7f32c00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f32c00ab920 0x7f32c0160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00c9ea0 con 0x7f32c00bebc0 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c015d840 con 0x7f32c00ab920 2023-12-24T19:51:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c6643700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0161780 con 0x7f32c00bef90 2023-12-24T19:51:21.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c5e42700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:21.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c5e42700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:58216/0 (socket says 172.21.15.50:58216) 2023-12-24T19:51:21.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.991+0000 7f32c5e42700 1 -- 172.21.15.50:0/2723708524 learned_addr learned my addr 172.21.15.50:0/2723708524 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c4e40700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.82:3300/0 conn(0x7f32c00ab920 0x7f32c0160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5641700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.50:3300/0 conn(0x7f32c00bebc0 0x7f32c00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5e42700 1 -- 172.21.15.50:0/2723708524 >> v2:172.21.15.82:3300/0 conn(0x7f32c00ab920 msgr2=0x7f32c0160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5e42700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.82:3300/0 conn(0x7f32c00ab920 0x7f32c0160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5e42700 1 -- 172.21.15.50:0/2723708524 >> v2:172.21.15.50:3300/0 conn(0x7f32c00bebc0 msgr2=0x7f32c00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5e42700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.50:3300/0 conn(0x7f32c00bebc0 0x7f32c00c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.995+0000 7f32c5e42700 1 -- 172.21.15.50:0/2723708524 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0161a60 con 0x7f32c00bef90 2023-12-24T19:51:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.999+0000 7f32c5e42700 1 --2- 172.21.15.50:0/2723708524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32c00aad70 tx=0x7f32b8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722bd58a6ef356e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.999+0000 7f32b7fff700 1 -- 172.21.15.50:0/2723708524 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e070 con 0x7f32c00bef90 2023-12-24T19:51:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.999+0000 7f32b7fff700 1 -- 172.21.15.50:0/2723708524 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800ba20 con 0x7f32c00bef90 2023-12-24T19:51:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:21.999+0000 7f32b7fff700 1 -- 172.21.15.50:0/2723708524 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b80092e0 con 0x7f32c00bef90 2023-12-24T19:51:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 -- 172.21.15.50:0/2723708524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 msgr2=0x7f32c00c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 --2- 172.21.15.50:0/2723708524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32c00aad70 tx=0x7f32b8009840 comp rx=0 tx=0).stop 2023-12-24T19:51:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 -- 172.21.15.50:0/2723708524 shutdown_connections 2023-12-24T19:51:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.82:3300/0 conn(0x7f32c00ab920 0x7f32c0160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 --2- 172.21.15.50:0/2723708524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bef90 0x7f32c00c87d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 --2- 172.21.15.50:0/2723708524 >> v2:172.21.15.50:3300/0 conn(0x7f32c00bebc0 0x7f32c00c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 -- 172.21.15.50:0/2723708524 >> 172.21.15.50:0/2723708524 conn(0x7f32c0067250 msgr2=0x7f32c0067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 -- 172.21.15.50:0/2723708524 shutdown_connections 2023-12-24T19:51:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.003+0000 7f32c6643700 1 -- 172.21.15.50:0/2723708524 wait complete. 2023-12-24T19:51:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.007+0000 7f32c6643700 1 Processor -- start 2023-12-24T19:51:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.011+0000 7f32c6643700 1 -- start start 2023-12-24T19:51:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.011+0000 7f32c6643700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c00ab920 0x7f32c015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.011+0000 7f32c6643700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bebc0 0x7f32c00b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.011+0000 7f32c6643700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c6643700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00b14d0 con 0x7f32c00ab920 2023-12-24T19:51:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c6643700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00c2ce0 con 0x7f32c00bef90 2023-12-24T19:51:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c6643700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00b0740 con 0x7f32c00bebc0 2023-12-24T19:51:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:34882/0 (socket says 172.21.15.50:34882) 2023-12-24T19:51:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 -- 172.21.15.50:0/711177336 learned_addr learned my addr 172.21.15.50:0/711177336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c4e40700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bebc0 0x7f32c00b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 -- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bebc0 msgr2=0x7f32c00b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bebc0 0x7f32c00b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 -- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c00ab920 msgr2=0x7f32c015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c00ab920 0x7f32c015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 -- 172.21.15.50:0/711177336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8009ae0 con 0x7f32c00bef90 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c5e42700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f32c01618c0 tx=0x7f32b8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b80032f0 con 0x7f32c00bef90 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b8026460 con 0x7f32c00bef90 2023-12-24T19:51:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8026800 con 0x7f32c00bef90 2023-12-24T19:51:22.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c00bf9c0 con 0x7f32c00bef90 2023-12-24T19:51:22.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.015+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c00bff80 con 0x7f32c00bef90 2023-12-24T19:51:22.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.019+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c00c2ec0 con 0x7f32c00bef90 2023-12-24T19:51:22.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.019+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 73) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f32b8003040 con 0x7f32c00bef90 2023-12-24T19:51:22.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.023+0000 7f32b57fa700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 0x7f32a4062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.023+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f32b807efb0 con 0x7f32c00bef90 2023-12-24T19:51:22.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.023+0000 7f32c5641700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 0x7f32a4062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.031+0000 7f32c5641700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 0x7f32a4062b70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009a60 tx=0x7f32bc008040 comp rx=0 tx=0).ready entity=mgr.8484 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:22.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.031+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f32b804ef50 con 0x7f32c00bef90 2023-12-24T19:51:22.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.259+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f32c004be40 con 0x7f32c00bef90 2023-12-24T19:51:22.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.459+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f32b807d090 con 0x7f32c00bef90 2023-12-24T19:51:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.459+0000 7f32b57fa700 1 -- 172.21.15.50:0/711177336 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v74) v1 ==== 93+0+0 (secure 0 0 0) 0x7f32b80529e0 con 0x7f32c00bef90 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 msgr2=0x7f32a4062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 0x7f32a4062b70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009a60 tx=0x7f32bc008040 comp rx=0 tx=0).stop 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 msgr2=0x7f32c00accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f32c01618c0 tx=0x7f32b8018000 comp rx=0 tx=0).stop 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 shutdown_connections 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f32a40606c0 0x7f32a4062b70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c00bef90 0x7f32c00accc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32c00bebc0 0x7f32c00b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 --2- 172.21.15.50:0/711177336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c00ab920 0x7f32c015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 >> 172.21.15.50:0/711177336 conn(0x7f32c0067250 msgr2=0x7f32c006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 shutdown_connections 2023-12-24T19:51:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.463+0000 7f32c6643700 1 -- 172.21.15.50:0/711177336 wait complete. 2023-12-24T19:51:22.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:51:22.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:51:22.526 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:51:22.557 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:51:22.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T19:51:22.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:22.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T19:51:22.626 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T19:51:22.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:22.626 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T19:51:22.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:22.644 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:22.638+0000 7effbb166000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:51:22.666 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:22.663+0000 7f1f9095b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:51:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.855+0000 7f08074f0700 1 Processor -- start 2023-12-24T19:51:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.855+0000 7f08074f0700 1 -- start start 2023-12-24T19:51:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f08074f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08001594c0 0x7f080006e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f08074f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0800158020 con 0x7f08000696a0 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f08074f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000ac120 con 0x7f0800155b10 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f08074f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080006eee0 con 0x7f08001594c0 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08001594c0 0x7f080006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08001594c0 0x7f080006e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40720/0 (socket says 172.21.15.50:40720) 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 -- 172.21.15.50:0/2230156186 learned_addr learned my addr 172.21.15.50:0/2230156186 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0804a8b700 1 --1- 172.21.15.50:0/2230156186 >> v1:172.21.15.50:6789/0 conn(0x7f08000696a0 0x7f0800155ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55034/0 (socket says 172.21.15.50:55034) 2023-12-24T19:51:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 -- 172.21.15.50:0/2230156186 >> v1:172.21.15.82:6789/0 conn(0x7f0800155b10 legacy=0x7f0800068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 -- 172.21.15.50:0/2230156186 >> v1:172.21.15.50:6789/0 conn(0x7f08000696a0 legacy=0x7f0800155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f07f7fff700 1 -- 172.21.15.50:0/2230156186 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110202193 0 0) 0x7f0800158020 con 0x7f08000696a0 2023-12-24T19:51:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 -- 172.21.15.50:0/2230156186 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08001576f0 con 0x7f08001594c0 2023-12-24T19:51:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f0805a8d700 1 --2- 172.21.15.50:0/2230156186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006e850 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009f20 tx=0x7f07f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dfb790219abde2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f07f7fff700 1 -- 172.21.15.50:0/2230156186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800e070 con 0x7f08001594c0 2023-12-24T19:51:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f07f7fff700 1 -- 172.21.15.50:0/2230156186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800ba80 con 0x7f08001594c0 2023-12-24T19:51:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.859+0000 7f07f7fff700 1 -- 172.21.15.50:0/2230156186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80092e0 con 0x7f08001594c0 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- 172.21.15.50:0/2230156186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 msgr2=0x7f080006e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 --2- 172.21.15.50:0/2230156186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006e850 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009f20 tx=0x7f07f8009840 comp rx=0 tx=0).stop 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- 172.21.15.50:0/2230156186 shutdown_connections 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 --2- 172.21.15.50:0/2230156186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006e850 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- 172.21.15.50:0/2230156186 >> 172.21.15.50:0/2230156186 conn(0x7f08000ccce0 msgr2=0x7f08000cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- 172.21.15.50:0/2230156186 shutdown_connections 2023-12-24T19:51:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- 172.21.15.50:0/2230156186 wait complete. 2023-12-24T19:51:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 Processor -- start 2023-12-24T19:51:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.863+0000 7f08074f0700 1 -- start start 2023-12-24T19:51:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08000696a0 0x7f080013a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0800155b10 0x7f08000ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000af1a0 con 0x7f08001594c0 2023-12-24T19:51:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000b00a0 con 0x7f08000696a0 2023-12-24T19:51:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000aeb50 con 0x7f0800155b10 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40724/0 (socket says 172.21.15.50:40724) 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 -- 172.21.15.50:0/2598686095 learned_addr learned my addr 172.21.15.50:0/2598686095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f080528c700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08000696a0 0x7f080013a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0804a8b700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0800155b10 0x7f08000ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0800155b10 msgr2=0x7f08000ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0800155b10 0x7f08000ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08000696a0 msgr2=0x7f080013a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08000696a0 0x7f080013a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 -- 172.21.15.50:0/2598686095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009ae0 con 0x7f08001594c0 2023-12-24T19:51:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f0805a8d700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f07f8012000 tx=0x7f07f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8007dc0 con 0x7f08001594c0 2023-12-24T19:51:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8025460 con 0x7f08001594c0 2023-12-24T19:51:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8025820 con 0x7f08001594c0 2023-12-24T19:51:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08000aee30 con 0x7f08001594c0 2023-12-24T19:51:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.867+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080013ab60 con 0x7f08001594c0 2023-12-24T19:51:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800155710 con 0x7f08001594c0 2023-12-24T19:51:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f07f801c410 con 0x7f08001594c0 2023-12-24T19:51:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f07f57fa700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 0x7f07e4062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f07f807e600 con 0x7f08001594c0 2023-12-24T19:51:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f080528c700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 msgr2=0x7f07e4062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.871+0000 7f080528c700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 0x7f07e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:22.879+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0800155710 con 0x7f08001594c0 2023-12-24T19:51:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.075+0000 7f080528c700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 msgr2=0x7f07e4062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.075+0000 7f080528c700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 0x7f07e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.119+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08000ae9a0 con 0x7f08001594c0 2023-12-24T19:51:23.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f07f57fa700 1 -- 172.21.15.50:0/2598686095 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f07f804e5a0 con 0x7f08001594c0 2023-12-24T19:51:23.123 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:23.124 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 msgr2=0x7f07e4062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 0x7f07e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 msgr2=0x7f080006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f07f8012000 tx=0x7f07f8018000 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 shutdown_connections 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f07e4060670 0x7f07e4062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08001594c0 0x7f080006c820 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0800155b10 0x7f08000ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 --2- 172.21.15.50:0/2598686095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08000696a0 0x7f080013a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 >> 172.21.15.50:0/2598686095 conn(0x7f08000ccce0 msgr2=0x7f08000ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 shutdown_connections 2023-12-24T19:51:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.123+0000 7f08074f0700 1 -- 172.21.15.50:0/2598686095 wait complete. 2023-12-24T19:51:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T19:51:23.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:23.162 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.158+0000 7effbb166000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:51:23.237 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.230+0000 7effbb166000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:51:23.253 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:23.251+0000 7f1f9095b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:51:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 Processor -- start 2023-12-24T19:51:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 -- start start 2023-12-24T19:51:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50480c6d00 0x7f50480c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f504806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504806c820 con 0x7f5048154450 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504806b960 con 0x7f50480c6d00 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504c8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504806bc40 con 0x7f504806aca0 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50480c6d00 0x7f50480c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50480c6d00 0x7f50480c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40730/0 (socket says 172.21.15.50:40730) 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f504659c700 1 -- 172.21.15.50:0/1723738307 learned_addr learned my addr 172.21.15.50:0/1723738307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.311+0000 7f5046d9d700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f504806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504659c700 1 -- 172.21.15.50:0/1723738307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 msgr2=0x7f504806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504659c700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f504806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504659c700 1 -- 172.21.15.50:0/1723738307 >> v1:172.21.15.82:6789/0 conn(0x7f5048154450 legacy=0x7f50481548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504659c700 1 -- 172.21.15.50:0/1723738307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504806bf20 con 0x7f50480c6d00 2023-12-24T19:51:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504659c700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50480c6d00 0x7f50480c70d0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f50380099b0 tx=0x7f5038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f70979ad44a213 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504559a700 1 -- 172.21.15.50:0/1723738307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038009ea0 con 0x7f50480c6d00 2023-12-24T19:51:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504559a700 1 -- 172.21.15.50:0/1723738307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503800b860 con 0x7f50480c6d00 2023-12-24T19:51:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504559a700 1 -- 172.21.15.50:0/1723738307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800bc00 con 0x7f50480c6d00 2023-12-24T19:51:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 -- 172.21.15.50:0/1723738307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50480c6d00 msgr2=0x7f50480c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50480c6d00 0x7f50480c70d0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f50380099b0 tx=0x7f5038009250 comp rx=0 tx=0).stop 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 -- 172.21.15.50:0/1723738307 shutdown_connections 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f504806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 --2- 172.21.15.50:0/1723738307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50480c6d00 0x7f50480c70d0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 -- 172.21.15.50:0/1723738307 >> 172.21.15.50:0/1723738307 conn(0x7f50480cbba0 msgr2=0x7f50480cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 -- 172.21.15.50:0/1723738307 shutdown_connections 2023-12-24T19:51:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.315+0000 7f504c8f0700 1 -- 172.21.15.50:0/1723738307 wait complete. 2023-12-24T19:51:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 Processor -- start 2023-12-24T19:51:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 -- start start 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f5048152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50480c6d00 0x7f5048169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ad870 con 0x7f5048154450 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480adb50 con 0x7f50480c6d00 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.319+0000 7f504c8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ade30 con 0x7f504806aca0 2023-12-24T19:51:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40734/0 (socket says 172.21.15.50:40734) 2023-12-24T19:51:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 -- 172.21.15.50:0/659329377 learned_addr learned my addr 172.21.15.50:0/659329377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5045d9b700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50480c6d00 0x7f5048169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f504659c700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f5048152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 msgr2=0x7f5048152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f5048152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50480c6d00 msgr2=0x7f5048169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50480c6d00 0x7f5048169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 -- 172.21.15.50:0/659329377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380094f0 con 0x7f5048154450 2023-12-24T19:51:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f5046d9d700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5040009e90 tx=0x7f504000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000cc20 con 0x7f5048154450 2023-12-24T19:51:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000f040 con 0x7f5048154450 2023-12-24T19:51:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480ae110 con 0x7f5048154450 2023-12-24T19:51:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040014480 con 0x7f5048154450 2023-12-24T19:51:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.323+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504816a3b0 con 0x7f5048154450 2023-12-24T19:51:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.327+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480652e0 con 0x7f5048154450 2023-12-24T19:51:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.327+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f5040014830 con 0x7f5048154450 2023-12-24T19:51:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.331+0000 7f50367fc700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 0x7f5028062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.331+0000 7f504659c700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 msgr2=0x7f5028062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.331+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f504007d9b0 con 0x7f5048154450 2023-12-24T19:51:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.331+0000 7f504659c700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 0x7f5028062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:23.333 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:23.331+0000 7f1f9095b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:51:23.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.335+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f504004d8b0 con 0x7f5048154450 2023-12-24T19:51:23.372 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.366+0000 7effbb166000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:23.498 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:23.495+0000 7f1f9095b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.527+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f504806c200 con 0x7f5048154450 2023-12-24T19:51:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.531+0000 7f50367fc700 1 -- 172.21.15.50:0/659329377 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16671 (secure 0 0 0) 0x7f5040050ed0 con 0x7f5048154450 2023-12-24T19:51:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:23.533 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":144,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:23.431644+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3054157555":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1565256126":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1936518309":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/2069533528":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6837/33814":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6836/33814":"2023-12-25T18:55:40.875942+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":54,"length":3},{"begin":110,"length":3}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504659c700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 msgr2=0x7f5028062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504659c700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 0x7f5028062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 msgr2=0x7f5028062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 0x7f5028062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 msgr2=0x7f50480ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5040009e90 tx=0x7f504000b040 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 shutdown_connections 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5028060670 0x7f5028062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5048154450 0x7f50480ca740 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50480c6d00 0x7f5048169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 --2- 172.21.15.50:0/659329377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504806aca0 0x7f5048152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 >> 172.21.15.50:0/659329377 conn(0x7f50480cbba0 msgr2=0x7f5048157900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 shutdown_connections 2023-12-24T19:51:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.535+0000 7f504c8f0700 1 -- 172.21.15.50:0/659329377 wait complete. 2023-12-24T19:51:23.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T18:55:19.145132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T18:55:20.516568+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 144, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:51:23.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:51:23.639 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.634+0000 7effbb166000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:51:23.718 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.714+0000 7effbb166000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.731+0000 7f51522e3700 1 Processor -- start 2023-12-24T19:51:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.731+0000 7f51522e3700 1 -- start start 2023-12-24T19:51:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51522e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f514c0bebc0 0x7f514c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51522e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51522e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0c9ea0 con 0x7f514c0ab920 2023-12-24T19:51:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51522e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c15d840 con 0x7f514c0bebc0 2023-12-24T19:51:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51522e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c161780 con 0x7f514c0bef90 2023-12-24T19:51:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f514c0bebc0 0x7f514c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f5150ae0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f514c0ab920 0x7f514c160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60420/0 (socket says 172.21.15.50:60420) 2023-12-24T19:51:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f5150ae0700 1 -- 172.21.15.50:0/2410589551 learned_addr learned my addr 172.21.15.50:0/2410589551 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f5151ae2700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 -- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 msgr2=0x7f514c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 -- 172.21.15.50:0/2410589551 >> v1:172.21.15.82:6789/0 conn(0x7f514c0ab920 legacy=0x7f514c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 -- 172.21.15.50:0/2410589551 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c161a60 con 0x7f514c0bebc0 2023-12-24T19:51:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.735+0000 7f51512e1700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0bebc0 0x7f514c0c6f50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f51480098e0 tx=0x7f51480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c3dd70d8f19f5a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f5143fff700 1 -- 172.21.15.50:0/2410589551 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800b640 con 0x7f514c0bebc0 2023-12-24T19:51:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f5143fff700 1 -- 172.21.15.50:0/2410589551 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800b7a0 con 0x7f514c0bebc0 2023-12-24T19:51:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f5143fff700 1 -- 172.21.15.50:0/2410589551 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800bb40 con 0x7f514c0bebc0 2023-12-24T19:51:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 -- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0bebc0 msgr2=0x7f514c0c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0bebc0 0x7f514c0c6f50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f51480098e0 tx=0x7f51480091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 -- 172.21.15.50:0/2410589551 shutdown_connections 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 --2- 172.21.15.50:0/2410589551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0bebc0 0x7f514c0c6f50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 -- 172.21.15.50:0/2410589551 >> 172.21.15.50:0/2410589551 conn(0x7f514c067250 msgr2=0x7f514c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 -- 172.21.15.50:0/2410589551 shutdown_connections 2023-12-24T19:51:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.739+0000 7f51522e3700 1 -- 172.21.15.50:0/2410589551 wait complete. 2023-12-24T19:51:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 Processor -- start 2023-12-24T19:51:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 -- start start 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0ab920 0x7f514c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c15ac90 con 0x7f514c0bebc0 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0acce0 con 0x7f514c0ab920 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51522e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0ac440 con 0x7f514c0bef90 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40750/0 (socket says 172.21.15.50:40750) 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 -- 172.21.15.50:0/2258459040 learned_addr learned my addr 172.21.15.50:0/2258459040 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f51512e1700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0ab920 0x7f514c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5151ae2700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 -- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 msgr2=0x7f514c0c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 -- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0ab920 msgr2=0x7f514c0abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0ab920 0x7f514c0abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.743+0000 7f5150ae0700 1 -- 172.21.15.50:0/2258459040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009420 con 0x7f514c0bebc0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f5150ae0700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c590 tx=0x7f513c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c005b30 con 0x7f514c0bebc0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c005cb0 con 0x7f514c0bebc0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c0ac720 con 0x7f514c0bebc0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c007320 con 0x7f514c0bebc0 2023-12-24T19:51:23.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c16d650 con 0x7f514c0bebc0 2023-12-24T19:51:23.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.747+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c16d4a0 con 0x7f514c0bebc0 2023-12-24T19:51:23.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.751+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f513c01b3b0 con 0x7f514c0bebc0 2023-12-24T19:51:23.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.751+0000 7f51417fa700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 0x7f5130062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:23.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.751+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f513c07c170 con 0x7f514c0bebc0 2023-12-24T19:51:23.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.751+0000 7f51512e1700 1 -- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 msgr2=0x7f5130062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.751+0000 7f51512e1700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 0x7f5130062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.755+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f513c04c180 con 0x7f514c0bebc0 2023-12-24T19:51:23.800 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:23.799+0000 7f1f9095b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:51:23.882 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:23.879+0000 7f1f9095b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:23.931 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:23.926+0000 7effbb166000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:51:23.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.931+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f514c16d840 con 0x7f514c0bebc0 2023-12-24T19:51:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.931+0000 7f51417fa700 1 -- 172.21.15.50:0/2258459040 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7f513c04f7a0 con 0x7f514c0bebc0 2023-12-24T19:51:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 msgr2=0x7f5130062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 0x7f5130062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 msgr2=0x7f514c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c590 tx=0x7f513c001020 comp rx=0 tx=0).stop 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 shutdown_connections 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5130060670 0x7f5130062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f514c0bef90 0x7f514c0c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f514c0bebc0 0x7f514c153f50 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 --2- 172.21.15.50:0/2258459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c0ab920 0x7f514c0abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 >> 172.21.15.50:0/2258459040 conn(0x7f514c067250 msgr2=0x7f514c0c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 shutdown_connections 2023-12-24T19:51:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:23.935+0000 7f51522e3700 1 -- 172.21.15.50:0/2258459040 wait complete. 2023-12-24T19:51:23.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:51:24.024 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:24.018+0000 7effbb166000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:51:24.107 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:24.102+0000 7effbb166000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:51:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.119+0000 7f42a486b700 1 Processor -- start 2023-12-24T19:51:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.119+0000 7f42a486b700 1 -- start start 2023-12-24T19:51:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f42a486b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a0151220 0x7f42a006cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f42a486b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 0x7f42a00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f42a486b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00cb9f0 con 0x7f42a015a880 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f42a486b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a015b850 con 0x7f42a0151220 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f42a486b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00b25e0 con 0x7f42a00b1c00 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a0151220 0x7f42a006cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42a015a880 0x7f42a015ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55042/0 (socket says 172.21.15.50:55042) 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a0151220 0x7f42a006cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:34972/0 (socket says 172.21.15.50:34972) 2023-12-24T19:51:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429ffff700 1 -- 172.21.15.50:0/3499442088 learned_addr learned my addr 172.21.15.50:0/3499442088 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429effd700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 0x7f42a00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 -- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 msgr2=0x7f42a00b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 0x7f42a00b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 -- 172.21.15.50:0/3499442088 >> v1:172.21.15.50:6789/0 conn(0x7f42a015a880 legacy=0x7f42a015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429f7fe700 1 -- 172.21.15.50:0/3499442088 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00cb100 con 0x7f42a0151220 2023-12-24T19:51:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429e7fc700 1 -- 172.21.15.50:0/3499442088 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397074492 0 0) 0x7f42a00cb9f0 con 0x7f42a015a880 2023-12-24T19:51:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.123+0000 7f429effd700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 0x7f42a00b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f429f7fe700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a006cc70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f42900098e0 tx=0x7f42900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ed110aa83f6c41b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.127 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f1f9095b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:51:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f429e7fc700 1 -- 172.21.15.50:0/3499442088 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290009e80 con 0x7f42a0151220 2023-12-24T19:51:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f429e7fc700 1 -- 172.21.15.50:0/3499442088 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000b860 con 0x7f42a0151220 2023-12-24T19:51:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f429e7fc700 1 -- 172.21.15.50:0/3499442088 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000bbe0 con 0x7f42a0151220 2023-12-24T19:51:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 -- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 msgr2=0x7f42a006cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a006cc70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f42900098e0 tx=0x7f42900091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 -- 172.21.15.50:0/3499442088 shutdown_connections 2023-12-24T19:51:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a00b1c00 0x7f42a00b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 --2- 172.21.15.50:0/3499442088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a006cc70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 -- 172.21.15.50:0/3499442088 >> 172.21.15.50:0/3499442088 conn(0x7f42a00ccb30 msgr2=0x7f42a00ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 -- 172.21.15.50:0/3499442088 shutdown_connections 2023-12-24T19:51:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.127+0000 7f42a486b700 1 -- 172.21.15.50:0/3499442088 wait complete. 2023-12-24T19:51:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 Processor -- start 2023-12-24T19:51:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 -- start start 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a00b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a015a880 0x7f42a00b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01418b0 con 0x7f42a00b1c00 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01548c0 con 0x7f42a0151220 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f42a486b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0154ba0 con 0x7f42a015a880 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40754/0 (socket says 172.21.15.50:40754) 2023-12-24T19:51:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 -- 172.21.15.50:0/1378896471 learned_addr learned my addr 172.21.15.50:0/1378896471 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429effd700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a00b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429ffff700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a015a880 0x7f42a00b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 -- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a015a880 msgr2=0x7f42a00b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a015a880 0x7f42a00b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 -- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 msgr2=0x7f42a00b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a00b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.131+0000 7f429f7fe700 1 -- 172.21.15.50:0/1378896471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290009420 con 0x7f42a00b1c00 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f429f7fe700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f42a006f8c0 tx=0x7f4290017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000b9d0 con 0x7f42a00b1c00 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000bb30 con 0x7f42a00b1c00 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a0154e80 con 0x7f42a00b1c00 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290011650 con 0x7f42a00b1c00 2023-12-24T19:51:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a0155440 con 0x7f42a00b1c00 2023-12-24T19:51:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.135+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a004be40 con 0x7f42a00b1c00 2023-12-24T19:51:24.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.139+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f4290011a80 con 0x7f42a00b1c00 2023-12-24T19:51:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.139+0000 7f42877fe700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 0x7f428c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.139+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f429007e600 con 0x7f42a00b1c00 2023-12-24T19:51:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.139+0000 7f429effd700 1 -- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 msgr2=0x7f428c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.139+0000 7f429effd700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 0x7f428c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.143+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f429004e610 con 0x7f42a00b1c00 2023-12-24T19:51:24.219 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:24.219+0000 7f1f9095b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:51:24.316 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:24.315+0000 7f1f9095b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:51:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.315+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42a006c820 con 0x7f42a00b1c00 2023-12-24T19:51:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.315+0000 7f42877fe700 1 -- 172.21.15.50:0/1378896471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4290051c30 con 0x7f42a00b1c00 2023-12-24T19:51:24.318 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 msgr2=0x7f428c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 0x7f428c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 msgr2=0x7f42a0153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f42a006f8c0 tx=0x7f4290017000 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 shutdown_connections 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f428c060670 0x7f428c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42a015a880 0x7f42a00b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a0151220 0x7f42a00b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 --2- 172.21.15.50:0/1378896471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a00b1c00 0x7f42a0153e40 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 >> 172.21.15.50:0/1378896471 conn(0x7f42a00ccb30 msgr2=0x7f42a0069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 shutdown_connections 2023-12-24T19:51:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.319+0000 7f42a486b700 1 -- 172.21.15.50:0/1378896471 wait complete. 2023-12-24T19:51:24.343 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:51:24.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 Processor -- start 2023-12-24T19:51:24.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 -- start start 2023-12-24T19:51:24.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f10f806ae20 0x7f10f80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f80b3fd0 con 0x7f10f806c820 2023-12-24T19:51:24.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f80b33c0 con 0x7f10f8158e00 2023-12-24T19:51:24.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f11002a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80b36a0 con 0x7f10f806ae20 2023-12-24T19:51:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f10fe842700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10f806c820 0x7f10f8162c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55050/0 (socket says 172.21.15.50:55050) 2023-12-24T19:51:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.515+0000 7f10fe842700 1 -- 172.21.15.50:0/2841614543 learned_addr learned my addr 172.21.15.50:0/2841614543 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd840700 1 --2- 172.21.15.50:0/2841614543 >> v2:172.21.15.82:3300/0 conn(0x7f10f806ae20 0x7f10f80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683618143 0 0) 0x7f10f80b3fd0 con 0x7f10f806c820 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e4003570 con 0x7f10f806c820 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd840700 1 -- 172.21.15.50:0/2841614543 >> v1:172.21.15.82:6789/0 conn(0x7f10f8158e00 legacy=0x7f10f806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd840700 1 -- 172.21.15.50:0/2841614543 >> v1:172.21.15.50:6789/0 conn(0x7f10f806c820 legacy=0x7f10f8162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863639635 0 0) 0x7f10e4003570 con 0x7f10f806c820 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd840700 1 -- 172.21.15.50:0/2841614543 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80b3980 con 0x7f10f806ae20 2023-12-24T19:51:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd840700 1 --2- 172.21.15.50:0/2841614543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f80b2de0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098e0 tx=0x7f10e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9898f37f60d3096d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00017f0 con 0x7f10f806ae20 2023-12-24T19:51:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8011420 con 0x7f10f806ae20 2023-12-24T19:51:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f10fd03f700 1 -- 172.21.15.50:0/2841614543 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80117c0 con 0x7f10f806ae20 2023-12-24T19:51:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f11002a5700 1 -- 172.21.15.50:0/2841614543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 msgr2=0x7f10f80b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.519+0000 7f11002a5700 1 --2- 172.21.15.50:0/2841614543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f80b2de0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098e0 tx=0x7f10e80091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 -- 172.21.15.50:0/2841614543 shutdown_connections 2023-12-24T19:51:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 --2- 172.21.15.50:0/2841614543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f80b2de0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 -- 172.21.15.50:0/2841614543 >> 172.21.15.50:0/2841614543 conn(0x7f10f8067b80 msgr2=0x7f10f80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 -- 172.21.15.50:0/2841614543 shutdown_connections 2023-12-24T19:51:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 -- 172.21.15.50:0/2841614543 wait complete. 2023-12-24T19:51:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 Processor -- start 2023-12-24T19:51:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.523+0000 7f11002a5700 1 -- start start 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 0x7f10f814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f814d870 con 0x7f10f8158e00 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f814c990 con 0x7f10f806ae20 2023-12-24T19:51:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f814cc60 con 0x7f10f806c820 2023-12-24T19:51:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40762/0 (socket says 172.21.15.50:40762) 2023-12-24T19:51:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe041700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 -- 172.21.15.50:0/571342390 learned_addr learned my addr 172.21.15.50:0/571342390 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fd840700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 0x7f10f814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 -- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 msgr2=0x7f10f814e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 0x7f10f814e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 -- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 msgr2=0x7f10f814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f814c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 -- 172.21.15.50:0/571342390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8009420 con 0x7f10f8158e00 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fd840700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 0x7f10f814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe041700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10fe842700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f10f0001560 tx=0x7f10f0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0004dc0 con 0x7f10f8158e00 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f000a6a0 con 0x7f10f8158e00 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f814cf40 con 0x7f10f8158e00 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f000aa60 con 0x7f10f8158e00 2023-12-24T19:51:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.527+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f814d500 con 0x7f10f8158e00 2023-12-24T19:51:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.531+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f80652e0 con 0x7f10f8158e00 2023-12-24T19:51:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.531+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f10f0007150 con 0x7f10f8158e00 2023-12-24T19:51:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.535+0000 7f10ee7fc700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 0x7f10dc062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.535+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f10f007cb60 con 0x7f10f8158e00 2023-12-24T19:51:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.535+0000 7f10fe041700 1 -- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 msgr2=0x7f10dc062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.535+0000 7f10fe041700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 0x7f10dc062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.535+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f10f0050700 con 0x7f10f8158e00 2023-12-24T19:51:24.554 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:24.550+0000 7effbb166000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:51:24.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.715+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10f814d9b0 con 0x7f10f8158e00 2023-12-24T19:51:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f10ee7fc700 1 -- 172.21.15.50:0/571342390 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10f814d9b0 con 0x7f10f8158e00 2023-12-24T19:51:24.720 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T19:51:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 msgr2=0x7f10dc062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 0x7f10dc062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 msgr2=0x7f10f815d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f10f0001560 tx=0x7f10f0001640 comp rx=0 tx=0).stop 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 shutdown_connections 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f10dc060670 0x7f10dc062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f8158e00 0x7f10f815d580 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10f806c820 0x7f10f814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 --2- 172.21.15.50:0/571342390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f806ae20 0x7f10f814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.719+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 >> 172.21.15.50:0/571342390 conn(0x7f10f8067b80 msgr2=0x7f10f815b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.723+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 shutdown_connections 2023-12-24T19:51:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.723+0000 7f11002a5700 1 -- 172.21.15.50:0/571342390 wait complete. 2023-12-24T19:51:24.743 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:24.738+0000 7effbb166000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:51:24.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:24.748 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:24.747+0000 7f1f9095b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:51:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 Processor -- start 2023-12-24T19:51:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 -- start start 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa73c06c0c0 0x7fa73c0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 0x7fa73c06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c06c510 con 0x7fa73c06c0c0 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0a9c80 con 0x7fa73c06afb0 2023-12-24T19:51:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa741a4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0a8e10 con 0x7fa73c158cd0 2023-12-24T19:51:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa73bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa73c06c0c0 0x7fa73c0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa73bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa73c06c0c0 0x7fa73c0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40774/0 (socket says 172.21.15.50:40774) 2023-12-24T19:51:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa73bfff700 1 -- 172.21.15.50:0/1479591813 learned_addr learned my addr 172.21.15.50:0/1479591813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa74124b700 1 --2- 172.21.15.50:0/1479591813 >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 0x7fa73c06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.919+0000 7fa740a4a700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 -- 172.21.15.50:0/1479591813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 msgr2=0x7fa73c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 -- 172.21.15.50:0/1479591813 >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 msgr2=0x7fa73c06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 --2- 172.21.15.50:0/1479591813 >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 0x7fa73c06b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 -- 172.21.15.50:0/1479591813 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c06b930 con 0x7fa73c06c0c0 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa740a4a700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa74124b700 1 --2- 172.21.15.50:0/1479591813 >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 0x7fa73c06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:24.924 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:24.923+0000 7f1f9095b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:51:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73bfff700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06c0c0 0x7fa73c0a88d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa73c1595e0 tx=0x7fa728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ad477887ab0f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73b7fe700 1 -- 172.21.15.50:0/1479591813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800b860 con 0x7fa73c06c0c0 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73b7fe700 1 -- 172.21.15.50:0/1479591813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800b9c0 con 0x7fa73c06c0c0 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa73b7fe700 1 -- 172.21.15.50:0/1479591813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800bd60 con 0x7fa73c06c0c0 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 -- 172.21.15.50:0/1479591813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06c0c0 msgr2=0x7fa73c0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06c0c0 0x7fa73c0a88d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa73c1595e0 tx=0x7fa728009250 comp rx=0 tx=0).stop 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 -- 172.21.15.50:0/1479591813 shutdown_connections 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 --2- 172.21.15.50:0/1479591813 >> v2:172.21.15.82:3300/0 conn(0x7fa73c06afb0 0x7fa73c06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06c0c0 0x7fa73c0a88d0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 --2- 172.21.15.50:0/1479591813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 -- 172.21.15.50:0/1479591813 >> 172.21.15.50:0/1479591813 conn(0x7fa73c067b80 msgr2=0x7fa73c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 -- 172.21.15.50:0/1479591813 shutdown_connections 2023-12-24T19:51:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.923+0000 7fa741a4c700 1 -- 172.21.15.50:0/1479591813 wait complete. 2023-12-24T19:51:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 Processor -- start 2023-12-24T19:51:24.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 -- start start 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 0x7fa73c16c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c150290 con 0x7fa73c06afb0 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b0ad0 con 0x7fa73c06c0c0 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa741a4c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b07f0 con 0x7fa73c158cd0 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa740a4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 0x7fa73c16c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa740a4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40776/0 (socket says 172.21.15.50:40776) 2023-12-24T19:51:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa740a4a700 1 -- 172.21.15.50:0/820339864 learned_addr learned my addr 172.21.15.50:0/820339864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa74124b700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 msgr2=0x7fa73c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 msgr2=0x7fa73c169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa73bfff700 1 -- 172.21.15.50:0/820339864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280094f0 con 0x7fa73c06c0c0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.927+0000 7fa740a4a700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa73bfff700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 0x7fa73c16c830 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa73c068ad0 tx=0x7fa728017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011e20 con 0x7fa73c06c0c0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72801f070 con 0x7fa73c06c0c0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280266d0 con 0x7fa73c06c0c0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c14fc40 con 0x7fa73c06c0c0 2023-12-24T19:51:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c16cd70 con 0x7fa73c06c0c0 2023-12-24T19:51:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c150440 con 0x7fa73c06c0c0 2023-12-24T19:51:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.931+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fa728026a80 con 0x7fa73c06c0c0 2023-12-24T19:51:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.935+0000 7fa738ff9700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 0x7fa720062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.935+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fa728021070 con 0x7fa73c06c0c0 2023-12-24T19:51:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.935+0000 7fa740a4a700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 msgr2=0x7fa720062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.935+0000 7fa740a4a700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 0x7fa720062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:24.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:24.947+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa73c150440 con 0x7fa73c06c0c0 2023-12-24T19:51:25.119 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.114+0000 7effbb166000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:51:25.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.139+0000 7fa740a4a700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 msgr2=0x7fa720062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.139+0000 7fa740a4a700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 0x7fa720062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:25.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.155+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa73c150440 con 0x7fa73c06c0c0 2023-12-24T19:51:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.155+0000 7fa738ff9700 1 -- 172.21.15.50:0/820339864 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa73c150440 con 0x7fa73c06c0c0 2023-12-24T19:51:25.158 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:25.158 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 msgr2=0x7fa720062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 0x7fa720062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 msgr2=0x7fa73c16c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 0x7fa73c16c830 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa73c068ad0 tx=0x7fa728017000 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 shutdown_connections 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa7200606a0 0x7fa720062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c158cd0 0x7fa73c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c06c0c0 0x7fa73c16c830 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 --2- 172.21.15.50:0/820339864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c06afb0 0x7fa73c169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 >> 172.21.15.50:0/820339864 conn(0x7fa73c067b80 msgr2=0x7fa73c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 shutdown_connections 2023-12-24T19:51:25.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.159+0000 7fa741a4c700 1 -- 172.21.15.50:0/820339864 wait complete. 2023-12-24T19:51:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T19:51:25.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:25.318 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:25.315+0000 7f1f9095b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:51:25.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.347+0000 7f865f0cd700 1 Processor -- start 2023-12-24T19:51:25.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.347+0000 7f865f0cd700 1 -- start start 2023-12-24T19:51:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f865813f550 0x7f86580ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86580cb3c0 0x7f865806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865806c090 con 0x7f865813f920 2023-12-24T19:51:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865806a6a0 con 0x7f86580cb3c0 2023-12-24T19:51:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86580cb8a0 con 0x7f865813f550 2023-12-24T19:51:25.352 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.346+0000 7effbb166000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f865813f550 0x7f86580ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865d66a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86580cb3c0 0x7f865806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f865813f550 0x7f86580ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:35042/0 (socket says 172.21.15.50:35042) 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 -- 172.21.15.50:0/3836530429 learned_addr learned my addr 172.21.15.50:0/3836530429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 -- 172.21.15.50:0/3836530429 >> v2:172.21.15.50:3300/0 conn(0x7f86580cb3c0 msgr2=0x7f865806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 --2- 172.21.15.50:0/3836530429 >> v2:172.21.15.50:3300/0 conn(0x7f86580cb3c0 0x7f865806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 -- 172.21.15.50:0/3836530429 >> v1:172.21.15.82:6789/0 conn(0x7f865813f920 legacy=0x7f865806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 -- 172.21.15.50:0/3836530429 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865806a960 con 0x7f865813f550 2023-12-24T19:51:25.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865ce69700 1 --2- 172.21.15.50:0/3836530429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f550 0x7f86580ab5e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f865806e290 tx=0x7f864c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cebb94f3bf750d6e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:25.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f86577fe700 1 -- 172.21.15.50:0/3836530429 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c009e70 con 0x7f865813f550 2023-12-24T19:51:25.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f86577fe700 1 -- 172.21.15.50:0/3836530429 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00b860 con 0x7f865813f550 2023-12-24T19:51:25.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f86577fe700 1 -- 172.21.15.50:0/3836530429 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00bc00 con 0x7f865813f550 2023-12-24T19:51:25.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 -- 172.21.15.50:0/3836530429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f550 msgr2=0x7f86580ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.351+0000 7f865f0cd700 1 --2- 172.21.15.50:0/3836530429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f550 0x7f86580ab5e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f865806e290 tx=0x7f864c009250 comp rx=0 tx=0).stop 2023-12-24T19:51:25.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 -- 172.21.15.50:0/3836530429 shutdown_connections 2023-12-24T19:51:25.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 --2- 172.21.15.50:0/3836530429 >> v2:172.21.15.50:3300/0 conn(0x7f86580cb3c0 0x7f865806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 --2- 172.21.15.50:0/3836530429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f550 0x7f86580ab5e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 -- 172.21.15.50:0/3836530429 >> 172.21.15.50:0/3836530429 conn(0x7f86580cbba0 msgr2=0x7f86580cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:25.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 -- 172.21.15.50:0/3836530429 shutdown_connections 2023-12-24T19:51:25.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 -- 172.21.15.50:0/3836530429 wait complete. 2023-12-24T19:51:25.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.355+0000 7f865f0cd700 1 Processor -- start 2023-12-24T19:51:25.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 -- start start 2023-12-24T19:51:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f865813f550 0x7f86580b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f920 0x7f86580ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865816d440 con 0x7f86580cb3c0 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86580af8c0 con 0x7f865813f920 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865f0cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86580afba0 con 0x7f865813f550 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40786/0 (socket says 172.21.15.50:40786) 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 -- 172.21.15.50:0/4065557559 learned_addr learned my addr 172.21.15.50:0/4065557559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f8657fff700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f865813f550 0x7f86580b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865d66a700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f920 0x7f86580ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 -- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f865813f550 msgr2=0x7f86580b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f865813f550 0x7f86580b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 -- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f920 msgr2=0x7f86580ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f920 0x7f86580ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 -- 172.21.15.50:0/4065557559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0094f0 con 0x7f86580cb3c0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.359+0000 7f865ce69700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f864c009290 tx=0x7f864c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00b9d0 con 0x7f86580cb3c0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00bb70 con 0x7f86580cb3c0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86580afe80 con 0x7f86580cb3c0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0106c0 con 0x7f86580cb3c0 2023-12-24T19:51:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86580b0440 con 0x7f86580cb3c0 2023-12-24T19:51:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.363+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86580652e0 con 0x7f86580cb3c0 2023-12-24T19:51:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.367+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f864c02c440 con 0x7f86580cb3c0 2023-12-24T19:51:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.367+0000 7f8654ff9700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 0x7f863c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.367+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f864c014070 con 0x7f86580cb3c0 2023-12-24T19:51:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.367+0000 7f8657fff700 1 -- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 msgr2=0x7f863c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.367+0000 7f8657fff700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 0x7f863c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:25.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.371+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f864c04e6e0 con 0x7f86580cb3c0 2023-12-24T19:51:25.444 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.438+0000 7effbb166000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:51:25.529 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.522+0000 7effbb166000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:51:25.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.551+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86581596b0 con 0x7f86580cb3c0 2023-12-24T19:51:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.551+0000 7f8654ff9700 1 -- 172.21.15.50:0/4065557559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16671 (secure 0 0 0) 0x7f864c051d00 con 0x7f86580cb3c0 2023-12-24T19:51:25.555 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:25.555 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":146,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:25.386656+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3054157555":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1565256126":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1936518309":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/2069533528":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6837/33814":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6836/33814":"2023-12-25T18:55:40.875942+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":52,"length":6},{"begin":80,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":18,"snaps":[{"begin":3,"length":49},{"begin":59,"length":21}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 msgr2=0x7f863c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 0x7f863c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 msgr2=0x7f865813c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f864c009290 tx=0x7f864c019000 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 shutdown_connections 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f863c060670 0x7f863c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f865813f920 0x7f86580ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f865813f550 0x7f86580b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 --2- 172.21.15.50:0/4065557559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86580cb3c0 0x7f865813c540 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 >> 172.21.15.50:0/4065557559 conn(0x7f86580cbba0 msgr2=0x7f86580c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 shutdown_connections 2023-12-24T19:51:25.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.555+0000 7f865f0cd700 1 -- 172.21.15.50:0/4065557559 wait complete. 2023-12-24T19:51:25.566 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:25.563+0000 7f1f9095b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:25.579 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T19:51:25.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:25.613 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.610+0000 7effbb166000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:51:25.670 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:25.667+0000 7f1f9095b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:51:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.743+0000 7fe10688e700 1 Processor -- start 2023-12-24T19:51:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 -- start start 2023-12-24T19:51:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1000afcd0 0x7fe1000b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10006c820 0x7fe10006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe100157680 0x7fe100157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10006d1d0 con 0x7fe1000afcd0 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10006d3e0 con 0x7fe100157680 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10688e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10006d6c0 con 0x7fe10006c820 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1000afcd0 0x7fe1000b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1000afcd0 0x7fe1000b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40800/0 (socket says 172.21.15.50:40800) 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 -- 172.21.15.50:0/3651739666 learned_addr learned my addr 172.21.15.50:0/3651739666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10508b700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10006c820 0x7fe10006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10608d700 1 --2- 172.21.15.50:0/3651739666 >> v2:172.21.15.82:3300/0 conn(0x7fe100157680 0x7fe100157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 -- 172.21.15.50:0/3651739666 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10006c820 msgr2=0x7fe10006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10006c820 0x7fe10006cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 -- 172.21.15.50:0/3651739666 >> v2:172.21.15.82:3300/0 conn(0x7fe100157680 msgr2=0x7fe100157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 --2- 172.21.15.50:0/3651739666 >> v2:172.21.15.82:3300/0 conn(0x7fe100157680 0x7fe100157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 -- 172.21.15.50:0/3651739666 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10006d9a0 con 0x7fe1000afcd0 2023-12-24T19:51:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.747+0000 7fe10588c700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1000afcd0 0x7fe1000b00a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fe1001572c0 tx=0x7fe0fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f6fd776b1ce24a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10488a700 1 -- 172.21.15.50:0/3651739666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00b640 con 0x7fe1000afcd0 2023-12-24T19:51:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10488a700 1 -- 172.21.15.50:0/3651739666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00b7a0 con 0x7fe1000afcd0 2023-12-24T19:51:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10488a700 1 -- 172.21.15.50:0/3651739666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00bb60 con 0x7fe1000afcd0 2023-12-24T19:51:25.752 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:25.751+0000 7f1f9095b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 -- 172.21.15.50:0/3651739666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1000afcd0 msgr2=0x7fe1000b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1000afcd0 0x7fe1000b00a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fe1001572c0 tx=0x7fe0fc009250 comp rx=0 tx=0).stop 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 -- 172.21.15.50:0/3651739666 shutdown_connections 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 --2- 172.21.15.50:0/3651739666 >> v2:172.21.15.82:3300/0 conn(0x7fe100157680 0x7fe100157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10006c820 0x7fe10006cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 --2- 172.21.15.50:0/3651739666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1000afcd0 0x7fe1000b00a0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 -- 172.21.15.50:0/3651739666 >> 172.21.15.50:0/3651739666 conn(0x7fe100069da0 msgr2=0x7fe1000cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 -- 172.21.15.50:0/3651739666 shutdown_connections 2023-12-24T19:51:25.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.751+0000 7fe10688e700 1 -- 172.21.15.50:0/3651739666 wait complete. 2023-12-24T19:51:25.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 Processor -- start 2023-12-24T19:51:25.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 -- start start 2023-12-24T19:51:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1000afcd0 0x7fe1000cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe100157680 0x7fe100155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c6d80 con 0x7fe10006c820 2023-12-24T19:51:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c4900 con 0x7fe100157680 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10688e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c4060 con 0x7fe1000afcd0 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40808/0 (socket says 172.21.15.50:40808) 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 -- 172.21.15.50:0/1215976525 learned_addr learned my addr 172.21.15.50:0/1215976525 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10508b700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1000afcd0 0x7fe1000cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10608d700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe100157680 0x7fe100155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1000afcd0 msgr2=0x7fe1000cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1000afcd0 0x7fe1000cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe100157680 msgr2=0x7fe100155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe100157680 0x7fe100155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.755+0000 7fe10588c700 1 -- 172.21.15.50:0/1215976525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0094f0 con 0x7fe10006c820 2023-12-24T19:51:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe10588c700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc006fd0 tx=0x7fe0fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00b910 con 0x7fe10006c820 2023-12-24T19:51:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00ba70 con 0x7fe10006c820 2023-12-24T19:51:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc011650 con 0x7fe10006c820 2023-12-24T19:51:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000c4340 con 0x7fe10006c820 2023-12-24T19:51:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1000cc130 con 0x7fe10006c820 2023-12-24T19:51:25.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.759+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10004be40 con 0x7fe10006c820 2023-12-24T19:51:25.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.763+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fe0fc0119c0 con 0x7fe10006c820 2023-12-24T19:51:25.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.763+0000 7fe0f5ffb700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 0x7fe0e4062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.763+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fe0fc07eb30 con 0x7fe10006c820 2023-12-24T19:51:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.763+0000 7fe10508b700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 msgr2=0x7fe0e4062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.763+0000 7fe10508b700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 0x7fe0e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:25.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.767+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0fc04ebc0 con 0x7fe10006c820 2023-12-24T19:51:25.846 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:25.843+0000 7f1f9095b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:51:25.856 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.850+0000 7effbb166000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:25.935 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:25.930+0000 7effbb166000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:51:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.967+0000 7fe10508b700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 msgr2=0x7fe0e4062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.967+0000 7fe10508b700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 0x7fe0e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.971+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1000c4a40 con 0x7fe10006c820 2023-12-24T19:51:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe0f5ffb700 1 -- 172.21.15.50:0/1215976525 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe1000c4a40 con 0x7fe10006c820 2023-12-24T19:51:25.987 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:25.987 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T19:51:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 msgr2=0x7fe0e4062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 0x7fe0e4062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 msgr2=0x7fe100168dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc006fd0 tx=0x7fe0fc017000 comp rx=0 tx=0).stop 2023-12-24T19:51:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 shutdown_connections 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe0e4060670 0x7fe0e4062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe100157680 0x7fe100155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1000afcd0 0x7fe1000cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 --2- 172.21.15.50:0/1215976525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10006c820 0x7fe100168dc0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 >> 172.21.15.50:0/1215976525 conn(0x7fe100069da0 msgr2=0x7fe1000ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 shutdown_connections 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:25.975+0000 7fe10688e700 1 -- 172.21.15.50:0/1215976525 wait complete. 2023-12-24T19:51:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T19:51:26.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:26.030 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:26.026+0000 7effbb166000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:51:26.089 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:26.087+0000 7f1f9095b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:26.174 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:26.171+0000 7f1f9095b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 Processor -- start 2023-12-24T19:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 -- start start 2023-12-24T19:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200acf40 0x7f3720068560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37200b3580 0x7f3720159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372006d360 con 0x7f3720159860 2023-12-24T19:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720068aa0 con 0x7f37200b3580 2023-12-24T19:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372504c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372006c820 con 0x7f37200acf40 2023-12-24T19:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.191+0000 7f372484b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3720159860 0x7f37200b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55062/0 (socket says 172.21.15.50:55062) 2023-12-24T19:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372484b700 1 -- 172.21.15.50:0/2171262987 learned_addr learned my addr 172.21.15.50:0/2171262987 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 --2- 172.21.15.50:0/2171262987 >> v2:172.21.15.82:3300/0 conn(0x7f37200b3580 0x7f3720159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371ffff700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200acf40 0x7f3720068560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371f7fe700 1 -- 172.21.15.50:0/2171262987 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078604749 0 0) 0x7f372006d360 con 0x7f3720159860 2023-12-24T19:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371f7fe700 1 -- 172.21.15.50:0/2171262987 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3700003570 con 0x7f3720159860 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 -- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200acf40 msgr2=0x7f3720068560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200acf40 0x7f3720068560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 -- 172.21.15.50:0/2171262987 >> v1:172.21.15.50:6789/0 conn(0x7f3720159860 legacy=0x7f37200b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 -- 172.21.15.50:0/2171262987 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720159c70 con 0x7f37200b3580 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f3717fff700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37200b3580 0x7f3720159320 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f37080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce8a0accd7716a9b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371f7fe700 1 -- 172.21.15.50:0/2171262987 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708011630 con 0x7f37200b3580 2023-12-24T19:51:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371f7fe700 1 -- 172.21.15.50:0/2171262987 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708011790 con 0x7f37200b3580 2023-12-24T19:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f371f7fe700 1 -- 172.21.15.50:0/2171262987 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708011b30 con 0x7f37200b3580 2023-12-24T19:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 -- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37200b3580 msgr2=0x7f3720159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37200b3580 0x7f3720159320 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f37080091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 -- 172.21.15.50:0/2171262987 shutdown_connections 2023-12-24T19:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37200b3580 0x7f3720159320 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 --2- 172.21.15.50:0/2171262987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200acf40 0x7f3720068560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 -- 172.21.15.50:0/2171262987 >> 172.21.15.50:0/2171262987 conn(0x7f37200cdc50 msgr2=0x7f37200ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 -- 172.21.15.50:0/2171262987 shutdown_connections 2023-12-24T19:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.195+0000 7f372504c700 1 -- 172.21.15.50:0/2171262987 wait complete. 2023-12-24T19:51:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.199+0000 7f372504c700 1 Processor -- start 2023-12-24T19:51:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.199+0000 7f372504c700 1 -- start start 2023-12-24T19:51:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 0x7f3720152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720159860 0x7f3720153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372015b6b0 con 0x7f37200acf40 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372015aaa0 con 0x7f3720159860 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372015ad80 con 0x7f37200b3580 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40814/0 (socket says 172.21.15.50:40814) 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 -- 172.21.15.50:0/657628259 learned_addr learned my addr 172.21.15.50:0/657628259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372484b700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720159860 0x7f3720153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f3717fff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 0x7f3720152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 msgr2=0x7f3720152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 0x7f3720152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720159860 msgr2=0x7f3720153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720159860 0x7f3720153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 -- 172.21.15.50:0/657628259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009420 con 0x7f37200acf40 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f3717fff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 0x7f3720152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371ffff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f371000ec80 tx=0x7f37100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000c8e0 con 0x7f37200acf40 2023-12-24T19:51:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371000ca40 con 0x7f37200acf40 2023-12-24T19:51:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000cde0 con 0x7f37200acf40 2023-12-24T19:51:26.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372015b060 con 0x7f37200acf40 2023-12-24T19:51:26.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.203+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3720156580 con 0x7f37200acf40 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372004be40 con 0x7f37200acf40 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f3710013680 con 0x7f37200acf40 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f371cff9700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 0x7f3704062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f371007d0b0 con 0x7f37200acf40 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f3717fff700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 msgr2=0x7f3704062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.207+0000 7f3717fff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 0x7f3704062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:26.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.215+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f371004d160 con 0x7f37200acf40 2023-12-24T19:51:26.232 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:26.226+0000 7effbb166000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:51:26.295 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:26.295+0000 7f1f9095b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:51:26.320 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:26.314+0000 7effbb166000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:51:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.411+0000 7f3717fff700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 msgr2=0x7f3704062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.411+0000 7f3717fff700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 0x7f3704062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:26.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.507+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f372006ca30 con 0x7f37200acf40 2023-12-24T19:51:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f371cff9700 1 -- 172.21.15.50:0/657628259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f3710050780 con 0x7f37200acf40 2023-12-24T19:51:26.512 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:26.512 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T18:55:21.508345+0000","modified":"2023-12-24T18:55:25.094335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8277":{"gid":8277,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1182389689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1182389689},{"type":"v1","addr":"172.21.15.82:6835","nonce":1182389689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T19:51:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 msgr2=0x7f3704062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 0x7f3704062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 msgr2=0x7f3720156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f371000ec80 tx=0x7f37100091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 shutdown_connections 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3704060670 0x7f3704062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720159860 0x7f3720153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37200b3580 0x7f3720152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 --2- 172.21.15.50:0/657628259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37200acf40 0x7f3720156040 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 >> 172.21.15.50:0/657628259 conn(0x7f37200cdc50 msgr2=0x7f37200cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 shutdown_connections 2023-12-24T19:51:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.511+0000 7f372504c700 1 -- 172.21.15.50:0/657628259 wait complete. 2023-12-24T19:51:26.517 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2023-12-24T19:51:26.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:26.545 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:26.543+0000 7f1f9095b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:51:26.646 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:26.643+0000 7f1f9095b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:51:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.703+0000 7f5afaf23700 1 Processor -- start 2023-12-24T19:51:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.703+0000 7f5afaf23700 1 -- start start 2023-12-24T19:51:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afaf23700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5af40ad220 0x7f5af40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afaf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af406afa0 0x7f5af406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afaf23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af406e110 con 0x7f5af4155710 2023-12-24T19:51:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afaf23700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af406b930 con 0x7f5af40ad220 2023-12-24T19:51:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afaf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406bb40 con 0x7f5af406afa0 2023-12-24T19:51:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afa722700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5af4155710 0x7f5af4155b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55070/0 (socket says 172.21.15.50:55070) 2023-12-24T19:51:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5afa722700 1 -- 172.21.15.50:0/2498945025 learned_addr learned my addr 172.21.15.50:0/2498945025 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2498945025 >> v2:172.21.15.50:3300/0 conn(0x7f5af40ad220 0x7f5af40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9720700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af406afa0 0x7f5af406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257725453 0 0) 0x7f5af406e110 con 0x7f5af4155710 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae0003570 con 0x7f5af4155710 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596082996 0 0) 0x7f5ae0003570 con 0x7f5af4155710 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 -- 172.21.15.50:0/2498945025 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af406afa0 msgr2=0x7f5af406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af406afa0 0x7f5af406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 -- 172.21.15.50:0/2498945025 >> v1:172.21.15.50:6789/0 conn(0x7f5af4155710 legacy=0x7f5af4155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 -- 172.21.15.50:0/2498945025 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af406be20 con 0x7f5af40ad220 2023-12-24T19:51:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af40ad220 0x7f5af40ad5f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e60 tx=0x7f5af0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a1c4e42085d61 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000e070 con 0x7f5af40ad220 2023-12-24T19:51:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000b7a0 con 0x7f5af40ad220 2023-12-24T19:51:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.707+0000 7f5af8f1f700 1 -- 172.21.15.50:0/2498945025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec001470 con 0x7f5af40ad220 2023-12-24T19:51:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- 172.21.15.50:0/2498945025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af40ad220 msgr2=0x7f5af40ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af40ad220 0x7f5af40ad5f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e60 tx=0x7f5af0009780 comp rx=0 tx=0).stop 2023-12-24T19:51:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- 172.21.15.50:0/2498945025 shutdown_connections 2023-12-24T19:51:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af406afa0 0x7f5af406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2498945025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af40ad220 0x7f5af40ad5f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- 172.21.15.50:0/2498945025 >> 172.21.15.50:0/2498945025 conn(0x7f5af4067b80 msgr2=0x7f5af40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- 172.21.15.50:0/2498945025 shutdown_connections 2023-12-24T19:51:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- 172.21.15.50:0/2498945025 wait complete. 2023-12-24T19:51:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 Processor -- start 2023-12-24T19:51:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.711+0000 7f5afaf23700 1 -- start start 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af40ad220 0x7f5af40c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af4155710 0x7f5af4158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40c6a60 con 0x7f5af406afa0 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af416b7c0 con 0x7f5af40ad220 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40c6130 con 0x7f5af4155710 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40834/0 (socket says 172.21.15.50:40834) 2023-12-24T19:51:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 -- 172.21.15.50:0/2543320415 learned_addr learned my addr 172.21.15.50:0/2543320415 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afa722700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af4155710 0x7f5af4158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9720700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af40ad220 0x7f5af40c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 -- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af4155710 msgr2=0x7f5af4158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af4155710 0x7f5af4158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 -- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af40ad220 msgr2=0x7f5af40c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af40ad220 0x7f5af40c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 -- 172.21.15.50:0/2543320415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009a20 con 0x7f5af406afa0 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5af9f21700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5af40c95c0 tx=0x7f5af0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0012af0 con 0x7f5af406afa0 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0012c70 con 0x7f5af406afa0 2023-12-24T19:51:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0027470 con 0x7f5af406afa0 2023-12-24T19:51:26.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40c6410 con 0x7f5af406afa0 2023-12-24T19:51:26.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.715+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4140300 con 0x7f5af406afa0 2023-12-24T19:51:26.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.719+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af40ae0a0 con 0x7f5af406afa0 2023-12-24T19:51:26.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.719+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f5af0024070 con 0x7f5af406afa0 2023-12-24T19:51:26.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.719+0000 7f5ae9ffb700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 0x7f5ad8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:26.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.723+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f5af007eee0 con 0x7f5af406afa0 2023-12-24T19:51:26.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.723+0000 7f5af9720700 1 -- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 msgr2=0x7f5ad8062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:26.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.723+0000 7f5af9720700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 0x7f5ad8062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:26.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.727+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5af40ae0a0 con 0x7f5af406afa0 2023-12-24T19:51:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.903+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af40ae0a0 con 0x7f5af406afa0 2023-12-24T19:51:26.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.903+0000 7f5ae9ffb700 1 -- 172.21.15.50:0/2543320415 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16671 (secure 0 0 0) 0x7f5af40ae0a0 con 0x7f5af406afa0 2023-12-24T19:51:26.910 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:26.910 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":146,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:25.386656+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-24T18:55:19.145132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-24T18:55:20.516568+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/3054157555":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1565256126":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/1936518309":"2023-12-25T18:55:40.875942+0000","172.21.15.50:0/2069533528":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6837/33814":"2023-12-25T18:55:40.875942+0000","172.21.15.50:6836/33814":"2023-12-25T18:55:40.875942+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":52,"length":6},{"begin":80,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":18,"snaps":[{"begin":3,"length":49},{"begin":59,"length":21}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 msgr2=0x7f5ad8062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 0x7f5ad8062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 msgr2=0x7f5af413fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5af40c95c0 tx=0x7f5af0018000 comp rx=0 tx=0).stop 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 shutdown_connections 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5ad80606a0 0x7f5ad8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af4155710 0x7f5af4158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af40ad220 0x7f5af40c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 --2- 172.21.15.50:0/2543320415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af406afa0 0x7f5af413fdc0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 >> 172.21.15.50:0/2543320415 conn(0x7f5af4067b80 msgr2=0x7f5af40ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 shutdown_connections 2023-12-24T19:51:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:26.907+0000 7f5afaf23700 1 -- 172.21.15.50:0/2543320415 wait complete. 2023-12-24T19:51:26.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T19:51:27.060 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:27.054+0000 7effbb166000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:51:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.171+0000 7fef334f0700 1 Processor -- start 2023-12-24T19:51:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.171+0000 7fef334f0700 1 -- start start 2023-12-24T19:51:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef334f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef2c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef334f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c06d5c0 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef334f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c0b4400 con 0x7fef2c0b3c90 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef334f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0b49c0 con 0x7fef2c158e10 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef31a8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef2c0b1ba0 0x7fef2c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55082/0 (socket says 172.21.15.50:55082) 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef31a8d700 1 -- 172.21.15.50:0/2223037533 learned_addr learned my addr 172.21.15.50:0/2223037533 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef3128c700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef2c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004016023 0 0) 0x7fef2c06d5c0 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18003570 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311150739 0 0) 0x7fef2c0b4400 con 0x7fef2c0b3c90 2023-12-24T19:51:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef2c06d5c0 con 0x7fef2c0b3c90 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132257907 0 0) 0x7fef18003570 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 msgr2=0x7fef2c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef2c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 >> v1:172.21.15.82:6789/0 conn(0x7fef2c0b3c90 legacy=0x7fef2c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0b46e0 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fef240017f0 con 0x7fef2c0b1ba0 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef3128c700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef2c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 >> v1:172.21.15.50:6789/0 conn(0x7fef2c0b1ba0 legacy=0x7fef2c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef18003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef18004160 0x7fef18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef18004d50 0x7fef180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0b49c0 con 0x7fef18004d50 2023-12-24T19:51:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1800bba0 con 0x7fef18004160 2023-12-24T19:51:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1800bd60 con 0x7fef2c158e10 2023-12-24T19:51:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef31a8d700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef18004d50 0x7fef180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef3128c700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef18003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.175+0000 7fef30a8b700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef18004160 0x7fef18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 -- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 msgr2=0x7fef18003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef2c158e10 0x7fef18003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 -- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef18004160 msgr2=0x7fef18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef18004160 0x7fef18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 -- 172.21.15.50:0/2223037533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009420 con 0x7fef18004d50 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef30a8b700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef18004160 0x7fef18004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef18004d50 0x7fef180051c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fef2400a8f0 tx=0x7fef24002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e325ca03ff5aafe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240070d0 con 0x7fef18004d50 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24007230 con 0x7fef18004d50 2023-12-24T19:51:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef23fff700 1 -- 172.21.15.50:0/2223037533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240075f0 con 0x7fef18004d50 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 -- 172.21.15.50:0/2223037533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef18004d50 msgr2=0x7fef180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 --2- 172.21.15.50:0/2223037533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef18004d50 0x7fef180051c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fef2400a8f0 tx=0x7fef24002190 comp rx=0 tx=0).stop 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef31a8d700 1 -- 172.21.15.50:0/2223037533 reap_dead start 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 -- 172.21.15.50:0/2223037533 shutdown_connections 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 -- 172.21.15.50:0/2223037533 >> 172.21.15.50:0/2223037533 conn(0x7fef2c0670b0 msgr2=0x7fef2c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 -- 172.21.15.50:0/2223037533 shutdown_connections 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.179+0000 7fef334f0700 1 -- 172.21.15.50:0/2223037533 wait complete. 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 Processor -- start 2023-12-24T19:51:27.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 -- start start 2023-12-24T19:51:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 0x7fef2c0a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 0x7fef2c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ad3c0 con 0x7fef2c155650 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0aa580 con 0x7fef2c155ac0 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.183+0000 7fef334f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ad680 con 0x7fef18004d50 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef30a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 0x7fef2c0a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef31a8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 0x7fef2c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef30a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40856/0 (socket says 172.21.15.50:40856) 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef30a8b700 1 -- 172.21.15.50:0/3856112477 learned_addr learned my addr 172.21.15.50:0/3856112477 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 msgr2=0x7fef2c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 0x7fef2c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 msgr2=0x7fef2c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 -- 172.21.15.50:0/3856112477 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0a9ce0 con 0x7fef18004d50 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef30a8b700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef31a8d700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 0x7fef2c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef3128c700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 0x7fef2c0a9340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef28011d40 tx=0x7fef280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800fa10 con 0x7fef18004d50 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800fb70 con 0x7fef18004d50 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c0a9fc0 con 0x7fef18004d50 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28014440 con 0x7fef18004d50 2023-12-24T19:51:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c0abcb0 con 0x7fef18004d50 2023-12-24T19:51:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.187+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c0652e0 con 0x7fef18004d50 2023-12-24T19:51:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.191+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 74) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fef28014830 con 0x7fef18004d50 2023-12-24T19:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.191+0000 7fef217fa700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 0x7fef10062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.191+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fef28018030 con 0x7fef18004d50 2023-12-24T19:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.191+0000 7fef30a8b700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 msgr2=0x7fef10062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.191+0000 7fef30a8b700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 0x7fef10062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.199+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fef2804dd60 con 0x7fef18004d50 2023-12-24T19:51:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.395+0000 7fef30a8b700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 msgr2=0x7fef10062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.395+0000 7fef30a8b700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 0x7fef10062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.407+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef2c06ca20 con 0x7fef18004d50 2023-12-24T19:51:27.410 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T19:51:27.407+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T19:51:27.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef217fa700 1 -- 172.21.15.50:0/3856112477 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef28022070 con 0x7fef18004d50 2023-12-24T19:51:27.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 msgr2=0x7fef10062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:27.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 0x7fef10062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 msgr2=0x7fef2c0a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 0x7fef2c0a9340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef28011d40 tx=0x7fef280091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 shutdown_connections 2023-12-24T19:51:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fef100606a0 0x7fef10062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c155ac0 0x7fef2c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef2c155650 0x7fef2c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 --2- 172.21.15.50:0/3856112477 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef18004d50 0x7fef2c0a9340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 >> 172.21.15.50:0/3856112477 conn(0x7fef2c0670b0 msgr2=0x7fef2c1564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:27.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 shutdown_connections 2023-12-24T19:51:27.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.423+0000 7fef334f0700 1 -- 172.21.15.50:0/3856112477 wait complete. 2023-12-24T19:51:27.429 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T19:51:27.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T19:51:27.474 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.471+0000 7f1f9095b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:51:27.494 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T19:51:27.592 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f5b5cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.592 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f5b5cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.592 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f5b5cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.592 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f5b5cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f5b5cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f585c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f585c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f585c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f585c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.593 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:27.591+0000 7f1f585c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.623+0000 7f33bcf23700 1 Processor -- start 2023-12-24T19:51:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.623+0000 7f33bcf23700 1 -- start start 2023-12-24T19:51:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33bcf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33bcf23700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33b80adb50 0x7f33b80adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33bcf23700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815b5a0 con 0x7f33b80c87d0 2023-12-24T19:51:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33bcf23700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b815a990 con 0x7f33b80adb50 2023-12-24T19:51:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33bcf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b815ac70 con 0x7f33b8156ab0 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33b80adb50 0x7f33b80adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33b80adb50 0x7f33b80adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40982/0 (socket says 172.21.15.50:40982) 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 -- 172.21.15.50:0/3497225936 learned_addr learned my addr 172.21.15.50:0/3497225936 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b77fe700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 -- 172.21.15.50:0/3497225936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 msgr2=0x7f33b8156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 -- 172.21.15.50:0/3497225936 >> v1:172.21.15.82:6789/0 conn(0x7f33b80c87d0 legacy=0x7f33b80ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.627+0000 7f33b6ffd700 1 -- 172.21.15.50:0/3497225936 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b815af50 con 0x7f33b80adb50 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33b6ffd700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80adb50 0x7f33b80adf80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0099b0 tx=0x7f33ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff5ae0af514529d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33b67fc700 1 -- 172.21.15.50:0/3497225936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac009ea0 con 0x7f33b80adb50 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33b67fc700 1 -- 172.21.15.50:0/3497225936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00b860 con 0x7f33b80adb50 2023-12-24T19:51:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33b67fc700 1 -- 172.21.15.50:0/3497225936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00bc00 con 0x7f33b80adb50 2023-12-24T19:51:27.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 -- 172.21.15.50:0/3497225936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80adb50 msgr2=0x7f33b80adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80adb50 0x7f33b80adf80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0099b0 tx=0x7f33ac009250 comp rx=0 tx=0).stop 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 -- 172.21.15.50:0/3497225936 shutdown_connections 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80adb50 0x7f33b80adf80 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 --2- 172.21.15.50:0/3497225936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 -- 172.21.15.50:0/3497225936 >> 172.21.15.50:0/3497225936 conn(0x7f33b8067250 msgr2=0x7f33b8067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 -- 172.21.15.50:0/3497225936 shutdown_connections 2023-12-24T19:51:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 -- 172.21.15.50:0/3497225936 wait complete. 2023-12-24T19:51:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.631+0000 7f33bcf23700 1 Processor -- start 2023-12-24T19:51:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 -- start start 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b80adb50 0x7f33b8157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8158840 con 0x7f33b80c87d0 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8158b20 con 0x7f33b80adb50 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8158e00 con 0x7f33b8156ab0 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40994/0 (socket says 172.21.15.50:40994) 2023-12-24T19:51:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 -- 172.21.15.50:0/2298712663 learned_addr learned my addr 172.21.15.50:0/2298712663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b7fff700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b77fe700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b80adb50 0x7f33b8157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 -- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 msgr2=0x7f33b8169180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8169180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 -- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b80adb50 msgr2=0x7f33b8157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b80adb50 0x7f33b8157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 -- 172.21.15.50:0/2298712663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0094f0 con 0x7f33b80c87d0 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b7fff700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33b6ffd700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f33b80c9450 tx=0x7f33ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00bbe0 con 0x7f33b80c87d0 2023-12-24T19:51:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac011420 con 0x7f33b80c87d0 2023-12-24T19:51:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0117c0 con 0x7f33b80c87d0 2023-12-24T19:51:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.635+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b81590e0 con 0x7f33b80c87d0 2023-12-24T19:51:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.639+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81685e0 con 0x7f33b80c87d0 2023-12-24T19:51:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.639+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b804be40 con 0x7f33b80c87d0 2023-12-24T19:51:27.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.639+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 76) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f33ac011bf0 con 0x7f33b80c87d0 2023-12-24T19:51:27.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.639+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7075+0+0 (secure 0 0 0) 0x7f33ac07e290 con 0x7f33b80c87d0 2023-12-24T19:51:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.647+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f33ac04e5f0 con 0x7f33b80c87d0 2023-12-24T19:51:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:27.859+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33b815b230 con 0x7f33b80c87d0 2023-12-24T19:51:28.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.507+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 77) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f33ac057020 con 0x7f33b80c87d0 2023-12-24T19:51:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.507+0000 7f339f7fe700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 0x7f33a4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.511+0000 7f33b77fe700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 0x7f33a4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.515+0000 7f33b77fe700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 0x7f33a4068a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009ca0 tx=0x7f33a8008040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.519+0000 7f339f7fe700 1 -- 172.21.15.50:0/2298712663 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33ac054d60 con 0x7f33b80c87d0 2023-12-24T19:51:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 msgr2=0x7f33a4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 0x7f33a4068a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009ca0 tx=0x7f33a8008040 comp rx=0 tx=0).stop 2023-12-24T19:51:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 msgr2=0x7f33b8168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f33b80c9450 tx=0x7f33ac017000 comp rx=0 tx=0).stop 2023-12-24T19:51:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 shutdown_connections 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f33a40666b0 0x7f33a4068a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33b8156ab0 0x7f33b8169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80c87d0 0x7f33b8168c40 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 --2- 172.21.15.50:0/2298712663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b80adb50 0x7f33b8157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 >> 172.21.15.50:0/2298712663 conn(0x7f33b8067250 msgr2=0x7f33b8150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 shutdown_connections 2023-12-24T19:51:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.523+0000 7f33bcf23700 1 -- 172.21.15.50:0/2298712663 wait complete. 2023-12-24T19:51:28.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T19:51:28.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.747+0000 7fb97dfc3700 1 Processor -- start 2023-12-24T19:51:28.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.747+0000 7fb97dfc3700 1 -- start start 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9780c5c90 0x7fb978163f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97806b5b0 con 0x7fb978159080 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780cbb40 con 0x7fb97806a4a0 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97815dbd0 con 0x7fb9780c5c90 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97cfc1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb978159080 0x7fb97806da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55092/0 (socket says 172.21.15.50:55092) 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97cfc1700 1 -- 172.21.15.50:0/3087835528 learned_addr learned my addr 172.21.15.50:0/3087835528 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:28.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97d7c2700 1 --2- 172.21.15.50:0/3087835528 >> v2:172.21.15.82:3300/0 conn(0x7fb9780c5c90 0x7fb978163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb9777fe700 1 -- 172.21.15.50:0/3087835528 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890300137 0 0) 0x7fb97806b5b0 con 0x7fb978159080 2023-12-24T19:51:28.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb9777fe700 1 -- 172.21.15.50:0/3087835528 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb968003570 con 0x7fb978159080 2023-12-24T19:51:28.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97d7c2700 1 -- 172.21.15.50:0/3087835528 >> v1:172.21.15.82:6789/0 conn(0x7fb97806a4a0 legacy=0x7fb9780c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97d7c2700 1 -- 172.21.15.50:0/3087835528 >> v1:172.21.15.50:6789/0 conn(0x7fb978159080 legacy=0x7fb97806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97d7c2700 1 -- 172.21.15.50:0/3087835528 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97806a9a0 con 0x7fb9780c5c90 2023-12-24T19:51:28.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97d7c2700 1 --2- 172.21.15.50:0/3087835528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb978163f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e60 tx=0x7fb970009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cd04c344b4c47e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:28.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb9777fe700 1 -- 172.21.15.50:0/3087835528 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000e070 con 0x7fb9780c5c90 2023-12-24T19:51:28.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb9777fe700 1 -- 172.21.15.50:0/3087835528 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000bb60 con 0x7fb9780c5c90 2023-12-24T19:51:28.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb9777fe700 1 -- 172.21.15.50:0/3087835528 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970012430 con 0x7fb9780c5c90 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3087835528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 msgr2=0x7fb978163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.751+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3087835528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb978163f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e60 tx=0x7fb970009780 comp rx=0 tx=0).stop 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3087835528 shutdown_connections 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3087835528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb978163f70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3087835528 >> 172.21.15.50:0/3087835528 conn(0x7fb978067b80 msgr2=0x7fb9780cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3087835528 shutdown_connections 2023-12-24T19:51:28.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3087835528 wait complete. 2023-12-24T19:51:28.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 Processor -- start 2023-12-24T19:51:28.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.755+0000 7fb97dfc3700 1 -- start start 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb97814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb978159080 0x7fb978169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97814e520 con 0x7fb97806a4a0 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97814f360 con 0x7fb9780c5c90 2023-12-24T19:51:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978169e90 con 0x7fb978159080 2023-12-24T19:51:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41008/0 (socket says 172.21.15.50:41008) 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 -- 172.21.15.50:0/3716163101 learned_addr learned my addr 172.21.15.50:0/3716163101 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb977fff700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb97814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97d7c2700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb978159080 0x7fb978169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 -- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb978159080 msgr2=0x7fb978169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb978159080 0x7fb978169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 -- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 msgr2=0x7fb97814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb97814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 -- 172.21.15.50:0/3716163101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009a20 con 0x7fb97806a4a0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97cfc1700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00c5c0 tx=0x7fb96c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c005b30 con 0x7fb97806a4a0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c005cb0 con 0x7fb97806a4a0 2023-12-24T19:51:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97814e750 con 0x7fb97806a4a0 2023-12-24T19:51:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c007320 con 0x7fb97806a4a0 2023-12-24T19:51:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.759+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97814ed10 con 0x7fb97806a4a0 2023-12-24T19:51:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.763+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97804be40 con 0x7fb97806a4a0 2023-12-24T19:51:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.763+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 77) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fb96c01b3b0 con 0x7fb97806a4a0 2023-12-24T19:51:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.763+0000 7fb974ff9700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 0x7fb95c062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.767+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7075+0+0 (secure 0 0 0) 0x7fb96c07be80 con 0x7fb97806a4a0 2023-12-24T19:51:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.767+0000 7fb977fff700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 0x7fb95c062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.767+0000 7fb977fff700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 0x7fb95c062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb97815d810 tx=0x7fb964007ec0 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.771+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb96c04c0f0 con 0x7fb97806a4a0 2023-12-24T19:51:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:28.943+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb97814f0b0 con 0x7fb97806a4a0 2023-12-24T19:51:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.535+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb96c080070 con 0x7fb97806a4a0 2023-12-24T19:51:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.535+0000 7fb974ff9700 1 -- 172.21.15.50:0/3716163101 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb96c0466b0 con 0x7fb97806a4a0 2023-12-24T19:51:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 msgr2=0x7fb95c062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 0x7fb95c062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb97815d810 tx=0x7fb964007ec0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 msgr2=0x7fb9781527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00c5c0 tx=0x7fb96c007e00 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 shutdown_connections 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb95c0603a0 0x7fb95c062850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb978159080 0x7fb978169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9780c5c90 0x7fb97814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 --2- 172.21.15.50:0/3716163101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97806a4a0 0x7fb9781527a0 secure :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00c5c0 tx=0x7fb96c007e00 comp rx=0 tx=0).stop 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 >> 172.21.15.50:0/3716163101 conn(0x7fb978067b80 msgr2=0x7fb9781536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.539+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 shutdown_connections 2023-12-24T19:51:29.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.543+0000 7fb97dfc3700 1 -- 172.21.15.50:0/3716163101 wait complete. 2023-12-24T19:51:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T19:51:29.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T19:51:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.731+0000 7f3d92d85700 1 Processor -- start 2023-12-24T19:51:29.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.731+0000 7f3d92d85700 1 -- start start 2023-12-24T19:51:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.735+0000 7f3d92d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.735+0000 7f3d92d85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d8c06db90 0x7f3d8c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.735+0000 7f3d92d85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c06d4d0 con 0x7f3d8c0b4060 2023-12-24T19:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b44e0 con 0x7f3d8c06db90 2023-12-24T19:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b4960 con 0x7f3d8c156b50 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d91322700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d8c0b4060 0x7f3d8c15ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36048/0 (socket says 172.21.15.50:36048) 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d91322700 1 -- 172.21.15.50:0/4050610008 learned_addr learned my addr 172.21.15.50:0/4050610008 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 --2- 172.21.15.50:0/4050610008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d8bfff700 1 --2- 172.21.15.50:0/4050610008 >> v2:172.21.15.82:3300/0 conn(0x7f3d8c06db90 0x7f3d8c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 -- 172.21.15.50:0/4050610008 >> v2:172.21.15.82:3300/0 conn(0x7f3d8c06db90 msgr2=0x7f3d8c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 --2- 172.21.15.50:0/4050610008 >> v2:172.21.15.82:3300/0 conn(0x7f3d8c06db90 0x7f3d8c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 -- 172.21.15.50:0/4050610008 >> v1:172.21.15.50:6789/0 conn(0x7f3d8c0b4060 legacy=0x7f3d8c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 -- 172.21.15.50:0/4050610008 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c15a620 con 0x7f3d8c156b50 2023-12-24T19:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d8b7fe700 1 -- 172.21.15.50:0/4050610008 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896974899 0 0) 0x7f3d8c06d4d0 con 0x7f3d8c0b4060 2023-12-24T19:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d90b21700 1 --2- 172.21.15.50:0/4050610008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c15a0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d800098e0 tx=0x7f3d800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccf9daf19b46410d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d8b7fe700 1 -- 172.21.15.50:0/4050610008 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000b640 con 0x7f3d8c156b50 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d8b7fe700 1 -- 172.21.15.50:0/4050610008 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000b7a0 con 0x7f3d8c156b50 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d8b7fe700 1 -- 172.21.15.50:0/4050610008 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000bb40 con 0x7f3d8c156b50 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 -- 172.21.15.50:0/4050610008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 msgr2=0x7f3d8c15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 --2- 172.21.15.50:0/4050610008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c15a0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d800098e0 tx=0x7f3d800091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 -- 172.21.15.50:0/4050610008 shutdown_connections 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 --2- 172.21.15.50:0/4050610008 >> v2:172.21.15.82:3300/0 conn(0x7f3d8c06db90 0x7f3d8c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 --2- 172.21.15.50:0/4050610008 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c15a0e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.739+0000 7f3d92d85700 1 -- 172.21.15.50:0/4050610008 >> 172.21.15.50:0/4050610008 conn(0x7f3d8c067b40 msgr2=0x7f3d8c0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.743+0000 7f3d92d85700 1 -- 172.21.15.50:0/4050610008 shutdown_connections 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.743+0000 7f3d92d85700 1 -- 172.21.15.50:0/4050610008 wait complete. 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.743+0000 7f3d92d85700 1 Processor -- start 2023-12-24T19:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.743+0000 7f3d92d85700 1 -- start start 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 0x7f3d8c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c151fd0 con 0x7f3d8c0b4060 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c1522b0 con 0x7f3d8c06db90 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c152590 con 0x7f3d8c156b50 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42788/0 (socket says 172.21.15.50:42788) 2023-12-24T19:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 -- 172.21.15.50:0/244817978 learned_addr learned my addr 172.21.15.50:0/244817978 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d90b21700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 0x7f3d8c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d91322700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 -- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 msgr2=0x7f3d8c0cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c0cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 -- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 msgr2=0x7f3d8c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 0x7f3d8c14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 -- 172.21.15.50:0/244817978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009420 con 0x7f3d8c0b4060 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d90b21700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 0x7f3d8c14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d8bfff700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800ec80 tx=0x7f3d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800c850 con 0x7f3d8c0b4060 2023-12-24T19:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800c9b0 con 0x7f3d8c0b4060 2023-12-24T19:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c152870 con 0x7f3d8c0b4060 2023-12-24T19:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800cd50 con 0x7f3d8c0b4060 2023-12-24T19:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.747+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c151200 con 0x7f3d8c0b4060 2023-12-24T19:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.751+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c071060 con 0x7f3d8c0b4060 2023-12-24T19:51:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.751+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3d78013680 con 0x7f3d8c0b4060 2023-12-24T19:51:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.755+0000 7f3d88ff9700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 0x7f3d70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.755+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3d7807cd90 con 0x7f3d8c0b4060 2023-12-24T19:51:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.755+0000 7f3d90b21700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 0x7f3d70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.755+0000 7f3d90b21700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 0x7f3d70062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d800093f0 tx=0x7f3d80017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:29.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.759+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d7804cfe0 con 0x7f3d8c0b4060 2023-12-24T19:51:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:29.935+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d8c06c8c0 con 0x7f3d8c0b4060 2023-12-24T19:51:30.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.399+0000 7f3d88ff9700 1 -- 172.21.15.50:0/244817978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v150) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d78050600 con 0x7f3d8c0b4060 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 msgr2=0x7f3d70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 0x7f3d70062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d800093f0 tx=0x7f3d80017000 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 msgr2=0x7f3d8c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800ec80 tx=0x7f3d780091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 shutdown_connections 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3d70060550 0x7f3d70062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d8c156b50 0x7f3d8c0cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c0b4060 0x7f3d8c0ce7a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 --2- 172.21.15.50:0/244817978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d8c06db90 0x7f3d8c14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 >> 172.21.15.50:0/244817978 conn(0x7f3d8c067b40 msgr2=0x7f3d8c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 shutdown_connections 2023-12-24T19:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.407+0000 7f3d92d85700 1 -- 172.21.15.50:0/244817978 wait complete. 2023-12-24T19:51:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T19:51:30.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T19:51:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.607+0000 7f453b323700 1 Processor -- start 2023-12-24T19:51:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.607+0000 7f453b323700 1 -- start start 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453b323700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 0x7f45340afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453b323700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340caa60 con 0x7f4534159020 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453b323700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340cee80 con 0x7f4534158c50 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453b323700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340af430 con 0x7f45340ccea0 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f4539b20700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4534159020 0x7f45340cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36056/0 (socket says 172.21.15.50:36056) 2023-12-24T19:51:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f4539b20700 1 -- 172.21.15.50:0/2663887748 learned_addr learned my addr 172.21.15.50:0/2663887748 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453ab22700 1 --2- 172.21.15.50:0/2663887748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 0x7f45340afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179317558 0 0) 0x7f45340caa60 con 0x7f4534159020 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003570 con 0x7f4534159020 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948358641 0 0) 0x7f45340cee80 con 0x7f4534158c50 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45340caa60 con 0x7f4534158c50 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453ab22700 1 -- 172.21.15.50:0/2663887748 >> v1:172.21.15.82:6789/0 conn(0x7f4534158c50 legacy=0x7f45340caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453ab22700 1 -- 172.21.15.50:0/2663887748 >> v1:172.21.15.50:6789/0 conn(0x7f4534159020 legacy=0x7f45340cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.611+0000 7f453ab22700 1 -- 172.21.15.50:0/2663887748 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340cf160 con 0x7f45340ccea0 2023-12-24T19:51:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453ab22700 1 --2- 172.21.15.50:0/2663887748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 0x7f45340afd30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f452c009e90 tx=0x7f452c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef4e3592323a780 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00e070 con 0x7f45340ccea0 2023-12-24T19:51:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00bb80 con 0x7f45340ccea0 2023-12-24T19:51:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453931f700 1 -- 172.21.15.50:0/2663887748 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c012430 con 0x7f45340ccea0 2023-12-24T19:51:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 -- 172.21.15.50:0/2663887748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 msgr2=0x7f45340afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 --2- 172.21.15.50:0/2663887748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 0x7f45340afd30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f452c009e90 tx=0x7f452c009780 comp rx=0 tx=0).stop 2023-12-24T19:51:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 -- 172.21.15.50:0/2663887748 shutdown_connections 2023-12-24T19:51:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 --2- 172.21.15.50:0/2663887748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45340ccea0 0x7f45340afd30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 -- 172.21.15.50:0/2663887748 >> 172.21.15.50:0/2663887748 conn(0x7f45340670b0 msgr2=0x7f45340674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 -- 172.21.15.50:0/2663887748 shutdown_connections 2023-12-24T19:51:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.615+0000 7f453b323700 1 -- 172.21.15.50:0/2663887748 wait complete. 2023-12-24T19:51:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.619+0000 7f453b323700 1 Processor -- start 2023-12-24T19:51:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.619+0000 7f453b323700 1 -- start start 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45340ccea0 0x7f4534155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 0x7f45341526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453415b540 con 0x7f4534159020 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b0100 con 0x7f45340ccea0 2023-12-24T19:51:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45341548d0 con 0x7f4534158c50 2023-12-24T19:51:30.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:30.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42790/0 (socket says 172.21.15.50:42790) 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 -- 172.21.15.50:0/3929259910 learned_addr learned my addr 172.21.15.50:0/3929259910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f4539b20700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 0x7f45341526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453a321700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45340ccea0 0x7f4534155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 -- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 msgr2=0x7f45341526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 0x7f45341526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 -- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45340ccea0 msgr2=0x7f4534155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45340ccea0 0x7f4534155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 -- 172.21.15.50:0/3929259910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c009a20 con 0x7f4534159020 2023-12-24T19:51:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f4539b20700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 0x7f45341526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453ab22700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f452c013000 tx=0x7f452c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c01b420 con 0x7f4534159020 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534154bb0 con 0x7f4534159020 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c01b5a0 con 0x7f4534159020 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c01b960 con 0x7f4534159020 2023-12-24T19:51:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.623+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45340afd90 con 0x7f4534159020 2023-12-24T19:51:30.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.627+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45340b02b0 con 0x7f4534159020 2023-12-24T19:51:30.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.627+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f452c01bd50 con 0x7f4534159020 2023-12-24T19:51:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.627+0000 7f452a7fc700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 0x7f4518062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.627+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f452c07e450 con 0x7f4534159020 2023-12-24T19:51:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.627+0000 7f453a321700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 0x7f4518062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:30.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.631+0000 7f453a321700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 0x7f4518062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530007d50 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.635+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f45340b02b0 con 0x7f4534159020 2023-12-24T19:51:30.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.827+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f45340b0270 con 0x7f4534159020 2023-12-24T19:51:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.839+0000 7f452a7fc700 1 -- 172.21.15.50:0/3929259910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v49) v1 ==== 115+0+0 (secure 0 0 0) 0x7f452c0522e0 con 0x7f4534159020 2023-12-24T19:51:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 msgr2=0x7f4518062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 0x7f4518062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530007d50 comp rx=0 tx=0).stop 2023-12-24T19:51:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 msgr2=0x7f45340b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f452c013000 tx=0x7f452c019000 comp rx=0 tx=0).stop 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 shutdown_connections 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4518060550 0x7f4518062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534159020 0x7f45340b0590 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4534158c50 0x7f45341526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 --2- 172.21.15.50:0/3929259910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45340ccea0 0x7f4534155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 >> 172.21.15.50:0/3929259910 conn(0x7f45340670b0 msgr2=0x7f453406b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 shutdown_connections 2023-12-24T19:51:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:30.843+0000 7f453b323700 1 -- 172.21.15.50:0/3929259910 wait complete. 2023-12-24T19:51:30.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T19:51:31.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 Processor -- start 2023-12-24T19:51:31.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 -- start start 2023-12-24T19:51:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa298160af0 0x7fa29806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29806b0b0 con 0x7fa298160720 2023-12-24T19:51:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29815e960 con 0x7fa29806ac40 2023-12-24T19:51:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.043+0000 7fa29d785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2981600a0 con 0x7fa298160af0 2023-12-24T19:51:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa296ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa298160720 0x7fa29806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36066/0 (socket says 172.21.15.50:36066) 2023-12-24T19:51:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa296ffd700 1 -- 172.21.15.50:0/2973189896 learned_addr learned my addr 172.21.15.50:0/2973189896 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa28ffff700 1 --2- 172.21.15.50:0/2973189896 >> v2:172.21.15.50:3300/0 conn(0x7fa298160af0 0x7fa29806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859196831 0 0) 0x7fa29815e960 con 0x7fa29806ac40 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa284003570 con 0x7fa29806ac40 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429378725 0 0) 0x7fa29806b0b0 con 0x7fa298160720 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa28ffff700 1 -- 172.21.15.50:0/2973189896 >> v1:172.21.15.82:6789/0 conn(0x7fa29806ac40 legacy=0x7fa29815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa28ffff700 1 -- 172.21.15.50:0/2973189896 >> v1:172.21.15.50:6789/0 conn(0x7fa298160720 legacy=0x7fa29806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa28ffff700 1 -- 172.21.15.50:0/2973189896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29815dd50 con 0x7fa298160af0 2023-12-24T19:51:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa28ffff700 1 --2- 172.21.15.50:0/2973189896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa298160af0 0x7fa29806a700 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa2800098e0 tx=0x7fa2800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4b9fa2b48f5e81 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000b640 con 0x7fa298160af0 2023-12-24T19:51:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28000b7a0 con 0x7fa298160af0 2023-12-24T19:51:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa2967fc700 1 -- 172.21.15.50:0/2973189896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000bb40 con 0x7fa298160af0 2023-12-24T19:51:31.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa29d785700 1 -- 172.21.15.50:0/2973189896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa298160af0 msgr2=0x7fa29806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa29d785700 1 --2- 172.21.15.50:0/2973189896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa298160af0 0x7fa29806a700 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa2800098e0 tx=0x7fa2800091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa29d785700 1 -- 172.21.15.50:0/2973189896 shutdown_connections 2023-12-24T19:51:31.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa29d785700 1 --2- 172.21.15.50:0/2973189896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa298160af0 0x7fa29806a700 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.047+0000 7fa29d785700 1 -- 172.21.15.50:0/2973189896 >> 172.21.15.50:0/2973189896 conn(0x7fa298067b80 msgr2=0x7fa2980cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:31.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.051+0000 7fa29d785700 1 -- 172.21.15.50:0/2973189896 shutdown_connections 2023-12-24T19:51:31.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.051+0000 7fa29d785700 1 -- 172.21.15.50:0/2973189896 wait complete. 2023-12-24T19:51:31.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.051+0000 7fa29d785700 1 Processor -- start 2023-12-24T19:51:31.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.051+0000 7fa29d785700 1 -- start start 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa298160720 0x7fa2980c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa298160af0 0x7fa2980c0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298149bc0 con 0x7fa29806ac40 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29814a450 con 0x7fa298160720 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29814a730 con 0x7fa298160af0 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42806/0 (socket says 172.21.15.50:42806) 2023-12-24T19:51:31.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 -- 172.21.15.50:0/2249019617 learned_addr learned my addr 172.21.15.50:0/2249019617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:31.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa28ffff700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa298160720 0x7fa2980c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa2977fe700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa298160af0 0x7fa2980c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 -- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa298160af0 msgr2=0x7fa2980c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa298160af0 0x7fa2980c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 -- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa298160720 msgr2=0x7fa2980c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa298160720 0x7fa2980c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 -- 172.21.15.50:0/2249019617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280009420 con 0x7fa29806ac40 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa296ffd700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa28800c5b0 tx=0x7fa288001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288005b30 con 0x7fa29806ac40 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288005c90 con 0x7fa29806ac40 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29814aa10 con 0x7fa29806ac40 2023-12-24T19:51:31.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.055+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288007300 con 0x7fa29806ac40 2023-12-24T19:51:31.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.059+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29814afd0 con 0x7fa29806ac40 2023-12-24T19:51:31.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.059+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2980cbfc0 con 0x7fa29806ac40 2023-12-24T19:51:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.059+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa28801b3b0 con 0x7fa29806ac40 2023-12-24T19:51:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.063+0000 7fa28effd700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.063+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa28807bfa0 con 0x7fa29806ac40 2023-12-24T19:51:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.063+0000 7fa28ffff700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.063+0000 7fa28ffff700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 0x7fa278062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2800093f0 tx=0x7fa280017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.067+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2980cbfc0 con 0x7fa29806ac40 2023-12-24T19:51:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.239+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa2980cbfc0 con 0x7fa29806ac40 2023-12-24T19:51:31.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.251+0000 7fa28effd700 1 -- 172.21.15.50:0/2249019617 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa2980cbfc0 con 0x7fa29806ac40 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 msgr2=0x7fa278062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 0x7fa278062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2800093f0 tx=0x7fa280017000 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 msgr2=0x7fa298149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa28800c5b0 tx=0x7fa288001070 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 shutdown_connections 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fa278060550 0x7fa278062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa298160af0 0x7fa2980c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa298160720 0x7fa2980c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 --2- 172.21.15.50:0/2249019617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa29806ac40 0x7fa298149e70 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 >> 172.21.15.50:0/2249019617 conn(0x7fa298067b80 msgr2=0x7fa2980c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 shutdown_connections 2023-12-24T19:51:31.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.255+0000 7fa29d785700 1 -- 172.21.15.50:0/2249019617 wait complete. 2023-12-24T19:51:31.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T19:51:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.443+0000 7f70bcce3700 1 Processor -- start 2023-12-24T19:51:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.443+0000 7f70bcce3700 1 -- start start 2023-12-24T19:51:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70bcce3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70b806d450 0x7f70b80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70bcce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b806a580 con 0x7f70b80cc780 2023-12-24T19:51:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70bcce3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80cd110 con 0x7f70b8158c40 2023-12-24T19:51:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70bcce3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b806a7d0 con 0x7f70b806d450 2023-12-24T19:51:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f70b80cc780 0x7f70b806cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36070/0 (socket says 172.21.15.50:36070) 2023-12-24T19:51:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b6ffd700 1 -- 172.21.15.50:0/2166534431 learned_addr learned my addr 172.21.15.50:0/2166534431 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b7fff700 1 --2- 172.21.15.50:0/2166534431 >> v2:172.21.15.50:3300/0 conn(0x7f70b806d450 0x7f70b80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321375367 0 0) 0x7f70b806a580 con 0x7f70b80cc780 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0003570 con 0x7f70b80cc780 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199625695 0 0) 0x7f70b80cd110 con 0x7f70b8158c40 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b7fff700 1 -- 172.21.15.50:0/2166534431 >> v1:172.21.15.82:6789/0 conn(0x7f70b8158c40 legacy=0x7f70b80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b7fff700 1 -- 172.21.15.50:0/2166534431 >> v1:172.21.15.50:6789/0 conn(0x7f70b80cc780 legacy=0x7f70b806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b7fff700 1 -- 172.21.15.50:0/2166534431 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b806aab0 con 0x7f70b806d450 2023-12-24T19:51:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.447+0000 7f70b7fff700 1 --2- 172.21.15.50:0/2166534431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b80ccbd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009e60 tx=0x7f70b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b72d5c272951200 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000e070 con 0x7f70b806d450 2023-12-24T19:51:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b000bb60 con 0x7f70b806d450 2023-12-24T19:51:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70b67fc700 1 -- 172.21.15.50:0/2166534431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0012430 con 0x7f70b806d450 2023-12-24T19:51:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- 172.21.15.50:0/2166534431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 msgr2=0x7f70b80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 --2- 172.21.15.50:0/2166534431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b80ccbd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009e60 tx=0x7f70b0009780 comp rx=0 tx=0).stop 2023-12-24T19:51:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- 172.21.15.50:0/2166534431 shutdown_connections 2023-12-24T19:51:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 --2- 172.21.15.50:0/2166534431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b80ccbd0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- 172.21.15.50:0/2166534431 >> 172.21.15.50:0/2166534431 conn(0x7f70b80d0800 msgr2=0x7f70b80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- 172.21.15.50:0/2166534431 shutdown_connections 2023-12-24T19:51:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- 172.21.15.50:0/2166534431 wait complete. 2023-12-24T19:51:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 Processor -- start 2023-12-24T19:51:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.451+0000 7f70bcce3700 1 -- start start 2023-12-24T19:51:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 0x7f70b8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70b8158c40 0x7f70b80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8152970 con 0x7f70b806d450 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8159010 con 0x7f70b80cc780 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c5ac0 con 0x7f70b8158c40 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42826/0 (socket says 172.21.15.50:42826) 2023-12-24T19:51:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b77fe700 1 -- 172.21.15.50:0/3110218077 learned_addr learned my addr 172.21.15.50:0/3110218077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 0x7f70b8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b7fff700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70b8158c40 0x7f70b80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 -- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70b8158c40 msgr2=0x7f70b80c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70b8158c40 0x7f70b80c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 -- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 msgr2=0x7f70b815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 -- 172.21.15.50:0/3110218077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009a20 con 0x7f70b80cc780 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b77fe700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70b6ffd700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 0x7f70b8152430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0058d0 tx=0x7f70ac007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac005b30 con 0x7f70b80cc780 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac005cd0 con 0x7f70b80cc780 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac007320 con 0x7f70b80cc780 2023-12-24T19:51:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b81592d0 con 0x7f70b80cc780 2023-12-24T19:51:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.455+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b8159890 con 0x7f70b80cc780 2023-12-24T19:51:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.459+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b804be40 con 0x7f70b80cc780 2023-12-24T19:51:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.459+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f70ac007690 con 0x7f70b80cc780 2023-12-24T19:51:31.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.459+0000 7f709f7fe700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 0x7f70a4062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.463+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f70ac07bca0 con 0x7f70b80cc780 2023-12-24T19:51:31.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.463+0000 7f70b77fe700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 0x7f70a4062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.463+0000 7f70b77fe700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 0x7f70a4062a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70a8007fd0 tx=0x7f70a8009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.471+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f70ac049be0 con 0x7f70b80cc780 2023-12-24T19:51:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.647+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f70b806ad90 con 0x7f70b80cc780 2023-12-24T19:51:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.659+0000 7f709f7fe700 1 -- 172.21.15.50:0/3110218077 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f70ac0170a0 con 0x7f70b80cc780 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 msgr2=0x7f70a4062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 0x7f70a4062a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70a8007fd0 tx=0x7f70a8009040 comp rx=0 tx=0).stop 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 msgr2=0x7f70b8152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 0x7f70b8152430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0058d0 tx=0x7f70ac007d10 comp rx=0 tx=0).stop 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 shutdown_connections 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f70a40605d0 0x7f70a4062a80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70b8158c40 0x7f70b80c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b80cc780 0x7f70b8152430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 --2- 172.21.15.50:0/3110218077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b806d450 0x7f70b815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 >> 172.21.15.50:0/3110218077 conn(0x7f70b80d0800 msgr2=0x7f70b806db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 shutdown_connections 2023-12-24T19:51:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.663+0000 7f70bcce3700 1 -- 172.21.15.50:0/3110218077 wait complete. 2023-12-24T19:51:31.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-12-24T19:51:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 Processor -- start 2023-12-24T19:51:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 -- start start 2023-12-24T19:51:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4c00c6d00 0x7fd4c00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c0154450 0x7fd4c01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c006c820 con 0x7fd4c006aca0 2023-12-24T19:51:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c0154de0 con 0x7fd4c00c6d00 2023-12-24T19:51:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4c4acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c006b960 con 0x7fd4c0154450 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4c00c6d00 0x7fd4c00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4c00c6d00 0x7fd4c00c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42828/0 (socket says 172.21.15.50:42828) 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 -- 172.21.15.50:0/637301294 learned_addr learned my addr 172.21.15.50:0/637301294 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4b7fff700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c0154450 0x7fd4c01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 -- 172.21.15.50:0/637301294 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c0154450 msgr2=0x7fd4c01548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c0154450 0x7fd4c01548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 -- 172.21.15.50:0/637301294 >> v1:172.21.15.50:6789/0 conn(0x7fd4c006aca0 legacy=0x7fd4c006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.855+0000 7fd4be59c700 1 -- 172.21.15.50:0/637301294 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c006bc40 con 0x7fd4c00c6d00 2023-12-24T19:51:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4be59c700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00c70d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d156e5bbfe57fe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4bdd9b700 1 -- 172.21.15.50:0/637301294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000b860 con 0x7fd4c00c6d00 2023-12-24T19:51:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4bdd9b700 1 -- 172.21.15.50:0/637301294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000b9c0 con 0x7fd4c00c6d00 2023-12-24T19:51:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4bdd9b700 1 -- 172.21.15.50:0/637301294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000bd60 con 0x7fd4c00c6d00 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 -- 172.21.15.50:0/637301294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c00c6d00 msgr2=0x7fd4c00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00c70d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0009250 comp rx=0 tx=0).stop 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 -- 172.21.15.50:0/637301294 shutdown_connections 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c0154450 0x7fd4c01548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/637301294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00c70d0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 -- 172.21.15.50:0/637301294 >> 172.21.15.50:0/637301294 conn(0x7fd4c00cbba0 msgr2=0x7fd4c00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 -- 172.21.15.50:0/637301294 shutdown_connections 2023-12-24T19:51:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.859+0000 7fd4c4acd700 1 -- 172.21.15.50:0/637301294 wait complete. 2023-12-24T19:51:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 Processor -- start 2023-12-24T19:51:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 -- start start 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c006aca0 0x7fd4c0167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0168770 con 0x7fd4c0154450 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0167cc0 con 0x7fd4c00c6d00 2023-12-24T19:51:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4c4acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00ab380 con 0x7fd4c006aca0 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4bed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4be59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c006aca0 0x7fd4c0167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4bed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42838/0 (socket says 172.21.15.50:42838) 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4bed9d700 1 -- 172.21.15.50:0/3790979539 learned_addr learned my addr 172.21.15.50:0/3790979539 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.863+0000 7fd4b7fff700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 -- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c006aca0 msgr2=0x7fd4c0167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c006aca0 0x7fd4c0167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 -- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c00c6d00 msgr2=0x7fd4c00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 -- 172.21.15.50:0/3790979539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00094f0 con 0x7fd4c0154450 2023-12-24T19:51:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4bed9d700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c910 tx=0x7fd4b8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8012630 con 0x7fd4c0154450 2023-12-24T19:51:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b80127b0 con 0x7fd4c0154450 2023-12-24T19:51:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8012b70 con 0x7fd4c0154450 2023-12-24T19:51:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c00c5ff0 con 0x7fd4c0154450 2023-12-24T19:51:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c0167ed0 con 0x7fd4c0154450 2023-12-24T19:51:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.867+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c015a430 con 0x7fd4c0154450 2023-12-24T19:51:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.871+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd4b8003030 con 0x7fd4c0154450 2023-12-24T19:51:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.871+0000 7fd4b67fc700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 0x7fd4a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.871+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd4b807c740 con 0x7fd4c0154450 2023-12-24T19:51:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.871+0000 7fd4be59c700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 0x7fd4a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:31.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.871+0000 7fd4be59c700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 0x7fd4a0062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:31.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:31.879+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd4c015a430 con 0x7fd4c0154450 2023-12-24T19:51:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.107+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fd4c00c5ff0 con 0x7fd4c0154450 2023-12-24T19:51:32.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.543+0000 7fd4b67fc700 1 -- 172.21.15.50:0/3790979539 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2429) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd4c00c5ff0 con 0x7fd4c0154450 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 msgr2=0x7fd4a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 0x7fd4a0062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0017000 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 msgr2=0x7fd4c00c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c910 tx=0x7fd4b8001710 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 shutdown_connections 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4a0060550 0x7fd4a0062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4c0154450 0x7fd4c00c5ab0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c00c6d00 0x7fd4c00aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 --2- 172.21.15.50:0/3790979539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4c006aca0 0x7fd4c0167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 >> 172.21.15.50:0/3790979539 conn(0x7fd4c00cbba0 msgr2=0x7fd4c00c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 shutdown_connections 2023-12-24T19:51:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.547+0000 7fd4c4acd700 1 -- 172.21.15.50:0/3790979539 wait complete. 2023-12-24T19:51:32.570 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-12-24T19:51:32.571 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-12-24T19:51:32.571 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T19:51:32.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-12-24T19:51:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.743+0000 7feae1a0c700 1 Processor -- start 2023-12-24T19:51:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.743+0000 7feae1a0c700 1 -- start start 2023-12-24T19:51:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae1a0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feadc06d8c0 0x7feadc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae1a0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc06b640 con 0x7feadc158e00 2023-12-24T19:51:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae1a0c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0b5e10 con 0x7feadc0b41e0 2023-12-24T19:51:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae1a0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc159710 con 0x7feadc06d8c0 2023-12-24T19:51:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae0a0a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feadc158e00 0x7feadc0b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36092/0 (socket says 172.21.15.50:36092) 2023-12-24T19:51:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae0a0a700 1 -- 172.21.15.50:0/434466768 learned_addr learned my addr 172.21.15.50:0/434466768 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae120b700 1 --2- 172.21.15.50:0/434466768 >> v2:172.21.15.82:3300/0 conn(0x7feadc06d8c0 0x7feadc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543030165 0 0) 0x7feadc06b640 con 0x7feadc158e00 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc003570 con 0x7feadc158e00 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229076876 0 0) 0x7feadc0b5e10 con 0x7feadc0b41e0 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feadc06b640 con 0x7feadc0b41e0 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae120b700 1 -- 172.21.15.50:0/434466768 >> v1:172.21.15.82:6789/0 conn(0x7feadc0b41e0 legacy=0x7feadc159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae120b700 1 -- 172.21.15.50:0/434466768 >> v1:172.21.15.50:6789/0 conn(0x7feadc158e00 legacy=0x7feadc0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae120b700 1 -- 172.21.15.50:0/434466768 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc06b8e0 con 0x7feadc06d8c0 2023-12-24T19:51:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.747+0000 7feae120b700 1 --2- 172.21.15.50:0/434466768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc06d8c0 0x7feadc1591d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fead4009e60 tx=0x7fead4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4662bfcde0b2e8b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400e070 con 0x7feadc06d8c0 2023-12-24T19:51:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead400bab0 con 0x7feadc06d8c0 2023-12-24T19:51:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feadb7fe700 1 -- 172.21.15.50:0/434466768 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400be30 con 0x7feadc06d8c0 2023-12-24T19:51:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 -- 172.21.15.50:0/434466768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc06d8c0 msgr2=0x7feadc1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 --2- 172.21.15.50:0/434466768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc06d8c0 0x7feadc1591d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fead4009e60 tx=0x7fead4009780 comp rx=0 tx=0).stop 2023-12-24T19:51:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 -- 172.21.15.50:0/434466768 shutdown_connections 2023-12-24T19:51:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 --2- 172.21.15.50:0/434466768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc06d8c0 0x7feadc1591d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 -- 172.21.15.50:0/434466768 >> 172.21.15.50:0/434466768 conn(0x7feadc067b80 msgr2=0x7feadc0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 -- 172.21.15.50:0/434466768 shutdown_connections 2023-12-24T19:51:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.751+0000 7feae1a0c700 1 -- 172.21.15.50:0/434466768 wait complete. 2023-12-24T19:51:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 Processor -- start 2023-12-24T19:51:32.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 -- start start 2023-12-24T19:51:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feadc0b41e0 0x7feadc15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 0x7feadc13f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc159dc0 con 0x7feadc06d8c0 2023-12-24T19:51:32.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15f220 con 0x7feadc158e00 2023-12-24T19:51:32.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae1a0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15f500 con 0x7feadc0b41e0 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42842/0 (socket says 172.21.15.50:42842) 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 -- 172.21.15.50:0/3664603771 learned_addr learned my addr 172.21.15.50:0/3664603771 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae120b700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 0x7feadc13f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feadbfff700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feadc0b41e0 0x7feadc15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 -- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feadc0b41e0 msgr2=0x7feadc15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feadc0b41e0 0x7feadc15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 -- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 msgr2=0x7feadc13f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 0x7feadc13f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae0a0a700 1 -- 172.21.15.50:0/3664603771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4009a20 con 0x7feadc06d8c0 2023-12-24T19:51:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.755+0000 7feae120b700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 0x7feadc13f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7feae0a0a700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fead000c790 tx=0x7fead0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0005c00 con 0x7feadc06d8c0 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0005d60 con 0x7feadc06d8c0 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc15f7e0 con 0x7feadc06d8c0 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0007300 con 0x7feadc06d8c0 2023-12-24T19:51:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc13fc90 con 0x7feadc06d8c0 2023-12-24T19:51:32.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.759+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc04be40 con 0x7feadc06d8c0 2023-12-24T19:51:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.763+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fead001b3b0 con 0x7feadc06d8c0 2023-12-24T19:51:32.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.763+0000 7fead8ff9700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 0x7feac0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:32.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.763+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fead007c060 con 0x7feadc06d8c0 2023-12-24T19:51:32.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.763+0000 7feadbfff700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 0x7feac0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.767+0000 7feadbfff700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 0x7feac0062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feadc15de00 tx=0x7feac8009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.771+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fead004c3b0 con 0x7feadc06d8c0 2023-12-24T19:51:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:32.999+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7feadc06bbc0 con 0x7feadc06d8c0 2023-12-24T19:51:33.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.547+0000 7fead8ff9700 1 -- 172.21.15.50:0/3664603771 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2430) v1 ==== 177+0+0 (secure 0 0 0) 0x7fead0017020 con 0x7feadc06d8c0 2023-12-24T19:51:33.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 msgr2=0x7feac0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 0x7feac0062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feadc15de00 tx=0x7feac8009040 comp rx=0 tx=0).stop 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 msgr2=0x7feadc1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fead000c790 tx=0x7fead0007ea0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 shutdown_connections 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7feac0060550 0x7feac0062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feadc158e00 0x7feadc13f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feadc0b41e0 0x7feadc15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 --2- 172.21.15.50:0/3664603771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc06d8c0 0x7feadc1517c0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 >> 172.21.15.50:0/3664603771 conn(0x7feadc067b80 msgr2=0x7feadc157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 shutdown_connections 2023-12-24T19:51:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.551+0000 7feae1a0c700 1 -- 172.21.15.50:0/3664603771 wait complete. 2023-12-24T19:51:33.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T19:51:33.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.755+0000 7f99a48f0700 1 Processor -- start 2023-12-24T19:51:33.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.755+0000 7f99a48f0700 1 -- start start 2023-12-24T19:51:33.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f99a48f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99a00cac10 0x7f99a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:33.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f99a48f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a006ccc0 con 0x7f99a0140870 2023-12-24T19:51:33.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f99a48f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a015b120 con 0x7f99a01404a0 2023-12-24T19:51:33.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f99a48f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a015b990 con 0x7f99a00cac10 2023-12-24T19:51:33.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f999dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99a0140870 0x7f99a00ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36094/0 (socket says 172.21.15.50:36094) 2023-12-24T19:51:33.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f999dd9b700 1 -- 172.21.15.50:0/1791687756 learned_addr learned my addr 172.21.15.50:0/1791687756 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:33.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.759+0000 7f999ed9d700 1 --2- 172.21.15.50:0/1791687756 >> v2:172.21.15.50:3300/0 conn(0x7f99a00cac10 0x7f99a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188288047 0 0) 0x7f99a006ccc0 con 0x7f99a0140870 2023-12-24T19:51:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9988003570 con 0x7f99a0140870 2023-12-24T19:51:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688886012 0 0) 0x7f99a015b120 con 0x7f99a01404a0 2023-12-24T19:51:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999ed9d700 1 -- 172.21.15.50:0/1791687756 >> v1:172.21.15.82:6789/0 conn(0x7f99a01404a0 legacy=0x7f99a015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999ed9d700 1 -- 172.21.15.50:0/1791687756 >> v1:172.21.15.50:6789/0 conn(0x7f99a0140870 legacy=0x7f99a00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999ed9d700 1 -- 172.21.15.50:0/1791687756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a015b3d0 con 0x7f99a00cac10 2023-12-24T19:51:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999ed9d700 1 --2- 172.21.15.50:0/1791687756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a00cac10 0x7f99a006d150 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9998009e60 tx=0x7f9998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18cb6d9d44232ec server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800e070 con 0x7f99a00cac10 2023-12-24T19:51:33.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800bb60 con 0x7f99a00cac10 2023-12-24T19:51:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f999d59a700 1 -- 172.21.15.50:0/1791687756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998012430 con 0x7f99a00cac10 2023-12-24T19:51:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 -- 172.21.15.50:0/1791687756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a00cac10 msgr2=0x7f99a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1791687756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a00cac10 0x7f99a006d150 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9998009e60 tx=0x7f9998009780 comp rx=0 tx=0).stop 2023-12-24T19:51:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 -- 172.21.15.50:0/1791687756 shutdown_connections 2023-12-24T19:51:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1791687756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a00cac10 0x7f99a006d150 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 -- 172.21.15.50:0/1791687756 >> 172.21.15.50:0/1791687756 conn(0x7f99a0067b80 msgr2=0x7f99a00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 -- 172.21.15.50:0/1791687756 shutdown_connections 2023-12-24T19:51:33.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.763+0000 7f99a48f0700 1 -- 172.21.15.50:0/1791687756 wait complete. 2023-12-24T19:51:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 Processor -- start 2023-12-24T19:51:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 -- start start 2023-12-24T19:51:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99a01404a0 0x7f99a01701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a0140870 0x7f99a013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00af920 con 0x7f99a0140870 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00aed10 con 0x7f99a00cac10 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f99a48f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00aeff0 con 0x7f99a01404a0 2023-12-24T19:51:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f999e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f999ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a0140870 0x7f99a013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f999e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:34366/0 (socket says 172.21.15.50:34366) 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f999e59c700 1 -- 172.21.15.50:0/1217197106 learned_addr learned my addr 172.21.15.50:0/1217197106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.767+0000 7f999dd9b700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99a01404a0 0x7f99a01701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 -- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99a01404a0 msgr2=0x7f99a01701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99a01404a0 0x7f99a01701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 -- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a0140870 msgr2=0x7f99a013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a0140870 0x7f99a013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 -- 172.21.15.50:0/1217197106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009a20 con 0x7f99a00cac10 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f999e59c700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f999000c7e0 tx=0x7f9990007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900105c0 con 0x7f99a00cac10 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990010740 con 0x7f99a00cac10 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00af2d0 con 0x7f99a00cac10 2023-12-24T19:51:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990010b00 con 0x7f99a00cac10 2023-12-24T19:51:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a00c2930 con 0x7f99a00cac10 2023-12-24T19:51:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.771+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a00652e0 con 0x7f99a00cac10 2023-12-24T19:51:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.775+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f999001b3b0 con 0x7f99a00cac10 2023-12-24T19:51:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.775+0000 7f998e7fc700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 0x7f9980062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.775+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f999007c000 con 0x7f99a00cac10 2023-12-24T19:51:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.775+0000 7f999dd9b700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 0x7f9980062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.775+0000 7f999dd9b700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 0x7f9980062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f99a00ad810 tx=0x7f9994009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:33.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.783+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f999004c350 con 0x7f99a00cac10 2023-12-24T19:51:33.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.963+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f99a015b6b0 con 0x7f99a00cac10 2023-12-24T19:51:33.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.975+0000 7f998e7fc700 1 -- 172.21.15.50:0/1217197106 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9990017020 con 0x7f99a00cac10 2023-12-24T19:51:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 msgr2=0x7f9980062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 0x7f9980062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f99a00ad810 tx=0x7f9994009040 comp rx=0 tx=0).stop 2023-12-24T19:51:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 msgr2=0x7f99a00c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f999000c7e0 tx=0x7f9990007df0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 shutdown_connections 2023-12-24T19:51:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9980060550 0x7f9980062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a0140870 0x7f99a013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99a01404a0 0x7f99a01701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 --2- 172.21.15.50:0/1217197106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99a00cac10 0x7f99a00c23f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 >> 172.21.15.50:0/1217197106 conn(0x7f99a0067b80 msgr2=0x7f99a0158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 shutdown_connections 2023-12-24T19:51:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:33.979+0000 7f99a48f0700 1 -- 172.21.15.50:0/1217197106 wait complete. 2023-12-24T19:51:34.004 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:51:34.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:51:34.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:51:34.097 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:51:34.097 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T19:51:34.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:34.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.267+0000 7f5e988cd700 1 Processor -- start 2023-12-24T19:51:34.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.267+0000 7f5e988cd700 1 -- start start 2023-12-24T19:51:34.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e988cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e94168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e988cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9406ca50 con 0x7f5e940ca770 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e988cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9406b520 con 0x7f5e940ca3a0 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e988cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c6980 con 0x7f5e9406def0 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e89d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e940ca770 0x7f5e9415aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36104/0 (socket says 172.21.15.50:36104) 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e89d9b700 1 -- 172.21.15.50:0/1344961791 learned_addr learned my addr 172.21.15.50:0/1344961791 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e92d9d700 1 --2- 172.21.15.50:0/1344961791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e94168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218959287 0 0) 0x7f5e9406ca50 con 0x7f5e940ca770 2023-12-24T19:51:34.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e80003570 con 0x7f5e940ca770 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220720557 0 0) 0x7f5e9406b520 con 0x7f5e940ca3a0 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e9406ca50 con 0x7f5e940ca3a0 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319700182 0 0) 0x7f5e80003570 con 0x7f5e940ca770 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1344961791 >> v1:172.21.15.82:6789/0 conn(0x7f5e940ca3a0 legacy=0x7f5e9406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1344961791 >> v1:172.21.15.50:6789/0 conn(0x7f5e940ca770 legacy=0x7f5e9415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1344961791 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9406b7f0 con 0x7f5e9406def0 2023-12-24T19:51:34.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.271+0000 7f5e92d9d700 1 --2- 172.21.15.50:0/1344961791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e94168380 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009e90 tx=0x7f5e8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b8e42b063414f17 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00e070 con 0x7f5e9406def0 2023-12-24T19:51:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00b870 con 0x7f5e9406def0 2023-12-24T19:51:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e91d9b700 1 -- 172.21.15.50:0/1344961791 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c001470 con 0x7f5e9406def0 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 -- 172.21.15.50:0/1344961791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 msgr2=0x7f5e94168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1344961791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e94168380 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009e90 tx=0x7f5e8c009780 comp rx=0 tx=0).stop 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 -- 172.21.15.50:0/1344961791 shutdown_connections 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1344961791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e94168380 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 -- 172.21.15.50:0/1344961791 >> 172.21.15.50:0/1344961791 conn(0x7f5e940cbba0 msgr2=0x7f5e940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 -- 172.21.15.50:0/1344961791 shutdown_connections 2023-12-24T19:51:34.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.275+0000 7f5e988cd700 1 -- 172.21.15.50:0/1344961791 wait complete. 2023-12-24T19:51:34.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 Processor -- start 2023-12-24T19:51:34.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 -- start start 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e940b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 0x7f5e9414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940b1260 con 0x7f5e940ca770 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940b1540 con 0x7f5e940ca3a0 2023-12-24T19:51:34.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e988cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94170c60 con 0x7f5e9406def0 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42872/0 (socket says 172.21.15.50:42872) 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1825553151 learned_addr learned my addr 172.21.15.50:0/1825553151 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e9259c700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e940b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e89d9b700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 0x7f5e9414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 msgr2=0x7f5e940b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e940b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 msgr2=0x7f5e9414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 0x7f5e9414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 -- 172.21.15.50:0/1825553151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c009a20 con 0x7f5e940ca770 2023-12-24T19:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e89d9b700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 0x7f5e9414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.279+0000 7f5e92d9d700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c003000 tx=0x7f5e8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c007040 con 0x7f5e940ca770 2023-12-24T19:51:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c012c20 con 0x7f5e940ca770 2023-12-24T19:51:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c026460 con 0x7f5e940ca770 2023-12-24T19:51:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e94170f40 con 0x7f5e940ca770 2023-12-24T19:51:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940b1820 con 0x7f5e940ca770 2023-12-24T19:51:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e94171160 con 0x7f5e940ca770 2023-12-24T19:51:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.283+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5e8c01d440 con 0x7f5e940ca770 2023-12-24T19:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.287+0000 7f5e8affd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 0x7f5e74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.287+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5e8c07ec10 con 0x7f5e940ca770 2023-12-24T19:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.287+0000 7f5e9259c700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 0x7f5e74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.287+0000 7f5e9259c700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 0x7f5e74062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e84007fd0 tx=0x7f5e84007d50 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.291+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e8c04ef60 con 0x7f5e940ca770 2023-12-24T19:51:34.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.499+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e940652e0 con 0x7f5e940ca770 2023-12-24T19:51:34.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.503+0000 7f5e8affd700 1 -- 172.21.15.50:0/1825553151 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f5e8c016de0 con 0x7f5e940ca770 2023-12-24T19:51:34.504 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:34.505 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/2853115368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2853115368},{"type":"v1","addr":"172.21.15.82:6833","nonce":2853115368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/627079947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":627079947},{"type":"v1","addr":"172.21.15.50:6833","nonce":627079947}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4196159559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4196159559},{"type":"v1","addr":"172.21.15.50:6835","nonce":4196159559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8551,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3706828036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3706828036},{"type":"v1","addr":"172.21.15.82:6835","nonce":3706828036}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 msgr2=0x7f5e74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 0x7f5e74062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e84007fd0 tx=0x7f5e84007d50 comp rx=0 tx=0).stop 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 msgr2=0x7f5e94171460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c003000 tx=0x7f5e8c017000 comp rx=0 tx=0).stop 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 shutdown_connections 2023-12-24T19:51:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5e74060550 0x7f5e74062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e940ca770 0x7f5e94171460 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e940ca3a0 0x7f5e9414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 --2- 172.21.15.50:0/1825553151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e9406def0 0x7f5e940b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 >> 172.21.15.50:0/1825553151 conn(0x7f5e940cbba0 msgr2=0x7f5e941599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 shutdown_connections 2023-12-24T19:51:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.507+0000 7f5e988cd700 1 -- 172.21.15.50:0/1825553151 wait complete. 2023-12-24T19:51:34.512 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 72 2023-12-24T19:51:34.530 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:51:34.530 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T19:51:34.530 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T19:51:34.530 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:51:34.530 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:51:34.530 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T19:51:34.531 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T19:51:34.531 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:51:34.531 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:51:34.531 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T19:51:34.531 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T19:51:34.531 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:51:34.531 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:51:34.531 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T19:51:34.532 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T19:51:34.532 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:51:34.555 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T19:51:34.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:51:34.556 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T19:51:34.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:51:34.560 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T19:51:34.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:51:34.561 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T19:51:34.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:51:34.608 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:51:34.608 DEBUG:teuthology.parallel:result is None 2023-12-24T19:51:34.613 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:51:34.613 DEBUG:teuthology.parallel:result is None 2023-12-24T19:51:34.614 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:51:34.614 DEBUG:teuthology.parallel:result is None 2023-12-24T19:51:34.616 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:51:34.616 DEBUG:teuthology.parallel:result is None 2023-12-24T19:51:34.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T19:51:34.722 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T19:51:34.723 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T19:51:34.723 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T19:51:34.730 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T19:51:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.779+0000 7f5410ee3700 1 Processor -- start 2023-12-24T19:51:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.779+0000 7f5410ee3700 1 -- start start 2023-12-24T19:51:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f5410ee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 0x7f540c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f5410ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f5410ee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c15a6b0 con 0x7f540c155d80 2023-12-24T19:51:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f5410ee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c15a3d0 con 0x7f540c1559b0 2023-12-24T19:51:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f5410ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0af9c0 con 0x7f540c0695d0 2023-12-24T19:51:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 0x7f540c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 0x7f540c0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:34432/0 (socket says 172.21.15.50:34432) 2023-12-24T19:51:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540b7fe700 1 -- 172.21.15.50:0/1378453597 learned_addr learned my addr 172.21.15.50:0/1378453597 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:47124/0 (socket says 172.21.15.50:47124) 2023-12-24T19:51:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540affd700 1 -- 172.21.15.50:0/1378453597 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830004566 0 0) 0x7f540c15a6b0 con 0x7f540c155d80 2023-12-24T19:51:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540affd700 1 -- 172.21.15.50:0/1378453597 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003570 con 0x7f540c155d80 2023-12-24T19:51:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 -- 172.21.15.50:0/1378453597 >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 msgr2=0x7f540c0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 --2- 172.21.15.50:0/1378453597 >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 0x7f540c0b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 -- 172.21.15.50:0/1378453597 >> v1:172.21.15.82:6789/0 conn(0x7f540c155d80 legacy=0x7f540c068ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 -- 172.21.15.50:0/1378453597 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0afca0 con 0x7f540c0695d0 2023-12-24T19:51:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540bfff700 1 --2- 172.21.15.50:0/1378453597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e60 tx=0x7f5404009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a2864463b3553c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540affd700 1 -- 172.21.15.50:0/1378453597 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400e070 con 0x7f540c0695d0 2023-12-24T19:51:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540affd700 1 -- 172.21.15.50:0/1378453597 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bab0 con 0x7f540c0695d0 2023-12-24T19:51:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.783+0000 7f540affd700 1 -- 172.21.15.50:0/1378453597 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400be70 con 0x7f540c0695d0 2023-12-24T19:51:34.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 -- 172.21.15.50:0/1378453597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 msgr2=0x7f540c159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 --2- 172.21.15.50:0/1378453597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e60 tx=0x7f5404009780 comp rx=0 tx=0).stop 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 -- 172.21.15.50:0/1378453597 shutdown_connections 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 --2- 172.21.15.50:0/1378453597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c0695d0 0x7f540c159770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 --2- 172.21.15.50:0/1378453597 >> v2:172.21.15.82:3300/0 conn(0x7f540c1559b0 0x7f540c0b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 -- 172.21.15.50:0/1378453597 >> 172.21.15.50:0/1378453597 conn(0x7f540c0ccb60 msgr2=0x7f540c0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 -- 172.21.15.50:0/1378453597 shutdown_connections 2023-12-24T19:51:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.787+0000 7f5410ee3700 1 -- 172.21.15.50:0/1378453597 wait complete. 2023-12-24T19:51:34.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 Processor -- start 2023-12-24T19:51:34.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 -- start start 2023-12-24T19:51:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 0x7f540c1694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540c1559b0 0x7f540c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 0x7f540c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1699f0 con 0x7f540c0695d0 2023-12-24T19:51:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15cc80 con 0x7f540c1559b0 2023-12-24T19:51:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f5410ee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c06d670 con 0x7f540c155d80 2023-12-24T19:51:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 0x7f540c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 0x7f540c1694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42892/0 (socket says 172.21.15.50:42892) 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.791+0000 7f540b7fe700 1 -- 172.21.15.50:0/959678794 learned_addr learned my addr 172.21.15.50:0/959678794 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 0x7f540c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f5403fff700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540c1559b0 0x7f540c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 -- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540c1559b0 msgr2=0x7f540c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540c1559b0 0x7f540c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 -- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 msgr2=0x7f540c1694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 0x7f540c1694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 -- 172.21.15.50:0/959678794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009a20 con 0x7f540c155d80 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f540bfff700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 0x7f540c06d130 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f540c06b150 tx=0x7f5404019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012dd0 con 0x7f540c155d80 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404027470 con 0x7f540c155d80 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404027830 con 0x7f540c155d80 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c15cf40 con 0x7f540c155d80 2023-12-24T19:51:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c15d500 con 0x7f540c155d80 2023-12-24T19:51:34.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.795+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c04be40 con 0x7f540c155d80 2023-12-24T19:51:34.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.799+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5404024070 con 0x7f540c155d80 2023-12-24T19:51:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.799+0000 7f54037fe700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 0x7f53ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.799+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f540407ef40 con 0x7f540c155d80 2023-12-24T19:51:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.799+0000 7f540b7fe700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 0x7f53ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:34.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.803+0000 7f540b7fe700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 0x7f53ec062a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00bf70 tx=0x7f53fc00b4f0 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:34.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.807+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f540404f290 con 0x7f540c155d80 2023-12-24T19:51:34.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:34.995+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f540c0cc590 con 0x7f540c155d80 2023-12-24T19:51:36.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.435+0000 7f54037fe700 1 -- 172.21.15.50:0/959678794 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v155) v1 ==== 97+0+0 (secure 0 0 0) 0x7f540402c080 con 0x7f540c155d80 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 msgr2=0x7f53ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 0x7f53ec062a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00bf70 tx=0x7f53fc00b4f0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 msgr2=0x7f540c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 0x7f540c06d130 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f540c06b150 tx=0x7f5404019000 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 shutdown_connections 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f53ec060550 0x7f53ec062a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f540c155d80 0x7f540c06d130 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540c1559b0 0x7f540c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 --2- 172.21.15.50:0/959678794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540c0695d0 0x7f540c1694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 >> 172.21.15.50:0/959678794 conn(0x7f540c0ccb60 msgr2=0x7f540c0ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 shutdown_connections 2023-12-24T19:51:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.439+0000 7f5410ee3700 1 -- 172.21.15.50:0/959678794 wait complete. 2023-12-24T19:51:36.443 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T19:51:36.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T19:51:36.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.631+0000 7f73f11cc700 1 Processor -- start 2023-12-24T19:51:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.631+0000 7f73f11cc700 1 -- start start 2023-12-24T19:51:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f11cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73ec06b6c0 0x7f73ec1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f11cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73ec06c0c0 0x7f73ec0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f11cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec0a9c80 con 0x7f73ec158cd0 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f11cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec06c4f0 con 0x7f73ec06b6c0 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f11cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0a8e10 con 0x7f73ec06c0c0 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73ebfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f73ec158cd0 0x7f73ec06afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:52528/0 (socket says 172.21.15.50:52528) 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73ebfff700 1 -- 172.21.15.50:0/1067682534 learned_addr learned my addr 172.21.15.50:0/1067682534 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/1067682534 >> v2:172.21.15.50:3300/0 conn(0x7f73ec06b6c0 0x7f73ec1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73f09cb700 1 --2- 172.21.15.50:0/1067682534 >> v2:172.21.15.82:3300/0 conn(0x7f73ec06c0c0 0x7f73ec0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73eaffd700 1 -- 172.21.15.50:0/1067682534 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091275970 0 0) 0x7f73ec0a9c80 con 0x7f73ec158cd0 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.635+0000 7f73eaffd700 1 -- 172.21.15.50:0/1067682534 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d4003570 con 0x7f73ec158cd0 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eb7fe700 1 -- 172.21.15.50:0/1067682534 >> v2:172.21.15.82:3300/0 conn(0x7f73ec06c0c0 msgr2=0x7f73ec0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/1067682534 >> v2:172.21.15.82:3300/0 conn(0x7f73ec06c0c0 0x7f73ec0a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eb7fe700 1 -- 172.21.15.50:0/1067682534 >> v1:172.21.15.82:6789/0 conn(0x7f73ec158cd0 legacy=0x7f73ec06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eb7fe700 1 -- 172.21.15.50:0/1067682534 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0a9070 con 0x7f73ec06b6c0 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/1067682534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1590a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0ad8e0 tx=0x7f73e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eee1c2ac94093ff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eaffd700 1 -- 172.21.15.50:0/1067682534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0011630 con 0x7f73ec06b6c0 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eaffd700 1 -- 172.21.15.50:0/1067682534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00117b0 con 0x7f73ec06b6c0 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73eaffd700 1 -- 172.21.15.50:0/1067682534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0011b70 con 0x7f73ec06b6c0 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 -- 172.21.15.50:0/1067682534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06b6c0 msgr2=0x7f73ec1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 --2- 172.21.15.50:0/1067682534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1590a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0ad8e0 tx=0x7f73e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 -- 172.21.15.50:0/1067682534 shutdown_connections 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 --2- 172.21.15.50:0/1067682534 >> v2:172.21.15.82:3300/0 conn(0x7f73ec06c0c0 0x7f73ec0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 --2- 172.21.15.50:0/1067682534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1590a0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 -- 172.21.15.50:0/1067682534 >> 172.21.15.50:0/1067682534 conn(0x7f73ec067b80 msgr2=0x7f73ec0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 -- 172.21.15.50:0/1067682534 shutdown_connections 2023-12-24T19:51:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.639+0000 7f73f11cc700 1 -- 172.21.15.50:0/1067682534 wait complete. 2023-12-24T19:51:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.643+0000 7f73f11cc700 1 Processor -- start 2023-12-24T19:51:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.643+0000 7f73f11cc700 1 -- start start 2023-12-24T19:51:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec158cd0 0x7f73ec0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec16cc10 con 0x7f73ec06c0c0 2023-12-24T19:51:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec1469f0 con 0x7f73ec06b6c0 2023-12-24T19:51:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b1650 con 0x7f73ec158cd0 2023-12-24T19:51:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42910/0 (socket says 172.21.15.50:42910) 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 -- 172.21.15.50:0/2897973783 learned_addr learned my addr 172.21.15.50:0/2897973783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73ebfff700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f09cb700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec158cd0 0x7f73ec0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 -- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec158cd0 msgr2=0x7f73ec0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec158cd0 0x7f73ec0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 -- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec06b6c0 msgr2=0x7f73ec1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 -- 172.21.15.50:0/2897973783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0009420 con 0x7f73ec06c0c0 2023-12-24T19:51:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73eb7fe700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f73e0013000 tx=0x7f73e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e001f070 con 0x7f73ec06c0c0 2023-12-24T19:51:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0000bc0 con 0x7f73ec06c0c0 2023-12-24T19:51:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec0b1370 con 0x7f73ec06c0c0 2023-12-24T19:51:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0011b70 con 0x7f73ec06c0c0 2023-12-24T19:51:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.647+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec16c8a0 con 0x7f73ec06c0c0 2023-12-24T19:51:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.651+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec04be40 con 0x7f73ec06c0c0 2023-12-24T19:51:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.651+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f73e0023070 con 0x7f73ec06c0c0 2023-12-24T19:51:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.651+0000 7f73d3fff700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 0x7f73d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.651+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f73e007da10 con 0x7f73ec06c0c0 2023-12-24T19:51:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.655+0000 7f73ebfff700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 0x7f73d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.655+0000 7f73ebfff700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 0x7f73d8062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007fd0 tx=0x7f73dc009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.659+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f73e004dfe0 con 0x7f73ec06c0c0 2023-12-24T19:51:36.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.895+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f73ec06a840 con 0x7f73ec06c0c0 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.895+0000 7f73d3fff700 1 -- 172.21.15.50:0/2897973783 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f73e002a090 con 0x7f73ec06c0c0 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T19:51:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:51:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T19:51:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:51:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T19:51:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T19:51:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T19:51:36.910 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 msgr2=0x7f73d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 0x7f73d8062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007fd0 tx=0x7f73dc009040 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 msgr2=0x7f73ec0b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f73e0013000 tx=0x7f73e0017000 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 shutdown_connections 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f73d8060550 0x7f73d8062a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec158cd0 0x7f73ec0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec06c0c0 0x7f73ec0b0920 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 --2- 172.21.15.50:0/2897973783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec06b6c0 0x7f73ec1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 >> 172.21.15.50:0/2897973783 conn(0x7f73ec067b80 msgr2=0x7f73ec157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:36.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 shutdown_connections 2023-12-24T19:51:36.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:36.899+0000 7f73f11cc700 1 -- 172.21.15.50:0/2897973783 wait complete. 2023-12-24T19:51:36.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.087+0000 7f83edf45700 1 Processor -- start 2023-12-24T19:51:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.087+0000 7f83edf45700 1 -- start start 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83edf45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f83e806b540 0x7f83e80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83edf45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e806ba80 con 0x7f83e8159a20 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83edf45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e806bd60 con 0x7f83e80ce750 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83edf45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e815a5d0 con 0x7f83e806b540 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83e8159a20 0x7f83e8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36124/0 (socket says 172.21.15.50:36124) 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e7fff700 1 -- 172.21.15.50:0/688606753 learned_addr learned my addr 172.21.15.50:0/688606753 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e6ffd700 1 --2- 172.21.15.50:0/688606753 >> v2:172.21.15.82:3300/0 conn(0x7f83e806b540 0x7f83e80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405944480 0 0) 0x7f83e806ba80 con 0x7f83e8159a20 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003570 con 0x7f83e8159a20 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665488421 0 0) 0x7f83e806bd60 con 0x7f83e80ce750 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e806ba80 con 0x7f83e80ce750 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e6ffd700 1 -- 172.21.15.50:0/688606753 >> v1:172.21.15.82:6789/0 conn(0x7f83e80ce750 legacy=0x7f83e806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e6ffd700 1 -- 172.21.15.50:0/688606753 >> v1:172.21.15.50:6789/0 conn(0x7f83e8159a20 legacy=0x7f83e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091855421 0 0) 0x7f83d0003570 con 0x7f83e8159a20 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e6ffd700 1 -- 172.21.15.50:0/688606753 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e806c040 con 0x7f83e806b540 2023-12-24T19:51:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.091+0000 7f83e6ffd700 1 --2- 172.21.15.50:0/688606753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e806b540 0x7f83e80ceb20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0098e0 tx=0x7f83dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296297e66a3b89e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00017f0 con 0x7f83e806b540 2023-12-24T19:51:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc011420 con 0x7f83e806b540 2023-12-24T19:51:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83e67fc700 1 -- 172.21.15.50:0/688606753 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0117c0 con 0x7f83e806b540 2023-12-24T19:51:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 -- 172.21.15.50:0/688606753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e806b540 msgr2=0x7f83e80ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 --2- 172.21.15.50:0/688606753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e806b540 0x7f83e80ceb20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0098e0 tx=0x7f83dc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 -- 172.21.15.50:0/688606753 shutdown_connections 2023-12-24T19:51:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 --2- 172.21.15.50:0/688606753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e806b540 0x7f83e80ceb20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 -- 172.21.15.50:0/688606753 >> 172.21.15.50:0/688606753 conn(0x7f83e80cffb0 msgr2=0x7f83e80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 -- 172.21.15.50:0/688606753 shutdown_connections 2023-12-24T19:51:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.095+0000 7f83edf45700 1 -- 172.21.15.50:0/688606753 wait complete. 2023-12-24T19:51:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 Processor -- start 2023-12-24T19:51:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 -- start start 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 0x7f83e81576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 0x7f83e81693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8159a20 0x7f83e80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8154b80 con 0x7f83e80ce750 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8154e60 con 0x7f83e8159a20 2023-12-24T19:51:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83edf45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8155140 con 0x7f83e806b540 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83e6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 0x7f83e81693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83e77fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 0x7f83e81576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83e6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 0x7f83e81693e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42914/0 (socket says 172.21.15.50:42914) 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83e6ffd700 1 -- 172.21.15.50:0/1526077788 learned_addr learned my addr 172.21.15.50:0/1526077788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.099+0000 7f83e7fff700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8159a20 0x7f83e80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 -- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8159a20 msgr2=0x7f83e80b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8159a20 0x7f83e80b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 -- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 msgr2=0x7f83e81693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 0x7f83e81693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 -- 172.21.15.50:0/1526077788 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009420 con 0x7f83e806b540 2023-12-24T19:51:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83e77fe700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 0x7f83e81576b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c560 tx=0x7f83d8007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8011590 con 0x7f83e806b540 2023-12-24T19:51:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d80116f0 con 0x7f83e806b540 2023-12-24T19:51:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e8155420 con 0x7f83e806b540 2023-12-24T19:51:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8011ab0 con 0x7f83e806b540 2023-12-24T19:51:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e81570b0 con 0x7f83e806b540 2023-12-24T19:51:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.103+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e8155920 con 0x7f83e806b540 2023-12-24T19:51:37.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.107+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f83d801c460 con 0x7f83e806b540 2023-12-24T19:51:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.107+0000 7f83cf7fe700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 0x7f83d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.107+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f83d807c440 con 0x7f83e806b540 2023-12-24T19:51:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.107+0000 7f83e6ffd700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 0x7f83d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.111+0000 7f83e6ffd700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 0x7f83d4062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0c90 tx=0x7f83dc016000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.119+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f83d804ca10 con 0x7f83e806b540 2023-12-24T19:51:37.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.299+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e80652e0 con 0x7f83e806b540 2023-12-24T19:51:37.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.299+0000 7f83cf7fe700 1 -- 172.21.15.50:0/1526077788 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+12918 (secure 0 0 0) 0x7f83d8050030 con 0x7f83e806b540 2023-12-24T19:51:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:37.303 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":155,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:36.421432+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:37.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 msgr2=0x7f83d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 0x7f83d4062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83e80d0c90 tx=0x7f83dc016000 comp rx=0 tx=0).stop 2023-12-24T19:51:37.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 msgr2=0x7f83e81576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 0x7f83e81576b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c560 tx=0x7f83d8007d50 comp rx=0 tx=0).stop 2023-12-24T19:51:37.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 shutdown_connections 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f83d4060550 0x7f83d4062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8159a20 0x7f83e80b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e80ce750 0x7f83e81693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 --2- 172.21.15.50:0/1526077788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e806b540 0x7f83e81576b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 >> 172.21.15.50:0/1526077788 conn(0x7f83e80cffb0 msgr2=0x7f83e80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 shutdown_connections 2023-12-24T19:51:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.303+0000 7f83edf45700 1 -- 172.21.15.50:0/1526077788 wait complete. 2023-12-24T19:51:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:51:37.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:51:37.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.499+0000 7f5bbda8e700 1 Processor -- start 2023-12-24T19:51:37.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.499+0000 7f5bbda8e700 1 -- start start 2023-12-24T19:51:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbda8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbda8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bb806cd40 0x7f5bb806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbda8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb806a580 con 0x7f5bb8158c40 2023-12-24T19:51:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbda8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80cd110 con 0x7f5bb806cd40 2023-12-24T19:51:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbda8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb806d700 con 0x7f5bb80cc780 2023-12-24T19:51:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bb806cd40 0x7f5bb806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bb806cd40 0x7f5bb806d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42926/0 (socket says 172.21.15.50:42926) 2023-12-24T19:51:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 -- 172.21.15.50:0/3039345950 learned_addr learned my addr 172.21.15.50:0/3039345950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bb7fff700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 -- 172.21.15.50:0/3039345950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 msgr2=0x7f5bb80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 -- 172.21.15.50:0/3039345950 >> v1:172.21.15.82:6789/0 conn(0x7f5bb8158c40 legacy=0x7f5bb80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 -- 172.21.15.50:0/3039345950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb806a7d0 con 0x7f5bb806cd40 2023-12-24T19:51:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.503+0000 7f5bbd28d700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb806cd40 0x7f5bb806d1c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009f20 tx=0x7f5bb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939e32541f7deb3e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bb77fe700 1 -- 172.21.15.50:0/3039345950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000e070 con 0x7f5bb806cd40 2023-12-24T19:51:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bb77fe700 1 -- 172.21.15.50:0/3039345950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000b9d0 con 0x7f5bb806cd40 2023-12-24T19:51:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bb77fe700 1 -- 172.21.15.50:0/3039345950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00092e0 con 0x7f5bb806cd40 2023-12-24T19:51:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 -- 172.21.15.50:0/3039345950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb806cd40 msgr2=0x7f5bb806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb806cd40 0x7f5bb806d1c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009f20 tx=0x7f5bb0009840 comp rx=0 tx=0).stop 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 -- 172.21.15.50:0/3039345950 shutdown_connections 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb806cd40 0x7f5bb806d1c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/3039345950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 -- 172.21.15.50:0/3039345950 >> 172.21.15.50:0/3039345950 conn(0x7f5bb80d0800 msgr2=0x7f5bb80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 -- 172.21.15.50:0/3039345950 shutdown_connections 2023-12-24T19:51:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.507+0000 7f5bbda8e700 1 -- 172.21.15.50:0/3039345950 wait complete. 2023-12-24T19:51:37.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 Processor -- start 2023-12-24T19:51:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 -- start start 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 0x7f5bb8169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb816a310 con 0x7f5bb8158c40 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8152f30 con 0x7f5bb806cd40 2023-12-24T19:51:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbda8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80cb440 con 0x7f5bb80cc780 2023-12-24T19:51:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbd28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbd28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42934/0 (socket says 172.21.15.50:42934) 2023-12-24T19:51:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbd28d700 1 -- 172.21.15.50:0/2133938682 learned_addr learned my addr 172.21.15.50:0/2133938682 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bbca8c700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 0x7f5bb8169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.511+0000 7f5bb7fff700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 -- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 msgr2=0x7f5bb80c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 -- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 msgr2=0x7f5bb8169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 0x7f5bb8169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 -- 172.21.15.50:0/2133938682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0009ae0 con 0x7f5bb8158c40 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbca8c700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 0x7f5bb8169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bb7fff700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:51:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbd28d700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b610 tx=0x7f5bb0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0008c30 con 0x7f5bb8158c40 2023-12-24T19:51:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0008db0 con 0x7f5bb8158c40 2023-12-24T19:51:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80ca830 con 0x7f5bb8158c40 2023-12-24T19:51:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb001c660 con 0x7f5bb8158c40 2023-12-24T19:51:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80cadf0 con 0x7f5bb8158c40 2023-12-24T19:51:37.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb80cb5f0 con 0x7f5bb8158c40 2023-12-24T19:51:37.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.515+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f5bb0003040 con 0x7f5bb8158c40 2023-12-24T19:51:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.519+0000 7f5bb4ff9700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 0x7f5b9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.519+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f5bb007e0d0 con 0x7f5bb8158c40 2023-12-24T19:51:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.519+0000 7f5bbca8c700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 0x7f5b9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.519+0000 7f5bbca8c700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 0x7f5b9c062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5bb816c900 tx=0x7f5bac009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.523+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5bb80cb5f0 con 0x7f5bb8158c40 2023-12-24T19:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.699+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bb80cb5b0 con 0x7f5bb8158c40 2023-12-24T19:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.699+0000 7f5bb4ff9700 1 -- 172.21.15.50:0/2133938682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bb004e740 con 0x7f5bb8158c40 2023-12-24T19:51:37.701 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T19:51:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 msgr2=0x7f5b9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 0x7f5b9c062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5bb816c900 tx=0x7f5bac009040 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 msgr2=0x7f5bb81453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b610 tx=0x7f5bb0018000 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 shutdown_connections 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f5b9c060550 0x7f5b9c062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb8158c40 0x7f5bb81453f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bb80cc780 0x7f5bb80c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 --2- 172.21.15.50:0/2133938682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bb806cd40 0x7f5bb8169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 >> 172.21.15.50:0/2133938682 conn(0x7f5bb80d0800 msgr2=0x7f5bb8153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 shutdown_connections 2023-12-24T19:51:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.703+0000 7f5bbda8e700 1 -- 172.21.15.50:0/2133938682 wait complete. 2023-12-24T19:51:37.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:51:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.891+0000 7f6bef24c700 1 Processor -- start 2023-12-24T19:51:37.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.891+0000 7f6bef24c700 1 -- start start 2023-12-24T19:51:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6bef24c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be80ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6bef24c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be806e110 con 0x7f6be806afa0 2023-12-24T19:51:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6bef24c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be806bb40 con 0x7f6be8155e20 2023-12-24T19:51:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6bef24c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be806be20 con 0x7f6be80ad220 2023-12-24T19:51:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6beda49700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6be806afa0 0x7f6be8155710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36126/0 (socket says 172.21.15.50:36126) 2023-12-24T19:51:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6beda49700 1 -- 172.21.15.50:0/1463487506 learned_addr learned my addr 172.21.15.50:0/1463487506 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.895+0000 7f6bee24a700 1 --2- 172.21.15.50:0/1463487506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be80ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954694562 0 0) 0x7f6be806e110 con 0x7f6be806afa0 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd4003570 con 0x7f6be806afa0 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214136470 0 0) 0x7f6be806bb40 con 0x7f6be8155e20 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bee24a700 1 -- 172.21.15.50:0/1463487506 >> v1:172.21.15.82:6789/0 conn(0x7f6be8155e20 legacy=0x7f6be80aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bee24a700 1 -- 172.21.15.50:0/1463487506 >> v1:172.21.15.50:6789/0 conn(0x7f6be806afa0 legacy=0x7f6be8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bee24a700 1 -- 172.21.15.50:0/1463487506 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80af740 con 0x7f6be80ad220 2023-12-24T19:51:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bee24a700 1 --2- 172.21.15.50:0/1463487506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be80ad5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009910 tx=0x7f6be40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6196d51c64a95f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400b680 con 0x7f6be80ad220 2023-12-24T19:51:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be400b7e0 con 0x7f6be80ad220 2023-12-24T19:51:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bed248700 1 -- 172.21.15.50:0/1463487506 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400bba0 con 0x7f6be80ad220 2023-12-24T19:51:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 -- 172.21.15.50:0/1463487506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 msgr2=0x7f6be80ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 --2- 172.21.15.50:0/1463487506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be80ad5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009910 tx=0x7f6be40091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 -- 172.21.15.50:0/1463487506 shutdown_connections 2023-12-24T19:51:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 --2- 172.21.15.50:0/1463487506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be80ad5f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 -- 172.21.15.50:0/1463487506 >> 172.21.15.50:0/1463487506 conn(0x7f6be8067b80 msgr2=0x7f6be80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 -- 172.21.15.50:0/1463487506 shutdown_connections 2023-12-24T19:51:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.899+0000 7f6bef24c700 1 -- 172.21.15.50:0/1463487506 wait complete. 2023-12-24T19:51:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 Processor -- start 2023-12-24T19:51:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 -- start start 2023-12-24T19:51:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be806afa0 0x7f6be8147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815e8d0 con 0x7f6be8155e20 2023-12-24T19:51:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81691c0 con 0x7f6be806afa0 2023-12-24T19:51:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bef24c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815dd50 con 0x7f6be80ad220 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42938/0 (socket says 172.21.15.50:42938) 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 -- 172.21.15.50:0/3206860856 learned_addr learned my addr 172.21.15.50:0/3206860856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beda49700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6bee24a700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be806afa0 0x7f6be8147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 -- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 msgr2=0x7f6be815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 -- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be806afa0 msgr2=0x7f6be8147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.903+0000 7f6beea4b700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be806afa0 0x7f6be8147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6beea4b700 1 -- 172.21.15.50:0/3206860856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009420 con 0x7f6be8155e20 2023-12-24T19:51:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6beea4b700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6be0001560 tx=0x7f6be0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0004160 con 0x7f6be8155e20 2023-12-24T19:51:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000a7e0 con 0x7f6be8155e20 2023-12-24T19:51:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000aba0 con 0x7f6be8155e20 2023-12-24T19:51:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be815e030 con 0x7f6be8155e20 2023-12-24T19:51:37.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be815e5f0 con 0x7f6be8155e20 2023-12-24T19:51:37.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.907+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be804be40 con 0x7f6be8155e20 2023-12-24T19:51:37.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.911+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6be0012420 con 0x7f6be8155e20 2023-12-24T19:51:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.911+0000 7f6bde7fc700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 0x7f6bcc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.911+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f6be007c630 con 0x7f6be8155e20 2023-12-24T19:51:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.911+0000 7f6bee24a700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 0x7f6bcc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.911+0000 7f6bee24a700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 0x7f6bcc062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6be40093f0 tx=0x7f6be4017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:37.915+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6be004cc00 con 0x7f6be8155e20 2023-12-24T19:51:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.091+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6be80aea10 con 0x7f6be8155e20 2023-12-24T19:51:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.091+0000 7f6bde7fc700 1 -- 172.21.15.50:0/3206860856 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v155) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6be0050220 con 0x7f6be8155e20 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:38.093 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 msgr2=0x7f6bcc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 0x7f6bcc062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6be40093f0 tx=0x7f6be4017000 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 msgr2=0x7f6be80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6be0001560 tx=0x7f6be0001770 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 shutdown_connections 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6bcc060550 0x7f6bcc062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8155e20 0x7f6be80caef0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6be80ad220 0x7f6be815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 --2- 172.21.15.50:0/3206860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be806afa0 0x7f6be8147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 >> 172.21.15.50:0/3206860856 conn(0x7f6be8067b80 msgr2=0x7f6be80afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:38.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 shutdown_connections 2023-12-24T19:51:38.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.095+0000 7f6bef24c700 1 -- 172.21.15.50:0/3206860856 wait complete. 2023-12-24T19:51:38.116 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:51:38.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:51:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.279+0000 7f2da12ae700 1 Processor -- start 2023-12-24T19:51:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.279+0000 7f2da12ae700 1 -- start start 2023-12-24T19:51:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2da12ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d9c06cf30 0x7f2d9c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2da12ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c06b000 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2da12ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c06d570 con 0x7f2d9c0cbf50 2023-12-24T19:51:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2da12ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c06bba0 con 0x7f2d9c06cf30 2023-12-24T19:51:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2d9affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d9c0cbb80 0x7f2d9c06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36142/0 (socket says 172.21.15.50:36142) 2023-12-24T19:51:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2d9affd700 1 -- 172.21.15.50:0/1514238450 learned_addr learned my addr 172.21.15.50:0/1514238450 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2d9b7fe700 1 --2- 172.21.15.50:0/1514238450 >> v2:172.21.15.82:3300/0 conn(0x7f2d9c06cf30 0x7f2d9c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586685262 0 0) 0x7f2d9c06b000 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.283+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d84003570 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d9b7fe700 1 -- 172.21.15.50:0/1514238450 >> v1:172.21.15.82:6789/0 conn(0x7f2d9c0cbf50 legacy=0x7f2d9c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882292187 0 0) 0x7f2d9c06d570 con 0x7f2d9c0cbf50 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d9b7fe700 1 -- 172.21.15.50:0/1514238450 >> v1:172.21.15.50:6789/0 conn(0x7f2d9c0cbb80 legacy=0x7f2d9c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d9b7fe700 1 -- 172.21.15.50:0/1514238450 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c06a6d0 con 0x7f2d9c06cf30 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d9b7fe700 1 --2- 172.21.15.50:0/1514238450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c06cf30 0x7f2d9c15d430 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009e60 tx=0x7f2d94009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=801db5983c8594e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400e070 con 0x7f2d9c06cf30 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400bb60 con 0x7f2d9c06cf30 2023-12-24T19:51:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2d99ffb700 1 -- 172.21.15.50:0/1514238450 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94012430 con 0x7f2d9c06cf30 2023-12-24T19:51:38.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 -- 172.21.15.50:0/1514238450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c06cf30 msgr2=0x7f2d9c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 --2- 172.21.15.50:0/1514238450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c06cf30 0x7f2d9c15d430 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009e60 tx=0x7f2d94009780 comp rx=0 tx=0).stop 2023-12-24T19:51:38.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 -- 172.21.15.50:0/1514238450 shutdown_connections 2023-12-24T19:51:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 --2- 172.21.15.50:0/1514238450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c06cf30 0x7f2d9c15d430 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 -- 172.21.15.50:0/1514238450 >> 172.21.15.50:0/1514238450 conn(0x7f2d9c067b80 msgr2=0x7f2d9c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 -- 172.21.15.50:0/1514238450 shutdown_connections 2023-12-24T19:51:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.287+0000 7f2da12ae700 1 -- 172.21.15.50:0/1514238450 wait complete. 2023-12-24T19:51:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 Processor -- start 2023-12-24T19:51:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 -- start start 2023-12-24T19:51:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 0x7f2d9c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 0x7f2d9c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c157560 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c9ce0 con 0x7f2d9c0cbf50 2023-12-24T19:51:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2da12ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0b5b30 con 0x7f2d9c06cf30 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42952/0 (socket says 172.21.15.50:42952) 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 -- 172.21.15.50:0/197374827 learned_addr learned my addr 172.21.15.50:0/197374827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9b7fe700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 0x7f2d9c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9affd700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 0x7f2d9c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 -- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 msgr2=0x7f2d9c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 0x7f2d9c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 -- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 msgr2=0x7f2d9c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 0x7f2d9c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 -- 172.21.15.50:0/197374827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94009a20 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9affd700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 0x7f2d9c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9b7fe700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 0x7f2d9c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d9a7fc700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c810 tx=0x7f2d90007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.291+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90012700 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d900128a0 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c0c93b0 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90012c60 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0c9970 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c04be40 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.295+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2d9001b400 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.299+0000 7f2d82ffd700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 0x7f2d88062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.299+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f2d9007c3d0 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.299+0000 7f2d9affd700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 0x7f2d88062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.299+0000 7f2d9affd700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 0x7f2d88062a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0058d0 tx=0x7f2d8c009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.303+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d9004c9a0 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.479+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2d9c0c9e20 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.579+0000 7f2d82ffd700 1 -- 172.21.15.50:0/197374827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v156) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2d9c0c9e20 con 0x7f2d9c0cbb80 2023-12-24T19:51:38.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 msgr2=0x7f2d88062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 0x7f2d88062a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0058d0 tx=0x7f2d8c009040 comp rx=0 tx=0).stop 2023-12-24T19:51:38.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 msgr2=0x7f2d9c0b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c810 tx=0x7f2d90007df0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 shutdown_connections 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2d880605d0 0x7f2d88062a80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d9c0cbf50 0x7f2d9c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0cbb80 0x7f2d9c0b3050 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 --2- 172.21.15.50:0/197374827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d9c06cf30 0x7f2d9c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 >> 172.21.15.50:0/197374827 conn(0x7f2d9c067b80 msgr2=0x7f2d9c15d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:38.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 shutdown_connections 2023-12-24T19:51:38.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.587+0000 7f2da12ae700 1 -- 172.21.15.50:0/197374827 wait complete. 2023-12-24T19:51:38.593 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T19:51:38.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:51:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.787+0000 7fe370af0700 1 Processor -- start 2023-12-24T19:51:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.787+0000 7fe370af0700 1 -- start start 2023-12-24T19:51:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe370af0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe370af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c06a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe370af0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c06b0a0 con 0x7fe36c06ac40 2023-12-24T19:51:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe370af0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c159640 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe370af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0cd680 con 0x7fe36c0cf8a0 2023-12-24T19:51:38.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42962/0 (socket says 172.21.15.50:42962) 2023-12-24T19:51:38.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 -- 172.21.15.50:0/1467641556 learned_addr learned my addr 172.21.15.50:0/1467641556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:38.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe369d9b700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c06a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36959a700 1 -- 172.21.15.50:0/1467641556 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083554768 0 0) 0x7fe364001490 con 0x7fe36c06ac40 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 -- 172.21.15.50:0/1467641556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 msgr2=0x7fe36c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c06a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 -- 172.21.15.50:0/1467641556 >> v1:172.21.15.50:6789/0 conn(0x7fe36c06ac40 legacy=0x7fe36c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 -- 172.21.15.50:0/1467641556 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0cca70 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36a59c700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0099b0 tx=0x7fe35c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0427a06d7ab4af4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36959a700 1 -- 172.21.15.50:0/1467641556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c009ea0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36959a700 1 -- 172.21.15.50:0/1467641556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00b860 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.791+0000 7fe36959a700 1 -- 172.21.15.50:0/1467641556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00bc00 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 -- 172.21.15.50:0/1467641556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 msgr2=0x7fe36c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0099b0 tx=0x7fe35c009250 comp rx=0 tx=0).stop 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 -- 172.21.15.50:0/1467641556 shutdown_connections 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c06a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 --2- 172.21.15.50:0/1467641556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c06d1e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 -- 172.21.15.50:0/1467641556 >> 172.21.15.50:0/1467641556 conn(0x7fe36c067b30 msgr2=0x7fe36c0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 -- 172.21.15.50:0/1467641556 shutdown_connections 2023-12-24T19:51:38.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 -- 172.21.15.50:0/1467641556 wait complete. 2023-12-24T19:51:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.795+0000 7fe370af0700 1 Processor -- start 2023-12-24T19:51:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 -- start start 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe36c06ac40 0x7fe36c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c5410 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c56f0 con 0x7fe36c06ac40 2023-12-24T19:51:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe370af0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c59d0 con 0x7fe36c0cf8a0 2023-12-24T19:51:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42964/0 (socket says 172.21.15.50:42964) 2023-12-24T19:51:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 -- 172.21.15.50:0/2646014855 learned_addr learned my addr 172.21.15.50:0/2646014855 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe36ad9d700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe36a59c700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe36c06ac40 0x7fe36c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 -- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 msgr2=0x7fe36c0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c0cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 -- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe36c06ac40 msgr2=0x7fe36c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe36c06ac40 0x7fe36c155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 -- 172.21.15.50:0/2646014855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0094f0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe369d9b700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e900 tx=0x7fe3600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.799+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36000eea0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.803+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36000c850 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.803+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0c5cb0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.803+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36000cc10 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.803+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c155d80 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.803+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0c6130 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.807+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe360013470 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.807+0000 7fe35a7fc700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 0x7fe34c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:38.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.807+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5947+0+0 (secure 0 0 0) 0x7fe36007d2f0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.807+0000 7fe36a59c700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 0x7fe34c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.807+0000 7fe36a59c700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 0x7fe34c062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0099b0 tx=0x7fe35c017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:38.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.815+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe36004d8d0 con 0x7fe36c0cf4d0 2023-12-24T19:51:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:38.987+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe36c0652e0 con 0x7fe36c0cf4d0 2023-12-24T19:51:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.599+0000 7fe35a7fc700 1 -- 172.21.15.50:0/2646014855 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v157) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe360050ef0 con 0x7fe36c0cf4d0 2023-12-24T19:51:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.611+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 msgr2=0x7fe34c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.611+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 0x7fe34c062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0099b0 tx=0x7fe35c017000 comp rx=0 tx=0).stop 2023-12-24T19:51:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.611+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 msgr2=0x7fe36c16a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.611+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e900 tx=0x7fe3600091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 shutdown_connections 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe34c060550 0x7fe34c062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe36c0cf8a0 0x7fe36c0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cf4d0 0x7fe36c16a420 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 --2- 172.21.15.50:0/2646014855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe36c06ac40 0x7fe36c155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.615+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 >> 172.21.15.50:0/2646014855 conn(0x7fe36c067b30 msgr2=0x7fe36c158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:39.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.623+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 shutdown_connections 2023-12-24T19:51:39.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.623+0000 7fe370af0700 1 -- 172.21.15.50:0/2646014855 wait complete. 2023-12-24T19:51:39.632 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T19:51:39.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:51:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.815+0000 7f273d723700 1 Processor -- start 2023-12-24T19:51:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.815+0000 7f273d723700 1 -- start start 2023-12-24T19:51:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.815+0000 7f273d723700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 0x7f2738159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27380ccea0 0x7f27380cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380caa60 con 0x7f27380caef0 2023-12-24T19:51:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380af430 con 0x7f2738158c50 2023-12-24T19:51:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380cee80 con 0x7f27380ccea0 2023-12-24T19:51:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f2737fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 0x7f2738159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f2737fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 0x7f2738159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40864/0 (socket says 172.21.15.50:40864) 2023-12-24T19:51:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f2737fff700 1 -- 172.21.15.50:0/4172300142 learned_addr learned my addr 172.21.15.50:0/4172300142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 --2- 172.21.15.50:0/4172300142 >> v2:172.21.15.82:3300/0 conn(0x7f27380ccea0 0x7f27380cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 -- 172.21.15.50:0/4172300142 >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 msgr2=0x7f2738159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 --2- 172.21.15.50:0/4172300142 >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 0x7f2738159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 -- 172.21.15.50:0/4172300142 >> v1:172.21.15.82:6789/0 conn(0x7f27380caef0 legacy=0x7f27380cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 -- 172.21.15.50:0/4172300142 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380cf160 con 0x7f27380ccea0 2023-12-24T19:51:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f27377fe700 1 -- 172.21.15.50:0/4172300142 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827647092 0 0) 0x7f27380caa60 con 0x7f27380caef0 2023-12-24T19:51:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273cf22700 1 --2- 172.21.15.50:0/4172300142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27380ccea0 0x7f27380cb320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f27380afaf0 tx=0x7f27300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e73440d5924bbd82 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f27377fe700 1 -- 172.21.15.50:0/4172300142 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730011630 con 0x7f27380ccea0 2023-12-24T19:51:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f27377fe700 1 -- 172.21.15.50:0/4172300142 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2730011790 con 0x7f27380ccea0 2023-12-24T19:51:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f27377fe700 1 -- 172.21.15.50:0/4172300142 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730011b30 con 0x7f27380ccea0 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 -- 172.21.15.50:0/4172300142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27380ccea0 msgr2=0x7f27380cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.819+0000 7f273d723700 1 --2- 172.21.15.50:0/4172300142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27380ccea0 0x7f27380cb320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f27380afaf0 tx=0x7f27300091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 -- 172.21.15.50:0/4172300142 shutdown_connections 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 --2- 172.21.15.50:0/4172300142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27380ccea0 0x7f27380cb320 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 --2- 172.21.15.50:0/4172300142 >> v2:172.21.15.50:3300/0 conn(0x7f2738158c50 0x7f2738159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 -- 172.21.15.50:0/4172300142 >> 172.21.15.50:0/4172300142 conn(0x7f27380670b0 msgr2=0x7f27380674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 -- 172.21.15.50:0/4172300142 shutdown_connections 2023-12-24T19:51:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 -- 172.21.15.50:0/4172300142 wait complete. 2023-12-24T19:51:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.823+0000 7f273d723700 1 Processor -- start 2023-12-24T19:51:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 -- start start 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27380caef0 0x7f27380b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 0x7f273816c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273815aa60 con 0x7f27380ccea0 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c9c40 con 0x7f2738158c50 2023-12-24T19:51:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273d723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380c9f20 con 0x7f27380caef0 2023-12-24T19:51:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40876/0 (socket says 172.21.15.50:40876) 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 -- 172.21.15.50:0/3771438827 learned_addr learned my addr 172.21.15.50:0/3771438827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273cf22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 0x7f273816c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f2737fff700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27380caef0 0x7f27380b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 -- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27380caef0 msgr2=0x7f27380b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27380caef0 0x7f27380b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 -- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 msgr2=0x7f273816c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 0x7f273816c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f272f7fe700 1 -- 172.21.15.50:0/3771438827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730009420 con 0x7f27380ccea0 2023-12-24T19:51:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.827+0000 7f273cf22700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 0x7f273816c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f272f7fe700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f272000c7e0 tx=0x7f2720007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011590 con 0x7f27380ccea0 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720011710 con 0x7f27380ccea0 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011ad0 con 0x7f27380ccea0 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273815a6f0 con 0x7f27380ccea0 2023-12-24T19:51:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27380c98a0 con 0x7f27380ccea0 2023-12-24T19:51:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.831+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273815a550 con 0x7f27380ccea0 2023-12-24T19:51:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.835+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f272001c460 con 0x7f27380ccea0 2023-12-24T19:51:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.835+0000 7f2734ff9700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 0x7f2718062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.835+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6329+0+0 (secure 0 0 0) 0x7f272007d0d0 con 0x7f27380ccea0 2023-12-24T19:51:39.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.835+0000 7f2737fff700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 0x7f2718062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.839+0000 7f2737fff700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 0x7f2718062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f272800b040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:39.843+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f272004d430 con 0x7f27380ccea0 2023-12-24T19:51:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.055+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f273815a550 con 0x7f27380ccea0 2023-12-24T19:51:40.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.615+0000 7f2734ff9700 1 -- 172.21.15.50:0/3771438827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f273815a550 con 0x7f27380ccea0 2023-12-24T19:51:40.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 msgr2=0x7f2718062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:40.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 0x7f2718062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f272800b040 comp rx=0 tx=0).stop 2023-12-24T19:51:40.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 msgr2=0x7f27380c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:40.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f272000c7e0 tx=0x7f2720007df0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 shutdown_connections 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2718060550 0x7f2718062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738158c50 0x7f273816c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27380ccea0 0x7f27380c9360 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 --2- 172.21.15.50:0/3771438827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27380caef0 0x7f27380b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.619+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 >> 172.21.15.50:0/3771438827 conn(0x7f27380670b0 msgr2=0x7f273806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:40.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.623+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 shutdown_connections 2023-12-24T19:51:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.623+0000 7f273d723700 1 -- 172.21.15.50:0/3771438827 wait complete. 2023-12-24T19:51:40.629 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 19 and data pool 20 2023-12-24T19:51:40.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:51:40.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:51:40.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:40.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.863+0000 7fd0a7eae700 1 Processor -- start 2023-12-24T19:51:40.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 -- start start 2023-12-24T19:51:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd0a015ac50 0x7fd0a015b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a0154590 0x7fd0a01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a006cbe0 0x7fd0a006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a006e1f0 con 0x7fd0a0154590 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00cc020 con 0x7fd0a015ac50 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a7eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0154f20 con 0x7fd0a006cbe0 2023-12-24T19:51:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.867+0000 7fd0a5449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a0154590 0x7fd0a01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a0154590 0x7fd0a01549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40880/0 (socket says 172.21.15.50:40880) 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 -- 172.21.15.50:0/1758116050 learned_addr learned my addr 172.21.15.50:0/1758116050 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5c4a700 1 --2- 172.21.15.50:0/1758116050 >> v2:172.21.15.82:3300/0 conn(0x7fd0a015ac50 0x7fd0a015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a644b700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a006cbe0 0x7fd0a006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 -- 172.21.15.50:0/1758116050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a006cbe0 msgr2=0x7fd0a006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a006cbe0 0x7fd0a006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 -- 172.21.15.50:0/1758116050 >> v2:172.21.15.82:3300/0 conn(0x7fd0a015ac50 msgr2=0x7fd0a015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 --2- 172.21.15.50:0/1758116050 >> v2:172.21.15.82:3300/0 conn(0x7fd0a015ac50 0x7fd0a015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 -- 172.21.15.50:0/1758116050 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a006d950 con 0x7fd0a0154590 2023-12-24T19:51:40.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a5449700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0154590 0x7fd0a01549e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd0a006bf70 tx=0x7fd090009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5fb2bc6a227e99 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:40.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a4c48700 1 -- 172.21.15.50:0/1758116050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090009e70 con 0x7fd0a0154590 2023-12-24T19:51:40.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a4c48700 1 -- 172.21.15.50:0/1758116050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000b860 con 0x7fd0a0154590 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a4c48700 1 -- 172.21.15.50:0/1758116050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09000bc20 con 0x7fd0a0154590 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 -- 172.21.15.50:0/1758116050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0154590 msgr2=0x7fd0a01549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0154590 0x7fd0a01549e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd0a006bf70 tx=0x7fd090009250 comp rx=0 tx=0).stop 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 -- 172.21.15.50:0/1758116050 shutdown_connections 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a006cbe0 0x7fd0a006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/1758116050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a0154590 0x7fd0a01549e0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/1758116050 >> v2:172.21.15.82:3300/0 conn(0x7fd0a015ac50 0x7fd0a015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 -- 172.21.15.50:0/1758116050 >> 172.21.15.50:0/1758116050 conn(0x7fd0a00cdd80 msgr2=0x7fd0a00ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 -- 172.21.15.50:0/1758116050 shutdown_connections 2023-12-24T19:51:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.871+0000 7fd0a7eae700 1 -- 172.21.15.50:0/1758116050 wait complete. 2023-12-24T19:51:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 Processor -- start 2023-12-24T19:51:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 -- start start 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 0x7fd0a00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0154590 0x7fd0a00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00c6820 con 0x7fd0a015ac50 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01515f0 con 0x7fd0a006cbe0 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a7eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00c5c10 con 0x7fd0a0154590 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40896/0 (socket says 172.21.15.50:40896) 2023-12-24T19:51:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 -- 172.21.15.50:0/3609539474 learned_addr learned my addr 172.21.15.50:0/3609539474 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a5449700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0154590 0x7fd0a00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a5c4a700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 0x7fd0a00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 -- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0154590 msgr2=0x7fd0a00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0154590 0x7fd0a00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 -- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 msgr2=0x7fd0a00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 0x7fd0a00c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 -- 172.21.15.50:0/3609539474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094f0 con 0x7fd0a015ac50 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a5c4a700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 0x7fd0a00c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.875+0000 7fd0a644b700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd098007f20 tx=0x7fd098009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800eca0 con 0x7fd0a015ac50 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800ee20 con 0x7fd0a015ac50 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098014670 con 0x7fd0a015ac50 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a00c5ef0 con 0x7fd0a015ac50 2023-12-24T19:51:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00c64b0 con 0x7fd0a015ac50 2023-12-24T19:51:40.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a00c71f0 con 0x7fd0a015ac50 2023-12-24T19:51:40.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.879+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd0980149e0 con 0x7fd0a015ac50 2023-12-24T19:51:40.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.883+0000 7fd095ffb700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:40.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.883+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fd09807d270 con 0x7fd0a015ac50 2023-12-24T19:51:40.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.883+0000 7fd0a5c4a700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:40.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.883+0000 7fd0a5c4a700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 0x7fd084062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd09c006f00 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:40.891+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd09804d4f0 con 0x7fd0a015ac50 2023-12-24T19:51:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.067+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0a00b3be0 con 0x7fd0a015ac50 2023-12-24T19:51:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.067+0000 7fd095ffb700 1 -- 172.21.15.50:0/3609539474 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16151 (secure 0 0 0) 0x7fd0a00b3be0 con 0x7fd0a015ac50 2023-12-24T19:51:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:41.072 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":158,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:40.060374+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:41.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 msgr2=0x7fd084062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 0x7fd084062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd09c006f00 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2023-12-24T19:51:41.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 msgr2=0x7fd0a01510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd098007f20 tx=0x7fd098009860 comp rx=0 tx=0).stop 2023-12-24T19:51:41.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 shutdown_connections 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd084060550 0x7fd084062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a015ac50 0x7fd0a01510b0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0a0154590 0x7fd0a00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 --2- 172.21.15.50:0/3609539474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a006cbe0 0x7fd0a00c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 >> 172.21.15.50:0/3609539474 conn(0x7fd0a00cdd80 msgr2=0x7fd0a00c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 shutdown_connections 2023-12-24T19:51:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.075+0000 7fd0a7eae700 1 -- 172.21.15.50:0/3609539474 wait complete. 2023-12-24T19:51:41.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.255+0000 7f3546ef0700 1 Processor -- start 2023-12-24T19:51:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.259+0000 7f3546ef0700 1 -- start start 2023-12-24T19:51:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.259+0000 7f3546ef0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3540159080 0x7f35401594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.259+0000 7f3546ef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3540155fe0 con 0x7f3540156470 2023-12-24T19:51:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.259+0000 7f3546ef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354006b0f0 con 0x7f3540156840 2023-12-24T19:51:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.259+0000 7f3546ef0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354006b3d0 con 0x7f3540159080 2023-12-24T19:51:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3544c8c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3540156470 0x7f354006a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34514/0 (socket says 172.21.15.50:34514) 2023-12-24T19:51:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3544c8c700 1 -- 172.21.15.50:0/1305337133 learned_addr learned my addr 172.21.15.50:0/1305337133 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f354548d700 1 --2- 172.21.15.50:0/1305337133 >> v2:172.21.15.82:3300/0 conn(0x7f3540159080 0x7f35401594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f354548d700 1 -- 172.21.15.50:0/1305337133 >> v1:172.21.15.82:6789/0 conn(0x7f3540156840 legacy=0x7f35401551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f354548d700 1 -- 172.21.15.50:0/1305337133 >> v1:172.21.15.50:6789/0 conn(0x7f3540156470 legacy=0x7f354006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f354548d700 1 -- 172.21.15.50:0/1305337133 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540155c70 con 0x7f3540159080 2023-12-24T19:51:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f354548d700 1 --2- 172.21.15.50:0/1305337133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f35401594d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3538009e60 tx=0x7f3538009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af2f3a6bce950fb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f35377fe700 1 -- 172.21.15.50:0/1305337133 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800e070 con 0x7f3540159080 2023-12-24T19:51:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f35377fe700 1 -- 172.21.15.50:0/1305337133 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800bc30 con 0x7f3540159080 2023-12-24T19:51:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f35377fe700 1 -- 172.21.15.50:0/1305337133 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538012430 con 0x7f3540159080 2023-12-24T19:51:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 -- 172.21.15.50:0/1305337133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 msgr2=0x7f35401594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 --2- 172.21.15.50:0/1305337133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f35401594d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3538009e60 tx=0x7f3538009780 comp rx=0 tx=0).stop 2023-12-24T19:51:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 -- 172.21.15.50:0/1305337133 shutdown_connections 2023-12-24T19:51:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 --2- 172.21.15.50:0/1305337133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f35401594d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 -- 172.21.15.50:0/1305337133 >> 172.21.15.50:0/1305337133 conn(0x7f35400cbba0 msgr2=0x7f35400cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 -- 172.21.15.50:0/1305337133 shutdown_connections 2023-12-24T19:51:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.263+0000 7f3546ef0700 1 -- 172.21.15.50:0/1305337133 wait complete. 2023-12-24T19:51:41.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 Processor -- start 2023-12-24T19:51:41.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 -- start start 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3540156470 0x7f35400af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f354016c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354014ec60 con 0x7f3540156840 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354014f220 con 0x7f3540159080 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.267+0000 7f3546ef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400b14b0 con 0x7f3540156470 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40912/0 (socket says 172.21.15.50:40912) 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 -- 172.21.15.50:0/3574204540 learned_addr learned my addr 172.21.15.50:0/3574204540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3544c8c700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3540156470 0x7f35400af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f354548d700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f354016c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 -- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3540156470 msgr2=0x7f35400af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3540156470 0x7f35400af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 -- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 msgr2=0x7f354016c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f354016c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 -- 172.21.15.50:0/3574204540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009a20 con 0x7f3540156840 2023-12-24T19:51:41.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f354548d700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f354016c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:41.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3537fff700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f353000c5c0 tx=0x7f353000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011590 con 0x7f3540156840 2023-12-24T19:51:41.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530011710 con 0x7f3540156840 2023-12-24T19:51:41.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35400b1790 con 0x7f3540156840 2023-12-24T19:51:41.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011ad0 con 0x7f3540156840 2023-12-24T19:51:41.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.271+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35400afc90 con 0x7f3540156840 2023-12-24T19:51:41.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.275+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35400b1920 con 0x7f3540156840 2023-12-24T19:51:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.275+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f353001b3b0 con 0x7f3540156840 2023-12-24T19:51:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.275+0000 7f3534ff9700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 0x7f352c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.279+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f353007bf40 con 0x7f3540156840 2023-12-24T19:51:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.279+0000 7f3544c8c700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 0x7f352c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.279+0000 7f3544c8c700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 0x7f352c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.283+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f353004c1c0 con 0x7f3540156840 2023-12-24T19:51:41.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.459+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f354014aaf0 con 0x7f3540156840 2023-12-24T19:51:41.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.463+0000 7f3534ff9700 1 -- 172.21.15.50:0/3574204540 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16138 (secure 0 0 0) 0x7f353004f7e0 con 0x7f3540156840 2023-12-24T19:51:41.465 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:41.465 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":159,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:41.401685+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 msgr2=0x7f352c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 0x7f352c062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c009040 comp rx=0 tx=0).stop 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 msgr2=0x7f354014a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f353000c5c0 tx=0x7f353000c8d0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 shutdown_connections 2023-12-24T19:51:41.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f352c060550 0x7f352c062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3540159080 0x7f354016c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3540156840 0x7f354014a4f0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 --2- 172.21.15.50:0/3574204540 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3540156470 0x7f35400af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 >> 172.21.15.50:0/3574204540 conn(0x7f35400cbba0 msgr2=0x7f35400c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 shutdown_connections 2023-12-24T19:51:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.467+0000 7f3546ef0700 1 -- 172.21.15.50:0/3574204540 wait complete. 2023-12-24T19:51:41.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:51:41.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.659+0000 7f7d8d616700 1 Processor -- start 2023-12-24T19:51:41.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.659+0000 7f7d8d616700 1 -- start start 2023-12-24T19:51:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8d616700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 0x7f7d880c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8d616700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880c9170 con 0x7f7d880c8d10 2023-12-24T19:51:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8d616700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8815b5a0 con 0x7f7d88156ab0 2023-12-24T19:51:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8d616700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8815a990 con 0x7f7d88156e80 2023-12-24T19:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8ce15700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d880c8d10 0x7f7d880c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34516/0 (socket says 172.21.15.50:34516) 2023-12-24T19:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d8ce15700 1 -- 172.21.15.50:0/2850141751 learned_addr learned my addr 172.21.15.50:0/2850141751 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d7f7fe700 1 --2- 172.21.15.50:0/2850141751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 0x7f7d880c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557221681 0 0) 0x7f7d80001490 con 0x7f7d880c8d10 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d74003570 con 0x7f7d880c8d10 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930188523 0 0) 0x7f7d8815b5a0 con 0x7f7d88156ab0 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d80001490 con 0x7f7d88156ab0 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d7f7fe700 1 -- 172.21.15.50:0/2850141751 >> v1:172.21.15.82:6789/0 conn(0x7f7d88156ab0 legacy=0x7f7d880adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d7f7fe700 1 -- 172.21.15.50:0/2850141751 >> v1:172.21.15.50:6789/0 conn(0x7f7d880c8d10 legacy=0x7f7d880c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d7f7fe700 1 -- 172.21.15.50:0/2850141751 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8815ac70 con 0x7f7d88156e80 2023-12-24T19:51:41.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d7f7fe700 1 --2- 172.21.15.50:0/2850141751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 0x7f7d880c87d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009910 tx=0x7f7d700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d1a6bff8f2c21 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011630 con 0x7f7d88156e80 2023-12-24T19:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.663+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70011790 con 0x7f7d88156e80 2023-12-24T19:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d877fe700 1 -- 172.21.15.50:0/2850141751 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011b30 con 0x7f7d88156e80 2023-12-24T19:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- 172.21.15.50:0/2850141751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 msgr2=0x7f7d880c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 --2- 172.21.15.50:0/2850141751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 0x7f7d880c87d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009910 tx=0x7f7d700091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- 172.21.15.50:0/2850141751 shutdown_connections 2023-12-24T19:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 --2- 172.21.15.50:0/2850141751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156e80 0x7f7d880c87d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- 172.21.15.50:0/2850141751 >> 172.21.15.50:0/2850141751 conn(0x7f7d88067250 msgr2=0x7f7d88067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- 172.21.15.50:0/2850141751 shutdown_connections 2023-12-24T19:51:41.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- 172.21.15.50:0/2850141751 wait complete. 2023-12-24T19:51:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 Processor -- start 2023-12-24T19:51:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.667+0000 7f7d8d616700 1 -- start start 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d880c8d10 0x7f7d88159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156ab0 0x7f7d8814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d88157d70 con 0x7f7d88156e80 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d88157480 con 0x7f7d880c8d10 2023-12-24T19:51:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8815a210 con 0x7f7d88156ab0 2023-12-24T19:51:41.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40920/0 (socket says 172.21.15.50:40920) 2023-12-24T19:51:41.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 -- 172.21.15.50:0/3718993579 learned_addr learned my addr 172.21.15.50:0/3718993579 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:41.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d87fff700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d880c8d10 0x7f7d88159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d7f7fe700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156ab0 0x7f7d8814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 -- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156ab0 msgr2=0x7f7d8814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156ab0 0x7f7d8814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 -- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d880c8d10 msgr2=0x7f7d88159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d880c8d10 0x7f7d88159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 -- 172.21.15.50:0/3718993579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70009420 con 0x7f7d88156e80 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8ce15700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7d80002070 tx=0x7f7d80001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000ab70 con 0x7f7d88156e80 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000acf0 con 0x7f7d88156e80 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80007340 con 0x7f7d88156e80 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d88157720 con 0x7f7d88156e80 2023-12-24T19:51:41.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.671+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d88150240 con 0x7f7d88156e80 2023-12-24T19:51:41.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.675+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d88157ee0 con 0x7f7d88156e80 2023-12-24T19:51:41.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.675+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7d800076f0 con 0x7f7d88156e80 2023-12-24T19:51:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.679+0000 7f7d84ff9700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 0x7f7d68062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.679+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f7d8007cf70 con 0x7f7d88156e80 2023-12-24T19:51:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.679+0000 7f7d87fff700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 0x7f7d68062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:41.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.679+0000 7f7d87fff700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 0x7f7d68062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d78003870 tx=0x7f7d78009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:41.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.683+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d80050d00 con 0x7f7d88156e80 2023-12-24T19:51:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:41.891+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7d880c9170 con 0x7f7d88156e80 2023-12-24T19:51:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.639+0000 7f7d84ff9700 1 -- 172.21.15.50:0/3718993579 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7d880c9170 con 0x7f7d88156e80 2023-12-24T19:51:42.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 msgr2=0x7f7d68062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 0x7f7d68062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d78003870 tx=0x7f7d78009040 comp rx=0 tx=0).stop 2023-12-24T19:51:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 msgr2=0x7f7d88154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7d80002070 tx=0x7f7d80001c70 comp rx=0 tx=0).stop 2023-12-24T19:51:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 shutdown_connections 2023-12-24T19:51:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d68060580 0x7f7d68062a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d88156e80 0x7f7d88154490 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d88156ab0 0x7f7d8814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 --2- 172.21.15.50:0/3718993579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d880c8d10 0x7f7d88159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 >> 172.21.15.50:0/3718993579 conn(0x7f7d88067250 msgr2=0x7f7d880ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 shutdown_connections 2023-12-24T19:51:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.643+0000 7f7d8d616700 1 -- 172.21.15.50:0/3718993579 wait complete. 2023-12-24T19:51:42.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:51:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 Processor -- start 2023-12-24T19:51:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 -- start start 2023-12-24T19:51:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbadc158db0 0x7fbadc159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc06cca0 con 0x7fbadc06a700 2023-12-24T19:51:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc0a9cc0 con 0x7fbadc158db0 2023-12-24T19:51:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbae266e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0a9fa0 con 0x7fbadc0a9290 2023-12-24T19:51:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbadbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbadc158db0 0x7fbadc159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.847+0000 7fbadbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbadc158db0 0x7fbadc159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40924/0 (socket says 172.21.15.50:40924) 2023-12-24T19:51:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 -- 172.21.15.50:0/93431348 learned_addr learned my addr 172.21.15.50:0/93431348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbad3fff700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 -- 172.21.15.50:0/93431348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 msgr2=0x7fbadc0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc0a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 -- 172.21.15.50:0/93431348 >> v1:172.21.15.82:6789/0 conn(0x7fbadc06a700 legacy=0x7fbadc15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadb7fe700 1 -- 172.21.15.50:0/93431348 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379186868 0 0) 0x7fbadc06cca0 con 0x7fbadc06a700 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 -- 172.21.15.50:0/93431348 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc06c930 con 0x7fbadc158db0 2023-12-24T19:51:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadbfff700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc159180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0099b0 tx=0x7fbacc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883aa1f9e1d8178c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadb7fe700 1 -- 172.21.15.50:0/93431348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc009ea0 con 0x7fbadc158db0 2023-12-24T19:51:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadb7fe700 1 -- 172.21.15.50:0/93431348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00b860 con 0x7fbadc158db0 2023-12-24T19:51:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbadb7fe700 1 -- 172.21.15.50:0/93431348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00bc00 con 0x7fbadc158db0 2023-12-24T19:51:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 -- 172.21.15.50:0/93431348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 msgr2=0x7fbadc159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc159180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0099b0 tx=0x7fbacc009250 comp rx=0 tx=0).stop 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 -- 172.21.15.50:0/93431348 shutdown_connections 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc0a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 --2- 172.21.15.50:0/93431348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc159180 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 -- 172.21.15.50:0/93431348 >> 172.21.15.50:0/93431348 conn(0x7fbadc067b80 msgr2=0x7fbadc0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 -- 172.21.15.50:0/93431348 shutdown_connections 2023-12-24T19:51:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.851+0000 7fbae266e700 1 -- 172.21.15.50:0/93431348 wait complete. 2023-12-24T19:51:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.855+0000 7fbae266e700 1 Processor -- start 2023-12-24T19:51:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.855+0000 7fbae266e700 1 -- start start 2023-12-24T19:51:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbadc06a700 0x7fbadc0c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c0e80 con 0x7fbadc158db0 2023-12-24T19:51:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c1100 con 0x7fbadc06a700 2023-12-24T19:51:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c13e0 con 0x7fbadc0a9290 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40928/0 (socket says 172.21.15.50:40928) 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 -- 172.21.15.50:0/2641795225 learned_addr learned my addr 172.21.15.50:0/2641795225 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbadbfff700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbadc06a700 0x7fbadc0c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbad3fff700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 -- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 msgr2=0x7fbadc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 -- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbadc06a700 msgr2=0x7fbadc0c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbadc06a700 0x7fbadc0c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 -- 172.21.15.50:0/2641795225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0094f0 con 0x7fbadc158db0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbad3fff700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae0c0b700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbad4001560 tx=0x7fbad4001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4003030 con 0x7fbadc158db0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad400a7e0 con 0x7fbadc158db0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400aba0 con 0x7fbadc158db0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc0c16c0 con 0x7fbadc158db0 2023-12-24T19:51:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.859+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc0c1c80 con 0x7fbadc158db0 2023-12-24T19:51:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.863+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc0c1ea0 con 0x7fbadc158db0 2023-12-24T19:51:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.863+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbad4012420 con 0x7fbadc158db0 2023-12-24T19:51:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.863+0000 7fbad8ff9700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 0x7fbabc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.867+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fbad4004070 con 0x7fbadc158db0 2023-12-24T19:51:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.867+0000 7fbadbfff700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 0x7fbabc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.867+0000 7fbadbfff700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 0x7fbabc062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0099b0 tx=0x7fbacc017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:42.871+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbad404ccb0 con 0x7fbadc158db0 2023-12-24T19:51:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.079+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbadc0652e0 con 0x7fbadc158db0 2023-12-24T19:51:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.647+0000 7fbad8ff9700 1 -- 172.21.15.50:0/2641795225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbad40502d0 con 0x7fbadc158db0 2023-12-24T19:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 msgr2=0x7fbabc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 0x7fbabc062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0099b0 tx=0x7fbacc017000 comp rx=0 tx=0).stop 2023-12-24T19:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 msgr2=0x7fbadc0c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbad4001560 tx=0x7fbad4001770 comp rx=0 tx=0).stop 2023-12-24T19:51:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 shutdown_connections 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbabc060550 0x7fbabc062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbadc158db0 0x7fbadc0c0940 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbadc0a9290 0x7fbadc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 --2- 172.21.15.50:0/2641795225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbadc06a700 0x7fbadc0c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 >> 172.21.15.50:0/2641795225 conn(0x7fbadc067b80 msgr2=0x7fbadc1532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 shutdown_connections 2023-12-24T19:51:43.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.651+0000 7fbae266e700 1 -- 172.21.15.50:0/2641795225 wait complete. 2023-12-24T19:51:43.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 Processor -- start 2023-12-24T19:51:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 -- start start 2023-12-24T19:51:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e800cb060 0x7f6e800cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e8006d3f0 0x7f6e8006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8006aac0 con 0x7f6e80158950 2023-12-24T19:51:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8006b900 con 0x7f6e8006d3f0 2023-12-24T19:51:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e8562e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8006d840 con 0x7f6e800cb060 2023-12-24T19:51:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e77fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e8006d3f0 0x7f6e8006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e77fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e8006d3f0 0x7f6e8006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40940/0 (socket says 172.21.15.50:40940) 2023-12-24T19:51:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e77fff700 1 -- 172.21.15.50:0/3923225130 learned_addr learned my addr 172.21.15.50:0/3923225130 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.843+0000 7f6e7effd700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e800cb060 0x7f6e800cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e77fff700 1 -- 172.21.15.50:0/3923225130 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e800cb060 msgr2=0x7f6e800cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e77fff700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e800cb060 0x7f6e800cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e77fff700 1 -- 172.21.15.50:0/3923225130 >> v1:172.21.15.82:6789/0 conn(0x7f6e80158950 legacy=0x7f6e80158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e77fff700 1 -- 172.21.15.50:0/3923225130 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8006bd90 con 0x7f6e8006d3f0 2023-12-24T19:51:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e77fff700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e8006a580 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b1c4c9351662f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e7e7fc700 1 -- 172.21.15.50:0/3923225130 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68009ea0 con 0x7f6e8006d3f0 2023-12-24T19:51:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e7e7fc700 1 -- 172.21.15.50:0/3923225130 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800b860 con 0x7f6e8006d3f0 2023-12-24T19:51:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e7e7fc700 1 -- 172.21.15.50:0/3923225130 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800bc00 con 0x7f6e8006d3f0 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 -- 172.21.15.50:0/3923225130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 msgr2=0x7f6e8006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e8006a580 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68009250 comp rx=0 tx=0).stop 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 -- 172.21.15.50:0/3923225130 shutdown_connections 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e8006a580 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 --2- 172.21.15.50:0/3923225130 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e800cb060 0x7f6e800cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 -- 172.21.15.50:0/3923225130 >> 172.21.15.50:0/3923225130 conn(0x7f6e80067b80 msgr2=0x7f6e800cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 -- 172.21.15.50:0/3923225130 shutdown_connections 2023-12-24T19:51:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.847+0000 7f6e8562e700 1 -- 172.21.15.50:0/3923225130 wait complete. 2023-12-24T19:51:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.851+0000 7f6e8562e700 1 Processor -- start 2023-12-24T19:51:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.851+0000 7f6e8562e700 1 -- start start 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.851+0000 7f6e8562e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.851+0000 7f6e8562e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 0x7f6e8015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.851+0000 7f6e8562e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 0x7f6e8014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e8562e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8015bf70 con 0x7f6e8006d3f0 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e8562e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8015b0c0 con 0x7f6e800cb060 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e8562e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8015c400 con 0x7f6e80158950 2023-12-24T19:51:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40948/0 (socket says 172.21.15.50:40948) 2023-12-24T19:51:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 -- 172.21.15.50:0/2379549027 learned_addr learned my addr 172.21.15.50:0/2379549027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e77fff700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 0x7f6e8015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7f7fe700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 0x7f6e8014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 -- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 msgr2=0x7f6e8014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 0x7f6e8014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 -- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 msgr2=0x7f6e8015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 0x7f6e8015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 -- 172.21.15.50:0/2379549027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680094f0 con 0x7f6e8006d3f0 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7f7fe700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 0x7f6e8014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e77fff700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 0x7f6e8015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e7effd700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ec80 tx=0x7f6e70009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000c9d0 con 0x7f6e8006d3f0 2023-12-24T19:51:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000cb30 con 0x7f6e8006d3f0 2023-12-24T19:51:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70013470 con 0x7f6e8006d3f0 2023-12-24T19:51:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8015b360 con 0x7f6e8006d3f0 2023-12-24T19:51:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.855+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8015b920 con 0x7f6e8006d3f0 2023-12-24T19:51:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.859+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8004be40 con 0x7f6e8006d3f0 2023-12-24T19:51:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.859+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6e70013820 con 0x7f6e8006d3f0 2023-12-24T19:51:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.859+0000 7f6e76ffd700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 0x7f6e60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.859+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f6e7007d280 con 0x7f6e8006d3f0 2023-12-24T19:51:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.859+0000 7f6e77fff700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 0x7f6e60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.863+0000 7f6e77fff700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 0x7f6e60062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:43.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:43.867+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6e7004d500 con 0x7f6e8006d3f0 2023-12-24T19:51:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.075+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e8006acf0 con 0x7f6e8006d3f0 2023-12-24T19:51:44.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.075+0000 7f6e76ffd700 1 -- 172.21.15.50:0/2379549027 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f6e70050b20 con 0x7f6e8006d3f0 2023-12-24T19:51:44.078 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:44.078 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 msgr2=0x7f6e60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 0x7f6e60062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68017000 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 msgr2=0x7f6e80156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ec80 tx=0x7f6e70009120 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 shutdown_connections 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e60060550 0x7f6e60062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e80158950 0x7f6e8014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e800cb060 0x7f6e8015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 --2- 172.21.15.50:0/2379549027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8006d3f0 0x7f6e80156bc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 >> 172.21.15.50:0/2379549027 conn(0x7f6e80067b80 msgr2=0x7f6e800b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 shutdown_connections 2023-12-24T19:51:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.079+0000 7f6e8562e700 1 -- 172.21.15.50:0/2379549027 wait complete. 2023-12-24T19:51:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:51:44.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:51:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 Processor -- start 2023-12-24T19:51:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 -- start start 2023-12-24T19:51:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 0x7f7bf41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 0x7f7bf4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf406b640 con 0x7f7bf4158e00 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf4159710 con 0x7f7bf40b41e0 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40b5e10 con 0x7f7bf406d8c0 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bebfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 0x7f7bf41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf2d9d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 0x7f7bf4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7bf4158e00 0x7f7bf40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42780/0 (socket says 172.21.15.50:42780) 2023-12-24T19:51:44.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.271+0000 7f7bf259c700 1 -- 172.21.15.50:0/3920367977 learned_addr learned my addr 172.21.15.50:0/3920367977 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf1d9b700 1 -- 172.21.15.50:0/3920367977 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097970378 0 0) 0x7f7bf406b640 con 0x7f7bf4158e00 2023-12-24T19:51:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf1d9b700 1 -- 172.21.15.50:0/3920367977 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be0003570 con 0x7f7bf4158e00 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf2d9d700 1 -- 172.21.15.50:0/3920367977 >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 msgr2=0x7f7bf41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf2d9d700 1 --2- 172.21.15.50:0/3920367977 >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 0x7f7bf41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf2d9d700 1 -- 172.21.15.50:0/3920367977 >> v1:172.21.15.82:6789/0 conn(0x7f7bf4158e00 legacy=0x7f7bf40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf2d9d700 1 -- 172.21.15.50:0/3920367977 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf406b8e0 con 0x7f7bf406d8c0 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bebfff700 1 --2- 172.21.15.50:0/3920367977 >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 0x7f7bf41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf2d9d700 1 --2- 172.21.15.50:0/3920367977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 0x7f7bf4159e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009e60 tx=0x7f7bec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8745e218dce83ae1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf1d9b700 1 -- 172.21.15.50:0/3920367977 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00e070 con 0x7f7bf406d8c0 2023-12-24T19:51:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf1d9b700 1 -- 172.21.15.50:0/3920367977 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00bab0 con 0x7f7bf406d8c0 2023-12-24T19:51:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf1d9b700 1 -- 172.21.15.50:0/3920367977 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00be70 con 0x7f7bf406d8c0 2023-12-24T19:51:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 -- 172.21.15.50:0/3920367977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 msgr2=0x7f7bf4159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 --2- 172.21.15.50:0/3920367977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 0x7f7bf4159e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009e60 tx=0x7f7bec009780 comp rx=0 tx=0).stop 2023-12-24T19:51:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 -- 172.21.15.50:0/3920367977 shutdown_connections 2023-12-24T19:51:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 --2- 172.21.15.50:0/3920367977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf406d8c0 0x7f7bf4159e30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 --2- 172.21.15.50:0/3920367977 >> v2:172.21.15.82:3300/0 conn(0x7f7bf40b41e0 0x7f7bf41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 -- 172.21.15.50:0/3920367977 >> 172.21.15.50:0/3920367977 conn(0x7f7bf4067b80 msgr2=0x7f7bf40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 -- 172.21.15.50:0/3920367977 shutdown_connections 2023-12-24T19:51:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.275+0000 7f7bf359e700 1 -- 172.21.15.50:0/3920367977 wait complete. 2023-12-24T19:51:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 Processor -- start 2023-12-24T19:51:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 -- start start 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf406d8c0 0x7f7bf4168660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf4158e00 0x7f7bf4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4168ba0 con 0x7f7bf40b41e0 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4150230 con 0x7f7bf406d8c0 2023-12-24T19:51:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.279+0000 7f7bf359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf414f340 con 0x7f7bf4158e00 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40950/0 (socket says 172.21.15.50:40950) 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 -- 172.21.15.50:0/315943930 learned_addr learned my addr 172.21.15.50:0/315943930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bf259c700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf406d8c0 0x7f7bf4168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bf2d9d700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf4158e00 0x7f7bf4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 -- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf4158e00 msgr2=0x7f7bf4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf4158e00 0x7f7bf4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 -- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf406d8c0 msgr2=0x7f7bf4168660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf406d8c0 0x7f7bf4168660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 -- 172.21.15.50:0/315943930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc009420 con 0x7f7bf40b41e0 2023-12-24T19:51:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bebfff700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00ec50 tx=0x7f7bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00c850 con 0x7f7bf40b41e0 2023-12-24T19:51:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec009a20 con 0x7f7bf40b41e0 2023-12-24T19:51:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00c9b0 con 0x7f7bf40b41e0 2023-12-24T19:51:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00cd50 con 0x7f7bf40b41e0 2023-12-24T19:51:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.283+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf414f900 con 0x7f7bf40b41e0 2023-12-24T19:51:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.287+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404be40 con 0x7f7bf40b41e0 2023-12-24T19:51:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.287+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7bdc013680 con 0x7f7bf40b41e0 2023-12-24T19:51:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.287+0000 7f7bea7fc700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 0x7f7bd4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.287+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f7bdc07cb80 con 0x7f7bf40b41e0 2023-12-24T19:51:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.291+0000 7f7bf259c700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 0x7f7bd4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.291+0000 7f7bf259c700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 0x7f7bd4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007fd0 tx=0x7f7be4009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.295+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7bdc04ce00 con 0x7f7bf40b41e0 2023-12-24T19:51:44.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.475+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bf406bbc0 con 0x7f7bf40b41e0 2023-12-24T19:51:44.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.475+0000 7f7bea7fc700 1 -- 172.21.15.50:0/315943930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16138 (secure 0 0 0) 0x7f7bdc017090 con 0x7f7bf40b41e0 2023-12-24T19:51:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:44.480 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":159,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:41.401685+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:51:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 msgr2=0x7f7bd4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 0x7f7bd4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007fd0 tx=0x7f7be4009040 comp rx=0 tx=0).stop 2023-12-24T19:51:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 msgr2=0x7f7bf4154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00ec50 tx=0x7f7bdc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 shutdown_connections 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7bd4060550 0x7f7bd4062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bf4158e00 0x7f7bf4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b41e0 0x7f7bf4154770 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 --2- 172.21.15.50:0/315943930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf406d8c0 0x7f7bf4168660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 >> 172.21.15.50:0/315943930 conn(0x7f7bf4067b80 msgr2=0x7f7bf40a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 shutdown_connections 2023-12-24T19:51:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.479+0000 7f7bf359e700 1 -- 172.21.15.50:0/315943930 wait complete. 2023-12-24T19:51:44.506 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:51:44.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:51:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.671+0000 7f2f2206e700 1 Processor -- start 2023-12-24T19:51:44.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.671+0000 7f2f2206e700 1 -- start start 2023-12-24T19:51:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f2206e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f1c06bce0 0x7f2f1c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f2206e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f1c0ab040 0x7f2f1c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f2206e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c06b850 con 0x7f2f1c159bc0 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f2206e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c06ac40 con 0x7f2f1c0ab040 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f2206e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c06af20 con 0x7f2f1c06bce0 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f1c0ab040 0x7f2f1c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f1c159bc0 0x7f2f1c159f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42790/0 (socket says 172.21.15.50:42790) 2023-12-24T19:51:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1b7fe700 1 -- 172.21.15.50:0/937647406 learned_addr learned my addr 172.21.15.50:0/937647406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:44.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1bfff700 1 --2- 172.21.15.50:0/937647406 >> v2:172.21.15.50:3300/0 conn(0x7f2f1c0ab040 0x7f2f1c0ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40952/0 (socket says 172.21.15.50:40952) 2023-12-24T19:51:44.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f12ffd700 1 --2- 172.21.15.50:0/937647406 >> v2:172.21.15.82:3300/0 conn(0x7f2f1c06bce0 0x7f2f1c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1bfff700 1 -- 172.21.15.50:0/937647406 >> v2:172.21.15.82:3300/0 conn(0x7f2f1c06bce0 msgr2=0x7f2f1c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:44.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.675+0000 7f2f1bfff700 1 --2- 172.21.15.50:0/937647406 >> v2:172.21.15.82:3300/0 conn(0x7f2f1c06bce0 0x7f2f1c0aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1bfff700 1 -- 172.21.15.50:0/937647406 >> v1:172.21.15.82:6789/0 conn(0x7f2f1c159bc0 legacy=0x7f2f1c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1bfff700 1 -- 172.21.15.50:0/937647406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c06b200 con 0x7f2f1c0ab040 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1affd700 1 -- 172.21.15.50:0/937647406 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371882396 0 0) 0x7f2f1c06b850 con 0x7f2f1c159bc0 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1bfff700 1 --2- 172.21.15.50:0/937647406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c0ca110 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cccb0 tx=0x7f2f14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b758e8697ebac70 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1affd700 1 -- 172.21.15.50:0/937647406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400e070 con 0x7f2f1c0ab040 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1affd700 1 -- 172.21.15.50:0/937647406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400bc30 con 0x7f2f1c0ab040 2023-12-24T19:51:44.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f1affd700 1 -- 172.21.15.50:0/937647406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14012430 con 0x7f2f1c0ab040 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 -- 172.21.15.50:0/937647406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 msgr2=0x7f2f1c0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 --2- 172.21.15.50:0/937647406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c0ca110 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cccb0 tx=0x7f2f14009780 comp rx=0 tx=0).stop 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 -- 172.21.15.50:0/937647406 shutdown_connections 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 --2- 172.21.15.50:0/937647406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c0ca110 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 --2- 172.21.15.50:0/937647406 >> v2:172.21.15.82:3300/0 conn(0x7f2f1c06bce0 0x7f2f1c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 -- 172.21.15.50:0/937647406 >> 172.21.15.50:0/937647406 conn(0x7f2f1c0cbba0 msgr2=0x7f2f1c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 -- 172.21.15.50:0/937647406 shutdown_connections 2023-12-24T19:51:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.679+0000 7f2f2206e700 1 -- 172.21.15.50:0/937647406 wait complete. 2023-12-24T19:51:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 Processor -- start 2023-12-24T19:51:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 -- start start 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c06bce0 0x7f2f1c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1c159bc0 0x7f2f1c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0abb00 con 0x7f2f1c0ab040 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c16dd00 con 0x7f2f1c06bce0 2023-12-24T19:51:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f2206e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c16d0f0 con 0x7f2f1c159bc0 2023-12-24T19:51:44.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40964/0 (socket says 172.21.15.50:40964) 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 -- 172.21.15.50:0/1583753349 learned_addr learned my addr 172.21.15.50:0/1583753349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f1b7fe700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c06bce0 0x7f2f1c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f1bfff700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1c159bc0 0x7f2f1c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 -- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1c159bc0 msgr2=0x7f2f1c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1c159bc0 0x7f2f1c15d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 -- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c06bce0 msgr2=0x7f2f1c0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c06bce0 0x7f2f1c0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 -- 172.21.15.50:0/1583753349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14009a20 con 0x7f2f1c0ab040 2023-12-24T19:51:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.683+0000 7f2f12ffd700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d860 tx=0x7f2f04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040125f0 con 0x7f2f1c0ab040 2023-12-24T19:51:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04012750 con 0x7f2f1c0ab040 2023-12-24T19:51:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04012b10 con 0x7f2f1c0ab040 2023-12-24T19:51:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c16d3d0 con 0x7f2f1c0ab040 2023-12-24T19:51:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c16d990 con 0x7f2f1c0ab040 2023-12-24T19:51:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c0652e0 con 0x7f2f1c0ab040 2023-12-24T19:51:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.687+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2f0401e460 con 0x7f2f1c0ab040 2023-12-24T19:51:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.691+0000 7f2f13fff700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.691+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f2f0407d0c0 con 0x7f2f1c0ab040 2023-12-24T19:51:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.691+0000 7f2f1b7fe700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.691+0000 7f2f1b7fe700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007fd0 tx=0x7f2f0c007d30 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:44.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.695+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f0404d340 con 0x7f2f1c0ab040 2023-12-24T19:51:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.863+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f1c06b4e0 con 0x7f2efc060550 2023-12-24T19:51:44.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.883+0000 7f2f13fff700 1 -- 172.21.15.50:0/1583753349 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275589 (secure 0 0 0) 0x7f2f1c06b4e0 con 0x7f2efc060550 2023-12-24T19:51:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 msgr2=0x7f2efc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007fd0 tx=0x7f2f0c007d30 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 msgr2=0x7f2f1c156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d860 tx=0x7f2f04008040 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 shutdown_connections 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f1c159bc0 0x7f2f1c15d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1c0ab040 0x7f2f1c156590 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 --2- 172.21.15.50:0/1583753349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c06bce0 0x7f2f1c0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 >> 172.21.15.50:0/1583753349 conn(0x7f2f1c0cbba0 msgr2=0x7f2f1c0c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 shutdown_connections 2023-12-24T19:51:44.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:44.891+0000 7f2f2206e700 1 -- 172.21.15.50:0/1583753349 wait complete. 2023-12-24T19:51:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:51:44.916 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T19:51:43.520090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":452,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2464316,"kb_used_data":16380,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752510404,"statfs":{"total":773094113280,"available":770570653696,"internally_reserved":0,"allocated":16773120,"data_stored":9231226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.938109"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430002+0000","last_change":"2023-12-24T19:51:40.423425+0000","last_active":"2023-12-24T19:51:40.430002+0000","last_peered":"2023-12-24T19:51:40.430002+0000","last_clean":"2023-12-24T19:51:40.430002+0000","last_became_active":"2023-12-24T19:51:40.423020+0000","last_became_peered":"2023-12-24T19:51:40.423020+0000","last_unstale":"2023-12-24T19:51:40.430002+0000","last_undegraded":"2023-12-24T19:51:40.430002+0000","last_fullsized":"2023-12-24T19:51:40.430002+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439630+0000","last_change":"2023-12-24T19:51:40.435820+0000","last_active":"2023-12-24T19:51:40.439630+0000","last_peered":"2023-12-24T19:51:40.439630+0000","last_clean":"2023-12-24T19:51:40.439630+0000","last_became_active":"2023-12-24T19:51:40.435487+0000","last_became_peered":"2023-12-24T19:51:40.435487+0000","last_unstale":"2023-12-24T19:51:40.439630+0000","last_undegraded":"2023-12-24T19:51:40.439630+0000","last_fullsized":"2023-12-24T19:51:40.439630+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:25.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442312+0000","last_change":"2023-12-24T19:51:40.439067+0000","last_active":"2023-12-24T19:51:40.442312+0000","last_peered":"2023-12-24T19:51:40.442312+0000","last_clean":"2023-12-24T19:51:40.442312+0000","last_became_active":"2023-12-24T19:51:40.437629+0000","last_became_peered":"2023-12-24T19:51:40.437629+0000","last_unstale":"2023-12-24T19:51:40.442312+0000","last_undegraded":"2023-12-24T19:51:40.442312+0000","last_fullsized":"2023-12-24T19:51:40.442312+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:01.896988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442661+0000","last_change":"2023-12-24T19:51:40.439954+0000","last_active":"2023-12-24T19:51:40.442661+0000","last_peered":"2023-12-24T19:51:40.442661+0000","last_clean":"2023-12-24T19:51:40.442661+0000","last_became_active":"2023-12-24T19:51:40.439679+0000","last_became_peered":"2023-12-24T19:51:40.439679+0000","last_unstale":"2023-12-24T19:51:40.442661+0000","last_undegraded":"2023-12-24T19:51:40.442661+0000","last_fullsized":"2023-12-24T19:51:40.442661+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:36.542056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443598+0000","last_change":"2023-12-24T19:51:40.441627+0000","last_active":"2023-12-24T19:51:40.443598+0000","last_peered":"2023-12-24T19:51:40.443598+0000","last_clean":"2023-12-24T19:51:40.443598+0000","last_became_active":"2023-12-24T19:51:40.440587+0000","last_became_peered":"2023-12-24T19:51:40.440587+0000","last_unstale":"2023-12-24T19:51:40.443598+0000","last_undegraded":"2023-12-24T19:51:40.443598+0000","last_fullsized":"2023-12-24T19:51:40.443598+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:50.426428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443559+0000","last_change":"2023-12-24T19:51:40.441435+0000","last_active":"2023-12-24T19:51:40.443559+0000","last_peered":"2023-12-24T19:51:40.443559+0000","last_clean":"2023-12-24T19:51:40.443559+0000","last_became_active":"2023-12-24T19:51:40.441142+0000","last_became_peered":"2023-12-24T19:51:40.441142+0000","last_unstale":"2023-12-24T19:51:40.443559+0000","last_undegraded":"2023-12-24T19:51:40.443559+0000","last_fullsized":"2023-12-24T19:51:40.443559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:46.386942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438746+0000","last_change":"2023-12-24T19:51:40.433297+0000","last_active":"2023-12-24T19:51:40.438746+0000","last_peered":"2023-12-24T19:51:40.438746+0000","last_clean":"2023-12-24T19:51:40.438746+0000","last_became_active":"2023-12-24T19:51:40.428557+0000","last_became_peered":"2023-12-24T19:51:40.428557+0000","last_unstale":"2023-12-24T19:51:40.438746+0000","last_undegraded":"2023-12-24T19:51:40.438746+0000","last_fullsized":"2023-12-24T19:51:40.438746+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440750+0000","last_change":"2023-12-24T19:51:40.434965+0000","last_active":"2023-12-24T19:51:40.440750+0000","last_peered":"2023-12-24T19:51:40.440750+0000","last_clean":"2023-12-24T19:51:40.440750+0000","last_became_active":"2023-12-24T19:51:40.430478+0000","last_became_peered":"2023-12-24T19:51:40.430478+0000","last_unstale":"2023-12-24T19:51:40.440750+0000","last_undegraded":"2023-12-24T19:51:40.440750+0000","last_fullsized":"2023-12-24T19:51:40.440750+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444261+0000","last_change":"2023-12-24T19:51:40.443021+0000","last_active":"2023-12-24T19:51:40.444261+0000","last_peered":"2023-12-24T19:51:40.444261+0000","last_clean":"2023-12-24T19:51:40.444261+0000","last_became_active":"2023-12-24T19:51:40.442698+0000","last_became_peered":"2023-12-24T19:51:40.442698+0000","last_unstale":"2023-12-24T19:51:40.444261+0000","last_undegraded":"2023-12-24T19:51:40.444261+0000","last_fullsized":"2023-12-24T19:51:40.444261+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631762+0000","last_change":"2023-12-24T19:51:39.614040+0000","last_active":"2023-12-24T19:51:40.631762+0000","last_peered":"2023-12-24T19:51:40.631762+0000","last_clean":"2023-12-24T19:51:40.631762+0000","last_became_active":"2023-12-24T19:51:39.613728+0000","last_became_peered":"2023-12-24T19:51:39.613728+0000","last_unstale":"2023-12-24T19:51:40.631762+0000","last_undegraded":"2023-12-24T19:51:40.631762+0000","last_fullsized":"2023-12-24T19:51:40.631762+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.524994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631702+0000","last_change":"2023-12-24T19:51:39.620796+0000","last_active":"2023-12-24T19:51:40.631702+0000","last_peered":"2023-12-24T19:51:40.631702+0000","last_clean":"2023-12-24T19:51:40.631702+0000","last_became_active":"2023-12-24T19:51:39.620494+0000","last_became_peered":"2023-12-24T19:51:39.620494+0000","last_unstale":"2023-12-24T19:51:40.631702+0000","last_undegraded":"2023-12-24T19:51:40.631702+0000","last_fullsized":"2023-12-24T19:51:40.631702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:45.369881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438765+0000","last_change":"2023-12-24T19:51:40.434720+0000","last_active":"2023-12-24T19:51:40.438765+0000","last_peered":"2023-12-24T19:51:40.438765+0000","last_clean":"2023-12-24T19:51:40.438765+0000","last_became_active":"2023-12-24T19:51:40.433651+0000","last_became_peered":"2023-12-24T19:51:40.433651+0000","last_unstale":"2023-12-24T19:51:40.438765+0000","last_undegraded":"2023-12-24T19:51:40.438765+0000","last_fullsized":"2023-12-24T19:51:40.438765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432720+0000","last_change":"2023-12-24T19:51:39.628949+0000","last_active":"2023-12-24T19:51:40.432720+0000","last_peered":"2023-12-24T19:51:40.432720+0000","last_clean":"2023-12-24T19:51:40.432720+0000","last_became_active":"2023-12-24T19:51:39.628339+0000","last_became_peered":"2023-12-24T19:51:39.628339+0000","last_unstale":"2023-12-24T19:51:40.432720+0000","last_undegraded":"2023-12-24T19:51:40.432720+0000","last_fullsized":"2023-12-24T19:51:40.432720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440701+0000","last_change":"2023-12-24T19:51:40.436559+0000","last_active":"2023-12-24T19:51:40.440701+0000","last_peered":"2023-12-24T19:51:40.440701+0000","last_clean":"2023-12-24T19:51:40.440701+0000","last_became_active":"2023-12-24T19:51:40.436138+0000","last_became_peered":"2023-12-24T19:51:40.436138+0000","last_unstale":"2023-12-24T19:51:40.440701+0000","last_undegraded":"2023-12-24T19:51:40.440701+0000","last_fullsized":"2023-12-24T19:51:40.440701+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:32.510531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440588+0000","last_change":"2023-12-24T19:51:40.436875+0000","last_active":"2023-12-24T19:51:40.440588+0000","last_peered":"2023-12-24T19:51:40.440588+0000","last_clean":"2023-12-24T19:51:40.440588+0000","last_became_active":"2023-12-24T19:51:40.436576+0000","last_became_peered":"2023-12-24T19:51:40.436576+0000","last_unstale":"2023-12-24T19:51:40.440588+0000","last_undegraded":"2023-12-24T19:51:40.440588+0000","last_fullsized":"2023-12-24T19:51:40.440588+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:25.727690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.635212+0000","last_change":"2023-12-24T19:51:39.622106+0000","last_active":"2023-12-24T19:51:40.635212+0000","last_peered":"2023-12-24T19:51:40.635212+0000","last_clean":"2023-12-24T19:51:40.635212+0000","last_became_active":"2023-12-24T19:51:39.621718+0000","last_became_peered":"2023-12-24T19:51:39.621718+0000","last_unstale":"2023-12-24T19:51:40.635212+0000","last_undegraded":"2023-12-24T19:51:40.635212+0000","last_fullsized":"2023-12-24T19:51:40.635212+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:39.191470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631043+0000","last_change":"2023-12-24T19:51:39.617148+0000","last_active":"2023-12-24T19:51:40.631043+0000","last_peered":"2023-12-24T19:51:40.631043+0000","last_clean":"2023-12-24T19:51:40.631043+0000","last_became_active":"2023-12-24T19:51:39.616836+0000","last_became_peered":"2023-12-24T19:51:39.616836+0000","last_unstale":"2023-12-24T19:51:40.631043+0000","last_undegraded":"2023-12-24T19:51:40.631043+0000","last_fullsized":"2023-12-24T19:51:40.631043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.415764+0000","last_change":"2023-12-24T19:51:39.620411+0000","last_active":"2023-12-24T19:51:40.415764+0000","last_peered":"2023-12-24T19:51:40.415764+0000","last_clean":"2023-12-24T19:51:40.415764+0000","last_became_active":"2023-12-24T19:51:39.619856+0000","last_became_peered":"2023-12-24T19:51:39.619856+0000","last_unstale":"2023-12-24T19:51:40.415764+0000","last_undegraded":"2023-12-24T19:51:40.415764+0000","last_fullsized":"2023-12-24T19:51:40.415764+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:51.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.421843+0000","last_change":"2023-12-24T19:51:40.420639+0000","last_active":"2023-12-24T19:51:40.421843+0000","last_peered":"2023-12-24T19:51:40.421843+0000","last_clean":"2023-12-24T19:51:40.421843+0000","last_became_active":"2023-12-24T19:51:40.420309+0000","last_became_peered":"2023-12-24T19:51:40.420309+0000","last_unstale":"2023-12-24T19:51:40.421843+0000","last_undegraded":"2023-12-24T19:51:40.421843+0000","last_fullsized":"2023-12-24T19:51:40.421843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438003+0000","last_change":"2023-12-24T19:51:40.427853+0000","last_active":"2023-12-24T19:51:40.438003+0000","last_peered":"2023-12-24T19:51:40.438003+0000","last_clean":"2023-12-24T19:51:40.438003+0000","last_became_active":"2023-12-24T19:51:40.427547+0000","last_became_peered":"2023-12-24T19:51:40.427547+0000","last_unstale":"2023-12-24T19:51:40.438003+0000","last_undegraded":"2023-12-24T19:51:40.438003+0000","last_fullsized":"2023-12-24T19:51:40.438003+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:11.645312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432612+0000","last_change":"2023-12-24T19:51:39.629814+0000","last_active":"2023-12-24T19:51:40.432612+0000","last_peered":"2023-12-24T19:51:40.432612+0000","last_clean":"2023-12-24T19:51:40.432612+0000","last_became_active":"2023-12-24T19:51:39.628065+0000","last_became_peered":"2023-12-24T19:51:39.628065+0000","last_unstale":"2023-12-24T19:51:40.432612+0000","last_undegraded":"2023-12-24T19:51:40.432612+0000","last_fullsized":"2023-12-24T19:51:40.432612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438879+0000","last_change":"2023-12-24T19:51:40.434532+0000","last_active":"2023-12-24T19:51:40.438879+0000","last_peered":"2023-12-24T19:51:40.438879+0000","last_clean":"2023-12-24T19:51:40.438879+0000","last_became_active":"2023-12-24T19:51:40.433863+0000","last_became_peered":"2023-12-24T19:51:40.433863+0000","last_unstale":"2023-12-24T19:51:40.438879+0000","last_undegraded":"2023-12-24T19:51:40.438879+0000","last_fullsized":"2023-12-24T19:51:40.438879+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.433449+0000","last_change":"2023-12-24T19:51:39.628603+0000","last_active":"2023-12-24T19:51:40.433449+0000","last_peered":"2023-12-24T19:51:40.433449+0000","last_clean":"2023-12-24T19:51:40.433449+0000","last_became_active":"2023-12-24T19:51:39.628257+0000","last_became_peered":"2023-12-24T19:51:39.628257+0000","last_unstale":"2023-12-24T19:51:40.433449+0000","last_undegraded":"2023-12-24T19:51:40.433449+0000","last_fullsized":"2023-12-24T19:51:40.433449+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442421+0000","last_change":"2023-12-24T19:51:40.438807+0000","last_active":"2023-12-24T19:51:40.442421+0000","last_peered":"2023-12-24T19:51:40.442421+0000","last_clean":"2023-12-24T19:51:40.442421+0000","last_became_active":"2023-12-24T19:51:40.438483+0000","last_became_peered":"2023-12-24T19:51:40.438483+0000","last_unstale":"2023-12-24T19:51:40.442421+0000","last_undegraded":"2023-12-24T19:51:40.442421+0000","last_fullsized":"2023-12-24T19:51:40.442421+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:07.744878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440201+0000","last_change":"2023-12-24T19:51:40.435720+0000","last_active":"2023-12-24T19:51:40.440201+0000","last_peered":"2023-12-24T19:51:40.440201+0000","last_clean":"2023-12-24T19:51:40.440201+0000","last_became_active":"2023-12-24T19:51:40.435390+0000","last_became_peered":"2023-12-24T19:51:40.435390+0000","last_unstale":"2023-12-24T19:51:40.440201+0000","last_undegraded":"2023-12-24T19:51:40.440201+0000","last_fullsized":"2023-12-24T19:51:40.440201+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:33.113558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442627+0000","last_change":"2023-12-24T19:51:40.439935+0000","last_active":"2023-12-24T19:51:40.442627+0000","last_peered":"2023-12-24T19:51:40.442627+0000","last_clean":"2023-12-24T19:51:40.442627+0000","last_became_active":"2023-12-24T19:51:40.439680+0000","last_became_peered":"2023-12-24T19:51:40.439680+0000","last_unstale":"2023-12-24T19:51:40.442627+0000","last_undegraded":"2023-12-24T19:51:40.442627+0000","last_fullsized":"2023-12-24T19:51:40.442627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:15.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432963+0000","last_change":"2023-12-24T19:51:39.625890+0000","last_active":"2023-12-24T19:51:40.432963+0000","last_peered":"2023-12-24T19:51:40.432963+0000","last_clean":"2023-12-24T19:51:40.432963+0000","last_became_active":"2023-12-24T19:51:39.625588+0000","last_became_peered":"2023-12-24T19:51:39.625588+0000","last_unstale":"2023-12-24T19:51:40.432963+0000","last_undegraded":"2023-12-24T19:51:40.432963+0000","last_fullsized":"2023-12-24T19:51:40.432963+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417885+0000","last_change":"2023-12-24T19:51:39.617606+0000","last_active":"2023-12-24T19:51:40.417885+0000","last_peered":"2023-12-24T19:51:40.417885+0000","last_clean":"2023-12-24T19:51:40.417885+0000","last_became_active":"2023-12-24T19:51:39.617301+0000","last_became_peered":"2023-12-24T19:51:39.617301+0000","last_unstale":"2023-12-24T19:51:40.417885+0000","last_undegraded":"2023-12-24T19:51:40.417885+0000","last_fullsized":"2023-12-24T19:51:40.417885+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:14.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":814,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-12-24T19:51:36.852946+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:51:36.852946+0000","last_peered":"2023-12-24T19:51:36.852946+0000","last_clean":"2023-12-24T19:51:36.852946+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:51:36.852946+0000","last_undegraded":"2023-12-24T19:51:36.852946+0000","last_fullsized":"2023-12-24T19:51:36.852946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":20,"acting":20,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072084,"statfs":{"total":96636764160,"available":96329814016,"internally_reserved":0,"allocated":2527232,"data_stored":1589468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1719999999999999,"15min":1.1759999999999999},"min":{"1min":0.83299999999999996,"5min":0.65300000000000002,"15min":0.58899999999999997},"max":{"1min":1.639,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2,"15min":1.202},"min":{"1min":1.0760000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5269999999999999,"5min":1.7230000000000001,"15min":1.804},"last":1.216}]},{"osd":1,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.1839999999999999},"min":{"1min":0.82699999999999996,"5min":0.80500000000000005,"15min":0.73899999999999999},"max":{"1min":1.645,"5min":1.645,"15min":1.702},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.2450000000000001},"min":{"1min":1.02,"5min":0.84799999999999998,"15min":0.80200000000000005},"max":{"1min":1.484,"5min":1.6180000000000001,"15min":1.788},"last":0.871}]},{"osd":2,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.2689999999999999,"15min":1.2470000000000001},"min":{"1min":0.98699999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.74,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.2569999999999999,"15min":1.2509999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.82999999999999996},"max":{"1min":1.472,"5min":1.726,"15min":1.79},"last":1.0640000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3109999999999999,"15min":1.3069999999999999},"min":{"1min":0.95499999999999996,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.5189999999999999,"5min":1.7569999999999999,"15min":1.77},"last":1.272},{"interface":"front","average":{"1min":1.319,"5min":1.3260000000000001,"15min":1.3220000000000001},"min":{"1min":0.997,"5min":0.98099999999999998,"15min":0.93500000000000005},"max":{"1min":1.593,"5min":1.829,"15min":1.829},"last":1.6259999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.669,"5min":1.7969999999999999,"15min":1.883},"last":1.331},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2629999999999999,"15min":1.248},"min":{"1min":0.85399999999999998,"5min":0.81200000000000006,"15min":0.73199999999999998},"max":{"1min":1.673,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.5469999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.28},"min":{"1min":1.0740000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7110000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3620000000000001},"min":{"1min":1.069,"5min":0.88100000000000001,"15min":0.80700000000000005},"max":{"1min":1.5920000000000001,"5min":1.853,"15min":2.0609999999999999},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4470000000000001,"15min":1.4299999999999999},"min":{"1min":1.248,"5min":1.024,"15min":0.871},"max":{"1min":1.752,"5min":1.909,"15min":1.97},"last":1.839},{"interface":"front","average":{"1min":1.47,"5min":1.4390000000000001,"15min":1.419},"min":{"1min":1.115,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.954,"15min":1.954},"last":1.671}]}]},{"osd":6,"up_from":13,"seq":55834575747,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315560,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056280,"statfs":{"total":96636764160,"available":96313630720,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.93600000000000005,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.4990000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.458},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.389,"15min":1.377},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.704,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.504}]},{"osd":1,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.80900000000000005,"5min":0.78000000000000003,"15min":0.624},"max":{"1min":1.659,"5min":1.659,"15min":2.089},"last":1.212},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.65700000000000003},"max":{"1min":1.6399999999999999,"5min":2.569,"15min":2.569},"last":1.2689999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.224,"15min":1.2130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.145},{"interface":"front","average":{"1min":1.298,"5min":1.282,"15min":1.2809999999999999},"min":{"1min":0.95299999999999996,"5min":0.878,"15min":0.82899999999999996},"max":{"1min":1.5860000000000001,"5min":1.7,"15min":1.7789999999999999},"last":1.6859999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3029999999999999,"15min":1.3129999999999999},"min":{"1min":0.97099999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.673,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.323,"15min":1.296},"min":{"1min":1.042,"5min":0.97099999999999997,"15min":0.83499999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.8720000000000001},"last":1.3280000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1990000000000001,"15min":1.196},"min":{"1min":0.876,"5min":0.82799999999999996,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.762,"15min":2.0510000000000002},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3109999999999999,"15min":1.2649999999999999},"min":{"1min":0.88100000000000001,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.8080000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.7050000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.2629999999999999},"min":{"1min":0.92700000000000005,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.873,"5min":2.359,"15min":2.359},"last":1.425},{"interface":"front","average":{"1min":1.431,"5min":1.401,"15min":1.365},"min":{"1min":1.052,"5min":0.94199999999999995,"15min":0.66100000000000003},"max":{"1min":1.6439999999999999,"5min":1.79,"15min":2.1859999999999999},"last":1.5649999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4710000000000001,"15min":1.415},"min":{"1min":1.2869999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.79,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4510000000000001,"15min":1.411},"min":{"1min":0.98699999999999999,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.9379999999999999,"5min":2.524,"15min":2.524},"last":1.534}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307368,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.1559999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.349}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.25}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.1220000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.5}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.6719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311464,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060376,"statfs":{"total":96636764160,"available":96317825024,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.254},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.67600000000000005},"max":{"1min":1.4670000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.2789999999999999},"min":{"1min":1.0720000000000001,"5min":0.84099999999999997,"15min":0.58399999999999996},"max":{"1min":1.5509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.873,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":1.4299999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1499999999999999,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.70499999999999996,"15min":0.60199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.7909999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3580000000000001,"15min":1.353},"min":{"1min":1.0449999999999999,"5min":0.94899999999999995,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3440000000000001,"15min":1.3460000000000001},"min":{"1min":1.0149999999999999,"5min":0.77800000000000002,"15min":0.66100000000000003},"max":{"1min":1.706,"5min":1.829,"15min":1.829},"last":2.121}]},{"osd":3,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":0.92600000000000005,"5min":0.83299999999999996,"15min":0.46400000000000002},"max":{"1min":1.4670000000000001,"5min":1.792,"15min":1.792},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":1.0660000000000001,"5min":0.88400000000000001,"15min":0.63900000000000001},"max":{"1min":1.631,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.712}]},{"osd":5,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":1.599,"5min":1.744,"15min":1.879},"last":1.669},{"interface":"front","average":{"1min":1.266,"5min":1.339,"15min":1.321},"min":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.8779999999999999,"15min":1.9159999999999999},"last":2.0779999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.256},"min":{"1min":0.79900000000000004,"5min":0.69399999999999995,"15min":0.56000000000000005},"max":{"1min":1.7350000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.952},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.331,"15min":1.3169999999999999},"min":{"1min":0.93200000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.798,"5min":1.887,"15min":1.887},"last":1.2569999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2829999999999999,"15min":1.27},"min":{"1min":0.77900000000000003,"5min":0.60699999999999998,"15min":0.54500000000000004},"max":{"1min":1.863,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.47},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4470000000000001,"15min":1.417},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.831,"5min":2,"15min":2},"last":1.843}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311528,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060312,"statfs":{"total":96636764160,"available":96317759488,"internally_reserved":0,"allocated":1998848,"data_stored":1028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.96399999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.2070000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.026}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.175},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.409}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.097}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311464,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060376,"statfs":{"total":96636764160,"available":96317825024,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.871},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":1.1759999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.2230000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.446},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.8600000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.276},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.669}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.744},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.3129999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.542},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.964}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.421,"15min":1.647},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.147,"15min":1.1499999999999999},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.087}]},{"osd":2,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0209999999999999,"15min":0.99399999999999999},"min":{"1min":0.754,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1479999999999999,"15min":1.1220000000000001},"min":{"1min":0.86799999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.034}]},{"osd":3,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.298,"15min":1.2729999999999999},"min":{"1min":0.98699999999999999,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.127,"15min":1.137},"min":{"1min":0.89400000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.823},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.298,"15min":1.282},"min":{"1min":1.083,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.6619999999999999,"5min":1.883,"15min":1.883},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.4370000000000001,"15min":1.4239999999999999},"min":{"1min":1.1859999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.849,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.405,"15min":1.403},"min":{"1min":1.0980000000000001,"5min":1.016,"15min":0.96499999999999997},"max":{"1min":1.7849999999999999,"5min":1.806,"15min":1.948},"last":1.351},{"interface":"front","average":{"1min":1.387,"5min":1.395,"15min":1.3839999999999999},"min":{"1min":1.099,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7909999999999999,"5min":1.843,"15min":2.2189999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.516,"15min":1.506},"min":{"1min":1.1299999999999999,"5min":1.0189999999999999,"15min":1.0089999999999999},"max":{"1min":1.944,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5069999999999999,"15min":1.498},"min":{"1min":1.103,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.9570000000000001,"5min":2.1339999999999999,"15min":2.323},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.554,"15min":1.548},"min":{"1min":1.2849999999999999,"5min":0.999,"15min":0.999},"max":{"1min":2.0840000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5389999999999999,"15min":1.512},"min":{"1min":1.268,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0009999999999999,"5min":2.532,"15min":2.532},"last":1.7250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072084,"statfs":{"total":96636764160,"available":96329814016,"internally_reserved":0,"allocated":2527232,"data_stored":1589468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.363,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.046,"15min":1.012},"min":{"1min":0.76100000000000001,"5min":0.50800000000000001,"15min":0.504},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.071,"15min":1.093},"min":{"1min":0.80400000000000005,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.4690000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.248},{"interface":"front","average":{"1min":1.103,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.74099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5980000000000001,"5min":1.663,"15min":1.833},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.0660000000000001},"min":{"1min":0.83899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5249999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.747},{"interface":"front","average":{"1min":1.296,"5min":1.258,"15min":1.272},"min":{"1min":0.92000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.732,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.401,"15min":1.379},"min":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.88200000000000001},"max":{"1min":1.6299999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.206},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3149999999999999},"min":{"1min":1.008,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.1399999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4350000000000001,"15min":1.4259999999999999},"min":{"1min":1.1699999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.6899999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.554},{"interface":"front","average":{"1min":1.419,"5min":1.4350000000000001,"15min":1.4390000000000001},"min":{"1min":1.123,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7110000000000001,"5min":2.0830000000000002,"15min":2.2989999999999999},"last":1.282}]},{"osd":6,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":1.073,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.677,"5min":1.873,"15min":1.964},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4830000000000001,"15min":1.4950000000000001},"min":{"1min":1.3009999999999999,"5min":1,"15min":1},"max":{"1min":1.8220000000000001,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.7390000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.514,"15min":1.522},"min":{"1min":1.254,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7470000000000001,"5min":2.46,"15min":2.46},"last":1.331},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4650000000000001,"15min":1.4690000000000001},"min":{"1min":1.2649999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9590000000000001,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.304}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:51:44.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:51:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.123+0000 7f0428c16700 1 Processor -- start 2023-12-24T19:51:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0428c16700 1 -- start start 2023-12-24T19:51:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0428c16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f042406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0428c16700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240a9c80 con 0x7f042406b6c0 2023-12-24T19:51:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0428c16700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240a9070 con 0x7f0424158cd0 2023-12-24T19:51:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0428c16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240a9350 con 0x7f04241590a0 2023-12-24T19:51:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f041affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f042406b6c0 0x7f042406c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34532/0 (socket says 172.21.15.50:34532) 2023-12-24T19:51:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f041affd700 1 -- 172.21.15.50:0/4039293831 learned_addr learned my addr 172.21.15.50:0/4039293831 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0423fff700 1 --2- 172.21.15.50:0/4039293831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f042406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230857188 0 0) 0x7f04240a9c80 con 0x7f042406b6c0 2023-12-24T19:51:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0410003570 con 0x7f042406b6c0 2023-12-24T19:51:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470429923 0 0) 0x7f04240a9070 con 0x7f0424158cd0 2023-12-24T19:51:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04240a9c80 con 0x7f0424158cd0 2023-12-24T19:51:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0423fff700 1 -- 172.21.15.50:0/4039293831 >> v1:172.21.15.82:6789/0 conn(0x7f0424158cd0 legacy=0x7f042406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0423fff700 1 -- 172.21.15.50:0/4039293831 >> v1:172.21.15.50:6789/0 conn(0x7f042406b6c0 legacy=0x7f042406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.127+0000 7f0423fff700 1 -- 172.21.15.50:0/4039293831 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240a9630 con 0x7f04241590a0 2023-12-24T19:51:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0423fff700 1 --2- 172.21.15.50:0/4039293831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f042406c0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e90 tx=0x7f041c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de9cd18898adda1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00e070 con 0x7f04241590a0 2023-12-24T19:51:45.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00bb80 con 0x7f04241590a0 2023-12-24T19:51:45.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0422ffd700 1 -- 172.21.15.50:0/4039293831 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c012430 con 0x7f04241590a0 2023-12-24T19:51:45.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 -- 172.21.15.50:0/4039293831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 msgr2=0x7f042406c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 --2- 172.21.15.50:0/4039293831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f042406c0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e90 tx=0x7f041c009780 comp rx=0 tx=0).stop 2023-12-24T19:51:45.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 -- 172.21.15.50:0/4039293831 shutdown_connections 2023-12-24T19:51:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 --2- 172.21.15.50:0/4039293831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f042406c0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 -- 172.21.15.50:0/4039293831 >> 172.21.15.50:0/4039293831 conn(0x7f0424067b80 msgr2=0x7f04240cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 -- 172.21.15.50:0/4039293831 shutdown_connections 2023-12-24T19:51:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.131+0000 7f0428c16700 1 -- 172.21.15.50:0/4039293831 wait complete. 2023-12-24T19:51:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 Processor -- start 2023-12-24T19:51:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 -- start start 2023-12-24T19:51:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042406b6c0 0x7f0424149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f04240ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424157110 con 0x7f0424158cd0 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424156500 con 0x7f042406b6c0 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f0428c16700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04241567e0 con 0x7f04241590a0 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f041affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f041affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40970/0 (socket says 172.21.15.50:40970) 2023-12-24T19:51:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f041affd700 1 -- 172.21.15.50:0/3271648257 learned_addr learned my addr 172.21.15.50:0/3271648257 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.135+0000 7f04237fe700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042406b6c0 0x7f0424149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f0423fff700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f04240ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 -- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 msgr2=0x7f04240ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f04240ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 -- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042406b6c0 msgr2=0x7f0424149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042406b6c0 0x7f0424149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 -- 172.21.15.50:0/3271648257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009a20 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f0423fff700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f04240ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041affd700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c790 tx=0x7f040c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c005b30 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c005cd0 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424156ac0 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c007320 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424149ac0 con 0x7f0424158cd0 2023-12-24T19:51:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.139+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0424157280 con 0x7f0424158cd0 2023-12-24T19:51:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.143+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f040c012400 con 0x7f0424158cd0 2023-12-24T19:51:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.143+0000 7f041bfff700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 0x7f0404062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.143+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f040c07bec0 con 0x7f0424158cd0 2023-12-24T19:51:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.143+0000 7f04237fe700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 0x7f0404062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.147+0000 7f04237fe700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 0x7f0404062ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0414007fd0 tx=0x7f0414007d50 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.151+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f040c049be0 con 0x7f0424158cd0 2023-12-24T19:51:45.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.319+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f042406bd90 con 0x7f0404060620 2023-12-24T19:51:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.327+0000 7f041bfff700 1 -- 172.21.15.50:0/3271648257 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275589 (secure 0 0 0) 0x7f042406bd90 con 0x7f0404060620 2023-12-24T19:51:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 msgr2=0x7f0404062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 0x7f0404062ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0414007fd0 tx=0x7f0414007d50 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 msgr2=0x7f04240acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c790 tx=0x7f040c007e80 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 shutdown_connections 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0404060620 0x7f0404062ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04241590a0 0x7f04240ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0424158cd0 0x7f04240acb40 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 --2- 172.21.15.50:0/3271648257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042406b6c0 0x7f0424149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 >> 172.21.15.50:0/3271648257 conn(0x7f0424067b80 msgr2=0x7f04240caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 shutdown_connections 2023-12-24T19:51:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.335+0000 7f0428c16700 1 -- 172.21.15.50:0/3271648257 wait complete. 2023-12-24T19:51:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:51:45.360 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T19:51:43.520090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":452,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2464316,"kb_used_data":16380,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752510404,"statfs":{"total":773094113280,"available":770570653696,"internally_reserved":0,"allocated":16773120,"data_stored":9231226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.938109"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430002+0000","last_change":"2023-12-24T19:51:40.423425+0000","last_active":"2023-12-24T19:51:40.430002+0000","last_peered":"2023-12-24T19:51:40.430002+0000","last_clean":"2023-12-24T19:51:40.430002+0000","last_became_active":"2023-12-24T19:51:40.423020+0000","last_became_peered":"2023-12-24T19:51:40.423020+0000","last_unstale":"2023-12-24T19:51:40.430002+0000","last_undegraded":"2023-12-24T19:51:40.430002+0000","last_fullsized":"2023-12-24T19:51:40.430002+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439630+0000","last_change":"2023-12-24T19:51:40.435820+0000","last_active":"2023-12-24T19:51:40.439630+0000","last_peered":"2023-12-24T19:51:40.439630+0000","last_clean":"2023-12-24T19:51:40.439630+0000","last_became_active":"2023-12-24T19:51:40.435487+0000","last_became_peered":"2023-12-24T19:51:40.435487+0000","last_unstale":"2023-12-24T19:51:40.439630+0000","last_undegraded":"2023-12-24T19:51:40.439630+0000","last_fullsized":"2023-12-24T19:51:40.439630+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:25.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442312+0000","last_change":"2023-12-24T19:51:40.439067+0000","last_active":"2023-12-24T19:51:40.442312+0000","last_peered":"2023-12-24T19:51:40.442312+0000","last_clean":"2023-12-24T19:51:40.442312+0000","last_became_active":"2023-12-24T19:51:40.437629+0000","last_became_peered":"2023-12-24T19:51:40.437629+0000","last_unstale":"2023-12-24T19:51:40.442312+0000","last_undegraded":"2023-12-24T19:51:40.442312+0000","last_fullsized":"2023-12-24T19:51:40.442312+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:01.896988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442661+0000","last_change":"2023-12-24T19:51:40.439954+0000","last_active":"2023-12-24T19:51:40.442661+0000","last_peered":"2023-12-24T19:51:40.442661+0000","last_clean":"2023-12-24T19:51:40.442661+0000","last_became_active":"2023-12-24T19:51:40.439679+0000","last_became_peered":"2023-12-24T19:51:40.439679+0000","last_unstale":"2023-12-24T19:51:40.442661+0000","last_undegraded":"2023-12-24T19:51:40.442661+0000","last_fullsized":"2023-12-24T19:51:40.442661+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:36.542056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443598+0000","last_change":"2023-12-24T19:51:40.441627+0000","last_active":"2023-12-24T19:51:40.443598+0000","last_peered":"2023-12-24T19:51:40.443598+0000","last_clean":"2023-12-24T19:51:40.443598+0000","last_became_active":"2023-12-24T19:51:40.440587+0000","last_became_peered":"2023-12-24T19:51:40.440587+0000","last_unstale":"2023-12-24T19:51:40.443598+0000","last_undegraded":"2023-12-24T19:51:40.443598+0000","last_fullsized":"2023-12-24T19:51:40.443598+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:50.426428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443559+0000","last_change":"2023-12-24T19:51:40.441435+0000","last_active":"2023-12-24T19:51:40.443559+0000","last_peered":"2023-12-24T19:51:40.443559+0000","last_clean":"2023-12-24T19:51:40.443559+0000","last_became_active":"2023-12-24T19:51:40.441142+0000","last_became_peered":"2023-12-24T19:51:40.441142+0000","last_unstale":"2023-12-24T19:51:40.443559+0000","last_undegraded":"2023-12-24T19:51:40.443559+0000","last_fullsized":"2023-12-24T19:51:40.443559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:46.386942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438746+0000","last_change":"2023-12-24T19:51:40.433297+0000","last_active":"2023-12-24T19:51:40.438746+0000","last_peered":"2023-12-24T19:51:40.438746+0000","last_clean":"2023-12-24T19:51:40.438746+0000","last_became_active":"2023-12-24T19:51:40.428557+0000","last_became_peered":"2023-12-24T19:51:40.428557+0000","last_unstale":"2023-12-24T19:51:40.438746+0000","last_undegraded":"2023-12-24T19:51:40.438746+0000","last_fullsized":"2023-12-24T19:51:40.438746+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440750+0000","last_change":"2023-12-24T19:51:40.434965+0000","last_active":"2023-12-24T19:51:40.440750+0000","last_peered":"2023-12-24T19:51:40.440750+0000","last_clean":"2023-12-24T19:51:40.440750+0000","last_became_active":"2023-12-24T19:51:40.430478+0000","last_became_peered":"2023-12-24T19:51:40.430478+0000","last_unstale":"2023-12-24T19:51:40.440750+0000","last_undegraded":"2023-12-24T19:51:40.440750+0000","last_fullsized":"2023-12-24T19:51:40.440750+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444261+0000","last_change":"2023-12-24T19:51:40.443021+0000","last_active":"2023-12-24T19:51:40.444261+0000","last_peered":"2023-12-24T19:51:40.444261+0000","last_clean":"2023-12-24T19:51:40.444261+0000","last_became_active":"2023-12-24T19:51:40.442698+0000","last_became_peered":"2023-12-24T19:51:40.442698+0000","last_unstale":"2023-12-24T19:51:40.444261+0000","last_undegraded":"2023-12-24T19:51:40.444261+0000","last_fullsized":"2023-12-24T19:51:40.444261+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631762+0000","last_change":"2023-12-24T19:51:39.614040+0000","last_active":"2023-12-24T19:51:40.631762+0000","last_peered":"2023-12-24T19:51:40.631762+0000","last_clean":"2023-12-24T19:51:40.631762+0000","last_became_active":"2023-12-24T19:51:39.613728+0000","last_became_peered":"2023-12-24T19:51:39.613728+0000","last_unstale":"2023-12-24T19:51:40.631762+0000","last_undegraded":"2023-12-24T19:51:40.631762+0000","last_fullsized":"2023-12-24T19:51:40.631762+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.524994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631702+0000","last_change":"2023-12-24T19:51:39.620796+0000","last_active":"2023-12-24T19:51:40.631702+0000","last_peered":"2023-12-24T19:51:40.631702+0000","last_clean":"2023-12-24T19:51:40.631702+0000","last_became_active":"2023-12-24T19:51:39.620494+0000","last_became_peered":"2023-12-24T19:51:39.620494+0000","last_unstale":"2023-12-24T19:51:40.631702+0000","last_undegraded":"2023-12-24T19:51:40.631702+0000","last_fullsized":"2023-12-24T19:51:40.631702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:45.369881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438765+0000","last_change":"2023-12-24T19:51:40.434720+0000","last_active":"2023-12-24T19:51:40.438765+0000","last_peered":"2023-12-24T19:51:40.438765+0000","last_clean":"2023-12-24T19:51:40.438765+0000","last_became_active":"2023-12-24T19:51:40.433651+0000","last_became_peered":"2023-12-24T19:51:40.433651+0000","last_unstale":"2023-12-24T19:51:40.438765+0000","last_undegraded":"2023-12-24T19:51:40.438765+0000","last_fullsized":"2023-12-24T19:51:40.438765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432720+0000","last_change":"2023-12-24T19:51:39.628949+0000","last_active":"2023-12-24T19:51:40.432720+0000","last_peered":"2023-12-24T19:51:40.432720+0000","last_clean":"2023-12-24T19:51:40.432720+0000","last_became_active":"2023-12-24T19:51:39.628339+0000","last_became_peered":"2023-12-24T19:51:39.628339+0000","last_unstale":"2023-12-24T19:51:40.432720+0000","last_undegraded":"2023-12-24T19:51:40.432720+0000","last_fullsized":"2023-12-24T19:51:40.432720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440701+0000","last_change":"2023-12-24T19:51:40.436559+0000","last_active":"2023-12-24T19:51:40.440701+0000","last_peered":"2023-12-24T19:51:40.440701+0000","last_clean":"2023-12-24T19:51:40.440701+0000","last_became_active":"2023-12-24T19:51:40.436138+0000","last_became_peered":"2023-12-24T19:51:40.436138+0000","last_unstale":"2023-12-24T19:51:40.440701+0000","last_undegraded":"2023-12-24T19:51:40.440701+0000","last_fullsized":"2023-12-24T19:51:40.440701+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:32.510531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440588+0000","last_change":"2023-12-24T19:51:40.436875+0000","last_active":"2023-12-24T19:51:40.440588+0000","last_peered":"2023-12-24T19:51:40.440588+0000","last_clean":"2023-12-24T19:51:40.440588+0000","last_became_active":"2023-12-24T19:51:40.436576+0000","last_became_peered":"2023-12-24T19:51:40.436576+0000","last_unstale":"2023-12-24T19:51:40.440588+0000","last_undegraded":"2023-12-24T19:51:40.440588+0000","last_fullsized":"2023-12-24T19:51:40.440588+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:25.727690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.635212+0000","last_change":"2023-12-24T19:51:39.622106+0000","last_active":"2023-12-24T19:51:40.635212+0000","last_peered":"2023-12-24T19:51:40.635212+0000","last_clean":"2023-12-24T19:51:40.635212+0000","last_became_active":"2023-12-24T19:51:39.621718+0000","last_became_peered":"2023-12-24T19:51:39.621718+0000","last_unstale":"2023-12-24T19:51:40.635212+0000","last_undegraded":"2023-12-24T19:51:40.635212+0000","last_fullsized":"2023-12-24T19:51:40.635212+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:39.191470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631043+0000","last_change":"2023-12-24T19:51:39.617148+0000","last_active":"2023-12-24T19:51:40.631043+0000","last_peered":"2023-12-24T19:51:40.631043+0000","last_clean":"2023-12-24T19:51:40.631043+0000","last_became_active":"2023-12-24T19:51:39.616836+0000","last_became_peered":"2023-12-24T19:51:39.616836+0000","last_unstale":"2023-12-24T19:51:40.631043+0000","last_undegraded":"2023-12-24T19:51:40.631043+0000","last_fullsized":"2023-12-24T19:51:40.631043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.415764+0000","last_change":"2023-12-24T19:51:39.620411+0000","last_active":"2023-12-24T19:51:40.415764+0000","last_peered":"2023-12-24T19:51:40.415764+0000","last_clean":"2023-12-24T19:51:40.415764+0000","last_became_active":"2023-12-24T19:51:39.619856+0000","last_became_peered":"2023-12-24T19:51:39.619856+0000","last_unstale":"2023-12-24T19:51:40.415764+0000","last_undegraded":"2023-12-24T19:51:40.415764+0000","last_fullsized":"2023-12-24T19:51:40.415764+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:51.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.421843+0000","last_change":"2023-12-24T19:51:40.420639+0000","last_active":"2023-12-24T19:51:40.421843+0000","last_peered":"2023-12-24T19:51:40.421843+0000","last_clean":"2023-12-24T19:51:40.421843+0000","last_became_active":"2023-12-24T19:51:40.420309+0000","last_became_peered":"2023-12-24T19:51:40.420309+0000","last_unstale":"2023-12-24T19:51:40.421843+0000","last_undegraded":"2023-12-24T19:51:40.421843+0000","last_fullsized":"2023-12-24T19:51:40.421843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438003+0000","last_change":"2023-12-24T19:51:40.427853+0000","last_active":"2023-12-24T19:51:40.438003+0000","last_peered":"2023-12-24T19:51:40.438003+0000","last_clean":"2023-12-24T19:51:40.438003+0000","last_became_active":"2023-12-24T19:51:40.427547+0000","last_became_peered":"2023-12-24T19:51:40.427547+0000","last_unstale":"2023-12-24T19:51:40.438003+0000","last_undegraded":"2023-12-24T19:51:40.438003+0000","last_fullsized":"2023-12-24T19:51:40.438003+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:11.645312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432612+0000","last_change":"2023-12-24T19:51:39.629814+0000","last_active":"2023-12-24T19:51:40.432612+0000","last_peered":"2023-12-24T19:51:40.432612+0000","last_clean":"2023-12-24T19:51:40.432612+0000","last_became_active":"2023-12-24T19:51:39.628065+0000","last_became_peered":"2023-12-24T19:51:39.628065+0000","last_unstale":"2023-12-24T19:51:40.432612+0000","last_undegraded":"2023-12-24T19:51:40.432612+0000","last_fullsized":"2023-12-24T19:51:40.432612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438879+0000","last_change":"2023-12-24T19:51:40.434532+0000","last_active":"2023-12-24T19:51:40.438879+0000","last_peered":"2023-12-24T19:51:40.438879+0000","last_clean":"2023-12-24T19:51:40.438879+0000","last_became_active":"2023-12-24T19:51:40.433863+0000","last_became_peered":"2023-12-24T19:51:40.433863+0000","last_unstale":"2023-12-24T19:51:40.438879+0000","last_undegraded":"2023-12-24T19:51:40.438879+0000","last_fullsized":"2023-12-24T19:51:40.438879+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.433449+0000","last_change":"2023-12-24T19:51:39.628603+0000","last_active":"2023-12-24T19:51:40.433449+0000","last_peered":"2023-12-24T19:51:40.433449+0000","last_clean":"2023-12-24T19:51:40.433449+0000","last_became_active":"2023-12-24T19:51:39.628257+0000","last_became_peered":"2023-12-24T19:51:39.628257+0000","last_unstale":"2023-12-24T19:51:40.433449+0000","last_undegraded":"2023-12-24T19:51:40.433449+0000","last_fullsized":"2023-12-24T19:51:40.433449+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442421+0000","last_change":"2023-12-24T19:51:40.438807+0000","last_active":"2023-12-24T19:51:40.442421+0000","last_peered":"2023-12-24T19:51:40.442421+0000","last_clean":"2023-12-24T19:51:40.442421+0000","last_became_active":"2023-12-24T19:51:40.438483+0000","last_became_peered":"2023-12-24T19:51:40.438483+0000","last_unstale":"2023-12-24T19:51:40.442421+0000","last_undegraded":"2023-12-24T19:51:40.442421+0000","last_fullsized":"2023-12-24T19:51:40.442421+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:07.744878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440201+0000","last_change":"2023-12-24T19:51:40.435720+0000","last_active":"2023-12-24T19:51:40.440201+0000","last_peered":"2023-12-24T19:51:40.440201+0000","last_clean":"2023-12-24T19:51:40.440201+0000","last_became_active":"2023-12-24T19:51:40.435390+0000","last_became_peered":"2023-12-24T19:51:40.435390+0000","last_unstale":"2023-12-24T19:51:40.440201+0000","last_undegraded":"2023-12-24T19:51:40.440201+0000","last_fullsized":"2023-12-24T19:51:40.440201+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:33.113558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442627+0000","last_change":"2023-12-24T19:51:40.439935+0000","last_active":"2023-12-24T19:51:40.442627+0000","last_peered":"2023-12-24T19:51:40.442627+0000","last_clean":"2023-12-24T19:51:40.442627+0000","last_became_active":"2023-12-24T19:51:40.439680+0000","last_became_peered":"2023-12-24T19:51:40.439680+0000","last_unstale":"2023-12-24T19:51:40.442627+0000","last_undegraded":"2023-12-24T19:51:40.442627+0000","last_fullsized":"2023-12-24T19:51:40.442627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:15.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432963+0000","last_change":"2023-12-24T19:51:39.625890+0000","last_active":"2023-12-24T19:51:40.432963+0000","last_peered":"2023-12-24T19:51:40.432963+0000","last_clean":"2023-12-24T19:51:40.432963+0000","last_became_active":"2023-12-24T19:51:39.625588+0000","last_became_peered":"2023-12-24T19:51:39.625588+0000","last_unstale":"2023-12-24T19:51:40.432963+0000","last_undegraded":"2023-12-24T19:51:40.432963+0000","last_fullsized":"2023-12-24T19:51:40.432963+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417885+0000","last_change":"2023-12-24T19:51:39.617606+0000","last_active":"2023-12-24T19:51:40.417885+0000","last_peered":"2023-12-24T19:51:40.417885+0000","last_clean":"2023-12-24T19:51:40.417885+0000","last_became_active":"2023-12-24T19:51:39.617301+0000","last_became_peered":"2023-12-24T19:51:39.617301+0000","last_unstale":"2023-12-24T19:51:40.417885+0000","last_undegraded":"2023-12-24T19:51:40.417885+0000","last_fullsized":"2023-12-24T19:51:40.417885+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:14.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:39.582616+0000","last_change":"2023-12-24T19:51:39.582616+0000","last_active":"2023-12-24T19:51:39.582616+0000","last_peered":"2023-12-24T19:51:39.582616+0000","last_clean":"2023-12-24T19:51:39.582616+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:39.582616+0000","last_undegraded":"2023-12-24T19:51:39.582616+0000","last_fullsized":"2023-12-24T19:51:39.582616+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:51:38.565555+0000","last_change":"2023-12-24T19:51:38.565555+0000","last_active":"2023-12-24T19:51:38.565555+0000","last_peered":"2023-12-24T19:51:38.565555+0000","last_clean":"2023-12-24T19:51:38.565555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:51:38.565555+0000","last_undegraded":"2023-12-24T19:51:38.565555+0000","last_fullsized":"2023-12-24T19:51:38.565555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":814,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-12-24T19:51:36.852946+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:51:36.852946+0000","last_peered":"2023-12-24T19:51:36.852946+0000","last_clean":"2023-12-24T19:51:36.852946+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:51:36.852946+0000","last_undegraded":"2023-12-24T19:51:36.852946+0000","last_fullsized":"2023-12-24T19:51:36.852946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":20,"acting":20,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072084,"statfs":{"total":96636764160,"available":96329814016,"internally_reserved":0,"allocated":2527232,"data_stored":1589468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1719999999999999,"15min":1.1759999999999999},"min":{"1min":0.83299999999999996,"5min":0.65300000000000002,"15min":0.58899999999999997},"max":{"1min":1.639,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2,"15min":1.202},"min":{"1min":1.0760000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5269999999999999,"5min":1.7230000000000001,"15min":1.804},"last":1.216}]},{"osd":1,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.1839999999999999},"min":{"1min":0.82699999999999996,"5min":0.80500000000000005,"15min":0.73899999999999999},"max":{"1min":1.645,"5min":1.645,"15min":1.702},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.2450000000000001},"min":{"1min":1.02,"5min":0.84799999999999998,"15min":0.80200000000000005},"max":{"1min":1.484,"5min":1.6180000000000001,"15min":1.788},"last":0.871}]},{"osd":2,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.2689999999999999,"15min":1.2470000000000001},"min":{"1min":0.98699999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.74,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.2569999999999999,"15min":1.2509999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.82999999999999996},"max":{"1min":1.472,"5min":1.726,"15min":1.79},"last":1.0640000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3109999999999999,"15min":1.3069999999999999},"min":{"1min":0.95499999999999996,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.5189999999999999,"5min":1.7569999999999999,"15min":1.77},"last":1.272},{"interface":"front","average":{"1min":1.319,"5min":1.3260000000000001,"15min":1.3220000000000001},"min":{"1min":0.997,"5min":0.98099999999999998,"15min":0.93500000000000005},"max":{"1min":1.593,"5min":1.829,"15min":1.829},"last":1.6259999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.669,"5min":1.7969999999999999,"15min":1.883},"last":1.331},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2629999999999999,"15min":1.248},"min":{"1min":0.85399999999999998,"5min":0.81200000000000006,"15min":0.73199999999999998},"max":{"1min":1.673,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.5469999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.28},"min":{"1min":1.0740000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7110000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3620000000000001},"min":{"1min":1.069,"5min":0.88100000000000001,"15min":0.80700000000000005},"max":{"1min":1.5920000000000001,"5min":1.853,"15min":2.0609999999999999},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4470000000000001,"15min":1.4299999999999999},"min":{"1min":1.248,"5min":1.024,"15min":0.871},"max":{"1min":1.752,"5min":1.909,"15min":1.97},"last":1.839},{"interface":"front","average":{"1min":1.47,"5min":1.4390000000000001,"15min":1.419},"min":{"1min":1.115,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.954,"15min":1.954},"last":1.671}]}]},{"osd":6,"up_from":13,"seq":55834575747,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315560,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056280,"statfs":{"total":96636764160,"available":96313630720,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.93600000000000005,"5min":0.79700000000000004,"15min":0.74099999999999999},"max":{"1min":1.4990000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.458},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.389,"15min":1.377},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.704,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.504}]},{"osd":1,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.80900000000000005,"5min":0.78000000000000003,"15min":0.624},"max":{"1min":1.659,"5min":1.659,"15min":2.089},"last":1.212},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.65700000000000003},"max":{"1min":1.6399999999999999,"5min":2.569,"15min":2.569},"last":1.2689999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.224,"15min":1.2130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.145},{"interface":"front","average":{"1min":1.298,"5min":1.282,"15min":1.2809999999999999},"min":{"1min":0.95299999999999996,"5min":0.878,"15min":0.82899999999999996},"max":{"1min":1.5860000000000001,"5min":1.7,"15min":1.7789999999999999},"last":1.6859999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3029999999999999,"15min":1.3129999999999999},"min":{"1min":0.97099999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.673,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.323,"15min":1.296},"min":{"1min":1.042,"5min":0.97099999999999997,"15min":0.83499999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.8720000000000001},"last":1.3280000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1990000000000001,"15min":1.196},"min":{"1min":0.876,"5min":0.82799999999999996,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.762,"15min":2.0510000000000002},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3109999999999999,"15min":1.2649999999999999},"min":{"1min":0.88100000000000001,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.8080000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.7050000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.2629999999999999},"min":{"1min":0.92700000000000005,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.873,"5min":2.359,"15min":2.359},"last":1.425},{"interface":"front","average":{"1min":1.431,"5min":1.401,"15min":1.365},"min":{"1min":1.052,"5min":0.94199999999999995,"15min":0.66100000000000003},"max":{"1min":1.6439999999999999,"5min":1.79,"15min":2.1859999999999999},"last":1.5649999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4710000000000001,"15min":1.415},"min":{"1min":1.2869999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.79,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4510000000000001,"15min":1.411},"min":{"1min":0.98699999999999999,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.9379999999999999,"5min":2.524,"15min":2.524},"last":1.534}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307368,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.1559999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.349}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.25}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.1220000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.5}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.6719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311464,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060376,"statfs":{"total":96636764160,"available":96317825024,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.254},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.67600000000000005},"max":{"1min":1.4670000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.2789999999999999},"min":{"1min":1.0720000000000001,"5min":0.84099999999999997,"15min":0.58399999999999996},"max":{"1min":1.5509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.873,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":1.4299999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1499999999999999,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.70499999999999996,"15min":0.60199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.7909999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3580000000000001,"15min":1.353},"min":{"1min":1.0449999999999999,"5min":0.94899999999999995,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3440000000000001,"15min":1.3460000000000001},"min":{"1min":1.0149999999999999,"5min":0.77800000000000002,"15min":0.66100000000000003},"max":{"1min":1.706,"5min":1.829,"15min":1.829},"last":2.121}]},{"osd":3,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":0.92600000000000005,"5min":0.83299999999999996,"15min":0.46400000000000002},"max":{"1min":1.4670000000000001,"5min":1.792,"15min":1.792},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":1.0660000000000001,"5min":0.88400000000000001,"15min":0.63900000000000001},"max":{"1min":1.631,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.712}]},{"osd":5,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":1.599,"5min":1.744,"15min":1.879},"last":1.669},{"interface":"front","average":{"1min":1.266,"5min":1.339,"15min":1.321},"min":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.8779999999999999,"15min":1.9159999999999999},"last":2.0779999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.256},"min":{"1min":0.79900000000000004,"5min":0.69399999999999995,"15min":0.56000000000000005},"max":{"1min":1.7350000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.952},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.331,"15min":1.3169999999999999},"min":{"1min":0.93200000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.798,"5min":1.887,"15min":1.887},"last":1.2569999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2829999999999999,"15min":1.27},"min":{"1min":0.77900000000000003,"5min":0.60699999999999998,"15min":0.54500000000000004},"max":{"1min":1.863,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.47},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4470000000000001,"15min":1.417},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.831,"5min":2,"15min":2},"last":1.843}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311528,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060312,"statfs":{"total":96636764160,"available":96317759488,"internally_reserved":0,"allocated":1998848,"data_stored":1028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.96399999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.2070000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.026}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.175},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.409}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.097}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311464,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060376,"statfs":{"total":96636764160,"available":96317825024,"internally_reserved":0,"allocated":1933312,"data_stored":999100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.871},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":1.1759999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.2230000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.446},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.8600000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.276},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.669}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.744},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.3129999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.542},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.964}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.421,"15min":1.647},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.147,"15min":1.1499999999999999},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.087}]},{"osd":2,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0209999999999999,"15min":0.99399999999999999},"min":{"1min":0.754,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1479999999999999,"15min":1.1220000000000001},"min":{"1min":0.86799999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.034}]},{"osd":3,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.298,"15min":1.2729999999999999},"min":{"1min":0.98699999999999999,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.127,"15min":1.137},"min":{"1min":0.89400000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.823},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.298,"15min":1.282},"min":{"1min":1.083,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.6619999999999999,"5min":1.883,"15min":1.883},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.4370000000000001,"15min":1.4239999999999999},"min":{"1min":1.1859999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.849,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.405,"15min":1.403},"min":{"1min":1.0980000000000001,"5min":1.016,"15min":0.96499999999999997},"max":{"1min":1.7849999999999999,"5min":1.806,"15min":1.948},"last":1.351},{"interface":"front","average":{"1min":1.387,"5min":1.395,"15min":1.3839999999999999},"min":{"1min":1.099,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7909999999999999,"5min":1.843,"15min":2.2189999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.516,"15min":1.506},"min":{"1min":1.1299999999999999,"5min":1.0189999999999999,"15min":1.0089999999999999},"max":{"1min":1.944,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5069999999999999,"15min":1.498},"min":{"1min":1.103,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.9570000000000001,"5min":2.1339999999999999,"15min":2.323},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.554,"15min":1.548},"min":{"1min":1.2849999999999999,"5min":0.999,"15min":0.999},"max":{"1min":2.0840000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5389999999999999,"15min":1.512},"min":{"1min":1.268,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0009999999999999,"5min":2.532,"15min":2.532},"last":1.7250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072084,"statfs":{"total":96636764160,"available":96329814016,"internally_reserved":0,"allocated":2527232,"data_stored":1589468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.363,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.046,"15min":1.012},"min":{"1min":0.76100000000000001,"5min":0.50800000000000001,"15min":0.504},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.071,"15min":1.093},"min":{"1min":0.80400000000000005,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.4690000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.248},{"interface":"front","average":{"1min":1.103,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.74099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5980000000000001,"5min":1.663,"15min":1.833},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.0660000000000001},"min":{"1min":0.83899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5249999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.747},{"interface":"front","average":{"1min":1.296,"5min":1.258,"15min":1.272},"min":{"1min":0.92000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.732,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.401,"15min":1.379},"min":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.88200000000000001},"max":{"1min":1.6299999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.206},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3149999999999999},"min":{"1min":1.008,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.1399999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4350000000000001,"15min":1.4259999999999999},"min":{"1min":1.1699999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.6899999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.554},{"interface":"front","average":{"1min":1.419,"5min":1.4350000000000001,"15min":1.4390000000000001},"min":{"1min":1.123,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7110000000000001,"5min":2.0830000000000002,"15min":2.2989999999999999},"last":1.282}]},{"osd":6,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":1.073,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.677,"5min":1.873,"15min":1.964},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4830000000000001,"15min":1.4950000000000001},"min":{"1min":1.3009999999999999,"5min":1,"15min":1},"max":{"1min":1.8220000000000001,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.7390000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.514,"15min":1.522},"min":{"1min":1.254,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7470000000000001,"5min":2.46,"15min":2.46},"last":1.331},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4650000000000001,"15min":1.4690000000000001},"min":{"1min":1.2649999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9590000000000001,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.304}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:51:45.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:51:45.571 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-12-24T19:51:45.567+0000 7f47e7f79700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:51:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 Processor -- start 2023-12-24T19:51:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 -- start start 2023-12-24T19:51:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04180ce750 0x7f04180ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041806ba80 con 0x7f0418159a20 2023-12-24T19:51:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041806bd60 con 0x7f041806ae30 2023-12-24T19:51:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f041d9c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041815a5d0 con 0x7f04180ce750 2023-12-24T19:51:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f04177fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0418159a20 0x7f0418159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34542/0 (socket says 172.21.15.50:34542) 2023-12-24T19:51:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f04177fe700 1 -- 172.21.15.50:0/1927345762 learned_addr learned my addr 172.21.15.50:0/1927345762 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.571+0000 7f0416ffd700 1 --2- 172.21.15.50:0/1927345762 >> v2:172.21.15.82:3300/0 conn(0x7f04180ce750 0x7f04180ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685885168 0 0) 0x7f041806bd60 con 0x7f041806ae30 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0404003570 con 0x7f041806ae30 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492002022 0 0) 0x7f041806ba80 con 0x7f0418159a20 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f041806bd60 con 0x7f0418159a20 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f0416ffd700 1 -- 172.21.15.50:0/1927345762 >> v1:172.21.15.82:6789/0 conn(0x7f041806ae30 legacy=0x7f041806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f0416ffd700 1 -- 172.21.15.50:0/1927345762 >> v1:172.21.15.50:6789/0 conn(0x7f0418159a20 legacy=0x7f0418159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f0416ffd700 1 -- 172.21.15.50:0/1927345762 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041806c040 con 0x7f04180ce750 2023-12-24T19:51:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f0416ffd700 1 --2- 172.21.15.50:0/1927345762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04180ce750 0x7f04180ceb20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f04080098e0 tx=0x7f04080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4a8efa24b78850a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408011630 con 0x7f04180ce750 2023-12-24T19:51:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408011790 con 0x7f04180ce750 2023-12-24T19:51:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f04167fc700 1 -- 172.21.15.50:0/1927345762 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408011b30 con 0x7f04180ce750 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 -- 172.21.15.50:0/1927345762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04180ce750 msgr2=0x7f04180ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 --2- 172.21.15.50:0/1927345762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04180ce750 0x7f04180ceb20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f04080098e0 tx=0x7f04080091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 -- 172.21.15.50:0/1927345762 shutdown_connections 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 --2- 172.21.15.50:0/1927345762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04180ce750 0x7f04180ceb20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 -- 172.21.15.50:0/1927345762 >> 172.21.15.50:0/1927345762 conn(0x7f04180cffb0 msgr2=0x7f04180d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 -- 172.21.15.50:0/1927345762 shutdown_connections 2023-12-24T19:51:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.575+0000 7f041d9c5700 1 -- 172.21.15.50:0/1927345762 wait complete. 2023-12-24T19:51:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.579+0000 7f041d9c5700 1 Processor -- start 2023-12-24T19:51:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.579+0000 7f041d9c5700 1 -- start start 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f041806ae30 0x7f04181558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04180ce750 0x7f0418157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418156000 con 0x7f0418159a20 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04181562e0 con 0x7f041806ae30 2023-12-24T19:51:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04181565c0 con 0x7f04180ce750 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40980/0 (socket says 172.21.15.50:40980) 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 -- 172.21.15.50:0/355587396 learned_addr learned my addr 172.21.15.50:0/355587396 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f0416ffd700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f041806ae30 0x7f04181558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f040ffff700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04180ce750 0x7f0418157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 -- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04180ce750 msgr2=0x7f0418157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04180ce750 0x7f0418157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 -- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f041806ae30 msgr2=0x7f04181558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f041806ae30 0x7f04181558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 -- 172.21.15.50:0/355587396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009420 con 0x7f0418159a20 2023-12-24T19:51:45.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f04177fe700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0410001460 tx=0x7f0410001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000ce80 con 0x7f0418159a20 2023-12-24T19:51:45.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000ab70 con 0x7f0418159a20 2023-12-24T19:51:45.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100070f0 con 0x7f0418159a20 2023-12-24T19:51:45.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04181568a0 con 0x7f0418159a20 2023-12-24T19:51:45.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.583+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04181570a0 con 0x7f0418159a20 2023-12-24T19:51:45.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.587+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04180652e0 con 0x7f0418159a20 2023-12-24T19:51:45.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.587+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0410007520 con 0x7f0418159a20 2023-12-24T19:51:45.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.587+0000 7f040effd700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:45.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.587+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f041007cfe0 con 0x7f0418159a20 2023-12-24T19:51:45.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.587+0000 7f0416ffd700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:45.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.591+0000 7f0416ffd700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 0x7f03f8062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04080093f0 tx=0x7f0408017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:45.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.595+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f041004d290 con 0x7f0418159a20 2023-12-24T19:51:45.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.763+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f041806c320 con 0x7f03f8060550 2023-12-24T19:51:45.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.779+0000 7f040effd700 1 -- 172.21.15.50:0/355587396 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f041806c320 con 0x7f03f8060550 2023-12-24T19:51:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:45.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.783+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 msgr2=0x7f03f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 0x7f03f8062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04080093f0 tx=0x7f0408017000 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 msgr2=0x7f04180c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0410001460 tx=0x7f0410001ae0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 shutdown_connections 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0418159a20 0x7f04180c9bb0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04180ce750 0x7f0418157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 --2- 172.21.15.50:0/355587396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f041806ae30 0x7f04181558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 >> 172.21.15.50:0/355587396 conn(0x7f04180cffb0 msgr2=0x7f04180c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 shutdown_connections 2023-12-24T19:51:45.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:45.787+0000 7f041d9c5700 1 -- 172.21.15.50:0/355587396 wait complete. 2023-12-24T19:51:45.790 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:51:45.809 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:51:45.520797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464648,"kb_used_data":16712,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752510072,"statfs":{"total":773094113280,"available":770570313728,"internally_reserved":0,"allocated":17113088,"data_stored":9402204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002539"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428180+0000","last_change":"2023-12-24T19:51:40.426029+0000","last_active":"2023-12-24T19:51:40.428180+0000","last_peered":"2023-12-24T19:51:40.428180+0000","last_clean":"2023-12-24T19:51:40.428180+0000","last_became_active":"2023-12-24T19:51:40.424974+0000","last_became_peered":"2023-12-24T19:51:40.424974+0000","last_unstale":"2023-12-24T19:51:40.428180+0000","last_undegraded":"2023-12-24T19:51:40.428180+0000","last_fullsized":"2023-12-24T19:51:40.428180+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:07.839132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436752+0000","last_change":"2023-12-24T19:51:40.432444+0000","last_active":"2023-12-24T19:51:40.436752+0000","last_peered":"2023-12-24T19:51:40.436752+0000","last_clean":"2023-12-24T19:51:40.436752+0000","last_became_active":"2023-12-24T19:51:40.432108+0000","last_became_peered":"2023-12-24T19:51:40.432108+0000","last_unstale":"2023-12-24T19:51:40.436752+0000","last_undegraded":"2023-12-24T19:51:40.436752+0000","last_fullsized":"2023-12-24T19:51:40.436752+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:59.366293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427164+0000","last_change":"2023-12-24T19:51:40.420928+0000","last_active":"2023-12-24T19:51:40.427164+0000","last_peered":"2023-12-24T19:51:40.427164+0000","last_clean":"2023-12-24T19:51:40.427164+0000","last_became_active":"2023-12-24T19:51:40.420627+0000","last_became_peered":"2023-12-24T19:51:40.420627+0000","last_unstale":"2023-12-24T19:51:40.427164+0000","last_undegraded":"2023-12-24T19:51:40.427164+0000","last_fullsized":"2023-12-24T19:51:40.427164+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:21.995194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434081+0000","last_change":"2023-12-24T19:51:40.430939+0000","last_active":"2023-12-24T19:51:40.434081+0000","last_peered":"2023-12-24T19:51:40.434081+0000","last_clean":"2023-12-24T19:51:40.434081+0000","last_became_active":"2023-12-24T19:51:40.430136+0000","last_became_peered":"2023-12-24T19:51:40.430136+0000","last_unstale":"2023-12-24T19:51:40.434081+0000","last_undegraded":"2023-12-24T19:51:40.434081+0000","last_fullsized":"2023-12-24T19:51:40.434081+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430002+0000","last_change":"2023-12-24T19:51:40.423425+0000","last_active":"2023-12-24T19:51:40.430002+0000","last_peered":"2023-12-24T19:51:40.430002+0000","last_clean":"2023-12-24T19:51:40.430002+0000","last_became_active":"2023-12-24T19:51:40.423020+0000","last_became_peered":"2023-12-24T19:51:40.423020+0000","last_unstale":"2023-12-24T19:51:40.430002+0000","last_undegraded":"2023-12-24T19:51:40.430002+0000","last_fullsized":"2023-12-24T19:51:40.430002+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439630+0000","last_change":"2023-12-24T19:51:40.435820+0000","last_active":"2023-12-24T19:51:40.439630+0000","last_peered":"2023-12-24T19:51:40.439630+0000","last_clean":"2023-12-24T19:51:40.439630+0000","last_became_active":"2023-12-24T19:51:40.435487+0000","last_became_peered":"2023-12-24T19:51:40.435487+0000","last_unstale":"2023-12-24T19:51:40.439630+0000","last_undegraded":"2023-12-24T19:51:40.439630+0000","last_fullsized":"2023-12-24T19:51:40.439630+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:25.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431001+0000","last_change":"2023-12-24T19:51:40.427983+0000","last_active":"2023-12-24T19:51:40.431001+0000","last_peered":"2023-12-24T19:51:40.431001+0000","last_clean":"2023-12-24T19:51:40.431001+0000","last_became_active":"2023-12-24T19:51:40.427648+0000","last_became_peered":"2023-12-24T19:51:40.427648+0000","last_unstale":"2023-12-24T19:51:40.431001+0000","last_undegraded":"2023-12-24T19:51:40.431001+0000","last_fullsized":"2023-12-24T19:51:40.431001+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:10.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427900+0000","last_change":"2023-12-24T19:51:40.423103+0000","last_active":"2023-12-24T19:51:40.427900+0000","last_peered":"2023-12-24T19:51:40.427900+0000","last_clean":"2023-12-24T19:51:40.427900+0000","last_became_active":"2023-12-24T19:51:40.422807+0000","last_became_peered":"2023-12-24T19:51:40.422807+0000","last_unstale":"2023-12-24T19:51:40.427900+0000","last_undegraded":"2023-12-24T19:51:40.427900+0000","last_fullsized":"2023-12-24T19:51:40.427900+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442312+0000","last_change":"2023-12-24T19:51:40.439067+0000","last_active":"2023-12-24T19:51:40.442312+0000","last_peered":"2023-12-24T19:51:40.442312+0000","last_clean":"2023-12-24T19:51:40.442312+0000","last_became_active":"2023-12-24T19:51:40.437629+0000","last_became_peered":"2023-12-24T19:51:40.437629+0000","last_unstale":"2023-12-24T19:51:40.442312+0000","last_undegraded":"2023-12-24T19:51:40.442312+0000","last_fullsized":"2023-12-24T19:51:40.442312+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:01.896988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429629+0000","last_change":"2023-12-24T19:51:40.424048+0000","last_active":"2023-12-24T19:51:40.429629+0000","last_peered":"2023-12-24T19:51:40.429629+0000","last_clean":"2023-12-24T19:51:40.429629+0000","last_became_active":"2023-12-24T19:51:40.423770+0000","last_became_peered":"2023-12-24T19:51:40.423770+0000","last_unstale":"2023-12-24T19:51:40.429629+0000","last_undegraded":"2023-12-24T19:51:40.429629+0000","last_fullsized":"2023-12-24T19:51:40.429629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434210+0000","last_change":"2023-12-24T19:51:40.430545+0000","last_active":"2023-12-24T19:51:40.434210+0000","last_peered":"2023-12-24T19:51:40.434210+0000","last_clean":"2023-12-24T19:51:40.434210+0000","last_became_active":"2023-12-24T19:51:40.430100+0000","last_became_peered":"2023-12-24T19:51:40.430100+0000","last_unstale":"2023-12-24T19:51:40.434210+0000","last_undegraded":"2023-12-24T19:51:40.434210+0000","last_fullsized":"2023-12-24T19:51:40.434210+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428489+0000","last_change":"2023-12-24T19:51:40.421200+0000","last_active":"2023-12-24T19:51:40.428489+0000","last_peered":"2023-12-24T19:51:40.428489+0000","last_clean":"2023-12-24T19:51:40.428489+0000","last_became_active":"2023-12-24T19:51:40.420655+0000","last_became_peered":"2023-12-24T19:51:40.420655+0000","last_unstale":"2023-12-24T19:51:40.428489+0000","last_undegraded":"2023-12-24T19:51:40.428489+0000","last_fullsized":"2023-12-24T19:51:40.428489+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:59.792856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442661+0000","last_change":"2023-12-24T19:51:40.439954+0000","last_active":"2023-12-24T19:51:40.442661+0000","last_peered":"2023-12-24T19:51:40.442661+0000","last_clean":"2023-12-24T19:51:40.442661+0000","last_became_active":"2023-12-24T19:51:40.439679+0000","last_became_peered":"2023-12-24T19:51:40.439679+0000","last_unstale":"2023-12-24T19:51:40.442661+0000","last_undegraded":"2023-12-24T19:51:40.442661+0000","last_fullsized":"2023-12-24T19:51:40.442661+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:36.542056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436110+0000","last_change":"2023-12-24T19:51:40.432361+0000","last_active":"2023-12-24T19:51:40.436110+0000","last_peered":"2023-12-24T19:51:40.436110+0000","last_clean":"2023-12-24T19:51:40.436110+0000","last_became_active":"2023-12-24T19:51:40.430131+0000","last_became_peered":"2023-12-24T19:51:40.430131+0000","last_unstale":"2023-12-24T19:51:40.436110+0000","last_undegraded":"2023-12-24T19:51:40.436110+0000","last_fullsized":"2023-12-24T19:51:40.436110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:49.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429680+0000","last_change":"2023-12-24T19:51:40.425521+0000","last_active":"2023-12-24T19:51:40.429680+0000","last_peered":"2023-12-24T19:51:40.429680+0000","last_clean":"2023-12-24T19:51:40.429680+0000","last_became_active":"2023-12-24T19:51:40.424646+0000","last_became_peered":"2023-12-24T19:51:40.424646+0000","last_unstale":"2023-12-24T19:51:40.429680+0000","last_undegraded":"2023-12-24T19:51:40.429680+0000","last_fullsized":"2023-12-24T19:51:40.429680+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:40.758803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443598+0000","last_change":"2023-12-24T19:51:40.441627+0000","last_active":"2023-12-24T19:51:40.443598+0000","last_peered":"2023-12-24T19:51:40.443598+0000","last_clean":"2023-12-24T19:51:40.443598+0000","last_became_active":"2023-12-24T19:51:40.440587+0000","last_became_peered":"2023-12-24T19:51:40.440587+0000","last_unstale":"2023-12-24T19:51:40.443598+0000","last_undegraded":"2023-12-24T19:51:40.443598+0000","last_fullsized":"2023-12-24T19:51:40.443598+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:50.426428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443559+0000","last_change":"2023-12-24T19:51:40.441435+0000","last_active":"2023-12-24T19:51:40.443559+0000","last_peered":"2023-12-24T19:51:40.443559+0000","last_clean":"2023-12-24T19:51:40.443559+0000","last_became_active":"2023-12-24T19:51:40.441142+0000","last_became_peered":"2023-12-24T19:51:40.441142+0000","last_unstale":"2023-12-24T19:51:40.443559+0000","last_undegraded":"2023-12-24T19:51:40.443559+0000","last_fullsized":"2023-12-24T19:51:40.443559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:46.386942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438746+0000","last_change":"2023-12-24T19:51:40.433297+0000","last_active":"2023-12-24T19:51:40.438746+0000","last_peered":"2023-12-24T19:51:40.438746+0000","last_clean":"2023-12-24T19:51:40.438746+0000","last_became_active":"2023-12-24T19:51:40.428557+0000","last_became_peered":"2023-12-24T19:51:40.428557+0000","last_unstale":"2023-12-24T19:51:40.438746+0000","last_undegraded":"2023-12-24T19:51:40.438746+0000","last_fullsized":"2023-12-24T19:51:40.438746+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434565+0000","last_change":"2023-12-24T19:51:40.430060+0000","last_active":"2023-12-24T19:51:40.434565+0000","last_peered":"2023-12-24T19:51:40.434565+0000","last_clean":"2023-12-24T19:51:40.434565+0000","last_became_active":"2023-12-24T19:51:40.429480+0000","last_became_peered":"2023-12-24T19:51:40.429480+0000","last_unstale":"2023-12-24T19:51:40.434565+0000","last_undegraded":"2023-12-24T19:51:40.434565+0000","last_fullsized":"2023-12-24T19:51:40.434565+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:59.905534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440750+0000","last_change":"2023-12-24T19:51:40.434965+0000","last_active":"2023-12-24T19:51:40.440750+0000","last_peered":"2023-12-24T19:51:40.440750+0000","last_clean":"2023-12-24T19:51:40.440750+0000","last_became_active":"2023-12-24T19:51:40.430478+0000","last_became_peered":"2023-12-24T19:51:40.430478+0000","last_unstale":"2023-12-24T19:51:40.440750+0000","last_undegraded":"2023-12-24T19:51:40.440750+0000","last_fullsized":"2023-12-24T19:51:40.440750+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440842+0000","last_change":"2023-12-24T19:51:40.435541+0000","last_active":"2023-12-24T19:51:40.440842+0000","last_peered":"2023-12-24T19:51:40.440842+0000","last_clean":"2023-12-24T19:51:40.440842+0000","last_became_active":"2023-12-24T19:51:40.435225+0000","last_became_peered":"2023-12-24T19:51:40.435225+0000","last_unstale":"2023-12-24T19:51:40.440842+0000","last_undegraded":"2023-12-24T19:51:40.440842+0000","last_fullsized":"2023-12-24T19:51:40.440842+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:46.218240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436594+0000","last_change":"2023-12-24T19:51:40.434506+0000","last_active":"2023-12-24T19:51:40.436594+0000","last_peered":"2023-12-24T19:51:40.436594+0000","last_clean":"2023-12-24T19:51:40.436594+0000","last_became_active":"2023-12-24T19:51:40.434235+0000","last_became_peered":"2023-12-24T19:51:40.434235+0000","last_unstale":"2023-12-24T19:51:40.436594+0000","last_undegraded":"2023-12-24T19:51:40.436594+0000","last_fullsized":"2023-12-24T19:51:40.436594+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:03.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436552+0000","last_change":"2023-12-24T19:51:40.433597+0000","last_active":"2023-12-24T19:51:40.436552+0000","last_peered":"2023-12-24T19:51:40.436552+0000","last_clean":"2023-12-24T19:51:40.436552+0000","last_became_active":"2023-12-24T19:51:40.433336+0000","last_became_peered":"2023-12-24T19:51:40.433336+0000","last_unstale":"2023-12-24T19:51:40.436552+0000","last_undegraded":"2023-12-24T19:51:40.436552+0000","last_fullsized":"2023-12-24T19:51:40.436552+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444261+0000","last_change":"2023-12-24T19:51:40.443021+0000","last_active":"2023-12-24T19:51:40.444261+0000","last_peered":"2023-12-24T19:51:40.444261+0000","last_clean":"2023-12-24T19:51:40.444261+0000","last_became_active":"2023-12-24T19:51:40.442698+0000","last_became_peered":"2023-12-24T19:51:40.442698+0000","last_unstale":"2023-12-24T19:51:40.444261+0000","last_undegraded":"2023-12-24T19:51:40.444261+0000","last_fullsized":"2023-12-24T19:51:40.444261+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419227+0000","last_change":"2023-12-24T19:51:40.415109+0000","last_active":"2023-12-24T19:51:40.419227+0000","last_peered":"2023-12-24T19:51:40.419227+0000","last_clean":"2023-12-24T19:51:40.419227+0000","last_became_active":"2023-12-24T19:51:40.413960+0000","last_became_peered":"2023-12-24T19:51:40.413960+0000","last_unstale":"2023-12-24T19:51:40.419227+0000","last_undegraded":"2023-12-24T19:51:40.419227+0000","last_fullsized":"2023-12-24T19:51:40.419227+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:41.110755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436867+0000","last_change":"2023-12-24T19:51:40.430598+0000","last_active":"2023-12-24T19:51:40.436867+0000","last_peered":"2023-12-24T19:51:40.436867+0000","last_clean":"2023-12-24T19:51:40.436867+0000","last_became_active":"2023-12-24T19:51:40.428623+0000","last_became_peered":"2023-12-24T19:51:40.428623+0000","last_unstale":"2023-12-24T19:51:40.436867+0000","last_undegraded":"2023-12-24T19:51:40.436867+0000","last_fullsized":"2023-12-24T19:51:40.436867+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:05.101525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444825+0000","last_change":"2023-12-24T19:51:40.443011+0000","last_active":"2023-12-24T19:51:40.444825+0000","last_peered":"2023-12-24T19:51:40.444825+0000","last_clean":"2023-12-24T19:51:40.444825+0000","last_became_active":"2023-12-24T19:51:40.442709+0000","last_became_peered":"2023-12-24T19:51:40.442709+0000","last_unstale":"2023-12-24T19:51:40.444825+0000","last_undegraded":"2023-12-24T19:51:40.444825+0000","last_fullsized":"2023-12-24T19:51:40.444825+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:37.960323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426546+0000","last_change":"2023-12-24T19:51:40.422494+0000","last_active":"2023-12-24T19:51:40.426546+0000","last_peered":"2023-12-24T19:51:40.426546+0000","last_clean":"2023-12-24T19:51:40.426546+0000","last_became_active":"2023-12-24T19:51:40.421874+0000","last_became_peered":"2023-12-24T19:51:40.421874+0000","last_unstale":"2023-12-24T19:51:40.426546+0000","last_undegraded":"2023-12-24T19:51:40.426546+0000","last_fullsized":"2023-12-24T19:51:40.426546+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444133+0000","last_change":"2023-12-24T19:51:40.439408+0000","last_active":"2023-12-24T19:51:40.444133+0000","last_peered":"2023-12-24T19:51:40.444133+0000","last_clean":"2023-12-24T19:51:40.444133+0000","last_became_active":"2023-12-24T19:51:40.438577+0000","last_became_peered":"2023-12-24T19:51:40.438577+0000","last_unstale":"2023-12-24T19:51:40.444133+0000","last_undegraded":"2023-12-24T19:51:40.444133+0000","last_fullsized":"2023-12-24T19:51:40.444133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:44.285116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419740+0000","last_change":"2023-12-24T19:51:40.415045+0000","last_active":"2023-12-24T19:51:40.419740+0000","last_peered":"2023-12-24T19:51:40.419740+0000","last_clean":"2023-12-24T19:51:40.419740+0000","last_became_active":"2023-12-24T19:51:40.414739+0000","last_became_peered":"2023-12-24T19:51:40.414739+0000","last_unstale":"2023-12-24T19:51:40.419740+0000","last_undegraded":"2023-12-24T19:51:40.419740+0000","last_fullsized":"2023-12-24T19:51:40.419740+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:38.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439832+0000","last_change":"2023-12-24T19:51:40.436389+0000","last_active":"2023-12-24T19:51:40.439832+0000","last_peered":"2023-12-24T19:51:40.439832+0000","last_clean":"2023-12-24T19:51:40.439832+0000","last_became_active":"2023-12-24T19:51:40.436043+0000","last_became_peered":"2023-12-24T19:51:40.436043+0000","last_unstale":"2023-12-24T19:51:40.439832+0000","last_undegraded":"2023-12-24T19:51:40.439832+0000","last_fullsized":"2023-12-24T19:51:40.439832+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436478+0000","last_change":"2023-12-24T19:51:40.433033+0000","last_active":"2023-12-24T19:51:40.436478+0000","last_peered":"2023-12-24T19:51:40.436478+0000","last_clean":"2023-12-24T19:51:40.436478+0000","last_became_active":"2023-12-24T19:51:40.432714+0000","last_became_peered":"2023-12-24T19:51:40.432714+0000","last_unstale":"2023-12-24T19:51:40.436478+0000","last_undegraded":"2023-12-24T19:51:40.436478+0000","last_fullsized":"2023-12-24T19:51:40.436478+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428640+0000","last_change":"2023-12-24T19:51:40.425834+0000","last_active":"2023-12-24T19:51:40.428640+0000","last_peered":"2023-12-24T19:51:40.428640+0000","last_clean":"2023-12-24T19:51:40.428640+0000","last_became_active":"2023-12-24T19:51:40.425546+0000","last_became_peered":"2023-12-24T19:51:40.425546+0000","last_unstale":"2023-12-24T19:51:40.428640+0000","last_undegraded":"2023-12-24T19:51:40.428640+0000","last_fullsized":"2023-12-24T19:51:40.428640+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632532+0000","last_change":"2023-12-24T19:51:39.624722+0000","last_active":"2023-12-24T19:51:40.632532+0000","last_peered":"2023-12-24T19:51:40.632532+0000","last_clean":"2023-12-24T19:51:40.632532+0000","last_became_active":"2023-12-24T19:51:39.624389+0000","last_became_peered":"2023-12-24T19:51:39.624389+0000","last_unstale":"2023-12-24T19:51:40.632532+0000","last_undegraded":"2023-12-24T19:51:40.632532+0000","last_fullsized":"2023-12-24T19:51:40.632532+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:46.834080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436623+0000","last_change":"2023-12-24T19:51:40.434492+0000","last_active":"2023-12-24T19:51:40.436623+0000","last_peered":"2023-12-24T19:51:40.436623+0000","last_clean":"2023-12-24T19:51:40.436623+0000","last_became_active":"2023-12-24T19:51:40.434172+0000","last_became_peered":"2023-12-24T19:51:40.434172+0000","last_unstale":"2023-12-24T19:51:40.436623+0000","last_undegraded":"2023-12-24T19:51:40.436623+0000","last_fullsized":"2023-12-24T19:51:40.436623+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:29.790775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631762+0000","last_change":"2023-12-24T19:51:39.614040+0000","last_active":"2023-12-24T19:51:40.631762+0000","last_peered":"2023-12-24T19:51:40.631762+0000","last_clean":"2023-12-24T19:51:40.631762+0000","last_became_active":"2023-12-24T19:51:39.613728+0000","last_became_peered":"2023-12-24T19:51:39.613728+0000","last_unstale":"2023-12-24T19:51:40.631762+0000","last_undegraded":"2023-12-24T19:51:40.631762+0000","last_fullsized":"2023-12-24T19:51:40.631762+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.524994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436148+0000","last_change":"2023-12-24T19:51:40.431375+0000","last_active":"2023-12-24T19:51:40.436148+0000","last_peered":"2023-12-24T19:51:40.436148+0000","last_clean":"2023-12-24T19:51:40.436148+0000","last_became_active":"2023-12-24T19:51:40.429179+0000","last_became_peered":"2023-12-24T19:51:40.429179+0000","last_unstale":"2023-12-24T19:51:40.436148+0000","last_undegraded":"2023-12-24T19:51:40.436148+0000","last_fullsized":"2023-12-24T19:51:40.436148+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632010+0000","last_change":"2023-12-24T19:51:39.632825+0000","last_active":"2023-12-24T19:51:40.632010+0000","last_peered":"2023-12-24T19:51:40.632010+0000","last_clean":"2023-12-24T19:51:40.632010+0000","last_became_active":"2023-12-24T19:51:39.632510+0000","last_became_peered":"2023-12-24T19:51:39.632510+0000","last_unstale":"2023-12-24T19:51:40.632010+0000","last_undegraded":"2023-12-24T19:51:40.632010+0000","last_fullsized":"2023-12-24T19:51:40.632010+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:04.825207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426987+0000","last_change":"2023-12-24T19:51:40.425316+0000","last_active":"2023-12-24T19:51:40.426987+0000","last_peered":"2023-12-24T19:51:40.426987+0000","last_clean":"2023-12-24T19:51:40.426987+0000","last_became_active":"2023-12-24T19:51:40.424708+0000","last_became_peered":"2023-12-24T19:51:40.424708+0000","last_unstale":"2023-12-24T19:51:40.426987+0000","last_undegraded":"2023-12-24T19:51:40.426987+0000","last_fullsized":"2023-12-24T19:51:40.426987+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:12.476714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630698+0000","last_change":"2023-12-24T19:51:39.627945+0000","last_active":"2023-12-24T19:51:40.630698+0000","last_peered":"2023-12-24T19:51:40.630698+0000","last_clean":"2023-12-24T19:51:40.630698+0000","last_became_active":"2023-12-24T19:51:39.627619+0000","last_became_peered":"2023-12-24T19:51:39.627619+0000","last_unstale":"2023-12-24T19:51:40.630698+0000","last_undegraded":"2023-12-24T19:51:40.630698+0000","last_fullsized":"2023-12-24T19:51:40.630698+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:23.816437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441628+0000","last_change":"2023-12-24T19:51:40.438779+0000","last_active":"2023-12-24T19:51:40.441628+0000","last_peered":"2023-12-24T19:51:40.441628+0000","last_clean":"2023-12-24T19:51:40.441628+0000","last_became_active":"2023-12-24T19:51:40.438495+0000","last_became_peered":"2023-12-24T19:51:40.438495+0000","last_unstale":"2023-12-24T19:51:40.441628+0000","last_undegraded":"2023-12-24T19:51:40.441628+0000","last_fullsized":"2023-12-24T19:51:40.441628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:32.553401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629405+0000","last_change":"2023-12-24T19:51:39.625630+0000","last_active":"2023-12-24T19:51:40.629405+0000","last_peered":"2023-12-24T19:51:40.629405+0000","last_clean":"2023-12-24T19:51:40.629405+0000","last_became_active":"2023-12-24T19:51:39.625062+0000","last_became_peered":"2023-12-24T19:51:39.625062+0000","last_unstale":"2023-12-24T19:51:40.629405+0000","last_undegraded":"2023-12-24T19:51:40.629405+0000","last_fullsized":"2023-12-24T19:51:40.629405+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428263+0000","last_change":"2023-12-24T19:51:40.423118+0000","last_active":"2023-12-24T19:51:40.428263+0000","last_peered":"2023-12-24T19:51:40.428263+0000","last_clean":"2023-12-24T19:51:40.428263+0000","last_became_active":"2023-12-24T19:51:40.422754+0000","last_became_peered":"2023-12-24T19:51:40.422754+0000","last_unstale":"2023-12-24T19:51:40.428263+0000","last_undegraded":"2023-12-24T19:51:40.428263+0000","last_fullsized":"2023-12-24T19:51:40.428263+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631702+0000","last_change":"2023-12-24T19:51:39.620796+0000","last_active":"2023-12-24T19:51:40.631702+0000","last_peered":"2023-12-24T19:51:40.631702+0000","last_clean":"2023-12-24T19:51:40.631702+0000","last_became_active":"2023-12-24T19:51:39.620494+0000","last_became_peered":"2023-12-24T19:51:39.620494+0000","last_unstale":"2023-12-24T19:51:40.631702+0000","last_undegraded":"2023-12-24T19:51:40.631702+0000","last_fullsized":"2023-12-24T19:51:40.631702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:45.369881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438765+0000","last_change":"2023-12-24T19:51:40.434720+0000","last_active":"2023-12-24T19:51:40.438765+0000","last_peered":"2023-12-24T19:51:40.438765+0000","last_clean":"2023-12-24T19:51:40.438765+0000","last_became_active":"2023-12-24T19:51:40.433651+0000","last_became_peered":"2023-12-24T19:51:40.433651+0000","last_unstale":"2023-12-24T19:51:40.438765+0000","last_undegraded":"2023-12-24T19:51:40.438765+0000","last_fullsized":"2023-12-24T19:51:40.438765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432720+0000","last_change":"2023-12-24T19:51:39.628949+0000","last_active":"2023-12-24T19:51:40.432720+0000","last_peered":"2023-12-24T19:51:40.432720+0000","last_clean":"2023-12-24T19:51:40.432720+0000","last_became_active":"2023-12-24T19:51:39.628339+0000","last_became_peered":"2023-12-24T19:51:39.628339+0000","last_unstale":"2023-12-24T19:51:40.432720+0000","last_undegraded":"2023-12-24T19:51:40.432720+0000","last_fullsized":"2023-12-24T19:51:40.432720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441331+0000","last_change":"2023-12-24T19:51:40.438801+0000","last_active":"2023-12-24T19:51:40.441331+0000","last_peered":"2023-12-24T19:51:40.441331+0000","last_clean":"2023-12-24T19:51:40.441331+0000","last_became_active":"2023-12-24T19:51:40.438303+0000","last_became_peered":"2023-12-24T19:51:40.438303+0000","last_unstale":"2023-12-24T19:51:40.441331+0000","last_undegraded":"2023-12-24T19:51:40.441331+0000","last_fullsized":"2023-12-24T19:51:40.441331+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:53:36.022014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.411137+0000","last_change":"2023-12-24T19:51:39.610871+0000","last_active":"2023-12-24T19:51:40.411137+0000","last_peered":"2023-12-24T19:51:40.411137+0000","last_clean":"2023-12-24T19:51:40.411137+0000","last_became_active":"2023-12-24T19:51:39.610529+0000","last_became_peered":"2023-12-24T19:51:39.610529+0000","last_unstale":"2023-12-24T19:51:40.411137+0000","last_undegraded":"2023-12-24T19:51:40.411137+0000","last_fullsized":"2023-12-24T19:51:40.411137+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:24:03.143988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418608+0000","last_change":"2023-12-24T19:51:40.416121+0000","last_active":"2023-12-24T19:51:40.418608+0000","last_peered":"2023-12-24T19:51:40.418608+0000","last_clean":"2023-12-24T19:51:40.418608+0000","last_became_active":"2023-12-24T19:51:40.415769+0000","last_became_peered":"2023-12-24T19:51:40.415769+0000","last_unstale":"2023-12-24T19:51:40.418608+0000","last_undegraded":"2023-12-24T19:51:40.418608+0000","last_fullsized":"2023-12-24T19:51:40.418608+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.420846+0000","last_change":"2023-12-24T19:51:39.613940+0000","last_active":"2023-12-24T19:51:40.420846+0000","last_peered":"2023-12-24T19:51:40.420846+0000","last_clean":"2023-12-24T19:51:40.420846+0000","last_became_active":"2023-12-24T19:51:39.613646+0000","last_became_peered":"2023-12-24T19:51:39.613646+0000","last_unstale":"2023-12-24T19:51:40.420846+0000","last_undegraded":"2023-12-24T19:51:40.420846+0000","last_fullsized":"2023-12-24T19:51:40.420846+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:40.093694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440701+0000","last_change":"2023-12-24T19:51:40.436559+0000","last_active":"2023-12-24T19:51:40.440701+0000","last_peered":"2023-12-24T19:51:40.440701+0000","last_clean":"2023-12-24T19:51:40.440701+0000","last_became_active":"2023-12-24T19:51:40.436138+0000","last_became_peered":"2023-12-24T19:51:40.436138+0000","last_unstale":"2023-12-24T19:51:40.440701+0000","last_undegraded":"2023-12-24T19:51:40.440701+0000","last_fullsized":"2023-12-24T19:51:40.440701+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:32.510531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409890+0000","last_change":"2023-12-24T19:51:39.632193+0000","last_active":"2023-12-24T19:51:40.409890+0000","last_peered":"2023-12-24T19:51:40.409890+0000","last_clean":"2023-12-24T19:51:40.409890+0000","last_became_active":"2023-12-24T19:51:39.631461+0000","last_became_peered":"2023-12-24T19:51:39.631461+0000","last_unstale":"2023-12-24T19:51:40.409890+0000","last_undegraded":"2023-12-24T19:51:40.409890+0000","last_fullsized":"2023-12-24T19:51:40.409890+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:27.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439526+0000","last_change":"2023-12-24T19:51:40.433371+0000","last_active":"2023-12-24T19:51:40.439526+0000","last_peered":"2023-12-24T19:51:40.439526+0000","last_clean":"2023-12-24T19:51:40.439526+0000","last_became_active":"2023-12-24T19:51:40.432550+0000","last_became_peered":"2023-12-24T19:51:40.432550+0000","last_unstale":"2023-12-24T19:51:40.439526+0000","last_undegraded":"2023-12-24T19:51:40.439526+0000","last_fullsized":"2023-12-24T19:51:40.439526+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:04.937548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632962+0000","last_change":"2023-12-24T19:51:39.629596+0000","last_active":"2023-12-24T19:51:40.632962+0000","last_peered":"2023-12-24T19:51:40.632962+0000","last_clean":"2023-12-24T19:51:40.632962+0000","last_became_active":"2023-12-24T19:51:39.629252+0000","last_became_peered":"2023-12-24T19:51:39.629252+0000","last_unstale":"2023-12-24T19:51:40.632962+0000","last_undegraded":"2023-12-24T19:51:40.632962+0000","last_fullsized":"2023-12-24T19:51:40.632962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:13:42.973463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428881+0000","last_change":"2023-12-24T19:51:40.424037+0000","last_active":"2023-12-24T19:51:40.428881+0000","last_peered":"2023-12-24T19:51:40.428881+0000","last_clean":"2023-12-24T19:51:40.428881+0000","last_became_active":"2023-12-24T19:51:40.422864+0000","last_became_peered":"2023-12-24T19:51:40.422864+0000","last_unstale":"2023-12-24T19:51:40.428881+0000","last_undegraded":"2023-12-24T19:51:40.428881+0000","last_fullsized":"2023-12-24T19:51:40.428881+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:40.208531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"158'6","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.634021+0000","last_change":"2023-12-24T19:51:39.631728+0000","last_active":"2023-12-24T19:51:40.634021+0000","last_peered":"2023-12-24T19:51:40.634021+0000","last_clean":"2023-12-24T19:51:40.634021+0000","last_became_active":"2023-12-24T19:51:39.631420+0000","last_became_peered":"2023-12-24T19:51:39.631420+0000","last_unstale":"2023-12-24T19:51:40.634021+0000","last_undegraded":"2023-12-24T19:51:40.634021+0000","last_fullsized":"2023-12-24T19:51:40.634021+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:05.017707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424378+0000","last_change":"2023-12-24T19:51:40.420704+0000","last_active":"2023-12-24T19:51:40.424378+0000","last_peered":"2023-12-24T19:51:40.424378+0000","last_clean":"2023-12-24T19:51:40.424378+0000","last_became_active":"2023-12-24T19:51:40.420273+0000","last_became_peered":"2023-12-24T19:51:40.420273+0000","last_unstale":"2023-12-24T19:51:40.424378+0000","last_undegraded":"2023-12-24T19:51:40.424378+0000","last_fullsized":"2023-12-24T19:51:40.424378+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630422+0000","last_change":"2023-12-24T19:51:39.627033+0000","last_active":"2023-12-24T19:51:40.630422+0000","last_peered":"2023-12-24T19:51:40.630422+0000","last_clean":"2023-12-24T19:51:40.630422+0000","last_became_active":"2023-12-24T19:51:39.626051+0000","last_became_peered":"2023-12-24T19:51:39.626051+0000","last_unstale":"2023-12-24T19:51:40.630422+0000","last_undegraded":"2023-12-24T19:51:40.630422+0000","last_fullsized":"2023-12-24T19:51:40.630422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:35.180205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439729+0000","last_change":"2023-12-24T19:51:40.436088+0000","last_active":"2023-12-24T19:51:40.439729+0000","last_peered":"2023-12-24T19:51:40.439729+0000","last_clean":"2023-12-24T19:51:40.439729+0000","last_became_active":"2023-12-24T19:51:40.435805+0000","last_became_peered":"2023-12-24T19:51:40.435805+0000","last_unstale":"2023-12-24T19:51:40.439729+0000","last_undegraded":"2023-12-24T19:51:40.439729+0000","last_fullsized":"2023-12-24T19:51:40.439729+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:50:19.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.412157+0000","last_change":"2023-12-24T19:51:39.615804+0000","last_active":"2023-12-24T19:51:40.412157+0000","last_peered":"2023-12-24T19:51:40.412157+0000","last_clean":"2023-12-24T19:51:40.412157+0000","last_became_active":"2023-12-24T19:51:39.615496+0000","last_became_peered":"2023-12-24T19:51:39.615496+0000","last_unstale":"2023-12-24T19:51:40.412157+0000","last_undegraded":"2023-12-24T19:51:40.412157+0000","last_fullsized":"2023-12-24T19:51:40.412157+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:24:25.652658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440588+0000","last_change":"2023-12-24T19:51:40.436875+0000","last_active":"2023-12-24T19:51:40.440588+0000","last_peered":"2023-12-24T19:51:40.440588+0000","last_clean":"2023-12-24T19:51:40.440588+0000","last_became_active":"2023-12-24T19:51:40.436576+0000","last_became_peered":"2023-12-24T19:51:40.436576+0000","last_unstale":"2023-12-24T19:51:40.440588+0000","last_undegraded":"2023-12-24T19:51:40.440588+0000","last_fullsized":"2023-12-24T19:51:40.440588+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:25.727690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.635212+0000","last_change":"2023-12-24T19:51:39.622106+0000","last_active":"2023-12-24T19:51:40.635212+0000","last_peered":"2023-12-24T19:51:40.635212+0000","last_clean":"2023-12-24T19:51:40.635212+0000","last_became_active":"2023-12-24T19:51:39.621718+0000","last_became_peered":"2023-12-24T19:51:39.621718+0000","last_unstale":"2023-12-24T19:51:40.635212+0000","last_undegraded":"2023-12-24T19:51:40.635212+0000","last_fullsized":"2023-12-24T19:51:40.635212+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:39.191470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424133+0000","last_change":"2023-12-24T19:51:40.419727+0000","last_active":"2023-12-24T19:51:40.424133+0000","last_peered":"2023-12-24T19:51:40.424133+0000","last_clean":"2023-12-24T19:51:40.424133+0000","last_became_active":"2023-12-24T19:51:40.419377+0000","last_became_peered":"2023-12-24T19:51:40.419377+0000","last_unstale":"2023-12-24T19:51:40.424133+0000","last_undegraded":"2023-12-24T19:51:40.424133+0000","last_fullsized":"2023-12-24T19:51:40.424133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:57.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629193+0000","last_change":"2023-12-24T19:51:39.630562+0000","last_active":"2023-12-24T19:51:40.629193+0000","last_peered":"2023-12-24T19:51:40.629193+0000","last_clean":"2023-12-24T19:51:40.629193+0000","last_became_active":"2023-12-24T19:51:39.630206+0000","last_became_peered":"2023-12-24T19:51:39.630206+0000","last_unstale":"2023-12-24T19:51:40.629193+0000","last_undegraded":"2023-12-24T19:51:40.629193+0000","last_fullsized":"2023-12-24T19:51:40.629193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439544+0000","last_change":"2023-12-24T19:51:40.435426+0000","last_active":"2023-12-24T19:51:40.439544+0000","last_peered":"2023-12-24T19:51:40.439544+0000","last_clean":"2023-12-24T19:51:40.439544+0000","last_became_active":"2023-12-24T19:51:40.435144+0000","last_became_peered":"2023-12-24T19:51:40.435144+0000","last_unstale":"2023-12-24T19:51:40.439544+0000","last_undegraded":"2023-12-24T19:51:40.439544+0000","last_fullsized":"2023-12-24T19:51:40.439544+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:51.815229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632750+0000","last_change":"2023-12-24T19:51:39.625620+0000","last_active":"2023-12-24T19:51:40.632750+0000","last_peered":"2023-12-24T19:51:40.632750+0000","last_clean":"2023-12-24T19:51:40.632750+0000","last_became_active":"2023-12-24T19:51:39.625041+0000","last_became_peered":"2023-12-24T19:51:39.625041+0000","last_unstale":"2023-12-24T19:51:40.632750+0000","last_undegraded":"2023-12-24T19:51:40.632750+0000","last_fullsized":"2023-12-24T19:51:40.632750+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:26.302719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444183+0000","last_change":"2023-12-24T19:51:40.439893+0000","last_active":"2023-12-24T19:51:40.444183+0000","last_peered":"2023-12-24T19:51:40.444183+0000","last_clean":"2023-12-24T19:51:40.444183+0000","last_became_active":"2023-12-24T19:51:40.439444+0000","last_became_peered":"2023-12-24T19:51:40.439444+0000","last_unstale":"2023-12-24T19:51:40.444183+0000","last_undegraded":"2023-12-24T19:51:40.444183+0000","last_fullsized":"2023-12-24T19:51:40.444183+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:03.393498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631043+0000","last_change":"2023-12-24T19:51:39.617148+0000","last_active":"2023-12-24T19:51:40.631043+0000","last_peered":"2023-12-24T19:51:40.631043+0000","last_clean":"2023-12-24T19:51:40.631043+0000","last_became_active":"2023-12-24T19:51:39.616836+0000","last_became_peered":"2023-12-24T19:51:39.616836+0000","last_unstale":"2023-12-24T19:51:40.631043+0000","last_undegraded":"2023-12-24T19:51:40.631043+0000","last_fullsized":"2023-12-24T19:51:40.631043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.423628+0000","last_change":"2023-12-24T19:51:40.421790+0000","last_active":"2023-12-24T19:51:40.423628+0000","last_peered":"2023-12-24T19:51:40.423628+0000","last_clean":"2023-12-24T19:51:40.423628+0000","last_became_active":"2023-12-24T19:51:40.421458+0000","last_became_peered":"2023-12-24T19:51:40.421458+0000","last_unstale":"2023-12-24T19:51:40.423628+0000","last_undegraded":"2023-12-24T19:51:40.423628+0000","last_fullsized":"2023-12-24T19:51:40.423628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.415764+0000","last_change":"2023-12-24T19:51:39.620411+0000","last_active":"2023-12-24T19:51:40.415764+0000","last_peered":"2023-12-24T19:51:40.415764+0000","last_clean":"2023-12-24T19:51:40.415764+0000","last_became_active":"2023-12-24T19:51:39.619856+0000","last_became_peered":"2023-12-24T19:51:39.619856+0000","last_unstale":"2023-12-24T19:51:40.415764+0000","last_undegraded":"2023-12-24T19:51:40.415764+0000","last_fullsized":"2023-12-24T19:51:40.415764+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:51.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.421843+0000","last_change":"2023-12-24T19:51:40.420639+0000","last_active":"2023-12-24T19:51:40.421843+0000","last_peered":"2023-12-24T19:51:40.421843+0000","last_clean":"2023-12-24T19:51:40.421843+0000","last_became_active":"2023-12-24T19:51:40.420309+0000","last_became_peered":"2023-12-24T19:51:40.420309+0000","last_unstale":"2023-12-24T19:51:40.421843+0000","last_undegraded":"2023-12-24T19:51:40.421843+0000","last_fullsized":"2023-12-24T19:51:40.421843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631675+0000","last_change":"2023-12-24T19:51:39.625407+0000","last_active":"2023-12-24T19:51:40.631675+0000","last_peered":"2023-12-24T19:51:40.631675+0000","last_clean":"2023-12-24T19:51:40.631675+0000","last_became_active":"2023-12-24T19:51:39.624691+0000","last_became_peered":"2023-12-24T19:51:39.624691+0000","last_unstale":"2023-12-24T19:51:40.631675+0000","last_undegraded":"2023-12-24T19:51:40.631675+0000","last_fullsized":"2023-12-24T19:51:40.631675+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431343+0000","last_change":"2023-12-24T19:51:40.430022+0000","last_active":"2023-12-24T19:51:40.431343+0000","last_peered":"2023-12-24T19:51:40.431343+0000","last_clean":"2023-12-24T19:51:40.431343+0000","last_became_active":"2023-12-24T19:51:40.426777+0000","last_became_peered":"2023-12-24T19:51:40.426777+0000","last_unstale":"2023-12-24T19:51:40.431343+0000","last_undegraded":"2023-12-24T19:51:40.431343+0000","last_fullsized":"2023-12-24T19:51:40.431343+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:28.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409179+0000","last_change":"2023-12-24T19:51:39.622856+0000","last_active":"2023-12-24T19:51:40.409179+0000","last_peered":"2023-12-24T19:51:40.409179+0000","last_clean":"2023-12-24T19:51:40.409179+0000","last_became_active":"2023-12-24T19:51:39.622570+0000","last_became_peered":"2023-12-24T19:51:39.622570+0000","last_unstale":"2023-12-24T19:51:40.409179+0000","last_undegraded":"2023-12-24T19:51:40.409179+0000","last_fullsized":"2023-12-24T19:51:40.409179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:45.599956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438003+0000","last_change":"2023-12-24T19:51:40.427853+0000","last_active":"2023-12-24T19:51:40.438003+0000","last_peered":"2023-12-24T19:51:40.438003+0000","last_clean":"2023-12-24T19:51:40.438003+0000","last_became_active":"2023-12-24T19:51:40.427547+0000","last_became_peered":"2023-12-24T19:51:40.427547+0000","last_unstale":"2023-12-24T19:51:40.438003+0000","last_undegraded":"2023-12-24T19:51:40.438003+0000","last_fullsized":"2023-12-24T19:51:40.438003+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:11.645312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417081+0000","last_change":"2023-12-24T19:51:39.630194+0000","last_active":"2023-12-24T19:51:40.417081+0000","last_peered":"2023-12-24T19:51:40.417081+0000","last_clean":"2023-12-24T19:51:40.417081+0000","last_became_active":"2023-12-24T19:51:39.629848+0000","last_became_peered":"2023-12-24T19:51:39.629848+0000","last_unstale":"2023-12-24T19:51:40.417081+0000","last_undegraded":"2023-12-24T19:51:40.417081+0000","last_fullsized":"2023-12-24T19:51:40.417081+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:25.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.435049+0000","last_change":"2023-12-24T19:51:40.432051+0000","last_active":"2023-12-24T19:51:40.435049+0000","last_peered":"2023-12-24T19:51:40.435049+0000","last_clean":"2023-12-24T19:51:40.435049+0000","last_became_active":"2023-12-24T19:51:40.431763+0000","last_became_peered":"2023-12-24T19:51:40.431763+0000","last_unstale":"2023-12-24T19:51:40.435049+0000","last_undegraded":"2023-12-24T19:51:40.435049+0000","last_fullsized":"2023-12-24T19:51:40.435049+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:05.957842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432612+0000","last_change":"2023-12-24T19:51:39.629814+0000","last_active":"2023-12-24T19:51:40.432612+0000","last_peered":"2023-12-24T19:51:40.432612+0000","last_clean":"2023-12-24T19:51:40.432612+0000","last_became_active":"2023-12-24T19:51:39.628065+0000","last_became_peered":"2023-12-24T19:51:39.628065+0000","last_unstale":"2023-12-24T19:51:40.432612+0000","last_undegraded":"2023-12-24T19:51:40.432612+0000","last_fullsized":"2023-12-24T19:51:40.432612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438879+0000","last_change":"2023-12-24T19:51:40.434532+0000","last_active":"2023-12-24T19:51:40.438879+0000","last_peered":"2023-12-24T19:51:40.438879+0000","last_clean":"2023-12-24T19:51:40.438879+0000","last_became_active":"2023-12-24T19:51:40.433863+0000","last_became_peered":"2023-12-24T19:51:40.433863+0000","last_unstale":"2023-12-24T19:51:40.438879+0000","last_undegraded":"2023-12-24T19:51:40.438879+0000","last_fullsized":"2023-12-24T19:51:40.438879+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.633179+0000","last_change":"2023-12-24T19:51:39.624918+0000","last_active":"2023-12-24T19:51:40.633179+0000","last_peered":"2023-12-24T19:51:40.633179+0000","last_clean":"2023-12-24T19:51:40.633179+0000","last_became_active":"2023-12-24T19:51:39.624060+0000","last_became_peered":"2023-12-24T19:51:39.624060+0000","last_unstale":"2023-12-24T19:51:40.633179+0000","last_undegraded":"2023-12-24T19:51:40.633179+0000","last_fullsized":"2023-12-24T19:51:40.633179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:54.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430333+0000","last_change":"2023-12-24T19:51:40.424064+0000","last_active":"2023-12-24T19:51:40.430333+0000","last_peered":"2023-12-24T19:51:40.430333+0000","last_clean":"2023-12-24T19:51:40.430333+0000","last_became_active":"2023-12-24T19:51:40.423752+0000","last_became_peered":"2023-12-24T19:51:40.423752+0000","last_unstale":"2023-12-24T19:51:40.430333+0000","last_undegraded":"2023-12-24T19:51:40.430333+0000","last_fullsized":"2023-12-24T19:51:40.430333+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:07.280866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.411315+0000","last_change":"2023-12-24T19:51:39.619047+0000","last_active":"2023-12-24T19:51:40.411315+0000","last_peered":"2023-12-24T19:51:40.411315+0000","last_clean":"2023-12-24T19:51:40.411315+0000","last_became_active":"2023-12-24T19:51:39.618656+0000","last_became_peered":"2023-12-24T19:51:39.618656+0000","last_unstale":"2023-12-24T19:51:40.411315+0000","last_undegraded":"2023-12-24T19:51:40.411315+0000","last_fullsized":"2023-12-24T19:51:40.411315+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.437339+0000","last_change":"2023-12-24T19:51:40.431853+0000","last_active":"2023-12-24T19:51:40.437339+0000","last_peered":"2023-12-24T19:51:40.437339+0000","last_clean":"2023-12-24T19:51:40.437339+0000","last_became_active":"2023-12-24T19:51:40.431311+0000","last_became_peered":"2023-12-24T19:51:40.431311+0000","last_unstale":"2023-12-24T19:51:40.437339+0000","last_undegraded":"2023-12-24T19:51:40.437339+0000","last_fullsized":"2023-12-24T19:51:40.437339+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:21.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.410314+0000","last_change":"2023-12-24T19:51:39.625981+0000","last_active":"2023-12-24T19:51:40.410314+0000","last_peered":"2023-12-24T19:51:40.410314+0000","last_clean":"2023-12-24T19:51:40.410314+0000","last_became_active":"2023-12-24T19:51:39.625275+0000","last_became_peered":"2023-12-24T19:51:39.625275+0000","last_unstale":"2023-12-24T19:51:40.410314+0000","last_undegraded":"2023-12-24T19:51:40.410314+0000","last_fullsized":"2023-12-24T19:51:40.410314+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.425243+0000","last_change":"2023-12-24T19:51:40.422375+0000","last_active":"2023-12-24T19:51:40.425243+0000","last_peered":"2023-12-24T19:51:40.425243+0000","last_clean":"2023-12-24T19:51:40.425243+0000","last_became_active":"2023-12-24T19:51:40.422046+0000","last_became_peered":"2023-12-24T19:51:40.422046+0000","last_unstale":"2023-12-24T19:51:40.425243+0000","last_undegraded":"2023-12-24T19:51:40.425243+0000","last_fullsized":"2023-12-24T19:51:40.425243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.433449+0000","last_change":"2023-12-24T19:51:39.628603+0000","last_active":"2023-12-24T19:51:40.433449+0000","last_peered":"2023-12-24T19:51:40.433449+0000","last_clean":"2023-12-24T19:51:40.433449+0000","last_became_active":"2023-12-24T19:51:39.628257+0000","last_became_peered":"2023-12-24T19:51:39.628257+0000","last_unstale":"2023-12-24T19:51:40.433449+0000","last_undegraded":"2023-12-24T19:51:40.433449+0000","last_fullsized":"2023-12-24T19:51:40.433449+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442421+0000","last_change":"2023-12-24T19:51:40.438807+0000","last_active":"2023-12-24T19:51:40.442421+0000","last_peered":"2023-12-24T19:51:40.442421+0000","last_clean":"2023-12-24T19:51:40.442421+0000","last_became_active":"2023-12-24T19:51:40.438483+0000","last_became_peered":"2023-12-24T19:51:40.438483+0000","last_unstale":"2023-12-24T19:51:40.442421+0000","last_undegraded":"2023-12-24T19:51:40.442421+0000","last_fullsized":"2023-12-24T19:51:40.442421+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:07.744878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418636+0000","last_change":"2023-12-24T19:51:39.624395+0000","last_active":"2023-12-24T19:51:40.418636+0000","last_peered":"2023-12-24T19:51:40.418636+0000","last_clean":"2023-12-24T19:51:40.418636+0000","last_became_active":"2023-12-24T19:51:39.624089+0000","last_became_peered":"2023-12-24T19:51:39.624089+0000","last_unstale":"2023-12-24T19:51:40.418636+0000","last_undegraded":"2023-12-24T19:51:40.418636+0000","last_fullsized":"2023-12-24T19:51:40.418636+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:37.763509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440201+0000","last_change":"2023-12-24T19:51:40.435720+0000","last_active":"2023-12-24T19:51:40.440201+0000","last_peered":"2023-12-24T19:51:40.440201+0000","last_clean":"2023-12-24T19:51:40.440201+0000","last_became_active":"2023-12-24T19:51:40.435390+0000","last_became_peered":"2023-12-24T19:51:40.435390+0000","last_unstale":"2023-12-24T19:51:40.440201+0000","last_undegraded":"2023-12-24T19:51:40.440201+0000","last_fullsized":"2023-12-24T19:51:40.440201+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:33.113558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417866+0000","last_change":"2023-12-24T19:51:39.630370+0000","last_active":"2023-12-24T19:51:40.417866+0000","last_peered":"2023-12-24T19:51:40.417866+0000","last_clean":"2023-12-24T19:51:40.417866+0000","last_became_active":"2023-12-24T19:51:39.629867+0000","last_became_peered":"2023-12-24T19:51:39.629867+0000","last_unstale":"2023-12-24T19:51:40.417866+0000","last_undegraded":"2023-12-24T19:51:40.417866+0000","last_fullsized":"2023-12-24T19:51:40.417866+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:32.129671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442627+0000","last_change":"2023-12-24T19:51:40.439935+0000","last_active":"2023-12-24T19:51:40.442627+0000","last_peered":"2023-12-24T19:51:40.442627+0000","last_clean":"2023-12-24T19:51:40.442627+0000","last_became_active":"2023-12-24T19:51:40.439680+0000","last_became_peered":"2023-12-24T19:51:40.439680+0000","last_unstale":"2023-12-24T19:51:40.442627+0000","last_undegraded":"2023-12-24T19:51:40.442627+0000","last_fullsized":"2023-12-24T19:51:40.442627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:15.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432963+0000","last_change":"2023-12-24T19:51:39.625890+0000","last_active":"2023-12-24T19:51:40.432963+0000","last_peered":"2023-12-24T19:51:40.432963+0000","last_clean":"2023-12-24T19:51:40.432963+0000","last_became_active":"2023-12-24T19:51:39.625588+0000","last_became_peered":"2023-12-24T19:51:39.625588+0000","last_unstale":"2023-12-24T19:51:40.432963+0000","last_undegraded":"2023-12-24T19:51:40.432963+0000","last_fullsized":"2023-12-24T19:51:40.432963+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439557+0000","last_change":"2023-12-24T19:51:40.431399+0000","last_active":"2023-12-24T19:51:40.439557+0000","last_peered":"2023-12-24T19:51:40.439557+0000","last_clean":"2023-12-24T19:51:40.439557+0000","last_became_active":"2023-12-24T19:51:40.431099+0000","last_became_peered":"2023-12-24T19:51:40.431099+0000","last_unstale":"2023-12-24T19:51:40.439557+0000","last_undegraded":"2023-12-24T19:51:40.439557+0000","last_fullsized":"2023-12-24T19:51:40.439557+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:31.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417885+0000","last_change":"2023-12-24T19:51:39.617606+0000","last_active":"2023-12-24T19:51:40.417885+0000","last_peered":"2023-12-24T19:51:40.417885+0000","last_clean":"2023-12-24T19:51:40.417885+0000","last_became_active":"2023-12-24T19:51:39.617301+0000","last_became_peered":"2023-12-24T19:51:39.617301+0000","last_unstale":"2023-12-24T19:51:40.417885+0000","last_undegraded":"2023-12-24T19:51:40.417885+0000","last_fullsized":"2023-12-24T19:51:40.417885+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:14.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424922+0000","last_change":"2023-12-24T19:51:40.420315+0000","last_active":"2023-12-24T19:51:40.424922+0000","last_peered":"2023-12-24T19:51:40.424922+0000","last_clean":"2023-12-24T19:51:40.424922+0000","last_became_active":"2023-12-24T19:51:40.420004+0000","last_became_peered":"2023-12-24T19:51:40.420004+0000","last_unstale":"2023-12-24T19:51:40.424922+0000","last_undegraded":"2023-12-24T19:51:40.424922+0000","last_fullsized":"2023-12-24T19:51:40.424922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:08.437228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417154+0000","last_change":"2023-12-24T19:51:39.629519+0000","last_active":"2023-12-24T19:51:40.417154+0000","last_peered":"2023-12-24T19:51:40.417154+0000","last_clean":"2023-12-24T19:51:40.417154+0000","last_became_active":"2023-12-24T19:51:39.629177+0000","last_became_peered":"2023-12-24T19:51:39.629177+0000","last_unstale":"2023-12-24T19:51:40.417154+0000","last_undegraded":"2023-12-24T19:51:40.417154+0000","last_fullsized":"2023-12-24T19:51:40.417154+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.109275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":818,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.416516+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:51:40.416516+0000","last_peered":"2023-12-24T19:51:40.416516+0000","last_clean":"2023-12-24T19:51:40.416516+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:51:40.416516+0000","last_undegraded":"2023-12-24T19:51:40.416516+0000","last_fullsized":"2023-12-24T19:51:40.416516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072020,"statfs":{"total":96636764160,"available":96329748480,"internally_reserved":0,"allocated":2592768,"data_stored":1619101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1719999999999999,"15min":1.1759999999999999},"min":{"1min":0.83299999999999996,"5min":0.65300000000000002,"15min":0.58899999999999997},"max":{"1min":1.639,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2,"15min":1.202},"min":{"1min":1.0760000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5269999999999999,"5min":1.7230000000000001,"15min":1.804},"last":1.216}]},{"osd":1,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.1839999999999999},"min":{"1min":0.82699999999999996,"5min":0.80500000000000005,"15min":0.73899999999999999},"max":{"1min":1.645,"5min":1.645,"15min":1.702},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.2450000000000001},"min":{"1min":1.02,"5min":0.84799999999999998,"15min":0.80200000000000005},"max":{"1min":1.484,"5min":1.6180000000000001,"15min":1.788},"last":0.871}]},{"osd":2,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.2689999999999999,"15min":1.2470000000000001},"min":{"1min":0.98699999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.74,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.2569999999999999,"15min":1.2509999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.82999999999999996},"max":{"1min":1.472,"5min":1.726,"15min":1.79},"last":1.0640000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3109999999999999,"15min":1.3069999999999999},"min":{"1min":0.95499999999999996,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.5189999999999999,"5min":1.7569999999999999,"15min":1.77},"last":1.272},{"interface":"front","average":{"1min":1.319,"5min":1.3260000000000001,"15min":1.3220000000000001},"min":{"1min":0.997,"5min":0.98099999999999998,"15min":0.93500000000000005},"max":{"1min":1.593,"5min":1.829,"15min":1.829},"last":1.6259999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.669,"5min":1.7969999999999999,"15min":1.883},"last":1.331},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2629999999999999,"15min":1.248},"min":{"1min":0.85399999999999998,"5min":0.81200000000000006,"15min":0.73199999999999998},"max":{"1min":1.673,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.5469999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.28},"min":{"1min":1.0740000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7110000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3620000000000001},"min":{"1min":1.069,"5min":0.88100000000000001,"15min":0.80700000000000005},"max":{"1min":1.5920000000000001,"5min":1.853,"15min":2.0609999999999999},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4470000000000001,"15min":1.4299999999999999},"min":{"1min":1.248,"5min":1.024,"15min":0.871},"max":{"1min":1.752,"5min":1.909,"15min":1.97},"last":1.839},{"interface":"front","average":{"1min":1.47,"5min":1.4390000000000001,"15min":1.419},"min":{"1min":1.115,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.954,"15min":1.954},"last":1.671}]}]},{"osd":6,"up_from":13,"seq":55834575748,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315616,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056224,"statfs":{"total":96636764160,"available":96313573376,"internally_reserved":0,"allocated":1990656,"data_stored":1027751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.137}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.0009999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.2969999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.2290000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.079},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.337}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.036},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.2}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.1619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.333}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.879}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.3959999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.109}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.482}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.371},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.496}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311512,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060328,"statfs":{"total":96636764160,"available":96317775872,"internally_reserved":0,"allocated":1982464,"data_stored":1027107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.254},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.67600000000000005},"max":{"1min":1.4670000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.2789999999999999},"min":{"1min":1.0720000000000001,"5min":0.84099999999999997,"15min":0.58399999999999996},"max":{"1min":1.5509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.587}]},{"osd":1,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.873,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":1.4299999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1499999999999999,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.70499999999999996,"15min":0.60199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.4850000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3580000000000001,"15min":1.353},"min":{"1min":1.0449999999999999,"5min":0.94899999999999995,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3440000000000001,"15min":1.3460000000000001},"min":{"1min":1.0149999999999999,"5min":0.77800000000000002,"15min":0.66100000000000003},"max":{"1min":1.706,"5min":1.829,"15min":1.829},"last":1.3169999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":0.92600000000000005,"5min":0.83299999999999996,"15min":0.46400000000000002},"max":{"1min":1.4670000000000001,"5min":1.792,"15min":1.792},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":1.0660000000000001,"5min":0.88400000000000001,"15min":0.63900000000000001},"max":{"1min":1.631,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":1.599,"5min":1.744,"15min":1.879},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.339,"15min":1.321},"min":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.8779999999999999,"15min":1.9159999999999999},"last":2.1819999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.256},"min":{"1min":0.79900000000000004,"5min":0.69399999999999995,"15min":0.56000000000000005},"max":{"1min":1.7350000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.74},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.331,"15min":1.3169999999999999},"min":{"1min":0.93200000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.798,"5min":1.887,"15min":1.887},"last":1.6519999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2829999999999999,"15min":1.27},"min":{"1min":0.77900000000000003,"5min":0.60699999999999998,"15min":0.54500000000000004},"max":{"1min":1.863,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4470000000000001,"15min":1.417},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.831,"5min":2,"15min":2},"last":1.6240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311528,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060312,"statfs":{"total":96636764160,"available":96317759488,"internally_reserved":0,"allocated":1998848,"data_stored":1028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.96399999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.2070000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.026}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.175},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.409}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.097}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":1027695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":0.92200000000000004}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.1679999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.333},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.1359999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.272}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.232}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.73},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.605}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.5760000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.421,"15min":1.647},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.147,"15min":1.1499999999999999},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.087}]},{"osd":2,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0209999999999999,"15min":0.99399999999999999},"min":{"1min":0.754,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1479999999999999,"15min":1.1220000000000001},"min":{"1min":0.86799999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.034}]},{"osd":3,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.298,"15min":1.2729999999999999},"min":{"1min":0.98699999999999999,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.127,"15min":1.137},"min":{"1min":0.89400000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.823},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.298,"15min":1.282},"min":{"1min":1.083,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.6619999999999999,"5min":1.883,"15min":1.883},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.4370000000000001,"15min":1.4239999999999999},"min":{"1min":1.1859999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.849,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.405,"15min":1.403},"min":{"1min":1.0980000000000001,"5min":1.016,"15min":0.96499999999999997},"max":{"1min":1.7849999999999999,"5min":1.806,"15min":1.948},"last":1.351},{"interface":"front","average":{"1min":1.387,"5min":1.395,"15min":1.3839999999999999},"min":{"1min":1.099,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7909999999999999,"5min":1.843,"15min":2.2189999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.516,"15min":1.506},"min":{"1min":1.1299999999999999,"5min":1.0189999999999999,"15min":1.0089999999999999},"max":{"1min":1.944,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5069999999999999,"15min":1.498},"min":{"1min":1.103,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.9570000000000001,"5min":2.1339999999999999,"15min":2.323},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.554,"15min":1.548},"min":{"1min":1.2849999999999999,"5min":0.999,"15min":0.999},"max":{"1min":2.0840000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5389999999999999,"15min":1.512},"min":{"1min":1.268,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0009999999999999,"5min":2.532,"15min":2.532},"last":1.7250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072028,"statfs":{"total":96636764160,"available":96329756672,"internally_reserved":0,"allocated":2584576,"data_stored":1617531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.363,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.091,"5min":1.046,"15min":1.012},"min":{"1min":0.76100000000000001,"5min":0.50800000000000001,"15min":0.504},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.179}]},{"osd":2,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.071,"15min":1.093},"min":{"1min":0.80400000000000005,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.4690000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.74099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5980000000000001,"5min":1.663,"15min":1.833},"last":1.0489999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.0660000000000001},"min":{"1min":0.83899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5249999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.258,"15min":1.272},"min":{"1min":0.92000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.732,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.0069999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.401,"15min":1.379},"min":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.88200000000000001},"max":{"1min":1.6299999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3149999999999999},"min":{"1min":1.008,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2110000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4350000000000001,"15min":1.4259999999999999},"min":{"1min":1.1699999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.6899999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.4350000000000001,"15min":1.4390000000000001},"min":{"1min":1.123,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7110000000000001,"5min":2.0830000000000002,"15min":2.2989999999999999},"last":1.2749999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":1.073,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.677,"5min":1.873,"15min":1.964},"last":1.123},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4830000000000001,"15min":1.4950000000000001},"min":{"1min":1.3009999999999999,"5min":1,"15min":1},"max":{"1min":1.8220000000000001,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.514,"15min":1.522},"min":{"1min":1.254,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7470000000000001,"5min":2.46,"15min":2.46},"last":1.458},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4650000000000001,"15min":1.4690000000000001},"min":{"1min":1.2649999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9590000000000001,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:51:45.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T19:51:46.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.027+0000 7f327f523700 1 Processor -- start 2023-12-24T19:51:46.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 -- start start 2023-12-24T19:51:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f327806db80 0x7f32780c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f327815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327806d6f0 con 0x7f32780c6830 2023-12-24T19:51:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327806c820 con 0x7f327806db80 2023-12-24T19:51:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327f523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327806cae0 con 0x7f327815ca50 2023-12-24T19:51:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f327806db80 0x7f32780c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f327806db80 0x7f32780c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40990/0 (socket says 172.21.15.50:40990) 2023-12-24T19:51:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 -- 172.21.15.50:0/725146026 learned_addr learned my addr 172.21.15.50:0/725146026 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327ed22700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f327815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 -- 172.21.15.50:0/725146026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 msgr2=0x7f327815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f327815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 -- 172.21.15.50:0/725146026 >> v1:172.21.15.82:6789/0 conn(0x7f32780c6830 legacy=0x7f327806af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.031+0000 7f327dd20700 1 -- 172.21.15.50:0/725146026 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327806cdc0 con 0x7f327806db80 2023-12-24T19:51:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327dd20700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c6c00 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f32680099b0 tx=0x7f3268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb13de011fa67d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327d51f700 1 -- 172.21.15.50:0/725146026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268009ea0 con 0x7f327806db80 2023-12-24T19:51:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327d51f700 1 -- 172.21.15.50:0/725146026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326800b860 con 0x7f327806db80 2023-12-24T19:51:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327d51f700 1 -- 172.21.15.50:0/725146026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326800bc00 con 0x7f327806db80 2023-12-24T19:51:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 -- 172.21.15.50:0/725146026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 msgr2=0x7f32780c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c6c00 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f32680099b0 tx=0x7f3268009250 comp rx=0 tx=0).stop 2023-12-24T19:51:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 -- 172.21.15.50:0/725146026 shutdown_connections 2023-12-24T19:51:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f327815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 --2- 172.21.15.50:0/725146026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c6c00 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 -- 172.21.15.50:0/725146026 >> 172.21.15.50:0/725146026 conn(0x7f32780670b0 msgr2=0x7f32780674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 -- 172.21.15.50:0/725146026 shutdown_connections 2023-12-24T19:51:46.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.035+0000 7f327f523700 1 -- 172.21.15.50:0/725146026 wait complete. 2023-12-24T19:51:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 Processor -- start 2023-12-24T19:51:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 -- start start 2023-12-24T19:51:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780c6830 0x7f32780c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f32780c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780bf730 con 0x7f327806db80 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b0f20 con 0x7f32780c6830 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327f523700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b1200 con 0x7f327815ca50 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41006/0 (socket says 172.21.15.50:41006) 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 -- 172.21.15.50:0/3846806270 learned_addr learned my addr 172.21.15.50:0/3846806270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327ed22700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f32780c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327dd20700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780c6830 0x7f32780c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 -- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 msgr2=0x7f32780c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f32780c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 -- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780c6830 msgr2=0x7f32780c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780c6830 0x7f32780c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.039+0000 7f327e521700 1 -- 172.21.15.50:0/3846806270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680094f0 con 0x7f327806db80 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f327e521700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f327400c590 tx=0x7f327400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274011590 con 0x7f327806db80 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3274011710 con 0x7f327806db80 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274011ad0 con 0x7f327806db80 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780b14e0 con 0x7f327806db80 2023-12-24T19:51:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780c1a30 con 0x7f327806db80 2023-12-24T19:51:46.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.043+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327804be40 con 0x7f327806db80 2023-12-24T19:51:46.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.047+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f327401b3b0 con 0x7f327806db80 2023-12-24T19:51:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.047+0000 7f326e7fc700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 0x7f325c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.047+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f327407bfa0 con 0x7f327806db80 2023-12-24T19:51:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.047+0000 7f327dd20700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 0x7f325c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.047+0000 7f327dd20700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 0x7f325c062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32680099b0 tx=0x7f3268017000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.051+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f327404c220 con 0x7f327806db80 2023-12-24T19:51:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.287+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f327806d0a0 con 0x7f327806db80 2023-12-24T19:51:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f326e7fc700 1 -- 172.21.15.50:0/3846806270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1091 (secure 0 0 0) 0x7f3274017460 con 0x7f327806db80 2023-12-24T19:51:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:46.292 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4542,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":159,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":68},{"state_name":"active+clean","count":29}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590438,"bytes_used":2523459584,"bytes_avail":770570653696,"bytes_total":773094113280,"unknown_pgs_ratio":0.7010309100151062,"write_bytes_sec":207,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":78,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8796}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-12-24T19:41:41.962537+0000","services":{}},"progress_events":{}} 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 msgr2=0x7f325c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 0x7f325c062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32680099b0 tx=0x7f3268017000 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 msgr2=0x7f32780c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f327400c590 tx=0x7f327400c8a0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 shutdown_connections 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f325c060550 0x7f325c062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f327815ca50 0x7f32780c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780c6830 0x7f32780c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 --2- 172.21.15.50:0/3846806270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327806db80 0x7f32780c14f0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 >> 172.21.15.50:0/3846806270 conn(0x7f32780670b0 msgr2=0x7f327815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 shutdown_connections 2023-12-24T19:51:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.291+0000 7f327f523700 1 -- 172.21.15.50:0/3846806270 wait complete. 2023-12-24T19:51:46.314 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T19:51:46.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:51:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 Processor -- start 2023-12-24T19:51:46.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 -- start start 2023-12-24T19:51:46.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49c4156dc0 0x7f49c40b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c406cf10 con 0x7f49c41569f0 2023-12-24T19:51:46.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40cd140 con 0x7f49c40cccc0 2023-12-24T19:51:46.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.483+0000 7f49ca84c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c415b890 con 0x7f49c4156dc0 2023-12-24T19:51:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c984a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49c41569f0 0x7f49c406d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34548/0 (socket says 172.21.15.50:34548) 2023-12-24T19:51:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c984a700 1 -- 172.21.15.50:0/3248305784 learned_addr learned my addr 172.21.15.50:0/3248305784 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c9049700 1 --2- 172.21.15.50:0/3248305784 >> v2:172.21.15.82:3300/0 conn(0x7f49c4156dc0 0x7f49c40b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c8848700 1 -- 172.21.15.50:0/3248305784 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596064576 0 0) 0x7f49c406cf10 con 0x7f49c41569f0 2023-12-24T19:51:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c8848700 1 -- 172.21.15.50:0/3248305784 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003570 con 0x7f49c41569f0 2023-12-24T19:51:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c9049700 1 -- 172.21.15.50:0/3248305784 >> v1:172.21.15.82:6789/0 conn(0x7f49c40cccc0 legacy=0x7f49c406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c9049700 1 -- 172.21.15.50:0/3248305784 >> v1:172.21.15.50:6789/0 conn(0x7f49c41569f0 legacy=0x7f49c406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c9049700 1 -- 172.21.15.50:0/3248305784 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40cd680 con 0x7f49c4156dc0 2023-12-24T19:51:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c9049700 1 --2- 172.21.15.50:0/3248305784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c4156dc0 0x7f49c40b1280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f49c40cd870 tx=0x7f49b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16aa2fb9a3d367f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c8848700 1 -- 172.21.15.50:0/3248305784 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4011630 con 0x7f49c4156dc0 2023-12-24T19:51:46.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c8848700 1 -- 172.21.15.50:0/3248305784 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4011790 con 0x7f49c4156dc0 2023-12-24T19:51:46.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.487+0000 7f49c8848700 1 -- 172.21.15.50:0/3248305784 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4011b50 con 0x7f49c4156dc0 2023-12-24T19:51:46.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 -- 172.21.15.50:0/3248305784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c4156dc0 msgr2=0x7f49c40b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 --2- 172.21.15.50:0/3248305784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c4156dc0 0x7f49c40b1280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f49c40cd870 tx=0x7f49b40091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 -- 172.21.15.50:0/3248305784 shutdown_connections 2023-12-24T19:51:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 --2- 172.21.15.50:0/3248305784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c4156dc0 0x7f49c40b1280 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 -- 172.21.15.50:0/3248305784 >> 172.21.15.50:0/3248305784 conn(0x7f49c40cdc50 msgr2=0x7f49c40ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 -- 172.21.15.50:0/3248305784 shutdown_connections 2023-12-24T19:51:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.491+0000 7f49ca84c700 1 -- 172.21.15.50:0/3248305784 wait complete. 2023-12-24T19:51:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 Processor -- start 2023-12-24T19:51:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 -- start start 2023-12-24T19:51:46.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49c40cccc0 0x7f49c414d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 0x7f49c414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c414e490 con 0x7f49c4156dc0 2023-12-24T19:51:46.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c414d880 con 0x7f49c41569f0 2023-12-24T19:51:46.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca84c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c414db60 con 0x7f49c40cccc0 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41022/0 (socket says 172.21.15.50:41022) 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 -- 172.21.15.50:0/2519492629 learned_addr learned my addr 172.21.15.50:0/2519492629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49c984a700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49c40cccc0 0x7f49c414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49c9049700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 0x7f49c414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 -- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49c40cccc0 msgr2=0x7f49c414d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49c40cccc0 0x7f49c414d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 -- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 msgr2=0x7f49c414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 0x7f49c414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49ca04b700 1 -- 172.21.15.50:0/2519492629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009420 con 0x7f49c4156dc0 2023-12-24T19:51:46.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.495+0000 7f49c9049700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 0x7f49c414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:46.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49ca04b700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c560 tx=0x7f49bc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011590 con 0x7f49c4156dc0 2023-12-24T19:51:46.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0116f0 con 0x7f49c4156dc0 2023-12-24T19:51:46.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011ab0 con 0x7f49c4156dc0 2023-12-24T19:51:46.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c414de40 con 0x7f49c4156dc0 2023-12-24T19:51:46.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c414d570 con 0x7f49c4156dc0 2023-12-24T19:51:46.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.499+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c414e600 con 0x7f49c4156dc0 2023-12-24T19:51:46.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.503+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f49bc01b3b0 con 0x7f49c4156dc0 2023-12-24T19:51:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.503+0000 7f49b9ffb700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 0x7f49a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.503+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f49bc07bee0 con 0x7f49c4156dc0 2023-12-24T19:51:46.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.503+0000 7f49c984a700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 0x7f49a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:46.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.503+0000 7f49c984a700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 0x7f49a8062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49c0005c50 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:46.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.507+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49bc04c160 con 0x7f49c4156dc0 2023-12-24T19:51:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.679+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49c404be40 con 0x7f49a8060550 2023-12-24T19:51:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.687+0000 7f49b9ffb700 1 -- 172.21.15.50:0/2519492629 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f49c404be40 con 0x7f49a8060550 2023-12-24T19:51:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 msgr2=0x7f49a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 0x7f49a8062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49c0005c50 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2023-12-24T19:51:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 msgr2=0x7f49c414e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:46.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c560 tx=0x7f49bc007ef0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 shutdown_connections 2023-12-24T19:51:46.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f49a8060550 0x7f49a8062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c4156dc0 0x7f49c414e920 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49c41569f0 0x7f49c414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 --2- 172.21.15.50:0/2519492629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49c40cccc0 0x7f49c414d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.695+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 >> 172.21.15.50:0/2519492629 conn(0x7f49c40cdc50 msgr2=0x7f49c40afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.699+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 shutdown_connections 2023-12-24T19:51:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:46.699+0000 7f49ca84c700 1 -- 172.21.15.50:0/2519492629 wait complete. 2023-12-24T19:51:46.702 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:51:46.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:51:45.520797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464648,"kb_used_data":16712,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752510072,"statfs":{"total":773094113280,"available":770570313728,"internally_reserved":0,"allocated":17113088,"data_stored":9402204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002539"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428180+0000","last_change":"2023-12-24T19:51:40.426029+0000","last_active":"2023-12-24T19:51:40.428180+0000","last_peered":"2023-12-24T19:51:40.428180+0000","last_clean":"2023-12-24T19:51:40.428180+0000","last_became_active":"2023-12-24T19:51:40.424974+0000","last_became_peered":"2023-12-24T19:51:40.424974+0000","last_unstale":"2023-12-24T19:51:40.428180+0000","last_undegraded":"2023-12-24T19:51:40.428180+0000","last_fullsized":"2023-12-24T19:51:40.428180+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:07.839132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436752+0000","last_change":"2023-12-24T19:51:40.432444+0000","last_active":"2023-12-24T19:51:40.436752+0000","last_peered":"2023-12-24T19:51:40.436752+0000","last_clean":"2023-12-24T19:51:40.436752+0000","last_became_active":"2023-12-24T19:51:40.432108+0000","last_became_peered":"2023-12-24T19:51:40.432108+0000","last_unstale":"2023-12-24T19:51:40.436752+0000","last_undegraded":"2023-12-24T19:51:40.436752+0000","last_fullsized":"2023-12-24T19:51:40.436752+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:59.366293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427164+0000","last_change":"2023-12-24T19:51:40.420928+0000","last_active":"2023-12-24T19:51:40.427164+0000","last_peered":"2023-12-24T19:51:40.427164+0000","last_clean":"2023-12-24T19:51:40.427164+0000","last_became_active":"2023-12-24T19:51:40.420627+0000","last_became_peered":"2023-12-24T19:51:40.420627+0000","last_unstale":"2023-12-24T19:51:40.427164+0000","last_undegraded":"2023-12-24T19:51:40.427164+0000","last_fullsized":"2023-12-24T19:51:40.427164+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:21.995194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434081+0000","last_change":"2023-12-24T19:51:40.430939+0000","last_active":"2023-12-24T19:51:40.434081+0000","last_peered":"2023-12-24T19:51:40.434081+0000","last_clean":"2023-12-24T19:51:40.434081+0000","last_became_active":"2023-12-24T19:51:40.430136+0000","last_became_peered":"2023-12-24T19:51:40.430136+0000","last_unstale":"2023-12-24T19:51:40.434081+0000","last_undegraded":"2023-12-24T19:51:40.434081+0000","last_fullsized":"2023-12-24T19:51:40.434081+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430002+0000","last_change":"2023-12-24T19:51:40.423425+0000","last_active":"2023-12-24T19:51:40.430002+0000","last_peered":"2023-12-24T19:51:40.430002+0000","last_clean":"2023-12-24T19:51:40.430002+0000","last_became_active":"2023-12-24T19:51:40.423020+0000","last_became_peered":"2023-12-24T19:51:40.423020+0000","last_unstale":"2023-12-24T19:51:40.430002+0000","last_undegraded":"2023-12-24T19:51:40.430002+0000","last_fullsized":"2023-12-24T19:51:40.430002+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439630+0000","last_change":"2023-12-24T19:51:40.435820+0000","last_active":"2023-12-24T19:51:40.439630+0000","last_peered":"2023-12-24T19:51:40.439630+0000","last_clean":"2023-12-24T19:51:40.439630+0000","last_became_active":"2023-12-24T19:51:40.435487+0000","last_became_peered":"2023-12-24T19:51:40.435487+0000","last_unstale":"2023-12-24T19:51:40.439630+0000","last_undegraded":"2023-12-24T19:51:40.439630+0000","last_fullsized":"2023-12-24T19:51:40.439630+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:25.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431001+0000","last_change":"2023-12-24T19:51:40.427983+0000","last_active":"2023-12-24T19:51:40.431001+0000","last_peered":"2023-12-24T19:51:40.431001+0000","last_clean":"2023-12-24T19:51:40.431001+0000","last_became_active":"2023-12-24T19:51:40.427648+0000","last_became_peered":"2023-12-24T19:51:40.427648+0000","last_unstale":"2023-12-24T19:51:40.431001+0000","last_undegraded":"2023-12-24T19:51:40.431001+0000","last_fullsized":"2023-12-24T19:51:40.431001+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:10.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427900+0000","last_change":"2023-12-24T19:51:40.423103+0000","last_active":"2023-12-24T19:51:40.427900+0000","last_peered":"2023-12-24T19:51:40.427900+0000","last_clean":"2023-12-24T19:51:40.427900+0000","last_became_active":"2023-12-24T19:51:40.422807+0000","last_became_peered":"2023-12-24T19:51:40.422807+0000","last_unstale":"2023-12-24T19:51:40.427900+0000","last_undegraded":"2023-12-24T19:51:40.427900+0000","last_fullsized":"2023-12-24T19:51:40.427900+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442312+0000","last_change":"2023-12-24T19:51:40.439067+0000","last_active":"2023-12-24T19:51:40.442312+0000","last_peered":"2023-12-24T19:51:40.442312+0000","last_clean":"2023-12-24T19:51:40.442312+0000","last_became_active":"2023-12-24T19:51:40.437629+0000","last_became_peered":"2023-12-24T19:51:40.437629+0000","last_unstale":"2023-12-24T19:51:40.442312+0000","last_undegraded":"2023-12-24T19:51:40.442312+0000","last_fullsized":"2023-12-24T19:51:40.442312+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:01.896988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429629+0000","last_change":"2023-12-24T19:51:40.424048+0000","last_active":"2023-12-24T19:51:40.429629+0000","last_peered":"2023-12-24T19:51:40.429629+0000","last_clean":"2023-12-24T19:51:40.429629+0000","last_became_active":"2023-12-24T19:51:40.423770+0000","last_became_peered":"2023-12-24T19:51:40.423770+0000","last_unstale":"2023-12-24T19:51:40.429629+0000","last_undegraded":"2023-12-24T19:51:40.429629+0000","last_fullsized":"2023-12-24T19:51:40.429629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434210+0000","last_change":"2023-12-24T19:51:40.430545+0000","last_active":"2023-12-24T19:51:40.434210+0000","last_peered":"2023-12-24T19:51:40.434210+0000","last_clean":"2023-12-24T19:51:40.434210+0000","last_became_active":"2023-12-24T19:51:40.430100+0000","last_became_peered":"2023-12-24T19:51:40.430100+0000","last_unstale":"2023-12-24T19:51:40.434210+0000","last_undegraded":"2023-12-24T19:51:40.434210+0000","last_fullsized":"2023-12-24T19:51:40.434210+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428489+0000","last_change":"2023-12-24T19:51:40.421200+0000","last_active":"2023-12-24T19:51:40.428489+0000","last_peered":"2023-12-24T19:51:40.428489+0000","last_clean":"2023-12-24T19:51:40.428489+0000","last_became_active":"2023-12-24T19:51:40.420655+0000","last_became_peered":"2023-12-24T19:51:40.420655+0000","last_unstale":"2023-12-24T19:51:40.428489+0000","last_undegraded":"2023-12-24T19:51:40.428489+0000","last_fullsized":"2023-12-24T19:51:40.428489+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:59.792856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442661+0000","last_change":"2023-12-24T19:51:40.439954+0000","last_active":"2023-12-24T19:51:40.442661+0000","last_peered":"2023-12-24T19:51:40.442661+0000","last_clean":"2023-12-24T19:51:40.442661+0000","last_became_active":"2023-12-24T19:51:40.439679+0000","last_became_peered":"2023-12-24T19:51:40.439679+0000","last_unstale":"2023-12-24T19:51:40.442661+0000","last_undegraded":"2023-12-24T19:51:40.442661+0000","last_fullsized":"2023-12-24T19:51:40.442661+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:36.542056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436110+0000","last_change":"2023-12-24T19:51:40.432361+0000","last_active":"2023-12-24T19:51:40.436110+0000","last_peered":"2023-12-24T19:51:40.436110+0000","last_clean":"2023-12-24T19:51:40.436110+0000","last_became_active":"2023-12-24T19:51:40.430131+0000","last_became_peered":"2023-12-24T19:51:40.430131+0000","last_unstale":"2023-12-24T19:51:40.436110+0000","last_undegraded":"2023-12-24T19:51:40.436110+0000","last_fullsized":"2023-12-24T19:51:40.436110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:49.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429680+0000","last_change":"2023-12-24T19:51:40.425521+0000","last_active":"2023-12-24T19:51:40.429680+0000","last_peered":"2023-12-24T19:51:40.429680+0000","last_clean":"2023-12-24T19:51:40.429680+0000","last_became_active":"2023-12-24T19:51:40.424646+0000","last_became_peered":"2023-12-24T19:51:40.424646+0000","last_unstale":"2023-12-24T19:51:40.429680+0000","last_undegraded":"2023-12-24T19:51:40.429680+0000","last_fullsized":"2023-12-24T19:51:40.429680+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:40.758803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443598+0000","last_change":"2023-12-24T19:51:40.441627+0000","last_active":"2023-12-24T19:51:40.443598+0000","last_peered":"2023-12-24T19:51:40.443598+0000","last_clean":"2023-12-24T19:51:40.443598+0000","last_became_active":"2023-12-24T19:51:40.440587+0000","last_became_peered":"2023-12-24T19:51:40.440587+0000","last_unstale":"2023-12-24T19:51:40.443598+0000","last_undegraded":"2023-12-24T19:51:40.443598+0000","last_fullsized":"2023-12-24T19:51:40.443598+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:50.426428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443559+0000","last_change":"2023-12-24T19:51:40.441435+0000","last_active":"2023-12-24T19:51:40.443559+0000","last_peered":"2023-12-24T19:51:40.443559+0000","last_clean":"2023-12-24T19:51:40.443559+0000","last_became_active":"2023-12-24T19:51:40.441142+0000","last_became_peered":"2023-12-24T19:51:40.441142+0000","last_unstale":"2023-12-24T19:51:40.443559+0000","last_undegraded":"2023-12-24T19:51:40.443559+0000","last_fullsized":"2023-12-24T19:51:40.443559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:46.386942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438746+0000","last_change":"2023-12-24T19:51:40.433297+0000","last_active":"2023-12-24T19:51:40.438746+0000","last_peered":"2023-12-24T19:51:40.438746+0000","last_clean":"2023-12-24T19:51:40.438746+0000","last_became_active":"2023-12-24T19:51:40.428557+0000","last_became_peered":"2023-12-24T19:51:40.428557+0000","last_unstale":"2023-12-24T19:51:40.438746+0000","last_undegraded":"2023-12-24T19:51:40.438746+0000","last_fullsized":"2023-12-24T19:51:40.438746+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434565+0000","last_change":"2023-12-24T19:51:40.430060+0000","last_active":"2023-12-24T19:51:40.434565+0000","last_peered":"2023-12-24T19:51:40.434565+0000","last_clean":"2023-12-24T19:51:40.434565+0000","last_became_active":"2023-12-24T19:51:40.429480+0000","last_became_peered":"2023-12-24T19:51:40.429480+0000","last_unstale":"2023-12-24T19:51:40.434565+0000","last_undegraded":"2023-12-24T19:51:40.434565+0000","last_fullsized":"2023-12-24T19:51:40.434565+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:59.905534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440750+0000","last_change":"2023-12-24T19:51:40.434965+0000","last_active":"2023-12-24T19:51:40.440750+0000","last_peered":"2023-12-24T19:51:40.440750+0000","last_clean":"2023-12-24T19:51:40.440750+0000","last_became_active":"2023-12-24T19:51:40.430478+0000","last_became_peered":"2023-12-24T19:51:40.430478+0000","last_unstale":"2023-12-24T19:51:40.440750+0000","last_undegraded":"2023-12-24T19:51:40.440750+0000","last_fullsized":"2023-12-24T19:51:40.440750+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440842+0000","last_change":"2023-12-24T19:51:40.435541+0000","last_active":"2023-12-24T19:51:40.440842+0000","last_peered":"2023-12-24T19:51:40.440842+0000","last_clean":"2023-12-24T19:51:40.440842+0000","last_became_active":"2023-12-24T19:51:40.435225+0000","last_became_peered":"2023-12-24T19:51:40.435225+0000","last_unstale":"2023-12-24T19:51:40.440842+0000","last_undegraded":"2023-12-24T19:51:40.440842+0000","last_fullsized":"2023-12-24T19:51:40.440842+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:46.218240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436594+0000","last_change":"2023-12-24T19:51:40.434506+0000","last_active":"2023-12-24T19:51:40.436594+0000","last_peered":"2023-12-24T19:51:40.436594+0000","last_clean":"2023-12-24T19:51:40.436594+0000","last_became_active":"2023-12-24T19:51:40.434235+0000","last_became_peered":"2023-12-24T19:51:40.434235+0000","last_unstale":"2023-12-24T19:51:40.436594+0000","last_undegraded":"2023-12-24T19:51:40.436594+0000","last_fullsized":"2023-12-24T19:51:40.436594+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:03.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436552+0000","last_change":"2023-12-24T19:51:40.433597+0000","last_active":"2023-12-24T19:51:40.436552+0000","last_peered":"2023-12-24T19:51:40.436552+0000","last_clean":"2023-12-24T19:51:40.436552+0000","last_became_active":"2023-12-24T19:51:40.433336+0000","last_became_peered":"2023-12-24T19:51:40.433336+0000","last_unstale":"2023-12-24T19:51:40.436552+0000","last_undegraded":"2023-12-24T19:51:40.436552+0000","last_fullsized":"2023-12-24T19:51:40.436552+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444261+0000","last_change":"2023-12-24T19:51:40.443021+0000","last_active":"2023-12-24T19:51:40.444261+0000","last_peered":"2023-12-24T19:51:40.444261+0000","last_clean":"2023-12-24T19:51:40.444261+0000","last_became_active":"2023-12-24T19:51:40.442698+0000","last_became_peered":"2023-12-24T19:51:40.442698+0000","last_unstale":"2023-12-24T19:51:40.444261+0000","last_undegraded":"2023-12-24T19:51:40.444261+0000","last_fullsized":"2023-12-24T19:51:40.444261+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419227+0000","last_change":"2023-12-24T19:51:40.415109+0000","last_active":"2023-12-24T19:51:40.419227+0000","last_peered":"2023-12-24T19:51:40.419227+0000","last_clean":"2023-12-24T19:51:40.419227+0000","last_became_active":"2023-12-24T19:51:40.413960+0000","last_became_peered":"2023-12-24T19:51:40.413960+0000","last_unstale":"2023-12-24T19:51:40.419227+0000","last_undegraded":"2023-12-24T19:51:40.419227+0000","last_fullsized":"2023-12-24T19:51:40.419227+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:41.110755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436867+0000","last_change":"2023-12-24T19:51:40.430598+0000","last_active":"2023-12-24T19:51:40.436867+0000","last_peered":"2023-12-24T19:51:40.436867+0000","last_clean":"2023-12-24T19:51:40.436867+0000","last_became_active":"2023-12-24T19:51:40.428623+0000","last_became_peered":"2023-12-24T19:51:40.428623+0000","last_unstale":"2023-12-24T19:51:40.436867+0000","last_undegraded":"2023-12-24T19:51:40.436867+0000","last_fullsized":"2023-12-24T19:51:40.436867+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:05.101525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444825+0000","last_change":"2023-12-24T19:51:40.443011+0000","last_active":"2023-12-24T19:51:40.444825+0000","last_peered":"2023-12-24T19:51:40.444825+0000","last_clean":"2023-12-24T19:51:40.444825+0000","last_became_active":"2023-12-24T19:51:40.442709+0000","last_became_peered":"2023-12-24T19:51:40.442709+0000","last_unstale":"2023-12-24T19:51:40.444825+0000","last_undegraded":"2023-12-24T19:51:40.444825+0000","last_fullsized":"2023-12-24T19:51:40.444825+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:37.960323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426546+0000","last_change":"2023-12-24T19:51:40.422494+0000","last_active":"2023-12-24T19:51:40.426546+0000","last_peered":"2023-12-24T19:51:40.426546+0000","last_clean":"2023-12-24T19:51:40.426546+0000","last_became_active":"2023-12-24T19:51:40.421874+0000","last_became_peered":"2023-12-24T19:51:40.421874+0000","last_unstale":"2023-12-24T19:51:40.426546+0000","last_undegraded":"2023-12-24T19:51:40.426546+0000","last_fullsized":"2023-12-24T19:51:40.426546+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444133+0000","last_change":"2023-12-24T19:51:40.439408+0000","last_active":"2023-12-24T19:51:40.444133+0000","last_peered":"2023-12-24T19:51:40.444133+0000","last_clean":"2023-12-24T19:51:40.444133+0000","last_became_active":"2023-12-24T19:51:40.438577+0000","last_became_peered":"2023-12-24T19:51:40.438577+0000","last_unstale":"2023-12-24T19:51:40.444133+0000","last_undegraded":"2023-12-24T19:51:40.444133+0000","last_fullsized":"2023-12-24T19:51:40.444133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:44.285116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419740+0000","last_change":"2023-12-24T19:51:40.415045+0000","last_active":"2023-12-24T19:51:40.419740+0000","last_peered":"2023-12-24T19:51:40.419740+0000","last_clean":"2023-12-24T19:51:40.419740+0000","last_became_active":"2023-12-24T19:51:40.414739+0000","last_became_peered":"2023-12-24T19:51:40.414739+0000","last_unstale":"2023-12-24T19:51:40.419740+0000","last_undegraded":"2023-12-24T19:51:40.419740+0000","last_fullsized":"2023-12-24T19:51:40.419740+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:38.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439832+0000","last_change":"2023-12-24T19:51:40.436389+0000","last_active":"2023-12-24T19:51:40.439832+0000","last_peered":"2023-12-24T19:51:40.439832+0000","last_clean":"2023-12-24T19:51:40.439832+0000","last_became_active":"2023-12-24T19:51:40.436043+0000","last_became_peered":"2023-12-24T19:51:40.436043+0000","last_unstale":"2023-12-24T19:51:40.439832+0000","last_undegraded":"2023-12-24T19:51:40.439832+0000","last_fullsized":"2023-12-24T19:51:40.439832+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436478+0000","last_change":"2023-12-24T19:51:40.433033+0000","last_active":"2023-12-24T19:51:40.436478+0000","last_peered":"2023-12-24T19:51:40.436478+0000","last_clean":"2023-12-24T19:51:40.436478+0000","last_became_active":"2023-12-24T19:51:40.432714+0000","last_became_peered":"2023-12-24T19:51:40.432714+0000","last_unstale":"2023-12-24T19:51:40.436478+0000","last_undegraded":"2023-12-24T19:51:40.436478+0000","last_fullsized":"2023-12-24T19:51:40.436478+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428640+0000","last_change":"2023-12-24T19:51:40.425834+0000","last_active":"2023-12-24T19:51:40.428640+0000","last_peered":"2023-12-24T19:51:40.428640+0000","last_clean":"2023-12-24T19:51:40.428640+0000","last_became_active":"2023-12-24T19:51:40.425546+0000","last_became_peered":"2023-12-24T19:51:40.425546+0000","last_unstale":"2023-12-24T19:51:40.428640+0000","last_undegraded":"2023-12-24T19:51:40.428640+0000","last_fullsized":"2023-12-24T19:51:40.428640+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632532+0000","last_change":"2023-12-24T19:51:39.624722+0000","last_active":"2023-12-24T19:51:40.632532+0000","last_peered":"2023-12-24T19:51:40.632532+0000","last_clean":"2023-12-24T19:51:40.632532+0000","last_became_active":"2023-12-24T19:51:39.624389+0000","last_became_peered":"2023-12-24T19:51:39.624389+0000","last_unstale":"2023-12-24T19:51:40.632532+0000","last_undegraded":"2023-12-24T19:51:40.632532+0000","last_fullsized":"2023-12-24T19:51:40.632532+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:46.834080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436623+0000","last_change":"2023-12-24T19:51:40.434492+0000","last_active":"2023-12-24T19:51:40.436623+0000","last_peered":"2023-12-24T19:51:40.436623+0000","last_clean":"2023-12-24T19:51:40.436623+0000","last_became_active":"2023-12-24T19:51:40.434172+0000","last_became_peered":"2023-12-24T19:51:40.434172+0000","last_unstale":"2023-12-24T19:51:40.436623+0000","last_undegraded":"2023-12-24T19:51:40.436623+0000","last_fullsized":"2023-12-24T19:51:40.436623+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:29.790775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631762+0000","last_change":"2023-12-24T19:51:39.614040+0000","last_active":"2023-12-24T19:51:40.631762+0000","last_peered":"2023-12-24T19:51:40.631762+0000","last_clean":"2023-12-24T19:51:40.631762+0000","last_became_active":"2023-12-24T19:51:39.613728+0000","last_became_peered":"2023-12-24T19:51:39.613728+0000","last_unstale":"2023-12-24T19:51:40.631762+0000","last_undegraded":"2023-12-24T19:51:40.631762+0000","last_fullsized":"2023-12-24T19:51:40.631762+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.524994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436148+0000","last_change":"2023-12-24T19:51:40.431375+0000","last_active":"2023-12-24T19:51:40.436148+0000","last_peered":"2023-12-24T19:51:40.436148+0000","last_clean":"2023-12-24T19:51:40.436148+0000","last_became_active":"2023-12-24T19:51:40.429179+0000","last_became_peered":"2023-12-24T19:51:40.429179+0000","last_unstale":"2023-12-24T19:51:40.436148+0000","last_undegraded":"2023-12-24T19:51:40.436148+0000","last_fullsized":"2023-12-24T19:51:40.436148+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632010+0000","last_change":"2023-12-24T19:51:39.632825+0000","last_active":"2023-12-24T19:51:40.632010+0000","last_peered":"2023-12-24T19:51:40.632010+0000","last_clean":"2023-12-24T19:51:40.632010+0000","last_became_active":"2023-12-24T19:51:39.632510+0000","last_became_peered":"2023-12-24T19:51:39.632510+0000","last_unstale":"2023-12-24T19:51:40.632010+0000","last_undegraded":"2023-12-24T19:51:40.632010+0000","last_fullsized":"2023-12-24T19:51:40.632010+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:04.825207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426987+0000","last_change":"2023-12-24T19:51:40.425316+0000","last_active":"2023-12-24T19:51:40.426987+0000","last_peered":"2023-12-24T19:51:40.426987+0000","last_clean":"2023-12-24T19:51:40.426987+0000","last_became_active":"2023-12-24T19:51:40.424708+0000","last_became_peered":"2023-12-24T19:51:40.424708+0000","last_unstale":"2023-12-24T19:51:40.426987+0000","last_undegraded":"2023-12-24T19:51:40.426987+0000","last_fullsized":"2023-12-24T19:51:40.426987+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:12.476714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630698+0000","last_change":"2023-12-24T19:51:39.627945+0000","last_active":"2023-12-24T19:51:40.630698+0000","last_peered":"2023-12-24T19:51:40.630698+0000","last_clean":"2023-12-24T19:51:40.630698+0000","last_became_active":"2023-12-24T19:51:39.627619+0000","last_became_peered":"2023-12-24T19:51:39.627619+0000","last_unstale":"2023-12-24T19:51:40.630698+0000","last_undegraded":"2023-12-24T19:51:40.630698+0000","last_fullsized":"2023-12-24T19:51:40.630698+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:23.816437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441628+0000","last_change":"2023-12-24T19:51:40.438779+0000","last_active":"2023-12-24T19:51:40.441628+0000","last_peered":"2023-12-24T19:51:40.441628+0000","last_clean":"2023-12-24T19:51:40.441628+0000","last_became_active":"2023-12-24T19:51:40.438495+0000","last_became_peered":"2023-12-24T19:51:40.438495+0000","last_unstale":"2023-12-24T19:51:40.441628+0000","last_undegraded":"2023-12-24T19:51:40.441628+0000","last_fullsized":"2023-12-24T19:51:40.441628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:32.553401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629405+0000","last_change":"2023-12-24T19:51:39.625630+0000","last_active":"2023-12-24T19:51:40.629405+0000","last_peered":"2023-12-24T19:51:40.629405+0000","last_clean":"2023-12-24T19:51:40.629405+0000","last_became_active":"2023-12-24T19:51:39.625062+0000","last_became_peered":"2023-12-24T19:51:39.625062+0000","last_unstale":"2023-12-24T19:51:40.629405+0000","last_undegraded":"2023-12-24T19:51:40.629405+0000","last_fullsized":"2023-12-24T19:51:40.629405+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428263+0000","last_change":"2023-12-24T19:51:40.423118+0000","last_active":"2023-12-24T19:51:40.428263+0000","last_peered":"2023-12-24T19:51:40.428263+0000","last_clean":"2023-12-24T19:51:40.428263+0000","last_became_active":"2023-12-24T19:51:40.422754+0000","last_became_peered":"2023-12-24T19:51:40.422754+0000","last_unstale":"2023-12-24T19:51:40.428263+0000","last_undegraded":"2023-12-24T19:51:40.428263+0000","last_fullsized":"2023-12-24T19:51:40.428263+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631702+0000","last_change":"2023-12-24T19:51:39.620796+0000","last_active":"2023-12-24T19:51:40.631702+0000","last_peered":"2023-12-24T19:51:40.631702+0000","last_clean":"2023-12-24T19:51:40.631702+0000","last_became_active":"2023-12-24T19:51:39.620494+0000","last_became_peered":"2023-12-24T19:51:39.620494+0000","last_unstale":"2023-12-24T19:51:40.631702+0000","last_undegraded":"2023-12-24T19:51:40.631702+0000","last_fullsized":"2023-12-24T19:51:40.631702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:45.369881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438765+0000","last_change":"2023-12-24T19:51:40.434720+0000","last_active":"2023-12-24T19:51:40.438765+0000","last_peered":"2023-12-24T19:51:40.438765+0000","last_clean":"2023-12-24T19:51:40.438765+0000","last_became_active":"2023-12-24T19:51:40.433651+0000","last_became_peered":"2023-12-24T19:51:40.433651+0000","last_unstale":"2023-12-24T19:51:40.438765+0000","last_undegraded":"2023-12-24T19:51:40.438765+0000","last_fullsized":"2023-12-24T19:51:40.438765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432720+0000","last_change":"2023-12-24T19:51:39.628949+0000","last_active":"2023-12-24T19:51:40.432720+0000","last_peered":"2023-12-24T19:51:40.432720+0000","last_clean":"2023-12-24T19:51:40.432720+0000","last_became_active":"2023-12-24T19:51:39.628339+0000","last_became_peered":"2023-12-24T19:51:39.628339+0000","last_unstale":"2023-12-24T19:51:40.432720+0000","last_undegraded":"2023-12-24T19:51:40.432720+0000","last_fullsized":"2023-12-24T19:51:40.432720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441331+0000","last_change":"2023-12-24T19:51:40.438801+0000","last_active":"2023-12-24T19:51:40.441331+0000","last_peered":"2023-12-24T19:51:40.441331+0000","last_clean":"2023-12-24T19:51:40.441331+0000","last_became_active":"2023-12-24T19:51:40.438303+0000","last_became_peered":"2023-12-24T19:51:40.438303+0000","last_unstale":"2023-12-24T19:51:40.441331+0000","last_undegraded":"2023-12-24T19:51:40.441331+0000","last_fullsized":"2023-12-24T19:51:40.441331+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:53:36.022014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.411137+0000","last_change":"2023-12-24T19:51:39.610871+0000","last_active":"2023-12-24T19:51:40.411137+0000","last_peered":"2023-12-24T19:51:40.411137+0000","last_clean":"2023-12-24T19:51:40.411137+0000","last_became_active":"2023-12-24T19:51:39.610529+0000","last_became_peered":"2023-12-24T19:51:39.610529+0000","last_unstale":"2023-12-24T19:51:40.411137+0000","last_undegraded":"2023-12-24T19:51:40.411137+0000","last_fullsized":"2023-12-24T19:51:40.411137+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:24:03.143988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418608+0000","last_change":"2023-12-24T19:51:40.416121+0000","last_active":"2023-12-24T19:51:40.418608+0000","last_peered":"2023-12-24T19:51:40.418608+0000","last_clean":"2023-12-24T19:51:40.418608+0000","last_became_active":"2023-12-24T19:51:40.415769+0000","last_became_peered":"2023-12-24T19:51:40.415769+0000","last_unstale":"2023-12-24T19:51:40.418608+0000","last_undegraded":"2023-12-24T19:51:40.418608+0000","last_fullsized":"2023-12-24T19:51:40.418608+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.420846+0000","last_change":"2023-12-24T19:51:39.613940+0000","last_active":"2023-12-24T19:51:40.420846+0000","last_peered":"2023-12-24T19:51:40.420846+0000","last_clean":"2023-12-24T19:51:40.420846+0000","last_became_active":"2023-12-24T19:51:39.613646+0000","last_became_peered":"2023-12-24T19:51:39.613646+0000","last_unstale":"2023-12-24T19:51:40.420846+0000","last_undegraded":"2023-12-24T19:51:40.420846+0000","last_fullsized":"2023-12-24T19:51:40.420846+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:40.093694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440701+0000","last_change":"2023-12-24T19:51:40.436559+0000","last_active":"2023-12-24T19:51:40.440701+0000","last_peered":"2023-12-24T19:51:40.440701+0000","last_clean":"2023-12-24T19:51:40.440701+0000","last_became_active":"2023-12-24T19:51:40.436138+0000","last_became_peered":"2023-12-24T19:51:40.436138+0000","last_unstale":"2023-12-24T19:51:40.440701+0000","last_undegraded":"2023-12-24T19:51:40.440701+0000","last_fullsized":"2023-12-24T19:51:40.440701+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:32.510531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409890+0000","last_change":"2023-12-24T19:51:39.632193+0000","last_active":"2023-12-24T19:51:40.409890+0000","last_peered":"2023-12-24T19:51:40.409890+0000","last_clean":"2023-12-24T19:51:40.409890+0000","last_became_active":"2023-12-24T19:51:39.631461+0000","last_became_peered":"2023-12-24T19:51:39.631461+0000","last_unstale":"2023-12-24T19:51:40.409890+0000","last_undegraded":"2023-12-24T19:51:40.409890+0000","last_fullsized":"2023-12-24T19:51:40.409890+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:27.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439526+0000","last_change":"2023-12-24T19:51:40.433371+0000","last_active":"2023-12-24T19:51:40.439526+0000","last_peered":"2023-12-24T19:51:40.439526+0000","last_clean":"2023-12-24T19:51:40.439526+0000","last_became_active":"2023-12-24T19:51:40.432550+0000","last_became_peered":"2023-12-24T19:51:40.432550+0000","last_unstale":"2023-12-24T19:51:40.439526+0000","last_undegraded":"2023-12-24T19:51:40.439526+0000","last_fullsized":"2023-12-24T19:51:40.439526+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:04.937548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632962+0000","last_change":"2023-12-24T19:51:39.629596+0000","last_active":"2023-12-24T19:51:40.632962+0000","last_peered":"2023-12-24T19:51:40.632962+0000","last_clean":"2023-12-24T19:51:40.632962+0000","last_became_active":"2023-12-24T19:51:39.629252+0000","last_became_peered":"2023-12-24T19:51:39.629252+0000","last_unstale":"2023-12-24T19:51:40.632962+0000","last_undegraded":"2023-12-24T19:51:40.632962+0000","last_fullsized":"2023-12-24T19:51:40.632962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:13:42.973463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428881+0000","last_change":"2023-12-24T19:51:40.424037+0000","last_active":"2023-12-24T19:51:40.428881+0000","last_peered":"2023-12-24T19:51:40.428881+0000","last_clean":"2023-12-24T19:51:40.428881+0000","last_became_active":"2023-12-24T19:51:40.422864+0000","last_became_peered":"2023-12-24T19:51:40.422864+0000","last_unstale":"2023-12-24T19:51:40.428881+0000","last_undegraded":"2023-12-24T19:51:40.428881+0000","last_fullsized":"2023-12-24T19:51:40.428881+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:40.208531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"158'6","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.634021+0000","last_change":"2023-12-24T19:51:39.631728+0000","last_active":"2023-12-24T19:51:40.634021+0000","last_peered":"2023-12-24T19:51:40.634021+0000","last_clean":"2023-12-24T19:51:40.634021+0000","last_became_active":"2023-12-24T19:51:39.631420+0000","last_became_peered":"2023-12-24T19:51:39.631420+0000","last_unstale":"2023-12-24T19:51:40.634021+0000","last_undegraded":"2023-12-24T19:51:40.634021+0000","last_fullsized":"2023-12-24T19:51:40.634021+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:05.017707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424378+0000","last_change":"2023-12-24T19:51:40.420704+0000","last_active":"2023-12-24T19:51:40.424378+0000","last_peered":"2023-12-24T19:51:40.424378+0000","last_clean":"2023-12-24T19:51:40.424378+0000","last_became_active":"2023-12-24T19:51:40.420273+0000","last_became_peered":"2023-12-24T19:51:40.420273+0000","last_unstale":"2023-12-24T19:51:40.424378+0000","last_undegraded":"2023-12-24T19:51:40.424378+0000","last_fullsized":"2023-12-24T19:51:40.424378+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630422+0000","last_change":"2023-12-24T19:51:39.627033+0000","last_active":"2023-12-24T19:51:40.630422+0000","last_peered":"2023-12-24T19:51:40.630422+0000","last_clean":"2023-12-24T19:51:40.630422+0000","last_became_active":"2023-12-24T19:51:39.626051+0000","last_became_peered":"2023-12-24T19:51:39.626051+0000","last_unstale":"2023-12-24T19:51:40.630422+0000","last_undegraded":"2023-12-24T19:51:40.630422+0000","last_fullsized":"2023-12-24T19:51:40.630422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:35.180205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439729+0000","last_change":"2023-12-24T19:51:40.436088+0000","last_active":"2023-12-24T19:51:40.439729+0000","last_peered":"2023-12-24T19:51:40.439729+0000","last_clean":"2023-12-24T19:51:40.439729+0000","last_became_active":"2023-12-24T19:51:40.435805+0000","last_became_peered":"2023-12-24T19:51:40.435805+0000","last_unstale":"2023-12-24T19:51:40.439729+0000","last_undegraded":"2023-12-24T19:51:40.439729+0000","last_fullsized":"2023-12-24T19:51:40.439729+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:50:19.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.412157+0000","last_change":"2023-12-24T19:51:39.615804+0000","last_active":"2023-12-24T19:51:40.412157+0000","last_peered":"2023-12-24T19:51:40.412157+0000","last_clean":"2023-12-24T19:51:40.412157+0000","last_became_active":"2023-12-24T19:51:39.615496+0000","last_became_peered":"2023-12-24T19:51:39.615496+0000","last_unstale":"2023-12-24T19:51:40.412157+0000","last_undegraded":"2023-12-24T19:51:40.412157+0000","last_fullsized":"2023-12-24T19:51:40.412157+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:24:25.652658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440588+0000","last_change":"2023-12-24T19:51:40.436875+0000","last_active":"2023-12-24T19:51:40.440588+0000","last_peered":"2023-12-24T19:51:40.440588+0000","last_clean":"2023-12-24T19:51:40.440588+0000","last_became_active":"2023-12-24T19:51:40.436576+0000","last_became_peered":"2023-12-24T19:51:40.436576+0000","last_unstale":"2023-12-24T19:51:40.440588+0000","last_undegraded":"2023-12-24T19:51:40.440588+0000","last_fullsized":"2023-12-24T19:51:40.440588+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:25.727690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.635212+0000","last_change":"2023-12-24T19:51:39.622106+0000","last_active":"2023-12-24T19:51:40.635212+0000","last_peered":"2023-12-24T19:51:40.635212+0000","last_clean":"2023-12-24T19:51:40.635212+0000","last_became_active":"2023-12-24T19:51:39.621718+0000","last_became_peered":"2023-12-24T19:51:39.621718+0000","last_unstale":"2023-12-24T19:51:40.635212+0000","last_undegraded":"2023-12-24T19:51:40.635212+0000","last_fullsized":"2023-12-24T19:51:40.635212+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:39.191470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424133+0000","last_change":"2023-12-24T19:51:40.419727+0000","last_active":"2023-12-24T19:51:40.424133+0000","last_peered":"2023-12-24T19:51:40.424133+0000","last_clean":"2023-12-24T19:51:40.424133+0000","last_became_active":"2023-12-24T19:51:40.419377+0000","last_became_peered":"2023-12-24T19:51:40.419377+0000","last_unstale":"2023-12-24T19:51:40.424133+0000","last_undegraded":"2023-12-24T19:51:40.424133+0000","last_fullsized":"2023-12-24T19:51:40.424133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:57.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629193+0000","last_change":"2023-12-24T19:51:39.630562+0000","last_active":"2023-12-24T19:51:40.629193+0000","last_peered":"2023-12-24T19:51:40.629193+0000","last_clean":"2023-12-24T19:51:40.629193+0000","last_became_active":"2023-12-24T19:51:39.630206+0000","last_became_peered":"2023-12-24T19:51:39.630206+0000","last_unstale":"2023-12-24T19:51:40.629193+0000","last_undegraded":"2023-12-24T19:51:40.629193+0000","last_fullsized":"2023-12-24T19:51:40.629193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439544+0000","last_change":"2023-12-24T19:51:40.435426+0000","last_active":"2023-12-24T19:51:40.439544+0000","last_peered":"2023-12-24T19:51:40.439544+0000","last_clean":"2023-12-24T19:51:40.439544+0000","last_became_active":"2023-12-24T19:51:40.435144+0000","last_became_peered":"2023-12-24T19:51:40.435144+0000","last_unstale":"2023-12-24T19:51:40.439544+0000","last_undegraded":"2023-12-24T19:51:40.439544+0000","last_fullsized":"2023-12-24T19:51:40.439544+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:51.815229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632750+0000","last_change":"2023-12-24T19:51:39.625620+0000","last_active":"2023-12-24T19:51:40.632750+0000","last_peered":"2023-12-24T19:51:40.632750+0000","last_clean":"2023-12-24T19:51:40.632750+0000","last_became_active":"2023-12-24T19:51:39.625041+0000","last_became_peered":"2023-12-24T19:51:39.625041+0000","last_unstale":"2023-12-24T19:51:40.632750+0000","last_undegraded":"2023-12-24T19:51:40.632750+0000","last_fullsized":"2023-12-24T19:51:40.632750+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:26.302719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444183+0000","last_change":"2023-12-24T19:51:40.439893+0000","last_active":"2023-12-24T19:51:40.444183+0000","last_peered":"2023-12-24T19:51:40.444183+0000","last_clean":"2023-12-24T19:51:40.444183+0000","last_became_active":"2023-12-24T19:51:40.439444+0000","last_became_peered":"2023-12-24T19:51:40.439444+0000","last_unstale":"2023-12-24T19:51:40.444183+0000","last_undegraded":"2023-12-24T19:51:40.444183+0000","last_fullsized":"2023-12-24T19:51:40.444183+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:03.393498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631043+0000","last_change":"2023-12-24T19:51:39.617148+0000","last_active":"2023-12-24T19:51:40.631043+0000","last_peered":"2023-12-24T19:51:40.631043+0000","last_clean":"2023-12-24T19:51:40.631043+0000","last_became_active":"2023-12-24T19:51:39.616836+0000","last_became_peered":"2023-12-24T19:51:39.616836+0000","last_unstale":"2023-12-24T19:51:40.631043+0000","last_undegraded":"2023-12-24T19:51:40.631043+0000","last_fullsized":"2023-12-24T19:51:40.631043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.423628+0000","last_change":"2023-12-24T19:51:40.421790+0000","last_active":"2023-12-24T19:51:40.423628+0000","last_peered":"2023-12-24T19:51:40.423628+0000","last_clean":"2023-12-24T19:51:40.423628+0000","last_became_active":"2023-12-24T19:51:40.421458+0000","last_became_peered":"2023-12-24T19:51:40.421458+0000","last_unstale":"2023-12-24T19:51:40.423628+0000","last_undegraded":"2023-12-24T19:51:40.423628+0000","last_fullsized":"2023-12-24T19:51:40.423628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.415764+0000","last_change":"2023-12-24T19:51:39.620411+0000","last_active":"2023-12-24T19:51:40.415764+0000","last_peered":"2023-12-24T19:51:40.415764+0000","last_clean":"2023-12-24T19:51:40.415764+0000","last_became_active":"2023-12-24T19:51:39.619856+0000","last_became_peered":"2023-12-24T19:51:39.619856+0000","last_unstale":"2023-12-24T19:51:40.415764+0000","last_undegraded":"2023-12-24T19:51:40.415764+0000","last_fullsized":"2023-12-24T19:51:40.415764+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:51.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.421843+0000","last_change":"2023-12-24T19:51:40.420639+0000","last_active":"2023-12-24T19:51:40.421843+0000","last_peered":"2023-12-24T19:51:40.421843+0000","last_clean":"2023-12-24T19:51:40.421843+0000","last_became_active":"2023-12-24T19:51:40.420309+0000","last_became_peered":"2023-12-24T19:51:40.420309+0000","last_unstale":"2023-12-24T19:51:40.421843+0000","last_undegraded":"2023-12-24T19:51:40.421843+0000","last_fullsized":"2023-12-24T19:51:40.421843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631675+0000","last_change":"2023-12-24T19:51:39.625407+0000","last_active":"2023-12-24T19:51:40.631675+0000","last_peered":"2023-12-24T19:51:40.631675+0000","last_clean":"2023-12-24T19:51:40.631675+0000","last_became_active":"2023-12-24T19:51:39.624691+0000","last_became_peered":"2023-12-24T19:51:39.624691+0000","last_unstale":"2023-12-24T19:51:40.631675+0000","last_undegraded":"2023-12-24T19:51:40.631675+0000","last_fullsized":"2023-12-24T19:51:40.631675+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431343+0000","last_change":"2023-12-24T19:51:40.430022+0000","last_active":"2023-12-24T19:51:40.431343+0000","last_peered":"2023-12-24T19:51:40.431343+0000","last_clean":"2023-12-24T19:51:40.431343+0000","last_became_active":"2023-12-24T19:51:40.426777+0000","last_became_peered":"2023-12-24T19:51:40.426777+0000","last_unstale":"2023-12-24T19:51:40.431343+0000","last_undegraded":"2023-12-24T19:51:40.431343+0000","last_fullsized":"2023-12-24T19:51:40.431343+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:28.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409179+0000","last_change":"2023-12-24T19:51:39.622856+0000","last_active":"2023-12-24T19:51:40.409179+0000","last_peered":"2023-12-24T19:51:40.409179+0000","last_clean":"2023-12-24T19:51:40.409179+0000","last_became_active":"2023-12-24T19:51:39.622570+0000","last_became_peered":"2023-12-24T19:51:39.622570+0000","last_unstale":"2023-12-24T19:51:40.409179+0000","last_undegraded":"2023-12-24T19:51:40.409179+0000","last_fullsized":"2023-12-24T19:51:40.409179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:45.599956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438003+0000","last_change":"2023-12-24T19:51:40.427853+0000","last_active":"2023-12-24T19:51:40.438003+0000","last_peered":"2023-12-24T19:51:40.438003+0000","last_clean":"2023-12-24T19:51:40.438003+0000","last_became_active":"2023-12-24T19:51:40.427547+0000","last_became_peered":"2023-12-24T19:51:40.427547+0000","last_unstale":"2023-12-24T19:51:40.438003+0000","last_undegraded":"2023-12-24T19:51:40.438003+0000","last_fullsized":"2023-12-24T19:51:40.438003+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:11.645312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417081+0000","last_change":"2023-12-24T19:51:39.630194+0000","last_active":"2023-12-24T19:51:40.417081+0000","last_peered":"2023-12-24T19:51:40.417081+0000","last_clean":"2023-12-24T19:51:40.417081+0000","last_became_active":"2023-12-24T19:51:39.629848+0000","last_became_peered":"2023-12-24T19:51:39.629848+0000","last_unstale":"2023-12-24T19:51:40.417081+0000","last_undegraded":"2023-12-24T19:51:40.417081+0000","last_fullsized":"2023-12-24T19:51:40.417081+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:25.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.435049+0000","last_change":"2023-12-24T19:51:40.432051+0000","last_active":"2023-12-24T19:51:40.435049+0000","last_peered":"2023-12-24T19:51:40.435049+0000","last_clean":"2023-12-24T19:51:40.435049+0000","last_became_active":"2023-12-24T19:51:40.431763+0000","last_became_peered":"2023-12-24T19:51:40.431763+0000","last_unstale":"2023-12-24T19:51:40.435049+0000","last_undegraded":"2023-12-24T19:51:40.435049+0000","last_fullsized":"2023-12-24T19:51:40.435049+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:05.957842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432612+0000","last_change":"2023-12-24T19:51:39.629814+0000","last_active":"2023-12-24T19:51:40.432612+0000","last_peered":"2023-12-24T19:51:40.432612+0000","last_clean":"2023-12-24T19:51:40.432612+0000","last_became_active":"2023-12-24T19:51:39.628065+0000","last_became_peered":"2023-12-24T19:51:39.628065+0000","last_unstale":"2023-12-24T19:51:40.432612+0000","last_undegraded":"2023-12-24T19:51:40.432612+0000","last_fullsized":"2023-12-24T19:51:40.432612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438879+0000","last_change":"2023-12-24T19:51:40.434532+0000","last_active":"2023-12-24T19:51:40.438879+0000","last_peered":"2023-12-24T19:51:40.438879+0000","last_clean":"2023-12-24T19:51:40.438879+0000","last_became_active":"2023-12-24T19:51:40.433863+0000","last_became_peered":"2023-12-24T19:51:40.433863+0000","last_unstale":"2023-12-24T19:51:40.438879+0000","last_undegraded":"2023-12-24T19:51:40.438879+0000","last_fullsized":"2023-12-24T19:51:40.438879+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.633179+0000","last_change":"2023-12-24T19:51:39.624918+0000","last_active":"2023-12-24T19:51:40.633179+0000","last_peered":"2023-12-24T19:51:40.633179+0000","last_clean":"2023-12-24T19:51:40.633179+0000","last_became_active":"2023-12-24T19:51:39.624060+0000","last_became_peered":"2023-12-24T19:51:39.624060+0000","last_unstale":"2023-12-24T19:51:40.633179+0000","last_undegraded":"2023-12-24T19:51:40.633179+0000","last_fullsized":"2023-12-24T19:51:40.633179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:54.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430333+0000","last_change":"2023-12-24T19:51:40.424064+0000","last_active":"2023-12-24T19:51:40.430333+0000","last_peered":"2023-12-24T19:51:40.430333+0000","last_clean":"2023-12-24T19:51:40.430333+0000","last_became_active":"2023-12-24T19:51:40.423752+0000","last_became_peered":"2023-12-24T19:51:40.423752+0000","last_unstale":"2023-12-24T19:51:40.430333+0000","last_undegraded":"2023-12-24T19:51:40.430333+0000","last_fullsized":"2023-12-24T19:51:40.430333+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:07.280866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.411315+0000","last_change":"2023-12-24T19:51:39.619047+0000","last_active":"2023-12-24T19:51:40.411315+0000","last_peered":"2023-12-24T19:51:40.411315+0000","last_clean":"2023-12-24T19:51:40.411315+0000","last_became_active":"2023-12-24T19:51:39.618656+0000","last_became_peered":"2023-12-24T19:51:39.618656+0000","last_unstale":"2023-12-24T19:51:40.411315+0000","last_undegraded":"2023-12-24T19:51:40.411315+0000","last_fullsized":"2023-12-24T19:51:40.411315+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.437339+0000","last_change":"2023-12-24T19:51:40.431853+0000","last_active":"2023-12-24T19:51:40.437339+0000","last_peered":"2023-12-24T19:51:40.437339+0000","last_clean":"2023-12-24T19:51:40.437339+0000","last_became_active":"2023-12-24T19:51:40.431311+0000","last_became_peered":"2023-12-24T19:51:40.431311+0000","last_unstale":"2023-12-24T19:51:40.437339+0000","last_undegraded":"2023-12-24T19:51:40.437339+0000","last_fullsized":"2023-12-24T19:51:40.437339+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:21.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.410314+0000","last_change":"2023-12-24T19:51:39.625981+0000","last_active":"2023-12-24T19:51:40.410314+0000","last_peered":"2023-12-24T19:51:40.410314+0000","last_clean":"2023-12-24T19:51:40.410314+0000","last_became_active":"2023-12-24T19:51:39.625275+0000","last_became_peered":"2023-12-24T19:51:39.625275+0000","last_unstale":"2023-12-24T19:51:40.410314+0000","last_undegraded":"2023-12-24T19:51:40.410314+0000","last_fullsized":"2023-12-24T19:51:40.410314+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.425243+0000","last_change":"2023-12-24T19:51:40.422375+0000","last_active":"2023-12-24T19:51:40.425243+0000","last_peered":"2023-12-24T19:51:40.425243+0000","last_clean":"2023-12-24T19:51:40.425243+0000","last_became_active":"2023-12-24T19:51:40.422046+0000","last_became_peered":"2023-12-24T19:51:40.422046+0000","last_unstale":"2023-12-24T19:51:40.425243+0000","last_undegraded":"2023-12-24T19:51:40.425243+0000","last_fullsized":"2023-12-24T19:51:40.425243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.433449+0000","last_change":"2023-12-24T19:51:39.628603+0000","last_active":"2023-12-24T19:51:40.433449+0000","last_peered":"2023-12-24T19:51:40.433449+0000","last_clean":"2023-12-24T19:51:40.433449+0000","last_became_active":"2023-12-24T19:51:39.628257+0000","last_became_peered":"2023-12-24T19:51:39.628257+0000","last_unstale":"2023-12-24T19:51:40.433449+0000","last_undegraded":"2023-12-24T19:51:40.433449+0000","last_fullsized":"2023-12-24T19:51:40.433449+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442421+0000","last_change":"2023-12-24T19:51:40.438807+0000","last_active":"2023-12-24T19:51:40.442421+0000","last_peered":"2023-12-24T19:51:40.442421+0000","last_clean":"2023-12-24T19:51:40.442421+0000","last_became_active":"2023-12-24T19:51:40.438483+0000","last_became_peered":"2023-12-24T19:51:40.438483+0000","last_unstale":"2023-12-24T19:51:40.442421+0000","last_undegraded":"2023-12-24T19:51:40.442421+0000","last_fullsized":"2023-12-24T19:51:40.442421+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:07.744878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418636+0000","last_change":"2023-12-24T19:51:39.624395+0000","last_active":"2023-12-24T19:51:40.418636+0000","last_peered":"2023-12-24T19:51:40.418636+0000","last_clean":"2023-12-24T19:51:40.418636+0000","last_became_active":"2023-12-24T19:51:39.624089+0000","last_became_peered":"2023-12-24T19:51:39.624089+0000","last_unstale":"2023-12-24T19:51:40.418636+0000","last_undegraded":"2023-12-24T19:51:40.418636+0000","last_fullsized":"2023-12-24T19:51:40.418636+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:37.763509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440201+0000","last_change":"2023-12-24T19:51:40.435720+0000","last_active":"2023-12-24T19:51:40.440201+0000","last_peered":"2023-12-24T19:51:40.440201+0000","last_clean":"2023-12-24T19:51:40.440201+0000","last_became_active":"2023-12-24T19:51:40.435390+0000","last_became_peered":"2023-12-24T19:51:40.435390+0000","last_unstale":"2023-12-24T19:51:40.440201+0000","last_undegraded":"2023-12-24T19:51:40.440201+0000","last_fullsized":"2023-12-24T19:51:40.440201+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:33.113558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417866+0000","last_change":"2023-12-24T19:51:39.630370+0000","last_active":"2023-12-24T19:51:40.417866+0000","last_peered":"2023-12-24T19:51:40.417866+0000","last_clean":"2023-12-24T19:51:40.417866+0000","last_became_active":"2023-12-24T19:51:39.629867+0000","last_became_peered":"2023-12-24T19:51:39.629867+0000","last_unstale":"2023-12-24T19:51:40.417866+0000","last_undegraded":"2023-12-24T19:51:40.417866+0000","last_fullsized":"2023-12-24T19:51:40.417866+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:32.129671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442627+0000","last_change":"2023-12-24T19:51:40.439935+0000","last_active":"2023-12-24T19:51:40.442627+0000","last_peered":"2023-12-24T19:51:40.442627+0000","last_clean":"2023-12-24T19:51:40.442627+0000","last_became_active":"2023-12-24T19:51:40.439680+0000","last_became_peered":"2023-12-24T19:51:40.439680+0000","last_unstale":"2023-12-24T19:51:40.442627+0000","last_undegraded":"2023-12-24T19:51:40.442627+0000","last_fullsized":"2023-12-24T19:51:40.442627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:15.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432963+0000","last_change":"2023-12-24T19:51:39.625890+0000","last_active":"2023-12-24T19:51:40.432963+0000","last_peered":"2023-12-24T19:51:40.432963+0000","last_clean":"2023-12-24T19:51:40.432963+0000","last_became_active":"2023-12-24T19:51:39.625588+0000","last_became_peered":"2023-12-24T19:51:39.625588+0000","last_unstale":"2023-12-24T19:51:40.432963+0000","last_undegraded":"2023-12-24T19:51:40.432963+0000","last_fullsized":"2023-12-24T19:51:40.432963+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439557+0000","last_change":"2023-12-24T19:51:40.431399+0000","last_active":"2023-12-24T19:51:40.439557+0000","last_peered":"2023-12-24T19:51:40.439557+0000","last_clean":"2023-12-24T19:51:40.439557+0000","last_became_active":"2023-12-24T19:51:40.431099+0000","last_became_peered":"2023-12-24T19:51:40.431099+0000","last_unstale":"2023-12-24T19:51:40.439557+0000","last_undegraded":"2023-12-24T19:51:40.439557+0000","last_fullsized":"2023-12-24T19:51:40.439557+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:31.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417885+0000","last_change":"2023-12-24T19:51:39.617606+0000","last_active":"2023-12-24T19:51:40.417885+0000","last_peered":"2023-12-24T19:51:40.417885+0000","last_clean":"2023-12-24T19:51:40.417885+0000","last_became_active":"2023-12-24T19:51:39.617301+0000","last_became_peered":"2023-12-24T19:51:39.617301+0000","last_unstale":"2023-12-24T19:51:40.417885+0000","last_undegraded":"2023-12-24T19:51:40.417885+0000","last_fullsized":"2023-12-24T19:51:40.417885+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:14.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424922+0000","last_change":"2023-12-24T19:51:40.420315+0000","last_active":"2023-12-24T19:51:40.424922+0000","last_peered":"2023-12-24T19:51:40.424922+0000","last_clean":"2023-12-24T19:51:40.424922+0000","last_became_active":"2023-12-24T19:51:40.420004+0000","last_became_peered":"2023-12-24T19:51:40.420004+0000","last_unstale":"2023-12-24T19:51:40.424922+0000","last_undegraded":"2023-12-24T19:51:40.424922+0000","last_fullsized":"2023-12-24T19:51:40.424922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:08.437228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417154+0000","last_change":"2023-12-24T19:51:39.629519+0000","last_active":"2023-12-24T19:51:40.417154+0000","last_peered":"2023-12-24T19:51:40.417154+0000","last_clean":"2023-12-24T19:51:40.417154+0000","last_became_active":"2023-12-24T19:51:39.629177+0000","last_became_peered":"2023-12-24T19:51:39.629177+0000","last_unstale":"2023-12-24T19:51:40.417154+0000","last_undegraded":"2023-12-24T19:51:40.417154+0000","last_fullsized":"2023-12-24T19:51:40.417154+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.109275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":818,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.416516+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:51:40.416516+0000","last_peered":"2023-12-24T19:51:40.416516+0000","last_clean":"2023-12-24T19:51:40.416516+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:51:40.416516+0000","last_undegraded":"2023-12-24T19:51:40.416516+0000","last_fullsized":"2023-12-24T19:51:40.416516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072020,"statfs":{"total":96636764160,"available":96329748480,"internally_reserved":0,"allocated":2592768,"data_stored":1619101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1719999999999999,"15min":1.1759999999999999},"min":{"1min":0.83299999999999996,"5min":0.65300000000000002,"15min":0.58899999999999997},"max":{"1min":1.639,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2,"15min":1.202},"min":{"1min":1.0760000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5269999999999999,"5min":1.7230000000000001,"15min":1.804},"last":1.216}]},{"osd":1,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2030000000000001,"15min":1.1839999999999999},"min":{"1min":0.82699999999999996,"5min":0.80500000000000005,"15min":0.73899999999999999},"max":{"1min":1.645,"5min":1.645,"15min":1.702},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.2450000000000001},"min":{"1min":1.02,"5min":0.84799999999999998,"15min":0.80200000000000005},"max":{"1min":1.484,"5min":1.6180000000000001,"15min":1.788},"last":0.871}]},{"osd":2,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.2689999999999999,"15min":1.2470000000000001},"min":{"1min":0.98699999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.74,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.2569999999999999,"15min":1.2509999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.82999999999999996},"max":{"1min":1.472,"5min":1.726,"15min":1.79},"last":1.0640000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3109999999999999,"15min":1.3069999999999999},"min":{"1min":0.95499999999999996,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.5189999999999999,"5min":1.7569999999999999,"15min":1.77},"last":1.272},{"interface":"front","average":{"1min":1.319,"5min":1.3260000000000001,"15min":1.3220000000000001},"min":{"1min":0.997,"5min":0.98099999999999998,"15min":0.93500000000000005},"max":{"1min":1.593,"5min":1.829,"15min":1.829},"last":1.6259999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.669,"5min":1.7969999999999999,"15min":1.883},"last":1.331},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2629999999999999,"15min":1.248},"min":{"1min":0.85399999999999998,"5min":0.81200000000000006,"15min":0.73199999999999998},"max":{"1min":1.673,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.5469999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.28},"min":{"1min":1.0740000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7110000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.367,"15min":1.3620000000000001},"min":{"1min":1.069,"5min":0.88100000000000001,"15min":0.80700000000000005},"max":{"1min":1.5920000000000001,"5min":1.853,"15min":2.0609999999999999},"last":1.4890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4470000000000001,"15min":1.4299999999999999},"min":{"1min":1.248,"5min":1.024,"15min":0.871},"max":{"1min":1.752,"5min":1.909,"15min":1.97},"last":1.839},{"interface":"front","average":{"1min":1.47,"5min":1.4390000000000001,"15min":1.419},"min":{"1min":1.115,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.954,"15min":1.954},"last":1.671}]}]},{"osd":6,"up_from":13,"seq":55834575748,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315616,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056224,"statfs":{"total":96636764160,"available":96313573376,"internally_reserved":0,"allocated":1990656,"data_stored":1027751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.137}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.0009999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.2969999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.2290000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.079},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.337}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.036},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.2}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.1619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.333}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.879}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.3959999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.109}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.482}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.371},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.496}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311512,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060328,"statfs":{"total":96636764160,"available":96317775872,"internally_reserved":0,"allocated":1982464,"data_stored":1027107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.254},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.67600000000000005},"max":{"1min":1.4670000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.2789999999999999},"min":{"1min":1.0720000000000001,"5min":0.84099999999999997,"15min":0.58399999999999996},"max":{"1min":1.5509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.587}]},{"osd":1,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.873,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":1.4299999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1499999999999999,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.70499999999999996,"15min":0.60199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.4850000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3580000000000001,"15min":1.353},"min":{"1min":1.0449999999999999,"5min":0.94899999999999995,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3440000000000001,"15min":1.3460000000000001},"min":{"1min":1.0149999999999999,"5min":0.77800000000000002,"15min":0.66100000000000003},"max":{"1min":1.706,"5min":1.829,"15min":1.829},"last":1.3169999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":0.92600000000000005,"5min":0.83299999999999996,"15min":0.46400000000000002},"max":{"1min":1.4670000000000001,"5min":1.792,"15min":1.792},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":1.0660000000000001,"5min":0.88400000000000001,"15min":0.63900000000000001},"max":{"1min":1.631,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":1.599,"5min":1.744,"15min":1.879},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.339,"15min":1.321},"min":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.8779999999999999,"15min":1.9159999999999999},"last":2.1819999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.256},"min":{"1min":0.79900000000000004,"5min":0.69399999999999995,"15min":0.56000000000000005},"max":{"1min":1.7350000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.74},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.331,"15min":1.3169999999999999},"min":{"1min":0.93200000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.798,"5min":1.887,"15min":1.887},"last":1.6519999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2829999999999999,"15min":1.27},"min":{"1min":0.77900000000000003,"5min":0.60699999999999998,"15min":0.54500000000000004},"max":{"1min":1.863,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4470000000000001,"15min":1.417},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.831,"5min":2,"15min":2},"last":1.6240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311528,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060312,"statfs":{"total":96636764160,"available":96317759488,"internally_reserved":0,"allocated":1998848,"data_stored":1028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.96399999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.2070000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.026}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.175},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.409}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.097}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":1027695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":0.92200000000000004}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.1679999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.333},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.1359999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.272}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.232}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.73},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.605}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.5760000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.421,"15min":1.647},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.147,"15min":1.1499999999999999},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.087}]},{"osd":2,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0209999999999999,"15min":0.99399999999999999},"min":{"1min":0.754,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1479999999999999,"15min":1.1220000000000001},"min":{"1min":0.86799999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.034}]},{"osd":3,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.298,"15min":1.2729999999999999},"min":{"1min":0.98699999999999999,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.127,"15min":1.137},"min":{"1min":0.89400000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.823},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.298,"15min":1.282},"min":{"1min":1.083,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.6619999999999999,"5min":1.883,"15min":1.883},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.4370000000000001,"15min":1.4239999999999999},"min":{"1min":1.1859999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.849,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.405,"15min":1.403},"min":{"1min":1.0980000000000001,"5min":1.016,"15min":0.96499999999999997},"max":{"1min":1.7849999999999999,"5min":1.806,"15min":1.948},"last":1.351},{"interface":"front","average":{"1min":1.387,"5min":1.395,"15min":1.3839999999999999},"min":{"1min":1.099,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7909999999999999,"5min":1.843,"15min":2.2189999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.516,"15min":1.506},"min":{"1min":1.1299999999999999,"5min":1.0189999999999999,"15min":1.0089999999999999},"max":{"1min":1.944,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5069999999999999,"15min":1.498},"min":{"1min":1.103,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.9570000000000001,"5min":2.1339999999999999,"15min":2.323},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.554,"15min":1.548},"min":{"1min":1.2849999999999999,"5min":0.999,"15min":0.999},"max":{"1min":2.0840000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5389999999999999,"15min":1.512},"min":{"1min":1.268,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0009999999999999,"5min":2.532,"15min":2.532},"last":1.7250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072028,"statfs":{"total":96636764160,"available":96329756672,"internally_reserved":0,"allocated":2584576,"data_stored":1617531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.363,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.091,"5min":1.046,"15min":1.012},"min":{"1min":0.76100000000000001,"5min":0.50800000000000001,"15min":0.504},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.179}]},{"osd":2,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.071,"15min":1.093},"min":{"1min":0.80400000000000005,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.4690000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.74099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5980000000000001,"5min":1.663,"15min":1.833},"last":1.0489999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.0660000000000001},"min":{"1min":0.83899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5249999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.258,"15min":1.272},"min":{"1min":0.92000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.732,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.0069999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.401,"15min":1.379},"min":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.88200000000000001},"max":{"1min":1.6299999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3149999999999999},"min":{"1min":1.008,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2110000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4350000000000001,"15min":1.4259999999999999},"min":{"1min":1.1699999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.6899999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.4350000000000001,"15min":1.4390000000000001},"min":{"1min":1.123,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7110000000000001,"5min":2.0830000000000002,"15min":2.2989999999999999},"last":1.2749999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":1.073,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.677,"5min":1.873,"15min":1.964},"last":1.123},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4830000000000001,"15min":1.4950000000000001},"min":{"1min":1.3009999999999999,"5min":1,"15min":1},"max":{"1min":1.8220000000000001,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.514,"15min":1.522},"min":{"1min":1.254,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7470000000000001,"5min":2.46,"15min":2.46},"last":1.458},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4650000000000001,"15min":1.4690000000000001},"min":{"1min":1.2649999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9590000000000001,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:51:49.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:51:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 Processor -- start 2023-12-24T19:51:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 -- start start 2023-12-24T19:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae7c154b60 0x7fae7c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c06c820 con 0x7fae7c0c6d00 2023-12-24T19:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c06b960 con 0x7fae7c154b60 2023-12-24T19:51:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae80cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c06bc40 con 0x7fae7c06aca0 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae7a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae7c0c6d00 0x7fae7c154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58144/0 (socket says 172.21.15.50:58144) 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae7a59c700 1 -- 172.21.15.50:0/487998026 learned_addr learned my addr 172.21.15.50:0/487998026 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae7ad9d700 1 --2- 172.21.15.50:0/487998026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.899+0000 7fae73fff700 1 --2- 172.21.15.50:0/487998026 >> v2:172.21.15.82:3300/0 conn(0x7fae7c154b60 0x7fae7c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae79d9b700 1 -- 172.21.15.50:0/487998026 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346404543 0 0) 0x7fae7c06c820 con 0x7fae7c0c6d00 2023-12-24T19:51:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae79d9b700 1 -- 172.21.15.50:0/487998026 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae68003570 con 0x7fae7c0c6d00 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae7ad9d700 1 -- 172.21.15.50:0/487998026 >> v2:172.21.15.82:3300/0 conn(0x7fae7c154b60 msgr2=0x7fae7c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae7ad9d700 1 --2- 172.21.15.50:0/487998026 >> v2:172.21.15.82:3300/0 conn(0x7fae7c154b60 0x7fae7c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae7ad9d700 1 -- 172.21.15.50:0/487998026 >> v1:172.21.15.50:6789/0 conn(0x7fae7c0c6d00 legacy=0x7fae7c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae7ad9d700 1 -- 172.21.15.50:0/487998026 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c06bf20 con 0x7fae7c06aca0 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae7ad9d700 1 --2- 172.21.15.50:0/487998026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c06b140 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae74009e60 tx=0x7fae74009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b120cc0afe40fb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae79d9b700 1 -- 172.21.15.50:0/487998026 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400e070 con 0x7fae7c06aca0 2023-12-24T19:51:49.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae79d9b700 1 -- 172.21.15.50:0/487998026 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7400bab0 con 0x7fae7c06aca0 2023-12-24T19:51:49.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae79d9b700 1 -- 172.21.15.50:0/487998026 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400be70 con 0x7fae7c06aca0 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 -- 172.21.15.50:0/487998026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 msgr2=0x7fae7c06b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 --2- 172.21.15.50:0/487998026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c06b140 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae74009e60 tx=0x7fae74009780 comp rx=0 tx=0).stop 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 -- 172.21.15.50:0/487998026 shutdown_connections 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 --2- 172.21.15.50:0/487998026 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c06b140 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 --2- 172.21.15.50:0/487998026 >> v2:172.21.15.82:3300/0 conn(0x7fae7c154b60 0x7fae7c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 -- 172.21.15.50:0/487998026 >> 172.21.15.50:0/487998026 conn(0x7fae7c0cbba0 msgr2=0x7fae7c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 -- 172.21.15.50:0/487998026 shutdown_connections 2023-12-24T19:51:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.903+0000 7fae80cae700 1 -- 172.21.15.50:0/487998026 wait complete. 2023-12-24T19:51:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 Processor -- start 2023-12-24T19:51:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 -- start start 2023-12-24T19:51:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7c154b60 0x7fae7c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c155ed0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1561b0 con 0x7fae7c154b60 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae80cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c156490 con 0x7fae7c06aca0 2023-12-24T19:51:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae73fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae73fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37090/0 (socket says 172.21.15.50:37090) 2023-12-24T19:51:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae73fff700 1 -- 172.21.15.50:0/284838522 learned_addr learned my addr 172.21.15.50:0/284838522 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae7ad9d700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7c154b60 0x7fae7c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.907+0000 7fae7a59c700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 -- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 msgr2=0x7fae7c0c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c0c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 -- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7c154b60 msgr2=0x7fae7c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7c154b60 0x7fae7c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 -- 172.21.15.50:0/284838522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74009a20 con 0x7fae7c0c6d00 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae73fff700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e930 tx=0x7fae640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64013680 con 0x7fae7c0c6d00 2023-12-24T19:51:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640137e0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c156770 con 0x7fae7c0c6d00 2023-12-24T19:51:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64013b80 con 0x7fae7c0c6d00 2023-12-24T19:51:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c0c32e0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.911+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0652e0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.915+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fae6400c3e0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.915+0000 7fae727fc700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 0x7fae5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:49.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.919+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fae6407cbd0 con 0x7fae7c0c6d00 2023-12-24T19:51:49.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.919+0000 7fae7a59c700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 0x7fae5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.919+0000 7fae7a59c700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 0x7fae5c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:49.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:49.923+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae6404ce50 con 0x7fae7c0c6d00 2023-12-24T19:51:50.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.099+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae7c06c200 con 0x7fae5c060550 2023-12-24T19:51:50.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.115+0000 7fae727fc700 1 -- 172.21.15.50:0/284838522 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286413 (secure 0 0 0) 0x7fae7c06c200 con 0x7fae5c060550 2023-12-24T19:51:50.124 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 msgr2=0x7fae5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 0x7fae5c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c009040 comp rx=0 tx=0).stop 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 msgr2=0x7fae7c0c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e930 tx=0x7fae640091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 shutdown_connections 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fae5c060550 0x7fae5c062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7c154b60 0x7fae7c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c0c6d00 0x7fae7c0c4930 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 --2- 172.21.15.50:0/284838522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae7c06aca0 0x7fae7c0c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.119+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 >> 172.21.15.50:0/284838522 conn(0x7fae7c0cbba0 msgr2=0x7fae7c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.123+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 shutdown_connections 2023-12-24T19:51:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.123+0000 7fae80cae700 1 -- 172.21.15.50:0/284838522 wait complete. 2023-12-24T19:51:50.129 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:51:50.145 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-24T19:51:49.522403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464648,"kb_used_data":16712,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752510072,"statfs":{"total":773094113280,"available":770570313728,"internally_reserved":0,"allocated":17113088,"data_stored":9402204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.118671"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428180+0000","last_change":"2023-12-24T19:51:40.426029+0000","last_active":"2023-12-24T19:51:40.428180+0000","last_peered":"2023-12-24T19:51:40.428180+0000","last_clean":"2023-12-24T19:51:40.428180+0000","last_became_active":"2023-12-24T19:51:40.424974+0000","last_became_peered":"2023-12-24T19:51:40.424974+0000","last_unstale":"2023-12-24T19:51:40.428180+0000","last_undegraded":"2023-12-24T19:51:40.428180+0000","last_fullsized":"2023-12-24T19:51:40.428180+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:07.839132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436752+0000","last_change":"2023-12-24T19:51:40.432444+0000","last_active":"2023-12-24T19:51:40.436752+0000","last_peered":"2023-12-24T19:51:40.436752+0000","last_clean":"2023-12-24T19:51:40.436752+0000","last_became_active":"2023-12-24T19:51:40.432108+0000","last_became_peered":"2023-12-24T19:51:40.432108+0000","last_unstale":"2023-12-24T19:51:40.436752+0000","last_undegraded":"2023-12-24T19:51:40.436752+0000","last_fullsized":"2023-12-24T19:51:40.436752+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:59.366293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427164+0000","last_change":"2023-12-24T19:51:40.420928+0000","last_active":"2023-12-24T19:51:40.427164+0000","last_peered":"2023-12-24T19:51:40.427164+0000","last_clean":"2023-12-24T19:51:40.427164+0000","last_became_active":"2023-12-24T19:51:40.420627+0000","last_became_peered":"2023-12-24T19:51:40.420627+0000","last_unstale":"2023-12-24T19:51:40.427164+0000","last_undegraded":"2023-12-24T19:51:40.427164+0000","last_fullsized":"2023-12-24T19:51:40.427164+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:21.995194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434081+0000","last_change":"2023-12-24T19:51:40.430939+0000","last_active":"2023-12-24T19:51:40.434081+0000","last_peered":"2023-12-24T19:51:40.434081+0000","last_clean":"2023-12-24T19:51:40.434081+0000","last_became_active":"2023-12-24T19:51:40.430136+0000","last_became_peered":"2023-12-24T19:51:40.430136+0000","last_unstale":"2023-12-24T19:51:40.434081+0000","last_undegraded":"2023-12-24T19:51:40.434081+0000","last_fullsized":"2023-12-24T19:51:40.434081+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430002+0000","last_change":"2023-12-24T19:51:40.423425+0000","last_active":"2023-12-24T19:51:40.430002+0000","last_peered":"2023-12-24T19:51:40.430002+0000","last_clean":"2023-12-24T19:51:40.430002+0000","last_became_active":"2023-12-24T19:51:40.423020+0000","last_became_peered":"2023-12-24T19:51:40.423020+0000","last_unstale":"2023-12-24T19:51:40.430002+0000","last_undegraded":"2023-12-24T19:51:40.430002+0000","last_fullsized":"2023-12-24T19:51:40.430002+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439630+0000","last_change":"2023-12-24T19:51:40.435820+0000","last_active":"2023-12-24T19:51:40.439630+0000","last_peered":"2023-12-24T19:51:40.439630+0000","last_clean":"2023-12-24T19:51:40.439630+0000","last_became_active":"2023-12-24T19:51:40.435487+0000","last_became_peered":"2023-12-24T19:51:40.435487+0000","last_unstale":"2023-12-24T19:51:40.439630+0000","last_undegraded":"2023-12-24T19:51:40.439630+0000","last_fullsized":"2023-12-24T19:51:40.439630+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:25.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431001+0000","last_change":"2023-12-24T19:51:40.427983+0000","last_active":"2023-12-24T19:51:40.431001+0000","last_peered":"2023-12-24T19:51:40.431001+0000","last_clean":"2023-12-24T19:51:40.431001+0000","last_became_active":"2023-12-24T19:51:40.427648+0000","last_became_peered":"2023-12-24T19:51:40.427648+0000","last_unstale":"2023-12-24T19:51:40.431001+0000","last_undegraded":"2023-12-24T19:51:40.431001+0000","last_fullsized":"2023-12-24T19:51:40.431001+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:10.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.427900+0000","last_change":"2023-12-24T19:51:40.423103+0000","last_active":"2023-12-24T19:51:40.427900+0000","last_peered":"2023-12-24T19:51:40.427900+0000","last_clean":"2023-12-24T19:51:40.427900+0000","last_became_active":"2023-12-24T19:51:40.422807+0000","last_became_peered":"2023-12-24T19:51:40.422807+0000","last_unstale":"2023-12-24T19:51:40.427900+0000","last_undegraded":"2023-12-24T19:51:40.427900+0000","last_fullsized":"2023-12-24T19:51:40.427900+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442312+0000","last_change":"2023-12-24T19:51:40.439067+0000","last_active":"2023-12-24T19:51:40.442312+0000","last_peered":"2023-12-24T19:51:40.442312+0000","last_clean":"2023-12-24T19:51:40.442312+0000","last_became_active":"2023-12-24T19:51:40.437629+0000","last_became_peered":"2023-12-24T19:51:40.437629+0000","last_unstale":"2023-12-24T19:51:40.442312+0000","last_undegraded":"2023-12-24T19:51:40.442312+0000","last_fullsized":"2023-12-24T19:51:40.442312+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:01.896988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429629+0000","last_change":"2023-12-24T19:51:40.424048+0000","last_active":"2023-12-24T19:51:40.429629+0000","last_peered":"2023-12-24T19:51:40.429629+0000","last_clean":"2023-12-24T19:51:40.429629+0000","last_became_active":"2023-12-24T19:51:40.423770+0000","last_became_peered":"2023-12-24T19:51:40.423770+0000","last_unstale":"2023-12-24T19:51:40.429629+0000","last_undegraded":"2023-12-24T19:51:40.429629+0000","last_fullsized":"2023-12-24T19:51:40.429629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434210+0000","last_change":"2023-12-24T19:51:40.430545+0000","last_active":"2023-12-24T19:51:40.434210+0000","last_peered":"2023-12-24T19:51:40.434210+0000","last_clean":"2023-12-24T19:51:40.434210+0000","last_became_active":"2023-12-24T19:51:40.430100+0000","last_became_peered":"2023-12-24T19:51:40.430100+0000","last_unstale":"2023-12-24T19:51:40.434210+0000","last_undegraded":"2023-12-24T19:51:40.434210+0000","last_fullsized":"2023-12-24T19:51:40.434210+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:14.226367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428489+0000","last_change":"2023-12-24T19:51:40.421200+0000","last_active":"2023-12-24T19:51:40.428489+0000","last_peered":"2023-12-24T19:51:40.428489+0000","last_clean":"2023-12-24T19:51:40.428489+0000","last_became_active":"2023-12-24T19:51:40.420655+0000","last_became_peered":"2023-12-24T19:51:40.420655+0000","last_unstale":"2023-12-24T19:51:40.428489+0000","last_undegraded":"2023-12-24T19:51:40.428489+0000","last_fullsized":"2023-12-24T19:51:40.428489+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:59.792856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442661+0000","last_change":"2023-12-24T19:51:40.439954+0000","last_active":"2023-12-24T19:51:40.442661+0000","last_peered":"2023-12-24T19:51:40.442661+0000","last_clean":"2023-12-24T19:51:40.442661+0000","last_became_active":"2023-12-24T19:51:40.439679+0000","last_became_peered":"2023-12-24T19:51:40.439679+0000","last_unstale":"2023-12-24T19:51:40.442661+0000","last_undegraded":"2023-12-24T19:51:40.442661+0000","last_fullsized":"2023-12-24T19:51:40.442661+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:36.542056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436110+0000","last_change":"2023-12-24T19:51:40.432361+0000","last_active":"2023-12-24T19:51:40.436110+0000","last_peered":"2023-12-24T19:51:40.436110+0000","last_clean":"2023-12-24T19:51:40.436110+0000","last_became_active":"2023-12-24T19:51:40.430131+0000","last_became_peered":"2023-12-24T19:51:40.430131+0000","last_unstale":"2023-12-24T19:51:40.436110+0000","last_undegraded":"2023-12-24T19:51:40.436110+0000","last_fullsized":"2023-12-24T19:51:40.436110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:49.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.429680+0000","last_change":"2023-12-24T19:51:40.425521+0000","last_active":"2023-12-24T19:51:40.429680+0000","last_peered":"2023-12-24T19:51:40.429680+0000","last_clean":"2023-12-24T19:51:40.429680+0000","last_became_active":"2023-12-24T19:51:40.424646+0000","last_became_peered":"2023-12-24T19:51:40.424646+0000","last_unstale":"2023-12-24T19:51:40.429680+0000","last_undegraded":"2023-12-24T19:51:40.429680+0000","last_fullsized":"2023-12-24T19:51:40.429680+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:40.758803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443598+0000","last_change":"2023-12-24T19:51:40.441627+0000","last_active":"2023-12-24T19:51:40.443598+0000","last_peered":"2023-12-24T19:51:40.443598+0000","last_clean":"2023-12-24T19:51:40.443598+0000","last_became_active":"2023-12-24T19:51:40.440587+0000","last_became_peered":"2023-12-24T19:51:40.440587+0000","last_unstale":"2023-12-24T19:51:40.443598+0000","last_undegraded":"2023-12-24T19:51:40.443598+0000","last_fullsized":"2023-12-24T19:51:40.443598+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:44:50.426428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.443559+0000","last_change":"2023-12-24T19:51:40.441435+0000","last_active":"2023-12-24T19:51:40.443559+0000","last_peered":"2023-12-24T19:51:40.443559+0000","last_clean":"2023-12-24T19:51:40.443559+0000","last_became_active":"2023-12-24T19:51:40.441142+0000","last_became_peered":"2023-12-24T19:51:40.441142+0000","last_unstale":"2023-12-24T19:51:40.443559+0000","last_undegraded":"2023-12-24T19:51:40.443559+0000","last_fullsized":"2023-12-24T19:51:40.443559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:46.386942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438746+0000","last_change":"2023-12-24T19:51:40.433297+0000","last_active":"2023-12-24T19:51:40.438746+0000","last_peered":"2023-12-24T19:51:40.438746+0000","last_clean":"2023-12-24T19:51:40.438746+0000","last_became_active":"2023-12-24T19:51:40.428557+0000","last_became_peered":"2023-12-24T19:51:40.428557+0000","last_unstale":"2023-12-24T19:51:40.438746+0000","last_undegraded":"2023-12-24T19:51:40.438746+0000","last_fullsized":"2023-12-24T19:51:40.438746+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.434565+0000","last_change":"2023-12-24T19:51:40.430060+0000","last_active":"2023-12-24T19:51:40.434565+0000","last_peered":"2023-12-24T19:51:40.434565+0000","last_clean":"2023-12-24T19:51:40.434565+0000","last_became_active":"2023-12-24T19:51:40.429480+0000","last_became_peered":"2023-12-24T19:51:40.429480+0000","last_unstale":"2023-12-24T19:51:40.434565+0000","last_undegraded":"2023-12-24T19:51:40.434565+0000","last_fullsized":"2023-12-24T19:51:40.434565+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:59.905534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440750+0000","last_change":"2023-12-24T19:51:40.434965+0000","last_active":"2023-12-24T19:51:40.440750+0000","last_peered":"2023-12-24T19:51:40.440750+0000","last_clean":"2023-12-24T19:51:40.440750+0000","last_became_active":"2023-12-24T19:51:40.430478+0000","last_became_peered":"2023-12-24T19:51:40.430478+0000","last_unstale":"2023-12-24T19:51:40.440750+0000","last_undegraded":"2023-12-24T19:51:40.440750+0000","last_fullsized":"2023-12-24T19:51:40.440750+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440842+0000","last_change":"2023-12-24T19:51:40.435541+0000","last_active":"2023-12-24T19:51:40.440842+0000","last_peered":"2023-12-24T19:51:40.440842+0000","last_clean":"2023-12-24T19:51:40.440842+0000","last_became_active":"2023-12-24T19:51:40.435225+0000","last_became_peered":"2023-12-24T19:51:40.435225+0000","last_unstale":"2023-12-24T19:51:40.440842+0000","last_undegraded":"2023-12-24T19:51:40.440842+0000","last_fullsized":"2023-12-24T19:51:40.440842+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:46.218240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436594+0000","last_change":"2023-12-24T19:51:40.434506+0000","last_active":"2023-12-24T19:51:40.436594+0000","last_peered":"2023-12-24T19:51:40.436594+0000","last_clean":"2023-12-24T19:51:40.436594+0000","last_became_active":"2023-12-24T19:51:40.434235+0000","last_became_peered":"2023-12-24T19:51:40.434235+0000","last_unstale":"2023-12-24T19:51:40.436594+0000","last_undegraded":"2023-12-24T19:51:40.436594+0000","last_fullsized":"2023-12-24T19:51:40.436594+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:03.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436552+0000","last_change":"2023-12-24T19:51:40.433597+0000","last_active":"2023-12-24T19:51:40.436552+0000","last_peered":"2023-12-24T19:51:40.436552+0000","last_clean":"2023-12-24T19:51:40.436552+0000","last_became_active":"2023-12-24T19:51:40.433336+0000","last_became_peered":"2023-12-24T19:51:40.433336+0000","last_unstale":"2023-12-24T19:51:40.436552+0000","last_undegraded":"2023-12-24T19:51:40.436552+0000","last_fullsized":"2023-12-24T19:51:40.436552+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444261+0000","last_change":"2023-12-24T19:51:40.443021+0000","last_active":"2023-12-24T19:51:40.444261+0000","last_peered":"2023-12-24T19:51:40.444261+0000","last_clean":"2023-12-24T19:51:40.444261+0000","last_became_active":"2023-12-24T19:51:40.442698+0000","last_became_peered":"2023-12-24T19:51:40.442698+0000","last_unstale":"2023-12-24T19:51:40.444261+0000","last_undegraded":"2023-12-24T19:51:40.444261+0000","last_fullsized":"2023-12-24T19:51:40.444261+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419227+0000","last_change":"2023-12-24T19:51:40.415109+0000","last_active":"2023-12-24T19:51:40.419227+0000","last_peered":"2023-12-24T19:51:40.419227+0000","last_clean":"2023-12-24T19:51:40.419227+0000","last_became_active":"2023-12-24T19:51:40.413960+0000","last_became_peered":"2023-12-24T19:51:40.413960+0000","last_unstale":"2023-12-24T19:51:40.419227+0000","last_undegraded":"2023-12-24T19:51:40.419227+0000","last_fullsized":"2023-12-24T19:51:40.419227+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:41.110755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436867+0000","last_change":"2023-12-24T19:51:40.430598+0000","last_active":"2023-12-24T19:51:40.436867+0000","last_peered":"2023-12-24T19:51:40.436867+0000","last_clean":"2023-12-24T19:51:40.436867+0000","last_became_active":"2023-12-24T19:51:40.428623+0000","last_became_peered":"2023-12-24T19:51:40.428623+0000","last_unstale":"2023-12-24T19:51:40.436867+0000","last_undegraded":"2023-12-24T19:51:40.436867+0000","last_fullsized":"2023-12-24T19:51:40.436867+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:05.101525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444825+0000","last_change":"2023-12-24T19:51:40.443011+0000","last_active":"2023-12-24T19:51:40.444825+0000","last_peered":"2023-12-24T19:51:40.444825+0000","last_clean":"2023-12-24T19:51:40.444825+0000","last_became_active":"2023-12-24T19:51:40.442709+0000","last_became_peered":"2023-12-24T19:51:40.442709+0000","last_unstale":"2023-12-24T19:51:40.444825+0000","last_undegraded":"2023-12-24T19:51:40.444825+0000","last_fullsized":"2023-12-24T19:51:40.444825+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:37.960323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426546+0000","last_change":"2023-12-24T19:51:40.422494+0000","last_active":"2023-12-24T19:51:40.426546+0000","last_peered":"2023-12-24T19:51:40.426546+0000","last_clean":"2023-12-24T19:51:40.426546+0000","last_became_active":"2023-12-24T19:51:40.421874+0000","last_became_peered":"2023-12-24T19:51:40.421874+0000","last_unstale":"2023-12-24T19:51:40.426546+0000","last_undegraded":"2023-12-24T19:51:40.426546+0000","last_fullsized":"2023-12-24T19:51:40.426546+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:05.015812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444133+0000","last_change":"2023-12-24T19:51:40.439408+0000","last_active":"2023-12-24T19:51:40.444133+0000","last_peered":"2023-12-24T19:51:40.444133+0000","last_clean":"2023-12-24T19:51:40.444133+0000","last_became_active":"2023-12-24T19:51:40.438577+0000","last_became_peered":"2023-12-24T19:51:40.438577+0000","last_unstale":"2023-12-24T19:51:40.444133+0000","last_undegraded":"2023-12-24T19:51:40.444133+0000","last_fullsized":"2023-12-24T19:51:40.444133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:44.285116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.419740+0000","last_change":"2023-12-24T19:51:40.415045+0000","last_active":"2023-12-24T19:51:40.419740+0000","last_peered":"2023-12-24T19:51:40.419740+0000","last_clean":"2023-12-24T19:51:40.419740+0000","last_became_active":"2023-12-24T19:51:40.414739+0000","last_became_peered":"2023-12-24T19:51:40.414739+0000","last_unstale":"2023-12-24T19:51:40.419740+0000","last_undegraded":"2023-12-24T19:51:40.419740+0000","last_fullsized":"2023-12-24T19:51:40.419740+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:38.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439832+0000","last_change":"2023-12-24T19:51:40.436389+0000","last_active":"2023-12-24T19:51:40.439832+0000","last_peered":"2023-12-24T19:51:40.439832+0000","last_clean":"2023-12-24T19:51:40.439832+0000","last_became_active":"2023-12-24T19:51:40.436043+0000","last_became_peered":"2023-12-24T19:51:40.436043+0000","last_unstale":"2023-12-24T19:51:40.439832+0000","last_undegraded":"2023-12-24T19:51:40.439832+0000","last_fullsized":"2023-12-24T19:51:40.439832+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:07:58.381366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436478+0000","last_change":"2023-12-24T19:51:40.433033+0000","last_active":"2023-12-24T19:51:40.436478+0000","last_peered":"2023-12-24T19:51:40.436478+0000","last_clean":"2023-12-24T19:51:40.436478+0000","last_became_active":"2023-12-24T19:51:40.432714+0000","last_became_peered":"2023-12-24T19:51:40.432714+0000","last_unstale":"2023-12-24T19:51:40.436478+0000","last_undegraded":"2023-12-24T19:51:40.436478+0000","last_fullsized":"2023-12-24T19:51:40.436478+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428640+0000","last_change":"2023-12-24T19:51:40.425834+0000","last_active":"2023-12-24T19:51:40.428640+0000","last_peered":"2023-12-24T19:51:40.428640+0000","last_clean":"2023-12-24T19:51:40.428640+0000","last_became_active":"2023-12-24T19:51:40.425546+0000","last_became_peered":"2023-12-24T19:51:40.425546+0000","last_unstale":"2023-12-24T19:51:40.428640+0000","last_undegraded":"2023-12-24T19:51:40.428640+0000","last_fullsized":"2023-12-24T19:51:40.428640+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632532+0000","last_change":"2023-12-24T19:51:39.624722+0000","last_active":"2023-12-24T19:51:40.632532+0000","last_peered":"2023-12-24T19:51:40.632532+0000","last_clean":"2023-12-24T19:51:40.632532+0000","last_became_active":"2023-12-24T19:51:39.624389+0000","last_became_peered":"2023-12-24T19:51:39.624389+0000","last_unstale":"2023-12-24T19:51:40.632532+0000","last_undegraded":"2023-12-24T19:51:40.632532+0000","last_fullsized":"2023-12-24T19:51:40.632532+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:46.834080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436623+0000","last_change":"2023-12-24T19:51:40.434492+0000","last_active":"2023-12-24T19:51:40.436623+0000","last_peered":"2023-12-24T19:51:40.436623+0000","last_clean":"2023-12-24T19:51:40.436623+0000","last_became_active":"2023-12-24T19:51:40.434172+0000","last_became_peered":"2023-12-24T19:51:40.434172+0000","last_unstale":"2023-12-24T19:51:40.436623+0000","last_undegraded":"2023-12-24T19:51:40.436623+0000","last_fullsized":"2023-12-24T19:51:40.436623+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:29.790775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631762+0000","last_change":"2023-12-24T19:51:39.614040+0000","last_active":"2023-12-24T19:51:40.631762+0000","last_peered":"2023-12-24T19:51:40.631762+0000","last_clean":"2023-12-24T19:51:40.631762+0000","last_became_active":"2023-12-24T19:51:39.613728+0000","last_became_peered":"2023-12-24T19:51:39.613728+0000","last_unstale":"2023-12-24T19:51:40.631762+0000","last_undegraded":"2023-12-24T19:51:40.631762+0000","last_fullsized":"2023-12-24T19:51:40.631762+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.524994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.436148+0000","last_change":"2023-12-24T19:51:40.431375+0000","last_active":"2023-12-24T19:51:40.436148+0000","last_peered":"2023-12-24T19:51:40.436148+0000","last_clean":"2023-12-24T19:51:40.436148+0000","last_became_active":"2023-12-24T19:51:40.429179+0000","last_became_peered":"2023-12-24T19:51:40.429179+0000","last_unstale":"2023-12-24T19:51:40.436148+0000","last_undegraded":"2023-12-24T19:51:40.436148+0000","last_fullsized":"2023-12-24T19:51:40.436148+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:45.873362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632010+0000","last_change":"2023-12-24T19:51:39.632825+0000","last_active":"2023-12-24T19:51:40.632010+0000","last_peered":"2023-12-24T19:51:40.632010+0000","last_clean":"2023-12-24T19:51:40.632010+0000","last_became_active":"2023-12-24T19:51:39.632510+0000","last_became_peered":"2023-12-24T19:51:39.632510+0000","last_unstale":"2023-12-24T19:51:40.632010+0000","last_undegraded":"2023-12-24T19:51:40.632010+0000","last_fullsized":"2023-12-24T19:51:40.632010+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:04.825207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.426987+0000","last_change":"2023-12-24T19:51:40.425316+0000","last_active":"2023-12-24T19:51:40.426987+0000","last_peered":"2023-12-24T19:51:40.426987+0000","last_clean":"2023-12-24T19:51:40.426987+0000","last_became_active":"2023-12-24T19:51:40.424708+0000","last_became_peered":"2023-12-24T19:51:40.424708+0000","last_unstale":"2023-12-24T19:51:40.426987+0000","last_undegraded":"2023-12-24T19:51:40.426987+0000","last_fullsized":"2023-12-24T19:51:40.426987+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:12.476714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630698+0000","last_change":"2023-12-24T19:51:39.627945+0000","last_active":"2023-12-24T19:51:40.630698+0000","last_peered":"2023-12-24T19:51:40.630698+0000","last_clean":"2023-12-24T19:51:40.630698+0000","last_became_active":"2023-12-24T19:51:39.627619+0000","last_became_peered":"2023-12-24T19:51:39.627619+0000","last_unstale":"2023-12-24T19:51:40.630698+0000","last_undegraded":"2023-12-24T19:51:40.630698+0000","last_fullsized":"2023-12-24T19:51:40.630698+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:23.816437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441628+0000","last_change":"2023-12-24T19:51:40.438779+0000","last_active":"2023-12-24T19:51:40.441628+0000","last_peered":"2023-12-24T19:51:40.441628+0000","last_clean":"2023-12-24T19:51:40.441628+0000","last_became_active":"2023-12-24T19:51:40.438495+0000","last_became_peered":"2023-12-24T19:51:40.438495+0000","last_unstale":"2023-12-24T19:51:40.441628+0000","last_undegraded":"2023-12-24T19:51:40.441628+0000","last_fullsized":"2023-12-24T19:51:40.441628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:32.553401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629405+0000","last_change":"2023-12-24T19:51:39.625630+0000","last_active":"2023-12-24T19:51:40.629405+0000","last_peered":"2023-12-24T19:51:40.629405+0000","last_clean":"2023-12-24T19:51:40.629405+0000","last_became_active":"2023-12-24T19:51:39.625062+0000","last_became_peered":"2023-12-24T19:51:39.625062+0000","last_unstale":"2023-12-24T19:51:40.629405+0000","last_undegraded":"2023-12-24T19:51:40.629405+0000","last_fullsized":"2023-12-24T19:51:40.629405+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428263+0000","last_change":"2023-12-24T19:51:40.423118+0000","last_active":"2023-12-24T19:51:40.428263+0000","last_peered":"2023-12-24T19:51:40.428263+0000","last_clean":"2023-12-24T19:51:40.428263+0000","last_became_active":"2023-12-24T19:51:40.422754+0000","last_became_peered":"2023-12-24T19:51:40.422754+0000","last_unstale":"2023-12-24T19:51:40.428263+0000","last_undegraded":"2023-12-24T19:51:40.428263+0000","last_fullsized":"2023-12-24T19:51:40.428263+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:18.308546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631702+0000","last_change":"2023-12-24T19:51:39.620796+0000","last_active":"2023-12-24T19:51:40.631702+0000","last_peered":"2023-12-24T19:51:40.631702+0000","last_clean":"2023-12-24T19:51:40.631702+0000","last_became_active":"2023-12-24T19:51:39.620494+0000","last_became_peered":"2023-12-24T19:51:39.620494+0000","last_unstale":"2023-12-24T19:51:40.631702+0000","last_undegraded":"2023-12-24T19:51:40.631702+0000","last_fullsized":"2023-12-24T19:51:40.631702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:38:45.369881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438765+0000","last_change":"2023-12-24T19:51:40.434720+0000","last_active":"2023-12-24T19:51:40.438765+0000","last_peered":"2023-12-24T19:51:40.438765+0000","last_clean":"2023-12-24T19:51:40.438765+0000","last_became_active":"2023-12-24T19:51:40.433651+0000","last_became_peered":"2023-12-24T19:51:40.433651+0000","last_unstale":"2023-12-24T19:51:40.438765+0000","last_undegraded":"2023-12-24T19:51:40.438765+0000","last_fullsized":"2023-12-24T19:51:40.438765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:00.081129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432720+0000","last_change":"2023-12-24T19:51:39.628949+0000","last_active":"2023-12-24T19:51:40.432720+0000","last_peered":"2023-12-24T19:51:40.432720+0000","last_clean":"2023-12-24T19:51:40.432720+0000","last_became_active":"2023-12-24T19:51:39.628339+0000","last_became_peered":"2023-12-24T19:51:39.628339+0000","last_unstale":"2023-12-24T19:51:40.432720+0000","last_undegraded":"2023-12-24T19:51:40.432720+0000","last_fullsized":"2023-12-24T19:51:40.432720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.441331+0000","last_change":"2023-12-24T19:51:40.438801+0000","last_active":"2023-12-24T19:51:40.441331+0000","last_peered":"2023-12-24T19:51:40.441331+0000","last_clean":"2023-12-24T19:51:40.441331+0000","last_became_active":"2023-12-24T19:51:40.438303+0000","last_became_peered":"2023-12-24T19:51:40.438303+0000","last_unstale":"2023-12-24T19:51:40.441331+0000","last_undegraded":"2023-12-24T19:51:40.441331+0000","last_fullsized":"2023-12-24T19:51:40.441331+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:53:36.022014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.411137+0000","last_change":"2023-12-24T19:51:39.610871+0000","last_active":"2023-12-24T19:51:40.411137+0000","last_peered":"2023-12-24T19:51:40.411137+0000","last_clean":"2023-12-24T19:51:40.411137+0000","last_became_active":"2023-12-24T19:51:39.610529+0000","last_became_peered":"2023-12-24T19:51:39.610529+0000","last_unstale":"2023-12-24T19:51:40.411137+0000","last_undegraded":"2023-12-24T19:51:40.411137+0000","last_fullsized":"2023-12-24T19:51:40.411137+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:24:03.143988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418608+0000","last_change":"2023-12-24T19:51:40.416121+0000","last_active":"2023-12-24T19:51:40.418608+0000","last_peered":"2023-12-24T19:51:40.418608+0000","last_clean":"2023-12-24T19:51:40.418608+0000","last_became_active":"2023-12-24T19:51:40.415769+0000","last_became_peered":"2023-12-24T19:51:40.415769+0000","last_unstale":"2023-12-24T19:51:40.418608+0000","last_undegraded":"2023-12-24T19:51:40.418608+0000","last_fullsized":"2023-12-24T19:51:40.418608+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.755566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.420846+0000","last_change":"2023-12-24T19:51:39.613940+0000","last_active":"2023-12-24T19:51:40.420846+0000","last_peered":"2023-12-24T19:51:40.420846+0000","last_clean":"2023-12-24T19:51:40.420846+0000","last_became_active":"2023-12-24T19:51:39.613646+0000","last_became_peered":"2023-12-24T19:51:39.613646+0000","last_unstale":"2023-12-24T19:51:40.420846+0000","last_undegraded":"2023-12-24T19:51:40.420846+0000","last_fullsized":"2023-12-24T19:51:40.420846+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:40:40.093694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440701+0000","last_change":"2023-12-24T19:51:40.436559+0000","last_active":"2023-12-24T19:51:40.440701+0000","last_peered":"2023-12-24T19:51:40.440701+0000","last_clean":"2023-12-24T19:51:40.440701+0000","last_became_active":"2023-12-24T19:51:40.436138+0000","last_became_peered":"2023-12-24T19:51:40.436138+0000","last_unstale":"2023-12-24T19:51:40.440701+0000","last_undegraded":"2023-12-24T19:51:40.440701+0000","last_fullsized":"2023-12-24T19:51:40.440701+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:32.510531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409890+0000","last_change":"2023-12-24T19:51:39.632193+0000","last_active":"2023-12-24T19:51:40.409890+0000","last_peered":"2023-12-24T19:51:40.409890+0000","last_clean":"2023-12-24T19:51:40.409890+0000","last_became_active":"2023-12-24T19:51:39.631461+0000","last_became_peered":"2023-12-24T19:51:39.631461+0000","last_unstale":"2023-12-24T19:51:40.409890+0000","last_undegraded":"2023-12-24T19:51:40.409890+0000","last_fullsized":"2023-12-24T19:51:40.409890+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:27.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439526+0000","last_change":"2023-12-24T19:51:40.433371+0000","last_active":"2023-12-24T19:51:40.439526+0000","last_peered":"2023-12-24T19:51:40.439526+0000","last_clean":"2023-12-24T19:51:40.439526+0000","last_became_active":"2023-12-24T19:51:40.432550+0000","last_became_peered":"2023-12-24T19:51:40.432550+0000","last_unstale":"2023-12-24T19:51:40.439526+0000","last_undegraded":"2023-12-24T19:51:40.439526+0000","last_fullsized":"2023-12-24T19:51:40.439526+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:04.937548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632962+0000","last_change":"2023-12-24T19:51:39.629596+0000","last_active":"2023-12-24T19:51:40.632962+0000","last_peered":"2023-12-24T19:51:40.632962+0000","last_clean":"2023-12-24T19:51:40.632962+0000","last_became_active":"2023-12-24T19:51:39.629252+0000","last_became_peered":"2023-12-24T19:51:39.629252+0000","last_unstale":"2023-12-24T19:51:40.632962+0000","last_undegraded":"2023-12-24T19:51:40.632962+0000","last_fullsized":"2023-12-24T19:51:40.632962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:13:42.973463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.428881+0000","last_change":"2023-12-24T19:51:40.424037+0000","last_active":"2023-12-24T19:51:40.428881+0000","last_peered":"2023-12-24T19:51:40.428881+0000","last_clean":"2023-12-24T19:51:40.428881+0000","last_became_active":"2023-12-24T19:51:40.422864+0000","last_became_peered":"2023-12-24T19:51:40.422864+0000","last_unstale":"2023-12-24T19:51:40.428881+0000","last_undegraded":"2023-12-24T19:51:40.428881+0000","last_fullsized":"2023-12-24T19:51:40.428881+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:40.208531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"158'6","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.634021+0000","last_change":"2023-12-24T19:51:39.631728+0000","last_active":"2023-12-24T19:51:40.634021+0000","last_peered":"2023-12-24T19:51:40.634021+0000","last_clean":"2023-12-24T19:51:40.634021+0000","last_became_active":"2023-12-24T19:51:39.631420+0000","last_became_peered":"2023-12-24T19:51:39.631420+0000","last_unstale":"2023-12-24T19:51:40.634021+0000","last_undegraded":"2023-12-24T19:51:40.634021+0000","last_fullsized":"2023-12-24T19:51:40.634021+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:05.017707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424378+0000","last_change":"2023-12-24T19:51:40.420704+0000","last_active":"2023-12-24T19:51:40.424378+0000","last_peered":"2023-12-24T19:51:40.424378+0000","last_clean":"2023-12-24T19:51:40.424378+0000","last_became_active":"2023-12-24T19:51:40.420273+0000","last_became_peered":"2023-12-24T19:51:40.420273+0000","last_unstale":"2023-12-24T19:51:40.424378+0000","last_undegraded":"2023-12-24T19:51:40.424378+0000","last_fullsized":"2023-12-24T19:51:40.424378+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.630422+0000","last_change":"2023-12-24T19:51:39.627033+0000","last_active":"2023-12-24T19:51:40.630422+0000","last_peered":"2023-12-24T19:51:40.630422+0000","last_clean":"2023-12-24T19:51:40.630422+0000","last_became_active":"2023-12-24T19:51:39.626051+0000","last_became_peered":"2023-12-24T19:51:39.626051+0000","last_unstale":"2023-12-24T19:51:40.630422+0000","last_undegraded":"2023-12-24T19:51:40.630422+0000","last_fullsized":"2023-12-24T19:51:40.630422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:35.180205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439729+0000","last_change":"2023-12-24T19:51:40.436088+0000","last_active":"2023-12-24T19:51:40.439729+0000","last_peered":"2023-12-24T19:51:40.439729+0000","last_clean":"2023-12-24T19:51:40.439729+0000","last_became_active":"2023-12-24T19:51:40.435805+0000","last_became_peered":"2023-12-24T19:51:40.435805+0000","last_unstale":"2023-12-24T19:51:40.439729+0000","last_undegraded":"2023-12-24T19:51:40.439729+0000","last_fullsized":"2023-12-24T19:51:40.439729+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:50:19.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.412157+0000","last_change":"2023-12-24T19:51:39.615804+0000","last_active":"2023-12-24T19:51:40.412157+0000","last_peered":"2023-12-24T19:51:40.412157+0000","last_clean":"2023-12-24T19:51:40.412157+0000","last_became_active":"2023-12-24T19:51:39.615496+0000","last_became_peered":"2023-12-24T19:51:39.615496+0000","last_unstale":"2023-12-24T19:51:40.412157+0000","last_undegraded":"2023-12-24T19:51:40.412157+0000","last_fullsized":"2023-12-24T19:51:40.412157+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:24:25.652658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440588+0000","last_change":"2023-12-24T19:51:40.436875+0000","last_active":"2023-12-24T19:51:40.440588+0000","last_peered":"2023-12-24T19:51:40.440588+0000","last_clean":"2023-12-24T19:51:40.440588+0000","last_became_active":"2023-12-24T19:51:40.436576+0000","last_became_peered":"2023-12-24T19:51:40.436576+0000","last_unstale":"2023-12-24T19:51:40.440588+0000","last_undegraded":"2023-12-24T19:51:40.440588+0000","last_fullsized":"2023-12-24T19:51:40.440588+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:47:25.727690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.635212+0000","last_change":"2023-12-24T19:51:39.622106+0000","last_active":"2023-12-24T19:51:40.635212+0000","last_peered":"2023-12-24T19:51:40.635212+0000","last_clean":"2023-12-24T19:51:40.635212+0000","last_became_active":"2023-12-24T19:51:39.621718+0000","last_became_peered":"2023-12-24T19:51:39.621718+0000","last_unstale":"2023-12-24T19:51:40.635212+0000","last_undegraded":"2023-12-24T19:51:40.635212+0000","last_fullsized":"2023-12-24T19:51:40.635212+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:39.191470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424133+0000","last_change":"2023-12-24T19:51:40.419727+0000","last_active":"2023-12-24T19:51:40.424133+0000","last_peered":"2023-12-24T19:51:40.424133+0000","last_clean":"2023-12-24T19:51:40.424133+0000","last_became_active":"2023-12-24T19:51:40.419377+0000","last_became_peered":"2023-12-24T19:51:40.419377+0000","last_unstale":"2023-12-24T19:51:40.424133+0000","last_undegraded":"2023-12-24T19:51:40.424133+0000","last_fullsized":"2023-12-24T19:51:40.424133+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:57.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.629193+0000","last_change":"2023-12-24T19:51:39.630562+0000","last_active":"2023-12-24T19:51:40.629193+0000","last_peered":"2023-12-24T19:51:40.629193+0000","last_clean":"2023-12-24T19:51:40.629193+0000","last_became_active":"2023-12-24T19:51:39.630206+0000","last_became_peered":"2023-12-24T19:51:39.630206+0000","last_unstale":"2023-12-24T19:51:40.629193+0000","last_undegraded":"2023-12-24T19:51:40.629193+0000","last_fullsized":"2023-12-24T19:51:40.629193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439544+0000","last_change":"2023-12-24T19:51:40.435426+0000","last_active":"2023-12-24T19:51:40.439544+0000","last_peered":"2023-12-24T19:51:40.439544+0000","last_clean":"2023-12-24T19:51:40.439544+0000","last_became_active":"2023-12-24T19:51:40.435144+0000","last_became_peered":"2023-12-24T19:51:40.435144+0000","last_unstale":"2023-12-24T19:51:40.439544+0000","last_undegraded":"2023-12-24T19:51:40.439544+0000","last_fullsized":"2023-12-24T19:51:40.439544+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:51.815229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.632750+0000","last_change":"2023-12-24T19:51:39.625620+0000","last_active":"2023-12-24T19:51:40.632750+0000","last_peered":"2023-12-24T19:51:40.632750+0000","last_clean":"2023-12-24T19:51:40.632750+0000","last_became_active":"2023-12-24T19:51:39.625041+0000","last_became_peered":"2023-12-24T19:51:39.625041+0000","last_unstale":"2023-12-24T19:51:40.632750+0000","last_undegraded":"2023-12-24T19:51:40.632750+0000","last_fullsized":"2023-12-24T19:51:40.632750+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:55:26.302719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.444183+0000","last_change":"2023-12-24T19:51:40.439893+0000","last_active":"2023-12-24T19:51:40.444183+0000","last_peered":"2023-12-24T19:51:40.444183+0000","last_clean":"2023-12-24T19:51:40.444183+0000","last_became_active":"2023-12-24T19:51:40.439444+0000","last_became_peered":"2023-12-24T19:51:40.439444+0000","last_unstale":"2023-12-24T19:51:40.444183+0000","last_undegraded":"2023-12-24T19:51:40.444183+0000","last_fullsized":"2023-12-24T19:51:40.444183+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:03.393498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631043+0000","last_change":"2023-12-24T19:51:39.617148+0000","last_active":"2023-12-24T19:51:40.631043+0000","last_peered":"2023-12-24T19:51:40.631043+0000","last_clean":"2023-12-24T19:51:40.631043+0000","last_became_active":"2023-12-24T19:51:39.616836+0000","last_became_peered":"2023-12-24T19:51:39.616836+0000","last_unstale":"2023-12-24T19:51:40.631043+0000","last_undegraded":"2023-12-24T19:51:40.631043+0000","last_fullsized":"2023-12-24T19:51:40.631043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.423628+0000","last_change":"2023-12-24T19:51:40.421790+0000","last_active":"2023-12-24T19:51:40.423628+0000","last_peered":"2023-12-24T19:51:40.423628+0000","last_clean":"2023-12-24T19:51:40.423628+0000","last_became_active":"2023-12-24T19:51:40.421458+0000","last_became_peered":"2023-12-24T19:51:40.421458+0000","last_unstale":"2023-12-24T19:51:40.423628+0000","last_undegraded":"2023-12-24T19:51:40.423628+0000","last_fullsized":"2023-12-24T19:51:40.423628+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:31.391018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.415764+0000","last_change":"2023-12-24T19:51:39.620411+0000","last_active":"2023-12-24T19:51:40.415764+0000","last_peered":"2023-12-24T19:51:40.415764+0000","last_clean":"2023-12-24T19:51:40.415764+0000","last_became_active":"2023-12-24T19:51:39.619856+0000","last_became_peered":"2023-12-24T19:51:39.619856+0000","last_unstale":"2023-12-24T19:51:40.415764+0000","last_undegraded":"2023-12-24T19:51:40.415764+0000","last_fullsized":"2023-12-24T19:51:40.415764+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:51.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.421843+0000","last_change":"2023-12-24T19:51:40.420639+0000","last_active":"2023-12-24T19:51:40.421843+0000","last_peered":"2023-12-24T19:51:40.421843+0000","last_clean":"2023-12-24T19:51:40.421843+0000","last_became_active":"2023-12-24T19:51:40.420309+0000","last_became_peered":"2023-12-24T19:51:40.420309+0000","last_unstale":"2023-12-24T19:51:40.421843+0000","last_undegraded":"2023-12-24T19:51:40.421843+0000","last_fullsized":"2023-12-24T19:51:40.421843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:04.875886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.631675+0000","last_change":"2023-12-24T19:51:39.625407+0000","last_active":"2023-12-24T19:51:40.631675+0000","last_peered":"2023-12-24T19:51:40.631675+0000","last_clean":"2023-12-24T19:51:40.631675+0000","last_became_active":"2023-12-24T19:51:39.624691+0000","last_became_peered":"2023-12-24T19:51:39.624691+0000","last_unstale":"2023-12-24T19:51:40.631675+0000","last_undegraded":"2023-12-24T19:51:40.631675+0000","last_fullsized":"2023-12-24T19:51:40.631675+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:04.084464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.431343+0000","last_change":"2023-12-24T19:51:40.430022+0000","last_active":"2023-12-24T19:51:40.431343+0000","last_peered":"2023-12-24T19:51:40.431343+0000","last_clean":"2023-12-24T19:51:40.431343+0000","last_became_active":"2023-12-24T19:51:40.426777+0000","last_became_peered":"2023-12-24T19:51:40.426777+0000","last_unstale":"2023-12-24T19:51:40.431343+0000","last_undegraded":"2023-12-24T19:51:40.431343+0000","last_fullsized":"2023-12-24T19:51:40.431343+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:28.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.409179+0000","last_change":"2023-12-24T19:51:39.622856+0000","last_active":"2023-12-24T19:51:40.409179+0000","last_peered":"2023-12-24T19:51:40.409179+0000","last_clean":"2023-12-24T19:51:40.409179+0000","last_became_active":"2023-12-24T19:51:39.622570+0000","last_became_peered":"2023-12-24T19:51:39.622570+0000","last_unstale":"2023-12-24T19:51:40.409179+0000","last_undegraded":"2023-12-24T19:51:40.409179+0000","last_fullsized":"2023-12-24T19:51:40.409179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:45.599956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438003+0000","last_change":"2023-12-24T19:51:40.427853+0000","last_active":"2023-12-24T19:51:40.438003+0000","last_peered":"2023-12-24T19:51:40.438003+0000","last_clean":"2023-12-24T19:51:40.438003+0000","last_became_active":"2023-12-24T19:51:40.427547+0000","last_became_peered":"2023-12-24T19:51:40.427547+0000","last_unstale":"2023-12-24T19:51:40.438003+0000","last_undegraded":"2023-12-24T19:51:40.438003+0000","last_fullsized":"2023-12-24T19:51:40.438003+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:11.645312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417081+0000","last_change":"2023-12-24T19:51:39.630194+0000","last_active":"2023-12-24T19:51:40.417081+0000","last_peered":"2023-12-24T19:51:40.417081+0000","last_clean":"2023-12-24T19:51:40.417081+0000","last_became_active":"2023-12-24T19:51:39.629848+0000","last_became_peered":"2023-12-24T19:51:39.629848+0000","last_unstale":"2023-12-24T19:51:40.417081+0000","last_undegraded":"2023-12-24T19:51:40.417081+0000","last_fullsized":"2023-12-24T19:51:40.417081+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:25.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.435049+0000","last_change":"2023-12-24T19:51:40.432051+0000","last_active":"2023-12-24T19:51:40.435049+0000","last_peered":"2023-12-24T19:51:40.435049+0000","last_clean":"2023-12-24T19:51:40.435049+0000","last_became_active":"2023-12-24T19:51:40.431763+0000","last_became_peered":"2023-12-24T19:51:40.431763+0000","last_unstale":"2023-12-24T19:51:40.435049+0000","last_undegraded":"2023-12-24T19:51:40.435049+0000","last_fullsized":"2023-12-24T19:51:40.435049+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:05.957842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432612+0000","last_change":"2023-12-24T19:51:39.629814+0000","last_active":"2023-12-24T19:51:40.432612+0000","last_peered":"2023-12-24T19:51:40.432612+0000","last_clean":"2023-12-24T19:51:40.432612+0000","last_became_active":"2023-12-24T19:51:39.628065+0000","last_became_peered":"2023-12-24T19:51:39.628065+0000","last_unstale":"2023-12-24T19:51:40.432612+0000","last_undegraded":"2023-12-24T19:51:40.432612+0000","last_fullsized":"2023-12-24T19:51:40.432612+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:26:55.807002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.438879+0000","last_change":"2023-12-24T19:51:40.434532+0000","last_active":"2023-12-24T19:51:40.438879+0000","last_peered":"2023-12-24T19:51:40.438879+0000","last_clean":"2023-12-24T19:51:40.438879+0000","last_became_active":"2023-12-24T19:51:40.433863+0000","last_became_peered":"2023-12-24T19:51:40.433863+0000","last_unstale":"2023-12-24T19:51:40.438879+0000","last_undegraded":"2023-12-24T19:51:40.438879+0000","last_fullsized":"2023-12-24T19:51:40.438879+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:47.785179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.633179+0000","last_change":"2023-12-24T19:51:39.624918+0000","last_active":"2023-12-24T19:51:40.633179+0000","last_peered":"2023-12-24T19:51:40.633179+0000","last_clean":"2023-12-24T19:51:40.633179+0000","last_became_active":"2023-12-24T19:51:39.624060+0000","last_became_peered":"2023-12-24T19:51:39.624060+0000","last_unstale":"2023-12-24T19:51:40.633179+0000","last_undegraded":"2023-12-24T19:51:40.633179+0000","last_fullsized":"2023-12-24T19:51:40.633179+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:54.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.430333+0000","last_change":"2023-12-24T19:51:40.424064+0000","last_active":"2023-12-24T19:51:40.430333+0000","last_peered":"2023-12-24T19:51:40.430333+0000","last_clean":"2023-12-24T19:51:40.430333+0000","last_became_active":"2023-12-24T19:51:40.423752+0000","last_became_peered":"2023-12-24T19:51:40.423752+0000","last_unstale":"2023-12-24T19:51:40.430333+0000","last_undegraded":"2023-12-24T19:51:40.430333+0000","last_fullsized":"2023-12-24T19:51:40.430333+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:07.280866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-24T19:51:41.413276+0000","last_change":"2023-12-24T19:51:39.619047+0000","last_active":"2023-12-24T19:51:41.413276+0000","last_peered":"2023-12-24T19:51:41.413276+0000","last_clean":"2023-12-24T19:51:41.413276+0000","last_became_active":"2023-12-24T19:51:39.618656+0000","last_became_peered":"2023-12-24T19:51:39.618656+0000","last_unstale":"2023-12-24T19:51:41.413276+0000","last_undegraded":"2023-12-24T19:51:41.413276+0000","last_fullsized":"2023-12-24T19:51:41.413276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.437339+0000","last_change":"2023-12-24T19:51:40.431853+0000","last_active":"2023-12-24T19:51:40.437339+0000","last_peered":"2023-12-24T19:51:40.437339+0000","last_clean":"2023-12-24T19:51:40.437339+0000","last_became_active":"2023-12-24T19:51:40.431311+0000","last_became_peered":"2023-12-24T19:51:40.431311+0000","last_unstale":"2023-12-24T19:51:40.437339+0000","last_undegraded":"2023-12-24T19:51:40.437339+0000","last_fullsized":"2023-12-24T19:51:40.437339+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:21.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.410314+0000","last_change":"2023-12-24T19:51:39.625981+0000","last_active":"2023-12-24T19:51:40.410314+0000","last_peered":"2023-12-24T19:51:40.410314+0000","last_clean":"2023-12-24T19:51:40.410314+0000","last_became_active":"2023-12-24T19:51:39.625275+0000","last_became_peered":"2023-12-24T19:51:39.625275+0000","last_unstale":"2023-12-24T19:51:40.410314+0000","last_undegraded":"2023-12-24T19:51:40.410314+0000","last_fullsized":"2023-12-24T19:51:40.410314+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:03:43.268055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.425243+0000","last_change":"2023-12-24T19:51:40.422375+0000","last_active":"2023-12-24T19:51:40.425243+0000","last_peered":"2023-12-24T19:51:40.425243+0000","last_clean":"2023-12-24T19:51:40.425243+0000","last_became_active":"2023-12-24T19:51:40.422046+0000","last_became_peered":"2023-12-24T19:51:40.422046+0000","last_unstale":"2023-12-24T19:51:40.425243+0000","last_undegraded":"2023-12-24T19:51:40.425243+0000","last_fullsized":"2023-12-24T19:51:40.425243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:28.886740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.433449+0000","last_change":"2023-12-24T19:51:39.628603+0000","last_active":"2023-12-24T19:51:40.433449+0000","last_peered":"2023-12-24T19:51:40.433449+0000","last_clean":"2023-12-24T19:51:40.433449+0000","last_became_active":"2023-12-24T19:51:39.628257+0000","last_became_peered":"2023-12-24T19:51:39.628257+0000","last_unstale":"2023-12-24T19:51:40.433449+0000","last_undegraded":"2023-12-24T19:51:40.433449+0000","last_fullsized":"2023-12-24T19:51:40.433449+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:38:08.173809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442421+0000","last_change":"2023-12-24T19:51:40.438807+0000","last_active":"2023-12-24T19:51:40.442421+0000","last_peered":"2023-12-24T19:51:40.442421+0000","last_clean":"2023-12-24T19:51:40.442421+0000","last_became_active":"2023-12-24T19:51:40.438483+0000","last_became_peered":"2023-12-24T19:51:40.438483+0000","last_unstale":"2023-12-24T19:51:40.442421+0000","last_undegraded":"2023-12-24T19:51:40.442421+0000","last_fullsized":"2023-12-24T19:51:40.442421+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:07.744878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.418636+0000","last_change":"2023-12-24T19:51:39.624395+0000","last_active":"2023-12-24T19:51:40.418636+0000","last_peered":"2023-12-24T19:51:40.418636+0000","last_clean":"2023-12-24T19:51:40.418636+0000","last_became_active":"2023-12-24T19:51:39.624089+0000","last_became_peered":"2023-12-24T19:51:39.624089+0000","last_unstale":"2023-12-24T19:51:40.418636+0000","last_undegraded":"2023-12-24T19:51:40.418636+0000","last_fullsized":"2023-12-24T19:51:40.418636+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:37.763509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.440201+0000","last_change":"2023-12-24T19:51:40.435720+0000","last_active":"2023-12-24T19:51:40.440201+0000","last_peered":"2023-12-24T19:51:40.440201+0000","last_clean":"2023-12-24T19:51:40.440201+0000","last_became_active":"2023-12-24T19:51:40.435390+0000","last_became_peered":"2023-12-24T19:51:40.435390+0000","last_unstale":"2023-12-24T19:51:40.440201+0000","last_undegraded":"2023-12-24T19:51:40.440201+0000","last_fullsized":"2023-12-24T19:51:40.440201+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:05:33.113558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417866+0000","last_change":"2023-12-24T19:51:39.630370+0000","last_active":"2023-12-24T19:51:40.417866+0000","last_peered":"2023-12-24T19:51:40.417866+0000","last_clean":"2023-12-24T19:51:40.417866+0000","last_became_active":"2023-12-24T19:51:39.629867+0000","last_became_peered":"2023-12-24T19:51:39.629867+0000","last_unstale":"2023-12-24T19:51:40.417866+0000","last_undegraded":"2023-12-24T19:51:40.417866+0000","last_fullsized":"2023-12-24T19:51:40.417866+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:32.129671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.442627+0000","last_change":"2023-12-24T19:51:40.439935+0000","last_active":"2023-12-24T19:51:40.442627+0000","last_peered":"2023-12-24T19:51:40.442627+0000","last_clean":"2023-12-24T19:51:40.442627+0000","last_became_active":"2023-12-24T19:51:40.439680+0000","last_became_peered":"2023-12-24T19:51:40.439680+0000","last_unstale":"2023-12-24T19:51:40.442627+0000","last_undegraded":"2023-12-24T19:51:40.442627+0000","last_fullsized":"2023-12-24T19:51:40.442627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:15.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.432963+0000","last_change":"2023-12-24T19:51:39.625890+0000","last_active":"2023-12-24T19:51:40.432963+0000","last_peered":"2023-12-24T19:51:40.432963+0000","last_clean":"2023-12-24T19:51:40.432963+0000","last_became_active":"2023-12-24T19:51:39.625588+0000","last_became_peered":"2023-12-24T19:51:39.625588+0000","last_unstale":"2023-12-24T19:51:40.432963+0000","last_undegraded":"2023-12-24T19:51:40.432963+0000","last_fullsized":"2023-12-24T19:51:40.432963+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:06.263805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.439557+0000","last_change":"2023-12-24T19:51:40.431399+0000","last_active":"2023-12-24T19:51:40.439557+0000","last_peered":"2023-12-24T19:51:40.439557+0000","last_clean":"2023-12-24T19:51:40.439557+0000","last_became_active":"2023-12-24T19:51:40.431099+0000","last_became_peered":"2023-12-24T19:51:40.431099+0000","last_unstale":"2023-12-24T19:51:40.439557+0000","last_undegraded":"2023-12-24T19:51:40.439557+0000","last_fullsized":"2023-12-24T19:51:40.439557+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:31.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417885+0000","last_change":"2023-12-24T19:51:39.617606+0000","last_active":"2023-12-24T19:51:40.417885+0000","last_peered":"2023-12-24T19:51:40.417885+0000","last_clean":"2023-12-24T19:51:40.417885+0000","last_became_active":"2023-12-24T19:51:39.617301+0000","last_became_peered":"2023-12-24T19:51:39.617301+0000","last_unstale":"2023-12-24T19:51:40.417885+0000","last_undegraded":"2023-12-24T19:51:40.417885+0000","last_fullsized":"2023-12-24T19:51:40.417885+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:14.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.424922+0000","last_change":"2023-12-24T19:51:40.420315+0000","last_active":"2023-12-24T19:51:40.424922+0000","last_peered":"2023-12-24T19:51:40.424922+0000","last_clean":"2023-12-24T19:51:40.424922+0000","last_became_active":"2023-12-24T19:51:40.420004+0000","last_became_peered":"2023-12-24T19:51:40.420004+0000","last_unstale":"2023-12-24T19:51:40.424922+0000","last_undegraded":"2023-12-24T19:51:40.424922+0000","last_fullsized":"2023-12-24T19:51:40.424922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:39.582616+0000","last_clean_scrub_stamp":"2023-12-24T19:51:39.582616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:08.437228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.417154+0000","last_change":"2023-12-24T19:51:39.629519+0000","last_active":"2023-12-24T19:51:40.417154+0000","last_peered":"2023-12-24T19:51:40.417154+0000","last_clean":"2023-12-24T19:51:40.417154+0000","last_became_active":"2023-12-24T19:51:39.629177+0000","last_became_peered":"2023-12-24T19:51:39.629177+0000","last_unstale":"2023-12-24T19:51:40.417154+0000","last_undegraded":"2023-12-24T19:51:40.417154+0000","last_fullsized":"2023-12-24T19:51:40.417154+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:51:38.565555+0000","last_clean_scrub_stamp":"2023-12-24T19:51:38.565555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.109275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":818,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-24T19:51:40.416516+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:51:40.416516+0000","last_peered":"2023-12-24T19:51:40.416516+0000","last_clean":"2023-12-24T19:51:40.416516+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:51:40.416516+0000","last_undegraded":"2023-12-24T19:51:40.416516+0000","last_fullsized":"2023-12-24T19:51:40.416516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072020,"statfs":{"total":96636764160,"available":96329748480,"internally_reserved":0,"allocated":2592768,"data_stored":1619101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":0.90500000000000003}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.2490000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.3320000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.5089999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.379},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575749,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315616,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056224,"statfs":{"total":96636764160,"available":96313573376,"internally_reserved":0,"allocated":1990656,"data_stored":1027751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.3819999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.4330000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.153},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.121}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.077}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.034},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.2410000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.2210000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.333}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.879}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.3959999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.109}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.482}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.371},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.496}]}]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311512,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060328,"statfs":{"total":96636764160,"available":96317775872,"internally_reserved":0,"allocated":1982464,"data_stored":1027107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.254},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.67600000000000005},"max":{"1min":1.4670000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.2789999999999999},"min":{"1min":1.0720000000000001,"5min":0.84099999999999997,"15min":0.58399999999999996},"max":{"1min":1.5509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.165}]},{"osd":1,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.873,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":1.4299999999999999,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.399},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1499999999999999,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.70499999999999996,"15min":0.60199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2529999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3580000000000001,"15min":1.353},"min":{"1min":1.0449999999999999,"5min":0.94899999999999995,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.3440000000000001,"15min":1.3460000000000001},"min":{"1min":1.0149999999999999,"5min":0.77800000000000002,"15min":0.66100000000000003},"max":{"1min":1.706,"5min":1.829,"15min":1.829},"last":1.5409999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":0.92600000000000005,"5min":0.83299999999999996,"15min":0.46400000000000002},"max":{"1min":1.4670000000000001,"5min":1.792,"15min":1.792},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":1.0660000000000001,"5min":0.88400000000000001,"15min":0.63900000000000001},"max":{"1min":1.631,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.631}]},{"osd":5,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.69199999999999995,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":1.599,"5min":1.744,"15min":1.879},"last":1.107},{"interface":"front","average":{"1min":1.266,"5min":1.339,"15min":1.321},"min":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.8779999999999999,"15min":1.9159999999999999},"last":1.51}]},{"osd":6,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.256},"min":{"1min":0.79900000000000004,"5min":0.69399999999999995,"15min":0.56000000000000005},"max":{"1min":1.7350000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.554},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.331,"15min":1.3169999999999999},"min":{"1min":0.93200000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.798,"5min":1.887,"15min":1.887},"last":1.345}]},{"osd":7,"last update":"Sun Dec 24 19:50:49 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2829999999999999,"15min":1.27},"min":{"1min":0.77900000000000003,"5min":0.60699999999999998,"15min":0.54500000000000004},"max":{"1min":1.863,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.367},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4470000000000001,"15min":1.417},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.831,"5min":2,"15min":2},"last":1.6899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575749,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311528,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060312,"statfs":{"total":96636764160,"available":96317759488,"internally_reserved":0,"allocated":1998848,"data_stored":1028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.2210000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.96699999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.0029999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.5740000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.667},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.302}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.486},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.544}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":1027695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":1.456},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.052}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.278}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.139},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.55}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.399},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.6000000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.4850000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.512},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.724}]}]},{"osd":1,"up_from":13,"seq":55834575749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1027177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.68100000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.421,"15min":1.647},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.147,"15min":1.1499999999999999},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.087}]},{"osd":2,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0209999999999999,"15min":0.99399999999999999},"min":{"1min":0.754,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1479999999999999,"15min":1.1220000000000001},"min":{"1min":0.86799999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.034}]},{"osd":3,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.298,"15min":1.2729999999999999},"min":{"1min":0.98699999999999999,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.127,"15min":1.137},"min":{"1min":0.89400000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.823},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.298,"15min":1.282},"min":{"1min":1.083,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.6619999999999999,"5min":1.883,"15min":1.883},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.4370000000000001,"15min":1.4239999999999999},"min":{"1min":1.1859999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.849,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.405,"15min":1.403},"min":{"1min":1.0980000000000001,"5min":1.016,"15min":0.96499999999999997},"max":{"1min":1.7849999999999999,"5min":1.806,"15min":1.948},"last":1.351},{"interface":"front","average":{"1min":1.387,"5min":1.395,"15min":1.3839999999999999},"min":{"1min":1.099,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7909999999999999,"5min":1.843,"15min":2.2189999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.516,"15min":1.506},"min":{"1min":1.1299999999999999,"5min":1.0189999999999999,"15min":1.0089999999999999},"max":{"1min":1.944,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5069999999999999,"15min":1.498},"min":{"1min":1.103,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.9570000000000001,"5min":2.1339999999999999,"15min":2.323},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.554,"15min":1.548},"min":{"1min":1.2849999999999999,"5min":0.999,"15min":0.999},"max":{"1min":2.0840000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5389999999999999,"15min":1.512},"min":{"1min":1.268,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.0009999999999999,"5min":2.532,"15min":2.532},"last":1.7250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575749,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299812,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072028,"statfs":{"total":96636764160,"available":96329756672,"internally_reserved":0,"allocated":2584576,"data_stored":1617531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.363,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.091,"5min":1.046,"15min":1.012},"min":{"1min":0.76100000000000001,"5min":0.50800000000000001,"15min":0.504},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.038}]},{"osd":2,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.071,"15min":1.093},"min":{"1min":0.80400000000000005,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.4690000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.74099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5980000000000001,"5min":1.663,"15min":1.833},"last":1.1379999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.0660000000000001},"min":{"1min":0.83899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5249999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.258,"15min":1.272},"min":{"1min":0.92000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.732,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.401,"15min":1.379},"min":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.88200000000000001},"max":{"1min":1.6299999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.21},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3149999999999999},"min":{"1min":1.008,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.1699999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4350000000000001,"15min":1.4259999999999999},"min":{"1min":1.1699999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.6899999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.4350000000000001,"15min":1.4390000000000001},"min":{"1min":1.123,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7110000000000001,"5min":2.0830000000000002,"15min":2.2989999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.361,"15min":1.3700000000000001},"min":{"1min":1.073,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.677,"5min":1.873,"15min":1.964},"last":1.246},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4830000000000001,"15min":1.4950000000000001},"min":{"1min":1.3009999999999999,"5min":1,"15min":1},"max":{"1min":1.8220000000000001,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.2909999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:50:51 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.514,"15min":1.522},"min":{"1min":1.254,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7470000000000001,"5min":2.46,"15min":2.46},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4650000000000001,"15min":1.4690000000000001},"min":{"1min":1.2649999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9590000000000001,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:51:50.151 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:51:50.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T19:51:50.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.371+0000 7fc9c706b700 1 Processor -- start 2023-12-24T19:51:50.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.371+0000 7fc9c706b700 1 -- start start 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.375+0000 7fc9c706b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0158c40 0x7fc9c00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.375+0000 7fc9c706b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9c00cc780 0x7fc9c00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.375+0000 7fc9c706b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c006a580 con 0x7fc9c006cd40 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.375+0000 7fc9c706b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00cd110 con 0x7fc9c0158c40 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.375+0000 7fc9c706b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c006a7d0 con 0x7fc9c00cc780 2023-12-24T19:51:50.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0158c40 0x7fc9c00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0158c40 0x7fc9c00cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37096/0 (socket says 172.21.15.50:37096) 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 -- 172.21.15.50:0/97487550 learned_addr learned my addr 172.21.15.50:0/97487550 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c686a700 1 --1- 172.21.15.50:0/97487550 >> v1:172.21.15.50:6789/0 conn(0x7fc9c006cd40 0x7fc9c006d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58148/0 (socket says 172.21.15.50:58148) 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c5868700 1 --2- 172.21.15.50:0/97487550 >> v2:172.21.15.82:3300/0 conn(0x7fc9c00cc780 0x7fc9c00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 -- 172.21.15.50:0/97487550 >> v2:172.21.15.82:3300/0 conn(0x7fc9c00cc780 msgr2=0x7fc9c00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 --2- 172.21.15.50:0/97487550 >> v2:172.21.15.82:3300/0 conn(0x7fc9c00cc780 0x7fc9c00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 -- 172.21.15.50:0/97487550 >> v1:172.21.15.50:6789/0 conn(0x7fc9c006cd40 legacy=0x7fc9c006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 -- 172.21.15.50:0/97487550 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c006aab0 con 0x7fc9c0158c40 2023-12-24T19:51:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c6069700 1 --2- 172.21.15.50:0/97487550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c00cf500 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0069010 tx=0x7fc9bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d091883ac2caf87c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c5067700 1 -- 172.21.15.50:0/97487550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc009e70 con 0x7fc9c0158c40 2023-12-24T19:51:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c5067700 1 -- 172.21.15.50:0/97487550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00b860 con 0x7fc9c0158c40 2023-12-24T19:51:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c5067700 1 -- 172.21.15.50:0/97487550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00bc00 con 0x7fc9c0158c40 2023-12-24T19:51:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c706b700 1 -- 172.21.15.50:0/97487550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 msgr2=0x7fc9c00cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.379+0000 7fc9c706b700 1 --2- 172.21.15.50:0/97487550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c00cf500 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0069010 tx=0x7fc9bc009250 comp rx=0 tx=0).stop 2023-12-24T19:51:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 -- 172.21.15.50:0/97487550 shutdown_connections 2023-12-24T19:51:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 --2- 172.21.15.50:0/97487550 >> v2:172.21.15.82:3300/0 conn(0x7fc9c00cc780 0x7fc9c00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 --2- 172.21.15.50:0/97487550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c00cf500 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 -- 172.21.15.50:0/97487550 >> 172.21.15.50:0/97487550 conn(0x7fc9c00d0800 msgr2=0x7fc9c00b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 -- 172.21.15.50:0/97487550 shutdown_connections 2023-12-24T19:51:50.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 -- 172.21.15.50:0/97487550 wait complete. 2023-12-24T19:51:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 Processor -- start 2023-12-24T19:51:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.383+0000 7fc9c706b700 1 -- start start 2023-12-24T19:51:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 0x7fc9c0169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc9c00cc780 0x7fc9c0142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0142d80 con 0x7fc9c0158c40 2023-12-24T19:51:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015ceb0 con 0x7fc9c006cd40 2023-12-24T19:51:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c706b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0169b60 con 0x7fc9c00cc780 2023-12-24T19:51:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c686a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c686a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37112/0 (socket says 172.21.15.50:37112) 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c686a700 1 -- 172.21.15.50:0/1872925913 learned_addr learned my addr 172.21.15.50:0/1872925913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 0x7fc9c0169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c5868700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc9c00cc780 0x7fc9c0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 -- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc9c00cc780 msgr2=0x7fc9c0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc9c00cc780 0x7fc9c0142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 -- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 msgr2=0x7fc9c015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 -- 172.21.15.50:0/1872925913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0094f0 con 0x7fc9c006cd40 2023-12-24T19:51:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c686a700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9c6069700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 0x7fc9c0169ff0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc013000 tx=0x7fc9bc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.387+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc000c90 con 0x7fc9c006cd40 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00b9d0 con 0x7fc9c006cd40 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc025670 con 0x7fc9c006cd40 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c0152590 con 0x7fc9c006cd40 2023-12-24T19:51:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c0169510 con 0x7fc9c006cd40 2023-12-24T19:51:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c004be40 con 0x7fc9c006cd40 2023-12-24T19:51:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.391+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc9bc023070 con 0x7fc9c006cd40 2023-12-24T19:51:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.395+0000 7fc9b67fc700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 0x7fc9a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.395+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fc9bc07df00 con 0x7fc9c006cd40 2023-12-24T19:51:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.395+0000 7fc9c5868700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 0x7fc9a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.395+0000 7fc9c5868700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 0x7fc9a4062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cc6e0 tx=0x7fc9b00091a0 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.403+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc9bc04e1c0 con 0x7fc9c006cd40 2023-12-24T19:51:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.639+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc9c006ad90 con 0x7fc9c006cd40 2023-12-24T19:51:50.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.655+0000 7fc9b67fc700 1 -- 172.21.15.50:0/1872925913 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc9bc0150e0 con 0x7fc9c006cd40 2023-12-24T19:51:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 msgr2=0x7fc9a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 0x7fc9a4062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cc6e0 tx=0x7fc9b00091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 msgr2=0x7fc9c0169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 0x7fc9c0169ff0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc013000 tx=0x7fc9bc017000 comp rx=0 tx=0).stop 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 shutdown_connections 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc9a4060550 0x7fc9a4062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0158c40 0x7fc9c015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc9c00cc780 0x7fc9c0142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 --2- 172.21.15.50:0/1872925913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c006cd40 0x7fc9c0169ff0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 >> 172.21.15.50:0/1872925913 conn(0x7fc9c00d0800 msgr2=0x7fc9c00b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 shutdown_connections 2023-12-24T19:51:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.659+0000 7fc9c706b700 1 -- 172.21.15.50:0/1872925913 wait complete. 2023-12-24T19:51:50.662 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T19:51:50.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.835+0000 7f8a5759e700 1 Processor -- start 2023-12-24T19:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.835+0000 7f8a5759e700 1 -- start start 2023-12-24T19:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5815a2d0 0x7f8a580ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a5806c820 0x7f8a580ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580b0460 con 0x7f8a580adc90 2023-12-24T19:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5806d8c0 con 0x7f8a5806c820 2023-12-24T19:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580afc60 con 0x7f8a5815a2d0 2023-12-24T19:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a5806c820 0x7f8a580ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5815a2d0 0x7f8a580ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a5806c820 0x7f8a580ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37122/0 (socket says 172.21.15.50:37122) 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 -- 172.21.15.50:0/2684072884 learned_addr learned my addr 172.21.15.50:0/2684072884 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a56d9d700 1 --1- 172.21.15.50:0/2684072884 >> v1:172.21.15.82:6789/0 conn(0x7f8a580adc90 0x7f8a580b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40322/0 (socket says 172.21.15.50:40322) 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 -- 172.21.15.50:0/2684072884 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5815a2d0 msgr2=0x7f8a580ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 --2- 172.21.15.50:0/2684072884 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5815a2d0 0x7f8a580ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 -- 172.21.15.50:0/2684072884 >> v1:172.21.15.82:6789/0 conn(0x7f8a580adc90 legacy=0x7f8a580b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 -- 172.21.15.50:0/2684072884 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580ae100 con 0x7f8a5806c820 2023-12-24T19:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a4dd9b700 1 --2- 172.21.15.50:0/2684072884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5806c820 0x7f8a580ad750 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8a400099b0 tx=0x7f8a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17090192c46906c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a55d9b700 1 -- 172.21.15.50:0/2684072884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40009ea0 con 0x7f8a5806c820 2023-12-24T19:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a55d9b700 1 -- 172.21.15.50:0/2684072884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000b860 con 0x7f8a5806c820 2023-12-24T19:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a55d9b700 1 -- 172.21.15.50:0/2684072884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000bc00 con 0x7f8a5806c820 2023-12-24T19:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.839+0000 7f8a5759e700 1 -- 172.21.15.50:0/2684072884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5806c820 msgr2=0x7f8a580ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 --2- 172.21.15.50:0/2684072884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5806c820 0x7f8a580ad750 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8a400099b0 tx=0x7f8a40009250 comp rx=0 tx=0).stop 2023-12-24T19:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 -- 172.21.15.50:0/2684072884 shutdown_connections 2023-12-24T19:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 --2- 172.21.15.50:0/2684072884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5806c820 0x7f8a580ad750 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 --2- 172.21.15.50:0/2684072884 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5815a2d0 0x7f8a580ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 -- 172.21.15.50:0/2684072884 >> 172.21.15.50:0/2684072884 conn(0x7f8a58067b80 msgr2=0x7f8a580cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 -- 172.21.15.50:0/2684072884 shutdown_connections 2023-12-24T19:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.843+0000 7f8a5759e700 1 -- 172.21.15.50:0/2684072884 wait complete. 2023-12-24T19:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 Processor -- start 2023-12-24T19:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- start start 2023-12-24T19:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5806c820 0x7f8a58153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a580adc90 0x7f8a5815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58154450 con 0x7f8a5815a2d0 2023-12-24T19:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58157ec0 con 0x7f8a580adc90 2023-12-24T19:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58158d20 con 0x7f8a5806c820 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37126/0 (socket says 172.21.15.50:37126) 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 -- 172.21.15.50:0/3717933146 learned_addr learned my addr 172.21.15.50:0/3717933146 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a4dd9b700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a580adc90 0x7f8a5815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5659c700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5806c820 0x7f8a58153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 -- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5806c820 msgr2=0x7f8a58153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5806c820 0x7f8a58153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 -- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a580adc90 msgr2=0x7f8a5815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a580adc90 0x7f8a5815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 -- 172.21.15.50:0/3717933146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400094f0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a56d9d700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000cd00 tx=0x7f8a50001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000ce60 con 0x7f8a5815a2d0 2023-12-24T19:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50005df0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5815c0e0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000ab00 con 0x7f8a5815a2d0 2023-12-24T19:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.847+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a581586d0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.851+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58158eb0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.851+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8a500070f0 con 0x7f8a5815a2d0 2023-12-24T19:51:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.855+0000 7f8a4effd700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 0x7f8a38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.855+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f8a5007cb10 con 0x7f8a5815a2d0 2023-12-24T19:51:50.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.855+0000 7f8a5659c700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 0x7f8a38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:50.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.855+0000 7f8a5659c700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 0x7f8a38062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009d10 tx=0x7f8a480091a0 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:50.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:50.863+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8a5004ce10 con 0x7f8a5815a2d0 2023-12-24T19:51:51.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.071+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a580ad600 con 0x7f8a5815a2d0 2023-12-24T19:51:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:51:51.076 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:51:51.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.075+0000 7f8a4effd700 1 -- 172.21.15.50:0/3717933146 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f8a50050430 con 0x7f8a5815a2d0 2023-12-24T19:51:51.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.075+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 msgr2=0x7f8a38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.075+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 0x7f8a38062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009d10 tx=0x7f8a480091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.075+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 msgr2=0x7f8a581591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.075+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000cd00 tx=0x7f8a50001b10 comp rx=0 tx=0).stop 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 shutdown_connections 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8a38060550 0x7f8a38062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5815a2d0 0x7f8a581591b0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a580adc90 0x7f8a5815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 --2- 172.21.15.50:0/3717933146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5806c820 0x7f8a58153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 >> 172.21.15.50:0/3717933146 conn(0x7f8a58067b80 msgr2=0x7f8a58155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 shutdown_connections 2023-12-24T19:51:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.079+0000 7f8a5759e700 1 -- 172.21.15.50:0/3717933146 wait complete. 2023-12-24T19:51:51.081 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:51:51.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:51:40.061618+0000', 'modified': '2023-12-24T19:51:43.639615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8796}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8796': {'gid': 8796, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3634441368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3634441368}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3634441368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:51:51.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:51:51.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T19:51:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 Processor -- start 2023-12-24T19:51:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 -- start start 2023-12-24T19:51:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabe01591d0 0x7fabe006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00cb7f0 con 0x7fabe006c820 2023-12-24T19:51:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00cabe0 con 0x7fabe0158e00 2023-12-24T19:51:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabe5345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe00caec0 con 0x7fabe01591d0 2023-12-24T19:51:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabdf7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabe006c820 0x7fabe006aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58160/0 (socket says 172.21.15.50:58160) 2023-12-24T19:51:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabdf7fe700 1 -- 172.21.15.50:0/4127758537 learned_addr learned my addr 172.21.15.50:0/4127758537 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabd67fc700 1 --2- 172.21.15.50:0/4127758537 >> v2:172.21.15.82:3300/0 conn(0x7fabe01591d0 0x7fabe006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372054983 0 0) 0x7fabe00cb7f0 con 0x7fabe006c820 2023-12-24T19:51:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabcc003570 con 0x7fabe006c820 2023-12-24T19:51:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.675+0000 7fabd67fc700 1 -- 172.21.15.50:0/4127758537 >> v1:172.21.15.82:6789/0 conn(0x7fabe0158e00 legacy=0x7fabe00cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946798253 0 0) 0x7fabcc003570 con 0x7fabe006c820 2023-12-24T19:51:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabd67fc700 1 -- 172.21.15.50:0/4127758537 >> v1:172.21.15.50:6789/0 conn(0x7fabe006c820 legacy=0x7fabe006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabd67fc700 1 -- 172.21.15.50:0/4127758537 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00cb1a0 con 0x7fabe01591d0 2023-12-24T19:51:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabd67fc700 1 --2- 172.21.15.50:0/4127758537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe006a580 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098e0 tx=0x7fabc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31620d33f31a22fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8001470 con 0x7fabe01591d0 2023-12-24T19:51:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8011420 con 0x7fabe01591d0 2023-12-24T19:51:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabde7fc700 1 -- 172.21.15.50:0/4127758537 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80117c0 con 0x7fabe01591d0 2023-12-24T19:51:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 -- 172.21.15.50:0/4127758537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 msgr2=0x7fabe006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 --2- 172.21.15.50:0/4127758537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe006a580 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098e0 tx=0x7fabc80091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 -- 172.21.15.50:0/4127758537 shutdown_connections 2023-12-24T19:51:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 --2- 172.21.15.50:0/4127758537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe006a580 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 -- 172.21.15.50:0/4127758537 >> 172.21.15.50:0/4127758537 conn(0x7fabe0067b80 msgr2=0x7fabe00cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 -- 172.21.15.50:0/4127758537 shutdown_connections 2023-12-24T19:51:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.679+0000 7fabe5345700 1 -- 172.21.15.50:0/4127758537 wait complete. 2023-12-24T19:51:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.683+0000 7fabe5345700 1 Processor -- start 2023-12-24T19:51:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.683+0000 7fabe5345700 1 -- start start 2023-12-24T19:51:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabe0158e00 0x7fabe01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b45f0 con 0x7fabe006c820 2023-12-24T19:51:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b48d0 con 0x7fabe01591d0 2023-12-24T19:51:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b4bb0 con 0x7fabe0158e00 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37134/0 (socket says 172.21.15.50:37134) 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 -- 172.21.15.50:0/533309116 learned_addr learned my addr 172.21.15.50:0/533309116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabd67fc700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabe0158e00 0x7fabe01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 -- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabe0158e00 msgr2=0x7fabe01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabe0158e00 0x7fabe01557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 -- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 msgr2=0x7fabe0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 -- 172.21.15.50:0/533309116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009420 con 0x7fabe006c820 2023-12-24T19:51:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabdeffd700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fabd000cdb0 tx=0x7fabd0001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabd77fe700 1 -- 172.21.15.50:0/533309116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000ab70 con 0x7fabe006c820 2023-12-24T19:51:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabd77fe700 1 -- 172.21.15.50:0/533309116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd000acd0 con 0x7fabe006c820 2023-12-24T19:51:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabd77fe700 1 -- 172.21.15.50:0/533309116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0012670 con 0x7fabe006c820 2023-12-24T19:51:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00b4e90 con 0x7fabe006c820 2023-12-24T19:51:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.687+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe00b3870 con 0x7fabe006c820 2023-12-24T19:51:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.691+0000 7fabd77fe700 1 -- 172.21.15.50:0/533309116 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fabd0012a60 con 0x7fabe006c820 2023-12-24T19:51:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabd77fe700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 0x7fabc0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 Processor -- start 2023-12-24T19:51:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabd77fe700 1 -- 172.21.15.50:0/533309116 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fabd007d2d0 con 0x7fabe006c820 2023-12-24T19:51:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabd67fc700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 0x7fabc0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 -- start start 2023-12-24T19:51:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabd67fc700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 0x7fabc0062a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabc80030c0 tx=0x7fabc8016000 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf3e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6bf30 con 0xcc0ae0 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xe67ed0 con 0xd0b790 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xe2e0b0 con 0xcc0710 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37144/0 (socket says 172.21.15.50:37144) 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 -- 172.21.15.50:0/4282340536 learned_addr learned my addr 172.21.15.50:0/4282340536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabd67fc700 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf3e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 -- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 msgr2=0xf3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 -- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 msgr2=0xf3e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf3e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 -- 172.21.15.50:0/4282340536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd0c9e0 con 0xcc0ae0 2023-12-24T19:51:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.695+0000 7fabdeffd700 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fabd004d710 tx=0x7fabd007b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb9fbb5cf91531d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabbffff700 1 -- 172.21.15.50:0/4282340536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd007d0c0 con 0xcc0ae0 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabbffff700 1 -- 172.21.15.50:0/4282340536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0051950 con 0xcc0ae0 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabbffff700 1 -- 172.21.15.50:0/4282340536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00544a0 con 0xcc0ae0 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- 172.21.15.50:0/4282340536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 msgr2=0xf3df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fabd004d710 tx=0x7fabd007b3e0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- 172.21.15.50:0/4282340536 shutdown_connections 2023-12-24T19:51:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf3e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 --2- 172.21.15.50:0/4282340536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf3df00 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- 172.21.15.50:0/4282340536 >> 172.21.15.50:0/4282340536 conn(0xcc0eb0 msgr2=0xefa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- 172.21.15.50:0/4282340536 shutdown_connections 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- 172.21.15.50:0/4282340536 wait complete. 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 -- start start 2023-12-24T19:51:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.699+0000 7fabe7637740 1 Processor -- start 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf42510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe2dd50 con 0xcc0ae0 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xe06970 con 0xd0b790 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xe676e0 con 0xcc0710 2023-12-24T19:51:51.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 10 client.0 _ll_register_callbacks cb 0xeb16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37148/0 (socket says 172.21.15.50:37148) 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 -- 172.21.15.50:0/3024276983 learned_addr learned my addr 172.21.15.50:0/3024276983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf42510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 -- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 msgr2=0xf42510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf42510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 -- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 msgr2=0xf23cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf23cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 -- 172.21.15.50:0/3024276983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe00b3870 con 0xcc0ae0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabd67fc700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fabc8006dc0 tx=0x7fabc8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f94ba773c8edfd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc802f070 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fabc8036da0 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe06cc0 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc8022070 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 10 client.8940 fetch_fsmap learned FSMap version 78 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0xe36370 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe06cc0 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabc803c020 con 0xcc0ae0 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 10 client.8940 fetch_fsmap finished waiting for FSMap version 78 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 10 client.8940 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T19:51:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 20 client.8940 populate_metadata read hostname 'smithi050' 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xf253c0 0xf4d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 4 client.8940 mds_command: new command op to 8796 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.703+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 --> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe0a3e0 con 0xf253c0 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xf253c0 0xf4d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xf253c0 0xf4d6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef80161146551d5d server_cookie=2f779d7f6e2c7958 in_seq=0 out_seq=0 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabbd7fa700 10 client.8940 ms_handle_connect on v2:172.21.15.50:6834/3634441368 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabbd7fa700 1 -- 172.21.15.50:0/3024276983 <== mds.0 v2:172.21.15.50:6834/3634441368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xe0a3e0 con 0xf253c0 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabbd7fa700 10 client.8940 handle_command_reply: tid=0 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 client.8940 shutdown 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 msgr2=0xf42a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fabc8006dc0 tx=0x7fabc8022000 comp rx=0 tx=0).stop 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 shutdown_connections 2023-12-24T19:51:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xf253c0 0xf4d6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd0b790 0xf23cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xf42a50 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 --2- 172.21.15.50:0/3024276983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xf42510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 >> 172.21.15.50:0/3024276983 conn(0xcc0eb0 msgr2=0xef2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabbd7fa700 0 client.8940 ms_handle_reset on v2:172.21.15.50:6834/3634441368 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 shutdown_connections 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 1 -- 172.21.15.50:0/3024276983 wait complete. 2023-12-24T19:51:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.707+0000 7fabe7637740 20 client.8940 trim_cache size 0 max 16384 2023-12-24T19:51:51.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 Processor -- start 2023-12-24T19:51:51.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 -- start start 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 0xef4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd0b790 0xf21780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6cef0 con 0xcc0ae0 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xe3bf40 con 0xcc0710 2023-12-24T19:51:51.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xe66d60 con 0xd0b790 2023-12-24T19:51:51.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabd67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabd67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37150/0 (socket says 172.21.15.50:37150) 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabd67fc700 1 -- 172.21.15.50:0/3415969608 learned_addr learned my addr 172.21.15.50:0/3415969608 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 0xef4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.727+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd0b790 0xf21780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 -- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd0b790 msgr2=0xf21780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd0b790 0xf21780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 -- 172.21.15.50:0/3415969608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 msgr2=0xef5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 -- 172.21.15.50:0/3415969608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe1cd80 con 0xcc0710 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabd67fc700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:51:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabdeffd700 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 0xef4ad0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fabd000cd80 tx=0x7fabd0066000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bdbb02998a6d8c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabd4ff9700 1 -- 172.21.15.50:0/3415969608 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd007a070 con 0xcc0710 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabd4ff9700 1 -- 172.21.15.50:0/3415969608 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00544a0 con 0xcc0710 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabd4ff9700 1 -- 172.21.15.50:0/3415969608 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00581f0 con 0xcc0710 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 msgr2=0xef4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 0xef4ad0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fabd000cd80 tx=0x7fabd0066000 comp rx=0 tx=0).stop 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- 172.21.15.50:0/3415969608 shutdown_connections 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xd0b790 0xf21780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xcc0ae0 0xef5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 --2- 172.21.15.50:0/3415969608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0710 0xef4ad0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- 172.21.15.50:0/3415969608 >> 172.21.15.50:0/3415969608 conn(0xcc0eb0 msgr2=0xf3d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- 172.21.15.50:0/3415969608 shutdown_connections 2023-12-24T19:51:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- 172.21.15.50:0/3415969608 wait complete. 2023-12-24T19:51:51.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 -- start start 2023-12-24T19:51:51.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.731+0000 7fabe7637740 1 Processor -- start 2023-12-24T19:51:51.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xef3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 0xef74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe63b50 con 0xd0b790 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xd397c0 con 0xcc0ae0 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0xe3fd60 con 0xcc0710 2023-12-24T19:51:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 10 client.0 _ll_register_callbacks cb 0xc8c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37152/0 (socket says 172.21.15.50:37152) 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 -- 172.21.15.50:0/512948087 learned_addr learned my addr 172.21.15.50:0/512948087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdeffd700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xef3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabd67fc700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 0xef74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 -- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 msgr2=0xef3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xef3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 -- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 msgr2=0xef74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 0xef74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 -- 172.21.15.50:0/512948087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe36370 con 0xd0b790 2023-12-24T19:51:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabd67fc700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 0xef74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:51:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabdf7fe700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fabd8017b10 tx=0x7fabd8007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764823219ad60dc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80059d0 con 0xd0b790 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fabd8015b00 con 0xd0b790 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabe0154b00 con 0xd0b790 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabd8015ed0 con 0xd0b790 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 10 client.8946 fetch_fsmap learned FSMap version 78 2023-12-24T19:51:51.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0xd0c9e0 con 0xd0b790 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0154b00 con 0xd0b790 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabd8020440 con 0xd0b790 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 10 client.8946 fetch_fsmap finished waiting for FSMap version 78 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 10 client.8946 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 20 client.8946 populate_metadata read hostname 'smithi050' 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xef7f40 0xf9fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 4 client.8946 mds_command: new command op to 8796 tid=0[{"prefix": "status"}] 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.735+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 --> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fabd0051950 con 0xef7f40 2023-12-24T19:51:51.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabdeffd700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xef7f40 0xf9fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabdeffd700 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xef7f40 0xf9fb30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a157566859d67 server_cookie=4f02b295382bb91 in_seq=0 out_seq=0 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabbd7fa700 10 client.8946 ms_handle_connect on v2:172.21.15.50:6834/3634441368 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabbd7fa700 1 -- 172.21.15.50:0/512948087 <== mds.0 v2:172.21.15.50:6834/3634441368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fabd0051950 con 0xef7f40 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabbd7fa700 10 client.8946 handle_command_reply: tid=0 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 client.8946 shutdown 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 msgr2=0xef7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fabd8017b10 tx=0x7fabd8007040 comp rx=0 tx=0).stop 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 shutdown_connections 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:6834/3634441368,v1:172.21.15.50:6835/3634441368] conn(0xef7f40 0xf9fb30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd0b790 0xef7a00 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xcc0ae0 0xef74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 --2- 172.21.15.50:0/512948087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0xcc0710 0xef3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 >> 172.21.15.50:0/512948087 conn(0xcc0eb0 msgr2=0xf22ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabbd7fa700 0 client.8946 ms_handle_reset on v2:172.21.15.50:6834/3634441368 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 shutdown_connections 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 1 -- 172.21.15.50:0/512948087 wait complete. 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe7637740 20 client.8946 trim_cache size 0 max 16384 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T19:51:51.743 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8796, 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.127536955, 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 78, 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 159, 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 159, 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.004326991999999 2023-12-24T19:51:51.744 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 msgr2=0x7fabc0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 0x7fabc0062a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabc80030c0 tx=0x7fabc8016000 comp rx=0 tx=0).stop 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 msgr2=0x7fabe01479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fabd000cdb0 tx=0x7fabd0001be0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 shutdown_connections 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fabc00605d0 0x7fabc0062a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe01591d0 0x7fabe0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabe0158e00 0x7fabe01557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 --2- 172.21.15.50:0/533309116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c820 0x7fabe01479d0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.739+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 >> 172.21.15.50:0/533309116 conn(0x7fabe0067b80 msgr2=0x7fabe0153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.743+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 shutdown_connections 2023-12-24T19:51:51.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.743+0000 7fabe5345700 1 -- 172.21.15.50:0/533309116 wait complete. 2023-12-24T19:51:51.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:51:51.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 Processor -- start 2023-12-24T19:51:51.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 -- start start 2023-12-24T19:51:51.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f287006aca0 0x7f287006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287006c820 con 0x7f28700c6d00 2023-12-24T19:51:51.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287006b960 con 0x7f2870154b60 2023-12-24T19:51:51.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f2875545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287006bc40 con 0x7f287006aca0 2023-12-24T19:51:51.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.927+0000 7f286e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37160/0 (socket says 172.21.15.50:37160) 2023-12-24T19:51:51.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 -- 172.21.15.50:0/530765024 learned_addr learned my addr 172.21.15.50:0/530765024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286effd700 1 --1- 172.21.15.50:0/530765024 >> v1:172.21.15.50:6789/0 conn(0x7f28700c6d00 0x7f2870154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58168/0 (socket says 172.21.15.50:58168) 2023-12-24T19:51:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286f7fe700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f287006aca0 0x7f287006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 -- 172.21.15.50:0/530765024 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f287006aca0 msgr2=0x7f287006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f287006aca0 0x7f287006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 -- 172.21.15.50:0/530765024 >> v1:172.21.15.50:6789/0 conn(0x7f28700c6d00 legacy=0x7f2870154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 -- 172.21.15.50:0/530765024 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287006bf20 con 0x7f2870154b60 2023-12-24T19:51:51.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286dffb700 1 -- 172.21.15.50:0/530765024 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333022434 0 0) 0x7f287006c820 con 0x7f28700c6d00 2023-12-24T19:51:51.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286e7fc700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2870154b60 0x7f28700c70d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f28640099b0 tx=0x7f2864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df842f3940644de server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286dffb700 1 -- 172.21.15.50:0/530765024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864009ea0 con 0x7f2870154b60 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286dffb700 1 -- 172.21.15.50:0/530765024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400b860 con 0x7f2870154b60 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f286dffb700 1 -- 172.21.15.50:0/530765024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400bc00 con 0x7f2870154b60 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 -- 172.21.15.50:0/530765024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2870154b60 msgr2=0x7f28700c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2870154b60 0x7f28700c70d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f28640099b0 tx=0x7f2864009250 comp rx=0 tx=0).stop 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 -- 172.21.15.50:0/530765024 shutdown_connections 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f287006aca0 0x7f287006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 --2- 172.21.15.50:0/530765024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2870154b60 0x7f28700c70d0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 -- 172.21.15.50:0/530765024 >> 172.21.15.50:0/530765024 conn(0x7f28700cbba0 msgr2=0x7f28700cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:51.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 -- 172.21.15.50:0/530765024 shutdown_connections 2023-12-24T19:51:51.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.931+0000 7f2875545700 1 -- 172.21.15.50:0/530765024 wait complete. 2023-12-24T19:51:51.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 Processor -- start 2023-12-24T19:51:51.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 -- start start 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f28700ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f2870151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701552f0 con 0x7f28700c6d00 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701555d0 con 0x7f287006aca0 2023-12-24T19:51:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f2875545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28701558b0 con 0x7f2870154b60 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37166/0 (socket says 172.21.15.50:37166) 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 -- 172.21.15.50:0/839451435 learned_addr learned my addr 172.21.15.50:0/839451435 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286f7fe700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f2870151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286effd700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f28700ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 -- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 msgr2=0x7f2870151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f2870151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 -- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 msgr2=0x7f28700ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f28700ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.935+0000 7f286e7fc700 1 -- 172.21.15.50:0/839451435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640094f0 con 0x7f28700c6d00 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f286e7fc700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2870069da0 tx=0x7f2864017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400bbe0 con 0x7f28700c6d00 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864011420 con 0x7f28700c6d00 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2870155b90 con 0x7f28700c6d00 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640117c0 con 0x7f28700c6d00 2023-12-24T19:51:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700acca0 con 0x7f28700c6d00 2023-12-24T19:51:51.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.939+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700652e0 con 0x7f28700c6d00 2023-12-24T19:51:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.943+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2864011b70 con 0x7f28700c6d00 2023-12-24T19:51:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.943+0000 7f2856ffd700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 0x7f285c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.943+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f286407e470 con 0x7f28700c6d00 2023-12-24T19:51:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.943+0000 7f286effd700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 0x7f285c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:51.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.943+0000 7f286effd700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 0x7f285c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28600011e0 tx=0x7f2860007bf0 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:51.947+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f286404e6f0 con 0x7f28700c6d00 2023-12-24T19:51:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.159+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f287006c200 con 0x7f28700c6d00 2023-12-24T19:51:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.159+0000 7f2856ffd700 1 -- 172.21.15.50:0/839451435 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2864051d10 con 0x7f28700c6d00 2023-12-24T19:51:52.161 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 msgr2=0x7f285c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 0x7f285c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28600011e0 tx=0x7f2860007bf0 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 msgr2=0x7f2870156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2870069da0 tx=0x7f2864017000 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 shutdown_connections 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f285c060550 0x7f285c062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2870154b60 0x7f2870151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28700c6d00 0x7f2870156d60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 --2- 172.21.15.50:0/839451435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f287006aca0 0x7f28700ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 >> 172.21.15.50:0/839451435 conn(0x7f28700cbba0 msgr2=0x7f28701525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 shutdown_connections 2023-12-24T19:51:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:52.163+0000 7f2875545700 1 -- 172.21.15.50:0/839451435 wait complete. 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T19:51:52.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:51:52.189 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:51:52.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.189 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T19:51:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:51:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:51:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:51:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 37898sec preferred_lft 37898sec 2023-12-24T19:51:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.204 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T19:51:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:51:52.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.206 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:51:52.289 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T19:51:52.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.293 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T19:51:52.355 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:51:52.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.356 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T19:51:52.356 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T19:51:52.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T19:51:52.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T19:51:52.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T19:51:52.357 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T19:51:52.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.494 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T19:51:52.511 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:51:52.512 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T19:51:52.512 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:51:52.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T19:51:52.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:51:52.591 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:51:52.657 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:51:52.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:51:52.658 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:51:52.721 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T19:51:52.721 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:51:52.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:51:52.843 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:51:52.843 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T19:51:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:51:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T19:51:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T19:51:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T19:51:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T19:51:52.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T19:51:52.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:51:52.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:51:52.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T19:51:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 Processor -- start 2023-12-24T19:51:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 -- start start 2023-12-24T19:51:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6e40ce750 0x7fd6e40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6e406ae30 0x7fd6e406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e415a580 con 0x7fd6e4159a20 2023-12-24T19:51:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e406b7e0 con 0x7fd6e406ae30 2023-12-24T19:51:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ebef0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e406ba80 con 0x7fd6e40ce750 2023-12-24T19:51:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6e948b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6e406ae30 0x7fd6e406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ea48d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6e4159a20 0x7fd6e4159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58184/0 (socket says 172.21.15.50:58184) 2023-12-24T19:51:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.115+0000 7fd6ea48d700 1 -- 172.21.15.50:0/1096664088 learned_addr learned my addr 172.21.15.50:0/1096664088 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e9c8c700 1 --2- 172.21.15.50:0/1096664088 >> v2:172.21.15.82:3300/0 conn(0x7fd6e40ce750 0x7fd6e40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e8c8a700 1 -- 172.21.15.50:0/1096664088 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597719358 0 0) 0x7fd6e415a580 con 0x7fd6e4159a20 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e8c8a700 1 -- 172.21.15.50:0/1096664088 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d0003570 con 0x7fd6e4159a20 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e948b700 1 -- 172.21.15.50:0/1096664088 >> v2:172.21.15.82:3300/0 conn(0x7fd6e40ce750 msgr2=0x7fd6e40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e948b700 1 --2- 172.21.15.50:0/1096664088 >> v2:172.21.15.82:3300/0 conn(0x7fd6e40ce750 0x7fd6e40ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e948b700 1 -- 172.21.15.50:0/1096664088 >> v1:172.21.15.50:6789/0 conn(0x7fd6e4159a20 legacy=0x7fd6e4159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e948b700 1 -- 172.21.15.50:0/1096664088 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e406bd60 con 0x7fd6e406ae30 2023-12-24T19:51:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e948b700 1 --2- 172.21.15.50:0/1096664088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e406ae30 0x7fd6e406b2a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40cda50 tx=0x7fd6d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8efd8e93158017b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e8c8a700 1 -- 172.21.15.50:0/1096664088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4011630 con 0x7fd6e406ae30 2023-12-24T19:51:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e8c8a700 1 -- 172.21.15.50:0/1096664088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40117b0 con 0x7fd6e406ae30 2023-12-24T19:51:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6e8c8a700 1 -- 172.21.15.50:0/1096664088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4011b70 con 0x7fd6e406ae30 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 -- 172.21.15.50:0/1096664088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e406ae30 msgr2=0x7fd6e406b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/1096664088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e406ae30 0x7fd6e406b2a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40cda50 tx=0x7fd6d40091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 -- 172.21.15.50:0/1096664088 shutdown_connections 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/1096664088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e406ae30 0x7fd6e406b2a0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/1096664088 >> v2:172.21.15.82:3300/0 conn(0x7fd6e40ce750 0x7fd6e40ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 -- 172.21.15.50:0/1096664088 >> 172.21.15.50:0/1096664088 conn(0x7fd6e40cffb0 msgr2=0x7fd6e40d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 -- 172.21.15.50:0/1096664088 shutdown_connections 2023-12-24T19:51:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.119+0000 7fd6ebef0700 1 -- 172.21.15.50:0/1096664088 wait complete. 2023-12-24T19:51:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 Processor -- start 2023-12-24T19:51:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 -- start start 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6e406ae30 0x7fd6e413a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6e4159a20 0x7fd6e415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e416a430 con 0x7fd6e40ce750 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e413aa50 con 0x7fd6e4159a20 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6ebef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41698b0 con 0x7fd6e406ae30 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.123+0000 7fd6e948b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37188/0 (socket says 172.21.15.50:37188) 2023-12-24T19:51:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 -- 172.21.15.50:0/3763495964 learned_addr learned my addr 172.21.15.50:0/3763495964 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e9c8c700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6e406ae30 0x7fd6e413a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6ea48d700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6e4159a20 0x7fd6e415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 -- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6e406ae30 msgr2=0x7fd6e413a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6e406ae30 0x7fd6e413a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 -- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6e4159a20 msgr2=0x7fd6e415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6e4159a20 0x7fd6e415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 -- 172.21.15.50:0/3763495964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009420 con 0x7fd6e40ce750 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6e948b700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4013000 tx=0x7fd6d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d401f070 con 0x7fd6e40ce750 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d4000c90 con 0x7fd6e40ce750 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4011b50 con 0x7fd6e40ce750 2023-12-24T19:51:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e4169b90 con 0x7fd6e40ce750 2023-12-24T19:51:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e416a150 con 0x7fd6e40ce750 2023-12-24T19:51:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.127+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e40652e0 con 0x7fd6e40ce750 2023-12-24T19:51:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.131+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd6d4023070 con 0x7fd6e40ce750 2023-12-24T19:51:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.131+0000 7fd6d9ffb700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 0x7fd6c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.131+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fd6d407df60 con 0x7fd6e40ce750 2023-12-24T19:51:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.131+0000 7fd6e9c8c700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 0x7fd6c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.135+0000 7fd6e9c8c700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 0x7fd6c8062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009d40 tx=0x7fd6e0008040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.139+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6d404e1e0 con 0x7fd6e40ce750 2023-12-24T19:51:53.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.331+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6e406c040 con 0x7fd6c8060550 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6d9ffb700 1 -- 172.21.15.50:0/3763495964 <== mgr.8595 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd6e406c040 con 0x7fd6c8060550 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:51:53.335 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T19:51:53.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 msgr2=0x7fd6c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 0x7fd6c8062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009d40 tx=0x7fd6e0008040 comp rx=0 tx=0).stop 2023-12-24T19:51:53.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 msgr2=0x7fd6e41532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4013000 tx=0x7fd6d4017000 comp rx=0 tx=0).stop 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 shutdown_connections 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd6c8060550 0x7fd6c8062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6e4159a20 0x7fd6e415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40ce750 0x7fd6e41532b0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 --2- 172.21.15.50:0/3763495964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6e406ae30 0x7fd6e413a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 >> 172.21.15.50:0/3763495964 conn(0x7fd6e40cffb0 msgr2=0x7fd6e415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 shutdown_connections 2023-12-24T19:51:53.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.335+0000 7fd6ebef0700 1 -- 172.21.15.50:0/3763495964 wait complete. 2023-12-24T19:51:53.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T19:51:53.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.523+0000 7f994e678700 1 Processor -- start 2023-12-24T19:51:53.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.523+0000 7f994e678700 1 -- start start 2023-12-24T19:51:53.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f994813f900 0x7f994806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480c93e0 con 0x7f99480adbe0 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480ca220 con 0x7f994813f530 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99480c9610 con 0x7f994813f900 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f994813f900 0x7f994806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994cc15700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99480adbe0 0x7f99480ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58196/0 (socket says 172.21.15.50:58196) 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f994813f900 0x7f994806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37198/0 (socket says 172.21.15.50:37198) 2023-12-24T19:51:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994cc15700 1 -- 172.21.15.50:0/2911850387 learned_addr learned my addr 172.21.15.50:0/2911850387 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:53.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 -- 172.21.15.50:0/2911850387 >> v1:172.21.15.82:6789/0 conn(0x7f994813f530 legacy=0x7f99480ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 -- 172.21.15.50:0/2911850387 >> v1:172.21.15.50:6789/0 conn(0x7f99480adbe0 legacy=0x7f99480ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 -- 172.21.15.50:0/2911850387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99480c98f0 con 0x7f994813f900 2023-12-24T19:51:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f99477fe700 1 --2- 172.21.15.50:0/2911850387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f994806d700 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854dac80c7bbf2ec server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f9946ffd700 1 -- 172.21.15.50:0/2911850387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c009e80 con 0x7f994813f900 2023-12-24T19:51:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f9946ffd700 1 -- 172.21.15.50:0/2911850387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00b860 con 0x7f994813f900 2023-12-24T19:51:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f9946ffd700 1 -- 172.21.15.50:0/2911850387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bbe0 con 0x7f994813f900 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- 172.21.15.50:0/2911850387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 msgr2=0x7f994806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 --2- 172.21.15.50:0/2911850387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f994806d700 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- 172.21.15.50:0/2911850387 shutdown_connections 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 --2- 172.21.15.50:0/2911850387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f994806d700 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.527+0000 7f994e678700 1 -- 172.21.15.50:0/2911850387 >> 172.21.15.50:0/2911850387 conn(0x7f9948067b80 msgr2=0x7f99480cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- 172.21.15.50:0/2911850387 shutdown_connections 2023-12-24T19:51:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- 172.21.15.50:0/2911850387 wait complete. 2023-12-24T19:51:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 Processor -- start 2023-12-24T19:51:53.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- start start 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99480adbe0 0x7f9948159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f994813f530 0x7f99481577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480aecb0 con 0x7f994813f900 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99481587d0 con 0x7f99480adbe0 2023-12-24T19:51:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994e678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9948157d00 con 0x7f994813f530 2023-12-24T19:51:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994cc15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994cc15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37210/0 (socket says 172.21.15.50:37210) 2023-12-24T19:51:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.531+0000 7f994cc15700 1 -- 172.21.15.50:0/3406019077 learned_addr learned my addr 172.21.15.50:0/3406019077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f9947fff700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99480adbe0 0x7f9948159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f99477fe700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f994813f530 0x7f99481577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 -- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f994813f530 msgr2=0x7f99481577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f994813f530 0x7f99481577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 -- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99480adbe0 msgr2=0x7f9948159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99480adbe0 0x7f9948159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 -- 172.21.15.50:0/3406019077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009420 con 0x7f994813f900 2023-12-24T19:51:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994cc15700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f994000cca0 tx=0x7f99400019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000ce50 con 0x7f994813f900 2023-12-24T19:51:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000ab30 con 0x7f994813f900 2023-12-24T19:51:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400070f0 con 0x7f994813f900 2023-12-24T19:51:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99480ac180 con 0x7f994813f900 2023-12-24T19:51:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9948158210 con 0x7f994813f900 2023-12-24T19:51:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.535+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99480aea80 con 0x7f994813f900 2023-12-24T19:51:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.539+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 78) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f99400074e0 con 0x7f994813f900 2023-12-24T19:51:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.539+0000 7f992ffff700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 0x7f9934062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.539+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f994007ce40 con 0x7f994813f900 2023-12-24T19:51:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.539+0000 7f9947fff700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 0x7f9934062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.539+0000 7f9947fff700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 0x7f9934062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9938003860 tx=0x7f9938009040 comp rx=0 tx=0).ready entity=mgr.8595 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:53.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.543+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99480aea80 con 0x7f994813f900 2023-12-24T19:51:53.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:53.755+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f99480aea80 con 0x7f994813f900 2023-12-24T19:51:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.631+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 79) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f994004d5b0 con 0x7f994813f900 2023-12-24T19:51:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f992ffff700 1 -- 172.21.15.50:0/3406019077 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v79) v1 ==== 92+0+0 (secure 0 0 0) 0x7f9940048b40 con 0x7f994813f900 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 msgr2=0x7f9934062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 0x7f9934062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9938003860 tx=0x7f9938009040 comp rx=0 tx=0).stop 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 msgr2=0x7f99480abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f994000cca0 tx=0x7f99400019f0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 shutdown_connections 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9934060550 0x7f9934062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f994813f900 0x7f99480abc40 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f994813f530 0x7f99481577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 --2- 172.21.15.50:0/3406019077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99480adbe0 0x7f9948159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 >> 172.21.15.50:0/3406019077 conn(0x7f9948067b80 msgr2=0x7f99480ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.635+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 shutdown_connections 2023-12-24T19:51:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.639+0000 7f994e678700 1 -- 172.21.15.50:0/3406019077 wait complete. 2023-12-24T19:51:54.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T19:51:54.823 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:54.817+0000 7f1d262e2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:51:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.827+0000 7fb61ece3700 1 Processor -- start 2023-12-24T19:51:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.827+0000 7fb61ece3700 1 -- start start 2023-12-24T19:51:54.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61ece3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6180cc780 0x7fb6180ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61ece3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb61806cd40 0x7fb61806d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61ece3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61806a580 con 0x7fb618158c40 2023-12-24T19:51:54.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61ece3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180cd110 con 0x7fb61806cd40 2023-12-24T19:51:54.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61ece3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61806a7d0 con 0x7fb6180cc780 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb61806cd40 0x7fb61806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb61806cd40 0x7fb61806d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37236/0 (socket says 172.21.15.50:37236) 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 -- 172.21.15.50:0/2550509097 learned_addr learned my addr 172.21.15.50:0/2550509097 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61d4e0700 1 --2- 172.21.15.50:0/2550509097 >> v2:172.21.15.82:3300/0 conn(0x7fb6180cc780 0x7fb6180ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 -- 172.21.15.50:0/2550509097 >> v2:172.21.15.82:3300/0 conn(0x7fb6180cc780 msgr2=0x7fb6180ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 --2- 172.21.15.50:0/2550509097 >> v2:172.21.15.82:3300/0 conn(0x7fb6180cc780 0x7fb6180ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 -- 172.21.15.50:0/2550509097 >> v1:172.21.15.82:6789/0 conn(0x7fb618158c40 legacy=0x7fb6180cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 -- 172.21.15.50:0/2550509097 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61806aab0 con 0x7fb61806cd40 2023-12-24T19:51:54.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.831+0000 7fb61e4e2700 1 --2- 172.21.15.50:0/2550509097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61806cd40 0x7fb61806d180 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fb618069010 tx=0x7fb610009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db218325fdcfcc3f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:54.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ccdf700 1 -- 172.21.15.50:0/2550509097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000e070 con 0x7fb61806cd40 2023-12-24T19:51:54.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ccdf700 1 -- 172.21.15.50:0/2550509097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000ba20 con 0x7fb61806cd40 2023-12-24T19:51:54.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ccdf700 1 -- 172.21.15.50:0/2550509097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100092e0 con 0x7fb61806cd40 2023-12-24T19:51:54.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 -- 172.21.15.50:0/2550509097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61806cd40 msgr2=0x7fb61806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 --2- 172.21.15.50:0/2550509097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61806cd40 0x7fb61806d180 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fb618069010 tx=0x7fb610009840 comp rx=0 tx=0).stop 2023-12-24T19:51:54.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 -- 172.21.15.50:0/2550509097 shutdown_connections 2023-12-24T19:51:54.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 --2- 172.21.15.50:0/2550509097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61806cd40 0x7fb61806d180 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 --2- 172.21.15.50:0/2550509097 >> v2:172.21.15.82:3300/0 conn(0x7fb6180cc780 0x7fb6180ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 -- 172.21.15.50:0/2550509097 >> 172.21.15.50:0/2550509097 conn(0x7fb6180d0800 msgr2=0x7fb6180b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:54.837 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fd2989ce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:51:54.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 -- 172.21.15.50:0/2550509097 shutdown_connections 2023-12-24T19:51:54.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 -- 172.21.15.50:0/2550509097 wait complete. 2023-12-24T19:51:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.835+0000 7fb61ece3700 1 Processor -- start 2023-12-24T19:51:54.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 -- start start 2023-12-24T19:51:54.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61806cd40 0x7fb61815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6180cc780 0x7fb6181599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618159f10 con 0x7fb618158c40 2023-12-24T19:51:54.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61815ad30 con 0x7fb61806cd40 2023-12-24T19:51:54.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61815b700 con 0x7fb6180cc780 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37242/0 (socket says 172.21.15.50:37242) 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 -- 172.21.15.50:0/3577639944 learned_addr learned my addr 172.21.15.50:0/3577639944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61d4e0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6180cc780 0x7fb6181599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61dce1700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61806cd40 0x7fb61815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 -- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6180cc780 msgr2=0x7fb6181599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6180cc780 0x7fb6181599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 -- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61806cd40 msgr2=0x7fb61815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61806cd40 0x7fb61815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:54.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 -- 172.21.15.50:0/3577639944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009ae0 con 0x7fb618158c40 2023-12-24T19:51:54.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61e4e2700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fb6100072f0 tx=0x7fb610018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:54.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610008b00 con 0x7fb618158c40 2023-12-24T19:51:54.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610008c60 con 0x7fb618158c40 2023-12-24T19:51:54.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61815a120 con 0x7fb618158c40 2023-12-24T19:51:54.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.839+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610026460 con 0x7fb618158c40 2023-12-24T19:51:54.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.843+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61815a6e0 con 0x7fb618158c40 2023-12-24T19:51:54.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.843+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61815aee0 con 0x7fb618158c40 2023-12-24T19:51:54.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.843+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 79) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fb610003040 con 0x7fb618158c40 2023-12-24T19:51:54.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.847+0000 7fb60dffb700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 0x7fb5fc062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:54.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.847+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fb61007ea00 con 0x7fb618158c40 2023-12-24T19:51:54.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.847+0000 7fb61dce1700 1 -- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 msgr2=0x7fb5fc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:54.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.847+0000 7fb61dce1700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 0x7fb5fc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:54.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:54.851+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb61815aee0 con 0x7fb618158c40 2023-12-24T19:51:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.030+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb61815aea0 con 0x7fb618158c40 2023-12-24T19:51:55.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.038+0000 7fb60dffb700 1 -- 172.21.15.50:0/3577639944 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb61004ec80 con 0x7fb618158c40 2023-12-24T19:51:55.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 msgr2=0x7fb5fc062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:55.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 0x7fb5fc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 msgr2=0x7fb61815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fb6100072f0 tx=0x7fb610018000 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 shutdown_connections 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb5fc0605a0 0x7fb5fc062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb618158c40 0x7fb61815b1c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6180cc780 0x7fb6181599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 --2- 172.21.15.50:0/3577639944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61806cd40 0x7fb61815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 >> 172.21.15.50:0/3577639944 conn(0x7fb6180d0800 msgr2=0x7fb6181545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 shutdown_connections 2023-12-24T19:51:55.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.046+0000 7fb61ece3700 1 -- 172.21.15.50:0/3577639944 wait complete. 2023-12-24T19:51:55.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T19:51:55.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 Processor -- start 2023-12-24T19:51:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 -- start start 2023-12-24T19:51:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ef01404a0 0x7f1ef015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef015af50 0x7f1ef00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef006ccc0 con 0x7f1ef0140870 2023-12-24T19:51:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef015b990 con 0x7f1ef01404a0 2023-12-24T19:51:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.234+0000 7f1ef5cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015b3d0 con 0x7f1ef015af50 2023-12-24T19:51:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ef01404a0 0x7f1ef015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eeffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ef0140870 0x7f1ef006d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40352/0 (socket says 172.21.15.50:40352) 2023-12-24T19:51:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eeffff700 1 -- 172.21.15.50:0/4201408779 learned_addr learned my addr 172.21.15.50:0/4201408779 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eeeffd700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef015af50 0x7f1ef00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 -- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef015af50 msgr2=0x7f1ef00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef015af50 0x7f1ef00ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 -- 172.21.15.50:0/4201408779 >> v1:172.21.15.82:6789/0 conn(0x7f1ef0140870 legacy=0x7f1ef006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 -- 172.21.15.50:0/4201408779 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef015b6b0 con 0x7f1ef01404a0 2023-12-24T19:51:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef01404a0 0x7f1ef015aa10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00098e0 tx=0x7f1ee00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98cbf8018ae0dd35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eee7fc700 1 -- 172.21.15.50:0/4201408779 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000b640 con 0x7f1ef01404a0 2023-12-24T19:51:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eee7fc700 1 -- 172.21.15.50:0/4201408779 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee000b7a0 con 0x7f1ef01404a0 2023-12-24T19:51:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1eee7fc700 1 -- 172.21.15.50:0/4201408779 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000bb40 con 0x7f1ef01404a0 2023-12-24T19:51:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 -- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef01404a0 msgr2=0x7f1ef015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef01404a0 0x7f1ef015aa10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00098e0 tx=0x7f1ee00091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 -- 172.21.15.50:0/4201408779 shutdown_connections 2023-12-24T19:51:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef015af50 0x7f1ef00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/4201408779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef01404a0 0x7f1ef015aa10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 -- 172.21.15.50:0/4201408779 >> 172.21.15.50:0/4201408779 conn(0x7f1ef0067b80 msgr2=0x7f1ef00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 -- 172.21.15.50:0/4201408779 shutdown_connections 2023-12-24T19:51:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.238+0000 7f1ef5cae700 1 -- 172.21.15.50:0/4201408779 wait complete. 2023-12-24T19:51:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 Processor -- start 2023-12-24T19:51:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 -- start start 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef0140870 0x7f1ef013c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef00a7000 0x7f1ef00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00a8160 con 0x7f1ef01404a0 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00ab450 con 0x7f1ef00a7000 2023-12-24T19:51:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1ef5cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef013cad0 con 0x7f1ef0140870 2023-12-24T19:51:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37256/0 (socket says 172.21.15.50:37256) 2023-12-24T19:51:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1eef7fe700 1 -- 172.21.15.50:0/2220193493 learned_addr learned my addr 172.21.15.50:0/2220193493 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1eeeffd700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef0140870 0x7f1ef013c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.242+0000 7f1eeffff700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef00a7000 0x7f1ef00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef0140870 msgr2=0x7f1ef013c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef0140870 0x7f1ef013c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef00a7000 msgr2=0x7f1ef00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef00a7000 0x7f1ef00b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 -- 172.21.15.50:0/2220193493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0009420 con 0x7f1ef01404a0 2023-12-24T19:51:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0069b20 tx=0x7f1ee0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee001bc40 con 0x7f1ef01404a0 2023-12-24T19:51:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee001bdc0 con 0x7f1ef01404a0 2023-12-24T19:51:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011670 con 0x7f1ef01404a0 2023-12-24T19:51:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef00a7550 con 0x7f1ef01404a0 2023-12-24T19:51:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef00a7b10 con 0x7f1ef01404a0 2023-12-24T19:51:55.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.246+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef00652e0 con 0x7f1ef01404a0 2023-12-24T19:51:55.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.250+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 79) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f1ee0011a20 con 0x7f1ef01404a0 2023-12-24T19:51:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.250+0000 7f1ed77fe700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 0x7f1edc062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.250+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1ee007e100 con 0x7f1ef01404a0 2023-12-24T19:51:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.250+0000 7f1eeeffd700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 msgr2=0x7f1edc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.250+0000 7f1eeeffd700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 0x7f1edc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.258+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ee004e380 con 0x7f1ef01404a0 2023-12-24T19:51:55.373 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:55.365+0000 7f1d262e2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:51:55.432 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:55.430+0000 7fd2989ce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:51:55.448 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:55.441+0000 7f1d262e2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:51:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.454+0000 7f1eeeffd700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 msgr2=0x7f1edc062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.454+0000 7f1eeeffd700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 0x7f1edc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.478+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f1ef006c950 con 0x7f1ef01404a0 2023-12-24T19:51:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.490+0000 7f1ed77fe700 1 -- 172.21.15.50:0/2220193493 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1ee00519a0 con 0x7f1ef01404a0 2023-12-24T19:51:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 msgr2=0x7f1edc062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 0x7f1edc062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 msgr2=0x7f1ef00a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0069b20 tx=0x7f1ee0017000 comp rx=0 tx=0).stop 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 shutdown_connections 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1edc0605a0 0x7f1edc062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef00a7000 0x7f1ef00b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ef0140870 0x7f1ef013c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 --2- 172.21.15.50:0/2220193493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef01404a0 0x7f1ef00a6870 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 >> 172.21.15.50:0/2220193493 conn(0x7f1ef0067b80 msgr2=0x7f1ef013f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 shutdown_connections 2023-12-24T19:51:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.494+0000 7f1ef5cae700 1 -- 172.21.15.50:0/2220193493 wait complete. 2023-12-24T19:51:55.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:51:55.515 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T19:51:55.538 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:55.534+0000 7fd2989ce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:51:55.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-12-24T19:51:55.591 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:55.585+0000 7f1d262e2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:55.703 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:55.698+0000 7fd2989ce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.758+0000 7fbbae678700 1 Processor -- start 2023-12-24T19:51:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.758+0000 7fbbae678700 1 -- start start 2023-12-24T19:51:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbae678700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba815c7a0 0x7fbba815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbae678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbae678700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba806b6b0 con 0x7fbba815c3d0 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbae678700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba806c250 con 0x7fbba815c7a0 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbae678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80cba20 con 0x7fbba80cb2b0 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbba77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba815c7a0 0x7fbba815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbba7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbba815c3d0 0x7fbba806bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58208/0 (socket says 172.21.15.50:58208) 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbba7fff700 1 -- 172.21.15.50:0/899550152 learned_addr learned my addr 172.21.15.50:0/899550152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbba77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba815c7a0 0x7fbba815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37270/0 (socket says 172.21.15.50:37270) 2023-12-24T19:51:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.762+0000 7fbbacc15700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba77fe700 1 -- 172.21.15.50:0/899550152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 msgr2=0x7fbba80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba77fe700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba80cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba6ffd700 1 -- 172.21.15.50:0/899550152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778040169 0 0) 0x7fbba806b6b0 con 0x7fbba815c3d0 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba77fe700 1 -- 172.21.15.50:0/899550152 >> v1:172.21.15.50:6789/0 conn(0x7fbba815c3d0 legacy=0x7fbba806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba77fe700 1 -- 172.21.15.50:0/899550152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba806ad80 con 0x7fbba815c7a0 2023-12-24T19:51:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba77fe700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c7a0 0x7fbba815d810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df64497ae4edbb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba6ffd700 1 -- 172.21.15.50:0/899550152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00b640 con 0x7fbba815c7a0 2023-12-24T19:51:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba6ffd700 1 -- 172.21.15.50:0/899550152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00b7a0 con 0x7fbba815c7a0 2023-12-24T19:51:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbba6ffd700 1 -- 172.21.15.50:0/899550152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00bb40 con 0x7fbba815c7a0 2023-12-24T19:51:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 -- 172.21.15.50:0/899550152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c7a0 msgr2=0x7fbba815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c7a0 0x7fbba815d810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 -- 172.21.15.50:0/899550152 shutdown_connections 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba80cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 --2- 172.21.15.50:0/899550152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c7a0 0x7fbba815d810 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 -- 172.21.15.50:0/899550152 >> 172.21.15.50:0/899550152 conn(0x7fbba80670b0 msgr2=0x7fbba80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 -- 172.21.15.50:0/899550152 shutdown_connections 2023-12-24T19:51:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.766+0000 7fbbae678700 1 -- 172.21.15.50:0/899550152 wait complete. 2023-12-24T19:51:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.770+0000 7fbbae678700 1 Processor -- start 2023-12-24T19:51:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.770+0000 7fbbae678700 1 -- start start 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba81568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 0x7fbba80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 0x7fbba806c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b5b00 con 0x7fbba815c3d0 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8156e30 con 0x7fbba815c7a0 2023-12-24T19:51:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b4ef0 con 0x7fbba80cb2b0 2023-12-24T19:51:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba81568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba81568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43290/0 (socket says 172.21.15.50:43290) 2023-12-24T19:51:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 learned_addr learned my addr 172.21.15.50:0/3456765621 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:51:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 0x7fbba80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbacc15700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 0x7fbba806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 msgr2=0x7fbba81568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba81568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 msgr2=0x7fbba806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 0x7fbba806c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009420 con 0x7fbba815c3d0 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbacc15700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 0x7fbba806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbba77fe700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 0x7fbba80c6780 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c016000 tx=0x7fbb9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:51:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00bb20 con 0x7fbba815c3d0 2023-12-24T19:51:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c024430 con 0x7fbba815c3d0 2023-12-24T19:51:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba80b51d0 con 0x7fbba815c3d0 2023-12-24T19:51:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0247f0 con 0x7fbba815c3d0 2023-12-24T19:51:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.774+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba80b5790 con 0x7fbba815c3d0 2023-12-24T19:51:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba80b5c70 con 0x7fbba815c3d0 2023-12-24T19:51:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 79) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fbb9c011420 con 0x7fbba815c3d0 2023-12-24T19:51:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbb8ffff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:51:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fbb9c07e5f0 con 0x7fbba815c3d0 2023-12-24T19:51:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.778+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:51:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.786+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb9c04e870 con 0x7fbba815c3d0 2023-12-24T19:51:55.872 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:55.865+0000 7f1d262e2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:51:55.949 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:55.941+0000 7f1d262e2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.978+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fbba8071060 con 0x7fbb940605a0 2023-12-24T19:51:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.982+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:55.982+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:51:55.986 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:55.982+0000 7fd2989ce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:51:56.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:56.058+0000 7fd2989ce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:56.169 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:56.161+0000 7f1d262e2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:51:56.252 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:56.245+0000 7f1d262e2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:51:56.303 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:56.298+0000 7fd2989ce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:51:56.347 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:56.341+0000 7f1d262e2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:51:56.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:56.386+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:56.386+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T19:51:56.389 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:56.386+0000 7fd2989ce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:51:56.484 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:56.482+0000 7fd2989ce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:51:56.757 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:56.753+0000 7f1d262e2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:51:56.893 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:56.890+0000 7fd2989ce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:51:56.934 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:56.929+0000 7f1d262e2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:51:57.066 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.062+0000 7fd2989ce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:51:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:57.190+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:57.190+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T19:51:57.312 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:57.305+0000 7f1d262e2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:51:57.451 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.446+0000 7fd2989ce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:51:57.537 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:57.529+0000 7f1d262e2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:57.630 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:57.625+0000 7f1d262e2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:51:57.681 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.678+0000 7fd2989ce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:51:57.701 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:57.697+0000 7f1d262e2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:51:57.778 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.774+0000 7fd2989ce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:51:57.785 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:57.781+0000 7f1d262e2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:51:57.858 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.854+0000 7fd2989ce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:51:57.940 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:57.938+0000 7fd2989ce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:51:58.005 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:58.001+0000 7f1d262e2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:58.078 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:58.073+0000 7f1d262e2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:51:58.157 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:58.154+0000 7fd2989ce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:51:58.169 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:58.161+0000 7f1d262e2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:51:58.241 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:58.238+0000 7fd2989ce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:51:58.327 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:58.326+0000 7fd2989ce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:51:58.355 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:58.349+0000 7f1d262e2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:51:58.438 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:58.433+0000 7f1d262e2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:51:58.524 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:58.522+0000 7fd2989ce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:51:58.608 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:58.606+0000 7fd2989ce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:51:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:58.794+0000 7fbba7fff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:51:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:58.794+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T19:51:59.141 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:51:59.133+0000 7f1d262e2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:51:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:59.206+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 80) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fbb9c04ec40 con 0x7fbba815c3d0 2023-12-24T19:51:59.342 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.338+0000 7fd2989ce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:51:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:59.354+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 81) v1 ==== 79689+0+0 (secure 0 0 0) 0x7fbb9c06b980 con 0x7fbba815c3d0 2023-12-24T19:51:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:59.358+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb94062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:51:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:51:59.358+0000 7fbb8ffff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb94062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:51:59.550 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd259559700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.550 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd259559700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.550 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd259559700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.550 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd259559700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.550 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd259559700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd257555700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd257555700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd257555700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd257555700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:51:59.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:51:59.546+0000 7fd257555700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:00.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.370+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 82) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fbb9c04f510 con 0x7fbba815c3d0 2023-12-24T19:52:00.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.370+0000 7fbb8ffff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb940629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.370+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fbba8071060 con 0x7fbb940605a0 2023-12-24T19:52:00.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.374+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb940629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.378+0000 7fbba7fff700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb940629d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbba806d470 tx=0x7fbb98007df0 comp rx=0 tx=0).ready entity=mgr.8988 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.482+0000 7fbb8ffff700 1 -- 172.21.15.50:0/3456765621 <== mgr.8988 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbba8071060 con 0x7fbb940605a0 2023-12-24T19:52:00.485 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 msgr2=0x7fbb940629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb940629d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbba806d470 tx=0x7fbb98007df0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 msgr2=0x7fbba80c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 0x7fbba80c6780 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c016000 tx=0x7fbb9c017000 comp rx=0 tx=0).stop 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 shutdown_connections 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbb940605a0 0x7fbb940629d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba815c7a0 0x7fbba806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba815c3d0 0x7fbba80c6780 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 --2- 172.21.15.50:0/3456765621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbba80cb2b0 0x7fbba81568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 >> 172.21.15.50:0/3456765621 conn(0x7fbba80670b0 msgr2=0x7fbba80cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 shutdown_connections 2023-12-24T19:52:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.486+0000 7fbbae678700 1 -- 172.21.15.50:0/3456765621 wait complete. 2023-12-24T19:52:00.517 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T19:52:00.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-12-24T19:52:00.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.698+0000 7f135fc2e700 1 Processor -- start 2023-12-24T19:52:00.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.698+0000 7f135fc2e700 1 -- start start 2023-12-24T19:52:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135fc2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f135806db90 0x7f135815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135fc2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135806d4d0 con 0x7f1358156b50 2023-12-24T19:52:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135fc2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580b4960 con 0x7f13580b4230 2023-12-24T19:52:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135fc2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135815a620 con 0x7f135806db90 2023-12-24T19:52:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135e1cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f135806db90 0x7f135815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135d9ca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1358156b50 0x7f13580b3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49128/0 (socket says 172.21.15.50:49128) 2023-12-24T19:52:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135d9ca700 1 -- 172.21.15.50:0/2003677780 learned_addr learned my addr 172.21.15.50:0/2003677780 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135e1cb700 1 -- 172.21.15.50:0/2003677780 >> v1:172.21.15.82:6789/0 conn(0x7f13580b4230 legacy=0x7f135806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135e1cb700 1 -- 172.21.15.50:0/2003677780 >> v1:172.21.15.50:6789/0 conn(0x7f1358156b50 legacy=0x7f13580b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135e1cb700 1 -- 172.21.15.50:0/2003677780 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135806c8c0 con 0x7f135806db90 2023-12-24T19:52:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135e1cb700 1 --2- 172.21.15.50:0/2003677780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806db90 0x7f135815a0e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1350009e60 tx=0x7f1350009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f8df69e246434d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135c9c8700 1 -- 172.21.15.50:0/2003677780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000e070 con 0x7f135806db90 2023-12-24T19:52:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135c9c8700 1 -- 172.21.15.50:0/2003677780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000bc30 con 0x7f135806db90 2023-12-24T19:52:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.702+0000 7f135c9c8700 1 -- 172.21.15.50:0/2003677780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350012430 con 0x7f135806db90 2023-12-24T19:52:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 -- 172.21.15.50:0/2003677780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806db90 msgr2=0x7f135815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 --2- 172.21.15.50:0/2003677780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806db90 0x7f135815a0e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1350009e60 tx=0x7f1350009780 comp rx=0 tx=0).stop 2023-12-24T19:52:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 -- 172.21.15.50:0/2003677780 shutdown_connections 2023-12-24T19:52:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 --2- 172.21.15.50:0/2003677780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806db90 0x7f135815a0e0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 -- 172.21.15.50:0/2003677780 >> 172.21.15.50:0/2003677780 conn(0x7f1358067b40 msgr2=0x7f13580b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:00.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 -- 172.21.15.50:0/2003677780 shutdown_connections 2023-12-24T19:52:00.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 -- 172.21.15.50:0/2003677780 wait complete. 2023-12-24T19:52:00.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.706+0000 7f135fc2e700 1 Processor -- start 2023-12-24T19:52:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 -- start start 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135806db90 0x7f13580b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 0x7f135816a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580b23f0 con 0x7f13580b4230 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580ab4d0 con 0x7f135806db90 2023-12-24T19:52:00.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135fc2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13580ab7b0 con 0x7f1358156b50 2023-12-24T19:52:00.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59116/0 (socket says 172.21.15.50:59116) 2023-12-24T19:52:00.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 -- 172.21.15.50:0/1686585364 learned_addr learned my addr 172.21.15.50:0/1686585364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d9ca700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135806db90 0x7f13580b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135e1cb700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 0x7f135816a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 -- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 msgr2=0x7f135816a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 0x7f135816a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 -- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135806db90 msgr2=0x7f13580b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135806db90 0x7f13580b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 -- 172.21.15.50:0/1686585364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009a20 con 0x7f13580b4230 2023-12-24T19:52:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135e1cb700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 0x7f135816a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.710+0000 7f135d1c9700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f134800c790 tx=0x7f1348007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348011590 con 0x7f13580b4230 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480116f0 con 0x7f13580b4230 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348011ab0 con 0x7f13580b4230 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13580ad840 con 0x7f13580b4230 2023-12-24T19:52:00.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13580ade00 con 0x7f13580b4230 2023-12-24T19:52:00.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358071060 con 0x7f13580b4230 2023-12-24T19:52:00.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.714+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 82) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f134801b3b0 con 0x7f13580b4230 2023-12-24T19:52:00.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.718+0000 7f134dffb700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 0x7f133c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.718+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f134807bb80 con 0x7f13580b4230 2023-12-24T19:52:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.718+0000 7f135d9ca700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 0x7f133c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.718+0000 7f135d9ca700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 0x7f133c0628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f13581673d0 tx=0x7f1354000bc0 comp rx=0 tx=0).ready entity=mgr.8988 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:00.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.726+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f134804c050 con 0x7f13580b4230 2023-12-24T19:52:00.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:00.914+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f13580ab610 con 0x7f133c0603f0 2023-12-24T19:52:01.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.034+0000 7f134dffb700 1 -- 172.21.15.50:0/1686585364 <== mgr.8988 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1354004ce0 con 0x7f133c0603f0 2023-12-24T19:52:01.037 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path snap_test_dir1 2023-12-24T19:52:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 msgr2=0x7f133c0628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 0x7f133c0628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f13581673d0 tx=0x7f1354000bc0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 msgr2=0x7f13580acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f134800c790 tx=0x7f1348007f40 comp rx=0 tx=0).stop 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 shutdown_connections 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f133c0603f0 0x7f133c0628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1358156b50 0x7f135816a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13580b4230 0x7f13580acff0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 --2- 172.21.15.50:0/1686585364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135806db90 0x7f13580b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 >> 172.21.15.50:0/1686585364 conn(0x7f1358067b40 msgr2=0x7f135815b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 shutdown_connections 2023-12-24T19:52:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.038+0000 7f135fc2e700 1 -- 172.21.15.50:0/1686585364 wait complete. 2023-12-24T19:52:01.068 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-12-24T19:52:01.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-12-24T19:52:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 Processor -- start 2023-12-24T19:52:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 -- start start 2023-12-24T19:52:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59400b0c60 0x7f59400aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f594006d510 0x7f594006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59400af300 con 0x7f59400b1030 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594006c820 con 0x7f59400b0c60 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f594582e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59400cb3f0 con 0x7f594006d510 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59400b0c60 0x7f59400aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f594006d510 0x7f594006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f594006d510 0x7f594006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:33896/0 (socket says 172.21.15.50:33896) 2023-12-24T19:52:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593f7fe700 1 -- 172.21.15.50:0/3736451629 learned_addr learned my addr 172.21.15.50:0/3736451629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593f7fe700 1 -- 172.21.15.50:0/3736451629 >> v2:172.21.15.50:3300/0 conn(0x7f59400b0c60 msgr2=0x7f59400aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.246+0000 7f593f7fe700 1 --2- 172.21.15.50:0/3736451629 >> v2:172.21.15.50:3300/0 conn(0x7f59400b0c60 0x7f59400aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593f7fe700 1 -- 172.21.15.50:0/3736451629 >> v1:172.21.15.50:6789/0 conn(0x7f59400b1030 legacy=0x7f59400cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593f7fe700 1 -- 172.21.15.50:0/3736451629 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594006ca30 con 0x7f594006d510 2023-12-24T19:52:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593f7fe700 1 --2- 172.21.15.50:0/3736451629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594006d510 0x7f594006d900 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5940064fa0 tx=0x7f5938009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfaa8eec4eaa5a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593dffb700 1 -- 172.21.15.50:0/3736451629 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593800e070 con 0x7f594006d510 2023-12-24T19:52:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593dffb700 1 -- 172.21.15.50:0/3736451629 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800ba20 con 0x7f594006d510 2023-12-24T19:52:01.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f593dffb700 1 -- 172.21.15.50:0/3736451629 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59380092e0 con 0x7f594006d510 2023-12-24T19:52:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 -- 172.21.15.50:0/3736451629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594006d510 msgr2=0x7f594006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 --2- 172.21.15.50:0/3736451629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594006d510 0x7f594006d900 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5940064fa0 tx=0x7f5938009840 comp rx=0 tx=0).stop 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 -- 172.21.15.50:0/3736451629 shutdown_connections 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 --2- 172.21.15.50:0/3736451629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594006d510 0x7f594006d900 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 --2- 172.21.15.50:0/3736451629 >> v2:172.21.15.50:3300/0 conn(0x7f59400b0c60 0x7f59400aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 -- 172.21.15.50:0/3736451629 >> 172.21.15.50:0/3736451629 conn(0x7f5940067b80 msgr2=0x7f59400cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 -- 172.21.15.50:0/3736451629 shutdown_connections 2023-12-24T19:52:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.250+0000 7f594582e700 1 -- 172.21.15.50:0/3736451629 wait complete. 2023-12-24T19:52:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 Processor -- start 2023-12-24T19:52:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 -- start start 2023-12-24T19:52:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f594006d510 0x7f5940156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59400b0c60 0x7f59400c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59400b1030 0x7f59400c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401690e0 con 0x7f59400b0c60 2023-12-24T19:52:01.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59400c3fa0 con 0x7f59400b1030 2023-12-24T19:52:01.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f594582e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59400c3700 con 0x7f594006d510 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.254+0000 7f593e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59400b0c60 0x7f59400c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59400b0c60 0x7f59400c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59136/0 (socket says 172.21.15.50:59136) 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 -- 172.21.15.50:0/4191585674 learned_addr learned my addr 172.21.15.50:0/4191585674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593f7fe700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59400b1030 0x7f59400c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593effd700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f594006d510 0x7f5940156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 -- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f594006d510 msgr2=0x7f5940156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f594006d510 0x7f5940156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 -- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59400b1030 msgr2=0x7f59400c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59400b1030 0x7f59400c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 -- 172.21.15.50:0/4191585674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009ae0 con 0x7f59400b0c60 2023-12-24T19:52:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593effd700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f594006d510 0x7f5940156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f593e7fc700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59400b0c60 0x7f59400c8900 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f593400c7c0 tx=0x7f5934007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934011590 con 0x7f59400b0c60 2023-12-24T19:52:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934011710 con 0x7f59400b0c60 2023-12-24T19:52:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934011ad0 con 0x7f59400b0c60 2023-12-24T19:52:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f594582e700 1 -- 172.21.15.50:0/4191585674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59400c39e0 con 0x7f59400b0c60 2023-12-24T19:52:01.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.258+0000 7f594582e700 1 -- 172.21.15.50:0/4191585674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5940157320 con 0x7f59400b0c60 2023-12-24T19:52:01.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.262+0000 7f594582e700 1 -- 172.21.15.50:0/4191585674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5940168eb0 con 0x7f59400b0c60 2023-12-24T19:52:01.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.262+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 82) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f593401a360 con 0x7f59400b0c60 2023-12-24T19:52:01.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.262+0000 7f5926ffd700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f592c0603f0 0x7f592c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.262+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f593407b8f0 con 0x7f59400b0c60 2023-12-24T19:52:01.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.262+0000 7f593effd700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f592c0603f0 0x7f592c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.266+0000 7f593effd700 1 --2- 172.21.15.50:0/4191585674 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f592c0603f0 0x7f592c0628a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5930009d80 tx=0x7f5930008040 comp rx=0 tx=0).ready entity=mgr.8988 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.270+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5940168eb0 con 0x7f59400b0c60 2023-12-24T19:52:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.418+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 83) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f593404c0c0 con 0x7f59400b0c60 2023-12-24T19:52:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.482+0000 7f594582e700 1 -- 172.21.15.50:0/4191585674 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5940168eb0 con 0x7f592c0603f0 2023-12-24T19:52:01.500 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:01.498+0000 7fd261d6a700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-12-24T19:52:01.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.498+0000 7f5926ffd700 1 -- 172.21.15.50:0/4191585674 <== mgr.8988 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f5940168eb0 con 0x7f592c0603f0 2023-12-24T19:52:01.504 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-12-24T19:52:01.514 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-24T19:52:01.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:52:01.515 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T19:52:01.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T19:52:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.742+0000 7f64a082d700 1 Processor -- start 2023-12-24T19:52:01.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.742+0000 7f64a082d700 1 -- start start 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f64a082d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f649c158c40 0x7f649c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f64a082d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f649c06d450 0x7f649c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f64a082d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c06a580 con 0x7f649c0cc780 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f64a082d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0cd110 con 0x7f649c158c40 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f64a082d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c06a7d0 con 0x7f649c06d450 2023-12-24T19:52:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f649c158c40 0x7f649c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f649c0cc780 0x7f649c06cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49158/0 (socket says 172.21.15.50:49158) 2023-12-24T19:52:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649a59c700 1 -- 172.21.15.50:0/3158209353 learned_addr learned my addr 172.21.15.50:0/3158209353 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649b59e700 1 --2- 172.21.15.50:0/3158209353 >> v2:172.21.15.82:3300/0 conn(0x7f649c06d450 0x7f649c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 -- 172.21.15.50:0/3158209353 >> v2:172.21.15.82:3300/0 conn(0x7f649c06d450 msgr2=0x7f649c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 --2- 172.21.15.50:0/3158209353 >> v2:172.21.15.82:3300/0 conn(0x7f649c06d450 0x7f649c0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 -- 172.21.15.50:0/3158209353 >> v1:172.21.15.50:6789/0 conn(0x7f649c0cc780 legacy=0x7f649c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f6499d9b700 1 -- 172.21.15.50:0/3158209353 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757477568 0 0) 0x7f649c06a580 con 0x7f649c0cc780 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 -- 172.21.15.50:0/3158209353 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c06aab0 con 0x7f649c158c40 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f649ad9d700 1 --2- 172.21.15.50:0/3158209353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c158c40 0x7f649c0cf500 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f649c0cc710 tx=0x7f648c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf36e46d9cef525 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f6499d9b700 1 -- 172.21.15.50:0/3158209353 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00b6b0 con 0x7f649c158c40 2023-12-24T19:52:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f6499d9b700 1 -- 172.21.15.50:0/3158209353 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c00b810 con 0x7f649c158c40 2023-12-24T19:52:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.746+0000 7f6499d9b700 1 -- 172.21.15.50:0/3158209353 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00bbb0 con 0x7f649c158c40 2023-12-24T19:52:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 -- 172.21.15.50:0/3158209353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c158c40 msgr2=0x7f649c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 --2- 172.21.15.50:0/3158209353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c158c40 0x7f649c0cf500 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f649c0cc710 tx=0x7f648c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 -- 172.21.15.50:0/3158209353 shutdown_connections 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 --2- 172.21.15.50:0/3158209353 >> v2:172.21.15.82:3300/0 conn(0x7f649c06d450 0x7f649c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 --2- 172.21.15.50:0/3158209353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c158c40 0x7f649c0cf500 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 -- 172.21.15.50:0/3158209353 >> 172.21.15.50:0/3158209353 conn(0x7f649c0d0800 msgr2=0x7f649c0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 -- 172.21.15.50:0/3158209353 shutdown_connections 2023-12-24T19:52:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.750+0000 7f64a082d700 1 -- 172.21.15.50:0/3158209353 wait complete. 2023-12-24T19:52:01.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 Processor -- start 2023-12-24T19:52:01.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 -- start start 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f649c06d450 0x7f649c148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f649c158c40 0x7f649c0b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0892a0 con 0x7f649c0cc780 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c089540 con 0x7f649c06d450 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f64a082d700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c089820 con 0x7f649c158c40 2023-12-24T19:52:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59160/0 (socket says 172.21.15.50:59160) 2023-12-24T19:52:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 -- 172.21.15.50:0/2527328864 learned_addr learned my addr 172.21.15.50:0/2527328864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649ad9d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f649c06d450 0x7f649c148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649b59e700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f649c158c40 0x7f649c0b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 -- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f649c158c40 msgr2=0x7f649c0b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f649c158c40 0x7f649c0b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 -- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f649c06d450 msgr2=0x7f649c148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f649c06d450 0x7f649c148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 -- 172.21.15.50:0/2527328864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c009420 con 0x7f649c0cc780 2023-12-24T19:52:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.754+0000 7f649a59c700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f649000c7e0 tx=0x7f6490007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490005b30 con 0x7f649c0cc780 2023-12-24T19:52:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490005c90 con 0x7f649c0cc780 2023-12-24T19:52:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490007300 con 0x7f649c0cc780 2023-12-24T19:52:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c089b00 con 0x7f649c0cc780 2023-12-24T19:52:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c1486a0 con 0x7f649c0cc780 2023-12-24T19:52:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c04be40 con 0x7f649c0cc780 2023-12-24T19:52:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.758+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 83) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f649001b3b0 con 0x7f649c0cc780 2023-12-24T19:52:01.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.762+0000 7f6482ffd700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 0x7f6488062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.762+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f649007c480 con 0x7f649c0cc780 2023-12-24T19:52:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.762+0000 7f649ad9d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 0x7f6488062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.762+0000 7f649ad9d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 0x7f6488062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648c0093f0 tx=0x7f648c017000 comp rx=0 tx=0).ready entity=mgr.8988 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:01.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.766+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f649004c420 con 0x7f649c0cc780 2023-12-24T19:52:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:01.982+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f649c06ad90 con 0x7f649c0cc780 2023-12-24T19:52:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.434+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f649004c7f0 con 0x7f649c0cc780 2023-12-24T19:52:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.434+0000 7f6482ffd700 1 -- 172.21.15.50:0/2527328864 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v84) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6490048310 con 0x7f649c0cc780 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 msgr2=0x7f6488062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 0x7f6488062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648c0093f0 tx=0x7f648c017000 comp rx=0 tx=0).stop 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 msgr2=0x7f649c1476b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f649000c7e0 tx=0x7f6490007df0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 shutdown_connections 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6488060750 0x7f6488062c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f649c158c40 0x7f649c0b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f649c0cc780 0x7f649c1476b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 --2- 172.21.15.50:0/2527328864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f649c06d450 0x7f649c148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 >> 172.21.15.50:0/2527328864 conn(0x7f649c0d0800 msgr2=0x7f649c062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 shutdown_connections 2023-12-24T19:52:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.438+0000 7f64a082d700 1 -- 172.21.15.50:0/2527328864 wait complete. 2023-12-24T19:52:02.462 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:52:02.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:52:02.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:52:02.549 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:52:02.550 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T19:52:02.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:52:02.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T19:52:02.610 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T19:52:02.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:02.610 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T19:52:02.633 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:02.621+0000 7f2da095b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:52:02.637 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:02.630+0000 7fc82335a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:52:02.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 Processor -- start 2023-12-24T19:52:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 -- start start 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda9015d430 0x7fda900c8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda9006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda90068f20 con 0x7fda9015d800 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900c0c50 con 0x7fda9015d430 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.874+0000 7fda95745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c8be0 con 0x7fda900ad120 2023-12-24T19:52:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda9015d800 0x7fda901611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49168/0 (socket says 172.21.15.50:49168) 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8ffff700 1 -- 172.21.15.50:0/1521753816 learned_addr learned my addr 172.21.15.50:0/1521753816 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda9006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> v2:172.21.15.82:3300/0 conn(0x7fda9015d430 0x7fda900c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258495545 0 0) 0x7fda90068f20 con 0x7fda9015d800 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7c003570 con 0x7fda9015d800 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 16597317 0 0) 0x7fda7c003570 con 0x7fda9015d800 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 msgr2=0x7fda9006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda9006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 >> v2:172.21.15.82:3300/0 conn(0x7fda9015d430 msgr2=0x7fda900c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 --2- 172.21.15.50:0/1521753816 >> v2:172.21.15.82:3300/0 conn(0x7fda9015d430 0x7fda900c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90067150 con 0x7fda9015d800 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fda880017f0 con 0x7fda9015d800 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda9006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> v2:172.21.15.82:3300/0 conn(0x7fda9015d430 0x7fda900c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 >> v1:172.21.15.50:6789/0 conn(0x7fda9015d800 legacy=0x7fda901611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c003a60 0x7fda7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c004810 0x7fda7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c0c50 con 0x7fda7c003a60 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c8be0 con 0x7fda7c004810 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00ba60 con 0x7fda900ad120 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c003a60 0x7fda7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c004810 0x7fda7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8ffff700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 -- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 msgr2=0x7fda7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ad120 0x7fda7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 -- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c004810 msgr2=0x7fda7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c004810 0x7fda7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.878+0000 7fda8effd700 1 -- 172.21.15.50:0/1521753816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009420 con 0x7fda7c003a60 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda8effd700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c003a60 0x7fda7c003e70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fda80009df0 tx=0x7fda800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6048b2360836d09e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000e920 con 0x7fda7c003a60 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000ea80 con 0x7fda7c003a60 2023-12-24T19:52:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda8dffb700 1 -- 172.21.15.50:0/1521753816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000ee20 con 0x7fda7c003a60 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 -- 172.21.15.50:0/1521753816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c003a60 msgr2=0x7fda7c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 --2- 172.21.15.50:0/1521753816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c003a60 0x7fda7c003e70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fda80009df0 tx=0x7fda800091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda8ffff700 1 -- 172.21.15.50:0/1521753816 reap_dead start 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 -- 172.21.15.50:0/1521753816 shutdown_connections 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 -- 172.21.15.50:0/1521753816 >> 172.21.15.50:0/1521753816 conn(0x7fda900c9da0 msgr2=0x7fda900ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 -- 172.21.15.50:0/1521753816 shutdown_connections 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.882+0000 7fda95745700 1 -- 172.21.15.50:0/1521753816 wait complete. 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 Processor -- start 2023-12-24T19:52:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 -- start start 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 0x7fda901492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ae080 0x7fda900c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c4e20 con 0x7fda900c7ae0 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c7650 con 0x7fda7c003a60 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda95745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900ae4d0 con 0x7fda900ae080 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ae080 0x7fda900c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 0x7fda901492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 0x7fda901492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:33952/0 (socket says 172.21.15.50:33952) 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8effd700 1 -- 172.21.15.50:0/3569492990 learned_addr learned my addr 172.21.15.50:0/3569492990 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.886+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59184/0 (socket says 172.21.15.50:59184) 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ae080 msgr2=0x7fda900c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ae080 0x7fda900c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 msgr2=0x7fda901492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 0x7fda901492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 -- 172.21.15.50:0/3569492990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90149830 con 0x7fda900c7ae0 2023-12-24T19:52:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda8e7fc700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fda78011d40 tx=0x7fda780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78011e40 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900c6a40 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7800fcd0 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78014670 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900c7000 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.890+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda900c77e0 con 0x7fda900c7ae0 2023-12-24T19:52:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.894+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fda78014a60 con 0x7fda900c7ae0 2023-12-24T19:52:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.894+0000 7fda86ffd700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 0x7fda70062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.894+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7fda78018030 con 0x7fda900c7ae0 2023-12-24T19:52:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.894+0000 7fda8effd700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 msgr2=0x7fda70062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.894+0000 7fda8effd700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 0x7fda70062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:02.898+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda7804d960 con 0x7fda900c7ae0 2023-12-24T19:52:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.098+0000 7fda8effd700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 msgr2=0x7fda70062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.098+0000 7fda8effd700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 0x7fda70062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.110+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda900652e0 con 0x7fda900c7ae0 2023-12-24T19:52:03.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.110+0000 7fda86ffd700 1 -- 172.21.15.50:0/3569492990 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fda78050f80 con 0x7fda900c7ae0 2023-12-24T19:52:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:03.120 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 msgr2=0x7fda70062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 0x7fda70062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 msgr2=0x7fda900adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fda78011d40 tx=0x7fda780091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 shutdown_connections 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fda70060700 0x7fda70062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda900ae080 0x7fda900c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda900c7ae0 0x7fda900adb40 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 --2- 172.21.15.50:0/3569492990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c003a60 0x7fda901492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 >> 172.21.15.50:0/3569492990 conn(0x7fda900c9da0 msgr2=0x7fda90062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 shutdown_connections 2023-12-24T19:52:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.114+0000 7fda95745700 1 -- 172.21.15.50:0/3569492990 wait complete. 2023-12-24T19:52:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:52:03.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:03.180 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.173+0000 7f2da095b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:52:03.223 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:03.222+0000 7fc82335a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:52:03.254 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.249+0000 7f2da095b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:52:03.304 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:03.302+0000 7fc82335a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:52:03.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.310+0000 7f60dca2e700 1 Processor -- start 2023-12-24T19:52:03.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.310+0000 7f60dca2e700 1 -- start start 2023-12-24T19:52:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60dca2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60dca2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60dca2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80cb240 con 0x7f60d814df60 2023-12-24T19:52:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60dca2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80ca6b0 con 0x7f60d80b1590 2023-12-24T19:52:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60dca2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80b1f20 con 0x7f60d8158080 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37708/0 (socket says 172.21.15.50:37708) 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:33966/0 (socket says 172.21.15.50:33966) 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 -- 172.21.15.50:0/303304565 learned_addr learned my addr 172.21.15.50:0/303304565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d659c700 1 --1- 172.21.15.50:0/303304565 >> v1:172.21.15.82:6789/0 conn(0x7f60d814df60 0x7f60d806af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41760/0 (socket says 172.21.15.50:41760) 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 -- 172.21.15.50:0/303304565 >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 msgr2=0x7f60d80b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 --2- 172.21.15.50:0/303304565 >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 -- 172.21.15.50:0/303304565 >> v1:172.21.15.82:6789/0 conn(0x7f60d814df60 legacy=0x7f60d806af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 -- 172.21.15.50:0/303304565 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d806b780 con 0x7f60d8158080 2023-12-24T19:52:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d6d9d700 1 --2- 172.21.15.50:0/303304565 >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d5d9b700 1 --2- 172.21.15.50:0/303304565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0099b0 tx=0x7f60cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab31debe81689b5c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d559a700 1 -- 172.21.15.50:0/303304565 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc009ea0 con 0x7f60d8158080 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d559a700 1 -- 172.21.15.50:0/303304565 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc00b860 con 0x7f60d8158080 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.314+0000 7f60d559a700 1 -- 172.21.15.50:0/303304565 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00bc20 con 0x7f60d8158080 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 -- 172.21.15.50:0/303304565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 msgr2=0x7f60d80c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 --2- 172.21.15.50:0/303304565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0099b0 tx=0x7f60cc009250 comp rx=0 tx=0).stop 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 -- 172.21.15.50:0/303304565 shutdown_connections 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 --2- 172.21.15.50:0/303304565 >> v2:172.21.15.82:3300/0 conn(0x7f60d80b1590 0x7f60d80b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 --2- 172.21.15.50:0/303304565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80c8720 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 -- 172.21.15.50:0/303304565 >> 172.21.15.50:0/303304565 conn(0x7f60d80670b0 msgr2=0x7f60d8067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 -- 172.21.15.50:0/303304565 shutdown_connections 2023-12-24T19:52:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.318+0000 7f60dca2e700 1 -- 172.21.15.50:0/303304565 wait complete. 2023-12-24T19:52:03.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 Processor -- start 2023-12-24T19:52:03.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 -- start start 2023-12-24T19:52:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60d80b1590 0x7f60d8169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80aa440 con 0x7f60d814df60 2023-12-24T19:52:03.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80a9a50 con 0x7f60d80b1590 2023-12-24T19:52:03.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60dca2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d816a1e0 con 0x7f60d8158080 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59198/0 (socket says 172.21.15.50:59198) 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60d5d9b700 1 -- 172.21.15.50:0/1269695416 learned_addr learned my addr 172.21.15.50:0/1269695416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60d659c700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60d80b1590 0x7f60d8169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.322+0000 7f60d6d9d700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 msgr2=0x7f60d80ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60d80b1590 msgr2=0x7f60d8169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60d80b1590 0x7f60d8169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 -- 172.21.15.50:0/1269695416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009a20 con 0x7f60d814df60 2023-12-24T19:52:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60d5d9b700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006fd0 tx=0x7f60cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc020070 con 0x7f60d814df60 2023-12-24T19:52:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc000bc0 con 0x7f60d814df60 2023-12-24T19:52:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00bc20 con 0x7f60d814df60 2023-12-24T19:52:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0094f0 con 0x7f60d814df60 2023-12-24T19:52:03.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d80a9120 con 0x7f60d814df60 2023-12-24T19:52:03.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.326+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d80a9bc0 con 0x7f60d814df60 2023-12-24T19:52:03.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.330+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f60cc024070 con 0x7f60d814df60 2023-12-24T19:52:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.330+0000 7f60c67fc700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 0x7f60b8062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.330+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f60cc07e110 con 0x7f60d814df60 2023-12-24T19:52:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.330+0000 7f60d659c700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 msgr2=0x7f60b8062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.330+0000 7f60d659c700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 0x7f60b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.338+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f60cc04e110 con 0x7f60d814df60 2023-12-24T19:52:03.402 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.397+0000 7f2da095b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:03.467 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:03.462+0000 7fc82335a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.526+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d80652e0 con 0x7f60d814df60 2023-12-24T19:52:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.526+0000 7f60c67fc700 1 -- 172.21.15.50:0/1269695416 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16504 (secure 0 0 0) 0x7f60cc0516f0 con 0x7f60d814df60 2023-12-24T19:52:03.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:03.531 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:59.346757+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/276202238":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/3234111717":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/1127027369":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/2322179702":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6837/33814":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6836/33814":"2023-12-25T19:51:59.346658+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 msgr2=0x7f60b8062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60d659c700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 msgr2=0x7f60b8062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60d659c700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 0x7f60b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:03.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 0x7f60b8062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 msgr2=0x7f60d814beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006fd0 tx=0x7f60cc017000 comp rx=0 tx=0).stop 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 shutdown_connections 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f60b8060700 0x7f60b8062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60d8158080 0x7f60d80ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60d814df60 0x7f60d814beb0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 --2- 172.21.15.50:0/1269695416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60d80b1590 0x7f60d8169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 >> 172.21.15.50:0/1269695416 conn(0x7f60d80670b0 msgr2=0x7f60d806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 shutdown_connections 2023-12-24T19:52:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.534+0000 7f60dca2e700 1 -- 172.21.15.50:0/1269695416 wait complete. 2023-12-24T19:52:03.557 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:51:38.547974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:51:39.055260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:52:03.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:52:03.680 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.673+0000 7f2da095b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 Processor -- start 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 -- start start 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 0x7f463815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f463815af50 0x7f46380ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 0x7f46380caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463815b990 con 0x7f463815af50 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463806ccc0 con 0x7f4638140870 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463cd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463815b3d0 con 0x7f46381404a0 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f463815af50 0x7f46380ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f463815af50 0x7f46380ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59204/0 (socket says 172.21.15.50:59204) 2023-12-24T19:52:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 -- 172.21.15.50:0/104944931 learned_addr learned my addr 172.21.15.50:0/104944931 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f4636d9d700 1 --2- 172.21.15.50:0/104944931 >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 0x7f46380caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 -- 172.21.15.50:0/104944931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 msgr2=0x7f463815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463659c700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 0x7f463815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 0x7f463815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 -- 172.21.15.50:0/104944931 >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 msgr2=0x7f46380caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 --2- 172.21.15.50:0/104944931 >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 0x7f46380caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f462ffff700 1 -- 172.21.15.50:0/104944931 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463815b6b0 con 0x7f463815af50 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f4636d9d700 1 --2- 172.21.15.50:0/104944931 >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 0x7f46380caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.726+0000 7f463659c700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 0x7f463815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f462ffff700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463815af50 0x7f46380ca500 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4638069d90 tx=0x7f4620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3dab1aec6506b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f4635d9b700 1 -- 172.21.15.50:0/104944931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000b860 con 0x7f463815af50 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f4635d9b700 1 -- 172.21.15.50:0/104944931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462000b9c0 con 0x7f463815af50 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f4635d9b700 1 -- 172.21.15.50:0/104944931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000bd60 con 0x7f463815af50 2023-12-24T19:52:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- 172.21.15.50:0/104944931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463815af50 msgr2=0x7f46380ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463815af50 0x7f46380ca500 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4638069d90 tx=0x7f4620009250 comp rx=0 tx=0).stop 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- 172.21.15.50:0/104944931 shutdown_connections 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 --2- 172.21.15.50:0/104944931 >> v2:172.21.15.82:3300/0 conn(0x7f4638140870 0x7f46380caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463815af50 0x7f46380ca500 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 --2- 172.21.15.50:0/104944931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46381404a0 0x7f463815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- 172.21.15.50:0/104944931 >> 172.21.15.50:0/104944931 conn(0x7f4638067b80 msgr2=0x7f46380cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- 172.21.15.50:0/104944931 shutdown_connections 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- 172.21.15.50:0/104944931 wait complete. 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 Processor -- start 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.730+0000 7f463cd45700 1 -- start start 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46381404a0 0x7f4638156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4638140870 0x7f4638158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380a9790 con 0x7f46381590a0 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380a9160 con 0x7f46381404a0 2023-12-24T19:52:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638159670 con 0x7f4638140870 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59220/0 (socket says 172.21.15.50:59220) 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 -- 172.21.15.50:0/4010122062 learned_addr learned my addr 172.21.15.50:0/4010122062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f462ffff700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4638140870 0x7f4638158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463659c700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46381404a0 0x7f4638156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 -- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4638140870 msgr2=0x7f4638158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4638140870 0x7f4638158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 -- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46381404a0 msgr2=0x7f4638156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46381404a0 0x7f4638156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 -- 172.21.15.50:0/4010122062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200094f0 con 0x7f46381590a0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f4636d9d700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f463000a380 tx=0x7f46300078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000ae10 con 0x7f46381590a0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000d650 con 0x7f46381590a0 2023-12-24T19:52:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4638159950 con 0x7f46381590a0 2023-12-24T19:52:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000da10 con 0x7f46381590a0 2023-12-24T19:52:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.734+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463813ec30 con 0x7f46381590a0 2023-12-24T19:52:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.738+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380652e0 con 0x7f46381590a0 2023-12-24T19:52:03.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.738+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f4630003020 con 0x7f46381590a0 2023-12-24T19:52:03.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.738+0000 7f462e7fc700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 0x7f4618062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:03.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.742+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f463007d6e0 con 0x7f46381590a0 2023-12-24T19:52:03.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.742+0000 7f463659c700 1 -- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 msgr2=0x7f4618062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:03.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.742+0000 7f463659c700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 0x7f4618062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.746+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f463004bbe0 con 0x7f46381590a0 2023-12-24T19:52:03.759 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.753+0000 7f2da095b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:03.774 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:03.770+0000 7fc82335a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:52:03.847 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:03.842+0000 7fc82335a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.938+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f463806c950 con 0x7f46381590a0 2023-12-24T19:52:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.938+0000 7f462e7fc700 1 -- 172.21.15.50:0/4010122062 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7f463004d680 con 0x7f46381590a0 2023-12-24T19:52:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T19:52:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 msgr2=0x7f4618062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 0x7f4618062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 msgr2=0x7f46380abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f463000a380 tx=0x7f46300078f0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 shutdown_connections 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f4618060700 0x7f4618062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46381590a0 0x7f46380abb50 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4638140870 0x7f4638158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 --2- 172.21.15.50:0/4010122062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46381404a0 0x7f4638156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 >> 172.21.15.50:0/4010122062 conn(0x7f4638067b80 msgr2=0x7f46380ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 shutdown_connections 2023-12-24T19:52:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:03.942+0000 7f463cd45700 1 -- 172.21.15.50:0/4010122062 wait complete. 2023-12-24T19:52:03.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:52:03.983 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:03.977+0000 7f2da095b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:52:04.066 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:04.061+0000 7f2da095b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:52:04.118 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:04.114+0000 7fc82335a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:52:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 Processor -- start 2023-12-24T19:52:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 -- start start 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 0x7f6e6006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e600cb980 0x7f6e600c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6006db30 con 0x7f6e600c8880 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e600c9b60 con 0x7f6e600cb980 2023-12-24T19:52:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.146+0000 7f6e66225700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6006cf20 con 0x7f6e600c9190 2023-12-24T19:52:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 0x7f6e6006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 0x7f6e6006c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59234/0 (socket says 172.21.15.50:59234) 2023-12-24T19:52:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5f7fe700 1 -- 172.21.15.50:0/226915443 learned_addr learned my addr 172.21.15.50:0/226915443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5effd700 1 --2- 172.21.15.50:0/226915443 >> v2:172.21.15.82:3300/0 conn(0x7f6e600cb980 0x7f6e600c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 -- 172.21.15.50:0/226915443 >> v2:172.21.15.82:3300/0 conn(0x7f6e600cb980 msgr2=0x7f6e600c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 --2- 172.21.15.50:0/226915443 >> v2:172.21.15.82:3300/0 conn(0x7f6e600cb980 0x7f6e600c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 -- 172.21.15.50:0/226915443 >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 msgr2=0x7f6e6006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 --2- 172.21.15.50:0/226915443 >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 0x7f6e6006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 -- 172.21.15.50:0/226915443 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6006d200 con 0x7f6e600c9190 2023-12-24T19:52:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5ffff700 1 --2- 172.21.15.50:0/226915443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600675c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6e6006c040 tx=0x7f6e58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4379140876416fc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5e7fc700 1 -- 172.21.15.50:0/226915443 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800e070 con 0x7f6e600c9190 2023-12-24T19:52:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5e7fc700 1 -- 172.21.15.50:0/226915443 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800bab0 con 0x7f6e600c9190 2023-12-24T19:52:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.150+0000 7f6e5e7fc700 1 -- 172.21.15.50:0/226915443 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800be70 con 0x7f6e600c9190 2023-12-24T19:52:04.155 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:04.149+0000 7f2da095b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 -- 172.21.15.50:0/226915443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 msgr2=0x7f6e600675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 --2- 172.21.15.50:0/226915443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600675c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6e6006c040 tx=0x7f6e58009780 comp rx=0 tx=0).stop 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 -- 172.21.15.50:0/226915443 shutdown_connections 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 --2- 172.21.15.50:0/226915443 >> v2:172.21.15.82:3300/0 conn(0x7f6e600cb980 0x7f6e600c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 --2- 172.21.15.50:0/226915443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600675c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 --2- 172.21.15.50:0/226915443 >> v2:172.21.15.50:3300/0 conn(0x7f6e600c8880 0x7f6e6006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 -- 172.21.15.50:0/226915443 >> 172.21.15.50:0/226915443 conn(0x7f6e600cddb0 msgr2=0x7f6e600ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 -- 172.21.15.50:0/226915443 shutdown_connections 2023-12-24T19:52:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 -- 172.21.15.50:0/226915443 wait complete. 2023-12-24T19:52:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.154+0000 7f6e66225700 1 Processor -- start 2023-12-24T19:52:04.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 -- start start 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 0x7f6e600ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600b2140 con 0x7f6e600c8880 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e601533c0 con 0x7f6e600cb980 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e66225700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600b1530 con 0x7f6e600c9190 2023-12-24T19:52:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59250/0 (socket says 172.21.15.50:59250) 2023-12-24T19:52:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 -- 172.21.15.50:0/3427758657 learned_addr learned my addr 172.21.15.50:0/3427758657 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5effd700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5ffff700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 0x7f6e600ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 -- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 msgr2=0x7f6e600b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 -- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 msgr2=0x7f6e600ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 0x7f6e600ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 -- 172.21.15.50:0/3427758657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58009a20 con 0x7f6e600c8880 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5ffff700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 0x7f6e600ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e5f7fe700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000e980 tx=0x7f6e50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000ee70 con 0x7f6e600c8880 2023-12-24T19:52:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.158+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000c850 con 0x7f6e600c8880 2023-12-24T19:52:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.162+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000cbd0 con 0x7f6e600c8880 2023-12-24T19:52:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.162+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e600b1810 con 0x7f6e600c8880 2023-12-24T19:52:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.162+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e600b1dd0 con 0x7f6e600c8880 2023-12-24T19:52:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.162+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e600652e0 con 0x7f6e600c8880 2023-12-24T19:52:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.162+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f6e50013470 con 0x7f6e600c8880 2023-12-24T19:52:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.166+0000 7f6e477fe700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 0x7f6e4c062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.166+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f6e5007cfb0 con 0x7f6e600c8880 2023-12-24T19:52:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.166+0000 7f6e5effd700 1 -- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 msgr2=0x7f6e4c062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.166+0000 7f6e5effd700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 0x7f6e4c062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:04.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.174+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6e500acbe0 con 0x7f6e600c8880 2023-12-24T19:52:04.211 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:04.206+0000 7fc82335a000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:52:04.307 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:04.302+0000 7fc82335a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:52:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.350+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e6006ede0 con 0x7f6e600c8880 2023-12-24T19:52:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.350+0000 7f6e477fe700 1 -- 172.21.15.50:0/3427758657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e500509e0 con 0x7f6e600c8880 2023-12-24T19:52:04.353 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 msgr2=0x7f6e4c062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 0x7f6e4c062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 msgr2=0x7f6e601519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000e980 tx=0x7f6e50009250 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 shutdown_connections 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6e4c060730 0x7f6e4c062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600cb980 0x7f6e600ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e600c9190 0x7f6e600b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 --2- 172.21.15.50:0/3427758657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e600c8880 0x7f6e601519e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 >> 172.21.15.50:0/3427758657 conn(0x7f6e600cddb0 msgr2=0x7f6e600c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 shutdown_connections 2023-12-24T19:52:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.354+0000 7f6e66225700 1 -- 172.21.15.50:0/3427758657 wait complete. 2023-12-24T19:52:04.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:52:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.542+0000 7ff5bcd63700 1 Processor -- start 2023-12-24T19:52:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.542+0000 7ff5bcd63700 1 -- start start 2023-12-24T19:52:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5bcd63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5b80cc780 0x7ff5b80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5bcd63700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5b806cd40 0x7ff5b806d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5bcd63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b806a580 con 0x7ff5b8158c40 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5bcd63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b80cd110 con 0x7ff5b80cc780 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5bcd63700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b806a7d0 con 0x7ff5b806cd40 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5b80cc780 0x7ff5b80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5b80cc780 0x7ff5b80ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59260/0 (socket says 172.21.15.50:59260) 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 -- 172.21.15.50:0/3871125505 learned_addr learned my addr 172.21.15.50:0/3871125505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b7fff700 1 --2- 172.21.15.50:0/3871125505 >> v2:172.21.15.82:3300/0 conn(0x7ff5b806cd40 0x7ff5b806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 -- 172.21.15.50:0/3871125505 >> v2:172.21.15.82:3300/0 conn(0x7ff5b806cd40 msgr2=0x7ff5b806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 --2- 172.21.15.50:0/3871125505 >> v2:172.21.15.82:3300/0 conn(0x7ff5b806cd40 0x7ff5b806d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 -- 172.21.15.50:0/3871125505 >> v1:172.21.15.82:6789/0 conn(0x7ff5b8158c40 legacy=0x7ff5b80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 -- 172.21.15.50:0/3871125505 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b806aab0 con 0x7ff5b80cc780 2023-12-24T19:52:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b67fc700 1 -- 172.21.15.50:0/3871125505 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378619389 0 0) 0x7ff5b806a580 con 0x7ff5b8158c40 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b6ffd700 1 --2- 172.21.15.50:0/3871125505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b80cc780 0x7ff5b80ccbd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80cc710 tx=0x7ff5ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c72441a921cca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.546+0000 7ff5b67fc700 1 -- 172.21.15.50:0/3871125505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac009e70 con 0x7ff5b80cc780 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5b67fc700 1 -- 172.21.15.50:0/3871125505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac00b860 con 0x7ff5b80cc780 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5b67fc700 1 -- 172.21.15.50:0/3871125505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00bc00 con 0x7ff5b80cc780 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- 172.21.15.50:0/3871125505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b80cc780 msgr2=0x7ff5b80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/3871125505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b80cc780 0x7ff5b80ccbd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80cc710 tx=0x7ff5ac009250 comp rx=0 tx=0).stop 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- 172.21.15.50:0/3871125505 shutdown_connections 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/3871125505 >> v2:172.21.15.82:3300/0 conn(0x7ff5b806cd40 0x7ff5b806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/3871125505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b80cc780 0x7ff5b80ccbd0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- 172.21.15.50:0/3871125505 >> 172.21.15.50:0/3871125505 conn(0x7ff5b80d0800 msgr2=0x7ff5b80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- 172.21.15.50:0/3871125505 shutdown_connections 2023-12-24T19:52:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- 172.21.15.50:0/3871125505 wait complete. 2023-12-24T19:52:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 Processor -- start 2023-12-24T19:52:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.550+0000 7ff5bcd63700 1 -- start start 2023-12-24T19:52:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 0x7ff5b80c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5b8158c40 0x7ff5b80cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b80c7f10 con 0x7ff5b806cd40 2023-12-24T19:52:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b816d4c0 con 0x7ff5b80cc780 2023-12-24T19:52:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b80c7300 con 0x7ff5b8158c40 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59268/0 (socket says 172.21.15.50:59268) 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 -- 172.21.15.50:0/4191297678 learned_addr learned my addr 172.21.15.50:0/4191297678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b6ffd700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 0x7ff5b80c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b7fff700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5b8158c40 0x7ff5b80cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 -- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5b8158c40 msgr2=0x7ff5b80cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5b8158c40 0x7ff5b80cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 -- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 msgr2=0x7ff5b80c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 0x7ff5b80c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 -- 172.21.15.50:0/4191297678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0094f0 con 0x7ff5b806cd40 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b6ffd700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 0x7ff5b80c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5b77fe700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c530 tx=0x7ff5a800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011590 con 0x7ff5b806cd40 2023-12-24T19:52:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8011710 con 0x7ff5b806cd40 2023-12-24T19:52:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b80c75e0 con 0x7ff5b806cd40 2023-12-24T19:52:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011ad0 con 0x7ff5b806cd40 2023-12-24T19:52:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.554+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b80c7ba0 con 0x7ff5b806cd40 2023-12-24T19:52:04.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b804be40 con 0x7ff5b806cd40 2023-12-24T19:52:04.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7ff5a8001010 con 0x7ff5b806cd40 2023-12-24T19:52:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff59f7fe700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 0x7ff5a4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff5b6ffd700 1 -- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 msgr2=0x7ff5a4062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7ff5a807c2c0 con 0x7ff5b806cd40 2023-12-24T19:52:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.558+0000 7ff5b6ffd700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 0x7ff5a4062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:04.567 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:04.561+0000 7f2da095b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:52:04.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.566+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff5a804c1c0 con 0x7ff5b806cd40 2023-12-24T19:52:04.735 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:04.729+0000 7f2da095b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:52:04.736 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:04.734+0000 7fc82335a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:52:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.738+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5b806ad90 con 0x7ff5b806cd40 2023-12-24T19:52:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.738+0000 7ff59f7fe700 1 -- 172.21.15.50:0/4191297678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5a804f7e0 con 0x7ff5b806cd40 2023-12-24T19:52:04.743 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 msgr2=0x7ff5a4062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 0x7ff5a4062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 msgr2=0x7ff5b81538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c530 tx=0x7ff5a800c840 comp rx=0 tx=0).stop 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 shutdown_connections 2023-12-24T19:52:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff5a4060730 0x7ff5a4062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5b8158c40 0x7ff5b80cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b80cc780 0x7ff5b80c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 --2- 172.21.15.50:0/4191297678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5b806cd40 0x7ff5b81538c0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 >> 172.21.15.50:0/4191297678 conn(0x7ff5b80d0800 msgr2=0x7ff5b80b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 shutdown_connections 2023-12-24T19:52:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.742+0000 7ff5bcd63700 1 -- 172.21.15.50:0/4191297678 wait complete. 2023-12-24T19:52:04.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:04.918 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:04.914+0000 7fc82335a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:52:04.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.922+0000 7f47ef6f0700 1 Processor -- start 2023-12-24T19:52:04.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 -- start start 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47e80ce750 0x7f47e80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815a5b0 con 0x7f47e8159a20 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e806b7e0 con 0x7f47e80ce750 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ef6f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e806ba80 con 0x7f47e806ae30 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47edc8d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47e8159a20 0x7f47e8159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41790/0 (socket says 172.21.15.50:41790) 2023-12-24T19:52:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47edc8d700 1 -- 172.21.15.50:0/2202072254 learned_addr learned my addr 172.21.15.50:0/2202072254 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ecc8b700 1 --2- 172.21.15.50:0/2202072254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47ed48c700 1 --2- 172.21.15.50:0/2202072254 >> v2:172.21.15.82:3300/0 conn(0x7f47e80ce750 0x7f47e80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47dffff700 1 -- 172.21.15.50:0/2202072254 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922410455 0 0) 0x7f47e0001490 con 0x7f47e8159a20 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.926+0000 7f47dffff700 1 -- 172.21.15.50:0/2202072254 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003570 con 0x7f47e8159a20 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ecc8b700 1 -- 172.21.15.50:0/2202072254 >> v2:172.21.15.82:3300/0 conn(0x7f47e80ce750 msgr2=0x7f47e80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ecc8b700 1 --2- 172.21.15.50:0/2202072254 >> v2:172.21.15.82:3300/0 conn(0x7f47e80ce750 0x7f47e80ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ecc8b700 1 -- 172.21.15.50:0/2202072254 >> v1:172.21.15.82:6789/0 conn(0x7f47e8159a20 legacy=0x7f47e8159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ecc8b700 1 -- 172.21.15.50:0/2202072254 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e806bd60 con 0x7f47e806ae30 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ecc8b700 1 --2- 172.21.15.50:0/2202072254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806b2a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09d05b3075194ce server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47dffff700 1 -- 172.21.15.50:0/2202072254 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8011630 con 0x7f47e806ae30 2023-12-24T19:52:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47dffff700 1 -- 172.21.15.50:0/2202072254 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8011790 con 0x7f47e806ae30 2023-12-24T19:52:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47dffff700 1 -- 172.21.15.50:0/2202072254 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8011b30 con 0x7f47e806ae30 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2202072254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 msgr2=0x7f47e806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2202072254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806b2a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2202072254 shutdown_connections 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2202072254 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806b2a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2202072254 >> v2:172.21.15.82:3300/0 conn(0x7f47e80ce750 0x7f47e80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2202072254 >> 172.21.15.50:0/2202072254 conn(0x7f47e80cffb0 msgr2=0x7f47e80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2202072254 shutdown_connections 2023-12-24T19:52:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.930+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2202072254 wait complete. 2023-12-24T19:52:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 Processor -- start 2023-12-24T19:52:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 -- start start 2023-12-24T19:52:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e80ce750 0x7f47e80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47e8159a20 0x7f47e80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8155f70 con 0x7f47e8159a20 2023-12-24T19:52:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8155360 con 0x7f47e80ce750 2023-12-24T19:52:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.934+0000 7f47ef6f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8155640 con 0x7f47e806ae30 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47edc8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47e8159a20 0x7f47e80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37798/0 (socket says 172.21.15.50:37798) 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 -- 172.21.15.50:0/2748852371 learned_addr learned my addr 172.21.15.50:0/2748852371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ecc8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e80ce750 0x7f47e80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e80ce750 msgr2=0x7f47e80b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e80ce750 0x7f47e80b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47e8159a20 msgr2=0x7f47e80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47e8159a20 0x7f47e80c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 -- 172.21.15.50:0/2748852371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009420 con 0x7f47e806ae30 2023-12-24T19:52:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ed48c700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e400ec80 tx=0x7f47e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400c850 con 0x7f47e806ae30 2023-12-24T19:52:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400c9b0 con 0x7f47e806ae30 2023-12-24T19:52:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8155920 con 0x7f47e806ae30 2023-12-24T19:52:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400cd50 con 0x7f47e806ae30 2023-12-24T19:52:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8156ce0 con 0x7f47e806ae30 2023-12-24T19:52:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.938+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e80652e0 con 0x7f47e806ae30 2023-12-24T19:52:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.942+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f47e4013680 con 0x7f47e806ae30 2023-12-24T19:52:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.942+0000 7f47dd7fa700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 0x7f47cc062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.942+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f47e407d160 con 0x7f47e806ae30 2023-12-24T19:52:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.942+0000 7f47ecc8b700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 msgr2=0x7f47cc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.942+0000 7f47ecc8b700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 0x7f47cc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:04.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:04.950+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47e404d060 con 0x7f47e806ae30 2023-12-24T19:52:05.113 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.105+0000 7f2da095b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:52:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.146+0000 7f47ecc8b700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 msgr2=0x7f47cc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.146+0000 7f47ecc8b700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 0x7f47cc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.158+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47e806c040 con 0x7f47e806ae30 2023-12-24T19:52:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.158+0000 7f47dd7fa700 1 -- 172.21.15.50:0/2748852371 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f47e4050680 con 0x7f47e806ae30 2023-12-24T19:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:52:05.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 msgr2=0x7f47cc062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:05.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 0x7f47cc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 msgr2=0x7f47e806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e400ec80 tx=0x7f47e40091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 shutdown_connections 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f47cc060700 0x7f47cc062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47e8159a20 0x7f47e80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e80ce750 0x7f47e80b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 --2- 172.21.15.50:0/2748852371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47e806ae30 0x7f47e806da50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 >> 172.21.15.50:0/2748852371 conn(0x7f47e80cffb0 msgr2=0x7f47e80c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 shutdown_connections 2023-12-24T19:52:05.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.162+0000 7f47ef6f0700 1 -- 172.21.15.50:0/2748852371 wait complete. 2023-12-24T19:52:05.168 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:52:05.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:05.315 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:05.314+0000 7fc82335a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:52:05.333 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.325+0000 7f2da095b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.350+0000 7f1799f45700 1 Processor -- start 2023-12-24T19:52:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.350+0000 7f1799f45700 1 -- start start 2023-12-24T19:52:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1799f45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1799f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f179406d6f0 0x7f179406db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1799f45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179406d260 con 0x7f17940ccde0 2023-12-24T19:52:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1799f45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940cdb60 con 0x7f1794156bc0 2023-12-24T19:52:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1799f45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940cd8e0 con 0x7f179406d6f0 2023-12-24T19:52:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f17937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f1792ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f179406d6f0 0x7f179406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f17937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59296/0 (socket says 172.21.15.50:59296) 2023-12-24T19:52:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.354+0000 7f17937fe700 1 -- 172.21.15.50:0/3288952587 learned_addr learned my addr 172.21.15.50:0/3288952587 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17927fc700 1 -- 172.21.15.50:0/3288952587 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359725624 0 0) 0x7f179406d260 con 0x7f17940ccde0 2023-12-24T19:52:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17927fc700 1 -- 172.21.15.50:0/3288952587 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f177c003570 con 0x7f17940ccde0 2023-12-24T19:52:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1792ffd700 1 -- 172.21.15.50:0/3288952587 >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 msgr2=0x7f17941584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1792ffd700 1 --2- 172.21.15.50:0/3288952587 >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1792ffd700 1 -- 172.21.15.50:0/3288952587 >> v1:172.21.15.82:6789/0 conn(0x7f17940ccde0 legacy=0x7f17940cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1792ffd700 1 -- 172.21.15.50:0/3288952587 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179406c930 con 0x7f179406d6f0 2023-12-24T19:52:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17937fe700 1 --2- 172.21.15.50:0/3288952587 >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1792ffd700 1 --2- 172.21.15.50:0/3288952587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179406d6f0 0x7f179406db40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17940ac940 tx=0x7f17880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3e44744507b877 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17927fc700 1 -- 172.21.15.50:0/3288952587 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011630 con 0x7f179406d6f0 2023-12-24T19:52:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17927fc700 1 -- 172.21.15.50:0/3288952587 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17880117b0 con 0x7f179406d6f0 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f17927fc700 1 -- 172.21.15.50:0/3288952587 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011b70 con 0x7f179406d6f0 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 -- 172.21.15.50:0/3288952587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179406d6f0 msgr2=0x7f179406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 --2- 172.21.15.50:0/3288952587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179406d6f0 0x7f179406db40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17940ac940 tx=0x7f17880091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 -- 172.21.15.50:0/3288952587 shutdown_connections 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 --2- 172.21.15.50:0/3288952587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179406d6f0 0x7f179406db40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 --2- 172.21.15.50:0/3288952587 >> v2:172.21.15.50:3300/0 conn(0x7f1794156bc0 0x7f17941584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 -- 172.21.15.50:0/3288952587 >> 172.21.15.50:0/3288952587 conn(0x7f17940cde00 msgr2=0x7f17940ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 -- 172.21.15.50:0/3288952587 shutdown_connections 2023-12-24T19:52:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.358+0000 7f1799f45700 1 -- 172.21.15.50:0/3288952587 wait complete. 2023-12-24T19:52:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 Processor -- start 2023-12-24T19:52:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 -- start start 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f179406d6f0 0x7f179416b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1794156bc0 0x7f17941415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17941585a0 con 0x7f17940ccde0 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794158880 con 0x7f1794156bc0 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1799f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794158b60 con 0x7f179406d6f0 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59300/0 (socket says 172.21.15.50:59300) 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 -- 172.21.15.50:0/4117815115 learned_addr learned my addr 172.21.15.50:0/4117815115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1793fff700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1794156bc0 0x7f17941415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f17937fe700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f179406d6f0 0x7f179416b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 -- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f179406d6f0 msgr2=0x7f179416b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f179406d6f0 0x7f179416b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 -- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1794156bc0 msgr2=0x7f17941415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1794156bc0 0x7f17941415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.362+0000 7f1792ffd700 1 -- 172.21.15.50:0/4117815115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840094f0 con 0x7f17940ccde0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f1792ffd700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1788013000 tx=0x7f1788017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178801f070 con 0x7f17940ccde0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788000bc0 con 0x7f17940ccde0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1788009420 con 0x7f17940ccde0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011b50 con 0x7f17940ccde0 2023-12-24T19:52:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1794159120 con 0x7f17940ccde0 2023-12-24T19:52:05.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.366+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17940652e0 con 0x7f17940ccde0 2023-12-24T19:52:05.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.370+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f1788023070 con 0x7f17940ccde0 2023-12-24T19:52:05.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.370+0000 7f177b7fe700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 0x7f1780062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.370+0000 7f17937fe700 1 -- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 msgr2=0x7f1780062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:05.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.370+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f178807e270 con 0x7f17940ccde0 2023-12-24T19:52:05.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.370+0000 7f17937fe700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 0x7f1780062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.378+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f178804e170 con 0x7f17940ccde0 2023-12-24T19:52:05.423 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.417+0000 7f2da095b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:52:05.498 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.493+0000 7f2da095b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:52:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.562+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f179406cc10 con 0x7f17940ccde0 2023-12-24T19:52:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.562+0000 7f177b7fe700 1 -- 172.21.15.50:0/4117815115 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16504 (secure 0 0 0) 0x7f1788051790 con 0x7f17940ccde0 2023-12-24T19:52:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:05.566 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:59.346757+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/276202238":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/3234111717":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/1127027369":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/2322179702":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6837/33814":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6836/33814":"2023-12-25T19:51:59.346658+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 msgr2=0x7f1780062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 0x7f1780062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 msgr2=0x7f17940c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1788013000 tx=0x7f1788017000 comp rx=0 tx=0).stop 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 shutdown_connections 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1780060700 0x7f1780062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1794156bc0 0x7f17941415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17940ccde0 0x7f17940c6fb0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 --2- 172.21.15.50:0/4117815115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f179406d6f0 0x7f179416b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 >> 172.21.15.50:0/4117815115 conn(0x7f17940cde00 msgr2=0x7f17940cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 shutdown_connections 2023-12-24T19:52:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.566+0000 7f1799f45700 1 -- 172.21.15.50:0/4117815115 wait complete. 2023-12-24T19:52:05.571 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:05.570+0000 7fc82335a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:05.583 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.577+0000 7f2da095b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:52:05.591 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T19:52:05.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:05.663 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:05.658+0000 7fc82335a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:52:05.749 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:05.746+0000 7fc82335a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:52:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.754+0000 7f29fd66b700 1 Processor -- start 2023-12-24T19:52:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.754+0000 7f29fd66b700 1 -- start start 2023-12-24T19:52:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.758+0000 7f29fd66b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29f8158dd0 0x7f29f806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.758+0000 7f29fd66b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f81591a0 0x7f29f806bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.758+0000 7f29fd66b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f806c820 con 0x7f29f806c070 2023-12-24T19:52:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.758+0000 7f29fd66b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f806d680 con 0x7f29f8158dd0 2023-12-24T19:52:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.758+0000 7f29fd66b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f806ca70 con 0x7f29f81591a0 2023-12-24T19:52:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29effff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f81591a0 0x7f29f806bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fce6a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f29f806c070 0x7f29f80b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:41812/0 (socket says 172.21.15.50:41812) 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29f8158dd0 0x7f29f806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fce6a700 1 -- 172.21.15.50:0/753032239 learned_addr learned my addr 172.21.15.50:0/753032239 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 -- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f81591a0 msgr2=0x7f29f806bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 --2- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f81591a0 0x7f29f806bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 -- 172.21.15.50:0/753032239 >> v1:172.21.15.82:6789/0 conn(0x7f29f806c070 legacy=0x7f29f80b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 -- 172.21.15.50:0/753032239 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f806cd50 con 0x7f29f8158dd0 2023-12-24T19:52:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f7fff700 1 --2- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8158dd0 0x7f29f806db10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f29e80098e0 tx=0x7f29e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda2f99756d80fb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f77fe700 1 -- 172.21.15.50:0/753032239 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b640 con 0x7f29f8158dd0 2023-12-24T19:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f77fe700 1 -- 172.21.15.50:0/753032239 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800b7a0 con 0x7f29f8158dd0 2023-12-24T19:52:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29f77fe700 1 -- 172.21.15.50:0/753032239 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800bb40 con 0x7f29f8158dd0 2023-12-24T19:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 -- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8158dd0 msgr2=0x7f29f806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 --2- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8158dd0 0x7f29f806db10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f29e80098e0 tx=0x7f29e80091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 -- 172.21.15.50:0/753032239 shutdown_connections 2023-12-24T19:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 --2- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f81591a0 0x7f29f806bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 --2- 172.21.15.50:0/753032239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8158dd0 0x7f29f806db10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 -- 172.21.15.50:0/753032239 >> 172.21.15.50:0/753032239 conn(0x7f29f8067ae0 msgr2=0x7f29f80cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 -- 172.21.15.50:0/753032239 shutdown_connections 2023-12-24T19:52:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.762+0000 7f29fd66b700 1 -- 172.21.15.50:0/753032239 wait complete. 2023-12-24T19:52:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.766+0000 7f29fd66b700 1 Processor -- start 2023-12-24T19:52:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.766+0000 7f29fd66b700 1 -- start start 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f806c070 0x7f29f8149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f81591a0 0x7f29f8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f81572b0 con 0x7f29f8158dd0 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8157590 con 0x7f29f81591a0 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8157870 con 0x7f29f806c070 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59312/0 (socket says 172.21.15.50:59312) 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 -- 172.21.15.50:0/3854337272 learned_addr learned my addr 172.21.15.50:0/3854337272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29f7fff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f806c070 0x7f29f8149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fce6a700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f81591a0 0x7f29f8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f806c070 msgr2=0x7f29f8149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f806c070 0x7f29f8149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f81591a0 msgr2=0x7f29f8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f81591a0 0x7f29f8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 -- 172.21.15.50:0/3854337272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8009420 con 0x7f29f8158dd0 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29effff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f29e000ec80 tx=0x7f29e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000c850 con 0x7f29f8158dd0 2023-12-24T19:52:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e000c9b0 con 0x7f29f8158dd0 2023-12-24T19:52:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000cd50 con 0x7f29f8158dd0 2023-12-24T19:52:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8157b50 con 0x7f29f8158dd0 2023-12-24T19:52:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.770+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f815dca0 con 0x7f29f8158dd0 2023-12-24T19:52:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.774+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f804be40 con 0x7f29f8158dd0 2023-12-24T19:52:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.774+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f29e0013680 con 0x7f29f8158dd0 2023-12-24T19:52:05.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.774+0000 7f29f4ff9700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 0x7f29d8062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:05.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.774+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f29e007d160 con 0x7f29f8158dd0 2023-12-24T19:52:05.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.778+0000 7f29f7fff700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 msgr2=0x7f29d8062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:05.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.778+0000 7f29f7fff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 0x7f29d8062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:05.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.782+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29e004d060 con 0x7f29f8158dd0 2023-12-24T19:52:05.802 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.797+0000 7f2da095b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:05.835 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:05.834+0000 7fc82335a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:52:05.881 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.873+0000 7f2da095b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:52:05.966 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:05.961+0000 7f2da095b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:52:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.982+0000 7f29f7fff700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 msgr2=0x7f29d8062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.982+0000 7f29f7fff700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 0x7f29d8062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:05.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.990+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29f80b4a40 con 0x7f29f8158dd0 2023-12-24T19:52:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.990+0000 7f29f4ff9700 1 -- 172.21.15.50:0/3854337272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f29e0050680 con 0x7f29f8158dd0 2023-12-24T19:52:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:05.994 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:52:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 msgr2=0x7f29d8062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 0x7f29d8062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 msgr2=0x7f29f8156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f29e000ec80 tx=0x7f29e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 shutdown_connections 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f29d8060730 0x7f29d8062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f81591a0 0x7f29f8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f8158dd0 0x7f29f8156780 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 --2- 172.21.15.50:0/3854337272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29f806c070 0x7f29f8149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 >> 172.21.15.50:0/3854337272 conn(0x7f29f8067ae0 msgr2=0x7f29f8062cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 shutdown_connections 2023-12-24T19:52:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:05.994+0000 7f29fd66b700 1 -- 172.21.15.50:0/3854337272 wait complete. 2023-12-24T19:52:06.000 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:52:06.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:06.090 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:06.086+0000 7fc82335a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:06.152 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:06.145+0000 7f2da095b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:52:06.181 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:06.178+0000 7fc82335a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:52:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 Processor -- start 2023-12-24T19:52:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 -- start start 2023-12-24T19:52:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d9c158e00 0x7f6d9c069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 0x7f6d9c0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c06d1e0 con 0x7f6d9c1591d0 2023-12-24T19:52:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c06d480 con 0x7f6d9c158e00 2023-12-24T19:52:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c06d760 con 0x7f6d9c0689e0 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.190+0000 7f6d9a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d9c158e00 0x7f6d9c069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d9c158e00 0x7f6d9c069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59316/0 (socket says 172.21.15.50:59316) 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3545357726 learned_addr learned my addr 172.21.15.50:0/3545357726 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9ad9d700 1 --2- 172.21.15.50:0/3545357726 >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 0x7f6d9c0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3545357726 >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 msgr2=0x7f6d9c0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3545357726 >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 0x7f6d9c0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3545357726 >> v1:172.21.15.82:6789/0 conn(0x7f6d9c1591d0 legacy=0x7f6d9c0682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3545357726 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0af1a0 con 0x7f6d9c158e00 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9ad9d700 1 --2- 172.21.15.50:0/3545357726 >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 0x7f6d9c0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3545357726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c069150 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c069f70 tx=0x7f6d8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53e99f48ce3f8fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9959a700 1 -- 172.21.15.50:0/3545357726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00b860 con 0x7f6d9c158e00 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9959a700 1 -- 172.21.15.50:0/3545357726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00b9c0 con 0x7f6d9c158e00 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9959a700 1 -- 172.21.15.50:0/3545357726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00bd60 con 0x7f6d9c158e00 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3545357726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 msgr2=0x7f6d9c069150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3545357726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c069150 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c069f70 tx=0x7f6d8c009250 comp rx=0 tx=0).stop 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3545357726 shutdown_connections 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3545357726 >> v2:172.21.15.82:3300/0 conn(0x7f6d9c0689e0 0x7f6d9c0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3545357726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c069150 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3545357726 >> 172.21.15.50:0/3545357726 conn(0x7f6d9c0ccd90 msgr2=0x7f6d9c0add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3545357726 shutdown_connections 2023-12-24T19:52:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.194+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3545357726 wait complete. 2023-12-24T19:52:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 Processor -- start 2023-12-24T19:52:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 -- start start 2023-12-24T19:52:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 0x7f6d9c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9c1591d0 0x7f6d9c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0c9de0 con 0x7f6d9c158e00 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0c9ba0 con 0x7f6d9c1591d0 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c15a040 con 0x7f6d9c0689e0 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d99d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d9ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9c1591d0 0x7f6d9c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d99d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59330/0 (socket says 172.21.15.50:59330) 2023-12-24T19:52:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.198+0000 7f6d99d9b700 1 -- 172.21.15.50:0/3353602983 learned_addr learned my addr 172.21.15.50:0/3353602983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 0x7f6d9c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 msgr2=0x7f6d9c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 0x7f6d9c0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9c1591d0 msgr2=0x7f6d9c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9c1591d0 0x7f6d9c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 -- 172.21.15.50:0/3353602983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0094f0 con 0x7f6d9c158e00 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 0x7f6d9c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d99d9b700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000c540 tx=0x7f6d90001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011590 con 0x7f6d9c158e00 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d900116f0 con 0x7f6d9c158e00 2023-12-24T19:52:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011ab0 con 0x7f6d9c158e00 2023-12-24T19:52:06.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c159710 con 0x7f6d9c158e00 2023-12-24T19:52:06.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.202+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c159cd0 con 0x7f6d9c158e00 2023-12-24T19:52:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c0cb0e0 con 0x7f6d9c158e00 2023-12-24T19:52:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f6d9001b3b0 con 0x7f6d9c158e00 2023-12-24T19:52:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d8a7fc700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 0x7f6d7c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f6d9007c310 con 0x7f6d9c158e00 2023-12-24T19:52:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 msgr2=0x7f6d7c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.206+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 0x7f6d7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:06.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.214+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d9004c2c0 con 0x7f6d9c158e00 2023-12-24T19:52:06.236 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:06.229+0000 7f2da095b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:52:06.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:06.286+0000 7fc82335a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:52:06.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.410+0000 7f6d9a59c700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 msgr2=0x7f6d7c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:06.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.410+0000 7f6d9a59c700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 0x7f6d7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.430+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d9c04be40 con 0x7f6d9c158e00 2023-12-24T19:52:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.430+0000 7f6d8a7fc700 1 -- 172.21.15.50:0/3353602983 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f6d9004f8e0 con 0x7f6d9c158e00 2023-12-24T19:52:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:06.433 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:51:40.061618+0000","modified":"2023-12-24T19:51:43.639615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3634441368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3634441368},{"type":"v1","addr":"172.21.15.50:6835","nonce":3634441368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T19:52:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 msgr2=0x7f6d7c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 0x7f6d7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 msgr2=0x7f6d9c0c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000c540 tx=0x7f6d90001070 comp rx=0 tx=0).stop 2023-12-24T19:52:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 shutdown_connections 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6d7c060700 0x7f6d7c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9c1591d0 0x7f6d9c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d9c158e00 0x7f6d9c0c9660 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 --2- 172.21.15.50:0/3353602983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d9c0689e0 0x7f6d9c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 >> 172.21.15.50:0/3353602983 conn(0x7f6d9c0ccd90 msgr2=0x7f6d9c1556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 shutdown_connections 2023-12-24T19:52:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.434+0000 7f6d9b59e700 1 -- 172.21.15.50:0/3353602983 wait complete. 2023-12-24T19:52:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-12-24T19:52:06.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:06.514 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:06.510+0000 7fc82335a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:52:06.614 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:06.610+0000 7fc82335a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:52:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.618+0000 7f34b6723700 1 Processor -- start 2023-12-24T19:52:06.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.618+0000 7f34b6723700 1 -- start start 2023-12-24T19:52:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b6723700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34b01611b0 0x7f34b0161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b6723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b6723700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b006c4d0 con 0x7f34b006c820 2023-12-24T19:52:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b6723700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b006c1f0 con 0x7f34b01611b0 2023-12-24T19:52:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b6723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00ab5e0 con 0x7f34b00ae100 2023-12-24T19:52:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b5f22700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f34b006c820 0x7f34b00ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49184/0 (socket says 172.21.15.50:49184) 2023-12-24T19:52:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b5f22700 1 -- 172.21.15.50:0/1411191319 learned_addr learned my addr 172.21.15.50:0/1411191319 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 --2- 172.21.15.50:0/1411191319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b5721700 1 --2- 172.21.15.50:0/1411191319 >> v2:172.21.15.82:3300/0 conn(0x7f34b01611b0 0x7f34b0161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314091583 0 0) 0x7f34a8001490 con 0x7f34b006c820 2023-12-24T19:52:06.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f349c003570 con 0x7f34b006c820 2023-12-24T19:52:06.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009365226 0 0) 0x7f349c003570 con 0x7f34b006c820 2023-12-24T19:52:06.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 -- 172.21.15.50:0/1411191319 >> v2:172.21.15.82:3300/0 conn(0x7f34b01611b0 msgr2=0x7f34b0161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 --2- 172.21.15.50:0/1411191319 >> v2:172.21.15.82:3300/0 conn(0x7f34b01611b0 0x7f34b0161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 -- 172.21.15.50:0/1411191319 >> v1:172.21.15.50:6789/0 conn(0x7f34b006c820 legacy=0x7f34b00ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 -- 172.21.15.50:0/1411191319 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00ab8c0 con 0x7f34b00ae100 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34b4f20700 1 --2- 172.21.15.50:0/1411191319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b006b9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098e0 tx=0x7f34a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556e699531f363f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8001980 con 0x7f34b00ae100 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011420 con 0x7f34b00ae100 2023-12-24T19:52:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.622+0000 7f34a7fff700 1 -- 172.21.15.50:0/1411191319 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00117c0 con 0x7f34b00ae100 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 -- 172.21.15.50:0/1411191319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 msgr2=0x7f34b006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 --2- 172.21.15.50:0/1411191319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b006b9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098e0 tx=0x7f34a00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 -- 172.21.15.50:0/1411191319 shutdown_connections 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 --2- 172.21.15.50:0/1411191319 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b006b9c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 --2- 172.21.15.50:0/1411191319 >> v2:172.21.15.82:3300/0 conn(0x7f34b01611b0 0x7f34b0161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 -- 172.21.15.50:0/1411191319 >> 172.21.15.50:0/1411191319 conn(0x7f34b0067b80 msgr2=0x7f34b00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 -- 172.21.15.50:0/1411191319 shutdown_connections 2023-12-24T19:52:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 -- 172.21.15.50:0/1411191319 wait complete. 2023-12-24T19:52:06.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.626+0000 7f34b6723700 1 Processor -- start 2023-12-24T19:52:06.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 -- start start 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 0x7f34b00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b0158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0171d90 con 0x7f34b01611b0 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0159430 con 0x7f34b006c820 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0159710 con 0x7f34b00ae100 2023-12-24T19:52:06.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 0x7f34b00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5f22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59340/0 (socket says 172.21.15.50:59340) 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5f22700 1 -- 172.21.15.50:0/897928963 learned_addr learned my addr 172.21.15.50:0/897928963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b4f20700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b0158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 -- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 msgr2=0x7f34b0158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b0158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 -- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 msgr2=0x7f34b0170fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 -- 172.21.15.50:0/897928963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009420 con 0x7f34b006c820 2023-12-24T19:52:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5f22700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b5721700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 0x7f34b00b02a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00ea50 tx=0x7f34ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00ee90 con 0x7f34b006c820 2023-12-24T19:52:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac00c7f0 con 0x7f34b006c820 2023-12-24T19:52:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b01599f0 con 0x7f34b006c820 2023-12-24T19:52:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.630+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00cb90 con 0x7f34b006c820 2023-12-24T19:52:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.634+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b0159fb0 con 0x7f34b006c820 2023-12-24T19:52:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.634+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b004be40 con 0x7f34b006c820 2023-12-24T19:52:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.634+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f34ac013470 con 0x7f34b006c820 2023-12-24T19:52:06.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.638+0000 7f34a57fa700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 0x7f3494062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:06.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.638+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f34ac07d090 con 0x7f34b006c820 2023-12-24T19:52:06.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.638+0000 7f34b4f20700 1 -- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 msgr2=0x7f3494062c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:06.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.638+0000 7f34b4f20700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 0x7f3494062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:06.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.646+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f34ac0acbe0 con 0x7f34b006c820 2023-12-24T19:52:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.822+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34b00aab20 con 0x7f34b006c820 2023-12-24T19:52:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.822+0000 7f34a57fa700 1 -- 172.21.15.50:0/897928963 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16504 (secure 0 0 0) 0x7f34ac04cf90 con 0x7f34b006c820 2023-12-24T19:52:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:06.828 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:51:59.346757+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:51:38.547974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-12-24T19:51:39.055260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/276202238":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/3234111717":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/1127027369":"2023-12-25T19:51:59.346658+0000","172.21.15.50:0/2322179702":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6837/33814":"2023-12-25T19:51:59.346658+0000","172.21.15.50:6836/33814":"2023-12-25T19:51:59.346658+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 msgr2=0x7f3494062c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 0x7f3494062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 msgr2=0x7f34b00b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 0x7f34b00b02a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00ea50 tx=0x7f34ac0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 shutdown_connections 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3494060780 0x7f3494062c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b01611b0 0x7f34b0170fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00ae100 0x7f34b0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 --2- 172.21.15.50:0/897928963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b006c820 0x7f34b00b02a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 >> 172.21.15.50:0/897928963 conn(0x7f34b0067b80 msgr2=0x7f34b0158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 shutdown_connections 2023-12-24T19:52:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:06.826+0000 7f34b6723700 1 -- 172.21.15.50:0/897928963 wait complete. 2023-12-24T19:52:06.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T19:52:06.943 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:06.937+0000 7f2da095b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:52:07.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.030+0000 7fb71fd85700 1 Processor -- start 2023-12-24T19:52:07.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.030+0000 7fb71fd85700 1 -- start start 2023-12-24T19:52:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71fd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb718158e10 0x7fb71815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71fd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b3c90 0x7fb71806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71fd85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71806d5c0 con 0x7fb7180b1ba0 2023-12-24T19:52:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71fd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180b49c0 con 0x7fb718158e10 2023-12-24T19:52:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71fd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71806d040 con 0x7fb7180b3c90 2023-12-24T19:52:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71e322700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7180b1ba0 0x7fb71806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49192/0 (socket says 172.21.15.50:49192) 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71e322700 1 -- 172.21.15.50:0/586678426 learned_addr learned my addr 172.21.15.50:0/586678426 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 --2- 172.21.15.50:0/586678426 >> v2:172.21.15.50:3300/0 conn(0x7fb718158e10 0x7fb71815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71d320700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b3c90 0x7fb71806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 -- 172.21.15.50:0/586678426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b3c90 msgr2=0x7fb71806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b3c90 0x7fb71806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71cb1f700 1 -- 172.21.15.50:0/586678426 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305946511 0 0) 0x7fb71806d5c0 con 0x7fb7180b1ba0 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 -- 172.21.15.50:0/586678426 >> v1:172.21.15.50:6789/0 conn(0x7fb7180b1ba0 legacy=0x7fb71806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 -- 172.21.15.50:0/586678426 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71806df90 con 0x7fb718158e10 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.034+0000 7fb71db21700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb71815d6d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fb7140098e0 tx=0x7fb7140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b029330803cc60 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71cb1f700 1 -- 172.21.15.50:0/586678426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714009e80 con 0x7fb718158e10 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71cb1f700 1 -- 172.21.15.50:0/586678426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400b860 con 0x7fb718158e10 2023-12-24T19:52:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71cb1f700 1 -- 172.21.15.50:0/586678426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400bbe0 con 0x7fb718158e10 2023-12-24T19:52:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 -- 172.21.15.50:0/586678426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 msgr2=0x7fb71815d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb71815d6d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fb7140098e0 tx=0x7fb7140091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 -- 172.21.15.50:0/586678426 shutdown_connections 2023-12-24T19:52:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b3c90 0x7fb71806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 --2- 172.21.15.50:0/586678426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb71815d6d0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 -- 172.21.15.50:0/586678426 >> 172.21.15.50:0/586678426 conn(0x7fb7180670b0 msgr2=0x7fb7180674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 -- 172.21.15.50:0/586678426 shutdown_connections 2023-12-24T19:52:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.038+0000 7fb71fd85700 1 -- 172.21.15.50:0/586678426 wait complete. 2023-12-24T19:52:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 Processor -- start 2023-12-24T19:52:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 -- start start 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b1ba0 0x7fb71814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7180b3c90 0x7fb718156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181560f0 con 0x7fb718158e10 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71814f990 con 0x7fb7180b3c90 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71fd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb718156fe0 con 0x7fb7180b1ba0 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71e322700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71e322700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59366/0 (socket says 172.21.15.50:59366) 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71e322700 1 -- 172.21.15.50:0/1221860271 learned_addr learned my addr 172.21.15.50:0/1221860271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.042+0000 7fb71db21700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b1ba0 0x7fb71814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71d320700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7180b3c90 0x7fb718156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b1ba0 msgr2=0x7fb71814f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b1ba0 0x7fb71814f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7180b3c90 msgr2=0x7fb718156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7180b3c90 0x7fb718156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 -- 172.21.15.50:0/1221860271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009420 con 0x7fb718158e10 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71e322700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb71000cc20 tx=0x7fb7100019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000a870 con 0x7fb718158e10 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000a9d0 con 0x7fb718158e10 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7181572c0 con 0x7fb718158e10 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000ad90 con 0x7fb718158e10 2023-12-24T19:52:07.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb718157880 con 0x7fb718158e10 2023-12-24T19:52:07.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.046+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718155ec0 con 0x7fb718158e10 2023-12-24T19:52:07.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.050+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 84) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fb710007300 con 0x7fb718158e10 2023-12-24T19:52:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.050+0000 7fb70dffb700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 0x7fb6fc062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.050+0000 7fb71db21700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 msgr2=0x7fb6fc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.050+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6687+0+0 (secure 0 0 0) 0x7fb71007d1d0 con 0x7fb718158e10 2023-12-24T19:52:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.050+0000 7fb71db21700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 0x7fb6fc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:07.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.058+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb718155ec0 con 0x7fb718158e10 2023-12-24T19:52:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.254+0000 7fb71db21700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 msgr2=0x7fb6fc062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.254+0000 7fb71db21700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 0x7fb6fc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.326+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb718155ec0 con 0x7fb718158e10 2023-12-24T19:52:07.329 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T19:52:07.326+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T19:52:07.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb70dffb700 1 -- 172.21.15.50:0/1221860271 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb718155ec0 con 0x7fb718158e10 2023-12-24T19:52:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 msgr2=0x7fb6fc062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 0x7fb6fc062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 msgr2=0x7fb718154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb71000cc20 tx=0x7fb7100019b0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 shutdown_connections 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb6fc060700 0x7fb6fc062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718158e10 0x7fb718154360 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7180b3c90 0x7fb718156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 --2- 172.21.15.50:0/1221860271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7180b1ba0 0x7fb71814f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 >> 172.21.15.50:0/1221860271 conn(0x7fb7180670b0 msgr2=0x7fb7181534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 shutdown_connections 2023-12-24T19:52:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.334+0000 7fb71fd85700 1 -- 172.21.15.50:0/1221860271 wait complete. 2023-12-24T19:52:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T19:52:07.345 INFO:tasks.ceph.mds.c.smithi050.stderr: -2240> 2023-12-24T19:51:45.567+0000 7f47e7f79700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:52:07.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T19:52:07.388 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T19:52:07.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.470+0000 7fc82335a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:52:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.506+0000 7f55fa563700 1 Processor -- start 2023-12-24T19:52:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.506+0000 7f55fa563700 1 -- start start 2023-12-24T19:52:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55fa563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55fa563700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55f406d450 0x7f55f40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55fa563700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f406a580 con 0x7f55f40cc780 2023-12-24T19:52:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55fa563700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40cd110 con 0x7f55f406d450 2023-12-24T19:52:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55fa563700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f406a7d0 con 0x7f55f4158c40 2023-12-24T19:52:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37962/0 (socket says 172.21.15.50:37962) 2023-12-24T19:52:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 -- 172.21.15.50:0/433535276 learned_addr learned my addr 172.21.15.50:0/433535276 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9d62700 1 --2- 172.21.15.50:0/433535276 >> v2:172.21.15.82:3300/0 conn(0x7f55f406d450 0x7f55f40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 -- 172.21.15.50:0/433535276 >> v2:172.21.15.82:3300/0 conn(0x7f55f406d450 msgr2=0x7f55f40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 --2- 172.21.15.50:0/433535276 >> v2:172.21.15.82:3300/0 conn(0x7f55f406d450 0x7f55f40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 -- 172.21.15.50:0/433535276 >> v1:172.21.15.82:6789/0 conn(0x7f55f40cc780 legacy=0x7f55f406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.510+0000 7f55f9561700 1 -- 172.21.15.50:0/433535276 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f406aab0 con 0x7f55f4158c40 2023-12-24T19:52:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55f9561700 1 --2- 172.21.15.50:0/433535276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55f00099b0 tx=0x7f55f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6ab9c133e8c9c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55ebfff700 1 -- 172.21.15.50:0/433535276 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0009ea0 con 0x7f55f4158c40 2023-12-24T19:52:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55ebfff700 1 -- 172.21.15.50:0/433535276 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000b860 con 0x7f55f4158c40 2023-12-24T19:52:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55ebfff700 1 -- 172.21.15.50:0/433535276 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000bc00 con 0x7f55f4158c40 2023-12-24T19:52:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 -- 172.21.15.50:0/433535276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 msgr2=0x7f55f40cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 --2- 172.21.15.50:0/433535276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55f00099b0 tx=0x7f55f0009250 comp rx=0 tx=0).stop 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 -- 172.21.15.50:0/433535276 shutdown_connections 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 --2- 172.21.15.50:0/433535276 >> v2:172.21.15.82:3300/0 conn(0x7f55f406d450 0x7f55f40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 --2- 172.21.15.50:0/433535276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f40cf500 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 -- 172.21.15.50:0/433535276 >> 172.21.15.50:0/433535276 conn(0x7f55f40d0800 msgr2=0x7f55f40b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 -- 172.21.15.50:0/433535276 shutdown_connections 2023-12-24T19:52:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 -- 172.21.15.50:0/433535276 wait complete. 2023-12-24T19:52:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.514+0000 7f55fa563700 1 Processor -- start 2023-12-24T19:52:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 -- start start 2023-12-24T19:52:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55f406d450 0x7f55f415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f41433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f41544e0 con 0x7f55f40cc780 2023-12-24T19:52:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f415a930 con 0x7f55f406d450 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f415ac10 con 0x7f55f4158c40 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59434/0 (socket says 172.21.15.50:59434) 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 -- 172.21.15.50:0/797276333 learned_addr learned my addr 172.21.15.50:0/797276333 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f9561700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55f406d450 0x7f55f415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f9d62700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f41433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 -- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 msgr2=0x7f55f41433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f41433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 -- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55f406d450 msgr2=0x7f55f415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55f406d450 0x7f55f415bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 -- 172.21.15.50:0/797276333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00094f0 con 0x7f55f40cc780 2023-12-24T19:52:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55f8d60700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c590 tx=0x7f55e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011590 con 0x7f55f40cc780 2023-12-24T19:52:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4011710 con 0x7f55f40cc780 2023-12-24T19:52:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f415aef0 con 0x7f55f40cc780 2023-12-24T19:52:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.518+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011ad0 con 0x7f55f40cc780 2023-12-24T19:52:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.522+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f415b4b0 con 0x7f55f40cc780 2023-12-24T19:52:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.522+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f404be40 con 0x7f55f40cc780 2023-12-24T19:52:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.522+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 86) v1 ==== 79672+0+0 (secure 0 0 0) 0x7f55e401b3b0 con 0x7f55f40cc780 2023-12-24T19:52:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.526+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7074+0+0 (secure 0 0 0) 0x7f55e407bd30 con 0x7f55f40cc780 2023-12-24T19:52:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.530+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f55e404c090 con 0x7f55f40cc780 2023-12-24T19:52:07.577 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7edf9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7edf9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7edf9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7edf9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7edf9a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7e9791700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7e9791700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7e9791700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.578 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7e9791700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.579 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:07.574+0000 7fc7e9791700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:07.750+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55f406ad90 con 0x7f55f40cc780 2023-12-24T19:52:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.338+0000 7f55e97fa700 1 -- 172.21.15.50:0/797276333 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55e404f6b0 con 0x7f55f40cc780 2023-12-24T19:52:08.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.342+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 msgr2=0x7f55f40c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:08.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.342+0000 7f55fa563700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c590 tx=0x7f55e400c8a0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 shutdown_connections 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55f4158c40 0x7f55f41433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f40cc780 0x7f55f40c6c10 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 --2- 172.21.15.50:0/797276333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55f406d450 0x7f55f415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 >> 172.21.15.50:0/797276333 conn(0x7f55f40d0800 msgr2=0x7f55f40b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 shutdown_connections 2023-12-24T19:52:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.346+0000 7f55fa563700 1 -- 172.21.15.50:0/797276333 wait complete. 2023-12-24T19:52:08.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T19:52:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.598+0000 7f2954b63700 1 Processor -- start 2023-12-24T19:52:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.602+0000 7f2954b63700 1 -- start start 2023-12-24T19:52:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.602+0000 7f2954b63700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2950158f20 0x7f295015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.602+0000 7f2954b63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f295006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.602+0000 7f2954b63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295015dc50 con 0x7f295006abe0 2023-12-24T19:52:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500c7190 con 0x7f2950158f20 2023-12-24T19:52:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500c9bb0 con 0x7f29501592f0 2023-12-24T19:52:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2950158f20 0x7f295015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2950158f20 0x7f295015d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59544/0 (socket says 172.21.15.50:59544) 2023-12-24T19:52:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 -- 172.21.15.50:0/3456013469 learned_addr learned my addr 172.21.15.50:0/3456013469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294effd700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f295006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 -- 172.21.15.50:0/3456013469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 msgr2=0x7f295006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f295006a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 -- 172.21.15.50:0/3456013469 >> v1:172.21.15.82:6789/0 conn(0x7f295006abe0 legacy=0x7f29500c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 -- 172.21.15.50:0/3456013469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500c9e90 con 0x7f2950158f20 2023-12-24T19:52:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f295015d710 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f29400099b0 tx=0x7f2940009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda1507bfcd41b42 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294e7fc700 1 -- 172.21.15.50:0/3456013469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000b860 con 0x7f2950158f20 2023-12-24T19:52:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294e7fc700 1 -- 172.21.15.50:0/3456013469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000b9c0 con 0x7f2950158f20 2023-12-24T19:52:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f294e7fc700 1 -- 172.21.15.50:0/3456013469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000bd60 con 0x7f2950158f20 2023-12-24T19:52:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- 172.21.15.50:0/3456013469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 msgr2=0x7f295015d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f295015d710 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f29400099b0 tx=0x7f2940009250 comp rx=0 tx=0).stop 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- 172.21.15.50:0/3456013469 shutdown_connections 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f295006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 --2- 172.21.15.50:0/3456013469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f295015d710 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- 172.21.15.50:0/3456013469 >> 172.21.15.50:0/3456013469 conn(0x7f2950067b40 msgr2=0x7f29500cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- 172.21.15.50:0/3456013469 shutdown_connections 2023-12-24T19:52:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.606+0000 7f2954b63700 1 -- 172.21.15.50:0/3456013469 wait complete. 2023-12-24T19:52:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 Processor -- start 2023-12-24T19:52:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 -- start start 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 0x7f29501509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f29501569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500af800 con 0x7f2950158f20 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500aec10 con 0x7f295006abe0 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f2954b63700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500aeed0 con 0x7f29501592f0 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59550/0 (socket says 172.21.15.50:59550) 2023-12-24T19:52:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 -- 172.21.15.50:0/3097661282 learned_addr learned my addr 172.21.15.50:0/3097661282 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 0x7f29501509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294ffff700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f29501569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 -- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 msgr2=0x7f29501569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f29501569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 -- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 msgr2=0x7f29501509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 0x7f29501509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294effd700 1 -- 172.21.15.50:0/3097661282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400094f0 con 0x7f2950158f20 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.610+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 0x7f29501509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f294effd700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f294400d890 tx=0x7f2944008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440125f0 con 0x7f2950158f20 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2944012770 con 0x7f2950158f20 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29500af1b0 con 0x7f2950158f20 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944012b30 con 0x7f2950158f20 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29501541e0 con 0x7f2950158f20 2023-12-24T19:52:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.614+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29500af970 con 0x7f2950158f20 2023-12-24T19:52:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.618+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 87) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f294401e460 con 0x7f2950158f20 2023-12-24T19:52:08.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.618+0000 7f29377fe700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 0x7f293c062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:08.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.618+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7074+0+0 (secure 0 0 0) 0x7f294407d100 con 0x7f2950158f20 2023-12-24T19:52:08.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.618+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 0x7f293c062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:08.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.618+0000 7f294f7fe700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 0x7f293c062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29400099b0 tx=0x7f2940017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.622+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f294404d440 con 0x7f2950158f20 2023-12-24T19:52:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:08.798+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f295004be40 con 0x7f2950158f20 2023-12-24T19:52:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.510+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f294404d810 con 0x7f2950158f20 2023-12-24T19:52:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.510+0000 7f29377fe700 1 -- 172.21.15.50:0/3097661282 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7f29440499a0 con 0x7f2950158f20 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 msgr2=0x7f293c062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 0x7f293c062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29400099b0 tx=0x7f2940017000 comp rx=0 tx=0).stop 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 msgr2=0x7f2950152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f294400d890 tx=0x7f2944008040 comp rx=0 tx=0).stop 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 shutdown_connections 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f293c0603a0 0x7f293c062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29501592f0 0x7f29501569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2950158f20 0x7f2950152e00 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 --2- 172.21.15.50:0/3097661282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295006abe0 0x7f29501509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.514+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 >> 172.21.15.50:0/3097661282 conn(0x7f2950067b40 msgr2=0x7f29500c8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.518+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 shutdown_connections 2023-12-24T19:52:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.518+0000 7f2954b63700 1 -- 172.21.15.50:0/3097661282 wait complete. 2023-12-24T19:52:09.521 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T19:52:09.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T19:52:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 Processor -- start 2023-12-24T19:52:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 -- start start 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33840b1460 0x7f33841574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f338415b6e0 0x7f3384157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3384157f50 con 0x7f3384154820 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338415b250 con 0x7f33840b1460 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.702+0000 7f338c785700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840ae550 con 0x7f338415b6e0 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33840b1460 0x7f33841574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338a521700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3384154820 0x7f33840b0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46288/0 (socket says 172.21.15.50:46288) 2023-12-24T19:52:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338a521700 1 -- 172.21.15.50:0/1343993046 learned_addr learned my addr 172.21.15.50:0/1343993046 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338ad22700 1 --2- 172.21.15.50:0/1343993046 >> v2:172.21.15.82:3300/0 conn(0x7f338415b6e0 0x7f3384157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 -- 172.21.15.50:0/1343993046 >> v2:172.21.15.82:3300/0 conn(0x7f338415b6e0 msgr2=0x7f3384157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 --2- 172.21.15.50:0/1343993046 >> v2:172.21.15.82:3300/0 conn(0x7f338415b6e0 0x7f3384157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 -- 172.21.15.50:0/1343993046 >> v1:172.21.15.50:6789/0 conn(0x7f3384154820 legacy=0x7f33840b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 -- 172.21.15.50:0/1343993046 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384158470 con 0x7f33840b1460 2023-12-24T19:52:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338951f700 1 -- 172.21.15.50:0/1343993046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420507138 0 0) 0x7f3380001110 con 0x7f3384154820 2023-12-24T19:52:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f3389d20700 1 --2- 172.21.15.50:0/1343993046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b1460 0x7f33841574d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f33840ca040 tx=0x7f33740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc6fde865773421 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338951f700 1 -- 172.21.15.50:0/1343993046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400b6b0 con 0x7f33840b1460 2023-12-24T19:52:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338951f700 1 -- 172.21.15.50:0/1343993046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400b810 con 0x7f33840b1460 2023-12-24T19:52:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338951f700 1 -- 172.21.15.50:0/1343993046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400bbb0 con 0x7f33840b1460 2023-12-24T19:52:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 -- 172.21.15.50:0/1343993046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b1460 msgr2=0x7f33841574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 --2- 172.21.15.50:0/1343993046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b1460 0x7f33841574d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f33840ca040 tx=0x7f33740091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 -- 172.21.15.50:0/1343993046 shutdown_connections 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 --2- 172.21.15.50:0/1343993046 >> v2:172.21.15.82:3300/0 conn(0x7f338415b6e0 0x7f3384157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 --2- 172.21.15.50:0/1343993046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b1460 0x7f33841574d0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 -- 172.21.15.50:0/1343993046 >> 172.21.15.50:0/1343993046 conn(0x7f3384067b80 msgr2=0x7f33840ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 -- 172.21.15.50:0/1343993046 shutdown_connections 2023-12-24T19:52:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.706+0000 7f338c785700 1 -- 172.21.15.50:0/1343993046 wait complete. 2023-12-24T19:52:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.710+0000 7f338c785700 1 Processor -- start 2023-12-24T19:52:09.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.710+0000 7f338c785700 1 -- start start 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 0x7f33841435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3384154820 0x7f33840caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338416d060 con 0x7f338415b6e0 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338416d340 con 0x7f3384154820 2023-12-24T19:52:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338416d620 con 0x7f33840b1460 2023-12-24T19:52:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55644/0 (socket says 172.21.15.50:55644) 2023-12-24T19:52:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 -- 172.21.15.50:0/84833055 learned_addr learned my addr 172.21.15.50:0/84833055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338a521700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 0x7f33841435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f3389d20700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3384154820 0x7f33840caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 -- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 msgr2=0x7f33841435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 0x7f33841435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 -- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3384154820 msgr2=0x7f33840caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3384154820 0x7f33840caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 -- 172.21.15.50:0/84833055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374009420 con 0x7f338415b6e0 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338a521700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 0x7f33841435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338ad22700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f337c007f20 tx=0x7f337c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00eca0 con 0x7f338415b6e0 2023-12-24T19:52:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c00ee20 con 0x7f338415b6e0 2023-12-24T19:52:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c014670 con 0x7f338415b6e0 2023-12-24T19:52:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338416d900 con 0x7f338415b6e0 2023-12-24T19:52:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.714+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3384143c90 con 0x7f338415b6e0 2023-12-24T19:52:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.718+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338416de20 con 0x7f338415b6e0 2023-12-24T19:52:09.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.718+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f337c0149e0 con 0x7f338415b6e0 2023-12-24T19:52:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.718+0000 7f337a7fc700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 0x7f3368062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.718+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f337c07d340 con 0x7f338415b6e0 2023-12-24T19:52:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.722+0000 7f338a521700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 0x7f3368062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.722+0000 7f338a521700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 0x7f3368062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3380001940 tx=0x7f3380009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.726+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f338416de20 con 0x7f338415b6e0 2023-12-24T19:52:09.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:09.898+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f338416de20 con 0x7f338415b6e0 2023-12-24T19:52:10.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.522+0000 7f337a7fc700 1 -- 172.21.15.50:0/84833055 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7f338416de20 con 0x7f338415b6e0 2023-12-24T19:52:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 msgr2=0x7f3368062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 0x7f3368062a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3380001940 tx=0x7f3380009040 comp rx=0 tx=0).stop 2023-12-24T19:52:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 msgr2=0x7f33840cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f337c007f20 tx=0x7f337c009860 comp rx=0 tx=0).stop 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 shutdown_connections 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f3368060550 0x7f3368062a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338415b6e0 0x7f33840cb470 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3384154820 0x7f33840caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 --2- 172.21.15.50:0/84833055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33840b1460 0x7f33841435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.526+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 >> 172.21.15.50:0/84833055 conn(0x7f3384067b80 msgr2=0x7f33841589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.530+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 shutdown_connections 2023-12-24T19:52:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.530+0000 7f338c785700 1 -- 172.21.15.50:0/84833055 wait complete. 2023-12-24T19:52:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T19:52:10.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T19:52:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.722+0000 7f926da78700 1 Processor -- start 2023-12-24T19:52:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.722+0000 7f926da78700 1 -- start start 2023-12-24T19:52:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f926da78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92680cf4d0 0x7f926806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f926da78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92680cf8a0 0x7f926806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f926da78700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680cd680 con 0x7f926806ac40 2023-12-24T19:52:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f926da78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9268159640 con 0x7f92680cf8a0 2023-12-24T19:52:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f926da78700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926806b030 con 0x7f92680cf4d0 2023-12-24T19:52:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92680cf8a0 0x7f926806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92680cf8a0 0x7f926806a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55654/0 (socket says 172.21.15.50:55654) 2023-12-24T19:52:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 -- 172.21.15.50:0/1091578381 learned_addr learned my addr 172.21.15.50:0/1091578381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f92677fe700 1 --2- 172.21.15.50:0/1091578381 >> v2:172.21.15.82:3300/0 conn(0x7f92680cf4d0 0x7f926806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 -- 172.21.15.50:0/1091578381 >> v2:172.21.15.82:3300/0 conn(0x7f92680cf4d0 msgr2=0x7f926806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 --2- 172.21.15.50:0/1091578381 >> v2:172.21.15.82:3300/0 conn(0x7f92680cf4d0 0x7f926806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 -- 172.21.15.50:0/1091578381 >> v1:172.21.15.82:6789/0 conn(0x7f926806ac40 legacy=0x7f926815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 -- 172.21.15.50:0/1091578381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680cca70 con 0x7f92680cf8a0 2023-12-24T19:52:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.726+0000 7f9266ffd700 1 --2- 172.21.15.50:0/1091578381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92680cf8a0 0x7f926806a700 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9268063780 tx=0x7f925c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee2272d876f005a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f92667fc700 1 -- 172.21.15.50:0/1091578381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c009e70 con 0x7f92680cf8a0 2023-12-24T19:52:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f92667fc700 1 -- 172.21.15.50:0/1091578381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00b860 con 0x7f92680cf8a0 2023-12-24T19:52:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f92667fc700 1 -- 172.21.15.50:0/1091578381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00bc20 con 0x7f92680cf8a0 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 -- 172.21.15.50:0/1091578381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92680cf8a0 msgr2=0x7f926806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 --2- 172.21.15.50:0/1091578381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92680cf8a0 0x7f926806a700 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9268063780 tx=0x7f925c009250 comp rx=0 tx=0).stop 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 -- 172.21.15.50:0/1091578381 shutdown_connections 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 --2- 172.21.15.50:0/1091578381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92680cf8a0 0x7f926806a700 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 --2- 172.21.15.50:0/1091578381 >> v2:172.21.15.82:3300/0 conn(0x7f92680cf4d0 0x7f926806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 -- 172.21.15.50:0/1091578381 >> 172.21.15.50:0/1091578381 conn(0x7f9268067b30 msgr2=0x7f92680cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 -- 172.21.15.50:0/1091578381 shutdown_connections 2023-12-24T19:52:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.730+0000 7f926da78700 1 -- 172.21.15.50:0/1091578381 wait complete. 2023-12-24T19:52:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 Processor -- start 2023-12-24T19:52:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 -- start start 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92680cf4d0 0x7f92681566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92680cf8a0 0x7f926814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9268171790 con 0x7f926806ac40 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9268170b80 con 0x7f92680cf8a0 2023-12-24T19:52:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f926da78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9268170e60 con 0x7f92680cf4d0 2023-12-24T19:52:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55656/0 (socket says 172.21.15.50:55656) 2023-12-24T19:52:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 -- 172.21.15.50:0/1595592814 learned_addr learned my addr 172.21.15.50:0/1595592814 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f9267fff700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92680cf8a0 0x7f926814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f9266ffd700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92680cf4d0 0x7f92681566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 -- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92680cf4d0 msgr2=0x7f92681566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92680cf4d0 0x7f92681566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 -- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92680cf8a0 msgr2=0x7f926814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92680cf8a0 0x7f926814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 -- 172.21.15.50:0/1595592814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0094f0 con 0x7f926806ac40 2023-12-24T19:52:10.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:52:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.734+0000 7f92677fe700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f925800ec80 tx=0x7f92580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800c850 con 0x7f926806ac40 2023-12-24T19:52:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800c9b0 con 0x7f926806ac40 2023-12-24T19:52:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800cd50 con 0x7f926806ac40 2023-12-24T19:52:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9268171140 con 0x7f926806ac40 2023-12-24T19:52:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926814e3f0 con 0x7f926806ac40 2023-12-24T19:52:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680652e0 con 0x7f926806ac40 2023-12-24T19:52:10.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:52:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.738+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9258013680 con 0x7f926806ac40 2023-12-24T19:52:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.742+0000 7f924f7fe700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 0x7f9254062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.742+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f925807ccd0 con 0x7f926806ac40 2023-12-24T19:52:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.742+0000 7f9266ffd700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 0x7f9254062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.742+0000 7f9266ffd700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 0x7f9254062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9268063780 tx=0x7f925c017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:10.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.746+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f925804d020 con 0x7f926806ac40 2023-12-24T19:52:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.922+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f92680ccd50 con 0x7f926806ac40 2023-12-24T19:52:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.930+0000 7f924f7fe700 1 -- 172.21.15.50:0/1595592814 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v55) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9258050640 con 0x7f926806ac40 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 msgr2=0x7f9254062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 0x7f9254062a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9268063780 tx=0x7f925c017000 comp rx=0 tx=0).stop 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 msgr2=0x7f9268157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f925800ec80 tx=0x7f92580091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 shutdown_connections 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9254060580 0x7f9254062a30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92680cf8a0 0x7f926814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92680cf4d0 0x7f92681566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 --2- 172.21.15.50:0/1595592814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926806ac40 0x7f9268157380 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 >> 172.21.15.50:0/1595592814 conn(0x7f9268067b30 msgr2=0x7f92680cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 shutdown_connections 2023-12-24T19:52:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:10.934+0000 7f926da78700 1 -- 172.21.15.50:0/1595592814 wait complete. 2023-12-24T19:52:10.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T19:52:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.126+0000 7fb3116cd700 1 Processor -- start 2023-12-24T19:52:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.126+0000 7fb3116cd700 1 -- start start 2023-12-24T19:52:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb3116cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb30c0cb3c0 0x7fb30c0ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb3116cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0adfb0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb3116cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0c93c0 con 0x7fb30c1554a0 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb3116cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0ae960 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb30c0b0f20 0x7fb30c15d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46302/0 (socket says 172.21.15.50:46302) 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30a7fc700 1 -- 172.21.15.50:0/2793107955 learned_addr learned my addr 172.21.15.50:0/2793107955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30affd700 1 --1- 172.21.15.50:0/2793107955 >> v1:172.21.15.82:6789/0 conn(0x7fb30c1554a0 0x7fb30c0b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35154/0 (socket says 172.21.15.50:35154) 2023-12-24T19:52:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30b7fe700 1 --2- 172.21.15.50:0/2793107955 >> v2:172.21.15.50:3300/0 conn(0x7fb30c0cb3c0 0x7fb30c0ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453144846 0 0) 0x7fb30c0c93c0 con 0x7fb30c1554a0 2023-12-24T19:52:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4004680 con 0x7fb30c1554a0 2023-12-24T19:52:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30b7fe700 1 -- 172.21.15.50:0/2793107955 >> v1:172.21.15.82:6789/0 conn(0x7fb30c1554a0 legacy=0x7fb30c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30b7fe700 1 -- 172.21.15.50:0/2793107955 >> v1:172.21.15.50:6789/0 conn(0x7fb30c0b0f20 legacy=0x7fb30c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557589566 0 0) 0x7fb30c0adfb0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.130+0000 7fb30b7fe700 1 -- 172.21.15.50:0/2793107955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0b0180 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb30b7fe700 1 --2- 172.21.15.50:0/2793107955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0cb3c0 0x7fb30c0ae420 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb304009e60 tx=0x7fb304009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af39144edc0343 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400e070 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400bb60 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb309ffb700 1 -- 172.21.15.50:0/2793107955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304012430 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 -- 172.21.15.50:0/2793107955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0cb3c0 msgr2=0x7fb30c0ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2793107955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0cb3c0 0x7fb30c0ae420 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb304009e60 tx=0x7fb304009780 comp rx=0 tx=0).stop 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 -- 172.21.15.50:0/2793107955 shutdown_connections 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2793107955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0cb3c0 0x7fb30c0ae420 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 -- 172.21.15.50:0/2793107955 >> 172.21.15.50:0/2793107955 conn(0x7fb30c06c820 msgr2=0x7fb30c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 -- 172.21.15.50:0/2793107955 shutdown_connections 2023-12-24T19:52:11.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.134+0000 7fb3116cd700 1 -- 172.21.15.50:0/2793107955 wait complete. 2023-12-24T19:52:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 Processor -- start 2023-12-24T19:52:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 -- start start 2023-12-24T19:52:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 0x7fb30c143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c1554a0 0x7fb30c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14dfc0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c147890 con 0x7fb30c1554a0 2023-12-24T19:52:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb3116cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c153f40 con 0x7fb30c0cb3c0 2023-12-24T19:52:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55682/0 (socket says 172.21.15.50:55682) 2023-12-24T19:52:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 -- 172.21.15.50:0/2729693120 learned_addr learned my addr 172.21.15.50:0/2729693120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30a7fc700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 0x7fb30c143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30b7fe700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c1554a0 0x7fb30c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 -- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 msgr2=0x7fb30c143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 0x7fb30c143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 -- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c1554a0 msgr2=0x7fb30c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c1554a0 0x7fb30c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 -- 172.21.15.50:0/2729693120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009a20 con 0x7fb30c0b0f20 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30a7fc700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 0x7fb30c143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.138+0000 7fb30affd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c7c0 tx=0x7fb2fc007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc005b40 con 0x7fb30c0b0f20 2023-12-24T19:52:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc005ca0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c1532b0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc007320 con 0x7fb30c0b0f20 2023-12-24T19:52:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c147520 con 0x7fb30c0b0f20 2023-12-24T19:52:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.142+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0652e0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.146+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb2fc01b3b0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.146+0000 7fb2f2ffd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 0x7fb2f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.146+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fb2fc07bef0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.146+0000 7fb30a7fc700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 0x7fb2f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.146+0000 7fb30a7fc700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 0x7fb2f8062a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb30c068020 tx=0x7fb300009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.150+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2fc04c240 con 0x7fb30c0b0f20 2023-12-24T19:52:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.342+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb30c146fc0 con 0x7fb30c0b0f20 2023-12-24T19:52:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.346+0000 7fb2f2ffd700 1 -- 172.21.15.50:0/2729693120 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb2fc04f860 con 0x7fb30c0b0f20 2023-12-24T19:52:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 msgr2=0x7fb2f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 0x7fb2f8062a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb30c068020 tx=0x7fb300009040 comp rx=0 tx=0).stop 2023-12-24T19:52:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 msgr2=0x7fb30c14da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c7c0 tx=0x7fb2fc007dc0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 shutdown_connections 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb2f8060580 0x7fb2f8062a30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c1554a0 0x7fb30c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb30c0cb3c0 0x7fb30c143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 --2- 172.21.15.50:0/2729693120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c0b0f20 0x7fb30c14da80 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 >> 172.21.15.50:0/2729693120 conn(0x7fb30c06c820 msgr2=0x7fb30c0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 shutdown_connections 2023-12-24T19:52:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.350+0000 7fb3116cd700 1 -- 172.21.15.50:0/2729693120 wait complete. 2023-12-24T19:52:11.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T19:52:11.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 Processor -- start 2023-12-24T19:52:11.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 -- start start 2023-12-24T19:52:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8068159180 0x7f806806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f806806ac40 0x7f806806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806806b0a0 con 0x7f8068158db0 2023-12-24T19:52:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806806cca0 con 0x7f806806ac40 2023-12-24T19:52:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806ce2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680a9cc0 con 0x7f8068159180 2023-12-24T19:52:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f8065d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8068159180 0x7f806806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.538+0000 7f806659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8068158db0 0x7f80680a9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35166/0 (socket says 172.21.15.50:35166) 2023-12-24T19:52:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806659c700 1 -- 172.21.15.50:0/2193694320 learned_addr learned my addr 172.21.15.50:0/2193694320 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 --2- 172.21.15.50:0/2193694320 >> v2:172.21.15.50:3300/0 conn(0x7f806806ac40 0x7f806806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806559a700 1 -- 172.21.15.50:0/2193694320 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425484885 0 0) 0x7f8058001490 con 0x7f8068158db0 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806559a700 1 -- 172.21.15.50:0/2193694320 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8050003570 con 0x7f8068158db0 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 -- 172.21.15.50:0/2193694320 >> v2:172.21.15.82:3300/0 conn(0x7f8068159180 msgr2=0x7f806806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 --2- 172.21.15.50:0/2193694320 >> v2:172.21.15.82:3300/0 conn(0x7f8068159180 0x7f806806a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 -- 172.21.15.50:0/2193694320 >> v1:172.21.15.82:6789/0 conn(0x7f8068158db0 legacy=0x7f80680a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 -- 172.21.15.50:0/2193694320 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680a9fa0 con 0x7f806806ac40 2023-12-24T19:52:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f8066d9d700 1 --2- 172.21.15.50:0/2193694320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806806d130 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f80680b1c90 tx=0x7f80600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38acb9cf4503a1ea server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806559a700 1 -- 172.21.15.50:0/2193694320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011630 con 0x7f806806ac40 2023-12-24T19:52:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806559a700 1 -- 172.21.15.50:0/2193694320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80600117b0 con 0x7f806806ac40 2023-12-24T19:52:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806559a700 1 -- 172.21.15.50:0/2193694320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011b70 con 0x7f806806ac40 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 -- 172.21.15.50:0/2193694320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 msgr2=0x7f806806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 --2- 172.21.15.50:0/2193694320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806806d130 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f80680b1c90 tx=0x7f80600091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 -- 172.21.15.50:0/2193694320 shutdown_connections 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 --2- 172.21.15.50:0/2193694320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806806d130 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 --2- 172.21.15.50:0/2193694320 >> v2:172.21.15.82:3300/0 conn(0x7f8068159180 0x7f806806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 -- 172.21.15.50:0/2193694320 >> 172.21.15.50:0/2193694320 conn(0x7f8068067b80 msgr2=0x7f80680cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 -- 172.21.15.50:0/2193694320 shutdown_connections 2023-12-24T19:52:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.542+0000 7f806ce2e700 1 -- 172.21.15.50:0/2193694320 wait complete. 2023-12-24T19:52:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.546+0000 7f806ce2e700 1 Processor -- start 2023-12-24T19:52:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.546+0000 7f806ce2e700 1 -- start start 2023-12-24T19:52:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8068158db0 0x7f80681573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 0x7f8068157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c0940 con 0x7f806806ac40 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c11e0 con 0x7f8068158db0 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c2360 con 0x7f8068159180 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55706/0 (socket says 172.21.15.50:55706) 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 -- 172.21.15.50:0/272589754 learned_addr learned my addr 172.21.15.50:0/272589754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f8065d9b700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8068158db0 0x7f80681573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f8066d9d700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 0x7f8068157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 -- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 msgr2=0x7f8068157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 0x7f8068157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 -- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8068158db0 msgr2=0x7f80681573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8068158db0 0x7f80681573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 -- 172.21.15.50:0/272589754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009420 con 0x7f806806ac40 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f8066d9d700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 0x7f8068157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806659c700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f805800cd60 tx=0x7f8058001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805800ce60 con 0x7f806806ac40 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805800ab30 con 0x7f806806ac40 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80680c0b90 con 0x7f806806ac40 2023-12-24T19:52:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580070f0 con 0x7f806806ac40 2023-12-24T19:52:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.550+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8068156e50 con 0x7f806806ac40 2023-12-24T19:52:11.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.554+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80680652e0 con 0x7f806806ac40 2023-12-24T19:52:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.554+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f80580074a0 con 0x7f806806ac40 2023-12-24T19:52:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.554+0000 7f80567fc700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 0x7f8048062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.558+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f805807cca0 con 0x7f806806ac40 2023-12-24T19:52:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.558+0000 7f8065d9b700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 0x7f8048062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.558+0000 7f8065d9b700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 0x7f8048062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80681563f0 tx=0x7f805c0091a0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.562+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f805804d070 con 0x7f806806ac40 2023-12-24T19:52:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.734+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f806806b0a0 con 0x7f806806ac40 2023-12-24T19:52:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.742+0000 7f80567fc700 1 -- 172.21.15.50:0/272589754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f806806b0a0 con 0x7f806806ac40 2023-12-24T19:52:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 msgr2=0x7f8048062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 0x7f8048062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80681563f0 tx=0x7f805c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 msgr2=0x7f806816d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f805800cd60 tx=0x7f8058001ad0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 shutdown_connections 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8048060550 0x7f8048062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8068159180 0x7f8068157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8068158db0 0x7f80681573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 --2- 172.21.15.50:0/272589754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f806806ac40 0x7f806816d310 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 >> 172.21.15.50:0/272589754 conn(0x7f8068067b80 msgr2=0x7f8068153440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 shutdown_connections 2023-12-24T19:52:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.746+0000 7f806ce2e700 1 -- 172.21.15.50:0/272589754 wait complete. 2023-12-24T19:52:11.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-12-24T19:52:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.934+0000 7fe7acd85700 1 Processor -- start 2023-12-24T19:52:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.934+0000 7fe7acd85700 1 -- start start 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a80ce750 0x7fe7a80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7a806ae30 0x7fe7a806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 0x7fe7a8159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a806b7e0 con 0x7fe7a806ae30 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a806ba80 con 0x7fe7a8159a20 2023-12-24T19:52:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7acd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a806bd60 con 0x7fe7a80ce750 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7a806ae30 0x7fe7a806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 0x7fe7a8159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7a806ae30 0x7fe7a806b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55708/0 (socket says 172.21.15.50:55708) 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/3087264511 learned_addr learned my addr 172.21.15.50:0/3087264511 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a659c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a80ce750 0x7fe7a80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/3087264511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a80ce750 msgr2=0x7fe7a80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/3087264511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a80ce750 0x7fe7a80ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/3087264511 >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 msgr2=0x7fe7a8159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/3087264511 >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 0x7fe7a8159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/3087264511 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a806c040 con 0x7fe7a806ae30 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.938+0000 7fe7a6d9d700 1 --2- 172.21.15.50:0/3087264511 >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 0x7fe7a8159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/3087264511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a806ae30 0x7fe7a806b2a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80634c0 tx=0x7fe79c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cd8270632aafc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7a559a700 1 -- 172.21.15.50:0/3087264511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00b640 con 0x7fe7a806ae30 2023-12-24T19:52:11.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7a559a700 1 -- 172.21.15.50:0/3087264511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00b7a0 con 0x7fe7a806ae30 2023-12-24T19:52:11.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7a559a700 1 -- 172.21.15.50:0/3087264511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00bb60 con 0x7fe7a806ae30 2023-12-24T19:52:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- 172.21.15.50:0/3087264511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a806ae30 msgr2=0x7fe7a806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 --2- 172.21.15.50:0/3087264511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a806ae30 0x7fe7a806b2a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80634c0 tx=0x7fe79c009250 comp rx=0 tx=0).stop 2023-12-24T19:52:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- 172.21.15.50:0/3087264511 shutdown_connections 2023-12-24T19:52:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 --2- 172.21.15.50:0/3087264511 >> v2:172.21.15.82:3300/0 conn(0x7fe7a8159a20 0x7fe7a8159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 --2- 172.21.15.50:0/3087264511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a806ae30 0x7fe7a806b2a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 --2- 172.21.15.50:0/3087264511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a80ce750 0x7fe7a80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- 172.21.15.50:0/3087264511 >> 172.21.15.50:0/3087264511 conn(0x7fe7a80cffb0 msgr2=0x7fe7a80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- 172.21.15.50:0/3087264511 shutdown_connections 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- 172.21.15.50:0/3087264511 wait complete. 2023-12-24T19:52:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 Processor -- start 2023-12-24T19:52:11.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.942+0000 7fe7acd85700 1 -- start start 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 0x7fe7a813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 0x7fe7a80c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a816a0d0 con 0x7fe7a80ce750 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a8156560 con 0x7fe7a8159a20 2023-12-24T19:52:11.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a8156e00 con 0x7fe7a806ae30 2023-12-24T19:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55710/0 (socket says 172.21.15.50:55710) 2023-12-24T19:52:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/2628065060 learned_addr learned my addr 172.21.15.50:0/2628065060 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a6d9d700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 0x7fe7a80c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a659c700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 0x7fe7a813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 msgr2=0x7fe7a813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 0x7fe7a813eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 msgr2=0x7fe7a80c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 0x7fe7a80c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 -- 172.21.15.50:0/2628065060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009a20 con 0x7fe7a80ce750 2023-12-24T19:52:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a6d9d700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 0x7fe7a80c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a659c700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 0x7fe7a813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7a5d9b700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8069a70 tx=0x7fe79c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c000c40 con 0x7fe7a80ce750 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00b910 con 0x7fe7a80ce750 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c025420 con 0x7fe7a80ce750 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c0094f0 con 0x7fe7a80ce750 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.946+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a81560b0 con 0x7fe7a80ce750 2023-12-24T19:52:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.950+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a81583f0 con 0x7fe7a80ce750 2023-12-24T19:52:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.950+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe79c023070 con 0x7fe7a80ce750 2023-12-24T19:52:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.950+0000 7fe7967fc700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 0x7fe788062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.950+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fe79c07dd80 con 0x7fe7a80ce750 2023-12-24T19:52:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.950+0000 7fe7a659c700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 0x7fe788062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.954+0000 7fe7a659c700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 0x7fe788062a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe798006f00 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:11.954+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe79c04e0d0 con 0x7fe7a80ce750 2023-12-24T19:52:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.182+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fe7a80652e0 con 0x7fe7a80ce750 2023-12-24T19:52:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.530+0000 7fe7967fc700 1 -- 172.21.15.50:0/2628065060 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2464) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe79c0516f0 con 0x7fe7a80ce750 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 msgr2=0x7fe788062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 0x7fe788062a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe798006f00 tx=0x7fe798008040 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 msgr2=0x7fe7a8155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8069a70 tx=0x7fe79c017000 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 shutdown_connections 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe7880605d0 0x7fe788062a80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a8159a20 0x7fe7a80c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a80ce750 0x7fe7a8155610 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 --2- 172.21.15.50:0/2628065060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7a806ae30 0x7fe7a813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 >> 172.21.15.50:0/2628065060 conn(0x7fe7a80cffb0 msgr2=0x7fe7a80b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:12.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 shutdown_connections 2023-12-24T19:52:12.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.538+0000 7fe7acd85700 1 -- 172.21.15.50:0/2628065060 wait complete. 2023-12-24T19:52:12.562 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-12-24T19:52:12.562 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-12-24T19:52:12.562 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T19:52:12.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-12-24T19:52:12.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.734+0000 7f2b56385700 1 Processor -- start 2023-12-24T19:52:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.734+0000 7f2b56385700 1 -- start start 2023-12-24T19:52:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b56385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b50159bc0 0x7f2b50159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b56385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b5006bce0 0x7f2b500aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b56385700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5006b850 con 0x7f2b500ab040 2023-12-24T19:52:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b56385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5006ac40 con 0x7f2b5006bce0 2023-12-24T19:52:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b56385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5006af20 con 0x7f2b50159bc0 2023-12-24T19:52:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b54922700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b500ab040 0x7f2b500ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46318/0 (socket says 172.21.15.50:46318) 2023-12-24T19:52:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b54922700 1 -- 172.21.15.50:0/2676480068 learned_addr learned my addr 172.21.15.50:0/2676480068 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 --2- 172.21.15.50:0/2676480068 >> v2:172.21.15.50:3300/0 conn(0x7f2b5006bce0 0x7f2b500aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4ffff700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b50159bc0 0x7f2b50159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4effd700 1 -- 172.21.15.50:0/2676480068 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658523336 0 0) 0x7f2b5006b850 con 0x7f2b500ab040 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4effd700 1 -- 172.21.15.50:0/2676480068 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b38003570 con 0x7f2b500ab040 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 -- 172.21.15.50:0/2676480068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b50159bc0 msgr2=0x7f2b50159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b50159bc0 0x7f2b50159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 -- 172.21.15.50:0/2676480068 >> v1:172.21.15.50:6789/0 conn(0x7f2b500ab040 legacy=0x7f2b500ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 -- 172.21.15.50:0/2676480068 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5006b200 con 0x7f2b5006bce0 2023-12-24T19:52:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.738+0000 7f2b4f7fe700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b5006bce0 0x7f2b500aab00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f2b440098e0 tx=0x7f2b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fdd5e9b3d9afa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b4effd700 1 -- 172.21.15.50:0/2676480068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44011630 con 0x7f2b5006bce0 2023-12-24T19:52:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b4effd700 1 -- 172.21.15.50:0/2676480068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44011790 con 0x7f2b5006bce0 2023-12-24T19:52:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b4effd700 1 -- 172.21.15.50:0/2676480068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44011b30 con 0x7f2b5006bce0 2023-12-24T19:52:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 -- 172.21.15.50:0/2676480068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b5006bce0 msgr2=0x7f2b500aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b5006bce0 0x7f2b500aab00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f2b440098e0 tx=0x7f2b440091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 -- 172.21.15.50:0/2676480068 shutdown_connections 2023-12-24T19:52:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b5006bce0 0x7f2b500aab00 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 --2- 172.21.15.50:0/2676480068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b50159bc0 0x7f2b50159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 -- 172.21.15.50:0/2676480068 >> 172.21.15.50:0/2676480068 conn(0x7f2b500cbba0 msgr2=0x7f2b500cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 -- 172.21.15.50:0/2676480068 shutdown_connections 2023-12-24T19:52:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.742+0000 7f2b56385700 1 -- 172.21.15.50:0/2676480068 wait complete. 2023-12-24T19:52:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 Processor -- start 2023-12-24T19:52:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 -- start start 2023-12-24T19:52:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 0x7f2b50154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b500ab040 0x7f2b5016d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c6d80 con 0x7f2b50159bc0 2023-12-24T19:52:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50154d70 con 0x7f2b5006bce0 2023-12-24T19:52:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b56385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5016de50 con 0x7f2b500ab040 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55732/0 (socket says 172.21.15.50:55732) 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 -- 172.21.15.50:0/134133072 learned_addr learned my addr 172.21.15.50:0/134133072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b4f7fe700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b500ab040 0x7f2b5016d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 -- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b500ab040 msgr2=0x7f2b5016d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b500ab040 0x7f2b5016d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b4ffff700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 0x7f2b50154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 -- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 msgr2=0x7f2b50154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 0x7f2b50154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 -- 172.21.15.50:0/134133072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009420 con 0x7f2b50159bc0 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b4ffff700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 0x7f2b50154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.746+0000 7f2b54922700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f2b48001460 tx=0x7f2b48001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800ce80 con 0x7f2b50159bc0 2023-12-24T19:52:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800ab70 con 0x7f2b50159bc0 2023-12-24T19:52:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480070f0 con 0x7f2b50159bc0 2023-12-24T19:52:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5016e130 con 0x7f2b50159bc0 2023-12-24T19:52:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b500c6a10 con 0x7f2b50159bc0 2023-12-24T19:52:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.750+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b500c6ef0 con 0x7f2b50159bc0 2023-12-24T19:52:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.754+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2b48007520 con 0x7f2b50159bc0 2023-12-24T19:52:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.754+0000 7f2b37fff700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 0x7f2b3c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.754+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f2b4807cec0 con 0x7f2b50159bc0 2023-12-24T19:52:12.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.754+0000 7f2b4ffff700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 0x7f2b3c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.754+0000 7f2b4ffff700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 0x7f2b3c062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b40006f00 tx=0x7f2b40008040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:12.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.762+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2b4804d290 con 0x7f2b50159bc0 2023-12-24T19:52:12.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:12.994+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f2b500652e0 con 0x7f2b50159bc0 2023-12-24T19:52:13.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.542+0000 7f2b37fff700 1 -- 172.21.15.50:0/134133072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2465) v1 ==== 168+0+0 (secure 0 0 0) 0x7f2b480508b0 con 0x7f2b50159bc0 2023-12-24T19:52:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 msgr2=0x7f2b3c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 0x7f2b3c062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b40006f00 tx=0x7f2b40008040 comp rx=0 tx=0).stop 2023-12-24T19:52:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 msgr2=0x7f2b500c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f2b48001460 tx=0x7f2b48001ae0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 shutdown_connections 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2b3c060580 0x7f2b3c062a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b50159bc0 0x7f2b500c7210 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b500ab040 0x7f2b5016d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 --2- 172.21.15.50:0/134133072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5006bce0 0x7f2b50154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 >> 172.21.15.50:0/134133072 conn(0x7f2b500cbba0 msgr2=0x7f2b50154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 shutdown_connections 2023-12-24T19:52:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.546+0000 7f2b56385700 1 -- 172.21.15.50:0/134133072 wait complete. 2023-12-24T19:52:13.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T19:52:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.742+0000 7f29ae0ae700 1 Processor -- start 2023-12-24T19:52:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.742+0000 7f29ae0ae700 1 -- start start 2023-12-24T19:52:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29ae0ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29a80cf8a0 0x7f29a806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29ae0ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a80cd680 con 0x7f29a80cf4d0 2023-12-24T19:52:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29ae0ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a806d8f0 con 0x7f29a806ac40 2023-12-24T19:52:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29ae0ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a8159640 con 0x7f29a80cf8a0 2023-12-24T19:52:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29a80cf8a0 0x7f29a806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a77fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29a80cf4d0 0x7f29a806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46324/0 (socket says 172.21.15.50:46324) 2023-12-24T19:52:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29a80cf8a0 0x7f29a806a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55746/0 (socket says 172.21.15.50:55746) 2023-12-24T19:52:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 -- 172.21.15.50:0/1929335252 learned_addr learned my addr 172.21.15.50:0/1929335252 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 -- 172.21.15.50:0/1929335252 >> v1:172.21.15.82:6789/0 conn(0x7f29a806ac40 legacy=0x7f29a80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 -- 172.21.15.50:0/1929335252 >> v1:172.21.15.50:6789/0 conn(0x7f29a80cf4d0 legacy=0x7f29a806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.746+0000 7f29a6ffd700 1 -- 172.21.15.50:0/1929335252 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a806b030 con 0x7f29a80cf8a0 2023-12-24T19:52:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29a6ffd700 1 --2- 172.21.15.50:0/1929335252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a806a700 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f299c0099b0 tx=0x7f299c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10c864736587c08 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29a67fc700 1 -- 172.21.15.50:0/1929335252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00b820 con 0x7f29a80cf8a0 2023-12-24T19:52:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29a67fc700 1 -- 172.21.15.50:0/1929335252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c00b980 con 0x7f29a80cf8a0 2023-12-24T19:52:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29a67fc700 1 -- 172.21.15.50:0/1929335252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00bd40 con 0x7f29a80cf8a0 2023-12-24T19:52:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- 172.21.15.50:0/1929335252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 msgr2=0x7f29a806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/1929335252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a806a700 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f299c0099b0 tx=0x7f299c009250 comp rx=0 tx=0).stop 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- 172.21.15.50:0/1929335252 shutdown_connections 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/1929335252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a806a700 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- 172.21.15.50:0/1929335252 >> 172.21.15.50:0/1929335252 conn(0x7f29a8067b30 msgr2=0x7f29a80cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- 172.21.15.50:0/1929335252 shutdown_connections 2023-12-24T19:52:13.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- 172.21.15.50:0/1929335252 wait complete. 2023-12-24T19:52:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 Processor -- start 2023-12-24T19:52:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.750+0000 7f29ae0ae700 1 -- start start 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 0x7f29a8141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29a80cf4d0 0x7f29a8150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a816a470 con 0x7f29a80cf8a0 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8141f60 con 0x7f29a806ac40 2023-12-24T19:52:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a815d700 con 0x7f29a80cf4d0 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 0x7f29a8141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55756/0 (socket says 172.21.15.50:55756) 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 0x7f29a8141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50506/0 (socket says 172.21.15.50:50506) 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 -- 172.21.15.50:0/329944549 learned_addr learned my addr 172.21.15.50:0/329944549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a6ffd700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29a80cf4d0 0x7f29a8150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 -- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29a80cf4d0 msgr2=0x7f29a8150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29a80cf4d0 0x7f29a8150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 -- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 msgr2=0x7f29a8141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 0x7f29a8141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 -- 172.21.15.50:0/329944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0094f0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29a7fff700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c930 tx=0x7f29a00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0012630 con 0x7f29a80cf8a0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00127d0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a8169fe0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.754+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0012b90 con 0x7f29a80cf8a0 2023-12-24T19:52:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.758+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a81696b0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.758+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a816a170 con 0x7f29a80cf8a0 2023-12-24T19:52:13.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.758+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f29a001b400 con 0x7f29a80cf8a0 2023-12-24T19:52:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.762+0000 7f298f7fe700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 0x7f2994062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.762+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f29a007cce0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.762+0000 7f29a77fe700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 0x7f2994062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.762+0000 7f29a77fe700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 0x7f2994062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2998004fd0 tx=0x7f2998007eb0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.766+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29a0050ac0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.938+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f29a80652e0 con 0x7f29a80cf8a0 2023-12-24T19:52:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.946+0000 7f298f7fe700 1 -- 172.21.15.50:0/329944549 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f29a0050650 con 0x7f29a80cf8a0 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 msgr2=0x7f2994062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 0x7f2994062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2998004fd0 tx=0x7f2998007eb0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 msgr2=0x7f29a8150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c930 tx=0x7f29a00026e0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 shutdown_connections 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2994060550 0x7f2994062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a80cf8a0 0x7f29a8150c60 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29a80cf4d0 0x7f29a8150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 --2- 172.21.15.50:0/329944549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29a806ac40 0x7f29a8141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 >> 172.21.15.50:0/329944549 conn(0x7f29a8067b30 msgr2=0x7f29a81519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 shutdown_connections 2023-12-24T19:52:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:13.950+0000 7f29ae0ae700 1 -- 172.21.15.50:0/329944549 wait complete. 2023-12-24T19:52:13.974 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:52:13.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:52:14.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:52:14.064 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:52:14.064 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T19:52:14.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:14.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 Processor -- start 2023-12-24T19:52:14.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 -- start start 2023-12-24T19:52:14.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f45180c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4518154450 0x7f45181548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 0x7f451806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451806c820 con 0x7f4518154450 2023-12-24T19:52:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4518154de0 con 0x7f451806aca0 2023-12-24T19:52:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.230+0000 7f451ecf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451806b960 con 0x7f45180c6d00 2023-12-24T19:52:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4518154450 0x7f45181548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4518154450 0x7f45181548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55758/0 (socket says 172.21.15.50:55758) 2023-12-24T19:52:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 -- 172.21.15.50:0/3720075127 learned_addr learned my addr 172.21.15.50:0/3720075127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ca8c700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f45180c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451d28d700 1 --2- 172.21.15.50:0/3720075127 >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 0x7f451806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 -- 172.21.15.50:0/3720075127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 msgr2=0x7f45180c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f45180c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 -- 172.21.15.50:0/3720075127 >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 msgr2=0x7f451806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 --2- 172.21.15.50:0/3720075127 >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 0x7f451806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 -- 172.21.15.50:0/3720075127 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451806bc40 con 0x7f4518154450 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ca8c700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f45180c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451d28d700 1 --2- 172.21.15.50:0/3720075127 >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 0x7f451806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f4517fff700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45181548a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f45180c6480 tx=0x7f4504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b54cafc0a626100 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f45177fe700 1 -- 172.21.15.50:0/3720075127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400b860 con 0x7f4518154450 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f45177fe700 1 -- 172.21.15.50:0/3720075127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400b9c0 con 0x7f4518154450 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f45177fe700 1 -- 172.21.15.50:0/3720075127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400bd60 con 0x7f4518154450 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 -- 172.21.15.50:0/3720075127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 msgr2=0x7f45181548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45181548a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f45180c6480 tx=0x7f4504009250 comp rx=0 tx=0).stop 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 -- 172.21.15.50:0/3720075127 shutdown_connections 2023-12-24T19:52:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 --2- 172.21.15.50:0/3720075127 >> v2:172.21.15.82:3300/0 conn(0x7f451806aca0 0x7f451806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45181548a0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 --2- 172.21.15.50:0/3720075127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f45180c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 -- 172.21.15.50:0/3720075127 >> 172.21.15.50:0/3720075127 conn(0x7f45180cbba0 msgr2=0x7f45180cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 -- 172.21.15.50:0/3720075127 shutdown_connections 2023-12-24T19:52:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.234+0000 7f451ecf0700 1 -- 172.21.15.50:0/3720075127 wait complete. 2023-12-24T19:52:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.238+0000 7f451ecf0700 1 Processor -- start 2023-12-24T19:52:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.238+0000 7f451ecf0700 1 -- start start 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f451806aca0 0x7f45180a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f451816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180ca240 con 0x7f4518154450 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180a9200 con 0x7f451806aca0 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45180c9910 con 0x7f45180c6d00 2023-12-24T19:52:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ca8c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f451806aca0 0x7f45180a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55774/0 (socket says 172.21.15.50:55774) 2023-12-24T19:52:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 -- 172.21.15.50:0/1941632027 learned_addr learned my addr 172.21.15.50:0/1941632027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f4517fff700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f451816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 -- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 msgr2=0x7f451816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f451816a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 -- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f451806aca0 msgr2=0x7f45180a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f451806aca0 0x7f45180a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 -- 172.21.15.50:0/1941632027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040094f0 con 0x7f4518154450 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451d28d700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f451000cf90 tx=0x7f4510007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000ae60 con 0x7f4518154450 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4510015440 con 0x7f4518154450 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510015800 con 0x7f4518154450 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45180c9bf0 con 0x7f4518154450 2023-12-24T19:52:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.242+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45180a8e10 con 0x7f4518154450 2023-12-24T19:52:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.246+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4518158390 con 0x7f4518154450 2023-12-24T19:52:14.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.246+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f451000d440 con 0x7f4518154450 2023-12-24T19:52:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.250+0000 7f4514ff9700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 0x7f44fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.250+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f451007d230 con 0x7f4518154450 2023-12-24T19:52:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.250+0000 7f451ca8c700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 0x7f44fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.250+0000 7f451ca8c700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 0x7f44fc062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45180aa450 tx=0x7f450c006f90 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.254+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4518158390 con 0x7f4518154450 2023-12-24T19:52:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.462+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4518158390 con 0x7f4518154450 2023-12-24T19:52:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.462+0000 7f4514ff9700 1 -- 172.21.15.50:0/1941632027 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f451001ade0 con 0x7f4518154450 2023-12-24T19:52:14.466 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:14.466 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3190833896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3190833896},{"type":"v1","addr":"172.21.15.82:6833","nonce":3190833896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/513018855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":513018855},{"type":"v1","addr":"172.21.15.82:6835","nonce":513018855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1134375734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1134375734},{"type":"v1","addr":"172.21.15.50:6833","nonce":1134375734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1666453666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1666453666},{"type":"v1","addr":"172.21.15.50:6835","nonce":1666453666}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 msgr2=0x7f44fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 0x7f44fc062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45180aa450 tx=0x7f450c006f90 comp rx=0 tx=0).stop 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 msgr2=0x7f45180aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f451000cf90 tx=0x7f4510007870 comp rx=0 tx=0).stop 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 shutdown_connections 2023-12-24T19:52:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f44fc060550 0x7f44fc062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4518154450 0x7f45180aa970 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45180c6d00 0x7f451816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 --2- 172.21.15.50:0/1941632027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f451806aca0 0x7f45180a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 >> 172.21.15.50:0/1941632027 conn(0x7f45180cbba0 msgr2=0x7f4518156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 shutdown_connections 2023-12-24T19:52:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.466+0000 7f451ecf0700 1 -- 172.21.15.50:0/1941632027 wait complete. 2023-12-24T19:52:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 80 2023-12-24T19:52:14.490 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:52:14.490 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T19:52:14.490 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T19:52:14.490 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:52:14.490 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:52:14.491 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T19:52:14.491 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T19:52:14.491 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:52:14.491 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:52:14.491 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T19:52:14.491 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T19:52:14.491 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:52:14.491 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:52:14.492 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T19:52:14.492 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T19:52:14.492 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:52:14.510 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T19:52:14.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:52:14.511 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T19:52:14.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:52:14.512 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T19:52:14.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:52:14.515 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T19:52:14.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:52:14.560 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:52:14.560 DEBUG:teuthology.parallel:result is None 2023-12-24T19:52:14.562 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:52:14.563 DEBUG:teuthology.parallel:result is None 2023-12-24T19:52:14.563 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:52:14.563 DEBUG:teuthology.parallel:result is None 2023-12-24T19:52:14.568 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:52:14.568 DEBUG:teuthology.parallel:result is None 2023-12-24T19:52:14.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T19:52:14.673 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T19:52:14.674 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T19:52:14.677 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T19:52:14.678 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T19:52:14.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.730+0000 7f0cb759e700 1 Processor -- start 2023-12-24T19:52:14.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.730+0000 7f0cb759e700 1 -- start start 2023-12-24T19:52:14.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 0x7f0cb81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb806d8c0 0x7f0cb80b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb806b640 con 0x7f0cb806a580 2023-12-24T19:52:14.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb8159710 con 0x7f0cb806d8c0 2023-12-24T19:52:14.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb80b5e10 con 0x7f0cb8158e00 2023-12-24T19:52:14.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 0x7f0cb81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb806d8c0 0x7f0cb80b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb6d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0cb806a580 0x7f0cb806c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:35208/0 (socket says 172.21.15.50:35208) 2023-12-24T19:52:14.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb6d9d700 1 -- 172.21.15.50:0/138998333 learned_addr learned my addr 172.21.15.50:0/138998333 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:14.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb559a700 1 -- 172.21.15.50:0/138998333 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772606743 0 0) 0x7f0cb806b640 con 0x7f0cb806a580 2023-12-24T19:52:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/138998333 >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 msgr2=0x7f0cb81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 --2- 172.21.15.50:0/138998333 >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 0x7f0cb81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/138998333 >> v1:172.21.15.82:6789/0 conn(0x7f0cb806a580 legacy=0x7f0cb806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/138998333 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb806b8e0 con 0x7f0cb806d8c0 2023-12-24T19:52:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb659c700 1 --2- 172.21.15.50:0/138998333 >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 0x7f0cb81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb5d9b700 1 --2- 172.21.15.50:0/138998333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb80b3ad0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8063b50 tx=0x7f0cac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371a1f9fcbbcc012 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb559a700 1 -- 172.21.15.50:0/138998333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac011630 con 0x7f0cb806d8c0 2023-12-24T19:52:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb559a700 1 -- 172.21.15.50:0/138998333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac011790 con 0x7f0cb806d8c0 2023-12-24T19:52:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.734+0000 7f0cb559a700 1 -- 172.21.15.50:0/138998333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac011b30 con 0x7f0cb806d8c0 2023-12-24T19:52:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 -- 172.21.15.50:0/138998333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 msgr2=0x7f0cb80b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 --2- 172.21.15.50:0/138998333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb80b3ad0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8063b50 tx=0x7f0cac0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 -- 172.21.15.50:0/138998333 shutdown_connections 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 --2- 172.21.15.50:0/138998333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb80b3ad0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 --2- 172.21.15.50:0/138998333 >> v2:172.21.15.82:3300/0 conn(0x7f0cb8158e00 0x7f0cb81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 -- 172.21.15.50:0/138998333 >> 172.21.15.50:0/138998333 conn(0x7f0cb8067b80 msgr2=0x7f0cb80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 -- 172.21.15.50:0/138998333 shutdown_connections 2023-12-24T19:52:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.738+0000 7f0cb759e700 1 -- 172.21.15.50:0/138998333 wait complete. 2023-12-24T19:52:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 Processor -- start 2023-12-24T19:52:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 -- start start 2023-12-24T19:52:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cb806a580 0x7f0cb813b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cb8158e00 0x7f0cb8151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb813b8e0 con 0x7f0cb806d8c0 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb815d6f0 con 0x7f0cb8158e00 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb815cae0 con 0x7f0cb806a580 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.742+0000 7f0cb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55828/0 (socket says 172.21.15.50:55828) 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/2938119133 learned_addr learned my addr 172.21.15.50:0/2938119133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb659c700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cb806a580 0x7f0cb813b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb6d9d700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cb8158e00 0x7f0cb8151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cb806a580 msgr2=0x7f0cb813b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cb806a580 0x7f0cb813b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cb8158e00 msgr2=0x7f0cb8151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cb8158e00 0x7f0cb8151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 -- 172.21.15.50:0/2938119133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009420 con 0x7f0cb806d8c0 2023-12-24T19:52:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb5d9b700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0cb806e730 tx=0x7f0cac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac000d10 con 0x7f0cb806d8c0 2023-12-24T19:52:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac011b10 con 0x7f0cb806d8c0 2023-12-24T19:52:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac025640 con 0x7f0cb806d8c0 2023-12-24T19:52:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac009420 con 0x7f0cb806d8c0 2023-12-24T19:52:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.746+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb815d0a0 con 0x7f0cb806d8c0 2023-12-24T19:52:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb804be40 con 0x7f0cb806d8c0 2023-12-24T19:52:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0cac025a30 con 0x7f0cb806d8c0 2023-12-24T19:52:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0ca67fc700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 0x7f0c98062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f0cac07e200 con 0x7f0cb806d8c0 2023-12-24T19:52:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0cb659c700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 0x7f0c98062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.750+0000 7f0cb659c700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 0x7f0c98062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009ea0 tx=0x7f0ca80091a0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.754+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cac04e550 con 0x7f0cb806d8c0 2023-12-24T19:52:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:14.942+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0cb806bbc0 con 0x7f0cb806d8c0 2023-12-24T19:52:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.454+0000 7f0ca67fc700 1 -- 172.21.15.50:0/2938119133 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0cac051b70 con 0x7f0cb806d8c0 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 msgr2=0x7f0c98062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 0x7f0c98062a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009ea0 tx=0x7f0ca80091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 msgr2=0x7f0cb815c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0cb806e730 tx=0x7f0cac017000 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 shutdown_connections 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f0c98060580 0x7f0c98062a30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cb8158e00 0x7f0cb8151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb806d8c0 0x7f0cb815c220 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 --2- 172.21.15.50:0/2938119133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0cb806a580 0x7f0cb813b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 >> 172.21.15.50:0/2938119133 conn(0x7f0cb8067b80 msgr2=0x7f0cb8156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 shutdown_connections 2023-12-24T19:52:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.462+0000 7f0cb759e700 1 -- 172.21.15.50:0/2938119133 wait complete. 2023-12-24T19:52:16.467 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T19:52:16.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T19:52:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 Processor -- start 2023-12-24T19:52:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 -- start start 2023-12-24T19:52:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6ca415a400 0x7f6ca415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40cc6a0 con 0x7f6ca415abe0 2023-12-24T19:52:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40cc980 con 0x7f6ca40cc1a0 2023-12-24T19:52:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca93c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca406e1e0 con 0x7f6ca415a400 2023-12-24T19:52:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ca415abe0 0x7f6ca406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46336/0 (socket says 172.21.15.50:46336) 2023-12-24T19:52:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca2ffd700 1 -- 172.21.15.50:0/1667383169 learned_addr learned my addr 172.21.15.50:0/1667383169 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.654+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/1667383169 >> v2:172.21.15.82:3300/0 conn(0x7f6ca415a400 0x7f6ca415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050229158 0 0) 0x7f6ca40cc980 con 0x7f6ca40cc1a0 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c003570 con 0x7f6ca40cc1a0 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217458541 0 0) 0x7f6ca40cc6a0 con 0x7f6ca415abe0 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca40cc980 con 0x7f6ca415abe0 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca37fe700 1 -- 172.21.15.50:0/1667383169 >> v1:172.21.15.82:6789/0 conn(0x7f6ca40cc1a0 legacy=0x7f6ca4159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca37fe700 1 -- 172.21.15.50:0/1667383169 >> v1:172.21.15.50:6789/0 conn(0x7f6ca415abe0 legacy=0x7f6ca406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca37fe700 1 -- 172.21.15.50:0/1667383169 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40ccc60 con 0x7f6ca415a400 2023-12-24T19:52:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/1667383169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca415a400 0x7f6ca415afb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009e60 tx=0x7f6c9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a8ce4d985fa199 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:16.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00e070 con 0x7f6ca415a400 2023-12-24T19:52:16.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00bab0 con 0x7f6ca415a400 2023-12-24T19:52:16.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/1667383169 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00be70 con 0x7f6ca415a400 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 -- 172.21.15.50:0/1667383169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca415a400 msgr2=0x7f6ca415afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/1667383169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca415a400 0x7f6ca415afb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009e60 tx=0x7f6c9c009780 comp rx=0 tx=0).stop 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 -- 172.21.15.50:0/1667383169 shutdown_connections 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/1667383169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca415a400 0x7f6ca415afb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 -- 172.21.15.50:0/1667383169 >> 172.21.15.50:0/1667383169 conn(0x7f6ca40cdd90 msgr2=0x7f6ca40ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 -- 172.21.15.50:0/1667383169 shutdown_connections 2023-12-24T19:52:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.658+0000 7f6ca93c5700 1 -- 172.21.15.50:0/1667383169 wait complete. 2023-12-24T19:52:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 Processor -- start 2023-12-24T19:52:16.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 -- start start 2023-12-24T19:52:16.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 0x7f6ca4152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ca415abe0 0x7f6ca40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40af9e0 con 0x7f6ca415a400 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca41526a0 con 0x7f6ca40cc1a0 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca93c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c4e40 con 0x7f6ca415abe0 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55840/0 (socket says 172.21.15.50:55840) 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca27fc700 1 -- 172.21.15.50:0/169151537 learned_addr learned my addr 172.21.15.50:0/169151537 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 0x7f6ca4152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.662+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ca415abe0 0x7f6ca40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:16.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 -- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ca415abe0 msgr2=0x7f6ca40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ca415abe0 0x7f6ca40ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 -- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 msgr2=0x7f6ca4152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 0x7f6ca4152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 -- 172.21.15.50:0/169151537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009a20 con 0x7f6ca415a400 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 0x7f6ca4152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c790 tx=0x7f6c98007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011680 con 0x7f6ca415a400 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c980117e0 con 0x7f6ca415a400 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca40adda0 con 0x7f6ca415a400 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011b60 con 0x7f6ca415a400 2023-12-24T19:52:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca40ae360 con 0x7f6ca415a400 2023-12-24T19:52:16.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca41575a0 con 0x7f6ca415a400 2023-12-24T19:52:16.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.666+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6c9801c460 con 0x7f6ca415a400 2023-12-24T19:52:16.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.670+0000 7f6c8affd700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 0x7f6c90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:16.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.670+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f6c9807c8e0 con 0x7f6ca415a400 2023-12-24T19:52:16.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.670+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 0x7f6c90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:16.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.670+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 0x7f6c90062a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c940058d0 tx=0x7f6c94009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:16.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.678+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ca41575a0 con 0x7f6ca415a400 2023-12-24T19:52:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.902+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6ca41575a0 con 0x7f6ca415a400 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.902+0000 7f6c8affd700 1 -- 172.21.15.50:0/169151537 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6c9804ceb0 con 0x7f6ca415a400 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T19:52:16.907 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:52:16.908 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.911 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T19:52:16.913 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T19:52:16.915 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:52:16.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T19:52:16.917 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T19:52:16.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T19:52:16.919 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T19:52:16.920 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T19:52:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 msgr2=0x7f6c90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 0x7f6c90062a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c940058d0 tx=0x7f6c94009040 comp rx=0 tx=0).stop 2023-12-24T19:52:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 msgr2=0x7f6ca4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c790 tx=0x7f6c98007e30 comp rx=0 tx=0).stop 2023-12-24T19:52:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 shutdown_connections 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c90060550 0x7f6c90062a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6ca415abe0 0x7f6ca40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca415a400 0x7f6ca4068a30 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 --2- 172.21.15.50:0/169151537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca40cc1a0 0x7f6ca4152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 >> 172.21.15.50:0/169151537 conn(0x7f6ca40cdd90 msgr2=0x7f6ca40cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 shutdown_connections 2023-12-24T19:52:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:16.906+0000 7f6ca93c5700 1 -- 172.21.15.50:0/169151537 wait complete. 2023-12-24T19:52:16.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.090+0000 7fe266ce3700 1 Processor -- start 2023-12-24T19:52:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.090+0000 7fe266ce3700 1 -- start start 2023-12-24T19:52:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 0x7fe260161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe26006c820 0x7fe26006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26006c4d0 con 0x7fe2601611b0 2023-12-24T19:52:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26006c1f0 con 0x7fe26006c820 2023-12-24T19:52:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe266ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600ab5e0 con 0x7fe2600ae100 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe265ce1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 0x7fe260161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe265ce1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 0x7fe260161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55848/0 (socket says 172.21.15.50:55848) 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:41954/0 (socket says 172.21.15.50:41954) 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 -- 172.21.15.50:0/3881945729 learned_addr learned my addr 172.21.15.50:0/3881945729 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2664e2700 1 --2- 172.21.15.50:0/3881945729 >> v2:172.21.15.82:3300/0 conn(0x7fe26006c820 0x7fe26006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 -- 172.21.15.50:0/3881945729 >> v2:172.21.15.82:3300/0 conn(0x7fe26006c820 msgr2=0x7fe26006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 --2- 172.21.15.50:0/3881945729 >> v2:172.21.15.82:3300/0 conn(0x7fe26006c820 0x7fe26006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 -- 172.21.15.50:0/3881945729 >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 msgr2=0x7fe260161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 --2- 172.21.15.50:0/3881945729 >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 0x7fe260161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 -- 172.21.15.50:0/3881945729 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600ab8c0 con 0x7fe2600ae100 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.094+0000 7fe2654e0700 1 --2- 172.21.15.50:0/3881945729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2600cb9a0 tx=0x7fe250009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382d27c9d86a9b50 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe264cdf700 1 -- 172.21.15.50:0/3881945729 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250009e70 con 0x7fe2600ae100 2023-12-24T19:52:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe264cdf700 1 -- 172.21.15.50:0/3881945729 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000b860 con 0x7fe2600ae100 2023-12-24T19:52:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe264cdf700 1 -- 172.21.15.50:0/3881945729 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000bc00 con 0x7fe2600ae100 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 -- 172.21.15.50:0/3881945729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 msgr2=0x7fe26006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 --2- 172.21.15.50:0/3881945729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2600cb9a0 tx=0x7fe250009250 comp rx=0 tx=0).stop 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 -- 172.21.15.50:0/3881945729 shutdown_connections 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 --2- 172.21.15.50:0/3881945729 >> v2:172.21.15.82:3300/0 conn(0x7fe26006c820 0x7fe26006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 --2- 172.21.15.50:0/3881945729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe26006b9c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 --2- 172.21.15.50:0/3881945729 >> v2:172.21.15.50:3300/0 conn(0x7fe2601611b0 0x7fe260161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 -- 172.21.15.50:0/3881945729 >> 172.21.15.50:0/3881945729 conn(0x7fe260067b80 msgr2=0x7fe2600cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 -- 172.21.15.50:0/3881945729 shutdown_connections 2023-12-24T19:52:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.098+0000 7fe266ce3700 1 -- 172.21.15.50:0/3881945729 wait complete. 2023-12-24T19:52:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 Processor -- start 2023-12-24T19:52:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 -- start start 2023-12-24T19:52:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe2600b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601611b0 0x7fe260156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26016d610 con 0x7fe26006c820 2023-12-24T19:52:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26015b190 con 0x7fe2601611b0 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.102+0000 7fe266ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26015ae90 con 0x7fe2600ae100 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55862/0 (socket says 172.21.15.50:55862) 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 -- 172.21.15.50:0/4279977009 learned_addr learned my addr 172.21.15.50:0/4279977009 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe2654e0700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe2600b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe2664e2700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601611b0 0x7fe260156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 -- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 msgr2=0x7fe2600b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe2600b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 -- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601611b0 msgr2=0x7fe260156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601611b0 0x7fe260156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 -- 172.21.15.50:0/4279977009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500094f0 con 0x7fe26006c820 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe265ce1700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009f20 tx=0x7fe25c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00cb70 con 0x7fe26006c820 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2600b1030 con 0x7fe26006c820 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x7fe26006c820 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c014480 con 0x7fe26006c820 2023-12-24T19:52:17.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe260150540 con 0x7fe26006c820 2023-12-24T19:52:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.106+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26004be40 con 0x7fe26006c820 2023-12-24T19:52:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.110+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe25c0147f0 con 0x7fe26006c820 2023-12-24T19:52:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.110+0000 7fe255ffb700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 0x7fe244062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.110+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5577+0+0 (secure 0 0 0) 0x7fe25c07d410 con 0x7fe26006c820 2023-12-24T19:52:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.110+0000 7fe2654e0700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 0x7fe244062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.110+0000 7fe2654e0700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 0x7fe244062a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2600cb9a0 tx=0x7fe250017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.118+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe25c04d9e0 con 0x7fe26006c820 2023-12-24T19:52:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.286+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe26006a840 con 0x7fe26006c820 2023-12-24T19:52:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.286+0000 7fe255ffb700 1 -- 172.21.15.50:0/4279977009 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+12918 (secure 0 0 0) 0x7fe25c051000 con 0x7fe26006c820 2023-12-24T19:52:17.291 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:17.291 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":169,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:52:16.448989+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:17.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 msgr2=0x7fe244062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 0x7fe244062a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2600cb9a0 tx=0x7fe250017000 comp rx=0 tx=0).stop 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 msgr2=0x7fe260150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009f20 tx=0x7fe25c00b040 comp rx=0 tx=0).stop 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 shutdown_connections 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe244060580 0x7fe244062a30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601611b0 0x7fe260156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2600ae100 0x7fe2600b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 --2- 172.21.15.50:0/4279977009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe26006c820 0x7fe260150000 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 >> 172.21.15.50:0/4279977009 conn(0x7fe260067b80 msgr2=0x7fe260150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:17.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 shutdown_connections 2023-12-24T19:52:17.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.290+0000 7fe266ce3700 1 -- 172.21.15.50:0/4279977009 wait complete. 2023-12-24T19:52:17.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:52:17.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:52:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.486+0000 7f8778ce3700 1 Processor -- start 2023-12-24T19:52:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.486+0000 7f8778ce3700 1 -- start start 2023-12-24T19:52:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8778ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8774158c50 0x7f8774159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8778ce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740caa60 con 0x7f87740caef0 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8778ce3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740cee80 con 0x7f87740ccea0 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8778ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87740af430 con 0x7f8774158c50 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8772ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87740caef0 0x7f87740cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46340/0 (socket says 172.21.15.50:46340) 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f8772ffd700 1 -- 172.21.15.50:0/2314512751 learned_addr learned my addr 172.21.15.50:0/2314512751 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:17.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87737fe700 1 --2- 172.21.15.50:0/2314512751 >> v2:172.21.15.82:3300/0 conn(0x7f8774158c50 0x7f8774159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137011532 0 0) 0x7f87740caa60 con 0x7f87740caef0 2023-12-24T19:52:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f875c003570 con 0x7f87740caef0 2023-12-24T19:52:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934140545 0 0) 0x7f87740cee80 con 0x7f87740ccea0 2023-12-24T19:52:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87740caa60 con 0x7f87740ccea0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2996261903 0 0) 0x7f875c003570 con 0x7f87740caef0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 >> v2:172.21.15.82:3300/0 conn(0x7f8774158c50 msgr2=0x7f8774159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 --2- 172.21.15.50:0/2314512751 >> v2:172.21.15.82:3300/0 conn(0x7f8774158c50 0x7f8774159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 >> v1:172.21.15.82:6789/0 conn(0x7f87740ccea0 legacy=0x7f87740afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740cf160 con 0x7f87740caef0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f8768001470 con 0x7f87740caef0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 >> v1:172.21.15.50:6789/0 conn(0x7f87740caef0 legacy=0x7f87740cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c003bf0 0x7f875c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.490+0000 7f87727fc700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c004810 0x7f875c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 0x7f875c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740af430 con 0x7f875c0051c0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c00c0b0 con 0x7f875c004810 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c00c270 con 0x7f875c003bf0 2023-12-24T19:52:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 0x7f875c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8772ffd700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c004810 0x7f875c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87737fe700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c003bf0 0x7f875c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 -- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c003bf0 msgr2=0x7f875c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c003bf0 0x7f875c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 -- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c004810 msgr2=0x7f875c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c004810 0x7f875c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 -- 172.21.15.50:0/2314512751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c003570 con 0x7f875c0051c0 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 -- 172.21.15.50:0/2314512751 reap_dead start 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8773fff700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 0x7f875c00ba60 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f876c002120 tx=0x7f876c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fb45787b327a52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00c980 con 0x7f875c0051c0 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c00cae0 con 0x7f875c0051c0 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f87727fc700 1 -- 172.21.15.50:0/2314512751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00ce80 con 0x7f875c0051c0 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 -- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 msgr2=0x7f875c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 0x7f875c00ba60 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f876c002120 tx=0x7f876c0017a0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 -- 172.21.15.50:0/2314512751 shutdown_connections 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 --2- 172.21.15.50:0/2314512751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875c0051c0 0x7f875c00ba60 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 -- 172.21.15.50:0/2314512751 >> 172.21.15.50:0/2314512751 conn(0x7f87740670b0 msgr2=0x7f87740674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 -- 172.21.15.50:0/2314512751 shutdown_connections 2023-12-24T19:52:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.494+0000 7f8778ce3700 1 -- 172.21.15.50:0/2314512751 wait complete. 2023-12-24T19:52:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 Processor -- start 2023-12-24T19:52:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 -- start start 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 0x7f877406a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877416d950 0x7f877416ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c94a0 con 0x7f8774170bf0 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c9db0 con 0x7f877416d950 2023-12-24T19:52:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8778ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8774171140 con 0x7f875c0051c0 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8772ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8772ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55872/0 (socket says 172.21.15.50:55872) 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8772ffd700 1 -- 172.21.15.50:0/1357658854 learned_addr learned my addr 172.21.15.50:0/1357658854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f87737fe700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 0x7f877406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8773fff700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877416d950 0x7f877416ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.498+0000 7f8772ffd700 1 -- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 msgr2=0x7f877406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8772ffd700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 0x7f877406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8772ffd700 1 -- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877416d950 msgr2=0x7f877416ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8772ffd700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877416d950 0x7f877416ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8772ffd700 1 -- 172.21.15.50:0/1357658854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774171420 con 0x7f8774170bf0 2023-12-24T19:52:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f87737fe700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 0x7f877406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8772ffd700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f876800e7e0 tx=0x7f8768000dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768012500 con 0x7f8774170bf0 2023-12-24T19:52:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768010040 con 0x7f8774170bf0 2023-12-24T19:52:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8774171700 con 0x7f8774170bf0 2023-12-24T19:52:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680128d0 con 0x7f8774170bf0 2023-12-24T19:52:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87740b3f30 con 0x7f8774170bf0 2023-12-24T19:52:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.502+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877404be40 con 0x7f8774170bf0 2023-12-24T19:52:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.506+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8768012c40 con 0x7f8774170bf0 2023-12-24T19:52:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.506+0000 7f875b7fe700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 0x7f8760062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.506+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f876807bbf0 con 0x7f8774170bf0 2023-12-24T19:52:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.506+0000 7f87737fe700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 0x7f8760062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.506+0000 7f87737fe700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 0x7f8760062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8764006c80 tx=0x7f8764008040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.510+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f876804c1c0 con 0x7f8774170bf0 2023-12-24T19:52:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.686+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87740ca410 con 0x7f8774170bf0 2023-12-24T19:52:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.686+0000 7f875b7fe700 1 -- 172.21.15.50:0/1357658854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8768019020 con 0x7f8774170bf0 2023-12-24T19:52:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 msgr2=0x7f8760062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 0x7f8760062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8764006c80 tx=0x7f8764008040 comp rx=0 tx=0).stop 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 msgr2=0x7f877406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f876800e7e0 tx=0x7f8768000dd0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 shutdown_connections 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8760060550 0x7f8760062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877416d950 0x7f877416ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8774170bf0 0x7f877406aa60 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 --2- 172.21.15.50:0/1357658854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f875c0051c0 0x7f877406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 >> 172.21.15.50:0/1357658854 conn(0x7f87740670b0 msgr2=0x7f8774157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 shutdown_connections 2023-12-24T19:52:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.690+0000 7f8778ce3700 1 -- 172.21.15.50:0/1357658854 wait complete. 2023-12-24T19:52:17.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:52:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.878+0000 7fb9ab59e700 1 Processor -- start 2023-12-24T19:52:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 -- start start 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0caf40 0x7fb9ac0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9ac06cd30 0x7fb9ac0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac15a4d0 con 0x7fb9ac0cd0d0 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac159610 con 0x7fb9ac06cd30 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9ab59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0cc8e0 con 0x7fb9ac0caf40 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9aad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9ac0cd0d0 0x7fb9ac156690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46348/0 (socket says 172.21.15.50:46348) 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9aad9d700 1 -- 172.21.15.50:0/2856124378 learned_addr learned my addr 172.21.15.50:0/2856124378 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/2856124378 >> v2:172.21.15.50:3300/0 conn(0x7fb9ac06cd30 0x7fb9ac0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.882+0000 7fb9aa59c700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0caf40 0x7fb9ac0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a959a700 1 -- 172.21.15.50:0/2856124378 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625432802 0 0) 0x7fb9ac15a4d0 con 0x7fb9ac0cd0d0 2023-12-24T19:52:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a959a700 1 -- 172.21.15.50:0/2856124378 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb994003570 con 0x7fb9ac0cd0d0 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a9d9b700 1 -- 172.21.15.50:0/2856124378 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0caf40 msgr2=0x7fb9ac0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0caf40 0x7fb9ac0cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a9d9b700 1 -- 172.21.15.50:0/2856124378 >> v1:172.21.15.50:6789/0 conn(0x7fb9ac0cd0d0 legacy=0x7fb9ac156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a9d9b700 1 -- 172.21.15.50:0/2856124378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac1598c0 con 0x7fb9ac06cd30 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0ccb90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009910 tx=0x7fb9a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d250d93c2c25b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a959a700 1 -- 172.21.15.50:0/2856124378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011630 con 0x7fb9ac06cd30 2023-12-24T19:52:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a959a700 1 -- 172.21.15.50:0/2856124378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0011790 con 0x7fb9ac06cd30 2023-12-24T19:52:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9a959a700 1 -- 172.21.15.50:0/2856124378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011b30 con 0x7fb9ac06cd30 2023-12-24T19:52:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 -- 172.21.15.50:0/2856124378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 msgr2=0x7fb9ac0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0ccb90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009910 tx=0x7fb9a00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 -- 172.21.15.50:0/2856124378 shutdown_connections 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0ccb90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/2856124378 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0caf40 0x7fb9ac0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.886+0000 7fb9ab59e700 1 -- 172.21.15.50:0/2856124378 >> 172.21.15.50:0/2856124378 conn(0x7fb9ac0670b0 msgr2=0x7fb9ac0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.890+0000 7fb9ab59e700 1 -- 172.21.15.50:0/2856124378 shutdown_connections 2023-12-24T19:52:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.890+0000 7fb9ab59e700 1 -- 172.21.15.50:0/2856124378 wait complete. 2023-12-24T19:52:17.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.890+0000 7fb9ab59e700 1 Processor -- start 2023-12-24T19:52:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 -- start start 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 0x7fb9ac0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 0x7fb9ac0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0b4430 con 0x7fb9ac06cd30 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0b2800 con 0x7fb9ac0caf40 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac169c10 con 0x7fb9ac0c9930 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55896/0 (socket says 172.21.15.50:55896) 2023-12-24T19:52:17.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 -- 172.21.15.50:0/3395389807 learned_addr learned my addr 172.21.15.50:0/3395389807 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 0x7fb9ac0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aad9d700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 0x7fb9ac0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 -- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 msgr2=0x7fb9ac0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 0x7fb9ac0c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 -- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 msgr2=0x7fb9ac0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 0x7fb9ac0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 -- 172.21.15.50:0/3395389807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009420 con 0x7fb9ac06cd30 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aad9d700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 0x7fb9ac0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 0x7fb9ac0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9aa59c700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00ec80 tx=0x7fb99c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00c9d0 con 0x7fb9ac06cd30 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c00cb30 con 0x7fb9ac06cd30 2023-12-24T19:52:17.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c013470 con 0x7fb9ac06cd30 2023-12-24T19:52:17.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.894+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0b3de0 con 0x7fb9ac06cd30 2023-12-24T19:52:17.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.898+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac169ef0 con 0x7fb9ac06cd30 2023-12-24T19:52:17.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.898+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac04be40 con 0x7fb9ac06cd30 2023-12-24T19:52:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.898+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb99c013820 con 0x7fb9ac06cd30 2023-12-24T19:52:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.902+0000 7fb99a7fc700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 0x7fb98c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.902+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5577+0+0 (secure 0 0 0) 0x7fb99c07cb30 con 0x7fb9ac06cd30 2023-12-24T19:52:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.902+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 0x7fb98c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.902+0000 7fb9a9d9b700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 0x7fb98c062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00091e0 tx=0x7fb9a0017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:17.906+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb99c04d100 con 0x7fb9ac06cd30 2023-12-24T19:52:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.090+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb9ac06bca0 con 0x7fb9ac06cd30 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb99a7fc700 1 -- 172.21.15.50:0/3395389807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v169) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb99c050720 con 0x7fb9ac06cd30 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T19:52:18.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:18.097 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T19:52:18.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 msgr2=0x7fb98c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 0x7fb98c062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00091e0 tx=0x7fb9a0017000 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 msgr2=0x7fb9ac0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00ec80 tx=0x7fb99c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 shutdown_connections 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fb98c060550 0x7fb98c062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9ac0c9930 0x7fb9ac0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9ac0caf40 0x7fb9ac0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 --2- 172.21.15.50:0/3395389807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac06cd30 0x7fb9ac0c93f0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 >> 172.21.15.50:0/3395389807 conn(0x7fb9ac0670b0 msgr2=0x7fb9ac06a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 shutdown_connections 2023-12-24T19:52:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.094+0000 7fb9ab59e700 1 -- 172.21.15.50:0/3395389807 wait complete. 2023-12-24T19:52:18.123 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:52:18.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:52:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.294+0000 7f94ef6f0700 1 Processor -- start 2023-12-24T19:52:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.294+0000 7f94ef6f0700 1 -- start start 2023-12-24T19:52:18.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ef6f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94e806db90 0x7f94e815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ef6f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e806d4d0 con 0x7f94e8156b50 2023-12-24T19:52:18.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ef6f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80b4960 con 0x7f94e80b4230 2023-12-24T19:52:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ef6f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e815a620 con 0x7f94e806db90 2023-12-24T19:52:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ed48c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94e8156b50 0x7f94e80b3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46356/0 (socket says 172.21.15.50:46356) 2023-12-24T19:52:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94ed48c700 1 -- 172.21.15.50:0/183840019 learned_addr learned my addr 172.21.15.50:0/183840019 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94edc8d700 1 --2- 172.21.15.50:0/183840019 >> v2:172.21.15.82:3300/0 conn(0x7f94e806db90 0x7f94e815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530693728 0 0) 0x7f94e806d4d0 con 0x7f94e8156b50 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d4003570 con 0x7f94e8156b50 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191808573 0 0) 0x7f94d8001110 con 0x7f94e80b4230 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.298+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e806d4d0 con 0x7f94e80b4230 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94edc8d700 1 -- 172.21.15.50:0/183840019 >> v1:172.21.15.82:6789/0 conn(0x7f94e80b4230 legacy=0x7f94e806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94edc8d700 1 -- 172.21.15.50:0/183840019 >> v1:172.21.15.50:6789/0 conn(0x7f94e8156b50 legacy=0x7f94e80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94edc8d700 1 -- 172.21.15.50:0/183840019 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e806c8c0 con 0x7f94e806db90 2023-12-24T19:52:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94edc8d700 1 --2- 172.21.15.50:0/183840019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e806db90 0x7f94e815a0e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009e60 tx=0x7f94e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c09affbf7db041e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000e070 con 0x7f94e806db90 2023-12-24T19:52:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000bab0 con 0x7f94e806db90 2023-12-24T19:52:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94dffff700 1 -- 172.21.15.50:0/183840019 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000be70 con 0x7f94e806db90 2023-12-24T19:52:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 -- 172.21.15.50:0/183840019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e806db90 msgr2=0x7f94e815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/183840019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e806db90 0x7f94e815a0e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009e60 tx=0x7f94e0009780 comp rx=0 tx=0).stop 2023-12-24T19:52:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 -- 172.21.15.50:0/183840019 shutdown_connections 2023-12-24T19:52:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/183840019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e806db90 0x7f94e815a0e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 -- 172.21.15.50:0/183840019 >> 172.21.15.50:0/183840019 conn(0x7f94e8067b40 msgr2=0x7f94e80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 -- 172.21.15.50:0/183840019 shutdown_connections 2023-12-24T19:52:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.302+0000 7f94ef6f0700 1 -- 172.21.15.50:0/183840019 wait complete. 2023-12-24T19:52:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 Processor -- start 2023-12-24T19:52:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 -- start start 2023-12-24T19:52:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e80b4230 0x7f94e8155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94e8156b50 0x7f94e8141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8150c30 con 0x7f94e806db90 2023-12-24T19:52:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e814ffb0 con 0x7f94e80b4230 2023-12-24T19:52:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ef6f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8150290 con 0x7f94e8156b50 2023-12-24T19:52:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ed48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ed48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55912/0 (socket says 172.21.15.50:55912) 2023-12-24T19:52:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ed48c700 1 -- 172.21.15.50:0/4270031005 learned_addr learned my addr 172.21.15.50:0/4270031005 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94edc8d700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94e8156b50 0x7f94e8141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.306+0000 7f94ecc8b700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e80b4230 0x7f94e8155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 -- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94e8156b50 msgr2=0x7f94e8141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94e8156b50 0x7f94e8141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 -- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e80b4230 msgr2=0x7f94e8155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e80b4230 0x7f94e8155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 -- 172.21.15.50:0/4270031005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009a20 con 0x7f94e806db90 2023-12-24T19:52:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ed48c700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c790 tx=0x7f94e4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4005b30 con 0x7f94e806db90 2023-12-24T19:52:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4005c90 con 0x7f94e806db90 2023-12-24T19:52:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4007300 con 0x7f94e806db90 2023-12-24T19:52:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e8150570 con 0x7f94e806db90 2023-12-24T19:52:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e814fca0 con 0x7f94e806db90 2023-12-24T19:52:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.310+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e8150d70 con 0x7f94e806db90 2023-12-24T19:52:18.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.314+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f94e401b3b0 con 0x7f94e806db90 2023-12-24T19:52:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.314+0000 7f94dd7fa700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 0x7f94cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.314+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5577+0+0 (secure 0 0 0) 0x7f94e407bc80 con 0x7f94e806db90 2023-12-24T19:52:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.314+0000 7f94ecc8b700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 0x7f94cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.314+0000 7f94ecc8b700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 0x7f94cc062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f94e80d0920 tx=0x7f94d8007bc0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.322+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94e404c250 con 0x7f94e806db90 2023-12-24T19:52:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.490+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f94e8071060 con 0x7f94e806db90 2023-12-24T19:52:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.586+0000 7f94dd7fa700 1 -- 172.21.15.50:0/4270031005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v170) v1 ==== 138+0+0 (secure 0 0 0) 0x7f94e40170b0 con 0x7f94e806db90 2023-12-24T19:52:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 msgr2=0x7f94cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 0x7f94cc062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f94e80d0920 tx=0x7f94d8007bc0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 msgr2=0x7f94e814f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c790 tx=0x7f94e4007ea0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 shutdown_connections 2023-12-24T19:52:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f94cc060550 0x7f94cc062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94e8156b50 0x7f94e8141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94e80b4230 0x7f94e8155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 --2- 172.21.15.50:0/4270031005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e806db90 0x7f94e814f760 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 >> 172.21.15.50:0/4270031005 conn(0x7f94e8067b40 msgr2=0x7f94e8156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 shutdown_connections 2023-12-24T19:52:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.594+0000 7f94ef6f0700 1 -- 172.21.15.50:0/4270031005 wait complete. 2023-12-24T19:52:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T19:52:18.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:52:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.782+0000 7f71b0078700 1 Processor -- start 2023-12-24T19:52:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.782+0000 7f71b0078700 1 -- start start 2023-12-24T19:52:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71b0078700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71a80cf4d0 0x7f71a806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71b0078700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71a80cf8a0 0x7f71a806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71b0078700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80cd680 con 0x7f71a806ac40 2023-12-24T19:52:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71b0078700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a8159640 con 0x7f71a80cf8a0 2023-12-24T19:52:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71b0078700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a806b030 con 0x7f71a80cf4d0 2023-12-24T19:52:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71a80cf8a0 0x7f71a806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71a80cf8a0 0x7f71a806a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55918/0 (socket says 172.21.15.50:55918) 2023-12-24T19:52:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 -- 172.21.15.50:0/2389569862 learned_addr learned my addr 172.21.15.50:0/2389569862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ade14700 1 --2- 172.21.15.50:0/2389569862 >> v2:172.21.15.82:3300/0 conn(0x7f71a80cf4d0 0x7f71a806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 -- 172.21.15.50:0/2389569862 >> v2:172.21.15.82:3300/0 conn(0x7f71a80cf4d0 msgr2=0x7f71a806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 --2- 172.21.15.50:0/2389569862 >> v2:172.21.15.82:3300/0 conn(0x7f71a80cf4d0 0x7f71a806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 -- 172.21.15.50:0/2389569862 >> v1:172.21.15.82:6789/0 conn(0x7f71a806ac40 legacy=0x7f71a815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 -- 172.21.15.50:0/2389569862 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80cca70 con 0x7f71a80cf8a0 2023-12-24T19:52:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.786+0000 7f71ad613700 1 --2- 172.21.15.50:0/2389569862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a806a700 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f71a8063780 tx=0x7f7198009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc27f8137782d07 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71ace12700 1 -- 172.21.15.50:0/2389569862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198009e70 con 0x7f71a80cf8a0 2023-12-24T19:52:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71ace12700 1 -- 172.21.15.50:0/2389569862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800b860 con 0x7f71a80cf8a0 2023-12-24T19:52:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71ace12700 1 -- 172.21.15.50:0/2389569862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800bc20 con 0x7f71a80cf8a0 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 -- 172.21.15.50:0/2389569862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 msgr2=0x7f71a806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 --2- 172.21.15.50:0/2389569862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a806a700 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f71a8063780 tx=0x7f7198009250 comp rx=0 tx=0).stop 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 -- 172.21.15.50:0/2389569862 shutdown_connections 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 --2- 172.21.15.50:0/2389569862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a806a700 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 --2- 172.21.15.50:0/2389569862 >> v2:172.21.15.82:3300/0 conn(0x7f71a80cf4d0 0x7f71a806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 -- 172.21.15.50:0/2389569862 >> 172.21.15.50:0/2389569862 conn(0x7f71a8067b30 msgr2=0x7f71a80cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 -- 172.21.15.50:0/2389569862 shutdown_connections 2023-12-24T19:52:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.790+0000 7f71b0078700 1 -- 172.21.15.50:0/2389569862 wait complete. 2023-12-24T19:52:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 Processor -- start 2023-12-24T19:52:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 -- start start 2023-12-24T19:52:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71a80cf4d0 0x7f71a815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a815afa0 con 0x7f71a80cf8a0 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a816cbe0 con 0x7f71a80cf4d0 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71b0078700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a816d480 con 0x7f71a806ac40 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ae615700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42030/0 (socket says 172.21.15.50:42030) 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 -- 172.21.15.50:0/3138826102 learned_addr learned my addr 172.21.15.50:0/3138826102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ad613700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71a80cf4d0 0x7f71a815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 -- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71a80cf4d0 msgr2=0x7f71a815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71a80cf4d0 0x7f71a815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 -- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 msgr2=0x7f71a80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.794+0000 7f71ade14700 1 -- 172.21.15.50:0/3138826102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980094f0 con 0x7f71a806ac40 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f71ade14700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ec80 tx=0x7f71a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400c850 con 0x7f71a806ac40 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400c9b0 con 0x7f71a806ac40 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a815c3b0 con 0x7f71a806ac40 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400cd50 con 0x7f71a806ac40 2023-12-24T19:52:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a816ce30 con 0x7f71a806ac40 2023-12-24T19:52:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.798+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a81593f0 con 0x7f71a806ac40 2023-12-24T19:52:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.802+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f71a4005a00 con 0x7f71a806ac40 2023-12-24T19:52:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.802+0000 7f719dffb700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 0x7f718c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.802+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5947+0+0 (secure 0 0 0) 0x7f71a407cf90 con 0x7f71a806ac40 2023-12-24T19:52:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.802+0000 7f71ad613700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 0x7f718c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.802+0000 7f71ad613700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 0x7f718c062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71a8063780 tx=0x7f7198017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.810+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f71a404d3f0 con 0x7f71a806ac40 2023-12-24T19:52:18.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:18.982+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71a8065310 con 0x7f71a806ac40 2023-12-24T19:52:19.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.606+0000 7f719dffb700 1 -- 172.21.15.50:0/3138826102 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v171) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71a40210d0 con 0x7f71a806ac40 2023-12-24T19:52:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 msgr2=0x7f718c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 0x7f718c062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71a8063780 tx=0x7f7198017000 comp rx=0 tx=0).stop 2023-12-24T19:52:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 msgr2=0x7f71a814f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ec80 tx=0x7f71a40091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 shutdown_connections 2023-12-24T19:52:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f718c060580 0x7f718c062a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a80cf8a0 0x7f71a80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71a80cf4d0 0x7f71a815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 --2- 172.21.15.50:0/3138826102 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f71a806ac40 0x7f71a814f6d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 >> 172.21.15.50:0/3138826102 conn(0x7f71a8067b30 msgr2=0x7f71a815ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.618+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 shutdown_connections 2023-12-24T19:52:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.622+0000 7f71b0078700 1 -- 172.21.15.50:0/3138826102 wait complete. 2023-12-24T19:52:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T19:52:19.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:52:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.822+0000 7fae06e0c700 1 Processor -- start 2023-12-24T19:52:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.822+0000 7fae06e0c700 1 -- start start 2023-12-24T19:52:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.826+0000 7fae06e0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 0x7fae000cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.826+0000 7fae06e0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae000ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.826+0000 7fae06e0c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0006a580 con 0x7fae000cc780 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.826+0000 7fae06e0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000cd110 con 0x7fae00158c40 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.826+0000 7fae06e0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0006a7d0 con 0x7fae0006d450 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae05e0a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 0x7fae000cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae05609700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae000cc780 0x7fae0006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42652/0 (socket says 172.21.15.50:42652) 2023-12-24T19:52:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae05609700 1 -- 172.21.15.50:0/1191829432 learned_addr learned my addr 172.21.15.50:0/1191829432 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 --2- 172.21.15.50:0/1191829432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae000ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae04e08700 1 -- 172.21.15.50:0/1191829432 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255831735 0 0) 0x7fae0006a580 con 0x7fae000cc780 2023-12-24T19:52:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae04e08700 1 -- 172.21.15.50:0/1191829432 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec003570 con 0x7fae000cc780 2023-12-24T19:52:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 -- 172.21.15.50:0/1191829432 >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 msgr2=0x7fae000cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 --2- 172.21.15.50:0/1191829432 >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 0x7fae000cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 -- 172.21.15.50:0/1191829432 >> v1:172.21.15.50:6789/0 conn(0x7fae000cc780 legacy=0x7fae0006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 -- 172.21.15.50:0/1191829432 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0006aab0 con 0x7fae0006d450 2023-12-24T19:52:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae05e0a700 1 --2- 172.21.15.50:0/1191829432 >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 0x7fae000cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae0660b700 1 --2- 172.21.15.50:0/1191829432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae000ccbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009e60 tx=0x7fadf8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf21a613f7b90f06 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:19.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae04e08700 1 -- 172.21.15.50:0/1191829432 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800e070 con 0x7fae0006d450 2023-12-24T19:52:19.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae04e08700 1 -- 172.21.15.50:0/1191829432 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800bab0 con 0x7fae0006d450 2023-12-24T19:52:19.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.830+0000 7fae04e08700 1 -- 172.21.15.50:0/1191829432 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800be70 con 0x7fae0006d450 2023-12-24T19:52:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- 172.21.15.50:0/1191829432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 msgr2=0x7fae000ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1191829432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae000ccbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009e60 tx=0x7fadf8009780 comp rx=0 tx=0).stop 2023-12-24T19:52:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- 172.21.15.50:0/1191829432 shutdown_connections 2023-12-24T19:52:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1191829432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae000ccbd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1191829432 >> v2:172.21.15.82:3300/0 conn(0x7fae00158c40 0x7fae000cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- 172.21.15.50:0/1191829432 >> 172.21.15.50:0/1191829432 conn(0x7fae000d0800 msgr2=0x7fae000b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- 172.21.15.50:0/1191829432 shutdown_connections 2023-12-24T19:52:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- 172.21.15.50:0/1191829432 wait complete. 2023-12-24T19:52:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 Processor -- start 2023-12-24T19:52:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 -- start start 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae00157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.834+0000 7fae06e0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae00158c40 0x7fae000c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c5a60 con 0x7fae000cc780 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c4b70 con 0x7fae00158c40 2023-12-24T19:52:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c4e50 con 0x7fae0006d450 2023-12-24T19:52:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41756/0 (socket says 172.21.15.50:41756) 2023-12-24T19:52:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 -- 172.21.15.50:0/1409232253 learned_addr learned my addr 172.21.15.50:0/1409232253 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05e0a700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae00157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae0660b700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae00158c40 0x7fae000c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 -- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 msgr2=0x7fae00157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae00157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 -- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae00158c40 msgr2=0x7fae000c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae00158c40 0x7fae000c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 -- 172.21.15.50:0/1409232253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc009420 con 0x7fae000cc780 2023-12-24T19:52:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05e0a700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae00157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae05609700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fadf000c7c0 tx=0x7fadf0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0005cd0 con 0x7fae000cc780 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0005e30 con 0x7fae000cc780 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf8009a20 con 0x7fae000cc780 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0007320 con 0x7fae000cc780 2023-12-24T19:52:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.838+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae000c5410 con 0x7fae000cc780 2023-12-24T19:52:19.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.842+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0004be40 con 0x7fae000cc780 2023-12-24T19:52:19.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.842+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fadf001b3b0 con 0x7fae000cc780 2023-12-24T19:52:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.842+0000 7fadf5ffb700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 0x7fade4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.842+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6329+0+0 (secure 0 0 0) 0x7fadf007c170 con 0x7fae000cc780 2023-12-24T19:52:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.842+0000 7fae05e0a700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 0x7fade4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.846+0000 7fae05e0a700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 0x7fade4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011560 tx=0x7fadfc0091a0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:19.854+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fadf004c450 con 0x7fae000cc780 2023-12-24T19:52:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.062+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fae0006ad90 con 0x7fae000cc780 2023-12-24T19:52:20.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.634+0000 7fadf5ffb700 1 -- 172.21.15.50:0/1409232253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7fadf004fa70 con 0x7fae000cc780 2023-12-24T19:52:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 msgr2=0x7fade4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 0x7fade4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011560 tx=0x7fadfc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 msgr2=0x7fae00168da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fadf000c7c0 tx=0x7fadf0007e00 comp rx=0 tx=0).stop 2023-12-24T19:52:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 shutdown_connections 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fade4060550 0x7fade4062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae00158c40 0x7fae000c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae000cc780 0x7fae00168da0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 --2- 172.21.15.50:0/1409232253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae0006d450 0x7fae00157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 >> 172.21.15.50:0/1409232253 conn(0x7fae000d0800 msgr2=0x7fae001531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 shutdown_connections 2023-12-24T19:52:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.638+0000 7fae06e0c700 1 -- 172.21.15.50:0/1409232253 wait complete. 2023-12-24T19:52:20.651 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 21 and data pool 22 2023-12-24T19:52:20.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:20.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 Processor -- start 2023-12-24T19:52:20.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 -- start start 2023-12-24T19:52:20.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f150c06aca0 0x7f150c06b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c06c820 con 0x7f150c154450 2023-12-24T19:52:20.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c06b960 con 0x7f150c06aca0 2023-12-24T19:52:20.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f1511a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c06bc40 con 0x7f150c0c6d00 2023-12-24T19:52:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f150b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f150c06aca0 0x7f150c06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f150affd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:57718/0 (socket says 172.21.15.50:57718) 2023-12-24T19:52:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 -- 172.21.15.50:0/3973199361 learned_addr learned my addr 172.21.15.50:0/3973199361 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.850+0000 7f150a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f150c154450 0x7f150c1548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42660/0 (socket says 172.21.15.50:42660) 2023-12-24T19:52:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 -- 172.21.15.50:0/3973199361 >> v2:172.21.15.50:3300/0 conn(0x7f150c06aca0 msgr2=0x7f150c06b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 --2- 172.21.15.50:0/3973199361 >> v2:172.21.15.50:3300/0 conn(0x7f150c06aca0 0x7f150c06b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 -- 172.21.15.50:0/3973199361 >> v1:172.21.15.50:6789/0 conn(0x7f150c154450 legacy=0x7f150c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 -- 172.21.15.50:0/3973199361 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c06bf20 con 0x7f150c0c6d00 2023-12-24T19:52:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f150affd700 1 --2- 172.21.15.50:0/3973199361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009f20 tx=0x7f14fc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873354c8d93b71ae server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1509ffb700 1 -- 172.21.15.50:0/3973199361 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00e070 con 0x7f150c0c6d00 2023-12-24T19:52:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1509ffb700 1 -- 172.21.15.50:0/3973199361 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc00b9d0 con 0x7f150c0c6d00 2023-12-24T19:52:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1509ffb700 1 -- 172.21.15.50:0/3973199361 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0092e0 con 0x7f150c0c6d00 2023-12-24T19:52:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 -- 172.21.15.50:0/3973199361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 msgr2=0x7f150c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3973199361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009f20 tx=0x7f14fc009840 comp rx=0 tx=0).stop 2023-12-24T19:52:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 -- 172.21.15.50:0/3973199361 shutdown_connections 2023-12-24T19:52:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3973199361 >> v2:172.21.15.50:3300/0 conn(0x7f150c06aca0 0x7f150c06b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3973199361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c0c6d00 0x7f150c0c70d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 -- 172.21.15.50:0/3973199361 >> 172.21.15.50:0/3973199361 conn(0x7f150c0cbba0 msgr2=0x7f150c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 -- 172.21.15.50:0/3973199361 shutdown_connections 2023-12-24T19:52:20.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.854+0000 7f1511a2e700 1 -- 172.21.15.50:0/3973199361 wait complete. 2023-12-24T19:52:20.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 Processor -- start 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 -- start start 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c06aca0 0x7f150c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f150c0c6d00 0x7f150c0abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b1460 con 0x7f150c154450 2023-12-24T19:52:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0c4980 con 0x7f150c0c6d00 2023-12-24T19:52:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f1511a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0ac2a0 con 0x7f150c06aca0 2023-12-24T19:52:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41778/0 (socket says 172.21.15.50:41778) 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 -- 172.21.15.50:0/3701167123 learned_addr learned my addr 172.21.15.50:0/3701167123 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150affd700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c06aca0 0x7f150c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150a7fc700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f150c0c6d00 0x7f150c0abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 -- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c06aca0 msgr2=0x7f150c0b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c06aca0 0x7f150c0b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 -- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f150c0c6d00 msgr2=0x7f150c0abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f150c0c6d00 0x7f150c0abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.858+0000 7f150b7fe700 1 -- 172.21.15.50:0/3701167123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009ae0 con 0x7f150c154450 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f150b7fe700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f150400ea80 tx=0x7f15040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400eec0 con 0x7f150c154450 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400c850 con 0x7f150c154450 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c0b1960 con 0x7f150c154450 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400cc10 con 0x7f150c154450 2023-12-24T19:52:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c0c4330 con 0x7f150c154450 2023-12-24T19:52:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c0c4190 con 0x7f150c154450 2023-12-24T19:52:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.862+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1504013470 con 0x7f150c154450 2023-12-24T19:52:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.866+0000 7f14f2ffd700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 0x7f14f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.866+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f150407cc00 con 0x7f150c154450 2023-12-24T19:52:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.866+0000 7f150affd700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 0x7f14f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.866+0000 7f150affd700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 0x7f14f8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f150c0b1bb0 tx=0x7f14fc018000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:20.870+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f150c0c4190 con 0x7f150c154450 2023-12-24T19:52:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.046+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150c0c4b30 con 0x7f150c154450 2023-12-24T19:52:21.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.046+0000 7f14f2ffd700 1 -- 172.21.15.50:0/3701167123 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+16151 (secure 0 0 0) 0x7f150c0c4b30 con 0x7f150c154450 2023-12-24T19:52:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:21.051 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":172,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:52:20.068690+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:21.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 msgr2=0x7f14f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 0x7f14f8062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f150c0b1bb0 tx=0x7f14fc018000 comp rx=0 tx=0).stop 2023-12-24T19:52:21.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 msgr2=0x7f150c153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f150400ea80 tx=0x7f15040091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 shutdown_connections 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f14f8060550 0x7f14f8062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f150c154450 0x7f150c153630 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f150c0c6d00 0x7f150c0abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 --2- 172.21.15.50:0/3701167123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f150c06aca0 0x7f150c0b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 >> 172.21.15.50:0/3701167123 conn(0x7f150c0cbba0 msgr2=0x7f150c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 shutdown_connections 2023-12-24T19:52:21.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.050+0000 7f1511a2e700 1 -- 172.21.15.50:0/3701167123 wait complete. 2023-12-24T19:52:21.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 Processor -- start 2023-12-24T19:52:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 -- start start 2023-12-24T19:52:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4f406b540 0x7fd4f40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f406ba80 con 0x7fd4f4159a20 2023-12-24T19:52:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f406bd60 con 0x7fd4f40ce750 2023-12-24T19:52:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f962e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f415a5d0 con 0x7fd4f406b540 2023-12-24T19:52:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd4f4159a20 0x7fd4f4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42666/0 (socket says 172.21.15.50:42666) 2023-12-24T19:52:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f37fe700 1 -- 172.21.15.50:0/1069483848 learned_addr learned my addr 172.21.15.50:0/1069483848 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f27fc700 1 --2- 172.21.15.50:0/1069483848 >> v2:172.21.15.82:3300/0 conn(0x7fd4f406b540 0x7fd4f40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226055160 0 0) 0x7fd4f406ba80 con 0x7fd4f4159a20 2023-12-24T19:52:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4dc003570 con 0x7fd4f4159a20 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058159538 0 0) 0x7fd4dc003570 con 0x7fd4f4159a20 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 >> v2:172.21.15.82:3300/0 conn(0x7fd4f406b540 msgr2=0x7fd4f40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 --2- 172.21.15.50:0/1069483848 >> v2:172.21.15.82:3300/0 conn(0x7fd4f406b540 0x7fd4f40ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 >> v1:172.21.15.82:6789/0 conn(0x7fd4f40ce750 legacy=0x7fd4f406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f406c040 con 0x7fd4f4159a20 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fd4ec0017f0 con 0x7fd4f4159a20 2023-12-24T19:52:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.242+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 >> v1:172.21.15.50:6789/0 conn(0x7fd4f4159a20 legacy=0x7fd4f4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4dc003a60 0x7fd4dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc004810 0x7fd4dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 0x7fd4dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f415a5d0 con 0x7fd4dc003a60 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00c0d0 con 0x7fd4dc004810 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00c290 con 0x7fd4dc0051c0 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 0x7fd4dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f2ffd700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4dc003a60 0x7fd4dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f27fc700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc004810 0x7fd4dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 -- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc004810 msgr2=0x7fd4dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc004810 0x7fd4dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 -- 172.21.15.50:0/1069483848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4dc003a60 msgr2=0x7fd4dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4dc003a60 0x7fd4dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 -- 172.21.15.50:0/1069483848 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc003570 con 0x7fd4dc0051c0 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 -- 172.21.15.50:0/1069483848 reap_dead start 2023-12-24T19:52:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 0x7fd4dc00ba60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a900 tx=0x7fd4f406c600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4f8d1ece3659bd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0070d0 con 0x7fd4dc0051c0 2023-12-24T19:52:21.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec007230 con 0x7fd4dc0051c0 2023-12-24T19:52:21.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f1ffb700 1 -- 172.21.15.50:0/1069483848 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0075f0 con 0x7fd4dc0051c0 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f962e700 1 -- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 msgr2=0x7fd4dc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f962e700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 0x7fd4dc00ba60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a900 tx=0x7fd4f406c600 comp rx=0 tx=0).stop 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f962e700 1 -- 172.21.15.50:0/1069483848 shutdown_connections 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f962e700 1 --2- 172.21.15.50:0/1069483848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4dc0051c0 0x7fd4dc00ba60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.246+0000 7fd4f962e700 1 -- 172.21.15.50:0/1069483848 >> 172.21.15.50:0/1069483848 conn(0x7fd4f40cffb0 msgr2=0x7fd4f40d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.250+0000 7fd4f962e700 1 -- 172.21.15.50:0/1069483848 shutdown_connections 2023-12-24T19:52:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.250+0000 7fd4f962e700 1 -- 172.21.15.50:0/1069483848 wait complete. 2023-12-24T19:52:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.250+0000 7fd4f962e700 1 Processor -- start 2023-12-24T19:52:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.250+0000 7fd4f962e700 1 -- start start 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc0051c0 0x7fd4f40c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4f415c830 0x7fd4f41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f4168fe0 con 0x7fd4f415a730 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f415b110 con 0x7fd4dc0051c0 2023-12-24T19:52:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40c8930 con 0x7fd4f415c830 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41794/0 (socket says 172.21.15.50:41794) 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 -- 172.21.15.50:0/2060065773 learned_addr learned my addr 172.21.15.50:0/2060065773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f2ffd700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc0051c0 0x7fd4f40c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f27fc700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4f415c830 0x7fd4f41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 -- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4f415c830 msgr2=0x7fd4f41569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4f415c830 0x7fd4f41569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 -- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc0051c0 msgr2=0x7fd4f40c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc0051c0 0x7fd4f40c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 -- 172.21.15.50:0/2060065773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40c8c10 con 0x7fd4f415a730 2023-12-24T19:52:21.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f37fe700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec002250 tx=0x7fd4ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0070d0 con 0x7fd4f415a730 2023-12-24T19:52:21.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec007960 con 0x7fd4f415a730 2023-12-24T19:52:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f40c8ef0 con 0x7fd4f415a730 2023-12-24T19:52:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0075d0 con 0x7fd4f415a730 2023-12-24T19:52:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.254+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f40c8570 con 0x7fd4f415a730 2023-12-24T19:52:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.258+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f4169130 con 0x7fd4f415a730 2023-12-24T19:52:21.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.258+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd4ec029460 con 0x7fd4f415a730 2023-12-24T19:52:21.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.262+0000 7fd4daffd700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 0x7fd4e0062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.262+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fd4ec07efe0 con 0x7fd4f415a730 2023-12-24T19:52:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.262+0000 7fd4f2ffd700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 0x7fd4e0062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.262+0000 7fd4f2ffd700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 0x7fd4e0062b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4007d30 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.266+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd4f4169130 con 0x7fd4f415a730 2023-12-24T19:52:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.438+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4f4169130 con 0x7fd4f415a730 2023-12-24T19:52:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4daffd700 1 -- 172.21.15.50:0/2060065773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16138 (secure 0 0 0) 0x7fd4f4169130 con 0x7fd4f415a730 2023-12-24T19:52:21.444 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:21.444 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":173,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:52:21.421976+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 msgr2=0x7fd4e0062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 0x7fd4e0062b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4007d30 comp rx=0 tx=0).stop 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 msgr2=0x7fd4f415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec002250 tx=0x7fd4ec015000 comp rx=0 tx=0).stop 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 shutdown_connections 2023-12-24T19:52:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd4e0060650 0x7fd4e0062b00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f415a730 0x7fd4f415abd0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4f415c830 0x7fd4f41569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 --2- 172.21.15.50:0/2060065773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4dc0051c0 0x7fd4f40c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 >> 172.21.15.50:0/2060065773 conn(0x7fd4f40cffb0 msgr2=0x7fd4f40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 shutdown_connections 2023-12-24T19:52:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.442+0000 7fd4f962e700 1 -- 172.21.15.50:0/2060065773 wait complete. 2023-12-24T19:52:21.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:52:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.654+0000 7fea61ce3700 1 Processor -- start 2023-12-24T19:52:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.654+0000 7fea61ce3700 1 -- start start 2023-12-24T19:52:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea61ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 0x7fea5c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea61ce3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea5c0adb50 0x7fea5c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea61ce3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c15b5a0 con 0x7fea5c0c87d0 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea61ce3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c15a990 con 0x7fea5c0adb50 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea61ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15ac70 con 0x7fea5c156ab0 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea614e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea5c0c87d0 0x7fea5c0ab750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42680/0 (socket says 172.21.15.50:42680) 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea614e2700 1 -- 172.21.15.50:0/3944926273 learned_addr learned my addr 172.21.15.50:0/3944926273 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3944926273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 0x7fea5c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea5bfff700 1 --2- 172.21.15.50:0/3944926273 >> v2:172.21.15.82:3300/0 conn(0x7fea5c0adb50 0x7fea5c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 -- 172.21.15.50:0/3944926273 >> v2:172.21.15.82:3300/0 conn(0x7fea5c0adb50 msgr2=0x7fea5c0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3944926273 >> v2:172.21.15.82:3300/0 conn(0x7fea5c0adb50 0x7fea5c0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 -- 172.21.15.50:0/3944926273 >> v1:172.21.15.50:6789/0 conn(0x7fea5c0c87d0 legacy=0x7fea5c0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 -- 172.21.15.50:0/3944926273 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c15af50 con 0x7fea5c156ab0 2023-12-24T19:52:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea5b7fe700 1 -- 172.21.15.50:0/3944926273 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086310891 0 0) 0x7fea5c15b5a0 con 0x7fea5c0c87d0 2023-12-24T19:52:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3944926273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 0x7fea5c156e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fea500098e0 tx=0x7fea500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcdbaf4082327fa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea5b7fe700 1 -- 172.21.15.50:0/3944926273 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000b640 con 0x7fea5c156ab0 2023-12-24T19:52:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea5b7fe700 1 -- 172.21.15.50:0/3944926273 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000b7a0 con 0x7fea5c156ab0 2023-12-24T19:52:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.658+0000 7fea5b7fe700 1 -- 172.21.15.50:0/3944926273 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000bb40 con 0x7fea5c156ab0 2023-12-24T19:52:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 -- 172.21.15.50:0/3944926273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 msgr2=0x7fea5c156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3944926273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 0x7fea5c156e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fea500098e0 tx=0x7fea500091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 -- 172.21.15.50:0/3944926273 shutdown_connections 2023-12-24T19:52:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3944926273 >> v2:172.21.15.82:3300/0 conn(0x7fea5c0adb50 0x7fea5c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3944926273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c156ab0 0x7fea5c156e80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 -- 172.21.15.50:0/3944926273 >> 172.21.15.50:0/3944926273 conn(0x7fea5c067250 msgr2=0x7fea5c067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 -- 172.21.15.50:0/3944926273 shutdown_connections 2023-12-24T19:52:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 -- 172.21.15.50:0/3944926273 wait complete. 2023-12-24T19:52:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.662+0000 7fea61ce3700 1 Processor -- start 2023-12-24T19:52:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 -- start start 2023-12-24T19:52:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c0adb50 0x7fea5c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c87d0 0x7fea5c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c5950 con 0x7fea5c156ab0 2023-12-24T19:52:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0a9c20 con 0x7fea5c0c87d0 2023-12-24T19:52:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0cb5c0 con 0x7fea5c0adb50 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41798/0 (socket says 172.21.15.50:41798) 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 -- 172.21.15.50:0/3570391668 learned_addr learned my addr 172.21.15.50:0/3570391668 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c0adb50 0x7fea5c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea5bfff700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c87d0 0x7fea5c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 -- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c0adb50 msgr2=0x7fea5c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c0adb50 0x7fea5c0c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 -- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c87d0 msgr2=0x7fea5c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c87d0 0x7fea5c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 -- 172.21.15.50:0/3570391668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009420 con 0x7fea5c156ab0 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea614e2700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fea5400ccc0 tx=0x7fea54001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400a8a0 con 0x7fea5c156ab0 2023-12-24T19:52:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400aa00 con 0x7fea5c156ab0 2023-12-24T19:52:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0c9a20 con 0x7fea5c156ab0 2023-12-24T19:52:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.666+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400adc0 con 0x7fea5c156ab0 2023-12-24T19:52:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.670+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c0a98b0 con 0x7fea5c156ab0 2023-12-24T19:52:21.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.670+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c04be40 con 0x7fea5c156ab0 2023-12-24T19:52:21.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.670+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fea54007300 con 0x7fea5c156ab0 2023-12-24T19:52:21.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.674+0000 7fea58ff9700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 0x7fea40062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:21.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.674+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fea5407cde0 con 0x7fea5c156ab0 2023-12-24T19:52:21.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.674+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 0x7fea40062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:21.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.674+0000 7fea60ce1700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 0x7fea40062ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.678+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea5404d160 con 0x7fea5c156ab0 2023-12-24T19:52:21.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:21.898+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea5c0a9d90 con 0x7fea5c156ab0 2023-12-24T19:52:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.650+0000 7fea58ff9700 1 -- 172.21.15.50:0/3570391668 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea54050780 con 0x7fea5c156ab0 2023-12-24T19:52:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 msgr2=0x7fea40062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 0x7fea40062ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).stop 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 msgr2=0x7fea5c0ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fea5400ccc0 tx=0x7fea54001a80 comp rx=0 tx=0).stop 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 shutdown_connections 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fea40060620 0x7fea40062ad0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5c156ab0 0x7fea5c0ab440 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c87d0 0x7fea5c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 --2- 172.21.15.50:0/3570391668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea5c0adb50 0x7fea5c0c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.654+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 >> 172.21.15.50:0/3570391668 conn(0x7fea5c067250 msgr2=0x7fea5c151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.658+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 shutdown_connections 2023-12-24T19:52:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.658+0000 7fea61ce3700 1 -- 172.21.15.50:0/3570391668 wait complete. 2023-12-24T19:52:22.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:52:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.862+0000 7f296bd45700 1 Processor -- start 2023-12-24T19:52:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 -- start start 2023-12-24T19:52:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29640cf4d0 0x7f296406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29640cf8a0 0x7f296406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296406b0a0 con 0x7f296406ac40 2023-12-24T19:52:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2964159640 con 0x7f29640cf8a0 2023-12-24T19:52:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.866+0000 7f296bd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29640cd680 con 0x7f29640cf4d0 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29640cf8a0 0x7f296406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29640cf8a0 0x7f296406a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41812/0 (socket says 172.21.15.50:41812) 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 -- 172.21.15.50:0/2432076722 learned_addr learned my addr 172.21.15.50:0/2432076722 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f2969ae1700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29640cf4d0 0x7f296406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 -- 172.21.15.50:0/2432076722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29640cf4d0 msgr2=0x7f296406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29640cf4d0 0x7f296406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 -- 172.21.15.50:0/2432076722 >> v1:172.21.15.82:6789/0 conn(0x7f296406ac40 legacy=0x7f296415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 -- 172.21.15.50:0/2432076722 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640cca70 con 0x7f29640cf8a0 2023-12-24T19:52:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f29692e0700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f296406a700 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f29540099b0 tx=0x7f2954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ce4b1d0c15461d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f2968adf700 1 -- 172.21.15.50:0/2432076722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954009ea0 con 0x7f29640cf8a0 2023-12-24T19:52:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f2968adf700 1 -- 172.21.15.50:0/2432076722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400b860 con 0x7f29640cf8a0 2023-12-24T19:52:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f2968adf700 1 -- 172.21.15.50:0/2432076722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400bc00 con 0x7f29640cf8a0 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 -- 172.21.15.50:0/2432076722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 msgr2=0x7f296406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f296406a700 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f29540099b0 tx=0x7f2954009250 comp rx=0 tx=0).stop 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 -- 172.21.15.50:0/2432076722 shutdown_connections 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f296406a700 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 --2- 172.21.15.50:0/2432076722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29640cf4d0 0x7f296406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 -- 172.21.15.50:0/2432076722 >> 172.21.15.50:0/2432076722 conn(0x7f2964067b30 msgr2=0x7f29640cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 -- 172.21.15.50:0/2432076722 shutdown_connections 2023-12-24T19:52:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.870+0000 7f296bd45700 1 -- 172.21.15.50:0/2432076722 wait complete. 2023-12-24T19:52:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.874+0000 7f296bd45700 1 Processor -- start 2023-12-24T19:52:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.874+0000 7f296bd45700 1 -- start start 2023-12-24T19:52:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640cf4d0 0x7f296415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f2964169370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296416a260 con 0x7f29640cf8a0 2023-12-24T19:52:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296415c0e0 con 0x7f29640cf4d0 2023-12-24T19:52:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2964155d00 con 0x7f296406ac40 2023-12-24T19:52:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296a2e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f2964169370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f29692e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640cf4d0 0x7f296415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:57768/0 (socket says 172.21.15.50:57768) 2023-12-24T19:52:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 -- 172.21.15.50:0/4000835680 learned_addr learned my addr 172.21.15.50:0/4000835680 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 -- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640cf4d0 msgr2=0x7f296415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640cf4d0 0x7f296415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 -- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 msgr2=0x7f2964169370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f2964169370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 -- 172.21.15.50:0/4000835680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540094f0 con 0x7f296406ac40 2023-12-24T19:52:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296a2e2700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f2964169370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2969ae1700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f296000ec80 tx=0x7f29600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000c850 con 0x7f296406ac40 2023-12-24T19:52:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000c9b0 con 0x7f296406ac40 2023-12-24T19:52:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296415b4d0 con 0x7f296406ac40 2023-12-24T19:52:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000cd50 con 0x7f296406ac40 2023-12-24T19:52:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.878+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296415ba90 con 0x7f296406ac40 2023-12-24T19:52:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.882+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29640652e0 con 0x7f296406ac40 2023-12-24T19:52:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.882+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2960013680 con 0x7f296406ac40 2023-12-24T19:52:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.886+0000 7f2959ffb700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 0x7f2948062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.886+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f296007cd40 con 0x7f296406ac40 2023-12-24T19:52:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.886+0000 7f29692e0700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 0x7f2948062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.886+0000 7f29692e0700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 0x7f2948062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29540099b0 tx=0x7f2954017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:22.890+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f296004cfc0 con 0x7f296406ac40 2023-12-24T19:52:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.098+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f29640ccd50 con 0x7f296406ac40 2023-12-24T19:52:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.674+0000 7f2959ffb700 1 -- 172.21.15.50:0/4000835680 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f29600505e0 con 0x7f296406ac40 2023-12-24T19:52:23.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 msgr2=0x7f2948062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 0x7f2948062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29540099b0 tx=0x7f2954017000 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 msgr2=0x7f29641557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f296000ec80 tx=0x7f29600091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 shutdown_connections 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f2948060550 0x7f2948062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29640cf8a0 0x7f2964169370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640cf4d0 0x7f296415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 --2- 172.21.15.50:0/4000835680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f296406ac40 0x7f29641557c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 >> 172.21.15.50:0/4000835680 conn(0x7f2964067b30 msgr2=0x7f29640b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 shutdown_connections 2023-12-24T19:52:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.678+0000 7f296bd45700 1 -- 172.21.15.50:0/4000835680 wait complete. 2023-12-24T19:52:23.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.886+0000 7fbef759e700 1 Processor -- start 2023-12-24T19:52:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.886+0000 7fbef759e700 1 -- start start 2023-12-24T19:52:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 0x7fbef81590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80a9c80 con 0x7fbef806c0c0 2023-12-24T19:52:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80a9070 con 0x7fbef8158cd0 2023-12-24T19:52:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef806c520 con 0x7fbef806b6c0 2023-12-24T19:52:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbef806c0c0 0x7fbef806c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42684/0 (socket says 172.21.15.50:42684) 2023-12-24T19:52:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbef6d9d700 1 -- 172.21.15.50:0/505507652 learned_addr learned my addr 172.21.15.50:0/505507652 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.890+0000 7fbeedd9b700 1 --2- 172.21.15.50:0/505507652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 0x7fbef81590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef5d9b700 1 -- 172.21.15.50:0/505507652 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580295798 0 0) 0x7fbef80a9070 con 0x7fbef8158cd0 2023-12-24T19:52:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbeedd9b700 1 -- 172.21.15.50:0/505507652 >> v1:172.21.15.82:6789/0 conn(0x7fbef8158cd0 legacy=0x7fbef806afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbeedd9b700 1 -- 172.21.15.50:0/505507652 >> v1:172.21.15.50:6789/0 conn(0x7fbef806c0c0 legacy=0x7fbef806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbeedd9b700 1 -- 172.21.15.50:0/505507652 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80a9350 con 0x7fbef806b6c0 2023-12-24T19:52:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbeedd9b700 1 --2- 172.21.15.50:0/505507652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 0x7fbef81590a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009910 tx=0x7fbee00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9df806d196ab99 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef5d9b700 1 -- 172.21.15.50:0/505507652 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000b760 con 0x7fbef806b6c0 2023-12-24T19:52:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef5d9b700 1 -- 172.21.15.50:0/505507652 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000b8c0 con 0x7fbef806b6c0 2023-12-24T19:52:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef5d9b700 1 -- 172.21.15.50:0/505507652 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000bc60 con 0x7fbef806b6c0 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 -- 172.21.15.50:0/505507652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 msgr2=0x7fbef81590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 --2- 172.21.15.50:0/505507652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 0x7fbef81590a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009910 tx=0x7fbee00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 -- 172.21.15.50:0/505507652 shutdown_connections 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 --2- 172.21.15.50:0/505507652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef806b6c0 0x7fbef81590a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 -- 172.21.15.50:0/505507652 >> 172.21.15.50:0/505507652 conn(0x7fbef8067b80 msgr2=0x7fbef80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 -- 172.21.15.50:0/505507652 shutdown_connections 2023-12-24T19:52:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.894+0000 7fbef759e700 1 -- 172.21.15.50:0/505507652 wait complete. 2023-12-24T19:52:23.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 Processor -- start 2023-12-24T19:52:23.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 -- start start 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 0x7fbef81532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef8158cd0 0x7fbef81569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815e640 con 0x7fbef806c0c0 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81578c0 con 0x7fbef806b6c0 2023-12-24T19:52:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815e360 con 0x7fbef8158cd0 2023-12-24T19:52:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbeedd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbeedd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41834/0 (socket says 172.21.15.50:41834) 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbeedd9b700 1 -- 172.21.15.50:0/2087949998 learned_addr learned my addr 172.21.15.50:0/2087949998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef6d9d700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef8158cd0 0x7fbef81569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.898+0000 7fbef659c700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 0x7fbef81532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 -- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef8158cd0 msgr2=0x7fbef81569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef8158cd0 0x7fbef81569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 -- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 msgr2=0x7fbef81532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 0x7fbef81532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 -- 172.21.15.50:0/2087949998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0009420 con 0x7fbef806c0c0 2023-12-24T19:52:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbef659c700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 0x7fbef81532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeedd9b700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbef80a9c30 tx=0x7fbee0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee001c460 con 0x7fbef806c0c0 2023-12-24T19:52:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee001c5e0 con 0x7fbef806c0c0 2023-12-24T19:52:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee001c9a0 con 0x7fbef806c0c0 2023-12-24T19:52:23.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8157270 con 0x7fbef806c0c0 2023-12-24T19:52:23.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8156f30 con 0x7fbef806c0c0 2023-12-24T19:52:23.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.902+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8157a50 con 0x7fbef806c0c0 2023-12-24T19:52:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.906+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbee001a450 con 0x7fbef806c0c0 2023-12-24T19:52:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.906+0000 7fbeeeffd700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 0x7fbed8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.906+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fbee007ef70 con 0x7fbef806c0c0 2023-12-24T19:52:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.906+0000 7fbef659c700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 0x7fbed8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.906+0000 7fbef659c700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 0x7fbed8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbee80011e0 tx=0x7fbee8009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:23.914+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbee004f1f0 con 0x7fbef806c0c0 2023-12-24T19:52:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.126+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef8157a00 con 0x7fbef806c0c0 2023-12-24T19:52:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.126+0000 7fbeeeffd700 1 -- 172.21.15.50:0/2087949998 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fbee0052810 con 0x7fbef806c0c0 2023-12-24T19:52:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:24.129 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T19:52:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 msgr2=0x7fbed8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 0x7fbed8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbee80011e0 tx=0x7fbee8009040 comp rx=0 tx=0).stop 2023-12-24T19:52:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 msgr2=0x7fbef81564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbef80a9c30 tx=0x7fbee0016000 comp rx=0 tx=0).stop 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 shutdown_connections 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fbed8060550 0x7fbed8062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbef8158cd0 0x7fbef81569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef806c0c0 0x7fbef81564b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 --2- 172.21.15.50:0/2087949998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbef806b6c0 0x7fbef81532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 >> 172.21.15.50:0/2087949998 conn(0x7fbef8067b80 msgr2=0x7fbef8154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 shutdown_connections 2023-12-24T19:52:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.130+0000 7fbef759e700 1 -- 172.21.15.50:0/2087949998 wait complete. 2023-12-24T19:52:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T19:52:24.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:52:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.318+0000 7f1eef043700 1 Processor -- start 2023-12-24T19:52:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.318+0000 7f1eef043700 1 -- start start 2023-12-24T19:52:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eef043700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ee80ae100 0x7f1ee8161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eef043700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee806c4d0 con 0x7f1ee81611b0 2023-12-24T19:52:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eef043700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee806c1f0 con 0x7f1ee806c820 2023-12-24T19:52:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eef043700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee80ab5e0 con 0x7f1ee80ae100 2023-12-24T19:52:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eee041700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ee81611b0 0x7f1ee806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42696/0 (socket says 172.21.15.50:42696) 2023-12-24T19:52:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eee041700 1 -- 172.21.15.50:0/1911147945 learned_addr learned my addr 172.21.15.50:0/1911147945 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed840700 1 --2- 172.21.15.50:0/1911147945 >> v2:172.21.15.82:3300/0 conn(0x7f1ee80ae100 0x7f1ee8161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97027801 0 0) 0x7f1ee4001110 con 0x7f1ee81611b0 2023-12-24T19:52:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed4003570 con 0x7f1ee81611b0 2023-12-24T19:52:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741276695 0 0) 0x7f1ee806c1f0 con 0x7f1ee806c820 2023-12-24T19:52:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee4001110 con 0x7f1ee806c820 2023-12-24T19:52:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.322+0000 7f1eed840700 1 -- 172.21.15.50:0/1911147945 >> v1:172.21.15.82:6789/0 conn(0x7f1ee806c820 legacy=0x7f1ee80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed840700 1 -- 172.21.15.50:0/1911147945 >> v1:172.21.15.50:6789/0 conn(0x7f1ee81611b0 legacy=0x7f1ee806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed840700 1 -- 172.21.15.50:0/1911147945 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee80ab8c0 con 0x7f1ee80ae100 2023-12-24T19:52:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed840700 1 --2- 172.21.15.50:0/1911147945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee80ae100 0x7f1ee8161580 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80098e0 tx=0x7f1ed80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d8562f04a6626d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011630 con 0x7f1ee80ae100 2023-12-24T19:52:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8011790 con 0x7f1ee80ae100 2023-12-24T19:52:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eed03f700 1 -- 172.21.15.50:0/1911147945 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011b30 con 0x7f1ee80ae100 2023-12-24T19:52:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 -- 172.21.15.50:0/1911147945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee80ae100 msgr2=0x7f1ee8161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 --2- 172.21.15.50:0/1911147945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee80ae100 0x7f1ee8161580 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80098e0 tx=0x7f1ed80091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 -- 172.21.15.50:0/1911147945 shutdown_connections 2023-12-24T19:52:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 --2- 172.21.15.50:0/1911147945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee80ae100 0x7f1ee8161580 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 -- 172.21.15.50:0/1911147945 >> 172.21.15.50:0/1911147945 conn(0x7f1ee8067b80 msgr2=0x7f1ee80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 -- 172.21.15.50:0/1911147945 shutdown_connections 2023-12-24T19:52:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.326+0000 7f1eef043700 1 -- 172.21.15.50:0/1911147945 wait complete. 2023-12-24T19:52:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 Processor -- start 2023-12-24T19:52:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 -- start start 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee806c820 0x7f1ee8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee81611b0 0x7f1ee8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee815f620 con 0x7f1ee80ae100 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee815f010 con 0x7f1ee806c820 2023-12-24T19:52:24.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eef043700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8147180 con 0x7f1ee81611b0 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41838/0 (socket says 172.21.15.50:41838) 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eee041700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee806c820 0x7f1ee8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 -- 172.21.15.50:0/3172444691 learned_addr learned my addr 172.21.15.50:0/3172444691 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eee842700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee81611b0 0x7f1ee8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 -- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee81611b0 msgr2=0x7f1ee8158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee81611b0 0x7f1ee8158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 -- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee806c820 msgr2=0x7f1ee8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee806c820 0x7f1ee8146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.330+0000 7f1eed840700 1 -- 172.21.15.50:0/3172444691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8009420 con 0x7f1ee80ae100 2023-12-24T19:52:24.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1eed840700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80c95c0 tx=0x7f1ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed801f070 con 0x7f1ee80ae100 2023-12-24T19:52:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee80b1680 con 0x7f1ee80ae100 2023-12-24T19:52:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8011900 con 0x7f1ee80ae100 2023-12-24T19:52:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8023410 con 0x7f1ee80ae100 2023-12-24T19:52:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee815f2b0 con 0x7f1ee80ae100 2023-12-24T19:52:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.334+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee815f790 con 0x7f1ee80ae100 2023-12-24T19:52:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.338+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1ed802c3b0 con 0x7f1ee80ae100 2023-12-24T19:52:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.338+0000 7f1ede7fc700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 0x7f1ecc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.338+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1ed807dcf0 con 0x7f1ee80ae100 2023-12-24T19:52:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.338+0000 7f1eee041700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 0x7f1ecc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.338+0000 7f1eee041700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 0x7f1ecc062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007fd0 tx=0x7f1ee4009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.346+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ed8082070 con 0x7f1ee80ae100 2023-12-24T19:52:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.518+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ee806a840 con 0x7f1ee80ae100 2023-12-24T19:52:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.522+0000 7f1ede7fc700 1 -- 172.21.15.50:0/3172444691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16138 (secure 0 0 0) 0x7f1ed804e010 con 0x7f1ee80ae100 2023-12-24T19:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":173,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T19:52:21.421976+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:52:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.522+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 msgr2=0x7f1ecc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.522+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 0x7f1ecc062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007fd0 tx=0x7f1ee4009040 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.522+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 msgr2=0x7f1ee8158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.522+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80c95c0 tx=0x7f1ed8017000 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 shutdown_connections 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ecc060580 0x7f1ecc062a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee81611b0 0x7f1ee8158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80ae100 0x7f1ee8158740 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 --2- 172.21.15.50:0/3172444691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee806c820 0x7f1ee8146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 >> 172.21.15.50:0/3172444691 conn(0x7f1ee8067b80 msgr2=0x7f1ee806b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 shutdown_connections 2023-12-24T19:52:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.526+0000 7f1eef043700 1 -- 172.21.15.50:0/3172444691 wait complete. 2023-12-24T19:52:24.552 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:52:24.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:52:24.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 Processor -- start 2023-12-24T19:52:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 -- start start 2023-12-24T19:52:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ae41611b0 0x7f9ae4161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ae40ae100 0x7f9ae406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae406c4d0 con 0x7f9ae406c820 2023-12-24T19:52:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae406c1f0 con 0x7f9ae40ae100 2023-12-24T19:52:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9aea7cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40ab5e0 con 0x7f9ae41611b0 2023-12-24T19:52:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9ae9fcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ae406c820 0x7f9ae40ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42704/0 (socket says 172.21.15.50:42704) 2023-12-24T19:52:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9ae9fcb700 1 -- 172.21.15.50:0/2483359797 learned_addr learned my addr 172.21.15.50:0/2483359797 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ae41611b0 0x7f9ae4161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.718+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/2483359797 >> v2:172.21.15.82:3300/0 conn(0x7f9ae40ae100 0x7f9ae406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646007417 0 0) 0x7f9adc001110 con 0x7f9ae406c820 2023-12-24T19:52:24.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad0003570 con 0x7f9ae406c820 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284747615 0 0) 0x7f9ad0003570 con 0x7f9ae406c820 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ae41611b0 msgr2=0x7f9ae4161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ae41611b0 0x7f9ae4161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 >> v2:172.21.15.82:3300/0 conn(0x7f9ae40ae100 msgr2=0x7f9ae406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 --2- 172.21.15.50:0/2483359797 >> v2:172.21.15.82:3300/0 conn(0x7f9ae40ae100 0x7f9ae406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40ab8c0 con 0x7f9ae406c820 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f9adc001600 con 0x7f9ae406c820 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 >> v1:172.21.15.50:6789/0 conn(0x7f9ae406c820 legacy=0x7f9ae40ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0003a60 0x7f9ad0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0004810 0x7f9ad0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad00051c0 0x7f9ad000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae406c1f0 con 0x7f9ad0004810 2023-12-24T19:52:24.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40ab5e0 con 0x7f9ad00051c0 2023-12-24T19:52:24.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad000bfa0 con 0x7f9ad0003a60 2023-12-24T19:52:24.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ae41611b0 0x7f9ae4161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:24.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0004810 0x7f9ad0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae9fcb700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad00051c0 0x7f9ad000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0003a60 msgr2=0x7f9ad0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0003a60 0x7f9ad0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0003a60 0x7f9ad0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad00051c0 msgr2=0x7f9ad000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad00051c0 0x7f9ad000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/2483359797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0003570 con 0x7f9ad0004810 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0003a60 0x7f9ad0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0004810 0x7f9ad0004c80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009c00 tx=0x7f9ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7da2e95cb15118 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e710 con 0x7f9ad0004810 2023-12-24T19:52:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400e870 con 0x7f9ad0004810 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.722+0000 7f9adbfff700 1 -- 172.21.15.50:0/2483359797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400ec30 con 0x7f9ad0004810 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- 172.21.15.50:0/2483359797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0004810 msgr2=0x7f9ad0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/2483359797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0004810 0x7f9ad0004c80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009c00 tx=0x7f9ad40091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9ae9fcb700 1 -- 172.21.15.50:0/2483359797 reap_dead start 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- 172.21.15.50:0/2483359797 shutdown_connections 2023-12-24T19:52:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- 172.21.15.50:0/2483359797 >> 172.21.15.50:0/2483359797 conn(0x7f9ae4067b80 msgr2=0x7f9ae40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- 172.21.15.50:0/2483359797 shutdown_connections 2023-12-24T19:52:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- 172.21.15.50:0/2483359797 wait complete. 2023-12-24T19:52:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 Processor -- start 2023-12-24T19:52:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.726+0000 7f9aea7cc700 1 -- start start 2023-12-24T19:52:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0004810 0x7f9ae4160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ae415faa0 0x7f9ae415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae415f610 con 0x7f9ae415e4b0 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae415ea00 con 0x7f9ae415faa0 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae415ece0 con 0x7f9ad0004810 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41846/0 (socket says 172.21.15.50:41846) 2023-12-24T19:52:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/438725491 learned_addr learned my addr 172.21.15.50:0/438725491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0004810 0x7f9ae4160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae9fcb700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ae415faa0 0x7f9ae415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0004810 msgr2=0x7f9ae4160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0004810 0x7f9ae4160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ae415faa0 msgr2=0x7f9ae415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ae415faa0 0x7f9ae415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 -- 172.21.15.50:0/438725491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae415efc0 con 0x7f9ae415e4b0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ae8fc9700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0004650 tx=0x7f9ad401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4022070 con 0x7f9ae415e4b0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400ebf0 con 0x7f9ae415e4b0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae415f2a0 con 0x7f9ae415e4b0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad401c6c0 con 0x7f9ae415e4b0 2023-12-24T19:52:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.730+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae40aa3a0 con 0x7f9ae415e4b0 2023-12-24T19:52:24.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.734+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae4159c20 con 0x7f9ae415e4b0 2023-12-24T19:52:24.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.734+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9ad401ca70 con 0x7f9ae415e4b0 2023-12-24T19:52:24.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.734+0000 7f9ad97fa700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 0x7f9ac8062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:24.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.734+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f9ad407e480 con 0x7f9ae415e4b0 2023-12-24T19:52:24.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.734+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 0x7f9ac8062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.738+0000 7f9ae97ca700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 0x7f9ac8062ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00099f0 tx=0x7f9ae000b040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:24.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.738+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ae4159c20 con 0x7f9ae415e4b0 2023-12-24T19:52:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.918+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ae4159c20 con 0x7f9ac8060600 2023-12-24T19:52:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.926+0000 7f9ad97fa700 1 -- 172.21.15.50:0/438725491 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271378 (secure 0 0 0) 0x7f9ae4159c20 con 0x7f9ac8060600 2023-12-24T19:52:24.937 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 msgr2=0x7f9ac8062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 0x7f9ac8062ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00099f0 tx=0x7f9ae000b040 comp rx=0 tx=0).stop 2023-12-24T19:52:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 msgr2=0x7f9ae40a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0004650 tx=0x7f9ad401a000 comp rx=0 tx=0).stop 2023-12-24T19:52:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 shutdown_connections 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f9ac8060600 0x7f9ac8062ab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ae415faa0 0x7f9ae415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae415e4b0 0x7f9ae40a9e60 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 --2- 172.21.15.50:0/438725491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ad0004810 0x7f9ae4160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 >> 172.21.15.50:0/438725491 conn(0x7f9ae4067b80 msgr2=0x7f9ae40abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:24.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 shutdown_connections 2023-12-24T19:52:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:24.934+0000 7f9aea7cc700 1 -- 172.21.15.50:0/438725491 wait complete. 2023-12-24T19:52:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:52:24.958 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T19:52:23.504816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2469704,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752505016,"statfs":{"total":773094113280,"available":770565136384,"internally_reserved":0,"allocated":18096128,"data_stored":9940800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.915605"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"162'293","reported_seq":903,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-24T19:52:16.354844+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:52:16.354844+0000","last_peered":"2023-12-24T19:52:16.354844+0000","last_clean":"2023-12-24T19:52:16.354844+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:52:16.354844+0000","last_undegraded":"2023-12-24T19:52:16.354844+0000","last_fullsized":"2023-12-24T19:52:16.354844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299932,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071908,"statfs":{"total":96636764160,"available":96329633792,"internally_reserved":0,"allocated":2707456,"data_stored":1685376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":1.3899999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":1.621}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.264},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.665}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":1.089},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.4750000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.323}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.232},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.2809999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.425}]}]},{"osd":6,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315736,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056104,"statfs":{"total":96636764160,"available":96313450496,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.956}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.196}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.379},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.111}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.615}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.579},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.6910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307544,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.95399999999999996}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.02}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.286}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.2130000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.069}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.365},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.149},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.4470000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060200,"statfs":{"total":96636764160,"available":96317644800,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.28},"min":{"1min":0.622,"5min":0.622,"15min":0.58399999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.175}]},{"osd":1,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2110000000000001,"15min":1.1679999999999999},"min":{"1min":0.83099999999999996,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1990000000000001,"15min":1.1539999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.1550000000000002,"5min":4.1550000000000002,"15min":4.1550000000000002},"last":0.96199999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.391,"15min":1.369},"min":{"1min":0.746,"5min":0.746,"15min":0.63900000000000001},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.397,"15min":1.3600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.4139999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.238,"15min":1.1919999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.46400000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.99399999999999999,"5min":0.89400000000000002,"15min":0.63900000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.131}]},{"osd":5,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3140000000000001,"15min":1.2849999999999999},"min":{"1min":0.77500000000000002,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":3.29,"5min":3.29,"15min":3.29},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.361,"15min":1.3300000000000001},"min":{"1min":0.92400000000000004,"5min":0.72999999999999998,"15min":0.58799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.24}]},{"osd":6,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.2929999999999999,"15min":1.266},"min":{"1min":1.095,"5min":0.79900000000000004,"15min":0.56000000000000005},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.363},{"interface":"front","average":{"1min":1.419,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.95699999999999996,"5min":0.621,"15min":0.621},"max":{"1min":1.853,"5min":1.887,"15min":1.887},"last":1.2090000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.3320000000000001,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.54500000000000004},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4430000000000001,"15min":1.4199999999999999},"min":{"1min":1.042,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.843,"5min":2,"15min":2},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060200,"statfs":{"total":96636764160,"available":96317644800,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.873},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":1.004},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.94399999999999995}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.3200000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.27},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.248},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.347}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.518},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834575756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315736,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056104,"statfs":{"total":96636764160,"available":96313450496,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":1.0449999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.99199999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.2430000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.5049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307544,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3360000000000001,"5min":1.421,"15min":1.647},"last":0.872},{"interface":"front","average":{"1min":1.073,"5min":1.1479999999999999,"15min":1.145},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3640000000000001,"5min":1.744,"15min":1.744},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.79000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.706,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.268,"15min":1.2649999999999999},"min":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":1.669,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.64700000000000002},"max":{"1min":1.702,"5min":1.726,"15min":1.823},"last":0.82699999999999996}]},{"osd":4,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2789999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.254},{"interface":"front","average":{"1min":1.367,"5min":1.429,"15min":1.423},"min":{"1min":0.93500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.7729999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.077}]},{"osd":5,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.413,"15min":1.407},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.948},"last":1.323},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.383},"min":{"1min":0.97699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.2189999999999999},"last":1.383}]},{"osd":6,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5189999999999999,"15min":1.506},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8919999999999999,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.514,"15min":1.5},"min":{"1min":1.1259999999999999,"5min":1.008,"15min":0.88900000000000001},"max":{"1min":1.7969999999999999,"5min":2.1339999999999999,"15min":2.323},"last":1.474}]},{"osd":7,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5640000000000001,"15min":1.5509999999999999},"min":{"1min":1.1100000000000001,"5min":0.999,"15min":0.999},"max":{"1min":1.95,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.53,"15min":1.5109999999999999},"min":{"1min":1.0109999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.954,"5min":2.532,"15min":2.532},"last":1.5029999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299932,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071908,"statfs":{"total":96636764160,"available":96329633792,"internally_reserved":0,"allocated":2707456,"data_stored":1685376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90300000000000002,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.478,"5min":1.6859999999999999,"15min":1.7250000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0669999999999999,"15min":1.018},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.50800000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0609999999999999,"15min":1.0940000000000001},"min":{"1min":0.79800000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.6950000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.129,"15min":1.137},"min":{"1min":0.93100000000000005,"5min":0.67800000000000005,"15min":0.61599999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.833},"last":1.0660000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.68500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6319999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.746,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.111}]},{"osd":4,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.405,"15min":1.381},"min":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.90400000000000003},"max":{"1min":1.8180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.335,"15min":1.3160000000000001},"min":{"1min":0.91900000000000004,"5min":0.85699999999999998,"15min":0.80200000000000005},"max":{"1min":1.8720000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4399999999999999,"15min":1.4279999999999999},"min":{"1min":1.129,"5min":0.87,"15min":0.87},"max":{"1min":1.752,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.179},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4570000000000001,"15min":1.444},"min":{"1min":1.1699999999999999,"5min":0.89600000000000002,"15min":0.66600000000000004},"max":{"1min":1.954,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.45}]},{"osd":6,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4890000000000001,"15min":1.496},"min":{"1min":1.262,"5min":1.0269999999999999,"15min":1},"max":{"1min":1.754,"5min":2.1309999999999998,"15min":2.4119999999999999},"last":1.2789999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.526,"15min":1.526},"min":{"1min":1.1919999999999999,"5min":1.052,"15min":0.82299999999999995},"max":{"1min":2.4169999999999998,"5min":2.46,"15min":2.46},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.476,"15min":1.468},"min":{"1min":0.84599999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.829,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.246}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:52:24.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:52:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 Processor -- start 2023-12-24T19:52:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 -- start start 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1cec13f550 0x7f1cec0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cec0cb3c0 0x7f1cec06bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec06c090 con 0x7f1cec13f920 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec06a6a0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.174+0000 7f1cf43c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0cb8a0 con 0x7f1cec13f550 2023-12-24T19:52:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cec0cb3c0 0x7f1cec06bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cec0cb3c0 0x7f1cec06bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41858/0 (socket says 172.21.15.50:41858) 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 -- 172.21.15.50:0/1476340293 learned_addr learned my addr 172.21.15.50:0/1476340293 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2161700 1 --2- 172.21.15.50:0/1476340293 >> v2:172.21.15.82:3300/0 conn(0x7f1cec13f550 0x7f1cec0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 -- 172.21.15.50:0/1476340293 >> v2:172.21.15.82:3300/0 conn(0x7f1cec13f550 msgr2=0x7f1cec0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 --2- 172.21.15.50:0/1476340293 >> v2:172.21.15.82:3300/0 conn(0x7f1cec13f550 0x7f1cec0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 -- 172.21.15.50:0/1476340293 >> v1:172.21.15.50:6789/0 conn(0x7f1cec13f920 legacy=0x7f1cec06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 -- 172.21.15.50:0/1476340293 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec06a960 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf2962700 1 --2- 172.21.15.50:0/1476340293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec06bb50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1cec06e290 tx=0x7f1ce4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1367c6e1bc636 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf115f700 1 -- 172.21.15.50:0/1476340293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400e070 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf115f700 1 -- 172.21.15.50:0/1476340293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400ba50 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf115f700 1 -- 172.21.15.50:0/1476340293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40092e0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1476340293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 msgr2=0x7f1cec06bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.178+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1476340293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec06bb50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1cec06e290 tx=0x7f1ce4009840 comp rx=0 tx=0).stop 2023-12-24T19:52:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1476340293 shutdown_connections 2023-12-24T19:52:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1476340293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec06bb50 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1476340293 >> v2:172.21.15.82:3300/0 conn(0x7f1cec13f550 0x7f1cec0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1476340293 >> 172.21.15.50:0/1476340293 conn(0x7f1cec0cbba0 msgr2=0x7f1cec0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1476340293 shutdown_connections 2023-12-24T19:52:25.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1476340293 wait complete. 2023-12-24T19:52:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 Processor -- start 2023-12-24T19:52:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.182+0000 7f1cf43c5700 1 -- start start 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cec13f550 0x7f1cec0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1cec13f920 0x7f1cec13c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0ace70 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0a9f40 con 0x7f1cec13f550 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c2390 con 0x7f1cec13f920 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41874/0 (socket says 172.21.15.50:41874) 2023-12-24T19:52:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 -- 172.21.15.50:0/1982430516 learned_addr learned my addr 172.21.15.50:0/1982430516 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2962700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1cec13f920 0x7f1cec13c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf1960700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cec13f550 0x7f1cec0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 -- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1cec13f920 msgr2=0x7f1cec13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1cec13f920 0x7f1cec13c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 -- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cec13f550 msgr2=0x7f1cec0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cec13f550 0x7f1cec0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 -- 172.21.15.50:0/1982430516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009ae0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf2161700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d890 tx=0x7f1ce8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800b600 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce800b760 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800bae0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0aa1e0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.186+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec0c2670 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.190+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0652e0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.190+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1ce801e460 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.190+0000 7f1ce27fc700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 0x7f1cd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.190+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1ce807d250 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.194+0000 7f1cf1960700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 0x7f1cd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.194+0000 7f1cf1960700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 0x7f1cd0062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0c6140 tx=0x7f1cdc009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.198+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ce804d4d0 con 0x7f1cec0cb3c0 2023-12-24T19:52:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.374+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cec0c7b50 con 0x7f1cd0060550 2023-12-24T19:52:25.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.386+0000 7f1ce27fc700 1 -- 172.21.15.50:0/1982430516 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271378 (secure 0 0 0) 0x7f1cec0c7b50 con 0x7f1cd0060550 2023-12-24T19:52:25.395 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 msgr2=0x7f1cd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 0x7f1cd0062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0c6140 tx=0x7f1cdc009040 comp rx=0 tx=0).stop 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 msgr2=0x7f1cec0c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d890 tx=0x7f1ce8008040 comp rx=0 tx=0).stop 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 shutdown_connections 2023-12-24T19:52:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1cd0060550 0x7f1cd0062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1cec13f920 0x7f1cec13c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cec13f550 0x7f1cec0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 --2- 172.21.15.50:0/1982430516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cb3c0 0x7f1cec0c1d20 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 >> 172.21.15.50:0/1982430516 conn(0x7f1cec0cbba0 msgr2=0x7f1cec0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 shutdown_connections 2023-12-24T19:52:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.394+0000 7f1cf43c5700 1 -- 172.21.15.50:0/1982430516 wait complete. 2023-12-24T19:52:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:52:25.421 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T19:52:23.504816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2469704,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752505016,"statfs":{"total":773094113280,"available":770565136384,"internally_reserved":0,"allocated":18096128,"data_stored":9940800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.915605"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:19.588429+0000","last_change":"2023-12-24T19:52:19.588429+0000","last_active":"2023-12-24T19:52:19.588429+0000","last_peered":"2023-12-24T19:52:19.588429+0000","last_clean":"2023-12-24T19:52:19.588429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:19.588429+0000","last_undegraded":"2023-12-24T19:52:19.588429+0000","last_fullsized":"2023-12-24T19:52:19.588429+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:52:18.574857+0000","last_change":"2023-12-24T19:52:18.574857+0000","last_active":"2023-12-24T19:52:18.574857+0000","last_peered":"2023-12-24T19:52:18.574857+0000","last_clean":"2023-12-24T19:52:18.574857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:52:18.574857+0000","last_undegraded":"2023-12-24T19:52:18.574857+0000","last_fullsized":"2023-12-24T19:52:18.574857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"162'293","reported_seq":903,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-24T19:52:16.354844+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:52:16.354844+0000","last_peered":"2023-12-24T19:52:16.354844+0000","last_clean":"2023-12-24T19:52:16.354844+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:52:16.354844+0000","last_undegraded":"2023-12-24T19:52:16.354844+0000","last_fullsized":"2023-12-24T19:52:16.354844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299932,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071908,"statfs":{"total":96636764160,"available":96329633792,"internally_reserved":0,"allocated":2707456,"data_stored":1685376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":1.3899999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":1.621}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.264},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.665}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":1.089},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.4750000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.323}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.232},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.2809999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.425}]}]},{"osd":6,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315736,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056104,"statfs":{"total":96636764160,"available":96313450496,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.956}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.196}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.379},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.111}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.615}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.579},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.6910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307544,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":0.95399999999999996}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.02}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.286}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.2130000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.069}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.365},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.149},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.4470000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060200,"statfs":{"total":96636764160,"available":96317644800,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.28},"min":{"1min":0.622,"5min":0.622,"15min":0.58399999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.175}]},{"osd":1,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2110000000000001,"15min":1.1679999999999999},"min":{"1min":0.83099999999999996,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1990000000000001,"15min":1.1539999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.1550000000000002,"5min":4.1550000000000002,"15min":4.1550000000000002},"last":0.96199999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.391,"15min":1.369},"min":{"1min":0.746,"5min":0.746,"15min":0.63900000000000001},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.397,"15min":1.3600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.4139999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.238,"15min":1.1919999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.46400000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.99399999999999999,"5min":0.89400000000000002,"15min":0.63900000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.131}]},{"osd":5,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3140000000000001,"15min":1.2849999999999999},"min":{"1min":0.77500000000000002,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":3.29,"5min":3.29,"15min":3.29},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.361,"15min":1.3300000000000001},"min":{"1min":0.92400000000000004,"5min":0.72999999999999998,"15min":0.58799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.24}]},{"osd":6,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.2929999999999999,"15min":1.266},"min":{"1min":1.095,"5min":0.79900000000000004,"15min":0.56000000000000005},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.363},{"interface":"front","average":{"1min":1.419,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.95699999999999996,"5min":0.621,"15min":0.621},"max":{"1min":1.853,"5min":1.887,"15min":1.887},"last":1.2090000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.3320000000000001,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.54500000000000004},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4430000000000001,"15min":1.4199999999999999},"min":{"1min":1.042,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.843,"5min":2,"15min":2},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311640,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060200,"statfs":{"total":96636764160,"available":96317644800,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.873},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":1.004},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.94399999999999995}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.3200000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.27},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.248},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.347}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":1.518},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834575756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315736,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056104,"statfs":{"total":96636764160,"available":96313450496,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":1.0449999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.99199999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.2430000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.5049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307544,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064296,"statfs":{"total":96636764160,"available":96321839104,"internally_reserved":0,"allocated":2113536,"data_stored":1095008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3360000000000001,"5min":1.421,"15min":1.647},"last":0.872},{"interface":"front","average":{"1min":1.073,"5min":1.1479999999999999,"15min":1.145},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3640000000000001,"5min":1.744,"15min":1.744},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.79000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.706,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.268,"15min":1.2649999999999999},"min":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":1.669,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.64700000000000002},"max":{"1min":1.702,"5min":1.726,"15min":1.823},"last":0.82699999999999996}]},{"osd":4,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2789999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.254},{"interface":"front","average":{"1min":1.367,"5min":1.429,"15min":1.423},"min":{"1min":0.93500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.7729999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.077}]},{"osd":5,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.413,"15min":1.407},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.948},"last":1.323},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.383},"min":{"1min":0.97699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.2189999999999999},"last":1.383}]},{"osd":6,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5189999999999999,"15min":1.506},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8919999999999999,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.514,"15min":1.5},"min":{"1min":1.1259999999999999,"5min":1.008,"15min":0.88900000000000001},"max":{"1min":1.7969999999999999,"5min":2.1339999999999999,"15min":2.323},"last":1.474}]},{"osd":7,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5640000000000001,"15min":1.5509999999999999},"min":{"1min":1.1100000000000001,"5min":0.999,"15min":0.999},"max":{"1min":1.95,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.53,"15min":1.5109999999999999},"min":{"1min":1.0109999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.954,"5min":2.532,"15min":2.532},"last":1.5029999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299932,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071908,"statfs":{"total":96636764160,"available":96329633792,"internally_reserved":0,"allocated":2707456,"data_stored":1685376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90300000000000002,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.478,"5min":1.6859999999999999,"15min":1.7250000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0669999999999999,"15min":1.018},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.50800000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0609999999999999,"15min":1.0940000000000001},"min":{"1min":0.79800000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.6950000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.129,"15min":1.137},"min":{"1min":0.93100000000000005,"5min":0.67800000000000005,"15min":0.61599999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.833},"last":1.0660000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.68500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6319999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.746,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.111}]},{"osd":4,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.405,"15min":1.381},"min":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.90400000000000003},"max":{"1min":1.8180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.335,"15min":1.3160000000000001},"min":{"1min":0.91900000000000004,"5min":0.85699999999999998,"15min":0.80200000000000005},"max":{"1min":1.8720000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4399999999999999,"15min":1.4279999999999999},"min":{"1min":1.129,"5min":0.87,"15min":0.87},"max":{"1min":1.752,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.179},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4570000000000001,"15min":1.444},"min":{"1min":1.1699999999999999,"5min":0.89600000000000002,"15min":0.66600000000000004},"max":{"1min":1.954,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.45}]},{"osd":6,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4890000000000001,"15min":1.496},"min":{"1min":1.262,"5min":1.0269999999999999,"15min":1},"max":{"1min":1.754,"5min":2.1309999999999998,"15min":2.4119999999999999},"last":1.2789999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.526,"15min":1.526},"min":{"1min":1.1919999999999999,"5min":1.052,"15min":0.82299999999999995},"max":{"1min":2.4169999999999998,"5min":2.46,"15min":2.46},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.476,"15min":1.468},"min":{"1min":0.84599999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.829,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.246}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:52:25.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:52:25.572 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-24T19:52:25.570+0000 7f651c521700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:52:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 Processor -- start 2023-12-24T19:52:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 -- start start 2023-12-24T19:52:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6ec06ae10 0x7fc6ec15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec06ca50 con 0x7fc6ec06b260 2023-12-24T19:52:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c6980 con 0x7fc6ec06ae10 2023-12-24T19:52:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.630+0000 7fc6f3625700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec06b7f0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:57830/0 (socket says 172.21.15.50:57830) 2023-12-24T19:52:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 -- 172.21.15.50:0/1925637432 learned_addr learned my addr 172.21.15.50:0/1925637432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f0bc0700 1 --2- 172.21.15.50:0/1925637432 >> v2:172.21.15.82:3300/0 conn(0x7fc6ec06ae10 0x7fc6ec15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 -- 172.21.15.50:0/1925637432 >> v2:172.21.15.82:3300/0 conn(0x7fc6ec06ae10 msgr2=0x7fc6ec15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 --2- 172.21.15.50:0/1925637432 >> v2:172.21.15.82:3300/0 conn(0x7fc6ec06ae10 0x7fc6ec15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 -- 172.21.15.50:0/1925637432 >> v1:172.21.15.82:6789/0 conn(0x7fc6ec06b260 legacy=0x7fc6ec160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 -- 172.21.15.50:0/1925637432 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec06bad0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6f13c1700 1 --2- 172.21.15.50:0/1925637432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80099b0 tx=0x7fc6e8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e626b24a5474884 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6e3fff700 1 -- 172.21.15.50:0/1925637432 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8009ea0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6e3fff700 1 -- 172.21.15.50:0/1925637432 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800b860 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.634+0000 7fc6e3fff700 1 -- 172.21.15.50:0/1925637432 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800bc20 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- 172.21.15.50:0/1925637432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 msgr2=0x7fc6ec0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1925637432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80099b0 tx=0x7fc6e8009250 comp rx=0 tx=0).stop 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- 172.21.15.50:0/1925637432 shutdown_connections 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1925637432 >> v2:172.21.15.82:3300/0 conn(0x7fc6ec06ae10 0x7fc6ec15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1925637432 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec0ca3a0 0x7fc6ec0ca770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- 172.21.15.50:0/1925637432 >> 172.21.15.50:0/1925637432 conn(0x7fc6ec0cbba0 msgr2=0x7fc6ec0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- 172.21.15.50:0/1925637432 shutdown_connections 2023-12-24T19:52:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- 172.21.15.50:0/1925637432 wait complete. 2023-12-24T19:52:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 Processor -- start 2023-12-24T19:52:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.638+0000 7fc6f3625700 1 -- start start 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6ec06ae10 0x7fc6ec14ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 0x7fc6ec15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec160d10 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec14d3f0 con 0x7fc6ec06ae10 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f3625700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec1614e0 con 0x7fc6ec06b260 2023-12-24T19:52:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f13c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6ec06ae10 0x7fc6ec14ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f0bc0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 0x7fc6ec15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41876/0 (socket says 172.21.15.50:41876) 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 -- 172.21.15.50:0/1939385087 learned_addr learned my addr 172.21.15.50:0/1939385087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 -- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 msgr2=0x7fc6ec15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 0x7fc6ec15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 -- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6ec06ae10 msgr2=0x7fc6ec14ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6ec06ae10 0x7fc6ec14ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 -- 172.21.15.50:0/1939385087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80094f0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f0bc0700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 0x7fc6ec15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.642+0000 7fc6f1bc2700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c8e0 tx=0x7fc6e4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4012630 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e4012790 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4012b50 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec15c370 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec161200 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.646+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec0652e0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.650+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc6e401a3a0 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.650+0000 7fc6e17fa700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 0x7fc6d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.650+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fc6e407cc10 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.650+0000 7fc6f13c1700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 0x7fc6d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.650+0000 7fc6f13c1700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 0x7fc6d0062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80099b0 tx=0x7fc6e8017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.658+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6e404cf30 con 0x7fc6ec0ca3a0 2023-12-24T19:52:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.826+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6ec06bdb0 con 0x7fc6d0060550 2023-12-24T19:52:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.842+0000 7fc6e17fa700 1 -- 172.21.15.50:0/1939385087 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286507 (secure 0 0 0) 0x7fc6ec06bdb0 con 0x7fc6d0060550 2023-12-24T19:52:25.849 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.846+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 msgr2=0x7fc6d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.846+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 0x7fc6d0062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80099b0 tx=0x7fc6e8017000 comp rx=0 tx=0).stop 2023-12-24T19:52:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.846+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 msgr2=0x7fc6ec16e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.846+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c8e0 tx=0x7fc6e4001710 comp rx=0 tx=0).stop 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 shutdown_connections 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc6d0060550 0x7fc6d0062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6ec0ca3a0 0x7fc6ec16e150 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6ec06b260 0x7fc6ec15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 --2- 172.21.15.50:0/1939385087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6ec06ae10 0x7fc6ec14ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 >> 172.21.15.50:0/1939385087 conn(0x7fc6ec0cbba0 msgr2=0x7fc6ec158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 shutdown_connections 2023-12-24T19:52:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:25.850+0000 7fc6f3625700 1 -- 172.21.15.50:0/1939385087 wait complete. 2023-12-24T19:52:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:52:25.874 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:52:25.505446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470152,"kb_used_data":18120,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504568,"statfs":{"total":773094113280,"available":770564677632,"internally_reserved":0,"allocated":18554880,"data_stored":10169532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002126"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452698+0000","last_change":"2023-12-24T19:52:20.445727+0000","last_active":"2023-12-24T19:52:20.452698+0000","last_peered":"2023-12-24T19:52:20.452698+0000","last_clean":"2023-12-24T19:52:20.452698+0000","last_became_active":"2023-12-24T19:52:20.445397+0000","last_became_peered":"2023-12-24T19:52:20.445397+0000","last_unstale":"2023-12-24T19:52:20.452698+0000","last_undegraded":"2023-12-24T19:52:20.452698+0000","last_fullsized":"2023-12-24T19:52:20.452698+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:22.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459069+0000","last_change":"2023-12-24T19:52:20.453790+0000","last_active":"2023-12-24T19:52:20.459069+0000","last_peered":"2023-12-24T19:52:20.459069+0000","last_clean":"2023-12-24T19:52:20.459069+0000","last_became_active":"2023-12-24T19:52:20.453359+0000","last_became_peered":"2023-12-24T19:52:20.453359+0000","last_unstale":"2023-12-24T19:52:20.459069+0000","last_undegraded":"2023-12-24T19:52:20.459069+0000","last_fullsized":"2023-12-24T19:52:20.459069+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:47:21.091012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460321+0000","last_change":"2023-12-24T19:52:20.457881+0000","last_active":"2023-12-24T19:52:20.460321+0000","last_peered":"2023-12-24T19:52:20.460321+0000","last_clean":"2023-12-24T19:52:20.460321+0000","last_became_active":"2023-12-24T19:52:20.457611+0000","last_became_peered":"2023-12-24T19:52:20.457611+0000","last_unstale":"2023-12-24T19:52:20.460321+0000","last_undegraded":"2023-12-24T19:52:20.460321+0000","last_fullsized":"2023-12-24T19:52:20.460321+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452247+0000","last_change":"2023-12-24T19:52:20.448108+0000","last_active":"2023-12-24T19:52:20.452247+0000","last_peered":"2023-12-24T19:52:20.452247+0000","last_clean":"2023-12-24T19:52:20.452247+0000","last_became_active":"2023-12-24T19:52:20.447808+0000","last_became_peered":"2023-12-24T19:52:20.447808+0000","last_unstale":"2023-12-24T19:52:20.452247+0000","last_undegraded":"2023-12-24T19:52:20.452247+0000","last_fullsized":"2023-12-24T19:52:20.452247+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:03.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449289+0000","last_change":"2023-12-24T19:52:20.443180+0000","last_active":"2023-12-24T19:52:20.449289+0000","last_peered":"2023-12-24T19:52:20.449289+0000","last_clean":"2023-12-24T19:52:20.449289+0000","last_became_active":"2023-12-24T19:52:20.440477+0000","last_became_peered":"2023-12-24T19:52:20.440477+0000","last_unstale":"2023-12-24T19:52:20.449289+0000","last_undegraded":"2023-12-24T19:52:20.449289+0000","last_fullsized":"2023-12-24T19:52:20.449289+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.457160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447975+0000","last_change":"2023-12-24T19:52:20.442278+0000","last_active":"2023-12-24T19:52:20.447975+0000","last_peered":"2023-12-24T19:52:20.447975+0000","last_clean":"2023-12-24T19:52:20.447975+0000","last_became_active":"2023-12-24T19:52:20.441556+0000","last_became_peered":"2023-12-24T19:52:20.441556+0000","last_unstale":"2023-12-24T19:52:20.447975+0000","last_undegraded":"2023-12-24T19:52:20.447975+0000","last_fullsized":"2023-12-24T19:52:20.447975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:55.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.455801+0000","last_change":"2023-12-24T19:52:20.452893+0000","last_active":"2023-12-24T19:52:20.455801+0000","last_peered":"2023-12-24T19:52:20.455801+0000","last_clean":"2023-12-24T19:52:20.455801+0000","last_became_active":"2023-12-24T19:52:20.452580+0000","last_became_peered":"2023-12-24T19:52:20.452580+0000","last_unstale":"2023-12-24T19:52:20.455801+0000","last_undegraded":"2023-12-24T19:52:20.455801+0000","last_fullsized":"2023-12-24T19:52:20.455801+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461274+0000","last_change":"2023-12-24T19:52:20.455969+0000","last_active":"2023-12-24T19:52:20.461274+0000","last_peered":"2023-12-24T19:52:20.461274+0000","last_clean":"2023-12-24T19:52:20.461274+0000","last_became_active":"2023-12-24T19:52:20.455612+0000","last_became_peered":"2023-12-24T19:52:20.455612+0000","last_unstale":"2023-12-24T19:52:20.461274+0000","last_undegraded":"2023-12-24T19:52:20.461274+0000","last_fullsized":"2023-12-24T19:52:20.461274+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460195+0000","last_change":"2023-12-24T19:52:20.453627+0000","last_active":"2023-12-24T19:52:20.460195+0000","last_peered":"2023-12-24T19:52:20.460195+0000","last_clean":"2023-12-24T19:52:20.460195+0000","last_became_active":"2023-12-24T19:52:20.453325+0000","last_became_peered":"2023-12-24T19:52:20.453325+0000","last_unstale":"2023-12-24T19:52:20.460195+0000","last_undegraded":"2023-12-24T19:52:20.460195+0000","last_fullsized":"2023-12-24T19:52:20.460195+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:16.280463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451237+0000","last_change":"2023-12-24T19:52:20.446017+0000","last_active":"2023-12-24T19:52:20.451237+0000","last_peered":"2023-12-24T19:52:20.451237+0000","last_clean":"2023-12-24T19:52:20.451237+0000","last_became_active":"2023-12-24T19:52:20.445707+0000","last_became_peered":"2023-12-24T19:52:20.445707+0000","last_unstale":"2023-12-24T19:52:20.451237+0000","last_undegraded":"2023-12-24T19:52:20.451237+0000","last_fullsized":"2023-12-24T19:52:20.451237+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:12.061233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461154+0000","last_change":"2023-12-24T19:52:20.458277+0000","last_active":"2023-12-24T19:52:20.461154+0000","last_peered":"2023-12-24T19:52:20.461154+0000","last_clean":"2023-12-24T19:52:20.461154+0000","last_became_active":"2023-12-24T19:52:20.457928+0000","last_became_peered":"2023-12-24T19:52:20.457928+0000","last_unstale":"2023-12-24T19:52:20.461154+0000","last_undegraded":"2023-12-24T19:52:20.461154+0000","last_fullsized":"2023-12-24T19:52:20.461154+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:44.881698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451836+0000","last_change":"2023-12-24T19:52:20.444756+0000","last_active":"2023-12-24T19:52:20.451836+0000","last_peered":"2023-12-24T19:52:20.451836+0000","last_clean":"2023-12-24T19:52:20.451836+0000","last_became_active":"2023-12-24T19:52:20.444447+0000","last_became_peered":"2023-12-24T19:52:20.444447+0000","last_unstale":"2023-12-24T19:52:20.451836+0000","last_undegraded":"2023-12-24T19:52:20.451836+0000","last_fullsized":"2023-12-24T19:52:20.451836+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:24.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451303+0000","last_change":"2023-12-24T19:52:20.445807+0000","last_active":"2023-12-24T19:52:20.451303+0000","last_peered":"2023-12-24T19:52:20.451303+0000","last_clean":"2023-12-24T19:52:20.451303+0000","last_became_active":"2023-12-24T19:52:20.445159+0000","last_became_peered":"2023-12-24T19:52:20.445159+0000","last_unstale":"2023-12-24T19:52:20.451303+0000","last_undegraded":"2023-12-24T19:52:20.451303+0000","last_fullsized":"2023-12-24T19:52:20.451303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:12.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450513+0000","last_change":"2023-12-24T19:52:20.443523+0000","last_active":"2023-12-24T19:52:20.450513+0000","last_peered":"2023-12-24T19:52:20.450513+0000","last_clean":"2023-12-24T19:52:20.450513+0000","last_became_active":"2023-12-24T19:52:20.443257+0000","last_became_peered":"2023-12-24T19:52:20.443257+0000","last_unstale":"2023-12-24T19:52:20.450513+0000","last_undegraded":"2023-12-24T19:52:20.450513+0000","last_fullsized":"2023-12-24T19:52:20.450513+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:01.659865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459257+0000","last_change":"2023-12-24T19:52:20.454137+0000","last_active":"2023-12-24T19:52:20.459257+0000","last_peered":"2023-12-24T19:52:20.459257+0000","last_clean":"2023-12-24T19:52:20.459257+0000","last_became_active":"2023-12-24T19:52:20.453835+0000","last_became_peered":"2023-12-24T19:52:20.453835+0000","last_unstale":"2023-12-24T19:52:20.459257+0000","last_undegraded":"2023-12-24T19:52:20.459257+0000","last_fullsized":"2023-12-24T19:52:20.459257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448473+0000","last_change":"2023-12-24T19:52:20.443793+0000","last_active":"2023-12-24T19:52:20.448473+0000","last_peered":"2023-12-24T19:52:20.448473+0000","last_clean":"2023-12-24T19:52:20.448473+0000","last_became_active":"2023-12-24T19:52:20.443041+0000","last_became_peered":"2023-12-24T19:52:20.443041+0000","last_unstale":"2023-12-24T19:52:20.448473+0000","last_undegraded":"2023-12-24T19:52:20.448473+0000","last_fullsized":"2023-12-24T19:52:20.448473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:13.176005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452525+0000","last_change":"2023-12-24T19:52:20.445004+0000","last_active":"2023-12-24T19:52:20.452525+0000","last_peered":"2023-12-24T19:52:20.452525+0000","last_clean":"2023-12-24T19:52:20.452525+0000","last_became_active":"2023-12-24T19:52:20.444719+0000","last_became_peered":"2023-12-24T19:52:20.444719+0000","last_unstale":"2023-12-24T19:52:20.452525+0000","last_undegraded":"2023-12-24T19:52:20.452525+0000","last_fullsized":"2023-12-24T19:52:20.452525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:58:17.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462223+0000","last_change":"2023-12-24T19:52:20.461262+0000","last_active":"2023-12-24T19:52:20.462223+0000","last_peered":"2023-12-24T19:52:20.462223+0000","last_clean":"2023-12-24T19:52:20.462223+0000","last_became_active":"2023-12-24T19:52:20.460637+0000","last_became_peered":"2023-12-24T19:52:20.460637+0000","last_unstale":"2023-12-24T19:52:20.462223+0000","last_undegraded":"2023-12-24T19:52:20.462223+0000","last_fullsized":"2023-12-24T19:52:20.462223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:51.651125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459144+0000","last_change":"2023-12-24T19:52:20.454330+0000","last_active":"2023-12-24T19:52:20.459144+0000","last_peered":"2023-12-24T19:52:20.459144+0000","last_clean":"2023-12-24T19:52:20.459144+0000","last_became_active":"2023-12-24T19:52:20.453787+0000","last_became_peered":"2023-12-24T19:52:20.453787+0000","last_unstale":"2023-12-24T19:52:20.459144+0000","last_undegraded":"2023-12-24T19:52:20.459144+0000","last_fullsized":"2023-12-24T19:52:20.459144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:31.843112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459505+0000","last_change":"2023-12-24T19:52:20.457538+0000","last_active":"2023-12-24T19:52:20.459505+0000","last_peered":"2023-12-24T19:52:20.459505+0000","last_clean":"2023-12-24T19:52:20.459505+0000","last_became_active":"2023-12-24T19:52:20.455869+0000","last_became_peered":"2023-12-24T19:52:20.455869+0000","last_unstale":"2023-12-24T19:52:20.459505+0000","last_undegraded":"2023-12-24T19:52:20.459505+0000","last_fullsized":"2023-12-24T19:52:20.459505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460391+0000","last_change":"2023-12-24T19:52:20.454224+0000","last_active":"2023-12-24T19:52:20.460391+0000","last_peered":"2023-12-24T19:52:20.460391+0000","last_clean":"2023-12-24T19:52:20.460391+0000","last_became_active":"2023-12-24T19:52:20.453928+0000","last_became_peered":"2023-12-24T19:52:20.453928+0000","last_unstale":"2023-12-24T19:52:20.460391+0000","last_undegraded":"2023-12-24T19:52:20.460391+0000","last_fullsized":"2023-12-24T19:52:20.460391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:14.133011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456105+0000","last_change":"2023-12-24T19:52:20.452399+0000","last_active":"2023-12-24T19:52:20.456105+0000","last_peered":"2023-12-24T19:52:20.456105+0000","last_clean":"2023-12-24T19:52:20.456105+0000","last_became_active":"2023-12-24T19:52:20.452126+0000","last_became_peered":"2023-12-24T19:52:20.452126+0000","last_unstale":"2023-12-24T19:52:20.456105+0000","last_undegraded":"2023-12-24T19:52:20.456105+0000","last_fullsized":"2023-12-24T19:52:20.456105+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461009+0000","last_change":"2023-12-24T19:52:20.453088+0000","last_active":"2023-12-24T19:52:20.461009+0000","last_peered":"2023-12-24T19:52:20.461009+0000","last_clean":"2023-12-24T19:52:20.461009+0000","last_became_active":"2023-12-24T19:52:20.452800+0000","last_became_peered":"2023-12-24T19:52:20.452800+0000","last_unstale":"2023-12-24T19:52:20.461009+0000","last_undegraded":"2023-12-24T19:52:20.461009+0000","last_fullsized":"2023-12-24T19:52:20.461009+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452095+0000","last_change":"2023-12-24T19:52:20.451037+0000","last_active":"2023-12-24T19:52:20.452095+0000","last_peered":"2023-12-24T19:52:20.452095+0000","last_clean":"2023-12-24T19:52:20.452095+0000","last_became_active":"2023-12-24T19:52:20.447988+0000","last_became_peered":"2023-12-24T19:52:20.447988+0000","last_unstale":"2023-12-24T19:52:20.452095+0000","last_undegraded":"2023-12-24T19:52:20.452095+0000","last_fullsized":"2023-12-24T19:52:20.452095+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:14.647509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452788+0000","last_change":"2023-12-24T19:52:20.449142+0000","last_active":"2023-12-24T19:52:20.452788+0000","last_peered":"2023-12-24T19:52:20.452788+0000","last_clean":"2023-12-24T19:52:20.452788+0000","last_became_active":"2023-12-24T19:52:20.448862+0000","last_became_peered":"2023-12-24T19:52:20.448862+0000","last_unstale":"2023-12-24T19:52:20.452788+0000","last_undegraded":"2023-12-24T19:52:20.452788+0000","last_fullsized":"2023-12-24T19:52:20.452788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454205+0000","last_change":"2023-12-24T19:52:20.448620+0000","last_active":"2023-12-24T19:52:20.454205+0000","last_peered":"2023-12-24T19:52:20.454205+0000","last_clean":"2023-12-24T19:52:20.454205+0000","last_became_active":"2023-12-24T19:52:20.448333+0000","last_became_peered":"2023-12-24T19:52:20.448333+0000","last_unstale":"2023-12-24T19:52:20.454205+0000","last_undegraded":"2023-12-24T19:52:20.454205+0000","last_fullsized":"2023-12-24T19:52:20.454205+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460509+0000","last_change":"2023-12-24T19:52:20.455597+0000","last_active":"2023-12-24T19:52:20.460509+0000","last_peered":"2023-12-24T19:52:20.460509+0000","last_clean":"2023-12-24T19:52:20.460509+0000","last_became_active":"2023-12-24T19:52:20.455312+0000","last_became_peered":"2023-12-24T19:52:20.455312+0000","last_unstale":"2023-12-24T19:52:20.460509+0000","last_undegraded":"2023-12-24T19:52:20.460509+0000","last_fullsized":"2023-12-24T19:52:20.460509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.335033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454609+0000","last_change":"2023-12-24T19:52:20.448896+0000","last_active":"2023-12-24T19:52:20.454609+0000","last_peered":"2023-12-24T19:52:20.454609+0000","last_clean":"2023-12-24T19:52:20.454609+0000","last_became_active":"2023-12-24T19:52:20.448596+0000","last_became_peered":"2023-12-24T19:52:20.448596+0000","last_unstale":"2023-12-24T19:52:20.454609+0000","last_undegraded":"2023-12-24T19:52:20.454609+0000","last_fullsized":"2023-12-24T19:52:20.454609+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:40.214594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457765+0000","last_change":"2023-12-24T19:52:20.446613+0000","last_active":"2023-12-24T19:52:20.457765+0000","last_peered":"2023-12-24T19:52:20.457765+0000","last_clean":"2023-12-24T19:52:20.457765+0000","last_became_active":"2023-12-24T19:52:20.445627+0000","last_became_peered":"2023-12-24T19:52:20.445627+0000","last_unstale":"2023-12-24T19:52:20.457765+0000","last_undegraded":"2023-12-24T19:52:20.457765+0000","last_fullsized":"2023-12-24T19:52:20.457765+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:20.374263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458502+0000","last_change":"2023-12-24T19:52:20.454043+0000","last_active":"2023-12-24T19:52:20.458502+0000","last_peered":"2023-12-24T19:52:20.458502+0000","last_clean":"2023-12-24T19:52:20.458502+0000","last_became_active":"2023-12-24T19:52:20.453310+0000","last_became_peered":"2023-12-24T19:52:20.453310+0000","last_unstale":"2023-12-24T19:52:20.458502+0000","last_undegraded":"2023-12-24T19:52:20.458502+0000","last_fullsized":"2023-12-24T19:52:20.458502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:46.948625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453843+0000","last_change":"2023-12-24T19:52:20.447630+0000","last_active":"2023-12-24T19:52:20.453843+0000","last_peered":"2023-12-24T19:52:20.453843+0000","last_clean":"2023-12-24T19:52:20.453843+0000","last_became_active":"2023-12-24T19:52:20.447340+0000","last_became_peered":"2023-12-24T19:52:20.447340+0000","last_unstale":"2023-12-24T19:52:20.453843+0000","last_undegraded":"2023-12-24T19:52:20.453843+0000","last_fullsized":"2023-12-24T19:52:20.453843+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:55.756326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461303+0000","last_change":"2023-12-24T19:52:20.456138+0000","last_active":"2023-12-24T19:52:20.461303+0000","last_peered":"2023-12-24T19:52:20.461303+0000","last_clean":"2023-12-24T19:52:20.461303+0000","last_became_active":"2023-12-24T19:52:20.455839+0000","last_became_peered":"2023-12-24T19:52:20.455839+0000","last_unstale":"2023-12-24T19:52:20.461303+0000","last_undegraded":"2023-12-24T19:52:20.461303+0000","last_fullsized":"2023-12-24T19:52:20.461303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459944+0000","last_change":"2023-12-24T19:52:20.454623+0000","last_active":"2023-12-24T19:52:20.459944+0000","last_peered":"2023-12-24T19:52:20.459944+0000","last_clean":"2023-12-24T19:52:20.459944+0000","last_became_active":"2023-12-24T19:52:20.452078+0000","last_became_peered":"2023-12-24T19:52:20.452078+0000","last_unstale":"2023-12-24T19:52:20.459944+0000","last_undegraded":"2023-12-24T19:52:20.459944+0000","last_fullsized":"2023-12-24T19:52:20.459944+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:54.274863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654262+0000","last_change":"2023-12-24T19:52:19.623289+0000","last_active":"2023-12-24T19:52:20.654262+0000","last_peered":"2023-12-24T19:52:20.654262+0000","last_clean":"2023-12-24T19:52:20.654262+0000","last_became_active":"2023-12-24T19:52:19.622982+0000","last_became_peered":"2023-12-24T19:52:19.622982+0000","last_unstale":"2023-12-24T19:52:20.654262+0000","last_undegraded":"2023-12-24T19:52:20.654262+0000","last_fullsized":"2023-12-24T19:52:20.654262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:38.006004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460291+0000","last_change":"2023-12-24T19:52:20.456568+0000","last_active":"2023-12-24T19:52:20.460291+0000","last_peered":"2023-12-24T19:52:20.460291+0000","last_clean":"2023-12-24T19:52:20.460291+0000","last_became_active":"2023-12-24T19:52:20.454058+0000","last_became_peered":"2023-12-24T19:52:20.454058+0000","last_unstale":"2023-12-24T19:52:20.460291+0000","last_undegraded":"2023-12-24T19:52:20.460291+0000","last_fullsized":"2023-12-24T19:52:20.460291+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:39.019576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656135+0000","last_change":"2023-12-24T19:52:19.634248+0000","last_active":"2023-12-24T19:52:20.656135+0000","last_peered":"2023-12-24T19:52:20.656135+0000","last_clean":"2023-12-24T19:52:20.656135+0000","last_became_active":"2023-12-24T19:52:19.633957+0000","last_became_peered":"2023-12-24T19:52:19.633957+0000","last_unstale":"2023-12-24T19:52:20.656135+0000","last_undegraded":"2023-12-24T19:52:20.656135+0000","last_fullsized":"2023-12-24T19:52:20.656135+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:43.556087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459716+0000","last_change":"2023-12-24T19:52:20.450176+0000","last_active":"2023-12-24T19:52:20.459716+0000","last_peered":"2023-12-24T19:52:20.459716+0000","last_clean":"2023-12-24T19:52:20.459716+0000","last_became_active":"2023-12-24T19:52:20.449883+0000","last_became_peered":"2023-12-24T19:52:20.449883+0000","last_unstale":"2023-12-24T19:52:20.459716+0000","last_undegraded":"2023-12-24T19:52:20.459716+0000","last_fullsized":"2023-12-24T19:52:20.459716+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:58.694109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656262+0000","last_change":"2023-12-24T19:52:19.633188+0000","last_active":"2023-12-24T19:52:20.656262+0000","last_peered":"2023-12-24T19:52:20.656262+0000","last_clean":"2023-12-24T19:52:20.656262+0000","last_became_active":"2023-12-24T19:52:19.632814+0000","last_became_peered":"2023-12-24T19:52:19.632814+0000","last_unstale":"2023-12-24T19:52:20.656262+0000","last_undegraded":"2023-12-24T19:52:20.656262+0000","last_fullsized":"2023-12-24T19:52:20.656262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:22:34.743736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461517+0000","last_change":"2023-12-24T19:52:20.455845+0000","last_active":"2023-12-24T19:52:20.461517+0000","last_peered":"2023-12-24T19:52:20.461517+0000","last_clean":"2023-12-24T19:52:20.461517+0000","last_became_active":"2023-12-24T19:52:20.455513+0000","last_became_peered":"2023-12-24T19:52:20.455513+0000","last_unstale":"2023-12-24T19:52:20.461517+0000","last_undegraded":"2023-12-24T19:52:20.461517+0000","last_fullsized":"2023-12-24T19:52:20.461517+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:33.303221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657449+0000","last_change":"2023-12-24T19:52:19.633282+0000","last_active":"2023-12-24T19:52:20.657449+0000","last_peered":"2023-12-24T19:52:20.657449+0000","last_clean":"2023-12-24T19:52:20.657449+0000","last_became_active":"2023-12-24T19:52:19.632977+0000","last_became_peered":"2023-12-24T19:52:19.632977+0000","last_unstale":"2023-12-24T19:52:20.657449+0000","last_undegraded":"2023-12-24T19:52:20.657449+0000","last_fullsized":"2023-12-24T19:52:20.657449+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:21.316376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457315+0000","last_change":"2023-12-24T19:52:20.454913+0000","last_active":"2023-12-24T19:52:20.457315+0000","last_peered":"2023-12-24T19:52:20.457315+0000","last_clean":"2023-12-24T19:52:20.457315+0000","last_became_active":"2023-12-24T19:52:20.454515+0000","last_became_peered":"2023-12-24T19:52:20.454515+0000","last_unstale":"2023-12-24T19:52:20.457315+0000","last_undegraded":"2023-12-24T19:52:20.457315+0000","last_fullsized":"2023-12-24T19:52:20.457315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655687+0000","last_change":"2023-12-24T19:52:19.632234+0000","last_active":"2023-12-24T19:52:20.655687+0000","last_peered":"2023-12-24T19:52:20.655687+0000","last_clean":"2023-12-24T19:52:20.655687+0000","last_became_active":"2023-12-24T19:52:19.631043+0000","last_became_peered":"2023-12-24T19:52:19.631043+0000","last_unstale":"2023-12-24T19:52:20.655687+0000","last_undegraded":"2023-12-24T19:52:20.655687+0000","last_fullsized":"2023-12-24T19:52:20.655687+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452144+0000","last_change":"2023-12-24T19:52:20.446043+0000","last_active":"2023-12-24T19:52:20.452144+0000","last_peered":"2023-12-24T19:52:20.452144+0000","last_clean":"2023-12-24T19:52:20.452144+0000","last_became_active":"2023-12-24T19:52:20.445753+0000","last_became_peered":"2023-12-24T19:52:20.445753+0000","last_unstale":"2023-12-24T19:52:20.452144+0000","last_undegraded":"2023-12-24T19:52:20.452144+0000","last_fullsized":"2023-12-24T19:52:20.452144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:03:46.910747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654431+0000","last_change":"2023-12-24T19:52:19.611715+0000","last_active":"2023-12-24T19:52:20.654431+0000","last_peered":"2023-12-24T19:52:20.654431+0000","last_clean":"2023-12-24T19:52:20.654431+0000","last_became_active":"2023-12-24T19:52:19.611384+0000","last_became_peered":"2023-12-24T19:52:19.611384+0000","last_unstale":"2023-12-24T19:52:20.654431+0000","last_undegraded":"2023-12-24T19:52:20.654431+0000","last_fullsized":"2023-12-24T19:52:20.654431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456851+0000","last_change":"2023-12-24T19:52:20.447681+0000","last_active":"2023-12-24T19:52:20.456851+0000","last_peered":"2023-12-24T19:52:20.456851+0000","last_clean":"2023-12-24T19:52:20.456851+0000","last_became_active":"2023-12-24T19:52:20.447098+0000","last_became_peered":"2023-12-24T19:52:20.447098+0000","last_unstale":"2023-12-24T19:52:20.456851+0000","last_undegraded":"2023-12-24T19:52:20.456851+0000","last_fullsized":"2023-12-24T19:52:20.456851+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:20.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431505+0000","last_change":"2023-12-24T19:52:19.624503+0000","last_active":"2023-12-24T19:52:20.431505+0000","last_peered":"2023-12-24T19:52:20.431505+0000","last_clean":"2023-12-24T19:52:20.431505+0000","last_became_active":"2023-12-24T19:52:19.621123+0000","last_became_peered":"2023-12-24T19:52:19.621123+0000","last_unstale":"2023-12-24T19:52:20.431505+0000","last_undegraded":"2023-12-24T19:52:20.431505+0000","last_fullsized":"2023-12-24T19:52:20.431505+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447519+0000","last_change":"2023-12-24T19:52:20.442294+0000","last_active":"2023-12-24T19:52:20.447519+0000","last_peered":"2023-12-24T19:52:20.447519+0000","last_clean":"2023-12-24T19:52:20.447519+0000","last_became_active":"2023-12-24T19:52:20.440941+0000","last_became_peered":"2023-12-24T19:52:20.440941+0000","last_unstale":"2023-12-24T19:52:20.447519+0000","last_undegraded":"2023-12-24T19:52:20.447519+0000","last_fullsized":"2023-12-24T19:52:20.447519+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.427537+0000","last_change":"2023-12-24T19:52:19.616328+0000","last_active":"2023-12-24T19:52:20.427537+0000","last_peered":"2023-12-24T19:52:20.427537+0000","last_clean":"2023-12-24T19:52:20.427537+0000","last_became_active":"2023-12-24T19:52:19.615974+0000","last_became_peered":"2023-12-24T19:52:19.615974+0000","last_unstale":"2023-12-24T19:52:20.427537+0000","last_undegraded":"2023-12-24T19:52:20.427537+0000","last_fullsized":"2023-12-24T19:52:20.427537+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:19.747414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460083+0000","last_change":"2023-12-24T19:52:20.450938+0000","last_active":"2023-12-24T19:52:20.460083+0000","last_peered":"2023-12-24T19:52:20.460083+0000","last_clean":"2023-12-24T19:52:20.460083+0000","last_became_active":"2023-12-24T19:52:20.450191+0000","last_became_peered":"2023-12-24T19:52:20.450191+0000","last_unstale":"2023-12-24T19:52:20.460083+0000","last_undegraded":"2023-12-24T19:52:20.460083+0000","last_fullsized":"2023-12-24T19:52:20.460083+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.443081+0000","last_change":"2023-12-24T19:52:19.630938+0000","last_active":"2023-12-24T19:52:20.443081+0000","last_peered":"2023-12-24T19:52:20.443081+0000","last_clean":"2023-12-24T19:52:20.443081+0000","last_became_active":"2023-12-24T19:52:19.630659+0000","last_became_peered":"2023-12-24T19:52:19.630659+0000","last_unstale":"2023-12-24T19:52:20.443081+0000","last_undegraded":"2023-12-24T19:52:20.443081+0000","last_fullsized":"2023-12-24T19:52:20.443081+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:27:59.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461129+0000","last_change":"2023-12-24T19:52:20.456394+0000","last_active":"2023-12-24T19:52:20.461129+0000","last_peered":"2023-12-24T19:52:20.461129+0000","last_clean":"2023-12-24T19:52:20.461129+0000","last_became_active":"2023-12-24T19:52:20.456077+0000","last_became_peered":"2023-12-24T19:52:20.456077+0000","last_unstale":"2023-12-24T19:52:20.461129+0000","last_undegraded":"2023-12-24T19:52:20.461129+0000","last_fullsized":"2023-12-24T19:52:20.461129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:05.733503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432888+0000","last_change":"2023-12-24T19:52:19.621239+0000","last_active":"2023-12-24T19:52:20.432888+0000","last_peered":"2023-12-24T19:52:20.432888+0000","last_clean":"2023-12-24T19:52:20.432888+0000","last_became_active":"2023-12-24T19:52:19.620920+0000","last_became_peered":"2023-12-24T19:52:19.620920+0000","last_unstale":"2023-12-24T19:52:20.432888+0000","last_undegraded":"2023-12-24T19:52:20.432888+0000","last_fullsized":"2023-12-24T19:52:20.432888+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:15.794978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461881+0000","last_change":"2023-12-24T19:52:20.460401+0000","last_active":"2023-12-24T19:52:20.461881+0000","last_peered":"2023-12-24T19:52:20.461881+0000","last_clean":"2023-12-24T19:52:20.461881+0000","last_became_active":"2023-12-24T19:52:20.459388+0000","last_became_peered":"2023-12-24T19:52:20.459388+0000","last_unstale":"2023-12-24T19:52:20.461881+0000","last_undegraded":"2023-12-24T19:52:20.461881+0000","last_fullsized":"2023-12-24T19:52:20.461881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:15.273424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654277+0000","last_change":"2023-12-24T19:52:19.622874+0000","last_active":"2023-12-24T19:52:20.654277+0000","last_peered":"2023-12-24T19:52:20.654277+0000","last_clean":"2023-12-24T19:52:20.654277+0000","last_became_active":"2023-12-24T19:52:19.622556+0000","last_became_peered":"2023-12-24T19:52:19.622556+0000","last_unstale":"2023-12-24T19:52:20.654277+0000","last_undegraded":"2023-12-24T19:52:20.654277+0000","last_fullsized":"2023-12-24T19:52:20.654277+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:18.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460225+0000","last_change":"2023-12-24T19:52:20.452626+0000","last_active":"2023-12-24T19:52:20.460225+0000","last_peered":"2023-12-24T19:52:20.460225+0000","last_clean":"2023-12-24T19:52:20.460225+0000","last_became_active":"2023-12-24T19:52:20.452360+0000","last_became_peered":"2023-12-24T19:52:20.452360+0000","last_unstale":"2023-12-24T19:52:20.460225+0000","last_undegraded":"2023-12-24T19:52:20.460225+0000","last_fullsized":"2023-12-24T19:52:20.460225+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.653976+0000","last_change":"2023-12-24T19:52:19.624741+0000","last_active":"2023-12-24T19:52:20.653976+0000","last_peered":"2023-12-24T19:52:20.653976+0000","last_clean":"2023-12-24T19:52:20.653976+0000","last_became_active":"2023-12-24T19:52:19.624434+0000","last_became_peered":"2023-12-24T19:52:19.624434+0000","last_unstale":"2023-12-24T19:52:20.653976+0000","last_undegraded":"2023-12-24T19:52:20.653976+0000","last_fullsized":"2023-12-24T19:52:20.653976+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.261291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459145+0000","last_change":"2023-12-24T19:52:20.453516+0000","last_active":"2023-12-24T19:52:20.459145+0000","last_peered":"2023-12-24T19:52:20.459145+0000","last_clean":"2023-12-24T19:52:20.459145+0000","last_became_active":"2023-12-24T19:52:20.451417+0000","last_became_peered":"2023-12-24T19:52:20.451417+0000","last_unstale":"2023-12-24T19:52:20.459145+0000","last_undegraded":"2023-12-24T19:52:20.459145+0000","last_fullsized":"2023-12-24T19:52:20.459145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:04.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432113+0000","last_change":"2023-12-24T19:52:19.630613+0000","last_active":"2023-12-24T19:52:20.432113+0000","last_peered":"2023-12-24T19:52:20.432113+0000","last_clean":"2023-12-24T19:52:20.432113+0000","last_became_active":"2023-12-24T19:52:19.629741+0000","last_became_peered":"2023-12-24T19:52:19.629741+0000","last_unstale":"2023-12-24T19:52:20.432113+0000","last_undegraded":"2023-12-24T19:52:20.432113+0000","last_fullsized":"2023-12-24T19:52:20.432113+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:30.807470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447996+0000","last_change":"2023-12-24T19:52:20.442555+0000","last_active":"2023-12-24T19:52:20.447996+0000","last_peered":"2023-12-24T19:52:20.447996+0000","last_clean":"2023-12-24T19:52:20.447996+0000","last_became_active":"2023-12-24T19:52:20.441968+0000","last_became_peered":"2023-12-24T19:52:20.441968+0000","last_unstale":"2023-12-24T19:52:20.447996+0000","last_undegraded":"2023-12-24T19:52:20.447996+0000","last_fullsized":"2023-12-24T19:52:20.447996+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:12:06.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.430392+0000","last_change":"2023-12-24T19:52:19.620713+0000","last_active":"2023-12-24T19:52:20.430392+0000","last_peered":"2023-12-24T19:52:20.430392+0000","last_clean":"2023-12-24T19:52:20.430392+0000","last_became_active":"2023-12-24T19:52:19.620417+0000","last_became_peered":"2023-12-24T19:52:19.620417+0000","last_unstale":"2023-12-24T19:52:20.430392+0000","last_undegraded":"2023-12-24T19:52:20.430392+0000","last_fullsized":"2023-12-24T19:52:20.430392+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:10.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453924+0000","last_change":"2023-12-24T19:52:20.448884+0000","last_active":"2023-12-24T19:52:20.453924+0000","last_peered":"2023-12-24T19:52:20.453924+0000","last_clean":"2023-12-24T19:52:20.453924+0000","last_became_active":"2023-12-24T19:52:20.448606+0000","last_became_peered":"2023-12-24T19:52:20.448606+0000","last_unstale":"2023-12-24T19:52:20.453924+0000","last_undegraded":"2023-12-24T19:52:20.453924+0000","last_fullsized":"2023-12-24T19:52:20.453924+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:59.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"172'8","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657177+0000","last_change":"2023-12-24T19:52:19.628126+0000","last_active":"2023-12-24T19:52:20.657177+0000","last_peered":"2023-12-24T19:52:20.657177+0000","last_clean":"2023-12-24T19:52:20.657177+0000","last_became_active":"2023-12-24T19:52:19.627819+0000","last_became_peered":"2023-12-24T19:52:19.627819+0000","last_unstale":"2023-12-24T19:52:20.657177+0000","last_undegraded":"2023-12-24T19:52:20.657177+0000","last_fullsized":"2023-12-24T19:52:20.657177+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:02.367913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459171+0000","last_change":"2023-12-24T19:52:20.454460+0000","last_active":"2023-12-24T19:52:20.459171+0000","last_peered":"2023-12-24T19:52:20.459171+0000","last_clean":"2023-12-24T19:52:20.459171+0000","last_became_active":"2023-12-24T19:52:20.451670+0000","last_became_peered":"2023-12-24T19:52:20.451670+0000","last_unstale":"2023-12-24T19:52:20.459171+0000","last_undegraded":"2023-12-24T19:52:20.459171+0000","last_fullsized":"2023-12-24T19:52:20.459171+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:59.000317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.649070+0000","last_change":"2023-12-24T19:52:19.627728+0000","last_active":"2023-12-24T19:52:20.649070+0000","last_peered":"2023-12-24T19:52:20.649070+0000","last_clean":"2023-12-24T19:52:20.649070+0000","last_became_active":"2023-12-24T19:52:19.627339+0000","last_became_peered":"2023-12-24T19:52:19.627339+0000","last_unstale":"2023-12-24T19:52:20.649070+0000","last_undegraded":"2023-12-24T19:52:20.649070+0000","last_fullsized":"2023-12-24T19:52:20.649070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:25.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462295+0000","last_change":"2023-12-24T19:52:20.458871+0000","last_active":"2023-12-24T19:52:20.462295+0000","last_peered":"2023-12-24T19:52:20.462295+0000","last_clean":"2023-12-24T19:52:20.462295+0000","last_became_active":"2023-12-24T19:52:20.458565+0000","last_became_peered":"2023-12-24T19:52:20.458565+0000","last_unstale":"2023-12-24T19:52:20.462295+0000","last_undegraded":"2023-12-24T19:52:20.462295+0000","last_fullsized":"2023-12-24T19:52:20.462295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:29.327761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655058+0000","last_change":"2023-12-24T19:52:19.630356+0000","last_active":"2023-12-24T19:52:20.655058+0000","last_peered":"2023-12-24T19:52:20.655058+0000","last_clean":"2023-12-24T19:52:20.655058+0000","last_became_active":"2023-12-24T19:52:19.630066+0000","last_became_peered":"2023-12-24T19:52:19.630066+0000","last_unstale":"2023-12-24T19:52:20.655058+0000","last_undegraded":"2023-12-24T19:52:20.655058+0000","last_fullsized":"2023-12-24T19:52:20.655058+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:15.266891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461544+0000","last_change":"2023-12-24T19:52:20.453710+0000","last_active":"2023-12-24T19:52:20.461544+0000","last_peered":"2023-12-24T19:52:20.461544+0000","last_clean":"2023-12-24T19:52:20.461544+0000","last_became_active":"2023-12-24T19:52:20.453383+0000","last_became_peered":"2023-12-24T19:52:20.453383+0000","last_unstale":"2023-12-24T19:52:20.461544+0000","last_undegraded":"2023-12-24T19:52:20.461544+0000","last_fullsized":"2023-12-24T19:52:20.461544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656007+0000","last_change":"2023-12-24T19:52:19.620872+0000","last_active":"2023-12-24T19:52:20.656007+0000","last_peered":"2023-12-24T19:52:20.656007+0000","last_clean":"2023-12-24T19:52:20.656007+0000","last_became_active":"2023-12-24T19:52:19.620309+0000","last_became_peered":"2023-12-24T19:52:19.620309+0000","last_unstale":"2023-12-24T19:52:20.656007+0000","last_undegraded":"2023-12-24T19:52:20.656007+0000","last_fullsized":"2023-12-24T19:52:20.656007+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:51.207604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453004+0000","last_change":"2023-12-24T19:52:20.450309+0000","last_active":"2023-12-24T19:52:20.453004+0000","last_peered":"2023-12-24T19:52:20.453004+0000","last_clean":"2023-12-24T19:52:20.453004+0000","last_became_active":"2023-12-24T19:52:20.450015+0000","last_became_peered":"2023-12-24T19:52:20.450015+0000","last_unstale":"2023-12-24T19:52:20.453004+0000","last_undegraded":"2023-12-24T19:52:20.453004+0000","last_fullsized":"2023-12-24T19:52:20.453004+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431176+0000","last_change":"2023-12-24T19:52:19.618844+0000","last_active":"2023-12-24T19:52:20.431176+0000","last_peered":"2023-12-24T19:52:20.431176+0000","last_clean":"2023-12-24T19:52:20.431176+0000","last_became_active":"2023-12-24T19:52:19.618517+0000","last_became_peered":"2023-12-24T19:52:19.618517+0000","last_unstale":"2023-12-24T19:52:20.431176+0000","last_undegraded":"2023-12-24T19:52:20.431176+0000","last_fullsized":"2023-12-24T19:52:20.431176+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:54.036031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458951+0000","last_change":"2023-12-24T19:52:20.453723+0000","last_active":"2023-12-24T19:52:20.458951+0000","last_peered":"2023-12-24T19:52:20.458951+0000","last_clean":"2023-12-24T19:52:20.458951+0000","last_became_active":"2023-12-24T19:52:20.450871+0000","last_became_peered":"2023-12-24T19:52:20.450871+0000","last_unstale":"2023-12-24T19:52:20.458951+0000","last_undegraded":"2023-12-24T19:52:20.458951+0000","last_fullsized":"2023-12-24T19:52:20.458951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:00.502880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657358+0000","last_change":"2023-12-24T19:52:19.633736+0000","last_active":"2023-12-24T19:52:20.657358+0000","last_peered":"2023-12-24T19:52:20.657358+0000","last_clean":"2023-12-24T19:52:20.657358+0000","last_became_active":"2023-12-24T19:52:19.633345+0000","last_became_peered":"2023-12-24T19:52:19.633345+0000","last_unstale":"2023-12-24T19:52:20.657358+0000","last_undegraded":"2023-12-24T19:52:20.657358+0000","last_fullsized":"2023-12-24T19:52:20.657358+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:58.575838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460350+0000","last_change":"2023-12-24T19:52:20.458023+0000","last_active":"2023-12-24T19:52:20.460350+0000","last_peered":"2023-12-24T19:52:20.460350+0000","last_clean":"2023-12-24T19:52:20.460350+0000","last_became_active":"2023-12-24T19:52:20.455936+0000","last_became_peered":"2023-12-24T19:52:20.455936+0000","last_unstale":"2023-12-24T19:52:20.460350+0000","last_undegraded":"2023-12-24T19:52:20.460350+0000","last_fullsized":"2023-12-24T19:52:20.460350+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:23.400292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.438646+0000","last_change":"2023-12-24T19:52:19.622235+0000","last_active":"2023-12-24T19:52:20.438646+0000","last_peered":"2023-12-24T19:52:20.438646+0000","last_clean":"2023-12-24T19:52:20.438646+0000","last_became_active":"2023-12-24T19:52:19.621726+0000","last_became_peered":"2023-12-24T19:52:19.621726+0000","last_unstale":"2023-12-24T19:52:20.438646+0000","last_undegraded":"2023-12-24T19:52:20.438646+0000","last_fullsized":"2023-12-24T19:52:20.438646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:35.512788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452524+0000","last_change":"2023-12-24T19:52:20.451501+0000","last_active":"2023-12-24T19:52:20.452524+0000","last_peered":"2023-12-24T19:52:20.452524+0000","last_clean":"2023-12-24T19:52:20.452524+0000","last_became_active":"2023-12-24T19:52:20.450966+0000","last_became_peered":"2023-12-24T19:52:20.450966+0000","last_unstale":"2023-12-24T19:52:20.452524+0000","last_undegraded":"2023-12-24T19:52:20.452524+0000","last_fullsized":"2023-12-24T19:52:20.452524+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:18:26.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.441265+0000","last_change":"2023-12-24T19:52:19.632975+0000","last_active":"2023-12-24T19:52:20.441265+0000","last_peered":"2023-12-24T19:52:20.441265+0000","last_clean":"2023-12-24T19:52:20.441265+0000","last_became_active":"2023-12-24T19:52:19.632576+0000","last_became_peered":"2023-12-24T19:52:19.632576+0000","last_unstale":"2023-12-24T19:52:20.441265+0000","last_undegraded":"2023-12-24T19:52:20.441265+0000","last_fullsized":"2023-12-24T19:52:20.441265+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459058+0000","last_change":"2023-12-24T19:52:20.453540+0000","last_active":"2023-12-24T19:52:20.459058+0000","last_peered":"2023-12-24T19:52:20.459058+0000","last_clean":"2023-12-24T19:52:20.459058+0000","last_became_active":"2023-12-24T19:52:20.453229+0000","last_became_peered":"2023-12-24T19:52:20.453229+0000","last_unstale":"2023-12-24T19:52:20.459058+0000","last_undegraded":"2023-12-24T19:52:20.459058+0000","last_fullsized":"2023-12-24T19:52:20.459058+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:23:01.774161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440406+0000","last_change":"2023-12-24T19:52:19.624224+0000","last_active":"2023-12-24T19:52:20.440406+0000","last_peered":"2023-12-24T19:52:20.440406+0000","last_clean":"2023-12-24T19:52:20.440406+0000","last_became_active":"2023-12-24T19:52:19.623961+0000","last_became_peered":"2023-12-24T19:52:19.623961+0000","last_unstale":"2023-12-24T19:52:20.440406+0000","last_undegraded":"2023-12-24T19:52:20.440406+0000","last_fullsized":"2023-12-24T19:52:20.440406+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451574+0000","last_change":"2023-12-24T19:52:20.444774+0000","last_active":"2023-12-24T19:52:20.451574+0000","last_peered":"2023-12-24T19:52:20.451574+0000","last_clean":"2023-12-24T19:52:20.451574+0000","last_became_active":"2023-12-24T19:52:20.444394+0000","last_became_peered":"2023-12-24T19:52:20.444394+0000","last_unstale":"2023-12-24T19:52:20.451574+0000","last_undegraded":"2023-12-24T19:52:20.451574+0000","last_fullsized":"2023-12-24T19:52:20.451574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:51:44.742350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654018+0000","last_change":"2023-12-24T19:52:19.625698+0000","last_active":"2023-12-24T19:52:20.654018+0000","last_peered":"2023-12-24T19:52:20.654018+0000","last_clean":"2023-12-24T19:52:20.654018+0000","last_became_active":"2023-12-24T19:52:19.625400+0000","last_became_peered":"2023-12-24T19:52:19.625400+0000","last_unstale":"2023-12-24T19:52:20.654018+0000","last_undegraded":"2023-12-24T19:52:20.654018+0000","last_fullsized":"2023-12-24T19:52:20.654018+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:38.897775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448937+0000","last_change":"2023-12-24T19:52:20.442376+0000","last_active":"2023-12-24T19:52:20.448937+0000","last_peered":"2023-12-24T19:52:20.448937+0000","last_clean":"2023-12-24T19:52:20.448937+0000","last_became_active":"2023-12-24T19:52:20.442080+0000","last_became_peered":"2023-12-24T19:52:20.442080+0000","last_unstale":"2023-12-24T19:52:20.448937+0000","last_undegraded":"2023-12-24T19:52:20.448937+0000","last_fullsized":"2023-12-24T19:52:20.448937+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:35.207713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.433044+0000","last_change":"2023-12-24T19:52:19.630494+0000","last_active":"2023-12-24T19:52:20.433044+0000","last_peered":"2023-12-24T19:52:20.433044+0000","last_clean":"2023-12-24T19:52:20.433044+0000","last_became_active":"2023-12-24T19:52:19.630208+0000","last_became_peered":"2023-12-24T19:52:19.630208+0000","last_unstale":"2023-12-24T19:52:20.433044+0000","last_undegraded":"2023-12-24T19:52:20.433044+0000","last_fullsized":"2023-12-24T19:52:20.433044+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:00.646294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447593+0000","last_change":"2023-12-24T19:52:20.441690+0000","last_active":"2023-12-24T19:52:20.447593+0000","last_peered":"2023-12-24T19:52:20.447593+0000","last_clean":"2023-12-24T19:52:20.447593+0000","last_became_active":"2023-12-24T19:52:20.441401+0000","last_became_peered":"2023-12-24T19:52:20.441401+0000","last_unstale":"2023-12-24T19:52:20.447593+0000","last_undegraded":"2023-12-24T19:52:20.447593+0000","last_fullsized":"2023-12-24T19:52:20.447593+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:07.383658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.437347+0000","last_change":"2023-12-24T19:52:19.627158+0000","last_active":"2023-12-24T19:52:20.437347+0000","last_peered":"2023-12-24T19:52:20.437347+0000","last_clean":"2023-12-24T19:52:20.437347+0000","last_became_active":"2023-12-24T19:52:19.626853+0000","last_became_peered":"2023-12-24T19:52:19.626853+0000","last_unstale":"2023-12-24T19:52:20.437347+0000","last_undegraded":"2023-12-24T19:52:20.437347+0000","last_fullsized":"2023-12-24T19:52:20.437347+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:29:32.489540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449029+0000","last_change":"2023-12-24T19:52:20.444049+0000","last_active":"2023-12-24T19:52:20.449029+0000","last_peered":"2023-12-24T19:52:20.449029+0000","last_clean":"2023-12-24T19:52:20.449029+0000","last_became_active":"2023-12-24T19:52:20.443576+0000","last_became_peered":"2023-12-24T19:52:20.443576+0000","last_unstale":"2023-12-24T19:52:20.449029+0000","last_undegraded":"2023-12-24T19:52:20.449029+0000","last_fullsized":"2023-12-24T19:52:20.449029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:14.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.428803+0000","last_change":"2023-12-24T19:52:19.627426+0000","last_active":"2023-12-24T19:52:20.428803+0000","last_peered":"2023-12-24T19:52:20.428803+0000","last_clean":"2023-12-24T19:52:20.428803+0000","last_became_active":"2023-12-24T19:52:19.626661+0000","last_became_peered":"2023-12-24T19:52:19.626661+0000","last_unstale":"2023-12-24T19:52:20.428803+0000","last_undegraded":"2023-12-24T19:52:20.428803+0000","last_fullsized":"2023-12-24T19:52:20.428803+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457509+0000","last_change":"2023-12-24T19:52:20.445257+0000","last_active":"2023-12-24T19:52:20.457509+0000","last_peered":"2023-12-24T19:52:20.457509+0000","last_clean":"2023-12-24T19:52:20.457509+0000","last_became_active":"2023-12-24T19:52:20.444758+0000","last_became_peered":"2023-12-24T19:52:20.444758+0000","last_unstale":"2023-12-24T19:52:20.457509+0000","last_undegraded":"2023-12-24T19:52:20.457509+0000","last_fullsized":"2023-12-24T19:52:20.457509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432442+0000","last_change":"2023-12-24T19:52:19.622896+0000","last_active":"2023-12-24T19:52:20.432442+0000","last_peered":"2023-12-24T19:52:20.432442+0000","last_clean":"2023-12-24T19:52:20.432442+0000","last_became_active":"2023-12-24T19:52:19.620554+0000","last_became_peered":"2023-12-24T19:52:19.620554+0000","last_unstale":"2023-12-24T19:52:20.432442+0000","last_undegraded":"2023-12-24T19:52:20.432442+0000","last_fullsized":"2023-12-24T19:52:20.432442+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:23.305323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450617+0000","last_change":"2023-12-24T19:52:20.442947+0000","last_active":"2023-12-24T19:52:20.450617+0000","last_peered":"2023-12-24T19:52:20.450617+0000","last_clean":"2023-12-24T19:52:20.450617+0000","last_became_active":"2023-12-24T19:52:20.442673+0000","last_became_peered":"2023-12-24T19:52:20.442673+0000","last_unstale":"2023-12-24T19:52:20.450617+0000","last_undegraded":"2023-12-24T19:52:20.450617+0000","last_fullsized":"2023-12-24T19:52:20.450617+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:16.808549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440349+0000","last_change":"2023-12-24T19:52:19.626676+0000","last_active":"2023-12-24T19:52:20.440349+0000","last_peered":"2023-12-24T19:52:20.440349+0000","last_clean":"2023-12-24T19:52:20.440349+0000","last_became_active":"2023-12-24T19:52:19.626369+0000","last_became_peered":"2023-12-24T19:52:19.626369+0000","last_unstale":"2023-12-24T19:52:20.440349+0000","last_undegraded":"2023-12-24T19:52:20.440349+0000","last_fullsized":"2023-12-24T19:52:20.440349+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:59.583628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458726+0000","last_change":"2023-12-24T19:52:20.453417+0000","last_active":"2023-12-24T19:52:20.458726+0000","last_peered":"2023-12-24T19:52:20.458726+0000","last_clean":"2023-12-24T19:52:20.458726+0000","last_became_active":"2023-12-24T19:52:20.446412+0000","last_became_peered":"2023-12-24T19:52:20.446412+0000","last_unstale":"2023-12-24T19:52:20.458726+0000","last_undegraded":"2023-12-24T19:52:20.458726+0000","last_fullsized":"2023-12-24T19:52:20.458726+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:57.299870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431646+0000","last_change":"2023-12-24T19:52:19.626315+0000","last_active":"2023-12-24T19:52:20.431646+0000","last_peered":"2023-12-24T19:52:20.431646+0000","last_clean":"2023-12-24T19:52:20.431646+0000","last_became_active":"2023-12-24T19:52:19.624214+0000","last_became_peered":"2023-12-24T19:52:19.624214+0000","last_unstale":"2023-12-24T19:52:20.431646+0000","last_undegraded":"2023-12-24T19:52:20.431646+0000","last_fullsized":"2023-12-24T19:52:20.431646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457788+0000","last_change":"2023-12-24T19:52:20.446836+0000","last_active":"2023-12-24T19:52:20.457788+0000","last_peered":"2023-12-24T19:52:20.457788+0000","last_clean":"2023-12-24T19:52:20.457788+0000","last_became_active":"2023-12-24T19:52:20.446047+0000","last_became_peered":"2023-12-24T19:52:20.446047+0000","last_unstale":"2023-12-24T19:52:20.457788+0000","last_undegraded":"2023-12-24T19:52:20.457788+0000","last_fullsized":"2023-12-24T19:52:20.457788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:17.021655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440741+0000","last_change":"2023-12-24T19:52:19.626817+0000","last_active":"2023-12-24T19:52:20.440741+0000","last_peered":"2023-12-24T19:52:20.440741+0000","last_clean":"2023-12-24T19:52:20.440741+0000","last_became_active":"2023-12-24T19:52:19.625919+0000","last_became_peered":"2023-12-24T19:52:19.625919+0000","last_unstale":"2023-12-24T19:52:20.440741+0000","last_undegraded":"2023-12-24T19:52:20.440741+0000","last_fullsized":"2023-12-24T19:52:20.440741+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:54.742755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459951+0000","last_change":"2023-12-24T19:52:20.451641+0000","last_active":"2023-12-24T19:52:20.459951+0000","last_peered":"2023-12-24T19:52:20.459951+0000","last_clean":"2023-12-24T19:52:20.459951+0000","last_became_active":"2023-12-24T19:52:20.451345+0000","last_became_peered":"2023-12-24T19:52:20.451345+0000","last_unstale":"2023-12-24T19:52:20.459951+0000","last_undegraded":"2023-12-24T19:52:20.459951+0000","last_fullsized":"2023-12-24T19:52:20.459951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"172'6","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.659634+0000","last_change":"2023-12-24T19:52:19.632553+0000","last_active":"2023-12-24T19:52:20.659634+0000","last_peered":"2023-12-24T19:52:20.659634+0000","last_clean":"2023-12-24T19:52:20.659634+0000","last_became_active":"2023-12-24T19:52:19.632215+0000","last_became_peered":"2023-12-24T19:52:19.632215+0000","last_unstale":"2023-12-24T19:52:20.659634+0000","last_undegraded":"2023-12-24T19:52:20.659634+0000","last_fullsized":"2023-12-24T19:52:20.659634+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"162'293","reported_seq":907,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440833+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:52:20.440833+0000","last_peered":"2023-12-24T19:52:20.440833+0000","last_clean":"2023-12-24T19:52:20.440833+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:52:20.440833+0000","last_undegraded":"2023-12-24T19:52:20.440833+0000","last_fullsized":"2023-12-24T19:52:20.440833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071856,"statfs":{"total":96636764160,"available":96329580544,"internally_reserved":0,"allocated":2760704,"data_stored":1713413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":1.099}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":1.1919999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.27},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.222}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.0549999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.333}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.248}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.304},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575755,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315788,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056052,"statfs":{"total":96636764160,"available":96313397248,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.532},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.052}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":1.157},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":0.97099999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.224},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.4319999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.016}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.254}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.296},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.613}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.347}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2162688,"data_stored":1123023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.327},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":1.409}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.877}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":1.298},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.123},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.355}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.2230000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.0129999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311700,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060140,"statfs":{"total":96636764160,"available":96317583360,"internally_reserved":0,"allocated":2174976,"data_stored":1124559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.28},"min":{"1min":0.622,"5min":0.622,"15min":0.58399999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.4610000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2110000000000001,"15min":1.1679999999999999},"min":{"1min":0.83099999999999996,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1990000000000001,"15min":1.1539999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.1550000000000002,"5min":4.1550000000000002,"15min":4.1550000000000002},"last":1.2869999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.391,"15min":1.369},"min":{"1min":0.746,"5min":0.746,"15min":0.63900000000000001},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.417},{"interface":"front","average":{"1min":1.579,"5min":1.397,"15min":1.3600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.383}]},{"osd":3,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.238,"15min":1.1919999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.46400000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.617},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.99399999999999999,"5min":0.89400000000000002,"15min":0.63900000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3140000000000001,"15min":1.2849999999999999},"min":{"1min":0.77500000000000002,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":3.29,"5min":3.29,"15min":3.29},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.361,"15min":1.3300000000000001},"min":{"1min":0.92400000000000004,"5min":0.72999999999999998,"15min":0.58799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.6890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.2929999999999999,"15min":1.266},"min":{"1min":1.095,"5min":0.79900000000000004,"15min":0.56000000000000005},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.25},{"interface":"front","average":{"1min":1.419,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.95699999999999996,"5min":0.621,"15min":0.621},"max":{"1min":1.853,"5min":1.887,"15min":1.887},"last":1.343}]},{"osd":7,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.3320000000000001,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.54500000000000004},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.736},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4430000000000001,"15min":1.4199999999999999},"min":{"1min":1.042,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.843,"5min":2,"15min":2},"last":1.532}]}]},{"osd":3,"up_from":13,"seq":55834575755,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1123611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.2569999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":2.3140000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":2.1539999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.8759999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":2.1749999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.5580000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":2.0289999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":2.1160000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":2.2040000000000002},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":2.0619999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575757,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315792,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056048,"statfs":{"total":96636764160,"available":96313393152,"internally_reserved":0,"allocated":2170880,"data_stored":1123135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.24}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":0.90200000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.718},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4370000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.486},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.3839999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.784},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.5469999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.901},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.601}]}]},{"osd":1,"up_from":13,"seq":55834575755,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3360000000000001,"5min":1.421,"15min":1.647},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1479999999999999,"15min":1.145},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.4630000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3640000000000001,"5min":1.744,"15min":1.744},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.79000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.706,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.268,"15min":1.2649999999999999},"min":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":1.669,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.64700000000000002},"max":{"1min":1.702,"5min":1.726,"15min":1.823},"last":1.649}]},{"osd":4,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2789999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.429,"15min":1.423},"min":{"1min":0.93500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.7729999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.3160000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.413,"15min":1.407},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.948},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.383},"min":{"1min":0.97699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.2189999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5189999999999999,"15min":1.506},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8919999999999999,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.514,"15min":1.5},"min":{"1min":1.1259999999999999,"5min":1.008,"15min":0.88900000000000001},"max":{"1min":1.7969999999999999,"5min":2.1339999999999999,"15min":2.323},"last":1.3500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5640000000000001,"15min":1.5509999999999999},"min":{"1min":1.1100000000000001,"5min":0.999,"15min":0.999},"max":{"1min":1.95,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.53,"15min":1.5109999999999999},"min":{"1min":1.0109999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.954,"5min":2.532,"15min":2.532},"last":1.2130000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575755,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300004,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071836,"statfs":{"total":96636764160,"available":96329560064,"internally_reserved":0,"allocated":2781184,"data_stored":1715605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90300000000000002,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.478,"5min":1.6859999999999999,"15min":1.7250000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0669999999999999,"15min":1.018},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.50800000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":3.0910000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0609999999999999,"15min":1.0940000000000001},"min":{"1min":0.79800000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.6950000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":3.113},{"interface":"front","average":{"1min":1.202,"5min":1.129,"15min":1.137},"min":{"1min":0.93100000000000005,"5min":0.67800000000000005,"15min":0.61599999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.833},"last":2.8279999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.68500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6319999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":13.553000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.746,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.405,"15min":1.381},"min":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.90400000000000003},"max":{"1min":1.8180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":2.9340000000000002},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.335,"15min":1.3160000000000001},"min":{"1min":0.91900000000000004,"5min":0.85699999999999998,"15min":0.80200000000000005},"max":{"1min":1.8720000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":13.608000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4399999999999999,"15min":1.4279999999999999},"min":{"1min":1.129,"5min":0.87,"15min":0.87},"max":{"1min":1.752,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":2.681},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4570000000000001,"15min":1.444},"min":{"1min":1.1699999999999999,"5min":0.89600000000000002,"15min":0.66600000000000004},"max":{"1min":1.954,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":2.7240000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":13.651},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4890000000000001,"15min":1.496},"min":{"1min":1.262,"5min":1.0269999999999999,"15min":1},"max":{"1min":1.754,"5min":2.1309999999999998,"15min":2.4119999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.526,"15min":1.526},"min":{"1min":1.1919999999999999,"5min":1.052,"15min":0.82299999999999995},"max":{"1min":2.4169999999999998,"5min":2.46,"15min":2.46},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.476,"15min":1.468},"min":{"1min":0.84599999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.829,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":10.205}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:52:25.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T19:52:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.074+0000 7fc38240c700 1 Processor -- start 2023-12-24T19:52:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38240c700 1 -- start start 2023-12-24T19:52:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38240c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc37c0c6c00 0x7fc37c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38240c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c06d6f0 con 0x7fc37c0c6830 2023-12-24T19:52:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38240c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c06c820 con 0x7fc37c06db80 2023-12-24T19:52:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38240c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c06cae0 con 0x7fc37c0c6c00 2023-12-24T19:52:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc381c0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc37c0c6c00 0x7fc37c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38140a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc37c0c6830 0x7fc37c06af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42724/0 (socket says 172.21.15.50:42724) 2023-12-24T19:52:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc38140a700 1 -- 172.21.15.50:0/4058983223 learned_addr learned my addr 172.21.15.50:0/4058983223 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc380c09700 1 --1- 172.21.15.50:0/4058983223 >> v1:172.21.15.82:6789/0 conn(0x7fc37c06db80 0x7fc37c15ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36804/0 (socket says 172.21.15.50:36804) 2023-12-24T19:52:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc373fff700 1 -- 172.21.15.50:0/4058983223 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835466937 0 0) 0x7fc37c06c820 con 0x7fc37c06db80 2023-12-24T19:52:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc373fff700 1 -- 172.21.15.50:0/4058983223 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc368003570 con 0x7fc37c06db80 2023-12-24T19:52:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc381c0b700 1 -- 172.21.15.50:0/4058983223 >> v1:172.21.15.82:6789/0 conn(0x7fc37c06db80 legacy=0x7fc37c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc381c0b700 1 -- 172.21.15.50:0/4058983223 >> v1:172.21.15.50:6789/0 conn(0x7fc37c0c6830 legacy=0x7fc37c06af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.078+0000 7fc381c0b700 1 -- 172.21.15.50:0/4058983223 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c06cdc0 con 0x7fc37c0c6c00 2023-12-24T19:52:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc381c0b700 1 --2- 172.21.15.50:0/4058983223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c15d160 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e60 tx=0x7fc374009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30084cf9a1caa130 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc373fff700 1 -- 172.21.15.50:0/4058983223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400e070 con 0x7fc37c0c6c00 2023-12-24T19:52:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc373fff700 1 -- 172.21.15.50:0/4058983223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400bb60 con 0x7fc37c0c6c00 2023-12-24T19:52:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc373fff700 1 -- 172.21.15.50:0/4058983223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374012430 con 0x7fc37c0c6c00 2023-12-24T19:52:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 -- 172.21.15.50:0/4058983223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 msgr2=0x7fc37c15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 --2- 172.21.15.50:0/4058983223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c15d160 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e60 tx=0x7fc374009780 comp rx=0 tx=0).stop 2023-12-24T19:52:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 -- 172.21.15.50:0/4058983223 shutdown_connections 2023-12-24T19:52:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 --2- 172.21.15.50:0/4058983223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c15d160 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 -- 172.21.15.50:0/4058983223 >> 172.21.15.50:0/4058983223 conn(0x7fc37c0670b0 msgr2=0x7fc37c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 -- 172.21.15.50:0/4058983223 shutdown_connections 2023-12-24T19:52:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.082+0000 7fc38240c700 1 -- 172.21.15.50:0/4058983223 wait complete. 2023-12-24T19:52:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 Processor -- start 2023-12-24T19:52:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 -- start start 2023-12-24T19:52:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37c06db80 0x7fc37c0ba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c0c6830 0x7fc37c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c16edb0 con 0x7fc37c0c6c00 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c16e7d0 con 0x7fc37c0c6830 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc38240c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c16e180 con 0x7fc37c06db80 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc381c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc381c0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41894/0 (socket says 172.21.15.50:41894) 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.086+0000 7fc381c0b700 1 -- 172.21.15.50:0/4211884331 learned_addr learned my addr 172.21.15.50:0/4211884331 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc380c09700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c0c6830 0x7fc37c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc38140a700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37c06db80 0x7fc37c0ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 -- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37c06db80 msgr2=0x7fc37c0ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37c06db80 0x7fc37c0ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 -- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c0c6830 msgr2=0x7fc37c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c0c6830 0x7fc37c150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 -- 172.21.15.50:0/4211884331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009a20 con 0x7fc37c0c6c00 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc381c0b700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc37400b6c0 tx=0x7fc374019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374012e30 con 0x7fc37c0c6c00 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37401d630 con 0x7fc37c0c6c00 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c16ea40 con 0x7fc37c0c6c00 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37401d9f0 con 0x7fc37c0c6c00 2023-12-24T19:52:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c16e460 con 0x7fc37c0c6c00 2023-12-24T19:52:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.090+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c16ef60 con 0x7fc37c0c6c00 2023-12-24T19:52:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.094+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc374024070 con 0x7fc37c0c6c00 2023-12-24T19:52:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.094+0000 7fc3717fa700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.094+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fc37407f2f0 con 0x7fc37c0c6c00 2023-12-24T19:52:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.094+0000 7fc38140a700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.094+0000 7fc38140a700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 0x7fc360062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc378001820 tx=0x7fc378009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.102+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc37c16ef60 con 0x7fc37c0c6c00 2023-12-24T19:52:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.338+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc37c16ef60 con 0x7fc37c0c6c00 2023-12-24T19:52:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.338+0000 7fc3717fa700 1 -- 172.21.15.50:0/4211884331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1030 (secure 0 0 0) 0x7fc37c16ef60 con 0x7fc37c0c6c00 2023-12-24T19:52:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:26.341 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4582,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":173,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2528976896,"bytes_avail":770565136384,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":86,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-12-24T19:41:41.962537+0000","services":{}},"progress_events":{}} 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 msgr2=0x7fc360062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 0x7fc360062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc378001820 tx=0x7fc378009040 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 msgr2=0x7fc37c0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc37400b6c0 tx=0x7fc374019000 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 shutdown_connections 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0c6c00 0x7fc37c0ca860 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c0c6830 0x7fc37c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 --2- 172.21.15.50:0/4211884331 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37c06db80 0x7fc37c0ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 >> 172.21.15.50:0/4211884331 conn(0x7fc37c0670b0 msgr2=0x7fc37c0c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 shutdown_connections 2023-12-24T19:52:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.342+0000 7fc38240c700 1 -- 172.21.15.50:0/4211884331 wait complete. 2023-12-24T19:52:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T19:52:26.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:52:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 Processor -- start 2023-12-24T19:52:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 -- start start 2023-12-24T19:52:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cdc0b4f50 0x7f8cdc0b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 0x7f8cdc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0cf980 con 0x7f8cdc159f00 2023-12-24T19:52:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc06aa10 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8ce1278700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc06acf0 con 0x7f8cdc06a510 2023-12-24T19:52:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8cdb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cdc159f00 0x7f8cdc1564e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42736/0 (socket says 172.21.15.50:42736) 2023-12-24T19:52:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8cdb7fe700 1 -- 172.21.15.50:0/2748980788 learned_addr learned my addr 172.21.15.50:0/2748980788 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/2748980788 >> v2:172.21.15.50:3300/0 conn(0x7f8cdc0b4f50 0x7f8cdc0b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.534+0000 7f8cd3fff700 1 --2- 172.21.15.50:0/2748980788 >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 0x7f8cdc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114546264 0 0) 0x7f8cdc0cf980 con 0x7f8cdc159f00 2023-12-24T19:52:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc8003570 con 0x7f8cdc159f00 2023-12-24T19:52:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cdaffd700 1 -- 172.21.15.50:0/2748980788 >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 msgr2=0x7f8cdc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/2748980788 >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 0x7f8cdc0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cdaffd700 1 -- 172.21.15.50:0/2748980788 >> v1:172.21.15.50:6789/0 conn(0x7f8cdc159f00 legacy=0x7f8cdc1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274001902 0 0) 0x7f8cc8003570 con 0x7f8cdc159f00 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cdaffd700 1 -- 172.21.15.50:0/2748980788 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc06afd0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cd3fff700 1 --2- 172.21.15.50:0/2748980788 >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 0x7f8cdc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/2748980788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc0b5320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc069ed0 tx=0x7f8ccc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42defbef6f8bfcf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40017f0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc011420 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8cda7fc700 1 -- 172.21.15.50:0/2748980788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0117c0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 -- 172.21.15.50:0/2748980788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 msgr2=0x7f8cdc0b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 --2- 172.21.15.50:0/2748980788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc0b5320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc069ed0 tx=0x7f8ccc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 -- 172.21.15.50:0/2748980788 shutdown_connections 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 --2- 172.21.15.50:0/2748980788 >> v2:172.21.15.82:3300/0 conn(0x7f8cdc06a510 0x7f8cdc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 --2- 172.21.15.50:0/2748980788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc0b5320 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 -- 172.21.15.50:0/2748980788 >> 172.21.15.50:0/2748980788 conn(0x7f8cdc0670b0 msgr2=0x7f8cdc067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 -- 172.21.15.50:0/2748980788 shutdown_connections 2023-12-24T19:52:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.538+0000 7f8ce1278700 1 -- 172.21.15.50:0/2748980788 wait complete. 2023-12-24T19:52:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 Processor -- start 2023-12-24T19:52:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 -- start start 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 0x7f8cdc14a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 0x7f8cdc157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1573a0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc156790 con 0x7f8cdc06a510 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8ce1278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc156a70 con 0x7f8cdc159f00 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41918/0 (socket says 172.21.15.50:41918) 2023-12-24T19:52:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 -- 172.21.15.50:0/3726869991 learned_addr learned my addr 172.21.15.50:0/3726869991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cdb7fe700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 0x7f8cdc157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 0x7f8cdc14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 -- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 msgr2=0x7f8cdc157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 0x7f8cdc157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 -- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 msgr2=0x7f8cdc14a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 0x7f8cdc14a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 -- 172.21.15.50:0/3726869991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009420 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cdb7fe700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 0x7f8cdc157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 0x7f8cdc14a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.542+0000 7f8cd3fff700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400ec80 tx=0x7f8cc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400c9d0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc400cb30 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc009420 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400ceb0 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc157030 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc04be40 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.546+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8cc4013680 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.550+0000 7f8cd2ffd700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 0x7f8cbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.550+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f8cc407d230 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.550+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 0x7f8cbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.550+0000 7f8cdaffd700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 0x7f8cbc062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc069ed0 tx=0x7f8ccc016000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.558+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8cc404d550 con 0x7f8cdc0b4f50 2023-12-24T19:52:26.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.726+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cdc0ce230 con 0x7f8cbc060550 2023-12-24T19:52:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.738+0000 7f8cd2ffd700 1 -- 172.21.15.50:0/3726869991 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286507 (secure 0 0 0) 0x7f8cdc0ce230 con 0x7f8cbc060550 2023-12-24T19:52:26.743 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 msgr2=0x7f8cbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 0x7f8cbc062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc069ed0 tx=0x7f8ccc016000 comp rx=0 tx=0).stop 2023-12-24T19:52:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 msgr2=0x7f8cdc169430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400ec80 tx=0x7f8cc40091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 shutdown_connections 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f8cbc060550 0x7f8cbc062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cdc159f00 0x7f8cdc157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0b4f50 0x7f8cdc169430 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 --2- 172.21.15.50:0/3726869991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc06a510 0x7f8cdc14a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 >> 172.21.15.50:0/3726869991 conn(0x7f8cdc0670b0 msgr2=0x7f8cdc152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 shutdown_connections 2023-12-24T19:52:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:26.746+0000 7f8ce1278700 1 -- 172.21.15.50:0/3726869991 wait complete. 2023-12-24T19:52:26.751 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:52:26.769 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:52:25.505446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470152,"kb_used_data":18120,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504568,"statfs":{"total":773094113280,"available":770564677632,"internally_reserved":0,"allocated":18554880,"data_stored":10169532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002126"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452698+0000","last_change":"2023-12-24T19:52:20.445727+0000","last_active":"2023-12-24T19:52:20.452698+0000","last_peered":"2023-12-24T19:52:20.452698+0000","last_clean":"2023-12-24T19:52:20.452698+0000","last_became_active":"2023-12-24T19:52:20.445397+0000","last_became_peered":"2023-12-24T19:52:20.445397+0000","last_unstale":"2023-12-24T19:52:20.452698+0000","last_undegraded":"2023-12-24T19:52:20.452698+0000","last_fullsized":"2023-12-24T19:52:20.452698+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:22.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459069+0000","last_change":"2023-12-24T19:52:20.453790+0000","last_active":"2023-12-24T19:52:20.459069+0000","last_peered":"2023-12-24T19:52:20.459069+0000","last_clean":"2023-12-24T19:52:20.459069+0000","last_became_active":"2023-12-24T19:52:20.453359+0000","last_became_peered":"2023-12-24T19:52:20.453359+0000","last_unstale":"2023-12-24T19:52:20.459069+0000","last_undegraded":"2023-12-24T19:52:20.459069+0000","last_fullsized":"2023-12-24T19:52:20.459069+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:47:21.091012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460321+0000","last_change":"2023-12-24T19:52:20.457881+0000","last_active":"2023-12-24T19:52:20.460321+0000","last_peered":"2023-12-24T19:52:20.460321+0000","last_clean":"2023-12-24T19:52:20.460321+0000","last_became_active":"2023-12-24T19:52:20.457611+0000","last_became_peered":"2023-12-24T19:52:20.457611+0000","last_unstale":"2023-12-24T19:52:20.460321+0000","last_undegraded":"2023-12-24T19:52:20.460321+0000","last_fullsized":"2023-12-24T19:52:20.460321+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452247+0000","last_change":"2023-12-24T19:52:20.448108+0000","last_active":"2023-12-24T19:52:20.452247+0000","last_peered":"2023-12-24T19:52:20.452247+0000","last_clean":"2023-12-24T19:52:20.452247+0000","last_became_active":"2023-12-24T19:52:20.447808+0000","last_became_peered":"2023-12-24T19:52:20.447808+0000","last_unstale":"2023-12-24T19:52:20.452247+0000","last_undegraded":"2023-12-24T19:52:20.452247+0000","last_fullsized":"2023-12-24T19:52:20.452247+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:03.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449289+0000","last_change":"2023-12-24T19:52:20.443180+0000","last_active":"2023-12-24T19:52:20.449289+0000","last_peered":"2023-12-24T19:52:20.449289+0000","last_clean":"2023-12-24T19:52:20.449289+0000","last_became_active":"2023-12-24T19:52:20.440477+0000","last_became_peered":"2023-12-24T19:52:20.440477+0000","last_unstale":"2023-12-24T19:52:20.449289+0000","last_undegraded":"2023-12-24T19:52:20.449289+0000","last_fullsized":"2023-12-24T19:52:20.449289+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.457160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447975+0000","last_change":"2023-12-24T19:52:20.442278+0000","last_active":"2023-12-24T19:52:20.447975+0000","last_peered":"2023-12-24T19:52:20.447975+0000","last_clean":"2023-12-24T19:52:20.447975+0000","last_became_active":"2023-12-24T19:52:20.441556+0000","last_became_peered":"2023-12-24T19:52:20.441556+0000","last_unstale":"2023-12-24T19:52:20.447975+0000","last_undegraded":"2023-12-24T19:52:20.447975+0000","last_fullsized":"2023-12-24T19:52:20.447975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:55.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.455801+0000","last_change":"2023-12-24T19:52:20.452893+0000","last_active":"2023-12-24T19:52:20.455801+0000","last_peered":"2023-12-24T19:52:20.455801+0000","last_clean":"2023-12-24T19:52:20.455801+0000","last_became_active":"2023-12-24T19:52:20.452580+0000","last_became_peered":"2023-12-24T19:52:20.452580+0000","last_unstale":"2023-12-24T19:52:20.455801+0000","last_undegraded":"2023-12-24T19:52:20.455801+0000","last_fullsized":"2023-12-24T19:52:20.455801+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461274+0000","last_change":"2023-12-24T19:52:20.455969+0000","last_active":"2023-12-24T19:52:20.461274+0000","last_peered":"2023-12-24T19:52:20.461274+0000","last_clean":"2023-12-24T19:52:20.461274+0000","last_became_active":"2023-12-24T19:52:20.455612+0000","last_became_peered":"2023-12-24T19:52:20.455612+0000","last_unstale":"2023-12-24T19:52:20.461274+0000","last_undegraded":"2023-12-24T19:52:20.461274+0000","last_fullsized":"2023-12-24T19:52:20.461274+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460195+0000","last_change":"2023-12-24T19:52:20.453627+0000","last_active":"2023-12-24T19:52:20.460195+0000","last_peered":"2023-12-24T19:52:20.460195+0000","last_clean":"2023-12-24T19:52:20.460195+0000","last_became_active":"2023-12-24T19:52:20.453325+0000","last_became_peered":"2023-12-24T19:52:20.453325+0000","last_unstale":"2023-12-24T19:52:20.460195+0000","last_undegraded":"2023-12-24T19:52:20.460195+0000","last_fullsized":"2023-12-24T19:52:20.460195+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:16.280463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451237+0000","last_change":"2023-12-24T19:52:20.446017+0000","last_active":"2023-12-24T19:52:20.451237+0000","last_peered":"2023-12-24T19:52:20.451237+0000","last_clean":"2023-12-24T19:52:20.451237+0000","last_became_active":"2023-12-24T19:52:20.445707+0000","last_became_peered":"2023-12-24T19:52:20.445707+0000","last_unstale":"2023-12-24T19:52:20.451237+0000","last_undegraded":"2023-12-24T19:52:20.451237+0000","last_fullsized":"2023-12-24T19:52:20.451237+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:12.061233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461154+0000","last_change":"2023-12-24T19:52:20.458277+0000","last_active":"2023-12-24T19:52:20.461154+0000","last_peered":"2023-12-24T19:52:20.461154+0000","last_clean":"2023-12-24T19:52:20.461154+0000","last_became_active":"2023-12-24T19:52:20.457928+0000","last_became_peered":"2023-12-24T19:52:20.457928+0000","last_unstale":"2023-12-24T19:52:20.461154+0000","last_undegraded":"2023-12-24T19:52:20.461154+0000","last_fullsized":"2023-12-24T19:52:20.461154+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:44.881698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451836+0000","last_change":"2023-12-24T19:52:20.444756+0000","last_active":"2023-12-24T19:52:20.451836+0000","last_peered":"2023-12-24T19:52:20.451836+0000","last_clean":"2023-12-24T19:52:20.451836+0000","last_became_active":"2023-12-24T19:52:20.444447+0000","last_became_peered":"2023-12-24T19:52:20.444447+0000","last_unstale":"2023-12-24T19:52:20.451836+0000","last_undegraded":"2023-12-24T19:52:20.451836+0000","last_fullsized":"2023-12-24T19:52:20.451836+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:24.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451303+0000","last_change":"2023-12-24T19:52:20.445807+0000","last_active":"2023-12-24T19:52:20.451303+0000","last_peered":"2023-12-24T19:52:20.451303+0000","last_clean":"2023-12-24T19:52:20.451303+0000","last_became_active":"2023-12-24T19:52:20.445159+0000","last_became_peered":"2023-12-24T19:52:20.445159+0000","last_unstale":"2023-12-24T19:52:20.451303+0000","last_undegraded":"2023-12-24T19:52:20.451303+0000","last_fullsized":"2023-12-24T19:52:20.451303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:12.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450513+0000","last_change":"2023-12-24T19:52:20.443523+0000","last_active":"2023-12-24T19:52:20.450513+0000","last_peered":"2023-12-24T19:52:20.450513+0000","last_clean":"2023-12-24T19:52:20.450513+0000","last_became_active":"2023-12-24T19:52:20.443257+0000","last_became_peered":"2023-12-24T19:52:20.443257+0000","last_unstale":"2023-12-24T19:52:20.450513+0000","last_undegraded":"2023-12-24T19:52:20.450513+0000","last_fullsized":"2023-12-24T19:52:20.450513+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:01.659865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459257+0000","last_change":"2023-12-24T19:52:20.454137+0000","last_active":"2023-12-24T19:52:20.459257+0000","last_peered":"2023-12-24T19:52:20.459257+0000","last_clean":"2023-12-24T19:52:20.459257+0000","last_became_active":"2023-12-24T19:52:20.453835+0000","last_became_peered":"2023-12-24T19:52:20.453835+0000","last_unstale":"2023-12-24T19:52:20.459257+0000","last_undegraded":"2023-12-24T19:52:20.459257+0000","last_fullsized":"2023-12-24T19:52:20.459257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448473+0000","last_change":"2023-12-24T19:52:20.443793+0000","last_active":"2023-12-24T19:52:20.448473+0000","last_peered":"2023-12-24T19:52:20.448473+0000","last_clean":"2023-12-24T19:52:20.448473+0000","last_became_active":"2023-12-24T19:52:20.443041+0000","last_became_peered":"2023-12-24T19:52:20.443041+0000","last_unstale":"2023-12-24T19:52:20.448473+0000","last_undegraded":"2023-12-24T19:52:20.448473+0000","last_fullsized":"2023-12-24T19:52:20.448473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:13.176005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452525+0000","last_change":"2023-12-24T19:52:20.445004+0000","last_active":"2023-12-24T19:52:20.452525+0000","last_peered":"2023-12-24T19:52:20.452525+0000","last_clean":"2023-12-24T19:52:20.452525+0000","last_became_active":"2023-12-24T19:52:20.444719+0000","last_became_peered":"2023-12-24T19:52:20.444719+0000","last_unstale":"2023-12-24T19:52:20.452525+0000","last_undegraded":"2023-12-24T19:52:20.452525+0000","last_fullsized":"2023-12-24T19:52:20.452525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:58:17.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462223+0000","last_change":"2023-12-24T19:52:20.461262+0000","last_active":"2023-12-24T19:52:20.462223+0000","last_peered":"2023-12-24T19:52:20.462223+0000","last_clean":"2023-12-24T19:52:20.462223+0000","last_became_active":"2023-12-24T19:52:20.460637+0000","last_became_peered":"2023-12-24T19:52:20.460637+0000","last_unstale":"2023-12-24T19:52:20.462223+0000","last_undegraded":"2023-12-24T19:52:20.462223+0000","last_fullsized":"2023-12-24T19:52:20.462223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:51.651125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459144+0000","last_change":"2023-12-24T19:52:20.454330+0000","last_active":"2023-12-24T19:52:20.459144+0000","last_peered":"2023-12-24T19:52:20.459144+0000","last_clean":"2023-12-24T19:52:20.459144+0000","last_became_active":"2023-12-24T19:52:20.453787+0000","last_became_peered":"2023-12-24T19:52:20.453787+0000","last_unstale":"2023-12-24T19:52:20.459144+0000","last_undegraded":"2023-12-24T19:52:20.459144+0000","last_fullsized":"2023-12-24T19:52:20.459144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:31.843112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459505+0000","last_change":"2023-12-24T19:52:20.457538+0000","last_active":"2023-12-24T19:52:20.459505+0000","last_peered":"2023-12-24T19:52:20.459505+0000","last_clean":"2023-12-24T19:52:20.459505+0000","last_became_active":"2023-12-24T19:52:20.455869+0000","last_became_peered":"2023-12-24T19:52:20.455869+0000","last_unstale":"2023-12-24T19:52:20.459505+0000","last_undegraded":"2023-12-24T19:52:20.459505+0000","last_fullsized":"2023-12-24T19:52:20.459505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460391+0000","last_change":"2023-12-24T19:52:20.454224+0000","last_active":"2023-12-24T19:52:20.460391+0000","last_peered":"2023-12-24T19:52:20.460391+0000","last_clean":"2023-12-24T19:52:20.460391+0000","last_became_active":"2023-12-24T19:52:20.453928+0000","last_became_peered":"2023-12-24T19:52:20.453928+0000","last_unstale":"2023-12-24T19:52:20.460391+0000","last_undegraded":"2023-12-24T19:52:20.460391+0000","last_fullsized":"2023-12-24T19:52:20.460391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:14.133011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456105+0000","last_change":"2023-12-24T19:52:20.452399+0000","last_active":"2023-12-24T19:52:20.456105+0000","last_peered":"2023-12-24T19:52:20.456105+0000","last_clean":"2023-12-24T19:52:20.456105+0000","last_became_active":"2023-12-24T19:52:20.452126+0000","last_became_peered":"2023-12-24T19:52:20.452126+0000","last_unstale":"2023-12-24T19:52:20.456105+0000","last_undegraded":"2023-12-24T19:52:20.456105+0000","last_fullsized":"2023-12-24T19:52:20.456105+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461009+0000","last_change":"2023-12-24T19:52:20.453088+0000","last_active":"2023-12-24T19:52:20.461009+0000","last_peered":"2023-12-24T19:52:20.461009+0000","last_clean":"2023-12-24T19:52:20.461009+0000","last_became_active":"2023-12-24T19:52:20.452800+0000","last_became_peered":"2023-12-24T19:52:20.452800+0000","last_unstale":"2023-12-24T19:52:20.461009+0000","last_undegraded":"2023-12-24T19:52:20.461009+0000","last_fullsized":"2023-12-24T19:52:20.461009+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452095+0000","last_change":"2023-12-24T19:52:20.451037+0000","last_active":"2023-12-24T19:52:20.452095+0000","last_peered":"2023-12-24T19:52:20.452095+0000","last_clean":"2023-12-24T19:52:20.452095+0000","last_became_active":"2023-12-24T19:52:20.447988+0000","last_became_peered":"2023-12-24T19:52:20.447988+0000","last_unstale":"2023-12-24T19:52:20.452095+0000","last_undegraded":"2023-12-24T19:52:20.452095+0000","last_fullsized":"2023-12-24T19:52:20.452095+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:14.647509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452788+0000","last_change":"2023-12-24T19:52:20.449142+0000","last_active":"2023-12-24T19:52:20.452788+0000","last_peered":"2023-12-24T19:52:20.452788+0000","last_clean":"2023-12-24T19:52:20.452788+0000","last_became_active":"2023-12-24T19:52:20.448862+0000","last_became_peered":"2023-12-24T19:52:20.448862+0000","last_unstale":"2023-12-24T19:52:20.452788+0000","last_undegraded":"2023-12-24T19:52:20.452788+0000","last_fullsized":"2023-12-24T19:52:20.452788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454205+0000","last_change":"2023-12-24T19:52:20.448620+0000","last_active":"2023-12-24T19:52:20.454205+0000","last_peered":"2023-12-24T19:52:20.454205+0000","last_clean":"2023-12-24T19:52:20.454205+0000","last_became_active":"2023-12-24T19:52:20.448333+0000","last_became_peered":"2023-12-24T19:52:20.448333+0000","last_unstale":"2023-12-24T19:52:20.454205+0000","last_undegraded":"2023-12-24T19:52:20.454205+0000","last_fullsized":"2023-12-24T19:52:20.454205+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460509+0000","last_change":"2023-12-24T19:52:20.455597+0000","last_active":"2023-12-24T19:52:20.460509+0000","last_peered":"2023-12-24T19:52:20.460509+0000","last_clean":"2023-12-24T19:52:20.460509+0000","last_became_active":"2023-12-24T19:52:20.455312+0000","last_became_peered":"2023-12-24T19:52:20.455312+0000","last_unstale":"2023-12-24T19:52:20.460509+0000","last_undegraded":"2023-12-24T19:52:20.460509+0000","last_fullsized":"2023-12-24T19:52:20.460509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.335033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454609+0000","last_change":"2023-12-24T19:52:20.448896+0000","last_active":"2023-12-24T19:52:20.454609+0000","last_peered":"2023-12-24T19:52:20.454609+0000","last_clean":"2023-12-24T19:52:20.454609+0000","last_became_active":"2023-12-24T19:52:20.448596+0000","last_became_peered":"2023-12-24T19:52:20.448596+0000","last_unstale":"2023-12-24T19:52:20.454609+0000","last_undegraded":"2023-12-24T19:52:20.454609+0000","last_fullsized":"2023-12-24T19:52:20.454609+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:40.214594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457765+0000","last_change":"2023-12-24T19:52:20.446613+0000","last_active":"2023-12-24T19:52:20.457765+0000","last_peered":"2023-12-24T19:52:20.457765+0000","last_clean":"2023-12-24T19:52:20.457765+0000","last_became_active":"2023-12-24T19:52:20.445627+0000","last_became_peered":"2023-12-24T19:52:20.445627+0000","last_unstale":"2023-12-24T19:52:20.457765+0000","last_undegraded":"2023-12-24T19:52:20.457765+0000","last_fullsized":"2023-12-24T19:52:20.457765+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:20.374263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458502+0000","last_change":"2023-12-24T19:52:20.454043+0000","last_active":"2023-12-24T19:52:20.458502+0000","last_peered":"2023-12-24T19:52:20.458502+0000","last_clean":"2023-12-24T19:52:20.458502+0000","last_became_active":"2023-12-24T19:52:20.453310+0000","last_became_peered":"2023-12-24T19:52:20.453310+0000","last_unstale":"2023-12-24T19:52:20.458502+0000","last_undegraded":"2023-12-24T19:52:20.458502+0000","last_fullsized":"2023-12-24T19:52:20.458502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:46.948625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453843+0000","last_change":"2023-12-24T19:52:20.447630+0000","last_active":"2023-12-24T19:52:20.453843+0000","last_peered":"2023-12-24T19:52:20.453843+0000","last_clean":"2023-12-24T19:52:20.453843+0000","last_became_active":"2023-12-24T19:52:20.447340+0000","last_became_peered":"2023-12-24T19:52:20.447340+0000","last_unstale":"2023-12-24T19:52:20.453843+0000","last_undegraded":"2023-12-24T19:52:20.453843+0000","last_fullsized":"2023-12-24T19:52:20.453843+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:55.756326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461303+0000","last_change":"2023-12-24T19:52:20.456138+0000","last_active":"2023-12-24T19:52:20.461303+0000","last_peered":"2023-12-24T19:52:20.461303+0000","last_clean":"2023-12-24T19:52:20.461303+0000","last_became_active":"2023-12-24T19:52:20.455839+0000","last_became_peered":"2023-12-24T19:52:20.455839+0000","last_unstale":"2023-12-24T19:52:20.461303+0000","last_undegraded":"2023-12-24T19:52:20.461303+0000","last_fullsized":"2023-12-24T19:52:20.461303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459944+0000","last_change":"2023-12-24T19:52:20.454623+0000","last_active":"2023-12-24T19:52:20.459944+0000","last_peered":"2023-12-24T19:52:20.459944+0000","last_clean":"2023-12-24T19:52:20.459944+0000","last_became_active":"2023-12-24T19:52:20.452078+0000","last_became_peered":"2023-12-24T19:52:20.452078+0000","last_unstale":"2023-12-24T19:52:20.459944+0000","last_undegraded":"2023-12-24T19:52:20.459944+0000","last_fullsized":"2023-12-24T19:52:20.459944+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:54.274863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654262+0000","last_change":"2023-12-24T19:52:19.623289+0000","last_active":"2023-12-24T19:52:20.654262+0000","last_peered":"2023-12-24T19:52:20.654262+0000","last_clean":"2023-12-24T19:52:20.654262+0000","last_became_active":"2023-12-24T19:52:19.622982+0000","last_became_peered":"2023-12-24T19:52:19.622982+0000","last_unstale":"2023-12-24T19:52:20.654262+0000","last_undegraded":"2023-12-24T19:52:20.654262+0000","last_fullsized":"2023-12-24T19:52:20.654262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:38.006004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460291+0000","last_change":"2023-12-24T19:52:20.456568+0000","last_active":"2023-12-24T19:52:20.460291+0000","last_peered":"2023-12-24T19:52:20.460291+0000","last_clean":"2023-12-24T19:52:20.460291+0000","last_became_active":"2023-12-24T19:52:20.454058+0000","last_became_peered":"2023-12-24T19:52:20.454058+0000","last_unstale":"2023-12-24T19:52:20.460291+0000","last_undegraded":"2023-12-24T19:52:20.460291+0000","last_fullsized":"2023-12-24T19:52:20.460291+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:39.019576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656135+0000","last_change":"2023-12-24T19:52:19.634248+0000","last_active":"2023-12-24T19:52:20.656135+0000","last_peered":"2023-12-24T19:52:20.656135+0000","last_clean":"2023-12-24T19:52:20.656135+0000","last_became_active":"2023-12-24T19:52:19.633957+0000","last_became_peered":"2023-12-24T19:52:19.633957+0000","last_unstale":"2023-12-24T19:52:20.656135+0000","last_undegraded":"2023-12-24T19:52:20.656135+0000","last_fullsized":"2023-12-24T19:52:20.656135+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:43.556087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459716+0000","last_change":"2023-12-24T19:52:20.450176+0000","last_active":"2023-12-24T19:52:20.459716+0000","last_peered":"2023-12-24T19:52:20.459716+0000","last_clean":"2023-12-24T19:52:20.459716+0000","last_became_active":"2023-12-24T19:52:20.449883+0000","last_became_peered":"2023-12-24T19:52:20.449883+0000","last_unstale":"2023-12-24T19:52:20.459716+0000","last_undegraded":"2023-12-24T19:52:20.459716+0000","last_fullsized":"2023-12-24T19:52:20.459716+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:58.694109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656262+0000","last_change":"2023-12-24T19:52:19.633188+0000","last_active":"2023-12-24T19:52:20.656262+0000","last_peered":"2023-12-24T19:52:20.656262+0000","last_clean":"2023-12-24T19:52:20.656262+0000","last_became_active":"2023-12-24T19:52:19.632814+0000","last_became_peered":"2023-12-24T19:52:19.632814+0000","last_unstale":"2023-12-24T19:52:20.656262+0000","last_undegraded":"2023-12-24T19:52:20.656262+0000","last_fullsized":"2023-12-24T19:52:20.656262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:22:34.743736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461517+0000","last_change":"2023-12-24T19:52:20.455845+0000","last_active":"2023-12-24T19:52:20.461517+0000","last_peered":"2023-12-24T19:52:20.461517+0000","last_clean":"2023-12-24T19:52:20.461517+0000","last_became_active":"2023-12-24T19:52:20.455513+0000","last_became_peered":"2023-12-24T19:52:20.455513+0000","last_unstale":"2023-12-24T19:52:20.461517+0000","last_undegraded":"2023-12-24T19:52:20.461517+0000","last_fullsized":"2023-12-24T19:52:20.461517+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:33.303221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657449+0000","last_change":"2023-12-24T19:52:19.633282+0000","last_active":"2023-12-24T19:52:20.657449+0000","last_peered":"2023-12-24T19:52:20.657449+0000","last_clean":"2023-12-24T19:52:20.657449+0000","last_became_active":"2023-12-24T19:52:19.632977+0000","last_became_peered":"2023-12-24T19:52:19.632977+0000","last_unstale":"2023-12-24T19:52:20.657449+0000","last_undegraded":"2023-12-24T19:52:20.657449+0000","last_fullsized":"2023-12-24T19:52:20.657449+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:21.316376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457315+0000","last_change":"2023-12-24T19:52:20.454913+0000","last_active":"2023-12-24T19:52:20.457315+0000","last_peered":"2023-12-24T19:52:20.457315+0000","last_clean":"2023-12-24T19:52:20.457315+0000","last_became_active":"2023-12-24T19:52:20.454515+0000","last_became_peered":"2023-12-24T19:52:20.454515+0000","last_unstale":"2023-12-24T19:52:20.457315+0000","last_undegraded":"2023-12-24T19:52:20.457315+0000","last_fullsized":"2023-12-24T19:52:20.457315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655687+0000","last_change":"2023-12-24T19:52:19.632234+0000","last_active":"2023-12-24T19:52:20.655687+0000","last_peered":"2023-12-24T19:52:20.655687+0000","last_clean":"2023-12-24T19:52:20.655687+0000","last_became_active":"2023-12-24T19:52:19.631043+0000","last_became_peered":"2023-12-24T19:52:19.631043+0000","last_unstale":"2023-12-24T19:52:20.655687+0000","last_undegraded":"2023-12-24T19:52:20.655687+0000","last_fullsized":"2023-12-24T19:52:20.655687+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452144+0000","last_change":"2023-12-24T19:52:20.446043+0000","last_active":"2023-12-24T19:52:20.452144+0000","last_peered":"2023-12-24T19:52:20.452144+0000","last_clean":"2023-12-24T19:52:20.452144+0000","last_became_active":"2023-12-24T19:52:20.445753+0000","last_became_peered":"2023-12-24T19:52:20.445753+0000","last_unstale":"2023-12-24T19:52:20.452144+0000","last_undegraded":"2023-12-24T19:52:20.452144+0000","last_fullsized":"2023-12-24T19:52:20.452144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:03:46.910747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654431+0000","last_change":"2023-12-24T19:52:19.611715+0000","last_active":"2023-12-24T19:52:20.654431+0000","last_peered":"2023-12-24T19:52:20.654431+0000","last_clean":"2023-12-24T19:52:20.654431+0000","last_became_active":"2023-12-24T19:52:19.611384+0000","last_became_peered":"2023-12-24T19:52:19.611384+0000","last_unstale":"2023-12-24T19:52:20.654431+0000","last_undegraded":"2023-12-24T19:52:20.654431+0000","last_fullsized":"2023-12-24T19:52:20.654431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456851+0000","last_change":"2023-12-24T19:52:20.447681+0000","last_active":"2023-12-24T19:52:20.456851+0000","last_peered":"2023-12-24T19:52:20.456851+0000","last_clean":"2023-12-24T19:52:20.456851+0000","last_became_active":"2023-12-24T19:52:20.447098+0000","last_became_peered":"2023-12-24T19:52:20.447098+0000","last_unstale":"2023-12-24T19:52:20.456851+0000","last_undegraded":"2023-12-24T19:52:20.456851+0000","last_fullsized":"2023-12-24T19:52:20.456851+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:20.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431505+0000","last_change":"2023-12-24T19:52:19.624503+0000","last_active":"2023-12-24T19:52:20.431505+0000","last_peered":"2023-12-24T19:52:20.431505+0000","last_clean":"2023-12-24T19:52:20.431505+0000","last_became_active":"2023-12-24T19:52:19.621123+0000","last_became_peered":"2023-12-24T19:52:19.621123+0000","last_unstale":"2023-12-24T19:52:20.431505+0000","last_undegraded":"2023-12-24T19:52:20.431505+0000","last_fullsized":"2023-12-24T19:52:20.431505+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447519+0000","last_change":"2023-12-24T19:52:20.442294+0000","last_active":"2023-12-24T19:52:20.447519+0000","last_peered":"2023-12-24T19:52:20.447519+0000","last_clean":"2023-12-24T19:52:20.447519+0000","last_became_active":"2023-12-24T19:52:20.440941+0000","last_became_peered":"2023-12-24T19:52:20.440941+0000","last_unstale":"2023-12-24T19:52:20.447519+0000","last_undegraded":"2023-12-24T19:52:20.447519+0000","last_fullsized":"2023-12-24T19:52:20.447519+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.427537+0000","last_change":"2023-12-24T19:52:19.616328+0000","last_active":"2023-12-24T19:52:20.427537+0000","last_peered":"2023-12-24T19:52:20.427537+0000","last_clean":"2023-12-24T19:52:20.427537+0000","last_became_active":"2023-12-24T19:52:19.615974+0000","last_became_peered":"2023-12-24T19:52:19.615974+0000","last_unstale":"2023-12-24T19:52:20.427537+0000","last_undegraded":"2023-12-24T19:52:20.427537+0000","last_fullsized":"2023-12-24T19:52:20.427537+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:19.747414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460083+0000","last_change":"2023-12-24T19:52:20.450938+0000","last_active":"2023-12-24T19:52:20.460083+0000","last_peered":"2023-12-24T19:52:20.460083+0000","last_clean":"2023-12-24T19:52:20.460083+0000","last_became_active":"2023-12-24T19:52:20.450191+0000","last_became_peered":"2023-12-24T19:52:20.450191+0000","last_unstale":"2023-12-24T19:52:20.460083+0000","last_undegraded":"2023-12-24T19:52:20.460083+0000","last_fullsized":"2023-12-24T19:52:20.460083+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.443081+0000","last_change":"2023-12-24T19:52:19.630938+0000","last_active":"2023-12-24T19:52:20.443081+0000","last_peered":"2023-12-24T19:52:20.443081+0000","last_clean":"2023-12-24T19:52:20.443081+0000","last_became_active":"2023-12-24T19:52:19.630659+0000","last_became_peered":"2023-12-24T19:52:19.630659+0000","last_unstale":"2023-12-24T19:52:20.443081+0000","last_undegraded":"2023-12-24T19:52:20.443081+0000","last_fullsized":"2023-12-24T19:52:20.443081+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:27:59.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461129+0000","last_change":"2023-12-24T19:52:20.456394+0000","last_active":"2023-12-24T19:52:20.461129+0000","last_peered":"2023-12-24T19:52:20.461129+0000","last_clean":"2023-12-24T19:52:20.461129+0000","last_became_active":"2023-12-24T19:52:20.456077+0000","last_became_peered":"2023-12-24T19:52:20.456077+0000","last_unstale":"2023-12-24T19:52:20.461129+0000","last_undegraded":"2023-12-24T19:52:20.461129+0000","last_fullsized":"2023-12-24T19:52:20.461129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:05.733503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432888+0000","last_change":"2023-12-24T19:52:19.621239+0000","last_active":"2023-12-24T19:52:20.432888+0000","last_peered":"2023-12-24T19:52:20.432888+0000","last_clean":"2023-12-24T19:52:20.432888+0000","last_became_active":"2023-12-24T19:52:19.620920+0000","last_became_peered":"2023-12-24T19:52:19.620920+0000","last_unstale":"2023-12-24T19:52:20.432888+0000","last_undegraded":"2023-12-24T19:52:20.432888+0000","last_fullsized":"2023-12-24T19:52:20.432888+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:15.794978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461881+0000","last_change":"2023-12-24T19:52:20.460401+0000","last_active":"2023-12-24T19:52:20.461881+0000","last_peered":"2023-12-24T19:52:20.461881+0000","last_clean":"2023-12-24T19:52:20.461881+0000","last_became_active":"2023-12-24T19:52:20.459388+0000","last_became_peered":"2023-12-24T19:52:20.459388+0000","last_unstale":"2023-12-24T19:52:20.461881+0000","last_undegraded":"2023-12-24T19:52:20.461881+0000","last_fullsized":"2023-12-24T19:52:20.461881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:15.273424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654277+0000","last_change":"2023-12-24T19:52:19.622874+0000","last_active":"2023-12-24T19:52:20.654277+0000","last_peered":"2023-12-24T19:52:20.654277+0000","last_clean":"2023-12-24T19:52:20.654277+0000","last_became_active":"2023-12-24T19:52:19.622556+0000","last_became_peered":"2023-12-24T19:52:19.622556+0000","last_unstale":"2023-12-24T19:52:20.654277+0000","last_undegraded":"2023-12-24T19:52:20.654277+0000","last_fullsized":"2023-12-24T19:52:20.654277+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:18.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460225+0000","last_change":"2023-12-24T19:52:20.452626+0000","last_active":"2023-12-24T19:52:20.460225+0000","last_peered":"2023-12-24T19:52:20.460225+0000","last_clean":"2023-12-24T19:52:20.460225+0000","last_became_active":"2023-12-24T19:52:20.452360+0000","last_became_peered":"2023-12-24T19:52:20.452360+0000","last_unstale":"2023-12-24T19:52:20.460225+0000","last_undegraded":"2023-12-24T19:52:20.460225+0000","last_fullsized":"2023-12-24T19:52:20.460225+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.653976+0000","last_change":"2023-12-24T19:52:19.624741+0000","last_active":"2023-12-24T19:52:20.653976+0000","last_peered":"2023-12-24T19:52:20.653976+0000","last_clean":"2023-12-24T19:52:20.653976+0000","last_became_active":"2023-12-24T19:52:19.624434+0000","last_became_peered":"2023-12-24T19:52:19.624434+0000","last_unstale":"2023-12-24T19:52:20.653976+0000","last_undegraded":"2023-12-24T19:52:20.653976+0000","last_fullsized":"2023-12-24T19:52:20.653976+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.261291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459145+0000","last_change":"2023-12-24T19:52:20.453516+0000","last_active":"2023-12-24T19:52:20.459145+0000","last_peered":"2023-12-24T19:52:20.459145+0000","last_clean":"2023-12-24T19:52:20.459145+0000","last_became_active":"2023-12-24T19:52:20.451417+0000","last_became_peered":"2023-12-24T19:52:20.451417+0000","last_unstale":"2023-12-24T19:52:20.459145+0000","last_undegraded":"2023-12-24T19:52:20.459145+0000","last_fullsized":"2023-12-24T19:52:20.459145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:04.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432113+0000","last_change":"2023-12-24T19:52:19.630613+0000","last_active":"2023-12-24T19:52:20.432113+0000","last_peered":"2023-12-24T19:52:20.432113+0000","last_clean":"2023-12-24T19:52:20.432113+0000","last_became_active":"2023-12-24T19:52:19.629741+0000","last_became_peered":"2023-12-24T19:52:19.629741+0000","last_unstale":"2023-12-24T19:52:20.432113+0000","last_undegraded":"2023-12-24T19:52:20.432113+0000","last_fullsized":"2023-12-24T19:52:20.432113+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:30.807470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447996+0000","last_change":"2023-12-24T19:52:20.442555+0000","last_active":"2023-12-24T19:52:20.447996+0000","last_peered":"2023-12-24T19:52:20.447996+0000","last_clean":"2023-12-24T19:52:20.447996+0000","last_became_active":"2023-12-24T19:52:20.441968+0000","last_became_peered":"2023-12-24T19:52:20.441968+0000","last_unstale":"2023-12-24T19:52:20.447996+0000","last_undegraded":"2023-12-24T19:52:20.447996+0000","last_fullsized":"2023-12-24T19:52:20.447996+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:12:06.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.430392+0000","last_change":"2023-12-24T19:52:19.620713+0000","last_active":"2023-12-24T19:52:20.430392+0000","last_peered":"2023-12-24T19:52:20.430392+0000","last_clean":"2023-12-24T19:52:20.430392+0000","last_became_active":"2023-12-24T19:52:19.620417+0000","last_became_peered":"2023-12-24T19:52:19.620417+0000","last_unstale":"2023-12-24T19:52:20.430392+0000","last_undegraded":"2023-12-24T19:52:20.430392+0000","last_fullsized":"2023-12-24T19:52:20.430392+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:10.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453924+0000","last_change":"2023-12-24T19:52:20.448884+0000","last_active":"2023-12-24T19:52:20.453924+0000","last_peered":"2023-12-24T19:52:20.453924+0000","last_clean":"2023-12-24T19:52:20.453924+0000","last_became_active":"2023-12-24T19:52:20.448606+0000","last_became_peered":"2023-12-24T19:52:20.448606+0000","last_unstale":"2023-12-24T19:52:20.453924+0000","last_undegraded":"2023-12-24T19:52:20.453924+0000","last_fullsized":"2023-12-24T19:52:20.453924+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:59.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"172'8","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657177+0000","last_change":"2023-12-24T19:52:19.628126+0000","last_active":"2023-12-24T19:52:20.657177+0000","last_peered":"2023-12-24T19:52:20.657177+0000","last_clean":"2023-12-24T19:52:20.657177+0000","last_became_active":"2023-12-24T19:52:19.627819+0000","last_became_peered":"2023-12-24T19:52:19.627819+0000","last_unstale":"2023-12-24T19:52:20.657177+0000","last_undegraded":"2023-12-24T19:52:20.657177+0000","last_fullsized":"2023-12-24T19:52:20.657177+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:02.367913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459171+0000","last_change":"2023-12-24T19:52:20.454460+0000","last_active":"2023-12-24T19:52:20.459171+0000","last_peered":"2023-12-24T19:52:20.459171+0000","last_clean":"2023-12-24T19:52:20.459171+0000","last_became_active":"2023-12-24T19:52:20.451670+0000","last_became_peered":"2023-12-24T19:52:20.451670+0000","last_unstale":"2023-12-24T19:52:20.459171+0000","last_undegraded":"2023-12-24T19:52:20.459171+0000","last_fullsized":"2023-12-24T19:52:20.459171+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:59.000317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.649070+0000","last_change":"2023-12-24T19:52:19.627728+0000","last_active":"2023-12-24T19:52:20.649070+0000","last_peered":"2023-12-24T19:52:20.649070+0000","last_clean":"2023-12-24T19:52:20.649070+0000","last_became_active":"2023-12-24T19:52:19.627339+0000","last_became_peered":"2023-12-24T19:52:19.627339+0000","last_unstale":"2023-12-24T19:52:20.649070+0000","last_undegraded":"2023-12-24T19:52:20.649070+0000","last_fullsized":"2023-12-24T19:52:20.649070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:25.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462295+0000","last_change":"2023-12-24T19:52:20.458871+0000","last_active":"2023-12-24T19:52:20.462295+0000","last_peered":"2023-12-24T19:52:20.462295+0000","last_clean":"2023-12-24T19:52:20.462295+0000","last_became_active":"2023-12-24T19:52:20.458565+0000","last_became_peered":"2023-12-24T19:52:20.458565+0000","last_unstale":"2023-12-24T19:52:20.462295+0000","last_undegraded":"2023-12-24T19:52:20.462295+0000","last_fullsized":"2023-12-24T19:52:20.462295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:29.327761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655058+0000","last_change":"2023-12-24T19:52:19.630356+0000","last_active":"2023-12-24T19:52:20.655058+0000","last_peered":"2023-12-24T19:52:20.655058+0000","last_clean":"2023-12-24T19:52:20.655058+0000","last_became_active":"2023-12-24T19:52:19.630066+0000","last_became_peered":"2023-12-24T19:52:19.630066+0000","last_unstale":"2023-12-24T19:52:20.655058+0000","last_undegraded":"2023-12-24T19:52:20.655058+0000","last_fullsized":"2023-12-24T19:52:20.655058+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:15.266891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461544+0000","last_change":"2023-12-24T19:52:20.453710+0000","last_active":"2023-12-24T19:52:20.461544+0000","last_peered":"2023-12-24T19:52:20.461544+0000","last_clean":"2023-12-24T19:52:20.461544+0000","last_became_active":"2023-12-24T19:52:20.453383+0000","last_became_peered":"2023-12-24T19:52:20.453383+0000","last_unstale":"2023-12-24T19:52:20.461544+0000","last_undegraded":"2023-12-24T19:52:20.461544+0000","last_fullsized":"2023-12-24T19:52:20.461544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656007+0000","last_change":"2023-12-24T19:52:19.620872+0000","last_active":"2023-12-24T19:52:20.656007+0000","last_peered":"2023-12-24T19:52:20.656007+0000","last_clean":"2023-12-24T19:52:20.656007+0000","last_became_active":"2023-12-24T19:52:19.620309+0000","last_became_peered":"2023-12-24T19:52:19.620309+0000","last_unstale":"2023-12-24T19:52:20.656007+0000","last_undegraded":"2023-12-24T19:52:20.656007+0000","last_fullsized":"2023-12-24T19:52:20.656007+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:51.207604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453004+0000","last_change":"2023-12-24T19:52:20.450309+0000","last_active":"2023-12-24T19:52:20.453004+0000","last_peered":"2023-12-24T19:52:20.453004+0000","last_clean":"2023-12-24T19:52:20.453004+0000","last_became_active":"2023-12-24T19:52:20.450015+0000","last_became_peered":"2023-12-24T19:52:20.450015+0000","last_unstale":"2023-12-24T19:52:20.453004+0000","last_undegraded":"2023-12-24T19:52:20.453004+0000","last_fullsized":"2023-12-24T19:52:20.453004+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431176+0000","last_change":"2023-12-24T19:52:19.618844+0000","last_active":"2023-12-24T19:52:20.431176+0000","last_peered":"2023-12-24T19:52:20.431176+0000","last_clean":"2023-12-24T19:52:20.431176+0000","last_became_active":"2023-12-24T19:52:19.618517+0000","last_became_peered":"2023-12-24T19:52:19.618517+0000","last_unstale":"2023-12-24T19:52:20.431176+0000","last_undegraded":"2023-12-24T19:52:20.431176+0000","last_fullsized":"2023-12-24T19:52:20.431176+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:54.036031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458951+0000","last_change":"2023-12-24T19:52:20.453723+0000","last_active":"2023-12-24T19:52:20.458951+0000","last_peered":"2023-12-24T19:52:20.458951+0000","last_clean":"2023-12-24T19:52:20.458951+0000","last_became_active":"2023-12-24T19:52:20.450871+0000","last_became_peered":"2023-12-24T19:52:20.450871+0000","last_unstale":"2023-12-24T19:52:20.458951+0000","last_undegraded":"2023-12-24T19:52:20.458951+0000","last_fullsized":"2023-12-24T19:52:20.458951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:00.502880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657358+0000","last_change":"2023-12-24T19:52:19.633736+0000","last_active":"2023-12-24T19:52:20.657358+0000","last_peered":"2023-12-24T19:52:20.657358+0000","last_clean":"2023-12-24T19:52:20.657358+0000","last_became_active":"2023-12-24T19:52:19.633345+0000","last_became_peered":"2023-12-24T19:52:19.633345+0000","last_unstale":"2023-12-24T19:52:20.657358+0000","last_undegraded":"2023-12-24T19:52:20.657358+0000","last_fullsized":"2023-12-24T19:52:20.657358+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:58.575838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460350+0000","last_change":"2023-12-24T19:52:20.458023+0000","last_active":"2023-12-24T19:52:20.460350+0000","last_peered":"2023-12-24T19:52:20.460350+0000","last_clean":"2023-12-24T19:52:20.460350+0000","last_became_active":"2023-12-24T19:52:20.455936+0000","last_became_peered":"2023-12-24T19:52:20.455936+0000","last_unstale":"2023-12-24T19:52:20.460350+0000","last_undegraded":"2023-12-24T19:52:20.460350+0000","last_fullsized":"2023-12-24T19:52:20.460350+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:23.400292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.438646+0000","last_change":"2023-12-24T19:52:19.622235+0000","last_active":"2023-12-24T19:52:20.438646+0000","last_peered":"2023-12-24T19:52:20.438646+0000","last_clean":"2023-12-24T19:52:20.438646+0000","last_became_active":"2023-12-24T19:52:19.621726+0000","last_became_peered":"2023-12-24T19:52:19.621726+0000","last_unstale":"2023-12-24T19:52:20.438646+0000","last_undegraded":"2023-12-24T19:52:20.438646+0000","last_fullsized":"2023-12-24T19:52:20.438646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:35.512788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452524+0000","last_change":"2023-12-24T19:52:20.451501+0000","last_active":"2023-12-24T19:52:20.452524+0000","last_peered":"2023-12-24T19:52:20.452524+0000","last_clean":"2023-12-24T19:52:20.452524+0000","last_became_active":"2023-12-24T19:52:20.450966+0000","last_became_peered":"2023-12-24T19:52:20.450966+0000","last_unstale":"2023-12-24T19:52:20.452524+0000","last_undegraded":"2023-12-24T19:52:20.452524+0000","last_fullsized":"2023-12-24T19:52:20.452524+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:18:26.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.441265+0000","last_change":"2023-12-24T19:52:19.632975+0000","last_active":"2023-12-24T19:52:20.441265+0000","last_peered":"2023-12-24T19:52:20.441265+0000","last_clean":"2023-12-24T19:52:20.441265+0000","last_became_active":"2023-12-24T19:52:19.632576+0000","last_became_peered":"2023-12-24T19:52:19.632576+0000","last_unstale":"2023-12-24T19:52:20.441265+0000","last_undegraded":"2023-12-24T19:52:20.441265+0000","last_fullsized":"2023-12-24T19:52:20.441265+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459058+0000","last_change":"2023-12-24T19:52:20.453540+0000","last_active":"2023-12-24T19:52:20.459058+0000","last_peered":"2023-12-24T19:52:20.459058+0000","last_clean":"2023-12-24T19:52:20.459058+0000","last_became_active":"2023-12-24T19:52:20.453229+0000","last_became_peered":"2023-12-24T19:52:20.453229+0000","last_unstale":"2023-12-24T19:52:20.459058+0000","last_undegraded":"2023-12-24T19:52:20.459058+0000","last_fullsized":"2023-12-24T19:52:20.459058+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:23:01.774161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440406+0000","last_change":"2023-12-24T19:52:19.624224+0000","last_active":"2023-12-24T19:52:20.440406+0000","last_peered":"2023-12-24T19:52:20.440406+0000","last_clean":"2023-12-24T19:52:20.440406+0000","last_became_active":"2023-12-24T19:52:19.623961+0000","last_became_peered":"2023-12-24T19:52:19.623961+0000","last_unstale":"2023-12-24T19:52:20.440406+0000","last_undegraded":"2023-12-24T19:52:20.440406+0000","last_fullsized":"2023-12-24T19:52:20.440406+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451574+0000","last_change":"2023-12-24T19:52:20.444774+0000","last_active":"2023-12-24T19:52:20.451574+0000","last_peered":"2023-12-24T19:52:20.451574+0000","last_clean":"2023-12-24T19:52:20.451574+0000","last_became_active":"2023-12-24T19:52:20.444394+0000","last_became_peered":"2023-12-24T19:52:20.444394+0000","last_unstale":"2023-12-24T19:52:20.451574+0000","last_undegraded":"2023-12-24T19:52:20.451574+0000","last_fullsized":"2023-12-24T19:52:20.451574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:51:44.742350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654018+0000","last_change":"2023-12-24T19:52:19.625698+0000","last_active":"2023-12-24T19:52:20.654018+0000","last_peered":"2023-12-24T19:52:20.654018+0000","last_clean":"2023-12-24T19:52:20.654018+0000","last_became_active":"2023-12-24T19:52:19.625400+0000","last_became_peered":"2023-12-24T19:52:19.625400+0000","last_unstale":"2023-12-24T19:52:20.654018+0000","last_undegraded":"2023-12-24T19:52:20.654018+0000","last_fullsized":"2023-12-24T19:52:20.654018+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:38.897775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448937+0000","last_change":"2023-12-24T19:52:20.442376+0000","last_active":"2023-12-24T19:52:20.448937+0000","last_peered":"2023-12-24T19:52:20.448937+0000","last_clean":"2023-12-24T19:52:20.448937+0000","last_became_active":"2023-12-24T19:52:20.442080+0000","last_became_peered":"2023-12-24T19:52:20.442080+0000","last_unstale":"2023-12-24T19:52:20.448937+0000","last_undegraded":"2023-12-24T19:52:20.448937+0000","last_fullsized":"2023-12-24T19:52:20.448937+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:35.207713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.433044+0000","last_change":"2023-12-24T19:52:19.630494+0000","last_active":"2023-12-24T19:52:20.433044+0000","last_peered":"2023-12-24T19:52:20.433044+0000","last_clean":"2023-12-24T19:52:20.433044+0000","last_became_active":"2023-12-24T19:52:19.630208+0000","last_became_peered":"2023-12-24T19:52:19.630208+0000","last_unstale":"2023-12-24T19:52:20.433044+0000","last_undegraded":"2023-12-24T19:52:20.433044+0000","last_fullsized":"2023-12-24T19:52:20.433044+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:00.646294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447593+0000","last_change":"2023-12-24T19:52:20.441690+0000","last_active":"2023-12-24T19:52:20.447593+0000","last_peered":"2023-12-24T19:52:20.447593+0000","last_clean":"2023-12-24T19:52:20.447593+0000","last_became_active":"2023-12-24T19:52:20.441401+0000","last_became_peered":"2023-12-24T19:52:20.441401+0000","last_unstale":"2023-12-24T19:52:20.447593+0000","last_undegraded":"2023-12-24T19:52:20.447593+0000","last_fullsized":"2023-12-24T19:52:20.447593+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:07.383658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.437347+0000","last_change":"2023-12-24T19:52:19.627158+0000","last_active":"2023-12-24T19:52:20.437347+0000","last_peered":"2023-12-24T19:52:20.437347+0000","last_clean":"2023-12-24T19:52:20.437347+0000","last_became_active":"2023-12-24T19:52:19.626853+0000","last_became_peered":"2023-12-24T19:52:19.626853+0000","last_unstale":"2023-12-24T19:52:20.437347+0000","last_undegraded":"2023-12-24T19:52:20.437347+0000","last_fullsized":"2023-12-24T19:52:20.437347+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:29:32.489540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449029+0000","last_change":"2023-12-24T19:52:20.444049+0000","last_active":"2023-12-24T19:52:20.449029+0000","last_peered":"2023-12-24T19:52:20.449029+0000","last_clean":"2023-12-24T19:52:20.449029+0000","last_became_active":"2023-12-24T19:52:20.443576+0000","last_became_peered":"2023-12-24T19:52:20.443576+0000","last_unstale":"2023-12-24T19:52:20.449029+0000","last_undegraded":"2023-12-24T19:52:20.449029+0000","last_fullsized":"2023-12-24T19:52:20.449029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:14.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.428803+0000","last_change":"2023-12-24T19:52:19.627426+0000","last_active":"2023-12-24T19:52:20.428803+0000","last_peered":"2023-12-24T19:52:20.428803+0000","last_clean":"2023-12-24T19:52:20.428803+0000","last_became_active":"2023-12-24T19:52:19.626661+0000","last_became_peered":"2023-12-24T19:52:19.626661+0000","last_unstale":"2023-12-24T19:52:20.428803+0000","last_undegraded":"2023-12-24T19:52:20.428803+0000","last_fullsized":"2023-12-24T19:52:20.428803+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457509+0000","last_change":"2023-12-24T19:52:20.445257+0000","last_active":"2023-12-24T19:52:20.457509+0000","last_peered":"2023-12-24T19:52:20.457509+0000","last_clean":"2023-12-24T19:52:20.457509+0000","last_became_active":"2023-12-24T19:52:20.444758+0000","last_became_peered":"2023-12-24T19:52:20.444758+0000","last_unstale":"2023-12-24T19:52:20.457509+0000","last_undegraded":"2023-12-24T19:52:20.457509+0000","last_fullsized":"2023-12-24T19:52:20.457509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432442+0000","last_change":"2023-12-24T19:52:19.622896+0000","last_active":"2023-12-24T19:52:20.432442+0000","last_peered":"2023-12-24T19:52:20.432442+0000","last_clean":"2023-12-24T19:52:20.432442+0000","last_became_active":"2023-12-24T19:52:19.620554+0000","last_became_peered":"2023-12-24T19:52:19.620554+0000","last_unstale":"2023-12-24T19:52:20.432442+0000","last_undegraded":"2023-12-24T19:52:20.432442+0000","last_fullsized":"2023-12-24T19:52:20.432442+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:23.305323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450617+0000","last_change":"2023-12-24T19:52:20.442947+0000","last_active":"2023-12-24T19:52:20.450617+0000","last_peered":"2023-12-24T19:52:20.450617+0000","last_clean":"2023-12-24T19:52:20.450617+0000","last_became_active":"2023-12-24T19:52:20.442673+0000","last_became_peered":"2023-12-24T19:52:20.442673+0000","last_unstale":"2023-12-24T19:52:20.450617+0000","last_undegraded":"2023-12-24T19:52:20.450617+0000","last_fullsized":"2023-12-24T19:52:20.450617+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:16.808549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440349+0000","last_change":"2023-12-24T19:52:19.626676+0000","last_active":"2023-12-24T19:52:20.440349+0000","last_peered":"2023-12-24T19:52:20.440349+0000","last_clean":"2023-12-24T19:52:20.440349+0000","last_became_active":"2023-12-24T19:52:19.626369+0000","last_became_peered":"2023-12-24T19:52:19.626369+0000","last_unstale":"2023-12-24T19:52:20.440349+0000","last_undegraded":"2023-12-24T19:52:20.440349+0000","last_fullsized":"2023-12-24T19:52:20.440349+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:59.583628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458726+0000","last_change":"2023-12-24T19:52:20.453417+0000","last_active":"2023-12-24T19:52:20.458726+0000","last_peered":"2023-12-24T19:52:20.458726+0000","last_clean":"2023-12-24T19:52:20.458726+0000","last_became_active":"2023-12-24T19:52:20.446412+0000","last_became_peered":"2023-12-24T19:52:20.446412+0000","last_unstale":"2023-12-24T19:52:20.458726+0000","last_undegraded":"2023-12-24T19:52:20.458726+0000","last_fullsized":"2023-12-24T19:52:20.458726+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:57.299870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431646+0000","last_change":"2023-12-24T19:52:19.626315+0000","last_active":"2023-12-24T19:52:20.431646+0000","last_peered":"2023-12-24T19:52:20.431646+0000","last_clean":"2023-12-24T19:52:20.431646+0000","last_became_active":"2023-12-24T19:52:19.624214+0000","last_became_peered":"2023-12-24T19:52:19.624214+0000","last_unstale":"2023-12-24T19:52:20.431646+0000","last_undegraded":"2023-12-24T19:52:20.431646+0000","last_fullsized":"2023-12-24T19:52:20.431646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457788+0000","last_change":"2023-12-24T19:52:20.446836+0000","last_active":"2023-12-24T19:52:20.457788+0000","last_peered":"2023-12-24T19:52:20.457788+0000","last_clean":"2023-12-24T19:52:20.457788+0000","last_became_active":"2023-12-24T19:52:20.446047+0000","last_became_peered":"2023-12-24T19:52:20.446047+0000","last_unstale":"2023-12-24T19:52:20.457788+0000","last_undegraded":"2023-12-24T19:52:20.457788+0000","last_fullsized":"2023-12-24T19:52:20.457788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:17.021655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440741+0000","last_change":"2023-12-24T19:52:19.626817+0000","last_active":"2023-12-24T19:52:20.440741+0000","last_peered":"2023-12-24T19:52:20.440741+0000","last_clean":"2023-12-24T19:52:20.440741+0000","last_became_active":"2023-12-24T19:52:19.625919+0000","last_became_peered":"2023-12-24T19:52:19.625919+0000","last_unstale":"2023-12-24T19:52:20.440741+0000","last_undegraded":"2023-12-24T19:52:20.440741+0000","last_fullsized":"2023-12-24T19:52:20.440741+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:54.742755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459951+0000","last_change":"2023-12-24T19:52:20.451641+0000","last_active":"2023-12-24T19:52:20.459951+0000","last_peered":"2023-12-24T19:52:20.459951+0000","last_clean":"2023-12-24T19:52:20.459951+0000","last_became_active":"2023-12-24T19:52:20.451345+0000","last_became_peered":"2023-12-24T19:52:20.451345+0000","last_unstale":"2023-12-24T19:52:20.459951+0000","last_undegraded":"2023-12-24T19:52:20.459951+0000","last_fullsized":"2023-12-24T19:52:20.459951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"172'6","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.659634+0000","last_change":"2023-12-24T19:52:19.632553+0000","last_active":"2023-12-24T19:52:20.659634+0000","last_peered":"2023-12-24T19:52:20.659634+0000","last_clean":"2023-12-24T19:52:20.659634+0000","last_became_active":"2023-12-24T19:52:19.632215+0000","last_became_peered":"2023-12-24T19:52:19.632215+0000","last_unstale":"2023-12-24T19:52:20.659634+0000","last_undegraded":"2023-12-24T19:52:20.659634+0000","last_fullsized":"2023-12-24T19:52:20.659634+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"162'293","reported_seq":907,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440833+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:52:20.440833+0000","last_peered":"2023-12-24T19:52:20.440833+0000","last_clean":"2023-12-24T19:52:20.440833+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:52:20.440833+0000","last_undegraded":"2023-12-24T19:52:20.440833+0000","last_fullsized":"2023-12-24T19:52:20.440833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071856,"statfs":{"total":96636764160,"available":96329580544,"internally_reserved":0,"allocated":2760704,"data_stored":1713413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":1.099}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":1.1919999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.27},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.222}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.0549999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.333}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.248}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.304},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575755,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315788,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056052,"statfs":{"total":96636764160,"available":96313397248,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.532},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.052}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":1.157},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":0.97099999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.224},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.4319999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.016}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.254}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.296},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.613}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.347}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2162688,"data_stored":1123023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.327},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":1.409}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.877}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":1.298},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.123},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.355}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.2230000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.0129999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311700,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060140,"statfs":{"total":96636764160,"available":96317583360,"internally_reserved":0,"allocated":2174976,"data_stored":1124559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.28},"min":{"1min":0.622,"5min":0.622,"15min":0.58399999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.4610000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2110000000000001,"15min":1.1679999999999999},"min":{"1min":0.83099999999999996,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1990000000000001,"15min":1.1539999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.1550000000000002,"5min":4.1550000000000002,"15min":4.1550000000000002},"last":1.2869999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.391,"15min":1.369},"min":{"1min":0.746,"5min":0.746,"15min":0.63900000000000001},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.417},{"interface":"front","average":{"1min":1.579,"5min":1.397,"15min":1.3600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.383}]},{"osd":3,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.238,"15min":1.1919999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.46400000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.617},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.99399999999999999,"5min":0.89400000000000002,"15min":0.63900000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3140000000000001,"15min":1.2849999999999999},"min":{"1min":0.77500000000000002,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":3.29,"5min":3.29,"15min":3.29},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.361,"15min":1.3300000000000001},"min":{"1min":0.92400000000000004,"5min":0.72999999999999998,"15min":0.58799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.6890000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.2929999999999999,"15min":1.266},"min":{"1min":1.095,"5min":0.79900000000000004,"15min":0.56000000000000005},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.25},{"interface":"front","average":{"1min":1.419,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.95699999999999996,"5min":0.621,"15min":0.621},"max":{"1min":1.853,"5min":1.887,"15min":1.887},"last":1.343}]},{"osd":7,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.3320000000000001,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.54500000000000004},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.736},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4430000000000001,"15min":1.4199999999999999},"min":{"1min":1.042,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.843,"5min":2,"15min":2},"last":1.532}]}]},{"osd":3,"up_from":13,"seq":55834575755,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1123611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.2569999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":2.3140000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":2.1539999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":1.8759999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":2.1749999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.5580000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":2.0289999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":2.1160000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":2.2040000000000002},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":2.0619999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575757,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315792,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056048,"statfs":{"total":96636764160,"available":96313393152,"internally_reserved":0,"allocated":2170880,"data_stored":1123135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.24}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":0.90200000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.718},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4370000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.486},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.3839999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.784},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.5469999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.901},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.601}]}]},{"osd":1,"up_from":13,"seq":55834575755,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3360000000000001,"5min":1.421,"15min":1.647},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1479999999999999,"15min":1.145},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.4630000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3640000000000001,"5min":1.744,"15min":1.744},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.79000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.706,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.268,"15min":1.2649999999999999},"min":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":1.669,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.64700000000000002},"max":{"1min":1.702,"5min":1.726,"15min":1.823},"last":1.649}]},{"osd":4,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2789999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.429,"15min":1.423},"min":{"1min":0.93500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.7729999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.3160000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.413,"15min":1.407},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.948},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.383},"min":{"1min":0.97699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.2189999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5189999999999999,"15min":1.506},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8919999999999999,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.514,"15min":1.5},"min":{"1min":1.1259999999999999,"5min":1.008,"15min":0.88900000000000001},"max":{"1min":1.7969999999999999,"5min":2.1339999999999999,"15min":2.323},"last":1.3500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5640000000000001,"15min":1.5509999999999999},"min":{"1min":1.1100000000000001,"5min":0.999,"15min":0.999},"max":{"1min":1.95,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.53,"15min":1.5109999999999999},"min":{"1min":1.0109999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.954,"5min":2.532,"15min":2.532},"last":1.2130000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575755,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300004,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071836,"statfs":{"total":96636764160,"available":96329560064,"internally_reserved":0,"allocated":2781184,"data_stored":1715605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90300000000000002,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.478,"5min":1.6859999999999999,"15min":1.7250000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0669999999999999,"15min":1.018},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.50800000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":3.0910000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0609999999999999,"15min":1.0940000000000001},"min":{"1min":0.79800000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.6950000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":3.113},{"interface":"front","average":{"1min":1.202,"5min":1.129,"15min":1.137},"min":{"1min":0.93100000000000005,"5min":0.67800000000000005,"15min":0.61599999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.833},"last":2.8279999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.68500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6319999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":13.553000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.746,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.405,"15min":1.381},"min":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.90400000000000003},"max":{"1min":1.8180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":2.9340000000000002},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.335,"15min":1.3160000000000001},"min":{"1min":0.91900000000000004,"5min":0.85699999999999998,"15min":0.80200000000000005},"max":{"1min":1.8720000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":13.608000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4399999999999999,"15min":1.4279999999999999},"min":{"1min":1.129,"5min":0.87,"15min":0.87},"max":{"1min":1.752,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":2.681},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4570000000000001,"15min":1.444},"min":{"1min":1.1699999999999999,"5min":0.89600000000000002,"15min":0.66600000000000004},"max":{"1min":1.954,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":2.7240000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":13.651},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4890000000000001,"15min":1.496},"min":{"1min":1.262,"5min":1.0269999999999999,"15min":1},"max":{"1min":1.754,"5min":2.1309999999999998,"15min":2.4119999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.526,"15min":1.526},"min":{"1min":1.1919999999999999,"5min":1.052,"15min":0.82299999999999995},"max":{"1min":2.4169999999999998,"5min":2.46,"15min":2.46},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.476,"15min":1.468},"min":{"1min":0.84599999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.829,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":10.205}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:52:29.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:52:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.946+0000 7fe76046e700 1 Processor -- start 2023-12-24T19:52:29.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.946+0000 7fe76046e700 1 -- start start 2023-12-24T19:52:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe76046e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 0x7fe75815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe76046e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580b3c90 0x7fe75806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe76046e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75806d5c0 con 0x7fe7580b1ba0 2023-12-24T19:52:29.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe76046e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580b49c0 con 0x7fe7580b3c90 2023-12-24T19:52:29.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe76046e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75806d040 con 0x7fe758158e10 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580b3c90 0x7fe75806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580b3c90 0x7fe75806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40008/0 (socket says 172.21.15.50:40008) 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 -- 172.21.15.50:0/1357700105 learned_addr learned my addr 172.21.15.50:0/1357700105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75e20a700 1 --2- 172.21.15.50:0/1357700105 >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 0x7fe75815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 -- 172.21.15.50:0/1357700105 >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 msgr2=0x7fe75815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 --2- 172.21.15.50:0/1357700105 >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 0x7fe75815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 -- 172.21.15.50:0/1357700105 >> v1:172.21.15.82:6789/0 conn(0x7fe7580b1ba0 legacy=0x7fe7580b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75da09700 1 -- 172.21.15.50:0/1357700105 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75806df90 con 0x7fe7580b3c90 2023-12-24T19:52:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.950+0000 7fe75e20a700 1 --2- 172.21.15.50:0/1357700105 >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 0x7fe75815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe75da09700 1 --2- 172.21.15.50:0/1357700105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580b3c90 0x7fe75806da50 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe758068410 tx=0x7fe748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8d579e7eb327ef server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe75d208700 1 -- 172.21.15.50:0/1357700105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800b860 con 0x7fe7580b3c90 2023-12-24T19:52:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe75d208700 1 -- 172.21.15.50:0/1357700105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74800b9c0 con 0x7fe7580b3c90 2023-12-24T19:52:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe75d208700 1 -- 172.21.15.50:0/1357700105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800bd60 con 0x7fe7580b3c90 2023-12-24T19:52:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 -- 172.21.15.50:0/1357700105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580b3c90 msgr2=0x7fe75806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 --2- 172.21.15.50:0/1357700105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580b3c90 0x7fe75806da50 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe758068410 tx=0x7fe748009250 comp rx=0 tx=0).stop 2023-12-24T19:52:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 -- 172.21.15.50:0/1357700105 shutdown_connections 2023-12-24T19:52:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 --2- 172.21.15.50:0/1357700105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580b3c90 0x7fe75806da50 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 --2- 172.21.15.50:0/1357700105 >> v2:172.21.15.82:3300/0 conn(0x7fe758158e10 0x7fe75815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 -- 172.21.15.50:0/1357700105 >> 172.21.15.50:0/1357700105 conn(0x7fe7580670b0 msgr2=0x7fe7580674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 -- 172.21.15.50:0/1357700105 shutdown_connections 2023-12-24T19:52:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.954+0000 7fe76046e700 1 -- 172.21.15.50:0/1357700105 wait complete. 2023-12-24T19:52:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 Processor -- start 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- start start 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 0x7fe758151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7580b3c90 0x7fe75814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75814b1e0 con 0x7fe758158e10 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75814a030 con 0x7fe7580b1ba0 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75814f1a0 con 0x7fe7580b3c90 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40020/0 (socket says 172.21.15.50:40020) 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 -- 172.21.15.50:0/3659915434 learned_addr learned my addr 172.21.15.50:0/3659915434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75e20a700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 0x7fe758151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75da09700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7580b3c90 0x7fe75814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 -- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7580b3c90 msgr2=0x7fe75814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7580b3c90 0x7fe75814e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 -- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 msgr2=0x7fe758151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 0x7fe758151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 -- 172.21.15.50:0/3659915434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480094f0 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75e20a700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 0x7fe758151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe75ea0b700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c8e0 tx=0x7fe750001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75000ce80 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75000a7e0 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75000ab80 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe758151f50 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.958+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75814ee30 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.962+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe758152430 con 0x7fe758158e10 2023-12-24T19:52:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.962+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe750012420 con 0x7fe758158e10 2023-12-24T19:52:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.966+0000 7fe74e7fc700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 0x7fe73c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.966+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fe75007ce50 con 0x7fe758158e10 2023-12-24T19:52:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.966+0000 7fe75e20a700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 0x7fe73c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.966+0000 7fe75e20a700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 0x7fe73c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe754006f00 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:29.974+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe75004d0d0 con 0x7fe758158e10 2023-12-24T19:52:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.142+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7580652e0 con 0x7fe73c060580 2023-12-24T19:52:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.158+0000 7fe74e7fc700 1 -- 172.21.15.50:0/3659915434 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286433 (secure 0 0 0) 0x7fe7580652e0 con 0x7fe73c060580 2023-12-24T19:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 msgr2=0x7fe73c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 0x7fe73c062a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe754006f00 tx=0x7fe754008040 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 msgr2=0x7fe758149400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c8e0 tx=0x7fe750001710 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 shutdown_connections 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fe73c060580 0x7fe73c062a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe758158e10 0x7fe758149400 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7580b3c90 0x7fe75814e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 --2- 172.21.15.50:0/3659915434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580b1ba0 0x7fe758151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 >> 172.21.15.50:0/3659915434 conn(0x7fe7580670b0 msgr2=0x7fe7581548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 shutdown_connections 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.170+0000 7fe76046e700 1 -- 172.21.15.50:0/3659915434 wait complete. 2023-12-24T19:52:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T19:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-24T19:52:29.506844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":524,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":332,"ondisk_log_size":332,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470152,"kb_used_data":18120,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504568,"statfs":{"total":773094113280,"available":770564677632,"internally_reserved":0,"allocated":18554880,"data_stored":10169532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.082729"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452698+0000","last_change":"2023-12-24T19:52:20.445727+0000","last_active":"2023-12-24T19:52:20.452698+0000","last_peered":"2023-12-24T19:52:20.452698+0000","last_clean":"2023-12-24T19:52:20.452698+0000","last_became_active":"2023-12-24T19:52:20.445397+0000","last_became_peered":"2023-12-24T19:52:20.445397+0000","last_unstale":"2023-12-24T19:52:20.452698+0000","last_undegraded":"2023-12-24T19:52:20.452698+0000","last_fullsized":"2023-12-24T19:52:20.452698+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:22.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459069+0000","last_change":"2023-12-24T19:52:20.453790+0000","last_active":"2023-12-24T19:52:20.459069+0000","last_peered":"2023-12-24T19:52:20.459069+0000","last_clean":"2023-12-24T19:52:20.459069+0000","last_became_active":"2023-12-24T19:52:20.453359+0000","last_became_peered":"2023-12-24T19:52:20.453359+0000","last_unstale":"2023-12-24T19:52:20.459069+0000","last_undegraded":"2023-12-24T19:52:20.459069+0000","last_fullsized":"2023-12-24T19:52:20.459069+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:47:21.091012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460321+0000","last_change":"2023-12-24T19:52:20.457881+0000","last_active":"2023-12-24T19:52:20.460321+0000","last_peered":"2023-12-24T19:52:20.460321+0000","last_clean":"2023-12-24T19:52:20.460321+0000","last_became_active":"2023-12-24T19:52:20.457611+0000","last_became_peered":"2023-12-24T19:52:20.457611+0000","last_unstale":"2023-12-24T19:52:20.460321+0000","last_undegraded":"2023-12-24T19:52:20.460321+0000","last_fullsized":"2023-12-24T19:52:20.460321+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452247+0000","last_change":"2023-12-24T19:52:20.448108+0000","last_active":"2023-12-24T19:52:20.452247+0000","last_peered":"2023-12-24T19:52:20.452247+0000","last_clean":"2023-12-24T19:52:20.452247+0000","last_became_active":"2023-12-24T19:52:20.447808+0000","last_became_peered":"2023-12-24T19:52:20.447808+0000","last_unstale":"2023-12-24T19:52:20.452247+0000","last_undegraded":"2023-12-24T19:52:20.452247+0000","last_fullsized":"2023-12-24T19:52:20.452247+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:03.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449289+0000","last_change":"2023-12-24T19:52:20.443180+0000","last_active":"2023-12-24T19:52:20.449289+0000","last_peered":"2023-12-24T19:52:20.449289+0000","last_clean":"2023-12-24T19:52:20.449289+0000","last_became_active":"2023-12-24T19:52:20.440477+0000","last_became_peered":"2023-12-24T19:52:20.440477+0000","last_unstale":"2023-12-24T19:52:20.449289+0000","last_undegraded":"2023-12-24T19:52:20.449289+0000","last_fullsized":"2023-12-24T19:52:20.449289+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.457160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447975+0000","last_change":"2023-12-24T19:52:20.442278+0000","last_active":"2023-12-24T19:52:20.447975+0000","last_peered":"2023-12-24T19:52:20.447975+0000","last_clean":"2023-12-24T19:52:20.447975+0000","last_became_active":"2023-12-24T19:52:20.441556+0000","last_became_peered":"2023-12-24T19:52:20.441556+0000","last_unstale":"2023-12-24T19:52:20.447975+0000","last_undegraded":"2023-12-24T19:52:20.447975+0000","last_fullsized":"2023-12-24T19:52:20.447975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:55.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.455801+0000","last_change":"2023-12-24T19:52:20.452893+0000","last_active":"2023-12-24T19:52:20.455801+0000","last_peered":"2023-12-24T19:52:20.455801+0000","last_clean":"2023-12-24T19:52:20.455801+0000","last_became_active":"2023-12-24T19:52:20.452580+0000","last_became_peered":"2023-12-24T19:52:20.452580+0000","last_unstale":"2023-12-24T19:52:20.455801+0000","last_undegraded":"2023-12-24T19:52:20.455801+0000","last_fullsized":"2023-12-24T19:52:20.455801+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461274+0000","last_change":"2023-12-24T19:52:20.455969+0000","last_active":"2023-12-24T19:52:20.461274+0000","last_peered":"2023-12-24T19:52:20.461274+0000","last_clean":"2023-12-24T19:52:20.461274+0000","last_became_active":"2023-12-24T19:52:20.455612+0000","last_became_peered":"2023-12-24T19:52:20.455612+0000","last_unstale":"2023-12-24T19:52:20.461274+0000","last_undegraded":"2023-12-24T19:52:20.461274+0000","last_fullsized":"2023-12-24T19:52:20.461274+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:48.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460195+0000","last_change":"2023-12-24T19:52:20.453627+0000","last_active":"2023-12-24T19:52:20.460195+0000","last_peered":"2023-12-24T19:52:20.460195+0000","last_clean":"2023-12-24T19:52:20.460195+0000","last_became_active":"2023-12-24T19:52:20.453325+0000","last_became_peered":"2023-12-24T19:52:20.453325+0000","last_unstale":"2023-12-24T19:52:20.460195+0000","last_undegraded":"2023-12-24T19:52:20.460195+0000","last_fullsized":"2023-12-24T19:52:20.460195+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:16.280463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451237+0000","last_change":"2023-12-24T19:52:20.446017+0000","last_active":"2023-12-24T19:52:20.451237+0000","last_peered":"2023-12-24T19:52:20.451237+0000","last_clean":"2023-12-24T19:52:20.451237+0000","last_became_active":"2023-12-24T19:52:20.445707+0000","last_became_peered":"2023-12-24T19:52:20.445707+0000","last_unstale":"2023-12-24T19:52:20.451237+0000","last_undegraded":"2023-12-24T19:52:20.451237+0000","last_fullsized":"2023-12-24T19:52:20.451237+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:12.061233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461154+0000","last_change":"2023-12-24T19:52:20.458277+0000","last_active":"2023-12-24T19:52:20.461154+0000","last_peered":"2023-12-24T19:52:20.461154+0000","last_clean":"2023-12-24T19:52:20.461154+0000","last_became_active":"2023-12-24T19:52:20.457928+0000","last_became_peered":"2023-12-24T19:52:20.457928+0000","last_unstale":"2023-12-24T19:52:20.461154+0000","last_undegraded":"2023-12-24T19:52:20.461154+0000","last_fullsized":"2023-12-24T19:52:20.461154+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:44.881698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451836+0000","last_change":"2023-12-24T19:52:20.444756+0000","last_active":"2023-12-24T19:52:20.451836+0000","last_peered":"2023-12-24T19:52:20.451836+0000","last_clean":"2023-12-24T19:52:20.451836+0000","last_became_active":"2023-12-24T19:52:20.444447+0000","last_became_peered":"2023-12-24T19:52:20.444447+0000","last_unstale":"2023-12-24T19:52:20.451836+0000","last_undegraded":"2023-12-24T19:52:20.451836+0000","last_fullsized":"2023-12-24T19:52:20.451836+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:24.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451303+0000","last_change":"2023-12-24T19:52:20.445807+0000","last_active":"2023-12-24T19:52:20.451303+0000","last_peered":"2023-12-24T19:52:20.451303+0000","last_clean":"2023-12-24T19:52:20.451303+0000","last_became_active":"2023-12-24T19:52:20.445159+0000","last_became_peered":"2023-12-24T19:52:20.445159+0000","last_unstale":"2023-12-24T19:52:20.451303+0000","last_undegraded":"2023-12-24T19:52:20.451303+0000","last_fullsized":"2023-12-24T19:52:20.451303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:12.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450513+0000","last_change":"2023-12-24T19:52:20.443523+0000","last_active":"2023-12-24T19:52:20.450513+0000","last_peered":"2023-12-24T19:52:20.450513+0000","last_clean":"2023-12-24T19:52:20.450513+0000","last_became_active":"2023-12-24T19:52:20.443257+0000","last_became_peered":"2023-12-24T19:52:20.443257+0000","last_unstale":"2023-12-24T19:52:20.450513+0000","last_undegraded":"2023-12-24T19:52:20.450513+0000","last_fullsized":"2023-12-24T19:52:20.450513+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:01.659865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459257+0000","last_change":"2023-12-24T19:52:20.454137+0000","last_active":"2023-12-24T19:52:20.459257+0000","last_peered":"2023-12-24T19:52:20.459257+0000","last_clean":"2023-12-24T19:52:20.459257+0000","last_became_active":"2023-12-24T19:52:20.453835+0000","last_became_peered":"2023-12-24T19:52:20.453835+0000","last_unstale":"2023-12-24T19:52:20.459257+0000","last_undegraded":"2023-12-24T19:52:20.459257+0000","last_fullsized":"2023-12-24T19:52:20.459257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448473+0000","last_change":"2023-12-24T19:52:20.443793+0000","last_active":"2023-12-24T19:52:20.448473+0000","last_peered":"2023-12-24T19:52:20.448473+0000","last_clean":"2023-12-24T19:52:20.448473+0000","last_became_active":"2023-12-24T19:52:20.443041+0000","last_became_peered":"2023-12-24T19:52:20.443041+0000","last_unstale":"2023-12-24T19:52:20.448473+0000","last_undegraded":"2023-12-24T19:52:20.448473+0000","last_fullsized":"2023-12-24T19:52:20.448473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:13.176005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452525+0000","last_change":"2023-12-24T19:52:20.445004+0000","last_active":"2023-12-24T19:52:20.452525+0000","last_peered":"2023-12-24T19:52:20.452525+0000","last_clean":"2023-12-24T19:52:20.452525+0000","last_became_active":"2023-12-24T19:52:20.444719+0000","last_became_peered":"2023-12-24T19:52:20.444719+0000","last_unstale":"2023-12-24T19:52:20.452525+0000","last_undegraded":"2023-12-24T19:52:20.452525+0000","last_fullsized":"2023-12-24T19:52:20.452525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:58:17.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462223+0000","last_change":"2023-12-24T19:52:20.461262+0000","last_active":"2023-12-24T19:52:20.462223+0000","last_peered":"2023-12-24T19:52:20.462223+0000","last_clean":"2023-12-24T19:52:20.462223+0000","last_became_active":"2023-12-24T19:52:20.460637+0000","last_became_peered":"2023-12-24T19:52:20.460637+0000","last_unstale":"2023-12-24T19:52:20.462223+0000","last_undegraded":"2023-12-24T19:52:20.462223+0000","last_fullsized":"2023-12-24T19:52:20.462223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:51.651125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459144+0000","last_change":"2023-12-24T19:52:20.454330+0000","last_active":"2023-12-24T19:52:20.459144+0000","last_peered":"2023-12-24T19:52:20.459144+0000","last_clean":"2023-12-24T19:52:20.459144+0000","last_became_active":"2023-12-24T19:52:20.453787+0000","last_became_peered":"2023-12-24T19:52:20.453787+0000","last_unstale":"2023-12-24T19:52:20.459144+0000","last_undegraded":"2023-12-24T19:52:20.459144+0000","last_fullsized":"2023-12-24T19:52:20.459144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:49:31.843112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459505+0000","last_change":"2023-12-24T19:52:20.457538+0000","last_active":"2023-12-24T19:52:20.459505+0000","last_peered":"2023-12-24T19:52:20.459505+0000","last_clean":"2023-12-24T19:52:20.459505+0000","last_became_active":"2023-12-24T19:52:20.455869+0000","last_became_peered":"2023-12-24T19:52:20.455869+0000","last_unstale":"2023-12-24T19:52:20.459505+0000","last_undegraded":"2023-12-24T19:52:20.459505+0000","last_fullsized":"2023-12-24T19:52:20.459505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:17.981106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460391+0000","last_change":"2023-12-24T19:52:20.454224+0000","last_active":"2023-12-24T19:52:20.460391+0000","last_peered":"2023-12-24T19:52:20.460391+0000","last_clean":"2023-12-24T19:52:20.460391+0000","last_became_active":"2023-12-24T19:52:20.453928+0000","last_became_peered":"2023-12-24T19:52:20.453928+0000","last_unstale":"2023-12-24T19:52:20.460391+0000","last_undegraded":"2023-12-24T19:52:20.460391+0000","last_fullsized":"2023-12-24T19:52:20.460391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:14.133011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456105+0000","last_change":"2023-12-24T19:52:20.452399+0000","last_active":"2023-12-24T19:52:20.456105+0000","last_peered":"2023-12-24T19:52:20.456105+0000","last_clean":"2023-12-24T19:52:20.456105+0000","last_became_active":"2023-12-24T19:52:20.452126+0000","last_became_peered":"2023-12-24T19:52:20.452126+0000","last_unstale":"2023-12-24T19:52:20.456105+0000","last_undegraded":"2023-12-24T19:52:20.456105+0000","last_fullsized":"2023-12-24T19:52:20.456105+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461009+0000","last_change":"2023-12-24T19:52:20.453088+0000","last_active":"2023-12-24T19:52:20.461009+0000","last_peered":"2023-12-24T19:52:20.461009+0000","last_clean":"2023-12-24T19:52:20.461009+0000","last_became_active":"2023-12-24T19:52:20.452800+0000","last_became_peered":"2023-12-24T19:52:20.452800+0000","last_unstale":"2023-12-24T19:52:20.461009+0000","last_undegraded":"2023-12-24T19:52:20.461009+0000","last_fullsized":"2023-12-24T19:52:20.461009+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452095+0000","last_change":"2023-12-24T19:52:20.451037+0000","last_active":"2023-12-24T19:52:20.452095+0000","last_peered":"2023-12-24T19:52:20.452095+0000","last_clean":"2023-12-24T19:52:20.452095+0000","last_became_active":"2023-12-24T19:52:20.447988+0000","last_became_peered":"2023-12-24T19:52:20.447988+0000","last_unstale":"2023-12-24T19:52:20.452095+0000","last_undegraded":"2023-12-24T19:52:20.452095+0000","last_fullsized":"2023-12-24T19:52:20.452095+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:14.647509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452788+0000","last_change":"2023-12-24T19:52:20.449142+0000","last_active":"2023-12-24T19:52:20.452788+0000","last_peered":"2023-12-24T19:52:20.452788+0000","last_clean":"2023-12-24T19:52:20.452788+0000","last_became_active":"2023-12-24T19:52:20.448862+0000","last_became_peered":"2023-12-24T19:52:20.448862+0000","last_unstale":"2023-12-24T19:52:20.452788+0000","last_undegraded":"2023-12-24T19:52:20.452788+0000","last_fullsized":"2023-12-24T19:52:20.452788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454205+0000","last_change":"2023-12-24T19:52:20.448620+0000","last_active":"2023-12-24T19:52:20.454205+0000","last_peered":"2023-12-24T19:52:20.454205+0000","last_clean":"2023-12-24T19:52:20.454205+0000","last_became_active":"2023-12-24T19:52:20.448333+0000","last_became_peered":"2023-12-24T19:52:20.448333+0000","last_unstale":"2023-12-24T19:52:20.454205+0000","last_undegraded":"2023-12-24T19:52:20.454205+0000","last_fullsized":"2023-12-24T19:52:20.454205+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460509+0000","last_change":"2023-12-24T19:52:20.455597+0000","last_active":"2023-12-24T19:52:20.460509+0000","last_peered":"2023-12-24T19:52:20.460509+0000","last_clean":"2023-12-24T19:52:20.460509+0000","last_became_active":"2023-12-24T19:52:20.455312+0000","last_became_peered":"2023-12-24T19:52:20.455312+0000","last_unstale":"2023-12-24T19:52:20.460509+0000","last_undegraded":"2023-12-24T19:52:20.460509+0000","last_fullsized":"2023-12-24T19:52:20.460509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:00.335033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.454609+0000","last_change":"2023-12-24T19:52:20.448896+0000","last_active":"2023-12-24T19:52:20.454609+0000","last_peered":"2023-12-24T19:52:20.454609+0000","last_clean":"2023-12-24T19:52:20.454609+0000","last_became_active":"2023-12-24T19:52:20.448596+0000","last_became_peered":"2023-12-24T19:52:20.448596+0000","last_unstale":"2023-12-24T19:52:20.454609+0000","last_undegraded":"2023-12-24T19:52:20.454609+0000","last_fullsized":"2023-12-24T19:52:20.454609+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:40.214594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457765+0000","last_change":"2023-12-24T19:52:20.446613+0000","last_active":"2023-12-24T19:52:20.457765+0000","last_peered":"2023-12-24T19:52:20.457765+0000","last_clean":"2023-12-24T19:52:20.457765+0000","last_became_active":"2023-12-24T19:52:20.445627+0000","last_became_peered":"2023-12-24T19:52:20.445627+0000","last_unstale":"2023-12-24T19:52:20.457765+0000","last_undegraded":"2023-12-24T19:52:20.457765+0000","last_fullsized":"2023-12-24T19:52:20.457765+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:14:20.374263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458502+0000","last_change":"2023-12-24T19:52:20.454043+0000","last_active":"2023-12-24T19:52:20.458502+0000","last_peered":"2023-12-24T19:52:20.458502+0000","last_clean":"2023-12-24T19:52:20.458502+0000","last_became_active":"2023-12-24T19:52:20.453310+0000","last_became_peered":"2023-12-24T19:52:20.453310+0000","last_unstale":"2023-12-24T19:52:20.458502+0000","last_undegraded":"2023-12-24T19:52:20.458502+0000","last_fullsized":"2023-12-24T19:52:20.458502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:46.948625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453843+0000","last_change":"2023-12-24T19:52:20.447630+0000","last_active":"2023-12-24T19:52:20.453843+0000","last_peered":"2023-12-24T19:52:20.453843+0000","last_clean":"2023-12-24T19:52:20.453843+0000","last_became_active":"2023-12-24T19:52:20.447340+0000","last_became_peered":"2023-12-24T19:52:20.447340+0000","last_unstale":"2023-12-24T19:52:20.453843+0000","last_undegraded":"2023-12-24T19:52:20.453843+0000","last_fullsized":"2023-12-24T19:52:20.453843+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:55.756326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461303+0000","last_change":"2023-12-24T19:52:20.456138+0000","last_active":"2023-12-24T19:52:20.461303+0000","last_peered":"2023-12-24T19:52:20.461303+0000","last_clean":"2023-12-24T19:52:20.461303+0000","last_became_active":"2023-12-24T19:52:20.455839+0000","last_became_peered":"2023-12-24T19:52:20.455839+0000","last_unstale":"2023-12-24T19:52:20.461303+0000","last_undegraded":"2023-12-24T19:52:20.461303+0000","last_fullsized":"2023-12-24T19:52:20.461303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:57.372663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459944+0000","last_change":"2023-12-24T19:52:20.454623+0000","last_active":"2023-12-24T19:52:20.459944+0000","last_peered":"2023-12-24T19:52:20.459944+0000","last_clean":"2023-12-24T19:52:20.459944+0000","last_became_active":"2023-12-24T19:52:20.452078+0000","last_became_peered":"2023-12-24T19:52:20.452078+0000","last_unstale":"2023-12-24T19:52:20.459944+0000","last_undegraded":"2023-12-24T19:52:20.459944+0000","last_fullsized":"2023-12-24T19:52:20.459944+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:54.274863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654262+0000","last_change":"2023-12-24T19:52:19.623289+0000","last_active":"2023-12-24T19:52:20.654262+0000","last_peered":"2023-12-24T19:52:20.654262+0000","last_clean":"2023-12-24T19:52:20.654262+0000","last_became_active":"2023-12-24T19:52:19.622982+0000","last_became_peered":"2023-12-24T19:52:19.622982+0000","last_unstale":"2023-12-24T19:52:20.654262+0000","last_undegraded":"2023-12-24T19:52:20.654262+0000","last_fullsized":"2023-12-24T19:52:20.654262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:38.006004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460291+0000","last_change":"2023-12-24T19:52:20.456568+0000","last_active":"2023-12-24T19:52:20.460291+0000","last_peered":"2023-12-24T19:52:20.460291+0000","last_clean":"2023-12-24T19:52:20.460291+0000","last_became_active":"2023-12-24T19:52:20.454058+0000","last_became_peered":"2023-12-24T19:52:20.454058+0000","last_unstale":"2023-12-24T19:52:20.460291+0000","last_undegraded":"2023-12-24T19:52:20.460291+0000","last_fullsized":"2023-12-24T19:52:20.460291+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:39.019576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656135+0000","last_change":"2023-12-24T19:52:19.634248+0000","last_active":"2023-12-24T19:52:20.656135+0000","last_peered":"2023-12-24T19:52:20.656135+0000","last_clean":"2023-12-24T19:52:20.656135+0000","last_became_active":"2023-12-24T19:52:19.633957+0000","last_became_peered":"2023-12-24T19:52:19.633957+0000","last_unstale":"2023-12-24T19:52:20.656135+0000","last_undegraded":"2023-12-24T19:52:20.656135+0000","last_fullsized":"2023-12-24T19:52:20.656135+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:43.556087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459716+0000","last_change":"2023-12-24T19:52:20.450176+0000","last_active":"2023-12-24T19:52:20.459716+0000","last_peered":"2023-12-24T19:52:20.459716+0000","last_clean":"2023-12-24T19:52:20.459716+0000","last_became_active":"2023-12-24T19:52:20.449883+0000","last_became_peered":"2023-12-24T19:52:20.449883+0000","last_unstale":"2023-12-24T19:52:20.459716+0000","last_undegraded":"2023-12-24T19:52:20.459716+0000","last_fullsized":"2023-12-24T19:52:20.459716+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:58.694109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656262+0000","last_change":"2023-12-24T19:52:19.633188+0000","last_active":"2023-12-24T19:52:20.656262+0000","last_peered":"2023-12-24T19:52:20.656262+0000","last_clean":"2023-12-24T19:52:20.656262+0000","last_became_active":"2023-12-24T19:52:19.632814+0000","last_became_peered":"2023-12-24T19:52:19.632814+0000","last_unstale":"2023-12-24T19:52:20.656262+0000","last_undegraded":"2023-12-24T19:52:20.656262+0000","last_fullsized":"2023-12-24T19:52:20.656262+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:22:34.743736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461517+0000","last_change":"2023-12-24T19:52:20.455845+0000","last_active":"2023-12-24T19:52:20.461517+0000","last_peered":"2023-12-24T19:52:20.461517+0000","last_clean":"2023-12-24T19:52:20.461517+0000","last_became_active":"2023-12-24T19:52:20.455513+0000","last_became_peered":"2023-12-24T19:52:20.455513+0000","last_unstale":"2023-12-24T19:52:20.461517+0000","last_undegraded":"2023-12-24T19:52:20.461517+0000","last_fullsized":"2023-12-24T19:52:20.461517+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:33.303221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657449+0000","last_change":"2023-12-24T19:52:19.633282+0000","last_active":"2023-12-24T19:52:20.657449+0000","last_peered":"2023-12-24T19:52:20.657449+0000","last_clean":"2023-12-24T19:52:20.657449+0000","last_became_active":"2023-12-24T19:52:19.632977+0000","last_became_peered":"2023-12-24T19:52:19.632977+0000","last_unstale":"2023-12-24T19:52:20.657449+0000","last_undegraded":"2023-12-24T19:52:20.657449+0000","last_fullsized":"2023-12-24T19:52:20.657449+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:21.316376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457315+0000","last_change":"2023-12-24T19:52:20.454913+0000","last_active":"2023-12-24T19:52:20.457315+0000","last_peered":"2023-12-24T19:52:20.457315+0000","last_clean":"2023-12-24T19:52:20.457315+0000","last_became_active":"2023-12-24T19:52:20.454515+0000","last_became_peered":"2023-12-24T19:52:20.454515+0000","last_unstale":"2023-12-24T19:52:20.457315+0000","last_undegraded":"2023-12-24T19:52:20.457315+0000","last_fullsized":"2023-12-24T19:52:20.457315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:59.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655687+0000","last_change":"2023-12-24T19:52:19.632234+0000","last_active":"2023-12-24T19:52:20.655687+0000","last_peered":"2023-12-24T19:52:20.655687+0000","last_clean":"2023-12-24T19:52:20.655687+0000","last_became_active":"2023-12-24T19:52:19.631043+0000","last_became_peered":"2023-12-24T19:52:19.631043+0000","last_unstale":"2023-12-24T19:52:20.655687+0000","last_undegraded":"2023-12-24T19:52:20.655687+0000","last_fullsized":"2023-12-24T19:52:20.655687+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452144+0000","last_change":"2023-12-24T19:52:20.446043+0000","last_active":"2023-12-24T19:52:20.452144+0000","last_peered":"2023-12-24T19:52:20.452144+0000","last_clean":"2023-12-24T19:52:20.452144+0000","last_became_active":"2023-12-24T19:52:20.445753+0000","last_became_peered":"2023-12-24T19:52:20.445753+0000","last_unstale":"2023-12-24T19:52:20.452144+0000","last_undegraded":"2023-12-24T19:52:20.452144+0000","last_fullsized":"2023-12-24T19:52:20.452144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:03:46.910747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654431+0000","last_change":"2023-12-24T19:52:19.611715+0000","last_active":"2023-12-24T19:52:20.654431+0000","last_peered":"2023-12-24T19:52:20.654431+0000","last_clean":"2023-12-24T19:52:20.654431+0000","last_became_active":"2023-12-24T19:52:19.611384+0000","last_became_peered":"2023-12-24T19:52:19.611384+0000","last_unstale":"2023-12-24T19:52:20.654431+0000","last_undegraded":"2023-12-24T19:52:20.654431+0000","last_fullsized":"2023-12-24T19:52:20.654431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.456851+0000","last_change":"2023-12-24T19:52:20.447681+0000","last_active":"2023-12-24T19:52:20.456851+0000","last_peered":"2023-12-24T19:52:20.456851+0000","last_clean":"2023-12-24T19:52:20.456851+0000","last_became_active":"2023-12-24T19:52:20.447098+0000","last_became_peered":"2023-12-24T19:52:20.447098+0000","last_unstale":"2023-12-24T19:52:20.456851+0000","last_undegraded":"2023-12-24T19:52:20.456851+0000","last_fullsized":"2023-12-24T19:52:20.456851+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:20.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431505+0000","last_change":"2023-12-24T19:52:19.624503+0000","last_active":"2023-12-24T19:52:20.431505+0000","last_peered":"2023-12-24T19:52:20.431505+0000","last_clean":"2023-12-24T19:52:20.431505+0000","last_became_active":"2023-12-24T19:52:19.621123+0000","last_became_peered":"2023-12-24T19:52:19.621123+0000","last_unstale":"2023-12-24T19:52:20.431505+0000","last_undegraded":"2023-12-24T19:52:20.431505+0000","last_fullsized":"2023-12-24T19:52:20.431505+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:34.194141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447519+0000","last_change":"2023-12-24T19:52:20.442294+0000","last_active":"2023-12-24T19:52:20.447519+0000","last_peered":"2023-12-24T19:52:20.447519+0000","last_clean":"2023-12-24T19:52:20.447519+0000","last_became_active":"2023-12-24T19:52:20.440941+0000","last_became_peered":"2023-12-24T19:52:20.440941+0000","last_unstale":"2023-12-24T19:52:20.447519+0000","last_undegraded":"2023-12-24T19:52:20.447519+0000","last_fullsized":"2023-12-24T19:52:20.447519+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:24:01.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.427537+0000","last_change":"2023-12-24T19:52:19.616328+0000","last_active":"2023-12-24T19:52:20.427537+0000","last_peered":"2023-12-24T19:52:20.427537+0000","last_clean":"2023-12-24T19:52:20.427537+0000","last_became_active":"2023-12-24T19:52:19.615974+0000","last_became_peered":"2023-12-24T19:52:19.615974+0000","last_unstale":"2023-12-24T19:52:20.427537+0000","last_undegraded":"2023-12-24T19:52:20.427537+0000","last_fullsized":"2023-12-24T19:52:20.427537+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:19.747414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460083+0000","last_change":"2023-12-24T19:52:20.450938+0000","last_active":"2023-12-24T19:52:20.460083+0000","last_peered":"2023-12-24T19:52:20.460083+0000","last_clean":"2023-12-24T19:52:20.460083+0000","last_became_active":"2023-12-24T19:52:20.450191+0000","last_became_peered":"2023-12-24T19:52:20.450191+0000","last_unstale":"2023-12-24T19:52:20.460083+0000","last_undegraded":"2023-12-24T19:52:20.460083+0000","last_fullsized":"2023-12-24T19:52:20.460083+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.443081+0000","last_change":"2023-12-24T19:52:19.630938+0000","last_active":"2023-12-24T19:52:20.443081+0000","last_peered":"2023-12-24T19:52:20.443081+0000","last_clean":"2023-12-24T19:52:20.443081+0000","last_became_active":"2023-12-24T19:52:19.630659+0000","last_became_peered":"2023-12-24T19:52:19.630659+0000","last_unstale":"2023-12-24T19:52:20.443081+0000","last_undegraded":"2023-12-24T19:52:20.443081+0000","last_fullsized":"2023-12-24T19:52:20.443081+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:27:59.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461129+0000","last_change":"2023-12-24T19:52:20.456394+0000","last_active":"2023-12-24T19:52:20.461129+0000","last_peered":"2023-12-24T19:52:20.461129+0000","last_clean":"2023-12-24T19:52:20.461129+0000","last_became_active":"2023-12-24T19:52:20.456077+0000","last_became_peered":"2023-12-24T19:52:20.456077+0000","last_unstale":"2023-12-24T19:52:20.461129+0000","last_undegraded":"2023-12-24T19:52:20.461129+0000","last_fullsized":"2023-12-24T19:52:20.461129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:05.733503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432888+0000","last_change":"2023-12-24T19:52:19.621239+0000","last_active":"2023-12-24T19:52:20.432888+0000","last_peered":"2023-12-24T19:52:20.432888+0000","last_clean":"2023-12-24T19:52:20.432888+0000","last_became_active":"2023-12-24T19:52:19.620920+0000","last_became_peered":"2023-12-24T19:52:19.620920+0000","last_unstale":"2023-12-24T19:52:20.432888+0000","last_undegraded":"2023-12-24T19:52:20.432888+0000","last_fullsized":"2023-12-24T19:52:20.432888+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:15.794978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461881+0000","last_change":"2023-12-24T19:52:20.460401+0000","last_active":"2023-12-24T19:52:20.461881+0000","last_peered":"2023-12-24T19:52:20.461881+0000","last_clean":"2023-12-24T19:52:20.461881+0000","last_became_active":"2023-12-24T19:52:20.459388+0000","last_became_peered":"2023-12-24T19:52:20.459388+0000","last_unstale":"2023-12-24T19:52:20.461881+0000","last_undegraded":"2023-12-24T19:52:20.461881+0000","last_fullsized":"2023-12-24T19:52:20.461881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:15.273424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654277+0000","last_change":"2023-12-24T19:52:19.622874+0000","last_active":"2023-12-24T19:52:20.654277+0000","last_peered":"2023-12-24T19:52:20.654277+0000","last_clean":"2023-12-24T19:52:20.654277+0000","last_became_active":"2023-12-24T19:52:19.622556+0000","last_became_peered":"2023-12-24T19:52:19.622556+0000","last_unstale":"2023-12-24T19:52:20.654277+0000","last_undegraded":"2023-12-24T19:52:20.654277+0000","last_fullsized":"2023-12-24T19:52:20.654277+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:18.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460225+0000","last_change":"2023-12-24T19:52:20.452626+0000","last_active":"2023-12-24T19:52:20.460225+0000","last_peered":"2023-12-24T19:52:20.460225+0000","last_clean":"2023-12-24T19:52:20.460225+0000","last_became_active":"2023-12-24T19:52:20.452360+0000","last_became_peered":"2023-12-24T19:52:20.452360+0000","last_unstale":"2023-12-24T19:52:20.460225+0000","last_undegraded":"2023-12-24T19:52:20.460225+0000","last_fullsized":"2023-12-24T19:52:20.460225+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:30.307273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.653976+0000","last_change":"2023-12-24T19:52:19.624741+0000","last_active":"2023-12-24T19:52:20.653976+0000","last_peered":"2023-12-24T19:52:20.653976+0000","last_clean":"2023-12-24T19:52:20.653976+0000","last_became_active":"2023-12-24T19:52:19.624434+0000","last_became_peered":"2023-12-24T19:52:19.624434+0000","last_unstale":"2023-12-24T19:52:20.653976+0000","last_undegraded":"2023-12-24T19:52:20.653976+0000","last_fullsized":"2023-12-24T19:52:20.653976+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:53.261291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459145+0000","last_change":"2023-12-24T19:52:20.453516+0000","last_active":"2023-12-24T19:52:20.459145+0000","last_peered":"2023-12-24T19:52:20.459145+0000","last_clean":"2023-12-24T19:52:20.459145+0000","last_became_active":"2023-12-24T19:52:20.451417+0000","last_became_peered":"2023-12-24T19:52:20.451417+0000","last_unstale":"2023-12-24T19:52:20.459145+0000","last_undegraded":"2023-12-24T19:52:20.459145+0000","last_fullsized":"2023-12-24T19:52:20.459145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:04.382583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432113+0000","last_change":"2023-12-24T19:52:19.630613+0000","last_active":"2023-12-24T19:52:20.432113+0000","last_peered":"2023-12-24T19:52:20.432113+0000","last_clean":"2023-12-24T19:52:20.432113+0000","last_became_active":"2023-12-24T19:52:19.629741+0000","last_became_peered":"2023-12-24T19:52:19.629741+0000","last_unstale":"2023-12-24T19:52:20.432113+0000","last_undegraded":"2023-12-24T19:52:20.432113+0000","last_fullsized":"2023-12-24T19:52:20.432113+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:46:30.807470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447996+0000","last_change":"2023-12-24T19:52:20.442555+0000","last_active":"2023-12-24T19:52:20.447996+0000","last_peered":"2023-12-24T19:52:20.447996+0000","last_clean":"2023-12-24T19:52:20.447996+0000","last_became_active":"2023-12-24T19:52:20.441968+0000","last_became_peered":"2023-12-24T19:52:20.441968+0000","last_unstale":"2023-12-24T19:52:20.447996+0000","last_undegraded":"2023-12-24T19:52:20.447996+0000","last_fullsized":"2023-12-24T19:52:20.447996+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:12:06.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.430392+0000","last_change":"2023-12-24T19:52:19.620713+0000","last_active":"2023-12-24T19:52:20.430392+0000","last_peered":"2023-12-24T19:52:20.430392+0000","last_clean":"2023-12-24T19:52:20.430392+0000","last_became_active":"2023-12-24T19:52:19.620417+0000","last_became_peered":"2023-12-24T19:52:19.620417+0000","last_unstale":"2023-12-24T19:52:20.430392+0000","last_undegraded":"2023-12-24T19:52:20.430392+0000","last_fullsized":"2023-12-24T19:52:20.430392+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:50:10.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453924+0000","last_change":"2023-12-24T19:52:20.448884+0000","last_active":"2023-12-24T19:52:20.453924+0000","last_peered":"2023-12-24T19:52:20.453924+0000","last_clean":"2023-12-24T19:52:20.453924+0000","last_became_active":"2023-12-24T19:52:20.448606+0000","last_became_peered":"2023-12-24T19:52:20.448606+0000","last_unstale":"2023-12-24T19:52:20.453924+0000","last_undegraded":"2023-12-24T19:52:20.453924+0000","last_fullsized":"2023-12-24T19:52:20.453924+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:59.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"172'8","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657177+0000","last_change":"2023-12-24T19:52:19.628126+0000","last_active":"2023-12-24T19:52:20.657177+0000","last_peered":"2023-12-24T19:52:20.657177+0000","last_clean":"2023-12-24T19:52:20.657177+0000","last_became_active":"2023-12-24T19:52:19.627819+0000","last_became_peered":"2023-12-24T19:52:19.627819+0000","last_unstale":"2023-12-24T19:52:20.657177+0000","last_undegraded":"2023-12-24T19:52:20.657177+0000","last_fullsized":"2023-12-24T19:52:20.657177+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:02.367913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459171+0000","last_change":"2023-12-24T19:52:20.454460+0000","last_active":"2023-12-24T19:52:20.459171+0000","last_peered":"2023-12-24T19:52:20.459171+0000","last_clean":"2023-12-24T19:52:20.459171+0000","last_became_active":"2023-12-24T19:52:20.451670+0000","last_became_peered":"2023-12-24T19:52:20.451670+0000","last_unstale":"2023-12-24T19:52:20.459171+0000","last_undegraded":"2023-12-24T19:52:20.459171+0000","last_fullsized":"2023-12-24T19:52:20.459171+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:59.000317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.649070+0000","last_change":"2023-12-24T19:52:19.627728+0000","last_active":"2023-12-24T19:52:20.649070+0000","last_peered":"2023-12-24T19:52:20.649070+0000","last_clean":"2023-12-24T19:52:20.649070+0000","last_became_active":"2023-12-24T19:52:19.627339+0000","last_became_peered":"2023-12-24T19:52:19.627339+0000","last_unstale":"2023-12-24T19:52:20.649070+0000","last_undegraded":"2023-12-24T19:52:20.649070+0000","last_fullsized":"2023-12-24T19:52:20.649070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:25.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.462295+0000","last_change":"2023-12-24T19:52:20.458871+0000","last_active":"2023-12-24T19:52:20.462295+0000","last_peered":"2023-12-24T19:52:20.462295+0000","last_clean":"2023-12-24T19:52:20.462295+0000","last_became_active":"2023-12-24T19:52:20.458565+0000","last_became_peered":"2023-12-24T19:52:20.458565+0000","last_unstale":"2023-12-24T19:52:20.462295+0000","last_undegraded":"2023-12-24T19:52:20.462295+0000","last_fullsized":"2023-12-24T19:52:20.462295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:29.327761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.655058+0000","last_change":"2023-12-24T19:52:19.630356+0000","last_active":"2023-12-24T19:52:20.655058+0000","last_peered":"2023-12-24T19:52:20.655058+0000","last_clean":"2023-12-24T19:52:20.655058+0000","last_became_active":"2023-12-24T19:52:19.630066+0000","last_became_peered":"2023-12-24T19:52:19.630066+0000","last_unstale":"2023-12-24T19:52:20.655058+0000","last_undegraded":"2023-12-24T19:52:20.655058+0000","last_fullsized":"2023-12-24T19:52:20.655058+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:15.266891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.461544+0000","last_change":"2023-12-24T19:52:20.453710+0000","last_active":"2023-12-24T19:52:20.461544+0000","last_peered":"2023-12-24T19:52:20.461544+0000","last_clean":"2023-12-24T19:52:20.461544+0000","last_became_active":"2023-12-24T19:52:20.453383+0000","last_became_peered":"2023-12-24T19:52:20.453383+0000","last_unstale":"2023-12-24T19:52:20.461544+0000","last_undegraded":"2023-12-24T19:52:20.461544+0000","last_fullsized":"2023-12-24T19:52:20.461544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:57:09.984356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.656007+0000","last_change":"2023-12-24T19:52:19.620872+0000","last_active":"2023-12-24T19:52:20.656007+0000","last_peered":"2023-12-24T19:52:20.656007+0000","last_clean":"2023-12-24T19:52:20.656007+0000","last_became_active":"2023-12-24T19:52:19.620309+0000","last_became_peered":"2023-12-24T19:52:19.620309+0000","last_unstale":"2023-12-24T19:52:20.656007+0000","last_undegraded":"2023-12-24T19:52:20.656007+0000","last_fullsized":"2023-12-24T19:52:20.656007+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:51.207604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.453004+0000","last_change":"2023-12-24T19:52:20.450309+0000","last_active":"2023-12-24T19:52:20.453004+0000","last_peered":"2023-12-24T19:52:20.453004+0000","last_clean":"2023-12-24T19:52:20.453004+0000","last_became_active":"2023-12-24T19:52:20.450015+0000","last_became_peered":"2023-12-24T19:52:20.450015+0000","last_unstale":"2023-12-24T19:52:20.453004+0000","last_undegraded":"2023-12-24T19:52:20.453004+0000","last_fullsized":"2023-12-24T19:52:20.453004+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431176+0000","last_change":"2023-12-24T19:52:19.618844+0000","last_active":"2023-12-24T19:52:20.431176+0000","last_peered":"2023-12-24T19:52:20.431176+0000","last_clean":"2023-12-24T19:52:20.431176+0000","last_became_active":"2023-12-24T19:52:19.618517+0000","last_became_peered":"2023-12-24T19:52:19.618517+0000","last_unstale":"2023-12-24T19:52:20.431176+0000","last_undegraded":"2023-12-24T19:52:20.431176+0000","last_fullsized":"2023-12-24T19:52:20.431176+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:53:54.036031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458951+0000","last_change":"2023-12-24T19:52:20.453723+0000","last_active":"2023-12-24T19:52:20.458951+0000","last_peered":"2023-12-24T19:52:20.458951+0000","last_clean":"2023-12-24T19:52:20.458951+0000","last_became_active":"2023-12-24T19:52:20.450871+0000","last_became_peered":"2023-12-24T19:52:20.450871+0000","last_unstale":"2023-12-24T19:52:20.458951+0000","last_undegraded":"2023-12-24T19:52:20.458951+0000","last_fullsized":"2023-12-24T19:52:20.458951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:40:00.502880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.657358+0000","last_change":"2023-12-24T19:52:19.633736+0000","last_active":"2023-12-24T19:52:20.657358+0000","last_peered":"2023-12-24T19:52:20.657358+0000","last_clean":"2023-12-24T19:52:20.657358+0000","last_became_active":"2023-12-24T19:52:19.633345+0000","last_became_peered":"2023-12-24T19:52:19.633345+0000","last_unstale":"2023-12-24T19:52:20.657358+0000","last_undegraded":"2023-12-24T19:52:20.657358+0000","last_fullsized":"2023-12-24T19:52:20.657358+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:13:58.575838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.460350+0000","last_change":"2023-12-24T19:52:20.458023+0000","last_active":"2023-12-24T19:52:20.460350+0000","last_peered":"2023-12-24T19:52:20.460350+0000","last_clean":"2023-12-24T19:52:20.460350+0000","last_became_active":"2023-12-24T19:52:20.455936+0000","last_became_peered":"2023-12-24T19:52:20.455936+0000","last_unstale":"2023-12-24T19:52:20.460350+0000","last_undegraded":"2023-12-24T19:52:20.460350+0000","last_fullsized":"2023-12-24T19:52:20.460350+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:23.400292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.438646+0000","last_change":"2023-12-24T19:52:19.622235+0000","last_active":"2023-12-24T19:52:20.438646+0000","last_peered":"2023-12-24T19:52:20.438646+0000","last_clean":"2023-12-24T19:52:20.438646+0000","last_became_active":"2023-12-24T19:52:19.621726+0000","last_became_peered":"2023-12-24T19:52:19.621726+0000","last_unstale":"2023-12-24T19:52:20.438646+0000","last_undegraded":"2023-12-24T19:52:20.438646+0000","last_fullsized":"2023-12-24T19:52:20.438646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:35.512788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.452524+0000","last_change":"2023-12-24T19:52:20.451501+0000","last_active":"2023-12-24T19:52:20.452524+0000","last_peered":"2023-12-24T19:52:20.452524+0000","last_clean":"2023-12-24T19:52:20.452524+0000","last_became_active":"2023-12-24T19:52:20.450966+0000","last_became_peered":"2023-12-24T19:52:20.450966+0000","last_unstale":"2023-12-24T19:52:20.452524+0000","last_undegraded":"2023-12-24T19:52:20.452524+0000","last_fullsized":"2023-12-24T19:52:20.452524+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:18:26.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.441265+0000","last_change":"2023-12-24T19:52:19.632975+0000","last_active":"2023-12-24T19:52:20.441265+0000","last_peered":"2023-12-24T19:52:20.441265+0000","last_clean":"2023-12-24T19:52:20.441265+0000","last_became_active":"2023-12-24T19:52:19.632576+0000","last_became_peered":"2023-12-24T19:52:19.632576+0000","last_unstale":"2023-12-24T19:52:20.441265+0000","last_undegraded":"2023-12-24T19:52:20.441265+0000","last_fullsized":"2023-12-24T19:52:20.441265+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459058+0000","last_change":"2023-12-24T19:52:20.453540+0000","last_active":"2023-12-24T19:52:20.459058+0000","last_peered":"2023-12-24T19:52:20.459058+0000","last_clean":"2023-12-24T19:52:20.459058+0000","last_became_active":"2023-12-24T19:52:20.453229+0000","last_became_peered":"2023-12-24T19:52:20.453229+0000","last_unstale":"2023-12-24T19:52:20.459058+0000","last_undegraded":"2023-12-24T19:52:20.459058+0000","last_fullsized":"2023-12-24T19:52:20.459058+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:23:01.774161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440406+0000","last_change":"2023-12-24T19:52:19.624224+0000","last_active":"2023-12-24T19:52:20.440406+0000","last_peered":"2023-12-24T19:52:20.440406+0000","last_clean":"2023-12-24T19:52:20.440406+0000","last_became_active":"2023-12-24T19:52:19.623961+0000","last_became_peered":"2023-12-24T19:52:19.623961+0000","last_unstale":"2023-12-24T19:52:20.440406+0000","last_undegraded":"2023-12-24T19:52:20.440406+0000","last_fullsized":"2023-12-24T19:52:20.440406+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.451574+0000","last_change":"2023-12-24T19:52:20.444774+0000","last_active":"2023-12-24T19:52:20.451574+0000","last_peered":"2023-12-24T19:52:20.451574+0000","last_clean":"2023-12-24T19:52:20.451574+0000","last_became_active":"2023-12-24T19:52:20.444394+0000","last_became_peered":"2023-12-24T19:52:20.444394+0000","last_unstale":"2023-12-24T19:52:20.451574+0000","last_undegraded":"2023-12-24T19:52:20.451574+0000","last_fullsized":"2023-12-24T19:52:20.451574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:51:44.742350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.654018+0000","last_change":"2023-12-24T19:52:19.625698+0000","last_active":"2023-12-24T19:52:20.654018+0000","last_peered":"2023-12-24T19:52:20.654018+0000","last_clean":"2023-12-24T19:52:20.654018+0000","last_became_active":"2023-12-24T19:52:19.625400+0000","last_became_peered":"2023-12-24T19:52:19.625400+0000","last_unstale":"2023-12-24T19:52:20.654018+0000","last_undegraded":"2023-12-24T19:52:20.654018+0000","last_fullsized":"2023-12-24T19:52:20.654018+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:38.897775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.448937+0000","last_change":"2023-12-24T19:52:20.442376+0000","last_active":"2023-12-24T19:52:20.448937+0000","last_peered":"2023-12-24T19:52:20.448937+0000","last_clean":"2023-12-24T19:52:20.448937+0000","last_became_active":"2023-12-24T19:52:20.442080+0000","last_became_peered":"2023-12-24T19:52:20.442080+0000","last_unstale":"2023-12-24T19:52:20.448937+0000","last_undegraded":"2023-12-24T19:52:20.448937+0000","last_fullsized":"2023-12-24T19:52:20.448937+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:35.207713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-24T19:52:21.476370+0000","last_change":"2023-12-24T19:52:19.630494+0000","last_active":"2023-12-24T19:52:21.476370+0000","last_peered":"2023-12-24T19:52:21.476370+0000","last_clean":"2023-12-24T19:52:21.476370+0000","last_became_active":"2023-12-24T19:52:19.630208+0000","last_became_peered":"2023-12-24T19:52:19.630208+0000","last_unstale":"2023-12-24T19:52:21.476370+0000","last_undegraded":"2023-12-24T19:52:21.476370+0000","last_fullsized":"2023-12-24T19:52:21.476370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:43:00.646294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.447593+0000","last_change":"2023-12-24T19:52:20.441690+0000","last_active":"2023-12-24T19:52:20.447593+0000","last_peered":"2023-12-24T19:52:20.447593+0000","last_clean":"2023-12-24T19:52:20.447593+0000","last_became_active":"2023-12-24T19:52:20.441401+0000","last_became_peered":"2023-12-24T19:52:20.441401+0000","last_unstale":"2023-12-24T19:52:20.447593+0000","last_undegraded":"2023-12-24T19:52:20.447593+0000","last_fullsized":"2023-12-24T19:52:20.447593+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:07.383658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.437347+0000","last_change":"2023-12-24T19:52:19.627158+0000","last_active":"2023-12-24T19:52:20.437347+0000","last_peered":"2023-12-24T19:52:20.437347+0000","last_clean":"2023-12-24T19:52:20.437347+0000","last_became_active":"2023-12-24T19:52:19.626853+0000","last_became_peered":"2023-12-24T19:52:19.626853+0000","last_unstale":"2023-12-24T19:52:20.437347+0000","last_undegraded":"2023-12-24T19:52:20.437347+0000","last_fullsized":"2023-12-24T19:52:20.437347+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:29:32.489540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.449029+0000","last_change":"2023-12-24T19:52:20.444049+0000","last_active":"2023-12-24T19:52:20.449029+0000","last_peered":"2023-12-24T19:52:20.449029+0000","last_clean":"2023-12-24T19:52:20.449029+0000","last_became_active":"2023-12-24T19:52:20.443576+0000","last_became_peered":"2023-12-24T19:52:20.443576+0000","last_unstale":"2023-12-24T19:52:20.449029+0000","last_undegraded":"2023-12-24T19:52:20.449029+0000","last_fullsized":"2023-12-24T19:52:20.449029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:14.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.428803+0000","last_change":"2023-12-24T19:52:19.627426+0000","last_active":"2023-12-24T19:52:20.428803+0000","last_peered":"2023-12-24T19:52:20.428803+0000","last_clean":"2023-12-24T19:52:20.428803+0000","last_became_active":"2023-12-24T19:52:19.626661+0000","last_became_peered":"2023-12-24T19:52:19.626661+0000","last_unstale":"2023-12-24T19:52:20.428803+0000","last_undegraded":"2023-12-24T19:52:20.428803+0000","last_fullsized":"2023-12-24T19:52:20.428803+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:02:03.369012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457509+0000","last_change":"2023-12-24T19:52:20.445257+0000","last_active":"2023-12-24T19:52:20.457509+0000","last_peered":"2023-12-24T19:52:20.457509+0000","last_clean":"2023-12-24T19:52:20.457509+0000","last_became_active":"2023-12-24T19:52:20.444758+0000","last_became_peered":"2023-12-24T19:52:20.444758+0000","last_unstale":"2023-12-24T19:52:20.457509+0000","last_undegraded":"2023-12-24T19:52:20.457509+0000","last_fullsized":"2023-12-24T19:52:20.457509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:36.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.432442+0000","last_change":"2023-12-24T19:52:19.622896+0000","last_active":"2023-12-24T19:52:20.432442+0000","last_peered":"2023-12-24T19:52:20.432442+0000","last_clean":"2023-12-24T19:52:20.432442+0000","last_became_active":"2023-12-24T19:52:19.620554+0000","last_became_peered":"2023-12-24T19:52:19.620554+0000","last_unstale":"2023-12-24T19:52:20.432442+0000","last_undegraded":"2023-12-24T19:52:20.432442+0000","last_fullsized":"2023-12-24T19:52:20.432442+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:23.305323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.450617+0000","last_change":"2023-12-24T19:52:20.442947+0000","last_active":"2023-12-24T19:52:20.450617+0000","last_peered":"2023-12-24T19:52:20.450617+0000","last_clean":"2023-12-24T19:52:20.450617+0000","last_became_active":"2023-12-24T19:52:20.442673+0000","last_became_peered":"2023-12-24T19:52:20.442673+0000","last_unstale":"2023-12-24T19:52:20.450617+0000","last_undegraded":"2023-12-24T19:52:20.450617+0000","last_fullsized":"2023-12-24T19:52:20.450617+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:16.808549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440349+0000","last_change":"2023-12-24T19:52:19.626676+0000","last_active":"2023-12-24T19:52:20.440349+0000","last_peered":"2023-12-24T19:52:20.440349+0000","last_clean":"2023-12-24T19:52:20.440349+0000","last_became_active":"2023-12-24T19:52:19.626369+0000","last_became_peered":"2023-12-24T19:52:19.626369+0000","last_unstale":"2023-12-24T19:52:20.440349+0000","last_undegraded":"2023-12-24T19:52:20.440349+0000","last_fullsized":"2023-12-24T19:52:20.440349+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:59.583628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.458726+0000","last_change":"2023-12-24T19:52:20.453417+0000","last_active":"2023-12-24T19:52:20.458726+0000","last_peered":"2023-12-24T19:52:20.458726+0000","last_clean":"2023-12-24T19:52:20.458726+0000","last_became_active":"2023-12-24T19:52:20.446412+0000","last_became_peered":"2023-12-24T19:52:20.446412+0000","last_unstale":"2023-12-24T19:52:20.458726+0000","last_undegraded":"2023-12-24T19:52:20.458726+0000","last_fullsized":"2023-12-24T19:52:20.458726+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:57.299870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.431646+0000","last_change":"2023-12-24T19:52:19.626315+0000","last_active":"2023-12-24T19:52:20.431646+0000","last_peered":"2023-12-24T19:52:20.431646+0000","last_clean":"2023-12-24T19:52:20.431646+0000","last_became_active":"2023-12-24T19:52:19.624214+0000","last_became_peered":"2023-12-24T19:52:19.624214+0000","last_unstale":"2023-12-24T19:52:20.431646+0000","last_undegraded":"2023-12-24T19:52:20.431646+0000","last_fullsized":"2023-12-24T19:52:20.431646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:54:08.467137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.457788+0000","last_change":"2023-12-24T19:52:20.446836+0000","last_active":"2023-12-24T19:52:20.457788+0000","last_peered":"2023-12-24T19:52:20.457788+0000","last_clean":"2023-12-24T19:52:20.457788+0000","last_became_active":"2023-12-24T19:52:20.446047+0000","last_became_peered":"2023-12-24T19:52:20.446047+0000","last_unstale":"2023-12-24T19:52:20.457788+0000","last_undegraded":"2023-12-24T19:52:20.457788+0000","last_fullsized":"2023-12-24T19:52:20.457788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:17.021655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440741+0000","last_change":"2023-12-24T19:52:19.626817+0000","last_active":"2023-12-24T19:52:20.440741+0000","last_peered":"2023-12-24T19:52:20.440741+0000","last_clean":"2023-12-24T19:52:20.440741+0000","last_became_active":"2023-12-24T19:52:19.625919+0000","last_became_peered":"2023-12-24T19:52:19.625919+0000","last_unstale":"2023-12-24T19:52:20.440741+0000","last_undegraded":"2023-12-24T19:52:20.440741+0000","last_fullsized":"2023-12-24T19:52:20.440741+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:54.742755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.459951+0000","last_change":"2023-12-24T19:52:20.451641+0000","last_active":"2023-12-24T19:52:20.459951+0000","last_peered":"2023-12-24T19:52:20.459951+0000","last_clean":"2023-12-24T19:52:20.459951+0000","last_became_active":"2023-12-24T19:52:20.451345+0000","last_became_peered":"2023-12-24T19:52:20.451345+0000","last_unstale":"2023-12-24T19:52:20.459951+0000","last_undegraded":"2023-12-24T19:52:20.459951+0000","last_fullsized":"2023-12-24T19:52:20.459951+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:19.588429+0000","last_clean_scrub_stamp":"2023-12-24T19:52:19.588429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:00.776336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"172'6","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.659634+0000","last_change":"2023-12-24T19:52:19.632553+0000","last_active":"2023-12-24T19:52:20.659634+0000","last_peered":"2023-12-24T19:52:20.659634+0000","last_clean":"2023-12-24T19:52:20.659634+0000","last_became_active":"2023-12-24T19:52:19.632215+0000","last_became_peered":"2023-12-24T19:52:19.632215+0000","last_unstale":"2023-12-24T19:52:20.659634+0000","last_undegraded":"2023-12-24T19:52:20.659634+0000","last_fullsized":"2023-12-24T19:52:20.659634+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:52:18.574857+0000","last_clean_scrub_stamp":"2023-12-24T19:52:18.574857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:25:02.809484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"162'293","reported_seq":907,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-24T19:52:20.440833+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T19:52:20.440833+0000","last_peered":"2023-12-24T19:52:20.440833+0000","last_clean":"2023-12-24T19:52:20.440833+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T19:52:20.440833+0000","last_undegraded":"2023-12-24T19:52:20.440833+0000","last_fullsized":"2023-12-24T19:52:20.440833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575756,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071856,"statfs":{"total":96636764160,"available":96329580544,"internally_reserved":0,"allocated":2760704,"data_stored":1713413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.163,"15min":1.173},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.421,"5min":1.6559999999999999,"15min":1.6830000000000001},"last":1.091},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2010000000000001},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5880000000000001,"5min":1.7230000000000001,"15min":1.804},"last":1.242}]},{"osd":1,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1819999999999999,"15min":1.1799999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":1.645,"15min":1.702},"last":1.181},{"interface":"front","average":{"1min":1.131,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.5229999999999999,"5min":1.6180000000000001,"15min":1.788},"last":1.143}]},{"osd":2,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.252,"15min":1.242},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.526,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.643,"5min":1.726,"15min":1.79},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.302,"15min":1.3069999999999999},"min":{"1min":0.96099999999999997,"5min":0.85499999999999998,"15min":0.83499999999999996},"max":{"1min":1.653,"5min":1.7569999999999999,"15min":1.77},"last":1.22},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3069999999999999,"15min":1.3160000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6259999999999999,"5min":1.829,"15min":1.829},"last":1.2749999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.167,"15min":1.1910000000000001},"min":{"1min":0.85999999999999999,"5min":0.71799999999999997,"15min":0.70199999999999996},"max":{"1min":1.524,"5min":1.7969999999999999,"15min":1.883},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.25},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.73199999999999998},"max":{"1min":1.607,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.90000000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.29,"15min":1.276},"min":{"1min":0.96099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.694,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.355,"15min":1.3620000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.80700000000000005},"max":{"1min":1.655,"5min":1.853,"15min":2.0609999999999999},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:51:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.429},"min":{"1min":1.173,"5min":1.024,"15min":0.871},"max":{"1min":1.839,"5min":1.909,"15min":1.97},"last":1.333},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4299999999999999,"15min":1.4199999999999999},"min":{"1min":1.0760000000000001,"5min":0.91900000000000004,"15min":0.69599999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.3069999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315788,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056052,"statfs":{"total":96636764160,"available":96313397248,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.306,"15min":1.3160000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.722,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.319},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3779999999999999,"15min":1.375},"min":{"1min":1.0780000000000001,"5min":1.0109999999999999,"15min":0.80700000000000005},"max":{"1min":1.6200000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.3720000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.6539999999999999,"5min":1.659,"15min":2.089},"last":1.411},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2450000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65700000000000003},"max":{"1min":1.7,"5min":2.569,"15min":2.569},"last":1.2789999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.22,"15min":1.2130000000000001},"min":{"1min":0.878,"5min":0.78900000000000003,"15min":0.73699999999999999},"max":{"1min":1.5049999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2849999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.7789999999999999},"last":1.6619999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2749999999999999,"15min":1.3069999999999999},"min":{"1min":0.81299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6379999999999999,"5min":2.1899999999999999,"15min":2.2730000000000001},"last":1.181},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2949999999999999,"15min":1.294},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5489999999999999,"5min":1.73,"15min":1.8720000000000001},"last":1.1399999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2010000000000001,"15min":1.2030000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66200000000000003},"max":{"1min":1.7529999999999999,"5min":1.762,"15min":2.0510000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.2769999999999999},"min":{"1min":0.876,"5min":0.874,"15min":0.68700000000000006},"max":{"1min":1.7050000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.48}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2849999999999999,"15min":1.272},"min":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.63500000000000001},"max":{"1min":1.6220000000000001,"5min":2.359,"15min":2.359},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4179999999999999,"15min":1.379},"min":{"1min":0.872,"5min":0.872,"15min":0.66100000000000003},"max":{"1min":1.851,"5min":1.851,"15min":2.1859999999999999},"last":1.5960000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.446,"15min":1.4179999999999999},"min":{"1min":0.98999999999999999,"5min":0.93600000000000005,"15min":0.61499999999999999},"max":{"1min":1.859,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4299999999999999,"15min":1.4179999999999999},"min":{"1min":1.038,"5min":0.90900000000000003,"15min":0.68799999999999994},"max":{"1min":1.766,"5min":2.524,"15min":2.524},"last":1.2330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575757,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2162688,"data_stored":1123023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.252},"min":{"1min":0.87,"5min":0.749,"15min":0.60499999999999998},"max":{"1min":1.5249999999999999,"5min":1.774,"15min":1.774},"last":1.397},{"interface":"front","average":{"1min":1.353,"5min":1.3779999999999999,"15min":1.361},"min":{"1min":0.90900000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.913,"15min":1.913},"last":1.381}]},{"osd":1,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.167,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.56299999999999994},"max":{"1min":1.5429999999999999,"5min":1.627,"15min":1.7709999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.198,"15min":1.1830000000000001},"min":{"1min":0.95699999999999996,"5min":0.872,"15min":0.69799999999999995},"max":{"1min":1.4279999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.1899999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.234,"15min":1.234},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.65300000000000002},"max":{"1min":1.4950000000000001,"5min":1.698,"15min":1.829},"last":1.282},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.252,"15min":1.252},"min":{"1min":0.87,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3460000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3169999999999999,"15min":1.2949999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.63},"max":{"1min":1.575,"5min":1.796,"15min":1.796},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.355,"15min":1.3440000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.752},"max":{"1min":1.556,"5min":1.718,"15min":1.736},"last":1.496}]},{"osd":4,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.151,"15min":1.149},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.61099999999999999},"max":{"1min":1.6499999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.94299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":1.798,"15min":1.917},"last":1.117}]},{"osd":6,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3260000000000001,"15min":1.3169999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.49299999999999999},"max":{"1min":1.6830000000000001,"5min":1.7310000000000001,"15min":1.867},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3540000000000001,"15min":1.3200000000000001},"min":{"1min":1.026,"5min":0.85499999999999998,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3}]},{"osd":7,"last update":"Sun Dec 24 19:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.423,"15min":1.413},"min":{"1min":0.91800000000000004,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":1.9419999999999999,"15min":2.0569999999999999},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4610000000000001,"15min":1.4530000000000001},"min":{"1min":0.99399999999999999,"5min":0.89700000000000002,"15min":0.60499999999999998},"max":{"1min":1.7010000000000001,"5min":1.917,"15min":1.962},"last":1.5660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311700,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060140,"statfs":{"total":96636764160,"available":96317583360,"internally_reserved":0,"allocated":2174976,"data_stored":1124559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":1.387},{"interface":"front","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.28},"min":{"1min":0.622,"5min":0.622,"15min":0.58399999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.093}]},{"osd":1,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2110000000000001,"15min":1.1679999999999999},"min":{"1min":0.83099999999999996,"5min":0.65500000000000003,"15min":0.434},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1990000000000001,"15min":1.1539999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.1550000000000002,"5min":4.1550000000000002,"15min":4.1550000000000002},"last":1.2869999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.391,"15min":1.369},"min":{"1min":0.746,"5min":0.746,"15min":0.63900000000000001},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.397,"15min":1.3600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.694,"5min":3.694,"15min":3.694},"last":1.6579999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.238,"15min":1.1919999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.46400000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.99399999999999999,"5min":0.89400000000000002,"15min":0.63900000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.0589999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3140000000000001,"15min":1.2849999999999999},"min":{"1min":0.77500000000000002,"5min":0.625,"15min":0.52200000000000002},"max":{"1min":3.29,"5min":3.29,"15min":3.29},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.361,"15min":1.3300000000000001},"min":{"1min":0.92400000000000004,"5min":0.72999999999999998,"15min":0.58799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.544}]},{"osd":6,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.2929999999999999,"15min":1.266},"min":{"1min":1.095,"5min":0.79900000000000004,"15min":0.56000000000000005},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.766},{"interface":"front","average":{"1min":1.419,"5min":1.3460000000000001,"15min":1.3220000000000001},"min":{"1min":0.95699999999999996,"5min":0.621,"15min":0.621},"max":{"1min":1.853,"5min":1.887,"15min":1.887},"last":1.587}]},{"osd":7,"last update":"Sun Dec 24 19:51:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.3320000000000001,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.77900000000000003,"15min":0.54500000000000004},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4430000000000001,"15min":1.4199999999999999},"min":{"1min":1.042,"5min":0.91000000000000003,"15min":0.69899999999999995},"max":{"1min":1.843,"5min":2,"15min":2},"last":1.1659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575756,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1123611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.628},"max":{"1min":1.6499999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.175,"5min":1.1559999999999999,"15min":1.1379999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.98299999999999998,"15min":1.018},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4410000000000001,"5min":1.482,"15min":1.6519999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.343,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":0.99399999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.149,"15min":1.149},"min":{"1min":0.68100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6879999999999999,"5min":1.6910000000000001,"15min":1.8180000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.276,"5min":1.2230000000000001,"15min":1.2170000000000001},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.381,"15min":1.395},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8120000000000001,"5min":1.899,"15min":1.907},"last":0.85999999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.4239999999999999,"15min":1.4510000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8799999999999999,"5min":2.246,"15min":2.246},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.484,"15min":1.454},"min":{"1min":1.2230000000000001,"5min":1.0529999999999999,"15min":1.0209999999999999},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.085}]},{"osd":6,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5329999999999999,"15min":1.5189999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0349999999999999},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.4570000000000001,"15min":1.429},"min":{"1min":0.996,"5min":0.98299999999999998,"15min":0.878},"max":{"1min":3,"5min":3,"15min":3},"last":1.0129999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.506,"15min":1.494},"min":{"1min":0.995,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5309999999999999,"15min":1.5469999999999999},"min":{"1min":0.85699999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8169999999999999,"5min":2.1509999999999998,"15min":2.1779999999999999},"last":1.046}]}]},{"osd":2,"up_from":13,"seq":55834575758,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315792,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056048,"statfs":{"total":96636764160,"available":96313393152,"internally_reserved":0,"allocated":2170880,"data_stored":1123135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97799999999999998,"15min":0.97299999999999998},"min":{"1min":0.72099999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.367,"5min":2.0699999999999998,"15min":2.2309999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.169,"15min":1.1459999999999999},"min":{"1min":0.85699999999999998,"5min":0.55900000000000005,"15min":0.35099999999999998},"max":{"1min":1.3140000000000001,"5min":1.7290000000000001,"15min":1.7849999999999999},"last":1.224}]},{"osd":1,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.377},"max":{"1min":1.3200000000000001,"5min":1.9159999999999999,"15min":2.4769999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0960000000000001,"15min":1.1379999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.498},"max":{"1min":1.52,"5min":1.698,"15min":2.1789999999999998},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.175,"15min":1.1559999999999999},"min":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.131},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1100000000000001,"15min":1.121},"min":{"1min":0.83499999999999996,"5min":0.70299999999999996,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.5960000000000001,"15min":2.5270000000000001},"last":1.052}]},{"osd":4,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":0.99399999999999999,"5min":0.86099999999999999,"15min":0.68200000000000005},"max":{"1min":1.597,"5min":1.7310000000000001,"15min":1.994},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.343,"15min":1.3260000000000001},"min":{"1min":1.0149999999999999,"5min":0.95399999999999996,"15min":0.70099999999999996},"max":{"1min":1.8600000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2969999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.333,"15min":1.3420000000000001},"min":{"1min":1.0329999999999999,"5min":0.89200000000000002,"15min":0.73199999999999998},"max":{"1min":1.4430000000000001,"5min":1.863,"15min":2.641},"last":1.407},{"interface":"front","average":{"1min":1.391,"5min":1.4470000000000001,"15min":1.4319999999999999},"min":{"1min":1.0720000000000001,"5min":0.999,"15min":0.76700000000000002},"max":{"1min":1.669,"5min":1.982,"15min":1.982},"last":1.3740000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.179,"5min":0.94099999999999995,"15min":0.65800000000000003},"max":{"1min":1.927,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.47,"15min":1.4690000000000001},"min":{"1min":1.2370000000000001,"5min":1.0880000000000001,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.966,"15min":2.4260000000000002},"last":1.2669999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5600000000000001,"15min":1.542},"min":{"1min":1.145,"5min":1.145,"15min":0.63300000000000001},"max":{"1min":1.8049999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.476},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.5289999999999999},"min":{"1min":1.181,"5min":1.0840000000000001,"15min":0.79800000000000004},"max":{"1min":1.964,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.3879999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2166784,"data_stored":1123093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3360000000000001,"5min":1.421,"15min":1.647},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.1479999999999999,"15min":1.145},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.88900000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3640000000000001,"5min":1.744,"15min":1.744},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.145,"15min":1.1220000000000001},"min":{"1min":0.79000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.706,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.196}]},{"osd":3,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.268,"15min":1.2649999999999999},"min":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.629},"max":{"1min":1.669,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.64700000000000002},"max":{"1min":1.702,"5min":1.726,"15min":1.823},"last":1.288}]},{"osd":4,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2789999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.429,"15min":1.423},"min":{"1min":0.93500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.7729999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.413,"15min":1.407},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.948},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.383},"min":{"1min":0.97699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":2.2189999999999999},"last":1.48}]},{"osd":6,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5189999999999999,"15min":1.506},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8919999999999999,"5min":2.1269999999999998,"15min":2.1669999999999998},"last":1.466},{"interface":"front","average":{"1min":1.474,"5min":1.514,"15min":1.5},"min":{"1min":1.1259999999999999,"5min":1.008,"15min":0.88900000000000001},"max":{"1min":1.7969999999999999,"5min":2.1339999999999999,"15min":2.323},"last":1.526}]},{"osd":7,"last update":"Sun Dec 24 19:51:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5640000000000001,"15min":1.5509999999999999},"min":{"1min":1.1100000000000001,"5min":0.999,"15min":0.999},"max":{"1min":1.95,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.53,"15min":1.5109999999999999},"min":{"1min":1.0109999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.954,"5min":2.532,"15min":2.532},"last":1.792}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300004,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071836,"statfs":{"total":96636764160,"available":96329560064,"internally_reserved":0,"allocated":2781184,"data_stored":1715605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90300000000000002,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55400000000000005,"15min":0.42299999999999999},"max":{"1min":1.478,"5min":1.6859999999999999,"15min":1.7250000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0669999999999999,"15min":1.018},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.50800000000000001},"max":{"1min":1.504,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.745}]},{"osd":2,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0609999999999999,"15min":1.0940000000000001},"min":{"1min":0.79800000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"max":{"1min":1.6950000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.129,"15min":1.137},"min":{"1min":0.93100000000000005,"5min":0.67800000000000005,"15min":0.61599999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.833},"last":1.145}]},{"osd":3,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.68500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6319999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.746,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8959999999999999},"last":1.0189999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.405,"15min":1.381},"min":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.90400000000000003},"max":{"1min":1.8180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.998},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.335,"15min":1.3160000000000001},"min":{"1min":0.91900000000000004,"5min":0.85699999999999998,"15min":0.80200000000000005},"max":{"1min":1.8720000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2709999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4399999999999999,"15min":1.4279999999999999},"min":{"1min":1.129,"5min":0.87,"15min":0.87},"max":{"1min":1.752,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4570000000000001,"15min":1.444},"min":{"1min":1.1699999999999999,"5min":0.89600000000000002,"15min":0.66600000000000004},"max":{"1min":1.954,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.1140000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4890000000000001,"15min":1.496},"min":{"1min":1.262,"5min":1.0269999999999999,"15min":1},"max":{"1min":1.754,"5min":2.1309999999999998,"15min":2.4119999999999999},"last":1.194}]},{"osd":7,"last update":"Sun Dec 24 19:51:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.526,"15min":1.526},"min":{"1min":1.1919999999999999,"5min":1.052,"15min":0.82299999999999995},"max":{"1min":2.4169999999999998,"5min":2.46,"15min":2.46},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.476,"15min":1.468},"min":{"1min":0.84599999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.829,"5min":1.9870000000000001,"15min":2.2040000000000002},"last":1.6970000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T19:52:30.198 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:52:30.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T19:52:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.414+0000 7fc45daf0700 1 Processor -- start 2023-12-24T19:52:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.414+0000 7fc45daf0700 1 -- start start 2023-12-24T19:52:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc45daf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4580cf8a0 0x7fc45806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc45daf0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580cd680 con 0x7fc45806ac40 2023-12-24T19:52:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc45daf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45806d8f0 con 0x7fc4580cf4d0 2023-12-24T19:52:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc45daf0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc458159640 con 0x7fc4580cf8a0 2023-12-24T19:52:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc457fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc45806ac40 0x7fc4580cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50854/0 (socket says 172.21.15.50:50854) 2023-12-24T19:52:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc457fff700 1 -- 172.21.15.50:0/3111697249 learned_addr learned my addr 172.21.15.50:0/3111697249 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc456ffd700 1 --2- 172.21.15.50:0/3111697249 >> v2:172.21.15.82:3300/0 conn(0x7fc4580cf8a0 0x7fc45806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640826668 0 0) 0x7fc4580cd680 con 0x7fc45806ac40 2023-12-24T19:52:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc440003570 con 0x7fc45806ac40 2023-12-24T19:52:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970326453 0 0) 0x7fc440003570 con 0x7fc45806ac40 2023-12-24T19:52:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc456ffd700 1 -- 172.21.15.50:0/3111697249 >> v1:172.21.15.82:6789/0 conn(0x7fc4580cf4d0 legacy=0x7fc45806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc456ffd700 1 -- 172.21.15.50:0/3111697249 >> v1:172.21.15.50:6789/0 conn(0x7fc45806ac40 legacy=0x7fc4580cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.418+0000 7fc456ffd700 1 -- 172.21.15.50:0/3111697249 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45806b030 con 0x7fc4580cf8a0 2023-12-24T19:52:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc456ffd700 1 --2- 172.21.15.50:0/3111697249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45806a700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098e0 tx=0x7fc44c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb5bda18c964a89 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500017f0 con 0x7fc4580cf8a0 2023-12-24T19:52:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c011420 con 0x7fc4580cf8a0 2023-12-24T19:52:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc4567fc700 1 -- 172.21.15.50:0/3111697249 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0117a0 con 0x7fc4580cf8a0 2023-12-24T19:52:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 -- 172.21.15.50:0/3111697249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 msgr2=0x7fc45806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3111697249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45806a700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098e0 tx=0x7fc44c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 -- 172.21.15.50:0/3111697249 shutdown_connections 2023-12-24T19:52:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3111697249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45806a700 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 -- 172.21.15.50:0/3111697249 >> 172.21.15.50:0/3111697249 conn(0x7fc458067b30 msgr2=0x7fc4580cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 -- 172.21.15.50:0/3111697249 shutdown_connections 2023-12-24T19:52:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.422+0000 7fc45daf0700 1 -- 172.21.15.50:0/3111697249 wait complete. 2023-12-24T19:52:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 Processor -- start 2023-12-24T19:52:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 -- start start 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458155ba0 con 0x7fc45806ac40 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815dd70 con 0x7fc4580cf8a0 2023-12-24T19:52:30.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc45daf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815e050 con 0x7fc4580cf4d0 2023-12-24T19:52:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc4577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc456ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc4577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40034/0 (socket says 172.21.15.50:40034) 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc456ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:36912/0 (socket says 172.21.15.50:36912) 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc457fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.426+0000 7fc4577fe700 1 -- 172.21.15.50:0/3920379632 learned_addr learned my addr 172.21.15.50:0/3920379632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 -- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 msgr2=0x7fc45815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 -- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 msgr2=0x7fc45815d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45815d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 -- 172.21.15.50:0/3920379632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009420 con 0x7fc45806ac40 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc456ffd700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc457fff700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:30.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc4577fe700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c590 tx=0x7fc44800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448011590 con 0x7fc45806ac40 2023-12-24T19:52:30.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448011710 con 0x7fc45806ac40 2023-12-24T19:52:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448011ad0 con 0x7fc45806ac40 2023-12-24T19:52:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45815e330 con 0x7fc45806ac40 2023-12-24T19:52:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45815e8f0 con 0x7fc45806ac40 2023-12-24T19:52:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.430+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45815a750 con 0x7fc45806ac40 2023-12-24T19:52:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.434+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc44801b3b0 con 0x7fc45806ac40 2023-12-24T19:52:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.434+0000 7fc43f7fe700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 0x7fc444062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.434+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fc44807bfa0 con 0x7fc45806ac40 2023-12-24T19:52:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.434+0000 7fc456ffd700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 0x7fc444062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.434+0000 7fc456ffd700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 0x7fc444062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cfc90 tx=0x7fc44c016000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.442+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc45815a750 con 0x7fc45806ac40 2023-12-24T19:52:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.666+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc45815a750 con 0x7fc45806ac40 2023-12-24T19:52:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.678+0000 7fc43f7fe700 1 -- 172.21.15.50:0/3920379632 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc45815a750 con 0x7fc45806ac40 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 msgr2=0x7fc444062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 0x7fc444062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cfc90 tx=0x7fc44c016000 comp rx=0 tx=0).stop 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 msgr2=0x7fc4580c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c590 tx=0x7fc44800c8a0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 shutdown_connections 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc444060550 0x7fc444062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580cf8a0 0x7fc45815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4580cf4d0 0x7fc45815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 --2- 172.21.15.50:0/3920379632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45806ac40 0x7fc4580c65f0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 >> 172.21.15.50:0/3920379632 conn(0x7fc458067b30 msgr2=0x7fc4580cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 shutdown_connections 2023-12-24T19:52:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.682+0000 7fc45daf0700 1 -- 172.21.15.50:0/3920379632 wait complete. 2023-12-24T19:52:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T19:52:30.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:52:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.858+0000 7f7d3304c700 1 Processor -- start 2023-12-24T19:52:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.858+0000 7f7d3304c700 1 -- start start 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3304c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3304c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d2c06d8c0 0x7f7d2c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3304c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2c06b640 con 0x7f7d2c158e00 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3304c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c159710 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3304c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c0b5e10 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d3284b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d2c06d8c0 0x7f7d2c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:43650/0 (socket says 172.21.15.50:43650) 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 -- 172.21.15.50:0/1733048619 learned_addr learned my addr 172.21.15.50:0/1733048619 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 -- 172.21.15.50:0/1733048619 >> v2:172.21.15.50:3300/0 conn(0x7f7d2c06d8c0 msgr2=0x7f7d2c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 --2- 172.21.15.50:0/1733048619 >> v2:172.21.15.50:3300/0 conn(0x7f7d2c06d8c0 0x7f7d2c159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 -- 172.21.15.50:0/1733048619 >> v1:172.21.15.82:6789/0 conn(0x7f7d2c158e00 legacy=0x7f7d2c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 -- 172.21.15.50:0/1733048619 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c06b8e0 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31849700 1 --2- 172.21.15.50:0/1733048619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a510 tx=0x7f7d1c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7b6694cb2ca536 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31048700 1 -- 172.21.15.50:0/1733048619 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c009e70 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31048700 1 -- 172.21.15.50:0/1733048619 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00b860 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.862+0000 7f7d31048700 1 -- 172.21.15.50:0/1733048619 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00bc00 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 -- 172.21.15.50:0/1733048619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c0b41e0 msgr2=0x7f7d2c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 --2- 172.21.15.50:0/1733048619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a510 tx=0x7f7d1c009250 comp rx=0 tx=0).stop 2023-12-24T19:52:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 -- 172.21.15.50:0/1733048619 shutdown_connections 2023-12-24T19:52:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 --2- 172.21.15.50:0/1733048619 >> v2:172.21.15.50:3300/0 conn(0x7f7d2c06d8c0 0x7f7d2c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 --2- 172.21.15.50:0/1733048619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c0b41e0 0x7f7d2c1591d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 -- 172.21.15.50:0/1733048619 >> 172.21.15.50:0/1733048619 conn(0x7f7d2c067b80 msgr2=0x7f7d2c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 -- 172.21.15.50:0/1733048619 shutdown_connections 2023-12-24T19:52:30.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 -- 172.21.15.50:0/1733048619 wait complete. 2023-12-24T19:52:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.866+0000 7f7d3304c700 1 Processor -- start 2023-12-24T19:52:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 -- start start 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2c0b41e0 0x7f7d2c14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 0x7f7d2c1694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0ad4b0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0ad790 con 0x7f7d2c158e00 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0ada70 con 0x7f7d2c0b41e0 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40054/0 (socket says 172.21.15.50:40054) 2023-12-24T19:52:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 -- 172.21.15.50:0/3495978269 learned_addr learned my addr 172.21.15.50:0/3495978269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d31849700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2c0b41e0 0x7f7d2c14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3284b700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 0x7f7d2c1694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 -- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2c0b41e0 msgr2=0x7f7d2c14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2c0b41e0 0x7f7d2c14f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 -- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 msgr2=0x7f7d2c1694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 0x7f7d2c1694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 -- 172.21.15.50:0/3495978269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0094f0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3284b700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 0x7f7d2c1694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3204a700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c4e0 tx=0x7f7d2800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011590 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28011710 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2c0ae5e0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.870+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011ad0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.874+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c0ad080 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.874+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c04be40 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.874+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7d2801b3b0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.878+0000 7f7d227fc700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 0x7f7d10062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.878+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f7d2807bfa0 con 0x7f7d2c06d8c0 2023-12-24T19:52:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.878+0000 7f7d31849700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 0x7f7d10062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.878+0000 7f7d31849700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 0x7f7d10062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a510 tx=0x7f7d1c017000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:30.882+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d2804c2c0 con 0x7f7d2c06d8c0 2023-12-24T19:52:31.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.094+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d2c06bbc0 con 0x7f7d2c06d8c0 2023-12-24T19:52:31.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d227fc700 1 -- 172.21.15.50:0/3495978269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f7d28017020 con 0x7f7d2c06d8c0 2023-12-24T19:52:31.100 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T19:52:31.100 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 msgr2=0x7f7d10062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 0x7f7d10062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a510 tx=0x7f7d1c017000 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 msgr2=0x7f7d2c0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c4e0 tx=0x7f7d2800c8a0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 shutdown_connections 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f7d10060580 0x7f7d10062a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d2c158e00 0x7f7d2c1694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7d2c0b41e0 0x7f7d2c14f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 --2- 172.21.15.50:0/3495978269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d2c06d8c0 0x7f7d2c0acb40 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 >> 172.21.15.50:0/3495978269 conn(0x7f7d2c067b80 msgr2=0x7f7d2c0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 shutdown_connections 2023-12-24T19:52:31.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.098+0000 7f7d3304c700 1 -- 172.21.15.50:0/3495978269 wait complete. 2023-12-24T19:52:31.104 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T19:52:31.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:52:20.070007+0000', 'modified': '2023-12-24T19:52:23.659220+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9273': {'gid': 9273, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6833/1417362913', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 1417362913}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 1417362913}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:52:31.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:52:31.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T19:52:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.702+0000 7f1ce5785700 1 Processor -- start 2023-12-24T19:52:31.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.702+0000 7f1ce5785700 1 -- start start 2023-12-24T19:52:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1ce5785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ce0155ae0 0x7f1ce00c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1ce5785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1ce5785700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce006e020 con 0x7f1ce006e4b0 2023-12-24T19:52:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1ce5785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce00c9070 con 0x7f1ce0155ae0 2023-12-24T19:52:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1ce5785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00c9350 con 0x7f1ce006ebe0 2023-12-24T19:52:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:36932/0 (socket says 172.21.15.50:36932) 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 -- 172.21.15.50:0/1119136677 learned_addr learned my addr 172.21.15.50:0/1119136677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cdeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ce0155ae0 0x7f1ce00c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 -- 172.21.15.50:0/1119136677 >> v2:172.21.15.50:3300/0 conn(0x7f1ce0155ae0 msgr2=0x7f1ce00c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/1119136677 >> v2:172.21.15.50:3300/0 conn(0x7f1ce0155ae0 0x7f1ce00c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 -- 172.21.15.50:0/1119136677 >> v1:172.21.15.82:6789/0 conn(0x7f1ce006e4b0 legacy=0x7f1ce0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cde7fc700 1 -- 172.21.15.50:0/1119136677 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce006d9d0 con 0x7f1ce006ebe0 2023-12-24T19:52:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.706+0000 7f1cddffb700 1 -- 172.21.15.50:0/1119136677 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703002441 0 0) 0x7f1ce006e020 con 0x7f1ce006e4b0 2023-12-24T19:52:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/1119136677 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400bc50 tx=0x7f1cd400b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d88784d3f027cca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1cddffb700 1 -- 172.21.15.50:0/1119136677 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400dbf0 con 0x7f1ce006ebe0 2023-12-24T19:52:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1cddffb700 1 -- 172.21.15.50:0/1119136677 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd400dd50 con 0x7f1ce006ebe0 2023-12-24T19:52:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1cddffb700 1 -- 172.21.15.50:0/1119136677 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40196b0 con 0x7f1ce006ebe0 2023-12-24T19:52:31.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- 172.21.15.50:0/1119136677 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 msgr2=0x7f1ce00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 --2- 172.21.15.50:0/1119136677 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400bc50 tx=0x7f1cd400b4f0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- 172.21.15.50:0/1119136677 shutdown_connections 2023-12-24T19:52:31.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 --2- 172.21.15.50:0/1119136677 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce006ebe0 0x7f1ce00cbf00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 --2- 172.21.15.50:0/1119136677 >> v2:172.21.15.50:3300/0 conn(0x7f1ce0155ae0 0x7f1ce00c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- 172.21.15.50:0/1119136677 >> 172.21.15.50:0/1119136677 conn(0x7f1ce00ccb20 msgr2=0x7f1ce00ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- 172.21.15.50:0/1119136677 shutdown_connections 2023-12-24T19:52:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- 172.21.15.50:0/1119136677 wait complete. 2023-12-24T19:52:31.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 Processor -- start 2023-12-24T19:52:31.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.710+0000 7f1ce5785700 1 -- start start 2023-12-24T19:52:31.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce006ebe0 0x7f1ce00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce0155ae0 0x7f1ce0149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014aa10 con 0x7f1ce006e4b0 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00b27a0 con 0x7f1ce006ebe0 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014a3c0 con 0x7f1ce0155ae0 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40062/0 (socket says 172.21.15.50:40062) 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 -- 172.21.15.50:0/4066589265 learned_addr learned my addr 172.21.15.50:0/4066589265 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce006ebe0 0x7f1ce00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce0155ae0 0x7f1ce0149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 -- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce0155ae0 msgr2=0x7f1ce0149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce0155ae0 0x7f1ce0149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 -- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce006ebe0 msgr2=0x7f1ce00afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce006ebe0 0x7f1ce00afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 -- 172.21.15.50:0/4066589265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd400b790 con 0x7f1ce006e4b0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000ec80 tx=0x7f1cd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cc6ffd700 1 -- 172.21.15.50:0/4066589265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000c9d0 con 0x7f1ce006e4b0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cc6ffd700 1 -- 172.21.15.50:0/4066589265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000cb30 con 0x7f1ce006e4b0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce014a6a0 con 0x7f1ce006e4b0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1cc6ffd700 1 -- 172.21.15.50:0/4066589265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0013470 con 0x7f1ce006e4b0 2023-12-24T19:52:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.714+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce0149ed0 con 0x7f1ce006e4b0 2023-12-24T19:52:31.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.718+0000 7f1cc6ffd700 1 -- 172.21.15.50:0/4066589265 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1cd0013820 con 0x7f1ce006e4b0 2023-12-24T19:52:31.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 Processor -- start 2023-12-24T19:52:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 -- start start 2023-12-24T19:52:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cc6ffd700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 0x7f1ccc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cc6ffd700 1 -- 172.21.15.50:0/4066589265 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1cd007cef0 con 0x7f1ce006e4b0 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 0x7f1ccc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x187e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x187e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17abf30 con 0x1600ae0 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a7ed0 con 0x164b790 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x176e0b0 con 0x1600710 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40076/0 (socket says 172.21.15.50:40076) 2023-12-24T19:52:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 -- 172.21.15.50:0/1434841084 learned_addr learned my addr 172.21.15.50:0/1434841084 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x187e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x187e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 -- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 msgr2=0x187e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x187e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 -- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 msgr2=0x187e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x187e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.722+0000 7f1cdeffd700 1 -- 172.21.15.50:0/1434841084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x164c9e0 con 0x1600ae0 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1cd007b070 tx=0x7f1cd007b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7aa16b280d6adc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 0x7f1ccc062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8007fd0 tx=0x7f1cd8009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1cbffff700 1 -- 172.21.15.50:0/1434841084 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0057e10 con 0x1600ae0 2023-12-24T19:52:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1cbffff700 1 -- 172.21.15.50:0/1434841084 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0050e30 con 0x1600ae0 2023-12-24T19:52:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1cbffff700 1 -- 172.21.15.50:0/1434841084 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd004f1d0 con 0x1600ae0 2023-12-24T19:52:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- 172.21.15.50:0/1434841084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 msgr2=0x187df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1cd007b070 tx=0x7f1cd007b000 comp rx=0 tx=0).stop 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- 172.21.15.50:0/1434841084 shutdown_connections 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x187e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x187e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/1434841084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x187df00 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- 172.21.15.50:0/1434841084 >> 172.21.15.50:0/1434841084 conn(0x1600eb0 msgr2=0x183a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- 172.21.15.50:0/1434841084 shutdown_connections 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- 172.21.15.50:0/1434841084 wait complete. 2023-12-24T19:52:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 -- start start 2023-12-24T19:52:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.726+0000 7f1ce7a78740 1 Processor -- start 2023-12-24T19:52:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x1882510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x1863cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x176dd50 con 0x1600ae0 2023-12-24T19:52:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1746970 con 0x164b790 2023-12-24T19:52:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1770920 con 0x1600710 2023-12-24T19:52:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 10 client.0 _ll_register_callbacks cb 0x17f16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40088/0 (socket says 172.21.15.50:40088) 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 -- 172.21.15.50:0/3128139969 learned_addr learned my addr 172.21.15.50:0/3128139969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x1882510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x1863cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 -- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 msgr2=0x1882510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x1882510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 -- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 msgr2=0x1863cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x1863cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 -- 172.21.15.50:0/3128139969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce0149ed0 con 0x1600ae0 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x1882510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d680 tx=0x7f1cd401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d78f6132afb763 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4010470 con 0x1600ae0 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1cd4014070 con 0x1600ae0 2023-12-24T19:52:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1746cc0 con 0x1600ae0 2023-12-24T19:52:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd40107e0 con 0x1600ae0 2023-12-24T19:52:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 10 client.9435 fetch_fsmap learned FSMap version 86 2023-12-24T19:52:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.730+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x1776370 con 0x1600ae0 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1746cc0 con 0x1600ae0 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1cd4010940 con 0x1600ae0 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 10 client.9435 fetch_fsmap finished waiting for FSMap version 86 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 10 client.9435 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 20 client.9435 populate_metadata read hostname 'smithi050' 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x188b6a0 0x188da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 4 client.9435 mds_command: new command op to 9273 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 --> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x174a3e0 con 0x188b6a0 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x188b6a0 0x188da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cbd7fa700 10 client.9435 ms_handle_connect on v2:172.21.15.50:6832/1417362913 2023-12-24T19:52:31.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x188b6a0 0x188da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77271e5175d43a86 server_cookie=af4d20eda427ce28 in_seq=0 out_seq=0 2023-12-24T19:52:31.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3128139969 <== mds.0 v2:172.21.15.50:6832/1417362913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x174a3e0 con 0x188b6a0 2023-12-24T19:52:31.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1cbd7fa700 10 client.9435 handle_command_reply: tid=0 2023-12-24T19:52:31.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 1 client.9435 shutdown 2023-12-24T19:52:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 msgr2=0x1882a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.734+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d680 tx=0x7f1cd401b000 comp rx=0 tx=0).stop 2023-12-24T19:52:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 shutdown_connections 2023-12-24T19:52:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x1863cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1882a50 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x188b6a0 0x188da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3128139969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600710 0x1882510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1cbd7fa700 0 client.9435 ms_handle_reset on v2:172.21.15.50:6832/1417362913 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 >> 172.21.15.50:0/3128139969 conn(0x1600eb0 msgr2=0x1832f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 shutdown_connections 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3128139969 wait complete. 2023-12-24T19:52:31.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.738+0000 7f1ce7a78740 20 client.9435 trim_cache size 0 max 16384 2023-12-24T19:52:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 Processor -- start 2023-12-24T19:52:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 -- start start 2023-12-24T19:52:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1600710 0x187e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 0x1861cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17acef0 con 0x1600ae0 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x17aa590 con 0x1600710 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1748b80 con 0x164b790 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1cde7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40096/0 (socket says 172.21.15.50:40096) 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1cde7fc700 1 -- 172.21.15.50:0/2271438763 learned_addr learned my addr 172.21.15.50:0/2271438763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 0x1861cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.758+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1600710 0x187e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 -- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 msgr2=0x1861cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 0x1861cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 -- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1600710 msgr2=0x187e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1600710 0x187e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 -- 172.21.15.50:0/2271438763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x175cd80 con 0x1600ae0 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 0x1861cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4001eb0 tx=0x7f1cd4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2139c58a2acbedd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cc4ff9700 1 -- 172.21.15.50:0/2271438763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4010ea0 con 0x1600ae0 2023-12-24T19:52:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cc4ff9700 1 -- 172.21.15.50:0/2271438763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd400dec0 con 0x1600ae0 2023-12-24T19:52:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1cc4ff9700 1 -- 172.21.15.50:0/2271438763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40107e0 con 0x1600ae0 2023-12-24T19:52:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 -- 172.21.15.50:0/2271438763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 msgr2=0x1861780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4001eb0 tx=0x7f1cd4023000 comp rx=0 tx=0).stop 2023-12-24T19:52:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 -- 172.21.15.50:0/2271438763 shutdown_connections 2023-12-24T19:52:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x164b790 0x1861cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600ae0 0x1861780 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/2271438763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1600710 0x187e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 -- 172.21.15.50:0/2271438763 >> 172.21.15.50:0/2271438763 conn(0x1600eb0 msgr2=0x1863570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 -- 172.21.15.50:0/2271438763 shutdown_connections 2023-12-24T19:52:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.762+0000 7f1ce7a78740 1 -- 172.21.15.50:0/2271438763 wait complete. 2023-12-24T19:52:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 -- start start 2023-12-24T19:52:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 Processor -- start 2023-12-24T19:52:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600ae0 0x18d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x18d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17ab9d0 con 0x1600710 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x177bf40 con 0x164b790 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x18d08e0 con 0x1600ae0 2023-12-24T19:52:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.766+0000 7f1ce7a78740 10 client.0 _ll_register_callbacks cb 0x15cc9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40102/0 (socket says 172.21.15.50:40102) 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 -- 172.21.15.50:0/3259496976 learned_addr learned my addr 172.21.15.50:0/3259496976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdf7fe700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x18d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600ae0 0x18d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 -- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600ae0 msgr2=0x18d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600ae0 0x18d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 -- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 msgr2=0x18d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x18d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 -- 172.21.15.50:0/3259496976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd8015e20 con 0x1600710 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cdeffd700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0051030 tx=0x7f1cd0066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307b049df6ece4b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0050970 con 0x1600710 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f1cd004f1d0 con 0x1600710 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cd0050e30 con 0x1600710 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd00510d0 con 0x1600710 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 10 client.9441 fetch_fsmap learned FSMap version 86 2023-12-24T19:52:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x1776370 con 0x1600710 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0050e30 con 0x1600710 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1cd0050320 con 0x1600710 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 10 client.9441 fetch_fsmap finished waiting for FSMap version 86 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 10 client.9441 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 20 client.9441 populate_metadata read hostname 'smithi050' 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x18dd810 0x18dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 4 client.9441 mds_command: new command op to 9273 tid=0[{"prefix": "status"}] 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 --> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] -- command(tid 0: {"prefix": "status"}) v1 -- 0x177c410 con 0x18dd810 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.770+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x18dd810 0x18dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1cde7fc700 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x18dd810 0x18dfbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b900562da6353e41 server_cookie=f955ed758b5d965b in_seq=0 out_seq=0 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1cbd7fa700 10 client.9441 ms_handle_connect on v2:172.21.15.50:6832/1417362913 2023-12-24T19:52:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1cbd7fa700 1 -- 172.21.15.50:0/3259496976 <== mds.0 v2:172.21.15.50:6832/1417362913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x177c410 con 0x18dd810 2023-12-24T19:52:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1cbd7fa700 10 client.9441 handle_command_reply: tid=0 2023-12-24T19:52:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 client.9441 shutdown 2023-12-24T19:52:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 msgr2=0x18d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0051030 tx=0x7f1cd0066000 comp rx=0 tx=0).stop 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 shutdown_connections 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x164b790 0x18d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:6832/1417362913,v1:172.21.15.50:6833/1417362913] conn(0x18dd810 0x18dfbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1600ae0 0x18d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 --2- 172.21.15.50:0/3259496976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1600710 0x18d1000 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1cbd7fa700 0 client.9441 ms_handle_reset on v2:172.21.15.50:6832/1417362913 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 >> 172.21.15.50:0/3259496976 conn(0x1600eb0 msgr2=0x1861780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 shutdown_connections 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 1 -- 172.21.15.50:0/3259496976 wait complete. 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce7a78740 20 client.9441 trim_cache size 0 max 16384 2023-12-24T19:52:31.778 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9273, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.141028026000001, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 86, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 173, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 173, 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.096075209999999 2023-12-24T19:52:31.779 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 msgr2=0x7f1ccc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 0x7f1ccc062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8007fd0 tx=0x7f1cd8009040 comp rx=0 tx=0).stop 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 msgr2=0x7f1ce014aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000ec80 tx=0x7f1cd00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 shutdown_connections 2023-12-24T19:52:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f1ccc060550 0x7f1ccc062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ce0155ae0 0x7f1ce0149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce006ebe0 0x7f1ce00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 --2- 172.21.15.50:0/4066589265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ce006e4b0 0x7f1ce014aea0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 >> 172.21.15.50:0/4066589265 conn(0x7f1ce00ccb20 msgr2=0x7f1ce014c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 shutdown_connections 2023-12-24T19:52:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.774+0000 7f1ce5785700 1 -- 172.21.15.50:0/4066589265 wait complete. 2023-12-24T19:52:31.802 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:52:31.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 Processor -- start 2023-12-24T19:52:31.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 -- start start 2023-12-24T19:52:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f64bc0caf40 0x7f64bc0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc15a4d0 con 0x7f64bc156690 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc159610 con 0x7f64bc06cd30 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c284c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0cd2a0 con 0x7f64bc0caf40 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c204b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64bc156690 0x7f64bc156af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50860/0 (socket says 172.21.15.50:50860) 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c204b700 1 -- 172.21.15.50:0/1639515719 learned_addr learned my addr 172.21.15.50:0/1639515719 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.966+0000 7f64c184a700 1 --2- 172.21.15.50:0/1639515719 >> v2:172.21.15.82:3300/0 conn(0x7f64bc0caf40 0x7f64bc0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423373722 0 0) 0x7f64bc15a4d0 con 0x7f64bc156690 2023-12-24T19:52:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a8003570 con 0x7f64bc156690 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168289933 0 0) 0x7f64bc159610 con 0x7f64bc06cd30 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64bc15a4d0 con 0x7f64bc06cd30 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c184a700 1 -- 172.21.15.50:0/1639515719 >> v1:172.21.15.82:6789/0 conn(0x7f64bc06cd30 legacy=0x7f64bc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c184a700 1 -- 172.21.15.50:0/1639515719 >> v1:172.21.15.50:6789/0 conn(0x7f64bc156690 legacy=0x7f64bc156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c184a700 1 -- 172.21.15.50:0/1639515719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0cc8e0 con 0x7f64bc0caf40 2023-12-24T19:52:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c184a700 1 --2- 172.21.15.50:0/1639515719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc0cb310 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009e60 tx=0x7f64b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784e0d333752ef09 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800e070 con 0x7f64bc0caf40 2023-12-24T19:52:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800bab0 con 0x7f64bc0caf40 2023-12-24T19:52:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c0848700 1 -- 172.21.15.50:0/1639515719 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800be70 con 0x7f64bc0caf40 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 -- 172.21.15.50:0/1639515719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 msgr2=0x7f64bc0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 --2- 172.21.15.50:0/1639515719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc0cb310 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009e60 tx=0x7f64b8009780 comp rx=0 tx=0).stop 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 -- 172.21.15.50:0/1639515719 shutdown_connections 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 --2- 172.21.15.50:0/1639515719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc0cb310 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 -- 172.21.15.50:0/1639515719 >> 172.21.15.50:0/1639515719 conn(0x7f64bc0670b0 msgr2=0x7f64bc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 -- 172.21.15.50:0/1639515719 shutdown_connections 2023-12-24T19:52:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.970+0000 7f64c284c700 1 -- 172.21.15.50:0/1639515719 wait complete. 2023-12-24T19:52:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 Processor -- start 2023-12-24T19:52:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 -- start start 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64bc06cd30 0x7f64bc169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc15ebd0 con 0x7f64bc156690 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc16c000 con 0x7f64bc0caf40 2023-12-24T19:52:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c284c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0d05b0 con 0x7f64bc06cd30 2023-12-24T19:52:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c184a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64bc06cd30 0x7f64bc169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40116/0 (socket says 172.21.15.50:40116) 2023-12-24T19:52:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 -- 172.21.15.50:0/2381243460 learned_addr learned my addr 172.21.15.50:0/2381243460 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c1049700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 -- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64bc06cd30 msgr2=0x7f64bc169390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64bc06cd30 0x7f64bc169390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 -- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 msgr2=0x7f64bc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.974+0000 7f64c204b700 1 -- 172.21.15.50:0/2381243460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8009a20 con 0x7f64bc156690 2023-12-24T19:52:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64c204b700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c560 tx=0x7f64b4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4005b30 con 0x7f64bc156690 2023-12-24T19:52:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4005c90 con 0x7f64bc156690 2023-12-24T19:52:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc1415d0 con 0x7f64bc156690 2023-12-24T19:52:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007320 con 0x7f64bc156690 2023-12-24T19:52:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc0cfa50 con 0x7f64bc156690 2023-12-24T19:52:31.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.978+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc04be40 con 0x7f64bc156690 2023-12-24T19:52:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.982+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f64b401b3b0 con 0x7f64bc156690 2023-12-24T19:52:31.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.982+0000 7f64b1ffb700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:31.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.982+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f64b407be40 con 0x7f64bc156690 2023-12-24T19:52:31.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.982+0000 7f64c184a700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:31.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.986+0000 7f64c184a700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 0x7f64a0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009460 tx=0x7f64b8019000 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:31.990+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64b404c0c0 con 0x7f64bc156690 2023-12-24T19:52:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.202+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64bc06bca0 con 0x7f64bc156690 2023-12-24T19:52:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.202+0000 7f64b1ffb700 1 -- 172.21.15.50:0/2381243460 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64b404f6e0 con 0x7f64bc156690 2023-12-24T19:52:32.206 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:52:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 msgr2=0x7f64a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 0x7f64a0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009460 tx=0x7f64b8019000 comp rx=0 tx=0).stop 2023-12-24T19:52:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 msgr2=0x7f64bc15d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c560 tx=0x7f64b4007db0 comp rx=0 tx=0).stop 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 shutdown_connections 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc156690 0x7f64bc15d2f0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc0caf40 0x7f64bc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 --2- 172.21.15.50:0/2381243460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64bc06cd30 0x7f64bc169390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 >> 172.21.15.50:0/2381243460 conn(0x7f64bc0670b0 msgr2=0x7f64bc15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 shutdown_connections 2023-12-24T19:52:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:32.206+0000 7f64c284c700 1 -- 172.21.15.50:0/2381243460 wait complete. 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:52:32.232 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:52:32.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.233 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T19:52:32.253 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:52:32.253 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:52:32.253 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:52:32.253 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.254 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 37858sec preferred_lft 37858sec 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T19:52:32.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:52:32.257 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:52:32.257 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T19:52:32.257 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:52:32.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.258 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:52:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T19:52:32.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.342 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T19:52:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T19:52:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:52:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T19:52:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T19:52:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T19:52:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:52:32.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T19:52:32.409 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T19:52:32.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.560 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T19:52:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:52:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T19:52:32.576 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:52:32.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T19:52:32.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:52:32.661 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:52:32.724 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:52:32.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:52:32.725 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:52:32.787 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T19:52:32.787 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:52:32.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:52:32.917 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:52:32.917 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T19:52:32.941 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T19:52:32.942 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T19:52:32.942 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T19:52:32.942 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T19:52:32.942 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T19:52:32.946 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T19:52:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:52:32.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:52:32.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T19:52:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.189+0000 7fd7bfef0700 1 Processor -- start 2023-12-24T19:52:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.189+0000 7fd7bfef0700 1 -- start start 2023-12-24T19:52:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bfef0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7b806def0 0x7fd7b8168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bfef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b806ca50 con 0x7fd7b80ca3a0 2023-12-24T19:52:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bfef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b806b520 con 0x7fd7b80ca770 2023-12-24T19:52:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bfef0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80c6980 con 0x7fd7b806def0 2023-12-24T19:52:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7be48d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7b806def0 0x7fd7b8168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bdc8c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd7b80ca3a0 0x7fd7b806ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50872/0 (socket says 172.21.15.50:50872) 2023-12-24T19:52:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7bdc8c700 1 -- 172.21.15.50:0/2506012085 learned_addr learned my addr 172.21.15.50:0/2506012085 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7be48d700 1 -- 172.21.15.50:0/2506012085 >> v1:172.21.15.82:6789/0 conn(0x7fd7b80ca770 legacy=0x7fd7b815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7be48d700 1 -- 172.21.15.50:0/2506012085 >> v1:172.21.15.50:6789/0 conn(0x7fd7b80ca3a0 legacy=0x7fd7b806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.193+0000 7fd7be48d700 1 -- 172.21.15.50:0/2506012085 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b806b7f0 con 0x7fd7b806def0 2023-12-24T19:52:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7be48d700 1 --2- 172.21.15.50:0/2506012085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b806def0 0x7fd7b8168380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009e90 tx=0x7fd7b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa44d4e010d7fb99 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bcc8a700 1 -- 172.21.15.50:0/2506012085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000e070 con 0x7fd7b806def0 2023-12-24T19:52:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bcc8a700 1 -- 172.21.15.50:0/2506012085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000bbf0 con 0x7fd7b806def0 2023-12-24T19:52:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bcc8a700 1 -- 172.21.15.50:0/2506012085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012430 con 0x7fd7b806def0 2023-12-24T19:52:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 -- 172.21.15.50:0/2506012085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b806def0 msgr2=0x7fd7b8168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/2506012085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b806def0 0x7fd7b8168380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009e90 tx=0x7fd7b0009780 comp rx=0 tx=0).stop 2023-12-24T19:52:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 -- 172.21.15.50:0/2506012085 shutdown_connections 2023-12-24T19:52:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/2506012085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b806def0 0x7fd7b8168380 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 -- 172.21.15.50:0/2506012085 >> 172.21.15.50:0/2506012085 conn(0x7fd7b80cbba0 msgr2=0x7fd7b80cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 -- 172.21.15.50:0/2506012085 shutdown_connections 2023-12-24T19:52:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.197+0000 7fd7bfef0700 1 -- 172.21.15.50:0/2506012085 wait complete. 2023-12-24T19:52:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 Processor -- start 2023-12-24T19:52:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 -- start start 2023-12-24T19:52:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b806def0 0x7fd7b80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b80ca3a0 0x7fd7b815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80c4da0 con 0x7fd7b80ca770 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8155e50 con 0x7fd7b80ca3a0 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bfef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80c4190 con 0x7fd7b806def0 2023-12-24T19:52:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7be48d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7be48d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40144/0 (socket says 172.21.15.50:40144) 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7be48d700 1 -- 172.21.15.50:0/3386564892 learned_addr learned my addr 172.21.15.50:0/3386564892 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bdc8c700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b806def0 0x7fd7b80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.201+0000 7fd7bd48b700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b80ca3a0 0x7fd7b815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 -- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b806def0 msgr2=0x7fd7b80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b806def0 0x7fd7b80c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 -- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b80ca3a0 msgr2=0x7fd7b815b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b80ca3a0 0x7fd7b815b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 -- 172.21.15.50:0/3386564892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009a20 con 0x7fd7b80ca770 2023-12-24T19:52:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7be48d700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009de0 tx=0x7fd7b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012db0 con 0x7fd7b80ca770 2023-12-24T19:52:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b0021070 con 0x7fd7b80ca770 2023-12-24T19:52:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0026680 con 0x7fd7b80ca770 2023-12-24T19:52:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b80c4470 con 0x7fd7b80ca770 2023-12-24T19:52:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b80c4a30 con 0x7fd7b80ca770 2023-12-24T19:52:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.205+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b80c4f50 con 0x7fd7b80ca770 2023-12-24T19:52:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.209+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd7b0023030 con 0x7fd7b80ca770 2023-12-24T19:52:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.209+0000 7fd7adffb700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 0x7fd79c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.209+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fd7b007ec10 con 0x7fd7b80ca770 2023-12-24T19:52:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.209+0000 7fd7bdc8c700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 0x7fd79c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.213+0000 7fd7bdc8c700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 0x7fd79c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4007130 tx=0x7fd7b4007eb0 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.217+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7b80c4f50 con 0x7fd7b80ca770 2023-12-24T19:52:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.413+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7b80652e0 con 0x7fd79c060550 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7adffb700 1 -- 172.21.15.50:0/3386564892 <== mgr.9084 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd7b80652e0 con 0x7fd79c060550 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T19:52:33.420 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T19:52:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 msgr2=0x7fd79c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 0x7fd79c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4007130 tx=0x7fd7b4007eb0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 msgr2=0x7fd7b815b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009de0 tx=0x7fd7b0019000 comp rx=0 tx=0).stop 2023-12-24T19:52:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 shutdown_connections 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd79c060550 0x7fd79c062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7b80ca770 0x7fd7b815b710 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b80ca3a0 0x7fd7b815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 --2- 172.21.15.50:0/3386564892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b806def0 0x7fd7b80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.417+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 >> 172.21.15.50:0/3386564892 conn(0x7fd7b80cbba0 msgr2=0x7fd7b81576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.421+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 shutdown_connections 2023-12-24T19:52:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.421+0000 7fd7bfef0700 1 -- 172.21.15.50:0/3386564892 wait complete. 2023-12-24T19:52:33.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T19:52:33.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.609+0000 7ff81ee8e700 1 Processor -- start 2023-12-24T19:52:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 -- start start 2023-12-24T19:52:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8180cc780 0x7ff8180ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff81806cd40 0x7ff81806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81806a580 con 0x7ff818158c40 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180cd110 con 0x7ff81806cd40 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.613+0000 7ff81ee8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81806d700 con 0x7ff8180cc780 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff81806cd40 0x7ff81806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff81806cd40 0x7ff81806d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40154/0 (socket says 172.21.15.50:40154) 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 -- 172.21.15.50:0/2001831828 learned_addr learned my addr 172.21.15.50:0/2001831828 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81d68b700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8180cc780 0x7ff8180ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 -- 172.21.15.50:0/2001831828 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8180cc780 msgr2=0x7ff8180ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8180cc780 0x7ff8180ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 -- 172.21.15.50:0/2001831828 >> v1:172.21.15.82:6789/0 conn(0x7ff818158c40 legacy=0x7ff8180cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 -- 172.21.15.50:0/2001831828 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81806a7d0 con 0x7ff81806cd40 2023-12-24T19:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81e68d700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff81806d1c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff810009f20 tx=0x7ff810009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0987e8cf4da32a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ce8a700 1 -- 172.21.15.50:0/2001831828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000e070 con 0x7ff81806cd40 2023-12-24T19:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ce8a700 1 -- 172.21.15.50:0/2001831828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000ba80 con 0x7ff81806cd40 2023-12-24T19:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ce8a700 1 -- 172.21.15.50:0/2001831828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100092e0 con 0x7ff81806cd40 2023-12-24T19:52:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 -- 172.21.15.50:0/2001831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 msgr2=0x7ff81806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff81806d1c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff810009f20 tx=0x7ff810009840 comp rx=0 tx=0).stop 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 -- 172.21.15.50:0/2001831828 shutdown_connections 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff81806d1c0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/2001831828 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8180cc780 0x7ff8180ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 -- 172.21.15.50:0/2001831828 >> 172.21.15.50:0/2001831828 conn(0x7ff8180d0800 msgr2=0x7ff8180b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 -- 172.21.15.50:0/2001831828 shutdown_connections 2023-12-24T19:52:33.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.617+0000 7ff81ee8e700 1 -- 172.21.15.50:0/2001831828 wait complete. 2023-12-24T19:52:33.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 Processor -- start 2023-12-24T19:52:33.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 -- start start 2023-12-24T19:52:33.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8180cc780 0x7ff81815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 0x7ff8180c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815c6f0 con 0x7ff81806cd40 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180caa20 con 0x7ff8180cc780 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81ee8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180cad00 con 0x7ff818158c40 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81de8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81e68d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 0x7ff8180c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81d68b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8180cc780 0x7ff81815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81de8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40162/0 (socket says 172.21.15.50:40162) 2023-12-24T19:52:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81de8c700 1 -- 172.21.15.50:0/4005060642 learned_addr learned my addr 172.21.15.50:0/4005060642 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81e68d700 1 -- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8180cc780 msgr2=0x7ff81815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.621+0000 7ff81e68d700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8180cc780 0x7ff81815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81e68d700 1 -- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 msgr2=0x7ff8181458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81e68d700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81e68d700 1 -- 172.21.15.50:0/4005060642 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810009ae0 con 0x7ff818158c40 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81de8c700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81e68d700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 0x7ff8180c85e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff810015000 tx=0x7ff810018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100032f0 con 0x7ff818158c40 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810008d20 con 0x7ff818158c40 2023-12-24T19:52:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8180cafe0 con 0x7ff818158c40 2023-12-24T19:52:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81001c640 con 0x7ff818158c40 2023-12-24T19:52:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8180cb5a0 con 0x7ff818158c40 2023-12-24T19:52:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.625+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8180cb7c0 con 0x7ff818158c40 2023-12-24T19:52:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.629+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 88) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff810003040 con 0x7ff818158c40 2023-12-24T19:52:33.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.629+0000 7ff80dffb700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 0x7ff7fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:33.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.629+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7ff81007e320 con 0x7ff818158c40 2023-12-24T19:52:33.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.629+0000 7ff81de8c700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 0x7ff7fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:33.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.629+0000 7ff81de8c700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 0x7ff7fc062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff814001e90 tx=0x7ff814009040 comp rx=0 tx=0).ready entity=mgr.9084 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:33.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.637+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff81004e5a0 con 0x7ff818158c40 2023-12-24T19:52:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:33.849+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff81804be40 con 0x7ff818158c40 2023-12-24T19:52:34.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.597+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mgrmap(e 89) v1 ==== 79978+0+0 (secure 0 0 0) 0x7ff81004e970 con 0x7ff818158c40 2023-12-24T19:52:34.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff80dffb700 1 -- 172.21.15.50:0/4005060642 <== mon.2 v2:172.21.15.82:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v89) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff810052030 con 0x7ff818158c40 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 msgr2=0x7ff7fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 0x7ff7fc062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff814001e90 tx=0x7ff814009040 comp rx=0 tx=0).stop 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 msgr2=0x7ff8180c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 0x7ff8180c85e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff810015000 tx=0x7ff810018000 comp rx=0 tx=0).stop 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 shutdown_connections 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7ff7fc060580 0x7ff7fc062a30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff818158c40 0x7ff8180c85e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8180cc780 0x7ff81815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 --2- 172.21.15.50:0/4005060642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff81806cd40 0x7ff8181458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 >> 172.21.15.50:0/4005060642 conn(0x7ff8180d0800 msgr2=0x7ff818153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 shutdown_connections 2023-12-24T19:52:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.601+0000 7ff81ee8e700 1 -- 172.21.15.50:0/4005060642 wait complete. 2023-12-24T19:52:34.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T19:52:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.781+0000 7fddd0545700 1 Processor -- start 2023-12-24T19:52:34.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.781+0000 7fddd0545700 1 -- start start 2023-12-24T19:52:34.788 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:34.784+0000 7ff4c31b1000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:52:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddd0545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddc813f900 0x7fddc806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddd0545700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80c93e0 con 0x7fddc80adbe0 2023-12-24T19:52:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddd0545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80ca220 con 0x7fddc813f530 2023-12-24T19:52:34.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddd0545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc80c9610 con 0x7fddc813f900 2023-12-24T19:52:34.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddceae2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddc80adbe0 0x7fddc80ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50886/0 (socket says 172.21.15.50:50886) 2023-12-24T19:52:34.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddceae2700 1 -- 172.21.15.50:0/1957149661 learned_addr learned my addr 172.21.15.50:0/1957149661 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:34.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.785+0000 7fddcdae0700 1 --2- 172.21.15.50:0/1957149661 >> v2:172.21.15.82:3300/0 conn(0x7fddc813f900 0x7fddc806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:34.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103922035 0 0) 0x7fddc80c93e0 con 0x7fddc80adbe0 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb4003570 con 0x7fddc80adbe0 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147815355 0 0) 0x7fddc80ca220 con 0x7fddc813f530 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc80c93e0 con 0x7fddc813f530 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcdae0700 1 -- 172.21.15.50:0/1957149661 >> v1:172.21.15.82:6789/0 conn(0x7fddc813f530 legacy=0x7fddc80ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcdae0700 1 -- 172.21.15.50:0/1957149661 >> v1:172.21.15.50:6789/0 conn(0x7fddc80adbe0 legacy=0x7fddc80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcdae0700 1 -- 172.21.15.50:0/1957149661 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80c98f0 con 0x7fddc813f900 2023-12-24T19:52:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcdae0700 1 --2- 172.21.15.50:0/1957149661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f900 0x7fddc806d700 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fddb80098e0 tx=0x7fddb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3864ea60711bde8a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011630 con 0x7fddc813f900 2023-12-24T19:52:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8011790 con 0x7fddc813f900 2023-12-24T19:52:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddcd2df700 1 -- 172.21.15.50:0/1957149661 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011b30 con 0x7fddc813f900 2023-12-24T19:52:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 -- 172.21.15.50:0/1957149661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f900 msgr2=0x7fddc806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 --2- 172.21.15.50:0/1957149661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f900 0x7fddc806d700 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fddb80098e0 tx=0x7fddb80091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 -- 172.21.15.50:0/1957149661 shutdown_connections 2023-12-24T19:52:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 --2- 172.21.15.50:0/1957149661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f900 0x7fddc806d700 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 -- 172.21.15.50:0/1957149661 >> 172.21.15.50:0/1957149661 conn(0x7fddc8067b80 msgr2=0x7fddc80cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:34.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 -- 172.21.15.50:0/1957149661 shutdown_connections 2023-12-24T19:52:34.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.789+0000 7fddd0545700 1 -- 172.21.15.50:0/1957149661 wait complete. 2023-12-24T19:52:34.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 Processor -- start 2023-12-24T19:52:34.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 -- start start 2023-12-24T19:52:34.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:34.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 0x7fddc815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:34.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 0x7fddc81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:34.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8169b80 con 0x7fddc80adbe0 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8157d10 con 0x7fddc813f530 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddd0545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc815a810 con 0x7fddc813f900 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddce2e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddceae2700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 0x7fddc81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddcdae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 0x7fddc815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddce2e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40186/0 (socket says 172.21.15.50:40186) 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.793+0000 7fddce2e1700 1 -- 172.21.15.50:0/218237924 learned_addr learned my addr 172.21.15.50:0/218237924 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 -- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 msgr2=0x7fddc81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 0x7fddc81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 -- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 msgr2=0x7fddc815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 0x7fddc815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 -- 172.21.15.50:0/218237924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009420 con 0x7fddc80adbe0 2023-12-24T19:52:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddceae2700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 0x7fddc81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddcdae0700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 0x7fddc815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddce2e1700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c790 tx=0x7fddc4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4010510 con 0x7fddc80adbe0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4010670 con 0x7fddc80adbe0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4010a10 con 0x7fddc80adbe0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc80a5210 con 0x7fddc80adbe0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc81579a0 con 0x7fddc80adbe0 2023-12-24T19:52:34.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.797+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc80652e0 con 0x7fddc80adbe0 2023-12-24T19:52:34.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.801+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 89) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fddc401b3b0 con 0x7fddc80adbe0 2023-12-24T19:52:34.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.801+0000 7fddbe7fc700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 0x7fddac062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.801+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fddc407c420 con 0x7fddc80adbe0 2023-12-24T19:52:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.801+0000 7fddcdae0700 1 -- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 msgr2=0x7fddac062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.801+0000 7fddcdae0700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 0x7fddac062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:34.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.805+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddc404c720 con 0x7fddc80adbe0 2023-12-24T19:52:34.811 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:34.809+0000 7f16b9dcc000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:52:34.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.981+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fddc80c9bd0 con 0x7fddc80adbe0 2023-12-24T19:52:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddbe7fc700 1 -- 172.21.15.50:0/218237924 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fddc40170d0 con 0x7fddc80adbe0 2023-12-24T19:52:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 msgr2=0x7fddac062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 0x7fddac062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 msgr2=0x7fddc8169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c790 tx=0x7fddc4007e10 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 shutdown_connections 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fddac060670 0x7fddac062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fddc813f900 0x7fddc81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc813f530 0x7fddc815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 --2- 172.21.15.50:0/218237924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc80adbe0 0x7fddc8169640 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 >> 172.21.15.50:0/218237924 conn(0x7fddc8067b80 msgr2=0x7fddc80c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 shutdown_connections 2023-12-24T19:52:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:34.989+0000 7fddd0545700 1 -- 172.21.15.50:0/218237924 wait complete. 2023-12-24T19:52:35.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T19:52:35.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.185+0000 7f6c8c145700 1 Processor -- start 2023-12-24T19:52:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.185+0000 7f6c8c145700 1 -- start start 2023-12-24T19:52:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8c145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8c145700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c840abfe0 0x7f6c8406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8c145700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8406eec0 con 0x7f6c8406de70 2023-12-24T19:52:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8c145700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c84157400 con 0x7f6c840abfe0 2023-12-24T19:52:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8c145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8406f1a0 con 0x7f6c840abc10 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c896e0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c840abfe0 0x7f6c8406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8a6e2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6c8406de70 0x7f6c840c9cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40450/0 (socket says 172.21.15.50:40450) 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37044/0 (socket says 172.21.15.50:37044) 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c8a6e2700 1 -- 172.21.15.50:0/4014705999 learned_addr learned my addr 172.21.15.50:0/4014705999 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c88edf700 1 -- 172.21.15.50:0/4014705999 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232835331 0 0) 0x7f6c8406eec0 con 0x7f6c8406de70 2023-12-24T19:52:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c88edf700 1 -- 172.21.15.50:0/4014705999 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c70003570 con 0x7f6c8406de70 2023-12-24T19:52:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 -- 172.21.15.50:0/4014705999 >> v2:172.21.15.82:3300/0 conn(0x7f6c840abfe0 msgr2=0x7f6c8406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 --2- 172.21.15.50:0/4014705999 >> v2:172.21.15.82:3300/0 conn(0x7f6c840abfe0 0x7f6c8406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 -- 172.21.15.50:0/4014705999 >> v1:172.21.15.82:6789/0 conn(0x7f6c8406de70 legacy=0x7f6c840c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 -- 172.21.15.50:0/4014705999 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840c97d0 con 0x7f6c840abc10 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c89ee1700 1 --2- 172.21.15.50:0/4014705999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098e0 tx=0x7f6c800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=629a9c509eb00e28 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c88edf700 1 -- 172.21.15.50:0/4014705999 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011630 con 0x7f6c840abc10 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c88edf700 1 -- 172.21.15.50:0/4014705999 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80011790 con 0x7f6c840abc10 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.189+0000 7f6c88edf700 1 -- 172.21.15.50:0/4014705999 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011b30 con 0x7f6c840abc10 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- 172.21.15.50:0/4014705999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 msgr2=0x7f6c84156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 --2- 172.21.15.50:0/4014705999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098e0 tx=0x7f6c800091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- 172.21.15.50:0/4014705999 shutdown_connections 2023-12-24T19:52:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 --2- 172.21.15.50:0/4014705999 >> v2:172.21.15.82:3300/0 conn(0x7f6c840abfe0 0x7f6c8406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 --2- 172.21.15.50:0/4014705999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c84156ec0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- 172.21.15.50:0/4014705999 >> 172.21.15.50:0/4014705999 conn(0x7f6c840afb40 msgr2=0x7f6c840aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- 172.21.15.50:0/4014705999 shutdown_connections 2023-12-24T19:52:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- 172.21.15.50:0/4014705999 wait complete. 2023-12-24T19:52:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 Processor -- start 2023-12-24T19:52:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.193+0000 7f6c8c145700 1 -- start start 2023-12-24T19:52:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c8413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c840abfe0 0x7f6c840a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84150680 con 0x7f6c8406de70 2023-12-24T19:52:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841500c0 con 0x7f6c840abfe0 2023-12-24T19:52:35.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841503a0 con 0x7f6c840abc10 2023-12-24T19:52:35.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40202/0 (socket says 172.21.15.50:40202) 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 -- 172.21.15.50:0/1344135320 learned_addr learned my addr 172.21.15.50:0/1344135320 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c896e0700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c8413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8a6e2700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c840abfe0 0x7f6c840a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 msgr2=0x7f6c8413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c8413ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c840abfe0 msgr2=0x7f6c840a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c840abfe0 0x7f6c840a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 -- 172.21.15.50:0/1344135320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009420 con 0x7f6c8406de70 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c89ee1700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6c84157540 tx=0x7f6c80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80000d10 con 0x7f6c8406de70 2023-12-24T19:52:35.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80011b10 con 0x7f6c8406de70 2023-12-24T19:52:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80025660 con 0x7f6c8406de70 2023-12-24T19:52:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8414cf10 con 0x7f6c8406de70 2023-12-24T19:52:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.197+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c840c7740 con 0x7f6c8406de70 2023-12-24T19:52:35.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c840652e0 con 0x7f6c8406de70 2023-12-24T19:52:35.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 89) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f6c80025a50 con 0x7f6c8406de70 2023-12-24T19:52:35.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c79ffb700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 0x7f6c68062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7f6c8007e350 con 0x7f6c8406de70 2023-12-24T19:52:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c896e0700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 msgr2=0x7f6c68062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.201+0000 7f6c896e0700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 0x7f6c68062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.209+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c8004e5d0 con 0x7f6c8406de70 2023-12-24T19:52:35.336 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:35.332+0000 7ff4c31b1000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:52:35.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.393+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f6c840af5d0 con 0x7f6c8406de70 2023-12-24T19:52:35.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.401+0000 7f6c79ffb700 1 -- 172.21.15.50:0/1344135320 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6c80051bf0 con 0x7f6c8406de70 2023-12-24T19:52:35.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c896e0700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 msgr2=0x7f6c68062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:35.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c896e0700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 0x7f6c68062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:35.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 msgr2=0x7f6c68062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:35.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 0x7f6c68062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 msgr2=0x7f6c840c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6c84157540 tx=0x7f6c80017000 comp rx=0 tx=0).stop 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 shutdown_connections 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f6c680605a0 0x7f6c68062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c840abfe0 0x7f6c840a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c840abc10 0x7f6c8413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 --2- 172.21.15.50:0/1344135320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c8406de70 0x7f6c840c7200 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 >> 172.21.15.50:0/1344135320 conn(0x7f6c840afb40 msgr2=0x7f6c84068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 shutdown_connections 2023-12-24T19:52:35.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.405+0000 7f6c8c145700 1 -- 172.21.15.50:0/1344135320 wait complete. 2023-12-24T19:52:35.414 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:35.412+0000 7ff4c31b1000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:52:35.422 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:35.417+0000 7f16b9dcc000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:52:35.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:52:35.430 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T19:52:35.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:52:35.457 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-12-24T19:52:35.506 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:35.501+0000 7f16b9dcc000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:52:35.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-12-24T19:52:35.564 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:35.560+0000 7ff4c31b1000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:35.667 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:35.665+0000 7f16b9dcc000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.741+0000 7fd8beb45700 1 Processor -- start 2023-12-24T19:52:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.741+0000 7fd8beb45700 1 -- start start 2023-12-24T19:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.741+0000 7fd8beb45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8b80ccf80 0x7fd8b815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8beb45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b806b6b0 con 0x7fd8b815c7a0 2023-12-24T19:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8beb45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80cba20 con 0x7fd8b815c3d0 2023-12-24T19:52:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8beb45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b806c250 con 0x7fd8b80ccf80 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8b815c7a0 0x7fd8b80cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50890/0 (socket says 172.21.15.50:50890) 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b7fff700 1 -- 172.21.15.50:0/3494950734 learned_addr learned my addr 172.21.15.50:0/3494950734 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8bd0e2700 1 --2- 172.21.15.50:0/3494950734 >> v2:172.21.15.82:3300/0 conn(0x7fd8b80ccf80 0x7fd8b815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596416951 0 0) 0x7fd8b806b6b0 con 0x7fd8b815c7a0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a8003570 con 0x7fd8b815c7a0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806930064 0 0) 0x7fd8b80cba20 con 0x7fd8b815c3d0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b806b6b0 con 0x7fd8b815c3d0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1657529548 0 0) 0x7fd8a8003570 con 0x7fd8b815c7a0 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8bd0e2700 1 -- 172.21.15.50:0/3494950734 >> v1:172.21.15.82:6789/0 conn(0x7fd8b815c3d0 legacy=0x7fd8b806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8bd0e2700 1 -- 172.21.15.50:0/3494950734 >> v1:172.21.15.50:6789/0 conn(0x7fd8b815c7a0 legacy=0x7fd8b80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8bd0e2700 1 -- 172.21.15.50:0/3494950734 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b806ad80 con 0x7fd8b80ccf80 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8bd0e2700 1 --2- 172.21.15.50:0/3494950734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b80ccf80 0x7fd8b815d810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009e60 tx=0x7fd8b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64591e3b9c3cdee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000e070 con 0x7fd8b80ccf80 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000b7a0 con 0x7fd8b80ccf80 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8b77fe700 1 -- 172.21.15.50:0/3494950734 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4001470 con 0x7fd8b80ccf80 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8beb45700 1 -- 172.21.15.50:0/3494950734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b80ccf80 msgr2=0x7fd8b815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.745+0000 7fd8beb45700 1 --2- 172.21.15.50:0/3494950734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b80ccf80 0x7fd8b815d810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009e60 tx=0x7fd8b0009780 comp rx=0 tx=0).stop 2023-12-24T19:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 -- 172.21.15.50:0/3494950734 shutdown_connections 2023-12-24T19:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 --2- 172.21.15.50:0/3494950734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b80ccf80 0x7fd8b815d810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 -- 172.21.15.50:0/3494950734 >> 172.21.15.50:0/3494950734 conn(0x7fd8b80670b0 msgr2=0x7fd8b80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 -- 172.21.15.50:0/3494950734 shutdown_connections 2023-12-24T19:52:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 -- 172.21.15.50:0/3494950734 wait complete. 2023-12-24T19:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 Processor -- start 2023-12-24T19:52:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.749+0000 7fd8beb45700 1 -- start start 2023-12-24T19:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 0x7fd8b80a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b815c7a0 0x7fd8b815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8158ba0 con 0x7fd8b80ccf80 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c8200 con 0x7fd8b815c7a0 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c84a0 con 0x7fd8b815c3d0 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40216/0 (socket says 172.21.15.50:40216) 2023-12-24T19:52:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 -- 172.21.15.50:0/1254932469 learned_addr learned my addr 172.21.15.50:0/1254932469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 0x7fd8b80a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bd0e2700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b815c7a0 0x7fd8b815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 msgr2=0x7fd8b80a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 0x7fd8b80a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b815c7a0 msgr2=0x7fd8b815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b815c7a0 0x7fd8b815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009a20 con 0x7fd8b80ccf80 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 0x7fd8b80a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8bc8e1700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c790 tx=0x7fd8ac007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac010510 con 0x7fd8b80ccf80 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac010670 con 0x7fd8b80ccf80 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac010a30 con 0x7fd8b80ccf80 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b80c8780 con 0x7fd8b80ccf80 2023-12-24T19:52:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.753+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b80c8d40 con 0x7fd8b80ccf80 2023-12-24T19:52:35.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.757+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b8159bb0 con 0x7fd8b80ccf80 2023-12-24T19:52:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.757+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 89) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fd8ac01b3b0 con 0x7fd8b80ccf80 2023-12-24T19:52:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.757+0000 7fd8b4ff9700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.761+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6429+0+0 (secure 0 0 0) 0x7fd8ac07c430 con 0x7fd8b80ccf80 2023-12-24T19:52:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.761+0000 7fd8b7fff700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.761+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:52:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.765+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd8b8159bb0 con 0x7fd8b80ccf80 2023-12-24T19:52:35.854 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:35.852+0000 7ff4c31b1000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:52:35.929 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:35.928+0000 7ff4c31b1000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.965+0000 7fd8b7fff700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.965+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T19:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:35.965+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b8159bb0 con 0x7fd89c0605a0 2023-12-24T19:52:35.979 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:35.977+0000 7f16b9dcc000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:52:36.058 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:36.053+0000 7f16b9dcc000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:36.157 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:36.152+0000 7ff4c31b1000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:52:36.243 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:36.240+0000 7ff4c31b1000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:52:36.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:36.285+0000 7f16b9dcc000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:52:36.331 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:36.328+0000 7ff4c31b1000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:52:36.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:36.369+0000 7fd8b7fff700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:36.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:36.369+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T19:52:36.380 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:36.377+0000 7f16b9dcc000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:52:36.475 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:36.469+0000 7f16b9dcc000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:52:36.743 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:36.740+0000 7ff4c31b1000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:52:36.896 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:36.893+0000 7f16b9dcc000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:52:36.909 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:36.908+0000 7ff4c31b1000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:52:37.076 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.073+0000 7f16b9dcc000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:52:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:37.173+0000 7fd8b7fff700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:37.173+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T19:52:37.282 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.280+0000 7ff4c31b1000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:52:37.473 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.469+0000 7f16b9dcc000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:52:37.502 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.500+0000 7ff4c31b1000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:37.594 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.592+0000 7ff4c31b1000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:52:37.672 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.668+0000 7ff4c31b1000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:52:37.705 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.701+0000 7f16b9dcc000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:52:37.752 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.748+0000 7ff4c31b1000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:52:37.798 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.793+0000 7f16b9dcc000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:52:37.877 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.873+0000 7f16b9dcc000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:52:37.961 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:37.957+0000 7f16b9dcc000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:52:38.025 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:37.968+0000 7ff4c31b1000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:38.049 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:38.044+0000 7ff4c31b1000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:52:38.137 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:38.132+0000 7ff4c31b1000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:52:38.186 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:38.181+0000 7f16b9dcc000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:52:38.268 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:38.265+0000 7f16b9dcc000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:52:38.327 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:38.324+0000 7ff4c31b1000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:52:38.362 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:38.357+0000 7f16b9dcc000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:52:38.408 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:38.404+0000 7ff4c31b1000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:52:38.559 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:38.553+0000 7f16b9dcc000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:52:38.646 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:38.641+0000 7f16b9dcc000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:52:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:38.777+0000 7fd8b7fff700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/33814 2023-12-24T19:52:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:38.777+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T19:52:39.113 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T19:52:39.108+0000 7ff4c31b1000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:52:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:39.177+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 90) v1 ==== 79978+0+0 (secure 0 0 0) 0x7fd8ac04ca80 con 0x7fd8b80ccf80 2023-12-24T19:52:39.400 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.397+0000 7f16b9dcc000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:52:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:39.413+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 91) v1 ==== 79689+0+0 (secure 0 0 0) 0x7fd8ac04f860 con 0x7fd8b80ccf80 2023-12-24T19:52:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:39.413+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:52:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:39.413+0000 7fd8b4ff9700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:39.616 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f1678172700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.616 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f1678172700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.616 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f1678172700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.616 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f1678172700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.616 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f1678172700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f167c17a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f167c17a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f167c17a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f167c17a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:39.618 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:52:39.613+0000 7f167c17a700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:52:40.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.421+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 92) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fd8ac04d350 con 0x7fd8b80ccf80 2023-12-24T19:52:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.421+0000 7fd8b4ff9700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.421+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b8159bb0 con 0x7fd89c0605a0 2023-12-24T19:52:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.425+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.429+0000 7fd8b7fff700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c0629d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80cb950 tx=0x7fd8a4000bc0 comp rx=0 tx=0).ready entity=mgr.9483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.537+0000 7fd8b4ff9700 1 -- 172.21.15.50:0/1254932469 <== mgr.9483 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd8b8159bb0 con 0x7fd89c0605a0 2023-12-24T19:52:40.542 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 msgr2=0x7fd89c0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c0629d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80cb950 tx=0x7fd8a4000bc0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 msgr2=0x7fd8b8158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c790 tx=0x7fd8ac007e10 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 shutdown_connections 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fd89c0605a0 0x7fd89c0629d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b815c7a0 0x7fd8b815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8b815c3d0 0x7fd8b80a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 --2- 172.21.15.50:0/1254932469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b80ccf80 0x7fd8b8158660 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 >> 172.21.15.50:0/1254932469 conn(0x7fd8b80670b0 msgr2=0x7fd8b80b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 shutdown_connections 2023-12-24T19:52:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.541+0000 7fd8beb45700 1 -- 172.21.15.50:0/1254932469 wait complete. 2023-12-24T19:52:40.575 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-12-24T19:52:40.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-12-24T19:52:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.749+0000 7f25ff59e700 1 Processor -- start 2023-12-24T19:52:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.749+0000 7f25ff59e700 1 -- start start 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25ff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2600158dd0 0x7f26001591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25ff59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26000ce470 0x7f26000ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25ff59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26000cee10 con 0x7f26000b2cf0 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25ff59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260006aa80 con 0x7f2600158dd0 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25ff59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26000cc0b0 con 0x7f26000ce470 2023-12-24T19:52:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2600158dd0 0x7f26001591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fdd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26000b2cf0 0x7f26000cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55648/0 (socket says 172.21.15.50:55648) 2023-12-24T19:52:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fdd9b700 1 -- 172.21.15.50:0/2738949785 learned_addr learned my addr 172.21.15.50:0/2738949785 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T19:52:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fed9d700 1 --2- 172.21.15.50:0/2738949785 >> v2:172.21.15.82:3300/0 conn(0x7f26000ce470 0x7f26000ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 -- 172.21.15.50:0/2738949785 >> v2:172.21.15.82:3300/0 conn(0x7f26000ce470 msgr2=0x7f26000ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 --2- 172.21.15.50:0/2738949785 >> v2:172.21.15.82:3300/0 conn(0x7f26000ce470 0x7f26000ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 -- 172.21.15.50:0/2738949785 >> v1:172.21.15.50:6789/0 conn(0x7f26000b2cf0 legacy=0x7f26000cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fd59a700 1 -- 172.21.15.50:0/2738949785 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770412911 0 0) 0x7f25f4004b80 con 0x7f26000b2cf0 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 -- 172.21.15.50:0/2738949785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000cc390 con 0x7f2600158dd0 2023-12-24T19:52:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fe59c700 1 --2- 172.21.15.50:0/2738949785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600158dd0 0x7f26001591a0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f26000b5fa0 tx=0x7f25f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cec05784331816 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fd59a700 1 -- 172.21.15.50:0/2738949785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000b6b0 con 0x7f2600158dd0 2023-12-24T19:52:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fd59a700 1 -- 172.21.15.50:0/2738949785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000b810 con 0x7f2600158dd0 2023-12-24T19:52:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.753+0000 7f25fd59a700 1 -- 172.21.15.50:0/2738949785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000bbb0 con 0x7f2600158dd0 2023-12-24T19:52:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- 172.21.15.50:0/2738949785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600158dd0 msgr2=0x7f26001591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- 172.21.15.50:0/2738949785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600158dd0 0x7f26001591a0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f26000b5fa0 tx=0x7f25f00091a0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- 172.21.15.50:0/2738949785 shutdown_connections 2023-12-24T19:52:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- 172.21.15.50:0/2738949785 >> v2:172.21.15.82:3300/0 conn(0x7f26000ce470 0x7f26000ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- 172.21.15.50:0/2738949785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600158dd0 0x7f26001591a0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- 172.21.15.50:0/2738949785 >> 172.21.15.50:0/2738949785 conn(0x7f2600067b80 msgr2=0x7f26000cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- 172.21.15.50:0/2738949785 shutdown_connections 2023-12-24T19:52:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- 172.21.15.50:0/2738949785 wait complete. 2023-12-24T19:52:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 Processor -- start 2023-12-24T19:52:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 -- start start 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26000b2cf0 0x7f26000c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.757+0000 7f25ff59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2600158dd0 0x7f26000aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ff59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000a9640 con 0x7f26000ce470 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ff59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000a8a70 con 0x7f26000b2cf0 2023-12-24T19:52:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ff59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000a8d10 con 0x7f2600158dd0 2023-12-24T19:52:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57458/0 (socket says 172.21.15.50:57458) 2023-12-24T19:52:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 -- 172.21.15.50:0/986303694 learned_addr learned my addr 172.21.15.50:0/986303694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T19:52:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fe59c700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26000b2cf0 0x7f26000c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fed9d700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2600158dd0 0x7f26000aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 -- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2600158dd0 msgr2=0x7f26000aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2600158dd0 0x7f26000aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 -- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26000b2cf0 msgr2=0x7f26000c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26000b2cf0 0x7f26000c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 -- 172.21.15.50:0/986303694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0009420 con 0x7f26000ce470 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25fdd9b700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c810 tx=0x7f25f4007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4005b30 con 0x7f26000ce470 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f4005c90 con 0x7f26000ce470 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000a8ff0 con 0x7f26000ce470 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4007320 con 0x7f26000ce470 2023-12-24T19:52:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.761+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26000a9ad0 con 0x7f26000ce470 2023-12-24T19:52:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.765+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000a97b0 con 0x7f26000ce470 2023-12-24T19:52:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.765+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 92) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f25f4007750 con 0x7f26000ce470 2023-12-24T19:52:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.765+0000 7f25ee7fc700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 0x7f25e0062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:52:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.765+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6687+0+0 (secure 0 0 0) 0x7f25f407bca0 con 0x7f26000ce470 2023-12-24T19:52:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.769+0000 7f25fe59c700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 0x7f25e0062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:52:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.769+0000 7f25fe59c700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 0x7f25e0062970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f25f00093f0 tx=0x7f25f0017000 comp rx=0 tx=0).ready entity=mgr.9483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:52:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.773+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f25f404c120 con 0x7f26000ce470 2023-12-24T19:52:40.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:52:40.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:52:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:40.973+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f26000cee10 con 0x7f25e00604c0 2023-12-24T19:52:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.061+0000 7f25ee7fc700 1 -- 172.21.15.50:0/986303694 <== mgr.9483 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f26000cee10 con 0x7f25e00604c0 2023-12-24T19:52:41.065 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 msgr2=0x7f25e0062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 0x7f25e0062970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f25f00093f0 tx=0x7f25f0017000 comp rx=0 tx=0).stop 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 msgr2=0x7f26000b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c810 tx=0x7f25f4007bf0 comp rx=0 tx=0).stop 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 shutdown_connections 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f25e00604c0 0x7f25e0062970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2600158dd0 0x7f26000aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26000ce470 0x7f26000b2250 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 --2- 172.21.15.50:0/986303694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26000b2cf0 0x7f26000c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:52:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 >> 172.21.15.50:0/986303694 conn(0x7f2600067b80 msgr2=0x7f26000caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:52:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 shutdown_connections 2023-12-24T19:52:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T19:52:41.065+0000 7f25ff59e700 1 -- 172.21.15.50:0/986303694 wait complete. 2023-12-24T19:52:41.092 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-12-24T19:53:00.086 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:53:00.081+0000 7f166b158700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:53:00.086 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:53:00.081+0000 7f166b158700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:53:00.086 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:53:00.081+0000 7f166b158700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:53:00.087 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:53:00.081+0000 7f166b158700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:53:00.087 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T19:53:00.081+0000 7f166b158700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T19:53:11.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:53:11.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:53:41.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:53:41.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:54:11.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:54:11.321 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:54:41.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:54:41.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:55:11.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:55:11.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:55:41.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:55:41.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:11.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:11.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:42.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:42.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:12.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:12.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:42.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:42.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:12.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:12.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:42.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:42.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:12.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:12.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:42.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:42.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:12.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:12.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:42.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:42.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:12.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:12.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:42.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:42.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:13.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:13.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:43.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:43.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:13.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:13.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:16.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:16.094 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-12-24T20:03:16.121 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_53_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_54_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_55_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_56_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_57_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_58_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_59_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_00_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_01_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_02_00_UTC 2023-12-24T20:03:16.122 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_03_00_UTC 2023-12-24T20:03:16.123 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-19_53_00_UTC', 'scheduled-2023-12-24-19_54_00_UTC', 'scheduled-2023-12-24-19_55_00_UTC', 'scheduled-2023-12-24-19_56_00_UTC', 'scheduled-2023-12-24-19_57_00_UTC', 'scheduled-2023-12-24-19_58_00_UTC', 'scheduled-2023-12-24-19_59_00_UTC', 'scheduled-2023-12-24-20_00_00_UTC', 'scheduled-2023-12-24-20_01_00_UTC', 'scheduled-2023-12-24-20_02_00_UTC', 'scheduled-2023-12-24-20_03_00_UTC'] 2023-12-24T20:03:16.124 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-12-24T20:03:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.345+0000 7f28acfc5700 1 Processor -- start 2023-12-24T20:03:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.345+0000 7f28acfc5700 1 -- start start 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28acfc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f28a80b4700 0x7f28a806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28acfc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a80b3660 con 0x7f28a81590c0 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28acfc5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a80b3940 con 0x7f28a806a730 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28acfc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a80b3c20 con 0x7f28a80b4700 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28a81590c0 0x7f28a80b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60962/0 (socket says 172.21.15.50:60962) 2023-12-24T20:03:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a659c700 1 -- 172.21.15.50:0/445395285 learned_addr learned my addr 172.21.15.50:0/445395285 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:03:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a5d9b700 1 --2- 172.21.15.50:0/445395285 >> v2:172.21.15.82:3300/0 conn(0x7f28a80b4700 0x7f28a806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a559a700 1 -- 172.21.15.50:0/445395285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230733962 0 0) 0x7f28a80b3660 con 0x7f28a81590c0 2023-12-24T20:03:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a559a700 1 -- 172.21.15.50:0/445395285 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2890003570 con 0x7f28a81590c0 2023-12-24T20:03:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a5d9b700 1 -- 172.21.15.50:0/445395285 >> v1:172.21.15.82:6789/0 conn(0x7f28a806a730 legacy=0x7f28a8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a5d9b700 1 -- 172.21.15.50:0/445395285 >> v1:172.21.15.50:6789/0 conn(0x7f28a81590c0 legacy=0x7f28a80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.349+0000 7f28a5d9b700 1 -- 172.21.15.50:0/445395285 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a80b3f00 con 0x7f28a80b4700 2023-12-24T20:03:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28a5d9b700 1 --2- 172.21.15.50:0/445395285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a806d470 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098e0 tx=0x7f289c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900385bdee774230 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28a559a700 1 -- 172.21.15.50:0/445395285 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00b640 con 0x7f28a80b4700 2023-12-24T20:03:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28a559a700 1 -- 172.21.15.50:0/445395285 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c00b7a0 con 0x7f28a80b4700 2023-12-24T20:03:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28a559a700 1 -- 172.21.15.50:0/445395285 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00bb40 con 0x7f28a80b4700 2023-12-24T20:03:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 -- 172.21.15.50:0/445395285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 msgr2=0x7f28a806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 --2- 172.21.15.50:0/445395285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a806d470 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098e0 tx=0x7f289c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 -- 172.21.15.50:0/445395285 shutdown_connections 2023-12-24T20:03:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 --2- 172.21.15.50:0/445395285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a806d470 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 -- 172.21.15.50:0/445395285 >> 172.21.15.50:0/445395285 conn(0x7f28a8067b40 msgr2=0x7f28a80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 -- 172.21.15.50:0/445395285 shutdown_connections 2023-12-24T20:03:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.353+0000 7f28acfc5700 1 -- 172.21.15.50:0/445395285 wait complete. 2023-12-24T20:03:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 Processor -- start 2023-12-24T20:03:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 -- start start 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28a81590c0 0x7f28a8169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a813e000 con 0x7f28a806a730 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a816cc20 con 0x7f28a80b4700 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28acfc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a816a130 con 0x7f28a81590c0 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47636/0 (socket says 172.21.15.50:47636) 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 -- 172.21.15.50:0/3253255419 learned_addr learned my addr 172.21.15.50:0/3253255419 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a5d9b700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a6d9d700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28a81590c0 0x7f28a8169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 -- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28a81590c0 msgr2=0x7f28a8169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28a81590c0 0x7f28a8169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 -- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 msgr2=0x7f28a81695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a81695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 -- 172.21.15.50:0/3253255419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009420 con 0x7f28a806a730 2023-12-24T20:03:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.357+0000 7f28a659c700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f289800c590 tx=0x7f2898007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898005b30 con 0x7f28a806a730 2023-12-24T20:03:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898005cb0 con 0x7f28a806a730 2023-12-24T20:03:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a816a410 con 0x7f28a806a730 2023-12-24T20:03:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898007320 con 0x7f28a806a730 2023-12-24T20:03:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a816d1a0 con 0x7f28a806a730 2023-12-24T20:03:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a816d390 con 0x7f28a806a730 2023-12-24T20:03:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.361+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 95) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f289801b3b0 con 0x7f28a806a730 2023-12-24T20:03:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.365+0000 7f28967fc700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 0x7f2888062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.365+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6774+0+0 (secure 0 0 0) 0x7f289807c2a0 con 0x7f28a806a730 2023-12-24T20:03:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.365+0000 7f28a5d9b700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 0x7f2888062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.365+0000 7f28a5d9b700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 0x7f2888062b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f28a80b4b40 tx=0x7f289c017000 comp rx=0 tx=0).ready entity=mgr.9483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.373+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f289804c2b0 con 0x7f28a806a730 2023-12-24T20:03:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.573+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 --> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28a8071060 con 0x7f28880606c0 2023-12-24T20:03:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.589+0000 7f28967fc700 1 -- 172.21.15.50:0/3253255419 <== mgr.9483 v2:172.21.15.50:6836/33814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f28a8071060 con 0x7f28880606c0 2023-12-24T20:03:16.593 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:03:16.593 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T19:52:40", "first": "2023-12-24T19:53:00", "last": "2023-12-24T20:03:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 msgr2=0x7f2888062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 0x7f2888062b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f28a80b4b40 tx=0x7f289c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 msgr2=0x7f28a813dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f289800c590 tx=0x7f2898007e00 comp rx=0 tx=0).stop 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 shutdown_connections 2023-12-24T20:03:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7f28880606c0 0x7f2888062b70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28a81590c0 0x7f28a8169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28a80b4700 0x7f28a81695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 --2- 172.21.15.50:0/3253255419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a806a730 0x7f28a813dac0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 >> 172.21.15.50:0/3253255419 conn(0x7f28a8067b40 msgr2=0x7f28a815b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 shutdown_connections 2023-12-24T20:03:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.593+0000 7f28acfc5700 1 -- 172.21.15.50:0/3253255419 wait complete. 2023-12-24T20:03:16.620 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T19:52:40", "first": "2023-12-24T19:53:00", "last": "2023-12-24T20:03:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-12-24T20:03:16.620 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T19:52:40', 'first': '2023-12-24T19:53:00', 'last': '2023-12-24T20:03:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-12-24T20:03:16.620 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-12-24T20:03:16.620 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-12-24T20:03:16.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-24T20:03:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 Processor -- start 2023-12-24T20:03:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 -- start start 2023-12-24T20:03:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5d40c6d00 0x7fc5d40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d41548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d406c820 con 0x7fc5d406aca0 2023-12-24T20:03:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4154de0 con 0x7fc5d40c6d00 2023-12-24T20:03:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.789+0000 7fc5da82e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d406b960 con 0x7fc5d4154450 2023-12-24T20:03:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5d8dcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc5d406aca0 0x7fc5d406b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60966/0 (socket says 172.21.15.50:60966) 2023-12-24T20:03:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5d8dcb700 1 -- 172.21.15.50:0/4111706459 learned_addr learned my addr 172.21.15.50:0/4111706459 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:03:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/4111706459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d41548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5d3fff700 1 --2- 172.21.15.50:0/4111706459 >> v2:172.21.15.82:3300/0 conn(0x7fc5d40c6d00 0x7fc5d40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5d37fe700 1 -- 172.21.15.50:0/4111706459 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230339241 0 0) 0x7fc5d406c820 con 0x7fc5d406aca0 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5d37fe700 1 -- 172.21.15.50:0/4111706459 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c0003570 con 0x7fc5d406aca0 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/4111706459 >> v2:172.21.15.82:3300/0 conn(0x7fc5d40c6d00 msgr2=0x7fc5d40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/4111706459 >> v2:172.21.15.82:3300/0 conn(0x7fc5d40c6d00 0x7fc5d40c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/4111706459 >> v1:172.21.15.50:6789/0 conn(0x7fc5d406aca0 legacy=0x7fc5d406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/4111706459 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d406bc40 con 0x7fc5d4154450 2023-12-24T20:03:16.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.793+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/4111706459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d41548a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0098e0 tx=0x7fc5bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26af7182f606f52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5d37fe700 1 -- 172.21.15.50:0/4111706459 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011630 con 0x7fc5d4154450 2023-12-24T20:03:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5d37fe700 1 -- 172.21.15.50:0/4111706459 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc011790 con 0x7fc5d4154450 2023-12-24T20:03:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5d37fe700 1 -- 172.21.15.50:0/4111706459 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011b30 con 0x7fc5d4154450 2023-12-24T20:03:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 -- 172.21.15.50:0/4111706459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 msgr2=0x7fc5d41548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 --2- 172.21.15.50:0/4111706459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d41548a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0098e0 tx=0x7fc5bc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 -- 172.21.15.50:0/4111706459 shutdown_connections 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 --2- 172.21.15.50:0/4111706459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d41548a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 --2- 172.21.15.50:0/4111706459 >> v2:172.21.15.82:3300/0 conn(0x7fc5d40c6d00 0x7fc5d40c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 -- 172.21.15.50:0/4111706459 >> 172.21.15.50:0/4111706459 conn(0x7fc5d40cbba0 msgr2=0x7fc5d40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 -- 172.21.15.50:0/4111706459 shutdown_connections 2023-12-24T20:03:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.801+0000 7fc5da82e700 1 -- 172.21.15.50:0/4111706459 wait complete. 2023-12-24T20:03:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 Processor -- start 2023-12-24T20:03:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 -- start start 2023-12-24T20:03:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d406aca0 0x7fc5d40a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d40abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4153f20 con 0x7fc5d40c6d00 2023-12-24T20:03:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d40a88d0 con 0x7fc5d406aca0 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5da82e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d40a9730 con 0x7fc5d4154450 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47644/0 (socket says 172.21.15.50:47644) 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/1458681711 learned_addr learned my addr 172.21.15.50:0/1458681711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5d3fff700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d406aca0 0x7fc5d40a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5d8dcb700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d40abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 msgr2=0x7fc5d40abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d40abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d406aca0 msgr2=0x7fc5d40a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d406aca0 0x7fc5d40a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.805+0000 7fc5cb7fe700 1 -- 172.21.15.50:0/1458681711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009420 con 0x7fc5d40c6d00 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5cb7fe700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009ed0 tx=0x7fc5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc000c40 con 0x7fc5d40c6d00 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc011900 con 0x7fc5d40c6d00 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc025420 con 0x7fc5d40c6d00 2023-12-24T20:03:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d40a8b20 con 0x7fc5d40c6d00 2023-12-24T20:03:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d40a90e0 con 0x7fc5d40c6d00 2023-12-24T20:03:16.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.809+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d40cb780 con 0x7fc5d40c6d00 2023-12-24T20:03:16.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.813+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 95) v1 ==== 80092+0+0 (secure 0 0 0) 0x7fc5bc023070 con 0x7fc5d40c6d00 2023-12-24T20:03:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.813+0000 7fc5d0ff9700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 0x7fc5b4062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.813+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6774+0+0 (secure 0 0 0) 0x7fc5bc07e180 con 0x7fc5d40c6d00 2023-12-24T20:03:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.813+0000 7fc5d3fff700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 0x7fc5b4062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.813+0000 7fc5d3fff700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 0x7fc5b4062b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400f570 tx=0x7fc5c400b040 comp rx=0 tx=0).ready entity=mgr.9483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:16.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:16.821+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc5d40cb780 con 0x7fc5d40c6d00 2023-12-24T20:03:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.037+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc5d40cb780 con 0x7fc5d40c6d00 2023-12-24T20:03:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.045+0000 7fc5d0ff9700 1 -- 172.21.15.50:0/1458681711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v95) v1 ==== 74+0+154340 (secure 0 0 0) 0x7fc5d40cb780 con 0x7fc5d40c6d00 2023-12-24T20:03:17.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:03:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 msgr2=0x7fc5b4062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 0x7fc5b4062b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400f570 tx=0x7fc5c400b040 comp rx=0 tx=0).stop 2023-12-24T20:03:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 msgr2=0x7fc5d40b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009ed0 tx=0x7fc5bc017000 comp rx=0 tx=0).stop 2023-12-24T20:03:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 shutdown_connections 2023-12-24T20:03:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:6836/33814,v1:172.21.15.50:6837/33814] conn(0x7fc5b40606c0 0x7fc5b4062b70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5d4154450 0x7fc5d40abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5d40c6d00 0x7fc5d40b0920 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 --2- 172.21.15.50:0/1458681711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d406aca0 0x7fc5d40a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 >> 172.21.15.50:0/1458681711 conn(0x7fc5d40cbba0 msgr2=0x7fc5d4062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 shutdown_connections 2023-12-24T20:03:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:03:17.049+0000 7fc5da82e700 1 -- 172.21.15.50:0/1458681711 wait complete. 2023-12-24T20:03:17.075 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"active_gid":9483,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":33814},{"type":"v1","addr":"172.21.15.50:6837","nonce":33814}]},"active_addr":"172.21.15.50:6837/33814","active_change":"2023-12-24T19:52:39.404331+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":9349,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":174,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2424533746}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3889288613}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2623688854}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2602753322}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2348689371}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2020731815}]}]} 2023-12-24T20:03:17.079 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-12-24T20:03:17.079 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-24T20:03:17.079 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-12-24T20:03:17.080 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-24T20:03:17.080 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:03:17.152 INFO:tasks.ceph.mgr.y:Stopped 2023-12-24T20:03:17.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-24T20:03:17.158 INFO:tasks.ceph.mgr.y:Started 2023-12-24T20:03:17.397 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:17.393+0000 7f2bb6b5c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:03:17.958 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:17.953+0000 7f2bb6b5c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:03:18.038 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.033+0000 7f2bb6b5c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:03:18.193 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.189+0000 7f2bb6b5c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:03:18.476 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.473+0000 7f2bb6b5c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:03:18.552 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.549+0000 7f2bb6b5c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:03:18.792 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.789+0000 7f2bb6b5c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:03:18.879 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.877+0000 7f2bb6b5c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:03:18.969 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:18.965+0000 7f2bb6b5c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:03:19.385 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:19.381+0000 7f2bb6b5c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:03:19.548 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:19.545+0000 7f2bb6b5c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:03:19.912 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:19.909+0000 7f2bb6b5c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:03:20.135 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.129+0000 7f2bb6b5c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:03:20.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.221+0000 7f2bb6b5c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:03:20.307 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.301+0000 7f2bb6b5c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:03:20.388 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.385+0000 7f2bb6b5c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:03:20.609 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.605+0000 7f2bb6b5c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:03:20.687 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.685+0000 7f2bb6b5c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:03:20.776 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.773+0000 7f2bb6b5c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:03:20.973 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:20.969+0000 7f2bb6b5c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:03:21.064 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:21.061+0000 7f2bb6b5c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:03:21.802 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:21.797+0000 7f2bb6b5c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:03:22.082 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.077+0000 7f2b73f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.082 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.077+0000 7f2b73f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.082 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.077+0000 7f2b73f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.083 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.077+0000 7f2b73f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.083 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.077+0000 7f2b73f8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.081+0000 7f2b77793700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.081+0000 7f2b77793700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.081+0000 7f2b77793700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.081+0000 7f2b77793700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:22.084 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:03:22.081+0000 7f2b77793700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:03:43.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:43.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:04:00.068+0000 7f2b7ffa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:04:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:04:00.068+0000 7f2b7ffa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:04:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:04:00.068+0000 7f2b7ffa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:04:00.069 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:04:00.068+0000 7f2b7ffa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:04:00.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:04:00.068+0000 7f2b7ffa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:04:13.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:13.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:43.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:43.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:13.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:13.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:44.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:44.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:14.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:14.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:44.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:44.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:14.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:14.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:44.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:44.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:14.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:14.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:17.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-12-24T20:08:17.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.341+0000 7f93da88e700 1 Processor -- start 2023-12-24T20:08:17.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.341+0000 7f93da88e700 1 -- start start 2023-12-24T20:08:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da88e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93d40ceb80 0x7f93d41591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da88e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d406aa80 con 0x7f93d4158dd0 2023-12-24T20:08:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da88e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d40cc0b0 con 0x7f93d40b2cf0 2023-12-24T20:08:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da88e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40cc390 con 0x7f93d40ceb80 2023-12-24T20:08:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d988c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93d4158dd0 0x7f93d40cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37162/0 (socket says 172.21.15.50:37162) 2023-12-24T20:08:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d988c700 1 -- 172.21.15.50:0/3546637905 learned_addr learned my addr 172.21.15.50:0/3546637905 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da08d700 1 --2- 172.21.15.50:0/3546637905 >> v2:172.21.15.82:3300/0 conn(0x7f93d40ceb80 0x7f93d41591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869127951 0 0) 0x7f93d406aa80 con 0x7f93d4158dd0 2023-12-24T20:08:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c0003570 con 0x7f93d4158dd0 2023-12-24T20:08:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782014991 0 0) 0x7f93d40cc0b0 con 0x7f93d40b2cf0 2023-12-24T20:08:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d406aa80 con 0x7f93d40b2cf0 2023-12-24T20:08:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da08d700 1 -- 172.21.15.50:0/3546637905 >> v1:172.21.15.82:6789/0 conn(0x7f93d40b2cf0 legacy=0x7f93d40ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da08d700 1 -- 172.21.15.50:0/3546637905 >> v1:172.21.15.50:6789/0 conn(0x7f93d4158dd0 legacy=0x7f93d40cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.345+0000 7f93da08d700 1 -- 172.21.15.50:0/3546637905 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d406a430 con 0x7f93d40ceb80 2023-12-24T20:08:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da08d700 1 --2- 172.21.15.50:0/3546637905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d41591a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009e60 tx=0x7f93cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be656e67f0d3f28d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00e070 con 0x7f93d40ceb80 2023-12-24T20:08:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00bab0 con 0x7f93d40ceb80 2023-12-24T20:08:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93d888a700 1 -- 172.21.15.50:0/3546637905 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00be70 con 0x7f93d40ceb80 2023-12-24T20:08:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 -- 172.21.15.50:0/3546637905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 msgr2=0x7f93d41591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 --2- 172.21.15.50:0/3546637905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d41591a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009e60 tx=0x7f93cc009780 comp rx=0 tx=0).stop 2023-12-24T20:08:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 -- 172.21.15.50:0/3546637905 shutdown_connections 2023-12-24T20:08:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 --2- 172.21.15.50:0/3546637905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d41591a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 -- 172.21.15.50:0/3546637905 >> 172.21.15.50:0/3546637905 conn(0x7f93d4067b80 msgr2=0x7f93d40cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 -- 172.21.15.50:0/3546637905 shutdown_connections 2023-12-24T20:08:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.349+0000 7f93da88e700 1 -- 172.21.15.50:0/3546637905 wait complete. 2023-12-24T20:08:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 Processor -- start 2023-12-24T20:08:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 -- start start 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93d40b2cf0 0x7f93d414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c98e0 con 0x7f93d4158dd0 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c8cd0 con 0x7f93d40ceb80 2023-12-24T20:08:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.353+0000 7f93da88e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c8fb0 con 0x7f93d40b2cf0 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58840/0 (socket says 172.21.15.50:58840) 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 -- 172.21.15.50:0/1824027054 learned_addr learned my addr 172.21.15.50:0/1824027054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93d908b700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93d988c700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93d40b2cf0 0x7f93d414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 -- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93d40b2cf0 msgr2=0x7f93d414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93d40b2cf0 0x7f93d414e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 -- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 msgr2=0x7f93d40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 -- 172.21.15.50:0/1824027054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009a20 con 0x7f93d4158dd0 2023-12-24T20:08:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93d908b700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da08d700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f93cc013000 tx=0x7f93cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc026480 con 0x7f93d4158dd0 2023-12-24T20:08:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc026600 con 0x7f93d4158dd0 2023-12-24T20:08:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40c9290 con 0x7f93d4158dd0 2023-12-24T20:08:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0269c0 con 0x7f93d4158dd0 2023-12-24T20:08:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.357+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40c9d70 con 0x7f93d4158dd0 2023-12-24T20:08:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.361+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d40c9a90 con 0x7f93d4158dd0 2023-12-24T20:08:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.361+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 100) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f93cc01c400 con 0x7f93d4158dd0 2023-12-24T20:08:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.361+0000 7f93c9ffb700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 0x7f93b8062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.361+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7032+0+0 (secure 0 0 0) 0x7f93cc07f2b0 con 0x7f93d4158dd0 2023-12-24T20:08:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.365+0000 7f93d988c700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 0x7f93b8062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.365+0000 7f93d988c700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 0x7f93b8062ba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93d00058d0 tx=0x7f93d0009040 comp rx=0 tx=0).ready entity=mgr.9573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.369+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f93d40c9a90 con 0x7f93d4158dd0 2023-12-24T20:08:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.565+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d404be40 con 0x7f93b80606f0 2023-12-24T20:08:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.685+0000 7f93c9ffb700 1 -- 172.21.15.50:0/1824027054 <== mgr.9573 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f93d404be40 con 0x7f93b80606f0 2023-12-24T20:08:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-12-24T20:08:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 msgr2=0x7f93b8062ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 0x7f93b8062ba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93d00058d0 tx=0x7f93d0009040 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 msgr2=0x7f93d40c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f93cc013000 tx=0x7f93cc019000 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 shutdown_connections 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f93b80606f0 0x7f93b8062ba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93d4158dd0 0x7f93d40c4c70 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d40ceb80 0x7f93d40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 --2- 172.21.15.50:0/1824027054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93d40b2cf0 0x7f93d414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 >> 172.21.15.50:0/1824027054 conn(0x7f93d4067b80 msgr2=0x7f93d40cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 shutdown_connections 2023-12-24T20:08:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.689+0000 7f93da88e700 1 -- 172.21.15.50:0/1824027054 wait complete. 2023-12-24T20:08:17.717 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-12-24T20:08:17.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:17.717 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-12-24T20:08:17.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_53_00_UTC 2023-12-24T20:08:17.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_54_00_UTC 2023-12-24T20:08:17.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_55_00_UTC 2023-12-24T20:08:17.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_56_00_UTC 2023-12-24T20:08:17.740 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_57_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_58_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_59_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_00_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_01_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_02_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_03_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_04_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_05_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_06_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_07_00_UTC 2023-12-24T20:08:17.741 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_08_00_UTC 2023-12-24T20:08:17.742 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-12-24-19_53_00_UTC', 'scheduled-2023-12-24-19_54_00_UTC', 'scheduled-2023-12-24-19_55_00_UTC', 'scheduled-2023-12-24-19_56_00_UTC', 'scheduled-2023-12-24-19_57_00_UTC', 'scheduled-2023-12-24-19_58_00_UTC', 'scheduled-2023-12-24-19_59_00_UTC', 'scheduled-2023-12-24-20_00_00_UTC', 'scheduled-2023-12-24-20_01_00_UTC', 'scheduled-2023-12-24-20_02_00_UTC', 'scheduled-2023-12-24-20_03_00_UTC', 'scheduled-2023-12-24-20_04_00_UTC', 'scheduled-2023-12-24-20_05_00_UTC', 'scheduled-2023-12-24-20_06_00_UTC', 'scheduled-2023-12-24-20_07_00_UTC', 'scheduled-2023-12-24-20_08_00_UTC'] 2023-12-24T20:08:17.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-12-24T20:08:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.965+0000 7f429b785700 1 Processor -- start 2023-12-24T20:08:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 -- start start 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 0x7f42940c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42940ca930 0x7f4294068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4294069500 0x7f42940cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4294069960 con 0x7f4294069500 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429415d020 con 0x7f4294150210 2023-12-24T20:08:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f429b785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429415d300 con 0x7f42940ca930 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4294069500 0x7f42940cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4294069500 0x7f42940cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58850/0 (socket says 172.21.15.50:58850) 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 -- 172.21.15.50:0/3252144675 learned_addr learned my addr 172.21.15.50:0/3252144675 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299521700 1 --2- 172.21.15.50:0/3252144675 >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 0x7f42940c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4298d20700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42940ca930 0x7f4294068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 -- 172.21.15.50:0/3252144675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42940ca930 msgr2=0x7f4294068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42940ca930 0x7f4294068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 -- 172.21.15.50:0/3252144675 >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 msgr2=0x7f42940c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 --2- 172.21.15.50:0/3252144675 >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 0x7f42940c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299d22700 1 -- 172.21.15.50:0/3252144675 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429415d5e0 con 0x7f4294069500 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.969+0000 7f4299521700 1 --2- 172.21.15.50:0/3252144675 >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 0x7f42940c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f4299d22700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294069500 0x7f42940cc030 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f42940642b0 tx=0x7f428c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dcdcde84e16c9b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f428bfff700 1 -- 172.21.15.50:0/3252144675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00e070 con 0x7f4294069500 2023-12-24T20:08:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f428bfff700 1 -- 172.21.15.50:0/3252144675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00ba50 con 0x7f4294069500 2023-12-24T20:08:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f428bfff700 1 -- 172.21.15.50:0/3252144675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0092e0 con 0x7f4294069500 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 -- 172.21.15.50:0/3252144675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294069500 msgr2=0x7f42940cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294069500 0x7f42940cc030 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f42940642b0 tx=0x7f428c009840 comp rx=0 tx=0).stop 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 -- 172.21.15.50:0/3252144675 shutdown_connections 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294069500 0x7f42940cc030 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 --2- 172.21.15.50:0/3252144675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42940ca930 0x7f4294068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 --2- 172.21.15.50:0/3252144675 >> v2:172.21.15.82:3300/0 conn(0x7f4294150210 0x7f42940c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 -- 172.21.15.50:0/3252144675 >> 172.21.15.50:0/3252144675 conn(0x7f42940ccd60 msgr2=0x7f42940cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 -- 172.21.15.50:0/3252144675 shutdown_connections 2023-12-24T20:08:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.973+0000 7f429b785700 1 -- 172.21.15.50:0/3252144675 wait complete. 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 Processor -- start 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 -- start start 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4294069500 0x7f429414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940ca930 0x7f429415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429415a850 con 0x7f4294150210 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429415ab30 con 0x7f42940ca930 2023-12-24T20:08:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f429b785700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429415ae10 con 0x7f4294069500 2023-12-24T20:08:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f4299d22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.977+0000 7f4299d22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58866/0 (socket says 172.21.15.50:58866) 2023-12-24T20:08:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 -- 172.21.15.50:0/1656225422 learned_addr learned my addr 172.21.15.50:0/1656225422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4298d20700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940ca930 0x7f429415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299521700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4294069500 0x7f429414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 -- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4294069500 msgr2=0x7f429414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4294069500 0x7f429414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 -- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940ca930 msgr2=0x7f429415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940ca930 0x7f429415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 -- 172.21.15.50:0/1656225422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009ae0 con 0x7f4294150210 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f4299d22700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4294067180 tx=0x7f428c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0032f0 con 0x7f4294150210 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c008ce0 con 0x7f4294150210 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c01c660 con 0x7f4294150210 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429415b0f0 con 0x7f4294150210 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429414fd50 con 0x7f4294150210 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.981+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4294071060 con 0x7f4294150210 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.985+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 100) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f428c003040 con 0x7f4294150210 2023-12-24T20:08:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.985+0000 7f42897fa700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 0x7f4278062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.985+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7032+0+0 (secure 0 0 0) 0x7f428c07e760 con 0x7f4294150210 2023-12-24T20:08:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.985+0000 7f4299521700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 0x7f4278062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.985+0000 7f4299521700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 0x7f4278062ba0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4290006f00 tx=0x7f4290008040 comp rx=0 tx=0).ready entity=mgr.9573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:17.993+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f428c04e560 con 0x7f4294150210 2023-12-24T20:08:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.189+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f429415aca0 con 0x7f42780606f0 2023-12-24T20:08:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.209+0000 7f42897fa700 1 -- 172.21.15.50:0/1656225422 <== mgr.9573 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f429415aca0 con 0x7f42780606f0 2023-12-24T20:08:18.211 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:18.212 INFO:teuthology.orchestra.run.smithi050.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T19:52:40", "first": "2023-12-24T19:53:00", "last": "2023-12-24T20:08:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-12-24T20:08:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 msgr2=0x7f4278062ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 0x7f4278062ba0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4290006f00 tx=0x7f4290008040 comp rx=0 tx=0).stop 2023-12-24T20:08:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 msgr2=0x7f429415eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4294067180 tx=0x7f428c018000 comp rx=0 tx=0).stop 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 shutdown_connections 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f42780606f0 0x7f4278062ba0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4294150210 0x7f429415eba0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940ca930 0x7f429415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 --2- 172.21.15.50:0/1656225422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4294069500 0x7f429414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 >> 172.21.15.50:0/1656225422 conn(0x7f42940ccd60 msgr2=0x7f42940c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 shutdown_connections 2023-12-24T20:08:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.213+0000 7f429b785700 1 -- 172.21.15.50:0/1656225422 wait complete. 2023-12-24T20:08:18.239 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-12-24T00:00:00", "created": "2023-12-24T19:52:40", "first": "2023-12-24T19:53:00", "last": "2023-12-24T20:08:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-12-24T20:08:18.239 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-12-24T00:00:00', 'created': '2023-12-24T19:52:40', 'first': '2023-12-24T19:53:00', 'last': '2023-12-24T20:08:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-12-24T20:08:18.239 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-12-24T20:08:18.239 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-12-24T20:08:18.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-12-24T20:08:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.413+0000 7fe89a443700 1 Processor -- start 2023-12-24T20:08:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.413+0000 7fe89a443700 1 -- start start 2023-12-24T20:08:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe89406e040 0x7fe8940ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940c7870 con 0x7fe894155980 2023-12-24T20:08:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940ae980 con 0x7fe894155d50 2023-12-24T20:08:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89406e7d0 con 0x7fe89406e040 2023-12-24T20:08:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe89406e040 0x7fe8940ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe89406e040 0x7fe8940ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58870/0 (socket says 172.21.15.50:58870) 2023-12-24T20:08:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe899441700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe894155980 0x7fe89406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37168/0 (socket says 172.21.15.50:37168) 2023-12-24T20:08:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 -- 172.21.15.50:0/3648462189 learned_addr learned my addr 172.21.15.50:0/3648462189 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 -- 172.21.15.50:0/3648462189 >> v1:172.21.15.82:6789/0 conn(0x7fe894155d50 legacy=0x7fe8940c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 -- 172.21.15.50:0/3648462189 >> v1:172.21.15.50:6789/0 conn(0x7fe894155980 legacy=0x7fe89406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 -- 172.21.15.50:0/3648462189 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940aebe0 con 0x7fe89406e040 2023-12-24T20:08:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe88bfff700 1 -- 172.21.15.50:0/3648462189 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601629845 0 0) 0x7fe8940c7870 con 0x7fe894155980 2023-12-24T20:08:18.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe898c40700 1 --2- 172.21.15.50:0/3648462189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89406e040 0x7fe8940ae440 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe8840099b0 tx=0x7fe884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83aedad88abda87 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe88bfff700 1 -- 172.21.15.50:0/3648462189 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400b860 con 0x7fe89406e040 2023-12-24T20:08:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe88bfff700 1 -- 172.21.15.50:0/3648462189 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400b9c0 con 0x7fe89406e040 2023-12-24T20:08:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe88bfff700 1 -- 172.21.15.50:0/3648462189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400bd60 con 0x7fe89406e040 2023-12-24T20:08:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 -- 172.21.15.50:0/3648462189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89406e040 msgr2=0x7fe8940ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.417+0000 7fe89a443700 1 --2- 172.21.15.50:0/3648462189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89406e040 0x7fe8940ae440 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe8840099b0 tx=0x7fe884009250 comp rx=0 tx=0).stop 2023-12-24T20:08:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 -- 172.21.15.50:0/3648462189 shutdown_connections 2023-12-24T20:08:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 --2- 172.21.15.50:0/3648462189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89406e040 0x7fe8940ae440 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 -- 172.21.15.50:0/3648462189 >> 172.21.15.50:0/3648462189 conn(0x7fe89406c110 msgr2=0x7fe894067700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 -- 172.21.15.50:0/3648462189 shutdown_connections 2023-12-24T20:08:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 -- 172.21.15.50:0/3648462189 wait complete. 2023-12-24T20:08:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 Processor -- start 2023-12-24T20:08:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.421+0000 7fe89a443700 1 -- start start 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89406e040 0x7fe894153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 0x7fe8940cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940c13d0 con 0x7fe894155d50 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940c04e0 con 0x7fe89406e040 2023-12-24T20:08:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940c07c0 con 0x7fe894155980 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58878/0 (socket says 172.21.15.50:58878) 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 -- 172.21.15.50:0/225951059 learned_addr learned my addr 172.21.15.50:0/225951059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899441700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89406e040 0x7fe894153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe898c40700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 0x7fe8940cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 -- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 msgr2=0x7fe8940cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 0x7fe8940cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 -- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89406e040 msgr2=0x7fe894153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89406e040 0x7fe894153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 -- 172.21.15.50:0/225951059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840094f0 con 0x7fe894155d50 2023-12-24T20:08:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe898c40700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 0x7fe8940cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe899c42700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c8e0 tx=0x7fe88c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012630 con 0x7fe894155d50 2023-12-24T20:08:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c012790 con 0x7fe894155d50 2023-12-24T20:08:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012b50 con 0x7fe894155d50 2023-12-24T20:08:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8940c0aa0 con 0x7fe894155d50 2023-12-24T20:08:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.425+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8940c1060 con 0x7fe894155d50 2023-12-24T20:08:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.429+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8940c1540 con 0x7fe894155d50 2023-12-24T20:08:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.429+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 100) v1 ==== 80092+0+0 (secure 0 0 0) 0x7fe88c00a3b0 con 0x7fe894155d50 2023-12-24T20:08:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.429+0000 7fe8897fa700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 0x7fe878062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.429+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7032+0+0 (secure 0 0 0) 0x7fe88c07d200 con 0x7fe894155d50 2023-12-24T20:08:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.429+0000 7fe899441700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 0x7fe878062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.433+0000 7fe899441700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 0x7fe878062b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe890007fd0 tx=0x7fe890007d30 comp rx=0 tx=0).ready entity=mgr.9573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.437+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe88c050c40 con 0x7fe894155d50 2023-12-24T20:08:18.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.629+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe89404be40 con 0x7fe8780606c0 2023-12-24T20:08:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.753+0000 7fe8897fa700 1 -- 172.21.15.50:0/225951059 <== mgr.9573 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fe89404be40 con 0x7fe8780606c0 2023-12-24T20:08:18.755 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-12-24T20:08:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.753+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 msgr2=0x7fe878062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.753+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 0x7fe878062b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe890007fd0 tx=0x7fe890007d30 comp rx=0 tx=0).stop 2023-12-24T20:08:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.753+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 msgr2=0x7fe8940c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.753+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c8e0 tx=0x7fe88c001710 comp rx=0 tx=0).stop 2023-12-24T20:08:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 shutdown_connections 2023-12-24T20:08:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe8780606c0 0x7fe878062b70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894155d50 0x7fe8940c1be0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe894155980 0x7fe8940cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 --2- 172.21.15.50:0/225951059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89406e040 0x7fe894153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 >> 172.21.15.50:0/225951059 conn(0x7fe89406c110 msgr2=0x7fe894154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 shutdown_connections 2023-12-24T20:08:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:18.757+0000 7fe89a443700 1 -- 172.21.15.50:0/225951059 wait complete. 2023-12-24T20:08:18.783 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-12-24T20:08:18.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_53_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_54_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_55_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_56_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_57_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_58_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-19_59_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_00_00_UTC 2023-12-24T20:08:18.808 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_01_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_02_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_03_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_04_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_05_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_06_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_07_00_UTC 2023-12-24T20:08:18.809 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_08_00_UTC 2023-12-24T20:08:18.810 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_53_00_UTC 2023-12-24T20:08:18.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:18.810 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_53_00_UTC) 2023-12-24T20:08:18.886 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_54_00_UTC 2023-12-24T20:08:18.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:18.886 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_54_00_UTC) 2023-12-24T20:08:18.967 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_55_00_UTC 2023-12-24T20:08:18.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:18.967 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_55_00_UTC) 2023-12-24T20:08:19.039 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_56_00_UTC 2023-12-24T20:08:19.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.040 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_56_00_UTC) 2023-12-24T20:08:19.116 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_57_00_UTC 2023-12-24T20:08:19.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.116 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_57_00_UTC) 2023-12-24T20:08:19.195 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_58_00_UTC 2023-12-24T20:08:19.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.195 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_58_00_UTC) 2023-12-24T20:08:19.273 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_59_00_UTC 2023-12-24T20:08:19.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.274 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-19_59_00_UTC) 2023-12-24T20:08:19.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_00_00_UTC 2023-12-24T20:08:19.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.346 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_00_00_UTC) 2023-12-24T20:08:19.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_01_00_UTC 2023-12-24T20:08:19.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.422 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_01_00_UTC) 2023-12-24T20:08:19.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_02_00_UTC 2023-12-24T20:08:19.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.499 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_02_00_UTC) 2023-12-24T20:08:19.574 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_03_00_UTC 2023-12-24T20:08:19.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.574 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_03_00_UTC) 2023-12-24T20:08:19.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_04_00_UTC 2023-12-24T20:08:19.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.647 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_04_00_UTC) 2023-12-24T20:08:19.726 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_05_00_UTC 2023-12-24T20:08:19.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.727 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_05_00_UTC) 2023-12-24T20:08:19.809 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_06_00_UTC 2023-12-24T20:08:19.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.809 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_06_00_UTC) 2023-12-24T20:08:19.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_07_00_UTC 2023-12-24T20:08:19.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.886 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_07_00_UTC) 2023-12-24T20:08:19.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_08_00_UTC 2023-12-24T20:08:19.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:19.957 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-12-24-20_08_00_UTC) 2023-12-24T20:08:20.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:20.056 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-12-24T20:08:20.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T20:08:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.293+0000 7f54fa185700 1 Processor -- start 2023-12-24T20:08:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.293+0000 7f54fa185700 1 -- start start 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54fa185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54f4160720 0x7f54f406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54fa185700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f4160af0 0x7f54f406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54fa185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f406b0b0 con 0x7f54f406ac40 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54fa185700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f415e960 con 0x7f54f4160af0 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54fa185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f415fe00 con 0x7f54f4160720 2023-12-24T20:08:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f4160af0 0x7f54f406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54f406ac40 0x7f54f4161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45600/0 (socket says 172.21.15.50:45600) 2023-12-24T20:08:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f37fe700 1 --2- 172.21.15.50:0/3743475142 >> v2:172.21.15.82:3300/0 conn(0x7f54f4160720 0x7f54f406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f3fff700 1 -- 172.21.15.50:0/3743475142 learned_addr learned my addr 172.21.15.50:0/3743475142 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 -- 172.21.15.50:0/3743475142 >> v2:172.21.15.82:3300/0 conn(0x7f54f4160720 msgr2=0x7f54f406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 --2- 172.21.15.50:0/3743475142 >> v2:172.21.15.82:3300/0 conn(0x7f54f4160720 0x7f54f406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 -- 172.21.15.50:0/3743475142 >> v1:172.21.15.50:6789/0 conn(0x7f54f406ac40 legacy=0x7f54f4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:20.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 -- 172.21.15.50:0/3743475142 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f41600a0 con 0x7f54f4160af0 2023-12-24T20:08:20.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.297+0000 7f54f2ffd700 1 --2- 172.21.15.50:0/3743475142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f406a700 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f54f40cc740 tx=0x7f54e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66c7f0c2062955e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54f27fc700 1 -- 172.21.15.50:0/3743475142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8011630 con 0x7f54f4160af0 2023-12-24T20:08:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54f27fc700 1 -- 172.21.15.50:0/3743475142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e8011790 con 0x7f54f4160af0 2023-12-24T20:08:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54f27fc700 1 -- 172.21.15.50:0/3743475142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8011b30 con 0x7f54f4160af0 2023-12-24T20:08:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 -- 172.21.15.50:0/3743475142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 msgr2=0x7f54f406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 --2- 172.21.15.50:0/3743475142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f406a700 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f54f40cc740 tx=0x7f54e80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 -- 172.21.15.50:0/3743475142 shutdown_connections 2023-12-24T20:08:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 --2- 172.21.15.50:0/3743475142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f406a700 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 --2- 172.21.15.50:0/3743475142 >> v2:172.21.15.82:3300/0 conn(0x7f54f4160720 0x7f54f406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 -- 172.21.15.50:0/3743475142 >> 172.21.15.50:0/3743475142 conn(0x7f54f4067b80 msgr2=0x7f54f40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 -- 172.21.15.50:0/3743475142 shutdown_connections 2023-12-24T20:08:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.301+0000 7f54fa185700 1 -- 172.21.15.50:0/3743475142 wait complete. 2023-12-24T20:08:20.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 Processor -- start 2023-12-24T20:08:20.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 -- start start 2023-12-24T20:08:20.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54f406ac40 0x7f54f4157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4160720 0x7f54f4154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415ae50 con 0x7f54f4160af0 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4154570 con 0x7f54f4160720 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54fa185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415a240 con 0x7f54f406ac40 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:20.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54f2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4160720 0x7f54f4154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59410/0 (socket says 172.21.15.50:59410) 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.305+0000 7f54f3fff700 1 -- 172.21.15.50:0/3244354959 learned_addr learned my addr 172.21.15.50:0/3244354959 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 -- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54f406ac40 msgr2=0x7f54f4157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54f406ac40 0x7f54f4157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 -- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4160720 msgr2=0x7f54f4154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4160720 0x7f54f4154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 -- 172.21.15.50:0/3244354959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8009420 con 0x7f54f4160af0 2023-12-24T20:08:20.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54f3fff700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00cbc0 tx=0x7f54ec0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:20.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00a890 con 0x7f54f4160af0 2023-12-24T20:08:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00a9f0 con 0x7f54f4160af0 2023-12-24T20:08:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00ad70 con 0x7f54f4160af0 2023-12-24T20:08:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f415a520 con 0x7f54f4160af0 2023-12-24T20:08:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.309+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f415aae0 con 0x7f54f4160af0 2023-12-24T20:08:20.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.313+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f40652e0 con 0x7f54f4160af0 2023-12-24T20:08:20.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.313+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 100) v1 ==== 80092+0+0 (secure 0 0 0) 0x7f54ec007300 con 0x7f54f4160af0 2023-12-24T20:08:20.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.317+0000 7f54db7fe700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 0x7f54e0062cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:20.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.317+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f54ec07dcd0 con 0x7f54f4160af0 2023-12-24T20:08:20.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.317+0000 7f54f37fe700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 0x7f54e0062cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:20.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.321+0000 7f54f37fe700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 0x7f54e0062cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54f415bf80 tx=0x7f54e40091a0 comp rx=0 tx=0).ready entity=mgr.9573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:20.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.325+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f54ec04dcb0 con 0x7f54f4160af0 2023-12-24T20:08:20.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:20.561+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f54f40c8d00 con 0x7f54f4160af0 2023-12-24T20:08:21.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.033+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f54ec04e080 con 0x7f54f4160af0 2023-12-24T20:08:21.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.037+0000 7f54db7fe700 1 -- 172.21.15.50:0/3244354959 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v101) v1 ==== 93+0+0 (secure 0 0 0) 0x7f54ec04fab0 con 0x7f54f4160af0 2023-12-24T20:08:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.041+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 msgr2=0x7f54e0062cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.041+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 0x7f54e0062cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54f415bf80 tx=0x7f54e40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.041+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 msgr2=0x7f54f415b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.041+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00cbc0 tx=0x7f54ec0019c0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 shutdown_connections 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54e0060840 0x7f54e0062cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f4160af0 0x7f54f415b0f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4160720 0x7f54f4154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 --2- 172.21.15.50:0/3244354959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54f406ac40 0x7f54f4157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 >> 172.21.15.50:0/3244354959 conn(0x7f54f4067b80 msgr2=0x7f54f40b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 shutdown_connections 2023-12-24T20:08:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.045+0000 7f54fa185700 1 -- 172.21.15.50:0/3244354959 wait complete. 2023-12-24T20:08:21.070 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:08:21.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:21.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:21.153 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:08:21.153 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T20:08:21.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:21.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:21.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:08:21.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:21.215 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:08:21.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:21.244 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:21.237+0000 7f42b7bce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:08:21.256 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:21.253+0000 7fc1abb5e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:08:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 Processor -- start 2023-12-24T20:08:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 -- start start 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a41611b0 0x7f30a4161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30a406c820 0x7f30a406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a406c4d0 con 0x7f30a40ae100 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a406c1f0 con 0x7f30a406c820 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30aa48e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40ab5e0 con 0x7f30a41611b0 2023-12-24T20:08:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30a9c8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30a406c820 0x7f30a406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30a948c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a41611b0 0x7f30a4161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30a8c8b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f30a40ae100 0x7f30a406b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34040/0 (socket says 172.21.15.50:34040) 2023-12-24T20:08:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30a8c8b700 1 -- 172.21.15.50:0/435500543 learned_addr learned my addr 172.21.15.50:0/435500543 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.429+0000 7f30a9c8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30a406c820 0x7f30a406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59432/0 (socket says 172.21.15.50:59432) 2023-12-24T20:08:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f309bfff700 1 -- 172.21.15.50:0/435500543 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924449038 0 0) 0x7f3094001110 con 0x7f30a40ae100 2023-12-24T20:08:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f309bfff700 1 -- 172.21.15.50:0/435500543 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3090003570 con 0x7f30a40ae100 2023-12-24T20:08:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30a9c8d700 1 -- 172.21.15.50:0/435500543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a41611b0 msgr2=0x7f30a4161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30a9c8d700 1 --2- 172.21.15.50:0/435500543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a41611b0 0x7f30a4161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30a9c8d700 1 -- 172.21.15.50:0/435500543 >> v1:172.21.15.82:6789/0 conn(0x7f30a40ae100 legacy=0x7f30a406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30a9c8d700 1 -- 172.21.15.50:0/435500543 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40ab8c0 con 0x7f30a406c820 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30a9c8d700 1 --2- 172.21.15.50:0/435500543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a406c820 0x7f30a406cc50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e60 tx=0x7f309c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aba2011b8384156 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f309bfff700 1 -- 172.21.15.50:0/435500543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c00e070 con 0x7f30a406c820 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f309bfff700 1 -- 172.21.15.50:0/435500543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c00bab0 con 0x7f30a406c820 2023-12-24T20:08:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f309bfff700 1 -- 172.21.15.50:0/435500543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c00be70 con 0x7f30a406c820 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 -- 172.21.15.50:0/435500543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a406c820 msgr2=0x7f30a406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 --2- 172.21.15.50:0/435500543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a406c820 0x7f30a406cc50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e60 tx=0x7f309c009780 comp rx=0 tx=0).stop 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 -- 172.21.15.50:0/435500543 shutdown_connections 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 --2- 172.21.15.50:0/435500543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a406c820 0x7f30a406cc50 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 --2- 172.21.15.50:0/435500543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a41611b0 0x7f30a4161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 -- 172.21.15.50:0/435500543 >> 172.21.15.50:0/435500543 conn(0x7f30a4067b80 msgr2=0x7f30a40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 -- 172.21.15.50:0/435500543 shutdown_connections 2023-12-24T20:08:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.433+0000 7f30aa48e700 1 -- 172.21.15.50:0/435500543 wait complete. 2023-12-24T20:08:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 Processor -- start 2023-12-24T20:08:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 -- start start 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a406c820 0x7f30a4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 0x7f30a40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b0ab0 con 0x7f30a40ae100 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4171060 con 0x7f30a41611b0 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30aa48e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b04f0 con 0x7f30a406c820 2023-12-24T20:08:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30a8c8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30a8c8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59436/0 (socket says 172.21.15.50:59436) 2023-12-24T20:08:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30a8c8b700 1 -- 172.21.15.50:0/436606931 learned_addr learned my addr 172.21.15.50:0/436606931 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30a9c8d700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 0x7f30a40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.437+0000 7f30a948c700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a406c820 0x7f30a4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a406c820 msgr2=0x7f30a4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a406c820 0x7f30a4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 msgr2=0x7f30a40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 0x7f30a40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 -- 172.21.15.50:0/436606931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c009a20 con 0x7f30a40ae100 2023-12-24T20:08:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a9c8d700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 0x7f30a40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30a8c8b700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f309400c7f0 tx=0x7f3094007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094005c00 con 0x7f30a40ae100 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094005d80 con 0x7f30a40ae100 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a40b07d0 con 0x7f30a40ae100 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094007320 con 0x7f30a40ae100 2023-12-24T20:08:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a414ff10 con 0x7f30a40ae100 2023-12-24T20:08:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.441+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a404be40 con 0x7f30a40ae100 2023-12-24T20:08:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.445+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f309401b3b0 con 0x7f30a40ae100 2023-12-24T20:08:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.445+0000 7f30997fa700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 0x7f3088062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.445+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f309407c340 con 0x7f30a40ae100 2023-12-24T20:08:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.445+0000 7f30a948c700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 msgr2=0x7f3088062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:21.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.445+0000 7f30a948c700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 0x7f3088062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:21.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.453+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f309404c220 con 0x7f30a40ae100 2023-12-24T20:08:21.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.649+0000 7f30a948c700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 msgr2=0x7f3088062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:21.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.649+0000 7f30a948c700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 0x7f3088062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.661+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30a406c4d0 con 0x7f30a40ae100 2023-12-24T20:08:21.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.661+0000 7f30997fa700 1 -- 172.21.15.50:0/436606931 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f30a406c4d0 con 0x7f30a40ae100 2023-12-24T20:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:08:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 msgr2=0x7f3088062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 0x7f3088062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 msgr2=0x7f30a414f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f309400c7f0 tx=0x7f3094007c70 comp rx=0 tx=0).stop 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 shutdown_connections 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3088060670 0x7f3088062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30a41611b0 0x7f30a40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30a40ae100 0x7f30a414f410 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 --2- 172.21.15.50:0/436606931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30a406c820 0x7f30a4155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 >> 172.21.15.50:0/436606931 conn(0x7f30a4067b80 msgr2=0x7f30a415dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 shutdown_connections 2023-12-24T20:08:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.665+0000 7f30aa48e700 1 -- 172.21.15.50:0/436606931 wait complete. 2023-12-24T20:08:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T20:08:21.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:21.801 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:21.793+0000 7f42b7bce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:08:21.857 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:21.853+0000 7fc1abb5e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:08:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 Processor -- start 2023-12-24T20:08:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 -- start start 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc28c06b6b0 0x7fc28c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc28c155710 0x7fc28c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c06e110 con 0x7fc28c0ad220 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c06bb40 con 0x7fc28c155710 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c06be20 con 0x7fc28c06b6b0 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc28c155710 0x7fc28c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc28c155710 0x7fc28c155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59452/0 (socket says 172.21.15.50:59452) 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc28ad9d700 1 -- 172.21.15.50:0/1162377795 learned_addr learned my addr 172.21.15.50:0/1162377795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.857+0000 7fc283fff700 1 --2- 172.21.15.50:0/1162377795 >> v2:172.21.15.82:3300/0 conn(0x7fc28c06b6b0 0x7fc28c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28ad9d700 1 -- 172.21.15.50:0/1162377795 >> v2:172.21.15.82:3300/0 conn(0x7fc28c06b6b0 msgr2=0x7fc28c0ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28ad9d700 1 --2- 172.21.15.50:0/1162377795 >> v2:172.21.15.82:3300/0 conn(0x7fc28c06b6b0 0x7fc28c0ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28ad9d700 1 -- 172.21.15.50:0/1162377795 >> v1:172.21.15.82:6789/0 conn(0x7fc28c0ad220 legacy=0x7fc28c06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28ad9d700 1 -- 172.21.15.50:0/1162377795 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0af740 con 0x7fc28c155710 2023-12-24T20:08:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28ad9d700 1 --2- 172.21.15.50:0/1162377795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c155b70 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc28c06a3c0 tx=0x7fc284009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c05bdbe0b4570 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc289d9b700 1 -- 172.21.15.50:0/1162377795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400e070 con 0x7fc28c155710 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc289d9b700 1 -- 172.21.15.50:0/1162377795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28400ba20 con 0x7fc28c155710 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc289d9b700 1 -- 172.21.15.50:0/1162377795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840092e0 con 0x7fc28c155710 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 -- 172.21.15.50:0/1162377795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 msgr2=0x7fc28c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 --2- 172.21.15.50:0/1162377795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c155b70 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc28c06a3c0 tx=0x7fc284009840 comp rx=0 tx=0).stop 2023-12-24T20:08:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 -- 172.21.15.50:0/1162377795 shutdown_connections 2023-12-24T20:08:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 --2- 172.21.15.50:0/1162377795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c155b70 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 --2- 172.21.15.50:0/1162377795 >> v2:172.21.15.82:3300/0 conn(0x7fc28c06b6b0 0x7fc28c0ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 -- 172.21.15.50:0/1162377795 >> 172.21.15.50:0/1162377795 conn(0x7fc28c067b80 msgr2=0x7fc28c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 -- 172.21.15.50:0/1162377795 shutdown_connections 2023-12-24T20:08:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.861+0000 7fc28b59e700 1 -- 172.21.15.50:0/1162377795 wait complete. 2023-12-24T20:08:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 Processor -- start 2023-12-24T20:08:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- start start 2023-12-24T20:08:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c06b6b0 0x7fc28c145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1451d0 con 0x7fc28c155710 2023-12-24T20:08:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c147030 con 0x7fc28c0ad220 2023-12-24T20:08:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1484e0 con 0x7fc28c06b6b0 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28a59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c06b6b0 0x7fc28c145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56548/0 (socket says 172.21.15.50:56548) 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 -- 172.21.15.50:0/2103992678 learned_addr learned my addr 172.21.15.50:0/2103992678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 -- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c06b6b0 msgr2=0x7fc28c145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c06b6b0 0x7fc28c145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 -- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 msgr2=0x7fc28c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 -- 172.21.15.50:0/2103992678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009ae0 con 0x7fc28c0ad220 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28ad9d700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc283fff700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc27400ec80 tx=0x7fc2740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400c850 con 0x7fc28c0ad220 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400c9b0 con 0x7fc28c0ad220 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c146420 con 0x7fc28c0ad220 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400cd50 con 0x7fc28c0ad220 2023-12-24T20:08:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.865+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c1469e0 con 0x7fc28c0ad220 2023-12-24T20:08:21.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c06b480 con 0x7fc28c0ad220 2023-12-24T20:08:21.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fc274013680 con 0x7fc28c0ad220 2023-12-24T20:08:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc2827fc700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 0x7fc26c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc27407d4f0 con 0x7fc28c0ad220 2023-12-24T20:08:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc28a59c700 1 -- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 msgr2=0x7fc26c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.869+0000 7fc28a59c700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 0x7fc26c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:21.877+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc28c06b480 con 0x7fc28c0ad220 2023-12-24T20:08:21.888 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:21.881+0000 7f42b7bce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:08:21.943 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:21.941+0000 7fc1abb5e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:08:22.043 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.037+0000 7f42b7bce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.057+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc28c06b480 con 0x7fc28c0ad220 2023-12-24T20:08:22.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc2827fc700 1 -- 172.21.15.50:0/2103992678 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17185 (secure 0 0 0) 0x7fc28c06b480 con 0x7fc28c0ad220 2023-12-24T20:08:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:22.065 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":180,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:22.031417+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2348689371":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/3889288613":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2020731815":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2623688854":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2602753322":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2424533746":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/767919455":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3012835903":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/1974691616":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6837/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6836/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3552589056":"2023-12-25T19:52:39.403854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":16,"length":1},{"begin":32,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:22.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 msgr2=0x7fc26c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 0x7fc26c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 msgr2=0x7fc28c158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc27400ec80 tx=0x7fc2740091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 shutdown_connections 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc26c060670 0x7fc26c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc28c155710 0x7fc28c159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ad220 0x7fc28c158c20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 --2- 172.21.15.50:0/2103992678 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c06b6b0 0x7fc28c145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 >> 172.21.15.50:0/2103992678 conn(0x7fc28c067b80 msgr2=0x7fc28c06ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:22.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 shutdown_connections 2023-12-24T20:08:22.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.061+0000 7fc28b59e700 1 -- 172.21.15.50:0/2103992678 wait complete. 2023-12-24T20:08:22.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:52:18.561272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:52:19.051332+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 180, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:08:22.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:08:22.105 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.101+0000 7fc1abb5e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:22.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.257+0000 7feb8d80c700 1 Processor -- start 2023-12-24T20:08:22.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.257+0000 7feb8d80c700 1 -- start start 2023-12-24T20:08:22.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb8d80c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb880cc780 0x7feb880ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb8d80c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8806a580 con 0x7feb88158c40 2023-12-24T20:08:22.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb8d80c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880cd110 con 0x7feb8806cd40 2023-12-24T20:08:22.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb8d80c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8806a7d0 con 0x7feb880cc780 2023-12-24T20:08:22.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb87fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb880cc780 0x7feb880ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb87fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb880cc780 0x7feb880ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59464/0 (socket says 172.21.15.50:59464) 2023-12-24T20:08:22.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.261+0000 7feb87fff700 1 -- 172.21.15.50:0/2378993626 learned_addr learned my addr 172.21.15.50:0/2378993626 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb87fff700 1 -- 172.21.15.50:0/2378993626 >> v1:172.21.15.82:6789/0 conn(0x7feb8806cd40 legacy=0x7feb8806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb87fff700 1 -- 172.21.15.50:0/2378993626 >> v1:172.21.15.50:6789/0 conn(0x7feb88158c40 legacy=0x7feb880cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb87fff700 1 -- 172.21.15.50:0/2378993626 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8806aab0 con 0x7feb880cc780 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb87fff700 1 --2- 172.21.15.50:0/2378993626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb880cc780 0x7feb880ccbd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7feb740099b0 tx=0x7feb74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59007ba9f96d1f08 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb877fe700 1 -- 172.21.15.50:0/2378993626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400b860 con 0x7feb880cc780 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb877fe700 1 -- 172.21.15.50:0/2378993626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400b9c0 con 0x7feb880cc780 2023-12-24T20:08:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb877fe700 1 -- 172.21.15.50:0/2378993626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400bd60 con 0x7feb880cc780 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 -- 172.21.15.50:0/2378993626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb880cc780 msgr2=0x7feb880ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 --2- 172.21.15.50:0/2378993626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb880cc780 0x7feb880ccbd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7feb740099b0 tx=0x7feb74009250 comp rx=0 tx=0).stop 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 -- 172.21.15.50:0/2378993626 shutdown_connections 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 --2- 172.21.15.50:0/2378993626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb880cc780 0x7feb880ccbd0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 -- 172.21.15.50:0/2378993626 >> 172.21.15.50:0/2378993626 conn(0x7feb880d0800 msgr2=0x7feb880b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 -- 172.21.15.50:0/2378993626 shutdown_connections 2023-12-24T20:08:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.265+0000 7feb8d80c700 1 -- 172.21.15.50:0/2378993626 wait complete. 2023-12-24T20:08:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 Processor -- start 2023-12-24T20:08:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 -- start start 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb8806cd40 0x7feb880c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb880cc780 0x7feb880ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c6500 con 0x7feb88158c40 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c5a70 con 0x7feb880cc780 2023-12-24T20:08:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.269+0000 7feb8d80c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ca5d0 con 0x7feb8806cd40 2023-12-24T20:08:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59478/0 (socket says 172.21.15.50:59478) 2023-12-24T20:08:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb880cc780 0x7feb880ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 -- 172.21.15.50:0/4261516216 learned_addr learned my addr 172.21.15.50:0/4261516216 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8c80a700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb8806cd40 0x7feb880c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 -- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb8806cd40 msgr2=0x7feb880c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb8806cd40 0x7feb880c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 -- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb880cc780 msgr2=0x7feb880ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb880cc780 0x7feb880ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 -- 172.21.15.50:0/4261516216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb740094f0 con 0x7feb88158c40 2023-12-24T20:08:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d00b700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c840 tx=0x7feb80001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80012630 con 0x7feb88158c40 2023-12-24T20:08:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800127b0 con 0x7feb88158c40 2023-12-24T20:08:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb880c5c60 con 0x7feb88158c40 2023-12-24T20:08:22.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80012b70 con 0x7feb88158c40 2023-12-24T20:08:22.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.273+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb880c6220 con 0x7feb88158c40 2023-12-24T20:08:22.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.277+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8804be40 con 0x7feb88158c40 2023-12-24T20:08:22.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.277+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7feb8001a3a0 con 0x7feb88158c40 2023-12-24T20:08:22.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.277+0000 7feb84ff9700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 0x7feb6c062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.277+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 7120+0+0 (secure 0 0 0) 0x7feb8007d070 con 0x7feb88158c40 2023-12-24T20:08:22.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.277+0000 7feb8c80a700 1 -- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 msgr2=0x7feb6c062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:22.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.281+0000 7feb8c80a700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 0x7feb6c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:22.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.285+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feb8004cf50 con 0x7feb88158c40 2023-12-24T20:08:22.328 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.321+0000 7f42b7bce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:08:22.400 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.393+0000 7f42b7bce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:22.407 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.405+0000 7fc1abb5e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:08:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.465+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb8806ad90 con 0x7feb88158c40 2023-12-24T20:08:22.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.465+0000 7feb84ff9700 1 -- 172.21.15.50:0/4261516216 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb80050570 con 0x7feb88158c40 2023-12-24T20:08:22.468 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 msgr2=0x7feb6c062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 0x7feb6c062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 msgr2=0x7feb880c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c840 tx=0x7feb80001670 comp rx=0 tx=0).stop 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 shutdown_connections 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7feb6c060670 0x7feb6c062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb88158c40 0x7feb880c9150 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb880cc780 0x7feb880ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 --2- 172.21.15.50:0/4261516216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feb8806cd40 0x7feb880c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 >> 172.21.15.50:0/4261516216 conn(0x7feb880d0800 msgr2=0x7feb880b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 shutdown_connections 2023-12-24T20:08:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.469+0000 7feb8d80c700 1 -- 172.21.15.50:0/4261516216 wait complete. 2023-12-24T20:08:22.484 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.481+0000 7fc1abb5e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:22.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:08:22.628 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.621+0000 7f42b7bce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:08:22.714 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.709+0000 7f42b7bce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:08:22.721 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.717+0000 7fc1abb5e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:08:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 Processor -- start 2023-12-24T20:08:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 -- start start 2023-12-24T20:08:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d04156e80 0x7f9d040c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0415b5a0 con 0x7f9d04156ab0 2023-12-24T20:08:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040c9100 con 0x7f9d04156e80 2023-12-24T20:08:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.729+0000 7f9d0b00c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0415a990 con 0x7f9d040c8d10 2023-12-24T20:08:22.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d04156e80 0x7f9d040c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0a80b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0a80b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56570/0 (socket says 172.21.15.50:56570) 2023-12-24T20:08:22.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0a80b700 1 -- 172.21.15.50:0/1070168723 learned_addr learned my addr 172.21.15.50:0/1070168723 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 -- 172.21.15.50:0/1070168723 >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 msgr2=0x7f9d040c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 --2- 172.21.15.50:0/1070168723 >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 -- 172.21.15.50:0/1070168723 >> v1:172.21.15.82:6789/0 conn(0x7f9d04156ab0 legacy=0x7f9d040adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 -- 172.21.15.50:0/1070168723 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0415ac70 con 0x7f9d04156e80 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0a80b700 1 --2- 172.21.15.50:0/1070168723 >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09809700 1 --2- 172.21.15.50:0/1070168723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d040c87d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9d040cb8d0 tx=0x7f9cf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7003b93649bf5d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:22.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09008700 1 -- 172.21.15.50:0/1070168723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011630 con 0x7f9d04156e80 2023-12-24T20:08:22.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09008700 1 -- 172.21.15.50:0/1070168723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4011790 con 0x7f9d04156e80 2023-12-24T20:08:22.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d09008700 1 -- 172.21.15.50:0/1070168723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011b30 con 0x7f9d04156e80 2023-12-24T20:08:22.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 -- 172.21.15.50:0/1070168723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 msgr2=0x7f9d040c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/1070168723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d040c87d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9d040cb8d0 tx=0x7f9cf40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 -- 172.21.15.50:0/1070168723 shutdown_connections 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/1070168723 >> v2:172.21.15.82:3300/0 conn(0x7f9d040c8d10 0x7f9d040c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/1070168723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d040c87d0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 -- 172.21.15.50:0/1070168723 >> 172.21.15.50:0/1070168723 conn(0x7f9d04067250 msgr2=0x7f9d04067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 -- 172.21.15.50:0/1070168723 shutdown_connections 2023-12-24T20:08:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.733+0000 7f9d0b00c700 1 -- 172.21.15.50:0/1070168723 wait complete. 2023-12-24T20:08:22.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 Processor -- start 2023-12-24T20:08:22.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 -- start start 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d040c8d10 0x7f9d040cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d04156ab0 0x7f9d040ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04159c30 con 0x7f9d04156e80 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04159020 con 0x7f9d04156ab0 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0b00c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04159300 con 0x7f9d040c8d10 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59492/0 (socket says 172.21.15.50:59492) 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 -- 172.21.15.50:0/2506087122 learned_addr learned my addr 172.21.15.50:0/2506087122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:22.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d09809700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d04156ab0 0x7f9d040ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a00a700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d040c8d10 0x7f9d040cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 -- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d040c8d10 msgr2=0x7f9d040cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d040c8d10 0x7f9d040cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 -- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d04156ab0 msgr2=0x7f9d040ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d04156ab0 0x7f9d040ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.737+0000 7f9d0a80b700 1 -- 172.21.15.50:0/2506087122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009ae0 con 0x7f9d04156e80 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9d0a80b700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009f30 tx=0x7f9cfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc018070 con 0x7f9d04156e80 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc00f040 con 0x7f9d04156e80 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4009420 con 0x7f9d04156e80 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00cc20 con 0x7f9d04156e80 2023-12-24T20:08:22.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d041598c0 con 0x7f9d04156e80 2023-12-24T20:08:22.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d04159da0 con 0x7f9d04156e80 2023-12-24T20:08:22.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.741+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f9cfc003020 con 0x7f9d04156e80 2023-12-24T20:08:22.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.745+0000 7f9cfa7fc700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 0x7f9ce8062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:22.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.745+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f9cfc07d450 con 0x7f9d04156e80 2023-12-24T20:08:22.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.745+0000 7f9d0a00a700 1 -- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 msgr2=0x7f9ce8062bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:22.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.745+0000 7f9d0a00a700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 0x7f9ce8062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:22.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.749+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9cfc050d30 con 0x7f9d04156e80 2023-12-24T20:08:22.803 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:22.797+0000 7f42b7bce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:08:22.820 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.817+0000 7fc1abb5e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:08:22.916 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:22.913+0000 7fc1abb5e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:08:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.925+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d0404be40 con 0x7f9d04156e80 2023-12-24T20:08:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.925+0000 7f9cfa7fc700 1 -- 172.21.15.50:0/2506087122 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cfc0508c0 con 0x7f9d04156e80 2023-12-24T20:08:22.928 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 msgr2=0x7f9ce8062bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 0x7f9ce8062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 msgr2=0x7f9d041689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009f30 tx=0x7f9cfc00b040 comp rx=0 tx=0).stop 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 shutdown_connections 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9ce8060740 0x7f9ce8062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d04156e80 0x7f9d041689b0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d04156ab0 0x7f9d040ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 --2- 172.21.15.50:0/2506087122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d040c8d10 0x7f9d040cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 >> 172.21.15.50:0/2506087122 conn(0x7f9d04067250 msgr2=0x7f9d04151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 shutdown_connections 2023-12-24T20:08:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:22.929+0000 7f9d0b00c700 1 -- 172.21.15.50:0/2506087122 wait complete. 2023-12-24T20:08:22.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:08:23.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 Processor -- start 2023-12-24T20:08:23.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 -- start start 2023-12-24T20:08:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 0x7fa268161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680cd380 con 0x7fa26806cbf0 2023-12-24T20:08:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680cc770 con 0x7fa26806c820 2023-12-24T20:08:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26ddcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680cca50 con 0x7fa26815f820 2023-12-24T20:08:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa25ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa26806cbf0 0x7fa26806d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45622/0 (socket says 172.21.15.50:45622) 2023-12-24T20:08:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa25ffff700 1 -- 172.21.15.50:0/3220023406 learned_addr learned my addr 172.21.15.50:0/3220023406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa26d5cb700 1 --2- 172.21.15.50:0/3220023406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 0x7fa268161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533602550 0 0) 0x7fa2680cd380 con 0x7fa26806cbf0 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.113+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003570 con 0x7fa26806cbf0 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3220023406 >> v1:172.21.15.82:6789/0 conn(0x7fa26806c820 legacy=0x7fa2680cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3220023406 >> v1:172.21.15.50:6789/0 conn(0x7fa26806cbf0 legacy=0x7fa26806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323222217 0 0) 0x7fa250003570 con 0x7fa26806cbf0 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3220023406 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680ccd30 con 0x7fa26815f820 2023-12-24T20:08:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26d5cb700 1 --2- 172.21.15.50:0/3220023406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 0x7fa268161c00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e90 tx=0x7fa260009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddc79a823fc6e534 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000e070 con 0x7fa26815f820 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000b920 con 0x7fa26815f820 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa25f7fe700 1 -- 172.21.15.50:0/3220023406 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258001470 con 0x7fa26815f820 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3220023406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 msgr2=0x7fa268161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3220023406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 0x7fa268161c00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e90 tx=0x7fa260009780 comp rx=0 tx=0).stop 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3220023406 shutdown_connections 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3220023406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26815f820 0x7fa268161c00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3220023406 >> 172.21.15.50:0/3220023406 conn(0x7fa2680ca600 msgr2=0x7fa2680caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3220023406 shutdown_connections 2023-12-24T20:08:23.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.117+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3220023406 wait complete. 2023-12-24T20:08:23.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 Processor -- start 2023-12-24T20:08:23.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 -- start start 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26806c820 0x7fa268152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 0x7fa268157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268153560 con 0x7fa26806cbf0 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681583b0 con 0x7fa26815f820 2023-12-24T20:08:23.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26ddcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268159d50 con 0x7fa26806c820 2023-12-24T20:08:23.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa25ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 0x7fa268157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa25ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59494/0 (socket says 172.21.15.50:59494) 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa25ffff700 1 -- 172.21.15.50:0/3409567903 learned_addr learned my addr 172.21.15.50:0/3409567903 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26cdca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26806c820 0x7fa268152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26806c820 msgr2=0x7fa268152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26806c820 0x7fa268152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 msgr2=0x7fa2681526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.121+0000 7fa26d5cb700 1 -- 172.21.15.50:0/3409567903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009a20 con 0x7fa26815f820 2023-12-24T20:08:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa25ffff700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa26d5cb700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 0x7fa268157740 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa260014000 tx=0x7fa260017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260012c40 con 0x7fa26815f820 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260012de0 con 0x7fa26815f820 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26815a030 con 0x7fa26815f820 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2600266b0 con 0x7fa26815f820 2023-12-24T20:08:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa268159a20 con 0x7fa26815f820 2023-12-24T20:08:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.125+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268159bb0 con 0x7fa26815f820 2023-12-24T20:08:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.129+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fa26001d440 con 0x7fa26815f820 2023-12-24T20:08:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.129+0000 7fa25cff9700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 0x7fa254062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.129+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fa26007ec50 con 0x7fa26815f820 2023-12-24T20:08:23.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.129+0000 7fa26cdca700 1 -- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 msgr2=0x7fa254062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:23.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.129+0000 7fa26cdca700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 0x7fa254062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.141+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa268159bb0 con 0x7fa26815f820 2023-12-24T20:08:23.212 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:23.205+0000 7f42b7bce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:08:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.317+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa268159bb0 con 0x7fa26815f820 2023-12-24T20:08:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.317+0000 7fa25cff9700 1 -- 172.21.15.50:0/3409567903 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa268159bb0 con 0x7fa26815f820 2023-12-24T20:08:23.321 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T20:08:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 msgr2=0x7fa254062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 0x7fa254062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 msgr2=0x7fa268157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 0x7fa268157740 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa260014000 tx=0x7fa260017000 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 shutdown_connections 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa254060670 0x7fa254062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26815f820 0x7fa268157740 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26806cbf0 0x7fa2681526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 --2- 172.21.15.50:0/3409567903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa26806c820 0x7fa268152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 >> 172.21.15.50:0/3409567903 conn(0x7fa2680ca600 msgr2=0x7fa26806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 shutdown_connections 2023-12-24T20:08:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.321+0000 7fa26ddcc700 1 -- 172.21.15.50:0/3409567903 wait complete. 2023-12-24T20:08:23.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:23.357 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:23.353+0000 7fc1abb5e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:08:23.381 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:23.373+0000 7f42b7bce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:08:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.497+0000 7eff4186e700 1 Processor -- start 2023-12-24T20:08:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.497+0000 7eff4186e700 1 -- start start 2023-12-24T20:08:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff3c06ab80 0x7eff3c06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c06cd10 con 0x7eff3c06a7b0 2023-12-24T20:08:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c06b920 con 0x7eff3c159cf0 2023-12-24T20:08:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0ad4e0 con 0x7eff3c06ab80 2023-12-24T20:08:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff3c06ab80 0x7eff3c06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff3c06ab80 0x7eff3c06b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59496/0 (socket says 172.21.15.50:59496) 2023-12-24T20:08:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 -- 172.21.15.50:0/3382972426 learned_addr learned my addr 172.21.15.50:0/3382972426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3b7fe700 1 --1- 172.21.15.50:0/3382972426 >> v1:172.21.15.82:6789/0 conn(0x7eff3c159cf0 0x7eff3c06d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34102/0 (socket says 172.21.15.50:34102) 2023-12-24T20:08:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 -- 172.21.15.50:0/3382972426 >> v1:172.21.15.82:6789/0 conn(0x7eff3c159cf0 legacy=0x7eff3c06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 -- 172.21.15.50:0/3382972426 >> v1:172.21.15.50:6789/0 conn(0x7eff3c06a7b0 legacy=0x7eff3c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 -- 172.21.15.50:0/3382972426 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c06bc00 con 0x7eff3c06ab80 2023-12-24T20:08:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff39ffb700 1 -- 172.21.15.50:0/3382972426 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974383116 0 0) 0x7eff3c06b920 con 0x7eff3c159cf0 2023-12-24T20:08:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff3a7fc700 1 --2- 172.21.15.50:0/3382972426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06ab80 0x7eff3c06b2d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7eff300099b0 tx=0x7eff30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e19e22932375f7f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff39ffb700 1 -- 172.21.15.50:0/3382972426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b860 con 0x7eff3c06ab80 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff39ffb700 1 -- 172.21.15.50:0/3382972426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000b9c0 con 0x7eff3c06ab80 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff39ffb700 1 -- 172.21.15.50:0/3382972426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000bd60 con 0x7eff3c06ab80 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- 172.21.15.50:0/3382972426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06ab80 msgr2=0x7eff3c06b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 --2- 172.21.15.50:0/3382972426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06ab80 0x7eff3c06b2d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7eff300099b0 tx=0x7eff30009250 comp rx=0 tx=0).stop 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- 172.21.15.50:0/3382972426 shutdown_connections 2023-12-24T20:08:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 --2- 172.21.15.50:0/3382972426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06ab80 0x7eff3c06b2d0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- 172.21.15.50:0/3382972426 >> 172.21.15.50:0/3382972426 conn(0x7eff3c067b40 msgr2=0x7eff3c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- 172.21.15.50:0/3382972426 shutdown_connections 2023-12-24T20:08:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.501+0000 7eff4186e700 1 -- 172.21.15.50:0/3382972426 wait complete. 2023-12-24T20:08:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 Processor -- start 2023-12-24T20:08:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 -- start start 2023-12-24T20:08:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 0x7eff3c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 0x7eff3c16d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff3c159cf0 0x7eff3c16e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c31e0 con 0x7eff3c06a7b0 2023-12-24T20:08:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c153c00 con 0x7eff3c06ab80 2023-12-24T20:08:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff4186e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c16db90 con 0x7eff3c159cf0 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff3affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 0x7eff3c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.505+0000 7eff3affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 0x7eff3c1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59506/0 (socket says 172.21.15.50:59506) 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3affd700 1 -- 172.21.15.50:0/1793058760 learned_addr learned my addr 172.21.15.50:0/1793058760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 0x7eff3c16d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3b7fe700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff3c159cf0 0x7eff3c16e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff3c159cf0 msgr2=0x7eff3c16e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff3c159cf0 0x7eff3c16e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 msgr2=0x7eff3c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 0x7eff3c1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 -- 172.21.15.50:0/1793058760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094f0 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff3a7fc700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 0x7eff3c16d250 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff3c068050 tx=0x7eff30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3001f070 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30011b20 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30025420 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c16de70 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.509+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c16e150 con 0x7eff3c06ab80 2023-12-24T20:08:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0c3030 con 0x7eff3c06ab80 2023-12-24T20:08:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7eff30023070 con 0x7eff3c06ab80 2023-12-24T20:08:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff22ffd700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 0x7eff28062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7eff3007dee0 con 0x7eff3c06ab80 2023-12-24T20:08:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff3affd700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 msgr2=0x7eff28062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.513+0000 7eff3affd700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 0x7eff28062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.521+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff3004df00 con 0x7eff3c06ab80 2023-12-24T20:08:23.535 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:23.533+0000 7fc1abb5e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:08:23.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.717+0000 7eff3affd700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 msgr2=0x7eff28062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:23.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.717+0000 7eff3affd700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 0x7eff28062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.741+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff3c04be40 con 0x7eff3c06ab80 2023-12-24T20:08:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.741+0000 7eff22ffd700 1 -- 172.21.15.50:0/1793058760 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7eff300514a0 con 0x7eff3c06ab80 2023-12-24T20:08:23.747 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:23.747 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:08:23.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 msgr2=0x7eff28062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:23.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 0x7eff28062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 msgr2=0x7eff3c16d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 0x7eff3c16d250 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff3c068050 tx=0x7eff30017000 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 shutdown_connections 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff28060670 0x7eff28062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff3c159cf0 0x7eff3c16e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c06ab80 0x7eff3c16d250 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 --2- 172.21.15.50:0/1793058760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff3c06a7b0 0x7eff3c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 >> 172.21.15.50:0/1793058760 conn(0x7eff3c067b40 msgr2=0x7eff3c15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 shutdown_connections 2023-12-24T20:08:23.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.749+0000 7eff4186e700 1 -- 172.21.15.50:0/1793058760 wait complete. 2023-12-24T20:08:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T20:08:23.768 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:23.761+0000 7f42b7bce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:08:23.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:23.954 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:23.949+0000 7fc1abb5e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:08:23.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.985+0000 7fe1482cd700 1 Processor -- start 2023-12-24T20:08:23.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 -- start start 2023-12-24T20:08:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe140158e10 0x7fe14015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1400b3c90 0x7fe14006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1400b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1400b49c0 con 0x7fe140158e10 2023-12-24T20:08:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14006d040 con 0x7fe1400b3c90 2023-12-24T20:08:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe1482cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b2540 con 0x7fe1400b1ba0 2023-12-24T20:08:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe146069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe140158e10 0x7fe14015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe146069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe140158e10 0x7fe14015d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59508/0 (socket says 172.21.15.50:59508) 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe146069700 1 -- 172.21.15.50:0/4288502692 learned_addr learned my addr 172.21.15.50:0/4288502692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe145868700 1 --2- 172.21.15.50:0/4288502692 >> v2:172.21.15.82:3300/0 conn(0x7fe1400b3c90 0x7fe14006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.989+0000 7fe14686a700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1400b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 -- 172.21.15.50:0/4288502692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 msgr2=0x7fe1400b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1400b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 -- 172.21.15.50:0/4288502692 >> v2:172.21.15.82:3300/0 conn(0x7fe1400b3c90 msgr2=0x7fe14006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 --2- 172.21.15.50:0/4288502692 >> v2:172.21.15.82:3300/0 conn(0x7fe1400b3c90 0x7fe14006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 -- 172.21.15.50:0/4288502692 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14006d5c0 con 0x7fe140158e10 2023-12-24T20:08:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe146069700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe14015d6d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fe1400694f0 tx=0x7fe13c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc98575af8c0a68a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe145067700 1 -- 172.21.15.50:0/4288502692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c009e70 con 0x7fe140158e10 2023-12-24T20:08:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe145067700 1 -- 172.21.15.50:0/4288502692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00b860 con 0x7fe140158e10 2023-12-24T20:08:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe145067700 1 -- 172.21.15.50:0/4288502692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00bc00 con 0x7fe140158e10 2023-12-24T20:08:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 -- 172.21.15.50:0/4288502692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 msgr2=0x7fe14015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe14015d6d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fe1400694f0 tx=0x7fe13c009250 comp rx=0 tx=0).stop 2023-12-24T20:08:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 -- 172.21.15.50:0/4288502692 shutdown_connections 2023-12-24T20:08:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 --2- 172.21.15.50:0/4288502692 >> v2:172.21.15.82:3300/0 conn(0x7fe1400b3c90 0x7fe14006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1400b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 --2- 172.21.15.50:0/4288502692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe14015d6d0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 -- 172.21.15.50:0/4288502692 >> 172.21.15.50:0/4288502692 conn(0x7fe1400670b0 msgr2=0x7fe1400674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 -- 172.21.15.50:0/4288502692 shutdown_connections 2023-12-24T20:08:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.993+0000 7fe1482cd700 1 -- 172.21.15.50:0/4288502692 wait complete. 2023-12-24T20:08:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.997+0000 7fe1482cd700 1 Processor -- start 2023-12-24T20:08:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:23.997+0000 7fe1482cd700 1 -- start start 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1401516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1400b3c90 0x7fe1400a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400ab560 con 0x7fe140158e10 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14016a680 con 0x7fe1400b3c90 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400a88d0 con 0x7fe1400b1ba0 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59514/0 (socket says 172.21.15.50:59514) 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 -- 172.21.15.50:0/120498279 learned_addr learned my addr 172.21.15.50:0/120498279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe146069700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1401516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe145868700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1400b3c90 0x7fe1400a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 -- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 msgr2=0x7fe1401516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1401516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 -- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1400b3c90 msgr2=0x7fe1400a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1400b3c90 0x7fe1400a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 -- 172.21.15.50:0/120498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094f0 con 0x7fe140158e10 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe14686a700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe138009fd0 tx=0x7fe138009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800ebf0 con 0x7fe140158e10 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800ed50 con 0x7fe140158e10 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1400a9450 con 0x7fe140158e10 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138014670 con 0x7fe140158e10 2023-12-24T20:08:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.001+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400a90e0 con 0x7fe140158e10 2023-12-24T20:08:24.007 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.001+0000 7f42b7bce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:24.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.005+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400a95e0 con 0x7fe140158e10 2023-12-24T20:08:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.005+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fe1380149e0 con 0x7fe140158e10 2023-12-24T20:08:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.009+0000 7fe1367fc700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 0x7fe124062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.009+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fe13807d4a0 con 0x7fe140158e10 2023-12-24T20:08:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.009+0000 7fe146069700 1 -- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 msgr2=0x7fe124062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.009+0000 7fe146069700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 0x7fe124062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.013+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe13804d410 con 0x7fe140158e10 2023-12-24T20:08:24.104 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.097+0000 7f42b7bce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:08:24.190 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.185+0000 7f42b7bce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:08:24.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.189+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1400a8c30 con 0x7fe140158e10 2023-12-24T20:08:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.193+0000 7fe1367fc700 1 -- 172.21.15.50:0/120498279 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+17160 (secure 0 0 0) 0x7fe138050a30 con 0x7fe140158e10 2023-12-24T20:08:24.197 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:24.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":181,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:23.045122+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2348689371":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/3889288613":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2020731815":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2623688854":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2602753322":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2424533746":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/767919455":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3012835903":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/1974691616":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6837/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6836/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3552589056":"2023-12-25T19:52:39.403854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:24.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 msgr2=0x7fe124062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:24.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 0x7fe124062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 msgr2=0x7fe1400aa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe138009fd0 tx=0x7fe138009900 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 shutdown_connections 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe124060670 0x7fe124062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe140158e10 0x7fe1400aa280 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1400b3c90 0x7fe1400a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 --2- 172.21.15.50:0/120498279 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1400b1ba0 0x7fe1401516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 >> 172.21.15.50:0/120498279 conn(0x7fe1400670b0 msgr2=0x7fe140152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 shutdown_connections 2023-12-24T20:08:24.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.197+0000 7fe1482cd700 1 -- 172.21.15.50:0/120498279 wait complete. 2023-12-24T20:08:24.227 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:08:24.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:24.248 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.245+0000 7fc1abb5e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:24.274 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.269+0000 7f42b7bce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:08:24.342 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.337+0000 7fc1abb5e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:08:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.389+0000 7f9a131cc700 1 Processor -- start 2023-12-24T20:08:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a131cc700 1 -- start start 2023-12-24T20:08:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a131cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a0c06b6c0 0x7f9a0c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a131cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0a9c80 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a131cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0a9070 con 0x7f9a0c158cd0 2023-12-24T20:08:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a131cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c06c4f0 con 0x7f9a0c06b6c0 2023-12-24T20:08:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a129cb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9a0c06c0c0 0x7f9a0c06c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45648/0 (socket says 172.21.15.50:45648) 2023-12-24T20:08:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a129cb700 1 -- 172.21.15.50:0/1691547058 learned_addr learned my addr 172.21.15.50:0/1691547058 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a119c9700 1 --2- 172.21.15.50:0/1691547058 >> v2:172.21.15.82:3300/0 conn(0x7f9a0c06b6c0 0x7f9a0c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756581708 0 0) 0x7f9a0c0a9c80 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f8003570 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622387106 0 0) 0x7f99f8003570 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 >> v2:172.21.15.82:3300/0 conn(0x7f9a0c06b6c0 msgr2=0x7f9a0c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 --2- 172.21.15.50:0/1691547058 >> v2:172.21.15.82:3300/0 conn(0x7f9a0c06b6c0 0x7f9a0c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 >> v1:172.21.15.82:6789/0 conn(0x7f9a0c158cd0 legacy=0x7f9a0c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.393+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0a9350 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f9a040017f0 con 0x7f9a0c06c0c0 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 >> v1:172.21.15.50:6789/0 conn(0x7f9a0c06c0c0 legacy=0x7f9a0c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f8003a60 0x7f99f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f8004810 0x7f99f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 0x7f99f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c06c4f0 con 0x7f99f80051c0 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f800c0d0 con 0x7f99f8004810 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f800c290 con 0x7f99f8003a60 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 0x7f99f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a119c9700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f8004810 0x7f99f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a121ca700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f8003a60 0x7f99f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 -- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f8003a60 msgr2=0x7f99f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f8003a60 0x7f99f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 -- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f8004810 msgr2=0x7f99f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f8004810 0x7f99f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 -- 172.21.15.50:0/1691547058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8003570 con 0x7f99f80051c0 2023-12-24T20:08:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 -- 172.21.15.50:0/1691547058 reap_dead start 2023-12-24T20:08:24.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a129cb700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 0x7f99f800ba60 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a930 tx=0x7f9a040021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13a85d70d6a67b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040070d0 con 0x7f99f80051c0 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04007270 con 0x7f99f80051c0 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a111c8700 1 -- 172.21.15.50:0/1691547058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04007630 con 0x7f99f80051c0 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 -- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 msgr2=0x7f99f800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 0x7f99f800ba60 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a930 tx=0x7f9a040021d0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 -- 172.21.15.50:0/1691547058 shutdown_connections 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 --2- 172.21.15.50:0/1691547058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80051c0 0x7f99f800ba60 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 -- 172.21.15.50:0/1691547058 >> 172.21.15.50:0/1691547058 conn(0x7f9a0c067b80 msgr2=0x7f9a0c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 -- 172.21.15.50:0/1691547058 shutdown_connections 2023-12-24T20:08:24.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.397+0000 7f9a131cc700 1 -- 172.21.15.50:0/1691547058 wait complete. 2023-12-24T20:08:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.401+0000 7f9a131cc700 1 Processor -- start 2023-12-24T20:08:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.401+0000 7f9a131cc700 1 -- start start 2023-12-24T20:08:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f80051c0 0x7f9a0c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c152490 0x7f9a0c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c153890 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c152c80 con 0x7f9a0c152490 2023-12-24T20:08:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c152f60 con 0x7f99f80051c0 2023-12-24T20:08:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a121ca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f80051c0 0x7f9a0c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59528/0 (socket says 172.21.15.50:59528) 2023-12-24T20:08:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a119c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c152490 0x7f9a0c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 -- 172.21.15.50:0/392780707 learned_addr learned my addr 172.21.15.50:0/392780707 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f80051c0 msgr2=0x7f9a0c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f80051c0 0x7f9a0c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c152490 msgr2=0x7f9a0c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c152490 0x7f9a0c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 -- 172.21.15.50:0/392780707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c153240 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a129cb700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a3f0 tx=0x7f9a04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04023070 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040017f0 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04001960 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c153520 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.405+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c152900 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.409+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c04be40 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.413+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f9a04004bb0 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.413+0000 7f9a027fc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 0x7f99f0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.413+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7f9a0407f0b0 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.413+0000 7f9a121ca700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 msgr2=0x7f99f0062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.413+0000 7f9a121ca700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 0x7f99f0062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.421+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a0404f050 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.426 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.425+0000 7fc1abb5e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:08:24.509 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.501+0000 7f42b7bce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:24.511 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.509+0000 7fc1abb5e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:08:24.589 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.581+0000 7f42b7bce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:08:24.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.617+0000 7f9a121ca700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 msgr2=0x7f99f0062b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:24.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.617+0000 7f9a121ca700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 0x7f99f0062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:24.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.629+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a0c1539d0 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.629+0000 7f9a027fc700 1 -- 172.21.15.50:0/392780707 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f9a0c1539d0 con 0x7f9a0c15d7f0 2023-12-24T20:08:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:24.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 msgr2=0x7f99f0062b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 0x7f99f0062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 msgr2=0x7f9a0c15dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a3f0 tx=0x7f9a04016000 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 shutdown_connections 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f99f00606a0 0x7f99f0062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c15d7f0 0x7f9a0c15dc40 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c152490 0x7f9a0c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 --2- 172.21.15.50:0/392780707 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99f80051c0 0x7f9a0c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 >> 172.21.15.50:0/392780707 conn(0x7f9a0c067b80 msgr2=0x7f9a0c0c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 shutdown_connections 2023-12-24T20:08:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.633+0000 7f9a131cc700 1 -- 172.21.15.50:0/392780707 wait complete. 2023-12-24T20:08:24.638 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T20:08:24.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:24.688 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.681+0000 7f42b7bce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:08:24.755 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.753+0000 7fc1abb5e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:24.841 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.837+0000 7fc1abb5e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:08:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 Processor -- start 2023-12-24T20:08:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 -- start start 2023-12-24T20:08:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09d006a510 0x7f09d00b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09d00cc780 0x7f09d01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d00cf980 con 0x7f09d00b4f50 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d006aa10 con 0x7f09d006a510 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09d542e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d006acf0 con 0x7f09d00cc780 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09d006a510 0x7f09d00b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09d006a510 0x7f09d00b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59540/0 (socket says 172.21.15.50:59540) 2023-12-24T20:08:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09c7fff700 1 -- 172.21.15.50:0/4202752470 learned_addr learned my addr 172.21.15.50:0/4202752470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.869+0000 7f09cf7fe700 1 --2- 172.21.15.50:0/4202752470 >> v2:172.21.15.82:3300/0 conn(0x7f09d00cc780 0x7f09d01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09c7fff700 1 -- 172.21.15.50:0/4202752470 >> v2:172.21.15.82:3300/0 conn(0x7f09d00cc780 msgr2=0x7f09d01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09c7fff700 1 --2- 172.21.15.50:0/4202752470 >> v2:172.21.15.82:3300/0 conn(0x7f09d00cc780 0x7f09d01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09c7fff700 1 -- 172.21.15.50:0/4202752470 >> v1:172.21.15.50:6789/0 conn(0x7f09d00b4f50 legacy=0x7f09d0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09c7fff700 1 -- 172.21.15.50:0/4202752470 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d006afd0 con 0x7f09d006a510 2023-12-24T20:08:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09c7fff700 1 --2- 172.21.15.50:0/4202752470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d006a510 0x7f09d00b5320 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f09d00cedc0 tx=0x7f09b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6abde9e00a65f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09ce7fc700 1 -- 172.21.15.50:0/4202752470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800b860 con 0x7f09d006a510 2023-12-24T20:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09ce7fc700 1 -- 172.21.15.50:0/4202752470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b800b9c0 con 0x7f09d006a510 2023-12-24T20:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09ce7fc700 1 -- 172.21.15.50:0/4202752470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800bd60 con 0x7f09d006a510 2023-12-24T20:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 -- 172.21.15.50:0/4202752470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d006a510 msgr2=0x7f09d00b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 --2- 172.21.15.50:0/4202752470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d006a510 0x7f09d00b5320 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f09d00cedc0 tx=0x7f09b8009250 comp rx=0 tx=0).stop 2023-12-24T20:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 -- 172.21.15.50:0/4202752470 shutdown_connections 2023-12-24T20:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 --2- 172.21.15.50:0/4202752470 >> v2:172.21.15.82:3300/0 conn(0x7f09d00cc780 0x7f09d01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 --2- 172.21.15.50:0/4202752470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d006a510 0x7f09d00b5320 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 -- 172.21.15.50:0/4202752470 >> 172.21.15.50:0/4202752470 conn(0x7f09d00670b0 msgr2=0x7f09d0067480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 -- 172.21.15.50:0/4202752470 shutdown_connections 2023-12-24T20:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.873+0000 7f09d542e700 1 -- 172.21.15.50:0/4202752470 wait complete. 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 Processor -- start 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 -- start start 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d006a510 0x7f09d0146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 0x7f09d016bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0147750 con 0x7f09d00cc780 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0147a30 con 0x7f09d006a510 2023-12-24T20:08:24.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09d542e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0147d10 con 0x7f09d00b4f50 2023-12-24T20:08:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59544/0 (socket says 172.21.15.50:59544) 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 -- 172.21.15.50:0/4246782151 learned_addr learned my addr 172.21.15.50:0/4246782151 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09ceffd700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d006a510 0x7f09d0146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09c7fff700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 0x7f09d016bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 msgr2=0x7f09d016bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 0x7f09d016bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d006a510 msgr2=0x7f09d0146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d006a510 0x7f09d0146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09cf7fe700 1 -- 172.21.15.50:0/4246782151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80094f0 con 0x7f09d00cc780 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.877+0000 7f09c7fff700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 0x7f09d016bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09cf7fe700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f09c8007f20 tx=0x7f09c8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800ebf0 con 0x7f09d00cc780 2023-12-24T20:08:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800ed70 con 0x7f09d00cc780 2023-12-24T20:08:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d0147ff0 con 0x7f09d00cc780 2023-12-24T20:08:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8014670 con 0x7f09d00cc780 2023-12-24T20:08:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d0147340 con 0x7f09d00cc780 2023-12-24T20:08:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d004be40 con 0x7f09d00cc780 2023-12-24T20:08:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.881+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f09c80149e0 con 0x7f09d00cc780 2023-12-24T20:08:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.885+0000 7f09c6ffd700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 0x7f09b0062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.885+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7f09c807d5b0 con 0x7f09d00cc780 2023-12-24T20:08:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.885+0000 7f09ceffd700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 msgr2=0x7f09b0062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.885+0000 7f09ceffd700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 0x7f09b0062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:24.889+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f09c804d4a0 con 0x7f09d00cc780 2023-12-24T20:08:24.894 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.889+0000 7f42b7bce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:08:24.948 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:24.945+0000 7fc1abb5e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:08:24.985 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:24.981+0000 7f42b7bce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:08:25.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.089+0000 7f09ceffd700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 msgr2=0x7f09b0062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:25.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.089+0000 7f09ceffd700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 0x7f09b0062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.105+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d006b2b0 con 0x7f09d00cc780 2023-12-24T20:08:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.105+0000 7f09c6ffd700 1 -- 172.21.15.50:0/4246782151 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f09c8050ac0 con 0x7f09d00cc780 2023-12-24T20:08:25.108 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:25.109 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:52:20.070007+0000","modified":"2023-12-24T19:52:23.659220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9273":{"gid":9273,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/1417362913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1417362913},{"type":"v1","addr":"172.21.15.50:6833","nonce":1417362913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:08:25.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 msgr2=0x7f09b0062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:25.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 0x7f09b0062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 msgr2=0x7f09d00b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f09c8007f20 tx=0x7f09c8009860 comp rx=0 tx=0).stop 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 shutdown_connections 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f09b0060670 0x7f09b0062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09d00cc780 0x7f09d00b3120 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09d00b4f50 0x7f09d016bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 --2- 172.21.15.50:0/4246782151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d006a510 0x7f09d0146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 >> 172.21.15.50:0/4246782151 conn(0x7f09d00670b0 msgr2=0x7f09d00b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 shutdown_connections 2023-12-24T20:08:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.109+0000 7f09d542e700 1 -- 172.21.15.50:0/4246782151 wait complete. 2023-12-24T20:08:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 86 2023-12-24T20:08:25.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:25.171 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:25.169+0000 7fc1abb5e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:08:25.270 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:25.265+0000 7fc1abb5e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:08:25.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.301+0000 7fe553985700 1 Processor -- start 2023-12-24T20:08:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.301+0000 7fe553985700 1 -- start start 2023-12-24T20:08:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe553985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe553985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 0x7fe54c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe553985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54c06ca50 con 0x7fe54c06b260 2023-12-24T20:08:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe553985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0c6980 con 0x7fe54c0ca3a0 2023-12-24T20:08:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe553985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c06b7f0 con 0x7fe54c06ae10 2023-12-24T20:08:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe551721700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 0x7fe54c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe551721700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:56676/0 (socket says 172.21.15.50:56676) 2023-12-24T20:08:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe551721700 1 -- 172.21.15.50:0/3302896823 learned_addr learned my addr 172.21.15.50:0/3302896823 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe551f22700 1 --1- 172.21.15.50:0/3302896823 >> v1:172.21.15.82:6789/0 conn(0x7fe54c06b260 0x7fe54c160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34128/0 (socket says 172.21.15.50:34128) 2023-12-24T20:08:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 -- 172.21.15.50:0/3302896823 >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 msgr2=0x7fe54c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 --2- 172.21.15.50:0/3302896823 >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 -- 172.21.15.50:0/3302896823 >> v1:172.21.15.82:6789/0 conn(0x7fe54c06b260 legacy=0x7fe54c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 -- 172.21.15.50:0/3302896823 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c06bad0 con 0x7fe54c06ae10 2023-12-24T20:08:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe551721700 1 --2- 172.21.15.50:0/3302896823 >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe550f20700 1 --2- 172.21.15.50:0/3302896823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 0x7fe54c15aa50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0098e0 tx=0x7fe53c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa6babdd7c49a69 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe543fff700 1 -- 172.21.15.50:0/3302896823 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00b640 con 0x7fe54c06ae10 2023-12-24T20:08:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe543fff700 1 -- 172.21.15.50:0/3302896823 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00b7a0 con 0x7fe54c06ae10 2023-12-24T20:08:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.305+0000 7fe543fff700 1 -- 172.21.15.50:0/3302896823 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00bb40 con 0x7fe54c06ae10 2023-12-24T20:08:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 -- 172.21.15.50:0/3302896823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 msgr2=0x7fe54c15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 --2- 172.21.15.50:0/3302896823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 0x7fe54c15aa50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0098e0 tx=0x7fe53c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 -- 172.21.15.50:0/3302896823 shutdown_connections 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 --2- 172.21.15.50:0/3302896823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06ae10 0x7fe54c15aa50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 --2- 172.21.15.50:0/3302896823 >> v2:172.21.15.82:3300/0 conn(0x7fe54c0ca3a0 0x7fe54c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 -- 172.21.15.50:0/3302896823 >> 172.21.15.50:0/3302896823 conn(0x7fe54c0cbba0 msgr2=0x7fe54c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 -- 172.21.15.50:0/3302896823 shutdown_connections 2023-12-24T20:08:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.309+0000 7fe553985700 1 -- 172.21.15.50:0/3302896823 wait complete. 2023-12-24T20:08:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 Processor -- start 2023-12-24T20:08:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 -- start start 2023-12-24T20:08:25.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06b260 0x7fe54c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 0x7fe54c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0b10a0 con 0x7fe54c06ae10 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0c4900 con 0x7fe54c0ca3a0 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe553985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0c3cf0 con 0x7fe54c06b260 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe551721700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe551721700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59558/0 (socket says 172.21.15.50:59558) 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe551721700 1 -- 172.21.15.50:0/2308596592 learned_addr learned my addr 172.21.15.50:0/2308596592 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.313+0000 7fe551f22700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 0x7fe54c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe550f20700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06b260 0x7fe54c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 -- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06b260 msgr2=0x7fe54c0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06b260 0x7fe54c0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 -- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 msgr2=0x7fe54c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 0x7fe54c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 -- 172.21.15.50:0/2308596592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480094f0 con 0x7fe54c06ae10 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551f22700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 0x7fe54c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe551721700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fe54800ec50 tx=0x7fe548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800c970 con 0x7fe54c06ae10 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54800cad0 con 0x7fe54c06ae10 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53c009420 con 0x7fe54c06ae10 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800ce50 con 0x7fe54c06ae10 2023-12-24T20:08:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c0c42b0 con 0x7fe54c06ae10 2023-12-24T20:08:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.317+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c0652e0 con 0x7fe54c06ae10 2023-12-24T20:08:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.321+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7fe548013680 con 0x7fe54c06ae10 2023-12-24T20:08:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.321+0000 7fe5417fa700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 0x7fe530062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.321+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fe54807d230 con 0x7fe54c06ae10 2023-12-24T20:08:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.321+0000 7fe550f20700 1 -- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 msgr2=0x7fe530062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.321+0000 7fe550f20700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 0x7fe530062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.325+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe54804d120 con 0x7fe54c06ae10 2023-12-24T20:08:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.501+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe54c06bdb0 con 0x7fe54c06ae10 2023-12-24T20:08:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.501+0000 7fe5417fa700 1 -- 172.21.15.50:0/2308596592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+17160 (secure 0 0 0) 0x7fe548050740 con 0x7fe54c06ae10 2023-12-24T20:08:25.507 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:25.507 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":181,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:23.045122+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:52:18.561272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-12-24T19:52:19.051332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2348689371":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/3889288613":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2020731815":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2623688854":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2602753322":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/2424533746":"2023-12-25T20:03:21.805542+0000","172.21.15.50:0/767919455":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3012835903":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/1974691616":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6837/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:6836/33814":"2023-12-25T19:52:39.403854+0000","172.21.15.50:0/3552589056":"2023-12-25T19:52:39.403854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 msgr2=0x7fe530062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 0x7fe530062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 msgr2=0x7fe54c144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fe54800ec50 tx=0x7fe548009250 comp rx=0 tx=0).stop 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 shutdown_connections 2023-12-24T20:08:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe530060670 0x7fe530062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe54c0ca3a0 0x7fe54c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe54c06b260 0x7fe54c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 --2- 172.21.15.50:0/2308596592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c06ae10 0x7fe54c144ec0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 >> 172.21.15.50:0/2308596592 conn(0x7fe54c0cbba0 msgr2=0x7fe54c0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 shutdown_connections 2023-12-24T20:08:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.505+0000 7fe553985700 1 -- 172.21.15.50:0/2308596592 wait complete. 2023-12-24T20:08:25.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:08:25.720 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:25.713+0000 7f42b7bce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:08:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.741+0000 7f01efc6e700 1 Processor -- start 2023-12-24T20:08:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.741+0000 7f01efc6e700 1 -- start start 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01efc6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 0x7f01e80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01efc6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806ba80 con 0x7f01e80ce750 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01efc6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806bd60 con 0x7f01e806b540 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01efc6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e806c040 con 0x7f01e80cc310 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eda0a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f01e80ce750 0x7f01e806ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45674/0 (socket says 172.21.15.50:45674) 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eda0a700 1 -- 172.21.15.50:0/3923982634 learned_addr learned my addr 172.21.15.50:0/3923982634 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01ee20b700 1 --2- 172.21.15.50:0/3923982634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 0x7f01e80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552460295 0 0) 0x7f01e806bd60 con 0x7f01e806b540 2023-12-24T20:08:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d4003570 con 0x7f01e806b540 2023-12-24T20:08:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582396236 0 0) 0x7f01e806ba80 con 0x7f01e80ce750 2023-12-24T20:08:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e806bd60 con 0x7f01e80ce750 2023-12-24T20:08:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01ee20b700 1 -- 172.21.15.50:0/3923982634 >> v1:172.21.15.82:6789/0 conn(0x7f01e806b540 legacy=0x7f01e8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01ee20b700 1 -- 172.21.15.50:0/3923982634 >> v1:172.21.15.50:6789/0 conn(0x7f01e80ce750 legacy=0x7f01e806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01ee20b700 1 -- 172.21.15.50:0/3923982634 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e806c320 con 0x7f01e80cc310 2023-12-24T20:08:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01ee20b700 1 --2- 172.21.15.50:0/3923982634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 0x7f01e80ceb20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009e90 tx=0x7f01e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f52912cae617f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000e070 con 0x7f01e80cc310 2023-12-24T20:08:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000bb80 con 0x7f01e80cc310 2023-12-24T20:08:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.745+0000 7f01eca08700 1 -- 172.21.15.50:0/3923982634 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0012430 con 0x7f01e80cc310 2023-12-24T20:08:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- 172.21.15.50:0/3923982634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 msgr2=0x7f01e80ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 --2- 172.21.15.50:0/3923982634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 0x7f01e80ceb20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009e90 tx=0x7f01e0009780 comp rx=0 tx=0).stop 2023-12-24T20:08:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- 172.21.15.50:0/3923982634 shutdown_connections 2023-12-24T20:08:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 --2- 172.21.15.50:0/3923982634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80cc310 0x7f01e80ceb20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- 172.21.15.50:0/3923982634 >> 172.21.15.50:0/3923982634 conn(0x7f01e80cffb0 msgr2=0x7f01e80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- 172.21.15.50:0/3923982634 shutdown_connections 2023-12-24T20:08:25.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- 172.21.15.50:0/3923982634 wait complete. 2023-12-24T20:08:25.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 Processor -- start 2023-12-24T20:08:25.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.749+0000 7f01efc6e700 1 -- start start 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01e80cc310 0x7f01e8169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80ce750 0x7f01e80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8158570 con 0x7f01e806b540 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8154bd0 con 0x7f01e80cc310 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e81548f0 con 0x7f01e80ce750 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59568/0 (socket says 172.21.15.50:59568) 2023-12-24T20:08:25.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 -- 172.21.15.50:0/299845844 learned_addr learned my addr 172.21.15.50:0/299845844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01ee20b700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80ce750 0x7f01e80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01ed209700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01e80cc310 0x7f01e8169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80ce750 msgr2=0x7f01e80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80ce750 0x7f01e80c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01e80cc310 msgr2=0x7f01e8169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01e80cc310 0x7f01e8169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 -- 172.21.15.50:0/299845844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0009a20 con 0x7f01e806b540 2023-12-24T20:08:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01eda0a700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c590 tx=0x7f01e4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4005b30 con 0x7f01e806b540 2023-12-24T20:08:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4005c90 con 0x7f01e806b540 2023-12-24T20:08:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4007320 con 0x7f01e806b540 2023-12-24T20:08:25.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e8155a60 con 0x7f01e806b540 2023-12-24T20:08:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.753+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e8156020 con 0x7f01e806b540 2023-12-24T20:08:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.757+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e8155860 con 0x7f01e806b540 2023-12-24T20:08:25.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.757+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 101) v1 ==== 80075+0+0 (secure 0 0 0) 0x7f01e4007690 con 0x7f01e806b540 2023-12-24T20:08:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.761+0000 7f01ddffb700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 0x7f01cc062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.761+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7104+0+0 (secure 0 0 0) 0x7f01e407c2d0 con 0x7f01e806b540 2023-12-24T20:08:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.761+0000 7f01ed209700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 msgr2=0x7f01cc062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.761+0000 7f01ed209700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 0x7f01cc062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.765+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01e404c1c0 con 0x7f01e806b540 2023-12-24T20:08:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.965+0000 7f01ed209700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 msgr2=0x7f01cc062b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.965+0000 7f01ed209700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 0x7f01cc062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.973+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f01e80652e0 con 0x7f01e806b540 2023-12-24T20:08:25.980 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T20:08:25.977+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:08:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.985+0000 7f01ddffb700 1 -- 172.21.15.50:0/299845844 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f01e404f7e0 con 0x7f01e806b540 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 msgr2=0x7f01cc062b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 0x7f01cc062b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 msgr2=0x7f01e8158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c590 tx=0x7f01e4007e80 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 shutdown_connections 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f01cc060670 0x7f01cc062b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01e80ce750 0x7f01e80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01e80cc310 0x7f01e8169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 --2- 172.21.15.50:0/299845844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e806b540 0x7f01e8158030 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 >> 172.21.15.50:0/299845844 conn(0x7f01e80cffb0 msgr2=0x7f01e80c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 shutdown_connections 2023-12-24T20:08:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:25.989+0000 7f01efc6e700 1 -- 172.21.15.50:0/299845844 wait complete. 2023-12-24T20:08:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:08:26.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:08:26.062 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T20:08:26.111 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.109+0000 7fc1abb5e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:08:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.177+0000 7ff729816700 1 Processor -- start 2023-12-24T20:08:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 -- start start 2023-12-24T20:08:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff724156e80 0x7ff7240c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7240c8d10 0x7ff7240c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72415b5a0 con 0x7ff724156ab0 2023-12-24T20:08:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240c9100 con 0x7ff724156e80 2023-12-24T20:08:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729816700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72415a990 con 0x7ff7240c8d10 2023-12-24T20:08:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff724156e80 0x7ff7240c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff728814700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff724156ab0 0x7ff7240adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:34154/0 (socket says 172.21.15.50:34154) 2023-12-24T20:08:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff728814700 1 -- 172.21.15.50:0/1766072854 learned_addr learned my addr 172.21.15.50:0/1766072854 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff729015700 1 --2- 172.21.15.50:0/1766072854 >> v2:172.21.15.82:3300/0 conn(0x7ff7240c8d10 0x7ff7240c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 -- 172.21.15.50:0/1766072854 >> v2:172.21.15.82:3300/0 conn(0x7ff7240c8d10 msgr2=0x7ff7240c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 --2- 172.21.15.50:0/1766072854 >> v2:172.21.15.82:3300/0 conn(0x7ff7240c8d10 0x7ff7240c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 -- 172.21.15.50:0/1766072854 >> v1:172.21.15.82:6789/0 conn(0x7ff724156ab0 legacy=0x7ff7240adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 -- 172.21.15.50:0/1766072854 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72415ac70 con 0x7ff724156e80 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff7237fe700 1 -- 172.21.15.50:0/1766072854 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909504025 0 0) 0x7ff72415b5a0 con 0x7ff724156ab0 2023-12-24T20:08:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.181+0000 7ff723fff700 1 --2- 172.21.15.50:0/1766072854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724156e80 0x7ff7240c87d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff7240cb8d0 tx=0x7ff7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc36060e2cba4c01 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff7237fe700 1 -- 172.21.15.50:0/1766072854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710011630 con 0x7ff724156e80 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff7237fe700 1 -- 172.21.15.50:0/1766072854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710011790 con 0x7ff724156e80 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff7237fe700 1 -- 172.21.15.50:0/1766072854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710011b30 con 0x7ff724156e80 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- 172.21.15.50:0/1766072854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724156e80 msgr2=0x7ff7240c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 --2- 172.21.15.50:0/1766072854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724156e80 0x7ff7240c87d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff7240cb8d0 tx=0x7ff7100091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- 172.21.15.50:0/1766072854 shutdown_connections 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 --2- 172.21.15.50:0/1766072854 >> v2:172.21.15.82:3300/0 conn(0x7ff7240c8d10 0x7ff7240c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 --2- 172.21.15.50:0/1766072854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724156e80 0x7ff7240c87d0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- 172.21.15.50:0/1766072854 >> 172.21.15.50:0/1766072854 conn(0x7ff724067250 msgr2=0x7ff724067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- 172.21.15.50:0/1766072854 shutdown_connections 2023-12-24T20:08:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- 172.21.15.50:0/1766072854 wait complete. 2023-12-24T20:08:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 Processor -- start 2023-12-24T20:08:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.185+0000 7ff729816700 1 -- start start 2023-12-24T20:08:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff724156ab0 0x7ff724159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff724156e80 0x7ff724153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7241598c0 con 0x7ff7240c8d10 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724157e40 con 0x7ff724156ab0 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c24e0 con 0x7ff724156e80 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59642/0 (socket says 172.21.15.50:59642) 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 -- 172.21.15.50:0/618684395 learned_addr learned my addr 172.21.15.50:0/618684395 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729015700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff724156e80 0x7ff724153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff723fff700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff724156ab0 0x7ff724159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 -- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff724156e80 msgr2=0x7ff724153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff724156e80 0x7ff724153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 -- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff724156ab0 msgr2=0x7ff724159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff724156ab0 0x7ff724159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 -- 172.21.15.50:0/618684395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710009420 con 0x7ff7240c8d10 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff728814700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff71800cd80 tx=0x7ff718001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800aa60 con 0x7ff7240c8d10 2023-12-24T20:08:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800abc0 con 0x7ff7240c8d10 2023-12-24T20:08:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff724157510 con 0x7ff7240c8d10 2023-12-24T20:08:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180070f0 con 0x7ff7240c8d10 2023-12-24T20:08:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.189+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff724157ad0 con 0x7ff7240c8d10 2023-12-24T20:08:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.193+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72404be40 con 0x7ff7240c8d10 2023-12-24T20:08:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.193+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 103) v1 ==== 79672+0+0 (secure 0 0 0) 0x7ff7180074a0 con 0x7ff7240c8d10 2023-12-24T20:08:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.193+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7490+0+0 (secure 0 0 0) 0x7ff71807ce00 con 0x7ff7240c8d10 2023-12-24T20:08:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.201+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff71804d040 con 0x7ff7240c8d10 2023-12-24T20:08:26.226 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.221+0000 7fc176773700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.221+0000 7fc176773700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.221+0000 7fc176773700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.221+0000 7fc176773700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.227 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.221+0000 7fc176773700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.229 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.225+0000 7fc172f6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.229 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.225+0000 7fc172f6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.229 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.225+0000 7fc172f6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.229 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.225+0000 7fc172f6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.229 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:26.225+0000 7fc172f6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:26.417+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff7240ac450 con 0x7ff7240c8d10 2023-12-24T20:08:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.077+0000 7ff720ff9700 1 -- 172.21.15.50:0/618684395 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff718050660 con 0x7ff7240c8d10 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 msgr2=0x7ff724158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff71800cd80 tx=0x7ff718001ae0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 shutdown_connections 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff724156e80 0x7ff724153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff724156ab0 0x7ff724159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 --2- 172.21.15.50:0/618684395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7240c8d10 0x7ff724158ce0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 >> 172.21.15.50:0/618684395 conn(0x7ff724067250 msgr2=0x7ff7240c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:27.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 shutdown_connections 2023-12-24T20:08:27.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.085+0000 7ff729816700 1 -- 172.21.15.50:0/618684395 wait complete. 2023-12-24T20:08:27.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.317+0000 7fa384984700 1 Processor -- start 2023-12-24T20:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.317+0000 7fa384984700 1 -- start start 2023-12-24T20:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 0x7fa3801591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3800ce470 0x7fa3800ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38006aa80 con 0x7fa380158dd0 2023-12-24T20:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800cee30 con 0x7fa3800ce470 2023-12-24T20:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800cc0b0 con 0x7fa3800b2cf0 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa380158dd0 0x7fa3800cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45694/0 (socket says 172.21.15.50:45694) 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37ed9d700 1 -- 172.21.15.50:0/923956634 learned_addr learned my addr 172.21.15.50:0/923956634 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37e59c700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 0x7fa3801591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 --2- 172.21.15.50:0/923956634 >> v2:172.21.15.82:3300/0 conn(0x7fa3800ce470 0x7fa3800ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37dd9b700 1 -- 172.21.15.50:0/923956634 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772188951 0 0) 0x7fa38006aa80 con 0x7fa380158dd0 2023-12-24T20:08:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37dd9b700 1 -- 172.21.15.50:0/923956634 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa368003570 con 0x7fa380158dd0 2023-12-24T20:08:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 -- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 msgr2=0x7fa3801591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 0x7fa3801591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 -- 172.21.15.50:0/923956634 >> v1:172.21.15.50:6789/0 conn(0x7fa380158dd0 legacy=0x7fa3800cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 -- 172.21.15.50:0/923956634 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800cc390 con 0x7fa3800ce470 2023-12-24T20:08:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37e59c700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 0x7fa3801591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37f59e700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800ce470 0x7fa3800ce8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e60 tx=0x7fa378009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a6f43421396a108 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37dd9b700 1 -- 172.21.15.50:0/923956634 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800e070 con 0x7fa3800ce470 2023-12-24T20:08:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37dd9b700 1 -- 172.21.15.50:0/923956634 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800bab0 con 0x7fa3800ce470 2023-12-24T20:08:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa37dd9b700 1 -- 172.21.15.50:0/923956634 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800be70 con 0x7fa3800ce470 2023-12-24T20:08:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800ce470 msgr2=0x7fa3800ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800ce470 0x7fa3800ce8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e60 tx=0x7fa378009780 comp rx=0 tx=0).stop 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- 172.21.15.50:0/923956634 shutdown_connections 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800ce470 0x7fa3800ce8f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 --2- 172.21.15.50:0/923956634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800b2cf0 0x7fa3801591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.321+0000 7fa384984700 1 -- 172.21.15.50:0/923956634 >> 172.21.15.50:0/923956634 conn(0x7fa380067b80 msgr2=0x7fa3800cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- 172.21.15.50:0/923956634 shutdown_connections 2023-12-24T20:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- 172.21.15.50:0/923956634 wait complete. 2023-12-24T20:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 Processor -- start 2023-12-24T20:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- start start 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 0x7fa380154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800ce470 0x7fa3800c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801556d0 con 0x7fa380158dd0 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800ca040 con 0x7fa3800b2cf0 2023-12-24T20:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa384984700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38016d990 con 0x7fa3800ce470 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa37f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa37f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59706/0 (socket says 172.21.15.50:59706) 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.325+0000 7fa37f59e700 1 -- 172.21.15.50:0/703001314 learned_addr learned my addr 172.21.15.50:0/703001314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37e59c700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800ce470 0x7fa3800c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37ed9d700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 0x7fa380154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 -- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800ce470 msgr2=0x7fa3800c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800ce470 0x7fa3800c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 -- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 msgr2=0x7fa380154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 0x7fa380154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 -- 172.21.15.50:0/703001314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740093c0 con 0x7fa380158dd0 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37ed9d700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 0x7fa380154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa37f59e700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b610 tx=0x7fa378019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378027470 con 0x7fa380158dd0 2023-12-24T20:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780275f0 con 0x7fa380158dd0 2023-12-24T20:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa378009a20 con 0x7fa380158dd0 2023-12-24T20:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780279b0 con 0x7fa380158dd0 2023-12-24T20:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa380155b60 con 0x7fa380158dd0 2023-12-24T20:08:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.329+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380155880 con 0x7fa380158dd0 2023-12-24T20:08:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.333+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 104) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fa378024070 con 0x7fa380158dd0 2023-12-24T20:08:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.333+0000 7fa366ffd700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 0x7fa36c062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.333+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7490+0+0 (secure 0 0 0) 0x7fa37807f4e0 con 0x7fa380158dd0 2023-12-24T20:08:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.333+0000 7fa37ed9d700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 0x7fa36c062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.333+0000 7fa37ed9d700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 0x7fa36c062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3700058d0 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:27.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.341+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa380155880 con 0x7fa380158dd0 2023-12-24T20:08:27.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:27.517+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa380155880 con 0x7fa380158dd0 2023-12-24T20:08:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.141+0000 7fa366ffd700 1 -- 172.21.15.50:0/703001314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v184) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa380155880 con 0x7fa380158dd0 2023-12-24T20:08:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 msgr2=0x7fa36c062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 0x7fa36c062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3700058d0 tx=0x7fa370009040 comp rx=0 tx=0).stop 2023-12-24T20:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 msgr2=0x7fa380171af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b610 tx=0x7fa378019000 comp rx=0 tx=0).stop 2023-12-24T20:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 shutdown_connections 2023-12-24T20:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa36c0603a0 0x7fa36c062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa380158dd0 0x7fa380171af0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3800ce470 0x7fa3800c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 --2- 172.21.15.50:0/703001314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3800b2cf0 0x7fa380154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 >> 172.21.15.50:0/703001314 conn(0x7fa380067b80 msgr2=0x7fa3800b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 shutdown_connections 2023-12-24T20:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.145+0000 7fa384984700 1 -- 172.21.15.50:0/703001314 wait complete. 2023-12-24T20:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:08:28.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:08:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 Processor -- start 2023-12-24T20:08:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 -- start start 2023-12-24T20:08:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2c80c8070 0x7fc2c80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c80c8440 0x7fc2c80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80af450 con 0x7fc2c80aef80 2023-12-24T20:08:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80af730 con 0x7fc2c80c8440 2023-12-24T20:08:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.349+0000 7fc2cd385700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80afa10 con 0x7fc2c80c8070 2023-12-24T20:08:28.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c80c8440 0x7fc2c80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c80c8440 0x7fc2c80b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59718/0 (socket says 172.21.15.50:59718) 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 -- 172.21.15.50:0/1707314416 learned_addr learned my addr 172.21.15.50:0/1707314416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c6ffd700 1 --2- 172.21.15.50:0/1707314416 >> v2:172.21.15.82:3300/0 conn(0x7fc2c80c8070 0x7fc2c80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 -- 172.21.15.50:0/1707314416 >> v2:172.21.15.82:3300/0 conn(0x7fc2c80c8070 msgr2=0x7fc2c80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 --2- 172.21.15.50:0/1707314416 >> v2:172.21.15.82:3300/0 conn(0x7fc2c80c8070 0x7fc2c80aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 -- 172.21.15.50:0/1707314416 >> v1:172.21.15.82:6789/0 conn(0x7fc2c80aef80 legacy=0x7fc2c81599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 -- 172.21.15.50:0/1707314416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80afcf0 con 0x7fc2c80c8440 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c67fc700 1 --2- 172.21.15.50:0/1707314416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80b0940 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8068ba0 tx=0x7fc2bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e1f88bc9854cdf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c5ffb700 1 -- 172.21.15.50:0/1707314416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00b860 con 0x7fc2c80c8440 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c5ffb700 1 -- 172.21.15.50:0/1707314416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00b9c0 con 0x7fc2c80c8440 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2c5ffb700 1 -- 172.21.15.50:0/1707314416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00bd80 con 0x7fc2c80c8440 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 -- 172.21.15.50:0/1707314416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 msgr2=0x7fc2c80b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 --2- 172.21.15.50:0/1707314416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80b0940 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8068ba0 tx=0x7fc2bc009250 comp rx=0 tx=0).stop 2023-12-24T20:08:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 -- 172.21.15.50:0/1707314416 shutdown_connections 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 --2- 172.21.15.50:0/1707314416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80b0940 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 --2- 172.21.15.50:0/1707314416 >> v2:172.21.15.82:3300/0 conn(0x7fc2c80c8070 0x7fc2c80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 -- 172.21.15.50:0/1707314416 >> 172.21.15.50:0/1707314416 conn(0x7fc2c8067b80 msgr2=0x7fc2c80ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.353+0000 7fc2cd385700 1 -- 172.21.15.50:0/1707314416 shutdown_connections 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.357+0000 7fc2cd385700 1 -- 172.21.15.50:0/1707314416 wait complete. 2023-12-24T20:08:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.357+0000 7fc2cd385700 1 Processor -- start 2023-12-24T20:08:28.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.357+0000 7fc2cd385700 1 -- start start 2023-12-24T20:08:28.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2c80aef80 0x7fc2c815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 0x7fc2c8153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c815e920 con 0x7fc2c80c8440 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80cbfe0 con 0x7fc2c80c8070 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2cd385700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c815dd10 con 0x7fc2c80aef80 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 0x7fc2c8153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c6ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2c80aef80 0x7fc2c815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59724/0 (socket says 172.21.15.50:59724) 2023-12-24T20:08:28.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 -- 172.21.15.50:0/119883618 learned_addr learned my addr 172.21.15.50:0/119883618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 -- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2c80aef80 msgr2=0x7fc2c815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2c80aef80 0x7fc2c815d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 -- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 msgr2=0x7fc2c8153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 0x7fc2c8153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 -- 172.21.15.50:0/119883618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc0094f0 con 0x7fc2c80c8440 2023-12-24T20:08:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c67fc700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 0x7fc2c8153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.361+0000 7fc2c77fe700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c940 tx=0x7fc2c00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0012630 con 0x7fc2c80c8440 2023-12-24T20:08:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c00127b0 con 0x7fc2c80c8440 2023-12-24T20:08:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0012b70 con 0x7fc2c80c8440 2023-12-24T20:08:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c815dff0 con 0x7fc2c80c8440 2023-12-24T20:08:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c815e5b0 con 0x7fc2c80c8440 2023-12-24T20:08:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.365+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c815ead0 con 0x7fc2c80c8440 2023-12-24T20:08:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.369+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 104) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fc2c001a3a0 con 0x7fc2c80c8440 2023-12-24T20:08:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.369+0000 7fc2aeffd700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 0x7fc2b4062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.369+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 7052+0+0 (secure 0 0 0) 0x7fc2c007cbc0 con 0x7fc2c80c8440 2023-12-24T20:08:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.369+0000 7fc2c6ffd700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 0x7fc2b4062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.369+0000 7fc2c6ffd700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 0x7fc2b4062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8006fd0 tx=0x7fc2b8008040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.377+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc2c815ead0 con 0x7fc2c80c8440 2023-12-24T20:08:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:28.549+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2c815ead0 con 0x7fc2c80c8440 2023-12-24T20:08:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.101+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc2c004d220 con 0x7fc2c80c8440 2023-12-24T20:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.149+0000 7fc2aeffd700 1 -- 172.21.15.50:0/119883618 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v185) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2c004ce50 con 0x7fc2c80c8440 2023-12-24T20:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 msgr2=0x7fc2b4062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 0x7fc2b4062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8006fd0 tx=0x7fc2b8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 msgr2=0x7fc2c80cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c940 tx=0x7fc2c00016b0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 shutdown_connections 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2b40603a0 0x7fc2b4062850 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8006fd0 tx=0x7fc2b8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c80c8440 0x7fc2c80cbaa0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c80c8070 0x7fc2c8153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 --2- 172.21.15.50:0/119883618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2c80aef80 0x7fc2c815d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.153+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 >> 172.21.15.50:0/119883618 conn(0x7fc2c8067b80 msgr2=0x7fc2c80c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.157+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 shutdown_connections 2023-12-24T20:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.157+0000 7fc2cd385700 1 -- 172.21.15.50:0/119883618 wait complete. 2023-12-24T20:08:29.164 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T20:08:29.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T20:08:29.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.353+0000 7efe86f45700 1 Processor -- start 2023-12-24T20:08:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.353+0000 7efe86f45700 1 -- start start 2023-12-24T20:08:29.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe86f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe800c8880 0x7efe8006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe86f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800cb980 0x7efe800c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe86f45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8006db30 con 0x7efe800c9190 2023-12-24T20:08:29.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe86f45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800c9b60 con 0x7efe800c8880 2023-12-24T20:08:29.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe86f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006cf20 con 0x7efe800cb980 2023-12-24T20:08:29.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe84ce1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe800c8880 0x7efe8006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe854e2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efe800c9190 0x7efe800675c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:53852/0 (socket says 172.21.15.50:53852) 2023-12-24T20:08:29.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe854e2700 1 -- 172.21.15.50:0/1970772289 learned_addr learned my addr 172.21.15.50:0/1970772289 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:29.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.357+0000 7efe7ffff700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800cb980 0x7efe800c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe7f7fe700 1 -- 172.21.15.50:0/1970772289 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769208764 0 0) 0x7efe8006db30 con 0x7efe800c9190 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe7f7fe700 1 -- 172.21.15.50:0/1970772289 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70003570 con 0x7efe800c9190 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe84ce1700 1 -- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800cb980 msgr2=0x7efe800c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe84ce1700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800cb980 0x7efe800c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe84ce1700 1 -- 172.21.15.50:0/1970772289 >> v1:172.21.15.82:6789/0 conn(0x7efe800c9190 legacy=0x7efe800675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe84ce1700 1 -- 172.21.15.50:0/1970772289 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8006d200 con 0x7efe800c8880 2023-12-24T20:08:29.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe84ce1700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800c8880 0x7efe8006c820 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe740098e0 tx=0x7efe740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4bee5b86ee79f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe7f7fe700 1 -- 172.21.15.50:0/1970772289 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011630 con 0x7efe800c8880 2023-12-24T20:08:29.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe7f7fe700 1 -- 172.21.15.50:0/1970772289 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74011790 con 0x7efe800c8880 2023-12-24T20:08:29.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe7f7fe700 1 -- 172.21.15.50:0/1970772289 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011b30 con 0x7efe800c8880 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 -- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800c8880 msgr2=0x7efe8006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800c8880 0x7efe8006c820 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe740098e0 tx=0x7efe740091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 -- 172.21.15.50:0/1970772289 shutdown_connections 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800cb980 0x7efe800c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 --2- 172.21.15.50:0/1970772289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800c8880 0x7efe8006c820 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 -- 172.21.15.50:0/1970772289 >> 172.21.15.50:0/1970772289 conn(0x7efe800cddb0 msgr2=0x7efe800ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 -- 172.21.15.50:0/1970772289 shutdown_connections 2023-12-24T20:08:29.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.361+0000 7efe86f45700 1 -- 172.21.15.50:0/1970772289 wait complete. 2023-12-24T20:08:29.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.365+0000 7efe86f45700 1 Processor -- start 2023-12-24T20:08:29.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.365+0000 7efe86f45700 1 -- start start 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800c9190 0x7efe800c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 0x7efe800b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe801438f0 con 0x7efe800c8880 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c61d0 con 0x7efe800cb980 2023-12-24T20:08:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c64b0 con 0x7efe800c9190 2023-12-24T20:08:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57730/0 (socket says 172.21.15.50:57730) 2023-12-24T20:08:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 -- 172.21.15.50:0/195914062 learned_addr learned my addr 172.21.15.50:0/195914062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe854e2700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 0x7efe800b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe7ffff700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800c9190 0x7efe800c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 -- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800c9190 msgr2=0x7efe800c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800c9190 0x7efe800c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 -- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 msgr2=0x7efe800b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 0x7efe800b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 -- 172.21.15.50:0/195914062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009420 con 0x7efe800c8880 2023-12-24T20:08:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe854e2700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 0x7efe800b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe84ce1700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7efe8006c4c0 tx=0x7efe74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011900 con 0x7efe800c8880 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74011a60 con 0x7efe800c8880 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74023620 con 0x7efe800c8880 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe800c6790 con 0x7efe800c8880 2023-12-24T20:08:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.369+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800c5ee0 con 0x7efe800c8880 2023-12-24T20:08:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.373+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe800c6c10 con 0x7efe800c8880 2023-12-24T20:08:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.373+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efe7402c3b0 con 0x7efe800c8880 2023-12-24T20:08:29.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.373+0000 7efe7cff9700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 0x7efe64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.373+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7efe7407de40 con 0x7efe800c8880 2023-12-24T20:08:29.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.373+0000 7efe7ffff700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 0x7efe64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.377+0000 7efe7ffff700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 0x7efe64062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe8015c4f0 tx=0x7efe6c0091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.381+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe7404e0e0 con 0x7efe800c8880 2023-12-24T20:08:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.557+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7efe800652e0 con 0x7efe800c8880 2023-12-24T20:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.569+0000 7efe7cff9700 1 -- 172.21.15.50:0/195914062 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v61) v1 ==== 115+0+0 (secure 0 0 0) 0x7efe740150b0 con 0x7efe800c8880 2023-12-24T20:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 msgr2=0x7efe64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 0x7efe64062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe8015c4f0 tx=0x7efe6c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 msgr2=0x7efe800c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7efe8006c4c0 tx=0x7efe74017000 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 shutdown_connections 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe64060550 0x7efe64062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe800cb980 0x7efe800b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe800c9190 0x7efe800c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 --2- 172.21.15.50:0/195914062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe800c8880 0x7efe800c5460 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 >> 172.21.15.50:0/195914062 conn(0x7efe800cddb0 msgr2=0x7efe800c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 shutdown_connections 2023-12-24T20:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.573+0000 7efe86f45700 1 -- 172.21.15.50:0/195914062 wait complete. 2023-12-24T20:08:29.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T20:08:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.777+0000 7f02bdee3700 1 Processor -- start 2023-12-24T20:08:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.777+0000 7f02bdee3700 1 -- start start 2023-12-24T20:08:29.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bdee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b80cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bdee3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b80caa60 con 0x7f02b80cccd0 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bdee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b80cee80 con 0x7f02b8158c50 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bdee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80af430 con 0x7f02b8159020 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bcee1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02b8158c50 0x7f02b80caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:53854/0 (socket says 172.21.15.50:53854) 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bd6e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02b80cccd0 0x7f02b80afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53126/0 (socket says 172.21.15.50:53126) 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02bcee1700 1 -- 172.21.15.50:0/3482071794 learned_addr learned my addr 172.21.15.50:0/3482071794 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b80cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b77fe700 1 -- 172.21.15.50:0/3482071794 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589805114 0 0) 0x7f02b80cee80 con 0x7f02b8158c50 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b7fff700 1 -- 172.21.15.50:0/3482071794 >> v1:172.21.15.82:6789/0 conn(0x7f02b8158c50 legacy=0x7f02b80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b7fff700 1 -- 172.21.15.50:0/3482071794 >> v1:172.21.15.50:6789/0 conn(0x7f02b80cccd0 legacy=0x7f02b80afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b7fff700 1 -- 172.21.15.50:0/3482071794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b80cf160 con 0x7f02b8159020 2023-12-24T20:08:29.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b7fff700 1 --2- 172.21.15.50:0/3482071794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b80cc790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009910 tx=0x7f02a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626cb6c194f385a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b77fe700 1 -- 172.21.15.50:0/3482071794 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400b860 con 0x7f02b8159020 2023-12-24T20:08:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b77fe700 1 -- 172.21.15.50:0/3482071794 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400b9c0 con 0x7f02b8159020 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.781+0000 7f02b77fe700 1 -- 172.21.15.50:0/3482071794 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400bd60 con 0x7f02b8159020 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- 172.21.15.50:0/3482071794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 msgr2=0x7f02b80cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3482071794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b80cc790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009910 tx=0x7f02a40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- 172.21.15.50:0/3482071794 shutdown_connections 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3482071794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b80cc790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- 172.21.15.50:0/3482071794 >> 172.21.15.50:0/3482071794 conn(0x7f02b80670b0 msgr2=0x7f02b80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- 172.21.15.50:0/3482071794 shutdown_connections 2023-12-24T20:08:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- 172.21.15.50:0/3482071794 wait complete. 2023-12-24T20:08:29.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 Processor -- start 2023-12-24T20:08:29.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.785+0000 7f02bdee3700 1 -- start start 2023-12-24T20:08:29.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b8158c50 0x7f02b815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b8155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80b2fd0 con 0x7f02b80cccd0 2023-12-24T20:08:29.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81543b0 con 0x7f02b8158c50 2023-12-24T20:08:29.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8154690 con 0x7f02b8159020 2023-12-24T20:08:29.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57742/0 (socket says 172.21.15.50:57742) 2023-12-24T20:08:29.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 -- 172.21.15.50:0/3172966225 learned_addr learned my addr 172.21.15.50:0/3172966225 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:29.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02b7fff700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b8158c50 0x7f02b815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bd6e2700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 -- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 msgr2=0x7f02b8155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b8155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 -- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b8158c50 msgr2=0x7f02b815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b8158c50 0x7f02b815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 -- 172.21.15.50:0/3172966225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4009420 con 0x7f02b80cccd0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bd6e2700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b8155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bcee1700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c810 tx=0x7f02ac007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac005c00 con 0x7f02b80cccd0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac005d60 con 0x7f02b80cccd0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac007320 con 0x7f02b80cccd0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8154970 con 0x7f02b80cccd0 2023-12-24T20:08:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.789+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b8154f30 con 0x7f02b80cccd0 2023-12-24T20:08:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.793+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8155150 con 0x7f02b80cccd0 2023-12-24T20:08:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.793+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f02ac01b3b0 con 0x7f02b80cccd0 2023-12-24T20:08:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.793+0000 7f02b4ff9700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 0x7f029c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.793+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f02ac07c130 con 0x7f02b80cccd0 2023-12-24T20:08:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.797+0000 7f02b7fff700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 0x7f029c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.797+0000 7f02b7fff700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 0x7f029c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02a40093f0 tx=0x7f02a4017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.801+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f02ac04c330 con 0x7f02b80cccd0 2023-12-24T20:08:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.973+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f02b804be40 con 0x7f02b80cccd0 2023-12-24T20:08:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.985+0000 7f02b4ff9700 1 -- 172.21.15.50:0/3172966225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7f02ac04f950 con 0x7f02b80cccd0 2023-12-24T20:08:29.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.985+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 msgr2=0x7f029c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.985+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 0x7f029c062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02a40093f0 tx=0x7f02a4017000 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 msgr2=0x7f02b80b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c810 tx=0x7f02ac007d90 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 shutdown_connections 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f029c060550 0x7f029c062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02b8159020 0x7f02b8155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b8158c50 0x7f02b815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 --2- 172.21.15.50:0/3172966225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b80cccd0 0x7f02b80b5460 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 >> 172.21.15.50:0/3172966225 conn(0x7f02b80670b0 msgr2=0x7f02b806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 shutdown_connections 2023-12-24T20:08:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:29.989+0000 7f02bdee3700 1 -- 172.21.15.50:0/3172966225 wait complete. 2023-12-24T20:08:30.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:08:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.189+0000 7fbd26816700 1 Processor -- start 2023-12-24T20:08:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.189+0000 7fbd26816700 1 -- start start 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26816700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 0x7fbd200ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26816700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 0x7fbd200cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26816700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200ce020 con 0x7fbd20158c50 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26816700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200cb700 con 0x7fbd20159020 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26816700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200b03b0 con 0x7fbd200ca950 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd25814700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbd20158c50 0x7fbd200afca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53138/0 (socket says 172.21.15.50:53138) 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd25814700 1 -- 172.21.15.50:0/2495141361 learned_addr learned my addr 172.21.15.50:0/2495141361 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd25013700 1 --2- 172.21.15.50:0/2495141361 >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 0x7fbd200ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 --2- 172.21.15.50:0/2495141361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 0x7fbd200cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249911466 0 0) 0x7fbd200ce020 con 0x7fbd20158c50 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd0c003570 con 0x7fbd20158c50 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 209940966 0 0) 0x7fbd0c003570 con 0x7fbd20158c50 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 -- 172.21.15.50:0/2495141361 >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 msgr2=0x7fbd200ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 --2- 172.21.15.50:0/2495141361 >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 0x7fbd200ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 -- 172.21.15.50:0/2495141361 >> v1:172.21.15.50:6789/0 conn(0x7fbd20158c50 legacy=0x7fbd200afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 -- 172.21.15.50:0/2495141361 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200cae60 con 0x7fbd200ca950 2023-12-24T20:08:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd25013700 1 --2- 172.21.15.50:0/2495141361 >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 0x7fbd200ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:30.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd26015700 1 --2- 172.21.15.50:0/2495141361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 0x7fbd200cc770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e60 tx=0x7fbd18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebfeec67aaad10a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800e070 con 0x7fbd200ca950 2023-12-24T20:08:30.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800b7a0 con 0x7fbd200ca950 2023-12-24T20:08:30.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.193+0000 7fbd24812700 1 -- 172.21.15.50:0/2495141361 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c001490 con 0x7fbd200ca950 2023-12-24T20:08:30.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- 172.21.15.50:0/2495141361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 msgr2=0x7fbd200cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 --2- 172.21.15.50:0/2495141361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 0x7fbd200cc770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e60 tx=0x7fbd18009780 comp rx=0 tx=0).stop 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- 172.21.15.50:0/2495141361 shutdown_connections 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 --2- 172.21.15.50:0/2495141361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd200ca950 0x7fbd200cc770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 --2- 172.21.15.50:0/2495141361 >> v2:172.21.15.50:3300/0 conn(0x7fbd20159020 0x7fbd200ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- 172.21.15.50:0/2495141361 >> 172.21.15.50:0/2495141361 conn(0x7fbd200670b0 msgr2=0x7fbd200674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- 172.21.15.50:0/2495141361 shutdown_connections 2023-12-24T20:08:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- 172.21.15.50:0/2495141361 wait complete. 2023-12-24T20:08:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 Processor -- start 2023-12-24T20:08:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.197+0000 7fbd26816700 1 -- start start 2023-12-24T20:08:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca950 0x7fbd200c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 0x7fbd200cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c5980 con 0x7fbd20159020 2023-12-24T20:08:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c4590 con 0x7fbd200ca950 2023-12-24T20:08:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c4870 con 0x7fbd20158c50 2023-12-24T20:08:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57754/0 (socket says 172.21.15.50:57754) 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 -- 172.21.15.50:0/3198350635 learned_addr learned my addr 172.21.15.50:0/3198350635 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd25814700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca950 0x7fbd200c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd25013700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 0x7fbd200cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 -- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 msgr2=0x7fbd200cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 0x7fbd200cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 -- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca950 msgr2=0x7fbd200c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca950 0x7fbd200c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 -- 172.21.15.50:0/3198350635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009420 con 0x7fbd20159020 2023-12-24T20:08:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd25013700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 0x7fbd200cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26015700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbd18003000 tx=0x7fbd18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18012c70 con 0x7fbd20159020 2023-12-24T20:08:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18012e10 con 0x7fbd20159020 2023-12-24T20:08:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1801d680 con 0x7fbd20159020 2023-12-24T20:08:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd18009a20 con 0x7fbd20159020 2023-12-24T20:08:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.201+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd201532f0 con 0x7fbd20159020 2023-12-24T20:08:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.205+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2004be40 con 0x7fbd20159020 2023-12-24T20:08:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.205+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbd18024070 con 0x7fbd20159020 2023-12-24T20:08:30.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.209+0000 7fbd15ffb700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 0x7fbd04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.209+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7fbd1807ed40 con 0x7fbd20159020 2023-12-24T20:08:30.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.209+0000 7fbd25814700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 0x7fbd04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.209+0000 7fbd25814700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 0x7fbd04062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c001200 tx=0x7fbd1c001ac0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.213+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd1804ef40 con 0x7fbd20159020 2023-12-24T20:08:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.385+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbd200cb140 con 0x7fbd20159020 2023-12-24T20:08:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.397+0000 7fbd15ffb700 1 -- 172.21.15.50:0/3198350635 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd18052560 con 0x7fbd20159020 2023-12-24T20:08:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 msgr2=0x7fbd04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 0x7fbd04062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c001200 tx=0x7fbd1c001ac0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 msgr2=0x7fbd200cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbd18003000 tx=0x7fbd18018000 comp rx=0 tx=0).stop 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 shutdown_connections 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbd04060550 0x7fbd04062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd20159020 0x7fbd200cf6c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd20158c50 0x7fbd200cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 --2- 172.21.15.50:0/3198350635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca950 0x7fbd200c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 >> 172.21.15.50:0/3198350635 conn(0x7fbd200670b0 msgr2=0x7fbd200cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:30.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 shutdown_connections 2023-12-24T20:08:30.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.401+0000 7fbd26816700 1 -- 172.21.15.50:0/3198350635 wait complete. 2023-12-24T20:08:30.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-12-24T20:08:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.601+0000 7efc2d46b700 1 Processor -- start 2023-12-24T20:08:30.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.601+0000 7efc2d46b700 1 -- start start 2023-12-24T20:08:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2d46b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2815a2d0 0x7efc280ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2d46b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc280ade60 0x7efc28160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2d46b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc280b0460 con 0x7efc2806c820 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2d46b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2806d8c0 con 0x7efc2815a2d0 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2d46b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc280afc60 con 0x7efc280ade60 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc277fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc2806c820 0x7efc280ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53140/0 (socket says 172.21.15.50:53140) 2023-12-24T20:08:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc277fe700 1 -- 172.21.15.50:0/1262938779 learned_addr learned my addr 172.21.15.50:0/1262938779 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:30.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2815a2d0 0x7efc280ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc2cc6a700 1 --2- 172.21.15.50:0/1262938779 >> v2:172.21.15.82:3300/0 conn(0x7efc280ade60 0x7efc28160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc26ffd700 1 -- 172.21.15.50:0/1262938779 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499787407 0 0) 0x7efc280b0460 con 0x7efc2806c820 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc26ffd700 1 -- 172.21.15.50:0/1262938779 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc10003570 con 0x7efc2806c820 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 -- 172.21.15.50:0/1262938779 >> v2:172.21.15.82:3300/0 conn(0x7efc280ade60 msgr2=0x7efc28160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 --2- 172.21.15.50:0/1262938779 >> v2:172.21.15.82:3300/0 conn(0x7efc280ade60 0x7efc28160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 -- 172.21.15.50:0/1262938779 >> v1:172.21.15.50:6789/0 conn(0x7efc2806c820 legacy=0x7efc280ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 -- 172.21.15.50:0/1262938779 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2806a5c0 con 0x7efc2815a2d0 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.605+0000 7efc27fff700 1 --2- 172.21.15.50:0/1262938779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2815a2d0 0x7efc280ae8b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7efc280c8440 tx=0x7efc180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63ad4f7a7feedbe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc26ffd700 1 -- 172.21.15.50:0/1262938779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011630 con 0x7efc2815a2d0 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc26ffd700 1 -- 172.21.15.50:0/1262938779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18011790 con 0x7efc2815a2d0 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc26ffd700 1 -- 172.21.15.50:0/1262938779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011b30 con 0x7efc2815a2d0 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 -- 172.21.15.50:0/1262938779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2815a2d0 msgr2=0x7efc280ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 --2- 172.21.15.50:0/1262938779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2815a2d0 0x7efc280ae8b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7efc280c8440 tx=0x7efc180091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 -- 172.21.15.50:0/1262938779 shutdown_connections 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 --2- 172.21.15.50:0/1262938779 >> v2:172.21.15.82:3300/0 conn(0x7efc280ade60 0x7efc28160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 --2- 172.21.15.50:0/1262938779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2815a2d0 0x7efc280ae8b0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 -- 172.21.15.50:0/1262938779 >> 172.21.15.50:0/1262938779 conn(0x7efc28067b80 msgr2=0x7efc280cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 -- 172.21.15.50:0/1262938779 shutdown_connections 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.609+0000 7efc2d46b700 1 -- 172.21.15.50:0/1262938779 wait complete. 2023-12-24T20:08:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 Processor -- start 2023-12-24T20:08:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 -- start start 2023-12-24T20:08:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc2806c820 0x7efc28157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2815a2d0 0x7efc28150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc281584e0 con 0x7efc280ade60 2023-12-24T20:08:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc281587c0 con 0x7efc2815a2d0 2023-12-24T20:08:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2d46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc28158aa0 con 0x7efc2806c820 2023-12-24T20:08:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57784/0 (socket says 172.21.15.50:57784) 2023-12-24T20:08:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc277fe700 1 -- 172.21.15.50:0/2712897930 learned_addr learned my addr 172.21.15.50:0/2712897930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc2cc6a700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2815a2d0 0x7efc28150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.613+0000 7efc27fff700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc2806c820 0x7efc28157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 -- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc2806c820 msgr2=0x7efc28157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc2806c820 0x7efc28157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 -- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2815a2d0 msgr2=0x7efc28150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2815a2d0 0x7efc28150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 -- 172.21.15.50:0/2712897930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc18009420 con 0x7efc280ade60 2023-12-24T20:08:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc277fe700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c590 tx=0x7efc1c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c005b30 con 0x7efc280ade60 2023-12-24T20:08:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c005cb0 con 0x7efc280ade60 2023-12-24T20:08:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc28158d80 con 0x7efc280ade60 2023-12-24T20:08:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c007320 con 0x7efc280ade60 2023-12-24T20:08:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc28158160 con 0x7efc280ade60 2023-12-24T20:08:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.617+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2804be40 con 0x7efc280ade60 2023-12-24T20:08:30.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.621+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7efc1c01b3b0 con 0x7efc280ade60 2023-12-24T20:08:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.621+0000 7efc0ffff700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.621+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7efc1c07bfe0 con 0x7efc280ade60 2023-12-24T20:08:30.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.625+0000 7efc27fff700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:30.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.625+0000 7efc27fff700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 0x7efc14062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efc180093f0 tx=0x7efc18017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:30.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.629+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efc1c04c200 con 0x7efc280ade60 2023-12-24T20:08:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:30.861+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7efc2806a880 con 0x7efc280ade60 2023-12-24T20:08:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.149+0000 7efc0ffff700 1 -- 172.21.15.50:0/2712897930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2972) v1 ==== 165+0+0 (secure 0 0 0) 0x7efc1c04f820 con 0x7efc280ade60 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 msgr2=0x7efc14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 0x7efc14062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efc180093f0 tx=0x7efc18017000 comp rx=0 tx=0).stop 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 msgr2=0x7efc28146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c590 tx=0x7efc1c007e00 comp rx=0 tx=0).stop 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 shutdown_connections 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efc14060550 0x7efc14062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2815a2d0 0x7efc28150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280ade60 0x7efc28146380 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 --2- 172.21.15.50:0/2712897930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc2806c820 0x7efc28157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 >> 172.21.15.50:0/2712897930 conn(0x7efc28067b80 msgr2=0x7efc281522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 shutdown_connections 2023-12-24T20:08:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.153+0000 7efc2d46b700 1 -- 172.21.15.50:0/2712897930 wait complete. 2023-12-24T20:08:31.181 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-12-24T20:08:31.181 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-12-24T20:08:31.181 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-12-24T20:08:31.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-12-24T20:08:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.345+0000 7f8b99585700 1 Processor -- start 2023-12-24T20:08:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 -- start start 2023-12-24T20:08:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94154b60 0x7f8b940c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b9406aca0 0x7f8b9406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9406c820 con 0x7f8b940c6d00 2023-12-24T20:08:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9406b960 con 0x7f8b9406aca0 2023-12-24T20:08:31.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b99585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9406bc40 con 0x7f8b94154b60 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b9406aca0 0x7f8b9406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b9406aca0 0x7f8b9406b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57794/0 (socket says 172.21.15.50:57794) 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 -- 172.21.15.50:0/1221350393 learned_addr learned my addr 172.21.15.50:0/1221350393 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b8a7fc700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94154b60 0x7f8b940c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 -- 172.21.15.50:0/1221350393 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94154b60 msgr2=0x7f8b940c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94154b60 0x7f8b940c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 -- 172.21.15.50:0/1221350393 >> v1:172.21.15.50:6789/0 conn(0x7f8b940c6d00 legacy=0x7f8b94154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 -- 172.21.15.50:0/1221350393 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9406bf20 con 0x7f8b9406aca0 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.349+0000 7f8b937fe700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406aca0 0x7f8b9406b100 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0099b0 tx=0x7f8b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcb57bb3eadb78f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b927fc700 1 -- 172.21.15.50:0/1221350393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00b860 con 0x7f8b9406aca0 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b927fc700 1 -- 172.21.15.50:0/1221350393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00b9c0 con 0x7f8b9406aca0 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b927fc700 1 -- 172.21.15.50:0/1221350393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00bd60 con 0x7f8b9406aca0 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- 172.21.15.50:0/1221350393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406aca0 msgr2=0x7f8b9406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406aca0 0x7f8b9406b100 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0099b0 tx=0x7f8b8c009250 comp rx=0 tx=0).stop 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- 172.21.15.50:0/1221350393 shutdown_connections 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b9406aca0 0x7f8b9406b100 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 --2- 172.21.15.50:0/1221350393 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94154b60 0x7f8b940c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- 172.21.15.50:0/1221350393 >> 172.21.15.50:0/1221350393 conn(0x7f8b940cbba0 msgr2=0x7f8b940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- 172.21.15.50:0/1221350393 shutdown_connections 2023-12-24T20:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- 172.21.15.50:0/1221350393 wait complete. 2023-12-24T20:08:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 Processor -- start 2023-12-24T20:08:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.353+0000 7f8b99585700 1 -- start start 2023-12-24T20:08:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 0x7f8b940a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c6d00 0x7f8b940c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940aa330 con 0x7f8b94154b60 2023-12-24T20:08:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ca450 con 0x7f8b9406aca0 2023-12-24T20:08:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ca9d0 con 0x7f8b940c6d00 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57802/0 (socket says 172.21.15.50:57802) 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 -- 172.21.15.50:0/2991286384 learned_addr learned my addr 172.21.15.50:0/2991286384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b8a7fc700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c6d00 0x7f8b940c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b92ffd700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 0x7f8b940a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 -- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c6d00 msgr2=0x7f8b940c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c6d00 0x7f8b940c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 -- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 msgr2=0x7f8b940a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 0x7f8b940a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:31.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 -- 172.21.15.50:0/2991286384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0094f0 con 0x7f8b94154b60 2023-12-24T20:08:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b92ffd700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 0x7f8b940a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b937fe700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8b94069da0 tx=0x7f8b8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00b860 con 0x7f8b94154b60 2023-12-24T20:08:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c01a630 con 0x7f8b94154b60 2023-12-24T20:08:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b940a9d70 con 0x7f8b94154b60 2023-12-24T20:08:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c01a9f0 con 0x7f8b94154b60 2023-12-24T20:08:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.357+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940ca660 con 0x7f8b94154b60 2023-12-24T20:08:31.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.361+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940cab80 con 0x7f8b94154b60 2023-12-24T20:08:31.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.361+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8b8c02d440 con 0x7f8b94154b60 2023-12-24T20:08:31.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.361+0000 7f8b8b7fe700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 0x7f8b74062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:31.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.361+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f8b8c07e6f0 con 0x7f8b94154b60 2023-12-24T20:08:31.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.365+0000 7f8b92ffd700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 0x7f8b74062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:31.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.365+0000 7f8b92ffd700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 0x7f8b74062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b84007fd0 tx=0x7f8b84009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.369+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b940cab80 con 0x7f8b94154b60 2023-12-24T20:08:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:31.601+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f8b94065340 con 0x7f8b94154b60 2023-12-24T20:08:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.161+0000 7f8b8b7fe700 1 -- 172.21.15.50:0/2991286384 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2973) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8b8c052380 con 0x7f8b94154b60 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 msgr2=0x7f8b74062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 0x7f8b74062a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b84007fd0 tx=0x7f8b84009040 comp rx=0 tx=0).stop 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 msgr2=0x7f8b940c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8b94069da0 tx=0x7f8b8c017000 comp rx=0 tx=0).stop 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 shutdown_connections 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b74060580 0x7f8b74062a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b94154b60 0x7f8b940c1de0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b940c6d00 0x7f8b940c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 --2- 172.21.15.50:0/2991286384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9406aca0 0x7f8b940a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 >> 172.21.15.50:0/2991286384 conn(0x7f8b940cbba0 msgr2=0x7f8b941536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 shutdown_connections 2023-12-24T20:08:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.165+0000 7f8b99585700 1 -- 172.21.15.50:0/2991286384 wait complete. 2023-12-24T20:08:32.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:08:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 Processor -- start 2023-12-24T20:08:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 -- start start 2023-12-24T20:08:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 0x7f2af406a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af415e960 con 0x7f2af406ac40 2023-12-24T20:08:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af406b070 con 0x7f2af4160af0 2023-12-24T20:08:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.385+0000 7f2afbb85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af415fe00 con 0x7f2af4160720 2023-12-24T20:08:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9120700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 0x7f2af406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2afa122700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2af406ac40 0x7f2af4161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:53868/0 (socket says 172.21.15.50:53868) 2023-12-24T20:08:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2afa122700 1 -- 172.21.15.50:0/846558238 learned_addr learned my addr 172.21.15.50:0/846558238 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af891f700 1 -- 172.21.15.50:0/846558238 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578767992 0 0) 0x7f2af415e960 con 0x7f2af406ac40 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af891f700 1 -- 172.21.15.50:0/846558238 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae0003570 con 0x7f2af406ac40 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 -- 172.21.15.50:0/846558238 >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 msgr2=0x7f2af406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 --2- 172.21.15.50:0/846558238 >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 0x7f2af406a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 -- 172.21.15.50:0/846558238 >> v1:172.21.15.82:6789/0 conn(0x7f2af406ac40 legacy=0x7f2af4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 -- 172.21.15.50:0/846558238 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af41600a0 con 0x7f2af4160720 2023-12-24T20:08:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9120700 1 --2- 172.21.15.50:0/846558238 >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 0x7f2af406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af9921700 1 --2- 172.21.15.50:0/846558238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d1e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2af00098e0 tx=0x7f2af00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434fb4593e54f85e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af891f700 1 -- 172.21.15.50:0/846558238 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011630 con 0x7f2af4160720 2023-12-24T20:08:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af891f700 1 -- 172.21.15.50:0/846558238 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0011790 con 0x7f2af4160720 2023-12-24T20:08:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.389+0000 7f2af891f700 1 -- 172.21.15.50:0/846558238 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011b30 con 0x7f2af4160720 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- 172.21.15.50:0/846558238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 msgr2=0x7f2af406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 --2- 172.21.15.50:0/846558238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d1e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2af00098e0 tx=0x7f2af00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- 172.21.15.50:0/846558238 shutdown_connections 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 --2- 172.21.15.50:0/846558238 >> v2:172.21.15.50:3300/0 conn(0x7f2af4160af0 0x7f2af406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 --2- 172.21.15.50:0/846558238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d1e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- 172.21.15.50:0/846558238 >> 172.21.15.50:0/846558238 conn(0x7f2af4067b80 msgr2=0x7f2af40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- 172.21.15.50:0/846558238 shutdown_connections 2023-12-24T20:08:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- 172.21.15.50:0/846558238 wait complete. 2023-12-24T20:08:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 Processor -- start 2023-12-24T20:08:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.393+0000 7f2afbb85700 1 -- start start 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af406ac40 0x7f2af4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4158470 con 0x7f2af4160af0 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af41575c0 con 0x7f2af406ac40 2023-12-24T20:08:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afbb85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4157860 con 0x7f2af4160720 2023-12-24T20:08:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57818/0 (socket says 172.21.15.50:57818) 2023-12-24T20:08:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2af9921700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af406ac40 0x7f2af4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 -- 172.21.15.50:0/1818424280 learned_addr learned my addr 172.21.15.50:0/1818424280 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2af9120700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 -- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 msgr2=0x7f2af406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 -- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af406ac40 msgr2=0x7f2af4155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af406ac40 0x7f2af4155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 -- 172.21.15.50:0/1818424280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009420 con 0x7f2af4160af0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2afa122700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2aec001460 tx=0x7f2aec001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00a870 con 0x7f2af4160af0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00a9d0 con 0x7f2af4160af0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.397+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00ad50 con 0x7f2af4160af0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.401+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0009420 con 0x7f2af4160af0 2023-12-24T20:08:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.401+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af4157e20 con 0x7f2af4160af0 2023-12-24T20:08:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.401+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af4158620 con 0x7f2af4160af0 2023-12-24T20:08:32.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.401+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2aec007300 con 0x7f2af4160af0 2023-12-24T20:08:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.405+0000 7f2ae9ffb700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 0x7f2ad8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.405+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f2aec07cf30 con 0x7f2af4160af0 2023-12-24T20:08:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.405+0000 7f2af9921700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 0x7f2ad8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.405+0000 7f2af9921700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 0x7f2ad8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2af00091e0 tx=0x7f2af0017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.413+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2af4158620 con 0x7f2af4160af0 2023-12-24T20:08:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.585+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2af4158620 con 0x7f2af4160af0 2023-12-24T20:08:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.597+0000 7f2ae9ffb700 1 -- 172.21.15.50:0/1818424280 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2af4158620 con 0x7f2af4160af0 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 msgr2=0x7f2ad8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 0x7f2ad8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2af00091e0 tx=0x7f2af0017000 comp rx=0 tx=0).stop 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 msgr2=0x7f2af406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2aec001460 tx=0x7f2aec001a40 comp rx=0 tx=0).stop 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 shutdown_connections 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ad8060550 0x7f2ad8062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2af4160af0 0x7f2af406dd30 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2af4160720 0x7f2af406d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 --2- 172.21.15.50:0/1818424280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af406ac40 0x7f2af4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 >> 172.21.15.50:0/1818424280 conn(0x7f2af4067b80 msgr2=0x7f2af40b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 shutdown_connections 2023-12-24T20:08:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.601+0000 7f2afbb85700 1 -- 172.21.15.50:0/1818424280 wait complete. 2023-12-24T20:08:32.626 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:08:32.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:32.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:32.719 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:08:32.719 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:08:32.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.893+0000 7f4a7359e700 1 Processor -- start 2023-12-24T20:08:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.893+0000 7f4a7359e700 1 -- start start 2023-12-24T20:08:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a741611b0 0x7f4a74161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a7406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7406c4d0 con 0x7f4a7406c820 2023-12-24T20:08:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7406c1f0 con 0x7f4a741611b0 2023-12-24T20:08:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740ab5e0 con 0x7f4a740ae100 2023-12-24T20:08:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a72d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a7406c820 0x7f4a740ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53152/0 (socket says 172.21.15.50:53152) 2023-12-24T20:08:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a72d9d700 1 -- 172.21.15.50:0/2533979935 learned_addr learned my addr 172.21.15.50:0/2533979935 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 --2- 172.21.15.50:0/2533979935 >> v2:172.21.15.82:3300/0 conn(0x7f4a741611b0 0x7f4a74161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a69d9b700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a7406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915554220 0 0) 0x7f4a6c001110 con 0x7f4a7406c820 2023-12-24T20:08:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a60003570 con 0x7f4a7406c820 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 -- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 msgr2=0x7f4a7406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a7406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232054667 0 0) 0x7f4a60003570 con 0x7f4a7406c820 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 -- 172.21.15.50:0/2533979935 >> v1:172.21.15.50:6789/0 conn(0x7f4a7406c820 legacy=0x7f4a740ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 -- 172.21.15.50:0/2533979935 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740ab8c0 con 0x7f4a741611b0 2023-12-24T20:08:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.897+0000 7f4a7259c700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a74161580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4a640098e0 tx=0x7f4a640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83f3f675fbdb8b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c001600 con 0x7f4a741611b0 2023-12-24T20:08:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64011420 con 0x7f4a741611b0 2023-12-24T20:08:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a71d9b700 1 -- 172.21.15.50:0/2533979935 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640117c0 con 0x7f4a741611b0 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 -- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 msgr2=0x7f4a74161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a74161580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4a640098e0 tx=0x7f4a640091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 -- 172.21.15.50:0/2533979935 shutdown_connections 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a7406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 --2- 172.21.15.50:0/2533979935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a74161580 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 -- 172.21.15.50:0/2533979935 >> 172.21.15.50:0/2533979935 conn(0x7f4a74067b80 msgr2=0x7f4a740cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 -- 172.21.15.50:0/2533979935 shutdown_connections 2023-12-24T20:08:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 -- 172.21.15.50:0/2533979935 wait complete. 2023-12-24T20:08:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.901+0000 7f4a7359e700 1 Processor -- start 2023-12-24T20:08:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 -- start start 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a740b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a740a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74155710 con 0x7f4a7406c820 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741559f0 con 0x7f4a741611b0 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740b0cf0 con 0x7f4a740ae100 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57820/0 (socket says 172.21.15.50:57820) 2023-12-24T20:08:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 -- 172.21.15.50:0/427355835 learned_addr learned my addr 172.21.15.50:0/427355835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a72d9d700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a740a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a69d9b700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a740b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 -- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 msgr2=0x7f4a740b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a740b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 -- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 msgr2=0x7f4a740a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a740a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 -- 172.21.15.50:0/427355835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009420 con 0x7f4a7406c820 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a72d9d700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a740a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a7259c700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c95c0 tx=0x7f4a64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.905+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6401cba0 con 0x7f4a7406c820 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6401cd00 con 0x7f4a7406c820 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6401a6a0 con 0x7f4a7406c820 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740aa0e0 con 0x7f4a7406c820 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740b1220 con 0x7f4a7406c820 2023-12-24T20:08:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7404be40 con 0x7f4a7406c820 2023-12-24T20:08:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.909+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4a6401aad0 con 0x7f4a7406c820 2023-12-24T20:08:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.913+0000 7f4a6affd700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 0x7f4a54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.913+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f4a6407e490 con 0x7f4a7406c820 2023-12-24T20:08:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.913+0000 7f4a69d9b700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 0x7f4a54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.913+0000 7f4a69d9b700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 0x7f4a54062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a7406ce30 tx=0x7f4a5c00b040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:32.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:32.921+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a6404e690 con 0x7f4a7406c820 2023-12-24T20:08:33.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.133+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a7406a840 con 0x7f4a7406c820 2023-12-24T20:08:33.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.137+0000 7f4a6affd700 1 -- 172.21.15.50:0/427355835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4a64029de0 con 0x7f4a7406c820 2023-12-24T20:08:33.139 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:33.140 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4088267814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4088267814},{"type":"v1","addr":"172.21.15.82:6835","nonce":4088267814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3119403209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3119403209},{"type":"v1","addr":"172.21.15.50:6835","nonce":3119403209}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3566772712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3566772712},{"type":"v1","addr":"172.21.15.82:6833","nonce":3566772712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9741,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1835009755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1835009755},{"type":"v1","addr":"172.21.15.50:6833","nonce":1835009755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[]} 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 msgr2=0x7f4a54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 0x7f4a54062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a7406ce30 tx=0x7f4a5c00b040 comp rx=0 tx=0).stop 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 msgr2=0x7f4a7406b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c95c0 tx=0x7f4a64016000 comp rx=0 tx=0).stop 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 shutdown_connections 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4a54060550 0x7f4a54062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a741611b0 0x7f4a740a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a740ae100 0x7f4a740b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 --2- 172.21.15.50:0/427355835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7406c820 0x7f4a7406b540 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 >> 172.21.15.50:0/427355835 conn(0x7f4a74067b80 msgr2=0x7f4a7415cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:33.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 shutdown_connections 2023-12-24T20:08:33.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.141+0000 7f4a7359e700 1 -- 172.21.15.50:0/427355835 wait complete. 2023-12-24T20:08:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 88 2023-12-24T20:08:33.172 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:08:33.172 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:08:33.173 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:08:33.173 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:33.173 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:08:33.173 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:08:33.173 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:08:33.173 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:33.173 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:08:33.173 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:08:33.174 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:08:33.174 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:33.174 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:08:33.174 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:08:33.174 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:08:33.174 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:33.189 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:08:33.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:08:33.193 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:08:33.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:08:33.195 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:08:33.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:08:33.199 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:08:33.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:08:33.244 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:08:33.245 DEBUG:teuthology.parallel:result is None 2023-12-24T20:08:33.250 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:08:33.251 DEBUG:teuthology.parallel:result is None 2023-12-24T20:08:33.251 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:08:33.251 DEBUG:teuthology.parallel:result is None 2023-12-24T20:08:33.254 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:08:33.254 DEBUG:teuthology.parallel:result is None 2023-12-24T20:08:33.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:08:33.360 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T20:08:33.361 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T20:08:33.362 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T20:08:33.366 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T20:08:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.409+0000 7f4bfb02e700 1 Processor -- start 2023-12-24T20:08:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.413+0000 7f4bfb02e700 1 -- start start 2023-12-24T20:08:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.413+0000 7f4bfb02e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.413+0000 7f4bfb02e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf406a6a0 con 0x7f4bf413f550 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf8dca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4bf413f550 0x7f4bf406b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53164/0 (socket says 172.21.15.50:53164) 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf8dca700 1 -- 172.21.15.50:0/333260150 learned_addr learned my addr 172.21.15.50:0/333260150 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf40cb8a0 con 0x7f4bf413f920 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf406a960 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf95cb700 1 --2- 172.21.15.50:0/333260150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056202209 0 0) 0x7f4bf406a6a0 con 0x7f4bf413f550 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bdc003570 con 0x7f4bf413f550 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf95cb700 1 -- 172.21.15.50:0/333260150 >> v1:172.21.15.82:6789/0 conn(0x7f4bf413f920 legacy=0x7f4bf406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193539906 0 0) 0x7f4bf40cb8a0 con 0x7f4bf413f920 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf95cb700 1 -- 172.21.15.50:0/333260150 >> v1:172.21.15.50:6789/0 conn(0x7f4bf413f550 legacy=0x7f4bf406b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf95cb700 1 -- 172.21.15.50:0/333260150 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf406ac40 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bf95cb700 1 --2- 172.21.15.50:0/333260150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40ab5e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009e90 tx=0x7f4bec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45e833e807eb85d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00e070 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec00bc30 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4beb7fe700 1 -- 172.21.15.50:0/333260150 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec012430 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 msgr2=0x7f4bf40ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.417+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/333260150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40ab5e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009e90 tx=0x7f4bec009780 comp rx=0 tx=0).stop 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 shutdown_connections 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/333260150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40ab5e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 >> 172.21.15.50:0/333260150 conn(0x7f4bf40cbba0 msgr2=0x7f4bf40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 shutdown_connections 2023-12-24T20:08:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- 172.21.15.50:0/333260150 wait complete. 2023-12-24T20:08:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 Processor -- start 2023-12-24T20:08:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- start start 2023-12-24T20:08:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 0x7f4bf413c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf413f920 0x7f4bf40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40b18f0 con 0x7f4bf413f550 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40b0ce0 con 0x7f4bf413f920 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.421+0000 7f4bfb02e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40b0fc0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 0x7f4bf413c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:53604/0 (socket says 172.21.15.50:53604) 2023-12-24T20:08:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 -- 172.21.15.50:0/1136214366 learned_addr learned my addr 172.21.15.50:0/1136214366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf95cb700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf413f920 0x7f4bf40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 -- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf413f920 msgr2=0x7f4bf40c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf413f920 0x7f4bf40c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 -- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 msgr2=0x7f4bf413c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 0x7f4bf413c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 -- 172.21.15.50:0/1136214366 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009a20 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bebfff700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 0x7f4bf413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bf8dca700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c7c0 tx=0x7f4bf0007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005cd0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0005e30 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0007320 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf40b12a0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.425+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf40b09d0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.429+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf40652e0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.429+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4bf001b3b0 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.429+0000 7f4be8ff9700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 0x7f4be0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.429+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6551+0+0 (secure 0 0 0) 0x7f4bf007c250 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.429+0000 7f4bebfff700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 0x7f4be0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.433+0000 7f4bebfff700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 0x7f4be0062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40c27d0 tx=0x7f4be4009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.437+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bf004c450 con 0x7f4bf40cb3c0 2023-12-24T20:08:33.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:33.637+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4bf40b1100 con 0x7f4bf40cb3c0 2023-12-24T20:08:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.193+0000 7f4be8ff9700 1 -- 172.21.15.50:0/1136214366 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v187) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4bf40b1100 con 0x7f4bf40cb3c0 2023-12-24T20:08:34.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 msgr2=0x7f4be0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 0x7f4be0062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40c27d0 tx=0x7f4be4009040 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 msgr2=0x7f4bf40b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c7c0 tx=0x7f4bf0007e00 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 shutdown_connections 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4be0060550 0x7f4be0062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf413f920 0x7f4bf40c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf413f550 0x7f4bf413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 --2- 172.21.15.50:0/1136214366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bf40cb3c0 0x7f4bf40b0490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 >> 172.21.15.50:0/1136214366 conn(0x7f4bf40cbba0 msgr2=0x7f4bf406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 shutdown_connections 2023-12-24T20:08:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.197+0000 7f4bfb02e700 1 -- 172.21.15.50:0/1136214366 wait complete. 2023-12-24T20:08:34.204 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T20:08:34.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:08:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.385+0000 7f0ef2dcc700 1 Processor -- start 2023-12-24T20:08:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.385+0000 7f0ef2dcc700 1 -- start start 2023-12-24T20:08:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 0x7f0eec161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eec0ae100 0x7f0eec06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eec06c820 0x7f0eec06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec06c4d0 con 0x7f0eec0ae100 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec06c1f0 con 0x7f0eec06c820 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef2dcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0ab5e0 con 0x7f0eec1611b0 2023-12-24T20:08:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eec0ae100 0x7f0eec06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eec0ae100 0x7f0eec06b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57856/0 (socket says 172.21.15.50:57856) 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 -- 172.21.15.50:0/2274667227 learned_addr learned my addr 172.21.15.50:0/2274667227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef1dca700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 0x7f0eec161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef25cb700 1 --2- 172.21.15.50:0/2274667227 >> v2:172.21.15.82:3300/0 conn(0x7f0eec06c820 0x7f0eec06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 -- 172.21.15.50:0/2274667227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 msgr2=0x7f0eec161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 0x7f0eec161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 -- 172.21.15.50:0/2274667227 >> v2:172.21.15.82:3300/0 conn(0x7f0eec06c820 msgr2=0x7f0eec06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 --2- 172.21.15.50:0/2274667227 >> v2:172.21.15.82:3300/0 conn(0x7f0eec06c820 0x7f0eec06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 -- 172.21.15.50:0/2274667227 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0ab8c0 con 0x7f0eec0ae100 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef1dca700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 0x7f0eec161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef15c9700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec0ae100 0x7f0eec06b9c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0c8410 tx=0x7f0edc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9645888705342e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef0dc8700 1 -- 172.21.15.50:0/2274667227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00b860 con 0x7f0eec0ae100 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef0dc8700 1 -- 172.21.15.50:0/2274667227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00b9c0 con 0x7f0eec0ae100 2023-12-24T20:08:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.389+0000 7f0ef0dc8700 1 -- 172.21.15.50:0/2274667227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00bd60 con 0x7f0eec0ae100 2023-12-24T20:08:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/2274667227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec0ae100 msgr2=0x7f0eec06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec0ae100 0x7f0eec06b9c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0c8410 tx=0x7f0edc009250 comp rx=0 tx=0).stop 2023-12-24T20:08:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/2274667227 shutdown_connections 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/2274667227 >> v2:172.21.15.82:3300/0 conn(0x7f0eec06c820 0x7f0eec06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec0ae100 0x7f0eec06b9c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/2274667227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec1611b0 0x7f0eec161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/2274667227 >> 172.21.15.50:0/2274667227 conn(0x7f0eec067b80 msgr2=0x7f0eec0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/2274667227 shutdown_connections 2023-12-24T20:08:34.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/2274667227 wait complete. 2023-12-24T20:08:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.393+0000 7f0ef2dcc700 1 Processor -- start 2023-12-24T20:08:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 -- start start 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eec06c820 0x7f0eec1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec0ae100 0x7f0eec16d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec16dbe0 con 0x7f0eec1611b0 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec156e20 con 0x7f0eec06c820 2023-12-24T20:08:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef2dcc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b01d0 con 0x7f0eec0ae100 2023-12-24T20:08:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57858/0 (socket says 172.21.15.50:57858) 2023-12-24T20:08:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 -- 172.21.15.50:0/880867416 learned_addr learned my addr 172.21.15.50:0/880867416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef15c9700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec0ae100 0x7f0eec16d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef1dca700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eec06c820 0x7f0eec1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 -- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec0ae100 msgr2=0x7f0eec16d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec0ae100 0x7f0eec16d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 -- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eec06c820 msgr2=0x7f0eec1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eec06c820 0x7f0eec1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 -- 172.21.15.50:0/880867416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0094f0 con 0x7f0eec1611b0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ef25cb700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009fa0 tx=0x7f0ee4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400eb60 con 0x7f0eec1611b0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.397+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400ecc0 con 0x7f0eec1611b0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.401+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec15c1a0 con 0x7f0eec1611b0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.401+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4014670 con 0x7f0eec1611b0 2023-12-24T20:08:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.401+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec156b40 con 0x7f0eec1611b0 2023-12-24T20:08:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.401+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec04be40 con 0x7f0eec1611b0 2023-12-24T20:08:34.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.401+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0ee40149e0 con 0x7f0eec1611b0 2023-12-24T20:08:34.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.405+0000 7f0ee1ffb700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.405+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0ee407cd70 con 0x7f0eec1611b0 2023-12-24T20:08:34.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.405+0000 7f0ef1dca700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.405+0000 7f0ef1dca700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ac480 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.413+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ee404d3c0 con 0x7f0eec1611b0 2023-12-24T20:08:34.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0eec0cb630 con 0x7f0eec1611b0 2023-12-24T20:08:34.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ee1ffb700 1 -- 172.21.15.50:0/880867416 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0ee40509e0 con 0x7f0eec1611b0 2023-12-24T20:08:34.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:34.644 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:08:34.644 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T20:08:34.645 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T20:08:34.647 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.649 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.651 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T20:08:34.652 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:08:34.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:08:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:34.656 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T20:08:34.657 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 msgr2=0x7f0ed0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ac480 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 msgr2=0x7f0eec170310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.641+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009fa0 tx=0x7f0ee4009900 comp rx=0 tx=0).stop 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 shutdown_connections 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eec1611b0 0x7f0eec170310 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eec0ae100 0x7f0eec16d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 --2- 172.21.15.50:0/880867416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eec06c820 0x7f0eec1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 >> 172.21.15.50:0/880867416 conn(0x7f0eec067b80 msgr2=0x7f0eec06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 shutdown_connections 2023-12-24T20:08:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.645+0000 7f0ef2dcc700 1 -- 172.21.15.50:0/880867416 wait complete. 2023-12-24T20:08:34.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.825+0000 7f1545ae3700 1 Processor -- start 2023-12-24T20:08:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.825+0000 7f1545ae3700 1 -- start start 2023-12-24T20:08:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1545ae3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1540158dd0 0x7f154006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1545ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15401591a0 0x7f154006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1545ae3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154006c820 con 0x7f154006c070 2023-12-24T20:08:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1545ae3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154006d680 con 0x7f1540158dd0 2023-12-24T20:08:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1545ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154006ca70 con 0x7f15401591a0 2023-12-24T20:08:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f15452e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f154006c070 0x7f15400b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53170/0 (socket says 172.21.15.50:53170) 2023-12-24T20:08:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f15452e2700 1 -- 172.21.15.50:0/3954393244 learned_addr learned my addr 172.21.15.50:0/3954393244 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 --2- 172.21.15.50:0/3954393244 >> v2:172.21.15.82:3300/0 conn(0x7f1540158dd0 0x7f154006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153ffff700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15401591a0 0x7f154006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153f7fe700 1 -- 172.21.15.50:0/3954393244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77506057 0 0) 0x7f154006c820 con 0x7f154006c070 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153f7fe700 1 -- 172.21.15.50:0/3954393244 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1528003570 con 0x7f154006c070 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 -- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15401591a0 msgr2=0x7f154006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15401591a0 0x7f154006bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 -- 172.21.15.50:0/3954393244 >> v1:172.21.15.50:6789/0 conn(0x7f154006c070 legacy=0x7f15400b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 -- 172.21.15.50:0/3954393244 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154006cd50 con 0x7f1540158dd0 2023-12-24T20:08:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f1544ae1700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f154006db10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15340098e0 tx=0x7f15340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6258c793df82b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153f7fe700 1 -- 172.21.15.50:0/3954393244 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011630 con 0x7f1540158dd0 2023-12-24T20:08:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153f7fe700 1 -- 172.21.15.50:0/3954393244 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1534011790 con 0x7f1540158dd0 2023-12-24T20:08:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.829+0000 7f153f7fe700 1 -- 172.21.15.50:0/3954393244 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011b30 con 0x7f1540158dd0 2023-12-24T20:08:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 msgr2=0x7f154006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f154006db10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15340098e0 tx=0x7f15340091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- 172.21.15.50:0/3954393244 shutdown_connections 2023-12-24T20:08:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15401591a0 0x7f154006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 --2- 172.21.15.50:0/3954393244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f154006db10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- 172.21.15.50:0/3954393244 >> 172.21.15.50:0/3954393244 conn(0x7f1540067ae0 msgr2=0x7f15400cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- 172.21.15.50:0/3954393244 shutdown_connections 2023-12-24T20:08:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- 172.21.15.50:0/3954393244 wait complete. 2023-12-24T20:08:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 Processor -- start 2023-12-24T20:08:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.833+0000 7f1545ae3700 1 -- start start 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 0x7f15401697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f1540169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154014e0c0 con 0x7f15401591a0 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154015ad10 con 0x7f1540158dd0 2023-12-24T20:08:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1540151160 con 0x7f154006c070 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57870/0 (socket says 172.21.15.50:57870) 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 -- 172.21.15.50:0/2568522209 learned_addr learned my addr 172.21.15.50:0/2568522209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f153ffff700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f1540169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1544ae1700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 0x7f15401697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 -- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 msgr2=0x7f15401697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 0x7f15401697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 -- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 msgr2=0x7f1540169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f1540169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 -- 172.21.15.50:0/2568522209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534009420 con 0x7f15401591a0 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1544ae1700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 0x7f15401697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f153ffff700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f1540169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f15452e2700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f1538001460 tx=0x7f1538001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800a950 con 0x7f15401591a0 2023-12-24T20:08:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800aab0 con 0x7f15401591a0 2023-12-24T20:08:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800ae30 con 0x7f15401591a0 2023-12-24T20:08:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.837+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15401513f0 con 0x7f15401591a0 2023-12-24T20:08:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.841+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154015a9a0 con 0x7f15401591a0 2023-12-24T20:08:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.841+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154015ae80 con 0x7f15401591a0 2023-12-24T20:08:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.841+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1538007300 con 0x7f15401591a0 2023-12-24T20:08:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.845+0000 7f153cff9700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 0x7f152c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.845+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f153807cc40 con 0x7f15401591a0 2023-12-24T20:08:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.845+0000 7f1544ae1700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 0x7f152c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.845+0000 7f1544ae1700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 0x7f152c062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f15340091e0 tx=0x7f1534017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:34.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:34.853+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f153804d200 con 0x7f15401591a0 2023-12-24T20:08:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.029+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f154004be40 con 0x7f15401591a0 2023-12-24T20:08:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.029+0000 7f153cff9700 1 -- 172.21.15.50:0/2568522209 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+12964 (secure 0 0 0) 0x7f1538050820 con 0x7f15401591a0 2023-12-24T20:08:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:35.034 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":189,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:34.202976+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.033+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 msgr2=0x7f152c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.033+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 0x7f152c062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f15340091e0 tx=0x7f1534017000 comp rx=0 tx=0).stop 2023-12-24T20:08:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.033+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 msgr2=0x7f1540150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.033+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f1538001460 tx=0x7f1538001a40 comp rx=0 tx=0).stop 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 shutdown_connections 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f152c060550 0x7f152c062a00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15401591a0 0x7f1540150c20 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1540158dd0 0x7f1540169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 --2- 172.21.15.50:0/2568522209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154006c070 0x7f15401697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 >> 172.21.15.50:0/2568522209 conn(0x7f1540067ae0 msgr2=0x7f15400b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 shutdown_connections 2023-12-24T20:08:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.037+0000 7f1545ae3700 1 -- 172.21.15.50:0/2568522209 wait complete. 2023-12-24T20:08:35.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:08:35.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:08:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.225+0000 7fc0a2d85700 1 Processor -- start 2023-12-24T20:08:35.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.225+0000 7fc0a2d85700 1 -- start start 2023-12-24T20:08:35.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a2d85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a2d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c06a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a2d85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c06b0a0 con 0x7fc09c06ac40 2023-12-24T20:08:35.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a2d85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c159640 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a2d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0cd680 con 0x7fc09c0cf8a0 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a0b21700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a0b21700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57882/0 (socket says 172.21.15.50:57882) 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.229+0000 7fc0a0b21700 1 -- 172.21.15.50:0/3917280115 learned_addr learned my addr 172.21.15.50:0/3917280115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc093fff700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c06a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a0b21700 1 -- 172.21.15.50:0/3917280115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 msgr2=0x7fc09c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a0b21700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c06a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a0b21700 1 -- 172.21.15.50:0/3917280115 >> v1:172.21.15.50:6789/0 conn(0x7fc09c06ac40 legacy=0x7fc09c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a0b21700 1 -- 172.21.15.50:0/3917280115 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0cca70 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a0b21700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc098009f20 tx=0x7fc098009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55c316159ee9607 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0937fe700 1 -- 172.21.15.50:0/3917280115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800e070 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0937fe700 1 -- 172.21.15.50:0/3917280115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09800b9d0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0937fe700 1 -- 172.21.15.50:0/3917280115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980092e0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 -- 172.21.15.50:0/3917280115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 msgr2=0x7fc09c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc098009f20 tx=0x7fc098009840 comp rx=0 tx=0).stop 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 -- 172.21.15.50:0/3917280115 shutdown_connections 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c06a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/3917280115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c06d1e0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 -- 172.21.15.50:0/3917280115 >> 172.21.15.50:0/3917280115 conn(0x7fc09c067b30 msgr2=0x7fc09c0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 -- 172.21.15.50:0/3917280115 shutdown_connections 2023-12-24T20:08:35.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.233+0000 7fc0a2d85700 1 -- 172.21.15.50:0/3917280115 wait complete. 2023-12-24T20:08:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.237+0000 7fc0a2d85700 1 Processor -- start 2023-12-24T20:08:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.237+0000 7fc0a2d85700 1 -- start start 2023-12-24T20:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06ac40 0x7fc09c148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c152bd0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c1494c0 con 0x7fc09c06ac40 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c158a40 con 0x7fc09c0cf8a0 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57898/0 (socket says 172.21.15.50:57898) 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 -- 172.21.15.50:0/1103589167 learned_addr learned my addr 172.21.15.50:0/1103589167 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a0b21700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06ac40 0x7fc09c148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a1322700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 -- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 msgr2=0x7fc09c158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 -- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06ac40 msgr2=0x7fc09c148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06ac40 0x7fc09c148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 -- 172.21.15.50:0/1103589167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009ae0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc093fff700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e900 tx=0x7fc08c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00eea0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00c850 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c1522a0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00cc10 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c152860 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.241+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0652e0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.245+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc08c013470 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.245+0000 7fc090ff9700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 0x7fc088062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.245+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fc08c07c920 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.245+0000 7fc0a0b21700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 0x7fc088062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.249+0000 7fc0a0b21700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 0x7fc088062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc098009880 tx=0x7fc098018000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.253+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc08c04ced0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.429+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc09c0ccd50 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.429+0000 7fc090ff9700 1 -- 172.21.15.50:0/1103589167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc08c0504f0 con 0x7fc09c0cf4d0 2023-12-24T20:08:35.432 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T20:08:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 msgr2=0x7fc088062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 0x7fc088062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc098009880 tx=0x7fc098018000 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 msgr2=0x7fc09c157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e900 tx=0x7fc08c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 shutdown_connections 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc088060580 0x7fc088062a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc09c0cf8a0 0x7fc09c158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc09c0cf4d0 0x7fc09c157ef0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 --2- 172.21.15.50:0/1103589167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06ac40 0x7fc09c148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 >> 172.21.15.50:0/1103589167 conn(0x7fc09c067b30 msgr2=0x7fc09c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:35.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 shutdown_connections 2023-12-24T20:08:35.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.433+0000 7fc0a2d85700 1 -- 172.21.15.50:0/1103589167 wait complete. 2023-12-24T20:08:35.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:08:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 Processor -- start 2023-12-24T20:08:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 -- start start 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f366c06def0 0x7f366c168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c06ca50 con 0x7f366c0ca3a0 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c06b520 con 0x7f366c0ca770 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f367422e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0c6980 con 0x7f366c06def0 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f3671fca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f366c0ca3a0 0x7f366c06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53178/0 (socket says 172.21.15.50:53178) 2023-12-24T20:08:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.617+0000 7f3671fca700 1 -- 172.21.15.50:0/3989323874 learned_addr learned my addr 172.21.15.50:0/3989323874 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36727cb700 1 --2- 172.21.15.50:0/3989323874 >> v2:172.21.15.82:3300/0 conn(0x7f366c06def0 0x7f366c168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025377681 0 0) 0x7f366c06ca50 con 0x7f366c0ca3a0 2023-12-24T20:08:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3658003570 con 0x7f366c0ca3a0 2023-12-24T20:08:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237035634 0 0) 0x7f366c06b520 con 0x7f366c0ca770 2023-12-24T20:08:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366c06ca50 con 0x7f366c0ca770 2023-12-24T20:08:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247191896 0 0) 0x7f3658003570 con 0x7f366c0ca3a0 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 >> v2:172.21.15.82:3300/0 conn(0x7f366c06def0 msgr2=0x7f366c168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 --2- 172.21.15.50:0/3989323874 >> v2:172.21.15.82:3300/0 conn(0x7f366c06def0 0x7f366c168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 >> v1:172.21.15.82:6789/0 conn(0x7f366c0ca770 legacy=0x7f366c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c06b7f0 con 0x7f366c0ca3a0 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f3668001470 con 0x7f366c0ca3a0 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 >> v1:172.21.15.50:6789/0 conn(0x7f366c0ca3a0 legacy=0x7f366c06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658003c20 0x7f3658003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 0x7f3658004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658005210 0x7f365800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365800c180 con 0x7f3658004810 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365800c2f0 con 0x7f3658005210 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365800c4b0 con 0x7f3658003c20 2023-12-24T20:08:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 0x7f3658004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3671fca700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658003c20 0x7f3658003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36727cb700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658005210 0x7f365800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 -- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658003c20 msgr2=0x7f3658003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658003c20 0x7f3658003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 -- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658005210 msgr2=0x7f365800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658005210 0x7f365800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 -- 172.21.15.50:0/3989323874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658003570 con 0x7f3658004810 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36727cb700 1 -- 172.21.15.50:0/3989323874 reap_dead start 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f36717c9700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 0x7f3658004c80 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f365c001a10 tx=0x7f365c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9126c86ccdff396 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00c590 con 0x7f3658004810 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00c6f0 con 0x7f3658004810 2023-12-24T20:08:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.621+0000 7f3670fc8700 1 -- 172.21.15.50:0/3989323874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00ca90 con 0x7f3658004810 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 -- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 msgr2=0x7f3658004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 0x7f3658004c80 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f365c001a10 tx=0x7f365c007d30 comp rx=0 tx=0).stop 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 -- 172.21.15.50:0/3989323874 shutdown_connections 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 --2- 172.21.15.50:0/3989323874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3658004810 0x7f3658004c80 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 -- 172.21.15.50:0/3989323874 >> 172.21.15.50:0/3989323874 conn(0x7f366c0cbba0 msgr2=0x7f366c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 -- 172.21.15.50:0/3989323874 shutdown_connections 2023-12-24T20:08:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 -- 172.21.15.50:0/3989323874 wait complete. 2023-12-24T20:08:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.625+0000 7f367422e700 1 Processor -- start 2023-12-24T20:08:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 -- start start 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 0x7f366c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 0x7f366c161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c161980 con 0x7f366c0c3630 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15b150 con 0x7f366c160fa0 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f367422e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15ebb0 con 0x7f3658004810 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57908/0 (socket says 172.21.15.50:57908) 2023-12-24T20:08:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 -- 172.21.15.50:0/1905445437 learned_addr learned my addr 172.21.15.50:0/1905445437 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f3671fca700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 0x7f366c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36727cb700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 0x7f366c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 -- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 msgr2=0x7f366c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 0x7f366c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 -- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 msgr2=0x7f366c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 0x7f366c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 -- 172.21.15.50:0/1905445437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c15f170 con 0x7f366c0c3630 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f3671fca700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 0x7f366c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36727cb700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 0x7f366c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.629+0000 7f36717c9700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f365800c2c0 tx=0x7f365c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00c590 con 0x7f366c0c3630 2023-12-24T20:08:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00ce40 con 0x7f366c0c3630 2023-12-24T20:08:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c007b10 con 0x7f366c0c3630 2023-12-24T20:08:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c0c4120 con 0x7f366c0c3630 2023-12-24T20:08:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c15ee00 con 0x7f366c0c3630 2023-12-24T20:08:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.633+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c15f300 con 0x7f366c0c3630 2023-12-24T20:08:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.637+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f365c019030 con 0x7f366c0c3630 2023-12-24T20:08:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.637+0000 7f3661ffb700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 0x7f3650062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.637+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f365c07df30 con 0x7f366c0c3630 2023-12-24T20:08:35.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.637+0000 7f3671fca700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 0x7f3650062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:35.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.637+0000 7f3671fca700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 0x7f3650062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36680015a0 tx=0x7f366800a040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.645+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f365c04e4e0 con 0x7f366c0c3630 2023-12-24T20:08:35.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.817+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f366c0652e0 con 0x7f366c0c3630 2023-12-24T20:08:35.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.817+0000 7f3661ffb700 1 -- 172.21.15.50:0/1905445437 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v189) v1 ==== 84+0+65 (secure 0 0 0) 0x7f365c02c060 con 0x7f366c0c3630 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:35.822 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 msgr2=0x7f3650062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 0x7f3650062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36680015a0 tx=0x7f366800a040 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 msgr2=0x7f366c0c3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f365800c2c0 tx=0x7f365c015000 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 shutdown_connections 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3650060550 0x7f3650062a00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c160fa0 0x7f366c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f366c0c3630 0x7f366c0c3aa0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 --2- 172.21.15.50:0/1905445437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3658004810 0x7f366c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 >> 172.21.15.50:0/1905445437 conn(0x7f366c0cbba0 msgr2=0x7f366c0b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 shutdown_connections 2023-12-24T20:08:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:35.821+0000 7f367422e700 1 -- 172.21.15.50:0/1905445437 wait complete. 2023-12-24T20:08:35.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:08:35.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:08:36.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.021+0000 7f3a9b985700 1 Processor -- start 2023-12-24T20:08:36.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.021+0000 7f3a9b985700 1 -- start start 2023-12-24T20:08:36.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9415c3d0 0x7f3a9415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a9415c7a0 0x7f3a940cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a940cb7f0 con 0x7f3a9406bb40 2023-12-24T20:08:36.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9406b6b0 con 0x7f3a9415c3d0 2023-12-24T20:08:36.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a940cba20 con 0x7f3a9415c7a0 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9415c3d0 0x7f3a9415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9415c3d0 0x7f3a9415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57922/0 (socket says 172.21.15.50:57922) 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 -- 172.21.15.50:0/3529101792 learned_addr learned my addr 172.21.15.50:0/3529101792 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a98f20700 1 --2- 172.21.15.50:0/3529101792 >> v2:172.21.15.82:3300/0 conn(0x7f3a9415c7a0 0x7f3a940cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 -- 172.21.15.50:0/3529101792 >> v2:172.21.15.82:3300/0 conn(0x7f3a9415c7a0 msgr2=0x7f3a940cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 --2- 172.21.15.50:0/3529101792 >> v2:172.21.15.82:3300/0 conn(0x7f3a9415c7a0 0x7f3a940cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 -- 172.21.15.50:0/3529101792 >> v1:172.21.15.82:6789/0 conn(0x7f3a9406bb40 legacy=0x7f3a940cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 -- 172.21.15.50:0/3529101792 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9406ad80 con 0x7f3a9415c3d0 2023-12-24T20:08:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a99721700 1 --2- 172.21.15.50:0/3529101792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9415c3d0 0x7f3a9415d810 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f3a940b6190 tx=0x7f3a90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bf53903d117f97 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a8bfff700 1 -- 172.21.15.50:0/3529101792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000b860 con 0x7f3a9415c3d0 2023-12-24T20:08:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a8bfff700 1 -- 172.21.15.50:0/3529101792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000b9c0 con 0x7f3a9415c3d0 2023-12-24T20:08:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a8bfff700 1 -- 172.21.15.50:0/3529101792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000bd60 con 0x7f3a9415c3d0 2023-12-24T20:08:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.025+0000 7f3a9b985700 1 -- 172.21.15.50:0/3529101792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9415c3d0 msgr2=0x7f3a9415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 --2- 172.21.15.50:0/3529101792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9415c3d0 0x7f3a9415d810 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f3a940b6190 tx=0x7f3a90009250 comp rx=0 tx=0).stop 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 -- 172.21.15.50:0/3529101792 shutdown_connections 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 --2- 172.21.15.50:0/3529101792 >> v2:172.21.15.82:3300/0 conn(0x7f3a9415c7a0 0x7f3a940cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 --2- 172.21.15.50:0/3529101792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9415c3d0 0x7f3a9415d810 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 -- 172.21.15.50:0/3529101792 >> 172.21.15.50:0/3529101792 conn(0x7f3a940670b0 msgr2=0x7f3a940674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 -- 172.21.15.50:0/3529101792 shutdown_connections 2023-12-24T20:08:36.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 -- 172.21.15.50:0/3529101792 wait complete. 2023-12-24T20:08:36.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 Processor -- start 2023-12-24T20:08:36.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.029+0000 7f3a9b985700 1 -- start start 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9415c3d0 0x7f3a940b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a9415c7a0 0x7f3a940b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940b3090 con 0x7f3a9406bb40 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940b32e0 con 0x7f3a9415c3d0 2023-12-24T20:08:36.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940b35c0 con 0x7f3a9415c7a0 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57938/0 (socket says 172.21.15.50:57938) 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 -- 172.21.15.50:0/1150976657 learned_addr learned my addr 172.21.15.50:0/1150976657 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a98f20700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9415c3d0 0x7f3a940b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99f22700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a9415c7a0 0x7f3a940b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 -- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a9415c7a0 msgr2=0x7f3a940b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:36.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a9415c7a0 0x7f3a940b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:36.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 -- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9415c3d0 msgr2=0x7f3a940b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:36.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9415c3d0 0x7f3a940b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:36.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 -- 172.21.15.50:0/1150976657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900094f0 con 0x7f3a9406bb40 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a99721700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f3a94068090 tx=0x7f3a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90026450 con 0x7f3a9406bb40 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a900265b0 con 0x7f3a9406bb40 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a940b38a0 con 0x7f3a9406bb40 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90026970 con 0x7f3a9406bb40 2023-12-24T20:08:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.033+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940cb0b0 con 0x7f3a9406bb40 2023-12-24T20:08:36.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.037+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94071060 con 0x7f3a9406bb40 2023-12-24T20:08:36.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.037+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3a900303f0 con 0x7f3a9406bb40 2023-12-24T20:08:36.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.037+0000 7f3a897fa700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 0x7f3a78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:36.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.037+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3a9007e330 con 0x7f3a9406bb40 2023-12-24T20:08:36.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.041+0000 7f3a98f20700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 0x7f3a78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:36.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.041+0000 7f3a98f20700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 0x7f3a78062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a9415fe80 tx=0x7f3a84008040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:36.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.045+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3a9004e980 con 0x7f3a9406bb40 2023-12-24T20:08:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:36.225+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3a9406a930 con 0x7f3a9406bb40 2023-12-24T20:08:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.201+0000 7f3a897fa700 1 -- 172.21.15.50:0/1150976657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v190) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3a90051fa0 con 0x7f3a9406bb40 2023-12-24T20:08:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.205+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 msgr2=0x7f3a78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.205+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 0x7f3a78062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a9415fe80 tx=0x7f3a84008040 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.205+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 msgr2=0x7f3a9416da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.205+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f3a94068090 tx=0x7f3a90017000 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 shutdown_connections 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3a78060550 0x7f3a78062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a9415c7a0 0x7f3a940b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9415c3d0 0x7f3a940b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 --2- 172.21.15.50:0/1150976657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9406bb40 0x7f3a9416da00 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 >> 172.21.15.50:0/1150976657 conn(0x7f3a940670b0 msgr2=0x7f3a9415b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 shutdown_connections 2023-12-24T20:08:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.209+0000 7f3a9b985700 1 -- 172.21.15.50:0/1150976657 wait complete. 2023-12-24T20:08:37.218 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T20:08:37.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:08:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.409+0000 7f07c3345700 1 Processor -- start 2023-12-24T20:08:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.409+0000 7f07c3345700 1 -- start start 2023-12-24T20:08:37.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c3345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07bc160720 0x7f07bc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c3345700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc15e960 con 0x7f07bc06ae10 2023-12-24T20:08:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c3345700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc1600a0 con 0x7f07bc160af0 2023-12-24T20:08:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c3345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc15dd50 con 0x7f07bc160720 2023-12-24T20:08:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f07bc06ae10 0x7f07bc15edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53194/0 (socket says 172.21.15.50:53194) 2023-12-24T20:08:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 -- 172.21.15.50:0/756916995 learned_addr learned my addr 172.21.15.50:0/756916995 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c10e1700 1 --2- 172.21.15.50:0/756916995 >> v2:172.21.15.82:3300/0 conn(0x7f07bc160720 0x7f07bc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103336697 0 0) 0x7f07bc15e960 con 0x7f07bc06ae10 2023-12-24T20:08:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a8003570 con 0x7f07bc06ae10 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924489112 0 0) 0x7f07a8003570 con 0x7f07bc06ae10 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 >> v2:172.21.15.82:3300/0 conn(0x7f07bc160720 msgr2=0x7f07bc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 --2- 172.21.15.50:0/756916995 >> v2:172.21.15.82:3300/0 conn(0x7f07bc160720 0x7f07bc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 >> v1:172.21.15.82:6789/0 conn(0x7f07bc160af0 legacy=0x7f07bc06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc15e030 con 0x7f07bc06ae10 2023-12-24T20:08:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f07b40017f0 con 0x7f07bc06ae10 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 >> v1:172.21.15.50:6789/0 conn(0x7f07bc06ae10 legacy=0x7f07bc15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07a8003a60 0x7f07a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a8004810 0x7f07a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 0x7f07a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc15dd50 con 0x7f07a80051c0 2023-12-24T20:08:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a800c160 con 0x7f07a8003a60 2023-12-24T20:08:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a800c320 con 0x7f07a8004810 2023-12-24T20:08:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 0x7f07a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c10e1700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07a8003a60 0x7f07a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 -- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a8004810 msgr2=0x7f07a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a8004810 0x7f07a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 -- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07a8003a60 msgr2=0x7f07a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07a8003a60 0x7f07a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c18e2700 1 -- 172.21.15.50:0/756916995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8003570 con 0x7f07a80051c0 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c18e2700 1 -- 172.21.15.50:0/756916995 reap_dead start 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.413+0000 7f07c10e1700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07a8003a60 0x7f07a8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c18e2700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 0x7f07a800ba60 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f07b400a930 tx=0x7f07b40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb483a3eb8cc191 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40070d0 con 0x7f07a80051c0 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4007230 con 0x7f07a80051c0 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07b3fff700 1 -- 172.21.15.50:0/756916995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40075d0 con 0x7f07a80051c0 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 -- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 msgr2=0x7f07a800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 0x7f07a800ba60 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f07b400a930 tx=0x7f07b40021d0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 -- 172.21.15.50:0/756916995 shutdown_connections 2023-12-24T20:08:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 --2- 172.21.15.50:0/756916995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07a80051c0 0x7f07a800ba60 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 -- 172.21.15.50:0/756916995 >> 172.21.15.50:0/756916995 conn(0x7f07bc067b80 msgr2=0x7f07bc0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:37.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 -- 172.21.15.50:0/756916995 shutdown_connections 2023-12-24T20:08:37.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.417+0000 7f07c3345700 1 -- 172.21.15.50:0/756916995 wait complete. 2023-12-24T20:08:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 Processor -- start 2023-12-24T20:08:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 -- start start 2023-12-24T20:08:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a80051c0 0x7f07bc0c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07bc0c3ee0 0x7f07bc14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0c5790 con 0x7f07bc0ca510 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0ca9d0 con 0x7f07bc0c3ee0 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c3345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0cacb0 con 0x7f07a80051c0 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c18e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c18e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57956/0 (socket says 172.21.15.50:57956) 2023-12-24T20:08:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c18e2700 1 -- 172.21.15.50:0/2847172765 learned_addr learned my addr 172.21.15.50:0/2847172765 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c10e1700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a80051c0 0x7f07bc0c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.421+0000 7f07c08e0700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07bc0c3ee0 0x7f07bc14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 -- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a80051c0 msgr2=0x7f07bc0c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a80051c0 0x7f07bc0c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 -- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07bc0c3ee0 msgr2=0x7f07bc14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07bc0c3ee0 0x7f07bc14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 -- 172.21.15.50:0/2847172765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0caf90 con 0x7f07bc0ca510 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c18e2700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000f80 tx=0x7f07b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40070d0 con 0x7f07bc0ca510 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b40017b0 con 0x7f07bc0ca510 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b401e890 con 0x7f07bc0ca510 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc0cb270 con 0x7f07bc0ca510 2023-12-24T20:08:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc0c5e90 con 0x7f07bc0ca510 2023-12-24T20:08:37.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.425+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc0652e0 con 0x7f07bc0ca510 2023-12-24T20:08:37.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.429+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f07b401ecc0 con 0x7f07bc0ca510 2023-12-24T20:08:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.429+0000 7f07b17fa700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 0x7f07a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.429+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f07b407f8d0 con 0x7f07bc0ca510 2023-12-24T20:08:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.433+0000 7f07c10e1700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 0x7f07a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.433+0000 7f07c10e1700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 0x7f07a0062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009170 tx=0x7f07b8008040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.437+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07b404fdb0 con 0x7f07bc0ca510 2023-12-24T20:08:37.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:37.613+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07bc15e310 con 0x7f07bc0ca510 2023-12-24T20:08:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.221+0000 7f07b17fa700 1 -- 172.21.15.50:0/2847172765 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v191) v1 ==== 170+0+0 (secure 0 0 0) 0x7f07b40533d0 con 0x7f07bc0ca510 2023-12-24T20:08:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.229+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 msgr2=0x7f07a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.229+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 0x7f07a0062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009170 tx=0x7f07b8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.229+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 msgr2=0x7f07bc14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.229+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000f80 tx=0x7f07b4016000 comp rx=0 tx=0).stop 2023-12-24T20:08:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 shutdown_connections 2023-12-24T20:08:38.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f07a0060550 0x7f07a0062a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc0ca510 0x7f07bc14df20 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07bc0c3ee0 0x7f07bc14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 --2- 172.21.15.50:0/2847172765 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07a80051c0 0x7f07bc0c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 >> 172.21.15.50:0/2847172765 conn(0x7f07bc067b80 msgr2=0x7f07bc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:38.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 shutdown_connections 2023-12-24T20:08:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.237+0000 7f07c3345700 1 -- 172.21.15.50:0/2847172765 wait complete. 2023-12-24T20:08:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T20:08:38.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:08:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 Processor -- start 2023-12-24T20:08:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 -- start start 2023-12-24T20:08:38.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 0x7febe415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40ab1b0 con 0x7febe40672e0 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe406a840 con 0x7febe415d420 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe95c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe406a630 con 0x7febe40676b0 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7febe40672e0 0x7febe40aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53206/0 (socket says 172.21.15.50:53206) 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febe2ffd700 1 -- 172.21.15.50:0/4108803988 learned_addr learned my addr 172.21.15.50:0/4108803988 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.437+0000 7febda7fc700 1 --2- 172.21.15.50:0/4108803988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 0x7febe415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febda7fc700 1 -- 172.21.15.50:0/4108803988 >> v1:172.21.15.82:6789/0 conn(0x7febe415d420 legacy=0x7febe4161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe27fc700 1 -- 172.21.15.50:0/4108803988 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131146494 0 0) 0x7febe406a840 con 0x7febe415d420 2023-12-24T20:08:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febda7fc700 1 -- 172.21.15.50:0/4108803988 >> v1:172.21.15.50:6789/0 conn(0x7febe40672e0 legacy=0x7febe40aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febda7fc700 1 -- 172.21.15.50:0/4108803988 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe406ab20 con 0x7febe40676b0 2023-12-24T20:08:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febda7fc700 1 --2- 172.21.15.50:0/4108803988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 0x7febe415cee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e90 tx=0x7febcc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697e9aefc7e30c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe27fc700 1 -- 172.21.15.50:0/4108803988 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc00e070 con 0x7febe40676b0 2023-12-24T20:08:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe27fc700 1 -- 172.21.15.50:0/4108803988 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc00bb30 con 0x7febe40676b0 2023-12-24T20:08:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe27fc700 1 -- 172.21.15.50:0/4108803988 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc012430 con 0x7febe40676b0 2023-12-24T20:08:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 -- 172.21.15.50:0/4108803988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 msgr2=0x7febe415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 --2- 172.21.15.50:0/4108803988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 0x7febe415cee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e90 tx=0x7febcc009780 comp rx=0 tx=0).stop 2023-12-24T20:08:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 -- 172.21.15.50:0/4108803988 shutdown_connections 2023-12-24T20:08:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 --2- 172.21.15.50:0/4108803988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe40676b0 0x7febe415cee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 -- 172.21.15.50:0/4108803988 >> 172.21.15.50:0/4108803988 conn(0x7febe40cba30 msgr2=0x7febe40cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 -- 172.21.15.50:0/4108803988 shutdown_connections 2023-12-24T20:08:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.441+0000 7febe95c5700 1 -- 172.21.15.50:0/4108803988 wait complete. 2023-12-24T20:08:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 Processor -- start 2023-12-24T20:08:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 -- start start 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe40676b0 0x7febe4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe415d420 0x7febe4151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4152310 con 0x7febe40672e0 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4153c10 con 0x7febe40676b0 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe95c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe4153790 con 0x7febe415d420 2023-12-24T20:08:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.445+0000 7febe2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57972/0 (socket says 172.21.15.50:57972) 2023-12-24T20:08:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 -- 172.21.15.50:0/2408861565 learned_addr learned my addr 172.21.15.50:0/2408861565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febda7fc700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe40676b0 0x7febe4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe37fe700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe415d420 0x7febe4151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 -- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe415d420 msgr2=0x7febe4151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe415d420 0x7febe4151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 -- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe40676b0 msgr2=0x7febe4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe40676b0 0x7febe4151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 -- 172.21.15.50:0/2408861565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009a20 con 0x7febe40672e0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe2ffd700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7febd400c840 tx=0x7febd4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4005b30 con 0x7febe40672e0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4005cb0 con 0x7febe40672e0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4007320 con 0x7febe40672e0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4152500 con 0x7febe40672e0 2023-12-24T20:08:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.449+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4153e60 con 0x7febe40672e0 2023-12-24T20:08:38.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.453+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe4154050 con 0x7febe40672e0 2023-12-24T20:08:38.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.453+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7febd401b3b0 con 0x7febe40672e0 2023-12-24T20:08:38.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.457+0000 7febdb7fe700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 0x7febc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.457+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6357+0+0 (secure 0 0 0) 0x7febd407c2d0 con 0x7febe40672e0 2023-12-24T20:08:38.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.457+0000 7febda7fc700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 0x7febc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.457+0000 7febda7fc700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 0x7febc4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febcc0097c0 tx=0x7febcc018000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.461+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7febd404c6b0 con 0x7febe40672e0 2023-12-24T20:08:38.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:38.673+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7febe404be40 con 0x7febe40672e0 2023-12-24T20:08:39.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.249+0000 7febdb7fe700 1 -- 172.21.15.50:0/2408861565 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v91) v1 ==== 174+0+0 (secure 0 0 0) 0x7febd40170c0 con 0x7febe40672e0 2023-12-24T20:08:39.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.261+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 msgr2=0x7febc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.261+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 0x7febc4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febcc0097c0 tx=0x7febcc018000 comp rx=0 tx=0).stop 2023-12-24T20:08:39.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.261+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 msgr2=0x7febe415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.261+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7febd400c840 tx=0x7febd4007ef0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 shutdown_connections 2023-12-24T20:08:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7febc4060550 0x7febc4062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7febe415d420 0x7febe4151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe40676b0 0x7febe4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 --2- 172.21.15.50:0/2408861565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febe40672e0 0x7febe415bf50 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 >> 172.21.15.50:0/2408861565 conn(0x7febe40cba30 msgr2=0x7febe41599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 shutdown_connections 2023-12-24T20:08:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.265+0000 7febe95c5700 1 -- 172.21.15.50:0/2408861565 wait complete. 2023-12-24T20:08:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 23 and data pool 24 2023-12-24T20:08:39.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:39.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 Processor -- start 2023-12-24T20:08:39.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 -- start start 2023-12-24T20:08:39.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 0x7f488c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f488c154450 0x7f488c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c06c820 con 0x7f488c06aca0 2023-12-24T20:08:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c154e10 con 0x7f488c154450 2023-12-24T20:08:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f4891f85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c06b960 con 0x7f488c0c6d00 2023-12-24T20:08:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f488affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f488c154450 0x7f488c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f488affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f488c154450 0x7f488c1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46012/0 (socket says 172.21.15.50:46012) 2023-12-24T20:08:39.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f488affd700 1 -- 172.21.15.50:0/3594354536 learned_addr learned my addr 172.21.15.50:0/3594354536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:39.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.461+0000 7f488bfff700 1 --1- 172.21.15.50:0/3594354536 >> v1:172.21.15.50:6789/0 conn(0x7f488c06aca0 0x7f488c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35692/0 (socket says 172.21.15.50:35692) 2023-12-24T20:08:39.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488b7fe700 1 --2- 172.21.15.50:0/3594354536 >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 0x7f488c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488affd700 1 -- 172.21.15.50:0/3594354536 >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 msgr2=0x7f488c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488affd700 1 --2- 172.21.15.50:0/3594354536 >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 0x7f488c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488affd700 1 -- 172.21.15.50:0/3594354536 >> v1:172.21.15.50:6789/0 conn(0x7f488c06aca0 legacy=0x7f488c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488affd700 1 -- 172.21.15.50:0/3594354536 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c06bc40 con 0x7f488c154450 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488b7fe700 1 --2- 172.21.15.50:0/3594354536 >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 0x7f488c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488affd700 1 --2- 172.21.15.50:0/3594354536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1548d0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01cc1d9ff860d63 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488a7fc700 1 -- 172.21.15.50:0/3594354536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000b820 con 0x7f488c154450 2023-12-24T20:08:39.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488a7fc700 1 -- 172.21.15.50:0/3594354536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000b980 con 0x7f488c154450 2023-12-24T20:08:39.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f488a7fc700 1 -- 172.21.15.50:0/3594354536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000bd20 con 0x7f488c154450 2023-12-24T20:08:39.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 -- 172.21.15.50:0/3594354536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 msgr2=0x7f488c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 --2- 172.21.15.50:0/3594354536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1548d0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).stop 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 -- 172.21.15.50:0/3594354536 shutdown_connections 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 --2- 172.21.15.50:0/3594354536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1548d0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 --2- 172.21.15.50:0/3594354536 >> v2:172.21.15.82:3300/0 conn(0x7f488c0c6d00 0x7f488c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 -- 172.21.15.50:0/3594354536 >> 172.21.15.50:0/3594354536 conn(0x7f488c0cbba0 msgr2=0x7f488c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 -- 172.21.15.50:0/3594354536 shutdown_connections 2023-12-24T20:08:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.465+0000 7f4891f85700 1 -- 172.21.15.50:0/3594354536 wait complete. 2023-12-24T20:08:39.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.469+0000 7f4891f85700 1 Processor -- start 2023-12-24T20:08:39.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.469+0000 7f4891f85700 1 -- start start 2023-12-24T20:08:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 0x7f488c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c0c6d00 0x7f488c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c4250 con 0x7f488c154450 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c4af0 con 0x7f488c0c6d00 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0b1560 con 0x7f488c06aca0 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46026/0 (socket says 172.21.15.50:46026) 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 -- 172.21.15.50:0/2555924938 learned_addr learned my addr 172.21.15.50:0/2555924938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488affd700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c0c6d00 0x7f488c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488b7fe700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 0x7f488c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 -- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 msgr2=0x7f488c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 0x7f488c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 -- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c0c6d00 msgr2=0x7f488c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c0c6d00 0x7f488c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 -- 172.21.15.50:0/2555924938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800094f0 con 0x7f488c154450 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488b7fe700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 0x7f488c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f488bfff700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f488400cd00 tx=0x7f4884001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400ce60 con 0x7f488c154450 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884005df0 con 0x7f488c154450 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400abb0 con 0x7f488c154450 2023-12-24T20:08:39.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c0b1800 con 0x7f488c154450 2023-12-24T20:08:39.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.473+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c0c4780 con 0x7f488c154450 2023-12-24T20:08:39.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.477+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c06c9d0 con 0x7f488c154450 2023-12-24T20:08:39.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.477+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f48840070f0 con 0x7f488c154450 2023-12-24T20:08:39.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.481+0000 7f48737fe700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 0x7f4878062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.481+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f488407cc30 con 0x7f488c154450 2023-12-24T20:08:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.481+0000 7f488b7fe700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 0x7f4878062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.481+0000 7f488b7fe700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 0x7f4878062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f487c006f00 tx=0x7f487c008040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.485+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f488c06c9d0 con 0x7f488c154450 2023-12-24T20:08:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.665+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488c06c9d0 con 0x7f488c154450 2023-12-24T20:08:39.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.665+0000 7f48737fe700 1 -- 172.21.15.50:0/2555924938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16197 (secure 0 0 0) 0x7f488c06c9d0 con 0x7f488c154450 2023-12-24T20:08:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:39.670 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":192,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:38.679339+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 msgr2=0x7f4878062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 0x7f4878062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f487c006f00 tx=0x7f487c008040 comp rx=0 tx=0).stop 2023-12-24T20:08:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 msgr2=0x7f488c1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f488400cd00 tx=0x7f4884001b10 comp rx=0 tx=0).stop 2023-12-24T20:08:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 shutdown_connections 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4878060550 0x7f4878062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f488c154450 0x7f488c1555d0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c0c6d00 0x7f488c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 --2- 172.21.15.50:0/2555924938 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f488c06aca0 0x7f488c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 >> 172.21.15.50:0/2555924938 conn(0x7f488c0cbba0 msgr2=0x7f488c06b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 shutdown_connections 2023-12-24T20:08:39.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.669+0000 7f4891f85700 1 -- 172.21.15.50:0/2555924938 wait complete. 2023-12-24T20:08:39.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 Processor -- start 2023-12-24T20:08:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 -- start start 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d6c0ca3a0 0x7f3d6c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d6c06ae10 0x7f3d6c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c06ca50 con 0x7f3d6c06b290 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0c6980 con 0x7f3d6c06ae10 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d71945700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c06b7f0 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d63fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d6c06ae10 0x7f3d6c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d6b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d6c06b290 0x7f3d6c160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35698/0 (socket says 172.21.15.50:35698) 2023-12-24T20:08:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d6b7fe700 1 -- 172.21.15.50:0/2150816638 learned_addr learned my addr 172.21.15.50:0/2150816638 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.869+0000 7f3d6affd700 1 --2- 172.21.15.50:0/2150816638 >> v2:172.21.15.82:3300/0 conn(0x7f3d6c0ca3a0 0x7f3d6c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d63fff700 1 -- 172.21.15.50:0/2150816638 >> v2:172.21.15.82:3300/0 conn(0x7f3d6c0ca3a0 msgr2=0x7f3d6c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d63fff700 1 --2- 172.21.15.50:0/2150816638 >> v2:172.21.15.82:3300/0 conn(0x7f3d6c0ca3a0 0x7f3d6c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d63fff700 1 -- 172.21.15.50:0/2150816638 >> v1:172.21.15.50:6789/0 conn(0x7f3d6c06b290 legacy=0x7f3d6c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d63fff700 1 -- 172.21.15.50:0/2150816638 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c06bad0 con 0x7f3d6c06ae10 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d63fff700 1 --2- 172.21.15.50:0/2150816638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15aa50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c069ce0 tx=0x7f3d540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b55fd404797ed9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d6a7fc700 1 -- 172.21.15.50:0/2150816638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54011630 con 0x7f3d6c06ae10 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d6a7fc700 1 -- 172.21.15.50:0/2150816638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54011790 con 0x7f3d6c06ae10 2023-12-24T20:08:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d6a7fc700 1 -- 172.21.15.50:0/2150816638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54011b30 con 0x7f3d6c06ae10 2023-12-24T20:08:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 -- 172.21.15.50:0/2150816638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c06ae10 msgr2=0x7f3d6c15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 --2- 172.21.15.50:0/2150816638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15aa50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c069ce0 tx=0x7f3d540091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 -- 172.21.15.50:0/2150816638 shutdown_connections 2023-12-24T20:08:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 --2- 172.21.15.50:0/2150816638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15aa50 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 --2- 172.21.15.50:0/2150816638 >> v2:172.21.15.82:3300/0 conn(0x7f3d6c0ca3a0 0x7f3d6c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 -- 172.21.15.50:0/2150816638 >> 172.21.15.50:0/2150816638 conn(0x7f3d6c0cbba0 msgr2=0x7f3d6c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 -- 172.21.15.50:0/2150816638 shutdown_connections 2023-12-24T20:08:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.873+0000 7f3d71945700 1 -- 172.21.15.50:0/2150816638 wait complete. 2023-12-24T20:08:39.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 Processor -- start 2023-12-24T20:08:39.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 -- start start 2023-12-24T20:08:39.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d6c06b290 0x7f3d6c16d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15b340 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15d710 con 0x7f3d6c06ae10 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d71945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15b5c0 con 0x7f3d6c06b290 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46040/0 (socket says 172.21.15.50:46040) 2023-12-24T20:08:39.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48066/0 (socket says 172.21.15.50:48066) 2023-12-24T20:08:39.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d6b7fe700 1 -- 172.21.15.50:0/2539130826 learned_addr learned my addr 172.21.15.50:0/2539130826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:39.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.877+0000 7f3d63fff700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d6c06b290 0x7f3d6c16d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 -- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d6c06b290 msgr2=0x7f3d6c16d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d6c06b290 0x7f3d6c16d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 -- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 msgr2=0x7f3d6c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 -- 172.21.15.50:0/2539130826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009420 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d6b7fe700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400cc40 tx=0x7f3d64001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400a8b0 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400aa10 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400add0 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c15b8a0 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c15be60 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.881+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c06cc00 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.885+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3d64007300 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.885+0000 7f3d62ffd700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 0x7f3d4c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.885+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f3d6407ce50 con 0x7f3d6c0ca3a0 2023-12-24T20:08:39.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.885+0000 7f3d6affd700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 0x7f3d4c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.885+0000 7f3d6affd700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 0x7f3d4c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c152830 tx=0x7f3d5c0091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:39.893+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d6c06cc00 con 0x7f3d6c0ca3a0 2023-12-24T20:08:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.065+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d6c06cc00 con 0x7f3d6c0ca3a0 2023-12-24T20:08:40.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.065+0000 7f3d62ffd700 1 -- 172.21.15.50:0/2539130826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16197 (secure 0 0 0) 0x7f3d6c06cc00 con 0x7f3d6c0ca3a0 2023-12-24T20:08:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:40.070 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":192,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:38.679339+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 msgr2=0x7f3d4c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 0x7f3d4c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c152830 tx=0x7f3d5c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 msgr2=0x7f3d6c16da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400cc40 tx=0x7f3d64001a50 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 shutdown_connections 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3d4c060550 0x7f3d4c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d6c0ca3a0 0x7f3d6c16da90 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d6c06b290 0x7f3d6c16d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 --2- 172.21.15.50:0/2539130826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c06ae10 0x7f3d6c15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 >> 172.21.15.50:0/2539130826 conn(0x7f3d6c0cbba0 msgr2=0x7f3d6c0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 shutdown_connections 2023-12-24T20:08:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.069+0000 7f3d71945700 1 -- 172.21.15.50:0/2539130826 wait complete. 2023-12-24T20:08:40.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:08:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.269+0000 7ff67359e700 1 Processor -- start 2023-12-24T20:08:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.269+0000 7ff67359e700 1 -- start start 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff6740cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 0x7ff67406cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740cd380 con 0x7ff67406d130 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740cc770 con 0x7ff6740cc210 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740cca50 con 0x7ff67406c820 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff672d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff67406d130 0x7ff6740ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35708/0 (socket says 172.21.15.50:35708) 2023-12-24T20:08:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff672d9d700 1 -- 172.21.15.50:0/2197268363 learned_addr learned my addr 172.21.15.50:0/2197268363 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 --2- 172.21.15.50:0/2197268363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff6740cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff671d9b700 1 --2- 172.21.15.50:0/2197268363 >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 0x7ff67406cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67159a700 1 -- 172.21.15.50:0/2197268363 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135723100 0 0) 0x7ff6740cd380 con 0x7ff67406d130 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67159a700 1 -- 172.21.15.50:0/2197268363 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff65c003570 con 0x7ff67406d130 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 -- 172.21.15.50:0/2197268363 >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 msgr2=0x7ff67406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 --2- 172.21.15.50:0/2197268363 >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 0x7ff67406cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 -- 172.21.15.50:0/2197268363 >> v1:172.21.15.50:6789/0 conn(0x7ff67406d130 legacy=0x7ff6740ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 -- 172.21.15.50:0/2197268363 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740ccd30 con 0x7ff67406c820 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff671d9b700 1 --2- 172.21.15.50:0/2197268363 >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 0x7ff67406cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67259c700 1 --2- 172.21.15.50:0/2197268363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff6740cbcd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6640098e0 tx=0x7ff6640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9b352f7d16015b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67159a700 1 -- 172.21.15.50:0/2197268363 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011630 con 0x7ff67406c820 2023-12-24T20:08:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67159a700 1 -- 172.21.15.50:0/2197268363 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664011790 con 0x7ff67406c820 2023-12-24T20:08:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67159a700 1 -- 172.21.15.50:0/2197268363 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011b30 con 0x7ff67406c820 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- 172.21.15.50:0/2197268363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 msgr2=0x7ff6740cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 --2- 172.21.15.50:0/2197268363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff6740cbcd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6640098e0 tx=0x7ff6640091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- 172.21.15.50:0/2197268363 shutdown_connections 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 --2- 172.21.15.50:0/2197268363 >> v2:172.21.15.82:3300/0 conn(0x7ff6740cc210 0x7ff67406cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 --2- 172.21.15.50:0/2197268363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff6740cbcd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- 172.21.15.50:0/2197268363 >> 172.21.15.50:0/2197268363 conn(0x7ff6740ca600 msgr2=0x7ff6740caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- 172.21.15.50:0/2197268363 shutdown_connections 2023-12-24T20:08:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.273+0000 7ff67359e700 1 -- 172.21.15.50:0/2197268363 wait complete. 2023-12-24T20:08:40.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 Processor -- start 2023-12-24T20:08:40.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 -- start start 2023-12-24T20:08:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff67414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6740cc210 0x7ff67416c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67414f9c0 con 0x7ff67406d130 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741539c0 con 0x7ff6740cc210 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67359e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67416cf90 con 0x7ff67406c820 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff671d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff671d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46044/0 (socket says 172.21.15.50:46044) 2023-12-24T20:08:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff671d9b700 1 -- 172.21.15.50:0/229248741 learned_addr learned my addr 172.21.15.50:0/229248741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff67259c700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff67414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.277+0000 7ff672d9d700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6740cc210 0x7ff67416c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 -- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 msgr2=0x7ff67414f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff67414f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 -- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6740cc210 msgr2=0x7ff67416c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6740cc210 0x7ff67416c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 -- 172.21.15.50:0/229248741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668009420 con 0x7ff67406d130 2023-12-24T20:08:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff67259c700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff67414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff671d9b700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ec80 tx=0x7ff6680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800c9d0 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66800cb30 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800ceb0 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff664009420 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff674153650 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67404be40 con 0x7ff67406d130 2023-12-24T20:08:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.281+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff668013680 con 0x7ff67406d130 2023-12-24T20:08:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.285+0000 7ff6627fc700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 0x7ff654062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.285+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7ff66807cdf0 con 0x7ff67406d130 2023-12-24T20:08:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.285+0000 7ff67259c700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 0x7ff654062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.285+0000 7ff67259c700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 0x7ff654062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6640091e0 tx=0x7ff664017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.293+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff66804d0f0 con 0x7ff67406d130 2023-12-24T20:08:40.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:40.497+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff6740cd010 con 0x7ff67406d130 2023-12-24T20:08:41.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.261+0000 7ff6627fc700 1 -- 172.21.15.50:0/229248741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff668050710 con 0x7ff67406d130 2023-12-24T20:08:41.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 msgr2=0x7ff654062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 0x7ff654062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6640091e0 tx=0x7ff664017000 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 msgr2=0x7ff6740675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ec80 tx=0x7ff6680091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 shutdown_connections 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff654060580 0x7ff654062a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6740cc210 0x7ff67416c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d130 0x7ff6740675f0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 --2- 172.21.15.50:0/229248741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff67406c820 0x7ff67414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.265+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 >> 172.21.15.50:0/229248741 conn(0x7ff6740ca600 msgr2=0x7ff674152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.269+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 shutdown_connections 2023-12-24T20:08:41.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.269+0000 7ff67359e700 1 -- 172.21.15.50:0/229248741 wait complete. 2023-12-24T20:08:41.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:08:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.465+0000 7fe93d42e700 1 Processor -- start 2023-12-24T20:08:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.465+0000 7fe93d42e700 1 -- start start 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe93d42e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe93806b220 0x7fe9380cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe93d42e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9380ccac0 0x7fe93815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe93d42e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9380ccf40 con 0x7fe938158ab0 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe93d42e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93806a530 con 0x7fe93806b220 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe93d42e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815d8d0 con 0x7fe9380ccac0 2023-12-24T20:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe93806b220 0x7fe9380cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe93806b220 0x7fe9380cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46054/0 (socket says 172.21.15.50:46054) 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 -- 172.21.15.50:0/982123621 learned_addr learned my addr 172.21.15.50:0/982123621 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe936ffd700 1 --1- 172.21.15.50:0/982123621 >> v1:172.21.15.50:6789/0 conn(0x7fe938158ab0 0x7fe938158e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35724/0 (socket says 172.21.15.50:35724) 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe9377fe700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9380ccac0 0x7fe93815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 -- 172.21.15.50:0/982123621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9380ccac0 msgr2=0x7fe93815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9380ccac0 0x7fe93815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 -- 172.21.15.50:0/982123621 >> v1:172.21.15.50:6789/0 conn(0x7fe938158ab0 legacy=0x7fe938158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 -- 172.21.15.50:0/982123621 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93806a740 con 0x7fe93806b220 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe92e7fc700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe93806b220 0x7fe9380cc580 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fe920009f50 tx=0x7fe920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44cee955c56f262 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe9367fc700 1 -- 172.21.15.50:0/982123621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000e070 con 0x7fe93806b220 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe9367fc700 1 -- 172.21.15.50:0/982123621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000b9c0 con 0x7fe93806b220 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.469+0000 7fe9367fc700 1 -- 172.21.15.50:0/982123621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200092e0 con 0x7fe93806b220 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 -- 172.21.15.50:0/982123621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe93806b220 msgr2=0x7fe9380cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe93806b220 0x7fe9380cc580 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fe920009f50 tx=0x7fe920009840 comp rx=0 tx=0).stop 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 -- 172.21.15.50:0/982123621 shutdown_connections 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9380ccac0 0x7fe93815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 --2- 172.21.15.50:0/982123621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe93806b220 0x7fe9380cc580 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 -- 172.21.15.50:0/982123621 >> 172.21.15.50:0/982123621 conn(0x7fe9380670b0 msgr2=0x7fe9380674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 -- 172.21.15.50:0/982123621 shutdown_connections 2023-12-24T20:08:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.473+0000 7fe93d42e700 1 -- 172.21.15.50:0/982123621 wait complete. 2023-12-24T20:08:41.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 Processor -- start 2023-12-24T20:08:41.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 -- start start 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe93806b220 0x7fe938156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe938158ab0 0x7fe9380b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380c59c0 con 0x7fe9380ccac0 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380c5e50 con 0x7fe938158ab0 2023-12-24T20:08:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe93d42e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380c4db0 con 0x7fe93806b220 2023-12-24T20:08:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46068/0 (socket says 172.21.15.50:46068) 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 -- 172.21.15.50:0/698903663 learned_addr learned my addr 172.21.15.50:0/698903663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe9377fe700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe938158ab0 0x7fe9380b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe936ffd700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe93806b220 0x7fe938156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 -- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe93806b220 msgr2=0x7fe938156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe93806b220 0x7fe938156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 -- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe938158ab0 msgr2=0x7fe9380b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe938158ab0 0x7fe9380b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.477+0000 7fe92e7fc700 1 -- 172.21.15.50:0/698903663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009ae0 con 0x7fe9380ccac0 2023-12-24T20:08:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe92e7fc700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fe920012000 tx=0x7fe920018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200089e0 con 0x7fe9380ccac0 2023-12-24T20:08:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920008b60 con 0x7fe9380ccac0 2023-12-24T20:08:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9380c5090 con 0x7fe9380ccac0 2023-12-24T20:08:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920026460 con 0x7fe9380ccac0 2023-12-24T20:08:41.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9380c5650 con 0x7fe9380ccac0 2023-12-24T20:08:41.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9380c5b70 con 0x7fe9380ccac0 2023-12-24T20:08:41.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.481+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe920003040 con 0x7fe9380ccac0 2023-12-24T20:08:41.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.485+0000 7fe92f7fe700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 0x7fe918062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:41.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.485+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7fe92007e860 con 0x7fe9380ccac0 2023-12-24T20:08:41.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.485+0000 7fe936ffd700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 0x7fe918062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:41.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.485+0000 7fe936ffd700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 0x7fe918062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe928005f80 tx=0x7fe928007ce0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.493+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe9380c5b70 con 0x7fe9380ccac0 2023-12-24T20:08:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:41.709+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe93804be40 con 0x7fe9380ccac0 2023-12-24T20:08:42.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.273+0000 7fe92f7fe700 1 -- 172.21.15.50:0/698903663 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe92004ec10 con 0x7fe9380ccac0 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 msgr2=0x7fe918062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 0x7fe918062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe928005f80 tx=0x7fe928007ce0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 msgr2=0x7fe9380c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fe920012000 tx=0x7fe920018000 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 shutdown_connections 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe918060550 0x7fe918062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe938158ab0 0x7fe9380b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9380ccac0 0x7fe9380c91b0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 --2- 172.21.15.50:0/698903663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe93806b220 0x7fe938156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 >> 172.21.15.50:0/698903663 conn(0x7fe9380670b0 msgr2=0x7fe9381582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 shutdown_connections 2023-12-24T20:08:42.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.277+0000 7fe93d42e700 1 -- 172.21.15.50:0/698903663 wait complete. 2023-12-24T20:08:42.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 Processor -- start 2023-12-24T20:08:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 -- start start 2023-12-24T20:08:42.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f960c06bce0 0x7f960c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c06b850 con 0x7f960c159bc0 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c06ac40 con 0x7f960c06bce0 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f96130cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c06af20 con 0x7f960c0ab040 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f961166a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f9603fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f960c06bce0 0x7f960c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f961166a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43726/0 (socket says 172.21.15.50:43726) 2023-12-24T20:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.469+0000 7f961166a700 1 -- 172.21.15.50:0/3191430486 learned_addr learned my addr 172.21.15.50:0/3191430486 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f961166a700 1 -- 172.21.15.50:0/3191430486 >> v2:172.21.15.82:3300/0 conn(0x7f960c06bce0 msgr2=0x7f960c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f961166a700 1 --2- 172.21.15.50:0/3191430486 >> v2:172.21.15.82:3300/0 conn(0x7f960c06bce0 0x7f960c0aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f961166a700 1 -- 172.21.15.50:0/3191430486 >> v1:172.21.15.82:6789/0 conn(0x7f960c159bc0 legacy=0x7f960c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f961166a700 1 -- 172.21.15.50:0/3191430486 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c06b200 con 0x7f960c0ab040 2023-12-24T20:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f961166a700 1 --2- 172.21.15.50:0/3191430486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9604009f20 tx=0x7f9604009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252f3275e6775fe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96037fe700 1 -- 172.21.15.50:0/3191430486 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400e070 con 0x7f960c0ab040 2023-12-24T20:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96037fe700 1 -- 172.21.15.50:0/3191430486 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400b9d0 con 0x7f960c0ab040 2023-12-24T20:08:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96037fe700 1 -- 172.21.15.50:0/3191430486 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040092e0 con 0x7f960c0ab040 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 -- 172.21.15.50:0/3191430486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 msgr2=0x7f960c0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 --2- 172.21.15.50:0/3191430486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9604009f20 tx=0x7f9604009840 comp rx=0 tx=0).stop 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 -- 172.21.15.50:0/3191430486 shutdown_connections 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 --2- 172.21.15.50:0/3191430486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c0ab040 0x7f960c0ca110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 --2- 172.21.15.50:0/3191430486 >> v2:172.21.15.82:3300/0 conn(0x7f960c06bce0 0x7f960c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 -- 172.21.15.50:0/3191430486 >> 172.21.15.50:0/3191430486 conn(0x7f960c0cbba0 msgr2=0x7f960c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 -- 172.21.15.50:0/3191430486 shutdown_connections 2023-12-24T20:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.473+0000 7f96130cd700 1 -- 172.21.15.50:0/3191430486 wait complete. 2023-12-24T20:08:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 Processor -- start 2023-12-24T20:08:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 -- start start 2023-12-24T20:08:42.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c06bce0 0x7f960c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c159bc0 0x7f960c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0a98a0 con 0x7f960c0ab040 2023-12-24T20:08:42.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0aa700 con 0x7f960c159bc0 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f96130cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b15c0 con 0x7f960c06bce0 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f9603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f9603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46082/0 (socket says 172.21.15.50:46082) 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f9603fff700 1 -- 172.21.15.50:0/3628873579 learned_addr learned my addr 172.21.15.50:0/3628873579 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f961166a700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c159bc0 0x7f960c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.477+0000 7f9610e69700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c06bce0 0x7f960c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 -- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c06bce0 msgr2=0x7f960c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c06bce0 0x7f960c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 -- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c159bc0 msgr2=0x7f960c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c159bc0 0x7f960c0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 -- 172.21.15.50:0/3628873579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009ae0 con 0x7f960c0ab040 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9603fff700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e960 tx=0x7f95fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc013680 con 0x7f960c0ab040 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc0137e0 con 0x7f960c0ab040 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc013b80 con 0x7f960c0ab040 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0c5970 con 0x7f960c0ab040 2023-12-24T20:08:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c0a9e50 con 0x7f960c0ab040 2023-12-24T20:08:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.481+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c0652e0 con 0x7f960c0ab040 2023-12-24T20:08:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.485+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f95fc0123d0 con 0x7f960c0ab040 2023-12-24T20:08:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.485+0000 7f9600ff9700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 0x7f95f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.485+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f95fc07cbd0 con 0x7f960c0ab040 2023-12-24T20:08:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.485+0000 7f9610e69700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 0x7f95f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.485+0000 7f9610e69700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 0x7f95f8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f960c1594a0 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.493+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f95fc04ce30 con 0x7f960c0ab040 2023-12-24T20:08:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.705+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f960c06b570 con 0x7f960c0ab040 2023-12-24T20:08:42.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.705+0000 7f9600ff9700 1 -- 172.21.15.50:0/3628873579 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f95fc017090 con 0x7f960c0ab040 2023-12-24T20:08:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:42.709 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 msgr2=0x7f95f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 0x7f95f8062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f960c1594a0 tx=0x7f9608009040 comp rx=0 tx=0).stop 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 msgr2=0x7f960c168bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e960 tx=0x7f95fc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 shutdown_connections 2023-12-24T20:08:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f8060550 0x7f95f8062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c159bc0 0x7f960c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c0ab040 0x7f960c168bd0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 --2- 172.21.15.50:0/3628873579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f960c06bce0 0x7f960c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 >> 172.21.15.50:0/3628873579 conn(0x7f960c0cbba0 msgr2=0x7f960c0c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 shutdown_connections 2023-12-24T20:08:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.709+0000 7f96130cd700 1 -- 172.21.15.50:0/3628873579 wait complete. 2023-12-24T20:08:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:08:42.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.893+0000 7f27b9985700 1 Processor -- start 2023-12-24T20:08:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.893+0000 7f27b9985700 1 -- start start 2023-12-24T20:08:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b9985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27b40ca770 0x7f27b415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b9985700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b406ca50 con 0x7f27b415af90 2023-12-24T20:08:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b9985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b415b410 con 0x7f27b40ca3a0 2023-12-24T20:08:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b9985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b40c6980 con 0x7f27b40ca770 2023-12-24T20:08:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27b415af90 0x7f27b406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35726/0 (socket says 172.21.15.50:35726) 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b37fe700 1 -- 172.21.15.50:0/1674708641 learned_addr learned my addr 172.21.15.50:0/1674708641 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27aa7fc700 1 --2- 172.21.15.50:0/1674708641 >> v2:172.21.15.82:3300/0 conn(0x7f27b40ca770 0x7f27b415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665134178 0 0) 0x7f27b406ca50 con 0x7f27b415af90 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a0003570 con 0x7f27b415af90 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27aa7fc700 1 -- 172.21.15.50:0/1674708641 >> v1:172.21.15.82:6789/0 conn(0x7f27b40ca3a0 legacy=0x7f27b406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.897+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475417232 0 0) 0x7f27a0003570 con 0x7f27b415af90 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27aa7fc700 1 -- 172.21.15.50:0/1674708641 >> v1:172.21.15.50:6789/0 conn(0x7f27b415af90 legacy=0x7f27b406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27aa7fc700 1 -- 172.21.15.50:0/1674708641 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b406b520 con 0x7f27b40ca770 2023-12-24T20:08:42.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27aa7fc700 1 --2- 172.21.15.50:0/1674708641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b40ca770 0x7f27b415aa50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f279c0098e0 tx=0x7f279c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953c0ce05df4ff04 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0017f0 con 0x7f27b40ca770 2023-12-24T20:08:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c011420 con 0x7f27b40ca770 2023-12-24T20:08:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b27fc700 1 -- 172.21.15.50:0/1674708641 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0117c0 con 0x7f27b40ca770 2023-12-24T20:08:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 -- 172.21.15.50:0/1674708641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b40ca770 msgr2=0x7f27b415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 --2- 172.21.15.50:0/1674708641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b40ca770 0x7f27b415aa50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f279c0098e0 tx=0x7f279c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 -- 172.21.15.50:0/1674708641 shutdown_connections 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 --2- 172.21.15.50:0/1674708641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b40ca770 0x7f27b415aa50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 -- 172.21.15.50:0/1674708641 >> 172.21.15.50:0/1674708641 conn(0x7f27b40cbba0 msgr2=0x7f27b40cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 -- 172.21.15.50:0/1674708641 shutdown_connections 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.901+0000 7f27b9985700 1 -- 172.21.15.50:0/1674708641 wait complete. 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 Processor -- start 2023-12-24T20:08:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 -- start start 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b40ca3a0 0x7f27b4170f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b415af90 0x7f27b41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40afe20 con 0x7f27b40ca770 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40afb20 con 0x7f27b415af90 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b9985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41717c0 con 0x7f27b40ca3a0 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27aa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27aa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46092/0 (socket says 172.21.15.50:46092) 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27aa7fc700 1 -- 172.21.15.50:0/998930665 learned_addr learned my addr 172.21.15.50:0/998930665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b37fe700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b415af90 0x7f27b41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.905+0000 7f27b2ffd700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b40ca3a0 0x7f27b4170f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 -- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b40ca3a0 msgr2=0x7f27b4170f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b40ca3a0 0x7f27b4170f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 -- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b415af90 msgr2=0x7f27b41566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b415af90 0x7f27b41566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 -- 172.21.15.50:0/998930665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c009420 con 0x7f27b40ca770 2023-12-24T20:08:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27aa7fc700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f279c009f80 tx=0x7f279c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c000d10 con 0x7f27b40ca770 2023-12-24T20:08:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c010ab0 con 0x7f27b40ca770 2023-12-24T20:08:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b4171aa0 con 0x7f27b40ca770 2023-12-24T20:08:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c010e70 con 0x7f27b40ca770 2023-12-24T20:08:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b40c3320 con 0x7f27b40ca770 2023-12-24T20:08:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b40affd0 con 0x7f27b40ca770 2023-12-24T20:08:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.909+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f279c01d640 con 0x7f27b40ca770 2023-12-24T20:08:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.913+0000 7f27ab7fe700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 0x7f2794062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.913+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f279c07e730 con 0x7f27b40ca770 2023-12-24T20:08:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.913+0000 7f27b2ffd700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 0x7f2794062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.913+0000 7f27b2ffd700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 0x7f2794062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27a4003b80 tx=0x7f27a4007e40 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:42.917+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27b40affd0 con 0x7f27b40ca770 2023-12-24T20:08:43.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.089+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27b40affd0 con 0x7f27b40ca770 2023-12-24T20:08:43.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27ab7fe700 1 -- 172.21.15.50:0/998930665 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16184 (secure 0 0 0) 0x7f27b40affd0 con 0x7f27b40ca770 2023-12-24T20:08:43.095 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":193,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:08:40.223926+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 msgr2=0x7f2794062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 0x7f2794062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27a4003b80 tx=0x7f27a4007e40 comp rx=0 tx=0).stop 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 msgr2=0x7f27b40c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f279c009f80 tx=0x7f279c017000 comp rx=0 tx=0).stop 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 shutdown_connections 2023-12-24T20:08:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2794060550 0x7f2794062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b415af90 0x7f27b41566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b40ca770 0x7f27b40c2de0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 --2- 172.21.15.50:0/998930665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b40ca3a0 0x7f27b4170f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 >> 172.21.15.50:0/998930665 conn(0x7f27b40cbba0 msgr2=0x7f27b40c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 shutdown_connections 2023-12-24T20:08:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.093+0000 7f27b9985700 1 -- 172.21.15.50:0/998930665 wait complete. 2023-12-24T20:08:43.120 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:08:43.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:43.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 Processor -- start 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 -- start start 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7eec158e00 0x7f7eec1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 0x7f7eec0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec159710 con 0x7f7eec06a580 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec06b640 con 0x7f7eec158e00 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef21cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0b5e10 con 0x7f7eec06d8c0 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef19cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef19cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46108/0 (socket says 172.21.15.50:46108) 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef19cb700 1 -- 172.21.15.50:0/874294035 learned_addr learned my addr 172.21.15.50:0/874294035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/874294035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 0x7f7eec0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef11ca700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.82:3300/0 conn(0x7f7eec158e00 0x7f7eec1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 -- 172.21.15.50:0/874294035 >> v2:172.21.15.82:3300/0 conn(0x7f7eec158e00 msgr2=0x7f7eec1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.82:3300/0 conn(0x7f7eec158e00 0x7f7eec1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 -- 172.21.15.50:0/874294035 >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 msgr2=0x7f7eec0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef09c9700 1 -- 172.21.15.50:0/874294035 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec06b8e0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.281+0000 7f7ef19cb700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/874294035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 0x7f7eec0b3ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7eec063b50 tx=0x7f7edc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5978a5be99b1c6f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ee3fff700 1 -- 172.21.15.50:0/874294035 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc011630 con 0x7f7eec06d8c0 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ee3fff700 1 -- 172.21.15.50:0/874294035 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc0117b0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ee3fff700 1 -- 172.21.15.50:0/874294035 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc011b70 con 0x7f7eec06d8c0 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 -- 172.21.15.50:0/874294035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 msgr2=0x7f7eec0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/874294035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 0x7f7eec0b3ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7eec063b50 tx=0x7f7edc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 -- 172.21.15.50:0/874294035 shutdown_connections 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.50:3300/0 conn(0x7f7eec06a580 0x7f7eec0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/874294035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06d8c0 0x7f7eec0b3ad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/874294035 >> v2:172.21.15.82:3300/0 conn(0x7f7eec158e00 0x7f7eec1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 -- 172.21.15.50:0/874294035 >> 172.21.15.50:0/874294035 conn(0x7f7eec067b80 msgr2=0x7f7eec0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 -- 172.21.15.50:0/874294035 shutdown_connections 2023-12-24T20:08:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.285+0000 7f7ef21cc700 1 -- 172.21.15.50:0/874294035 wait complete. 2023-12-24T20:08:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 Processor -- start 2023-12-24T20:08:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 -- start start 2023-12-24T20:08:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06a580 0x7f7eec0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 0x7f7eec1413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0ad550 con 0x7f7eec158e00 2023-12-24T20:08:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0ac940 con 0x7f7eec06d8c0 2023-12-24T20:08:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef21cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0acc20 con 0x7f7eec06a580 2023-12-24T20:08:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef19cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef19cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46124/0 (socket says 172.21.15.50:46124) 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef19cb700 1 -- 172.21.15.50:0/3645809015 learned_addr learned my addr 172.21.15.50:0/3645809015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 0x7f7eec1413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.289+0000 7f7ef11ca700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06a580 0x7f7eec0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 -- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06a580 msgr2=0x7f7eec0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06a580 0x7f7eec0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 -- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 msgr2=0x7f7eec15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 -- 172.21.15.50:0/3645809015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4009ae0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef19cb700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:43.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef09c9700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 0x7f7eec1413a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7edc016000 tx=0x7f7edc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc01f070 con 0x7f7eec06d8c0 2023-12-24T20:08:43.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc000bc0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc011b70 con 0x7f7eec06d8c0 2023-12-24T20:08:43.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc009420 con 0x7f7eec06d8c0 2023-12-24T20:08:43.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec0ad1e0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.293+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec0ad6c0 con 0x7f7eec06d8c0 2023-12-24T20:08:43.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.297+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7edc023070 con 0x7f7eec06d8c0 2023-12-24T20:08:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.297+0000 7f7ee17fa700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 0x7f7ed0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.297+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f7edc07db50 con 0x7f7eec06d8c0 2023-12-24T20:08:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.297+0000 7f7ef11ca700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 0x7f7ed0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.297+0000 7f7ef11ca700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 0x7f7ed0062ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0aee00 tx=0x7f7ee80091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.305+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7edc04df20 con 0x7f7eec06d8c0 2023-12-24T20:08:43.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.477+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7eec0acd60 con 0x7f7ed0060620 2023-12-24T20:08:43.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.489+0000 7f7ee17fa700 1 -- 172.21.15.50:0/3645809015 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273508 (secure 0 0 0) 0x7f7eec0acd60 con 0x7f7ed0060620 2023-12-24T20:08:43.498 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 msgr2=0x7f7ed0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 0x7f7ed0062ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0aee00 tx=0x7f7ee80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 msgr2=0x7f7eec1413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 0x7f7eec1413a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7edc016000 tx=0x7f7edc017000 comp rx=0 tx=0).stop 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 shutdown_connections 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7ed0060620 0x7f7ed0062ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eec158e00 0x7f7eec15c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec06d8c0 0x7f7eec1413a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 --2- 172.21.15.50:0/3645809015 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eec06a580 0x7f7eec0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 >> 172.21.15.50:0/3645809015 conn(0x7f7eec067b80 msgr2=0x7f7eec0a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 shutdown_connections 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.497+0000 7f7ef21cc700 1 -- 172.21.15.50:0/3645809015 wait complete. 2023-12-24T20:08:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:08:43.522 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T20:08:42.146902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":542,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2455352,"kb_used_data":19704,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752519368,"statfs":{"total":773094113280,"available":770579832832,"internally_reserved":0,"allocated":20176896,"data_stored":11112879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.943372"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269363+0000","last_change":"2023-12-24T20:08:39.257674+0000","last_active":"2023-12-24T20:08:39.269363+0000","last_peered":"2023-12-24T20:08:39.269363+0000","last_clean":"2023-12-24T20:08:39.269363+0000","last_became_active":"2023-12-24T20:08:39.257389+0000","last_became_peered":"2023-12-24T20:08:39.257389+0000","last_unstale":"2023-12-24T20:08:39.269363+0000","last_undegraded":"2023-12-24T20:08:39.269363+0000","last_fullsized":"2023-12-24T20:08:39.269363+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:26.974198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.245788+0000","last_change":"2023-12-24T20:08:39.241938+0000","last_active":"2023-12-24T20:08:39.245788+0000","last_peered":"2023-12-24T20:08:39.245788+0000","last_clean":"2023-12-24T20:08:39.245788+0000","last_became_active":"2023-12-24T20:08:39.241578+0000","last_became_peered":"2023-12-24T20:08:39.241578+0000","last_unstale":"2023-12-24T20:08:39.245788+0000","last_undegraded":"2023-12-24T20:08:39.245788+0000","last_fullsized":"2023-12-24T20:08:39.245788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.275303+0000","last_change":"2023-12-24T20:08:38.246604+0000","last_active":"2023-12-24T20:08:39.275303+0000","last_peered":"2023-12-24T20:08:39.275303+0000","last_clean":"2023-12-24T20:08:39.275303+0000","last_became_active":"2023-12-24T20:08:38.246300+0000","last_became_peered":"2023-12-24T20:08:38.246300+0000","last_unstale":"2023-12-24T20:08:39.275303+0000","last_undegraded":"2023-12-24T20:08:39.275303+0000","last_fullsized":"2023-12-24T20:08:39.275303+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:17.334028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.268365+0000","last_change":"2023-12-24T20:08:39.258550+0000","last_active":"2023-12-24T20:08:39.268365+0000","last_peered":"2023-12-24T20:08:39.268365+0000","last_clean":"2023-12-24T20:08:39.268365+0000","last_became_active":"2023-12-24T20:08:39.258267+0000","last_became_peered":"2023-12-24T20:08:39.258267+0000","last_unstale":"2023-12-24T20:08:39.268365+0000","last_undegraded":"2023-12-24T20:08:39.268365+0000","last_fullsized":"2023-12-24T20:08:39.268365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.872081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263266+0000","last_change":"2023-12-24T20:08:39.252283+0000","last_active":"2023-12-24T20:08:39.263266+0000","last_peered":"2023-12-24T20:08:39.263266+0000","last_clean":"2023-12-24T20:08:39.263266+0000","last_became_active":"2023-12-24T20:08:39.251971+0000","last_became_peered":"2023-12-24T20:08:39.251971+0000","last_unstale":"2023-12-24T20:08:39.263266+0000","last_undegraded":"2023-12-24T20:08:39.263266+0000","last_fullsized":"2023-12-24T20:08:39.263266+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:17.713632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229002+0000","last_change":"2023-12-24T20:08:38.243723+0000","last_active":"2023-12-24T20:08:39.229002+0000","last_peered":"2023-12-24T20:08:39.229002+0000","last_clean":"2023-12-24T20:08:39.229002+0000","last_became_active":"2023-12-24T20:08:38.243019+0000","last_became_peered":"2023-12-24T20:08:38.243019+0000","last_unstale":"2023-12-24T20:08:39.229002+0000","last_undegraded":"2023-12-24T20:08:39.229002+0000","last_fullsized":"2023-12-24T20:08:39.229002+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:35.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.249982+0000","last_change":"2023-12-24T20:08:39.243493+0000","last_active":"2023-12-24T20:08:39.249982+0000","last_peered":"2023-12-24T20:08:39.249982+0000","last_clean":"2023-12-24T20:08:39.249982+0000","last_became_active":"2023-12-24T20:08:39.243091+0000","last_became_peered":"2023-12-24T20:08:39.243091+0000","last_unstale":"2023-12-24T20:08:39.249982+0000","last_undegraded":"2023-12-24T20:08:39.249982+0000","last_fullsized":"2023-12-24T20:08:39.249982+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:33.552641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243182+0000","last_change":"2023-12-24T20:08:39.239953+0000","last_active":"2023-12-24T20:08:39.243182+0000","last_peered":"2023-12-24T20:08:39.243182+0000","last_clean":"2023-12-24T20:08:39.243182+0000","last_became_active":"2023-12-24T20:08:39.239598+0000","last_became_peered":"2023-12-24T20:08:39.239598+0000","last_unstale":"2023-12-24T20:08:39.243182+0000","last_undegraded":"2023-12-24T20:08:39.243182+0000","last_fullsized":"2023-12-24T20:08:39.243182+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:22.720213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229366+0000","last_change":"2023-12-24T20:08:38.243949+0000","last_active":"2023-12-24T20:08:39.229366+0000","last_peered":"2023-12-24T20:08:39.229366+0000","last_clean":"2023-12-24T20:08:39.229366+0000","last_became_active":"2023-12-24T20:08:38.243446+0000","last_became_peered":"2023-12-24T20:08:38.243446+0000","last_unstale":"2023-12-24T20:08:39.229366+0000","last_undegraded":"2023-12-24T20:08:39.229366+0000","last_fullsized":"2023-12-24T20:08:39.229366+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:52.516275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.267639+0000","last_change":"2023-12-24T20:08:39.257209+0000","last_active":"2023-12-24T20:08:39.267639+0000","last_peered":"2023-12-24T20:08:39.267639+0000","last_clean":"2023-12-24T20:08:39.267639+0000","last_became_active":"2023-12-24T20:08:39.256410+0000","last_became_peered":"2023-12-24T20:08:39.256410+0000","last_unstale":"2023-12-24T20:08:39.267639+0000","last_undegraded":"2023-12-24T20:08:39.267639+0000","last_fullsized":"2023-12-24T20:08:39.267639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:26.287672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229549+0000","last_change":"2023-12-24T20:08:38.250060+0000","last_active":"2023-12-24T20:08:39.229549+0000","last_peered":"2023-12-24T20:08:39.229549+0000","last_clean":"2023-12-24T20:08:39.229549+0000","last_became_active":"2023-12-24T20:08:38.249746+0000","last_became_peered":"2023-12-24T20:08:38.249746+0000","last_unstale":"2023-12-24T20:08:39.229549+0000","last_undegraded":"2023-12-24T20:08:39.229549+0000","last_fullsized":"2023-12-24T20:08:39.229549+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:33.428126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.250034+0000","last_change":"2023-12-24T20:08:39.244572+0000","last_active":"2023-12-24T20:08:39.250034+0000","last_peered":"2023-12-24T20:08:39.250034+0000","last_clean":"2023-12-24T20:08:39.250034+0000","last_became_active":"2023-12-24T20:08:39.244190+0000","last_became_peered":"2023-12-24T20:08:39.244190+0000","last_unstale":"2023-12-24T20:08:39.250034+0000","last_undegraded":"2023-12-24T20:08:39.250034+0000","last_fullsized":"2023-12-24T20:08:39.250034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:30:43.712363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1039,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-12-24T20:08:34.817020+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:08:34.817020+0000","last_peered":"2023-12-24T20:08:34.817020+0000","last_clean":"2023-12-24T20:08:34.817020+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:08:34.817020+0000","last_undegraded":"2023-12-24T20:08:34.817020+0000","last_fullsized":"2023-12-24T20:08:34.817020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067564,"statfs":{"total":96636764160,"available":96325185536,"internally_reserved":0,"allocated":2961408,"data_stored":1828371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1339999999999999,"15min":1.163},"min":{"1min":0.73399999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.46,"5min":1.728,"15min":1.728},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.179,"15min":1.1799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.028}]},{"osd":1,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.163,"15min":1.169},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.518,"5min":1.718,"15min":1.9379999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.29,"15min":1.2669999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7130000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1459999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.262},"min":{"1min":0.92500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.514,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.274},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.85999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5580000000000001,"5min":1.752,"15min":1.8200000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.3280000000000001,"15min":1.319},"min":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6319999999999999,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":0.89200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.641,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.323}]},{"osd":4,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.246,"15min":1.214},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.865,"5min":1.865,"15min":2.194},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.3360000000000001,"15min":1.2769999999999999},"min":{"1min":0.88700000000000001,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":0.96699999999999997,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.873,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.411,"15min":1.3540000000000001},"min":{"1min":0.90600000000000003,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.377}]},{"osd":6,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4790000000000001,"15min":1.444},"min":{"1min":1.1040000000000001,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.3319999999999999},"last":1.484},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":1.004,"5min":0.75600000000000001,"15min":0.55000000000000004},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299600,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072240,"statfs":{"total":96636764160,"available":96329973760,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2929999999999999,"15min":1.3129999999999999},"min":{"1min":0.97299999999999998,"5min":0.66800000000000004,"15min":0.44500000000000001},"max":{"1min":1.645,"5min":1.7210000000000001,"15min":1.837},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":1.1759999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6160000000000001,"5min":1.744,"15min":1.821},"last":0.92200000000000004}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.1779999999999999},"min":{"1min":0.90400000000000003,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.4870000000000001,"5min":1.663,"15min":1.663},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1990000000000001,"15min":1.2270000000000001},"min":{"1min":0.95499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.4279999999999999,"5min":1.6899999999999999,"15min":1.784},"last":1.1890000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.96799999999999997,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.6240000000000001,"5min":1.6459999999999999,"15min":1.827},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.94999999999999996,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.589,"5min":1.758,"15min":1.768},"last":1.548}]},{"osd":3,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3069999999999999,"15min":1.298},"min":{"1min":0.98699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.8879999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3160000000000001,"15min":1.3109999999999999},"min":{"1min":1.1240000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":1.7010000000000001,"15min":1.8360000000000001},"last":1.2370000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.22,"15min":1.208},"min":{"1min":0.79500000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.6599999999999999,"5min":1.7110000000000001,"15min":1.9039999999999999},"last":1.482},{"interface":"front","average":{"1min":1.242,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.67000000000000004,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.8580000000000001},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.258},"min":{"1min":0.79100000000000004,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.9370000000000001},"last":1.407},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.373,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5820000000000001,"5min":1.839,"15min":1.954},"last":1.2809999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3959999999999999,"15min":1.403},"min":{"1min":1.1200000000000001,"5min":0.60599999999999998,"15min":0.55800000000000005},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.9710000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4159999999999999,"15min":1.407},"min":{"1min":0.97799999999999998,"5min":0.73399999999999999,"15min":0.65300000000000002},"max":{"1min":1.7549999999999999,"5min":1.804,"15min":2.0259999999999998},"last":1.1299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311888,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059952,"statfs":{"total":96636764160,"available":96317390848,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.268},"min":{"1min":0.871,"5min":0.77200000000000002,"15min":0.498},"max":{"1min":1.6020000000000001,"5min":1.661,"15min":1.738},"last":1.165},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.393,"15min":1.349},"min":{"1min":1.0229999999999999,"5min":0.81200000000000006,"15min":0.80300000000000005},"max":{"1min":1.597,"5min":1.7410000000000001,"15min":1.784},"last":1.143}]},{"osd":1,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.196},"min":{"1min":0.94399999999999995,"5min":0.80700000000000005,"15min":0.65100000000000002},"max":{"1min":1.5960000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.92800000000000005,"5min":0.747,"15min":0.56000000000000005},"max":{"1min":1.46,"5min":1.673,"15min":1.7210000000000001},"last":1.103}]},{"osd":2,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.90400000000000003,"5min":0.876,"15min":0.80000000000000004},"max":{"1min":1.677,"5min":1.6839999999999999,"15min":1.819},"last":1.306},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.268,"15min":1.284},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.878},"max":{"1min":1.635,"5min":1.883,"15min":1.883},"last":0.83199999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3220000000000001,"15min":1.3},"min":{"1min":1.0449999999999999,"5min":0.92300000000000004,"15min":0.75800000000000001},"max":{"1min":1.784,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.403,"15min":1.369},"min":{"1min":1.091,"5min":1.038,"15min":0.94499999999999995},"max":{"1min":1.7210000000000001,"5min":1.877,"15min":1.8799999999999999},"last":1.206}]},{"osd":4,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.61899999999999999},"max":{"1min":1.6599999999999999,"5min":1.839,"15min":1.839},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":0.98899999999999999,"5min":0.82099999999999995,"15min":0.59599999999999997},"max":{"1min":1.5920000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.351,"15min":1.325},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.796,"5min":2.008,"15min":2.008},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.373,"15min":1.3560000000000001},"min":{"1min":1.012,"5min":0.93500000000000005,"15min":0.69599999999999995},"max":{"1min":1.6930000000000001,"5min":1.7669999999999999,"15min":1.9630000000000001},"last":1.254}]},{"osd":7,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.466,"15min":1.423},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.80700000000000005},"max":{"1min":1.9370000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":1.0229999999999999,"5min":0.90600000000000003,"15min":0.85999999999999999},"max":{"1min":1.8580000000000001,"5min":1.978,"15min":2.0009999999999999},"last":1.0740000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311888,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059952,"statfs":{"total":96636764160,"available":96317390848,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.268},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67500000000000004},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.24},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.66300000000000003},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":2.012},"last":1.577}]},{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.179,"15min":1.1539999999999999},"min":{"1min":0.748,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5589999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1699999999999999,"15min":1.155},"min":{"1min":0.92300000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.694},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3380000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.84899999999999998},"max":{"1min":1.7989999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.466},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.367},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"max":{"1min":1.825,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.2989999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.91600000000000004,"5min":0.82799999999999996,"15min":0.66700000000000004},"max":{"1min":1.5229999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3129999999999999,"15min":1.3049999999999999},"min":{"1min":1.1259999999999999,"5min":0.90600000000000003,"15min":0.81699999999999995},"max":{"1min":1.6950000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.099}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.28,"15min":1.3009999999999999},"min":{"1min":0.92100000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.704,"5min":1.704,"15min":1.8169999999999999},"last":1.421},{"interface":"front","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.82199999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7290000000000001,"5min":2.0720000000000001,"15min":2.089},"last":1.669}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.878,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.571,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.385},{"interface":"front","average":{"1min":1.399,"5min":1.335,"15min":1.335},"min":{"1min":1.087,"5min":0.65700000000000003,"15min":0.51600000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.96},"last":1.343}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.27,"15min":1.3009999999999999},"min":{"1min":0.97699999999999998,"5min":0.72799999999999998,"15min":0.57099999999999995},"max":{"1min":1.865,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4410000000000001,"15min":1.423},"min":{"1min":1.0580000000000001,"5min":0.82999999999999996,"15min":0.72999999999999998},"max":{"1min":1.8879999999999999,"5min":2.0329999999999999,"15min":2.7829999999999999},"last":1.3109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315984,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055856,"statfs":{"total":96636764160,"available":96313196544,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.885},"last":1.073},{"interface":"front","average":{"1min":1.165,"5min":1.1000000000000001,"15min":1.131},"min":{"1min":0.81299999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.6990000000000001,"15min":2.0059999999999998},"last":1.2290000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.052,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":1.6830000000000001,"5min":1.722,"15min":2.0899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.321,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.99399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6850000000000001,"5min":1.889,"15min":1.889},"last":1.319}]},{"osd":2,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1220000000000001,"15min":1.147},"min":{"1min":0.69099999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":2.0619999999999998,"15min":2.21},"last":1.373},{"interface":"front","average":{"1min":1.206,"5min":1.232,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":2.036,"5min":2.036,"15min":2.0550000000000002},"last":1.4259999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.272,"15min":1.27},"min":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.71099999999999997},"max":{"1min":1.581,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.8700000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":1.0740000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.7430000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4419999999999999,"15min":1.446},"min":{"1min":1.1200000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.7,"5min":2.0129999999999999,"15min":2.3900000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.145,"5min":1.1120000000000001,"15min":0.96099999999999997},"max":{"1min":1.956,"5min":2.032,"15min":2.2250000000000001},"last":1.554}]},{"osd":6,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5029999999999999,"15min":1.524},"min":{"1min":1.147,"5min":1.1419999999999999,"15min":1.0209999999999999},"max":{"1min":1.927,"5min":2.089,"15min":2.145},"last":1.673},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":1.0649999999999999,"5min":0.95699999999999996,"15min":0.879},"max":{"1min":1.8740000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":2.0600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.48,"15min":1.49},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.758,"5min":2.1920000000000002,"15min":2.2639999999999998},"last":2.3210000000000002},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5529999999999999,"15min":1.5609999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.913,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.9099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.3939999999999999,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5669999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":2.056},"last":1.218},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1559999999999999,"15min":1.125},"min":{"1min":0.83699999999999997,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.4670000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.27}]},{"osd":3,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2470000000000001,"15min":1.234},"min":{"1min":0.81200000000000006,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7629999999999999,"5min":1.8140000000000001,"15min":2.1659999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2130000000000001,"15min":1.163},"min":{"1min":1.034,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":1.1739999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.423,"15min":1.3919999999999999},"min":{"1min":1.228,"5min":0.96699999999999997,"15min":0.92600000000000005},"max":{"1min":1.754,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.357},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.94499999999999995},"max":{"1min":1.8149999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.774}]},{"osd":5,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.417,"15min":1.369},"min":{"1min":1.042,"5min":0.877,"15min":0.877},"max":{"1min":1.8620000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.4790000000000001,"15min":1.4650000000000001},"min":{"1min":1.1899999999999999,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0230000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.8100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.52,"15min":1.502},"min":{"1min":1.2729999999999999,"5min":1.1160000000000001,"15min":1.012},"max":{"1min":1.917,"5min":2.0779999999999998,"15min":2.1219999999999999},"last":1.653},{"interface":"front","average":{"1min":1.631,"5min":1.556,"15min":1.5109999999999999},"min":{"1min":1.357,"5min":1.1000000000000001,"15min":0.876},"max":{"1min":2.1379999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.5880000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.603,"15min":1.581},"min":{"1min":1.2190000000000001,"5min":1.048,"15min":1.048},"max":{"1min":2.1589999999999998,"5min":2.387,"15min":2.387},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.7,"5min":1.615,"15min":1.5940000000000001},"min":{"1min":1.355,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.214,"5min":2.226,"15min":2.2589999999999999},"last":1.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307792,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064048,"statfs":{"total":96636764160,"available":96321585152,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57999999999999996,"15min":0.54900000000000004},"max":{"1min":1.2809999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1759999999999999,"15min":1.1599999999999999},"min":{"1min":0.94499999999999995,"5min":0.82799999999999996,"15min":0.58199999999999996},"max":{"1min":1.49,"5min":1.657,"15min":1.671},"last":1.095}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.57799999999999996,"15min":0.41099999999999998},"max":{"1min":1.28,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.75900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.532,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.147}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.296,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.6299999999999999,"5min":1.909,"15min":1.909},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82899999999999996,"5min":0.73899999999999999,"15min":0.48899999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.8140000000000001},"last":1.409}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2689999999999999,"15min":1.284},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.63},"max":{"1min":1.73,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.4390000000000001},"min":{"1min":1.109,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7569999999999999,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.478}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.423,"15min":1.401},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.81200000000000006},"max":{"1min":1.819,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.407,"15min":1.4019999999999999},"min":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.84599999999999997},"max":{"1min":1.837,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4359999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.534,"15min":1.5229999999999999},"min":{"1min":1.1519999999999999,"5min":1.032,"15min":0.72999999999999998},"max":{"1min":2.1160000000000001,"5min":2.2410000000000001,"15min":2.3540000000000001},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.4890000000000001,"15min":1.4930000000000001},"min":{"1min":1.147,"5min":0.97899999999999998,"15min":0.86699999999999999},"max":{"1min":1.7629999999999999,"5min":2.379,"15min":2.456},"last":1.5149999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5609999999999999},"min":{"1min":1.216,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7909999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.599},{"interface":"front","average":{"1min":1.476,"5min":1.48,"15min":1.5069999999999999},"min":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.95899999999999996},"max":{"1min":1.7829999999999999,"5min":2.177,"15min":2.177},"last":1.5369999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067564,"statfs":{"total":96636764160,"available":96325185536,"internally_reserved":0,"allocated":2961408,"data_stored":1828371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.90100000000000002,"15min":0.91700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.6950000000000001},"last":1.069},{"interface":"front","average":{"1min":1.091,"5min":1.085,"15min":1.071},"min":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":1.6559999999999999,"5min":1.823,"15min":1.823},"last":1.2490000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0900000000000001,"15min":1.0960000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.615,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.214,"5min":1.167,"15min":1.163},"min":{"1min":0.82799999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5409999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.107},"min":{"1min":0.745,"5min":0.71999999999999997,"15min":0.58199999999999996},"max":{"1min":1.5820000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.012},{"interface":"front","average":{"1min":1.298,"5min":1.2729999999999999,"15min":1.284},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.331},"min":{"1min":1.0660000000000001,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6890000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.4350000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4390000000000001,"15min":1.4450000000000001},"min":{"1min":0.98099999999999998,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.8939999999999999,"5min":1.958,"15min":2.2519999999999998},"last":1.845},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4610000000000001,"15min":1.462},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.9099999999999999,"5min":2.125,"15min":2.125},"last":1.375}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.657,"5min":2.1320000000000001,"15min":2.492},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5169999999999999},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":1.9610000000000001,"5min":2.25,"15min":2.3330000000000002},"last":1.764}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.548,"15min":1.538},"min":{"1min":1.167,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.984,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5449999999999999,"15min":1.5189999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8100000000000001,"5min":2.234,"15min":2.411},"last":1.3180000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:08:43.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:43.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 Processor -- start 2023-12-24T20:08:43.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 -- start start 2023-12-24T20:08:43.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9dc0ca770 0x7fb9dc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc06ca50 con 0x7fb9dc15af90 2023-12-24T20:08:43.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc15b410 con 0x7fb9dc0ca3a0 2023-12-24T20:08:43.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e3a2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c6980 con 0x7fb9dc0ca770 2023-12-24T20:08:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e1fcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9dc15af90 0x7fb9dc06cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35736/0 (socket says 172.21.15.50:35736) 2023-12-24T20:08:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e1fcb700 1 -- 172.21.15.50:0/1528492872 learned_addr learned my addr 172.21.15.50:0/1528492872 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.733+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/1528492872 >> v2:172.21.15.82:3300/0 conn(0x7fb9dc0ca770 0x7fb9dc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136279112 0 0) 0x7fb9dc15b410 con 0x7fb9dc0ca3a0 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8003570 con 0x7fb9dc0ca3a0 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52979175 0 0) 0x7fb9dc06ca50 con 0x7fb9dc15af90 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9dc15b410 con 0x7fb9dc15af90 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/1528492872 >> v1:172.21.15.82:6789/0 conn(0x7fb9dc0ca3a0 legacy=0x7fb9dc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/1528492872 >> v1:172.21.15.50:6789/0 conn(0x7fb9dc15af90 legacy=0x7fb9dc06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/1528492872 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc06b520 con 0x7fb9dc0ca770 2023-12-24T20:08:43.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/1528492872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc15aa50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098e0 tx=0x7fb9cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f0b6b75b1832de server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc011630 con 0x7fb9dc0ca770 2023-12-24T20:08:43.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc011790 con 0x7fb9dc0ca770 2023-12-24T20:08:43.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9d3fff700 1 -- 172.21.15.50:0/1528492872 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc011b30 con 0x7fb9dc0ca770 2023-12-24T20:08:43.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/1528492872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 msgr2=0x7fb9dc15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/1528492872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc15aa50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098e0 tx=0x7fb9cc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/1528492872 shutdown_connections 2023-12-24T20:08:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/1528492872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc15aa50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/1528492872 >> 172.21.15.50:0/1528492872 conn(0x7fb9dc0cbba0 msgr2=0x7fb9dc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.737+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/1528492872 shutdown_connections 2023-12-24T20:08:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.741+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/1528492872 wait complete. 2023-12-24T20:08:43.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.741+0000 7fb9e3a2e700 1 Processor -- start 2023-12-24T20:08:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.741+0000 7fb9e3a2e700 1 -- start start 2023-12-24T20:08:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9dc15af90 0x7fb9dc1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1618b0 con 0x7fb9dc0ca3a0 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b0ae0 con 0x7fb9dc0ca770 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b0dc0 con 0x7fb9dc15af90 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e17ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e17ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46128/0 (socket says 172.21.15.50:46128) 2023-12-24T20:08:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e17ca700 1 -- 172.21.15.50:0/3192749301 learned_addr learned my addr 172.21.15.50:0/3192749301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e1fcb700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9dc15af90 0x7fb9dc1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9dc15af90 msgr2=0x7fb9dc1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9dc15af90 0x7fb9dc1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 msgr2=0x7fb9dc161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 -- 172.21.15.50:0/3192749301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc009420 con 0x7fb9dc0ca770 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e17ca700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e0fc9700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc0aec60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c6210 tx=0x7fb9cc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc000d10 con 0x7fb9dc0ca770 2023-12-24T20:08:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc011900 con 0x7fb9dc0ca770 2023-12-24T20:08:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc0b10a0 con 0x7fb9dc0ca770 2023-12-24T20:08:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc026430 con 0x7fb9dc0ca770 2023-12-24T20:08:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.745+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc0b1660 con 0x7fb9dc0ca770 2023-12-24T20:08:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.749+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc0b1850 con 0x7fb9dc0ca770 2023-12-24T20:08:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.749+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb9cc023030 con 0x7fb9dc0ca770 2023-12-24T20:08:43.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.753+0000 7fb9d17fa700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 0x7fb9c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:43.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.753+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7fb9cc07e160 con 0x7fb9dc0ca770 2023-12-24T20:08:43.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.753+0000 7fb9e17ca700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 0x7fb9c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:43.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.753+0000 7fb9e17ca700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 0x7fb9c0062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8007fd0 tx=0x7fb9d8007eb0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.761+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9cc04e440 con 0x7fb9dc0ca770 2023-12-24T20:08:43.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.933+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9dc0652e0 con 0x7fb9c0060550 2023-12-24T20:08:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.949+0000 7fb9d17fa700 1 -- 172.21.15.50:0/3192749301 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273508 (secure 0 0 0) 0x7fb9dc0652e0 con 0x7fb9c0060550 2023-12-24T20:08:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 msgr2=0x7fb9c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 0x7fb9c0062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8007fd0 tx=0x7fb9d8007eb0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 msgr2=0x7fb9dc0aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc0aec60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c6210 tx=0x7fb9cc017000 comp rx=0 tx=0).stop 2023-12-24T20:08:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 shutdown_connections 2023-12-24T20:08:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fb9c0060550 0x7fb9c0062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9dc15af90 0x7fb9dc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ca770 0x7fb9dc0aec60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 --2- 172.21.15.50:0/3192749301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0ca3a0 0x7fb9dc161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 >> 172.21.15.50:0/3192749301 conn(0x7fb9dc0cbba0 msgr2=0x7fb9dc15b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 shutdown_connections 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:43.957+0000 7fb9e3a2e700 1 -- 172.21.15.50:0/3192749301 wait complete. 2023-12-24T20:08:43.963 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:08:43.983 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T20:08:42.146902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":542,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2455352,"kb_used_data":19704,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752519368,"statfs":{"total":773094113280,"available":770579832832,"internally_reserved":0,"allocated":20176896,"data_stored":11112879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.943372"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269363+0000","last_change":"2023-12-24T20:08:39.257674+0000","last_active":"2023-12-24T20:08:39.269363+0000","last_peered":"2023-12-24T20:08:39.269363+0000","last_clean":"2023-12-24T20:08:39.269363+0000","last_became_active":"2023-12-24T20:08:39.257389+0000","last_became_peered":"2023-12-24T20:08:39.257389+0000","last_unstale":"2023-12-24T20:08:39.269363+0000","last_undegraded":"2023-12-24T20:08:39.269363+0000","last_fullsized":"2023-12-24T20:08:39.269363+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:26.974198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.245788+0000","last_change":"2023-12-24T20:08:39.241938+0000","last_active":"2023-12-24T20:08:39.245788+0000","last_peered":"2023-12-24T20:08:39.245788+0000","last_clean":"2023-12-24T20:08:39.245788+0000","last_became_active":"2023-12-24T20:08:39.241578+0000","last_became_peered":"2023-12-24T20:08:39.241578+0000","last_unstale":"2023-12-24T20:08:39.245788+0000","last_undegraded":"2023-12-24T20:08:39.245788+0000","last_fullsized":"2023-12-24T20:08:39.245788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.275303+0000","last_change":"2023-12-24T20:08:38.246604+0000","last_active":"2023-12-24T20:08:39.275303+0000","last_peered":"2023-12-24T20:08:39.275303+0000","last_clean":"2023-12-24T20:08:39.275303+0000","last_became_active":"2023-12-24T20:08:38.246300+0000","last_became_peered":"2023-12-24T20:08:38.246300+0000","last_unstale":"2023-12-24T20:08:39.275303+0000","last_undegraded":"2023-12-24T20:08:39.275303+0000","last_fullsized":"2023-12-24T20:08:39.275303+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:17.334028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.268365+0000","last_change":"2023-12-24T20:08:39.258550+0000","last_active":"2023-12-24T20:08:39.268365+0000","last_peered":"2023-12-24T20:08:39.268365+0000","last_clean":"2023-12-24T20:08:39.268365+0000","last_became_active":"2023-12-24T20:08:39.258267+0000","last_became_peered":"2023-12-24T20:08:39.258267+0000","last_unstale":"2023-12-24T20:08:39.268365+0000","last_undegraded":"2023-12-24T20:08:39.268365+0000","last_fullsized":"2023-12-24T20:08:39.268365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.872081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263266+0000","last_change":"2023-12-24T20:08:39.252283+0000","last_active":"2023-12-24T20:08:39.263266+0000","last_peered":"2023-12-24T20:08:39.263266+0000","last_clean":"2023-12-24T20:08:39.263266+0000","last_became_active":"2023-12-24T20:08:39.251971+0000","last_became_peered":"2023-12-24T20:08:39.251971+0000","last_unstale":"2023-12-24T20:08:39.263266+0000","last_undegraded":"2023-12-24T20:08:39.263266+0000","last_fullsized":"2023-12-24T20:08:39.263266+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:17.713632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229002+0000","last_change":"2023-12-24T20:08:38.243723+0000","last_active":"2023-12-24T20:08:39.229002+0000","last_peered":"2023-12-24T20:08:39.229002+0000","last_clean":"2023-12-24T20:08:39.229002+0000","last_became_active":"2023-12-24T20:08:38.243019+0000","last_became_peered":"2023-12-24T20:08:38.243019+0000","last_unstale":"2023-12-24T20:08:39.229002+0000","last_undegraded":"2023-12-24T20:08:39.229002+0000","last_fullsized":"2023-12-24T20:08:39.229002+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:35.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.249982+0000","last_change":"2023-12-24T20:08:39.243493+0000","last_active":"2023-12-24T20:08:39.249982+0000","last_peered":"2023-12-24T20:08:39.249982+0000","last_clean":"2023-12-24T20:08:39.249982+0000","last_became_active":"2023-12-24T20:08:39.243091+0000","last_became_peered":"2023-12-24T20:08:39.243091+0000","last_unstale":"2023-12-24T20:08:39.249982+0000","last_undegraded":"2023-12-24T20:08:39.249982+0000","last_fullsized":"2023-12-24T20:08:39.249982+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:33.552641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243182+0000","last_change":"2023-12-24T20:08:39.239953+0000","last_active":"2023-12-24T20:08:39.243182+0000","last_peered":"2023-12-24T20:08:39.243182+0000","last_clean":"2023-12-24T20:08:39.243182+0000","last_became_active":"2023-12-24T20:08:39.239598+0000","last_became_peered":"2023-12-24T20:08:39.239598+0000","last_unstale":"2023-12-24T20:08:39.243182+0000","last_undegraded":"2023-12-24T20:08:39.243182+0000","last_fullsized":"2023-12-24T20:08:39.243182+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:22.720213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229366+0000","last_change":"2023-12-24T20:08:38.243949+0000","last_active":"2023-12-24T20:08:39.229366+0000","last_peered":"2023-12-24T20:08:39.229366+0000","last_clean":"2023-12-24T20:08:39.229366+0000","last_became_active":"2023-12-24T20:08:38.243446+0000","last_became_peered":"2023-12-24T20:08:38.243446+0000","last_unstale":"2023-12-24T20:08:39.229366+0000","last_undegraded":"2023-12-24T20:08:39.229366+0000","last_fullsized":"2023-12-24T20:08:39.229366+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:52.516275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.267639+0000","last_change":"2023-12-24T20:08:39.257209+0000","last_active":"2023-12-24T20:08:39.267639+0000","last_peered":"2023-12-24T20:08:39.267639+0000","last_clean":"2023-12-24T20:08:39.267639+0000","last_became_active":"2023-12-24T20:08:39.256410+0000","last_became_peered":"2023-12-24T20:08:39.256410+0000","last_unstale":"2023-12-24T20:08:39.267639+0000","last_undegraded":"2023-12-24T20:08:39.267639+0000","last_fullsized":"2023-12-24T20:08:39.267639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:26.287672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229549+0000","last_change":"2023-12-24T20:08:38.250060+0000","last_active":"2023-12-24T20:08:39.229549+0000","last_peered":"2023-12-24T20:08:39.229549+0000","last_clean":"2023-12-24T20:08:39.229549+0000","last_became_active":"2023-12-24T20:08:38.249746+0000","last_became_peered":"2023-12-24T20:08:38.249746+0000","last_unstale":"2023-12-24T20:08:39.229549+0000","last_undegraded":"2023-12-24T20:08:39.229549+0000","last_fullsized":"2023-12-24T20:08:39.229549+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:33.428126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.250034+0000","last_change":"2023-12-24T20:08:39.244572+0000","last_active":"2023-12-24T20:08:39.250034+0000","last_peered":"2023-12-24T20:08:39.250034+0000","last_clean":"2023-12-24T20:08:39.250034+0000","last_became_active":"2023-12-24T20:08:39.244190+0000","last_became_peered":"2023-12-24T20:08:39.244190+0000","last_unstale":"2023-12-24T20:08:39.250034+0000","last_undegraded":"2023-12-24T20:08:39.250034+0000","last_fullsized":"2023-12-24T20:08:39.250034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:30:43.712363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:38.203809+0000","last_change":"2023-12-24T20:08:38.203809+0000","last_active":"2023-12-24T20:08:38.203809+0000","last_peered":"2023-12-24T20:08:38.203809+0000","last_clean":"2023-12-24T20:08:38.203809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:38.203809+0000","last_undegraded":"2023-12-24T20:08:38.203809+0000","last_fullsized":"2023-12-24T20:08:38.203809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:08:37.189086+0000","last_change":"2023-12-24T20:08:37.189086+0000","last_active":"2023-12-24T20:08:37.189086+0000","last_peered":"2023-12-24T20:08:37.189086+0000","last_clean":"2023-12-24T20:08:37.189086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:08:37.189086+0000","last_undegraded":"2023-12-24T20:08:37.189086+0000","last_fullsized":"2023-12-24T20:08:37.189086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1039,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-12-24T20:08:34.817020+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:08:34.817020+0000","last_peered":"2023-12-24T20:08:34.817020+0000","last_clean":"2023-12-24T20:08:34.817020+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:08:34.817020+0000","last_undegraded":"2023-12-24T20:08:34.817020+0000","last_fullsized":"2023-12-24T20:08:34.817020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067564,"statfs":{"total":96636764160,"available":96325185536,"internally_reserved":0,"allocated":2961408,"data_stored":1828371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1339999999999999,"15min":1.163},"min":{"1min":0.73399999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.46,"5min":1.728,"15min":1.728},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.179,"15min":1.1799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.028}]},{"osd":1,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.163,"15min":1.169},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.518,"5min":1.718,"15min":1.9379999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.29,"15min":1.2669999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7130000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1459999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.262},"min":{"1min":0.92500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.514,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.274},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.85999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5580000000000001,"5min":1.752,"15min":1.8200000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.3280000000000001,"15min":1.319},"min":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6319999999999999,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.089},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":0.89200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.641,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.323}]},{"osd":4,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.246,"15min":1.214},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.865,"5min":1.865,"15min":2.194},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.3360000000000001,"15min":1.2769999999999999},"min":{"1min":0.88700000000000001,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":0.96699999999999997,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.873,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.411,"15min":1.3540000000000001},"min":{"1min":0.90600000000000003,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.377}]},{"osd":6,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4790000000000001,"15min":1.444},"min":{"1min":1.1040000000000001,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.3319999999999999},"last":1.484},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":1.004,"5min":0.75600000000000001,"15min":0.55000000000000004},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299600,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072240,"statfs":{"total":96636764160,"available":96329973760,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2929999999999999,"15min":1.3129999999999999},"min":{"1min":0.97299999999999998,"5min":0.66800000000000004,"15min":0.44500000000000001},"max":{"1min":1.645,"5min":1.7210000000000001,"15min":1.837},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":1.1759999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6160000000000001,"5min":1.744,"15min":1.821},"last":0.92200000000000004}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.1779999999999999},"min":{"1min":0.90400000000000003,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.4870000000000001,"5min":1.663,"15min":1.663},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1990000000000001,"15min":1.2270000000000001},"min":{"1min":0.95499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.4279999999999999,"5min":1.6899999999999999,"15min":1.784},"last":1.1890000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.96799999999999997,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.6240000000000001,"5min":1.6459999999999999,"15min":1.827},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.94999999999999996,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.589,"5min":1.758,"15min":1.768},"last":1.548}]},{"osd":3,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3069999999999999,"15min":1.298},"min":{"1min":0.98699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.8879999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3160000000000001,"15min":1.3109999999999999},"min":{"1min":1.1240000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":1.7010000000000001,"15min":1.8360000000000001},"last":1.2370000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.22,"15min":1.208},"min":{"1min":0.79500000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.6599999999999999,"5min":1.7110000000000001,"15min":1.9039999999999999},"last":1.482},{"interface":"front","average":{"1min":1.242,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.67000000000000004,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.8580000000000001},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.258},"min":{"1min":0.79100000000000004,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.9370000000000001},"last":1.407},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.373,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5820000000000001,"5min":1.839,"15min":1.954},"last":1.2809999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3959999999999999,"15min":1.403},"min":{"1min":1.1200000000000001,"5min":0.60599999999999998,"15min":0.55800000000000005},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.9710000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4159999999999999,"15min":1.407},"min":{"1min":0.97799999999999998,"5min":0.73399999999999999,"15min":0.65300000000000002},"max":{"1min":1.7549999999999999,"5min":1.804,"15min":2.0259999999999998},"last":1.1299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311888,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059952,"statfs":{"total":96636764160,"available":96317390848,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.268},"min":{"1min":0.871,"5min":0.77200000000000002,"15min":0.498},"max":{"1min":1.6020000000000001,"5min":1.661,"15min":1.738},"last":1.165},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.393,"15min":1.349},"min":{"1min":1.0229999999999999,"5min":0.81200000000000006,"15min":0.80300000000000005},"max":{"1min":1.597,"5min":1.7410000000000001,"15min":1.784},"last":1.143}]},{"osd":1,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.196},"min":{"1min":0.94399999999999995,"5min":0.80700000000000005,"15min":0.65100000000000002},"max":{"1min":1.5960000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.92800000000000005,"5min":0.747,"15min":0.56000000000000005},"max":{"1min":1.46,"5min":1.673,"15min":1.7210000000000001},"last":1.103}]},{"osd":2,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.90400000000000003,"5min":0.876,"15min":0.80000000000000004},"max":{"1min":1.677,"5min":1.6839999999999999,"15min":1.819},"last":1.306},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.268,"15min":1.284},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.878},"max":{"1min":1.635,"5min":1.883,"15min":1.883},"last":0.83199999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3220000000000001,"15min":1.3},"min":{"1min":1.0449999999999999,"5min":0.92300000000000004,"15min":0.75800000000000001},"max":{"1min":1.784,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.403,"15min":1.369},"min":{"1min":1.091,"5min":1.038,"15min":0.94499999999999995},"max":{"1min":1.7210000000000001,"5min":1.877,"15min":1.8799999999999999},"last":1.206}]},{"osd":4,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.61899999999999999},"max":{"1min":1.6599999999999999,"5min":1.839,"15min":1.839},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":0.98899999999999999,"5min":0.82099999999999995,"15min":0.59599999999999997},"max":{"1min":1.5920000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.351,"15min":1.325},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.796,"5min":2.008,"15min":2.008},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.373,"15min":1.3560000000000001},"min":{"1min":1.012,"5min":0.93500000000000005,"15min":0.69599999999999995},"max":{"1min":1.6930000000000001,"5min":1.7669999999999999,"15min":1.9630000000000001},"last":1.254}]},{"osd":7,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.466,"15min":1.423},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.80700000000000005},"max":{"1min":1.9370000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":1.0229999999999999,"5min":0.90600000000000003,"15min":0.85999999999999999},"max":{"1min":1.8580000000000001,"5min":1.978,"15min":2.0009999999999999},"last":1.0740000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311888,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059952,"statfs":{"total":96636764160,"available":96317390848,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.268},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67500000000000004},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.24},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.66300000000000003},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":2.012},"last":1.577}]},{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.179,"15min":1.1539999999999999},"min":{"1min":0.748,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5589999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1699999999999999,"15min":1.155},"min":{"1min":0.92300000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.694},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3380000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.84899999999999998},"max":{"1min":1.7989999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.466},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.367},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"max":{"1min":1.825,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.2989999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.91600000000000004,"5min":0.82799999999999996,"15min":0.66700000000000004},"max":{"1min":1.5229999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3129999999999999,"15min":1.3049999999999999},"min":{"1min":1.1259999999999999,"5min":0.90600000000000003,"15min":0.81699999999999995},"max":{"1min":1.6950000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.099}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.28,"15min":1.3009999999999999},"min":{"1min":0.92100000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.704,"5min":1.704,"15min":1.8169999999999999},"last":1.421},{"interface":"front","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.82199999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7290000000000001,"5min":2.0720000000000001,"15min":2.089},"last":1.669}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.878,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.571,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.385},{"interface":"front","average":{"1min":1.399,"5min":1.335,"15min":1.335},"min":{"1min":1.087,"5min":0.65700000000000003,"15min":0.51600000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.96},"last":1.343}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.27,"15min":1.3009999999999999},"min":{"1min":0.97699999999999998,"5min":0.72799999999999998,"15min":0.57099999999999995},"max":{"1min":1.865,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4410000000000001,"15min":1.423},"min":{"1min":1.0580000000000001,"5min":0.82999999999999996,"15min":0.72999999999999998},"max":{"1min":1.8879999999999999,"5min":2.0329999999999999,"15min":2.7829999999999999},"last":1.3109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":315984,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055856,"statfs":{"total":96636764160,"available":96313196544,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.885},"last":1.073},{"interface":"front","average":{"1min":1.165,"5min":1.1000000000000001,"15min":1.131},"min":{"1min":0.81299999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.6990000000000001,"15min":2.0059999999999998},"last":1.2290000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.052,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":1.6830000000000001,"5min":1.722,"15min":2.0899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.321,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.99399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6850000000000001,"5min":1.889,"15min":1.889},"last":1.319}]},{"osd":2,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1220000000000001,"15min":1.147},"min":{"1min":0.69099999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":2.0619999999999998,"15min":2.21},"last":1.373},{"interface":"front","average":{"1min":1.206,"5min":1.232,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":2.036,"5min":2.036,"15min":2.0550000000000002},"last":1.4259999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.272,"15min":1.27},"min":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.71099999999999997},"max":{"1min":1.581,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.8700000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":1.0740000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.7430000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4419999999999999,"15min":1.446},"min":{"1min":1.1200000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.7,"5min":2.0129999999999999,"15min":2.3900000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.145,"5min":1.1120000000000001,"15min":0.96099999999999997},"max":{"1min":1.956,"5min":2.032,"15min":2.2250000000000001},"last":1.554}]},{"osd":6,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5029999999999999,"15min":1.524},"min":{"1min":1.147,"5min":1.1419999999999999,"15min":1.0209999999999999},"max":{"1min":1.927,"5min":2.089,"15min":2.145},"last":1.673},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":1.0649999999999999,"5min":0.95699999999999996,"15min":0.879},"max":{"1min":1.8740000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":2.0600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.48,"15min":1.49},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.758,"5min":2.1920000000000002,"15min":2.2639999999999998},"last":2.3210000000000002},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5529999999999999,"15min":1.5609999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.913,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.9099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.3939999999999999,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5669999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":2.056},"last":1.218},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1559999999999999,"15min":1.125},"min":{"1min":0.83699999999999997,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.4670000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.27}]},{"osd":3,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2470000000000001,"15min":1.234},"min":{"1min":0.81200000000000006,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7629999999999999,"5min":1.8140000000000001,"15min":2.1659999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2130000000000001,"15min":1.163},"min":{"1min":1.034,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":1.1739999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.423,"15min":1.3919999999999999},"min":{"1min":1.228,"5min":0.96699999999999997,"15min":0.92600000000000005},"max":{"1min":1.754,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.357},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.94499999999999995},"max":{"1min":1.8149999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.774}]},{"osd":5,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.417,"15min":1.369},"min":{"1min":1.042,"5min":0.877,"15min":0.877},"max":{"1min":1.8620000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.4790000000000001,"15min":1.4650000000000001},"min":{"1min":1.1899999999999999,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0230000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.8100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.52,"15min":1.502},"min":{"1min":1.2729999999999999,"5min":1.1160000000000001,"15min":1.012},"max":{"1min":1.917,"5min":2.0779999999999998,"15min":2.1219999999999999},"last":1.653},{"interface":"front","average":{"1min":1.631,"5min":1.556,"15min":1.5109999999999999},"min":{"1min":1.357,"5min":1.1000000000000001,"15min":0.876},"max":{"1min":2.1379999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.5880000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.603,"15min":1.581},"min":{"1min":1.2190000000000001,"5min":1.048,"15min":1.048},"max":{"1min":2.1589999999999998,"5min":2.387,"15min":2.387},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.7,"5min":1.615,"15min":1.5940000000000001},"min":{"1min":1.355,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.214,"5min":2.226,"15min":2.2589999999999999},"last":1.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307792,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064048,"statfs":{"total":96636764160,"available":96321585152,"internally_reserved":0,"allocated":2367488,"data_stored":1238003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57999999999999996,"15min":0.54900000000000004},"max":{"1min":1.2809999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1759999999999999,"15min":1.1599999999999999},"min":{"1min":0.94499999999999995,"5min":0.82799999999999996,"15min":0.58199999999999996},"max":{"1min":1.49,"5min":1.657,"15min":1.671},"last":1.095}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.57799999999999996,"15min":0.41099999999999998},"max":{"1min":1.28,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.75900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.532,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.147}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.296,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.6299999999999999,"5min":1.909,"15min":1.909},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82899999999999996,"5min":0.73899999999999999,"15min":0.48899999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.8140000000000001},"last":1.409}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2689999999999999,"15min":1.284},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.63},"max":{"1min":1.73,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.4390000000000001},"min":{"1min":1.109,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7569999999999999,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.478}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.423,"15min":1.401},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.81200000000000006},"max":{"1min":1.819,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.407,"15min":1.4019999999999999},"min":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.84599999999999997},"max":{"1min":1.837,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4359999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.534,"15min":1.5229999999999999},"min":{"1min":1.1519999999999999,"5min":1.032,"15min":0.72999999999999998},"max":{"1min":2.1160000000000001,"5min":2.2410000000000001,"15min":2.3540000000000001},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.4890000000000001,"15min":1.4930000000000001},"min":{"1min":1.147,"5min":0.97899999999999998,"15min":0.86699999999999999},"max":{"1min":1.7629999999999999,"5min":2.379,"15min":2.456},"last":1.5149999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5609999999999999},"min":{"1min":1.216,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7909999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.599},{"interface":"front","average":{"1min":1.476,"5min":1.48,"15min":1.5069999999999999},"min":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.95899999999999996},"max":{"1min":1.7829999999999999,"5min":2.177,"15min":2.177},"last":1.5369999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067564,"statfs":{"total":96636764160,"available":96325185536,"internally_reserved":0,"allocated":2961408,"data_stored":1828371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.90100000000000002,"15min":0.91700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.6950000000000001},"last":1.069},{"interface":"front","average":{"1min":1.091,"5min":1.085,"15min":1.071},"min":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":1.6559999999999999,"5min":1.823,"15min":1.823},"last":1.2490000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0900000000000001,"15min":1.0960000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.615,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.214,"5min":1.167,"15min":1.163},"min":{"1min":0.82799999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5409999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.107},"min":{"1min":0.745,"5min":0.71999999999999997,"15min":0.58199999999999996},"max":{"1min":1.5820000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.012},{"interface":"front","average":{"1min":1.298,"5min":1.2729999999999999,"15min":1.284},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.331},"min":{"1min":1.0660000000000001,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6890000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.4350000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4390000000000001,"15min":1.4450000000000001},"min":{"1min":0.98099999999999998,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.8939999999999999,"5min":1.958,"15min":2.2519999999999998},"last":1.845},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4610000000000001,"15min":1.462},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.9099999999999999,"5min":2.125,"15min":2.125},"last":1.375}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.657,"5min":2.1320000000000001,"15min":2.492},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5169999999999999},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":1.9610000000000001,"5min":2.25,"15min":2.3330000000000002},"last":1.764}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.548,"15min":1.538},"min":{"1min":1.167,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.984,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5449999999999999,"15min":1.5189999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8100000000000001,"5min":2.234,"15min":2.411},"last":1.3180000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:08:43.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.185+0000 7f7b57b45700 1 Processor -- start 2023-12-24T20:08:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.185+0000 7f7b57b45700 1 -- start start 2023-12-24T20:08:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b57b45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b500cc980 0x7f7b500ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b57b45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5006d890 con 0x7f7b5015c860 2023-12-24T20:08:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b57b45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5006ca30 con 0x7f7b500b00d0 2023-12-24T20:08:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b57b45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500cd310 con 0x7f7b500cc980 2023-12-24T20:08:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b558e1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b5015c860 0x7f7b5006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35746/0 (socket says 172.21.15.50:35746) 2023-12-24T20:08:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b558e1700 1 -- 172.21.15.50:0/181870560 learned_addr learned my addr 172.21.15.50:0/181870560 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b550e0700 1 --2- 172.21.15.50:0/181870560 >> v2:172.21.15.82:3300/0 conn(0x7f7b500cc980 0x7f7b500ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804323866 0 0) 0x7f7b5006d890 con 0x7f7b5015c860 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b3c003570 con 0x7f7b5015c860 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b550e0700 1 -- 172.21.15.50:0/181870560 >> v1:172.21.15.82:6789/0 conn(0x7f7b500b00d0 legacy=0x7f7b500b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852092384 0 0) 0x7f7b5006ca30 con 0x7f7b500b00d0 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b550e0700 1 -- 172.21.15.50:0/181870560 >> v1:172.21.15.50:6789/0 conn(0x7f7b5015c860 legacy=0x7f7b5006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b550e0700 1 -- 172.21.15.50:0/181870560 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5006cc80 con 0x7f7b500cc980 2023-12-24T20:08:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.189+0000 7f7b550e0700 1 --2- 172.21.15.50:0/181870560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500ccdd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7b400098e0 tx=0x7f7b400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce56780a646f76ad server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000b640 con 0x7f7b500cc980 2023-12-24T20:08:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000b7a0 con 0x7f7b500cc980 2023-12-24T20:08:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b548df700 1 -- 172.21.15.50:0/181870560 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000bb40 con 0x7f7b500cc980 2023-12-24T20:08:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- 172.21.15.50:0/181870560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 msgr2=0x7f7b500ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 --2- 172.21.15.50:0/181870560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500ccdd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7b400098e0 tx=0x7f7b400091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- 172.21.15.50:0/181870560 shutdown_connections 2023-12-24T20:08:44.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 --2- 172.21.15.50:0/181870560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500ccdd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- 172.21.15.50:0/181870560 >> 172.21.15.50:0/181870560 conn(0x7f7b500670b0 msgr2=0x7f7b500674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:44.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- 172.21.15.50:0/181870560 shutdown_connections 2023-12-24T20:08:44.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- 172.21.15.50:0/181870560 wait complete. 2023-12-24T20:08:44.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 Processor -- start 2023-12-24T20:08:44.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.193+0000 7f7b57b45700 1 -- start start 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b500b00d0 0x7f7b500c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50157420 con 0x7f7b5015c860 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500c7030 con 0x7f7b500cc980 2023-12-24T20:08:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500c72d0 con 0x7f7b500b00d0 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46142/0 (socket says 172.21.15.50:46142) 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 -- 172.21.15.50:0/1091172124 learned_addr learned my addr 172.21.15.50:0/1091172124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b550e0700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b558e1700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b500b00d0 0x7f7b500c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 -- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b500b00d0 msgr2=0x7f7b500c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b500b00d0 0x7f7b500c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 -- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 msgr2=0x7f7b500c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 -- 172.21.15.50:0/1091172124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009420 con 0x7f7b5015c860 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b560e2700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7b48001560 tx=0x7f7b48001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48004160 con 0x7f7b5015c860 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800a7e0 con 0x7f7b5015c860 2023-12-24T20:08:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500c75b0 con 0x7f7b5015c860 2023-12-24T20:08:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800aba0 con 0x7f7b5015c860 2023-12-24T20:08:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.197+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500c7ec0 con 0x7f7b5015c860 2023-12-24T20:08:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.201+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5006b430 con 0x7f7b5015c860 2023-12-24T20:08:44.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.201+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7b48012420 con 0x7f7b5015c860 2023-12-24T20:08:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.205+0000 7f7b45ffb700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 0x7f7b34062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.205+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f7b4807c880 con 0x7f7b5015c860 2023-12-24T20:08:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.205+0000 7f7b558e1700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 0x7f7b34062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.205+0000 7f7b558e1700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 0x7f7b34062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007fd0 tx=0x7f7b4c009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.209+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7b5006b430 con 0x7f7b5015c860 2023-12-24T20:08:44.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.381+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b50157560 con 0x7f7b34060580 2023-12-24T20:08:44.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.389+0000 7f7b45ffb700 1 -- 172.21.15.50:0/1091172124 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286699 (secure 0 0 0) 0x7f7b50157560 con 0x7f7b34060580 2023-12-24T20:08:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 msgr2=0x7f7b34062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 0x7f7b34062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007fd0 tx=0x7f7b4c009040 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 msgr2=0x7f7b501578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7b48001560 tx=0x7f7b48001770 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 shutdown_connections 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7b34060580 0x7f7b34062a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5015c860 0x7f7b501578b0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b500cc980 0x7f7b500c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 --2- 172.21.15.50:0/1091172124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b500b00d0 0x7f7b500c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 >> 172.21.15.50:0/1091172124 conn(0x7f7b500670b0 msgr2=0x7f7b5015cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:44.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 shutdown_connections 2023-12-24T20:08:44.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.397+0000 7f7b57b45700 1 -- 172.21.15.50:0/1091172124 wait complete. 2023-12-24T20:08:44.404 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:08:44.424 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T20:08:44.147627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459848,"kb_used_data":20104,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752514872,"statfs":{"total":773094113280,"available":770575228928,"internally_reserved":0,"allocated":20586496,"data_stored":11314324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001948"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258154+0000","last_change":"2023-12-24T20:08:39.255111+0000","last_active":"2023-12-24T20:08:39.258154+0000","last_peered":"2023-12-24T20:08:39.258154+0000","last_clean":"2023-12-24T20:08:39.258154+0000","last_became_active":"2023-12-24T20:08:39.254695+0000","last_became_peered":"2023-12-24T20:08:39.254695+0000","last_unstale":"2023-12-24T20:08:39.258154+0000","last_undegraded":"2023-12-24T20:08:39.258154+0000","last_fullsized":"2023-12-24T20:08:39.258154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:16.694071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262123+0000","last_change":"2023-12-24T20:08:39.259699+0000","last_active":"2023-12-24T20:08:39.262123+0000","last_peered":"2023-12-24T20:08:39.262123+0000","last_clean":"2023-12-24T20:08:39.262123+0000","last_became_active":"2023-12-24T20:08:39.257235+0000","last_became_peered":"2023-12-24T20:08:39.257235+0000","last_unstale":"2023-12-24T20:08:39.262123+0000","last_undegraded":"2023-12-24T20:08:39.262123+0000","last_fullsized":"2023-12-24T20:08:39.262123+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:58:09.989946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242022+0000","last_change":"2023-12-24T20:08:39.237190+0000","last_active":"2023-12-24T20:08:39.242022+0000","last_peered":"2023-12-24T20:08:39.242022+0000","last_clean":"2023-12-24T20:08:39.242022+0000","last_became_active":"2023-12-24T20:08:39.236904+0000","last_became_peered":"2023-12-24T20:08:39.236904+0000","last_unstale":"2023-12-24T20:08:39.242022+0000","last_undegraded":"2023-12-24T20:08:39.242022+0000","last_fullsized":"2023-12-24T20:08:39.242022+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:23:49.335014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261226+0000","last_change":"2023-12-24T20:08:39.259338+0000","last_active":"2023-12-24T20:08:39.261226+0000","last_peered":"2023-12-24T20:08:39.261226+0000","last_clean":"2023-12-24T20:08:39.261226+0000","last_became_active":"2023-12-24T20:08:39.259024+0000","last_became_peered":"2023-12-24T20:08:39.259024+0000","last_unstale":"2023-12-24T20:08:39.261226+0000","last_undegraded":"2023-12-24T20:08:39.261226+0000","last_fullsized":"2023-12-24T20:08:39.261226+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:20.251605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258307+0000","last_change":"2023-12-24T20:08:39.253890+0000","last_active":"2023-12-24T20:08:39.258307+0000","last_peered":"2023-12-24T20:08:39.258307+0000","last_clean":"2023-12-24T20:08:39.258307+0000","last_became_active":"2023-12-24T20:08:39.253577+0000","last_became_peered":"2023-12-24T20:08:39.253577+0000","last_unstale":"2023-12-24T20:08:39.258307+0000","last_undegraded":"2023-12-24T20:08:39.258307+0000","last_fullsized":"2023-12-24T20:08:39.258307+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262023+0000","last_change":"2023-12-24T20:08:39.256510+0000","last_active":"2023-12-24T20:08:39.262023+0000","last_peered":"2023-12-24T20:08:39.262023+0000","last_clean":"2023-12-24T20:08:39.262023+0000","last_became_active":"2023-12-24T20:08:39.256205+0000","last_became_peered":"2023-12-24T20:08:39.256205+0000","last_unstale":"2023-12-24T20:08:39.262023+0000","last_undegraded":"2023-12-24T20:08:39.262023+0000","last_fullsized":"2023-12-24T20:08:39.262023+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:55.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270406+0000","last_change":"2023-12-24T20:08:39.265203+0000","last_active":"2023-12-24T20:08:39.270406+0000","last_peered":"2023-12-24T20:08:39.270406+0000","last_clean":"2023-12-24T20:08:39.270406+0000","last_became_active":"2023-12-24T20:08:39.262585+0000","last_became_peered":"2023-12-24T20:08:39.262585+0000","last_unstale":"2023-12-24T20:08:39.270406+0000","last_undegraded":"2023-12-24T20:08:39.270406+0000","last_fullsized":"2023-12-24T20:08:39.270406+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270503+0000","last_change":"2023-12-24T20:08:39.264824+0000","last_active":"2023-12-24T20:08:39.270503+0000","last_peered":"2023-12-24T20:08:39.270503+0000","last_clean":"2023-12-24T20:08:39.270503+0000","last_became_active":"2023-12-24T20:08:39.264265+0000","last_became_peered":"2023-12-24T20:08:39.264265+0000","last_unstale":"2023-12-24T20:08:39.270503+0000","last_undegraded":"2023-12-24T20:08:39.270503+0000","last_fullsized":"2023-12-24T20:08:39.270503+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:10.180706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270783+0000","last_change":"2023-12-24T20:08:39.267145+0000","last_active":"2023-12-24T20:08:39.270783+0000","last_peered":"2023-12-24T20:08:39.270783+0000","last_clean":"2023-12-24T20:08:39.270783+0000","last_became_active":"2023-12-24T20:08:39.266033+0000","last_became_peered":"2023-12-24T20:08:39.266033+0000","last_unstale":"2023-12-24T20:08:39.270783+0000","last_undegraded":"2023-12-24T20:08:39.270783+0000","last_fullsized":"2023-12-24T20:08:39.270783+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:46.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270491+0000","last_change":"2023-12-24T20:08:39.265894+0000","last_active":"2023-12-24T20:08:39.270491+0000","last_peered":"2023-12-24T20:08:39.270491+0000","last_clean":"2023-12-24T20:08:39.270491+0000","last_became_active":"2023-12-24T20:08:39.265604+0000","last_became_peered":"2023-12-24T20:08:39.265604+0000","last_unstale":"2023-12-24T20:08:39.270491+0000","last_undegraded":"2023-12-24T20:08:39.270491+0000","last_fullsized":"2023-12-24T20:08:39.270491+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256950+0000","last_change":"2023-12-24T20:08:39.249813+0000","last_active":"2023-12-24T20:08:39.256950+0000","last_peered":"2023-12-24T20:08:39.256950+0000","last_clean":"2023-12-24T20:08:39.256950+0000","last_became_active":"2023-12-24T20:08:39.249507+0000","last_became_peered":"2023-12-24T20:08:39.249507+0000","last_unstale":"2023-12-24T20:08:39.256950+0000","last_undegraded":"2023-12-24T20:08:39.256950+0000","last_fullsized":"2023-12-24T20:08:39.256950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261918+0000","last_change":"2023-12-24T20:08:39.259412+0000","last_active":"2023-12-24T20:08:39.261918+0000","last_peered":"2023-12-24T20:08:39.261918+0000","last_clean":"2023-12-24T20:08:39.261918+0000","last_became_active":"2023-12-24T20:08:39.257706+0000","last_became_peered":"2023-12-24T20:08:39.257706+0000","last_unstale":"2023-12-24T20:08:39.261918+0000","last_undegraded":"2023-12-24T20:08:39.261918+0000","last_fullsized":"2023-12-24T20:08:39.261918+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:25.851791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270543+0000","last_change":"2023-12-24T20:08:39.258151+0000","last_active":"2023-12-24T20:08:39.270543+0000","last_peered":"2023-12-24T20:08:39.270543+0000","last_clean":"2023-12-24T20:08:39.270543+0000","last_became_active":"2023-12-24T20:08:39.257853+0000","last_became_peered":"2023-12-24T20:08:39.257853+0000","last_unstale":"2023-12-24T20:08:39.270543+0000","last_undegraded":"2023-12-24T20:08:39.270543+0000","last_fullsized":"2023-12-24T20:08:39.270543+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:42:19.517102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263196+0000","last_change":"2023-12-24T20:08:39.255900+0000","last_active":"2023-12-24T20:08:39.263196+0000","last_peered":"2023-12-24T20:08:39.263196+0000","last_clean":"2023-12-24T20:08:39.263196+0000","last_became_active":"2023-12-24T20:08:39.254111+0000","last_became_peered":"2023-12-24T20:08:39.254111+0000","last_unstale":"2023-12-24T20:08:39.263196+0000","last_undegraded":"2023-12-24T20:08:39.263196+0000","last_fullsized":"2023-12-24T20:08:39.263196+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272078+0000","last_change":"2023-12-24T20:08:39.268992+0000","last_active":"2023-12-24T20:08:39.272078+0000","last_peered":"2023-12-24T20:08:39.272078+0000","last_clean":"2023-12-24T20:08:39.272078+0000","last_became_active":"2023-12-24T20:08:39.268661+0000","last_became_peered":"2023-12-24T20:08:39.268661+0000","last_unstale":"2023-12-24T20:08:39.272078+0000","last_undegraded":"2023-12-24T20:08:39.272078+0000","last_fullsized":"2023-12-24T20:08:39.272078+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251985+0000","last_change":"2023-12-24T20:08:39.248160+0000","last_active":"2023-12-24T20:08:39.251985+0000","last_peered":"2023-12-24T20:08:39.251985+0000","last_clean":"2023-12-24T20:08:39.251985+0000","last_became_active":"2023-12-24T20:08:39.247402+0000","last_became_peered":"2023-12-24T20:08:39.247402+0000","last_unstale":"2023-12-24T20:08:39.251985+0000","last_undegraded":"2023-12-24T20:08:39.251985+0000","last_fullsized":"2023-12-24T20:08:39.251985+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:17.120833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270764+0000","last_change":"2023-12-24T20:08:39.266760+0000","last_active":"2023-12-24T20:08:39.270764+0000","last_peered":"2023-12-24T20:08:39.270764+0000","last_clean":"2023-12-24T20:08:39.270764+0000","last_became_active":"2023-12-24T20:08:39.265577+0000","last_became_peered":"2023-12-24T20:08:39.265577+0000","last_unstale":"2023-12-24T20:08:39.270764+0000","last_undegraded":"2023-12-24T20:08:39.270764+0000","last_fullsized":"2023-12-24T20:08:39.270764+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:38.722712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261563+0000","last_change":"2023-12-24T20:08:39.255496+0000","last_active":"2023-12-24T20:08:39.261563+0000","last_peered":"2023-12-24T20:08:39.261563+0000","last_clean":"2023-12-24T20:08:39.261563+0000","last_became_active":"2023-12-24T20:08:39.254996+0000","last_became_peered":"2023-12-24T20:08:39.254996+0000","last_unstale":"2023-12-24T20:08:39.261563+0000","last_undegraded":"2023-12-24T20:08:39.261563+0000","last_fullsized":"2023-12-24T20:08:39.261563+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:33.780421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.266185+0000","last_change":"2023-12-24T20:08:39.264683+0000","last_active":"2023-12-24T20:08:39.266185+0000","last_peered":"2023-12-24T20:08:39.266185+0000","last_clean":"2023-12-24T20:08:39.266185+0000","last_became_active":"2023-12-24T20:08:39.264342+0000","last_became_peered":"2023-12-24T20:08:39.264342+0000","last_unstale":"2023-12-24T20:08:39.266185+0000","last_undegraded":"2023-12-24T20:08:39.266185+0000","last_fullsized":"2023-12-24T20:08:39.266185+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269363+0000","last_change":"2023-12-24T20:08:39.257674+0000","last_active":"2023-12-24T20:08:39.269363+0000","last_peered":"2023-12-24T20:08:39.269363+0000","last_clean":"2023-12-24T20:08:39.269363+0000","last_became_active":"2023-12-24T20:08:39.257389+0000","last_became_peered":"2023-12-24T20:08:39.257389+0000","last_unstale":"2023-12-24T20:08:39.269363+0000","last_undegraded":"2023-12-24T20:08:39.269363+0000","last_fullsized":"2023-12-24T20:08:39.269363+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:26.974198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271002+0000","last_change":"2023-12-24T20:08:39.258398+0000","last_active":"2023-12-24T20:08:39.271002+0000","last_peered":"2023-12-24T20:08:39.271002+0000","last_clean":"2023-12-24T20:08:39.271002+0000","last_became_active":"2023-12-24T20:08:39.257772+0000","last_became_peered":"2023-12-24T20:08:39.257772+0000","last_unstale":"2023-12-24T20:08:39.271002+0000","last_undegraded":"2023-12-24T20:08:39.271002+0000","last_fullsized":"2023-12-24T20:08:39.271002+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:56.189952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261999+0000","last_change":"2023-12-24T20:08:39.256454+0000","last_active":"2023-12-24T20:08:39.261999+0000","last_peered":"2023-12-24T20:08:39.261999+0000","last_clean":"2023-12-24T20:08:39.261999+0000","last_became_active":"2023-12-24T20:08:39.256157+0000","last_became_peered":"2023-12-24T20:08:39.256157+0000","last_unstale":"2023-12-24T20:08:39.261999+0000","last_undegraded":"2023-12-24T20:08:39.261999+0000","last_fullsized":"2023-12-24T20:08:39.261999+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:48.478125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261598+0000","last_change":"2023-12-24T20:08:39.254994+0000","last_active":"2023-12-24T20:08:39.261598+0000","last_peered":"2023-12-24T20:08:39.261598+0000","last_clean":"2023-12-24T20:08:39.261598+0000","last_became_active":"2023-12-24T20:08:39.254531+0000","last_became_peered":"2023-12-24T20:08:39.254531+0000","last_unstale":"2023-12-24T20:08:39.261598+0000","last_undegraded":"2023-12-24T20:08:39.261598+0000","last_fullsized":"2023-12-24T20:08:39.261598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:48:23.827865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251966+0000","last_change":"2023-12-24T20:08:39.247588+0000","last_active":"2023-12-24T20:08:39.251966+0000","last_peered":"2023-12-24T20:08:39.251966+0000","last_clean":"2023-12-24T20:08:39.251966+0000","last_became_active":"2023-12-24T20:08:39.247017+0000","last_became_peered":"2023-12-24T20:08:39.247017+0000","last_unstale":"2023-12-24T20:08:39.251966+0000","last_undegraded":"2023-12-24T20:08:39.251966+0000","last_fullsized":"2023-12-24T20:08:39.251966+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:46.594765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271550+0000","last_change":"2023-12-24T20:08:39.258623+0000","last_active":"2023-12-24T20:08:39.271550+0000","last_peered":"2023-12-24T20:08:39.271550+0000","last_clean":"2023-12-24T20:08:39.271550+0000","last_became_active":"2023-12-24T20:08:39.258321+0000","last_became_peered":"2023-12-24T20:08:39.258321+0000","last_unstale":"2023-12-24T20:08:39.271550+0000","last_undegraded":"2023-12-24T20:08:39.271550+0000","last_fullsized":"2023-12-24T20:08:39.271550+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:23:45.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.245788+0000","last_change":"2023-12-24T20:08:39.241938+0000","last_active":"2023-12-24T20:08:39.245788+0000","last_peered":"2023-12-24T20:08:39.245788+0000","last_clean":"2023-12-24T20:08:39.245788+0000","last_became_active":"2023-12-24T20:08:39.241578+0000","last_became_peered":"2023-12-24T20:08:39.241578+0000","last_unstale":"2023-12-24T20:08:39.245788+0000","last_undegraded":"2023-12-24T20:08:39.245788+0000","last_fullsized":"2023-12-24T20:08:39.245788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260365+0000","last_change":"2023-12-24T20:08:39.255883+0000","last_active":"2023-12-24T20:08:39.260365+0000","last_peered":"2023-12-24T20:08:39.260365+0000","last_clean":"2023-12-24T20:08:39.260365+0000","last_became_active":"2023-12-24T20:08:39.255588+0000","last_became_peered":"2023-12-24T20:08:39.255588+0000","last_unstale":"2023-12-24T20:08:39.260365+0000","last_undegraded":"2023-12-24T20:08:39.260365+0000","last_fullsized":"2023-12-24T20:08:39.260365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:42:28.887874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271234+0000","last_change":"2023-12-24T20:08:39.260289+0000","last_active":"2023-12-24T20:08:39.271234+0000","last_peered":"2023-12-24T20:08:39.271234+0000","last_clean":"2023-12-24T20:08:39.271234+0000","last_became_active":"2023-12-24T20:08:39.259821+0000","last_became_peered":"2023-12-24T20:08:39.259821+0000","last_unstale":"2023-12-24T20:08:39.271234+0000","last_undegraded":"2023-12-24T20:08:39.271234+0000","last_fullsized":"2023-12-24T20:08:39.271234+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.265923+0000","last_change":"2023-12-24T20:08:39.264321+0000","last_active":"2023-12-24T20:08:39.265923+0000","last_peered":"2023-12-24T20:08:39.265923+0000","last_clean":"2023-12-24T20:08:39.265923+0000","last_became_active":"2023-12-24T20:08:39.263895+0000","last_became_peered":"2023-12-24T20:08:39.263895+0000","last_unstale":"2023-12-24T20:08:39.265923+0000","last_undegraded":"2023-12-24T20:08:39.265923+0000","last_fullsized":"2023-12-24T20:08:39.265923+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:05.893308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259457+0000","last_change":"2023-12-24T20:08:39.250850+0000","last_active":"2023-12-24T20:08:39.259457+0000","last_peered":"2023-12-24T20:08:39.259457+0000","last_clean":"2023-12-24T20:08:39.259457+0000","last_became_active":"2023-12-24T20:08:39.250550+0000","last_became_peered":"2023-12-24T20:08:39.250550+0000","last_unstale":"2023-12-24T20:08:39.259457+0000","last_undegraded":"2023-12-24T20:08:39.259457+0000","last_fullsized":"2023-12-24T20:08:39.259457+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:23:20.667204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256598+0000","last_change":"2023-12-24T20:08:39.252094+0000","last_active":"2023-12-24T20:08:39.256598+0000","last_peered":"2023-12-24T20:08:39.256598+0000","last_clean":"2023-12-24T20:08:39.256598+0000","last_became_active":"2023-12-24T20:08:39.251788+0000","last_became_peered":"2023-12-24T20:08:39.251788+0000","last_unstale":"2023-12-24T20:08:39.256598+0000","last_undegraded":"2023-12-24T20:08:39.256598+0000","last_fullsized":"2023-12-24T20:08:39.256598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259153+0000","last_change":"2023-12-24T20:08:39.253505+0000","last_active":"2023-12-24T20:08:39.259153+0000","last_peered":"2023-12-24T20:08:39.259153+0000","last_clean":"2023-12-24T20:08:39.259153+0000","last_became_active":"2023-12-24T20:08:39.253214+0000","last_became_peered":"2023-12-24T20:08:39.253214+0000","last_unstale":"2023-12-24T20:08:39.259153+0000","last_undegraded":"2023-12-24T20:08:39.259153+0000","last_fullsized":"2023-12-24T20:08:39.259153+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:49.615897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272168+0000","last_change":"2023-12-24T20:08:39.267015+0000","last_active":"2023-12-24T20:08:39.272168+0000","last_peered":"2023-12-24T20:08:39.272168+0000","last_clean":"2023-12-24T20:08:39.272168+0000","last_became_active":"2023-12-24T20:08:39.266103+0000","last_became_peered":"2023-12-24T20:08:39.266103+0000","last_unstale":"2023-12-24T20:08:39.272168+0000","last_undegraded":"2023-12-24T20:08:39.272168+0000","last_fullsized":"2023-12-24T20:08:39.272168+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:52.239952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"192'4","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276783+0000","last_change":"2023-12-24T20:08:38.240700+0000","last_active":"2023-12-24T20:08:39.276783+0000","last_peered":"2023-12-24T20:08:39.276783+0000","last_clean":"2023-12-24T20:08:39.276783+0000","last_became_active":"2023-12-24T20:08:38.240414+0000","last_became_peered":"2023-12-24T20:08:38.240414+0000","last_unstale":"2023-12-24T20:08:39.276783+0000","last_undegraded":"2023-12-24T20:08:39.276783+0000","last_fullsized":"2023-12-24T20:08:39.276783+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:47.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270472+0000","last_change":"2023-12-24T20:08:39.256207+0000","last_active":"2023-12-24T20:08:39.270472+0000","last_peered":"2023-12-24T20:08:39.270472+0000","last_clean":"2023-12-24T20:08:39.270472+0000","last_became_active":"2023-12-24T20:08:39.255922+0000","last_became_peered":"2023-12-24T20:08:39.255922+0000","last_unstale":"2023-12-24T20:08:39.270472+0000","last_undegraded":"2023-12-24T20:08:39.270472+0000","last_fullsized":"2023-12-24T20:08:39.270472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:39.770243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281278+0000","last_change":"2023-12-24T20:08:38.255635+0000","last_active":"2023-12-24T20:08:39.281278+0000","last_peered":"2023-12-24T20:08:39.281278+0000","last_clean":"2023-12-24T20:08:39.281278+0000","last_became_active":"2023-12-24T20:08:38.255261+0000","last_became_peered":"2023-12-24T20:08:38.255261+0000","last_unstale":"2023-12-24T20:08:39.281278+0000","last_undegraded":"2023-12-24T20:08:39.281278+0000","last_fullsized":"2023-12-24T20:08:39.281278+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263177+0000","last_change":"2023-12-24T20:08:39.254070+0000","last_active":"2023-12-24T20:08:39.263177+0000","last_peered":"2023-12-24T20:08:39.263177+0000","last_clean":"2023-12-24T20:08:39.263177+0000","last_became_active":"2023-12-24T20:08:39.253766+0000","last_became_peered":"2023-12-24T20:08:39.253766+0000","last_unstale":"2023-12-24T20:08:39.263177+0000","last_undegraded":"2023-12-24T20:08:39.263177+0000","last_fullsized":"2023-12-24T20:08:39.263177+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.274202+0000","last_change":"2023-12-24T20:08:38.244714+0000","last_active":"2023-12-24T20:08:39.274202+0000","last_peered":"2023-12-24T20:08:39.274202+0000","last_clean":"2023-12-24T20:08:39.274202+0000","last_became_active":"2023-12-24T20:08:38.244411+0000","last_became_peered":"2023-12-24T20:08:38.244411+0000","last_unstale":"2023-12-24T20:08:39.274202+0000","last_undegraded":"2023-12-24T20:08:39.274202+0000","last_fullsized":"2023-12-24T20:08:39.274202+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269382+0000","last_change":"2023-12-24T20:08:39.265824+0000","last_active":"2023-12-24T20:08:39.269382+0000","last_peered":"2023-12-24T20:08:39.269382+0000","last_clean":"2023-12-24T20:08:39.269382+0000","last_became_active":"2023-12-24T20:08:39.265356+0000","last_became_peered":"2023-12-24T20:08:39.265356+0000","last_unstale":"2023-12-24T20:08:39.269382+0000","last_undegraded":"2023-12-24T20:08:39.269382+0000","last_fullsized":"2023-12-24T20:08:39.269382+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:40.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.275303+0000","last_change":"2023-12-24T20:08:38.246604+0000","last_active":"2023-12-24T20:08:39.275303+0000","last_peered":"2023-12-24T20:08:39.275303+0000","last_clean":"2023-12-24T20:08:39.275303+0000","last_became_active":"2023-12-24T20:08:38.246300+0000","last_became_peered":"2023-12-24T20:08:38.246300+0000","last_unstale":"2023-12-24T20:08:39.275303+0000","last_undegraded":"2023-12-24T20:08:39.275303+0000","last_fullsized":"2023-12-24T20:08:39.275303+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:17.334028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270531+0000","last_change":"2023-12-24T20:08:39.266196+0000","last_active":"2023-12-24T20:08:39.270531+0000","last_peered":"2023-12-24T20:08:39.270531+0000","last_clean":"2023-12-24T20:08:39.270531+0000","last_became_active":"2023-12-24T20:08:39.265163+0000","last_became_peered":"2023-12-24T20:08:39.265163+0000","last_unstale":"2023-12-24T20:08:39.270531+0000","last_undegraded":"2023-12-24T20:08:39.270531+0000","last_fullsized":"2023-12-24T20:08:39.270531+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:12:25.048378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278364+0000","last_change":"2023-12-24T20:08:38.255319+0000","last_active":"2023-12-24T20:08:39.278364+0000","last_peered":"2023-12-24T20:08:39.278364+0000","last_clean":"2023-12-24T20:08:39.278364+0000","last_became_active":"2023-12-24T20:08:38.255035+0000","last_became_peered":"2023-12-24T20:08:38.255035+0000","last_unstale":"2023-12-24T20:08:39.278364+0000","last_undegraded":"2023-12-24T20:08:39.278364+0000","last_fullsized":"2023-12-24T20:08:39.278364+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.268365+0000","last_change":"2023-12-24T20:08:39.258550+0000","last_active":"2023-12-24T20:08:39.268365+0000","last_peered":"2023-12-24T20:08:39.268365+0000","last_clean":"2023-12-24T20:08:39.268365+0000","last_became_active":"2023-12-24T20:08:39.258267+0000","last_became_peered":"2023-12-24T20:08:39.258267+0000","last_unstale":"2023-12-24T20:08:39.268365+0000","last_undegraded":"2023-12-24T20:08:39.268365+0000","last_fullsized":"2023-12-24T20:08:39.268365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.872081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281648+0000","last_change":"2023-12-24T20:08:38.256797+0000","last_active":"2023-12-24T20:08:39.281648+0000","last_peered":"2023-12-24T20:08:39.281648+0000","last_clean":"2023-12-24T20:08:39.281648+0000","last_became_active":"2023-12-24T20:08:38.256462+0000","last_became_peered":"2023-12-24T20:08:38.256462+0000","last_unstale":"2023-12-24T20:08:39.281648+0000","last_undegraded":"2023-12-24T20:08:39.281648+0000","last_fullsized":"2023-12-24T20:08:39.281648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263266+0000","last_change":"2023-12-24T20:08:39.252283+0000","last_active":"2023-12-24T20:08:39.263266+0000","last_peered":"2023-12-24T20:08:39.263266+0000","last_clean":"2023-12-24T20:08:39.263266+0000","last_became_active":"2023-12-24T20:08:39.251971+0000","last_became_peered":"2023-12-24T20:08:39.251971+0000","last_unstale":"2023-12-24T20:08:39.263266+0000","last_undegraded":"2023-12-24T20:08:39.263266+0000","last_fullsized":"2023-12-24T20:08:39.263266+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:17.713632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229002+0000","last_change":"2023-12-24T20:08:38.243723+0000","last_active":"2023-12-24T20:08:39.229002+0000","last_peered":"2023-12-24T20:08:39.229002+0000","last_clean":"2023-12-24T20:08:39.229002+0000","last_became_active":"2023-12-24T20:08:38.243019+0000","last_became_peered":"2023-12-24T20:08:38.243019+0000","last_unstale":"2023-12-24T20:08:39.229002+0000","last_undegraded":"2023-12-24T20:08:39.229002+0000","last_fullsized":"2023-12-24T20:08:39.229002+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:35.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255044+0000","last_change":"2023-12-24T20:08:39.248182+0000","last_active":"2023-12-24T20:08:39.255044+0000","last_peered":"2023-12-24T20:08:39.255044+0000","last_clean":"2023-12-24T20:08:39.255044+0000","last_became_active":"2023-12-24T20:08:39.247850+0000","last_became_peered":"2023-12-24T20:08:39.247850+0000","last_unstale":"2023-12-24T20:08:39.255044+0000","last_undegraded":"2023-12-24T20:08:39.255044+0000","last_fullsized":"2023-12-24T20:08:39.255044+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:42.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243004+0000","last_change":"2023-12-24T20:08:38.253034+0000","last_active":"2023-12-24T20:08:39.243004+0000","last_peered":"2023-12-24T20:08:39.243004+0000","last_clean":"2023-12-24T20:08:39.243004+0000","last_became_active":"2023-12-24T20:08:38.252713+0000","last_became_peered":"2023-12-24T20:08:38.252713+0000","last_unstale":"2023-12-24T20:08:39.243004+0000","last_undegraded":"2023-12-24T20:08:39.243004+0000","last_fullsized":"2023-12-24T20:08:39.243004+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272150+0000","last_change":"2023-12-24T20:08:39.267266+0000","last_active":"2023-12-24T20:08:39.272150+0000","last_peered":"2023-12-24T20:08:39.272150+0000","last_clean":"2023-12-24T20:08:39.272150+0000","last_became_active":"2023-12-24T20:08:39.266976+0000","last_became_peered":"2023-12-24T20:08:39.266976+0000","last_unstale":"2023-12-24T20:08:39.272150+0000","last_undegraded":"2023-12-24T20:08:39.272150+0000","last_fullsized":"2023-12-24T20:08:39.272150+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:06.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.241865+0000","last_change":"2023-12-24T20:08:38.254881+0000","last_active":"2023-12-24T20:08:39.241865+0000","last_peered":"2023-12-24T20:08:39.241865+0000","last_clean":"2023-12-24T20:08:39.241865+0000","last_became_active":"2023-12-24T20:08:38.254519+0000","last_became_peered":"2023-12-24T20:08:38.254519+0000","last_unstale":"2023-12-24T20:08:39.241865+0000","last_undegraded":"2023-12-24T20:08:39.241865+0000","last_fullsized":"2023-12-24T20:08:39.241865+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:23.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271183+0000","last_change":"2023-12-24T20:08:39.258291+0000","last_active":"2023-12-24T20:08:39.271183+0000","last_peered":"2023-12-24T20:08:39.271183+0000","last_clean":"2023-12-24T20:08:39.271183+0000","last_became_active":"2023-12-24T20:08:39.255972+0000","last_became_peered":"2023-12-24T20:08:39.255972+0000","last_unstale":"2023-12-24T20:08:39.271183+0000","last_undegraded":"2023-12-24T20:08:39.271183+0000","last_fullsized":"2023-12-24T20:08:39.271183+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:13.784610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269848+0000","last_change":"2023-12-24T20:08:38.239476+0000","last_active":"2023-12-24T20:08:39.269848+0000","last_peered":"2023-12-24T20:08:39.269848+0000","last_clean":"2023-12-24T20:08:39.269848+0000","last_became_active":"2023-12-24T20:08:38.239171+0000","last_became_peered":"2023-12-24T20:08:38.239171+0000","last_unstale":"2023-12-24T20:08:39.269848+0000","last_undegraded":"2023-12-24T20:08:39.269848+0000","last_fullsized":"2023-12-24T20:08:39.269848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T08:00:49.593212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.249982+0000","last_change":"2023-12-24T20:08:39.243493+0000","last_active":"2023-12-24T20:08:39.249982+0000","last_peered":"2023-12-24T20:08:39.249982+0000","last_clean":"2023-12-24T20:08:39.249982+0000","last_became_active":"2023-12-24T20:08:39.243091+0000","last_became_peered":"2023-12-24T20:08:39.243091+0000","last_unstale":"2023-12-24T20:08:39.249982+0000","last_undegraded":"2023-12-24T20:08:39.249982+0000","last_fullsized":"2023-12-24T20:08:39.249982+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:33.552641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"192'6","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.284188+0000","last_change":"2023-12-24T20:08:38.251434+0000","last_active":"2023-12-24T20:08:39.284188+0000","last_peered":"2023-12-24T20:08:39.284188+0000","last_clean":"2023-12-24T20:08:39.284188+0000","last_became_active":"2023-12-24T20:08:38.249590+0000","last_became_peered":"2023-12-24T20:08:38.249590+0000","last_unstale":"2023-12-24T20:08:39.284188+0000","last_undegraded":"2023-12-24T20:08:39.284188+0000","last_fullsized":"2023-12-24T20:08:39.284188+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:14.934133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259751+0000","last_change":"2023-12-24T20:08:39.252251+0000","last_active":"2023-12-24T20:08:39.259751+0000","last_peered":"2023-12-24T20:08:39.259751+0000","last_clean":"2023-12-24T20:08:39.259751+0000","last_became_active":"2023-12-24T20:08:39.251277+0000","last_became_peered":"2023-12-24T20:08:39.251277+0000","last_unstale":"2023-12-24T20:08:39.259751+0000","last_undegraded":"2023-12-24T20:08:39.259751+0000","last_fullsized":"2023-12-24T20:08:39.259751+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:04.044223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281622+0000","last_change":"2023-12-24T20:08:38.244032+0000","last_active":"2023-12-24T20:08:39.281622+0000","last_peered":"2023-12-24T20:08:39.281622+0000","last_clean":"2023-12-24T20:08:39.281622+0000","last_became_active":"2023-12-24T20:08:38.243765+0000","last_became_peered":"2023-12-24T20:08:38.243765+0000","last_unstale":"2023-12-24T20:08:39.281622+0000","last_undegraded":"2023-12-24T20:08:39.281622+0000","last_fullsized":"2023-12-24T20:08:39.281622+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.264695+0000","last_change":"2023-12-24T20:08:39.256123+0000","last_active":"2023-12-24T20:08:39.264695+0000","last_peered":"2023-12-24T20:08:39.264695+0000","last_clean":"2023-12-24T20:08:39.264695+0000","last_became_active":"2023-12-24T20:08:39.255845+0000","last_became_peered":"2023-12-24T20:08:39.255845+0000","last_unstale":"2023-12-24T20:08:39.264695+0000","last_undegraded":"2023-12-24T20:08:39.264695+0000","last_fullsized":"2023-12-24T20:08:39.264695+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240884+0000","last_change":"2023-12-24T20:08:38.254571+0000","last_active":"2023-12-24T20:08:39.240884+0000","last_peered":"2023-12-24T20:08:39.240884+0000","last_clean":"2023-12-24T20:08:39.240884+0000","last_became_active":"2023-12-24T20:08:38.253910+0000","last_became_peered":"2023-12-24T20:08:38.253910+0000","last_unstale":"2023-12-24T20:08:39.240884+0000","last_undegraded":"2023-12-24T20:08:39.240884+0000","last_fullsized":"2023-12-24T20:08:39.240884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:56.484325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.254492+0000","last_change":"2023-12-24T20:08:39.251583+0000","last_active":"2023-12-24T20:08:39.254492+0000","last_peered":"2023-12-24T20:08:39.254492+0000","last_clean":"2023-12-24T20:08:39.254492+0000","last_became_active":"2023-12-24T20:08:39.250926+0000","last_became_peered":"2023-12-24T20:08:39.250926+0000","last_unstale":"2023-12-24T20:08:39.254492+0000","last_undegraded":"2023-12-24T20:08:39.254492+0000","last_fullsized":"2023-12-24T20:08:39.254492+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240566+0000","last_change":"2023-12-24T20:08:38.252005+0000","last_active":"2023-12-24T20:08:39.240566+0000","last_peered":"2023-12-24T20:08:39.240566+0000","last_clean":"2023-12-24T20:08:39.240566+0000","last_became_active":"2023-12-24T20:08:38.251718+0000","last_became_peered":"2023-12-24T20:08:38.251718+0000","last_unstale":"2023-12-24T20:08:39.240566+0000","last_undegraded":"2023-12-24T20:08:39.240566+0000","last_fullsized":"2023-12-24T20:08:39.240566+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243182+0000","last_change":"2023-12-24T20:08:39.239953+0000","last_active":"2023-12-24T20:08:39.243182+0000","last_peered":"2023-12-24T20:08:39.243182+0000","last_clean":"2023-12-24T20:08:39.243182+0000","last_became_active":"2023-12-24T20:08:39.239598+0000","last_became_peered":"2023-12-24T20:08:39.239598+0000","last_unstale":"2023-12-24T20:08:39.243182+0000","last_undegraded":"2023-12-24T20:08:39.243182+0000","last_fullsized":"2023-12-24T20:08:39.243182+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:22.720213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"192'8","reported_seq":18,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281579+0000","last_change":"2023-12-24T20:08:38.247901+0000","last_active":"2023-12-24T20:08:39.281579+0000","last_peered":"2023-12-24T20:08:39.281579+0000","last_clean":"2023-12-24T20:08:39.281579+0000","last_became_active":"2023-12-24T20:08:38.247604+0000","last_became_peered":"2023-12-24T20:08:38.247604+0000","last_unstale":"2023-12-24T20:08:39.281579+0000","last_undegraded":"2023-12-24T20:08:39.281579+0000","last_fullsized":"2023-12-24T20:08:39.281579+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276940+0000","last_change":"2023-12-24T20:08:39.270339+0000","last_active":"2023-12-24T20:08:39.276940+0000","last_peered":"2023-12-24T20:08:39.276940+0000","last_clean":"2023-12-24T20:08:39.276940+0000","last_became_active":"2023-12-24T20:08:39.270031+0000","last_became_peered":"2023-12-24T20:08:39.270031+0000","last_unstale":"2023-12-24T20:08:39.276940+0000","last_undegraded":"2023-12-24T20:08:39.276940+0000","last_fullsized":"2023-12-24T20:08:39.276940+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:26.458164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279784+0000","last_change":"2023-12-24T20:08:38.240060+0000","last_active":"2023-12-24T20:08:39.279784+0000","last_peered":"2023-12-24T20:08:39.279784+0000","last_clean":"2023-12-24T20:08:39.279784+0000","last_became_active":"2023-12-24T20:08:38.239336+0000","last_became_peered":"2023-12-24T20:08:38.239336+0000","last_unstale":"2023-12-24T20:08:39.279784+0000","last_undegraded":"2023-12-24T20:08:39.279784+0000","last_fullsized":"2023-12-24T20:08:39.279784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:27.226154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259418+0000","last_change":"2023-12-24T20:08:39.254126+0000","last_active":"2023-12-24T20:08:39.259418+0000","last_peered":"2023-12-24T20:08:39.259418+0000","last_clean":"2023-12-24T20:08:39.259418+0000","last_became_active":"2023-12-24T20:08:39.253845+0000","last_became_peered":"2023-12-24T20:08:39.253845+0000","last_unstale":"2023-12-24T20:08:39.259418+0000","last_undegraded":"2023-12-24T20:08:39.259418+0000","last_fullsized":"2023-12-24T20:08:39.259418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:41.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279501+0000","last_change":"2023-12-24T20:08:38.248304+0000","last_active":"2023-12-24T20:08:39.279501+0000","last_peered":"2023-12-24T20:08:39.279501+0000","last_clean":"2023-12-24T20:08:39.279501+0000","last_became_active":"2023-12-24T20:08:38.247924+0000","last_became_peered":"2023-12-24T20:08:38.247924+0000","last_unstale":"2023-12-24T20:08:39.279501+0000","last_undegraded":"2023-12-24T20:08:39.279501+0000","last_fullsized":"2023-12-24T20:08:39.279501+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:24.843770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.252851+0000","last_change":"2023-12-24T20:08:39.250188+0000","last_active":"2023-12-24T20:08:39.252851+0000","last_peered":"2023-12-24T20:08:39.252851+0000","last_clean":"2023-12-24T20:08:39.252851+0000","last_became_active":"2023-12-24T20:08:39.249421+0000","last_became_peered":"2023-12-24T20:08:39.249421+0000","last_unstale":"2023-12-24T20:08:39.252851+0000","last_undegraded":"2023-12-24T20:08:39.252851+0000","last_fullsized":"2023-12-24T20:08:39.252851+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278103+0000","last_change":"2023-12-24T20:08:38.245114+0000","last_active":"2023-12-24T20:08:39.278103+0000","last_peered":"2023-12-24T20:08:39.278103+0000","last_clean":"2023-12-24T20:08:39.278103+0000","last_became_active":"2023-12-24T20:08:38.244729+0000","last_became_peered":"2023-12-24T20:08:38.244729+0000","last_unstale":"2023-12-24T20:08:39.278103+0000","last_undegraded":"2023-12-24T20:08:39.278103+0000","last_fullsized":"2023-12-24T20:08:39.278103+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256690+0000","last_change":"2023-12-24T20:08:39.253674+0000","last_active":"2023-12-24T20:08:39.256690+0000","last_peered":"2023-12-24T20:08:39.256690+0000","last_clean":"2023-12-24T20:08:39.256690+0000","last_became_active":"2023-12-24T20:08:39.253369+0000","last_became_peered":"2023-12-24T20:08:39.253369+0000","last_unstale":"2023-12-24T20:08:39.256690+0000","last_undegraded":"2023-12-24T20:08:39.256690+0000","last_fullsized":"2023-12-24T20:08:39.256690+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242781+0000","last_change":"2023-12-24T20:08:38.253981+0000","last_active":"2023-12-24T20:08:39.242781+0000","last_peered":"2023-12-24T20:08:39.242781+0000","last_clean":"2023-12-24T20:08:39.242781+0000","last_became_active":"2023-12-24T20:08:38.253691+0000","last_became_peered":"2023-12-24T20:08:38.253691+0000","last_unstale":"2023-12-24T20:08:39.242781+0000","last_undegraded":"2023-12-24T20:08:39.242781+0000","last_fullsized":"2023-12-24T20:08:39.242781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271215+0000","last_change":"2023-12-24T20:08:39.260099+0000","last_active":"2023-12-24T20:08:39.271215+0000","last_peered":"2023-12-24T20:08:39.271215+0000","last_clean":"2023-12-24T20:08:39.271215+0000","last_became_active":"2023-12-24T20:08:39.259444+0000","last_became_peered":"2023-12-24T20:08:39.259444+0000","last_unstale":"2023-12-24T20:08:39.271215+0000","last_undegraded":"2023-12-24T20:08:39.271215+0000","last_fullsized":"2023-12-24T20:08:39.271215+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.280314+0000","last_change":"2023-12-24T20:08:38.245770+0000","last_active":"2023-12-24T20:08:39.280314+0000","last_peered":"2023-12-24T20:08:39.280314+0000","last_clean":"2023-12-24T20:08:39.280314+0000","last_became_active":"2023-12-24T20:08:38.245431+0000","last_became_peered":"2023-12-24T20:08:38.245431+0000","last_unstale":"2023-12-24T20:08:39.280314+0000","last_undegraded":"2023-12-24T20:08:39.280314+0000","last_fullsized":"2023-12-24T20:08:39.280314+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271955+0000","last_change":"2023-12-24T20:08:39.264271+0000","last_active":"2023-12-24T20:08:39.271955+0000","last_peered":"2023-12-24T20:08:39.271955+0000","last_clean":"2023-12-24T20:08:39.271955+0000","last_became_active":"2023-12-24T20:08:39.263819+0000","last_became_peered":"2023-12-24T20:08:39.263819+0000","last_unstale":"2023-12-24T20:08:39.271955+0000","last_undegraded":"2023-12-24T20:08:39.271955+0000","last_fullsized":"2023-12-24T20:08:39.271955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.239064+0000","last_change":"2023-12-24T20:08:38.256267+0000","last_active":"2023-12-24T20:08:39.239064+0000","last_peered":"2023-12-24T20:08:39.239064+0000","last_clean":"2023-12-24T20:08:39.239064+0000","last_became_active":"2023-12-24T20:08:38.255858+0000","last_became_peered":"2023-12-24T20:08:38.255858+0000","last_unstale":"2023-12-24T20:08:39.239064+0000","last_undegraded":"2023-12-24T20:08:39.239064+0000","last_fullsized":"2023-12-24T20:08:39.239064+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262529+0000","last_change":"2023-12-24T20:08:39.258104+0000","last_active":"2023-12-24T20:08:39.262529+0000","last_peered":"2023-12-24T20:08:39.262529+0000","last_clean":"2023-12-24T20:08:39.262529+0000","last_became_active":"2023-12-24T20:08:39.257822+0000","last_became_peered":"2023-12-24T20:08:39.257822+0000","last_unstale":"2023-12-24T20:08:39.262529+0000","last_undegraded":"2023-12-24T20:08:39.262529+0000","last_fullsized":"2023-12-24T20:08:39.262529+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229366+0000","last_change":"2023-12-24T20:08:38.243949+0000","last_active":"2023-12-24T20:08:39.229366+0000","last_peered":"2023-12-24T20:08:39.229366+0000","last_clean":"2023-12-24T20:08:39.229366+0000","last_became_active":"2023-12-24T20:08:38.243446+0000","last_became_peered":"2023-12-24T20:08:38.243446+0000","last_unstale":"2023-12-24T20:08:39.229366+0000","last_undegraded":"2023-12-24T20:08:39.229366+0000","last_fullsized":"2023-12-24T20:08:39.229366+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:52.516275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256761+0000","last_change":"2023-12-24T20:08:39.253736+0000","last_active":"2023-12-24T20:08:39.256761+0000","last_peered":"2023-12-24T20:08:39.256761+0000","last_clean":"2023-12-24T20:08:39.256761+0000","last_became_active":"2023-12-24T20:08:39.251407+0000","last_became_peered":"2023-12-24T20:08:39.251407+0000","last_unstale":"2023-12-24T20:08:39.256761+0000","last_undegraded":"2023-12-24T20:08:39.256761+0000","last_fullsized":"2023-12-24T20:08:39.256761+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:06.228504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242932+0000","last_change":"2023-12-24T20:08:38.246611+0000","last_active":"2023-12-24T20:08:39.242932+0000","last_peered":"2023-12-24T20:08:39.242932+0000","last_clean":"2023-12-24T20:08:39.242932+0000","last_became_active":"2023-12-24T20:08:38.245986+0000","last_became_peered":"2023-12-24T20:08:38.245986+0000","last_unstale":"2023-12-24T20:08:39.242932+0000","last_undegraded":"2023-12-24T20:08:39.242932+0000","last_fullsized":"2023-12-24T20:08:39.242932+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:39.839197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256639+0000","last_change":"2023-12-24T20:08:39.253242+0000","last_active":"2023-12-24T20:08:39.256639+0000","last_peered":"2023-12-24T20:08:39.256639+0000","last_clean":"2023-12-24T20:08:39.256639+0000","last_became_active":"2023-12-24T20:08:39.251554+0000","last_became_peered":"2023-12-24T20:08:39.251554+0000","last_unstale":"2023-12-24T20:08:39.256639+0000","last_undegraded":"2023-12-24T20:08:39.256639+0000","last_fullsized":"2023-12-24T20:08:39.256639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:28:14.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278816+0000","last_change":"2023-12-24T20:08:38.245783+0000","last_active":"2023-12-24T20:08:39.278816+0000","last_peered":"2023-12-24T20:08:39.278816+0000","last_clean":"2023-12-24T20:08:39.278816+0000","last_became_active":"2023-12-24T20:08:38.244565+0000","last_became_peered":"2023-12-24T20:08:38.244565+0000","last_unstale":"2023-12-24T20:08:39.278816+0000","last_undegraded":"2023-12-24T20:08:39.278816+0000","last_fullsized":"2023-12-24T20:08:39.278816+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270426+0000","last_change":"2023-12-24T20:08:39.265615+0000","last_active":"2023-12-24T20:08:39.270426+0000","last_peered":"2023-12-24T20:08:39.270426+0000","last_clean":"2023-12-24T20:08:39.270426+0000","last_became_active":"2023-12-24T20:08:39.263000+0000","last_became_peered":"2023-12-24T20:08:39.263000+0000","last_unstale":"2023-12-24T20:08:39.270426+0000","last_undegraded":"2023-12-24T20:08:39.270426+0000","last_fullsized":"2023-12-24T20:08:39.270426+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242211+0000","last_change":"2023-12-24T20:08:38.250806+0000","last_active":"2023-12-24T20:08:39.242211+0000","last_peered":"2023-12-24T20:08:39.242211+0000","last_clean":"2023-12-24T20:08:39.242211+0000","last_became_active":"2023-12-24T20:08:38.250359+0000","last_became_peered":"2023-12-24T20:08:38.250359+0000","last_unstale":"2023-12-24T20:08:39.242211+0000","last_undegraded":"2023-12-24T20:08:39.242211+0000","last_fullsized":"2023-12-24T20:08:39.242211+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:06.702396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.267639+0000","last_change":"2023-12-24T20:08:39.257209+0000","last_active":"2023-12-24T20:08:39.267639+0000","last_peered":"2023-12-24T20:08:39.267639+0000","last_clean":"2023-12-24T20:08:39.267639+0000","last_became_active":"2023-12-24T20:08:39.256410+0000","last_became_peered":"2023-12-24T20:08:39.256410+0000","last_unstale":"2023-12-24T20:08:39.267639+0000","last_undegraded":"2023-12-24T20:08:39.267639+0000","last_fullsized":"2023-12-24T20:08:39.267639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:26.287672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240490+0000","last_change":"2023-12-24T20:08:38.250328+0000","last_active":"2023-12-24T20:08:39.240490+0000","last_peered":"2023-12-24T20:08:39.240490+0000","last_clean":"2023-12-24T20:08:39.240490+0000","last_became_active":"2023-12-24T20:08:38.250020+0000","last_became_peered":"2023-12-24T20:08:38.250020+0000","last_unstale":"2023-12-24T20:08:39.240490+0000","last_undegraded":"2023-12-24T20:08:39.240490+0000","last_fullsized":"2023-12-24T20:08:39.240490+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:47.468412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260458+0000","last_change":"2023-12-24T20:08:39.251809+0000","last_active":"2023-12-24T20:08:39.260458+0000","last_peered":"2023-12-24T20:08:39.260458+0000","last_clean":"2023-12-24T20:08:39.260458+0000","last_became_active":"2023-12-24T20:08:39.251491+0000","last_became_peered":"2023-12-24T20:08:39.251491+0000","last_unstale":"2023-12-24T20:08:39.260458+0000","last_undegraded":"2023-12-24T20:08:39.260458+0000","last_fullsized":"2023-12-24T20:08:39.260458+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229549+0000","last_change":"2023-12-24T20:08:38.250060+0000","last_active":"2023-12-24T20:08:39.229549+0000","last_peered":"2023-12-24T20:08:39.229549+0000","last_clean":"2023-12-24T20:08:39.229549+0000","last_became_active":"2023-12-24T20:08:38.249746+0000","last_became_peered":"2023-12-24T20:08:38.249746+0000","last_unstale":"2023-12-24T20:08:39.229549+0000","last_undegraded":"2023-12-24T20:08:39.229549+0000","last_fullsized":"2023-12-24T20:08:39.229549+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:33.428126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255593+0000","last_change":"2023-12-24T20:08:39.252994+0000","last_active":"2023-12-24T20:08:39.255593+0000","last_peered":"2023-12-24T20:08:39.255593+0000","last_clean":"2023-12-24T20:08:39.255593+0000","last_became_active":"2023-12-24T20:08:39.252438+0000","last_became_peered":"2023-12-24T20:08:39.252438+0000","last_unstale":"2023-12-24T20:08:39.255593+0000","last_undegraded":"2023-12-24T20:08:39.255593+0000","last_fullsized":"2023-12-24T20:08:39.255593+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:44.720849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.233775+0000","last_change":"2023-12-24T20:08:38.243330+0000","last_active":"2023-12-24T20:08:39.233775+0000","last_peered":"2023-12-24T20:08:39.233775+0000","last_clean":"2023-12-24T20:08:39.233775+0000","last_became_active":"2023-12-24T20:08:38.242985+0000","last_became_peered":"2023-12-24T20:08:38.242985+0000","last_unstale":"2023-12-24T20:08:39.233775+0000","last_undegraded":"2023-12-24T20:08:39.233775+0000","last_fullsized":"2023-12-24T20:08:39.233775+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:40.375343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269420+0000","last_change":"2023-12-24T20:08:39.265833+0000","last_active":"2023-12-24T20:08:39.269420+0000","last_peered":"2023-12-24T20:08:39.269420+0000","last_clean":"2023-12-24T20:08:39.269420+0000","last_became_active":"2023-12-24T20:08:39.265456+0000","last_became_peered":"2023-12-24T20:08:39.265456+0000","last_unstale":"2023-12-24T20:08:39.269420+0000","last_undegraded":"2023-12-24T20:08:39.269420+0000","last_fullsized":"2023-12-24T20:08:39.269420+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:17.991414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240992+0000","last_change":"2023-12-24T20:08:38.260555+0000","last_active":"2023-12-24T20:08:39.240992+0000","last_peered":"2023-12-24T20:08:39.240992+0000","last_clean":"2023-12-24T20:08:39.240992+0000","last_became_active":"2023-12-24T20:08:38.260223+0000","last_became_peered":"2023-12-24T20:08:38.260223+0000","last_unstale":"2023-12-24T20:08:39.240992+0000","last_undegraded":"2023-12-24T20:08:39.240992+0000","last_fullsized":"2023-12-24T20:08:39.240992+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:59.815420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271743+0000","last_change":"2023-12-24T20:08:39.259346+0000","last_active":"2023-12-24T20:08:39.271743+0000","last_peered":"2023-12-24T20:08:39.271743+0000","last_clean":"2023-12-24T20:08:39.271743+0000","last_became_active":"2023-12-24T20:08:39.259051+0000","last_became_peered":"2023-12-24T20:08:39.259051+0000","last_unstale":"2023-12-24T20:08:39.271743+0000","last_undegraded":"2023-12-24T20:08:39.271743+0000","last_fullsized":"2023-12-24T20:08:39.271743+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:58.145573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240677+0000","last_change":"2023-12-24T20:08:38.245775+0000","last_active":"2023-12-24T20:08:39.240677+0000","last_peered":"2023-12-24T20:08:39.240677+0000","last_clean":"2023-12-24T20:08:39.240677+0000","last_became_active":"2023-12-24T20:08:38.245051+0000","last_became_peered":"2023-12-24T20:08:38.245051+0000","last_unstale":"2023-12-24T20:08:39.240677+0000","last_undegraded":"2023-12-24T20:08:39.240677+0000","last_fullsized":"2023-12-24T20:08:39.240677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.250034+0000","last_change":"2023-12-24T20:08:39.244572+0000","last_active":"2023-12-24T20:08:39.250034+0000","last_peered":"2023-12-24T20:08:39.250034+0000","last_clean":"2023-12-24T20:08:39.250034+0000","last_became_active":"2023-12-24T20:08:39.244190+0000","last_became_peered":"2023-12-24T20:08:39.244190+0000","last_unstale":"2023-12-24T20:08:39.250034+0000","last_undegraded":"2023-12-24T20:08:39.250034+0000","last_fullsized":"2023-12-24T20:08:39.250034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:30:43.712363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.235534+0000","last_change":"2023-12-24T20:08:38.245309+0000","last_active":"2023-12-24T20:08:39.235534+0000","last_peered":"2023-12-24T20:08:39.235534+0000","last_clean":"2023-12-24T20:08:39.235534+0000","last_became_active":"2023-12-24T20:08:38.245009+0000","last_became_peered":"2023-12-24T20:08:38.245009+0000","last_unstale":"2023-12-24T20:08:39.235534+0000","last_undegraded":"2023-12-24T20:08:39.235534+0000","last_fullsized":"2023-12-24T20:08:39.235534+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:10.563414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263769+0000","last_change":"2023-12-24T20:08:39.262632+0000","last_active":"2023-12-24T20:08:39.263769+0000","last_peered":"2023-12-24T20:08:39.263769+0000","last_clean":"2023-12-24T20:08:39.263769+0000","last_became_active":"2023-12-24T20:08:39.262309+0000","last_became_peered":"2023-12-24T20:08:39.262309+0000","last_unstale":"2023-12-24T20:08:39.263769+0000","last_undegraded":"2023-12-24T20:08:39.263769+0000","last_fullsized":"2023-12-24T20:08:39.263769+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:16.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242105+0000","last_change":"2023-12-24T20:08:38.250456+0000","last_active":"2023-12-24T20:08:39.242105+0000","last_peered":"2023-12-24T20:08:39.242105+0000","last_clean":"2023-12-24T20:08:39.242105+0000","last_became_active":"2023-12-24T20:08:38.250150+0000","last_became_peered":"2023-12-24T20:08:38.250150+0000","last_unstale":"2023-12-24T20:08:39.242105+0000","last_undegraded":"2023-12-24T20:08:39.242105+0000","last_fullsized":"2023-12-24T20:08:39.242105+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:36:59.848456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1043,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243026+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:08:39.243026+0000","last_peered":"2023-12-24T20:08:39.243026+0000","last_clean":"2023-12-24T20:08:39.243026+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:08:39.243026+0000","last_undegraded":"2023-12-24T20:08:39.243026+0000","last_fullsized":"2023-12-24T20:08:39.243026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304324,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067516,"statfs":{"total":96636764160,"available":96325136384,"internally_reserved":0,"allocated":3010560,"data_stored":1856490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1339999999999999,"15min":1.163},"min":{"1min":0.73399999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.46,"5min":1.728,"15min":1.728},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.179,"15min":1.1799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.163,"15min":1.169},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.518,"5min":1.718,"15min":1.9379999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.29,"15min":1.2669999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7130000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.262},"min":{"1min":0.92500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.514,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.123},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.85999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5580000000000001,"5min":1.752,"15min":1.8200000000000001},"last":1.264}]},{"osd":3,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.3280000000000001,"15min":1.319},"min":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6319999999999999,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.228},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":0.89200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.641,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.3720000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.246,"15min":1.214},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.865,"5min":1.865,"15min":2.194},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.3360000000000001,"15min":1.2769999999999999},"min":{"1min":0.88700000000000001,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":0.96699999999999997,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.873,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.411,"15min":1.3540000000000001},"min":{"1min":0.90600000000000003,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.3089999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4790000000000001,"15min":1.444},"min":{"1min":1.1040000000000001,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.3319999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":1.004,"5min":0.75600000000000001,"15min":0.55000000000000004},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.333}]}]},{"osd":6,"up_from":13,"seq":55834575949,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2929999999999999,"15min":1.3129999999999999},"min":{"1min":0.97299999999999998,"5min":0.66800000000000004,"15min":0.44500000000000001},"max":{"1min":1.645,"5min":1.7210000000000001,"15min":1.837},"last":1.238},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":1.1759999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6160000000000001,"5min":1.744,"15min":1.821},"last":1.274}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.1779999999999999},"min":{"1min":0.90400000000000003,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.4870000000000001,"5min":1.663,"15min":1.663},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1990000000000001,"15min":1.2270000000000001},"min":{"1min":0.95499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.4279999999999999,"5min":1.6899999999999999,"15min":1.784},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.96799999999999997,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.6240000000000001,"5min":1.6459999999999999,"15min":1.827},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.94999999999999996,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.589,"5min":1.758,"15min":1.768},"last":1.135}]},{"osd":3,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3069999999999999,"15min":1.298},"min":{"1min":0.98699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.8879999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.3160000000000001,"15min":1.3109999999999999},"min":{"1min":1.1240000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":1.7010000000000001,"15min":1.8360000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.22,"15min":1.208},"min":{"1min":0.79500000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.6599999999999999,"5min":1.7110000000000001,"15min":1.9039999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.67000000000000004,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.8580000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.258},"min":{"1min":0.79100000000000004,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.9370000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.373,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5820000000000001,"5min":1.839,"15min":1.954},"last":1.3220000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3959999999999999,"15min":1.403},"min":{"1min":1.1200000000000001,"5min":0.60599999999999998,"15min":0.55800000000000005},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.9710000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4159999999999999,"15min":1.407},"min":{"1min":0.97799999999999998,"5min":0.73399999999999999,"15min":0.65300000000000002},"max":{"1min":1.7549999999999999,"5min":1.804,"15min":2.0259999999999998},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311944,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059896,"statfs":{"total":96636764160,"available":96317333504,"internally_reserved":0,"allocated":2424832,"data_stored":1266246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.268},"min":{"1min":0.871,"5min":0.77200000000000002,"15min":0.498},"max":{"1min":1.6020000000000001,"5min":1.661,"15min":1.738},"last":1.278},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.393,"15min":1.349},"min":{"1min":1.0229999999999999,"5min":0.81200000000000006,"15min":0.80300000000000005},"max":{"1min":1.597,"5min":1.7410000000000001,"15min":1.784},"last":1.357}]},{"osd":1,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.196},"min":{"1min":0.94399999999999995,"5min":0.80700000000000005,"15min":0.65100000000000002},"max":{"1min":1.5960000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.92800000000000005,"5min":0.747,"15min":0.56000000000000005},"max":{"1min":1.46,"5min":1.673,"15min":1.7210000000000001},"last":1.079}]},{"osd":2,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.90400000000000003,"5min":0.876,"15min":0.80000000000000004},"max":{"1min":1.677,"5min":1.6839999999999999,"15min":1.819},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.268,"15min":1.284},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.878},"max":{"1min":1.635,"5min":1.883,"15min":1.883},"last":1.194}]},{"osd":3,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3220000000000001,"15min":1.3},"min":{"1min":1.0449999999999999,"5min":0.92300000000000004,"15min":0.75800000000000001},"max":{"1min":1.784,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.403,"15min":1.369},"min":{"1min":1.091,"5min":1.038,"15min":0.94499999999999995},"max":{"1min":1.7210000000000001,"5min":1.877,"15min":1.8799999999999999},"last":1.319}]},{"osd":4,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.61899999999999999},"max":{"1min":1.6599999999999999,"5min":1.839,"15min":1.839},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":0.98899999999999999,"5min":0.82099999999999995,"15min":0.59599999999999997},"max":{"1min":1.5920000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.1060000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.351,"15min":1.325},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.796,"5min":2.008,"15min":2.008},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.357,"5min":1.373,"15min":1.3560000000000001},"min":{"1min":1.012,"5min":0.93500000000000005,"15min":0.69599999999999995},"max":{"1min":1.6930000000000001,"5min":1.7669999999999999,"15min":1.9630000000000001},"last":1.155}]},{"osd":7,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.466,"15min":1.423},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.80700000000000005},"max":{"1min":1.9370000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":1.0229999999999999,"5min":0.90600000000000003,"15min":0.85999999999999999},"max":{"1min":1.8580000000000001,"5min":1.978,"15min":2.0009999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311952,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059888,"statfs":{"total":96636764160,"available":96317325312,"internally_reserved":0,"allocated":2433024,"data_stored":1266858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.268},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67500000000000004},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.391},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.66300000000000003},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":2.012},"last":1.524}]},{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.179,"15min":1.1539999999999999},"min":{"1min":0.748,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5589999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1699999999999999,"15min":1.155},"min":{"1min":0.92300000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.694},"last":1.1910000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3380000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.84899999999999998},"max":{"1min":1.7989999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.105},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.367},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"max":{"1min":1.825,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.659}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.91600000000000004,"5min":0.82799999999999996,"15min":0.66700000000000004},"max":{"1min":1.5229999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.331},{"interface":"front","average":{"1min":1.367,"5min":1.3129999999999999,"15min":1.3049999999999999},"min":{"1min":1.1259999999999999,"5min":0.90600000000000003,"15min":0.81699999999999995},"max":{"1min":1.6950000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4510000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.28,"15min":1.3009999999999999},"min":{"1min":0.92100000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.704,"5min":1.704,"15min":1.8169999999999999},"last":1.726},{"interface":"front","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.82199999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7290000000000001,"5min":2.0720000000000001,"15min":2.089},"last":1.6970000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.878,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.571,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.335,"15min":1.335},"min":{"1min":1.087,"5min":0.65700000000000003,"15min":0.51600000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.96},"last":1.5780000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.27,"15min":1.3009999999999999},"min":{"1min":0.97699999999999998,"5min":0.72799999999999998,"15min":0.57099999999999995},"max":{"1min":1.865,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4410000000000001,"15min":1.423},"min":{"1min":1.0580000000000001,"5min":0.82999999999999996,"15min":0.72999999999999998},"max":{"1min":1.8879999999999999,"5min":2.0329999999999999,"15min":2.7829999999999999},"last":1.605}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316052,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055788,"statfs":{"total":96636764160,"available":96313126912,"internally_reserved":0,"allocated":2437120,"data_stored":1268234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.885},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.1000000000000001,"15min":1.131},"min":{"1min":0.81299999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.6990000000000001,"15min":2.0059999999999998},"last":1.0649999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.052,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":1.6830000000000001,"5min":1.722,"15min":2.0899999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.99399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6850000000000001,"5min":1.889,"15min":1.889},"last":1.3089999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1220000000000001,"15min":1.147},"min":{"1min":0.69099999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":2.0619999999999998,"15min":2.21},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.232,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":2.036,"5min":2.036,"15min":2.0550000000000002},"last":1.175}]},{"osd":4,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.272,"15min":1.27},"min":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.71099999999999997},"max":{"1min":1.581,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.526},{"interface":"front","average":{"1min":1.381,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":1.0740000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.234}]},{"osd":5,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4419999999999999,"15min":1.446},"min":{"1min":1.1200000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.7,"5min":2.0129999999999999,"15min":2.3900000000000001},"last":1.482},{"interface":"front","average":{"1min":1.484,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.145,"5min":1.1120000000000001,"15min":0.96099999999999997},"max":{"1min":1.956,"5min":2.032,"15min":2.2250000000000001},"last":1.6060000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5029999999999999,"15min":1.524},"min":{"1min":1.147,"5min":1.1419999999999999,"15min":1.0209999999999999},"max":{"1min":1.927,"5min":2.089,"15min":2.145},"last":1.401},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":1.0649999999999999,"5min":0.95699999999999996,"15min":0.879},"max":{"1min":1.8740000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.647}]},{"osd":7,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.48,"15min":1.49},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.758,"5min":2.1920000000000002,"15min":2.2639999999999998},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5529999999999999,"15min":1.5609999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.913,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.6890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.3939999999999999,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5669999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":2.056},"last":1.218},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1559999999999999,"15min":1.125},"min":{"1min":0.83699999999999997,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.4670000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.27}]},{"osd":3,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2470000000000001,"15min":1.234},"min":{"1min":0.81200000000000006,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7629999999999999,"5min":1.8140000000000001,"15min":2.1659999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2130000000000001,"15min":1.163},"min":{"1min":1.034,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":1.1739999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.423,"15min":1.3919999999999999},"min":{"1min":1.228,"5min":0.96699999999999997,"15min":0.92600000000000005},"max":{"1min":1.754,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.357},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.94499999999999995},"max":{"1min":1.8149999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.774}]},{"osd":5,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.417,"15min":1.369},"min":{"1min":1.042,"5min":0.877,"15min":0.877},"max":{"1min":1.8620000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.4790000000000001,"15min":1.4650000000000001},"min":{"1min":1.1899999999999999,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0230000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.8100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.52,"15min":1.502},"min":{"1min":1.2729999999999999,"5min":1.1160000000000001,"15min":1.012},"max":{"1min":1.917,"5min":2.0779999999999998,"15min":2.1219999999999999},"last":1.653},{"interface":"front","average":{"1min":1.631,"5min":1.556,"15min":1.5109999999999999},"min":{"1min":1.357,"5min":1.1000000000000001,"15min":0.876},"max":{"1min":2.1379999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.5880000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.603,"15min":1.581},"min":{"1min":1.2190000000000001,"5min":1.048,"15min":1.048},"max":{"1min":2.1589999999999998,"5min":2.387,"15min":2.387},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.7,"5min":1.615,"15min":1.5940000000000001},"min":{"1min":1.355,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.214,"5min":2.226,"15min":2.2589999999999999},"last":1.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1267658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57999999999999996,"15min":0.54900000000000004},"max":{"1min":1.2809999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1759999999999999,"15min":1.1599999999999999},"min":{"1min":0.94499999999999995,"5min":0.82799999999999996,"15min":0.58199999999999996},"max":{"1min":1.49,"5min":1.657,"15min":1.671},"last":1.1859999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.57799999999999996,"15min":0.41099999999999998},"max":{"1min":1.28,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.75900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.532,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.119}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.296,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.6299999999999999,"5min":1.909,"15min":1.909},"last":1.232},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82899999999999996,"5min":0.73899999999999999,"15min":0.48899999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.8140000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2689999999999999,"15min":1.284},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.63},"max":{"1min":1.73,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.4390000000000001},"min":{"1min":1.109,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7569999999999999,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.48}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.423,"15min":1.401},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.81200000000000006},"max":{"1min":1.819,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.407,"15min":1.4019999999999999},"min":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.84599999999999997},"max":{"1min":1.837,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4239999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.534,"15min":1.5229999999999999},"min":{"1min":1.1519999999999999,"5min":1.032,"15min":0.72999999999999998},"max":{"1min":2.1160000000000001,"5min":2.2410000000000001,"15min":2.3540000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.4890000000000001,"15min":1.4930000000000001},"min":{"1min":1.147,"5min":0.97899999999999998,"15min":0.86699999999999999},"max":{"1min":1.7629999999999999,"5min":2.379,"15min":2.456},"last":1.325}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5609999999999999},"min":{"1min":1.216,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7909999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.544},{"interface":"front","average":{"1min":1.476,"5min":1.48,"15min":1.5069999999999999},"min":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.95899999999999996},"max":{"1min":1.7829999999999999,"5min":2.177,"15min":2.177},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304332,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067508,"statfs":{"total":96636764160,"available":96325128192,"internally_reserved":0,"allocated":3018752,"data_stored":1856594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.90100000000000002,"15min":0.91700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.6950000000000001},"last":1.161},{"interface":"front","average":{"1min":1.091,"5min":1.085,"15min":1.071},"min":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":1.6559999999999999,"5min":1.823,"15min":1.823},"last":0.92400000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0900000000000001,"15min":1.0960000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.615,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.375},{"interface":"front","average":{"1min":1.214,"5min":1.167,"15min":1.163},"min":{"1min":0.82799999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5409999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.107},"min":{"1min":0.745,"5min":0.71999999999999997,"15min":0.58199999999999996},"max":{"1min":1.5820000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.2729999999999999,"15min":1.284},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.633}]},{"osd":4,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.482},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.331},"min":{"1min":1.0660000000000001,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6890000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.2150000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4390000000000001,"15min":1.4450000000000001},"min":{"1min":0.98099999999999998,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.8939999999999999,"5min":1.958,"15min":2.2519999999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4610000000000001,"15min":1.462},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.9099999999999999,"5min":2.125,"15min":2.125},"last":1.099}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.657,"5min":2.1320000000000001,"15min":2.492},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5169999999999999},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":1.9610000000000001,"5min":2.25,"15min":2.3330000000000002},"last":1.5449999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.548,"15min":1.538},"min":{"1min":1.167,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.984,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.327},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5449999999999999,"15min":1.5189999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8100000000000001,"5min":2.234,"15min":2.411},"last":1.5880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:08:44.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T20:08:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.641+0000 7f9feef23700 1 Processor -- start 2023-12-24T20:08:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.641+0000 7f9feef23700 1 -- start start 2023-12-24T20:08:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9feef23700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9fe80c6830 0x7f9fe80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9feef23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 0x7f9fe806af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9feef23700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe806d6f0 con 0x7f9fe80c8070 2023-12-24T20:08:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9feef23700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe806b460 con 0x7f9fe80c6830 2023-12-24T20:08:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9feef23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806c820 con 0x7f9fe806db80 2023-12-24T20:08:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fee722700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9fe80c8070 0x7f9fe80c84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35748/0 (socket says 172.21.15.50:35748) 2023-12-24T20:08:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fee722700 1 -- 172.21.15.50:0/3300712465 learned_addr learned my addr 172.21.15.50:0/3300712465 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fed720700 1 --2- 172.21.15.50:0/3300712465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 0x7f9fe806af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fedf21700 1 --2- 172.21.15.50:0/3300712465 >> v2:172.21.15.82:3300/0 conn(0x7f9fe80c6830 0x7f9fe80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fecf1f700 1 -- 172.21.15.50:0/3300712465 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854654325 0 0) 0x7f9fe806d6f0 con 0x7f9fe80c8070 2023-12-24T20:08:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fecf1f700 1 -- 172.21.15.50:0/3300712465 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd4003570 con 0x7f9fe80c8070 2023-12-24T20:08:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fed720700 1 -- 172.21.15.50:0/3300712465 >> v2:172.21.15.82:3300/0 conn(0x7f9fe80c6830 msgr2=0x7f9fe80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fed720700 1 --2- 172.21.15.50:0/3300712465 >> v2:172.21.15.82:3300/0 conn(0x7f9fe80c6830 0x7f9fe80c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fed720700 1 -- 172.21.15.50:0/3300712465 >> v1:172.21.15.50:6789/0 conn(0x7f9fe80c8070 legacy=0x7f9fe80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.645+0000 7f9fed720700 1 -- 172.21.15.50:0/3300712465 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe806cae0 con 0x7f9fe806db80 2023-12-24T20:08:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9fed720700 1 --2- 172.21.15.50:0/3300712465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 0x7f9fe806af20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80098e0 tx=0x7f9fd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2f26f2328f5bd73 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9fecf1f700 1 -- 172.21.15.50:0/3300712465 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011630 con 0x7f9fe806db80 2023-12-24T20:08:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9fecf1f700 1 -- 172.21.15.50:0/3300712465 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8011790 con 0x7f9fe806db80 2023-12-24T20:08:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9fecf1f700 1 -- 172.21.15.50:0/3300712465 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011b30 con 0x7f9fe806db80 2023-12-24T20:08:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 -- 172.21.15.50:0/3300712465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 msgr2=0x7f9fe806af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 --2- 172.21.15.50:0/3300712465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 0x7f9fe806af20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80098e0 tx=0x7f9fd80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 -- 172.21.15.50:0/3300712465 shutdown_connections 2023-12-24T20:08:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 --2- 172.21.15.50:0/3300712465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe806db80 0x7f9fe806af20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 --2- 172.21.15.50:0/3300712465 >> v2:172.21.15.82:3300/0 conn(0x7f9fe80c6830 0x7f9fe80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 -- 172.21.15.50:0/3300712465 >> 172.21.15.50:0/3300712465 conn(0x7f9fe80670b0 msgr2=0x7f9fe80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 -- 172.21.15.50:0/3300712465 shutdown_connections 2023-12-24T20:08:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.649+0000 7f9feef23700 1 -- 172.21.15.50:0/3300712465 wait complete. 2023-12-24T20:08:44.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 Processor -- start 2023-12-24T20:08:44.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 -- start start 2023-12-24T20:08:44.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 0x7f9fe815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe80c8070 0x7f9fe80ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815b570 con 0x7f9fe80c6830 2023-12-24T20:08:44.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c0180 con 0x7f9fe806db80 2023-12-24T20:08:44.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9feef23700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c0460 con 0x7f9fe80c8070 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46146/0 (socket says 172.21.15.50:46146) 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 -- 172.21.15.50:0/1662020360 learned_addr learned my addr 172.21.15.50:0/1662020360 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fee722700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe80c8070 0x7f9fe80ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fedf21700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 0x7f9fe815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 -- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe80c8070 msgr2=0x7f9fe80ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe80c8070 0x7f9fe80ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 -- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 msgr2=0x7f9fe815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 0x7f9fe815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 -- 172.21.15.50:0/1662020360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009420 con 0x7f9fe80c6830 2023-12-24T20:08:44.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fedf21700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 0x7f9fe815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:44.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.653+0000 7f9fed720700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806c960 tx=0x7f9fd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8000d10 con 0x7f9fe80c6830 2023-12-24T20:08:44.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8011b10 con 0x7f9fe80c6830 2023-12-24T20:08:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8025660 con 0x7f9fe80c6830 2023-12-24T20:08:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80c0740 con 0x7f9fe80c6830 2023-12-24T20:08:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80c4440 con 0x7f9fe80c6830 2023-12-24T20:08:44.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.657+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80c46c0 con 0x7f9fe80c6830 2023-12-24T20:08:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.661+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9fd8025a50 con 0x7f9fe80c6830 2023-12-24T20:08:44.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.661+0000 7f9fddffb700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 0x7f9fcc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:44.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.661+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f9fd807e270 con 0x7f9fe80c6830 2023-12-24T20:08:44.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.661+0000 7f9fedf21700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 0x7f9fcc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:44.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.661+0000 7f9fedf21700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 0x7f9fcc062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4011480 tx=0x7f9fe40091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:44.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.669+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9fd804e570 con 0x7f9fe80c6830 2023-12-24T20:08:44.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.901+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9fe804be40 con 0x7f9fe80c6830 2023-12-24T20:08:44.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.901+0000 7f9fddffb700 1 -- 172.21.15.50:0/1662020360 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7f9fd8051b90 con 0x7f9fe80c6830 2023-12-24T20:08:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:44.904 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5561,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":193,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2518884352,"bytes_avail":770575228928,"bytes_total":773094113280,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":95,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9864}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-12-24T20:04:23.856031+0000","services":{}},"progress_events":{}} 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 msgr2=0x7f9fcc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 0x7f9fcc062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4011480 tx=0x7f9fe40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 msgr2=0x7f9fe80acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806c960 tx=0x7f9fd8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 shutdown_connections 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9fcc060550 0x7f9fcc062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fe80c8070 0x7f9fe80ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80c6830 0x7f9fe80acc80 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 --2- 172.21.15.50:0/1662020360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe806db80 0x7f9fe815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 >> 172.21.15.50:0/1662020360 conn(0x7f9fe80670b0 msgr2=0x7f9fe815be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 shutdown_connections 2023-12-24T20:08:44.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:44.905+0000 7f9feef23700 1 -- 172.21.15.50:0/1662020360 wait complete. 2023-12-24T20:08:44.935 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T20:08:44.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:45.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:45.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.093+0000 7fdde4923700 1 Processor -- start 2023-12-24T20:08:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.093+0000 7fdde4923700 1 -- start start 2023-12-24T20:08:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdde4923700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdde0158e00 0x7fdde01591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdde4923700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdde006d8c0 0x7fdde00b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdde4923700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde006b640 con 0x7fdde006a580 2023-12-24T20:08:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdde4923700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde0159710 con 0x7fdde006d8c0 2023-12-24T20:08:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdde4923700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00b5e10 con 0x7fdde0158e00 2023-12-24T20:08:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdde006d8c0 0x7fdde00b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdde006d8c0 0x7fdde00b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46148/0 (socket says 172.21.15.50:46148) 2023-12-24T20:08:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 -- 172.21.15.50:0/1419702935 learned_addr learned my addr 172.21.15.50:0/1419702935 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdddf7fe700 1 --2- 172.21.15.50:0/1419702935 >> v2:172.21.15.82:3300/0 conn(0x7fdde0158e00 0x7fdde01591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 -- 172.21.15.50:0/1419702935 >> v2:172.21.15.82:3300/0 conn(0x7fdde0158e00 msgr2=0x7fdde01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 --2- 172.21.15.50:0/1419702935 >> v2:172.21.15.82:3300/0 conn(0x7fdde0158e00 0x7fdde01591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 -- 172.21.15.50:0/1419702935 >> v1:172.21.15.82:6789/0 conn(0x7fdde006a580 legacy=0x7fdde006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 -- 172.21.15.50:0/1419702935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde006b8e0 con 0x7fdde006d8c0 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fddd6ffd700 1 --2- 172.21.15.50:0/1419702935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b3ad0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdde0063b50 tx=0x7fddc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a79f814d1363af2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdddeffd700 1 -- 172.21.15.50:0/1419702935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8009e70 con 0x7fdde006d8c0 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdddeffd700 1 -- 172.21.15.50:0/1419702935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800b860 con 0x7fdde006d8c0 2023-12-24T20:08:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.097+0000 7fdddeffd700 1 -- 172.21.15.50:0/1419702935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800bc00 con 0x7fdde006d8c0 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 -- 172.21.15.50:0/1419702935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 msgr2=0x7fdde00b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 --2- 172.21.15.50:0/1419702935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b3ad0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdde0063b50 tx=0x7fddc8009250 comp rx=0 tx=0).stop 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 -- 172.21.15.50:0/1419702935 shutdown_connections 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 --2- 172.21.15.50:0/1419702935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b3ad0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 --2- 172.21.15.50:0/1419702935 >> v2:172.21.15.82:3300/0 conn(0x7fdde0158e00 0x7fdde01591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 -- 172.21.15.50:0/1419702935 >> 172.21.15.50:0/1419702935 conn(0x7fdde0067b80 msgr2=0x7fdde00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 -- 172.21.15.50:0/1419702935 shutdown_connections 2023-12-24T20:08:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 -- 172.21.15.50:0/1419702935 wait complete. 2023-12-24T20:08:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.101+0000 7fdde4923700 1 Processor -- start 2023-12-24T20:08:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 -- start start 2023-12-24T20:08:45.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdde006a580 0x7fdde01477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 0x7fdde015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00af030 con 0x7fdde006d8c0 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00af310 con 0x7fdde0158e00 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdde4923700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00af5f0 con 0x7fdde006a580 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46154/0 (socket says 172.21.15.50:46154) 2023-12-24T20:08:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 -- 172.21.15.50:0/2337057883 learned_addr learned my addr 172.21.15.50:0/2337057883 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:45.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 -- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdde006a580 msgr2=0x7fdde01477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdde006a580 0x7fdde01477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 -- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 msgr2=0x7fdde015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdddffff700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 0x7fdde015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 0x7fdde015f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 -- 172.21.15.50:0/2337057883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80094f0 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fdddffff700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 0x7fdde015f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.105+0000 7fddd6ffd700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fdde006e730 tx=0x7fddc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800bbe0 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8011420 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00af8d0 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80117a0 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde0147ce0 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde004be40 con 0x7fdde006d8c0 2023-12-24T20:08:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.109+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fddc8011bd0 con 0x7fdde006d8c0 2023-12-24T20:08:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.113+0000 7fddd7fff700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.113+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7fddc807e570 con 0x7fdde006d8c0 2023-12-24T20:08:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.113+0000 7fdddf7fe700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.113+0000 7fdddf7fe700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 0x7fddc4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009b10 tx=0x7fddd00091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.121+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddc804e7d0 con 0x7fdde006d8c0 2023-12-24T20:08:45.195 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-24T20:08:45.193+0000 7efe8875b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:08:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.293+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdde006bbc0 con 0x7fddc4060550 2023-12-24T20:08:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.301+0000 7fddd7fff700 1 -- 172.21.15.50:0/2337057883 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286699 (secure 0 0 0) 0x7fdde006bbc0 con 0x7fddc4060550 2023-12-24T20:08:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 msgr2=0x7fddc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 0x7fddc4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009b10 tx=0x7fddd00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 msgr2=0x7fdde00b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fdde006e730 tx=0x7fddc8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 shutdown_connections 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdde0158e00 0x7fdde015f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde006d8c0 0x7fdde00b00d0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 --2- 172.21.15.50:0/2337057883 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdde006a580 0x7fdde01477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 >> 172.21.15.50:0/2337057883 conn(0x7fdde0067b80 msgr2=0x7fdde00a99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 shutdown_connections 2023-12-24T20:08:45.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:45.309+0000 7fdde4923700 1 -- 172.21.15.50:0/2337057883 wait complete. 2023-12-24T20:08:45.314 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:08:45.336 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T20:08:44.147627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459848,"kb_used_data":20104,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752514872,"statfs":{"total":773094113280,"available":770575228928,"internally_reserved":0,"allocated":20586496,"data_stored":11314324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001948"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258154+0000","last_change":"2023-12-24T20:08:39.255111+0000","last_active":"2023-12-24T20:08:39.258154+0000","last_peered":"2023-12-24T20:08:39.258154+0000","last_clean":"2023-12-24T20:08:39.258154+0000","last_became_active":"2023-12-24T20:08:39.254695+0000","last_became_peered":"2023-12-24T20:08:39.254695+0000","last_unstale":"2023-12-24T20:08:39.258154+0000","last_undegraded":"2023-12-24T20:08:39.258154+0000","last_fullsized":"2023-12-24T20:08:39.258154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:16.694071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262123+0000","last_change":"2023-12-24T20:08:39.259699+0000","last_active":"2023-12-24T20:08:39.262123+0000","last_peered":"2023-12-24T20:08:39.262123+0000","last_clean":"2023-12-24T20:08:39.262123+0000","last_became_active":"2023-12-24T20:08:39.257235+0000","last_became_peered":"2023-12-24T20:08:39.257235+0000","last_unstale":"2023-12-24T20:08:39.262123+0000","last_undegraded":"2023-12-24T20:08:39.262123+0000","last_fullsized":"2023-12-24T20:08:39.262123+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:58:09.989946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242022+0000","last_change":"2023-12-24T20:08:39.237190+0000","last_active":"2023-12-24T20:08:39.242022+0000","last_peered":"2023-12-24T20:08:39.242022+0000","last_clean":"2023-12-24T20:08:39.242022+0000","last_became_active":"2023-12-24T20:08:39.236904+0000","last_became_peered":"2023-12-24T20:08:39.236904+0000","last_unstale":"2023-12-24T20:08:39.242022+0000","last_undegraded":"2023-12-24T20:08:39.242022+0000","last_fullsized":"2023-12-24T20:08:39.242022+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:23:49.335014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261226+0000","last_change":"2023-12-24T20:08:39.259338+0000","last_active":"2023-12-24T20:08:39.261226+0000","last_peered":"2023-12-24T20:08:39.261226+0000","last_clean":"2023-12-24T20:08:39.261226+0000","last_became_active":"2023-12-24T20:08:39.259024+0000","last_became_peered":"2023-12-24T20:08:39.259024+0000","last_unstale":"2023-12-24T20:08:39.261226+0000","last_undegraded":"2023-12-24T20:08:39.261226+0000","last_fullsized":"2023-12-24T20:08:39.261226+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:20.251605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258307+0000","last_change":"2023-12-24T20:08:39.253890+0000","last_active":"2023-12-24T20:08:39.258307+0000","last_peered":"2023-12-24T20:08:39.258307+0000","last_clean":"2023-12-24T20:08:39.258307+0000","last_became_active":"2023-12-24T20:08:39.253577+0000","last_became_peered":"2023-12-24T20:08:39.253577+0000","last_unstale":"2023-12-24T20:08:39.258307+0000","last_undegraded":"2023-12-24T20:08:39.258307+0000","last_fullsized":"2023-12-24T20:08:39.258307+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262023+0000","last_change":"2023-12-24T20:08:39.256510+0000","last_active":"2023-12-24T20:08:39.262023+0000","last_peered":"2023-12-24T20:08:39.262023+0000","last_clean":"2023-12-24T20:08:39.262023+0000","last_became_active":"2023-12-24T20:08:39.256205+0000","last_became_peered":"2023-12-24T20:08:39.256205+0000","last_unstale":"2023-12-24T20:08:39.262023+0000","last_undegraded":"2023-12-24T20:08:39.262023+0000","last_fullsized":"2023-12-24T20:08:39.262023+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:55.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270406+0000","last_change":"2023-12-24T20:08:39.265203+0000","last_active":"2023-12-24T20:08:39.270406+0000","last_peered":"2023-12-24T20:08:39.270406+0000","last_clean":"2023-12-24T20:08:39.270406+0000","last_became_active":"2023-12-24T20:08:39.262585+0000","last_became_peered":"2023-12-24T20:08:39.262585+0000","last_unstale":"2023-12-24T20:08:39.270406+0000","last_undegraded":"2023-12-24T20:08:39.270406+0000","last_fullsized":"2023-12-24T20:08:39.270406+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270503+0000","last_change":"2023-12-24T20:08:39.264824+0000","last_active":"2023-12-24T20:08:39.270503+0000","last_peered":"2023-12-24T20:08:39.270503+0000","last_clean":"2023-12-24T20:08:39.270503+0000","last_became_active":"2023-12-24T20:08:39.264265+0000","last_became_peered":"2023-12-24T20:08:39.264265+0000","last_unstale":"2023-12-24T20:08:39.270503+0000","last_undegraded":"2023-12-24T20:08:39.270503+0000","last_fullsized":"2023-12-24T20:08:39.270503+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:10.180706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270783+0000","last_change":"2023-12-24T20:08:39.267145+0000","last_active":"2023-12-24T20:08:39.270783+0000","last_peered":"2023-12-24T20:08:39.270783+0000","last_clean":"2023-12-24T20:08:39.270783+0000","last_became_active":"2023-12-24T20:08:39.266033+0000","last_became_peered":"2023-12-24T20:08:39.266033+0000","last_unstale":"2023-12-24T20:08:39.270783+0000","last_undegraded":"2023-12-24T20:08:39.270783+0000","last_fullsized":"2023-12-24T20:08:39.270783+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:46.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270491+0000","last_change":"2023-12-24T20:08:39.265894+0000","last_active":"2023-12-24T20:08:39.270491+0000","last_peered":"2023-12-24T20:08:39.270491+0000","last_clean":"2023-12-24T20:08:39.270491+0000","last_became_active":"2023-12-24T20:08:39.265604+0000","last_became_peered":"2023-12-24T20:08:39.265604+0000","last_unstale":"2023-12-24T20:08:39.270491+0000","last_undegraded":"2023-12-24T20:08:39.270491+0000","last_fullsized":"2023-12-24T20:08:39.270491+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256950+0000","last_change":"2023-12-24T20:08:39.249813+0000","last_active":"2023-12-24T20:08:39.256950+0000","last_peered":"2023-12-24T20:08:39.256950+0000","last_clean":"2023-12-24T20:08:39.256950+0000","last_became_active":"2023-12-24T20:08:39.249507+0000","last_became_peered":"2023-12-24T20:08:39.249507+0000","last_unstale":"2023-12-24T20:08:39.256950+0000","last_undegraded":"2023-12-24T20:08:39.256950+0000","last_fullsized":"2023-12-24T20:08:39.256950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261918+0000","last_change":"2023-12-24T20:08:39.259412+0000","last_active":"2023-12-24T20:08:39.261918+0000","last_peered":"2023-12-24T20:08:39.261918+0000","last_clean":"2023-12-24T20:08:39.261918+0000","last_became_active":"2023-12-24T20:08:39.257706+0000","last_became_peered":"2023-12-24T20:08:39.257706+0000","last_unstale":"2023-12-24T20:08:39.261918+0000","last_undegraded":"2023-12-24T20:08:39.261918+0000","last_fullsized":"2023-12-24T20:08:39.261918+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:25.851791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270543+0000","last_change":"2023-12-24T20:08:39.258151+0000","last_active":"2023-12-24T20:08:39.270543+0000","last_peered":"2023-12-24T20:08:39.270543+0000","last_clean":"2023-12-24T20:08:39.270543+0000","last_became_active":"2023-12-24T20:08:39.257853+0000","last_became_peered":"2023-12-24T20:08:39.257853+0000","last_unstale":"2023-12-24T20:08:39.270543+0000","last_undegraded":"2023-12-24T20:08:39.270543+0000","last_fullsized":"2023-12-24T20:08:39.270543+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:42:19.517102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263196+0000","last_change":"2023-12-24T20:08:39.255900+0000","last_active":"2023-12-24T20:08:39.263196+0000","last_peered":"2023-12-24T20:08:39.263196+0000","last_clean":"2023-12-24T20:08:39.263196+0000","last_became_active":"2023-12-24T20:08:39.254111+0000","last_became_peered":"2023-12-24T20:08:39.254111+0000","last_unstale":"2023-12-24T20:08:39.263196+0000","last_undegraded":"2023-12-24T20:08:39.263196+0000","last_fullsized":"2023-12-24T20:08:39.263196+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272078+0000","last_change":"2023-12-24T20:08:39.268992+0000","last_active":"2023-12-24T20:08:39.272078+0000","last_peered":"2023-12-24T20:08:39.272078+0000","last_clean":"2023-12-24T20:08:39.272078+0000","last_became_active":"2023-12-24T20:08:39.268661+0000","last_became_peered":"2023-12-24T20:08:39.268661+0000","last_unstale":"2023-12-24T20:08:39.272078+0000","last_undegraded":"2023-12-24T20:08:39.272078+0000","last_fullsized":"2023-12-24T20:08:39.272078+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251985+0000","last_change":"2023-12-24T20:08:39.248160+0000","last_active":"2023-12-24T20:08:39.251985+0000","last_peered":"2023-12-24T20:08:39.251985+0000","last_clean":"2023-12-24T20:08:39.251985+0000","last_became_active":"2023-12-24T20:08:39.247402+0000","last_became_peered":"2023-12-24T20:08:39.247402+0000","last_unstale":"2023-12-24T20:08:39.251985+0000","last_undegraded":"2023-12-24T20:08:39.251985+0000","last_fullsized":"2023-12-24T20:08:39.251985+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:17.120833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270764+0000","last_change":"2023-12-24T20:08:39.266760+0000","last_active":"2023-12-24T20:08:39.270764+0000","last_peered":"2023-12-24T20:08:39.270764+0000","last_clean":"2023-12-24T20:08:39.270764+0000","last_became_active":"2023-12-24T20:08:39.265577+0000","last_became_peered":"2023-12-24T20:08:39.265577+0000","last_unstale":"2023-12-24T20:08:39.270764+0000","last_undegraded":"2023-12-24T20:08:39.270764+0000","last_fullsized":"2023-12-24T20:08:39.270764+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:38.722712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261563+0000","last_change":"2023-12-24T20:08:39.255496+0000","last_active":"2023-12-24T20:08:39.261563+0000","last_peered":"2023-12-24T20:08:39.261563+0000","last_clean":"2023-12-24T20:08:39.261563+0000","last_became_active":"2023-12-24T20:08:39.254996+0000","last_became_peered":"2023-12-24T20:08:39.254996+0000","last_unstale":"2023-12-24T20:08:39.261563+0000","last_undegraded":"2023-12-24T20:08:39.261563+0000","last_fullsized":"2023-12-24T20:08:39.261563+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:33.780421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.266185+0000","last_change":"2023-12-24T20:08:39.264683+0000","last_active":"2023-12-24T20:08:39.266185+0000","last_peered":"2023-12-24T20:08:39.266185+0000","last_clean":"2023-12-24T20:08:39.266185+0000","last_became_active":"2023-12-24T20:08:39.264342+0000","last_became_peered":"2023-12-24T20:08:39.264342+0000","last_unstale":"2023-12-24T20:08:39.266185+0000","last_undegraded":"2023-12-24T20:08:39.266185+0000","last_fullsized":"2023-12-24T20:08:39.266185+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269363+0000","last_change":"2023-12-24T20:08:39.257674+0000","last_active":"2023-12-24T20:08:39.269363+0000","last_peered":"2023-12-24T20:08:39.269363+0000","last_clean":"2023-12-24T20:08:39.269363+0000","last_became_active":"2023-12-24T20:08:39.257389+0000","last_became_peered":"2023-12-24T20:08:39.257389+0000","last_unstale":"2023-12-24T20:08:39.269363+0000","last_undegraded":"2023-12-24T20:08:39.269363+0000","last_fullsized":"2023-12-24T20:08:39.269363+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:26.974198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271002+0000","last_change":"2023-12-24T20:08:39.258398+0000","last_active":"2023-12-24T20:08:39.271002+0000","last_peered":"2023-12-24T20:08:39.271002+0000","last_clean":"2023-12-24T20:08:39.271002+0000","last_became_active":"2023-12-24T20:08:39.257772+0000","last_became_peered":"2023-12-24T20:08:39.257772+0000","last_unstale":"2023-12-24T20:08:39.271002+0000","last_undegraded":"2023-12-24T20:08:39.271002+0000","last_fullsized":"2023-12-24T20:08:39.271002+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:56.189952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261999+0000","last_change":"2023-12-24T20:08:39.256454+0000","last_active":"2023-12-24T20:08:39.261999+0000","last_peered":"2023-12-24T20:08:39.261999+0000","last_clean":"2023-12-24T20:08:39.261999+0000","last_became_active":"2023-12-24T20:08:39.256157+0000","last_became_peered":"2023-12-24T20:08:39.256157+0000","last_unstale":"2023-12-24T20:08:39.261999+0000","last_undegraded":"2023-12-24T20:08:39.261999+0000","last_fullsized":"2023-12-24T20:08:39.261999+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:48.478125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261598+0000","last_change":"2023-12-24T20:08:39.254994+0000","last_active":"2023-12-24T20:08:39.261598+0000","last_peered":"2023-12-24T20:08:39.261598+0000","last_clean":"2023-12-24T20:08:39.261598+0000","last_became_active":"2023-12-24T20:08:39.254531+0000","last_became_peered":"2023-12-24T20:08:39.254531+0000","last_unstale":"2023-12-24T20:08:39.261598+0000","last_undegraded":"2023-12-24T20:08:39.261598+0000","last_fullsized":"2023-12-24T20:08:39.261598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:48:23.827865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251966+0000","last_change":"2023-12-24T20:08:39.247588+0000","last_active":"2023-12-24T20:08:39.251966+0000","last_peered":"2023-12-24T20:08:39.251966+0000","last_clean":"2023-12-24T20:08:39.251966+0000","last_became_active":"2023-12-24T20:08:39.247017+0000","last_became_peered":"2023-12-24T20:08:39.247017+0000","last_unstale":"2023-12-24T20:08:39.251966+0000","last_undegraded":"2023-12-24T20:08:39.251966+0000","last_fullsized":"2023-12-24T20:08:39.251966+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:46.594765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271550+0000","last_change":"2023-12-24T20:08:39.258623+0000","last_active":"2023-12-24T20:08:39.271550+0000","last_peered":"2023-12-24T20:08:39.271550+0000","last_clean":"2023-12-24T20:08:39.271550+0000","last_became_active":"2023-12-24T20:08:39.258321+0000","last_became_peered":"2023-12-24T20:08:39.258321+0000","last_unstale":"2023-12-24T20:08:39.271550+0000","last_undegraded":"2023-12-24T20:08:39.271550+0000","last_fullsized":"2023-12-24T20:08:39.271550+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:23:45.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.245788+0000","last_change":"2023-12-24T20:08:39.241938+0000","last_active":"2023-12-24T20:08:39.245788+0000","last_peered":"2023-12-24T20:08:39.245788+0000","last_clean":"2023-12-24T20:08:39.245788+0000","last_became_active":"2023-12-24T20:08:39.241578+0000","last_became_peered":"2023-12-24T20:08:39.241578+0000","last_unstale":"2023-12-24T20:08:39.245788+0000","last_undegraded":"2023-12-24T20:08:39.245788+0000","last_fullsized":"2023-12-24T20:08:39.245788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260365+0000","last_change":"2023-12-24T20:08:39.255883+0000","last_active":"2023-12-24T20:08:39.260365+0000","last_peered":"2023-12-24T20:08:39.260365+0000","last_clean":"2023-12-24T20:08:39.260365+0000","last_became_active":"2023-12-24T20:08:39.255588+0000","last_became_peered":"2023-12-24T20:08:39.255588+0000","last_unstale":"2023-12-24T20:08:39.260365+0000","last_undegraded":"2023-12-24T20:08:39.260365+0000","last_fullsized":"2023-12-24T20:08:39.260365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:42:28.887874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271234+0000","last_change":"2023-12-24T20:08:39.260289+0000","last_active":"2023-12-24T20:08:39.271234+0000","last_peered":"2023-12-24T20:08:39.271234+0000","last_clean":"2023-12-24T20:08:39.271234+0000","last_became_active":"2023-12-24T20:08:39.259821+0000","last_became_peered":"2023-12-24T20:08:39.259821+0000","last_unstale":"2023-12-24T20:08:39.271234+0000","last_undegraded":"2023-12-24T20:08:39.271234+0000","last_fullsized":"2023-12-24T20:08:39.271234+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.265923+0000","last_change":"2023-12-24T20:08:39.264321+0000","last_active":"2023-12-24T20:08:39.265923+0000","last_peered":"2023-12-24T20:08:39.265923+0000","last_clean":"2023-12-24T20:08:39.265923+0000","last_became_active":"2023-12-24T20:08:39.263895+0000","last_became_peered":"2023-12-24T20:08:39.263895+0000","last_unstale":"2023-12-24T20:08:39.265923+0000","last_undegraded":"2023-12-24T20:08:39.265923+0000","last_fullsized":"2023-12-24T20:08:39.265923+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:05.893308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259457+0000","last_change":"2023-12-24T20:08:39.250850+0000","last_active":"2023-12-24T20:08:39.259457+0000","last_peered":"2023-12-24T20:08:39.259457+0000","last_clean":"2023-12-24T20:08:39.259457+0000","last_became_active":"2023-12-24T20:08:39.250550+0000","last_became_peered":"2023-12-24T20:08:39.250550+0000","last_unstale":"2023-12-24T20:08:39.259457+0000","last_undegraded":"2023-12-24T20:08:39.259457+0000","last_fullsized":"2023-12-24T20:08:39.259457+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:23:20.667204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256598+0000","last_change":"2023-12-24T20:08:39.252094+0000","last_active":"2023-12-24T20:08:39.256598+0000","last_peered":"2023-12-24T20:08:39.256598+0000","last_clean":"2023-12-24T20:08:39.256598+0000","last_became_active":"2023-12-24T20:08:39.251788+0000","last_became_peered":"2023-12-24T20:08:39.251788+0000","last_unstale":"2023-12-24T20:08:39.256598+0000","last_undegraded":"2023-12-24T20:08:39.256598+0000","last_fullsized":"2023-12-24T20:08:39.256598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259153+0000","last_change":"2023-12-24T20:08:39.253505+0000","last_active":"2023-12-24T20:08:39.259153+0000","last_peered":"2023-12-24T20:08:39.259153+0000","last_clean":"2023-12-24T20:08:39.259153+0000","last_became_active":"2023-12-24T20:08:39.253214+0000","last_became_peered":"2023-12-24T20:08:39.253214+0000","last_unstale":"2023-12-24T20:08:39.259153+0000","last_undegraded":"2023-12-24T20:08:39.259153+0000","last_fullsized":"2023-12-24T20:08:39.259153+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:49.615897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272168+0000","last_change":"2023-12-24T20:08:39.267015+0000","last_active":"2023-12-24T20:08:39.272168+0000","last_peered":"2023-12-24T20:08:39.272168+0000","last_clean":"2023-12-24T20:08:39.272168+0000","last_became_active":"2023-12-24T20:08:39.266103+0000","last_became_peered":"2023-12-24T20:08:39.266103+0000","last_unstale":"2023-12-24T20:08:39.272168+0000","last_undegraded":"2023-12-24T20:08:39.272168+0000","last_fullsized":"2023-12-24T20:08:39.272168+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:52.239952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"192'4","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276783+0000","last_change":"2023-12-24T20:08:38.240700+0000","last_active":"2023-12-24T20:08:39.276783+0000","last_peered":"2023-12-24T20:08:39.276783+0000","last_clean":"2023-12-24T20:08:39.276783+0000","last_became_active":"2023-12-24T20:08:38.240414+0000","last_became_peered":"2023-12-24T20:08:38.240414+0000","last_unstale":"2023-12-24T20:08:39.276783+0000","last_undegraded":"2023-12-24T20:08:39.276783+0000","last_fullsized":"2023-12-24T20:08:39.276783+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:47.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270472+0000","last_change":"2023-12-24T20:08:39.256207+0000","last_active":"2023-12-24T20:08:39.270472+0000","last_peered":"2023-12-24T20:08:39.270472+0000","last_clean":"2023-12-24T20:08:39.270472+0000","last_became_active":"2023-12-24T20:08:39.255922+0000","last_became_peered":"2023-12-24T20:08:39.255922+0000","last_unstale":"2023-12-24T20:08:39.270472+0000","last_undegraded":"2023-12-24T20:08:39.270472+0000","last_fullsized":"2023-12-24T20:08:39.270472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:39.770243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281278+0000","last_change":"2023-12-24T20:08:38.255635+0000","last_active":"2023-12-24T20:08:39.281278+0000","last_peered":"2023-12-24T20:08:39.281278+0000","last_clean":"2023-12-24T20:08:39.281278+0000","last_became_active":"2023-12-24T20:08:38.255261+0000","last_became_peered":"2023-12-24T20:08:38.255261+0000","last_unstale":"2023-12-24T20:08:39.281278+0000","last_undegraded":"2023-12-24T20:08:39.281278+0000","last_fullsized":"2023-12-24T20:08:39.281278+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263177+0000","last_change":"2023-12-24T20:08:39.254070+0000","last_active":"2023-12-24T20:08:39.263177+0000","last_peered":"2023-12-24T20:08:39.263177+0000","last_clean":"2023-12-24T20:08:39.263177+0000","last_became_active":"2023-12-24T20:08:39.253766+0000","last_became_peered":"2023-12-24T20:08:39.253766+0000","last_unstale":"2023-12-24T20:08:39.263177+0000","last_undegraded":"2023-12-24T20:08:39.263177+0000","last_fullsized":"2023-12-24T20:08:39.263177+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.274202+0000","last_change":"2023-12-24T20:08:38.244714+0000","last_active":"2023-12-24T20:08:39.274202+0000","last_peered":"2023-12-24T20:08:39.274202+0000","last_clean":"2023-12-24T20:08:39.274202+0000","last_became_active":"2023-12-24T20:08:38.244411+0000","last_became_peered":"2023-12-24T20:08:38.244411+0000","last_unstale":"2023-12-24T20:08:39.274202+0000","last_undegraded":"2023-12-24T20:08:39.274202+0000","last_fullsized":"2023-12-24T20:08:39.274202+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269382+0000","last_change":"2023-12-24T20:08:39.265824+0000","last_active":"2023-12-24T20:08:39.269382+0000","last_peered":"2023-12-24T20:08:39.269382+0000","last_clean":"2023-12-24T20:08:39.269382+0000","last_became_active":"2023-12-24T20:08:39.265356+0000","last_became_peered":"2023-12-24T20:08:39.265356+0000","last_unstale":"2023-12-24T20:08:39.269382+0000","last_undegraded":"2023-12-24T20:08:39.269382+0000","last_fullsized":"2023-12-24T20:08:39.269382+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:40.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.275303+0000","last_change":"2023-12-24T20:08:38.246604+0000","last_active":"2023-12-24T20:08:39.275303+0000","last_peered":"2023-12-24T20:08:39.275303+0000","last_clean":"2023-12-24T20:08:39.275303+0000","last_became_active":"2023-12-24T20:08:38.246300+0000","last_became_peered":"2023-12-24T20:08:38.246300+0000","last_unstale":"2023-12-24T20:08:39.275303+0000","last_undegraded":"2023-12-24T20:08:39.275303+0000","last_fullsized":"2023-12-24T20:08:39.275303+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:17.334028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270531+0000","last_change":"2023-12-24T20:08:39.266196+0000","last_active":"2023-12-24T20:08:39.270531+0000","last_peered":"2023-12-24T20:08:39.270531+0000","last_clean":"2023-12-24T20:08:39.270531+0000","last_became_active":"2023-12-24T20:08:39.265163+0000","last_became_peered":"2023-12-24T20:08:39.265163+0000","last_unstale":"2023-12-24T20:08:39.270531+0000","last_undegraded":"2023-12-24T20:08:39.270531+0000","last_fullsized":"2023-12-24T20:08:39.270531+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:12:25.048378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278364+0000","last_change":"2023-12-24T20:08:38.255319+0000","last_active":"2023-12-24T20:08:39.278364+0000","last_peered":"2023-12-24T20:08:39.278364+0000","last_clean":"2023-12-24T20:08:39.278364+0000","last_became_active":"2023-12-24T20:08:38.255035+0000","last_became_peered":"2023-12-24T20:08:38.255035+0000","last_unstale":"2023-12-24T20:08:39.278364+0000","last_undegraded":"2023-12-24T20:08:39.278364+0000","last_fullsized":"2023-12-24T20:08:39.278364+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.268365+0000","last_change":"2023-12-24T20:08:39.258550+0000","last_active":"2023-12-24T20:08:39.268365+0000","last_peered":"2023-12-24T20:08:39.268365+0000","last_clean":"2023-12-24T20:08:39.268365+0000","last_became_active":"2023-12-24T20:08:39.258267+0000","last_became_peered":"2023-12-24T20:08:39.258267+0000","last_unstale":"2023-12-24T20:08:39.268365+0000","last_undegraded":"2023-12-24T20:08:39.268365+0000","last_fullsized":"2023-12-24T20:08:39.268365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.872081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281648+0000","last_change":"2023-12-24T20:08:38.256797+0000","last_active":"2023-12-24T20:08:39.281648+0000","last_peered":"2023-12-24T20:08:39.281648+0000","last_clean":"2023-12-24T20:08:39.281648+0000","last_became_active":"2023-12-24T20:08:38.256462+0000","last_became_peered":"2023-12-24T20:08:38.256462+0000","last_unstale":"2023-12-24T20:08:39.281648+0000","last_undegraded":"2023-12-24T20:08:39.281648+0000","last_fullsized":"2023-12-24T20:08:39.281648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263266+0000","last_change":"2023-12-24T20:08:39.252283+0000","last_active":"2023-12-24T20:08:39.263266+0000","last_peered":"2023-12-24T20:08:39.263266+0000","last_clean":"2023-12-24T20:08:39.263266+0000","last_became_active":"2023-12-24T20:08:39.251971+0000","last_became_peered":"2023-12-24T20:08:39.251971+0000","last_unstale":"2023-12-24T20:08:39.263266+0000","last_undegraded":"2023-12-24T20:08:39.263266+0000","last_fullsized":"2023-12-24T20:08:39.263266+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:17.713632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229002+0000","last_change":"2023-12-24T20:08:38.243723+0000","last_active":"2023-12-24T20:08:39.229002+0000","last_peered":"2023-12-24T20:08:39.229002+0000","last_clean":"2023-12-24T20:08:39.229002+0000","last_became_active":"2023-12-24T20:08:38.243019+0000","last_became_peered":"2023-12-24T20:08:38.243019+0000","last_unstale":"2023-12-24T20:08:39.229002+0000","last_undegraded":"2023-12-24T20:08:39.229002+0000","last_fullsized":"2023-12-24T20:08:39.229002+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:35.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255044+0000","last_change":"2023-12-24T20:08:39.248182+0000","last_active":"2023-12-24T20:08:39.255044+0000","last_peered":"2023-12-24T20:08:39.255044+0000","last_clean":"2023-12-24T20:08:39.255044+0000","last_became_active":"2023-12-24T20:08:39.247850+0000","last_became_peered":"2023-12-24T20:08:39.247850+0000","last_unstale":"2023-12-24T20:08:39.255044+0000","last_undegraded":"2023-12-24T20:08:39.255044+0000","last_fullsized":"2023-12-24T20:08:39.255044+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:42.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243004+0000","last_change":"2023-12-24T20:08:38.253034+0000","last_active":"2023-12-24T20:08:39.243004+0000","last_peered":"2023-12-24T20:08:39.243004+0000","last_clean":"2023-12-24T20:08:39.243004+0000","last_became_active":"2023-12-24T20:08:38.252713+0000","last_became_peered":"2023-12-24T20:08:38.252713+0000","last_unstale":"2023-12-24T20:08:39.243004+0000","last_undegraded":"2023-12-24T20:08:39.243004+0000","last_fullsized":"2023-12-24T20:08:39.243004+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272150+0000","last_change":"2023-12-24T20:08:39.267266+0000","last_active":"2023-12-24T20:08:39.272150+0000","last_peered":"2023-12-24T20:08:39.272150+0000","last_clean":"2023-12-24T20:08:39.272150+0000","last_became_active":"2023-12-24T20:08:39.266976+0000","last_became_peered":"2023-12-24T20:08:39.266976+0000","last_unstale":"2023-12-24T20:08:39.272150+0000","last_undegraded":"2023-12-24T20:08:39.272150+0000","last_fullsized":"2023-12-24T20:08:39.272150+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:06.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.241865+0000","last_change":"2023-12-24T20:08:38.254881+0000","last_active":"2023-12-24T20:08:39.241865+0000","last_peered":"2023-12-24T20:08:39.241865+0000","last_clean":"2023-12-24T20:08:39.241865+0000","last_became_active":"2023-12-24T20:08:38.254519+0000","last_became_peered":"2023-12-24T20:08:38.254519+0000","last_unstale":"2023-12-24T20:08:39.241865+0000","last_undegraded":"2023-12-24T20:08:39.241865+0000","last_fullsized":"2023-12-24T20:08:39.241865+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:23.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271183+0000","last_change":"2023-12-24T20:08:39.258291+0000","last_active":"2023-12-24T20:08:39.271183+0000","last_peered":"2023-12-24T20:08:39.271183+0000","last_clean":"2023-12-24T20:08:39.271183+0000","last_became_active":"2023-12-24T20:08:39.255972+0000","last_became_peered":"2023-12-24T20:08:39.255972+0000","last_unstale":"2023-12-24T20:08:39.271183+0000","last_undegraded":"2023-12-24T20:08:39.271183+0000","last_fullsized":"2023-12-24T20:08:39.271183+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:13.784610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269848+0000","last_change":"2023-12-24T20:08:38.239476+0000","last_active":"2023-12-24T20:08:39.269848+0000","last_peered":"2023-12-24T20:08:39.269848+0000","last_clean":"2023-12-24T20:08:39.269848+0000","last_became_active":"2023-12-24T20:08:38.239171+0000","last_became_peered":"2023-12-24T20:08:38.239171+0000","last_unstale":"2023-12-24T20:08:39.269848+0000","last_undegraded":"2023-12-24T20:08:39.269848+0000","last_fullsized":"2023-12-24T20:08:39.269848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T08:00:49.593212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.249982+0000","last_change":"2023-12-24T20:08:39.243493+0000","last_active":"2023-12-24T20:08:39.249982+0000","last_peered":"2023-12-24T20:08:39.249982+0000","last_clean":"2023-12-24T20:08:39.249982+0000","last_became_active":"2023-12-24T20:08:39.243091+0000","last_became_peered":"2023-12-24T20:08:39.243091+0000","last_unstale":"2023-12-24T20:08:39.249982+0000","last_undegraded":"2023-12-24T20:08:39.249982+0000","last_fullsized":"2023-12-24T20:08:39.249982+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:33.552641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"192'6","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.284188+0000","last_change":"2023-12-24T20:08:38.251434+0000","last_active":"2023-12-24T20:08:39.284188+0000","last_peered":"2023-12-24T20:08:39.284188+0000","last_clean":"2023-12-24T20:08:39.284188+0000","last_became_active":"2023-12-24T20:08:38.249590+0000","last_became_peered":"2023-12-24T20:08:38.249590+0000","last_unstale":"2023-12-24T20:08:39.284188+0000","last_undegraded":"2023-12-24T20:08:39.284188+0000","last_fullsized":"2023-12-24T20:08:39.284188+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:14.934133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259751+0000","last_change":"2023-12-24T20:08:39.252251+0000","last_active":"2023-12-24T20:08:39.259751+0000","last_peered":"2023-12-24T20:08:39.259751+0000","last_clean":"2023-12-24T20:08:39.259751+0000","last_became_active":"2023-12-24T20:08:39.251277+0000","last_became_peered":"2023-12-24T20:08:39.251277+0000","last_unstale":"2023-12-24T20:08:39.259751+0000","last_undegraded":"2023-12-24T20:08:39.259751+0000","last_fullsized":"2023-12-24T20:08:39.259751+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:04.044223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281622+0000","last_change":"2023-12-24T20:08:38.244032+0000","last_active":"2023-12-24T20:08:39.281622+0000","last_peered":"2023-12-24T20:08:39.281622+0000","last_clean":"2023-12-24T20:08:39.281622+0000","last_became_active":"2023-12-24T20:08:38.243765+0000","last_became_peered":"2023-12-24T20:08:38.243765+0000","last_unstale":"2023-12-24T20:08:39.281622+0000","last_undegraded":"2023-12-24T20:08:39.281622+0000","last_fullsized":"2023-12-24T20:08:39.281622+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.264695+0000","last_change":"2023-12-24T20:08:39.256123+0000","last_active":"2023-12-24T20:08:39.264695+0000","last_peered":"2023-12-24T20:08:39.264695+0000","last_clean":"2023-12-24T20:08:39.264695+0000","last_became_active":"2023-12-24T20:08:39.255845+0000","last_became_peered":"2023-12-24T20:08:39.255845+0000","last_unstale":"2023-12-24T20:08:39.264695+0000","last_undegraded":"2023-12-24T20:08:39.264695+0000","last_fullsized":"2023-12-24T20:08:39.264695+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240884+0000","last_change":"2023-12-24T20:08:38.254571+0000","last_active":"2023-12-24T20:08:39.240884+0000","last_peered":"2023-12-24T20:08:39.240884+0000","last_clean":"2023-12-24T20:08:39.240884+0000","last_became_active":"2023-12-24T20:08:38.253910+0000","last_became_peered":"2023-12-24T20:08:38.253910+0000","last_unstale":"2023-12-24T20:08:39.240884+0000","last_undegraded":"2023-12-24T20:08:39.240884+0000","last_fullsized":"2023-12-24T20:08:39.240884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:56.484325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.254492+0000","last_change":"2023-12-24T20:08:39.251583+0000","last_active":"2023-12-24T20:08:39.254492+0000","last_peered":"2023-12-24T20:08:39.254492+0000","last_clean":"2023-12-24T20:08:39.254492+0000","last_became_active":"2023-12-24T20:08:39.250926+0000","last_became_peered":"2023-12-24T20:08:39.250926+0000","last_unstale":"2023-12-24T20:08:39.254492+0000","last_undegraded":"2023-12-24T20:08:39.254492+0000","last_fullsized":"2023-12-24T20:08:39.254492+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240566+0000","last_change":"2023-12-24T20:08:38.252005+0000","last_active":"2023-12-24T20:08:39.240566+0000","last_peered":"2023-12-24T20:08:39.240566+0000","last_clean":"2023-12-24T20:08:39.240566+0000","last_became_active":"2023-12-24T20:08:38.251718+0000","last_became_peered":"2023-12-24T20:08:38.251718+0000","last_unstale":"2023-12-24T20:08:39.240566+0000","last_undegraded":"2023-12-24T20:08:39.240566+0000","last_fullsized":"2023-12-24T20:08:39.240566+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243182+0000","last_change":"2023-12-24T20:08:39.239953+0000","last_active":"2023-12-24T20:08:39.243182+0000","last_peered":"2023-12-24T20:08:39.243182+0000","last_clean":"2023-12-24T20:08:39.243182+0000","last_became_active":"2023-12-24T20:08:39.239598+0000","last_became_peered":"2023-12-24T20:08:39.239598+0000","last_unstale":"2023-12-24T20:08:39.243182+0000","last_undegraded":"2023-12-24T20:08:39.243182+0000","last_fullsized":"2023-12-24T20:08:39.243182+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:22.720213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"192'8","reported_seq":18,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281579+0000","last_change":"2023-12-24T20:08:38.247901+0000","last_active":"2023-12-24T20:08:39.281579+0000","last_peered":"2023-12-24T20:08:39.281579+0000","last_clean":"2023-12-24T20:08:39.281579+0000","last_became_active":"2023-12-24T20:08:38.247604+0000","last_became_peered":"2023-12-24T20:08:38.247604+0000","last_unstale":"2023-12-24T20:08:39.281579+0000","last_undegraded":"2023-12-24T20:08:39.281579+0000","last_fullsized":"2023-12-24T20:08:39.281579+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276940+0000","last_change":"2023-12-24T20:08:39.270339+0000","last_active":"2023-12-24T20:08:39.276940+0000","last_peered":"2023-12-24T20:08:39.276940+0000","last_clean":"2023-12-24T20:08:39.276940+0000","last_became_active":"2023-12-24T20:08:39.270031+0000","last_became_peered":"2023-12-24T20:08:39.270031+0000","last_unstale":"2023-12-24T20:08:39.276940+0000","last_undegraded":"2023-12-24T20:08:39.276940+0000","last_fullsized":"2023-12-24T20:08:39.276940+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:26.458164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279784+0000","last_change":"2023-12-24T20:08:38.240060+0000","last_active":"2023-12-24T20:08:39.279784+0000","last_peered":"2023-12-24T20:08:39.279784+0000","last_clean":"2023-12-24T20:08:39.279784+0000","last_became_active":"2023-12-24T20:08:38.239336+0000","last_became_peered":"2023-12-24T20:08:38.239336+0000","last_unstale":"2023-12-24T20:08:39.279784+0000","last_undegraded":"2023-12-24T20:08:39.279784+0000","last_fullsized":"2023-12-24T20:08:39.279784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:27.226154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259418+0000","last_change":"2023-12-24T20:08:39.254126+0000","last_active":"2023-12-24T20:08:39.259418+0000","last_peered":"2023-12-24T20:08:39.259418+0000","last_clean":"2023-12-24T20:08:39.259418+0000","last_became_active":"2023-12-24T20:08:39.253845+0000","last_became_peered":"2023-12-24T20:08:39.253845+0000","last_unstale":"2023-12-24T20:08:39.259418+0000","last_undegraded":"2023-12-24T20:08:39.259418+0000","last_fullsized":"2023-12-24T20:08:39.259418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:41.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279501+0000","last_change":"2023-12-24T20:08:38.248304+0000","last_active":"2023-12-24T20:08:39.279501+0000","last_peered":"2023-12-24T20:08:39.279501+0000","last_clean":"2023-12-24T20:08:39.279501+0000","last_became_active":"2023-12-24T20:08:38.247924+0000","last_became_peered":"2023-12-24T20:08:38.247924+0000","last_unstale":"2023-12-24T20:08:39.279501+0000","last_undegraded":"2023-12-24T20:08:39.279501+0000","last_fullsized":"2023-12-24T20:08:39.279501+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:24.843770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.252851+0000","last_change":"2023-12-24T20:08:39.250188+0000","last_active":"2023-12-24T20:08:39.252851+0000","last_peered":"2023-12-24T20:08:39.252851+0000","last_clean":"2023-12-24T20:08:39.252851+0000","last_became_active":"2023-12-24T20:08:39.249421+0000","last_became_peered":"2023-12-24T20:08:39.249421+0000","last_unstale":"2023-12-24T20:08:39.252851+0000","last_undegraded":"2023-12-24T20:08:39.252851+0000","last_fullsized":"2023-12-24T20:08:39.252851+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278103+0000","last_change":"2023-12-24T20:08:38.245114+0000","last_active":"2023-12-24T20:08:39.278103+0000","last_peered":"2023-12-24T20:08:39.278103+0000","last_clean":"2023-12-24T20:08:39.278103+0000","last_became_active":"2023-12-24T20:08:38.244729+0000","last_became_peered":"2023-12-24T20:08:38.244729+0000","last_unstale":"2023-12-24T20:08:39.278103+0000","last_undegraded":"2023-12-24T20:08:39.278103+0000","last_fullsized":"2023-12-24T20:08:39.278103+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256690+0000","last_change":"2023-12-24T20:08:39.253674+0000","last_active":"2023-12-24T20:08:39.256690+0000","last_peered":"2023-12-24T20:08:39.256690+0000","last_clean":"2023-12-24T20:08:39.256690+0000","last_became_active":"2023-12-24T20:08:39.253369+0000","last_became_peered":"2023-12-24T20:08:39.253369+0000","last_unstale":"2023-12-24T20:08:39.256690+0000","last_undegraded":"2023-12-24T20:08:39.256690+0000","last_fullsized":"2023-12-24T20:08:39.256690+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242781+0000","last_change":"2023-12-24T20:08:38.253981+0000","last_active":"2023-12-24T20:08:39.242781+0000","last_peered":"2023-12-24T20:08:39.242781+0000","last_clean":"2023-12-24T20:08:39.242781+0000","last_became_active":"2023-12-24T20:08:38.253691+0000","last_became_peered":"2023-12-24T20:08:38.253691+0000","last_unstale":"2023-12-24T20:08:39.242781+0000","last_undegraded":"2023-12-24T20:08:39.242781+0000","last_fullsized":"2023-12-24T20:08:39.242781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271215+0000","last_change":"2023-12-24T20:08:39.260099+0000","last_active":"2023-12-24T20:08:39.271215+0000","last_peered":"2023-12-24T20:08:39.271215+0000","last_clean":"2023-12-24T20:08:39.271215+0000","last_became_active":"2023-12-24T20:08:39.259444+0000","last_became_peered":"2023-12-24T20:08:39.259444+0000","last_unstale":"2023-12-24T20:08:39.271215+0000","last_undegraded":"2023-12-24T20:08:39.271215+0000","last_fullsized":"2023-12-24T20:08:39.271215+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.280314+0000","last_change":"2023-12-24T20:08:38.245770+0000","last_active":"2023-12-24T20:08:39.280314+0000","last_peered":"2023-12-24T20:08:39.280314+0000","last_clean":"2023-12-24T20:08:39.280314+0000","last_became_active":"2023-12-24T20:08:38.245431+0000","last_became_peered":"2023-12-24T20:08:38.245431+0000","last_unstale":"2023-12-24T20:08:39.280314+0000","last_undegraded":"2023-12-24T20:08:39.280314+0000","last_fullsized":"2023-12-24T20:08:39.280314+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271955+0000","last_change":"2023-12-24T20:08:39.264271+0000","last_active":"2023-12-24T20:08:39.271955+0000","last_peered":"2023-12-24T20:08:39.271955+0000","last_clean":"2023-12-24T20:08:39.271955+0000","last_became_active":"2023-12-24T20:08:39.263819+0000","last_became_peered":"2023-12-24T20:08:39.263819+0000","last_unstale":"2023-12-24T20:08:39.271955+0000","last_undegraded":"2023-12-24T20:08:39.271955+0000","last_fullsized":"2023-12-24T20:08:39.271955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.239064+0000","last_change":"2023-12-24T20:08:38.256267+0000","last_active":"2023-12-24T20:08:39.239064+0000","last_peered":"2023-12-24T20:08:39.239064+0000","last_clean":"2023-12-24T20:08:39.239064+0000","last_became_active":"2023-12-24T20:08:38.255858+0000","last_became_peered":"2023-12-24T20:08:38.255858+0000","last_unstale":"2023-12-24T20:08:39.239064+0000","last_undegraded":"2023-12-24T20:08:39.239064+0000","last_fullsized":"2023-12-24T20:08:39.239064+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262529+0000","last_change":"2023-12-24T20:08:39.258104+0000","last_active":"2023-12-24T20:08:39.262529+0000","last_peered":"2023-12-24T20:08:39.262529+0000","last_clean":"2023-12-24T20:08:39.262529+0000","last_became_active":"2023-12-24T20:08:39.257822+0000","last_became_peered":"2023-12-24T20:08:39.257822+0000","last_unstale":"2023-12-24T20:08:39.262529+0000","last_undegraded":"2023-12-24T20:08:39.262529+0000","last_fullsized":"2023-12-24T20:08:39.262529+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229366+0000","last_change":"2023-12-24T20:08:38.243949+0000","last_active":"2023-12-24T20:08:39.229366+0000","last_peered":"2023-12-24T20:08:39.229366+0000","last_clean":"2023-12-24T20:08:39.229366+0000","last_became_active":"2023-12-24T20:08:38.243446+0000","last_became_peered":"2023-12-24T20:08:38.243446+0000","last_unstale":"2023-12-24T20:08:39.229366+0000","last_undegraded":"2023-12-24T20:08:39.229366+0000","last_fullsized":"2023-12-24T20:08:39.229366+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:52.516275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256761+0000","last_change":"2023-12-24T20:08:39.253736+0000","last_active":"2023-12-24T20:08:39.256761+0000","last_peered":"2023-12-24T20:08:39.256761+0000","last_clean":"2023-12-24T20:08:39.256761+0000","last_became_active":"2023-12-24T20:08:39.251407+0000","last_became_peered":"2023-12-24T20:08:39.251407+0000","last_unstale":"2023-12-24T20:08:39.256761+0000","last_undegraded":"2023-12-24T20:08:39.256761+0000","last_fullsized":"2023-12-24T20:08:39.256761+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:06.228504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242932+0000","last_change":"2023-12-24T20:08:38.246611+0000","last_active":"2023-12-24T20:08:39.242932+0000","last_peered":"2023-12-24T20:08:39.242932+0000","last_clean":"2023-12-24T20:08:39.242932+0000","last_became_active":"2023-12-24T20:08:38.245986+0000","last_became_peered":"2023-12-24T20:08:38.245986+0000","last_unstale":"2023-12-24T20:08:39.242932+0000","last_undegraded":"2023-12-24T20:08:39.242932+0000","last_fullsized":"2023-12-24T20:08:39.242932+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:39.839197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256639+0000","last_change":"2023-12-24T20:08:39.253242+0000","last_active":"2023-12-24T20:08:39.256639+0000","last_peered":"2023-12-24T20:08:39.256639+0000","last_clean":"2023-12-24T20:08:39.256639+0000","last_became_active":"2023-12-24T20:08:39.251554+0000","last_became_peered":"2023-12-24T20:08:39.251554+0000","last_unstale":"2023-12-24T20:08:39.256639+0000","last_undegraded":"2023-12-24T20:08:39.256639+0000","last_fullsized":"2023-12-24T20:08:39.256639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:28:14.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278816+0000","last_change":"2023-12-24T20:08:38.245783+0000","last_active":"2023-12-24T20:08:39.278816+0000","last_peered":"2023-12-24T20:08:39.278816+0000","last_clean":"2023-12-24T20:08:39.278816+0000","last_became_active":"2023-12-24T20:08:38.244565+0000","last_became_peered":"2023-12-24T20:08:38.244565+0000","last_unstale":"2023-12-24T20:08:39.278816+0000","last_undegraded":"2023-12-24T20:08:39.278816+0000","last_fullsized":"2023-12-24T20:08:39.278816+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270426+0000","last_change":"2023-12-24T20:08:39.265615+0000","last_active":"2023-12-24T20:08:39.270426+0000","last_peered":"2023-12-24T20:08:39.270426+0000","last_clean":"2023-12-24T20:08:39.270426+0000","last_became_active":"2023-12-24T20:08:39.263000+0000","last_became_peered":"2023-12-24T20:08:39.263000+0000","last_unstale":"2023-12-24T20:08:39.270426+0000","last_undegraded":"2023-12-24T20:08:39.270426+0000","last_fullsized":"2023-12-24T20:08:39.270426+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242211+0000","last_change":"2023-12-24T20:08:38.250806+0000","last_active":"2023-12-24T20:08:39.242211+0000","last_peered":"2023-12-24T20:08:39.242211+0000","last_clean":"2023-12-24T20:08:39.242211+0000","last_became_active":"2023-12-24T20:08:38.250359+0000","last_became_peered":"2023-12-24T20:08:38.250359+0000","last_unstale":"2023-12-24T20:08:39.242211+0000","last_undegraded":"2023-12-24T20:08:39.242211+0000","last_fullsized":"2023-12-24T20:08:39.242211+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:06.702396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.267639+0000","last_change":"2023-12-24T20:08:39.257209+0000","last_active":"2023-12-24T20:08:39.267639+0000","last_peered":"2023-12-24T20:08:39.267639+0000","last_clean":"2023-12-24T20:08:39.267639+0000","last_became_active":"2023-12-24T20:08:39.256410+0000","last_became_peered":"2023-12-24T20:08:39.256410+0000","last_unstale":"2023-12-24T20:08:39.267639+0000","last_undegraded":"2023-12-24T20:08:39.267639+0000","last_fullsized":"2023-12-24T20:08:39.267639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:26.287672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240490+0000","last_change":"2023-12-24T20:08:38.250328+0000","last_active":"2023-12-24T20:08:39.240490+0000","last_peered":"2023-12-24T20:08:39.240490+0000","last_clean":"2023-12-24T20:08:39.240490+0000","last_became_active":"2023-12-24T20:08:38.250020+0000","last_became_peered":"2023-12-24T20:08:38.250020+0000","last_unstale":"2023-12-24T20:08:39.240490+0000","last_undegraded":"2023-12-24T20:08:39.240490+0000","last_fullsized":"2023-12-24T20:08:39.240490+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:47.468412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260458+0000","last_change":"2023-12-24T20:08:39.251809+0000","last_active":"2023-12-24T20:08:39.260458+0000","last_peered":"2023-12-24T20:08:39.260458+0000","last_clean":"2023-12-24T20:08:39.260458+0000","last_became_active":"2023-12-24T20:08:39.251491+0000","last_became_peered":"2023-12-24T20:08:39.251491+0000","last_unstale":"2023-12-24T20:08:39.260458+0000","last_undegraded":"2023-12-24T20:08:39.260458+0000","last_fullsized":"2023-12-24T20:08:39.260458+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229549+0000","last_change":"2023-12-24T20:08:38.250060+0000","last_active":"2023-12-24T20:08:39.229549+0000","last_peered":"2023-12-24T20:08:39.229549+0000","last_clean":"2023-12-24T20:08:39.229549+0000","last_became_active":"2023-12-24T20:08:38.249746+0000","last_became_peered":"2023-12-24T20:08:38.249746+0000","last_unstale":"2023-12-24T20:08:39.229549+0000","last_undegraded":"2023-12-24T20:08:39.229549+0000","last_fullsized":"2023-12-24T20:08:39.229549+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:33.428126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255593+0000","last_change":"2023-12-24T20:08:39.252994+0000","last_active":"2023-12-24T20:08:39.255593+0000","last_peered":"2023-12-24T20:08:39.255593+0000","last_clean":"2023-12-24T20:08:39.255593+0000","last_became_active":"2023-12-24T20:08:39.252438+0000","last_became_peered":"2023-12-24T20:08:39.252438+0000","last_unstale":"2023-12-24T20:08:39.255593+0000","last_undegraded":"2023-12-24T20:08:39.255593+0000","last_fullsized":"2023-12-24T20:08:39.255593+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:44.720849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.233775+0000","last_change":"2023-12-24T20:08:38.243330+0000","last_active":"2023-12-24T20:08:39.233775+0000","last_peered":"2023-12-24T20:08:39.233775+0000","last_clean":"2023-12-24T20:08:39.233775+0000","last_became_active":"2023-12-24T20:08:38.242985+0000","last_became_peered":"2023-12-24T20:08:38.242985+0000","last_unstale":"2023-12-24T20:08:39.233775+0000","last_undegraded":"2023-12-24T20:08:39.233775+0000","last_fullsized":"2023-12-24T20:08:39.233775+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:40.375343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269420+0000","last_change":"2023-12-24T20:08:39.265833+0000","last_active":"2023-12-24T20:08:39.269420+0000","last_peered":"2023-12-24T20:08:39.269420+0000","last_clean":"2023-12-24T20:08:39.269420+0000","last_became_active":"2023-12-24T20:08:39.265456+0000","last_became_peered":"2023-12-24T20:08:39.265456+0000","last_unstale":"2023-12-24T20:08:39.269420+0000","last_undegraded":"2023-12-24T20:08:39.269420+0000","last_fullsized":"2023-12-24T20:08:39.269420+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:17.991414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240992+0000","last_change":"2023-12-24T20:08:38.260555+0000","last_active":"2023-12-24T20:08:39.240992+0000","last_peered":"2023-12-24T20:08:39.240992+0000","last_clean":"2023-12-24T20:08:39.240992+0000","last_became_active":"2023-12-24T20:08:38.260223+0000","last_became_peered":"2023-12-24T20:08:38.260223+0000","last_unstale":"2023-12-24T20:08:39.240992+0000","last_undegraded":"2023-12-24T20:08:39.240992+0000","last_fullsized":"2023-12-24T20:08:39.240992+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:59.815420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271743+0000","last_change":"2023-12-24T20:08:39.259346+0000","last_active":"2023-12-24T20:08:39.271743+0000","last_peered":"2023-12-24T20:08:39.271743+0000","last_clean":"2023-12-24T20:08:39.271743+0000","last_became_active":"2023-12-24T20:08:39.259051+0000","last_became_peered":"2023-12-24T20:08:39.259051+0000","last_unstale":"2023-12-24T20:08:39.271743+0000","last_undegraded":"2023-12-24T20:08:39.271743+0000","last_fullsized":"2023-12-24T20:08:39.271743+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:58.145573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240677+0000","last_change":"2023-12-24T20:08:38.245775+0000","last_active":"2023-12-24T20:08:39.240677+0000","last_peered":"2023-12-24T20:08:39.240677+0000","last_clean":"2023-12-24T20:08:39.240677+0000","last_became_active":"2023-12-24T20:08:38.245051+0000","last_became_peered":"2023-12-24T20:08:38.245051+0000","last_unstale":"2023-12-24T20:08:39.240677+0000","last_undegraded":"2023-12-24T20:08:39.240677+0000","last_fullsized":"2023-12-24T20:08:39.240677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.250034+0000","last_change":"2023-12-24T20:08:39.244572+0000","last_active":"2023-12-24T20:08:39.250034+0000","last_peered":"2023-12-24T20:08:39.250034+0000","last_clean":"2023-12-24T20:08:39.250034+0000","last_became_active":"2023-12-24T20:08:39.244190+0000","last_became_peered":"2023-12-24T20:08:39.244190+0000","last_unstale":"2023-12-24T20:08:39.250034+0000","last_undegraded":"2023-12-24T20:08:39.250034+0000","last_fullsized":"2023-12-24T20:08:39.250034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:30:43.712363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.235534+0000","last_change":"2023-12-24T20:08:38.245309+0000","last_active":"2023-12-24T20:08:39.235534+0000","last_peered":"2023-12-24T20:08:39.235534+0000","last_clean":"2023-12-24T20:08:39.235534+0000","last_became_active":"2023-12-24T20:08:38.245009+0000","last_became_peered":"2023-12-24T20:08:38.245009+0000","last_unstale":"2023-12-24T20:08:39.235534+0000","last_undegraded":"2023-12-24T20:08:39.235534+0000","last_fullsized":"2023-12-24T20:08:39.235534+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:10.563414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263769+0000","last_change":"2023-12-24T20:08:39.262632+0000","last_active":"2023-12-24T20:08:39.263769+0000","last_peered":"2023-12-24T20:08:39.263769+0000","last_clean":"2023-12-24T20:08:39.263769+0000","last_became_active":"2023-12-24T20:08:39.262309+0000","last_became_peered":"2023-12-24T20:08:39.262309+0000","last_unstale":"2023-12-24T20:08:39.263769+0000","last_undegraded":"2023-12-24T20:08:39.263769+0000","last_fullsized":"2023-12-24T20:08:39.263769+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:16.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242105+0000","last_change":"2023-12-24T20:08:38.250456+0000","last_active":"2023-12-24T20:08:39.242105+0000","last_peered":"2023-12-24T20:08:39.242105+0000","last_clean":"2023-12-24T20:08:39.242105+0000","last_became_active":"2023-12-24T20:08:38.250150+0000","last_became_peered":"2023-12-24T20:08:38.250150+0000","last_unstale":"2023-12-24T20:08:39.242105+0000","last_undegraded":"2023-12-24T20:08:39.242105+0000","last_fullsized":"2023-12-24T20:08:39.242105+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:36:59.848456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1043,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243026+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:08:39.243026+0000","last_peered":"2023-12-24T20:08:39.243026+0000","last_clean":"2023-12-24T20:08:39.243026+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:08:39.243026+0000","last_undegraded":"2023-12-24T20:08:39.243026+0000","last_fullsized":"2023-12-24T20:08:39.243026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304324,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067516,"statfs":{"total":96636764160,"available":96325136384,"internally_reserved":0,"allocated":3010560,"data_stored":1856490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1339999999999999,"15min":1.163},"min":{"1min":0.73399999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.46,"5min":1.728,"15min":1.728},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.179,"15min":1.1799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.163,"15min":1.169},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.518,"5min":1.718,"15min":1.9379999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.29,"15min":1.2669999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7130000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.262},"min":{"1min":0.92500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.514,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.123},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.85999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5580000000000001,"5min":1.752,"15min":1.8200000000000001},"last":1.264}]},{"osd":3,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.3280000000000001,"15min":1.319},"min":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6319999999999999,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.228},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":0.89200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.641,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.3720000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.246,"15min":1.214},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.865,"5min":1.865,"15min":2.194},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.3360000000000001,"15min":1.2769999999999999},"min":{"1min":0.88700000000000001,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":0.96699999999999997,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.873,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.411,"15min":1.3540000000000001},"min":{"1min":0.90600000000000003,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.3089999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4790000000000001,"15min":1.444},"min":{"1min":1.1040000000000001,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.3319999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":1.004,"5min":0.75600000000000001,"15min":0.55000000000000004},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.333}]}]},{"osd":6,"up_from":13,"seq":55834575949,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2929999999999999,"15min":1.3129999999999999},"min":{"1min":0.97299999999999998,"5min":0.66800000000000004,"15min":0.44500000000000001},"max":{"1min":1.645,"5min":1.7210000000000001,"15min":1.837},"last":1.238},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":1.1759999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6160000000000001,"5min":1.744,"15min":1.821},"last":1.274}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.1779999999999999},"min":{"1min":0.90400000000000003,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.4870000000000001,"5min":1.663,"15min":1.663},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1990000000000001,"15min":1.2270000000000001},"min":{"1min":0.95499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.4279999999999999,"5min":1.6899999999999999,"15min":1.784},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.96799999999999997,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.6240000000000001,"5min":1.6459999999999999,"15min":1.827},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.94999999999999996,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.589,"5min":1.758,"15min":1.768},"last":1.135}]},{"osd":3,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3069999999999999,"15min":1.298},"min":{"1min":0.98699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.8879999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.3160000000000001,"15min":1.3109999999999999},"min":{"1min":1.1240000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":1.7010000000000001,"15min":1.8360000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.22,"15min":1.208},"min":{"1min":0.79500000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.6599999999999999,"5min":1.7110000000000001,"15min":1.9039999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.67000000000000004,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.8580000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.258},"min":{"1min":0.79100000000000004,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.9370000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.373,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5820000000000001,"5min":1.839,"15min":1.954},"last":1.3220000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3959999999999999,"15min":1.403},"min":{"1min":1.1200000000000001,"5min":0.60599999999999998,"15min":0.55800000000000005},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.9710000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4159999999999999,"15min":1.407},"min":{"1min":0.97799999999999998,"5min":0.73399999999999999,"15min":0.65300000000000002},"max":{"1min":1.7549999999999999,"5min":1.804,"15min":2.0259999999999998},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311944,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059896,"statfs":{"total":96636764160,"available":96317333504,"internally_reserved":0,"allocated":2424832,"data_stored":1266246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.268},"min":{"1min":0.871,"5min":0.77200000000000002,"15min":0.498},"max":{"1min":1.6020000000000001,"5min":1.661,"15min":1.738},"last":1.278},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.393,"15min":1.349},"min":{"1min":1.0229999999999999,"5min":0.81200000000000006,"15min":0.80300000000000005},"max":{"1min":1.597,"5min":1.7410000000000001,"15min":1.784},"last":1.357}]},{"osd":1,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.196},"min":{"1min":0.94399999999999995,"5min":0.80700000000000005,"15min":0.65100000000000002},"max":{"1min":1.5960000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.92800000000000005,"5min":0.747,"15min":0.56000000000000005},"max":{"1min":1.46,"5min":1.673,"15min":1.7210000000000001},"last":1.079}]},{"osd":2,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.90400000000000003,"5min":0.876,"15min":0.80000000000000004},"max":{"1min":1.677,"5min":1.6839999999999999,"15min":1.819},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.268,"15min":1.284},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.878},"max":{"1min":1.635,"5min":1.883,"15min":1.883},"last":1.194}]},{"osd":3,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3220000000000001,"15min":1.3},"min":{"1min":1.0449999999999999,"5min":0.92300000000000004,"15min":0.75800000000000001},"max":{"1min":1.784,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.403,"15min":1.369},"min":{"1min":1.091,"5min":1.038,"15min":0.94499999999999995},"max":{"1min":1.7210000000000001,"5min":1.877,"15min":1.8799999999999999},"last":1.319}]},{"osd":4,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.61899999999999999},"max":{"1min":1.6599999999999999,"5min":1.839,"15min":1.839},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":0.98899999999999999,"5min":0.82099999999999995,"15min":0.59599999999999997},"max":{"1min":1.5920000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.1060000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.351,"15min":1.325},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.796,"5min":2.008,"15min":2.008},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.357,"5min":1.373,"15min":1.3560000000000001},"min":{"1min":1.012,"5min":0.93500000000000005,"15min":0.69599999999999995},"max":{"1min":1.6930000000000001,"5min":1.7669999999999999,"15min":1.9630000000000001},"last":1.155}]},{"osd":7,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.466,"15min":1.423},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.80700000000000005},"max":{"1min":1.9370000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":1.0229999999999999,"5min":0.90600000000000003,"15min":0.85999999999999999},"max":{"1min":1.8580000000000001,"5min":1.978,"15min":2.0009999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311952,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059888,"statfs":{"total":96636764160,"available":96317325312,"internally_reserved":0,"allocated":2433024,"data_stored":1266858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.268},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67500000000000004},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.391},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.66300000000000003},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":2.012},"last":1.524}]},{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.179,"15min":1.1539999999999999},"min":{"1min":0.748,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5589999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1699999999999999,"15min":1.155},"min":{"1min":0.92300000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.694},"last":1.1910000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3380000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.84899999999999998},"max":{"1min":1.7989999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.105},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.367},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"max":{"1min":1.825,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.659}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.91600000000000004,"5min":0.82799999999999996,"15min":0.66700000000000004},"max":{"1min":1.5229999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.331},{"interface":"front","average":{"1min":1.367,"5min":1.3129999999999999,"15min":1.3049999999999999},"min":{"1min":1.1259999999999999,"5min":0.90600000000000003,"15min":0.81699999999999995},"max":{"1min":1.6950000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4510000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.28,"15min":1.3009999999999999},"min":{"1min":0.92100000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.704,"5min":1.704,"15min":1.8169999999999999},"last":1.726},{"interface":"front","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.82199999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7290000000000001,"5min":2.0720000000000001,"15min":2.089},"last":1.6970000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.878,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.571,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.335,"15min":1.335},"min":{"1min":1.087,"5min":0.65700000000000003,"15min":0.51600000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.96},"last":1.5780000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.27,"15min":1.3009999999999999},"min":{"1min":0.97699999999999998,"5min":0.72799999999999998,"15min":0.57099999999999995},"max":{"1min":1.865,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4410000000000001,"15min":1.423},"min":{"1min":1.0580000000000001,"5min":0.82999999999999996,"15min":0.72999999999999998},"max":{"1min":1.8879999999999999,"5min":2.0329999999999999,"15min":2.7829999999999999},"last":1.605}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316052,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055788,"statfs":{"total":96636764160,"available":96313126912,"internally_reserved":0,"allocated":2437120,"data_stored":1268234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.885},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.1000000000000001,"15min":1.131},"min":{"1min":0.81299999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.6990000000000001,"15min":2.0059999999999998},"last":1.0649999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.052,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":1.6830000000000001,"5min":1.722,"15min":2.0899999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.99399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6850000000000001,"5min":1.889,"15min":1.889},"last":1.3089999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1220000000000001,"15min":1.147},"min":{"1min":0.69099999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":2.0619999999999998,"15min":2.21},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.232,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":2.036,"5min":2.036,"15min":2.0550000000000002},"last":1.175}]},{"osd":4,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.272,"15min":1.27},"min":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.71099999999999997},"max":{"1min":1.581,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.526},{"interface":"front","average":{"1min":1.381,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":1.0740000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.234}]},{"osd":5,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4419999999999999,"15min":1.446},"min":{"1min":1.1200000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.7,"5min":2.0129999999999999,"15min":2.3900000000000001},"last":1.482},{"interface":"front","average":{"1min":1.484,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.145,"5min":1.1120000000000001,"15min":0.96099999999999997},"max":{"1min":1.956,"5min":2.032,"15min":2.2250000000000001},"last":1.6060000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5029999999999999,"15min":1.524},"min":{"1min":1.147,"5min":1.1419999999999999,"15min":1.0209999999999999},"max":{"1min":1.927,"5min":2.089,"15min":2.145},"last":1.401},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":1.0649999999999999,"5min":0.95699999999999996,"15min":0.879},"max":{"1min":1.8740000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.647}]},{"osd":7,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.48,"15min":1.49},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.758,"5min":2.1920000000000002,"15min":2.2639999999999998},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5529999999999999,"15min":1.5609999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.913,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.6890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.3939999999999999,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5669999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.4139999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":2.056},"last":1.218},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1559999999999999,"15min":1.125},"min":{"1min":0.83699999999999997,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.4670000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.27}]},{"osd":3,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2470000000000001,"15min":1.234},"min":{"1min":0.81200000000000006,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7629999999999999,"5min":1.8140000000000001,"15min":2.1659999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2130000000000001,"15min":1.163},"min":{"1min":1.034,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":1.1739999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.423,"15min":1.3919999999999999},"min":{"1min":1.228,"5min":0.96699999999999997,"15min":0.92600000000000005},"max":{"1min":1.754,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.357},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.94499999999999995},"max":{"1min":1.8149999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.774}]},{"osd":5,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.417,"15min":1.369},"min":{"1min":1.042,"5min":0.877,"15min":0.877},"max":{"1min":1.8620000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.4790000000000001,"15min":1.4650000000000001},"min":{"1min":1.1899999999999999,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0230000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.8100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.52,"15min":1.502},"min":{"1min":1.2729999999999999,"5min":1.1160000000000001,"15min":1.012},"max":{"1min":1.917,"5min":2.0779999999999998,"15min":2.1219999999999999},"last":1.653},{"interface":"front","average":{"1min":1.631,"5min":1.556,"15min":1.5109999999999999},"min":{"1min":1.357,"5min":1.1000000000000001,"15min":0.876},"max":{"1min":2.1379999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.5880000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.603,"15min":1.581},"min":{"1min":1.2190000000000001,"5min":1.048,"15min":1.048},"max":{"1min":2.1589999999999998,"5min":2.387,"15min":2.387},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.7,"5min":1.615,"15min":1.5940000000000001},"min":{"1min":1.355,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.214,"5min":2.226,"15min":2.2589999999999999},"last":1.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1267658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57999999999999996,"15min":0.54900000000000004},"max":{"1min":1.2809999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1759999999999999,"15min":1.1599999999999999},"min":{"1min":0.94499999999999995,"5min":0.82799999999999996,"15min":0.58199999999999996},"max":{"1min":1.49,"5min":1.657,"15min":1.671},"last":1.1859999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.57799999999999996,"15min":0.41099999999999998},"max":{"1min":1.28,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.75900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.532,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.119}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.296,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.6299999999999999,"5min":1.909,"15min":1.909},"last":1.232},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82899999999999996,"5min":0.73899999999999999,"15min":0.48899999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.8140000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2689999999999999,"15min":1.284},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.63},"max":{"1min":1.73,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.4390000000000001},"min":{"1min":1.109,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7569999999999999,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.48}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.423,"15min":1.401},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.81200000000000006},"max":{"1min":1.819,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.407,"15min":1.4019999999999999},"min":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.84599999999999997},"max":{"1min":1.837,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4239999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.534,"15min":1.5229999999999999},"min":{"1min":1.1519999999999999,"5min":1.032,"15min":0.72999999999999998},"max":{"1min":2.1160000000000001,"5min":2.2410000000000001,"15min":2.3540000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.4890000000000001,"15min":1.4930000000000001},"min":{"1min":1.147,"5min":0.97899999999999998,"15min":0.86699999999999999},"max":{"1min":1.7629999999999999,"5min":2.379,"15min":2.456},"last":1.325}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5609999999999999},"min":{"1min":1.216,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7909999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.544},{"interface":"front","average":{"1min":1.476,"5min":1.48,"15min":1.5069999999999999},"min":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.95899999999999996},"max":{"1min":1.7829999999999999,"5min":2.177,"15min":2.177},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304332,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067508,"statfs":{"total":96636764160,"available":96325128192,"internally_reserved":0,"allocated":3018752,"data_stored":1856594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.90100000000000002,"15min":0.91700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.6950000000000001},"last":1.161},{"interface":"front","average":{"1min":1.091,"5min":1.085,"15min":1.071},"min":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":1.6559999999999999,"5min":1.823,"15min":1.823},"last":0.92400000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0900000000000001,"15min":1.0960000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.615,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.375},{"interface":"front","average":{"1min":1.214,"5min":1.167,"15min":1.163},"min":{"1min":0.82799999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5409999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.107},"min":{"1min":0.745,"5min":0.71999999999999997,"15min":0.58199999999999996},"max":{"1min":1.5820000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.2729999999999999,"15min":1.284},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.633}]},{"osd":4,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.482},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.331},"min":{"1min":1.0660000000000001,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6890000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.2150000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4390000000000001,"15min":1.4450000000000001},"min":{"1min":0.98099999999999998,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.8939999999999999,"5min":1.958,"15min":2.2519999999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4610000000000001,"15min":1.462},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.9099999999999999,"5min":2.125,"15min":2.125},"last":1.099}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.657,"5min":2.1320000000000001,"15min":2.492},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5169999999999999},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":1.9610000000000001,"5min":2.25,"15min":2.3330000000000002},"last":1.5449999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.548,"15min":1.538},"min":{"1min":1.167,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.984,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.327},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5449999999999999,"15min":1.5189999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8100000000000001,"5min":2.234,"15min":2.411},"last":1.5880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:08:48.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:48.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 Processor -- start 2023-12-24T20:08:48.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 -- start start 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffae013f550 0x7ffae00ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae006b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffae00cb3c0 0x7ffae006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae006a6a0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae00cb8a0 con 0x7ffae013f550 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.525+0000 7ffae5dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae006a960 con 0x7ffae013f920 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffae00cb3c0 0x7ffae006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffae00cb3c0 0x7ffae006b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46162/0 (socket says 172.21.15.50:46162) 2023-12-24T20:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 -- 172.21.15.50:0/1928287787 learned_addr learned my addr 172.21.15.50:0/1928287787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadeffd700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadf7fe700 1 --2- 172.21.15.50:0/1928287787 >> v2:172.21.15.82:3300/0 conn(0x7ffae013f550 0x7ffae00ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 -- 172.21.15.50:0/1928287787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 msgr2=0x7ffae006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae006b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 -- 172.21.15.50:0/1928287787 >> v2:172.21.15.82:3300/0 conn(0x7ffae013f550 msgr2=0x7ffae00ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 --2- 172.21.15.50:0/1928287787 >> v2:172.21.15.82:3300/0 conn(0x7ffae013f550 0x7ffae00ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 -- 172.21.15.50:0/1928287787 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae006ac40 con 0x7ffae00cb3c0 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffadffff700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae006b980 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ffae006e290 tx=0x7ffad8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4081adfb01850452 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffade7fc700 1 -- 172.21.15.50:0/1928287787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad80092e0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffade7fc700 1 -- 172.21.15.50:0/1928287787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad800b970 con 0x7ffae00cb3c0 2023-12-24T20:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffade7fc700 1 -- 172.21.15.50:0/1928287787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800bd30 con 0x7ffae00cb3c0 2023-12-24T20:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 -- 172.21.15.50:0/1928287787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 msgr2=0x7ffae006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae006b980 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ffae006e290 tx=0x7ffad8009840 comp rx=0 tx=0).stop 2023-12-24T20:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 -- 172.21.15.50:0/1928287787 shutdown_connections 2023-12-24T20:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae006b980 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/1928287787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae006b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/1928287787 >> v2:172.21.15.82:3300/0 conn(0x7ffae013f550 0x7ffae00ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 -- 172.21.15.50:0/1928287787 >> 172.21.15.50:0/1928287787 conn(0x7ffae00cbba0 msgr2=0x7ffae00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:48.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 -- 172.21.15.50:0/1928287787 shutdown_connections 2023-12-24T20:08:48.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.529+0000 7ffae5dc5700 1 -- 172.21.15.50:0/1928287787 wait complete. 2023-12-24T20:08:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 Processor -- start 2023-12-24T20:08:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 -- start start 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 0x7ffae0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae013c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0157600 con 0x7ffae00cb3c0 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae013c710 con 0x7ffae013f550 2023-12-24T20:08:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffae5dc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00a9870 con 0x7ffae013f920 2023-12-24T20:08:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffadf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffadeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 0x7ffae0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffadf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46166/0 (socket says 172.21.15.50:46166) 2023-12-24T20:08:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffadf7fe700 1 -- 172.21.15.50:0/53320698 learned_addr learned my addr 172.21.15.50:0/53320698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.533+0000 7ffadffff700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae013c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 -- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 msgr2=0x7ffae013c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae013c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 -- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 msgr2=0x7ffae0158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 0x7ffae0158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 -- 172.21.15.50:0/53320698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8009ae0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadeffd700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 0x7ffae0158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffadf7fe700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7ffad000ec80 tx=0x7ffad00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000c850 con 0x7ffae00cb3c0 2023-12-24T20:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000c9b0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae0157040 con 0x7ffae00cb3c0 2023-12-24T20:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000cd50 con 0x7ffae00cb3c0 2023-12-24T20:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae00b0ad0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.537+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae00652e0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.541+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ffad0013680 con 0x7ffae00cb3c0 2023-12-24T20:08:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.541+0000 7ffac77fe700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 0x7ffacc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.541+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7ffad007cd00 con 0x7ffae00cb3c0 2023-12-24T20:08:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.541+0000 7ffadeffd700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 0x7ffacc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.545+0000 7ffadeffd700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 0x7ffacc062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffae015ecf0 tx=0x7ffad40091a0 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.549+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffad004cfe0 con 0x7ffae00cb3c0 2023-12-24T20:08:48.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.717+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffae00cca10 con 0x7ffacc060620 2023-12-24T20:08:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.737+0000 7ffac77fe700 1 -- 172.21.15.50:0/53320698 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286576 (secure 0 0 0) 0x7ffae00cca10 con 0x7ffacc060620 2023-12-24T20:08:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 msgr2=0x7ffacc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 0x7ffacc062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffae015ecf0 tx=0x7ffad40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 msgr2=0x7ffae00a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7ffad000ec80 tx=0x7ffad00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 shutdown_connections 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ffacc060620 0x7ffacc062ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffae013f920 0x7ffae013c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae013f550 0x7ffae0158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 --2- 172.21.15.50:0/53320698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae00cb3c0 0x7ffae00a91e0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 >> 172.21.15.50:0/53320698 conn(0x7ffae00cbba0 msgr2=0x7ffae013e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 shutdown_connections 2023-12-24T20:08:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.741+0000 7ffae5dc5700 1 -- 172.21.15.50:0/53320698 wait complete. 2023-12-24T20:08:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:08:48.766 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-24T20:08:48.149197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459848,"kb_used_data":20104,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752514872,"statfs":{"total":773094113280,"available":770575228928,"internally_reserved":0,"allocated":20586496,"data_stored":11314324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.923450"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258154+0000","last_change":"2023-12-24T20:08:39.255111+0000","last_active":"2023-12-24T20:08:39.258154+0000","last_peered":"2023-12-24T20:08:39.258154+0000","last_clean":"2023-12-24T20:08:39.258154+0000","last_became_active":"2023-12-24T20:08:39.254695+0000","last_became_peered":"2023-12-24T20:08:39.254695+0000","last_unstale":"2023-12-24T20:08:39.258154+0000","last_undegraded":"2023-12-24T20:08:39.258154+0000","last_fullsized":"2023-12-24T20:08:39.258154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:24:16.694071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262123+0000","last_change":"2023-12-24T20:08:39.259699+0000","last_active":"2023-12-24T20:08:39.262123+0000","last_peered":"2023-12-24T20:08:39.262123+0000","last_clean":"2023-12-24T20:08:39.262123+0000","last_became_active":"2023-12-24T20:08:39.257235+0000","last_became_peered":"2023-12-24T20:08:39.257235+0000","last_unstale":"2023-12-24T20:08:39.262123+0000","last_undegraded":"2023-12-24T20:08:39.262123+0000","last_fullsized":"2023-12-24T20:08:39.262123+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:58:09.989946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242022+0000","last_change":"2023-12-24T20:08:39.237190+0000","last_active":"2023-12-24T20:08:39.242022+0000","last_peered":"2023-12-24T20:08:39.242022+0000","last_clean":"2023-12-24T20:08:39.242022+0000","last_became_active":"2023-12-24T20:08:39.236904+0000","last_became_peered":"2023-12-24T20:08:39.236904+0000","last_unstale":"2023-12-24T20:08:39.242022+0000","last_undegraded":"2023-12-24T20:08:39.242022+0000","last_fullsized":"2023-12-24T20:08:39.242022+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:23:49.335014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261226+0000","last_change":"2023-12-24T20:08:39.259338+0000","last_active":"2023-12-24T20:08:39.261226+0000","last_peered":"2023-12-24T20:08:39.261226+0000","last_clean":"2023-12-24T20:08:39.261226+0000","last_became_active":"2023-12-24T20:08:39.259024+0000","last_became_peered":"2023-12-24T20:08:39.259024+0000","last_unstale":"2023-12-24T20:08:39.261226+0000","last_undegraded":"2023-12-24T20:08:39.261226+0000","last_fullsized":"2023-12-24T20:08:39.261226+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:20.251605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.258307+0000","last_change":"2023-12-24T20:08:39.253890+0000","last_active":"2023-12-24T20:08:39.258307+0000","last_peered":"2023-12-24T20:08:39.258307+0000","last_clean":"2023-12-24T20:08:39.258307+0000","last_became_active":"2023-12-24T20:08:39.253577+0000","last_became_peered":"2023-12-24T20:08:39.253577+0000","last_unstale":"2023-12-24T20:08:39.258307+0000","last_undegraded":"2023-12-24T20:08:39.258307+0000","last_fullsized":"2023-12-24T20:08:39.258307+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262023+0000","last_change":"2023-12-24T20:08:39.256510+0000","last_active":"2023-12-24T20:08:39.262023+0000","last_peered":"2023-12-24T20:08:39.262023+0000","last_clean":"2023-12-24T20:08:39.262023+0000","last_became_active":"2023-12-24T20:08:39.256205+0000","last_became_peered":"2023-12-24T20:08:39.256205+0000","last_unstale":"2023-12-24T20:08:39.262023+0000","last_undegraded":"2023-12-24T20:08:39.262023+0000","last_fullsized":"2023-12-24T20:08:39.262023+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:37:55.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270406+0000","last_change":"2023-12-24T20:08:39.265203+0000","last_active":"2023-12-24T20:08:39.270406+0000","last_peered":"2023-12-24T20:08:39.270406+0000","last_clean":"2023-12-24T20:08:39.270406+0000","last_became_active":"2023-12-24T20:08:39.262585+0000","last_became_peered":"2023-12-24T20:08:39.262585+0000","last_unstale":"2023-12-24T20:08:39.270406+0000","last_undegraded":"2023-12-24T20:08:39.270406+0000","last_fullsized":"2023-12-24T20:08:39.270406+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270503+0000","last_change":"2023-12-24T20:08:39.264824+0000","last_active":"2023-12-24T20:08:39.270503+0000","last_peered":"2023-12-24T20:08:39.270503+0000","last_clean":"2023-12-24T20:08:39.270503+0000","last_became_active":"2023-12-24T20:08:39.264265+0000","last_became_peered":"2023-12-24T20:08:39.264265+0000","last_unstale":"2023-12-24T20:08:39.270503+0000","last_undegraded":"2023-12-24T20:08:39.270503+0000","last_fullsized":"2023-12-24T20:08:39.270503+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:10.180706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270783+0000","last_change":"2023-12-24T20:08:39.267145+0000","last_active":"2023-12-24T20:08:39.270783+0000","last_peered":"2023-12-24T20:08:39.270783+0000","last_clean":"2023-12-24T20:08:39.270783+0000","last_became_active":"2023-12-24T20:08:39.266033+0000","last_became_peered":"2023-12-24T20:08:39.266033+0000","last_unstale":"2023-12-24T20:08:39.270783+0000","last_undegraded":"2023-12-24T20:08:39.270783+0000","last_fullsized":"2023-12-24T20:08:39.270783+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:46.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270491+0000","last_change":"2023-12-24T20:08:39.265894+0000","last_active":"2023-12-24T20:08:39.270491+0000","last_peered":"2023-12-24T20:08:39.270491+0000","last_clean":"2023-12-24T20:08:39.270491+0000","last_became_active":"2023-12-24T20:08:39.265604+0000","last_became_peered":"2023-12-24T20:08:39.265604+0000","last_unstale":"2023-12-24T20:08:39.270491+0000","last_undegraded":"2023-12-24T20:08:39.270491+0000","last_fullsized":"2023-12-24T20:08:39.270491+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256950+0000","last_change":"2023-12-24T20:08:39.249813+0000","last_active":"2023-12-24T20:08:39.256950+0000","last_peered":"2023-12-24T20:08:39.256950+0000","last_clean":"2023-12-24T20:08:39.256950+0000","last_became_active":"2023-12-24T20:08:39.249507+0000","last_became_peered":"2023-12-24T20:08:39.249507+0000","last_unstale":"2023-12-24T20:08:39.256950+0000","last_undegraded":"2023-12-24T20:08:39.256950+0000","last_fullsized":"2023-12-24T20:08:39.256950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261918+0000","last_change":"2023-12-24T20:08:39.259412+0000","last_active":"2023-12-24T20:08:39.261918+0000","last_peered":"2023-12-24T20:08:39.261918+0000","last_clean":"2023-12-24T20:08:39.261918+0000","last_became_active":"2023-12-24T20:08:39.257706+0000","last_became_peered":"2023-12-24T20:08:39.257706+0000","last_unstale":"2023-12-24T20:08:39.261918+0000","last_undegraded":"2023-12-24T20:08:39.261918+0000","last_fullsized":"2023-12-24T20:08:39.261918+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:25.851791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270543+0000","last_change":"2023-12-24T20:08:39.258151+0000","last_active":"2023-12-24T20:08:39.270543+0000","last_peered":"2023-12-24T20:08:39.270543+0000","last_clean":"2023-12-24T20:08:39.270543+0000","last_became_active":"2023-12-24T20:08:39.257853+0000","last_became_peered":"2023-12-24T20:08:39.257853+0000","last_unstale":"2023-12-24T20:08:39.270543+0000","last_undegraded":"2023-12-24T20:08:39.270543+0000","last_fullsized":"2023-12-24T20:08:39.270543+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:42:19.517102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263196+0000","last_change":"2023-12-24T20:08:39.255900+0000","last_active":"2023-12-24T20:08:39.263196+0000","last_peered":"2023-12-24T20:08:39.263196+0000","last_clean":"2023-12-24T20:08:39.263196+0000","last_became_active":"2023-12-24T20:08:39.254111+0000","last_became_peered":"2023-12-24T20:08:39.254111+0000","last_unstale":"2023-12-24T20:08:39.263196+0000","last_undegraded":"2023-12-24T20:08:39.263196+0000","last_fullsized":"2023-12-24T20:08:39.263196+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272078+0000","last_change":"2023-12-24T20:08:39.268992+0000","last_active":"2023-12-24T20:08:39.272078+0000","last_peered":"2023-12-24T20:08:39.272078+0000","last_clean":"2023-12-24T20:08:39.272078+0000","last_became_active":"2023-12-24T20:08:39.268661+0000","last_became_peered":"2023-12-24T20:08:39.268661+0000","last_unstale":"2023-12-24T20:08:39.272078+0000","last_undegraded":"2023-12-24T20:08:39.272078+0000","last_fullsized":"2023-12-24T20:08:39.272078+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251985+0000","last_change":"2023-12-24T20:08:39.248160+0000","last_active":"2023-12-24T20:08:39.251985+0000","last_peered":"2023-12-24T20:08:39.251985+0000","last_clean":"2023-12-24T20:08:39.251985+0000","last_became_active":"2023-12-24T20:08:39.247402+0000","last_became_peered":"2023-12-24T20:08:39.247402+0000","last_unstale":"2023-12-24T20:08:39.251985+0000","last_undegraded":"2023-12-24T20:08:39.251985+0000","last_fullsized":"2023-12-24T20:08:39.251985+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:26:17.120833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270764+0000","last_change":"2023-12-24T20:08:39.266760+0000","last_active":"2023-12-24T20:08:39.270764+0000","last_peered":"2023-12-24T20:08:39.270764+0000","last_clean":"2023-12-24T20:08:39.270764+0000","last_became_active":"2023-12-24T20:08:39.265577+0000","last_became_peered":"2023-12-24T20:08:39.265577+0000","last_unstale":"2023-12-24T20:08:39.270764+0000","last_undegraded":"2023-12-24T20:08:39.270764+0000","last_fullsized":"2023-12-24T20:08:39.270764+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:38.722712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261563+0000","last_change":"2023-12-24T20:08:39.255496+0000","last_active":"2023-12-24T20:08:39.261563+0000","last_peered":"2023-12-24T20:08:39.261563+0000","last_clean":"2023-12-24T20:08:39.261563+0000","last_became_active":"2023-12-24T20:08:39.254996+0000","last_became_peered":"2023-12-24T20:08:39.254996+0000","last_unstale":"2023-12-24T20:08:39.261563+0000","last_undegraded":"2023-12-24T20:08:39.261563+0000","last_fullsized":"2023-12-24T20:08:39.261563+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:33.780421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.266185+0000","last_change":"2023-12-24T20:08:39.264683+0000","last_active":"2023-12-24T20:08:39.266185+0000","last_peered":"2023-12-24T20:08:39.266185+0000","last_clean":"2023-12-24T20:08:39.266185+0000","last_became_active":"2023-12-24T20:08:39.264342+0000","last_became_peered":"2023-12-24T20:08:39.264342+0000","last_unstale":"2023-12-24T20:08:39.266185+0000","last_undegraded":"2023-12-24T20:08:39.266185+0000","last_fullsized":"2023-12-24T20:08:39.266185+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269363+0000","last_change":"2023-12-24T20:08:39.257674+0000","last_active":"2023-12-24T20:08:39.269363+0000","last_peered":"2023-12-24T20:08:39.269363+0000","last_clean":"2023-12-24T20:08:39.269363+0000","last_became_active":"2023-12-24T20:08:39.257389+0000","last_became_peered":"2023-12-24T20:08:39.257389+0000","last_unstale":"2023-12-24T20:08:39.269363+0000","last_undegraded":"2023-12-24T20:08:39.269363+0000","last_fullsized":"2023-12-24T20:08:39.269363+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:26.974198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271002+0000","last_change":"2023-12-24T20:08:39.258398+0000","last_active":"2023-12-24T20:08:39.271002+0000","last_peered":"2023-12-24T20:08:39.271002+0000","last_clean":"2023-12-24T20:08:39.271002+0000","last_became_active":"2023-12-24T20:08:39.257772+0000","last_became_peered":"2023-12-24T20:08:39.257772+0000","last_unstale":"2023-12-24T20:08:39.271002+0000","last_undegraded":"2023-12-24T20:08:39.271002+0000","last_fullsized":"2023-12-24T20:08:39.271002+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:56.189952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261999+0000","last_change":"2023-12-24T20:08:39.256454+0000","last_active":"2023-12-24T20:08:39.261999+0000","last_peered":"2023-12-24T20:08:39.261999+0000","last_clean":"2023-12-24T20:08:39.261999+0000","last_became_active":"2023-12-24T20:08:39.256157+0000","last_became_peered":"2023-12-24T20:08:39.256157+0000","last_unstale":"2023-12-24T20:08:39.261999+0000","last_undegraded":"2023-12-24T20:08:39.261999+0000","last_fullsized":"2023-12-24T20:08:39.261999+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:48.478125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.261598+0000","last_change":"2023-12-24T20:08:39.254994+0000","last_active":"2023-12-24T20:08:39.261598+0000","last_peered":"2023-12-24T20:08:39.261598+0000","last_clean":"2023-12-24T20:08:39.261598+0000","last_became_active":"2023-12-24T20:08:39.254531+0000","last_became_peered":"2023-12-24T20:08:39.254531+0000","last_unstale":"2023-12-24T20:08:39.261598+0000","last_undegraded":"2023-12-24T20:08:39.261598+0000","last_fullsized":"2023-12-24T20:08:39.261598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:48:23.827865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.251966+0000","last_change":"2023-12-24T20:08:39.247588+0000","last_active":"2023-12-24T20:08:39.251966+0000","last_peered":"2023-12-24T20:08:39.251966+0000","last_clean":"2023-12-24T20:08:39.251966+0000","last_became_active":"2023-12-24T20:08:39.247017+0000","last_became_peered":"2023-12-24T20:08:39.247017+0000","last_unstale":"2023-12-24T20:08:39.251966+0000","last_undegraded":"2023-12-24T20:08:39.251966+0000","last_fullsized":"2023-12-24T20:08:39.251966+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:46.594765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271550+0000","last_change":"2023-12-24T20:08:39.258623+0000","last_active":"2023-12-24T20:08:39.271550+0000","last_peered":"2023-12-24T20:08:39.271550+0000","last_clean":"2023-12-24T20:08:39.271550+0000","last_became_active":"2023-12-24T20:08:39.258321+0000","last_became_peered":"2023-12-24T20:08:39.258321+0000","last_unstale":"2023-12-24T20:08:39.271550+0000","last_undegraded":"2023-12-24T20:08:39.271550+0000","last_fullsized":"2023-12-24T20:08:39.271550+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:23:45.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.245788+0000","last_change":"2023-12-24T20:08:39.241938+0000","last_active":"2023-12-24T20:08:39.245788+0000","last_peered":"2023-12-24T20:08:39.245788+0000","last_clean":"2023-12-24T20:08:39.245788+0000","last_became_active":"2023-12-24T20:08:39.241578+0000","last_became_peered":"2023-12-24T20:08:39.241578+0000","last_unstale":"2023-12-24T20:08:39.245788+0000","last_undegraded":"2023-12-24T20:08:39.245788+0000","last_fullsized":"2023-12-24T20:08:39.245788+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260365+0000","last_change":"2023-12-24T20:08:39.255883+0000","last_active":"2023-12-24T20:08:39.260365+0000","last_peered":"2023-12-24T20:08:39.260365+0000","last_clean":"2023-12-24T20:08:39.260365+0000","last_became_active":"2023-12-24T20:08:39.255588+0000","last_became_peered":"2023-12-24T20:08:39.255588+0000","last_unstale":"2023-12-24T20:08:39.260365+0000","last_undegraded":"2023-12-24T20:08:39.260365+0000","last_fullsized":"2023-12-24T20:08:39.260365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:42:28.887874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271234+0000","last_change":"2023-12-24T20:08:39.260289+0000","last_active":"2023-12-24T20:08:39.271234+0000","last_peered":"2023-12-24T20:08:39.271234+0000","last_clean":"2023-12-24T20:08:39.271234+0000","last_became_active":"2023-12-24T20:08:39.259821+0000","last_became_peered":"2023-12-24T20:08:39.259821+0000","last_unstale":"2023-12-24T20:08:39.271234+0000","last_undegraded":"2023-12-24T20:08:39.271234+0000","last_fullsized":"2023-12-24T20:08:39.271234+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.265923+0000","last_change":"2023-12-24T20:08:39.264321+0000","last_active":"2023-12-24T20:08:39.265923+0000","last_peered":"2023-12-24T20:08:39.265923+0000","last_clean":"2023-12-24T20:08:39.265923+0000","last_became_active":"2023-12-24T20:08:39.263895+0000","last_became_peered":"2023-12-24T20:08:39.263895+0000","last_unstale":"2023-12-24T20:08:39.265923+0000","last_undegraded":"2023-12-24T20:08:39.265923+0000","last_fullsized":"2023-12-24T20:08:39.265923+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:05.893308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259457+0000","last_change":"2023-12-24T20:08:39.250850+0000","last_active":"2023-12-24T20:08:39.259457+0000","last_peered":"2023-12-24T20:08:39.259457+0000","last_clean":"2023-12-24T20:08:39.259457+0000","last_became_active":"2023-12-24T20:08:39.250550+0000","last_became_peered":"2023-12-24T20:08:39.250550+0000","last_unstale":"2023-12-24T20:08:39.259457+0000","last_undegraded":"2023-12-24T20:08:39.259457+0000","last_fullsized":"2023-12-24T20:08:39.259457+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:23:20.667204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256598+0000","last_change":"2023-12-24T20:08:39.252094+0000","last_active":"2023-12-24T20:08:39.256598+0000","last_peered":"2023-12-24T20:08:39.256598+0000","last_clean":"2023-12-24T20:08:39.256598+0000","last_became_active":"2023-12-24T20:08:39.251788+0000","last_became_peered":"2023-12-24T20:08:39.251788+0000","last_unstale":"2023-12-24T20:08:39.256598+0000","last_undegraded":"2023-12-24T20:08:39.256598+0000","last_fullsized":"2023-12-24T20:08:39.256598+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:28.240877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259153+0000","last_change":"2023-12-24T20:08:39.253505+0000","last_active":"2023-12-24T20:08:39.259153+0000","last_peered":"2023-12-24T20:08:39.259153+0000","last_clean":"2023-12-24T20:08:39.259153+0000","last_became_active":"2023-12-24T20:08:39.253214+0000","last_became_peered":"2023-12-24T20:08:39.253214+0000","last_unstale":"2023-12-24T20:08:39.259153+0000","last_undegraded":"2023-12-24T20:08:39.259153+0000","last_fullsized":"2023-12-24T20:08:39.259153+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:49.615897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272168+0000","last_change":"2023-12-24T20:08:39.267015+0000","last_active":"2023-12-24T20:08:39.272168+0000","last_peered":"2023-12-24T20:08:39.272168+0000","last_clean":"2023-12-24T20:08:39.272168+0000","last_became_active":"2023-12-24T20:08:39.266103+0000","last_became_peered":"2023-12-24T20:08:39.266103+0000","last_unstale":"2023-12-24T20:08:39.272168+0000","last_undegraded":"2023-12-24T20:08:39.272168+0000","last_fullsized":"2023-12-24T20:08:39.272168+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:52.239952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"192'4","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276783+0000","last_change":"2023-12-24T20:08:38.240700+0000","last_active":"2023-12-24T20:08:39.276783+0000","last_peered":"2023-12-24T20:08:39.276783+0000","last_clean":"2023-12-24T20:08:39.276783+0000","last_became_active":"2023-12-24T20:08:38.240414+0000","last_became_peered":"2023-12-24T20:08:38.240414+0000","last_unstale":"2023-12-24T20:08:39.276783+0000","last_undegraded":"2023-12-24T20:08:39.276783+0000","last_fullsized":"2023-12-24T20:08:39.276783+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:47.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270472+0000","last_change":"2023-12-24T20:08:39.256207+0000","last_active":"2023-12-24T20:08:39.270472+0000","last_peered":"2023-12-24T20:08:39.270472+0000","last_clean":"2023-12-24T20:08:39.270472+0000","last_became_active":"2023-12-24T20:08:39.255922+0000","last_became_peered":"2023-12-24T20:08:39.255922+0000","last_unstale":"2023-12-24T20:08:39.270472+0000","last_undegraded":"2023-12-24T20:08:39.270472+0000","last_fullsized":"2023-12-24T20:08:39.270472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:39.770243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281278+0000","last_change":"2023-12-24T20:08:38.255635+0000","last_active":"2023-12-24T20:08:39.281278+0000","last_peered":"2023-12-24T20:08:39.281278+0000","last_clean":"2023-12-24T20:08:39.281278+0000","last_became_active":"2023-12-24T20:08:38.255261+0000","last_became_peered":"2023-12-24T20:08:38.255261+0000","last_unstale":"2023-12-24T20:08:39.281278+0000","last_undegraded":"2023-12-24T20:08:39.281278+0000","last_fullsized":"2023-12-24T20:08:39.281278+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263177+0000","last_change":"2023-12-24T20:08:39.254070+0000","last_active":"2023-12-24T20:08:39.263177+0000","last_peered":"2023-12-24T20:08:39.263177+0000","last_clean":"2023-12-24T20:08:39.263177+0000","last_became_active":"2023-12-24T20:08:39.253766+0000","last_became_peered":"2023-12-24T20:08:39.253766+0000","last_unstale":"2023-12-24T20:08:39.263177+0000","last_undegraded":"2023-12-24T20:08:39.263177+0000","last_fullsized":"2023-12-24T20:08:39.263177+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.274202+0000","last_change":"2023-12-24T20:08:38.244714+0000","last_active":"2023-12-24T20:08:39.274202+0000","last_peered":"2023-12-24T20:08:39.274202+0000","last_clean":"2023-12-24T20:08:39.274202+0000","last_became_active":"2023-12-24T20:08:38.244411+0000","last_became_peered":"2023-12-24T20:08:38.244411+0000","last_unstale":"2023-12-24T20:08:39.274202+0000","last_undegraded":"2023-12-24T20:08:39.274202+0000","last_fullsized":"2023-12-24T20:08:39.274202+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269382+0000","last_change":"2023-12-24T20:08:39.265824+0000","last_active":"2023-12-24T20:08:39.269382+0000","last_peered":"2023-12-24T20:08:39.269382+0000","last_clean":"2023-12-24T20:08:39.269382+0000","last_became_active":"2023-12-24T20:08:39.265356+0000","last_became_peered":"2023-12-24T20:08:39.265356+0000","last_unstale":"2023-12-24T20:08:39.269382+0000","last_undegraded":"2023-12-24T20:08:39.269382+0000","last_fullsized":"2023-12-24T20:08:39.269382+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:40.494286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.275303+0000","last_change":"2023-12-24T20:08:38.246604+0000","last_active":"2023-12-24T20:08:39.275303+0000","last_peered":"2023-12-24T20:08:39.275303+0000","last_clean":"2023-12-24T20:08:39.275303+0000","last_became_active":"2023-12-24T20:08:38.246300+0000","last_became_peered":"2023-12-24T20:08:38.246300+0000","last_unstale":"2023-12-24T20:08:39.275303+0000","last_undegraded":"2023-12-24T20:08:39.275303+0000","last_fullsized":"2023-12-24T20:08:39.275303+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:22:17.334028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270531+0000","last_change":"2023-12-24T20:08:39.266196+0000","last_active":"2023-12-24T20:08:39.270531+0000","last_peered":"2023-12-24T20:08:39.270531+0000","last_clean":"2023-12-24T20:08:39.270531+0000","last_became_active":"2023-12-24T20:08:39.265163+0000","last_became_peered":"2023-12-24T20:08:39.265163+0000","last_unstale":"2023-12-24T20:08:39.270531+0000","last_undegraded":"2023-12-24T20:08:39.270531+0000","last_fullsized":"2023-12-24T20:08:39.270531+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:12:25.048378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278364+0000","last_change":"2023-12-24T20:08:38.255319+0000","last_active":"2023-12-24T20:08:39.278364+0000","last_peered":"2023-12-24T20:08:39.278364+0000","last_clean":"2023-12-24T20:08:39.278364+0000","last_became_active":"2023-12-24T20:08:38.255035+0000","last_became_peered":"2023-12-24T20:08:38.255035+0000","last_unstale":"2023-12-24T20:08:39.278364+0000","last_undegraded":"2023-12-24T20:08:39.278364+0000","last_fullsized":"2023-12-24T20:08:39.278364+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.268365+0000","last_change":"2023-12-24T20:08:39.258550+0000","last_active":"2023-12-24T20:08:39.268365+0000","last_peered":"2023-12-24T20:08:39.268365+0000","last_clean":"2023-12-24T20:08:39.268365+0000","last_became_active":"2023-12-24T20:08:39.258267+0000","last_became_peered":"2023-12-24T20:08:39.258267+0000","last_unstale":"2023-12-24T20:08:39.268365+0000","last_undegraded":"2023-12-24T20:08:39.268365+0000","last_fullsized":"2023-12-24T20:08:39.268365+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:22:45.872081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281648+0000","last_change":"2023-12-24T20:08:38.256797+0000","last_active":"2023-12-24T20:08:39.281648+0000","last_peered":"2023-12-24T20:08:39.281648+0000","last_clean":"2023-12-24T20:08:39.281648+0000","last_became_active":"2023-12-24T20:08:38.256462+0000","last_became_peered":"2023-12-24T20:08:38.256462+0000","last_unstale":"2023-12-24T20:08:39.281648+0000","last_undegraded":"2023-12-24T20:08:39.281648+0000","last_fullsized":"2023-12-24T20:08:39.281648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263266+0000","last_change":"2023-12-24T20:08:39.252283+0000","last_active":"2023-12-24T20:08:39.263266+0000","last_peered":"2023-12-24T20:08:39.263266+0000","last_clean":"2023-12-24T20:08:39.263266+0000","last_became_active":"2023-12-24T20:08:39.251971+0000","last_became_peered":"2023-12-24T20:08:39.251971+0000","last_unstale":"2023-12-24T20:08:39.263266+0000","last_undegraded":"2023-12-24T20:08:39.263266+0000","last_fullsized":"2023-12-24T20:08:39.263266+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:17.713632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229002+0000","last_change":"2023-12-24T20:08:38.243723+0000","last_active":"2023-12-24T20:08:39.229002+0000","last_peered":"2023-12-24T20:08:39.229002+0000","last_clean":"2023-12-24T20:08:39.229002+0000","last_became_active":"2023-12-24T20:08:38.243019+0000","last_became_peered":"2023-12-24T20:08:38.243019+0000","last_unstale":"2023-12-24T20:08:39.229002+0000","last_undegraded":"2023-12-24T20:08:39.229002+0000","last_fullsized":"2023-12-24T20:08:39.229002+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:35.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255044+0000","last_change":"2023-12-24T20:08:39.248182+0000","last_active":"2023-12-24T20:08:39.255044+0000","last_peered":"2023-12-24T20:08:39.255044+0000","last_clean":"2023-12-24T20:08:39.255044+0000","last_became_active":"2023-12-24T20:08:39.247850+0000","last_became_peered":"2023-12-24T20:08:39.247850+0000","last_unstale":"2023-12-24T20:08:39.255044+0000","last_undegraded":"2023-12-24T20:08:39.255044+0000","last_fullsized":"2023-12-24T20:08:39.255044+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:42.437879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243004+0000","last_change":"2023-12-24T20:08:38.253034+0000","last_active":"2023-12-24T20:08:39.243004+0000","last_peered":"2023-12-24T20:08:39.243004+0000","last_clean":"2023-12-24T20:08:39.243004+0000","last_became_active":"2023-12-24T20:08:38.252713+0000","last_became_peered":"2023-12-24T20:08:38.252713+0000","last_unstale":"2023-12-24T20:08:39.243004+0000","last_undegraded":"2023-12-24T20:08:39.243004+0000","last_fullsized":"2023-12-24T20:08:39.243004+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.272150+0000","last_change":"2023-12-24T20:08:39.267266+0000","last_active":"2023-12-24T20:08:39.272150+0000","last_peered":"2023-12-24T20:08:39.272150+0000","last_clean":"2023-12-24T20:08:39.272150+0000","last_became_active":"2023-12-24T20:08:39.266976+0000","last_became_peered":"2023-12-24T20:08:39.266976+0000","last_unstale":"2023-12-24T20:08:39.272150+0000","last_undegraded":"2023-12-24T20:08:39.272150+0000","last_fullsized":"2023-12-24T20:08:39.272150+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:06.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.241865+0000","last_change":"2023-12-24T20:08:38.254881+0000","last_active":"2023-12-24T20:08:39.241865+0000","last_peered":"2023-12-24T20:08:39.241865+0000","last_clean":"2023-12-24T20:08:39.241865+0000","last_became_active":"2023-12-24T20:08:38.254519+0000","last_became_peered":"2023-12-24T20:08:38.254519+0000","last_unstale":"2023-12-24T20:08:39.241865+0000","last_undegraded":"2023-12-24T20:08:39.241865+0000","last_fullsized":"2023-12-24T20:08:39.241865+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:23.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271183+0000","last_change":"2023-12-24T20:08:39.258291+0000","last_active":"2023-12-24T20:08:39.271183+0000","last_peered":"2023-12-24T20:08:39.271183+0000","last_clean":"2023-12-24T20:08:39.271183+0000","last_became_active":"2023-12-24T20:08:39.255972+0000","last_became_peered":"2023-12-24T20:08:39.255972+0000","last_unstale":"2023-12-24T20:08:39.271183+0000","last_undegraded":"2023-12-24T20:08:39.271183+0000","last_fullsized":"2023-12-24T20:08:39.271183+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:13.784610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269848+0000","last_change":"2023-12-24T20:08:38.239476+0000","last_active":"2023-12-24T20:08:39.269848+0000","last_peered":"2023-12-24T20:08:39.269848+0000","last_clean":"2023-12-24T20:08:39.269848+0000","last_became_active":"2023-12-24T20:08:38.239171+0000","last_became_peered":"2023-12-24T20:08:38.239171+0000","last_unstale":"2023-12-24T20:08:39.269848+0000","last_undegraded":"2023-12-24T20:08:39.269848+0000","last_fullsized":"2023-12-24T20:08:39.269848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T08:00:49.593212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.249982+0000","last_change":"2023-12-24T20:08:39.243493+0000","last_active":"2023-12-24T20:08:39.249982+0000","last_peered":"2023-12-24T20:08:39.249982+0000","last_clean":"2023-12-24T20:08:39.249982+0000","last_became_active":"2023-12-24T20:08:39.243091+0000","last_became_peered":"2023-12-24T20:08:39.243091+0000","last_unstale":"2023-12-24T20:08:39.249982+0000","last_undegraded":"2023-12-24T20:08:39.249982+0000","last_fullsized":"2023-12-24T20:08:39.249982+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:33.552641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"192'6","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.284188+0000","last_change":"2023-12-24T20:08:38.251434+0000","last_active":"2023-12-24T20:08:39.284188+0000","last_peered":"2023-12-24T20:08:39.284188+0000","last_clean":"2023-12-24T20:08:39.284188+0000","last_became_active":"2023-12-24T20:08:38.249590+0000","last_became_peered":"2023-12-24T20:08:38.249590+0000","last_unstale":"2023-12-24T20:08:39.284188+0000","last_undegraded":"2023-12-24T20:08:39.284188+0000","last_fullsized":"2023-12-24T20:08:39.284188+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:14.934133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259751+0000","last_change":"2023-12-24T20:08:39.252251+0000","last_active":"2023-12-24T20:08:39.259751+0000","last_peered":"2023-12-24T20:08:39.259751+0000","last_clean":"2023-12-24T20:08:39.259751+0000","last_became_active":"2023-12-24T20:08:39.251277+0000","last_became_peered":"2023-12-24T20:08:39.251277+0000","last_unstale":"2023-12-24T20:08:39.259751+0000","last_undegraded":"2023-12-24T20:08:39.259751+0000","last_fullsized":"2023-12-24T20:08:39.259751+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:04.044223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281622+0000","last_change":"2023-12-24T20:08:38.244032+0000","last_active":"2023-12-24T20:08:39.281622+0000","last_peered":"2023-12-24T20:08:39.281622+0000","last_clean":"2023-12-24T20:08:39.281622+0000","last_became_active":"2023-12-24T20:08:38.243765+0000","last_became_peered":"2023-12-24T20:08:38.243765+0000","last_unstale":"2023-12-24T20:08:39.281622+0000","last_undegraded":"2023-12-24T20:08:39.281622+0000","last_fullsized":"2023-12-24T20:08:39.281622+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:43:35.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.264695+0000","last_change":"2023-12-24T20:08:39.256123+0000","last_active":"2023-12-24T20:08:39.264695+0000","last_peered":"2023-12-24T20:08:39.264695+0000","last_clean":"2023-12-24T20:08:39.264695+0000","last_became_active":"2023-12-24T20:08:39.255845+0000","last_became_peered":"2023-12-24T20:08:39.255845+0000","last_unstale":"2023-12-24T20:08:39.264695+0000","last_undegraded":"2023-12-24T20:08:39.264695+0000","last_fullsized":"2023-12-24T20:08:39.264695+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:40.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240884+0000","last_change":"2023-12-24T20:08:38.254571+0000","last_active":"2023-12-24T20:08:39.240884+0000","last_peered":"2023-12-24T20:08:39.240884+0000","last_clean":"2023-12-24T20:08:39.240884+0000","last_became_active":"2023-12-24T20:08:38.253910+0000","last_became_peered":"2023-12-24T20:08:38.253910+0000","last_unstale":"2023-12-24T20:08:39.240884+0000","last_undegraded":"2023-12-24T20:08:39.240884+0000","last_fullsized":"2023-12-24T20:08:39.240884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:56.484325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.254492+0000","last_change":"2023-12-24T20:08:39.251583+0000","last_active":"2023-12-24T20:08:39.254492+0000","last_peered":"2023-12-24T20:08:39.254492+0000","last_clean":"2023-12-24T20:08:39.254492+0000","last_became_active":"2023-12-24T20:08:39.250926+0000","last_became_peered":"2023-12-24T20:08:39.250926+0000","last_unstale":"2023-12-24T20:08:39.254492+0000","last_undegraded":"2023-12-24T20:08:39.254492+0000","last_fullsized":"2023-12-24T20:08:39.254492+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:48.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240566+0000","last_change":"2023-12-24T20:08:38.252005+0000","last_active":"2023-12-24T20:08:39.240566+0000","last_peered":"2023-12-24T20:08:39.240566+0000","last_clean":"2023-12-24T20:08:39.240566+0000","last_became_active":"2023-12-24T20:08:38.251718+0000","last_became_peered":"2023-12-24T20:08:38.251718+0000","last_unstale":"2023-12-24T20:08:39.240566+0000","last_undegraded":"2023-12-24T20:08:39.240566+0000","last_fullsized":"2023-12-24T20:08:39.240566+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243182+0000","last_change":"2023-12-24T20:08:39.239953+0000","last_active":"2023-12-24T20:08:39.243182+0000","last_peered":"2023-12-24T20:08:39.243182+0000","last_clean":"2023-12-24T20:08:39.243182+0000","last_became_active":"2023-12-24T20:08:39.239598+0000","last_became_peered":"2023-12-24T20:08:39.239598+0000","last_unstale":"2023-12-24T20:08:39.243182+0000","last_undegraded":"2023-12-24T20:08:39.243182+0000","last_fullsized":"2023-12-24T20:08:39.243182+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:22.720213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"192'8","reported_seq":18,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.281579+0000","last_change":"2023-12-24T20:08:38.247901+0000","last_active":"2023-12-24T20:08:39.281579+0000","last_peered":"2023-12-24T20:08:39.281579+0000","last_clean":"2023-12-24T20:08:39.281579+0000","last_became_active":"2023-12-24T20:08:38.247604+0000","last_became_peered":"2023-12-24T20:08:38.247604+0000","last_unstale":"2023-12-24T20:08:39.281579+0000","last_undegraded":"2023-12-24T20:08:39.281579+0000","last_fullsized":"2023-12-24T20:08:39.281579+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.276940+0000","last_change":"2023-12-24T20:08:39.270339+0000","last_active":"2023-12-24T20:08:39.276940+0000","last_peered":"2023-12-24T20:08:39.276940+0000","last_clean":"2023-12-24T20:08:39.276940+0000","last_became_active":"2023-12-24T20:08:39.270031+0000","last_became_peered":"2023-12-24T20:08:39.270031+0000","last_unstale":"2023-12-24T20:08:39.276940+0000","last_undegraded":"2023-12-24T20:08:39.276940+0000","last_fullsized":"2023-12-24T20:08:39.276940+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:26.458164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279784+0000","last_change":"2023-12-24T20:08:38.240060+0000","last_active":"2023-12-24T20:08:39.279784+0000","last_peered":"2023-12-24T20:08:39.279784+0000","last_clean":"2023-12-24T20:08:39.279784+0000","last_became_active":"2023-12-24T20:08:38.239336+0000","last_became_peered":"2023-12-24T20:08:38.239336+0000","last_unstale":"2023-12-24T20:08:39.279784+0000","last_undegraded":"2023-12-24T20:08:39.279784+0000","last_fullsized":"2023-12-24T20:08:39.279784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:22:27.226154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.259418+0000","last_change":"2023-12-24T20:08:39.254126+0000","last_active":"2023-12-24T20:08:39.259418+0000","last_peered":"2023-12-24T20:08:39.259418+0000","last_clean":"2023-12-24T20:08:39.259418+0000","last_became_active":"2023-12-24T20:08:39.253845+0000","last_became_peered":"2023-12-24T20:08:39.253845+0000","last_unstale":"2023-12-24T20:08:39.259418+0000","last_undegraded":"2023-12-24T20:08:39.259418+0000","last_fullsized":"2023-12-24T20:08:39.259418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:41.759711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.279501+0000","last_change":"2023-12-24T20:08:38.248304+0000","last_active":"2023-12-24T20:08:39.279501+0000","last_peered":"2023-12-24T20:08:39.279501+0000","last_clean":"2023-12-24T20:08:39.279501+0000","last_became_active":"2023-12-24T20:08:38.247924+0000","last_became_peered":"2023-12-24T20:08:38.247924+0000","last_unstale":"2023-12-24T20:08:39.279501+0000","last_undegraded":"2023-12-24T20:08:39.279501+0000","last_fullsized":"2023-12-24T20:08:39.279501+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:24.843770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.252851+0000","last_change":"2023-12-24T20:08:39.250188+0000","last_active":"2023-12-24T20:08:39.252851+0000","last_peered":"2023-12-24T20:08:39.252851+0000","last_clean":"2023-12-24T20:08:39.252851+0000","last_became_active":"2023-12-24T20:08:39.249421+0000","last_became_peered":"2023-12-24T20:08:39.249421+0000","last_unstale":"2023-12-24T20:08:39.252851+0000","last_undegraded":"2023-12-24T20:08:39.252851+0000","last_fullsized":"2023-12-24T20:08:39.252851+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:57.499048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278103+0000","last_change":"2023-12-24T20:08:38.245114+0000","last_active":"2023-12-24T20:08:39.278103+0000","last_peered":"2023-12-24T20:08:39.278103+0000","last_clean":"2023-12-24T20:08:39.278103+0000","last_became_active":"2023-12-24T20:08:38.244729+0000","last_became_peered":"2023-12-24T20:08:38.244729+0000","last_unstale":"2023-12-24T20:08:39.278103+0000","last_undegraded":"2023-12-24T20:08:39.278103+0000","last_fullsized":"2023-12-24T20:08:39.278103+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:39.927979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256690+0000","last_change":"2023-12-24T20:08:39.253674+0000","last_active":"2023-12-24T20:08:39.256690+0000","last_peered":"2023-12-24T20:08:39.256690+0000","last_clean":"2023-12-24T20:08:39.256690+0000","last_became_active":"2023-12-24T20:08:39.253369+0000","last_became_peered":"2023-12-24T20:08:39.253369+0000","last_unstale":"2023-12-24T20:08:39.256690+0000","last_undegraded":"2023-12-24T20:08:39.256690+0000","last_fullsized":"2023-12-24T20:08:39.256690+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:07.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242781+0000","last_change":"2023-12-24T20:08:38.253981+0000","last_active":"2023-12-24T20:08:39.242781+0000","last_peered":"2023-12-24T20:08:39.242781+0000","last_clean":"2023-12-24T20:08:39.242781+0000","last_became_active":"2023-12-24T20:08:38.253691+0000","last_became_peered":"2023-12-24T20:08:38.253691+0000","last_unstale":"2023-12-24T20:08:39.242781+0000","last_undegraded":"2023-12-24T20:08:39.242781+0000","last_fullsized":"2023-12-24T20:08:39.242781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:02.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271215+0000","last_change":"2023-12-24T20:08:39.260099+0000","last_active":"2023-12-24T20:08:39.271215+0000","last_peered":"2023-12-24T20:08:39.271215+0000","last_clean":"2023-12-24T20:08:39.271215+0000","last_became_active":"2023-12-24T20:08:39.259444+0000","last_became_peered":"2023-12-24T20:08:39.259444+0000","last_unstale":"2023-12-24T20:08:39.271215+0000","last_undegraded":"2023-12-24T20:08:39.271215+0000","last_fullsized":"2023-12-24T20:08:39.271215+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:13:19.511234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.280314+0000","last_change":"2023-12-24T20:08:38.245770+0000","last_active":"2023-12-24T20:08:39.280314+0000","last_peered":"2023-12-24T20:08:39.280314+0000","last_clean":"2023-12-24T20:08:39.280314+0000","last_became_active":"2023-12-24T20:08:38.245431+0000","last_became_peered":"2023-12-24T20:08:38.245431+0000","last_unstale":"2023-12-24T20:08:39.280314+0000","last_undegraded":"2023-12-24T20:08:39.280314+0000","last_fullsized":"2023-12-24T20:08:39.280314+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271955+0000","last_change":"2023-12-24T20:08:39.264271+0000","last_active":"2023-12-24T20:08:39.271955+0000","last_peered":"2023-12-24T20:08:39.271955+0000","last_clean":"2023-12-24T20:08:39.271955+0000","last_became_active":"2023-12-24T20:08:39.263819+0000","last_became_peered":"2023-12-24T20:08:39.263819+0000","last_unstale":"2023-12-24T20:08:39.271955+0000","last_undegraded":"2023-12-24T20:08:39.271955+0000","last_fullsized":"2023-12-24T20:08:39.271955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.239064+0000","last_change":"2023-12-24T20:08:38.256267+0000","last_active":"2023-12-24T20:08:39.239064+0000","last_peered":"2023-12-24T20:08:39.239064+0000","last_clean":"2023-12-24T20:08:39.239064+0000","last_became_active":"2023-12-24T20:08:38.255858+0000","last_became_peered":"2023-12-24T20:08:38.255858+0000","last_unstale":"2023-12-24T20:08:39.239064+0000","last_undegraded":"2023-12-24T20:08:39.239064+0000","last_fullsized":"2023-12-24T20:08:39.239064+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:17.957301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.262529+0000","last_change":"2023-12-24T20:08:39.258104+0000","last_active":"2023-12-24T20:08:39.262529+0000","last_peered":"2023-12-24T20:08:39.262529+0000","last_clean":"2023-12-24T20:08:39.262529+0000","last_became_active":"2023-12-24T20:08:39.257822+0000","last_became_peered":"2023-12-24T20:08:39.257822+0000","last_unstale":"2023-12-24T20:08:39.262529+0000","last_undegraded":"2023-12-24T20:08:39.262529+0000","last_fullsized":"2023-12-24T20:08:39.262529+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:00.830143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229366+0000","last_change":"2023-12-24T20:08:38.243949+0000","last_active":"2023-12-24T20:08:39.229366+0000","last_peered":"2023-12-24T20:08:39.229366+0000","last_clean":"2023-12-24T20:08:39.229366+0000","last_became_active":"2023-12-24T20:08:38.243446+0000","last_became_peered":"2023-12-24T20:08:38.243446+0000","last_unstale":"2023-12-24T20:08:39.229366+0000","last_undegraded":"2023-12-24T20:08:39.229366+0000","last_fullsized":"2023-12-24T20:08:39.229366+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:52.516275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256761+0000","last_change":"2023-12-24T20:08:39.253736+0000","last_active":"2023-12-24T20:08:39.256761+0000","last_peered":"2023-12-24T20:08:39.256761+0000","last_clean":"2023-12-24T20:08:39.256761+0000","last_became_active":"2023-12-24T20:08:39.251407+0000","last_became_peered":"2023-12-24T20:08:39.251407+0000","last_unstale":"2023-12-24T20:08:39.256761+0000","last_undegraded":"2023-12-24T20:08:39.256761+0000","last_fullsized":"2023-12-24T20:08:39.256761+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:06.228504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242932+0000","last_change":"2023-12-24T20:08:38.246611+0000","last_active":"2023-12-24T20:08:39.242932+0000","last_peered":"2023-12-24T20:08:39.242932+0000","last_clean":"2023-12-24T20:08:39.242932+0000","last_became_active":"2023-12-24T20:08:38.245986+0000","last_became_peered":"2023-12-24T20:08:38.245986+0000","last_unstale":"2023-12-24T20:08:39.242932+0000","last_undegraded":"2023-12-24T20:08:39.242932+0000","last_fullsized":"2023-12-24T20:08:39.242932+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:39.839197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.256639+0000","last_change":"2023-12-24T20:08:39.253242+0000","last_active":"2023-12-24T20:08:39.256639+0000","last_peered":"2023-12-24T20:08:39.256639+0000","last_clean":"2023-12-24T20:08:39.256639+0000","last_became_active":"2023-12-24T20:08:39.251554+0000","last_became_peered":"2023-12-24T20:08:39.251554+0000","last_unstale":"2023-12-24T20:08:39.256639+0000","last_undegraded":"2023-12-24T20:08:39.256639+0000","last_fullsized":"2023-12-24T20:08:39.256639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:28:14.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.278816+0000","last_change":"2023-12-24T20:08:38.245783+0000","last_active":"2023-12-24T20:08:39.278816+0000","last_peered":"2023-12-24T20:08:39.278816+0000","last_clean":"2023-12-24T20:08:39.278816+0000","last_became_active":"2023-12-24T20:08:38.244565+0000","last_became_peered":"2023-12-24T20:08:38.244565+0000","last_unstale":"2023-12-24T20:08:39.278816+0000","last_undegraded":"2023-12-24T20:08:39.278816+0000","last_fullsized":"2023-12-24T20:08:39.278816+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:54.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.270426+0000","last_change":"2023-12-24T20:08:39.265615+0000","last_active":"2023-12-24T20:08:39.270426+0000","last_peered":"2023-12-24T20:08:39.270426+0000","last_clean":"2023-12-24T20:08:39.270426+0000","last_became_active":"2023-12-24T20:08:39.263000+0000","last_became_peered":"2023-12-24T20:08:39.263000+0000","last_unstale":"2023-12-24T20:08:39.270426+0000","last_undegraded":"2023-12-24T20:08:39.270426+0000","last_fullsized":"2023-12-24T20:08:39.270426+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:46:24.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-24T20:08:40.233290+0000","last_change":"2023-12-24T20:08:38.250806+0000","last_active":"2023-12-24T20:08:40.233290+0000","last_peered":"2023-12-24T20:08:40.233290+0000","last_clean":"2023-12-24T20:08:40.233290+0000","last_became_active":"2023-12-24T20:08:38.250359+0000","last_became_peered":"2023-12-24T20:08:38.250359+0000","last_unstale":"2023-12-24T20:08:40.233290+0000","last_undegraded":"2023-12-24T20:08:40.233290+0000","last_fullsized":"2023-12-24T20:08:40.233290+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:20:06.702396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.267639+0000","last_change":"2023-12-24T20:08:39.257209+0000","last_active":"2023-12-24T20:08:39.267639+0000","last_peered":"2023-12-24T20:08:39.267639+0000","last_clean":"2023-12-24T20:08:39.267639+0000","last_became_active":"2023-12-24T20:08:39.256410+0000","last_became_peered":"2023-12-24T20:08:39.256410+0000","last_unstale":"2023-12-24T20:08:39.267639+0000","last_undegraded":"2023-12-24T20:08:39.267639+0000","last_fullsized":"2023-12-24T20:08:39.267639+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:26.287672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240490+0000","last_change":"2023-12-24T20:08:38.250328+0000","last_active":"2023-12-24T20:08:39.240490+0000","last_peered":"2023-12-24T20:08:39.240490+0000","last_clean":"2023-12-24T20:08:39.240490+0000","last_became_active":"2023-12-24T20:08:38.250020+0000","last_became_peered":"2023-12-24T20:08:38.250020+0000","last_unstale":"2023-12-24T20:08:39.240490+0000","last_undegraded":"2023-12-24T20:08:39.240490+0000","last_fullsized":"2023-12-24T20:08:39.240490+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:47.468412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.260458+0000","last_change":"2023-12-24T20:08:39.251809+0000","last_active":"2023-12-24T20:08:39.260458+0000","last_peered":"2023-12-24T20:08:39.260458+0000","last_clean":"2023-12-24T20:08:39.260458+0000","last_became_active":"2023-12-24T20:08:39.251491+0000","last_became_peered":"2023-12-24T20:08:39.251491+0000","last_unstale":"2023-12-24T20:08:39.260458+0000","last_undegraded":"2023-12-24T20:08:39.260458+0000","last_fullsized":"2023-12-24T20:08:39.260458+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:00.863180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.229549+0000","last_change":"2023-12-24T20:08:38.250060+0000","last_active":"2023-12-24T20:08:39.229549+0000","last_peered":"2023-12-24T20:08:39.229549+0000","last_clean":"2023-12-24T20:08:39.229549+0000","last_became_active":"2023-12-24T20:08:38.249746+0000","last_became_peered":"2023-12-24T20:08:38.249746+0000","last_unstale":"2023-12-24T20:08:39.229549+0000","last_undegraded":"2023-12-24T20:08:39.229549+0000","last_fullsized":"2023-12-24T20:08:39.229549+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:33.428126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.255593+0000","last_change":"2023-12-24T20:08:39.252994+0000","last_active":"2023-12-24T20:08:39.255593+0000","last_peered":"2023-12-24T20:08:39.255593+0000","last_clean":"2023-12-24T20:08:39.255593+0000","last_became_active":"2023-12-24T20:08:39.252438+0000","last_became_peered":"2023-12-24T20:08:39.252438+0000","last_unstale":"2023-12-24T20:08:39.255593+0000","last_undegraded":"2023-12-24T20:08:39.255593+0000","last_fullsized":"2023-12-24T20:08:39.255593+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:44.720849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.233775+0000","last_change":"2023-12-24T20:08:38.243330+0000","last_active":"2023-12-24T20:08:39.233775+0000","last_peered":"2023-12-24T20:08:39.233775+0000","last_clean":"2023-12-24T20:08:39.233775+0000","last_became_active":"2023-12-24T20:08:38.242985+0000","last_became_peered":"2023-12-24T20:08:38.242985+0000","last_unstale":"2023-12-24T20:08:39.233775+0000","last_undegraded":"2023-12-24T20:08:39.233775+0000","last_fullsized":"2023-12-24T20:08:39.233775+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:32:40.375343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.269420+0000","last_change":"2023-12-24T20:08:39.265833+0000","last_active":"2023-12-24T20:08:39.269420+0000","last_peered":"2023-12-24T20:08:39.269420+0000","last_clean":"2023-12-24T20:08:39.269420+0000","last_became_active":"2023-12-24T20:08:39.265456+0000","last_became_peered":"2023-12-24T20:08:39.265456+0000","last_unstale":"2023-12-24T20:08:39.269420+0000","last_undegraded":"2023-12-24T20:08:39.269420+0000","last_fullsized":"2023-12-24T20:08:39.269420+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:17.991414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240992+0000","last_change":"2023-12-24T20:08:38.260555+0000","last_active":"2023-12-24T20:08:39.240992+0000","last_peered":"2023-12-24T20:08:39.240992+0000","last_clean":"2023-12-24T20:08:39.240992+0000","last_became_active":"2023-12-24T20:08:38.260223+0000","last_became_peered":"2023-12-24T20:08:38.260223+0000","last_unstale":"2023-12-24T20:08:39.240992+0000","last_undegraded":"2023-12-24T20:08:39.240992+0000","last_fullsized":"2023-12-24T20:08:39.240992+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:59.815420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.271743+0000","last_change":"2023-12-24T20:08:39.259346+0000","last_active":"2023-12-24T20:08:39.271743+0000","last_peered":"2023-12-24T20:08:39.271743+0000","last_clean":"2023-12-24T20:08:39.271743+0000","last_became_active":"2023-12-24T20:08:39.259051+0000","last_became_peered":"2023-12-24T20:08:39.259051+0000","last_unstale":"2023-12-24T20:08:39.271743+0000","last_undegraded":"2023-12-24T20:08:39.271743+0000","last_fullsized":"2023-12-24T20:08:39.271743+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:38:58.145573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.240677+0000","last_change":"2023-12-24T20:08:38.245775+0000","last_active":"2023-12-24T20:08:39.240677+0000","last_peered":"2023-12-24T20:08:39.240677+0000","last_clean":"2023-12-24T20:08:39.240677+0000","last_became_active":"2023-12-24T20:08:38.245051+0000","last_became_peered":"2023-12-24T20:08:38.245051+0000","last_unstale":"2023-12-24T20:08:39.240677+0000","last_undegraded":"2023-12-24T20:08:39.240677+0000","last_fullsized":"2023-12-24T20:08:39.240677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:38:13.712545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.250034+0000","last_change":"2023-12-24T20:08:39.244572+0000","last_active":"2023-12-24T20:08:39.250034+0000","last_peered":"2023-12-24T20:08:39.250034+0000","last_clean":"2023-12-24T20:08:39.250034+0000","last_became_active":"2023-12-24T20:08:39.244190+0000","last_became_peered":"2023-12-24T20:08:39.244190+0000","last_unstale":"2023-12-24T20:08:39.250034+0000","last_undegraded":"2023-12-24T20:08:39.250034+0000","last_fullsized":"2023-12-24T20:08:39.250034+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:30:43.712363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.235534+0000","last_change":"2023-12-24T20:08:38.245309+0000","last_active":"2023-12-24T20:08:39.235534+0000","last_peered":"2023-12-24T20:08:39.235534+0000","last_clean":"2023-12-24T20:08:39.235534+0000","last_became_active":"2023-12-24T20:08:38.245009+0000","last_became_peered":"2023-12-24T20:08:38.245009+0000","last_unstale":"2023-12-24T20:08:39.235534+0000","last_undegraded":"2023-12-24T20:08:39.235534+0000","last_fullsized":"2023-12-24T20:08:39.235534+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:54:10.563414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.263769+0000","last_change":"2023-12-24T20:08:39.262632+0000","last_active":"2023-12-24T20:08:39.263769+0000","last_peered":"2023-12-24T20:08:39.263769+0000","last_clean":"2023-12-24T20:08:39.263769+0000","last_became_active":"2023-12-24T20:08:39.262309+0000","last_became_peered":"2023-12-24T20:08:39.262309+0000","last_unstale":"2023-12-24T20:08:39.263769+0000","last_undegraded":"2023-12-24T20:08:39.263769+0000","last_fullsized":"2023-12-24T20:08:39.263769+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:38.203809+0000","last_clean_scrub_stamp":"2023-12-24T20:08:38.203809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:00:16.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.242105+0000","last_change":"2023-12-24T20:08:38.250456+0000","last_active":"2023-12-24T20:08:39.242105+0000","last_peered":"2023-12-24T20:08:39.242105+0000","last_clean":"2023-12-24T20:08:39.242105+0000","last_became_active":"2023-12-24T20:08:38.250150+0000","last_became_peered":"2023-12-24T20:08:38.250150+0000","last_unstale":"2023-12-24T20:08:39.242105+0000","last_undegraded":"2023-12-24T20:08:39.242105+0000","last_fullsized":"2023-12-24T20:08:39.242105+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:08:37.189086+0000","last_clean_scrub_stamp":"2023-12-24T20:08:37.189086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:36:59.848456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1043,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-24T20:08:39.243026+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:08:39.243026+0000","last_peered":"2023-12-24T20:08:39.243026+0000","last_clean":"2023-12-24T20:08:39.243026+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:08:39.243026+0000","last_undegraded":"2023-12-24T20:08:39.243026+0000","last_fullsized":"2023-12-24T20:08:39.243026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304324,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067516,"statfs":{"total":96636764160,"available":96325136384,"internally_reserved":0,"allocated":3010560,"data_stored":1856490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1339999999999999,"15min":1.163},"min":{"1min":0.73399999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.46,"5min":1.728,"15min":1.728},"last":1.046},{"interface":"front","average":{"1min":1.143,"5min":1.179,"15min":1.1799999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.171}]},{"osd":1,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.163,"15min":1.169},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.518,"5min":1.718,"15min":1.9379999999999999},"last":1.111},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.29,"15min":1.2669999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7130000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.532}]},{"osd":2,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.262},"min":{"1min":0.92500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.514,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.85999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5580000000000001,"5min":1.752,"15min":1.8200000000000001},"last":1.2310000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.3280000000000001,"15min":1.319},"min":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6319999999999999,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":0.89200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.641,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.379}]},{"osd":4,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.246,"15min":1.214},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.865,"5min":1.865,"15min":2.194},"last":1.647},{"interface":"front","average":{"1min":1.321,"5min":1.3360000000000001,"15min":1.2769999999999999},"min":{"1min":0.88700000000000001,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4530000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":0.96699999999999997,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.873,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.478},{"interface":"front","average":{"1min":1.409,"5min":1.411,"15min":1.3540000000000001},"min":{"1min":0.90600000000000003,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.7629999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:27 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4790000000000001,"15min":1.444},"min":{"1min":1.1040000000000001,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.3319999999999999},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":1.004,"5min":0.75600000000000001,"15min":0.55000000000000004},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.6759999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575950,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2929999999999999,"15min":1.3129999999999999},"min":{"1min":0.97299999999999998,"5min":0.66800000000000004,"15min":0.44500000000000001},"max":{"1min":1.645,"5min":1.7210000000000001,"15min":1.837},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":1.1759999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6160000000000001,"5min":1.744,"15min":1.821},"last":1.1040000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.1779999999999999},"min":{"1min":0.90400000000000003,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.4870000000000001,"5min":1.663,"15min":1.663},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1990000000000001,"15min":1.2270000000000001},"min":{"1min":0.95499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.4279999999999999,"5min":1.6899999999999999,"15min":1.784},"last":0.96299999999999997}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.96799999999999997,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.6240000000000001,"5min":1.6459999999999999,"15min":1.827},"last":1.288},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.94999999999999996,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.589,"5min":1.758,"15min":1.768},"last":1.3}]},{"osd":3,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3069999999999999,"15min":1.298},"min":{"1min":0.98699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.8879999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.3160000000000001,"15min":1.3109999999999999},"min":{"1min":1.1240000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":1.7010000000000001,"15min":1.8360000000000001},"last":1.2330000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.22,"15min":1.208},"min":{"1min":0.79500000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.6599999999999999,"5min":1.7110000000000001,"15min":1.9039999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.67000000000000004,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.8580000000000001},"last":1.252}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2669999999999999,"15min":1.258},"min":{"1min":0.79100000000000004,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.9370000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.373,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5820000000000001,"5min":1.839,"15min":1.954},"last":1.5229999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3959999999999999,"15min":1.403},"min":{"1min":1.1200000000000001,"5min":0.60599999999999998,"15min":0.55800000000000005},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.9710000000000001},"last":1.341},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4159999999999999,"15min":1.407},"min":{"1min":0.97799999999999998,"5min":0.73399999999999999,"15min":0.65300000000000002},"max":{"1min":1.7549999999999999,"5min":1.804,"15min":2.0259999999999998},"last":1.548}]}]},{"osd":5,"up_from":13,"seq":55834575951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311944,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059896,"statfs":{"total":96636764160,"available":96317333504,"internally_reserved":0,"allocated":2424832,"data_stored":1266246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.268},"min":{"1min":0.871,"5min":0.77200000000000002,"15min":0.498},"max":{"1min":1.6020000000000001,"5min":1.661,"15min":1.738},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.393,"15min":1.349},"min":{"1min":1.0229999999999999,"5min":0.81200000000000006,"15min":0.80300000000000005},"max":{"1min":1.597,"5min":1.7410000000000001,"15min":1.784},"last":1.4850000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2310000000000001,"15min":1.196},"min":{"1min":0.94399999999999995,"5min":0.80700000000000005,"15min":0.65100000000000002},"max":{"1min":1.5960000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.044},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.92800000000000005,"5min":0.747,"15min":0.56000000000000005},"max":{"1min":1.46,"5min":1.673,"15min":1.7210000000000001},"last":1.2310000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.90400000000000003,"5min":0.876,"15min":0.80000000000000004},"max":{"1min":1.677,"5min":1.6839999999999999,"15min":1.819},"last":1.415},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.268,"15min":1.284},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.878},"max":{"1min":1.635,"5min":1.883,"15min":1.883},"last":0.82399999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3220000000000001,"15min":1.3},"min":{"1min":1.0449999999999999,"5min":0.92300000000000004,"15min":0.75800000000000001},"max":{"1min":1.784,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.403,"15min":1.369},"min":{"1min":1.091,"5min":1.038,"15min":0.94499999999999995},"max":{"1min":1.7210000000000001,"5min":1.877,"15min":1.8799999999999999},"last":1.3759999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.61899999999999999},"max":{"1min":1.6599999999999999,"5min":1.839,"15min":1.839},"last":1.093},{"interface":"front","average":{"1min":1.331,"5min":1.3160000000000001,"15min":1.302},"min":{"1min":0.98899999999999999,"5min":0.82099999999999995,"15min":0.59599999999999997},"max":{"1min":1.5920000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.351,"15min":1.325},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.796,"5min":2.008,"15min":2.008},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.357,"5min":1.373,"15min":1.3560000000000001},"min":{"1min":1.012,"5min":0.93500000000000005,"15min":0.69599999999999995},"max":{"1min":1.6930000000000001,"5min":1.7669999999999999,"15min":1.9630000000000001},"last":0.877}]},{"osd":7,"last update":"Sun Dec 24 20:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.466,"15min":1.423},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.80700000000000005},"max":{"1min":1.9370000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.554},{"interface":"front","average":{"1min":1.482,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":1.0229999999999999,"5min":0.90600000000000003,"15min":0.85999999999999999},"max":{"1min":1.8580000000000001,"5min":1.978,"15min":2.0009999999999999},"last":1.2729999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311952,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059888,"statfs":{"total":96636764160,"available":96317325312,"internally_reserved":0,"allocated":2433024,"data_stored":1266858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.268},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.67500000000000004},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.66300000000000003},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":2.012},"last":1.355}]},{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.179,"15min":1.1539999999999999},"min":{"1min":0.748,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5589999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.161},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1699999999999999,"15min":1.155},"min":{"1min":0.92300000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.694},"last":1.1990000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3380000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.84899999999999998},"max":{"1min":1.7989999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.49},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.367},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"max":{"1min":1.825,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.319}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.91600000000000004,"5min":0.82799999999999996,"15min":0.66700000000000004},"max":{"1min":1.5229999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3129999999999999,"15min":1.3049999999999999},"min":{"1min":1.1259999999999999,"5min":0.90600000000000003,"15min":0.81699999999999995},"max":{"1min":1.6950000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4450000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.28,"15min":1.3009999999999999},"min":{"1min":0.92100000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.704,"5min":1.704,"15min":1.8169999999999999},"last":1.415},{"interface":"front","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.82199999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7290000000000001,"5min":2.0720000000000001,"15min":2.089},"last":1.2450000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.286},"min":{"1min":0.878,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.571,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.387},{"interface":"front","average":{"1min":1.399,"5min":1.335,"15min":1.335},"min":{"1min":1.087,"5min":0.65700000000000003,"15min":0.51600000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.96},"last":1.077}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.27,"15min":1.3009999999999999},"min":{"1min":0.97699999999999998,"5min":0.72799999999999998,"15min":0.57099999999999995},"max":{"1min":1.865,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.129},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4410000000000001,"15min":1.423},"min":{"1min":1.0580000000000001,"5min":0.82999999999999996,"15min":0.72999999999999998},"max":{"1min":1.8879999999999999,"5min":2.0329999999999999,"15min":2.7829999999999999},"last":1.2789999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575950,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316052,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055788,"statfs":{"total":96636764160,"available":96313126912,"internally_reserved":0,"allocated":2437120,"data_stored":1268234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.885},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.1000000000000001,"15min":1.131},"min":{"1min":0.81299999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.577,"5min":1.6990000000000001,"15min":2.0059999999999998},"last":0.90100000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.052,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":1.6830000000000001,"5min":1.722,"15min":2.0899999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.321,"5min":1.2809999999999999,"15min":1.278},"min":{"1min":0.99399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6850000000000001,"5min":1.889,"15min":1.889},"last":1.504}]},{"osd":2,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1220000000000001,"15min":1.147},"min":{"1min":0.69099999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":2.0619999999999998,"15min":2.21},"last":1.032},{"interface":"front","average":{"1min":1.206,"5min":1.232,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":2.036,"5min":2.036,"15min":2.0550000000000002},"last":1.117}]},{"osd":4,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.272,"15min":1.27},"min":{"1min":0.85999999999999999,"5min":0.78500000000000003,"15min":0.71099999999999997},"max":{"1min":1.581,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":1.0740000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.173}]},{"osd":5,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4419999999999999,"15min":1.446},"min":{"1min":1.1200000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.7,"5min":2.0129999999999999,"15min":2.3900000000000001},"last":1.359},{"interface":"front","average":{"1min":1.484,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.145,"5min":1.1120000000000001,"15min":0.96099999999999997},"max":{"1min":1.956,"5min":2.032,"15min":2.2250000000000001},"last":1.3740000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5029999999999999,"15min":1.524},"min":{"1min":1.147,"5min":1.1419999999999999,"15min":1.0209999999999999},"max":{"1min":1.927,"5min":2.089,"15min":2.145},"last":1.234},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":1.0649999999999999,"5min":0.95699999999999996,"15min":0.879},"max":{"1min":1.8740000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.323}]},{"osd":7,"last update":"Sun Dec 24 20:08:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.48,"15min":1.49},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.758,"5min":2.1920000000000002,"15min":2.2639999999999998},"last":1.196},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5529999999999999,"15min":1.5609999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.913,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.27}]}]},{"osd":2,"up_from":13,"seq":55834575952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072192,"statfs":{"total":96636764160,"available":96329924608,"internally_reserved":0,"allocated":2416640,"data_stored":1266122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.3939999999999999,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5669999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.325}]},{"osd":1,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":2.056},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1559999999999999,"15min":1.125},"min":{"1min":0.83699999999999997,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.4670000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.90100000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2470000000000001,"15min":1.234},"min":{"1min":0.81200000000000006,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7629999999999999,"5min":1.8140000000000001,"15min":2.1659999999999999},"last":1.258},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2130000000000001,"15min":1.163},"min":{"1min":1.034,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":1.052}]},{"osd":4,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.423,"15min":1.3919999999999999},"min":{"1min":1.228,"5min":0.96699999999999997,"15min":0.92600000000000005},"max":{"1min":1.754,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.357},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":0.94499999999999995},"max":{"1min":1.8149999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.75}]},{"osd":5,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.417,"15min":1.369},"min":{"1min":1.042,"5min":0.877,"15min":0.877},"max":{"1min":1.8620000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.4790000000000001,"15min":1.4650000000000001},"min":{"1min":1.1899999999999999,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0230000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.8009999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.52,"15min":1.502},"min":{"1min":1.2729999999999999,"5min":1.1160000000000001,"15min":1.012},"max":{"1min":1.917,"5min":2.0779999999999998,"15min":2.1219999999999999},"last":1.601},{"interface":"front","average":{"1min":1.631,"5min":1.556,"15min":1.5109999999999999},"min":{"1min":1.357,"5min":1.1000000000000001,"15min":0.876},"max":{"1min":2.1379999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":2.0110000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.603,"15min":1.581},"min":{"1min":1.2190000000000001,"5min":1.048,"15min":1.048},"max":{"1min":2.1589999999999998,"5min":2.387,"15min":2.387},"last":1.978},{"interface":"front","average":{"1min":1.7,"5min":1.615,"15min":1.5940000000000001},"min":{"1min":1.355,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.214,"5min":2.226,"15min":2.2589999999999999},"last":1.6439999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575950,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1267658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57999999999999996,"15min":0.54900000000000004},"max":{"1min":1.2809999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1759999999999999,"15min":1.1599999999999999},"min":{"1min":0.94499999999999995,"5min":0.82799999999999996,"15min":0.58199999999999996},"max":{"1min":1.49,"5min":1.657,"15min":1.671},"last":0.79600000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.57799999999999996,"15min":0.41099999999999998},"max":{"1min":1.28,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.75900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.532,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.296,"15min":1.306},"min":{"1min":0.76000000000000001,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.6299999999999999,"5min":1.909,"15min":1.909},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82899999999999996,"5min":0.73899999999999999,"15min":0.48899999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.8140000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2689999999999999,"15min":1.284},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.63},"max":{"1min":1.73,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.4390000000000001},"min":{"1min":1.109,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7569999999999999,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.0029999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.423,"15min":1.401},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.81200000000000006},"max":{"1min":1.819,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.407,"15min":1.4019999999999999},"min":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.84599999999999997},"max":{"1min":1.837,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.054}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.534,"15min":1.5229999999999999},"min":{"1min":1.1519999999999999,"5min":1.032,"15min":0.72999999999999998},"max":{"1min":2.1160000000000001,"5min":2.2410000000000001,"15min":2.3540000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.4890000000000001,"15min":1.4930000000000001},"min":{"1min":1.147,"5min":0.97899999999999998,"15min":0.86699999999999999},"max":{"1min":1.7629999999999999,"5min":2.379,"15min":2.456},"last":1.123}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5609999999999999},"min":{"1min":1.216,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7909999999999999,"5min":2.29,"15min":2.5299999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.476,"5min":1.48,"15min":1.5069999999999999},"min":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.95899999999999996},"max":{"1min":1.7829999999999999,"5min":2.177,"15min":2.177},"last":1.1699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575950,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304332,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067508,"statfs":{"total":96636764160,"available":96325128192,"internally_reserved":0,"allocated":3018752,"data_stored":1856594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.90100000000000002,"15min":0.91700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.6950000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.091,"5min":1.085,"15min":1.071},"min":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":1.6559999999999999,"5min":1.823,"15min":1.823},"last":1.325}]},{"osd":2,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0900000000000001,"15min":1.0960000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.615,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.167,"15min":1.163},"min":{"1min":0.82799999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5409999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.94999999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.107},"min":{"1min":0.745,"5min":0.71999999999999997,"15min":0.58199999999999996},"max":{"1min":1.5820000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.2729999999999999,"15min":1.284},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.657}]},{"osd":4,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4159999999999999,"15min":1.3959999999999999},"min":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.222},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.331},"min":{"1min":1.0660000000000001,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6890000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.383}]},{"osd":5,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4390000000000001,"15min":1.4450000000000001},"min":{"1min":0.98099999999999998,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.8939999999999999,"5min":1.958,"15min":2.2519999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4610000000000001,"15min":1.462},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.9099999999999999,"5min":2.125,"15min":2.125},"last":1.5}]},{"osd":6,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.657,"5min":2.1320000000000001,"15min":2.492},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5169999999999999},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":1.9610000000000001,"5min":2.25,"15min":2.3330000000000002},"last":1.833}]},{"osd":7,"last update":"Sun Dec 24 20:08:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.548,"15min":1.538},"min":{"1min":1.167,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.984,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.736},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5449999999999999,"15min":1.5189999999999999},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8100000000000001,"5min":2.234,"15min":2.411},"last":1.7749999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:08:48.771 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:08:48.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:08:48.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.977+0000 7f4060545700 1 Processor -- start 2023-12-24T20:08:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.981+0000 7f4060545700 1 -- start start 2023-12-24T20:08:48.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.981+0000 7f4060545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f405815c370 0x7f40580afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.981+0000 7f4060545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 0x7f40580b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f4060545700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40580c9e10 con 0x7f40580add00 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f4060545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580c9200 con 0x7f405815c370 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f4060545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580c94e0 con 0x7f40580cb2b0 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405dae0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f40580add00 0x7f405815cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35750/0 (socket says 172.21.15.50:35750) 2023-12-24T20:08:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405dae0700 1 -- 172.21.15.50:0/1433637526 learned_addr learned my addr 172.21.15.50:0/1433637526 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:48.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 --2- 172.21.15.50:0/1433637526 >> v2:172.21.15.82:3300/0 conn(0x7f405815c370 0x7f40580afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405eae2700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 0x7f40580b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405d2df700 1 -- 172.21.15.50:0/1433637526 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706016173 0 0) 0x7f40580c9e10 con 0x7f40580add00 2023-12-24T20:08:48.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405d2df700 1 -- 172.21.15.50:0/1433637526 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4044003570 con 0x7f40580add00 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 -- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 msgr2=0x7f40580b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 0x7f40580b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 -- 172.21.15.50:0/1433637526 >> v1:172.21.15.50:6789/0 conn(0x7f40580add00 legacy=0x7f405815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 -- 172.21.15.50:0/1433637526 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580c97c0 con 0x7f405815c370 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405eae2700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 0x7f40580b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405e2e1700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f405815c370 0x7f40580afe40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40540098e0 tx=0x7f40540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2daf8696069c5b85 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405d2df700 1 -- 172.21.15.50:0/1433637526 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400b640 con 0x7f405815c370 2023-12-24T20:08:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405d2df700 1 -- 172.21.15.50:0/1433637526 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405400b7a0 con 0x7f405815c370 2023-12-24T20:08:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.985+0000 7f405d2df700 1 -- 172.21.15.50:0/1433637526 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400bb40 con 0x7f405815c370 2023-12-24T20:08:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f405815c370 msgr2=0x7f40580afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f405815c370 0x7f40580afe40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40540098e0 tx=0x7f40540091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- 172.21.15.50:0/1433637526 shutdown_connections 2023-12-24T20:08:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580cb2b0 0x7f40580b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 --2- 172.21.15.50:0/1433637526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f405815c370 0x7f40580afe40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- 172.21.15.50:0/1433637526 >> 172.21.15.50:0/1433637526 conn(0x7f405806c820 msgr2=0x7f405806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- 172.21.15.50:0/1433637526 shutdown_connections 2023-12-24T20:08:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- 172.21.15.50:0/1433637526 wait complete. 2023-12-24T20:08:48.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 Processor -- start 2023-12-24T20:08:48.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.989+0000 7f4060545700 1 -- start start 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 0x7f40580676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580cb2b0 0x7f405816a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405816a660 con 0x7f405815c370 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405816a870 con 0x7f40580cb2b0 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058067cb0 con 0x7f40580add00 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46180/0 (socket says 172.21.15.50:46180) 2023-12-24T20:08:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 -- 172.21.15.50:0/500169745 learned_addr learned my addr 172.21.15.50:0/500169745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405dae0700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580cb2b0 0x7f405816a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405e2e1700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 0x7f40580676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 -- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 msgr2=0x7f40580676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 0x7f40580676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 -- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580cb2b0 msgr2=0x7f405816a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580cb2b0 0x7f405816a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 -- 172.21.15.50:0/500169745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054009420 con 0x7f405815c370 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405e2e1700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 0x7f40580676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f405eae2700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f405000d180 tx=0x7f4050009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000dd70 con 0x7f405815c370 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405000f040 con 0x7f405815c370 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4058067f90 con 0x7f405815c370 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050015690 con 0x7f405815c370 2023-12-24T20:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.993+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4058068550 con 0x7f405815c370 2023-12-24T20:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.997+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40580652e0 con 0x7f405815c370 2023-12-24T20:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.997+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f405001e3b0 con 0x7f405815c370 2023-12-24T20:08:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:48.997+0000 7f404e7fc700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.001+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f405007d0f0 con 0x7f405815c370 2023-12-24T20:08:49.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.001+0000 7f405e2e1700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.001+0000 7f405e2e1700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 0x7f403c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40540093f0 tx=0x7f4054017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:49.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.005+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f405004d350 con 0x7f405815c370 2023-12-24T20:08:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.241+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f405816a9b0 con 0x7f405815c370 2023-12-24T20:08:49.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.253+0000 7f404e7fc700 1 -- 172.21.15.50:0/500169745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v51) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4050050970 con 0x7f405815c370 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 msgr2=0x7f403c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 0x7f403c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40540093f0 tx=0x7f4054017000 comp rx=0 tx=0).stop 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 msgr2=0x7f405816c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f405000d180 tx=0x7f4050009a50 comp rx=0 tx=0).stop 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 shutdown_connections 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405815c370 0x7f405816c400 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580cb2b0 0x7f405816a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 --2- 172.21.15.50:0/500169745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40580add00 0x7f40580676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 >> 172.21.15.50:0/500169745 conn(0x7f405806c820 msgr2=0x7f40581591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 shutdown_connections 2023-12-24T20:08:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.257+0000 7f4060545700 1 -- 172.21.15.50:0/500169745 wait complete. 2023-12-24T20:08:49.261 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T20:08:49.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:49.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.441+0000 7f7a57563700 1 Processor -- start 2023-12-24T20:08:49.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.441+0000 7f7a57563700 1 -- start start 2023-12-24T20:08:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a57563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a57563700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a5006c820 0x7f7a500ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a57563700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500b0460 con 0x7f7a500adc90 2023-12-24T20:08:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a57563700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5006d8c0 con 0x7f7a5006c820 2023-12-24T20:08:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a57563700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500afc60 con 0x7f7a5015a2d0 2023-12-24T20:08:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43000/0 (socket says 172.21.15.50:43000) 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 -- 172.21.15.50:0/535066080 learned_addr learned my addr 172.21.15.50:0/535066080 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a55d60700 1 --2- 172.21.15.50:0/535066080 >> v2:172.21.15.82:3300/0 conn(0x7f7a5006c820 0x7f7a500ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56d62700 1 --1- 172.21.15.50:0/535066080 >> v1:172.21.15.50:6789/0 conn(0x7f7a500adc90 0x7f7a500b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43258/0 (socket says 172.21.15.50:43258) 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 -- 172.21.15.50:0/535066080 >> v2:172.21.15.82:3300/0 conn(0x7f7a5006c820 msgr2=0x7f7a500ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 --2- 172.21.15.50:0/535066080 >> v2:172.21.15.82:3300/0 conn(0x7f7a5006c820 0x7f7a500ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 -- 172.21.15.50:0/535066080 >> v1:172.21.15.50:6789/0 conn(0x7f7a500adc90 legacy=0x7f7a500b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 -- 172.21.15.50:0/535066080 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500ae100 con 0x7f7a5015a2d0 2023-12-24T20:08:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.445+0000 7f7a56561700 1 --2- 172.21.15.50:0/535066080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009f20 tx=0x7f7a4c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a346987652cd88 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a5555f700 1 -- 172.21.15.50:0/535066080 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c00e070 con 0x7f7a5015a2d0 2023-12-24T20:08:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a5555f700 1 -- 172.21.15.50:0/535066080 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c00ba80 con 0x7f7a5015a2d0 2023-12-24T20:08:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a5555f700 1 -- 172.21.15.50:0/535066080 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0092e0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 -- 172.21.15.50:0/535066080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 msgr2=0x7f7a500ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 --2- 172.21.15.50:0/535066080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009f20 tx=0x7f7a4c009840 comp rx=0 tx=0).stop 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 -- 172.21.15.50:0/535066080 shutdown_connections 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 --2- 172.21.15.50:0/535066080 >> v2:172.21.15.82:3300/0 conn(0x7f7a5006c820 0x7f7a500ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 --2- 172.21.15.50:0/535066080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a500ae8b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 -- 172.21.15.50:0/535066080 >> 172.21.15.50:0/535066080 conn(0x7f7a50067b80 msgr2=0x7f7a500cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 -- 172.21.15.50:0/535066080 shutdown_connections 2023-12-24T20:08:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.449+0000 7f7a57563700 1 -- 172.21.15.50:0/535066080 wait complete. 2023-12-24T20:08:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 Processor -- start 2023-12-24T20:08:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 -- start start 2023-12-24T20:08:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 0x7f7a50153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500adc90 0x7f7a50169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500ad400 con 0x7f7a500adc90 2023-12-24T20:08:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5016a3b0 con 0x7f7a5006c820 2023-12-24T20:08:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a57563700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500ac7f0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a55d60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500adc90 0x7f7a50169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a56d62700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a56561700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 0x7f7a50153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a56d62700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43010/0 (socket says 172.21.15.50:43010) 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a56d62700 1 -- 172.21.15.50:0/2138908351 learned_addr learned my addr 172.21.15.50:0/2138908351 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.453+0000 7f7a56561700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 0x7f7a50153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:35088/0 (socket says 172.21.15.50:35088) 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 -- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 msgr2=0x7f7a50153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 0x7f7a50153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 -- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500adc90 msgr2=0x7f7a50169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500adc90 0x7f7a50169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 -- 172.21.15.50:0/2138908351 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009ae0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a56d62700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c590 tx=0x7f7a48007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48005a70 con 0x7f7a5015a2d0 2023-12-24T20:08:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48005bf0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480070d0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a500acad0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a500ad090 con 0x7f7a5015a2d0 2023-12-24T20:08:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.457+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a500ad5b0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.461+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7a480074c0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.461+0000 7f7a467fc700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 0x7f7a34062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.461+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f7a4807bed0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.461+0000 7f7a56561700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 0x7f7a34062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.461+0000 7f7a56561700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 0x7f7a34062b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009880 tx=0x7f7a4c018000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.469+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a4804c1b0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.677+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a500ac540 con 0x7f7a5015a2d0 2023-12-24T20:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.677+0000 7f7a467fc700 1 -- 172.21.15.50:0/2138908351 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f7a4804f7d0 con 0x7f7a5015a2d0 2023-12-24T20:08:49.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:08:49.682 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 msgr2=0x7f7a34062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 0x7f7a34062b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009880 tx=0x7f7a4c018000 comp rx=0 tx=0).stop 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 msgr2=0x7f7a5015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c590 tx=0x7f7a48007ef0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 shutdown_connections 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7a34060650 0x7f7a34062b00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a5015a2d0 0x7f7a5015d620 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500adc90 0x7f7a50169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 --2- 172.21.15.50:0/2138908351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a5006c820 0x7f7a50153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 >> 172.21.15.50:0/2138908351 conn(0x7f7a50067b80 msgr2=0x7f7a5006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 shutdown_connections 2023-12-24T20:08:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:49.681+0000 7f7a57563700 1 -- 172.21.15.50:0/2138908351 wait complete. 2023-12-24T20:08:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:08:50.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:08:38.679694+0000', 'modified': '2023-12-24T20:08:42.263810+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9864}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9864': {'gid': 9864, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2617886579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2617886579}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2617886579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:08:50.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:08:50.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T20:08:50.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.265+0000 7f6b9b0f0700 1 Processor -- start 2023-12-24T20:08:50.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.265+0000 7f6b9b0f0700 1 -- start start 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b940ce750 0x7f6b940ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 0x7f6b94159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9406b7e0 con 0x7f6b94159a20 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9406ba80 con 0x7f6b940ce750 2023-12-24T20:08:50.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9b0f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9406bd60 con 0x7f6b9406ae30 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9968d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 0x7f6b94159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b940ce750 0x7f6b940ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b940ce750 0x7f6b940ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:35090/0 (socket says 172.21.15.50:35090) 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:43020/0 (socket says 172.21.15.50:43020) 2023-12-24T20:08:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 -- 172.21.15.50:0/2778164907 learned_addr learned my addr 172.21.15.50:0/2778164907 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 -- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 msgr2=0x7f6b9406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 -- 172.21.15.50:0/2778164907 >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 msgr2=0x7f6b94159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2778164907 >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 0x7f6b94159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 -- 172.21.15.50:0/2778164907 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9406c040 con 0x7f6b940ce750 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b9968d700 1 --2- 172.21.15.50:0/2778164907 >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 0x7f6b94159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.269+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b940ceb20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6b940cda50 tx=0x7f6b90009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62dc687edd309db7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b8b7fe700 1 -- 172.21.15.50:0/2778164907 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000b640 con 0x7f6b940ce750 2023-12-24T20:08:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b8b7fe700 1 -- 172.21.15.50:0/2778164907 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000b7a0 con 0x7f6b940ce750 2023-12-24T20:08:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b8b7fe700 1 -- 172.21.15.50:0/2778164907 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000bb60 con 0x7f6b940ce750 2023-12-24T20:08:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 msgr2=0x7f6b940ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b940ceb20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6b940cda50 tx=0x7f6b90009250 comp rx=0 tx=0).stop 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/2778164907 shutdown_connections 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/2778164907 >> v2:172.21.15.50:3300/0 conn(0x7f6b94159a20 0x7f6b94159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b9406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/2778164907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b940ceb20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/2778164907 >> 172.21.15.50:0/2778164907 conn(0x7f6b940cffb0 msgr2=0x7f6b940d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/2778164907 shutdown_connections 2023-12-24T20:08:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/2778164907 wait complete. 2023-12-24T20:08:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.273+0000 7f6b9b0f0700 1 Processor -- start 2023-12-24T20:08:50.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 -- start start 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b94153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b941552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94153120 con 0x7f6b94159a20 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94152bc0 con 0x7f6b940ce750 2023-12-24T20:08:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9b0f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94154210 con 0x7f6b9406ae30 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58446/0 (socket says 172.21.15.50:58446) 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 -- 172.21.15.50:0/758085304 learned_addr learned my addr 172.21.15.50:0/758085304 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b94153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b941552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 -- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 msgr2=0x7f6b94153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b94153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 -- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 msgr2=0x7f6b941552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b941552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.277+0000 7f6b9968d700 1 -- 172.21.15.50:0/758085304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84009420 con 0x7f6b94159a20 2023-12-24T20:08:50.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b9968d700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009f20 tx=0x7f6b8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b88ff9700 1 -- 172.21.15.50:0/758085304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00cb70 con 0x7f6b94159a20 2023-12-24T20:08:50.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b88ff9700 1 -- 172.21.15.50:0/758085304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00f040 con 0x7f6b94159a20 2023-12-24T20:08:50.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b88ff9700 1 -- 172.21.15.50:0/758085304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c014480 con 0x7f6b94159a20 2023-12-24T20:08:50.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c009a20 con 0x7f6b94159a20 2023-12-24T20:08:50.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.281+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b900094f0 con 0x7f6b94159a20 2023-12-24T20:08:50.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b88ff9700 1 -- 172.21.15.50:0/758085304 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6b8c003020 con 0x7f6b94159a20 2023-12-24T20:08:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b88ff9700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 0x7f6b80062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 Processor -- start 2023-12-24T20:08:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b88ff9700 1 -- 172.21.15.50:0/758085304 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f6b8c07d3b0 con 0x7f6b94159a20 2023-12-24T20:08:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 -- start start 2023-12-24T20:08:50.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 0x7f6b80062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x19a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x19a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d3f30 con 0x1728ae0 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x18cfed0 con 0x1728710 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x18960b0 con 0x1773790 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 0x7f6b80062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b940cda50 tx=0x7f6b90017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b98e8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b98e8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58454/0 (socket says 172.21.15.50:58454) 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b98e8c700 1 -- 172.21.15.50:0/10817300 learned_addr learned my addr 172.21.15.50:0/10817300 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.285+0000 7f6b9968d700 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x19a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x19a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 -- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 msgr2=0x19a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x19a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 -- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 msgr2=0x19a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x19a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 -- 172.21.15.50:0/10817300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17749e0 con 0x1728ae0 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5a18c580ca1af server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b79ffb700 1 -- 172.21.15.50:0/10817300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9002d070 con 0x1728ae0 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b79ffb700 1 -- 172.21.15.50:0/10817300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9001a880 con 0x1728ae0 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b79ffb700 1 -- 172.21.15.50:0/10817300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90021070 con 0x1728ae0 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/10817300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 msgr2=0x19a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90021000 comp rx=0 tx=0).stop 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/10817300 shutdown_connections 2023-12-24T20:08:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x19a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x19a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/10817300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x19a5f00 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/10817300 >> 172.21.15.50:0/10817300 conn(0x1728eb0 msgr2=0x1962930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/10817300 shutdown_connections 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/10817300 wait complete. 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.289+0000 7f6b9d3b3740 1 -- start start 2023-12-24T20:08:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 Processor -- start 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1728710 0x19aa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 0x19aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1895d50 con 0x1773790 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x186e970 con 0x1728ae0 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x18d0770 con 0x1728710 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 10 client.0 _ll_register_callbacks cb 0x19196a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58458/0 (socket says 172.21.15.50:58458) 2023-12-24T20:08:50.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 -- 172.21.15.50:0/801918660 learned_addr learned my addr 172.21.15.50:0/801918660 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1728710 0x19aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 0x19aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 -- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1728710 msgr2=0x19aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1728710 0x19aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 -- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 msgr2=0x19aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 0x19aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 -- 172.21.15.50:0/801918660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9406c040 con 0x1773790 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 0x19aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9968d700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c051260 tx=0x7f6b8c07b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c7c4f10f8802bf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0510a0 con 0x1773790 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f6b8c0507c0 con 0x1773790 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x186ecc0 con 0x1773790 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b8c07b080 con 0x1773790 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 10 client.10014 fetch_fsmap learned FSMap version 95 2023-12-24T20:08:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x189e370 con 0x1773790 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.293+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c06f070 con 0x1773790 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6b8c057e20 con 0x1773790 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 10 client.10014 fetch_fsmap finished waiting for FSMap version 95 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 10 client.10014 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 20 client.10014 populate_metadata read hostname 'smithi050' 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x198d420 0x19b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 4 client.10014 mds_command: new command op to 9864 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 --> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18723e0 con 0x198d420 2023-12-24T20:08:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x198d420 0x19b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b72ffd700 10 client.10014 ms_handle_connect on v2:172.21.15.50:6834/2617886579 2023-12-24T20:08:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x198d420 0x19b56b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ea85bec23bcfc8 server_cookie=aaa0308a4b276219 in_seq=0 out_seq=0 2023-12-24T20:08:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b72ffd700 1 -- 172.21.15.50:0/801918660 <== mds.0 v2:172.21.15.50:6834/2617886579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x18723e0 con 0x198d420 2023-12-24T20:08:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b72ffd700 10 client.10014 handle_command_reply: tid=0 2023-12-24T20:08:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 client.10014 shutdown 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 msgr2=0x198bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c051260 tx=0x7f6b8c07b4a0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 shutdown_connections 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x198d420 0x19b56b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x198bcb0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728ae0 0x19aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/801918660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1728710 0x19aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b72ffd700 0 client.10014 ms_handle_reset on v2:172.21.15.50:6834/2617886579 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 >> 172.21.15.50:0/801918660 conn(0x1728eb0 msgr2=0x195af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 shutdown_connections 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.297+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/801918660 wait complete. 2023-12-24T20:08:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.301+0000 7f6b9d3b3740 20 client.10014 trim_cache size 0 max 16384 2023-12-24T20:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 Processor -- start 2023-12-24T20:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 -- start start 2023-12-24T20:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x1989780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1870b80 con 0x1728ae0 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x18a3040 con 0x1728710 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x18cd890 con 0x1773790 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58468/0 (socket says 172.21.15.50:58468) 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 -- 172.21.15.50:0/1948747103 learned_addr learned my addr 172.21.15.50:0/1948747103 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b9968d700 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x1989780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 -- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 msgr2=0x1989780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x1989780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 -- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 msgr2=0x195cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 -- 172.21.15.50:0/1948747103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1884d80 con 0x1728ae0 2023-12-24T20:08:50.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.321+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009ec0 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db82a4df4e2d6be server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b7a7fc700 1 -- 172.21.15.50:0/1948747103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84015b10 con 0x1728ae0 2023-12-24T20:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b7a7fc700 1 -- 172.21.15.50:0/1948747103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84015c70 con 0x1728ae0 2023-12-24T20:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b7a7fc700 1 -- 172.21.15.50:0/1948747103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84016430 con 0x1728ae0 2023-12-24T20:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/1948747103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 msgr2=0x195d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009ec0 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/1948747103 shutdown_connections 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1773790 0x1989780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1728ae0 0x195d010 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/1948747103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/1948747103 >> 172.21.15.50:0/1948747103 conn(0x1728eb0 msgr2=0x19a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/1948747103 shutdown_connections 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/1948747103 wait complete. 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 -- start start 2023-12-24T20:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.325+0000 7f6b9d3b3740 1 Processor -- start 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x195fa00 0x195fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d2590 con 0x1773790 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d39d0 con 0x1728710 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1899400 con 0x195fa00 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 10 client.0 _ll_register_callbacks cb 0x16f49d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58474/0 (socket says 172.21.15.50:58474) 2023-12-24T20:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 -- 172.21.15.50:0/2373658068 learned_addr learned my addr 172.21.15.50:0/2373658068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9968d700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x195fa00 0x195fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 -- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x195fa00 msgr2=0x195fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x195fa00 0x195fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 -- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 msgr2=0x195bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 -- 172.21.15.50:0/2373658068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b84009bf0 con 0x1773790 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b8bfff700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f6b84020040 tx=0x7f6b8401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c50fbef60606b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T20:08:50.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84015b10 con 0x1773790 2023-12-24T20:08:50.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b940c7840 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f6b84015de0 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b84027670 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 10 client.10020 fetch_fsmap learned FSMap version 95 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x1879130 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b940c7840 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6b84027a60 con 0x1773790 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 10 client.10020 fetch_fsmap finished waiting for FSMap version 95 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 10 client.10020 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 20 client.10020 populate_metadata read hostname 'smithi050' 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x1a07e70 0x1a08240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 4 client.10020 mds_command: new command op to 9864 tid=0[{"prefix": "status"}] 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 --> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f6b9001a880 con 0x1a07e70 2023-12-24T20:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.329+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x1a07e70 0x1a08240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b98e8c700 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x1a07e70 0x1a08240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87909e8130ec2ae3 server_cookie=462389d675cfea0c in_seq=0 out_seq=0 2023-12-24T20:08:50.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b72ffd700 10 client.10020 ms_handle_connect on v2:172.21.15.50:6834/2617886579 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b72ffd700 1 -- 172.21.15.50:0/2373658068 <== mds.0 v2:172.21.15.50:6834/2617886579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f6b9001a880 con 0x1a07e70 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b72ffd700 10 client.10020 handle_command_reply: tid=0 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 client.10020 shutdown 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 msgr2=0x195f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f6b84020040 tx=0x7f6b8401d000 comp rx=0 tx=0).stop 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 shutdown_connections 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:6834/2617886579,v1:172.21.15.50:6835/2617886579] conn(0x1a07e70 0x1a08240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x195fa00 0x195fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1773790 0x195f4c0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b72ffd700 0 client.10020 ms_handle_reset on v2:172.21.15.50:6834/2617886579 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 --2- 172.21.15.50:0/2373658068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1728710 0x195bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 >> 172.21.15.50:0/2373658068 conn(0x1728eb0 msgr2=0x1989780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 shutdown_connections 2023-12-24T20:08:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 1 -- 172.21.15.50:0/2373658068 wait complete. 2023-12-24T20:08:50.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9d3b3740 20 client.10020 trim_cache size 0 max 16384 2023-12-24T20:08:50.338 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:08:50.338 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T20:08:50.338 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9864, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.091726393, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 95, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 193, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 193, 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 16.963289454000002 2023-12-24T20:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 msgr2=0x7f6b80062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 0x7f6b80062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b940cda50 tx=0x7f6b90017000 comp rx=0 tx=0).stop 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 msgr2=0x7f6b94152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009f20 tx=0x7f6b8c00b040 comp rx=0 tx=0).stop 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 shutdown_connections 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b80060580 0x7f6b80062a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94159a20 0x7f6b94152680 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b940ce750 0x7f6b941552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 --2- 172.21.15.50:0/758085304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b9406ae30 0x7f6b94153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 >> 172.21.15.50:0/758085304 conn(0x7f6b940cffb0 msgr2=0x7f6b940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 shutdown_connections 2023-12-24T20:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.333+0000 7f6b9b0f0700 1 -- 172.21.15.50:0/758085304 wait complete. 2023-12-24T20:08:50.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:08:50.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.529+0000 7fa98e8f0700 1 Processor -- start 2023-12-24T20:08:50.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.529+0000 7fa98e8f0700 1 -- start start 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98e8f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa988154b60 0x7fa9880c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98e8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa98806aca0 0x7fa98806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98e8f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98806c820 con 0x7fa9880c6d00 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98e8f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98806b960 con 0x7fa988154b60 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98e8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98806bc40 con 0x7fa98806aca0 2023-12-24T20:08:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa987fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9880c6d00 0x7fa988154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43262/0 (socket says 172.21.15.50:43262) 2023-12-24T20:08:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa987fff700 1 -- 172.21.15.50:0/3662992566 learned_addr learned my addr 172.21.15.50:0/3662992566 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/3662992566 >> v2:172.21.15.82:3300/0 conn(0x7fa988154b60 0x7fa9880c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa98ce8d700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa98806aca0 0x7fa98806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa9877fe700 1 -- 172.21.15.50:0/3662992566 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349691493 0 0) 0x7fa98806c820 con 0x7fa9880c6d00 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa9877fe700 1 -- 172.21.15.50:0/3662992566 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa974003570 con 0x7fa9880c6d00 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 -- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa98806aca0 msgr2=0x7fa98806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa98806aca0 0x7fa98806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 -- 172.21.15.50:0/3662992566 >> v1:172.21.15.50:6789/0 conn(0x7fa9880c6d00 legacy=0x7fa988154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 -- 172.21.15.50:0/3662992566 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98806bf20 con 0x7fa988154b60 2023-12-24T20:08:50.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa9880c70d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e60 tx=0x7fa970009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2320b545e46ec06 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa9877fe700 1 -- 172.21.15.50:0/3662992566 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa988154b60 2023-12-24T20:08:50.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa9877fe700 1 -- 172.21.15.50:0/3662992566 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000bab0 con 0x7fa988154b60 2023-12-24T20:08:50.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.533+0000 7fa9877fe700 1 -- 172.21.15.50:0/3662992566 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000be70 con 0x7fa988154b60 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 -- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 msgr2=0x7fa9880c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa9880c70d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e60 tx=0x7fa970009780 comp rx=0 tx=0).stop 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 -- 172.21.15.50:0/3662992566 shutdown_connections 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa98806aca0 0x7fa98806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/3662992566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa9880c70d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 -- 172.21.15.50:0/3662992566 >> 172.21.15.50:0/3662992566 conn(0x7fa9880cbba0 msgr2=0x7fa9880cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 -- 172.21.15.50:0/3662992566 shutdown_connections 2023-12-24T20:08:50.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 -- 172.21.15.50:0/3662992566 wait complete. 2023-12-24T20:08:50.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.537+0000 7fa98e8f0700 1 Processor -- start 2023-12-24T20:08:50.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 -- start start 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 0x7fa988142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa988142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c4190 con 0x7fa98806aca0 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c3bd0 con 0x7fa988154b60 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98e8f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c3eb0 con 0x7fa9880c6d00 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa987fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa987fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58488/0 (socket says 172.21.15.50:58488) 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa987fff700 1 -- 172.21.15.50:0/4215891897 learned_addr learned my addr 172.21.15.50:0/4215891897 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:50.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 0x7fa988142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.541+0000 7fa98ce8d700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa988142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 -- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 msgr2=0x7fa988142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 0x7fa988142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 -- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 msgr2=0x7fa988142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa988142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 -- 172.21.15.50:0/4215891897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009a20 con 0x7fa98806aca0 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 0x7fa988142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa987fff700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fa97800c7c0 tx=0x7fa978007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978005cd0 con 0x7fa98806aca0 2023-12-24T20:08:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978005e30 con 0x7fa98806aca0 2023-12-24T20:08:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978007320 con 0x7fa98806aca0 2023-12-24T20:08:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa988155980 con 0x7fa98806aca0 2023-12-24T20:08:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988168200 con 0x7fa98806aca0 2023-12-24T20:08:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.545+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9880652e0 con 0x7fa98806aca0 2023-12-24T20:08:50.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.549+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa97801b3b0 con 0x7fa98806aca0 2023-12-24T20:08:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.549+0000 7fa984ff9700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 0x7fa968062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.549+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7fa97807c150 con 0x7fa98806aca0 2023-12-24T20:08:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.549+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 0x7fa968062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.549+0000 7fa97f7fe700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 0x7fa968062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097c0 tx=0x7fa970019000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.557+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa97804c450 con 0x7fa98806aca0 2023-12-24T20:08:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa98806c200 con 0x7fa98806aca0 2023-12-24T20:08:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa984ff9700 1 -- 172.21.15.50:0/4215891897 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa978017060 con 0x7fa98806aca0 2023-12-24T20:08:50.772 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 msgr2=0x7fa968062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 0x7fa968062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097c0 tx=0x7fa970019000 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 msgr2=0x7fa9881676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.769+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fa97800c7c0 tx=0x7fa978007e00 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 shutdown_connections 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa968060550 0x7fa968062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988154b60 0x7fa988142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9880c6d00 0x7fa988142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 --2- 172.21.15.50:0/4215891897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98806aca0 0x7fa9881676a0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 >> 172.21.15.50:0/4215891897 conn(0x7fa9880cbba0 msgr2=0x7fa9880c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 shutdown_connections 2023-12-24T20:08:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:50.773+0000 7fa98e8f0700 1 -- 172.21.15.50:0/4215891897 wait complete. 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:08:50.796 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:08:50.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:50.797 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T20:08:50.815 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 36879sec preferred_lft 36879sec 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.816 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.817 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T20:08:50.818 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:08:50.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:50.819 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:08:50.903 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T20:08:50.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:50.906 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T20:08:50.971 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T20:08:51.285 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:08:51.285 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T20:08:51.285 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T20:08:51.285 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T20:08:51.285 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:08:51.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T20:08:51.286 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T20:08:51.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:51.393 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T20:08:51.419 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:08:51.419 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:08:51.420 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:08:51.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:51.420 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T20:08:51.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:08:51.506 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:51.578 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:08:51.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:08:51.579 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:51.647 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T20:08:51.648 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:08:51.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:08:51.775 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:08:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T20:08:51.798 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:08:51.798 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T20:08:51.799 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T20:08:51.799 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T20:08:51.799 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T20:08:51.804 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T20:08:51.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:51.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:51.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T20:08:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.056+0000 7f2700eae700 1 Processor -- start 2023-12-24T20:08:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.056+0000 7f2700eae700 1 -- start start 2023-12-24T20:08:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f2700eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc15d6d0 0x7f26fc0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f2700eae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc0b41d0 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f2700eae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc06d5c0 con 0x7f26fc158e10 2023-12-24T20:08:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f2700eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0b49c0 con 0x7f26fc15d6d0 2023-12-24T20:08:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26fad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26fc0b1ba0 0x7f26fc1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43264/0 (socket says 172.21.15.50:43264) 2023-12-24T20:08:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26fad9d700 1 -- 172.21.15.50:0/539021564 learned_addr learned my addr 172.21.15.50:0/539021564 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f9d9b700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc15d6d0 0x7f26fc0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791233573 0 0) 0x7f26fc0b41d0 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e4003570 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595484436 0 0) 0x7f26fc06d5c0 con 0x7f26fc158e10 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26fc0b41d0 con 0x7f26fc158e10 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1767119258 0 0) 0x7f26e4003570 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc15d6d0 msgr2=0x7f26fc0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc15d6d0 0x7f26fc0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 >> v1:172.21.15.82:6789/0 conn(0x7f26fc158e10 legacy=0x7f26fc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc15db20 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f26f4001470 con 0x7f26fc0b1ba0 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 >> v1:172.21.15.50:6789/0 conn(0x7f26fc0b1ba0 legacy=0x7f26fc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26e4003c20 0x7f26e4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e4004810 0x7f26e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26e40051c0 0x7f26e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0b49c0 con 0x7f26e40051c0 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e400c020 con 0x7f26e4004810 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e400c1e0 con 0x7f26e4003c20 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26fad9d700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26e40051c0 0x7f26e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26f9d9b700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e4004810 0x7f26e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26fa59c700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26e4003c20 0x7f26e4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.060+0000 7f26fad9d700 1 -- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26e4003c20 msgr2=0x7f26e4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26e4003c20 0x7f26e4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 -- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e4004810 msgr2=0x7f26e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e4004810 0x7f26e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 -- 172.21.15.50:0/539021564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4003570 con 0x7f26e40051c0 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fa59c700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26e4003c20 0x7f26e4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26e40051c0 0x7f26e400ba60 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c2d0 tx=0x7f26fc06d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1686ef348f695b6f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400cc00 con 0x7f26e40051c0 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400cd60 con 0x7f26e40051c0 2023-12-24T20:08:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26f959a700 1 -- 172.21.15.50:0/539021564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4005b30 con 0x7f26e40051c0 2023-12-24T20:08:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 -- 172.21.15.50:0/539021564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26e40051c0 msgr2=0x7f26e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 --2- 172.21.15.50:0/539021564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26e40051c0 0x7f26e400ba60 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c2d0 tx=0x7f26fc06d530 comp rx=0 tx=0).stop 2023-12-24T20:08:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f26fad9d700 1 -- 172.21.15.50:0/539021564 reap_dead start 2023-12-24T20:08:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 -- 172.21.15.50:0/539021564 shutdown_connections 2023-12-24T20:08:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 -- 172.21.15.50:0/539021564 >> 172.21.15.50:0/539021564 conn(0x7f26fc0670b0 msgr2=0x7f26fc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 -- 172.21.15.50:0/539021564 shutdown_connections 2023-12-24T20:08:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.064+0000 7f2700eae700 1 -- 172.21.15.50:0/539021564 wait complete. 2023-12-24T20:08:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 Processor -- start 2023-12-24T20:08:52.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 -- start start 2023-12-24T20:08:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e40051c0 0x7f26fc0a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc159410 0x7f26fc159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0b3e30 con 0x7f26fc0b3480 2023-12-24T20:08:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15b290 con 0x7f26e40051c0 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.068+0000 7f2700eae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15a160 con 0x7f26fc159410 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58500/0 (socket says 172.21.15.50:58500) 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 -- 172.21.15.50:0/1919916055 learned_addr learned my addr 172.21.15.50:0/1919916055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26fa59c700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e40051c0 0x7f26fc0a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26fad9d700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc159410 0x7f26fc159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 -- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc159410 msgr2=0x7f26fc159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc159410 0x7f26fc159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 -- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e40051c0 msgr2=0x7f26fc0a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e40051c0 0x7f26fc0a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 -- 172.21.15.50:0/1919916055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc15a960 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26f9d9b700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f26f00119d0 tx=0x7f26f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000f860 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000f9c0 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000fd60 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc15ac40 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc0a93a0 con 0x7f26fc0b3480 2023-12-24T20:08:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.072+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc15b440 con 0x7f26fc0b3480 2023-12-24T20:08:52.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.076+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f26f0014650 con 0x7f26fc0b3480 2023-12-24T20:08:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.076+0000 7f26ea7fc700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 0x7f26dc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.076+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f26f0018030 con 0x7f26fc0b3480 2023-12-24T20:08:52.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.076+0000 7f26fa59c700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 0x7f26dc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.080+0000 7f26fa59c700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 0x7f26dc062a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007fd0 tx=0x7f26ec009040 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.084+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f26fc15b440 con 0x7f26fc0b3480 2023-12-24T20:08:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.284+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f26fc15b0c0 con 0x7f26dc060580 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.284+0000 7f26ea7fc700 1 -- 172.21.15.50:0/1919916055 <== mgr.9663 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f26fc15b0c0 con 0x7f26dc060580 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:08:52.290 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T20:08:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 msgr2=0x7f26dc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 0x7f26dc062a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007fd0 tx=0x7f26ec009040 comp rx=0 tx=0).stop 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 msgr2=0x7f26fc0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f26f00119d0 tx=0x7f26f00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 shutdown_connections 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f26dc060580 0x7f26dc062a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26fc159410 0x7f26fc159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc0b3480 0x7f26fc0b38f0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 --2- 172.21.15.50:0/1919916055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e40051c0 0x7f26fc0a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 >> 172.21.15.50:0/1919916055 conn(0x7f26fc0670b0 msgr2=0x7f26fc155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 shutdown_connections 2023-12-24T20:08:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.288+0000 7f2700eae700 1 -- 172.21.15.50:0/1919916055 wait complete. 2023-12-24T20:08:52.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T20:08:52.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.480+0000 7f3737e2e700 1 Processor -- start 2023-12-24T20:08:52.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.480+0000 7f3737e2e700 1 -- start start 2023-12-24T20:08:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.484+0000 7f3737e2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 0x7f37300b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.484+0000 7f3737e2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3730156490 0x7f37300b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.484+0000 7f3737e2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37300acf70 con 0x7f3730155c20 2023-12-24T20:08:52.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.484+0000 7f3737e2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3730156930 con 0x7f3730156490 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.484+0000 7f3737e2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3730156c10 con 0x7f3730155ff0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3735bca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3730155c20 0x7f373015a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43280/0 (socket says 172.21.15.50:43280) 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3735bca700 1 -- 172.21.15.50:0/1800138996 learned_addr learned my addr 172.21.15.50:0/1800138996 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37363cb700 1 --2- 172.21.15.50:0/1800138996 >> v2:172.21.15.82:3300/0 conn(0x7f3730156490 0x7f37300b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 --2- 172.21.15.50:0/1800138996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 0x7f37300b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 -- 172.21.15.50:0/1800138996 >> v2:172.21.15.82:3300/0 conn(0x7f3730156490 msgr2=0x7f37300b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3734bc8700 1 -- 172.21.15.50:0/1800138996 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747291490 0 0) 0x7f37300acf70 con 0x7f3730155c20 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 --2- 172.21.15.50:0/1800138996 >> v2:172.21.15.82:3300/0 conn(0x7f3730156490 0x7f37300b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 -- 172.21.15.50:0/1800138996 >> v1:172.21.15.50:6789/0 conn(0x7f3730155c20 legacy=0x7f373015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 -- 172.21.15.50:0/1800138996 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730156ef0 con 0x7f3730155ff0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f37353c9700 1 --2- 172.21.15.50:0/1800138996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 0x7f37300b11a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37200098e0 tx=0x7f37200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b65a7096fdc8300 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3734bc8700 1 -- 172.21.15.50:0/1800138996 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000b640 con 0x7f3730155ff0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3734bc8700 1 -- 172.21.15.50:0/1800138996 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372000b7a0 con 0x7f3730155ff0 2023-12-24T20:08:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3734bc8700 1 -- 172.21.15.50:0/1800138996 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000bb40 con 0x7f3730155ff0 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 -- 172.21.15.50:0/1800138996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 msgr2=0x7f37300b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 --2- 172.21.15.50:0/1800138996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 0x7f37300b11a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37200098e0 tx=0x7f37200091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 -- 172.21.15.50:0/1800138996 shutdown_connections 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 --2- 172.21.15.50:0/1800138996 >> v2:172.21.15.82:3300/0 conn(0x7f3730156490 0x7f37300b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 --2- 172.21.15.50:0/1800138996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730155ff0 0x7f37300b11a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 -- 172.21.15.50:0/1800138996 >> 172.21.15.50:0/1800138996 conn(0x7f373006c820 msgr2=0x7f373006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.488+0000 7f3737e2e700 1 -- 172.21.15.50:0/1800138996 shutdown_connections 2023-12-24T20:08:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 -- 172.21.15.50:0/1800138996 wait complete. 2023-12-24T20:08:52.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 Processor -- start 2023-12-24T20:08:52.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 -- start start 2023-12-24T20:08:52.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3730155ff0 0x7f373006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730156490 0x7f3730153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373016c590 con 0x7f3730155c20 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373016ce30 con 0x7f3730155ff0 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3737e2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373015c260 con 0x7f3730156490 2023-12-24T20:08:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3735bca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3735bca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58504/0 (socket says 172.21.15.50:58504) 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f3735bca700 1 -- 172.21.15.50:0/2702681682 learned_addr learned my addr 172.21.15.50:0/2702681682 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.492+0000 7f37353c9700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3730155ff0 0x7f373006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f37363cb700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730156490 0x7f3730153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 -- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730156490 msgr2=0x7f3730153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730156490 0x7f3730153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 -- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3730155ff0 msgr2=0x7f373006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3730155ff0 0x7f373006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 -- 172.21.15.50:0/2702681682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720009420 con 0x7f3730155c20 2023-12-24T20:08:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3735bca700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c810 tx=0x7f372c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c005b30 con 0x7f3730155c20 2023-12-24T20:08:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c005c90 con 0x7f3730155c20 2023-12-24T20:08:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373016c7e0 con 0x7f3730155c20 2023-12-24T20:08:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c007300 con 0x7f3730155c20 2023-12-24T20:08:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373016d2c0 con 0x7f3730155c20 2023-12-24T20:08:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.496+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373016d4b0 con 0x7f3730155c20 2023-12-24T20:08:52.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.500+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 105) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f372c01b3b0 con 0x7f3730155c20 2023-12-24T20:08:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.500+0000 7f3725ffb700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 0x7f3714062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.500+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f372c07c0a0 con 0x7f3730155c20 2023-12-24T20:08:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.500+0000 7f37353c9700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 0x7f3714062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.504+0000 7f37353c9700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 0x7f3714062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37200093f0 tx=0x7f3720017000 comp rx=0 tx=0).ready entity=mgr.9663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.508+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f372c04c300 con 0x7f3730155c20 2023-12-24T20:08:52.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.720+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f37300652e0 con 0x7f3730155c20 2023-12-24T20:08:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.984+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 106) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f372c04c6d0 con 0x7f3730155c20 2023-12-24T20:08:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.984+0000 7f3725ffb700 1 -- 172.21.15.50:0/2702681682 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v106) v1 ==== 92+0+0 (secure 0 0 0) 0x7f372c04fd90 con 0x7f3730155c20 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 msgr2=0x7f3714062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 0x7f3714062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37200093f0 tx=0x7f3720017000 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 msgr2=0x7f373015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c810 tx=0x7f372c007df0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 shutdown_connections 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3714060550 0x7f3714062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3730156490 0x7f3730153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3730155ff0 0x7f373006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 --2- 172.21.15.50:0/2702681682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3730155c20 0x7f373015b8c0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 >> 172.21.15.50:0/2702681682 conn(0x7f373006c820 msgr2=0x7f37301574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 shutdown_connections 2023-12-24T20:08:52.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:52.988+0000 7f3737e2e700 1 -- 172.21.15.50:0/2702681682 wait complete. 2023-12-24T20:08:53.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T20:08:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.172+0000 7f34af59e700 1 Processor -- start 2023-12-24T20:08:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.172+0000 7f34af59e700 1 -- start start 2023-12-24T20:08:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34b0159020 0x7f34b00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00caa60 con 0x7f34b0158c50 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00cd100 con 0x7f34b00cccd0 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00af430 con 0x7f34b0159020 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34b0159020 0x7f34b00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34b0159020 0x7f34b00cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58534/0 (socket says 172.21.15.50:58534) 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 -- 172.21.15.50:0/3410186896 learned_addr learned my addr 172.21.15.50:0/3410186896 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 -- 172.21.15.50:0/3410186896 >> v1:172.21.15.82:6789/0 conn(0x7f34b00cccd0 legacy=0x7f34b00afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 -- 172.21.15.50:0/3410186896 >> v1:172.21.15.50:6789/0 conn(0x7f34b0158c50 legacy=0x7f34b00caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 -- 172.21.15.50:0/3410186896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00cee80 con 0x7f34b0159020 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34add9b700 1 --2- 172.21.15.50:0/3410186896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00cc790 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f34a40099b0 tx=0x7f34a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c88c35a3ba38a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34ad59a700 1 -- 172.21.15.50:0/3410186896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400b820 con 0x7f34b0159020 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34ad59a700 1 -- 172.21.15.50:0/3410186896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400b980 con 0x7f34b0159020 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34ad59a700 1 -- 172.21.15.50:0/3410186896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400bd20 con 0x7f34b0159020 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 -- 172.21.15.50:0/3410186896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 msgr2=0x7f34b00cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.176+0000 7f34af59e700 1 --2- 172.21.15.50:0/3410186896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00cc790 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f34a40099b0 tx=0x7f34a4009250 comp rx=0 tx=0).stop 2023-12-24T20:08:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 -- 172.21.15.50:0/3410186896 shutdown_connections 2023-12-24T20:08:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 --2- 172.21.15.50:0/3410186896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00cc790 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 -- 172.21.15.50:0/3410186896 >> 172.21.15.50:0/3410186896 conn(0x7f34b00670b0 msgr2=0x7f34b00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 -- 172.21.15.50:0/3410186896 shutdown_connections 2023-12-24T20:08:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 -- 172.21.15.50:0/3410186896 wait complete. 2023-12-24T20:08:53.184 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:53.180+0000 7f44f670c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 Processor -- start 2023-12-24T20:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.180+0000 7f34af59e700 1 -- start start 2023-12-24T20:08:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00cccd0 0x7f34b01565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 0x7f34b00c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c7f10 con 0x7f34b0159020 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c4ef0 con 0x7f34b0158c50 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c9b60 con 0x7f34b00cccd0 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58542/0 (socket says 172.21.15.50:58542) 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 -- 172.21.15.50:0/4216112635 learned_addr learned my addr 172.21.15.50:0/4216112635 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34add9b700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 0x7f34b00c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34ae59c700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00cccd0 0x7f34b01565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 -- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00cccd0 msgr2=0x7f34b01565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00cccd0 0x7f34b01565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 -- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 msgr2=0x7f34b00c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 0x7f34b00c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 -- 172.21.15.50:0/4216112635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40094f0 con 0x7f34b0159020 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34add9b700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 0x7f34b00c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34aed9d700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f34a800bbb0 tx=0x7f34a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:53.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80092e0 con 0x7f34b0159020 2023-12-24T20:08:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800c7a0 con 0x7f34b0159020 2023-12-24T20:08:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800cb40 con 0x7f34b0159020 2023-12-24T20:08:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00c9e40 con 0x7f34b0159020 2023-12-24T20:08:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.184+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00c9850 con 0x7f34b0159020 2023-12-24T20:08:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b00c5060 con 0x7f34b0159020 2023-12-24T20:08:53.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 106) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f34a8012070 con 0x7f34b0159020 2023-12-24T20:08:53.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f349e7fc700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 0x7f3490062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f34a807c940 con 0x7f34b0159020 2023-12-24T20:08:53.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f34ae59c700 1 -- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 msgr2=0x7f3490062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:53.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.188+0000 7f34ae59c700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 0x7f3490062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:53.196 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:53.192+0000 7f53403ce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.196+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f34a804cba0 con 0x7f34b0159020 2023-12-24T20:08:53.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.372+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f34b004be40 con 0x7f34b0159020 2023-12-24T20:08:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f349e7fc700 1 -- 172.21.15.50:0/4216112635 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f34a801a020 con 0x7f34b0159020 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 msgr2=0x7f3490062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 0x7f3490062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 msgr2=0x7f34b00c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f34a800bbb0 tx=0x7f34a8009840 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 shutdown_connections 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f34900605a0 0x7f3490062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34b0159020 0x7f34b00c9310 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b0158c50 0x7f34b00c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 --2- 172.21.15.50:0/4216112635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34b00cccd0 0x7f34b01565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.380+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 >> 172.21.15.50:0/4216112635 conn(0x7f34b00670b0 msgr2=0x7f34b0157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.384+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 shutdown_connections 2023-12-24T20:08:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.384+0000 7f34af59e700 1 -- 172.21.15.50:0/4216112635 wait complete. 2023-12-24T20:08:53.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T20:08:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 Processor -- start 2023-12-24T20:08:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 -- start start 2023-12-24T20:08:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5518158db0 0x7f5518159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551806cca0 con 0x7f55180a9290 2023-12-24T20:08:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55180a9cc0 con 0x7f551806ae10 2023-12-24T20:08:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.592+0000 7f551ce2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180a9fa0 con 0x7f5518158db0 2023-12-24T20:08:53.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f550dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f55180a9290 0x7f551806a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43292/0 (socket says 172.21.15.50:43292) 2023-12-24T20:08:53.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f550dd9b700 1 -- 172.21.15.50:0/4103782022 learned_addr learned my addr 172.21.15.50:0/4103782022 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:53.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551659c700 1 --2- 172.21.15.50:0/4103782022 >> v2:172.21.15.50:3300/0 conn(0x7f5518158db0 0x7f5518159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018947636 0 0) 0x7f551806cca0 con 0x7f55180a9290 2023-12-24T20:08:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5504003570 con 0x7f55180a9290 2023-12-24T20:08:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751192574 0 0) 0x7f55180a9cc0 con 0x7f551806ae10 2023-12-24T20:08:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551806cca0 con 0x7f551806ae10 2023-12-24T20:08:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551659c700 1 -- 172.21.15.50:0/4103782022 >> v1:172.21.15.82:6789/0 conn(0x7f551806ae10 legacy=0x7f551806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159201828 0 0) 0x7f5504003570 con 0x7f55180a9290 2023-12-24T20:08:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551659c700 1 -- 172.21.15.50:0/4103782022 >> v1:172.21.15.50:6789/0 conn(0x7f55180a9290 legacy=0x7f551806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551659c700 1 -- 172.21.15.50:0/4103782022 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551806c930 con 0x7f5518158db0 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551659c700 1 --2- 172.21.15.50:0/4103782022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5518158db0 0x7f5518159180 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5508009e60 tx=0x7f5508009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1505afabfdc5d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800e070 con 0x7f5518158db0 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800b7a0 con 0x7f5518158db0 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f5515d9b700 1 -- 172.21.15.50:0/4103782022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500001470 con 0x7f5518158db0 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551ce2e700 1 -- 172.21.15.50:0/4103782022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5518158db0 msgr2=0x7f5518159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551ce2e700 1 --2- 172.21.15.50:0/4103782022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5518158db0 0x7f5518159180 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5508009e60 tx=0x7f5508009780 comp rx=0 tx=0).stop 2023-12-24T20:08:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551ce2e700 1 -- 172.21.15.50:0/4103782022 shutdown_connections 2023-12-24T20:08:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551ce2e700 1 --2- 172.21.15.50:0/4103782022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5518158db0 0x7f5518159180 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.596+0000 7f551ce2e700 1 -- 172.21.15.50:0/4103782022 >> 172.21.15.50:0/4103782022 conn(0x7f5518067b80 msgr2=0x7f55180cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- 172.21.15.50:0/4103782022 shutdown_connections 2023-12-24T20:08:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- 172.21.15.50:0/4103782022 wait complete. 2023-12-24T20:08:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 Processor -- start 2023-12-24T20:08:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- start start 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806ae10 0x7f55180a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 0x7f55180b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180a8390 con 0x7f55180a9290 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180a4d30 con 0x7f551806ae10 2023-12-24T20:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f551ce2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551815b0d0 con 0x7f5518158db0 2023-12-24T20:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f550dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f550dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58562/0 (socket says 172.21.15.50:58562) 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.600+0000 7f550dd9b700 1 -- 172.21.15.50:0/879306521 learned_addr learned my addr 172.21.15.50:0/879306521 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f551659c700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806ae10 0x7f55180a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f5516d9d700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 0x7f55180b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 -- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 msgr2=0x7f55180b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 0x7f55180b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 -- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806ae10 msgr2=0x7f55180a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806ae10 0x7f55180a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 -- 172.21.15.50:0/879306521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009a20 con 0x7f55180a9290 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f5516d9d700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 0x7f55180b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550dd9b700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f550000cb90 tx=0x7f5500001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000cea0 con 0x7f55180a9290 2023-12-24T20:08:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500007e90 con 0x7f55180a9290 2023-12-24T20:08:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55180a7830 con 0x7f55180a9290 2023-12-24T20:08:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000075d0 con 0x7f55180a9290 2023-12-24T20:08:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180a7dd0 con 0x7f55180a9290 2023-12-24T20:08:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.604+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551815aea0 con 0x7f55180a9290 2023-12-24T20:08:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.608+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 106) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f5500004a40 con 0x7f55180a9290 2023-12-24T20:08:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.608+0000 7f550effd700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 0x7f54f8062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.608+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f550007c140 con 0x7f55180a9290 2023-12-24T20:08:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.608+0000 7f551659c700 1 -- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 msgr2=0x7f54f8062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.608+0000 7f551659c700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 0x7f54f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:53.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.612+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f551815aea0 con 0x7f55180a9290 2023-12-24T20:08:53.754 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:53.752+0000 7f44f670c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:08:53.772 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:53.768+0000 7f53403ce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:08:53.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.784+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f551815aea0 con 0x7f55180a9290 2023-12-24T20:08:53.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.792+0000 7f550effd700 1 -- 172.21.15.50:0/879306521 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f551815aea0 con 0x7f55180a9290 2023-12-24T20:08:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 msgr2=0x7f54f8062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 0x7f54f8062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 msgr2=0x7f55180a72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f550000cb90 tx=0x7f5500001b50 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 shutdown_connections 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f54f80605a0 0x7f54f8062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5518158db0 0x7f55180b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55180a9290 0x7f55180a72f0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 --2- 172.21.15.50:0/879306521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f551806ae10 0x7f55180a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 >> 172.21.15.50:0/879306521 conn(0x7f5518067b80 msgr2=0x7f551815e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 shutdown_connections 2023-12-24T20:08:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:53.800+0000 7f551ce2e700 1 -- 172.21.15.50:0/879306521 wait complete. 2023-12-24T20:08:53.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:53.823 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T20:08:53.833 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:53.832+0000 7f44f670c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:08:53.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-12-24T20:08:53.865 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:53.860+0000 7f53403ce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:08:53.978 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:53.976+0000 7f44f670c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:54.017 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.012+0000 7f53403ce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.032+0000 7f194e06b700 1 Processor -- start 2023-12-24T20:08:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.032+0000 7f194e06b700 1 -- start start 2023-12-24T20:08:54.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1948159080 0x7f194806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f194806a4a0 0x7f19480c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480c5f20 con 0x7f19480c5ac0 2023-12-24T20:08:54.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194815dbd0 con 0x7f1948159080 2023-12-24T20:08:54.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194806b5b0 con 0x7f194806a4a0 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1948159080 0x7f194806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1948159080 0x7f194806da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58566/0 (socket says 172.21.15.50:58566) 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 -- 172.21.15.50:0/246970854 learned_addr learned my addr 172.21.15.50:0/246970854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194c868700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f194806a4a0 0x7f19480c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 -- 172.21.15.50:0/246970854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f194806a4a0 msgr2=0x7f19480c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f194806a4a0 0x7f19480c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 -- 172.21.15.50:0/246970854 >> v1:172.21.15.82:6789/0 conn(0x7f19480c5ac0 legacy=0x7f194806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:54.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 -- 172.21.15.50:0/246970854 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194806df80 con 0x7f1948159080 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194d069700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948159080 0x7f194806da40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f19440099b0 tx=0x7f1944009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0f97d8ad390edc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f193ffff700 1 -- 172.21.15.50:0/246970854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400b820 con 0x7f1948159080 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f193ffff700 1 -- 172.21.15.50:0/246970854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400b980 con 0x7f1948159080 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f193ffff700 1 -- 172.21.15.50:0/246970854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400bd20 con 0x7f1948159080 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- 172.21.15.50:0/246970854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948159080 msgr2=0x7f194806da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948159080 0x7f194806da40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f19440099b0 tx=0x7f1944009250 comp rx=0 tx=0).stop 2023-12-24T20:08:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- 172.21.15.50:0/246970854 shutdown_connections 2023-12-24T20:08:54.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f194806a4a0 0x7f19480c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:54.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 --2- 172.21.15.50:0/246970854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1948159080 0x7f194806da40 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:54.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.036+0000 7f194e06b700 1 -- 172.21.15.50:0/246970854 >> 172.21.15.50:0/246970854 conn(0x7f1948067b80 msgr2=0x7f19480cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:54.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- 172.21.15.50:0/246970854 shutdown_connections 2023-12-24T20:08:54.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- 172.21.15.50:0/246970854 wait complete. 2023-12-24T20:08:54.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 Processor -- start 2023-12-24T20:08:54.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- start start 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480c5ac0 0x7f194816aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948159080 0x7f19480b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194816b000 con 0x7f194806a4a0 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480b5a00 con 0x7f1948159080 2023-12-24T20:08:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194e06b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194815a5c0 con 0x7f19480c5ac0 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194d069700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194d069700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58578/0 (socket says 172.21.15.50:58578) 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194d069700 1 -- 172.21.15.50:0/4147705543 learned_addr learned my addr 172.21.15.50:0/4147705543 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194c868700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480c5ac0 0x7f194816aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.040+0000 7f194d86a700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948159080 0x7f19480b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480c5ac0 msgr2=0x7f194816aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480c5ac0 0x7f194816aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948159080 msgr2=0x7f19480b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948159080 0x7f19480b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:54.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440094f0 con 0x7f194806a4a0 2023-12-24T20:08:54.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194d069700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f1944009290 tx=0x7f1944016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:54.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944011b40 con 0x7f194806a4a0 2023-12-24T20:08:54.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944020070 con 0x7f194806a4a0 2023-12-24T20:08:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194401b450 con 0x7f194806a4a0 2023-12-24T20:08:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194815a8a0 con 0x7f194806a4a0 2023-12-24T20:08:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19480b5690 con 0x7f194806a4a0 2023-12-24T20:08:54.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.044+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194815a420 con 0x7f194806a4a0 2023-12-24T20:08:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.048+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 106) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f1944022030 con 0x7f194806a4a0 2023-12-24T20:08:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.048+0000 7f193d7fa700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.048+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6457+0+0 (secure 0 0 0) 0x7f194407e630 con 0x7f194806a4a0 2023-12-24T20:08:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.048+0000 7f194c868700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.048+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:08:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.056+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f194815a420 con 0x7f194806a4a0 2023-12-24T20:08:54.254 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:54.252+0000 7f44f670c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:08:54.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.252+0000 7f194c868700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:54.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.252+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:08:54.331 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:54.328+0000 7f44f670c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.340+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f19480c5f20 con 0x7f192c0605d0 2023-12-24T20:08:54.358 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.352+0000 7f53403ce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:08:54.434 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.428+0000 7f53403ce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:54.554 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:54.552+0000 7f44f670c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:08:54.636 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:54.632+0000 7f44f670c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:08:54.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.656+0000 7f194c868700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:54.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:54.656+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T20:08:54.664 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.660+0000 7f53403ce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:08:54.727 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:54.724+0000 7f44f670c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:08:54.755 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.752+0000 7f53403ce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:08:54.847 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:54.840+0000 7f53403ce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:08:55.131 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.128+0000 7f44f670c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:08:55.270 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:55.264+0000 7f53403ce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:08:55.286 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.284+0000 7f44f670c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:08:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:55.460+0000 7f194c868700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:55.460+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T20:08:55.474 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:55.468+0000 7f53403ce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:08:55.624 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.620+0000 7f44f670c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:08:55.829 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.824+0000 7f44f670c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:55.860 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:55.856+0000 7f53403ce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:08:55.919 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.916+0000 7f44f670c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:08:55.995 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:55.992+0000 7f44f670c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:08:56.066 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.060+0000 7f44f670c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:08:56.093 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.088+0000 7f53403ce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:08:56.193 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.188+0000 7f53403ce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:08:56.274 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.268+0000 7f53403ce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:08:56.302 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.300+0000 7f44f670c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:56.360 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.356+0000 7f53403ce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:08:56.388 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.384+0000 7f44f670c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:08:56.479 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.476+0000 7f44f670c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:08:56.603 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.600+0000 7f53403ce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:08:56.684 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.680+0000 7f44f670c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:08:56.690 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.684+0000 7f53403ce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:08:56.779 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:56.776+0000 7f44f670c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:08:56.786 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:56.780+0000 7f53403ce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:08:57.003 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:57.000+0000 7f53403ce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.064+0000 7f194c868700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.064+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T20:08:57.098 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:57.092+0000 7f53403ce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:08:57.516 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:08:57.512+0000 7f44f670c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:08:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.580+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 107) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f194404ec60 con 0x7f194806a4a0 2023-12-24T20:08:57.913 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:57.908+0000 7f53403ce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:08:57.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.928+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 108) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f194404b240 con 0x7f194806a4a0 2023-12-24T20:08:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.928+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:08:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:57.928+0000 7f193d7fa700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:58.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5300a9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5300a9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5300a9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5300a9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5300a9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5303aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5303aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5303aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5303aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.124 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:08:58.120+0000 7f5303aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:08:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:58.940+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 109) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f194404f530 con 0x7f194806a4a0 2023-12-24T20:08:58.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:58.940+0000 7f193d7fa700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:58.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:58.940+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f19480c5f20 con 0x7f192c0605d0 2023-12-24T20:08:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:58.944+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:58.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:58.952+0000 7f194c868700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f194806d6b0 tx=0x7f1938008040 comp rx=0 tx=0).ready entity=mgr.8627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.036+0000 7f193d7fa700 1 -- 172.21.15.50:0/4147705543 <== mgr.8627 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f19480c5f20 con 0x7f192c0605d0 2023-12-24T20:08:59.041 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T20:08:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 msgr2=0x7f192c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f194806d6b0 tx=0x7f1938008040 comp rx=0 tx=0).stop 2023-12-24T20:08:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 msgr2=0x7f19480b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f1944009290 tx=0x7f1944016000 comp rx=0 tx=0).stop 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 shutdown_connections 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f192c0605d0 0x7f192c062a00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948159080 0x7f19480b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19480c5ac0 0x7f194816aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 --2- 172.21.15.50:0/4147705543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f194806a4a0 0x7f19480b2f00 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 >> 172.21.15.50:0/4147705543 conn(0x7f1948067b80 msgr2=0x7f19481497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 shutdown_connections 2023-12-24T20:08:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.040+0000 7f194e06b700 1 -- 172.21.15.50:0/4147705543 wait complete. 2023-12-24T20:08:59.073 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T20:08:59.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-12-24T20:08:59.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 Processor -- start 2023-12-24T20:08:59.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 -- start start 2023-12-24T20:08:59.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd300cf4d0 0x7efd3006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 0x7efd300cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300cd680 con 0x7efd300cf8a0 2023-12-24T20:08:59.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd30159640 con 0x7efd3006ae10 2023-12-24T20:08:59.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd37065700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300cca70 con 0x7efd300cf4d0 2023-12-24T20:08:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd2ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd300cf8a0 0x7efd3006a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:33596/0 (socket says 172.21.15.50:33596) 2023-12-24T20:08:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd2ffff700 1 -- 172.21.15.50:0/1254514324 learned_addr learned my addr 172.21.15.50:0/1254514324 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:08:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd34e01700 1 --2- 172.21.15.50:0/1254514324 >> v2:172.21.15.82:3300/0 conn(0x7efd300cf4d0 0x7efd3006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.260+0000 7efd35602700 1 --2- 172.21.15.50:0/1254514324 >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 0x7efd300cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd2f7fe700 1 -- 172.21.15.50:0/1254514324 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370181213 0 0) 0x7efd300cd680 con 0x7efd300cf8a0 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd2f7fe700 1 -- 172.21.15.50:0/1254514324 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd20003570 con 0x7efd300cf8a0 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd34e01700 1 -- 172.21.15.50:0/1254514324 >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 msgr2=0x7efd300cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd34e01700 1 --2- 172.21.15.50:0/1254514324 >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 0x7efd300cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd34e01700 1 -- 172.21.15.50:0/1254514324 >> v1:172.21.15.82:6789/0 conn(0x7efd300cf8a0 legacy=0x7efd3006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd34e01700 1 -- 172.21.15.50:0/1254514324 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300ccd50 con 0x7efd300cf4d0 2023-12-24T20:08:59.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd35602700 1 --2- 172.21.15.50:0/1254514324 >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 0x7efd300cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:59.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd34e01700 1 --2- 172.21.15.50:0/1254514324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf4d0 0x7efd3006d1e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efd30063780 tx=0x7efd240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bded9f39800908 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd2f7fe700 1 -- 172.21.15.50:0/1254514324 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24011630 con 0x7efd300cf4d0 2023-12-24T20:08:59.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd2f7fe700 1 -- 172.21.15.50:0/1254514324 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240117b0 con 0x7efd300cf4d0 2023-12-24T20:08:59.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd2f7fe700 1 -- 172.21.15.50:0/1254514324 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24011b70 con 0x7efd300cf4d0 2023-12-24T20:08:59.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 -- 172.21.15.50:0/1254514324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf4d0 msgr2=0x7efd3006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 --2- 172.21.15.50:0/1254514324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf4d0 0x7efd3006d1e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efd30063780 tx=0x7efd240091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 -- 172.21.15.50:0/1254514324 shutdown_connections 2023-12-24T20:08:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 --2- 172.21.15.50:0/1254514324 >> v2:172.21.15.50:3300/0 conn(0x7efd3006ae10 0x7efd300cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 --2- 172.21.15.50:0/1254514324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf4d0 0x7efd3006d1e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 -- 172.21.15.50:0/1254514324 >> 172.21.15.50:0/1254514324 conn(0x7efd30067b30 msgr2=0x7efd300cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 -- 172.21.15.50:0/1254514324 shutdown_connections 2023-12-24T20:08:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.264+0000 7efd37065700 1 -- 172.21.15.50:0/1254514324 wait complete. 2023-12-24T20:08:59.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.268+0000 7efd37065700 1 Processor -- start 2023-12-24T20:08:59.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.268+0000 7efd37065700 1 -- start start 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd3006ae10 0x7efd30154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 0x7efd30155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd301538a0 con 0x7efd300cf4d0 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd301529f0 con 0x7efd300cf8a0 2023-12-24T20:08:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd30152c90 con 0x7efd3006ae10 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58750/0 (socket says 172.21.15.50:58750) 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 -- 172.21.15.50:0/491127332 learned_addr learned my addr 172.21.15.50:0/491127332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd34e01700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd3006ae10 0x7efd30154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd35602700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 0x7efd30155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 -- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd3006ae10 msgr2=0x7efd30154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd3006ae10 0x7efd30154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 -- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 msgr2=0x7efd30155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 0x7efd30155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 -- 172.21.15.50:0/491127332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009a20 con 0x7efd300cf4d0 2023-12-24T20:08:59.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd35602700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 0x7efd30155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2ffff700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00c560 tx=0x7efd1c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c005c00 con 0x7efd300cf4d0 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c005d60 con 0x7efd300cf4d0 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c007300 con 0x7efd300cf4d0 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd24009420 con 0x7efd300cf4d0 2023-12-24T20:08:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.272+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd30153250 con 0x7efd300cf4d0 2023-12-24T20:08:59.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.276+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd30158920 con 0x7efd300cf4d0 2023-12-24T20:08:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.276+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 109) v1 ==== 79816+0+0 (secure 0 0 0) 0x7efd1c0076b0 con 0x7efd300cf4d0 2023-12-24T20:08:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.280+0000 7efd2cff9700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 0x7efd14062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.280+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6715+0+0 (secure 0 0 0) 0x7efd1c07be30 con 0x7efd300cf4d0 2023-12-24T20:08:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.280+0000 7efd34e01700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 0x7efd14062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.280+0000 7efd34e01700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 0x7efd14062970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd30063780 tx=0x7efd24017000 comp rx=0 tx=0).ready entity=mgr.8627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.284+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd30158920 con 0x7efd300cf4d0 2023-12-24T20:08:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.480+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd300cd030 con 0x7efd140604c0 2023-12-24T20:08:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.564+0000 7efd2cff9700 1 -- 172.21.15.50:0/491127332 <== mgr.8627 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7efd300cd030 con 0x7efd140604c0 2023-12-24T20:08:59.569 INFO:teuthology.orchestra.run.smithi050.stdout:Retention added to path snap_test_dir1 2023-12-24T20:08:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 msgr2=0x7efd14062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 0x7efd14062970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd30063780 tx=0x7efd24017000 comp rx=0 tx=0).stop 2023-12-24T20:08:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 msgr2=0x7efd301524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00c560 tx=0x7efd1c007dd0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 shutdown_connections 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efd140604c0 0x7efd14062970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd300cf8a0 0x7efd30155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300cf4d0 0x7efd301524b0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 --2- 172.21.15.50:0/491127332 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd3006ae10 0x7efd30154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 >> 172.21.15.50:0/491127332 conn(0x7efd30067b30 msgr2=0x7efd3006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 shutdown_connections 2023-12-24T20:08:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.568+0000 7efd37065700 1 -- 172.21.15.50:0/491127332 wait complete. 2023-12-24T20:08:59.598 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-12-24T20:08:59.598 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-12-24-20_09_00 in ~1s... 2023-12-24T20:08:59.598 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-12-24T20:08:59.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-12-24T20:08:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.772+0000 7fa1fb078700 1 Processor -- start 2023-12-24T20:08:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.772+0000 7fa1fb078700 1 -- start start 2023-12-24T20:08:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1fb078700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa1f40ca930 0x7fa1f4068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1fb078700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1f4069500 0x7fa1f40cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1fb078700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f4069920 con 0x7fa1f4150210 2023-12-24T20:08:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1fb078700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f415d020 con 0x7fa1f4069500 2023-12-24T20:08:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1fb078700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f415d300 con 0x7fa1f40ca930 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1f4069500 0x7fa1f40cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1f4069500 0x7fa1f40cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38708/0 (socket says 172.21.15.50:38708) 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 -- 172.21.15.50:0/3191038914 learned_addr learned my addr 172.21.15.50:0/3191038914 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f3fff700 1 --2- 172.21.15.50:0/3191038914 >> v2:172.21.15.82:3300/0 conn(0x7fa1f40ca930 0x7fa1f4068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 -- 172.21.15.50:0/3191038914 >> v2:172.21.15.82:3300/0 conn(0x7fa1f40ca930 msgr2=0x7fa1f4068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 --2- 172.21.15.50:0/3191038914 >> v2:172.21.15.82:3300/0 conn(0x7fa1f40ca930 0x7fa1f4068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 -- 172.21.15.50:0/3191038914 >> v1:172.21.15.82:6789/0 conn(0x7fa1f4150210 legacy=0x7fa1f40c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.776+0000 7fa1f9615700 1 -- 172.21.15.50:0/3191038914 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f415d5e0 con 0x7fa1f4069500 2023-12-24T20:08:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1f9615700 1 --2- 172.21.15.50:0/3191038914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4069500 0x7fa1f40cc030 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40c9730 tx=0x7fa1ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16280bf4e5b3748 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1f37fe700 1 -- 172.21.15.50:0/3191038914 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00e070 con 0x7fa1f4069500 2023-12-24T20:08:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1f37fe700 1 -- 172.21.15.50:0/3191038914 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec00ba50 con 0x7fa1f4069500 2023-12-24T20:08:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1f37fe700 1 -- 172.21.15.50:0/3191038914 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0092e0 con 0x7fa1f4069500 2023-12-24T20:08:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 -- 172.21.15.50:0/3191038914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4069500 msgr2=0x7fa1f40cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3191038914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4069500 0x7fa1f40cc030 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40c9730 tx=0x7fa1ec009840 comp rx=0 tx=0).stop 2023-12-24T20:08:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 -- 172.21.15.50:0/3191038914 shutdown_connections 2023-12-24T20:08:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3191038914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4069500 0x7fa1f40cc030 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3191038914 >> v2:172.21.15.82:3300/0 conn(0x7fa1f40ca930 0x7fa1f4068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 -- 172.21.15.50:0/3191038914 >> 172.21.15.50:0/3191038914 conn(0x7fa1f40ccd60 msgr2=0x7fa1f40cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 -- 172.21.15.50:0/3191038914 shutdown_connections 2023-12-24T20:08:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.780+0000 7fa1fb078700 1 -- 172.21.15.50:0/3191038914 wait complete. 2023-12-24T20:08:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 Processor -- start 2023-12-24T20:08:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 -- start start 2023-12-24T20:08:59.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1f4069500 0x7fa1f40a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f40ca930 0x7fa1f40aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4151bd0 con 0x7fa1f4150210 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40ab6e0 con 0x7fa1f40ca930 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1fb078700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40ab420 con 0x7fa1f4069500 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1f9615700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1f9615700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38714/0 (socket says 172.21.15.50:38714) 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1f9615700 1 -- 172.21.15.50:0/3136661165 learned_addr learned my addr 172.21.15.50:0/3136661165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1f3fff700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f40ca930 0x7fa1f40aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.784+0000 7fa1f8e14700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1f4069500 0x7fa1f40a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 -- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1f4069500 msgr2=0x7fa1f40a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1f4069500 0x7fa1f40a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 -- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f40ca930 msgr2=0x7fa1f40aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f40ca930 0x7fa1f40aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 -- 172.21.15.50:0/3136661165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec009ae0 con 0x7fa1f4150210 2023-12-24T20:08:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f9615700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4069ad0 tx=0x7fa1ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00be60 con 0x7fa1f4150210 2023-12-24T20:08:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec008d20 con 0x7fa1f4150210 2023-12-24T20:08:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f41512a0 con 0x7fa1f4150210 2023-12-24T20:08:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0256b0 con 0x7fa1f4150210 2023-12-24T20:08:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f4151860 con 0x7fa1f4150210 2023-12-24T20:08:59.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.788+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4151d80 con 0x7fa1f4150210 2023-12-24T20:08:59.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.792+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 109) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fa1ec003040 con 0x7fa1f4150210 2023-12-24T20:08:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.792+0000 7fa1f0ff9700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 0x7fa1d80628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.792+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fa1ec07de80 con 0x7fa1f4150210 2023-12-24T20:08:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.792+0000 7fa1f8e14700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 0x7fa1d80628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:59.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.796+0000 7fa1f8e14700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 0x7fa1d80628d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8003a80 tx=0x7fa1e8007ec0 comp rx=0 tx=0).ready entity=mgr.8627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:59.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.800+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa1f4151d80 con 0x7fa1f4150210 2023-12-24T20:08:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:08:59.956+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 110) v1 ==== 80137+0+0 (secure 0 0 0) 0x7fa1ec082070 con 0x7fa1f4150210 2023-12-24T20:09:00.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.012+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f4071060 con 0x7fa1d8060420 2023-12-24T20:09:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.024+0000 7fa1f0ff9700 1 -- 172.21.15.50:0/3136661165 <== mgr.8627 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fa1f4071060 con 0x7fa1d8060420 2023-12-24T20:09:00.029 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:09:00.029 INFO:teuthology.orchestra.run.smithi050.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 msgr2=0x7fa1d80628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 0x7fa1d80628d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8003a80 tx=0x7fa1e8007ec0 comp rx=0 tx=0).stop 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 msgr2=0x7fa1f40ac190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4069ad0 tx=0x7fa1ec018000 comp rx=0 tx=0).stop 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 shutdown_connections 2023-12-24T20:09:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa1d8060420 0x7fa1d80628d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f4150210 0x7fa1f40ac190 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f40ca930 0x7fa1f40aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 --2- 172.21.15.50:0/3136661165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa1f4069500 0x7fa1f40a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 >> 172.21.15.50:0/3136661165 conn(0x7fa1f40ccd60 msgr2=0x7fa1f414f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 shutdown_connections 2023-12-24T20:09:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:09:00.028+0000 7fa1fb078700 1 -- 172.21.15.50:0/3136661165 wait complete. 2023-12-24T20:09:00.053 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-12-24T20:09:00.053 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-12-24T20:09:00.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:00.053 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:00.077 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-12-24T20:09:00.077 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:00.077 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:00.588 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:09:00.584+0000 7f52f2a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:09:00.588 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:09:00.584+0000 7f52f2a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:09:00.588 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:09:00.584+0000 7f52f2a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:09:00.589 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:09:00.584+0000 7f52f2a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:09:00.589 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:09:00.584+0000 7f52f2a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:09:01.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:01.078 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:01.103 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:01.105 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:01.105 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:01.105 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:01.105 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-12-24-20_09_00_UTC'] 2023-12-24T20:09:01.105 DEBUG:tasks.cephfs.test_snap_schedules:exec=1703448539.5985234, now = 1703448541.1056519, timo = 1 2023-12-24T20:09:02.106 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-12-24-20_09_00 in ~61s... 2023-12-24T20:09:02.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:02.107 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:02.130 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:02.132 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:02.132 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:02.132 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:03.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:03.133 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:03.158 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:03.159 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:03.159 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:03.159 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:04.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:04.160 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:04.185 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:04.185 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:04.185 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:05.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:05.186 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:05.210 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:05.211 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:05.211 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:05.211 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:06.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:06.212 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:06.233 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:06.234 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:06.234 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:06.235 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:07.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:07.236 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:07.259 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:07.260 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:07.260 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:07.261 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:08.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:08.262 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:08.286 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:08.288 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:08.288 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:08.288 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:09.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:09.290 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:09.319 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:09.320 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:09.320 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:09.320 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:10.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:10.322 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:10.347 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:10.349 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:10.349 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:10.349 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:11.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:11.350 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:11.377 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:11.379 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:11.379 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:11.379 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:12.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:12.380 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:12.404 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:12.405 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:12.405 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:12.406 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:13.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:13.407 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:13.430 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:13.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:13.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:13.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:14.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:14.432 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:14.455 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:14.456 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:14.456 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:14.456 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:15.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:09:15.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:09:15.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:15.458 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:15.481 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:15.482 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:15.483 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:15.483 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:16.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:16.484 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:16.509 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:16.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:16.511 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:16.511 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:17.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:17.513 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:17.537 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:17.539 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:17.539 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:17.539 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:18.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:18.541 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:18.566 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:18.568 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:18.568 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:18.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:19.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:19.569 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:19.595 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:19.595 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:19.595 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:20.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:20.597 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:20.622 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:20.623 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:20.623 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:20.624 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:21.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:21.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:21.646 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:21.648 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:21.648 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:21.648 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:22.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:22.650 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:22.675 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:22.677 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:22.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:22.677 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:23.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:23.679 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:23.704 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:23.706 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:23.706 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:23.706 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:24.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:24.709 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:24.735 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:24.736 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:24.736 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:24.736 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:25.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:25.737 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:25.763 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:25.764 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:25.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:25.764 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:26.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:26.766 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:26.790 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:26.792 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:26.792 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:26.792 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:27.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:27.793 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:27.817 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:27.818 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:27.818 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:27.818 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:28.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:28.819 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:28.843 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:28.844 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:28.844 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:28.844 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:29.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:29.845 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:29.870 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:29.871 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:29.871 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:29.872 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:30.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:30.872 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:30.895 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:30.897 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:30.897 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:30.897 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:31.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:31.899 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:31.923 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:31.924 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:31.924 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:31.924 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:32.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:32.925 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:32.950 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:32.951 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:32.952 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:32.952 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:33.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:33.953 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:33.974 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:33.976 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:33.976 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:33.976 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:34.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:34.977 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:35.002 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:35.004 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:35.004 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:35.004 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:36.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:36.005 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:36.026 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:36.027 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:36.027 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:36.027 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:37.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:37.028 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:37.052 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:37.054 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:37.054 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:37.054 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:38.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:38.055 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:38.083 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:38.085 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:38.085 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:38.085 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:39.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:39.086 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:39.107 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:39.109 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:39.109 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:39.109 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:40.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:40.111 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:40.132 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:40.134 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:40.134 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:40.134 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:41.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:41.135 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:41.159 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:41.161 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:41.161 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:41.161 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:42.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:42.162 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:42.186 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:42.188 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:42.188 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:42.188 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:43.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:43.188 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:43.213 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:43.213 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:43.213 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:44.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:44.214 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:44.240 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:44.242 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:44.242 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:44.242 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:45.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:09:45.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:09:45.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:45.243 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:45.278 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:45.279 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:45.279 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:45.279 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:46.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:46.280 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:46.301 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:46.303 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:46.304 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:46.304 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:47.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:47.304 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:47.327 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:47.329 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:47.329 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:47.329 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:48.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:48.330 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:48.351 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:48.352 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:48.353 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:48.353 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:49.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:49.354 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:49.376 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:49.377 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:49.377 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:49.378 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:50.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:50.378 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:50.403 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:50.406 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:50.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:50.406 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:51.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:51.407 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:51.432 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:51.433 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:51.434 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:51.434 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:52.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:52.435 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:52.458 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:52.460 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:52.460 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:52.460 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:53.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:53.461 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:53.486 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:53.487 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:53.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:53.487 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:54.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:54.488 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:54.514 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:54.514 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:54.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:54.515 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:55.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:55.515 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:55.540 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:55.541 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:55.542 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:55.542 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:56.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:56.542 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:56.567 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:56.568 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:56.568 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:56.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:57.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:57.569 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:57.593 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:57.595 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:57.595 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:57.595 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:58.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:58.596 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:58.619 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:58.621 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:58.621 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:58.621 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:09:59.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:09:59.625 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:09:59.649 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:09:59.650 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:09:59.650 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:09:59.650 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:10:00.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:00.651 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:10:00.677 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_09_00_UTC 2023-12-24T20:10:00.678 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:10:00.678 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-12-24T20:10:00.678 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-12-24T20:10:01.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:01.720 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:10:01.745 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_10_00_UTC 2023-12-24T20:10:01.747 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-12-24-20_10_00_UTC'} 2023-12-24T20:10:01.747 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-12-24-20_10_00_UTC'} 2023-12-24T20:10:01.747 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-12-24-20_09_00_UTC'} 2023-12-24T20:10:01.747 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-12-24-20_09_00_UTC'] 2023-12-24T20:10:01.747 DEBUG:tasks.cephfs.test_snap_schedules:exec=1703448539.5985234, now = 1703448601.7479374, timo = 61 2023-12-24T20:10:02.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-12-24T20:10:02.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 Processor -- start 2023-12-24T20:10:02.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 -- start start 2023-12-24T20:10:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 0x7f8a1006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a100b4700 0x7f8a100b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100b3390 con 0x7f8a1006a730 2023-12-24T20:10:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100b3660 con 0x7f8a100b4700 2023-12-24T20:10:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.927+0000 7f8a16a6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100b3940 con 0x7f8a101590c0 2023-12-24T20:10:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a100b4700 0x7f8a100b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a100b4700 0x7f8a100b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58294/0 (socket says 172.21.15.50:58294) 2023-12-24T20:10:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 -- 172.21.15.50:0/1712046420 learned_addr learned my addr 172.21.15.50:0/1712046420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a1480a700 1 --2- 172.21.15.50:0/1712046420 >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 0x7f8a1006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a077fe700 1 -- 172.21.15.50:0/1712046420 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283116895 0 0) 0x7f8a100b3390 con 0x7f8a1006a730 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a077fe700 1 -- 172.21.15.50:0/1712046420 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f8003570 con 0x7f8a1006a730 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 -- 172.21.15.50:0/1712046420 >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 msgr2=0x7f8a1006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 --2- 172.21.15.50:0/1712046420 >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 0x7f8a1006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 -- 172.21.15.50:0/1712046420 >> v1:172.21.15.82:6789/0 conn(0x7f8a1006a730 legacy=0x7f8a1015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 -- 172.21.15.50:0/1712046420 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100b3c20 con 0x7f8a100b4700 2023-12-24T20:10:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a1480a700 1 --2- 172.21.15.50:0/1712046420 >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 0x7f8a1006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a07fff700 1 --2- 172.21.15.50:0/1712046420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100b4700 0x7f8a100b2e50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006a1e0 tx=0x7f8a00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3734c7217728701c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a077fe700 1 -- 172.21.15.50:0/1712046420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000b640 con 0x7f8a100b4700 2023-12-24T20:10:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a077fe700 1 -- 172.21.15.50:0/1712046420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000b7a0 con 0x7f8a100b4700 2023-12-24T20:10:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a077fe700 1 -- 172.21.15.50:0/1712046420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000bb60 con 0x7f8a100b4700 2023-12-24T20:10:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 -- 172.21.15.50:0/1712046420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100b4700 msgr2=0x7f8a100b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/1712046420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100b4700 0x7f8a100b2e50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006a1e0 tx=0x7f8a00009250 comp rx=0 tx=0).stop 2023-12-24T20:10:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 -- 172.21.15.50:0/1712046420 shutdown_connections 2023-12-24T20:10:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/1712046420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a100b4700 0x7f8a100b2e50 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/1712046420 >> v2:172.21.15.82:3300/0 conn(0x7f8a101590c0 0x7f8a1006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.931+0000 7f8a16a6e700 1 -- 172.21.15.50:0/1712046420 >> 172.21.15.50:0/1712046420 conn(0x7f8a10067b40 msgr2=0x7f8a100b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- 172.21.15.50:0/1712046420 shutdown_connections 2023-12-24T20:10:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- 172.21.15.50:0/1712046420 wait complete. 2023-12-24T20:10:02.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 Processor -- start 2023-12-24T20:10:02.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- start start 2023-12-24T20:10:02.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1006a730 0x7f8a10148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 0x7f8a1014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10151bf0 con 0x7f8a101590c0 2023-12-24T20:10:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10151ed0 con 0x7f8a1006a730 2023-12-24T20:10:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.935+0000 7f8a16a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101521b0 con 0x7f8a100b4700 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58304/0 (socket says 172.21.15.50:58304) 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 -- 172.21.15.50:0/2791382489 learned_addr learned my addr 172.21.15.50:0/2791382489 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1480a700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1006a730 0x7f8a10148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a07fff700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 0x7f8a1014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 -- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 msgr2=0x7f8a1014fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 0x7f8a1014fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 -- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1006a730 msgr2=0x7f8a10148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1006a730 0x7f8a10148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 -- 172.21.15.50:0/2791382489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009a20 con 0x7f8a101590c0 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a07fff700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 0x7f8a1014fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a1500b700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c590 tx=0x7f8a08007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08016070 con 0x7f8a101590c0 2023-12-24T20:10:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08011590 con 0x7f8a101590c0 2023-12-24T20:10:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a000094f0 con 0x7f8a101590c0 2023-12-24T20:10:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08011970 con 0x7f8a101590c0 2023-12-24T20:10:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.939+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10152540 con 0x7f8a101590c0 2023-12-24T20:10:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.943+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10071060 con 0x7f8a101590c0 2023-12-24T20:10:02.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.943+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 111) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f8a08012420 con 0x7f8a101590c0 2023-12-24T20:10:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.943+0000 7f8a04ff9700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 0x7f89fc062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.943+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f8a0807cc00 con 0x7f8a101590c0 2023-12-24T20:10:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.943+0000 7f8a1480a700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 0x7f89fc062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.947+0000 7f8a1480a700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 0x7f89fc062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0099f0 tx=0x7f8a0c00b040 comp rx=0 tx=0).ready entity=mgr.8627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:02.951+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8a0804cad0 con 0x7f8a101590c0 2023-12-24T20:10:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.151+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a10152370 con 0x7f89fc0607e0 2023-12-24T20:10:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.243+0000 7f8a04ff9700 1 -- 172.21.15.50:0/2791382489 <== mgr.8627 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8a0c00f050 con 0x7f89fc0607e0 2023-12-24T20:10:03.244 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path snap_test_dir1 2023-12-24T20:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 msgr2=0x7f89fc062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 0x7f89fc062c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0099f0 tx=0x7f8a0c00b040 comp rx=0 tx=0).stop 2023-12-24T20:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 msgr2=0x7f8a10150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c590 tx=0x7f8a08007d80 comp rx=0 tx=0).stop 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 shutdown_connections 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89fc0607e0 0x7f89fc062c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a101590c0 0x7f8a10150100 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a100b4700 0x7f8a1014fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 --2- 172.21.15.50:0/2791382489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1006a730 0x7f8a10148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 >> 172.21.15.50:0/2791382489 conn(0x7f8a10067b40 msgr2=0x7f8a101531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 shutdown_connections 2023-12-24T20:10:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.247+0000 7f8a16a6e700 1 -- 172.21.15.50:0/2791382489 wait complete. 2023-12-24T20:10:03.272 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-12-24T20:10:03.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:03.273 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:10:03.296 INFO:teuthology.orchestra.run.smithi050.stdout:scheduled-2023-12-24-20_10_00_UTC 2023-12-24T20:10:03.297 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-12-24-20_10_00_UTC 2023-12-24T20:10:03.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:03.298 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-12-24-20_10_00_UTC) 2023-12-24T20:10:03.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:03.373 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T20:10:03.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T20:10:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.659+0000 7f77daaa5700 1 Processor -- start 2023-12-24T20:10:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.659+0000 7f77daaa5700 1 -- start start 2023-12-24T20:10:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d41404a0 0x7f77d415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415af50 0x7f77d40ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77d4140870 0x7f77d40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d415b990 con 0x7f77d41404a0 2023-12-24T20:10:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d406ccc0 con 0x7f77d4140870 2023-12-24T20:10:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77daaa5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415b3d0 con 0x7f77d415af50 2023-12-24T20:10:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d41404a0 0x7f77d415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d41404a0 0x7f77d415aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58308/0 (socket says 172.21.15.50:58308) 2023-12-24T20:10:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 -- 172.21.15.50:0/220180343 learned_addr learned my addr 172.21.15.50:0/220180343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d3fff700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415af50 0x7f77d40ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d9042700 1 --2- 172.21.15.50:0/220180343 >> v2:172.21.15.82:3300/0 conn(0x7f77d4140870 0x7f77d40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 -- 172.21.15.50:0/220180343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415af50 msgr2=0x7f77d40ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415af50 0x7f77d40ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 -- 172.21.15.50:0/220180343 >> v2:172.21.15.82:3300/0 conn(0x7f77d4140870 msgr2=0x7f77d40caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 --2- 172.21.15.50:0/220180343 >> v2:172.21.15.82:3300/0 conn(0x7f77d4140870 0x7f77d40caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 -- 172.21.15.50:0/220180343 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d415b6b0 con 0x7f77d41404a0 2023-12-24T20:10:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d8841700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415aa10 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f77d4069d90 tx=0x7f77c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9f6d41fb021fee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.663+0000 7f77d37fe700 1 -- 172.21.15.50:0/220180343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800b640 con 0x7f77d41404a0 2023-12-24T20:10:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77d37fe700 1 -- 172.21.15.50:0/220180343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c800b7a0 con 0x7f77d41404a0 2023-12-24T20:10:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77d37fe700 1 -- 172.21.15.50:0/220180343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800bb60 con 0x7f77d41404a0 2023-12-24T20:10:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 -- 172.21.15.50:0/220180343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 msgr2=0x7f77d415aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415aa10 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f77d4069d90 tx=0x7f77c8009250 comp rx=0 tx=0).stop 2023-12-24T20:10:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 -- 172.21.15.50:0/220180343 shutdown_connections 2023-12-24T20:10:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 --2- 172.21.15.50:0/220180343 >> v2:172.21.15.82:3300/0 conn(0x7f77d4140870 0x7f77d40caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415af50 0x7f77d40ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 --2- 172.21.15.50:0/220180343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415aa10 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 -- 172.21.15.50:0/220180343 >> 172.21.15.50:0/220180343 conn(0x7f77d4067b80 msgr2=0x7f77d40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 -- 172.21.15.50:0/220180343 shutdown_connections 2023-12-24T20:10:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 -- 172.21.15.50:0/220180343 wait complete. 2023-12-24T20:10:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.667+0000 7f77daaa5700 1 Processor -- start 2023-12-24T20:10:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 -- start start 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 0x7f77d413d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415cb20 0x7f77d40aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415dbc0 con 0x7f77d41404a0 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d413d830 con 0x7f77d4140870 2023-12-24T20:10:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415cfb0 con 0x7f77d415cb20 2023-12-24T20:10:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58312/0 (socket says 172.21.15.50:58312) 2023-12-24T20:10:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 -- 172.21.15.50:0/3226201816 learned_addr learned my addr 172.21.15.50:0/3226201816 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d3fff700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 0x7f77d413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d9042700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415cb20 0x7f77d40aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 -- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415cb20 msgr2=0x7f77d40aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415cb20 0x7f77d40aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 -- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 msgr2=0x7f77d413d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 0x7f77d413d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 -- 172.21.15.50:0/3226201816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80094f0 con 0x7f77d41404a0 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d3fff700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 0x7f77d413d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d8841700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f77d4069b20 tx=0x7f77c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8000d10 con 0x7f77d41404a0 2023-12-24T20:10:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c800bb20 con 0x7f77d41404a0 2023-12-24T20:10:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011670 con 0x7f77d41404a0 2023-12-24T20:10:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.671+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d415d290 con 0x7f77d41404a0 2023-12-24T20:10:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.675+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d415d850 con 0x7f77d41404a0 2023-12-24T20:10:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.675+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d40652e0 con 0x7f77d41404a0 2023-12-24T20:10:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.675+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 111) v1 ==== 80194+0+0 (secure 0 0 0) 0x7f77c80119e0 con 0x7f77d41404a0 2023-12-24T20:10:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.675+0000 7f77d0ff9700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 0x7f77b8062c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.679+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f77c807e770 con 0x7f77d41404a0 2023-12-24T20:10:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.679+0000 7f77d3fff700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 0x7f77b8062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.679+0000 7f77d3fff700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 0x7f77b8062c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77d4158e20 tx=0x7f77c0008040 comp rx=0 tx=0).ready entity=mgr.8627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.687+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77c804e640 con 0x7f77d41404a0 2023-12-24T20:10:03.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:03.907+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f77d406c950 con 0x7f77d41404a0 2023-12-24T20:10:04.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.103+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f77c804ea10 con 0x7f77d41404a0 2023-12-24T20:10:04.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.107+0000 7f77d0ff9700 1 -- 172.21.15.50:0/3226201816 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v112) v1 ==== 93+0+0 (secure 0 0 0) 0x7f77c802ec70 con 0x7f77d41404a0 2023-12-24T20:10:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 msgr2=0x7f77b8062c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 0x7f77b8062c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77d4158e20 tx=0x7f77c0008040 comp rx=0 tx=0).stop 2023-12-24T20:10:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 msgr2=0x7f77d415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f77d4069b20 tx=0x7f77c8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 shutdown_connections 2023-12-24T20:10:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f77b80607e0 0x7f77b8062c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d415cb20 0x7f77d40aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d4140870 0x7f77d413d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 --2- 172.21.15.50:0/3226201816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d41404a0 0x7f77d415e050 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 >> 172.21.15.50:0/3226201816 conn(0x7f77d4067b80 msgr2=0x7f77d40aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 shutdown_connections 2023-12-24T20:10:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.111+0000 7f77daaa5700 1 -- 172.21.15.50:0/3226201816 wait complete. 2023-12-24T20:10:04.131 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:10:04.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:04.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:04.212 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:10:04.212 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T20:10:04.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:04.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:04.279 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:10:04.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:04.280 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:10:04.292 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:04.287+0000 7f19112ef000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:04.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:04.321 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:04.319+0000 7fdba935f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.491+0000 7f3626745700 1 Processor -- start 2023-12-24T20:10:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.491+0000 7f3626745700 1 -- start start 2023-12-24T20:10:04.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 0x7f36200caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36200c6fd0 0x7f362015cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f3620159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36200c6ae0 con 0x7f36200c6fd0 2023-12-24T20:10:04.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362015d5c0 con 0x7f3620156b40 2023-12-24T20:10:04.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3626745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36200cb400 con 0x7f362015d140 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36200c6fd0 0x7f362015cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36200c6fd0 0x7f362015cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58334/0 (socket says 172.21.15.50:58334) 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 -- 172.21.15.50:0/1884647607 learned_addr learned my addr 172.21.15.50:0/1884647607 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f361ffff700 1 --2- 172.21.15.50:0/1884647607 >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 0x7f36200caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f3624ce2700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f3620159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 -- 172.21.15.50:0/1884647607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 msgr2=0x7f3620159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f3620159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 -- 172.21.15.50:0/1884647607 >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 msgr2=0x7f36200caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 --2- 172.21.15.50:0/1884647607 >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 0x7f36200caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.495+0000 7f36177fe700 1 -- 172.21.15.50:0/1884647607 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200c7800 con 0x7f36200c6fd0 2023-12-24T20:10:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f361ffff700 1 --2- 172.21.15.50:0/1884647607 >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 0x7f36200caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f36177fe700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f362015cc00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f362006aa30 tx=0x7f3608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd46342de30212c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f361f7fe700 1 -- 172.21.15.50:0/1884647607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800b860 con 0x7f36200c6fd0 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f361f7fe700 1 -- 172.21.15.50:0/1884647607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360800b9c0 con 0x7f36200c6fd0 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f361f7fe700 1 -- 172.21.15.50:0/1884647607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800bd60 con 0x7f36200c6fd0 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 -- 172.21.15.50:0/1884647607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 msgr2=0x7f362015cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f362015cc00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f362006aa30 tx=0x7f3608009250 comp rx=0 tx=0).stop 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 -- 172.21.15.50:0/1884647607 shutdown_connections 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f3620159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 --2- 172.21.15.50:0/1884647607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f362015cc00 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 --2- 172.21.15.50:0/1884647607 >> v2:172.21.15.82:3300/0 conn(0x7f3620156b40 0x7f36200caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 -- 172.21.15.50:0/1884647607 >> 172.21.15.50:0/1884647607 conn(0x7f36200c8e60 msgr2=0x7f36200c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 -- 172.21.15.50:0/1884647607 shutdown_connections 2023-12-24T20:10:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 -- 172.21.15.50:0/1884647607 wait complete. 2023-12-24T20:10:04.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.499+0000 7f3626745700 1 Processor -- start 2023-12-24T20:10:04.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 -- start start 2023-12-24T20:10:04.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3620156b40 0x7f3620142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f36200b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620155790 con 0x7f36200c6fd0 2023-12-24T20:10:04.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362015a4e0 con 0x7f3620156b40 2023-12-24T20:10:04.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3626745700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36200b03b0 con 0x7f362015d140 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58336/0 (socket says 172.21.15.50:58336) 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 -- 172.21.15.50:0/3721286042 learned_addr learned my addr 172.21.15.50:0/3721286042 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f3624ce2700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f36200b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f36177fe700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3620156b40 0x7f3620142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 msgr2=0x7f36200b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f36200b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3620156b40 msgr2=0x7f3620142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3620156b40 0x7f3620142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 -- 172.21.15.50:0/3721286042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080094f0 con 0x7f36200c6fd0 2023-12-24T20:10:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.503+0000 7f361ffff700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f361000e8d0 tx=0x7f3610008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610013410 con 0x7f36200c6fd0 2023-12-24T20:10:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3610013570 con 0x7f36200c6fd0 2023-12-24T20:10:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610013910 con 0x7f36200c6fd0 2023-12-24T20:10:04.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36200b0690 con 0x7f36200c6fd0 2023-12-24T20:10:04.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36200b0c50 con 0x7f36200c6fd0 2023-12-24T20:10:04.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36200cba50 con 0x7f36200c6fd0 2023-12-24T20:10:04.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.507+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f3610013d00 con 0x7f36200c6fd0 2023-12-24T20:10:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.511+0000 7f361cff9700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 0x7f3600062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.511+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f361007cd20 con 0x7f36200c6fd0 2023-12-24T20:10:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.511+0000 7f36177fe700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 msgr2=0x7f3600062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.511+0000 7f36177fe700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 0x7f3600062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:04.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.515+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36200cba50 con 0x7f36200c6fd0 2023-12-24T20:10:04.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.715+0000 7f36177fe700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 msgr2=0x7f3600062c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:04.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.715+0000 7f36177fe700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 0x7f3600062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.731+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36200cba50 con 0x7f36200c6fd0 2023-12-24T20:10:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.731+0000 7f361cff9700 1 -- 172.21.15.50:0/3721286042 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f361007c090 con 0x7f36200c6fd0 2023-12-24T20:10:04.734 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:04.735 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 msgr2=0x7f3600062c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 0x7f3600062c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 msgr2=0x7f36200c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f361000e8d0 tx=0x7f3610008040 comp rx=0 tx=0).stop 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 shutdown_connections 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36000607c0 0x7f3600062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f362015d140 0x7f36200b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3620156b40 0x7f3620142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 --2- 172.21.15.50:0/3721286042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36200c6fd0 0x7f36200c3f00 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 >> 172.21.15.50:0/3721286042 conn(0x7f36200c8e60 msgr2=0x7f362015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 shutdown_connections 2023-12-24T20:10:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.735+0000 7f3626745700 1 -- 172.21.15.50:0/3721286042 wait complete. 2023-12-24T20:10:04.739 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:10:04.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:04.851 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:04.847+0000 7f19112ef000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:04.913 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:04.911+0000 7fdba935f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:04.924 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:04.919+0000 7f19112ef000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:04.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 Processor -- start 2023-12-24T20:10:04.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 -- start start 2023-12-24T20:10:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8400ca770 0x7fa84015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 0x7fa84006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84006ca50 con 0x7fa8400ca3a0 2023-12-24T20:10:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400c6980 con 0x7fa8400ca770 2023-12-24T20:10:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa8472cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84015b410 con 0x7fa84015af90 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa844868700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8400ca770 0x7fa84015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.927+0000 7fa84586a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 0x7fa84006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8400ca770 0x7fa84015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:53890/0 (socket says 172.21.15.50:53890) 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa84586a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 0x7fa84006cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:41928/0 (socket says 172.21.15.50:41928) 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 -- 172.21.15.50:0/1939905819 learned_addr learned my addr 172.21.15.50:0/1939905819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa845069700 1 --1- 172.21.15.50:0/1939905819 >> v1:172.21.15.82:6789/0 conn(0x7fa8400ca3a0 0x7fa84006ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40370/0 (socket says 172.21.15.50:40370) 2023-12-24T20:10:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 -- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 msgr2=0x7fa84006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 --2- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 0x7fa84006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 -- 172.21.15.50:0/1939905819 >> v1:172.21.15.82:6789/0 conn(0x7fa8400ca3a0 legacy=0x7fa84006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 -- 172.21.15.50:0/1939905819 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84006b520 con 0x7fa8400ca770 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa844868700 1 --2- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8400ca770 0x7fa84015aa50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa8300099b0 tx=0x7fa830009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea152179fa40dd83 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa837fff700 1 -- 172.21.15.50:0/1939905819 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830009ea0 con 0x7fa8400ca770 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa837fff700 1 -- 172.21.15.50:0/1939905819 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000b860 con 0x7fa8400ca770 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa837fff700 1 -- 172.21.15.50:0/1939905819 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000bc20 con 0x7fa8400ca770 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 -- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8400ca770 msgr2=0x7fa84015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 --2- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8400ca770 0x7fa84015aa50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa8300099b0 tx=0x7fa830009250 comp rx=0 tx=0).stop 2023-12-24T20:10:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 -- 172.21.15.50:0/1939905819 shutdown_connections 2023-12-24T20:10:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 --2- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa84015af90 0x7fa84006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 --2- 172.21.15.50:0/1939905819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8400ca770 0x7fa84015aa50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 -- 172.21.15.50:0/1939905819 >> 172.21.15.50:0/1939905819 conn(0x7fa8400cbba0 msgr2=0x7fa8400cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 -- 172.21.15.50:0/1939905819 shutdown_connections 2023-12-24T20:10:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.931+0000 7fa8472cd700 1 -- 172.21.15.50:0/1939905819 wait complete. 2023-12-24T20:10:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.935+0000 7fa8472cd700 1 Processor -- start 2023-12-24T20:10:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.935+0000 7fa8472cd700 1 -- start start 2023-12-24T20:10:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 0x7fa8400c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84015af90 0x7fa840146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400c3190 con 0x7fa8400ca770 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400af720 con 0x7fa84015af90 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400aedf0 con 0x7fa8400ca3a0 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58338/0 (socket says 172.21.15.50:58338) 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 -- 172.21.15.50:0/2419567357 learned_addr learned my addr 172.21.15.50:0/2419567357 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa84586a700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84015af90 0x7fa840146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa845069700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 0x7fa8400c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 -- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 msgr2=0x7fa8400c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 0x7fa8400c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 -- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84015af90 msgr2=0x7fa840146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84015af90 0x7fa840146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 -- 172.21.15.50:0/2419567357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300094f0 con 0x7fa8400ca770 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa845069700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 0x7fa8400c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa844868700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b3c0 tx=0x7fa830017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83001f070 con 0x7fa8400ca770 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000bbe0 con 0x7fa8400ca770 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830011650 con 0x7fa8400ca770 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8400af0d0 con 0x7fa8400ca770 2023-12-24T20:10:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.939+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa840147290 con 0x7fa8400ca770 2023-12-24T20:10:04.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8400c5ad0 con 0x7fa8400ca770 2023-12-24T20:10:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fa830011a40 con 0x7fa8400ca770 2023-12-24T20:10:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa8357fa700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 0x7fa824062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fa83007e370 con 0x7fa8400ca770 2023-12-24T20:10:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa845069700 1 -- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 msgr2=0x7fa824062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.943+0000 7fa845069700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 0x7fa824062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:04.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:04.951+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa83004e300 con 0x7fa8400ca770 2023-12-24T20:10:05.000 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:04.999+0000 7fdba935f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:05.072 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.067+0000 7f19112ef000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:05.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.131+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8400652e0 con 0x7fa8400ca770 2023-12-24T20:10:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.131+0000 7fa8357fa700 1 -- 172.21.15.50:0/2419567357 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16685 (secure 0 0 0) 0x7fa830051920 con 0x7fa8400ca770 2023-12-24T20:10:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:05.135 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":196,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:05.098065+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":196,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1482161656":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6837/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6836/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3459245740":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/111496610":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3323397143":"2023-12-25T20:08:57.919617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 msgr2=0x7fa824062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 0x7fa824062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 msgr2=0x7fa8400c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b3c0 tx=0x7fa830017000 comp rx=0 tx=0).stop 2023-12-24T20:10:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 shutdown_connections 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa824060790 0x7fa824062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84015af90 0x7fa840146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8400ca770 0x7fa8400c2c50 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 --2- 172.21.15.50:0/2419567357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa8400ca3a0 0x7fa8400c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 >> 172.21.15.50:0/2419567357 conn(0x7fa8400cbba0 msgr2=0x7fa84006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 shutdown_connections 2023-12-24T20:10:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.135+0000 7fa8472cd700 1 -- 172.21.15.50:0/2419567357 wait complete. 2023-12-24T20:10:05.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:08:36.297704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:08:37.684193+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 196, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:10:05.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:10:05.173 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.171+0000 7fdba935f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 Processor -- start 2023-12-24T20:10:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 -- start start 2023-12-24T20:10:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66b4156ab0 0x7f66b4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 0x7f66b40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40c9170 con 0x7f66b40c87d0 2023-12-24T20:10:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b415b5a0 con 0x7f66b4156ab0 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b9123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b415a990 con 0x7f66b40adb50 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b8922700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66abfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 0x7f66b40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b8922700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58350/0 (socket says 172.21.15.50:58350) 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b8922700 1 -- 172.21.15.50:0/2777180316 learned_addr learned my addr 172.21.15.50:0/2777180316 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.343+0000 7f66b3fff700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.82:3300/0 conn(0x7f66b4156ab0 0x7f66b4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 -- 172.21.15.50:0/2777180316 >> v2:172.21.15.82:3300/0 conn(0x7f66b4156ab0 msgr2=0x7f66b4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.82:3300/0 conn(0x7f66b4156ab0 0x7f66b4156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 -- 172.21.15.50:0/2777180316 >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 msgr2=0x7f66b40c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 -- 172.21.15.50:0/2777180316 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b415ac70 con 0x7f66b40adb50 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b8922700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66abfff700 1 --2- 172.21.15.50:0/2777180316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 0x7f66b40adf80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cb810 tx=0x7f669c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fff340cb78540c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b37fe700 1 -- 172.21.15.50:0/2777180316 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011630 con 0x7f66b40adb50 2023-12-24T20:10:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b37fe700 1 -- 172.21.15.50:0/2777180316 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0117b0 con 0x7f66b40adb50 2023-12-24T20:10:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b37fe700 1 -- 172.21.15.50:0/2777180316 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011b70 con 0x7f66b40adb50 2023-12-24T20:10:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 -- 172.21.15.50:0/2777180316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 msgr2=0x7f66b40adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 --2- 172.21.15.50:0/2777180316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 0x7f66b40adf80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cb810 tx=0x7f669c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 -- 172.21.15.50:0/2777180316 shutdown_connections 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.50:3300/0 conn(0x7f66b40c87d0 0x7f66b40c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 --2- 172.21.15.50:0/2777180316 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b40adb50 0x7f66b40adf80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 --2- 172.21.15.50:0/2777180316 >> v2:172.21.15.82:3300/0 conn(0x7f66b4156ab0 0x7f66b4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 -- 172.21.15.50:0/2777180316 >> 172.21.15.50:0/2777180316 conn(0x7f66b4067250 msgr2=0x7f66b4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 -- 172.21.15.50:0/2777180316 shutdown_connections 2023-12-24T20:10:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.347+0000 7f66b9123700 1 -- 172.21.15.50:0/2777180316 wait complete. 2023-12-24T20:10:05.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 Processor -- start 2023-12-24T20:10:05.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 -- start start 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b40adb50 0x7f66b41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 0x7f66b40a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40a88e0 con 0x7f66b40c87d0 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40a8b30 con 0x7f66b40adb50 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b9123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40a8e10 con 0x7f66b4156ab0 2023-12-24T20:10:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b8922700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 0x7f66b40a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b8922700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:41960/0 (socket says 172.21.15.50:41960) 2023-12-24T20:10:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b8922700 1 -- 172.21.15.50:0/1999849003 learned_addr learned my addr 172.21.15.50:0/1999849003 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.351+0000 7f66b3fff700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b40adb50 0x7f66b41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 -- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b40adb50 msgr2=0x7f66b41573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b40adb50 0x7f66b41573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 -- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 msgr2=0x7f66b40a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 0x7f66b40a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 -- 172.21.15.50:0/1999849003 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009ae0 con 0x7f66b4156ab0 2023-12-24T20:10:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66abfff700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 0x7f66b40a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b8922700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009fd0 tx=0x7f66ac00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac018070 con 0x7f66b4156ab0 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac00f040 con 0x7f66b4156ab0 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c009420 con 0x7f66b4156ab0 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00cbd0 con 0x7f66b4156ab0 2023-12-24T20:10:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b40a93d0 con 0x7f66b4156ab0 2023-12-24T20:10:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.355+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b40a9620 con 0x7f66b4156ab0 2023-12-24T20:10:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.359+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f66ac003020 con 0x7f66b4156ab0 2023-12-24T20:10:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.359+0000 7f66b0ff9700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 0x7f6694062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.359+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f66ac07cff0 con 0x7f66b4156ab0 2023-12-24T20:10:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.359+0000 7f66b3fff700 1 -- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 msgr2=0x7f6694062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.359+0000 7f66b3fff700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 0x7f6694062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:05.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.367+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f66ac04bbe0 con 0x7f66b4156ab0 2023-12-24T20:10:05.379 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.375+0000 7f19112ef000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:05.448 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.443+0000 7f19112ef000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:05.479 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.475+0000 7fdba935f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.547+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66b404be40 con 0x7f66b4156ab0 2023-12-24T20:10:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.547+0000 7f66b0ff9700 1 -- 172.21.15.50:0/1999849003 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66ac04cd80 con 0x7f66b4156ab0 2023-12-24T20:10:05.551 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T20:10:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 msgr2=0x7f6694062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 0x7f6694062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 msgr2=0x7f66b40a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009fd0 tx=0x7f66ac00b040 comp rx=0 tx=0).stop 2023-12-24T20:10:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 shutdown_connections 2023-12-24T20:10:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6694060790 0x7f6694062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f66b4156ab0 0x7f66b40a9e30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66b40c87d0 0x7f66b40a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 --2- 172.21.15.50:0/1999849003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b40adb50 0x7f66b41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 >> 172.21.15.50:0/1999849003 conn(0x7f66b4067250 msgr2=0x7f66b4151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 shutdown_connections 2023-12-24T20:10:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.551+0000 7f66b9123700 1 -- 172.21.15.50:0/1999849003 wait complete. 2023-12-24T20:10:05.574 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.563+0000 7fdba935f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:05.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:10:05.663 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.659+0000 7f19112ef000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:05.748 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.743+0000 7f19112ef000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:05.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.795+0000 7f4fcd46b700 1 Processor -- start 2023-12-24T20:10:05.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.795+0000 7f4fcd46b700 1 -- start start 2023-12-24T20:10:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fcd46b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fcd46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fcd46b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80c1bc0 con 0x7f4fc806da60 2023-12-24T20:10:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fcd46b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80688a0 con 0x7f4fc80c2df0 2023-12-24T20:10:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fcd46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81575a0 con 0x7f4fc8156be0 2023-12-24T20:10:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc7fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4fc806da60 0x7f4fc8068190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40372/0 (socket says 172.21.15.50:40372) 2023-12-24T20:10:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:41976/0 (socket says 172.21.15.50:41976) 2023-12-24T20:10:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58370/0 (socket says 172.21.15.50:58370) 2023-12-24T20:10:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc7fff700 1 -- 172.21.15.50:0/453462227 learned_addr learned my addr 172.21.15.50:0/453462227 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 -- 172.21.15.50:0/453462227 >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 msgr2=0x7f4fc806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 --2- 172.21.15.50:0/453462227 >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 -- 172.21.15.50:0/453462227 >> v1:172.21.15.82:6789/0 conn(0x7f4fc806da60 legacy=0x7f4fc8068190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 -- 172.21.15.50:0/453462227 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80c0fb0 con 0x7f4fc8156be0 2023-12-24T20:10:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc6ffd700 1 -- 172.21.15.50:0/453462227 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056235520 0 0) 0x7f4fc80c1bc0 con 0x7f4fc806da60 2023-12-24T20:10:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc77fe700 1 --2- 172.21.15.50:0/453462227 >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fccc6a700 1 --2- 172.21.15.50:0/453462227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009e60 tx=0x7f4fc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55fccbe9376ccccc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc6ffd700 1 -- 172.21.15.50:0/453462227 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000e070 con 0x7f4fc8156be0 2023-12-24T20:10:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc6ffd700 1 -- 172.21.15.50:0/453462227 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000bb60 con 0x7f4fc8156be0 2023-12-24T20:10:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.799+0000 7f4fc6ffd700 1 -- 172.21.15.50:0/453462227 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0012430 con 0x7f4fc8156be0 2023-12-24T20:10:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- 172.21.15.50:0/453462227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 msgr2=0x7f4fc8157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/453462227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009e60 tx=0x7f4fc0009780 comp rx=0 tx=0).stop 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- 172.21.15.50:0/453462227 shutdown_connections 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/453462227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc8157060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/453462227 >> v2:172.21.15.50:3300/0 conn(0x7f4fc80c2df0 0x7f4fc806de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- 172.21.15.50:0/453462227 >> 172.21.15.50:0/453462227 conn(0x7f4fc806ae30 msgr2=0x7f4fc806b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- 172.21.15.50:0/453462227 shutdown_connections 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- 172.21.15.50:0/453462227 wait complete. 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 Processor -- start 2023-12-24T20:10:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.803+0000 7f4fcd46b700 1 -- start start 2023-12-24T20:10:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 0x7f4fc81542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.814 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.807+0000 7fdba935f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc80ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80aacf0 con 0x7f4fc80c2df0 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80a9c50 con 0x7f4fc806da60 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80a9f30 con 0x7f4fc8156be0 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58376/0 (socket says 172.21.15.50:58376) 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 -- 172.21.15.50:0/1292742995 learned_addr learned my addr 172.21.15.50:0/1292742995 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc7fff700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 0x7f4fc81542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fccc6a700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc80ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 -- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 msgr2=0x7f4fc80ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc80ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 -- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 msgr2=0x7f4fc81542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 0x7f4fc81542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 -- 172.21.15.50:0/1292742995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009420 con 0x7f4fc80c2df0 2023-12-24T20:10:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc7fff700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 0x7f4fc81542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fc77fe700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00ec80 tx=0x7f4fbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00c920 con 0x7f4fc80c2df0 2023-12-24T20:10:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00ca80 con 0x7f4fc80c2df0 2023-12-24T20:10:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0009a20 con 0x7f4fc80c2df0 2023-12-24T20:10:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00ce00 con 0x7f4fc80c2df0 2023-12-24T20:10:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.807+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc80aa4f0 con 0x7f4fc80c2df0 2023-12-24T20:10:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.811+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc804be40 con 0x7f4fc80c2df0 2023-12-24T20:10:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.811+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f4fbc013680 con 0x7f4fc80c2df0 2023-12-24T20:10:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.811+0000 7f4faffff700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 0x7f4fb4062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.811+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f4fbc07d3a0 con 0x7f4fc80c2df0 2023-12-24T20:10:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.811+0000 7f4fc7fff700 1 -- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 msgr2=0x7f4fb4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.815+0000 7f4fc7fff700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 0x7f4fb4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.819+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4fbc04d220 con 0x7f4fc80c2df0 2023-12-24T20:10:05.837 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:05.831+0000 7f19112ef000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:05.900 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.899+0000 7fdba935f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.987+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fc80c1290 con 0x7f4fc80c2df0 2023-12-24T20:10:05.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.987+0000 7f4faffff700 1 -- 172.21.15.50:0/1292742995 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v196) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fbc050840 con 0x7f4fc80c2df0 2023-12-24T20:10:05.990 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 msgr2=0x7f4fb4062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 0x7f4fb4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 msgr2=0x7f4fc8159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00ec80 tx=0x7f4fbc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 shutdown_connections 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4fb4060790 0x7f4fb4062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4fc8156be0 0x7f4fc80ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc80c2df0 0x7f4fc8159e00 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 --2- 172.21.15.50:0/1292742995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fc806da60 0x7f4fc81542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 >> 172.21.15.50:0/1292742995 conn(0x7f4fc806ae30 msgr2=0x7f4fc80abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 shutdown_connections 2023-12-24T20:10:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:05.991+0000 7f4fcd46b700 1 -- 172.21.15.50:0/1292742995 wait complete. 2023-12-24T20:10:05.999 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:05.999+0000 7fdba935f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:06.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:10:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 Processor -- start 2023-12-24T20:10:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 -- start start 2023-12-24T20:10:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f41404a0 0x7f25f415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25f415af50 0x7f25f40ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f406ccc0 con 0x7f25f4140870 2023-12-24T20:10:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f415b990 con 0x7f25f415af50 2023-12-24T20:10:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f982e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415b3d0 con 0x7f25f41404a0 2023-12-24T20:10:06.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25f415af50 0x7f25f40ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25f415af50 0x7f25f40ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2023-12-24T20:10:06.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.187+0000 7f25f27fc700 1 -- 172.21.15.50:0/4162483361 learned_addr learned my addr 172.21.15.50:0/4162483361 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f2ffd700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f41404a0 0x7f25f415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f27fc700 1 -- 172.21.15.50:0/4162483361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f41404a0 msgr2=0x7f25f415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f27fc700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f41404a0 0x7f25f415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f27fc700 1 -- 172.21.15.50:0/4162483361 >> v1:172.21.15.82:6789/0 conn(0x7f25f4140870 legacy=0x7f25f406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f27fc700 1 -- 172.21.15.50:0/4162483361 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f415b6b0 con 0x7f25f415af50 2023-12-24T20:10:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f27fc700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f415af50 0x7f25f40ca500 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f25e80099b0 tx=0x7f25e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37dc08bbbe411c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f1ffb700 1 -- 172.21.15.50:0/4162483361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800b860 con 0x7f25f415af50 2023-12-24T20:10:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f1ffb700 1 -- 172.21.15.50:0/4162483361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800b9c0 con 0x7f25f415af50 2023-12-24T20:10:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f1ffb700 1 -- 172.21.15.50:0/4162483361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800bd60 con 0x7f25f415af50 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 -- 172.21.15.50:0/4162483361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f415af50 msgr2=0x7f25f40ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f415af50 0x7f25f40ca500 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f25e80099b0 tx=0x7f25e8009250 comp rx=0 tx=0).stop 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 -- 172.21.15.50:0/4162483361 shutdown_connections 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f415af50 0x7f25f40ca500 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 --2- 172.21.15.50:0/4162483361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f41404a0 0x7f25f415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 -- 172.21.15.50:0/4162483361 >> 172.21.15.50:0/4162483361 conn(0x7f25f4067b80 msgr2=0x7f25f40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 -- 172.21.15.50:0/4162483361 shutdown_connections 2023-12-24T20:10:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.191+0000 7f25f982e700 1 -- 172.21.15.50:0/4162483361 wait complete. 2023-12-24T20:10:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 Processor -- start 2023-12-24T20:10:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 -- start start 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f4140870 0x7f25f4166e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25f41567c0 0x7f25f40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4167390 con 0x7f25f41404a0 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a71a0 con 0x7f25f41567c0 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f982e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a6580 con 0x7f25f4140870 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58400/0 (socket says 172.21.15.50:58400) 2023-12-24T20:10:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 -- 172.21.15.50:0/2356752756 learned_addr learned my addr 172.21.15.50:0/2356752756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f27fc700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f4140870 0x7f25f4166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f37fe700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25f41567c0 0x7f25f40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 -- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f4140870 msgr2=0x7f25f4166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f4140870 0x7f25f4166e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 -- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25f41567c0 msgr2=0x7f25f40aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25f41567c0 0x7f25f40aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 -- 172.21.15.50:0/2356752756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80094f0 con 0x7f25f41404a0 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.195+0000 7f25f2ffd700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d8c0 tx=0x7f25e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40125f0 con 0x7f25f41404a0 2023-12-24T20:10:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4012750 con 0x7f25f41404a0 2023-12-24T20:10:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f413ed20 con 0x7f25f41404a0 2023-12-24T20:10:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4012af0 con 0x7f25f41404a0 2023-12-24T20:10:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f40a67f0 con 0x7f25f41404a0 2023-12-24T20:10:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f40652e0 con 0x7f25f41404a0 2023-12-24T20:10:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.199+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f25e401e460 con 0x7f25f41404a0 2023-12-24T20:10:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.203+0000 7f25daffd700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 0x7f25e0062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.203+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f25e407d5a0 con 0x7f25f41404a0 2023-12-24T20:10:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.203+0000 7f25f27fc700 1 -- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 msgr2=0x7f25e0062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:06.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.203+0000 7f25f27fc700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 0x7f25e0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.211+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f25e404d420 con 0x7f25f41404a0 2023-12-24T20:10:06.248 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:06.243+0000 7f19112ef000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:06.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.399+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25f406c950 con 0x7f25f41404a0 2023-12-24T20:10:06.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.399+0000 7f25daffd700 1 -- 172.21.15.50:0/2356752756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v196) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25e4050a40 con 0x7f25f41404a0 2023-12-24T20:10:06.402 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T20:10:06.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 msgr2=0x7f25e0062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:06.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 0x7f25e0062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 msgr2=0x7f25f413e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d8c0 tx=0x7f25e4008040 comp rx=0 tx=0).stop 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 shutdown_connections 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25e0060790 0x7f25e0062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25f41567c0 0x7f25f40aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25f4140870 0x7f25f4166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 --2- 172.21.15.50:0/2356752756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25f41404a0 0x7f25f413e470 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 >> 172.21.15.50:0/2356752756 conn(0x7f25f4067b80 msgr2=0x7f25f415a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:06.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 shutdown_connections 2023-12-24T20:10:06.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.403+0000 7f25f982e700 1 -- 172.21.15.50:0/2356752756 wait complete. 2023-12-24T20:10:06.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:06.427 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:06.423+0000 7f19112ef000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:06.434 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:06.431+0000 7fdba935f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 Processor -- start 2023-12-24T20:10:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 -- start start 2023-12-24T20:10:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa47c15a2d0 0x7fa47c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c0b0460 con 0x7fa47c06c820 2023-12-24T20:10:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c06a5c0 con 0x7fa47c0ade60 2023-12-24T20:10:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa47b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c06d8c0 con 0x7fa47c15a2d0 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.587+0000 7fa471d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa47c06c820 0x7fa47c0ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49930/0 (socket says 172.21.15.50:49930) 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa471d9b700 1 -- 172.21.15.50:0/1902619612 learned_addr learned my addr 172.21.15.50:0/1902619612 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47a59c700 1 --2- 172.21.15.50:0/1902619612 >> v2:172.21.15.82:3300/0 conn(0x7fa47c15a2d0 0x7fa47c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa479d9b700 1 -- 172.21.15.50:0/1902619612 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256041947 0 0) 0x7fa47c0b0460 con 0x7fa47c06c820 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47a59c700 1 -- 172.21.15.50:0/1902619612 >> v1:172.21.15.82:6789/0 conn(0x7fa47c0ade60 legacy=0x7fa47c160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47a59c700 1 -- 172.21.15.50:0/1902619612 >> v1:172.21.15.50:6789/0 conn(0x7fa47c06c820 legacy=0x7fa47c0ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47a59c700 1 -- 172.21.15.50:0/1902619612 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c06ccb0 con 0x7fa47c15a2d0 2023-12-24T20:10:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47a59c700 1 --2- 172.21.15.50:0/1902619612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c0ae8b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0098e0 tx=0x7fa46c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91fafc25219632fa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa479d9b700 1 -- 172.21.15.50:0/1902619612 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c009e80 con 0x7fa47c15a2d0 2023-12-24T20:10:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa479d9b700 1 -- 172.21.15.50:0/1902619612 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00b860 con 0x7fa47c15a2d0 2023-12-24T20:10:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa479d9b700 1 -- 172.21.15.50:0/1902619612 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00bbe0 con 0x7fa47c15a2d0 2023-12-24T20:10:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 -- 172.21.15.50:0/1902619612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 msgr2=0x7fa47c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 --2- 172.21.15.50:0/1902619612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c0ae8b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0098e0 tx=0x7fa46c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 -- 172.21.15.50:0/1902619612 shutdown_connections 2023-12-24T20:10:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 --2- 172.21.15.50:0/1902619612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c0ae8b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 -- 172.21.15.50:0/1902619612 >> 172.21.15.50:0/1902619612 conn(0x7fa47c067b80 msgr2=0x7fa47c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 -- 172.21.15.50:0/1902619612 shutdown_connections 2023-12-24T20:10:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.591+0000 7fa47b59e700 1 -- 172.21.15.50:0/1902619612 wait complete. 2023-12-24T20:10:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.595+0000 7fa47b59e700 1 Processor -- start 2023-12-24T20:10:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.595+0000 7fa47b59e700 1 -- start start 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa47c0ade60 0x7fa47c0a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c155440 con 0x7fa47c06c820 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c156260 con 0x7fa47c15a2d0 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c153100 con 0x7fa47c0ade60 2023-12-24T20:10:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58416/0 (socket says 172.21.15.50:58416) 2023-12-24T20:10:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 -- 172.21.15.50:0/437616187 learned_addr learned my addr 172.21.15.50:0/437616187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa471d9b700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa47c0ade60 0x7fa47c0a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47ad9d700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa47c0ade60 msgr2=0x7fa47c0a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa47c0ade60 0x7fa47c0a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 msgr2=0x7fa47c15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 -- 172.21.15.50:0/437616187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009420 con 0x7fa47c06c820 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47a59c700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b3c0 tx=0x7fa46c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c01f070 con 0x7fa47c06c820 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c000c90 con 0x7fa47c06c820 2023-12-24T20:10:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c025420 con 0x7fa47c06c820 2023-12-24T20:10:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c155650 con 0x7fa47c06c820 2023-12-24T20:10:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.599+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c155c10 con 0x7fa47c06c820 2023-12-24T20:10:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c04be40 con 0x7fa47c06c820 2023-12-24T20:10:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fa46c023070 con 0x7fa47c06c820 2023-12-24T20:10:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa472ffd700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 0x7fa45c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7fa46c07e2e0 con 0x7fa47c06c820 2023-12-24T20:10:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa471d9b700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 msgr2=0x7fa45c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.603+0000 7fa471d9b700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 0x7fa45c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.611+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa46c04e1e0 con 0x7fa47c06c820 2023-12-24T20:10:06.617 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:06.615+0000 7fdba935f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.807+0000 7fa471d9b700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 msgr2=0x7fa45c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.807+0000 7fa471d9b700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 0x7fa45c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.819+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa47c06d550 con 0x7fa47c06c820 2023-12-24T20:10:06.822 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:06.819+0000 7f19112ef000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.819+0000 7fa472ffd700 1 -- 172.21.15.50:0/437616187 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fa46c051780 con 0x7fa47c06c820 2023-12-24T20:10:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:06.823 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 msgr2=0x7fa45c062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 0x7fa45c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 msgr2=0x7fa47c143410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b3c0 tx=0x7fa46c017000 comp rx=0 tx=0).stop 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 shutdown_connections 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa45c060790 0x7fa45c062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa47c15a2d0 0x7fa47c15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa47c0ade60 0x7fa47c0a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 --2- 172.21.15.50:0/437616187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47c06c820 0x7fa47c143410 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 >> 172.21.15.50:0/437616187 conn(0x7fa47c067b80 msgr2=0x7fa47c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 shutdown_connections 2023-12-24T20:10:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:06.823+0000 7fa47b59e700 1 -- 172.21.15.50:0/437616187 wait complete. 2023-12-24T20:10:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:10:06.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:07.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 Processor -- start 2023-12-24T20:10:07.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 -- start start 2023-12-24T20:10:07.016 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fdba935f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 0x7fcdac0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcdac06aca0 0x7fcdac06b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac06c820 con 0x7fcdac0c6d00 2023-12-24T20:10:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac06b960 con 0x7fcdac06aca0 2023-12-24T20:10:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdb0cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06bc40 con 0x7fcdac154b60 2023-12-24T20:10:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.015+0000 7fcdaa59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcdac0c6d00 0x7fcdac154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49944/0 (socket says 172.21.15.50:49944) 2023-12-24T20:10:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdaa59c700 1 -- 172.21.15.50:0/3067079926 learned_addr learned my addr 172.21.15.50:0/3067079926 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 --2- 172.21.15.50:0/3067079926 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 0x7fcdac0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdaad9d700 1 --2- 172.21.15.50:0/3067079926 >> v2:172.21.15.82:3300/0 conn(0x7fcdac06aca0 0x7fcdac06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda959a700 1 -- 172.21.15.50:0/3067079926 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769924257 0 0) 0x7fcdac06c820 con 0x7fcdac0c6d00 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda959a700 1 -- 172.21.15.50:0/3067079926 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003570 con 0x7fcdac0c6d00 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 -- 172.21.15.50:0/3067079926 >> v2:172.21.15.82:3300/0 conn(0x7fcdac06aca0 msgr2=0x7fcdac06b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 --2- 172.21.15.50:0/3067079926 >> v2:172.21.15.82:3300/0 conn(0x7fcdac06aca0 0x7fcdac06b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 -- 172.21.15.50:0/3067079926 >> v1:172.21.15.50:6789/0 conn(0x7fcdac0c6d00 legacy=0x7fcdac154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 -- 172.21.15.50:0/3067079926 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac06bf20 con 0x7fcdac154b60 2023-12-24T20:10:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda9d9b700 1 --2- 172.21.15.50:0/3067079926 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 0x7fcdac0c70d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098e0 tx=0x7fcda00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88399193d624e669 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda959a700 1 -- 172.21.15.50:0/3067079926 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011630 con 0x7fcdac154b60 2023-12-24T20:10:07.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda959a700 1 -- 172.21.15.50:0/3067079926 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0011790 con 0x7fcdac154b60 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcda959a700 1 -- 172.21.15.50:0/3067079926 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011b30 con 0x7fcdac154b60 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 -- 172.21.15.50:0/3067079926 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 msgr2=0x7fcdac0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/3067079926 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 0x7fcdac0c70d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098e0 tx=0x7fcda00091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 -- 172.21.15.50:0/3067079926 shutdown_connections 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/3067079926 >> v2:172.21.15.82:3300/0 conn(0x7fcdac06aca0 0x7fcdac06b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/3067079926 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac154b60 0x7fcdac0c70d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 -- 172.21.15.50:0/3067079926 >> 172.21.15.50:0/3067079926 conn(0x7fcdac0cbba0 msgr2=0x7fcdac0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 -- 172.21.15.50:0/3067079926 shutdown_connections 2023-12-24T20:10:07.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.019+0000 7fcdb0cae700 1 -- 172.21.15.50:0/3067079926 wait complete. 2023-12-24T20:10:07.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.023+0000 7fcdb0cae700 1 Processor -- start 2023-12-24T20:10:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.023+0000 7fcdb0cae700 1 -- start start 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 0x7fcdac153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 0x7fcdac159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac158d00 con 0x7fcdac154b60 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0a9c50 con 0x7fcdac0c6d00 2023-12-24T20:10:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac158f30 con 0x7fcdac06aca0 2023-12-24T20:10:07.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaa59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 0x7fcdac153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcda9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 0x7fcdac159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58428/0 (socket says 172.21.15.50:58428) 2023-12-24T20:10:07.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaa59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 0x7fcdac153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:42016/0 (socket says 172.21.15.50:42016) 2023-12-24T20:10:07.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 -- 172.21.15.50:0/569320788 learned_addr learned my addr 172.21.15.50:0/569320788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 -- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 msgr2=0x7fcdac153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 0x7fcdac153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 -- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 msgr2=0x7fcdac159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 0x7fcdac159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 -- 172.21.15.50:0/569320788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009420 con 0x7fcdac154b60 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcda9d9b700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 0x7fcdac159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdaad9d700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009e90 tx=0x7fcda400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cb70 con 0x7fcdac154b60 2023-12-24T20:10:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400f040 con 0x7fcdac154b60 2023-12-24T20:10:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4014480 con 0x7fcdac154b60 2023-12-24T20:10:07.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac159210 con 0x7fcdac154b60 2023-12-24T20:10:07.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.027+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac159850 con 0x7fcdac154b60 2023-12-24T20:10:07.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.031+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0cb7e0 con 0x7fcdac154b60 2023-12-24T20:10:07.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.031+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fcda4014830 con 0x7fcdac154b60 2023-12-24T20:10:07.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.035+0000 7fcd9a7fc700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 0x7fcd8c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.035+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7fcda407da80 con 0x7fcdac154b60 2023-12-24T20:10:07.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.035+0000 7fcdaa59c700 1 -- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 msgr2=0x7fcd8c062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:07.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.035+0000 7fcdaa59c700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 0x7fcd8c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.039+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcdac0cb7e0 con 0x7fcdac154b60 2023-12-24T20:10:07.050 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.047+0000 7f19112ef000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:07.143 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.139+0000 7f19112ef000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:07.216 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.211+0000 7f19112ef000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.227+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdac0cb7e0 con 0x7fcdac154b60 2023-12-24T20:10:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.227+0000 7fcd9a7fc700 1 -- 172.21.15.50:0/569320788 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16685 (secure 0 0 0) 0x7fcda4075e60 con 0x7fcdac154b60 2023-12-24T20:10:07.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":196,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:05.098065+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":196,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1482161656":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6837/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6836/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3459245740":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/111496610":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3323397143":"2023-12-25T20:08:57.919617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 msgr2=0x7fcd8c062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 0x7fcd8c062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 msgr2=0x7fcdac0a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009e90 tx=0x7fcda400b040 comp rx=0 tx=0).stop 2023-12-24T20:10:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 shutdown_connections 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd8c060790 0x7fcd8c062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac154b60 0x7fcdac0a9200 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdac0c6d00 0x7fcdac159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 --2- 172.21.15.50:0/569320788 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcdac06aca0 0x7fcdac153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 >> 172.21.15.50:0/569320788 conn(0x7fcdac0cbba0 msgr2=0x7fcdac0c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 shutdown_connections 2023-12-24T20:10:07.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.231+0000 7fcdb0cae700 1 -- 172.21.15.50:0/569320788 wait complete. 2023-12-24T20:10:07.252 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:10:07.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:07.271 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.271+0000 7fdba935f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:07.293 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.287+0000 7f19112ef000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:07.373 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.371+0000 7fdba935f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 Processor -- start 2023-12-24T20:10:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 -- start start 2023-12-24T20:10:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa6d006ae10 0x7fa6d015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6d006b260 0x7fa6d015af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d00c6980 con 0x7fa6d006b260 2023-12-24T20:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d006ca50 con 0x7fa6d006ae10 2023-12-24T20:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d7a65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d006b7f0 con 0x7fa6d00ca3a0 2023-12-24T20:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d5000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa6d006ae10 0x7fa6d015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d5000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa6d006ae10 0x7fa6d015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:53990/0 (socket says 172.21.15.50:53990) 2023-12-24T20:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d5000700 1 -- 172.21.15.50:0/1441215939 learned_addr learned my addr 172.21.15.50:0/1441215939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d5801700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.419+0000 7fa6d6002700 1 --2- 172.21.15.50:0/1441215939 >> v2:172.21.15.50:3300/0 conn(0x7fa6d006b260 0x7fa6d015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 -- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 msgr2=0x7fa6d00ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 -- 172.21.15.50:0/1441215939 >> v2:172.21.15.50:3300/0 conn(0x7fa6d006b260 msgr2=0x7fa6d015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 --2- 172.21.15.50:0/1441215939 >> v2:172.21.15.50:3300/0 conn(0x7fa6d006b260 0x7fa6d015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 -- 172.21.15.50:0/1441215939 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d006bad0 con 0x7fa6d006ae10 2023-12-24T20:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d5000700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d015aa50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0069bf0 tx=0x7fa6c0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c14421dbbb13799 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6c7fff700 1 -- 172.21.15.50:0/1441215939 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000b640 con 0x7fa6d006ae10 2023-12-24T20:10:07.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6c7fff700 1 -- 172.21.15.50:0/1441215939 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000b7a0 con 0x7fa6d006ae10 2023-12-24T20:10:07.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6c7fff700 1 -- 172.21.15.50:0/1441215939 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000bb40 con 0x7fa6d006ae10 2023-12-24T20:10:07.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 -- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 msgr2=0x7fa6d015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d015aa50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0069bf0 tx=0x7fa6c0009250 comp rx=0 tx=0).stop 2023-12-24T20:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 -- 172.21.15.50:0/1441215939 shutdown_connections 2023-12-24T20:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d015aa50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/1441215939 >> v2:172.21.15.50:3300/0 conn(0x7fa6d006b260 0x7fa6d015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/1441215939 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 -- 172.21.15.50:0/1441215939 >> 172.21.15.50:0/1441215939 conn(0x7fa6d00cbba0 msgr2=0x7fa6d00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:07.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 -- 172.21.15.50:0/1441215939 shutdown_connections 2023-12-24T20:10:07.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.423+0000 7fa6d7a65700 1 -- 172.21.15.50:0/1441215939 wait complete. 2023-12-24T20:10:07.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 Processor -- start 2023-12-24T20:10:07.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 -- start start 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00c4990 con 0x7fa6d006b260 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00c3cd0 con 0x7fa6d006ae10 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.427+0000 7fa6d7a65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00c30c0 con 0x7fa6d00ca3a0 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58452/0 (socket says 172.21.15.50:58452) 2023-12-24T20:10:07.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 -- 172.21.15.50:0/777899853 learned_addr learned my addr 172.21.15.50:0/777899853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:07.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5801700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d6002700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 msgr2=0x7fa6d00c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 msgr2=0x7fa6d014bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d014bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 -- 172.21.15.50:0/777899853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00094f0 con 0x7fa6d006b260 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5801700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d5000700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006fd0 tx=0x7fa6c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000b910 con 0x7fa6d006b260 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000ba70 con 0x7fa6d006b260 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d00c33a0 con 0x7fa6d006b260 2023-12-24T20:10:07.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011670 con 0x7fa6d006b260 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.431+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d00c3960 con 0x7fa6d006b260 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d00c3e40 con 0x7fa6d006b260 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fa6c0011a60 con 0x7fa6d006b260 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6c57fa700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 0x7fa6b4062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7fa6c007e590 con 0x7fa6d006b260 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6d5801700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 msgr2=0x7fa6b4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.435+0000 7fa6d5801700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 0x7fa6b4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.443+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa6c004e410 con 0x7fa6d006b260 2023-12-24T20:10:07.458 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.455+0000 7fdba935f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:07.514 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.511+0000 7f19112ef000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:07.545 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.543+0000 7fdba935f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:07.589 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.583+0000 7f19112ef000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.639+0000 7fa6d5801700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 msgr2=0x7fa6b4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.639+0000 7fa6d5801700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 0x7fa6b4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.651+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6d00652e0 con 0x7fa6d006b260 2023-12-24T20:10:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.651+0000 7fa6c57fa700 1 -- 172.21.15.50:0/777899853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fa6c0051a30 con 0x7fa6d006b260 2023-12-24T20:10:07.652 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:07.652 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:10:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 msgr2=0x7fa6b4062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 0x7fa6b4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 msgr2=0x7fa6d00c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006fd0 tx=0x7fa6c0017000 comp rx=0 tx=0).stop 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 shutdown_connections 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa6b4060790 0x7fa6b4062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6d00ca3a0 0x7fa6d00c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d006b260 0x7fa6d00c4c00 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 --2- 172.21.15.50:0/777899853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d006ae10 0x7fa6d014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 >> 172.21.15.50:0/777899853 conn(0x7fa6d00cbba0 msgr2=0x7fa6d0159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 shutdown_connections 2023-12-24T20:10:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.655+0000 7fa6d7a65700 1 -- 172.21.15.50:0/777899853 wait complete. 2023-12-24T20:10:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:10:07.673 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.667+0000 7f19112ef000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:07.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:07.793 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.791+0000 7fdba935f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:07.861 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.855+0000 7f19112ef000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.879+0000 7f370086b700 1 Processor -- start 2023-12-24T20:10:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 -- start start 2023-12-24T20:10:07.886 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.883+0000 7fdba935f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 0x7f36fc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36fc156690 0x7f36fc156b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc15a4d0 con 0x7f36fc0caf40 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc157050 con 0x7f36fc156690 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.883+0000 7f370086b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc159610 con 0x7f36fc0cb310 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36fc156690 0x7f36fc156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fb7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f36fc0caf40 0x7f36fc0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:40396/0 (socket says 172.21.15.50:40396) 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fb7fe700 1 -- 172.21.15.50:0/3665208067 learned_addr learned my addr 172.21.15.50:0/3665208067 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36faffd700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 0x7f36fc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 -- 172.21.15.50:0/3665208067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 msgr2=0x7f36fc06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 0x7f36fc06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 -- 172.21.15.50:0/3665208067 >> v1:172.21.15.82:6789/0 conn(0x7f36fc0caf40 legacy=0x7f36fc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fa7fc700 1 -- 172.21.15.50:0/3665208067 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884149246 0 0) 0x7f36fc15a4d0 con 0x7f36fc0caf40 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 -- 172.21.15.50:0/3665208067 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0cd2a0 con 0x7f36fc156690 2023-12-24T20:10:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36faffd700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 0x7f36fc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:07.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fbfff700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc156690 0x7f36fc156b10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009e60 tx=0x7f36f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9b279ce821293b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fa7fc700 1 -- 172.21.15.50:0/3665208067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400e070 con 0x7f36fc156690 2023-12-24T20:10:07.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fa7fc700 1 -- 172.21.15.50:0/3665208067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400bb60 con 0x7f36fc156690 2023-12-24T20:10:07.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f36fa7fc700 1 -- 172.21.15.50:0/3665208067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4012430 con 0x7f36fc156690 2023-12-24T20:10:07.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 -- 172.21.15.50:0/3665208067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc156690 msgr2=0x7f36fc156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc156690 0x7f36fc156b10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009e60 tx=0x7f36f4009780 comp rx=0 tx=0).stop 2023-12-24T20:10:07.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 -- 172.21.15.50:0/3665208067 shutdown_connections 2023-12-24T20:10:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc156690 0x7f36fc156b10 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 --2- 172.21.15.50:0/3665208067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc0cb310 0x7f36fc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 -- 172.21.15.50:0/3665208067 >> 172.21.15.50:0/3665208067 conn(0x7f36fc0670b0 msgr2=0x7f36fc0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 -- 172.21.15.50:0/3665208067 shutdown_connections 2023-12-24T20:10:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.887+0000 7f370086b700 1 -- 172.21.15.50:0/3665208067 wait complete. 2023-12-24T20:10:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 Processor -- start 2023-12-24T20:10:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 -- start start 2023-12-24T20:10:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 0x7f36fc0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc156690 0x7f36fc0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0c5460 con 0x7f36fc0caf40 2023-12-24T20:10:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0c5fe0 con 0x7f36fc0cb310 2023-12-24T20:10:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f370086b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc169e60 con 0x7f36fc156690 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36fb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 0x7f36fc0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 0x7f36fc0b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:54008/0 (socket says 172.21.15.50:54008) 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36fb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58464/0 (socket says 172.21.15.50:58464) 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36faffd700 1 -- 172.21.15.50:0/1150937895 learned_addr learned my addr 172.21.15.50:0/1150937895 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.891+0000 7f36fbfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc156690 0x7f36fc0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc156690 msgr2=0x7f36fc0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc156690 0x7f36fc0b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 msgr2=0x7f36fc0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 0x7f36fc0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 -- 172.21.15.50:0/1150937895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0009420 con 0x7f36fc0caf40 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36fb7fe700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c5d0 tx=0x7f36ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec005b30 con 0x7f36fc0caf40 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec005c90 con 0x7f36fc0caf40 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f4009a20 con 0x7f36fc0caf40 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec007300 con 0x7f36fc0caf40 2023-12-24T20:10:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc0c5990 con 0x7f36fc0caf40 2023-12-24T20:10:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.895+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc04be40 con 0x7f36fc0caf40 2023-12-24T20:10:07.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.899+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f36ec01b3b0 con 0x7f36fc0caf40 2023-12-24T20:10:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.899+0000 7f36e37fe700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 0x7f36e8062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.899+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f36ec07c480 con 0x7f36fc0caf40 2023-12-24T20:10:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.899+0000 7f36faffd700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 msgr2=0x7f36e8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.899+0000 7f36faffd700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 0x7f36e8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:07.907+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36ec04c2d0 con 0x7f36fc0caf40 2023-12-24T20:10:07.948 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:07.943+0000 7f19112ef000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:07.986 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:07.983+0000 7fdba935f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.103+0000 7f36faffd700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 msgr2=0x7f36e8062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.103+0000 7f36faffd700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 0x7f36e8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.123+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36fc06bca0 con 0x7f36fc0caf40 2023-12-24T20:10:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f36e37fe700 1 -- 172.21.15.50:0/1150937895 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f36ec04f8f0 con 0x7f36fc0caf40 2023-12-24T20:10:08.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:08.128 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:08:38.679694+0000","modified":"2023-12-24T20:08:42.263810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2617886579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2617886579},{"type":"v1","addr":"172.21.15.50:6835","nonce":2617886579}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:10:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 msgr2=0x7f36e8062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 0x7f36e8062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 msgr2=0x7f36fc169920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c5d0 tx=0x7f36ec007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 shutdown_connections 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f36e8060790 0x7f36e8062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36fc156690 0x7f36fc0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36fc0cb310 0x7f36fc0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 --2- 172.21.15.50:0/1150937895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36fc0caf40 0x7f36fc169920 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 >> 172.21.15.50:0/1150937895 conn(0x7f36fc0670b0 msgr2=0x7f36fc06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 shutdown_connections 2023-12-24T20:10:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.127+0000 7f370086b700 1 -- 172.21.15.50:0/1150937895 wait complete. 2023-12-24T20:10:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-12-24T20:10:08.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:08.226 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:08.223+0000 7fdba935f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 Processor -- start 2023-12-24T20:10:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 -- start start 2023-12-24T20:10:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09880680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880686e0 con 0x7f09880cc870 2023-12-24T20:10:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880689c0 con 0x7f0988158e70 2023-12-24T20:10:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f098df45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0988068ca0 con 0x7f09880c9f40 2023-12-24T20:10:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f0986ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f09880cc870 0x7f09880679b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49948/0 (socket says 172.21.15.50:49948) 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f0986ffd700 1 -- 172.21.15.50:0/228735 learned_addr learned my addr 172.21.15.50:0/228735 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f0987fff700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09880680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851559619 0 0) 0x7f09880686e0 con 0x7f09880cc870 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0970003570 con 0x7f09880cc870 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.307+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032481388 0 0) 0x7f09880689c0 con 0x7f0988158e70 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09880686e0 con 0x7f0988158e70 2023-12-24T20:10:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236069631 0 0) 0x7f0970003570 con 0x7f09880cc870 2023-12-24T20:10:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 msgr2=0x7f09880680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09880680c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 >> v1:172.21.15.82:6789/0 conn(0x7f0988158e70 legacy=0x7f09880cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988068f80 con 0x7f09880cc870 2023-12-24T20:10:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f097c001470 con 0x7f09880cc870 2023-12-24T20:10:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 >> v1:172.21.15.50:6789/0 conn(0x7f09880cc870 legacy=0x7f09880679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f0970004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0970004810 0x7f0970004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988068ca0 con 0x7f0970003c20 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097000bb40 con 0x7f0970004810 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097000bd00 con 0x7f09880c9f40 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f0970004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f0986ffd700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0970004810 0x7f0970004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f0987fff700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 -- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 msgr2=0x7f09700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09880c9f40 0x7f09700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 -- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0970004810 msgr2=0x7f0970004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0970004810 0x7f0970004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 -- 172.21.15.50:0/228735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970003570 con 0x7f0970003c20 2023-12-24T20:10:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f0986ffd700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0970004810 0x7f0970004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09877fe700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f0970004010 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0978001a10 tx=0x7f0978007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caffd6c398fe112 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800c5d0 con 0x7f0970003c20 2023-12-24T20:10:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800c730 con 0x7f0970003c20 2023-12-24T20:10:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f09867fc700 1 -- 172.21.15.50:0/228735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800cad0 con 0x7f0970003c20 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f098df45700 1 -- 172.21.15.50:0/228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 msgr2=0x7f0970004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f098df45700 1 --2- 172.21.15.50:0/228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f0970004010 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0978001a10 tx=0x7f0978007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f0987fff700 1 -- 172.21.15.50:0/228735 reap_dead start 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f098df45700 1 -- 172.21.15.50:0/228735 shutdown_connections 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.311+0000 7f098df45700 1 -- 172.21.15.50:0/228735 >> 172.21.15.50:0/228735 conn(0x7f09880cdd80 msgr2=0x7f09880ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.315+0000 7f098df45700 1 -- 172.21.15.50:0/228735 shutdown_connections 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.315+0000 7f098df45700 1 -- 172.21.15.50:0/228735 wait complete. 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.315+0000 7f098df45700 1 Processor -- start 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.315+0000 7f098df45700 1 -- start start 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 0x7f0988152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 0x7f098815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b1060 con 0x7f0970003c20 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098816a120 con 0x7f098815e6c0 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098815c720 con 0x7f098815bd90 2023-12-24T20:10:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58478/0 (socket says 172.21.15.50:58478) 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 -- 172.21.15.50:0/3691834364 learned_addr learned my addr 172.21.15.50:0/3691834364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f0986ffd700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 0x7f0988152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f0987fff700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 0x7f098815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 -- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 msgr2=0x7f098815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 0x7f098815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 -- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 msgr2=0x7f0988152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 0x7f0988152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 -- 172.21.15.50:0/3691834364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098816a5b0 con 0x7f0970003c20 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f0986ffd700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 0x7f0988152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f0987fff700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 0x7f098815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f09877fe700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f097000bb10 tx=0x7f0978015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978023070 con 0x7f0970003c20 2023-12-24T20:10:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978000fe0 con 0x7f0970003c20 2023-12-24T20:10:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0988169580 con 0x7f0970003c20 2023-12-24T20:10:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978006a70 con 0x7f0970003c20 2023-12-24T20:10:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.319+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09881697f0 con 0x7f0970003c20 2023-12-24T20:10:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.323+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880652e0 con 0x7f0970003c20 2023-12-24T20:10:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.323+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7f0978019070 con 0x7f0970003c20 2023-12-24T20:10:08.326 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:08.323+0000 7fdba935f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.323+0000 7f096f7fe700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 0x7f0974062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.327+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f097807e0b0 con 0x7f0970003c20 2023-12-24T20:10:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.327+0000 7f0986ffd700 1 -- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 msgr2=0x7f0974062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.327+0000 7f0986ffd700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 0x7f0974062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.331+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f097804df30 con 0x7f0970003c20 2023-12-24T20:10:08.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.507+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09880c8910 con 0x7f0970003c20 2023-12-24T20:10:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.507+0000 7f096f7fe700 1 -- 172.21.15.50:0/3691834364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16685 (secure 0 0 0) 0x7f0978017090 con 0x7f0970003c20 2023-12-24T20:10:08.510 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:08.510 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":196,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:05.098065+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:08:36.297704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-12-24T20:08:37.684193+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":196,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/1482161656":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6837/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:6836/60640":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3459245740":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/111496610":"2023-12-25T20:08:57.919617+0000","172.21.15.50:0/3323397143":"2023-12-25T20:08:57.919617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 msgr2=0x7f0974062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 0x7f0974062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 msgr2=0x7f09880b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f097000bb10 tx=0x7f0978015000 comp rx=0 tx=0).stop 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 shutdown_connections 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0974060790 0x7f0974062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f098815bd90 0x7f098815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f098815e6c0 0x7f0988152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 --2- 172.21.15.50:0/3691834364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0970003c20 0x7f09880b0b20 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 >> 172.21.15.50:0/3691834364 conn(0x7f09880cdd80 msgr2=0x7f09880c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 shutdown_connections 2023-12-24T20:10:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.511+0000 7f098df45700 1 -- 172.21.15.50:0/3691834364 wait complete. 2023-12-24T20:10:08.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:10:08.660 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:08.655+0000 7f19112ef000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:08.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 Processor -- start 2023-12-24T20:10:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 -- start start 2023-12-24T20:10:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff610158e10 0x7ff61015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61006d5c0 con 0x7ff6100b3c90 2023-12-24T20:10:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100b4400 con 0x7ff6100b1ba0 2023-12-24T20:10:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.703+0000 7ff6174cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100b49c0 con 0x7ff610158e10 2023-12-24T20:10:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff614a68700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6100b3c90 0x7ff61006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49956/0 (socket says 172.21.15.50:49956) 2023-12-24T20:10:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff614a68700 1 -- 172.21.15.50:0/1073281461 learned_addr learned my addr 172.21.15.50:0/1073281461 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff615269700 1 --2- 172.21.15.50:0/1073281461 >> v2:172.21.15.82:3300/0 conn(0x7ff610158e10 0x7ff61015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349832157 0 0) 0x7ff61006d5c0 con 0x7ff6100b3c90 2023-12-24T20:10:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5fc003570 con 0x7ff6100b3c90 2023-12-24T20:10:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614420080 0 0) 0x7ff6100b4400 con 0x7ff6100b1ba0 2023-12-24T20:10:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff61006d5c0 con 0x7ff6100b1ba0 2023-12-24T20:10:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff615269700 1 -- 172.21.15.50:0/1073281461 >> v1:172.21.15.82:6789/0 conn(0x7ff6100b1ba0 legacy=0x7ff6101591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff615269700 1 -- 172.21.15.50:0/1073281461 >> v1:172.21.15.50:6789/0 conn(0x7ff6100b3c90 legacy=0x7ff61006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958282628 0 0) 0x7ff5fc003570 con 0x7ff6100b3c90 2023-12-24T20:10:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff615269700 1 -- 172.21.15.50:0/1073281461 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100b46e0 con 0x7ff610158e10 2023-12-24T20:10:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff615269700 1 --2- 172.21.15.50:0/1073281461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff61015d6d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0098e0 tx=0x7ff60c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4ce9975fc4bc02 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600001470 con 0x7ff610158e10 2023-12-24T20:10:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c011420 con 0x7ff610158e10 2023-12-24T20:10:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.707+0000 7ff607fff700 1 -- 172.21.15.50:0/1073281461 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0117c0 con 0x7ff610158e10 2023-12-24T20:10:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- 172.21.15.50:0/1073281461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 msgr2=0x7ff61015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 --2- 172.21.15.50:0/1073281461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff61015d6d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0098e0 tx=0x7ff60c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- 172.21.15.50:0/1073281461 shutdown_connections 2023-12-24T20:10:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 --2- 172.21.15.50:0/1073281461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff61015d6d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- 172.21.15.50:0/1073281461 >> 172.21.15.50:0/1073281461 conn(0x7ff6100670b0 msgr2=0x7ff6100674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- 172.21.15.50:0/1073281461 shutdown_connections 2023-12-24T20:10:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- 172.21.15.50:0/1073281461 wait complete. 2023-12-24T20:10:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 Processor -- start 2023-12-24T20:10:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.711+0000 7ff6174cd700 1 -- start start 2023-12-24T20:10:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 0x7ff6100b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff6100aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100a9b30 con 0x7ff6100b1ba0 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610169d60 con 0x7ff610158e10 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff610169fd0 con 0x7ff6100b3c90 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58488/0 (socket says 172.21.15.50:58488) 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 -- 172.21.15.50:0/3363789354 learned_addr learned my addr 172.21.15.50:0/3363789354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff614a68700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 0x7ff6100b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615a6a700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff6100aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 msgr2=0x7ff6100b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 0x7ff6100b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 msgr2=0x7ff6100aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff6100aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 -- 172.21.15.50:0/3363789354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c009420 con 0x7ff6100b1ba0 2023-12-24T20:10:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff614a68700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 0x7ff6100b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff615269700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009ed0 tx=0x7ff60c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c01cc80 con 0x7ff6100b1ba0 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c01cde0 con 0x7ff6100b1ba0 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6100a9d80 con 0x7ff6100b1ba0 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c01a6a0 con 0x7ff6100b1ba0 2023-12-24T20:10:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.715+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6100b18d0 con 0x7ff6100b1ba0 2023-12-24T20:10:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.719+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6100aa260 con 0x7ff6100b1ba0 2023-12-24T20:10:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.719+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 112) v1 ==== 80177+0+0 (secure 0 0 0) 0x7ff60c01aa50 con 0x7ff6100b1ba0 2023-12-24T20:10:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.719+0000 7ff6057fa700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 0x7ff5f4062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.719+0000 7ff614a68700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 msgr2=0x7ff5f4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.719+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6787+0+0 (secure 0 0 0) 0x7ff60c07e8f0 con 0x7ff6100b1ba0 2023-12-24T20:10:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.723+0000 7ff614a68700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 0x7ff5f4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.727+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff60c04e770 con 0x7ff6100b1ba0 2023-12-24T20:10:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.927+0000 7ff614a68700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 msgr2=0x7ff5f4062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.927+0000 7ff614a68700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 0x7ff5f4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:08.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.943+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff6100a9920 con 0x7ff6100b1ba0 2023-12-24T20:10:08.947 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T20:10:08.947+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:10:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.955+0000 7ff6057fa700 1 -- 172.21.15.50:0/3363789354 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff60c051d90 con 0x7ff6100b1ba0 2023-12-24T20:10:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 msgr2=0x7ff5f4062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 0x7ff5f4062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 msgr2=0x7ff6100a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009ed0 tx=0x7ff60c016000 comp rx=0 tx=0).stop 2023-12-24T20:10:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 shutdown_connections 2023-12-24T20:10:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff5f4060790 0x7ff5f4062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff610158e10 0x7ff6100aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6100b3c90 0x7ff6100b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 --2- 172.21.15.50:0/3363789354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6100b1ba0 0x7ff6100a93e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 >> 172.21.15.50:0/3363789354 conn(0x7ff6100670b0 msgr2=0x7ff610157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 shutdown_connections 2023-12-24T20:10:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:08.959+0000 7ff6174cd700 1 -- 172.21.15.50:0/3363789354 wait complete. 2023-12-24T20:10:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:10:08.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:10:09.030 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T20:10:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 Processor -- start 2023-12-24T20:10:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 -- start start 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc080ad340 0x7fbc080cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080cbff0 0x7fbc0815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080cc450 con 0x7fbc080acf70 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080cd290 con 0x7fbc080ad340 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0ea65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080cc680 con 0x7fbc080cbff0 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc07fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc080ad340 0x7fbc080cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc07fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc080ad340 0x7fbc080cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:54068/0 (socket says 172.21.15.50:54068) 2023-12-24T20:10:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc07fff700 1 -- 172.21.15.50:0/379678576 learned_addr learned my addr 172.21.15.50:0/379678576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.155+0000 7fbc0d002700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080cbff0 0x7fbc0815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc07fff700 1 -- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080cbff0 msgr2=0x7fbc0815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc07fff700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080cbff0 0x7fbc0815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc07fff700 1 -- 172.21.15.50:0/379678576 >> v1:172.21.15.82:6789/0 conn(0x7fbc080acf70 legacy=0x7fbc080c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc07fff700 1 -- 172.21.15.50:0/379678576 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080cc960 con 0x7fbc080ad340 2023-12-24T20:10:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc07fff700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ad340 0x7fbc080cd720 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40099b0 tx=0x7fbbf4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b3059e4da117c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc077fe700 1 -- 172.21.15.50:0/379678576 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400b860 con 0x7fbc080ad340 2023-12-24T20:10:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc077fe700 1 -- 172.21.15.50:0/379678576 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400b9c0 con 0x7fbc080ad340 2023-12-24T20:10:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc077fe700 1 -- 172.21.15.50:0/379678576 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400bd60 con 0x7fbc080ad340 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 -- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ad340 msgr2=0x7fbc080cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ad340 0x7fbc080cd720 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40099b0 tx=0x7fbbf4009250 comp rx=0 tx=0).stop 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 -- 172.21.15.50:0/379678576 shutdown_connections 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080cbff0 0x7fbc0815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/379678576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ad340 0x7fbc080cd720 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 -- 172.21.15.50:0/379678576 >> 172.21.15.50:0/379678576 conn(0x7fbc080cddd0 msgr2=0x7fbc080ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 -- 172.21.15.50:0/379678576 shutdown_connections 2023-12-24T20:10:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.159+0000 7fbc0ea65700 1 -- 172.21.15.50:0/379678576 wait complete. 2023-12-24T20:10:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 Processor -- start 2023-12-24T20:10:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 -- start start 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080acf70 0x7fbc08157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080cbff0 0x7fbc08158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080b1380 con 0x7fbc080ad340 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08157d30 con 0x7fbc080cbff0 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc0ea65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08158010 con 0x7fbc080acf70 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.163+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58526/0 (socket says 172.21.15.50:58526) 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 -- 172.21.15.50:0/2561901161 learned_addr learned my addr 172.21.15.50:0/2561901161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc0d002700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080cbff0 0x7fbc08158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc0c801700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080acf70 0x7fbc08157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 -- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080acf70 msgr2=0x7fbc08157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080acf70 0x7fbc08157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 -- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080cbff0 msgr2=0x7fbc08158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080cbff0 0x7fbc08158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 -- 172.21.15.50:0/2561901161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40094f0 con 0x7fbc080ad340 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc07fff700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fbc0806b920 tx=0x7fbbf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4011e40 con 0x7fbc080ad340 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4024440 con 0x7fbc080ad340 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4024800 con 0x7fbc080ad340 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc080b15f0 con 0x7fbc080ad340 2023-12-24T20:10:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08157990 con 0x7fbc080ad340 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.167+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc080cb7e0 con 0x7fbc080ad340 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.171+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 113) v1 ==== 80177+0+0 (secure 0 0 0) 0x7fbbf401a420 con 0x7fbc080ad340 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.171+0000 7fbc04ff9700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 0x7fbbec062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.171+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6829+0+0 (secure 0 0 0) 0x7fbbf407ee30 con 0x7fbc080ad340 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.171+0000 7fbc0c801700 1 -- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 msgr2=0x7fbbec062c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.171+0000 7fbc0c801700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 0x7fbbec062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:09.175 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.175+0000 7fdba935f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.175+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc080cb7e0 con 0x7fbc080ad340 2023-12-24T20:10:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.191+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 114) v1 ==== 79672+0+0 (secure 0 0 0) 0x7fbbf404f060 con 0x7fbc080ad340 2023-12-24T20:10:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.191+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 msgr2=0x7fbbec062c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.191+0000 7fbc04ff9700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 0x7fbbec062c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.289 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb73f24700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb73f24700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb73f24700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb73f24700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb73f24700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb70f1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.290 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb70f1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.291 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb70f1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.291 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb70f1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.291 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:09.287+0000 7fdb70f1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.411+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc080cb7e0 con 0x7fbc080ad340 2023-12-24T20:10:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.959+0000 7fbc04ff9700 1 -- 172.21.15.50:0/2561901161 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc080cb7e0 con 0x7fbc080ad340 2023-12-24T20:10:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 msgr2=0x7fbc0814a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fbc0806b920 tx=0x7fbbf4017000 comp rx=0 tx=0).stop 2023-12-24T20:10:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 shutdown_connections 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbbec060790 0x7fbbec062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080cbff0 0x7fbc08158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc080ad340 0x7fbc0814a780 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 --2- 172.21.15.50:0/2561901161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc080acf70 0x7fbc08157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 >> 172.21.15.50:0/2561901161 conn(0x7fbc080cddd0 msgr2=0x7fbc080c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.963+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 shutdown_connections 2023-12-24T20:10:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:09.967+0000 7fbc0ea65700 1 -- 172.21.15.50:0/2561901161 wait complete. 2023-12-24T20:10:09.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:10:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.199+0000 7f4e2aa2e700 1 Processor -- start 2023-12-24T20:10:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.199+0000 7f4e2aa2e700 1 -- start start 2023-12-24T20:10:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e2aa2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e241547b0 0x7f4e240c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e2aa2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e24154b80 0x7f4e2406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e2aa2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240cc0d0 con 0x7f4e2415aa60 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e2aa2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240cc3b0 con 0x7f4e24154b80 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e2aa2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2406da10 con 0x7f4e241547b0 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e28fcb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e2415aa60 0x7f4e24157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55476/0 (socket says 172.21.15.50:55476) 2023-12-24T20:10:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e28fcb700 1 -- 172.21.15.50:0/857849475 learned_addr learned my addr 172.21.15.50:0/857849475 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e237fe700 1 --2- 172.21.15.50:0/857849475 >> v2:172.21.15.50:3300/0 conn(0x7f4e24154b80 0x7f4e2406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.203+0000 7f4e23fff700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e241547b0 0x7f4e240c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e237fe700 1 -- 172.21.15.50:0/857849475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e241547b0 msgr2=0x7f4e240c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e237fe700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e241547b0 0x7f4e240c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e237fe700 1 -- 172.21.15.50:0/857849475 >> v1:172.21.15.50:6789/0 conn(0x7f4e2415aa60 legacy=0x7f4e24157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e22ffd700 1 -- 172.21.15.50:0/857849475 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930636709 0 0) 0x7f4e240cc0d0 con 0x7f4e2415aa60 2023-12-24T20:10:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e237fe700 1 -- 172.21.15.50:0/857849475 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2406dcf0 con 0x7f4e24154b80 2023-12-24T20:10:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e237fe700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e24154b80 0x7f4e2406d1e0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098e0 tx=0x7f4e140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331f3bcfc2a7090 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e22ffd700 1 -- 172.21.15.50:0/857849475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14009e80 con 0x7f4e24154b80 2023-12-24T20:10:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e22ffd700 1 -- 172.21.15.50:0/857849475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1400b860 con 0x7f4e24154b80 2023-12-24T20:10:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.207+0000 7f4e22ffd700 1 -- 172.21.15.50:0/857849475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400bbe0 con 0x7f4e24154b80 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/857849475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e24154b80 msgr2=0x7f4e2406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e24154b80 0x7f4e2406d1e0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098e0 tx=0x7f4e140091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/857849475 shutdown_connections 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e24154b80 0x7f4e2406d1e0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/857849475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e241547b0 0x7f4e240c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/857849475 >> 172.21.15.50:0/857849475 conn(0x7f4e24069d90 msgr2=0x7f4e240cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/857849475 shutdown_connections 2023-12-24T20:10:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/857849475 wait complete. 2023-12-24T20:10:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.211+0000 7f4e2aa2e700 1 Processor -- start 2023-12-24T20:10:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- start start 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 0x7f4e2416d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 0x7f4e24152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240cae90 con 0x7f4e2415aa60 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240b28f0 con 0x7f4e241547b0 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2416d6f0 con 0x7f4e24154b80 2023-12-24T20:10:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 0x7f4e24152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:43392/0 (socket says 172.21.15.50:43392) 2023-12-24T20:10:10.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e23fff700 1 -- 172.21.15.50:0/3046384170 learned_addr learned my addr 172.21.15.50:0/3046384170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:10.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e237fe700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 0x7f4e2416d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 -- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 msgr2=0x7f4e2416d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 0x7f4e2416d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 -- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 msgr2=0x7f4e240b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 -- 172.21.15.50:0/3046384170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009420 con 0x7f4e2415aa60 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e237fe700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 0x7f4e2416d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e23fff700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e28fcb700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 0x7f4e24152b40 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c470 tx=0x7f4e0c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c005900 con 0x7f4e2415aa60 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c005a80 con 0x7f4e2415aa60 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c005e40 con 0x7f4e2415aa60 2023-12-24T20:10:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e240b13f0 con 0x7f4e2415aa60 2023-12-24T20:10:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.215+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e240b2b20 con 0x7f4e2415aa60 2023-12-24T20:10:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e24071060 con 0x7f4e2415aa60 2023-12-24T20:10:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 115) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f4e0c0072e0 con 0x7f4e2415aa60 2023-12-24T20:10:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e1bfff700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 0x7f4e04062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f4e0c07bd70 con 0x7f4e2415aa60 2023-12-24T20:10:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e23fff700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 0x7f4e04062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.219+0000 7f4e23fff700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 0x7f4e04062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007af0 tx=0x7f4e1c009920 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.223+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4e0c04bf80 con 0x7f4e2415aa60 2023-12-24T20:10:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:10.395+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e2406dfd0 con 0x7f4e2415aa60 2023-12-24T20:10:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.210+0000 7f4e1bfff700 1 -- 172.21.15.50:0/3046384170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v199) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e0c04f5a0 con 0x7f4e2415aa60 2023-12-24T20:10:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 msgr2=0x7f4e04062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 0x7f4e04062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007af0 tx=0x7f4e1c009920 comp rx=0 tx=0).stop 2023-12-24T20:10:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 msgr2=0x7f4e24152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 0x7f4e24152b40 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c470 tx=0x7f4e0c007ed0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 shutdown_connections 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4e040603a0 0x7f4e04062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2415aa60 0x7f4e24152b40 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4e24154b80 0x7f4e2416d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 --2- 172.21.15.50:0/3046384170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e241547b0 0x7f4e240b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 >> 172.21.15.50:0/3046384170 conn(0x7f4e24069d90 msgr2=0x7f4e240cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 shutdown_connections 2023-12-24T20:10:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.218+0000 7f4e2aa2e700 1 -- 172.21.15.50:0/3046384170 wait complete. 2023-12-24T20:10:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:10:11.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:10:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.414+0000 7faa45545700 1 Processor -- start 2023-12-24T20:10:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.414+0000 7faa45545700 1 -- start start 2023-12-24T20:10:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa45545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa4006db90 0x7faa4015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa45545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa45545700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4006b3e0 con 0x7faa4015d210 2023-12-24T20:10:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa45545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4006bf80 con 0x7faa4006c820 2023-12-24T20:10:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa45545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4006a7d0 con 0x7faa4006db90 2023-12-24T20:10:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa3f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa3f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58746/0 (socket says 172.21.15.50:58746) 2023-12-24T20:10:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa3f7fe700 1 -- 172.21.15.50:0/2793116669 learned_addr learned my addr 172.21.15.50:0/2793116669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.418+0000 7faa3e7fc700 1 --2- 172.21.15.50:0/2793116669 >> v2:172.21.15.82:3300/0 conn(0x7faa4006db90 0x7faa4015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3e7fc700 1 -- 172.21.15.50:0/2793116669 >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 msgr2=0x7faa400c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3e7fc700 1 --2- 172.21.15.50:0/2793116669 >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3e7fc700 1 -- 172.21.15.50:0/2793116669 >> v1:172.21.15.82:6789/0 conn(0x7faa4015d210 legacy=0x7faa4006b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3e7fc700 1 -- 172.21.15.50:0/2793116669 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4006aab0 con 0x7faa4006db90 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3f7fe700 1 --2- 172.21.15.50:0/2793116669 >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3e7fc700 1 --2- 172.21.15.50:0/2793116669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006db90 0x7faa4015d5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faa4006a140 tx=0x7faa340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2ac1775b5dc937 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3dffb700 1 -- 172.21.15.50:0/2793116669 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011630 con 0x7faa4006db90 2023-12-24T20:10:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3dffb700 1 -- 172.21.15.50:0/2793116669 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34011790 con 0x7faa4006db90 2023-12-24T20:10:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa3dffb700 1 -- 172.21.15.50:0/2793116669 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011b30 con 0x7faa4006db90 2023-12-24T20:10:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 -- 172.21.15.50:0/2793116669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006db90 msgr2=0x7faa4015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 --2- 172.21.15.50:0/2793116669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006db90 0x7faa4015d5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faa4006a140 tx=0x7faa340091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 -- 172.21.15.50:0/2793116669 shutdown_connections 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 --2- 172.21.15.50:0/2793116669 >> v2:172.21.15.50:3300/0 conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 --2- 172.21.15.50:0/2793116669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006db90 0x7faa4015d5e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 -- 172.21.15.50:0/2793116669 >> 172.21.15.50:0/2793116669 conn(0x7faa40067b80 msgr2=0x7faa400ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 -- 172.21.15.50:0/2793116669 shutdown_connections 2023-12-24T20:10:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.422+0000 7faa45545700 1 -- 172.21.15.50:0/2793116669 wait complete. 2023-12-24T20:10:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.426+0000 7faa45545700 1 Processor -- start 2023-12-24T20:10:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.426+0000 7faa45545700 1 -- start start 2023-12-24T20:10:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa4006db90 0x7faa4014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c98e0 con 0x7faa4015d210 2023-12-24T20:10:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4014f240 con 0x7faa4006c820 2023-12-24T20:10:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c8cd0 con 0x7faa4006db90 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58762/0 (socket says 172.21.15.50:58762) 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 -- 172.21.15.50:0/588374321 learned_addr learned my addr 172.21.15.50:0/588374321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3e7fc700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa4006db90 0x7faa4014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3effd700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 -- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa4006db90 msgr2=0x7faa4014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa4006db90 0x7faa4014fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 -- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006c820 msgr2=0x7faa400c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 -- 172.21.15.50:0/588374321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009ae0 con 0x7faa4015d210 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa3f7fe700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7faa38009fd0 tx=0x7faa3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38018070 con 0x7faa4015d210 2023-12-24T20:10:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800f040 con 0x7faa4015d210 2023-12-24T20:10:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800cd30 con 0x7faa4015d210 2023-12-24T20:10:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa34009420 con 0x7faa4015d210 2023-12-24T20:10:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.430+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400c9290 con 0x7faa4015d210 2023-12-24T20:10:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.434+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400c9a50 con 0x7faa4015d210 2023-12-24T20:10:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.434+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 115) v1 ==== 79799+0+0 (secure 0 0 0) 0x7faa38003020 con 0x7faa4015d210 2023-12-24T20:10:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.434+0000 7faa26ffd700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 0x7faa2c062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.434+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6735+0+0 (secure 0 0 0) 0x7faa3807cee0 con 0x7faa4015d210 2023-12-24T20:10:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.434+0000 7faa3effd700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 0x7faa2c062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.438+0000 7faa3effd700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 0x7faa2c062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa300037c0 tx=0x7faa30009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.442+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa3804d2b0 con 0x7faa4015d210 2023-12-24T20:10:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:11.614+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa4006ad90 con 0x7faa4015d210 2023-12-24T20:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.014+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7faa38080030 con 0x7faa4015d210 2023-12-24T20:10:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.222+0000 7faa26ffd700 1 -- 172.21.15.50:0/588374321 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v200) v1 ==== 169+0+0 (secure 0 0 0) 0x7faa38050ab0 con 0x7faa4015d210 2023-12-24T20:10:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.226+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 msgr2=0x7faa2c062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.226+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 0x7faa2c062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa300037c0 tx=0x7faa30009040 comp rx=0 tx=0).stop 2023-12-24T20:10:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.226+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 msgr2=0x7faa400aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.226+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7faa38009fd0 tx=0x7faa3800b040 comp rx=0 tx=0).stop 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 shutdown_connections 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faa2c0603a0 0x7faa2c062850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa4015d210 0x7faa400aca40 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faa4006db90 0x7faa4014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 --2- 172.21.15.50:0/588374321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa4006c820 0x7faa400c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 >> 172.21.15.50:0/588374321 conn(0x7faa40067b80 msgr2=0x7faa40162700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 shutdown_connections 2023-12-24T20:10:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.230+0000 7faa45545700 1 -- 172.21.15.50:0/588374321 wait complete. 2023-12-24T20:10:12.235 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T20:10:12.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T20:10:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.430+0000 7f81d986e700 1 Processor -- start 2023-12-24T20:10:12.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d986e700 1 -- start start 2023-12-24T20:10:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d986e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81d40cac10 0x7f81d406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d986e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d406ccc0 con 0x7f81d41404a0 2023-12-24T20:10:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d986e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d415b120 con 0x7f81d4140870 2023-12-24T20:10:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d986e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d415b990 con 0x7f81d40cac10 2023-12-24T20:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81d41404a0 0x7f81d415aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55486/0 (socket says 172.21.15.50:55486) 2023-12-24T20:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d2ffd700 1 -- 172.21.15.50:0/2856328173 learned_addr learned my addr 172.21.15.50:0/2856328173 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d37fe700 1 --2- 172.21.15.50:0/2856328173 >> v2:172.21.15.82:3300/0 conn(0x7f81d40cac10 0x7f81d406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.434+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292556627 0 0) 0x7f81d406ccc0 con 0x7f81d41404a0 2023-12-24T20:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003570 con 0x7f81d41404a0 2023-12-24T20:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505389254 0 0) 0x7f81d415b120 con 0x7f81d4140870 2023-12-24T20:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d406ccc0 con 0x7f81d4140870 2023-12-24T20:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d37fe700 1 -- 172.21.15.50:0/2856328173 >> v1:172.21.15.82:6789/0 conn(0x7f81d4140870 legacy=0x7f81d40ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d37fe700 1 -- 172.21.15.50:0/2856328173 >> v1:172.21.15.50:6789/0 conn(0x7f81d41404a0 legacy=0x7f81d415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7390779 0 0) 0x7f81c0003570 con 0x7f81d41404a0 2023-12-24T20:10:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d37fe700 1 -- 172.21.15.50:0/2856328173 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d415b3d0 con 0x7f81d40cac10 2023-12-24T20:10:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d37fe700 1 --2- 172.21.15.50:0/2856328173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d40cac10 0x7f81d406d150 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009e60 tx=0x7f81cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0359ab67dad3041 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00e070 con 0x7f81d40cac10 2023-12-24T20:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc00b7a0 con 0x7f81d40cac10 2023-12-24T20:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d27fc700 1 -- 172.21.15.50:0/2856328173 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4001470 con 0x7f81d40cac10 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 -- 172.21.15.50:0/2856328173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d40cac10 msgr2=0x7f81d406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 --2- 172.21.15.50:0/2856328173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d40cac10 0x7f81d406d150 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009e60 tx=0x7f81cc009780 comp rx=0 tx=0).stop 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 -- 172.21.15.50:0/2856328173 shutdown_connections 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 --2- 172.21.15.50:0/2856328173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d40cac10 0x7f81d406d150 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 -- 172.21.15.50:0/2856328173 >> 172.21.15.50:0/2856328173 conn(0x7f81d4067b80 msgr2=0x7f81d40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 -- 172.21.15.50:0/2856328173 shutdown_connections 2023-12-24T20:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.438+0000 7f81d986e700 1 -- 172.21.15.50:0/2856328173 wait complete. 2023-12-24T20:10:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 Processor -- start 2023-12-24T20:10:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 -- start start 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81d40cac10 0x7f81d40aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d41404a0 0x7f81d40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d416ad90 con 0x7f81d4140870 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40ab420 con 0x7f81d41404a0 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d986e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d416a180 con 0x7f81d40cac10 2023-12-24T20:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58766/0 (socket says 172.21.15.50:58766) 2023-12-24T20:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d37fe700 1 -- 172.21.15.50:0/1929218538 learned_addr learned my addr 172.21.15.50:0/1929218538 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81cbfff700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d41404a0 0x7f81d40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.442+0000 7f81d2ffd700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81d40cac10 0x7f81d40aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 -- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81d40cac10 msgr2=0x7f81d40aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81d40cac10 0x7f81d40aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 -- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d41404a0 msgr2=0x7f81d40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d41404a0 0x7f81d40cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 -- 172.21.15.50:0/1929218538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc009a20 con 0x7f81d4140870 2023-12-24T20:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d37fe700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f81d4069b20 tx=0x7f81cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc012b30 con 0x7f81d4140870 2023-12-24T20:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc012c90 con 0x7f81d4140870 2023-12-24T20:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d416a460 con 0x7f81d4140870 2023-12-24T20:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc01e660 con 0x7f81d4140870 2023-12-24T20:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d416aa20 con 0x7f81d4140870 2023-12-24T20:10:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.446+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d416af40 con 0x7f81d4140870 2023-12-24T20:10:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.450+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f81cc01e9d0 con 0x7f81d4140870 2023-12-24T20:10:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.450+0000 7f81caffd700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 0x7f81b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.450+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f81cc07eb40 con 0x7f81d4140870 2023-12-24T20:10:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.450+0000 7f81d2ffd700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 0x7f81b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.454+0000 7f81d2ffd700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 0x7f81b4062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81c40011e0 tx=0x7f81c4000bc0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.458+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f81cc04ee20 con 0x7f81d4140870 2023-12-24T20:10:12.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.634+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f81d40652e0 con 0x7f81d4140870 2023-12-24T20:10:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.642+0000 7f81caffd700 1 -- 172.21.15.50:0/1929218538 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v67) v1 ==== 115+0+0 (secure 0 0 0) 0x7f81cc07e0b0 con 0x7f81d4140870 2023-12-24T20:10:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 msgr2=0x7f81b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 0x7f81b4062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81c40011e0 tx=0x7f81c4000bc0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 msgr2=0x7f81d4156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f81d4069b20 tx=0x7f81cc017000 comp rx=0 tx=0).stop 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 shutdown_connections 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f81b4060550 0x7f81b4062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d4140870 0x7f81d4156270 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81d41404a0 0x7f81d40cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 --2- 172.21.15.50:0/1929218538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81d40cac10 0x7f81d40aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 >> 172.21.15.50:0/1929218538 conn(0x7f81d4067b80 msgr2=0x7f81d4159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 shutdown_connections 2023-12-24T20:10:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.646+0000 7f81d986e700 1 -- 172.21.15.50:0/1929218538 wait complete. 2023-12-24T20:10:12.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T20:10:12.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.842+0000 7f33e8e6e700 1 Processor -- start 2023-12-24T20:10:12.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.842+0000 7f33e8e6e700 1 -- start start 2023-12-24T20:10:12.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e8e6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33e406ae10 0x7f33e4164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e8e6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40cd680 con 0x7f33e40cf8a0 2023-12-24T20:10:12.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e8e6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e406d8f0 con 0x7f33e40cf4d0 2023-12-24T20:10:12.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e8e6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e4159640 con 0x7f33e406ae10 2023-12-24T20:10:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e1d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33e40cf8a0 0x7f33e406a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55498/0 (socket says 172.21.15.50:55498) 2023-12-24T20:10:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e1d9b700 1 -- 172.21.15.50:0/3042076870 learned_addr learned my addr 172.21.15.50:0/3042076870 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e2d9d700 1 --2- 172.21.15.50:0/3042076870 >> v2:172.21.15.50:3300/0 conn(0x7f33e406ae10 0x7f33e4164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952218958 0 0) 0x7f33e40cd680 con 0x7f33e40cf8a0 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc003570 con 0x7f33e40cf8a0 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985175697 0 0) 0x7f33e406d8f0 con 0x7f33e40cf4d0 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e2d9d700 1 -- 172.21.15.50:0/3042076870 >> v1:172.21.15.82:6789/0 conn(0x7f33e40cf4d0 legacy=0x7f33e406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e2d9d700 1 -- 172.21.15.50:0/3042076870 >> v1:172.21.15.50:6789/0 conn(0x7f33e40cf8a0 legacy=0x7f33e406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.846+0000 7f33e2d9d700 1 -- 172.21.15.50:0/3042076870 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40cca70 con 0x7f33e406ae10 2023-12-24T20:10:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e2d9d700 1 --2- 172.21.15.50:0/3042076870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e406ae10 0x7f33e4164010 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e60 tx=0x7f33dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0647f480a31f8a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00e070 con 0x7f33e406ae10 2023-12-24T20:10:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00b850 con 0x7f33e406ae10 2023-12-24T20:10:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e159a700 1 -- 172.21.15.50:0/3042076870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8001470 con 0x7f33e406ae10 2023-12-24T20:10:12.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 -- 172.21.15.50:0/3042076870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e406ae10 msgr2=0x7f33e4164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/3042076870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e406ae10 0x7f33e4164010 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e60 tx=0x7f33dc009780 comp rx=0 tx=0).stop 2023-12-24T20:10:12.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 -- 172.21.15.50:0/3042076870 shutdown_connections 2023-12-24T20:10:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/3042076870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e406ae10 0x7f33e4164010 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 -- 172.21.15.50:0/3042076870 >> 172.21.15.50:0/3042076870 conn(0x7f33e4067b30 msgr2=0x7f33e40cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 -- 172.21.15.50:0/3042076870 shutdown_connections 2023-12-24T20:10:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.850+0000 7f33e8e6e700 1 -- 172.21.15.50:0/3042076870 wait complete. 2023-12-24T20:10:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 Processor -- start 2023-12-24T20:10:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 -- start start 2023-12-24T20:10:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e406ae10 0x7f33e4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33e40cf4d0 0x7f33e4150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415cf60 con 0x7f33e40cf8a0 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415c350 con 0x7f33e406ae10 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e8e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415c630 con 0x7f33e40cf4d0 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58788/0 (socket says 172.21.15.50:58788) 2023-12-24T20:10:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e2d9d700 1 -- 172.21.15.50:0/4171175584 learned_addr learned my addr 172.21.15.50:0/4171175584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e1d9b700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33e40cf4d0 0x7f33e4150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.854+0000 7f33e259c700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e406ae10 0x7f33e4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 -- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33e40cf4d0 msgr2=0x7f33e4150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33e40cf4d0 0x7f33e4150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 -- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e406ae10 msgr2=0x7f33e4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e406ae10 0x7f33e4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 -- 172.21.15.50:0/4171175584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a20 con 0x7f33e40cf8a0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e2d9d700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b6c0 tx=0x7f33dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00bee0 con 0x7f33e40cf8a0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc007000 con 0x7f33e40cf8a0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e415c910 con 0x7f33e40cf8a0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc026650 con 0x7f33e40cf8a0 2023-12-24T20:10:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e41582f0 con 0x7f33e40cf8a0 2023-12-24T20:10:12.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.858+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e415d110 con 0x7f33e40cf8a0 2023-12-24T20:10:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.862+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f33dc019030 con 0x7f33e40cf8a0 2023-12-24T20:10:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.862+0000 7f33d27fc700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 0x7f33c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.862+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f33dc07e710 con 0x7f33e40cf8a0 2023-12-24T20:10:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.862+0000 7f33e259c700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 0x7f33c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.866+0000 7f33e259c700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 0x7f33c4062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4007d30 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:12.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:12.870+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f33dc04e9f0 con 0x7f33e40cf8a0 2023-12-24T20:10:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.042+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f33e40652e0 con 0x7f33e40cf8a0 2023-12-24T20:10:13.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.046+0000 7f33d27fc700 1 -- 172.21.15.50:0/4171175584 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7f33dc052010 con 0x7f33e40cf8a0 2023-12-24T20:10:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 msgr2=0x7f33c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 0x7f33c4062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 msgr2=0x7f33e4150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b6c0 tx=0x7f33dc017000 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 shutdown_connections 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f33c4060550 0x7f33c4062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33e40cf8a0 0x7f33e4150e40 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33e40cf4d0 0x7f33e4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 --2- 172.21.15.50:0/4171175584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e406ae10 0x7f33e4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 >> 172.21.15.50:0/4171175584 conn(0x7f33e4067b30 msgr2=0x7f33e4062d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 shutdown_connections 2023-12-24T20:10:13.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.050+0000 7f33e8e6e700 1 -- 172.21.15.50:0/4171175584 wait complete. 2023-12-24T20:10:13.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:10:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.234+0000 7f9e8b59e700 1 Processor -- start 2023-12-24T20:10:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.234+0000 7f9e8b59e700 1 -- start start 2023-12-24T20:10:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e8c1427c0 0x7f9e8c0693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0c7240 con 0x7f9e8c0c8340 2023-12-24T20:10:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0c7520 con 0x7f9e8c068ff0 2023-12-24T20:10:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c7800 con 0x7f9e8c1427c0 2023-12-24T20:10:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8a59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e8c068ff0 0x7f9e8c1420b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60284/0 (socket says 172.21.15.50:60284) 2023-12-24T20:10:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.238+0000 7f9e8a59c700 1 -- 172.21.15.50:0/2005470205 learned_addr learned my addr 172.21.15.50:0/2005470205 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259691921 0 0) 0x7f9e8c0c7520 con 0x7f9e8c068ff0 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e74003570 con 0x7f9e8c068ff0 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 660086658 0 0) 0x7f9e74003570 con 0x7f9e8c068ff0 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 >> v2:172.21.15.50:3300/0 conn(0x7f9e8c1427c0 msgr2=0x7f9e8c0693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 --2- 172.21.15.50:0/2005470205 >> v2:172.21.15.50:3300/0 conn(0x7f9e8c1427c0 0x7f9e8c0693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 >> v1:172.21.15.50:6789/0 conn(0x7f9e8c0c8340 legacy=0x7f9e8c0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0c7ae0 con 0x7f9e8c068ff0 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f9e7c001470 con 0x7f9e8c068ff0 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 >> v1:172.21.15.82:6789/0 conn(0x7f9e8c068ff0 legacy=0x7f9e8c1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e74003ae0 0x7f9e74003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e74004810 0x7f9e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 0x7f9e7400ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c7800 con 0x7f9e74003ae0 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7400c360 con 0x7f9e74004810 2023-12-24T20:10:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7400c520 con 0x7f9e740053c0 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.246+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 0x7f9e7400ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e89d9b700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e74004810 0x7f9e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e74004810 msgr2=0x7f9e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e74004810 0x7f9e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/2005470205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e74003ae0 msgr2=0x7f9e74003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e74003ae0 0x7f9e74003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/2005470205 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0c7ae0 con 0x7f9e740053c0 2023-12-24T20:10:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/2005470205 reap_dead start 2023-12-24T20:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 0x7f9e7400ba80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001ea0 tx=0x7f9e840014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6660ed263160b03e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84006b80 con 0x7f9e740053c0 2023-12-24T20:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84006d00 con 0x7f9e740053c0 2023-12-24T20:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.250+0000 7f9e8959a700 1 -- 172.21.15.50:0/2005470205 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400c8f0 con 0x7f9e740053c0 2023-12-24T20:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 -- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 msgr2=0x7f9e7400ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 0x7f9e7400ba80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001ea0 tx=0x7f9e840014d0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 -- 172.21.15.50:0/2005470205 shutdown_connections 2023-12-24T20:10:13.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/2005470205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e740053c0 0x7f9e7400ba80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 -- 172.21.15.50:0/2005470205 >> 172.21.15.50:0/2005470205 conn(0x7f9e8c0ccad0 msgr2=0x7f9e8c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.254+0000 7f9e8b59e700 1 -- 172.21.15.50:0/2005470205 shutdown_connections 2023-12-24T20:10:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.258+0000 7f9e8b59e700 1 -- 172.21.15.50:0/2005470205 wait complete. 2023-12-24T20:10:13.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.258+0000 7f9e8b59e700 1 Processor -- start 2023-12-24T20:10:13.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.266+0000 7f9e8b59e700 1 -- start start 2023-12-24T20:10:13.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e740053c0 0x7f9e8c175cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 0x7f9e8c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 0x7f9e8c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ad360 con 0x7f9e8c0ac3c0 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b1210 con 0x7f9e740053c0 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 0x7f9e8c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0acda0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 0x7f9e8c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58818/0 (socket says 172.21.15.50:58818) 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e89d9b700 1 -- 172.21.15.50:0/1815721305 learned_addr learned my addr 172.21.15.50:0/1815721305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8a59c700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e740053c0 0x7f9e8c175cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 0x7f9e8c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e740053c0 msgr2=0x7f9e8c175cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e740053c0 0x7f9e8c175cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 msgr2=0x7f9e8c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 0x7f9e8c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 -- 172.21.15.50:0/1815721305 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0ad080 con 0x7f9e8c0ac830 2023-12-24T20:10:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8ad9d700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 0x7f9e8c0cbeb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0af5f0 tx=0x7f9e84015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84006b80 con 0x7f9e8c0ac830 2023-12-24T20:10:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84006e70 con 0x7f9e8c0ac830 2023-12-24T20:10:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84012cf0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c0b0ea0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.270+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0af870 con 0x7f9e8c0ac830 2023-12-24T20:10:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.274+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c0b13a0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.274+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9e8401a040 con 0x7f9e8c0ac830 2023-12-24T20:10:13.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.278+0000 7f9e7a7fc700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 0x7f9e6c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.278+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f9e8407e340 con 0x7f9e8c0ac830 2023-12-24T20:10:13.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.278+0000 7f9e8a59c700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 0x7f9e6c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.278+0000 7f9e8a59c700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 0x7f9e6c062a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c001ed0 tx=0x7f9e7c001620 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.286+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9e8404e6a0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.458+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9e8c04be40 con 0x7f9e8c0ac830 2023-12-24T20:10:13.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.470+0000 7f9e7a7fc700 1 -- 172.21.15.50:0/1815721305 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9e84051cc0 con 0x7f9e8c0ac830 2023-12-24T20:10:13.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 msgr2=0x7f9e6c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 0x7f9e6c062a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c001ed0 tx=0x7f9e7c001620 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 msgr2=0x7f9e8c0cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 0x7f9e8c0cbeb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0af5f0 tx=0x7f9e84015000 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 shutdown_connections 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9e6c060580 0x7f9e6c062a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9e8c0ac830 0x7f9e8c0cbeb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0ac3c0 0x7f9e8c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 --2- 172.21.15.50:0/1815721305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e740053c0 0x7f9e8c175cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 >> 172.21.15.50:0/1815721305 conn(0x7f9e8c0ccad0 msgr2=0x7f9e8c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 shutdown_connections 2023-12-24T20:10:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.474+0000 7f9e8b59e700 1 -- 172.21.15.50:0/1815721305 wait complete. 2023-12-24T20:10:13.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-12-24T20:10:13.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.662+0000 7f2371163700 1 Processor -- start 2023-12-24T20:10:13.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.662+0000 7f2371163700 1 -- start start 2023-12-24T20:10:13.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2371163700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c0cb310 0x7f236c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2371163700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c15a4d0 con 0x7f236c0caf40 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2371163700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c159610 con 0x7f236c156690 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2371163700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0cd2a0 con 0x7f236c0cb310 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2363fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c0cb310 0x7f236c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2363fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236c0cb310 0x7f236c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58826/0 (socket says 172.21.15.50:58826) 2023-12-24T20:10:13.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.666+0000 7f2363fff700 1 -- 172.21.15.50:0/3811999972 learned_addr learned my addr 172.21.15.50:0/3811999972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2363fff700 1 -- 172.21.15.50:0/3811999972 >> v1:172.21.15.82:6789/0 conn(0x7f236c156690 legacy=0x7f236c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2363fff700 1 -- 172.21.15.50:0/3811999972 >> v1:172.21.15.50:6789/0 conn(0x7f236c0caf40 legacy=0x7f236c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2363fff700 1 -- 172.21.15.50:0/3811999972 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0cc8e0 con 0x7f236c0cb310 2023-12-24T20:10:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2363fff700 1 --2- 172.21.15.50:0/3811999972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0cb310 0x7f236c06cd30 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f23540099b0 tx=0x7f2354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b1d61d9dfa576c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f236b7fe700 1 -- 172.21.15.50:0/3811999972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400b860 con 0x7f236c0cb310 2023-12-24T20:10:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f236b7fe700 1 -- 172.21.15.50:0/3811999972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235400b9c0 con 0x7f236c0cb310 2023-12-24T20:10:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f236b7fe700 1 -- 172.21.15.50:0/3811999972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400bd60 con 0x7f236c0cb310 2023-12-24T20:10:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 -- 172.21.15.50:0/3811999972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0cb310 msgr2=0x7f236c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 --2- 172.21.15.50:0/3811999972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0cb310 0x7f236c06cd30 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f23540099b0 tx=0x7f2354009250 comp rx=0 tx=0).stop 2023-12-24T20:10:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 -- 172.21.15.50:0/3811999972 shutdown_connections 2023-12-24T20:10:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 --2- 172.21.15.50:0/3811999972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0cb310 0x7f236c06cd30 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 -- 172.21.15.50:0/3811999972 >> 172.21.15.50:0/3811999972 conn(0x7f236c0670b0 msgr2=0x7f236c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 -- 172.21.15.50:0/3811999972 shutdown_connections 2023-12-24T20:10:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.670+0000 7f2371163700 1 -- 172.21.15.50:0/3811999972 wait complete. 2023-12-24T20:10:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 Processor -- start 2023-12-24T20:10:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 -- start start 2023-12-24T20:10:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f236c0caf40 0x7f236c0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 0x7f236c0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b49c0 con 0x7f236c156690 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c16d3b0 con 0x7f236c0cb310 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2371163700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b3950 con 0x7f236c0caf40 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2370962700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 0x7f236c0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2363fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f236bfff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f236c0caf40 0x7f236c0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2363fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:43456/0 (socket says 172.21.15.50:43456) 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.674+0000 7f2363fff700 1 -- 172.21.15.50:0/1586687829 learned_addr learned my addr 172.21.15.50:0/1586687829 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 -- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f236c0caf40 msgr2=0x7f236c0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f236c0caf40 0x7f236c0b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 -- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 msgr2=0x7f236c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 -- 172.21.15.50:0/1586687829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540094f0 con 0x7f236c156690 2023-12-24T20:10:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2363fff700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2370962700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 0x7f236c0b32b0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f236400c790 tx=0x7f23640015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364012630 con 0x7f236c156690 2023-12-24T20:10:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23640127b0 con 0x7f236c156690 2023-12-24T20:10:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c16cd60 con 0x7f236c156690 2023-12-24T20:10:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364012b70 con 0x7f236c156690 2023-12-24T20:10:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c0b18c0 con 0x7f236c156690 2023-12-24T20:10:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.678+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c16cbc0 con 0x7f236c156690 2023-12-24T20:10:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.682+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2364003030 con 0x7f236c156690 2023-12-24T20:10:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.682+0000 7f2368ff9700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.682+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f236407c8d0 con 0x7f236c156690 2023-12-24T20:10:13.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.682+0000 7f236bfff700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:13.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.682+0000 7f236bfff700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 0x7f234c062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f235c003a80 tx=0x7f235c007ec0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.690+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f236c16cbc0 con 0x7f236c156690 2023-12-24T20:10:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:13.926+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f236c16cbc0 con 0x7f236c156690 2023-12-24T20:10:14.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.230+0000 7f2368ff9700 1 -- 172.21.15.50:0/1586687829 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3040) v1 ==== 163+0+0 (secure 0 0 0) 0x7f236c16cbc0 con 0x7f236c156690 2023-12-24T20:10:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 msgr2=0x7f234c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 0x7f234c062a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f235c003a80 tx=0x7f235c007ec0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 msgr2=0x7f236c0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 0x7f236c0b32b0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f236400c790 tx=0x7f23640015f0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 shutdown_connections 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c156690 0x7f236c0b32b0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f236c0cb310 0x7f236c0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 --2- 172.21.15.50:0/1586687829 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f236c0caf40 0x7f236c0b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.234+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 >> 172.21.15.50:0/1586687829 conn(0x7f236c0670b0 msgr2=0x7f236c15b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.238+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 shutdown_connections 2023-12-24T20:10:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.238+0000 7f2371163700 1 -- 172.21.15.50:0/1586687829 wait complete. 2023-12-24T20:10:14.263 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-12-24T20:10:14.263 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-12-24T20:10:14.263 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-12-24T20:10:14.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-12-24T20:10:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.434+0000 7fd19dc2e700 1 Processor -- start 2023-12-24T20:10:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.434+0000 7fd19dc2e700 1 -- start start 2023-12-24T20:10:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1980ca3a0 0x7fd1980ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19806ca50 con 0x7fd19815b160 2023-12-24T20:10:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19806b7f0 con 0x7fd19806ae10 2023-12-24T20:10:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980c6980 con 0x7fd1980ca3a0 2023-12-24T20:10:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1980ca3a0 0x7fd1980ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd196ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd19806ae10 0x7fd19815aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60304/0 (socket says 172.21.15.50:60304) 2023-12-24T20:10:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd196ffd700 1 -- 172.21.15.50:0/3011723657 learned_addr learned my addr 172.21.15.50:0/3011723657 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd197fff700 1 --1- 172.21.15.50:0/3011723657 >> v1:172.21.15.50:6789/0 conn(0x7fd19815b160 0x7fd19806cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55528/0 (socket says 172.21.15.50:55528) 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1977fe700 1 -- 172.21.15.50:0/3011723657 >> v1:172.21.15.82:6789/0 conn(0x7fd19806ae10 legacy=0x7fd19815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1977fe700 1 -- 172.21.15.50:0/3011723657 >> v1:172.21.15.50:6789/0 conn(0x7fd19815b160 legacy=0x7fd19806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1977fe700 1 -- 172.21.15.50:0/3011723657 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19806bad0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1967fc700 1 -- 172.21.15.50:0/3011723657 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327699185 0 0) 0x7fd19806b7f0 con 0x7fd19806ae10 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1977fe700 1 --2- 172.21.15.50:0/3011723657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd1980ca770 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fd1880098e0 tx=0x7fd1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcce03287f34a04 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1967fc700 1 -- 172.21.15.50:0/3011723657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188009e80 con 0x7fd1980ca3a0 2023-12-24T20:10:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1967fc700 1 -- 172.21.15.50:0/3011723657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18800b860 con 0x7fd1980ca3a0 2023-12-24T20:10:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd1967fc700 1 -- 172.21.15.50:0/3011723657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800bbe0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 -- 172.21.15.50:0/3011723657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 msgr2=0x7fd1980ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.438+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/3011723657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd1980ca770 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fd1880098e0 tx=0x7fd1880091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.442+0000 7fd19dc2e700 1 -- 172.21.15.50:0/3011723657 shutdown_connections 2023-12-24T20:10:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.442+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/3011723657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd1980ca770 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.442+0000 7fd19dc2e700 1 -- 172.21.15.50:0/3011723657 >> 172.21.15.50:0/3011723657 conn(0x7fd1980cbba0 msgr2=0x7fd1980cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.442+0000 7fd19dc2e700 1 -- 172.21.15.50:0/3011723657 shutdown_connections 2023-12-24T20:10:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.442+0000 7fd19dc2e700 1 -- 172.21.15.50:0/3011723657 wait complete. 2023-12-24T20:10:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 Processor -- start 2023-12-24T20:10:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 -- start start 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19806ae10 0x7fd19816e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd19815b160 0x7fd19816e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19816e7d0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19815ef20 con 0x7fd19806ae10 2023-12-24T20:10:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd19dc2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19815f200 con 0x7fd19815b160 2023-12-24T20:10:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58850/0 (socket says 172.21.15.50:58850) 2023-12-24T20:10:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 -- 172.21.15.50:0/1928934667 learned_addr learned my addr 172.21.15.50:0/1928934667 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd1977fe700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19806ae10 0x7fd19816e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd197fff700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd19815b160 0x7fd19816e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 -- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd19815b160 msgr2=0x7fd19816e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd19815b160 0x7fd19816e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 -- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19806ae10 msgr2=0x7fd19816e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19806ae10 0x7fd19816e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.446+0000 7fd196ffd700 1 -- 172.21.15.50:0/1928934667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188009420 con 0x7fd1980ca3a0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd196ffd700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c600 tx=0x7fd18c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c005b30 con 0x7fd1980ca3a0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c005cb0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19815f4e0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c007320 con 0x7fd1980ca3a0 2023-12-24T20:10:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19815faa0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19815fcf0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.450+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd18c01b3b0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.454+0000 7fd17f7fe700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 0x7fd184062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.454+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7fd18c07bf90 con 0x7fd1980ca3a0 2023-12-24T20:10:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.454+0000 7fd1977fe700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 0x7fd184062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.454+0000 7fd1977fe700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 0x7fd184062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1880093f0 tx=0x7fd188017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.458+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd18c04c2f0 con 0x7fd1980ca3a0 2023-12-24T20:10:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:14.698+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fd1980652e0 con 0x7fd1980ca3a0 2023-12-24T20:10:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.234+0000 7fd17f7fe700 1 -- 172.21.15.50:0/1928934667 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3041) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd18c0170e0 con 0x7fd1980ca3a0 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 msgr2=0x7fd184062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 0x7fd184062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1880093f0 tx=0x7fd188017000 comp rx=0 tx=0).stop 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 msgr2=0x7fd198156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c600 tx=0x7fd18c007e60 comp rx=0 tx=0).stop 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 shutdown_connections 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd184060550 0x7fd184062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd19815b160 0x7fd19816e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1980ca3a0 0x7fd198156b20 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 --2- 172.21.15.50:0/1928934667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19806ae10 0x7fd19816e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 >> 172.21.15.50:0/1928934667 conn(0x7fd1980cbba0 msgr2=0x7fd198157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 shutdown_connections 2023-12-24T20:10:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.238+0000 7fd19dc2e700 1 -- 172.21.15.50:0/1928934667 wait complete. 2023-12-24T20:10:15.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:10:15.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:10:15.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:10:15.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.430+0000 7fa5c17c5700 1 Processor -- start 2023-12-24T20:10:15.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.430+0000 7fa5c17c5700 1 -- start start 2023-12-24T20:10:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5c17c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5c17c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5bc06a630 0x7fa5bc0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5c17c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc159b30 con 0x7fa5bc158e00 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5c17c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc06b560 con 0x7fa5bc06a630 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5c17c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc06afa0 con 0x7fa5bc06df10 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5baffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5bc158e00 0x7fa5bc159fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55532/0 (socket says 172.21.15.50:55532) 2023-12-24T20:10:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5baffd700 1 -- 172.21.15.50:0/3217045663 learned_addr learned my addr 172.21.15.50:0/3217045663 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5ba7fc700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/3217045663 >> v2:172.21.15.82:3300/0 conn(0x7fa5bc06a630 0x7fa5bc0670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243457034 0 0) 0x7fa5bc159b30 con 0x7fa5bc158e00 2023-12-24T20:10:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a4003570 con 0x7fa5bc158e00 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678480560 0 0) 0x7fa5a4003570 con 0x7fa5bc158e00 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 msgr2=0x7fa5bc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 >> v2:172.21.15.82:3300/0 conn(0x7fa5bc06a630 msgr2=0x7fa5bc0670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 --2- 172.21.15.50:0/3217045663 >> v2:172.21.15.82:3300/0 conn(0x7fa5bc06a630 0x7fa5bc0670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc06b280 con 0x7fa5bc158e00 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fa5ac001470 con 0x7fa5bc158e00 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 >> v1:172.21.15.50:6789/0 conn(0x7fa5bc158e00 legacy=0x7fa5bc159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5a4003a60 0x7fa5a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5a4004810 0x7fa5a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc06afa0 con 0x7fa5a4004810 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a400ba60 con 0x7fa5a4003a60 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a400bba0 con 0x7fa5bc06df10 2023-12-24T20:10:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5ba7fc700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5a4004810 0x7fa5a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5baffd700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5a4003a60 0x7fa5a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.434+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 -- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5a4003a60 msgr2=0x7fa5a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5a4003a60 0x7fa5a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 -- 172.21.15.50:0/3217045663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5a4004810 msgr2=0x7fa5a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5a4004810 0x7fa5a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 -- 172.21.15.50:0/3217045663 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4003570 con 0x7fa5bc06df10 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5a40051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e210 tx=0x7fa5b400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db88903cd74c5a4f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400eac0 con 0x7fa5bc06df10 2023-12-24T20:10:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b400f040 con 0x7fa5bc06df10 2023-12-24T20:10:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5b9ffb700 1 -- 172.21.15.50:0/3217045663 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400ee70 con 0x7fa5bc06df10 2023-12-24T20:10:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 -- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 msgr2=0x7fa5a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/3217045663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5a40051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e210 tx=0x7fa5b400b040 comp rx=0 tx=0).stop 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5bb7fe700 1 -- 172.21.15.50:0/3217045663 reap_dead start 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 -- 172.21.15.50:0/3217045663 shutdown_connections 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 -- 172.21.15.50:0/3217045663 >> 172.21.15.50:0/3217045663 conn(0x7fa5bc0cfe40 msgr2=0x7fa5bc0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 -- 172.21.15.50:0/3217045663 shutdown_connections 2023-12-24T20:10:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.438+0000 7fa5c17c5700 1 -- 172.21.15.50:0/3217045663 wait complete. 2023-12-24T20:10:15.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 Processor -- start 2023-12-24T20:10:15.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 -- start start 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc169110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5bc14cbd0 0x7fa5bc154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc14df80 con 0x7fa5bc14c760 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b0ee0 con 0x7fa5bc14cbd0 2023-12-24T20:10:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5c17c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1571e0 con 0x7fa5bc06df10 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58872/0 (socket says 172.21.15.50:58872) 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 -- 172.21.15.50:0/1384849333 learned_addr learned my addr 172.21.15.50:0/1384849333 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5baffd700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5bb7fe700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5bc14cbd0 0x7fa5bc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 -- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 msgr2=0x7fa5bc169110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc169110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 -- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5bc14cbd0 msgr2=0x7fa5bc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5bc14cbd0 0x7fa5bc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.442+0000 7fa5ba7fc700 1 -- 172.21.15.50:0/1384849333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0b0310 con 0x7fa5bc14c760 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5ba7fc700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0011b40 tx=0x7fa5b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000fa10 con 0x7fa5bc14c760 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000fb70 con 0x7fa5bc14c760 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0014440 con 0x7fa5bc14c760 2023-12-24T20:10:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0b05b0 con 0x7fa5bc14c760 2023-12-24T20:10:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0b0b70 con 0x7fa5bc14c760 2023-12-24T20:10:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.446+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc04be40 con 0x7fa5bc14c760 2023-12-24T20:10:15.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.450+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa5b0014830 con 0x7fa5bc14c760 2023-12-24T20:10:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.450+0000 7fa5a2ffd700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 0x7fa5a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.450+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7fa5b0018030 con 0x7fa5bc14c760 2023-12-24T20:10:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.450+0000 7fa5baffd700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 0x7fa5a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.450+0000 7fa5baffd700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 0x7fa5a8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000e10 tx=0x7fa5ac009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.458+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5b004d8d0 con 0x7fa5bc14c760 2023-12-24T20:10:15.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.630+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa5bc06c9d0 con 0x7fa5bc14c760 2023-12-24T20:10:15.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.638+0000 7fa5a2ffd700 1 -- 172.21.15.50:0/1384849333 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5b0050ef0 con 0x7fa5bc14c760 2023-12-24T20:10:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 msgr2=0x7fa5a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 0x7fa5a8062a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000e10 tx=0x7fa5ac009040 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 msgr2=0x7fa5bc153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0011b40 tx=0x7fa5b00091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 shutdown_connections 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa5a8060550 0x7fa5a8062a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5bc14cbd0 0x7fa5bc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5bc14c760 0x7fa5bc153d40 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 --2- 172.21.15.50:0/1384849333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5bc06df10 0x7fa5bc169110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 >> 172.21.15.50:0/1384849333 conn(0x7fa5bc0cfe40 msgr2=0x7fa5bc15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 shutdown_connections 2023-12-24T20:10:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.642+0000 7fa5c17c5700 1 -- 172.21.15.50:0/1384849333 wait complete. 2023-12-24T20:10:15.671 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:10:15.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:15.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:15.764 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:10:15.764 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:10:15.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:15.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.934+0000 7f83e759e700 1 Processor -- start 2023-12-24T20:10:15.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.934+0000 7f83e759e700 1 -- start start 2023-12-24T20:10:15.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e806d8c0 0x7f83e81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e806b640 con 0x7f83e80b41e0 2023-12-24T20:10:15.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80b5e10 con 0x7f83e8158e00 2023-12-24T20:10:15.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e8159710 con 0x7f83e806d8c0 2023-12-24T20:10:15.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e806d8c0 0x7f83e81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e806d8c0 0x7f83e81591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58878/0 (socket says 172.21.15.50:58878) 2023-12-24T20:10:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e6d9d700 1 -- 172.21.15.50:0/2344614697 learned_addr learned my addr 172.21.15.50:0/2344614697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.938+0000 7f83e5d9b700 1 --1- 172.21.15.50:0/2344614697 >> v1:172.21.15.50:6789/0 conn(0x7f83e80b41e0 0x7f83e8159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55548/0 (socket says 172.21.15.50:55548) 2023-12-24T20:10:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e659c700 1 --1- 172.21.15.50:0/2344614697 >> v1:172.21.15.82:6789/0 conn(0x7f83e8158e00 0x7f83e80b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60312/0 (socket says 172.21.15.50:60312) 2023-12-24T20:10:15.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e6d9d700 1 -- 172.21.15.50:0/2344614697 >> v1:172.21.15.82:6789/0 conn(0x7f83e8158e00 legacy=0x7f83e80b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e6d9d700 1 -- 172.21.15.50:0/2344614697 >> v1:172.21.15.50:6789/0 conn(0x7f83e80b41e0 legacy=0x7f83e8159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e6d9d700 1 -- 172.21.15.50:0/2344614697 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e806b8e0 con 0x7f83e806d8c0 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e6d9d700 1 --2- 172.21.15.50:0/2344614697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e81591d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f20 tx=0x7f83e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e910166e9bd9c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e559a700 1 -- 172.21.15.50:0/2344614697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000e070 con 0x7f83e806d8c0 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e559a700 1 -- 172.21.15.50:0/2344614697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000ba80 con 0x7f83e806d8c0 2023-12-24T20:10:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e559a700 1 -- 172.21.15.50:0/2344614697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00092e0 con 0x7f83e806d8c0 2023-12-24T20:10:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 -- 172.21.15.50:0/2344614697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 msgr2=0x7f83e81591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 --2- 172.21.15.50:0/2344614697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e81591d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f20 tx=0x7f83e0009840 comp rx=0 tx=0).stop 2023-12-24T20:10:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 -- 172.21.15.50:0/2344614697 shutdown_connections 2023-12-24T20:10:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 --2- 172.21.15.50:0/2344614697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e81591d0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 -- 172.21.15.50:0/2344614697 >> 172.21.15.50:0/2344614697 conn(0x7f83e8067b80 msgr2=0x7f83e80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 -- 172.21.15.50:0/2344614697 shutdown_connections 2023-12-24T20:10:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.942+0000 7f83e759e700 1 -- 172.21.15.50:0/2344614697 wait complete. 2023-12-24T20:10:15.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 Processor -- start 2023-12-24T20:10:15.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 -- start start 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e80b41e0 0x7f83e815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8158e00 0x7f83e815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e816b140 con 0x7f83e806d8c0 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8152200 con 0x7f83e8158e00 2023-12-24T20:10:15.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e816a810 con 0x7f83e80b41e0 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58880/0 (socket says 172.21.15.50:58880) 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 -- 172.21.15.50:0/983373314 learned_addr learned my addr 172.21.15.50:0/983373314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e6d9d700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8158e00 0x7f83e815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e5d9b700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e80b41e0 0x7f83e815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 -- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e80b41e0 msgr2=0x7f83e815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e80b41e0 0x7f83e815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 -- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8158e00 msgr2=0x7f83e815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:15.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8158e00 0x7f83e815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:15.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.946+0000 7f83e659c700 1 -- 172.21.15.50:0/983373314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0009ae0 con 0x7f83e806d8c0 2023-12-24T20:10:15.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83e659c700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c560 tx=0x7f83d8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8005a70 con 0x7f83e806d8c0 2023-12-24T20:10:15.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8005bd0 con 0x7f83e806d8c0 2023-12-24T20:10:15.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d80070d0 con 0x7f83e806d8c0 2023-12-24T20:10:15.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e816aaf0 con 0x7f83e806d8c0 2023-12-24T20:10:15.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e813ed00 con 0x7f83e806d8c0 2023-12-24T20:10:15.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.950+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e804be40 con 0x7f83e806d8c0 2023-12-24T20:10:15.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.954+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f83d8007480 con 0x7f83e806d8c0 2023-12-24T20:10:15.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.954+0000 7f83d67fc700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 0x7f83c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:15.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.954+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f83d807be70 con 0x7f83e806d8c0 2023-12-24T20:10:15.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.954+0000 7f83e5d9b700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 0x7f83c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:15.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.954+0000 7f83e5d9b700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 0x7f83c8062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f83e814f950 tx=0x7f83dc007eb0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:15.958+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f83d804c1f0 con 0x7f83e806d8c0 2023-12-24T20:10:16.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.174+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83e806bbc0 con 0x7f83e806d8c0 2023-12-24T20:10:16.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.174+0000 7f83d67fc700 1 -- 172.21.15.50:0/983373314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+3527 (secure 0 0 0) 0x7f83d8017090 con 0x7f83e806d8c0 2023-12-24T20:10:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:16.176 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/422252546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":422252546},{"type":"v1","addr":"172.21.15.82:6834","nonce":422252546}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3915452425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3915452425},{"type":"v1","addr":"172.21.15.50:6833","nonce":3915452425}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3221165101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3221165101},{"type":"v1","addr":"172.21.15.82:6835","nonce":3221165101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1084014270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1084014270},{"type":"v1","addr":"172.21.15.50:6835","nonce":1084014270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[]} 2023-12-24T20:10:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.174+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 msgr2=0x7f83c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.174+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 0x7f83c8062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f83e814f950 tx=0x7f83dc007eb0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 msgr2=0x7f83e813e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c560 tx=0x7f83d8007f70 comp rx=0 tx=0).stop 2023-12-24T20:10:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 shutdown_connections 2023-12-24T20:10:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83c8060550 0x7f83c8062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e8158e00 0x7f83e815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f83e80b41e0 0x7f83e815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 --2- 172.21.15.50:0/983373314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e806d8c0 0x7f83e813e7c0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 >> 172.21.15.50:0/983373314 conn(0x7f83e8067b80 msgr2=0x7f83e80a93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 shutdown_connections 2023-12-24T20:10:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.178+0000 7f83e759e700 1 -- 172.21.15.50:0/983373314 wait complete. 2023-12-24T20:10:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 97 2023-12-24T20:10:16.199 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:10:16.199 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:10:16.200 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:10:16.200 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:10:16.200 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:10:16.200 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:10:16.201 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:10:16.201 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:10:16.201 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:10:16.201 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:10:16.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:10:16.201 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:10:16.201 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:10:16.202 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:10:16.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:10:16.202 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:10:16.218 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:10:16.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:10:16.221 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:10:16.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:10:16.223 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:10:16.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:10:16.225 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:10:16.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:10:16.272 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:10:16.273 DEBUG:teuthology.parallel:result is None 2023-12-24T20:10:16.275 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:10:16.275 DEBUG:teuthology.parallel:result is None 2023-12-24T20:10:16.276 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:10:16.276 DEBUG:teuthology.parallel:result is None 2023-12-24T20:10:16.279 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:10:16.279 DEBUG:teuthology.parallel:result is None 2023-12-24T20:10:16.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:10:16.379 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-24T20:10:16.380 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T20:10:16.394 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2023-12-24T20:10:16.397 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2023-12-24T20:10:16.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.458+0000 7f78de123700 1 Processor -- start 2023-12-24T20:10:16.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.458+0000 7f78de123700 1 -- start start 2023-12-24T20:10:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78de123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78d8161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78de123700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d806c4d0 con 0x7f78d81611b0 2023-12-24T20:10:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78de123700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d806c1f0 con 0x7f78d806c820 2023-12-24T20:10:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78de123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80ab5e0 con 0x7f78d80ae100 2023-12-24T20:10:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78dd121700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f78d81611b0 0x7f78d806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55582/0 (socket says 172.21.15.50:55582) 2023-12-24T20:10:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78dd121700 1 -- 172.21.15.50:0/2553202780 learned_addr learned my addr 172.21.15.50:0/2553202780 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78dc920700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78d8161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334430967 0 0) 0x7f78d4001110 con 0x7f78d81611b0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c4003570 con 0x7f78d81611b0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622122599 0 0) 0x7f78c4003570 con 0x7f78d81611b0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 msgr2=0x7f78d8161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78d8161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 >> v1:172.21.15.82:6789/0 conn(0x7f78d806c820 legacy=0x7f78d80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80ab8c0 con 0x7f78d81611b0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f78d4001600 con 0x7f78d81611b0 2023-12-24T20:10:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 >> v1:172.21.15.50:6789/0 conn(0x7f78d81611b0 legacy=0x7f78d806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c4003a90 0x7f78c4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.462+0000 7f78cffff700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4004810 0x7f78c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78c40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80ab5e0 con 0x7f78c4003a90 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c400bb90 con 0x7f78c4004810 2023-12-24T20:10:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c400bd50 con 0x7f78d80ae100 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dc920700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4004810 0x7f78c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c4003a90 0x7f78c4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd922700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78c40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 -- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 msgr2=0x7f78c40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80ae100 0x7f78c40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 -- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4004810 msgr2=0x7f78c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4004810 0x7f78c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 -- 172.21.15.50:0/2553202780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4003570 con 0x7f78c4003a90 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd121700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c4003a90 0x7f78c4003ea0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c5c0 tx=0x7f78d4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e028f19fc22df4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400cdc0 con 0x7f78c4003a90 2023-12-24T20:10:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4005920 con 0x7f78c4003a90 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78cffff700 1 -- 172.21.15.50:0/2553202780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4005ce0 con 0x7f78c4003a90 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 -- 172.21.15.50:0/2553202780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c4003a90 msgr2=0x7f78c4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 --2- 172.21.15.50:0/2553202780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c4003a90 0x7f78c4003ea0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c5c0 tx=0x7f78d4007a50 comp rx=0 tx=0).stop 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78dd922700 1 -- 172.21.15.50:0/2553202780 reap_dead start 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 -- 172.21.15.50:0/2553202780 shutdown_connections 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 -- 172.21.15.50:0/2553202780 >> 172.21.15.50:0/2553202780 conn(0x7f78d8067b80 msgr2=0x7f78d80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 -- 172.21.15.50:0/2553202780 shutdown_connections 2023-12-24T20:10:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.466+0000 7f78de123700 1 -- 172.21.15.50:0/2553202780 wait complete. 2023-12-24T20:10:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.470+0000 7f78de123700 1 Processor -- start 2023-12-24T20:10:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.470+0000 7f78de123700 1 -- start start 2023-12-24T20:10:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4003a90 0x7f78d8152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80b1440 0x7f78d8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80cb2b0 con 0x7f78d80ca8d0 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8154a80 con 0x7f78c4003a90 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8154150 con 0x7f78d80b1440 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58938/0 (socket says 172.21.15.50:58938) 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 -- 172.21.15.50:0/2266387138 learned_addr learned my addr 172.21.15.50:0/2266387138 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dc920700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80b1440 0x7f78d8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd121700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4003a90 0x7f78d8152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 -- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80b1440 msgr2=0x7f78d8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80b1440 0x7f78d8150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 -- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4003a90 msgr2=0x7f78d8152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4003a90 0x7f78d8152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 -- 172.21.15.50:0/2266387138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8154430 con 0x7f78d80ca8d0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78dd922700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f78d8069fd0 tx=0x7f78d0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0019070 con 0x7f78d80ca8d0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d000ee70 con 0x7f78d80ca8d0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0006dd0 con 0x7f78d80ca8d0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8154710 con 0x7f78d80ca8d0 2023-12-24T20:10:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.474+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d8152640 con 0x7f78d80ca8d0 2023-12-24T20:10:16.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.478+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d804be40 con 0x7f78d80ca8d0 2023-12-24T20:10:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.478+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f78d000c9c0 con 0x7f78d80ca8d0 2023-12-24T20:10:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.478+0000 7f78cd7fa700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 0x7f78bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.478+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6321+0+0 (secure 0 0 0) 0x7f78d007caf0 con 0x7f78d80ca8d0 2023-12-24T20:10:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.482+0000 7f78dd121700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 0x7f78bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:16.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.482+0000 7f78dd121700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 0x7f78bc062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f78d4007e70 tx=0x7f78d4015000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.486+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f78d004cdd0 con 0x7f78d80ca8d0 2023-12-24T20:10:16.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:16.682+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f78d806e150 con 0x7f78d80ca8d0 2023-12-24T20:10:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.262+0000 7f78cd7fa700 1 -- 172.21.15.50:0/2266387138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v202) v1 ==== 97+0+0 (secure 0 0 0) 0x7f78d00503f0 con 0x7f78d80ca8d0 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 msgr2=0x7f78bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 0x7f78bc062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f78d4007e70 tx=0x7f78d4015000 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 msgr2=0x7f78d80cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f78d8069fd0 tx=0x7f78d0001640 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 shutdown_connections 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f78bc060550 0x7f78bc062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78d80ca8d0 0x7f78d80cad70 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d80b1440 0x7f78d8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 --2- 172.21.15.50:0/2266387138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c4003a90 0x7f78d8152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 >> 172.21.15.50:0/2266387138 conn(0x7f78d8067b80 msgr2=0x7f78d8157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 shutdown_connections 2023-12-24T20:10:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.266+0000 7f78de123700 1 -- 172.21.15.50:0/2266387138 wait complete. 2023-12-24T20:10:17.270 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-24T20:10:17.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:10:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.446+0000 7f4cf566b700 1 Processor -- start 2023-12-24T20:10:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.446+0000 7f4cf566b700 1 -- start start 2023-12-24T20:10:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf566b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf566b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00a9c80 con 0x7f4cf006c0c0 2023-12-24T20:10:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf566b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00a9070 con 0x7f4cf0158cd0 2023-12-24T20:10:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf566b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf006c520 con 0x7f4cf006b6c0 2023-12-24T20:10:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf4e6a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4cf006c0c0 0x7f4cf006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55590/0 (socket says 172.21.15.50:55590) 2023-12-24T20:10:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cf4e6a700 1 -- 172.21.15.50:0/2239580212 learned_addr learned my addr 172.21.15.50:0/2239580212 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cef7fe700 1 --2- 172.21.15.50:0/2239580212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151676042 0 0) 0x7f4cf00a9c80 con 0x7f4cf006c0c0 2023-12-24T20:10:17.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd8003570 con 0x7f4cf006c0c0 2023-12-24T20:10:17.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051257926 0 0) 0x7f4cf00a9070 con 0x7f4cf0158cd0 2023-12-24T20:10:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf00a9c80 con 0x7f4cf0158cd0 2023-12-24T20:10:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cef7fe700 1 -- 172.21.15.50:0/2239580212 >> v1:172.21.15.82:6789/0 conn(0x7f4cf0158cd0 legacy=0x7f4cf006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2387447734 0 0) 0x7f4cd8003570 con 0x7f4cf006c0c0 2023-12-24T20:10:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cef7fe700 1 -- 172.21.15.50:0/2239580212 >> v1:172.21.15.50:6789/0 conn(0x7f4cf006c0c0 legacy=0x7f4cf006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cef7fe700 1 -- 172.21.15.50:0/2239580212 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00a9350 con 0x7f4cf006b6c0 2023-12-24T20:10:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.450+0000 7f4cef7fe700 1 --2- 172.21.15.50:0/2239580212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf01590a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009910 tx=0x7f4ce40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23521b6d39c662b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80017f0 con 0x7f4cf006b6c0 2023-12-24T20:10:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4011420 con 0x7f4cf006b6c0 2023-12-24T20:10:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4ceeffd700 1 -- 172.21.15.50:0/2239580212 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40117c0 con 0x7f4cf006b6c0 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 -- 172.21.15.50:0/2239580212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 msgr2=0x7f4cf01590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 --2- 172.21.15.50:0/2239580212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf01590a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009910 tx=0x7f4ce40091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 -- 172.21.15.50:0/2239580212 shutdown_connections 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 --2- 172.21.15.50:0/2239580212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf01590a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 -- 172.21.15.50:0/2239580212 >> 172.21.15.50:0/2239580212 conn(0x7f4cf0067b80 msgr2=0x7f4cf00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 -- 172.21.15.50:0/2239580212 shutdown_connections 2023-12-24T20:10:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 -- 172.21.15.50:0/2239580212 wait complete. 2023-12-24T20:10:17.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.454+0000 7f4cf566b700 1 Processor -- start 2023-12-24T20:10:17.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 -- start start 2023-12-24T20:10:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf0158cd0 0x7f4cf00c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01559e0 con 0x7f4cf006c0c0 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01550f0 con 0x7f4cf0158cd0 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0151a20 con 0x7f4cf006b6c0 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58948/0 (socket says 172.21.15.50:58948) 2023-12-24T20:10:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 -- 172.21.15.50:0/954912534 learned_addr learned my addr 172.21.15.50:0/954912534 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:17.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4ceffff700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf4e6a700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf0158cd0 0x7f4cf00c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 -- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 msgr2=0x7f4cf015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 -- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf0158cd0 msgr2=0x7f4cf00c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf0158cd0 0x7f4cf00c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 -- 172.21.15.50:0/954912534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4009420 con 0x7f4cf006c0c0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cef7fe700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40091e0 tx=0x7f4ce4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce401cc90 con 0x7f4cf006c0c0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce401cdf0 con 0x7f4cf006c0c0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce401a6a0 con 0x7f4cf006c0c0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.458+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf00b1680 con 0x7f4cf006c0c0 2023-12-24T20:10:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.462+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0155390 con 0x7f4cf006c0c0 2023-12-24T20:10:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.462+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf004be40 con 0x7f4cf006c0c0 2023-12-24T20:10:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.462+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4ce401aa90 con 0x7f4cf006c0c0 2023-12-24T20:10:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.466+0000 7f4cd7fff700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 0x7f4cdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.466+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5633+0+0 (secure 0 0 0) 0x7f4ce407e690 con 0x7f4cf006c0c0 2023-12-24T20:10:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.466+0000 7f4ceffff700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 0x7f4cdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.466+0000 7f4ceffff700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 0x7f4cdc062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0003870 tx=0x7f4ce0009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.474+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ce404ec20 con 0x7f4cf006c0c0 2023-12-24T20:10:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.702+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4cf006e150 con 0x7f4cf006c0c0 2023-12-24T20:10:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.702+0000 7f4cd7fff700 1 -- 172.21.15.50:0/954912534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4ce4052240 con 0x7f4cf006c0c0 2023-12-24T20:10:17.706 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlkMW7EhAAFMZdOZkAc17uTOnvHcxPnQ==", 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlc2PGJBAAYuZ/ocuDr6EBgs3Hf3Ufgw==", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-24T20:10:17.708 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhljS08HRAArE9x9pC3xtYENeVCEGjbgQ==", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlHa1tLxAA41nlkmf3b8YS0cvuCWvyLw==", 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDyeYhlj5BsIhAAA3rbatGIgKqkpTQQleCZJQ==", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD1eYhl1VrnLxAAzj/5YxU5rY85MJC97SNzlQ==", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5eYhlImRwARAA2lJ6ezasAli3fQPC/fG7ug==", 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD8eYhlPzdbDhAAgCIw8nLE/E+1KiEs0AEZIg==", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.712 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACeohlsaAXKxAA8UDicqXkdlX7m4gAKY+3Aw==", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAFeohlaMJiNxAAW1MPQXwRsAWygSE1rF+Xyg==", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJeohlPQw+CBAAZ/XbLMpHci65GpcTALRdEQ==", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMeohlAAWjGBAA0LB4yDQt9toCgw3qkMiG3g==", 2023-12-24T20:10:17.714 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlIcD0NRAAjMfF96ygMds8I+XB57Z7eg==", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlyEWyBRAApvc+0xP/X+CTa+ahPde5iA==", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlGWorABAAgxmtyOIDLWyKH4IAKSdlLw==", 2023-12-24T20:10:17.716 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDxeYhlXNxACxAAlryo5dNX14TmrnA6y7ugcw==", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-24T20:10:17.717 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDveYhljETQJhAAOGRgnYUGuvxhYMLLLSvGsg==", 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhlZeukDBAA2maHVCYYUuke6Hz3QgE2TA==", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDweYhl8nETBxAAvoRphJ6baaR5J+36khScjw==", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-24T20:10:17.719 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-24T20:10:17.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:17.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-24T20:10:17.720 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 msgr2=0x7f4cdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 0x7f4cdc062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0003870 tx=0x7f4ce0009040 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 msgr2=0x7f4cf01514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40091e0 tx=0x7f4ce4016000 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 shutdown_connections 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cdc060550 0x7f4cdc062a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf0158cd0 0x7f4cf00c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf006c0c0 0x7f4cf01514e0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 --2- 172.21.15.50:0/954912534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4cf006b6c0 0x7f4cf015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 >> 172.21.15.50:0/954912534 conn(0x7f4cf0067b80 msgr2=0x7f4cf0154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 shutdown_connections 2023-12-24T20:10:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.706+0000 7f4cf566b700 1 -- 172.21.15.50:0/954912534 wait complete. 2023-12-24T20:10:17.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.902+0000 7fd0f74f0700 1 Processor -- start 2023-12-24T20:10:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.902+0000 7fd0f74f0700 1 -- start start 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f74f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0f00ca3a0 0x7fd0f00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f74f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f006ca50 con 0x7fd0f015b160 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f74f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f006b7f0 con 0x7fd0f006ae10 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f74f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f00c6980 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f5a8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0f015b160 0x7fd0f006cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55606/0 (socket says 172.21.15.50:55606) 2023-12-24T20:10:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f5a8d700 1 -- 172.21.15.50:0/4088734468 learned_addr learned my addr 172.21.15.50:0/4088734468 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f528c700 1 --2- 172.21.15.50:0/4088734468 >> v2:172.21.15.50:3300/0 conn(0x7fd0f00ca3a0 0x7fd0f00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4088734468 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227067734 0 0) 0x7fd0f006ca50 con 0x7fd0f015b160 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4088734468 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0dc003570 con 0x7fd0f015b160 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f528c700 1 -- 172.21.15.50:0/4088734468 >> v1:172.21.15.82:6789/0 conn(0x7fd0f006ae10 legacy=0x7fd0f015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f528c700 1 -- 172.21.15.50:0/4088734468 >> v1:172.21.15.50:6789/0 conn(0x7fd0f015b160 legacy=0x7fd0f006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f528c700 1 -- 172.21.15.50:0/4088734468 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f006bad0 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0f528c700 1 --2- 172.21.15.50:0/4088734468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f00ca770 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0098e0 tx=0x7fd0ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26febdffa11ebb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.906+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4088734468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00b640 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4088734468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec00b7a0 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4088734468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00bb40 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 -- 172.21.15.50:0/4088734468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 msgr2=0x7fd0f00ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/4088734468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f00ca770 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0098e0 tx=0x7fd0ec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 -- 172.21.15.50:0/4088734468 shutdown_connections 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/4088734468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f00ca770 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 -- 172.21.15.50:0/4088734468 >> 172.21.15.50:0/4088734468 conn(0x7fd0f00cbba0 msgr2=0x7fd0f00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 -- 172.21.15.50:0/4088734468 shutdown_connections 2023-12-24T20:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.910+0000 7fd0f74f0700 1 -- 172.21.15.50:0/4088734468 wait complete. 2023-12-24T20:10:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 Processor -- start 2023-12-24T20:10:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 -- start start 2023-12-24T20:10:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0f006ae10 0x7fd0f00b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f015b160 0x7fd0f0148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0171460 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f01493b0 con 0x7fd0f015b160 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f74f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f015ebb0 con 0x7fd0f006ae10 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.914+0000 7fd0f4a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58958/0 (socket says 172.21.15.50:58958) 2023-12-24T20:10:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 -- 172.21.15.50:0/1613660512 learned_addr learned my addr 172.21.15.50:0/1613660512 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f5a8d700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f015b160 0x7fd0f0148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f528c700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0f006ae10 0x7fd0f00b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 -- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0f006ae10 msgr2=0x7fd0f00b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0f006ae10 0x7fd0f00b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 -- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f015b160 msgr2=0x7fd0f0148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f015b160 0x7fd0f0148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 -- 172.21.15.50:0/1613660512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec009420 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f4a8b700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000c7c0 tx=0x7fd0e0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0011590 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0011710 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0011ad0 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f015ee90 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f0171930 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.918+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f015f020 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.922+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd0e001b3b0 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.922+0000 7fd0e57fa700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 0x7fd0d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.922+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5633+0+0 (secure 0 0 0) 0x7fd0e007bae0 con 0x7fd0f00ca3a0 2023-12-24T20:10:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.922+0000 7fd0f528c700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 0x7fd0d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.922+0000 7fd0f528c700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 0x7fd0d4062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0093f0 tx=0x7fd0ec017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:17.930+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd0e004c070 con 0x7fd0f00ca3a0 2023-12-24T20:10:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.098+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0f00652e0 con 0x7fd0f00ca3a0 2023-12-24T20:10:18.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.102+0000 7fd0e57fa700 1 -- 172.21.15.50:0/1613660512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+13009 (secure 0 0 0) 0x7fd0e004f690 con 0x7fd0f00ca3a0 2023-12-24T20:10:18.104 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:18.104 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":204,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:17.275981+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.102+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 msgr2=0x7fd0d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.102+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 0x7fd0d4062a00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0093f0 tx=0x7fd0ec017000 comp rx=0 tx=0).stop 2023-12-24T20:10:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.102+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 msgr2=0x7fd0f0170f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.102+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000c7c0 tx=0x7fd0e0007f40 comp rx=0 tx=0).stop 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 shutdown_connections 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd0d4060550 0x7fd0d4062a00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f015b160 0x7fd0f0148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f00ca3a0 0x7fd0f0170f20 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 --2- 172.21.15.50:0/1613660512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0f006ae10 0x7fd0f00b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 >> 172.21.15.50:0/1613660512 conn(0x7fd0f00cbba0 msgr2=0x7fd0f0157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 shutdown_connections 2023-12-24T20:10:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.106+0000 7fd0f74f0700 1 -- 172.21.15.50:0/1613660512 wait complete. 2023-12-24T20:10:18.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:10:18.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:10:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 Processor -- start 2023-12-24T20:10:18.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 -- start start 2023-12-24T20:10:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 0x7f60c00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60c00ab920 0x7f60c0160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00c9ea0 con 0x7f60c00bef90 2023-12-24T20:10:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c015d840 con 0x7f60c00ab920 2023-12-24T20:10:18.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.302+0000 7f60c708e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0161780 con 0x7f60c00bebc0 2023-12-24T20:10:18.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c688d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60c00bef90 0x7f60c00c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55612/0 (socket says 172.21.15.50:55612) 2023-12-24T20:10:18.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c688d700 1 -- 172.21.15.50:0/2508629460 learned_addr learned my addr 172.21.15.50:0/2508629460 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 --2- 172.21.15.50:0/2508629460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 0x7f60c00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c588b700 1 --2- 172.21.15.50:0/2508629460 >> v2:172.21.15.50:3300/0 conn(0x7f60c00ab920 0x7f60c0160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710046865 0 0) 0x7f60c00c9ea0 con 0x7f60c00bef90 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ac003570 con 0x7f60c00bef90 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 -- 172.21.15.50:0/2508629460 >> v2:172.21.15.50:3300/0 conn(0x7f60c00ab920 msgr2=0x7f60c0160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 --2- 172.21.15.50:0/2508629460 >> v2:172.21.15.50:3300/0 conn(0x7f60c00ab920 0x7f60c0160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 -- 172.21.15.50:0/2508629460 >> v1:172.21.15.50:6789/0 conn(0x7f60c00bef90 legacy=0x7f60c00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2211360110 0 0) 0x7f60ac003570 con 0x7f60c00bef90 2023-12-24T20:10:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 -- 172.21.15.50:0/2508629460 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0161a60 con 0x7f60c00bebc0 2023-12-24T20:10:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c608c700 1 --2- 172.21.15.50:0/2508629460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 0x7f60c00c6f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009e60 tx=0x7f60bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e98f7b5befa2e0f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00e070 con 0x7f60c00bebc0 2023-12-24T20:10:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00b7a0 con 0x7f60c00bebc0 2023-12-24T20:10:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c508a700 1 -- 172.21.15.50:0/2508629460 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8001470 con 0x7f60c00bebc0 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 -- 172.21.15.50:0/2508629460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 msgr2=0x7f60c00c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 --2- 172.21.15.50:0/2508629460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 0x7f60c00c6f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009e60 tx=0x7f60bc009780 comp rx=0 tx=0).stop 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 -- 172.21.15.50:0/2508629460 shutdown_connections 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 --2- 172.21.15.50:0/2508629460 >> v2:172.21.15.50:3300/0 conn(0x7f60c00ab920 0x7f60c0160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 --2- 172.21.15.50:0/2508629460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00bebc0 0x7f60c00c6f50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.306+0000 7f60c708e700 1 -- 172.21.15.50:0/2508629460 >> 172.21.15.50:0/2508629460 conn(0x7f60c0067250 msgr2=0x7f60c0067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- 172.21.15.50:0/2508629460 shutdown_connections 2023-12-24T20:10:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- 172.21.15.50:0/2508629460 wait complete. 2023-12-24T20:10:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 Processor -- start 2023-12-24T20:10:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- start start 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00ab920 0x7f60c00c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 0x7f60c015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00ac4b0 con 0x7f60c00bebc0 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00bf8d0 con 0x7f60c00bef90 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c708e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00abe60 con 0x7f60c00ab920 2023-12-24T20:10:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c588b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c588b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58972/0 (socket says 172.21.15.50:58972) 2023-12-24T20:10:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c588b700 1 -- 172.21.15.50:0/267224832 learned_addr learned my addr 172.21.15.50:0/267224832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.310+0000 7f60c608c700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00ab920 0x7f60c00c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c688d700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 0x7f60c015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 -- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00ab920 msgr2=0x7f60c00c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00ab920 0x7f60c00c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 -- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 msgr2=0x7f60c015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 0x7f60c015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 -- 172.21.15.50:0/267224832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009a20 con 0x7f60c00bebc0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c688d700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 0x7f60c015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c588b700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f60b000ec50 tx=0x7f60b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000c850 con 0x7f60c00bebc0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b000c9b0 con 0x7f60c00bebc0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c00ac140 con 0x7f60c00bebc0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000cd70 con 0x7f60c00bebc0 2023-12-24T20:10:18.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c00bfbb0 con 0x7f60c00bebc0 2023-12-24T20:10:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.314+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c00ac660 con 0x7f60c00bebc0 2023-12-24T20:10:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.318+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f60b0013680 con 0x7f60c00bebc0 2023-12-24T20:10:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.318+0000 7f60b67fc700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 0x7f60a4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.318+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5633+0+0 (secure 0 0 0) 0x7f60b007c7e0 con 0x7f60c00bebc0 2023-12-24T20:10:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.318+0000 7f60c608c700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 0x7f60a4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.318+0000 7f60c608c700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 0x7f60a4062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0099f0 tx=0x7f60bc018000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.322+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f60c00ac660 con 0x7f60c00bebc0 2023-12-24T20:10:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.502+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60c004be40 con 0x7f60c00bebc0 2023-12-24T20:10:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.502+0000 7f60b67fc700 1 -- 172.21.15.50:0/267224832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v204) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60b004cd70 con 0x7f60c00bebc0 2023-12-24T20:10:18.505 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T20:10:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 msgr2=0x7f60a4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 0x7f60a4062a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0099f0 tx=0x7f60bc018000 comp rx=0 tx=0).stop 2023-12-24T20:10:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 msgr2=0x7f60c00c1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f60b000ec50 tx=0x7f60b00091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 shutdown_connections 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f60a4060580 0x7f60a4062a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c00bef90 0x7f60c015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60c00bebc0 0x7f60c00c1bd0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 --2- 172.21.15.50:0/267224832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f60c00ab920 0x7f60c00c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 >> 172.21.15.50:0/267224832 conn(0x7f60c0067250 msgr2=0x7f60c006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 shutdown_connections 2023-12-24T20:10:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.506+0000 7f60c708e700 1 -- 172.21.15.50:0/267224832 wait complete. 2023-12-24T20:10:18.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:10:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.698+0000 7f2ee9545700 1 Processor -- start 2023-12-24T20:10:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.698+0000 7f2ee9545700 1 -- start start 2023-12-24T20:10:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee9545700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ee4069600 0x7f2ee415d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee9545700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee40b06d0 0x7f2ee40b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee9545700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee415db80 con 0x7f2ee415d270 2023-12-24T20:10:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee9545700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee406f050 con 0x7f2ee40b06d0 2023-12-24T20:10:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee9545700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee415e6f0 con 0x7f2ee4069600 2023-12-24T20:10:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ee415d270 0x7f2ee4068ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55616/0 (socket says 172.21.15.50:55616) 2023-12-24T20:10:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee2ffd700 1 -- 172.21.15.50:0/3927535563 learned_addr learned my addr 172.21.15.50:0/3927535563 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/3927535563 >> v2:172.21.15.82:3300/0 conn(0x7f2ee4069600 0x7f2ee415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee37fe700 1 --2- 172.21.15.50:0/3927535563 >> v2:172.21.15.50:3300/0 conn(0x7f2ee40b06d0 0x7f2ee40b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee1ffb700 1 -- 172.21.15.50:0/3927535563 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420593972 0 0) 0x7f2ed4001110 con 0x7f2ee415d270 2023-12-24T20:10:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee1ffb700 1 -- 172.21.15.50:0/3927535563 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003570 con 0x7f2ee415d270 2023-12-24T20:10:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 -- 172.21.15.50:0/3927535563 >> v2:172.21.15.50:3300/0 conn(0x7f2ee40b06d0 msgr2=0x7f2ee40b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/3927535563 >> v2:172.21.15.50:3300/0 conn(0x7f2ee40b06d0 0x7f2ee40b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 -- 172.21.15.50:0/3927535563 >> v1:172.21.15.50:6789/0 conn(0x7f2ee415d270 legacy=0x7f2ee4068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 -- 172.21.15.50:0/3927535563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee415ddc0 con 0x7f2ee4069600 2023-12-24T20:10:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.702+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/3927535563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee415d640 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40b2da0 tx=0x7f2ed80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adde2fea74c198d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee1ffb700 1 -- 172.21.15.50:0/3927535563 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011630 con 0x7f2ee4069600 2023-12-24T20:10:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee1ffb700 1 -- 172.21.15.50:0/3927535563 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80117b0 con 0x7f2ee4069600 2023-12-24T20:10:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee1ffb700 1 -- 172.21.15.50:0/3927535563 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011b70 con 0x7f2ee4069600 2023-12-24T20:10:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 -- 172.21.15.50:0/3927535563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 msgr2=0x7f2ee415d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 --2- 172.21.15.50:0/3927535563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee415d640 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40b2da0 tx=0x7f2ed80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 -- 172.21.15.50:0/3927535563 shutdown_connections 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 --2- 172.21.15.50:0/3927535563 >> v2:172.21.15.50:3300/0 conn(0x7f2ee40b06d0 0x7f2ee40b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 --2- 172.21.15.50:0/3927535563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee415d640 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 -- 172.21.15.50:0/3927535563 >> 172.21.15.50:0/3927535563 conn(0x7f2ee40677c0 msgr2=0x7f2ee4067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 -- 172.21.15.50:0/3927535563 shutdown_connections 2023-12-24T20:10:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.706+0000 7f2ee9545700 1 -- 172.21.15.50:0/3927535563 wait complete. 2023-12-24T20:10:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 Processor -- start 2023-12-24T20:10:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 -- start start 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee40ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ee415d270 0x7f2ee416d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40a57e0 con 0x7f2ee40b06d0 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40ae780 con 0x7f2ee4069600 2023-12-24T20:10:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee9545700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41585f0 con 0x7f2ee415d270 2023-12-24T20:10:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59002/0 (socket says 172.21.15.50:59002) 2023-12-24T20:10:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.710+0000 7f2ee27fc700 1 -- 172.21.15.50:0/2446535764 learned_addr learned my addr 172.21.15.50:0/2446535764 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee2ffd700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee40ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee37fe700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ee415d270 0x7f2ee416d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 -- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ee415d270 msgr2=0x7f2ee416d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ee415d270 0x7f2ee416d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 -- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 msgr2=0x7f2ee40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee40ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 -- 172.21.15.50:0/2446535764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8009420 con 0x7f2ee40b06d0 2023-12-24T20:10:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee2ffd700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee40ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee27fc700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8013000 tx=0x7f2ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed801f070 con 0x7f2ee40b06d0 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8000bc0 con 0x7f2ee40b06d0 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011b70 con 0x7f2ee40b06d0 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40adb70 con 0x7f2ee40b06d0 2023-12-24T20:10:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40ae130 con 0x7f2ee40b06d0 2023-12-24T20:10:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.714+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee40652e0 con 0x7f2ee40b06d0 2023-12-24T20:10:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.718+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2ed8023070 con 0x7f2ee40b06d0 2023-12-24T20:10:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.718+0000 7f2ecaffd700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 0x7f2ed0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.718+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5633+0+0 (secure 0 0 0) 0x7f2ed807da90 con 0x7f2ee40b06d0 2023-12-24T20:10:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.718+0000 7f2ee2ffd700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 0x7f2ed0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.722+0000 7f2ee2ffd700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 0x7f2ed0062a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4163fb0 tx=0x7f2ed4007bf0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.726+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ed804e020 con 0x7f2ee40b06d0 2023-12-24T20:10:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.906+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ee415e0a0 con 0x7f2ee40b06d0 2023-12-24T20:10:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.906+0000 7f2ecaffd700 1 -- 172.21.15.50:0/2446535764 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v204) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2ed8051640 con 0x7f2ee40b06d0 2023-12-24T20:10:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:18.911 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T20:10:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-24T20:10:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-24T20:10:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:18.912 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T20:10:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.910+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 msgr2=0x7f2ed0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.910+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 0x7f2ed0062a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4163fb0 tx=0x7f2ed4007bf0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.910+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 msgr2=0x7f2ee40a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.910+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8013000 tx=0x7f2ed8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 shutdown_connections 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2ed0060580 0x7f2ed0062a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ee415d270 0x7f2ee416d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee40b06d0 0x7f2ee40a52a0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 --2- 172.21.15.50:0/2446535764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee4069600 0x7f2ee40ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 >> 172.21.15.50:0/2446535764 conn(0x7f2ee40677c0 msgr2=0x7f2ee4068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:18.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 shutdown_connections 2023-12-24T20:10:18.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:18.914+0000 7f2ee9545700 1 -- 172.21.15.50:0/2446535764 wait complete. 2023-12-24T20:10:18.936 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:10:18.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:10:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.126+0000 7ff9d0e65700 1 Processor -- start 2023-12-24T20:10:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.126+0000 7ff9d0e65700 1 -- start start 2023-12-24T20:10:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.126+0000 7ff9d0e65700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9cc156b50 0x7ff9cc15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.126+0000 7ff9d0e65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc06db90 0x7ff9cc0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9d0e65700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9d0e65700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0b44e0 con 0x7ff9cc0b4060 2023-12-24T20:10:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9d0e65700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc06d4d0 con 0x7ff9cc156b50 2023-12-24T20:10:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9d0e65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0b4960 con 0x7ff9cc06db90 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59012/0 (socket says 172.21.15.50:59012) 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 -- 172.21.15.50:0/1583718463 learned_addr learned my addr 172.21.15.50:0/1583718463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9ca59c700 1 --2- 172.21.15.50:0/1583718463 >> v2:172.21.15.82:3300/0 conn(0x7ff9cc156b50 0x7ff9cc15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9c9d9b700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc06db90 0x7ff9cc0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 -- 172.21.15.50:0/1583718463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc06db90 msgr2=0x7ff9cc0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc06db90 0x7ff9cc0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 -- 172.21.15.50:0/1583718463 >> v2:172.21.15.82:3300/0 conn(0x7ff9cc156b50 msgr2=0x7ff9cc15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 --2- 172.21.15.50:0/1583718463 >> v2:172.21.15.82:3300/0 conn(0x7ff9cc156b50 0x7ff9cc15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 -- 172.21.15.50:0/1583718463 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc15a620 con 0x7ff9cc0b4060 2023-12-24T20:10:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9cad9d700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc063610 tx=0x7ff9c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50df1e4e0d020619 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9c959a700 1 -- 172.21.15.50:0/1583718463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400e070 con 0x7ff9cc0b4060 2023-12-24T20:10:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9c959a700 1 -- 172.21.15.50:0/1583718463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400ba50 con 0x7ff9cc0b4060 2023-12-24T20:10:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.130+0000 7ff9c959a700 1 -- 172.21.15.50:0/1583718463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40092e0 con 0x7ff9cc0b4060 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- 172.21.15.50:0/1583718463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc0b4060 msgr2=0x7ff9cc15ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc063610 tx=0x7ff9c4009840 comp rx=0 tx=0).stop 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- 172.21.15.50:0/1583718463 shutdown_connections 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc0b4060 0x7ff9cc15ccb0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/1583718463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc06db90 0x7ff9cc0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/1583718463 >> v2:172.21.15.82:3300/0 conn(0x7ff9cc156b50 0x7ff9cc15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- 172.21.15.50:0/1583718463 >> 172.21.15.50:0/1583718463 conn(0x7ff9cc067b40 msgr2=0x7ff9cc0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- 172.21.15.50:0/1583718463 shutdown_connections 2023-12-24T20:10:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- 172.21.15.50:0/1583718463 wait complete. 2023-12-24T20:10:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 Processor -- start 2023-12-24T20:10:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.134+0000 7ff9d0e65700 1 -- start start 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 0x7ff9cc15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 0x7ff9cc16c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc152990 con 0x7ff9cc06db90 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1588c0 con 0x7ff9cc156b50 2023-12-24T20:10:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9d0e65700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc16d540 con 0x7ff9cc0b4060 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59020/0 (socket says 172.21.15.50:59020) 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 -- 172.21.15.50:0/4177466855 learned_addr learned my addr 172.21.15.50:0/4177466855 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9c9d9b700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 0x7ff9cc15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9cad9d700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 0x7ff9cc16c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 -- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 msgr2=0x7ff9cc15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 0x7ff9cc15d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 -- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 msgr2=0x7ff9cc16c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 0x7ff9cc16c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 -- 172.21.15.50:0/4177466855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009ae0 con 0x7ff9cc06db90 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9c9d9b700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 0x7ff9cc15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9cad9d700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 0x7ff9cc16c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ca59c700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00d860 tx=0x7ff9bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.138+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc009610 con 0x7ff9cc06db90 2023-12-24T20:10:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.142+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc009770 con 0x7ff9cc06db90 2023-12-24T20:10:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.142+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc158270 con 0x7ff9cc06db90 2023-12-24T20:10:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.142+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc009b30 con 0x7ff9cc06db90 2023-12-24T20:10:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.142+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc0a8e10 con 0x7ff9cc06db90 2023-12-24T20:10:19.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.142+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc071060 con 0x7ff9cc06db90 2023-12-24T20:10:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.146+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff9bc01e460 con 0x7ff9cc06db90 2023-12-24T20:10:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.146+0000 7ff9ba7fc700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 0x7ff9ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.146+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5633+0+0 (secure 0 0 0) 0x7ff9bc07ce50 con 0x7ff9cc06db90 2023-12-24T20:10:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.146+0000 7ff9c9d9b700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 0x7ff9ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.150+0000 7ff9c9d9b700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 0x7ff9ac062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc152dc0 tx=0x7ff9c0008040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.154+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff9bc04d3e0 con 0x7ff9cc06db90 2023-12-24T20:10:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:19.334+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9cc06c8c0 con 0x7ff9cc06db90 2023-12-24T20:10:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.286+0000 7ff9ba7fc700 1 -- 172.21.15.50:0/4177466855 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v205) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9bc050a00 con 0x7ff9cc06db90 2023-12-24T20:10:20.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.290+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 msgr2=0x7ff9ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.290+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 0x7ff9ac062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc152dc0 tx=0x7ff9c0008040 comp rx=0 tx=0).stop 2023-12-24T20:10:20.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.290+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 msgr2=0x7ff9cc0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.290+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00d860 tx=0x7ff9bc008040 comp rx=0 tx=0).stop 2023-12-24T20:10:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 shutdown_connections 2023-12-24T20:10:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff9ac060550 0x7ff9ac062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9cc156b50 0x7ff9cc16c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9cc0b4060 0x7ff9cc15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 --2- 172.21.15.50:0/4177466855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9cc06db90 0x7ff9cc0a88d0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 >> 172.21.15.50:0/4177466855 conn(0x7ff9cc067b40 msgr2=0x7ff9cc0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 shutdown_connections 2023-12-24T20:10:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.294+0000 7ff9d0e65700 1 -- 172.21.15.50:0/4177466855 wait complete. 2023-12-24T20:10:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-24T20:10:20.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:10:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.502+0000 7f4b7dcf0700 1 Processor -- start 2023-12-24T20:10:20.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.502+0000 7f4b7dcf0700 1 -- start start 2023-12-24T20:10:20.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b7dcf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b780adbe0 0x7f4b78160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b7dcf0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780c93e0 con 0x7f4b7813f900 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b7dcf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780ca220 con 0x7f4b7813f530 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b7dcf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b780c9610 con 0x7f4b780adbe0 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b76ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4b7813f900 0x7f4b7806d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58546/0 (socket says 172.21.15.50:58546) 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b76ffd700 1 -- 172.21.15.50:0/4072222082 learned_addr learned my addr 172.21.15.50:0/4072222082 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:20.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.506+0000 7f4b77fff700 1 --2- 172.21.15.50:0/4072222082 >> v2:172.21.15.50:3300/0 conn(0x7f4b780adbe0 0x7f4b78160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:20.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651346030 0 0) 0x7f4b780c93e0 con 0x7f4b7813f900 2023-12-24T20:10:20.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b60003570 con 0x7f4b7813f900 2023-12-24T20:10:20.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493853499 0 0) 0x7f4b780ca220 con 0x7f4b7813f530 2023-12-24T20:10:20.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b780c93e0 con 0x7f4b7813f530 2023-12-24T20:10:20.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b77fff700 1 -- 172.21.15.50:0/4072222082 >> v1:172.21.15.82:6789/0 conn(0x7f4b7813f530 legacy=0x7f4b780ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b77fff700 1 -- 172.21.15.50:0/4072222082 >> v1:172.21.15.50:6789/0 conn(0x7f4b7813f900 legacy=0x7f4b7806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b77fff700 1 -- 172.21.15.50:0/4072222082 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780c98f0 con 0x7f4b780adbe0 2023-12-24T20:10:20.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b77fff700 1 --2- 172.21.15.50:0/4072222082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b780adbe0 0x7f4b78160ce0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e60 tx=0x7f4b70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5b33109d803db8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:20.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x7f4b780adbe0 2023-12-24T20:10:20.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000bab0 con 0x7f4b780adbe0 2023-12-24T20:10:20.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b767fc700 1 -- 172.21.15.50:0/4072222082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000be70 con 0x7f4b780adbe0 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/4072222082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b780adbe0 msgr2=0x7f4b78160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/4072222082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b780adbe0 0x7f4b78160ce0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e60 tx=0x7f4b70009780 comp rx=0 tx=0).stop 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/4072222082 shutdown_connections 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/4072222082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b780adbe0 0x7f4b78160ce0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/4072222082 >> 172.21.15.50:0/4072222082 conn(0x7f4b78067b80 msgr2=0x7f4b780cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/4072222082 shutdown_connections 2023-12-24T20:10:20.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.510+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/4072222082 wait complete. 2023-12-24T20:10:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.514+0000 7f4b7dcf0700 1 Processor -- start 2023-12-24T20:10:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.514+0000 7f4b7dcf0700 1 -- start start 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b780adbe0 0x7f4b780c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b7813f530 0x7f4b780c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78171ab0 con 0x7f4b7813f900 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78170e30 con 0x7f4b7813f530 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78171110 con 0x7f4b780adbe0 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45964/0 (socket says 172.21.15.50:45964) 2023-12-24T20:10:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 -- 172.21.15.50:0/2212126701 learned_addr learned my addr 172.21.15.50:0/2212126701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b76ffd700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b7813f530 0x7f4b780c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b777fe700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b780adbe0 0x7f4b780c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 -- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b780adbe0 msgr2=0x7f4b780c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b780adbe0 0x7f4b780c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 -- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b7813f530 msgr2=0x7f4b780c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b7813f530 0x7f4b780c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 -- 172.21.15.50:0/2212126701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009a20 con 0x7f4b7813f900 2023-12-24T20:10:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b77fff700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f4b70013000 tx=0x7f4b70019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70012db0 con 0x7f4b7813f900 2023-12-24T20:10:20.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70026480 con 0x7f4b7813f900 2023-12-24T20:10:20.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b781713f0 con 0x7f4b7813f900 2023-12-24T20:10:20.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70026840 con 0x7f4b7813f900 2023-12-24T20:10:20.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.518+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780c1510 con 0x7f4b7813f900 2023-12-24T20:10:20.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.522+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78171bf0 con 0x7f4b7813f900 2023-12-24T20:10:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.526+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4b70030430 con 0x7f4b7813f900 2023-12-24T20:10:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.526+0000 7f4b5f7fe700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 0x7f4b64062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.526+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6003+0+0 (secure 0 0 0) 0x7f4b7007e890 con 0x7f4b7813f900 2023-12-24T20:10:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.526+0000 7f4b777fe700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 0x7f4b64062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.526+0000 7f4b777fe700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 0x7f4b64062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b68007fd0 tx=0x7f4b68007d50 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:20.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.530+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4b7004edd0 con 0x7f4b7813f900 2023-12-24T20:10:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:20.714+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b78171bf0 con 0x7f4b7813f900 2023-12-24T20:10:21.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.302+0000 7f4b5f7fe700 1 -- 172.21.15.50:0/2212126701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v206) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b78171bf0 con 0x7f4b7813f900 2023-12-24T20:10:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 msgr2=0x7f4b64062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 0x7f4b64062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b68007fd0 tx=0x7f4b68007d50 comp rx=0 tx=0).stop 2023-12-24T20:10:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 msgr2=0x7f4b7813e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f4b70013000 tx=0x7f4b70019000 comp rx=0 tx=0).stop 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 shutdown_connections 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4b64060580 0x7f4b64062a30 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b68007fd0 tx=0x7f4b68007d50 comp rx=0 tx=0).stop 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7813f900 0x7f4b7813e1c0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b7813f530 0x7f4b780c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 --2- 172.21.15.50:0/2212126701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4b780adbe0 0x7f4b780c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 >> 172.21.15.50:0/2212126701 conn(0x7f4b78067b80 msgr2=0x7f4b7806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.314+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 shutdown_connections 2023-12-24T20:10:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.318+0000 7f4b7dcf0700 1 -- 172.21.15.50:0/2212126701 wait complete. 2023-12-24T20:10:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-24T20:10:21.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:10:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.518+0000 7fc3cd123700 1 Processor -- start 2023-12-24T20:10:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.518+0000 7fc3cd123700 1 -- start start 2023-12-24T20:10:21.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cd123700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3c8158c40 0x7fc3c80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cd123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cd123700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c806a580 con 0x7fc3c80cc780 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cd123700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80cd110 con 0x7fc3c8158c40 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cd123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c806a7d0 con 0x7fc3c806d450 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3c8158c40 0x7fc3c80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3c8158c40 0x7fc3c80cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45974/0 (socket says 172.21.15.50:45974) 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 -- 172.21.15.50:0/3953576714 learned_addr learned my addr 172.21.15.50:0/3953576714 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3cc922700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 -- 172.21.15.50:0/3953576714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 msgr2=0x7fc3c80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 -- 172.21.15.50:0/3953576714 >> v1:172.21.15.82:6789/0 conn(0x7fc3c80cc780 legacy=0x7fc3c806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 -- 172.21.15.50:0/3953576714 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c806aab0 con 0x7fc3c8158c40 2023-12-24T20:10:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.522+0000 7fc3c7fff700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c8158c40 0x7fc3c80cf500 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099b0 tx=0x7fc3b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee99c1912682edcb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3c6ffd700 1 -- 172.21.15.50:0/3953576714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800b860 con 0x7fc3c8158c40 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3c6ffd700 1 -- 172.21.15.50:0/3953576714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800b9c0 con 0x7fc3c8158c40 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3c6ffd700 1 -- 172.21.15.50:0/3953576714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800bd60 con 0x7fc3c8158c40 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- 172.21.15.50:0/3953576714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c8158c40 msgr2=0x7fc3c80cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c8158c40 0x7fc3c80cf500 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099b0 tx=0x7fc3b8009250 comp rx=0 tx=0).stop 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- 172.21.15.50:0/3953576714 shutdown_connections 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3953576714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c8158c40 0x7fc3c80cf500 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- 172.21.15.50:0/3953576714 >> 172.21.15.50:0/3953576714 conn(0x7fc3c80d0800 msgr2=0x7fc3c80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- 172.21.15.50:0/3953576714 shutdown_connections 2023-12-24T20:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- 172.21.15.50:0/3953576714 wait complete. 2023-12-24T20:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 Processor -- start 2023-12-24T20:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.526+0000 7fc3cd123700 1 -- start start 2023-12-24T20:10:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c8088ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c80cc780 0x7fc3c808a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80876e0 con 0x7fc3c81539c0 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80897b0 con 0x7fc3c80cc780 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80894d0 con 0x7fc3c806d450 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45976/0 (socket says 172.21.15.50:45976) 2023-12-24T20:10:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3c7fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c8088ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 -- 172.21.15.50:0/3254540422 learned_addr learned my addr 172.21.15.50:0/3254540422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c80cc780 0x7fc3c808a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 -- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 msgr2=0x7fc3c8088ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c8088ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 -- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c80cc780 msgr2=0x7fc3c808a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c80cc780 0x7fc3c808a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:21.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 -- 172.21.15.50:0/3254540422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80094f0 con 0x7fc3c81539c0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cc922700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fa0 tx=0x7fc3c0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000ebc0 con 0x7fc3c81539c0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000ed20 con 0x7fc3c81539c0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8087090 con 0x7fc3c81539c0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0014670 con 0x7fc3c81539c0 2023-12-24T20:10:21.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.530+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c808af30 con 0x7fc3c81539c0 2023-12-24T20:10:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.534+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c804be40 con 0x7fc3c81539c0 2023-12-24T20:10:21.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.534+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc3c00149e0 con 0x7fc3c81539c0 2023-12-24T20:10:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.534+0000 7fc3affff700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 0x7fc3b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.534+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fc3c007d170 con 0x7fc3c81539c0 2023-12-24T20:10:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.538+0000 7fc3c7fff700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 0x7fc3b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.538+0000 7fc3c7fff700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 0x7fc3b4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099b0 tx=0x7fc3b8017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.542+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3c004d410 con 0x7fc3c81539c0 2023-12-24T20:10:21.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:21.750+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3c8087820 con 0x7fc3c81539c0 2023-12-24T20:10:22.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.306+0000 7fc3affff700 1 -- 172.21.15.50:0/3254540422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v100) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc3c0050a30 con 0x7fc3c81539c0 2023-12-24T20:10:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 msgr2=0x7fc3b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 0x7fc3b4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099b0 tx=0x7fc3b8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 msgr2=0x7fc3c8087b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fa0 tx=0x7fc3c0009900 comp rx=0 tx=0).stop 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 shutdown_connections 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3b4060550 0x7fc3b4062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c81539c0 0x7fc3c8087b70 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c80cc780 0x7fc3c808a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 --2- 172.21.15.50:0/3254540422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c806d450 0x7fc3c8088ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.314+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 >> 172.21.15.50:0/3254540422 conn(0x7fc3c80d0800 msgr2=0x7fc3c80b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:22.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.318+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 shutdown_connections 2023-12-24T20:10:22.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.318+0000 7fc3cd123700 1 -- 172.21.15.50:0/3254540422 wait complete. 2023-12-24T20:10:22.326 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 25 and data pool 26 2023-12-24T20:10:22.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.506+0000 7fae8640c700 1 Processor -- start 2023-12-24T20:10:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8640c700 1 -- start start 2023-12-24T20:10:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8640c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae8015a2d0 0x7fae800ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8640c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800b0460 con 0x7fae8006c820 2023-12-24T20:10:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8640c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8006a5c0 con 0x7fae800ade60 2023-12-24T20:10:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8640c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8006d8c0 con 0x7fae8015a2d0 2023-12-24T20:10:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae84c09700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae8006c820 0x7fae800ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58550/0 (socket says 172.21.15.50:58550) 2023-12-24T20:10:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae84c09700 1 -- 172.21.15.50:0/1658818812 learned_addr learned my addr 172.21.15.50:0/1658818812 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8540a700 1 --2- 172.21.15.50:0/1658818812 >> v2:172.21.15.50:3300/0 conn(0x7fae8015a2d0 0x7fae800ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae77fff700 1 -- 172.21.15.50:0/1658818812 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632133704 0 0) 0x7fae800b0460 con 0x7fae8006c820 2023-12-24T20:10:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae77fff700 1 -- 172.21.15.50:0/1658818812 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c003570 con 0x7fae8006c820 2023-12-24T20:10:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8540a700 1 -- 172.21.15.50:0/1658818812 >> v1:172.21.15.82:6789/0 conn(0x7fae800ade60 legacy=0x7fae80160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8540a700 1 -- 172.21.15.50:0/1658818812 >> v1:172.21.15.50:6789/0 conn(0x7fae8006c820 legacy=0x7fae800ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.510+0000 7fae8540a700 1 -- 172.21.15.50:0/1658818812 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8006ccb0 con 0x7fae8015a2d0 2023-12-24T20:10:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8540a700 1 --2- 172.21.15.50:0/1658818812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae8015a2d0 0x7fae800ae8b0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098e0 tx=0x7fae7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4730ce068ee8bf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae77fff700 1 -- 172.21.15.50:0/1658818812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00b640 con 0x7fae8015a2d0 2023-12-24T20:10:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae77fff700 1 -- 172.21.15.50:0/1658818812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00b7a0 con 0x7fae8015a2d0 2023-12-24T20:10:22.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae77fff700 1 -- 172.21.15.50:0/1658818812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00bb40 con 0x7fae8015a2d0 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 -- 172.21.15.50:0/1658818812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae8015a2d0 msgr2=0x7fae800ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 --2- 172.21.15.50:0/1658818812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae8015a2d0 0x7fae800ae8b0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098e0 tx=0x7fae7c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 -- 172.21.15.50:0/1658818812 shutdown_connections 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 --2- 172.21.15.50:0/1658818812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae8015a2d0 0x7fae800ae8b0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 -- 172.21.15.50:0/1658818812 >> 172.21.15.50:0/1658818812 conn(0x7fae80067b80 msgr2=0x7fae800cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 -- 172.21.15.50:0/1658818812 shutdown_connections 2023-12-24T20:10:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.514+0000 7fae8640c700 1 -- 172.21.15.50:0/1658818812 wait complete. 2023-12-24T20:10:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 Processor -- start 2023-12-24T20:10:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 -- start start 2023-12-24T20:10:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae8006c820 0x7fae80153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae8015a2d0 0x7fae800cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80169420 con 0x7fae800ade60 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8015b000 con 0x7fae8015a2d0 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae8640c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800aaae0 con 0x7fae8006c820 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae84c09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.518+0000 7fae84c09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45998/0 (socket says 172.21.15.50:45998) 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 -- 172.21.15.50:0/1224843979 learned_addr learned my addr 172.21.15.50:0/1224843979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae8540a700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae8006c820 0x7fae80153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae85c0b700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae8015a2d0 0x7fae800cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 -- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae8006c820 msgr2=0x7fae80153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae8006c820 0x7fae80153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 -- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae8015a2d0 msgr2=0x7fae800cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae8015a2d0 0x7fae800cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 -- 172.21.15.50:0/1224843979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009420 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae84c09700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c7c0 tx=0x7fae70007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70005cd0 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70005e30 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae800aadc0 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70007320 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8015a710 con 0x7fae800ade60 2023-12-24T20:10:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.522+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8015b170 con 0x7fae800ade60 2023-12-24T20:10:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.526+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fae70007690 con 0x7fae800ade60 2023-12-24T20:10:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.526+0000 7fae757fa700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 0x7fae64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.530+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fae7007c1c0 con 0x7fae800ade60 2023-12-24T20:10:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.530+0000 7fae8540a700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 0x7fae64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.530+0000 7fae8540a700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 0x7fae64062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0093f0 tx=0x7fae7c017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.534+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae7004c400 con 0x7fae800ade60 2023-12-24T20:10:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.714+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae8004be40 con 0x7fae800ade60 2023-12-24T20:10:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae757fa700 1 -- 172.21.15.50:0/1224843979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+16242 (secure 0 0 0) 0x7fae7004fa20 con 0x7fae800ade60 2023-12-24T20:10:22.719 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:22.719 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":207,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:21.756967+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 msgr2=0x7fae64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 0x7fae64062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0093f0 tx=0x7fae7c017000 comp rx=0 tx=0).stop 2023-12-24T20:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 msgr2=0x7fae800ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c7c0 tx=0x7fae70007e00 comp rx=0 tx=0).stop 2023-12-24T20:10:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 shutdown_connections 2023-12-24T20:10:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fae64060550 0x7fae64062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae8015a2d0 0x7fae800cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae800ade60 0x7fae800ca8d0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 --2- 172.21.15.50:0/1224843979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae8006c820 0x7fae80153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 >> 172.21.15.50:0/1224843979 conn(0x7fae80067b80 msgr2=0x7fae800a89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 shutdown_connections 2023-12-24T20:10:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.718+0000 7fae8640c700 1 -- 172.21.15.50:0/1224843979 wait complete. 2023-12-24T20:10:22.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.906+0000 7feaa0c2e700 1 Processor -- start 2023-12-24T20:10:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.906+0000 7feaa0c2e700 1 -- start start 2023-12-24T20:10:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c13f550 0x7fea9c0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea9c13f920 0x7fea9c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c06c090 con 0x7fea9c0cb3c0 2023-12-24T20:10:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c06a6a0 con 0x7fea9c13f920 2023-12-24T20:10:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0cb8a0 con 0x7fea9c13f550 2023-12-24T20:10:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea9c13f920 0x7fea9c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea9c0cb3c0 0x7fea9c06b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58558/0 (socket says 172.21.15.50:58558) 2023-12-24T20:10:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9ad9d700 1 -- 172.21.15.50:0/3143576663 learned_addr learned my addr 172.21.15.50:0/3143576663 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9a59c700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c13f550 0x7fea9c0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 -- 172.21.15.50:0/3143576663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c13f550 msgr2=0x7fea9c0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c13f550 0x7fea9c0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 -- 172.21.15.50:0/3143576663 >> v1:172.21.15.50:6789/0 conn(0x7fea9c0cb3c0 legacy=0x7fea9c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 -- 172.21.15.50:0/3143576663 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c06a960 con 0x7fea9c13f920 2023-12-24T20:10:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea99d9b700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c06b440 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fea900098e0 tx=0x7fea900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2ce686fcf219a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9959a700 1 -- 172.21.15.50:0/3143576663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90009e80 con 0x7fea9c13f920 2023-12-24T20:10:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9959a700 1 -- 172.21.15.50:0/3143576663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000b860 con 0x7fea9c13f920 2023-12-24T20:10:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7fea9959a700 1 -- 172.21.15.50:0/3143576663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000bbe0 con 0x7fea9c13f920 2023-12-24T20:10:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3143576663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 msgr2=0x7fea9c06b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.910+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c06b440 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fea900098e0 tx=0x7fea900091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3143576663 shutdown_connections 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c06b440 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3143576663 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c13f550 0x7fea9c0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3143576663 >> 172.21.15.50:0/3143576663 conn(0x7fea9c0cbba0 msgr2=0x7fea9c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3143576663 shutdown_connections 2023-12-24T20:10:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3143576663 wait complete. 2023-12-24T20:10:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 Processor -- start 2023-12-24T20:10:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- start start 2023-12-24T20:10:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c0cb3c0 0x7fea9c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 0x7fea9c0c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c156040 con 0x7fea9c13f920 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c3a30 con 0x7fea9c13f550 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7feaa0c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c3f20 con 0x7fea9c0cb3c0 2023-12-24T20:10:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7fea9ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7fea9ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46016/0 (socket says 172.21.15.50:46016) 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7fea9ad9d700 1 -- 172.21.15.50:0/3773709567 learned_addr learned my addr 172.21.15.50:0/3773709567 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7fea99d9b700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 0x7fea9c0c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.914+0000 7fea9a59c700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c0cb3c0 0x7fea9c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 -- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c0cb3c0 msgr2=0x7fea9c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c0cb3c0 0x7fea9c155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 -- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 msgr2=0x7fea9c0c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 0x7fea9c0c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 -- 172.21.15.50:0/3773709567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009420 con 0x7fea9c13f920 2023-12-24T20:10:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea99d9b700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 0x7fea9c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea9ad9d700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c590 tx=0x7fea94007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94005b30 con 0x7fea9c13f920 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94005c90 con 0x7fea9c13f920 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94007320 con 0x7fea9c13f920 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c157bc0 con 0x7fea9c13f920 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c157570 con 0x7fea9c13f920 2023-12-24T20:10:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.918+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c157d50 con 0x7fea9c13f920 2023-12-24T20:10:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.922+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fea9401b3b0 con 0x7fea9c13f920 2023-12-24T20:10:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.922+0000 7fea8a7fc700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 0x7fea7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.922+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fea9407bf30 con 0x7fea9c13f920 2023-12-24T20:10:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.922+0000 7fea9a59c700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 0x7fea7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.922+0000 7fea9a59c700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 0x7fea7c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0075a0 tx=0x7fea8c0097a0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:22.930+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea9404c210 con 0x7fea9c13f920 2023-12-24T20:10:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.106+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea9c0652e0 con 0x7fea9c13f920 2023-12-24T20:10:23.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.106+0000 7fea8a7fc700 1 -- 172.21.15.50:0/3773709567 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+16229 (secure 0 0 0) 0x7fea94017090 con 0x7fea9c13f920 2023-12-24T20:10:23.110 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:23.110 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":208,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:23.016866+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 msgr2=0x7fea7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 0x7fea7c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0075a0 tx=0x7fea8c0097a0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 msgr2=0x7fea9c137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c590 tx=0x7fea94007ec0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 shutdown_connections 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fea7c060550 0x7fea7c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9c13f920 0x7fea9c137450 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea9c13f550 0x7fea9c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 --2- 172.21.15.50:0/3773709567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea9c0cb3c0 0x7fea9c155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 >> 172.21.15.50:0/3773709567 conn(0x7fea9c0cbba0 msgr2=0x7fea9c13e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 shutdown_connections 2023-12-24T20:10:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.110+0000 7feaa0c2e700 1 -- 172.21.15.50:0/3773709567 wait complete. 2023-12-24T20:10:23.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:10:23.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.302+0000 7fc3f52f0700 1 Processor -- start 2023-12-24T20:10:23.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.302+0000 7fc3f52f0700 1 -- start start 2023-12-24T20:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3f52f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3f006b220 0x7fc3f00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3f52f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f00ccac0 0x7fc3f015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3f52f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f00ccf40 con 0x7fc3f0158ab0 2023-12-24T20:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3f52f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f006a530 con 0x7fc3f00ccac0 2023-12-24T20:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3f52f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f015d8d0 con 0x7fc3f006b220 2023-12-24T20:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f00ccac0 0x7fc3f015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ee7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3f006b220 0x7fc3f00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f00ccac0 0x7fc3f015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46024/0 (socket says 172.21.15.50:46024) 2023-12-24T20:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/699543288 learned_addr learned my addr 172.21.15.50:0/699543288 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3eeffd700 1 --1- 172.21.15.50:0/699543288 >> v1:172.21.15.82:6789/0 conn(0x7fc3f0158ab0 0x7fc3f0158e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51870/0 (socket says 172.21.15.50:51870) 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/699543288 >> v2:172.21.15.82:3300/0 conn(0x7fc3f006b220 msgr2=0x7fc3f00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 --2- 172.21.15.50:0/699543288 >> v2:172.21.15.82:3300/0 conn(0x7fc3f006b220 0x7fc3f00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/699543288 >> v1:172.21.15.82:6789/0 conn(0x7fc3f0158ab0 legacy=0x7fc3f0158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/699543288 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f006a740 con 0x7fc3f00ccac0 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.306+0000 7fc3edffb700 1 -- 172.21.15.50:0/699543288 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854390686 0 0) 0x7fc3f00ccf40 con 0x7fc3f0158ab0 2023-12-24T20:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3ef7fe700 1 --2- 172.21.15.50:0/699543288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f00ccac0 0x7fc3f015cbc0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009f20 tx=0x7fc3e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffde6538c42a749 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3edffb700 1 -- 172.21.15.50:0/699543288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800e070 con 0x7fc3f00ccac0 2023-12-24T20:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3edffb700 1 -- 172.21.15.50:0/699543288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800b990 con 0x7fc3f00ccac0 2023-12-24T20:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3edffb700 1 -- 172.21.15.50:0/699543288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80092e0 con 0x7fc3f00ccac0 2023-12-24T20:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 -- 172.21.15.50:0/699543288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f00ccac0 msgr2=0x7fc3f015cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/699543288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f00ccac0 0x7fc3f015cbc0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009f20 tx=0x7fc3e8009840 comp rx=0 tx=0).stop 2023-12-24T20:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 -- 172.21.15.50:0/699543288 shutdown_connections 2023-12-24T20:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/699543288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f00ccac0 0x7fc3f015cbc0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/699543288 >> v2:172.21.15.82:3300/0 conn(0x7fc3f006b220 0x7fc3f00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 -- 172.21.15.50:0/699543288 >> 172.21.15.50:0/699543288 conn(0x7fc3f00670b0 msgr2=0x7fc3f00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 -- 172.21.15.50:0/699543288 shutdown_connections 2023-12-24T20:10:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.310+0000 7fc3f52f0700 1 -- 172.21.15.50:0/699543288 wait complete. 2023-12-24T20:10:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 Processor -- start 2023-12-24T20:10:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 -- start start 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3f006b220 0x7fc3f00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3f00ccac0 0x7fc3f00c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00ce000 con 0x7fc3f0158ab0 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00d0040 con 0x7fc3f006b220 2023-12-24T20:10:23.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3f52f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00c54a0 con 0x7fc3f00ccac0 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46032/0 (socket says 172.21.15.50:46032) 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/3689731290 learned_addr learned my addr 172.21.15.50:0/3689731290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3eeffd700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3f006b220 0x7fc3f00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.314+0000 7fc3ee7fc700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3f00ccac0 0x7fc3f00c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3f00ccac0 msgr2=0x7fc3f00c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3f00ccac0 0x7fc3f00c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3f006b220 msgr2=0x7fc3f00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3f006b220 0x7fc3f00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 -- 172.21.15.50:0/3689731290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8009ae0 con 0x7fc3f0158ab0 2023-12-24T20:10:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.318+0000 7fc3ef7fe700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0159620 tx=0x7fc3e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8008ad0 con 0x7fc3f0158ab0 2023-12-24T20:10:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f00d0270 con 0x7fc3f0158ab0 2023-12-24T20:10:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f00d0830 con 0x7fc3f0158ab0 2023-12-24T20:10:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8008e40 con 0x7fc3f0158ab0 2023-12-24T20:10:23.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8026460 con 0x7fc3f0158ab0 2023-12-24T20:10:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f004be40 con 0x7fc3f0158ab0 2023-12-24T20:10:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc3e8003040 con 0x7fc3f0158ab0 2023-12-24T20:10:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 0x7fc3dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.322+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fc3e807e9a0 con 0x7fc3f0158ab0 2023-12-24T20:10:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.326+0000 7fc3eeffd700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 0x7fc3dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.326+0000 7fc3eeffd700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 0x7fc3dc062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0007180 tx=0x7fc3e0007ef0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.330+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3e804ec80 con 0x7fc3f0158ab0 2023-12-24T20:10:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:23.542+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3f006b960 con 0x7fc3f0158ab0 2023-12-24T20:10:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.342+0000 7fc3d6ffd700 1 -- 172.21.15.50:0/3689731290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3e80522a0 con 0x7fc3f0158ab0 2023-12-24T20:10:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 msgr2=0x7fc3dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 0x7fc3dc062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0007180 tx=0x7fc3e0007ef0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 msgr2=0x7fc3f0157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0159620 tx=0x7fc3e8018000 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 shutdown_connections 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc3dc060550 0x7fc3dc062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f0158ab0 0x7fc3f0157090 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3f00ccac0 0x7fc3f00c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 --2- 172.21.15.50:0/3689731290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3f006b220 0x7fc3f00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 >> 172.21.15.50:0/3689731290 conn(0x7fc3f00670b0 msgr2=0x7fc3f00b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 shutdown_connections 2023-12-24T20:10:24.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.346+0000 7fc3f52f0700 1 -- 172.21.15.50:0/3689731290 wait complete. 2023-12-24T20:10:24.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:10:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 Processor -- start 2023-12-24T20:10:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 -- start start 2023-12-24T20:10:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 0x7fa7e0161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e015b5a0 con 0x7fa7e0156ab0 2023-12-24T20:10:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e015a990 con 0x7fa7e0156e80 2023-12-24T20:10:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.550+0000 7fa7dffff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e015ac70 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7deffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa7e0156ab0 0x7fa7e00adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58572/0 (socket says 172.21.15.50:58572) 2023-12-24T20:10:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7deffd700 1 -- 172.21.15.50:0/3725823033 learned_addr learned my addr 172.21.15.50:0/3725823033 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7df7fe700 1 --2- 172.21.15.50:0/3725823033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 0x7fa7e0161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7ddffb700 1 -- 172.21.15.50:0/3725823033 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315888061 0 0) 0x7fa7e015b5a0 con 0x7fa7e0156ab0 2023-12-24T20:10:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7df7fe700 1 -- 172.21.15.50:0/3725823033 >> v1:172.21.15.82:6789/0 conn(0x7fa7e0156e80 legacy=0x7fa7e00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7df7fe700 1 -- 172.21.15.50:0/3725823033 >> v1:172.21.15.50:6789/0 conn(0x7fa7e0156ab0 legacy=0x7fa7e00adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7df7fe700 1 -- 172.21.15.50:0/3725823033 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e015af50 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7df7fe700 1 --2- 172.21.15.50:0/3725823033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 0x7fa7e0161c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e10 tx=0x7fa7d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69dfea022fa42c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7ddffb700 1 -- 172.21.15.50:0/3725823033 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800e070 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7ddffb700 1 -- 172.21.15.50:0/3725823033 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800bbb0 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7ddffb700 1 -- 172.21.15.50:0/3725823033 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8012430 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7dffff700 1 -- 172.21.15.50:0/3725823033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 msgr2=0x7fa7e0161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.554+0000 7fa7dffff700 1 --2- 172.21.15.50:0/3725823033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 0x7fa7e0161c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e10 tx=0x7fa7d8009780 comp rx=0 tx=0).stop 2023-12-24T20:10:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 -- 172.21.15.50:0/3725823033 shutdown_connections 2023-12-24T20:10:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 --2- 172.21.15.50:0/3725823033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e00c8ee0 0x7fa7e0161c30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 -- 172.21.15.50:0/3725823033 >> 172.21.15.50:0/3725823033 conn(0x7fa7e0067250 msgr2=0x7fa7e0067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 -- 172.21.15.50:0/3725823033 shutdown_connections 2023-12-24T20:10:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 -- 172.21.15.50:0/3725823033 wait complete. 2023-12-24T20:10:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 Processor -- start 2023-12-24T20:10:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.558+0000 7fa7dffff700 1 -- start start 2023-12-24T20:10:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00c8ee0 0x7fa7e01520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e0156e80 0x7fa7e01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00afd60 con 0x7fa7e0156ab0 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01525f0 con 0x7fa7e00c8ee0 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00af150 con 0x7fa7e0156e80 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46036/0 (socket says 172.21.15.50:46036) 2023-12-24T20:10:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 -- 172.21.15.50:0/2629329694 learned_addr learned my addr 172.21.15.50:0/2629329694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7df7fe700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e0156e80 0x7fa7e01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7deffd700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00c8ee0 0x7fa7e01520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 -- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e0156e80 msgr2=0x7fa7e01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e0156e80 0x7fa7e01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 -- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00c8ee0 msgr2=0x7fa7e01520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00c8ee0 0x7fa7e01520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 -- 172.21.15.50:0/2629329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009a20 con 0x7fa7e0156ab0 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7de7fc700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c810 tx=0x7fa7d4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011590 con 0x7fa7e0156ab0 2023-12-24T20:10:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4011730 con 0x7fa7e0156ab0 2023-12-24T20:10:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e00af430 con 0x7fa7e0156ab0 2023-12-24T20:10:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011af0 con 0x7fa7e0156ab0 2023-12-24T20:10:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.562+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e00af9f0 con 0x7fa7e0156ab0 2023-12-24T20:10:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.566+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e004be40 con 0x7fa7e0156ab0 2023-12-24T20:10:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.570+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa7d4012420 con 0x7fa7e0156ab0 2023-12-24T20:10:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.570+0000 7fa7c6ffd700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 0x7fa7cc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.570+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fa7d407bf10 con 0x7fa7e0156ab0 2023-12-24T20:10:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.570+0000 7fa7deffd700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 0x7fa7cc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.570+0000 7fa7deffd700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 0x7fa7cc062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007fd0 tx=0x7fa7d0007d10 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.578+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa7d4049be0 con 0x7fa7e0156ab0 2023-12-24T20:10:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:24.790+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa7e00ac610 con 0x7fa7e0156ab0 2023-12-24T20:10:25.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.358+0000 7fa7c6ffd700 1 -- 172.21.15.50:0/2629329694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7d4017020 con 0x7fa7e0156ab0 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 msgr2=0x7fa7cc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 0x7fa7cc062a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007fd0 tx=0x7fa7d0007d10 comp rx=0 tx=0).stop 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 msgr2=0x7fa7e0159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c810 tx=0x7fa7d4007f30 comp rx=0 tx=0).stop 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 shutdown_connections 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa7cc060580 0x7fa7cc062a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7e0156e80 0x7fa7e01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e0156ab0 0x7fa7e0159a90 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 --2- 172.21.15.50:0/2629329694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00c8ee0 0x7fa7e01520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 >> 172.21.15.50:0/2629329694 conn(0x7fa7e0067250 msgr2=0x7fa7e0150900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 shutdown_connections 2023-12-24T20:10:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.362+0000 7fa7dffff700 1 -- 172.21.15.50:0/2629329694 wait complete. 2023-12-24T20:10:25.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:25.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.558+0000 7fee5a945700 1 Processor -- start 2023-12-24T20:10:25.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.558+0000 7fee5a945700 1 -- start start 2023-12-24T20:10:25.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee5a945700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee541592d0 0x7fee5406ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee5a945700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee540c54d0 0x7fee540c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee5a945700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5415d660 con 0x7fee5406a760 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee5a945700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5415cda0 con 0x7fee541592d0 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee5a945700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5415d010 con 0x7fee540c54d0 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee53fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fee5406a760 0x7fee54158bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58580/0 (socket says 172.21.15.50:58580) 2023-12-24T20:10:25.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee53fff700 1 -- 172.21.15.50:0/2431751747 learned_addr learned my addr 172.21.15.50:0/2431751747 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:25.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 --2- 172.21.15.50:0/2431751747 >> v2:172.21.15.50:3300/0 conn(0x7fee541592d0 0x7fee5406ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee58ee2700 1 --2- 172.21.15.50:0/2431751747 >> v2:172.21.15.82:3300/0 conn(0x7fee540c54d0 0x7fee540c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee52ffd700 1 -- 172.21.15.50:0/2431751747 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694135833 0 0) 0x7fee5415d660 con 0x7fee5406a760 2023-12-24T20:10:25.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee52ffd700 1 -- 172.21.15.50:0/2431751747 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c003570 con 0x7fee5406a760 2023-12-24T20:10:25.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 -- 172.21.15.50:0/2431751747 >> v2:172.21.15.82:3300/0 conn(0x7fee540c54d0 msgr2=0x7fee540c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:25.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 --2- 172.21.15.50:0/2431751747 >> v2:172.21.15.82:3300/0 conn(0x7fee540c54d0 0x7fee540c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 -- 172.21.15.50:0/2431751747 >> v1:172.21.15.50:6789/0 conn(0x7fee5406a760 legacy=0x7fee54158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 -- 172.21.15.50:0/2431751747 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5415d2f0 con 0x7fee541592d0 2023-12-24T20:10:25.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.562+0000 7fee537fe700 1 --2- 172.21.15.50:0/2431751747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee541592d0 0x7fee5406ab30 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fee540d0ce0 tx=0x7fee480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6dca8eda6617fa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:25.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee52ffd700 1 -- 172.21.15.50:0/2431751747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48011630 con 0x7fee541592d0 2023-12-24T20:10:25.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee52ffd700 1 -- 172.21.15.50:0/2431751747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee480117b0 con 0x7fee541592d0 2023-12-24T20:10:25.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee52ffd700 1 -- 172.21.15.50:0/2431751747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48011b70 con 0x7fee541592d0 2023-12-24T20:10:25.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 -- 172.21.15.50:0/2431751747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee541592d0 msgr2=0x7fee5406ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 --2- 172.21.15.50:0/2431751747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee541592d0 0x7fee5406ab30 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fee540d0ce0 tx=0x7fee480091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 -- 172.21.15.50:0/2431751747 shutdown_connections 2023-12-24T20:10:25.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 --2- 172.21.15.50:0/2431751747 >> v2:172.21.15.82:3300/0 conn(0x7fee540c54d0 0x7fee540c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 --2- 172.21.15.50:0/2431751747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee541592d0 0x7fee5406ab30 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 -- 172.21.15.50:0/2431751747 >> 172.21.15.50:0/2431751747 conn(0x7fee54067b80 msgr2=0x7fee540cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:25.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 -- 172.21.15.50:0/2431751747 shutdown_connections 2023-12-24T20:10:25.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 -- 172.21.15.50:0/2431751747 wait complete. 2023-12-24T20:10:25.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.566+0000 7fee5a945700 1 Processor -- start 2023-12-24T20:10:25.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- start start 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 0x7fee540c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee541592d0 0x7fee541569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415c350 con 0x7fee540c54d0 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c8040 con 0x7fee5406a760 2023-12-24T20:10:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c8320 con 0x7fee541592d0 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46054/0 (socket says 172.21.15.50:46054) 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 -- 172.21.15.50:0/708449927 learned_addr learned my addr 172.21.15.50:0/708449927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee53fff700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 0x7fee540c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee58ee2700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee541592d0 0x7fee541569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 -- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee541592d0 msgr2=0x7fee541569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee541592d0 0x7fee541569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 -- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 msgr2=0x7fee540c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 0x7fee540c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 -- 172.21.15.50:0/708449927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009420 con 0x7fee540c54d0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee53fff700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 0x7fee540c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee537fe700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fee48013000 tx=0x7fee48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4801f070 con 0x7fee540c54d0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48000bc0 con 0x7fee540c54d0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540c8600 con 0x7fee540c54d0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48011b70 con 0x7fee540c54d0 2023-12-24T20:10:25.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.570+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540c8bc0 con 0x7fee540c54d0 2023-12-24T20:10:25.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.574+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540c8db0 con 0x7fee540c54d0 2023-12-24T20:10:25.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.574+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fee48023070 con 0x7fee540c54d0 2023-12-24T20:10:25.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.578+0000 7fee3bfff700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 0x7fee40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.578+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fee4807de30 con 0x7fee540c54d0 2023-12-24T20:10:25.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.578+0000 7fee53fff700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 0x7fee40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.578+0000 7fee53fff700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 0x7fee40062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee440058d0 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:25.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.582+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fee4804e070 con 0x7fee540c54d0 2023-12-24T20:10:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.786+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee540652e0 con 0x7fee540c54d0 2023-12-24T20:10:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.790+0000 7fee3bfff700 1 -- 172.21.15.50:0/708449927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7fee48015090 con 0x7fee540c54d0 2023-12-24T20:10:25.791 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:25.791 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 msgr2=0x7fee40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 0x7fee40062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee440058d0 tx=0x7fee44009040 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 msgr2=0x7fee5415be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fee48013000 tx=0x7fee48017000 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 shutdown_connections 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fee40060550 0x7fee40062a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee541592d0 0x7fee541569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee540c54d0 0x7fee5415be10 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 --2- 172.21.15.50:0/708449927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee5406a760 0x7fee540c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 >> 172.21.15.50:0/708449927 conn(0x7fee54067b80 msgr2=0x7fee540cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 shutdown_connections 2023-12-24T20:10:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.794+0000 7fee5a945700 1 -- 172.21.15.50:0/708449927 wait complete. 2023-12-24T20:10:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:25.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 Processor -- start 2023-12-24T20:10:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 -- start start 2023-12-24T20:10:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd25406aca0 0x7fd25406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25406c820 con 0x7fd2540c6d00 2023-12-24T20:10:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25406b960 con 0x7fd25406aca0 2023-12-24T20:10:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.990+0000 7fd258cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25406bc40 con 0x7fd254154b60 2023-12-24T20:10:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd25406aca0 0x7fd25406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd251d9b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2540c6d00 0x7fd254154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51892/0 (socket says 172.21.15.50:51892) 2023-12-24T20:10:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25259c700 1 -- 172.21.15.50:0/1804418793 learned_addr learned my addr 172.21.15.50:0/1804418793 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 -- 172.21.15.50:0/1804418793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 msgr2=0x7fd2540c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 --2- 172.21.15.50:0/1804418793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 -- 172.21.15.50:0/1804418793 >> v1:172.21.15.82:6789/0 conn(0x7fd2540c6d00 legacy=0x7fd254154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 -- 172.21.15.50:0/1804418793 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25406bf20 con 0x7fd25406aca0 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25159a700 1 -- 172.21.15.50:0/1804418793 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285373250 0 0) 0x7fd25406c820 con 0x7fd2540c6d00 2023-12-24T20:10:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd252d9d700 1 --2- 172.21.15.50:0/1804418793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd25406aca0 0x7fd25406b100 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009e60 tx=0x7fd24c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a830b4e70aa9397c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25159a700 1 -- 172.21.15.50:0/1804418793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00e070 con 0x7fd25406aca0 2023-12-24T20:10:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25159a700 1 -- 172.21.15.50:0/1804418793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c00bb60 con 0x7fd25406aca0 2023-12-24T20:10:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd25159a700 1 -- 172.21.15.50:0/1804418793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c012430 con 0x7fd25406aca0 2023-12-24T20:10:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd258cf0700 1 -- 172.21.15.50:0/1804418793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd25406aca0 msgr2=0x7fd25406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.994+0000 7fd258cf0700 1 --2- 172.21.15.50:0/1804418793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd25406aca0 0x7fd25406b100 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009e60 tx=0x7fd24c009780 comp rx=0 tx=0).stop 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- 172.21.15.50:0/1804418793 shutdown_connections 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 --2- 172.21.15.50:0/1804418793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd25406aca0 0x7fd25406b100 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 --2- 172.21.15.50:0/1804418793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- 172.21.15.50:0/1804418793 >> 172.21.15.50:0/1804418793 conn(0x7fd2540cbba0 msgr2=0x7fd2540cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- 172.21.15.50:0/1804418793 shutdown_connections 2023-12-24T20:10:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- 172.21.15.50:0/1804418793 wait complete. 2023-12-24T20:10:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 Processor -- start 2023-12-24T20:10:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- start start 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd25406aca0 0x7fd2540b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540ad9d0 con 0x7fd2540c6d00 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540acdc0 con 0x7fd25406aca0 2023-12-24T20:10:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:25.998+0000 7fd258cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540ad0a0 con 0x7fd254154b60 2023-12-24T20:10:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46086/0 (socket says 172.21.15.50:46086) 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 -- 172.21.15.50:0/3040141830 learned_addr learned my addr 172.21.15.50:0/3040141830 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd25259c700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd25406aca0 0x7fd2540b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd252d9d700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 -- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 msgr2=0x7fd2540ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 -- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd25406aca0 msgr2=0x7fd2540b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd25406aca0 0x7fd2540b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 -- 172.21.15.50:0/3040141830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009a20 con 0x7fd2540c6d00 2023-12-24T20:10:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd252d9d700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd251d9b700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd24800e930 tx=0x7fd2480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248013680 con 0x7fd2540c6d00 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480137e0 con 0x7fd2540c6d00 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2540ad380 con 0x7fd2540c6d00 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248013b80 con 0x7fd2540c6d00 2023-12-24T20:10:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2540ae3a0 con 0x7fd2540c6d00 2023-12-24T20:10:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.002+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540652e0 con 0x7fd2540c6d00 2023-12-24T20:10:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.006+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fd24800c460 con 0x7fd2540c6d00 2023-12-24T20:10:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.006+0000 7fd2427fc700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 0x7fd234062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.006+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fd24807ccd0 con 0x7fd2540c6d00 2023-12-24T20:10:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.006+0000 7fd25259c700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 0x7fd234062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.006+0000 7fd25259c700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 0x7fd234062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd244007fd0 tx=0x7fd244007d30 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.014+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd24804cf10 con 0x7fd2540c6d00 2023-12-24T20:10:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.190+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd25406c200 con 0x7fd2540c6d00 2023-12-24T20:10:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.194+0000 7fd2427fc700 1 -- 172.21.15.50:0/3040141830 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+16229 (secure 0 0 0) 0x7fd248050530 con 0x7fd2540c6d00 2023-12-24T20:10:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:26.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":208,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:23.016866+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 msgr2=0x7fd234062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 0x7fd234062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd244007fd0 tx=0x7fd244007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 msgr2=0x7fd2540ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd24800e930 tx=0x7fd2480091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 shutdown_connections 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fd234060550 0x7fd234062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd254154b60 0x7fd2540ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2540c6d00 0x7fd2540ade60 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 --2- 172.21.15.50:0/3040141830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd25406aca0 0x7fd2540b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 >> 172.21.15.50:0/3040141830 conn(0x7fd2540cbba0 msgr2=0x7fd254153790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 shutdown_connections 2023-12-24T20:10:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.198+0000 7fd258cf0700 1 -- 172.21.15.50:0/3040141830 wait complete. 2023-12-24T20:10:26.219 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:10:26.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.382+0000 7fdf4ecae700 1 Processor -- start 2023-12-24T20:10:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.382+0000 7fdf4ecae700 1 -- start start 2023-12-24T20:10:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ecae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf48158e70 0x7fdf480cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ecae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf480cc6a0 0x7fdf480679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ecae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480686e0 con 0x7fdf48067ef0 2023-12-24T20:10:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ecae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf480ccb20 con 0x7fdf480cc6a0 2023-12-24T20:10:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ecae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf480689c0 con 0x7fdf48158e70 2023-12-24T20:10:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf480cc6a0 0x7fdf480679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf480cc6a0 0x7fdf480679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46096/0 (socket says 172.21.15.50:46096) 2023-12-24T20:10:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 -- 172.21.15.50:0/44972972 learned_addr learned my addr 172.21.15.50:0/44972972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf4ca4a700 1 --2- 172.21.15.50:0/44972972 >> v2:172.21.15.82:3300/0 conn(0x7fdf48158e70 0x7fdf480cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 -- 172.21.15.50:0/44972972 >> v2:172.21.15.82:3300/0 conn(0x7fdf48158e70 msgr2=0x7fdf480cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 --2- 172.21.15.50:0/44972972 >> v2:172.21.15.82:3300/0 conn(0x7fdf48158e70 0x7fdf480cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 -- 172.21.15.50:0/44972972 >> v1:172.21.15.82:6789/0 conn(0x7fdf48067ef0 legacy=0x7fdf480c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 -- 172.21.15.50:0/44972972 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48068ca0 con 0x7fdf480cc6a0 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf47fff700 1 --2- 172.21.15.50:0/44972972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf480cc6a0 0x7fdf480679b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fdf48064a90 tx=0x7fdf34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4015767301d25e93 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf477fe700 1 -- 172.21.15.50:0/44972972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34009e70 con 0x7fdf480cc6a0 2023-12-24T20:10:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf477fe700 1 -- 172.21.15.50:0/44972972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400b860 con 0x7fdf480cc6a0 2023-12-24T20:10:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.386+0000 7fdf477fe700 1 -- 172.21.15.50:0/44972972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400bc00 con 0x7fdf480cc6a0 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 -- 172.21.15.50:0/44972972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf480cc6a0 msgr2=0x7fdf480679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/44972972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf480cc6a0 0x7fdf480679b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fdf48064a90 tx=0x7fdf34009250 comp rx=0 tx=0).stop 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 -- 172.21.15.50:0/44972972 shutdown_connections 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/44972972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf480cc6a0 0x7fdf480679b0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/44972972 >> v2:172.21.15.82:3300/0 conn(0x7fdf48158e70 0x7fdf480cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 -- 172.21.15.50:0/44972972 >> 172.21.15.50:0/44972972 conn(0x7fdf480cdd80 msgr2=0x7fdf480ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 -- 172.21.15.50:0/44972972 shutdown_connections 2023-12-24T20:10:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.390+0000 7fdf4ecae700 1 -- 172.21.15.50:0/44972972 wait complete. 2023-12-24T20:10:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 Processor -- start 2023-12-24T20:10:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 -- start start 2023-12-24T20:10:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf480cc6a0 0x7fdf480c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf48158e70 0x7fdf4815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4816d940 con 0x7fdf48067ef0 2023-12-24T20:10:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480b0460 con 0x7fdf48158e70 2023-12-24T20:10:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ecae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48159240 con 0x7fdf480cc6a0 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ca4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ca4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46110/0 (socket says 172.21.15.50:46110) 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4ca4a700 1 -- 172.21.15.50:0/2620148243 learned_addr learned my addr 172.21.15.50:0/2620148243 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf47fff700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf480cc6a0 0x7fdf480c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.394+0000 7fdf4d24b700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf48158e70 0x7fdf4815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 -- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf480cc6a0 msgr2=0x7fdf480c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf480cc6a0 0x7fdf480c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 -- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf48158e70 msgr2=0x7fdf4815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf48158e70 0x7fdf4815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 -- 172.21.15.50:0/2620148243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340094f0 con 0x7fdf48067ef0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ca4a700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e930 tx=0x7fdf3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c013680 con 0x7fdf48067ef0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c0137e0 con 0x7fdf48067ef0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf480ae440 con 0x7fdf48067ef0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c013b80 con 0x7fdf48067ef0 2023-12-24T20:10:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf480c7bf0 con 0x7fdf48067ef0 2023-12-24T20:10:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.398+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf480652e0 con 0x7fdf48067ef0 2023-12-24T20:10:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.402+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fdf3c00c3e0 con 0x7fdf48067ef0 2023-12-24T20:10:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.402+0000 7fdf44ff9700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 0x7fdf2c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.402+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fdf3c07cc00 con 0x7fdf48067ef0 2023-12-24T20:10:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.402+0000 7fdf47fff700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 0x7fdf2c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.402+0000 7fdf47fff700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 0x7fdf2c062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf48064a90 tx=0x7fdf34017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.410+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdf3c04ce40 con 0x7fdf48067ef0 2023-12-24T20:10:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.582+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf480aeab0 con 0x7fdf2c060580 2023-12-24T20:10:26.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.602+0000 7fdf44ff9700 1 -- 172.21.15.50:0/2620148243 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272218 (secure 0 0 0) 0x7fdf480aeab0 con 0x7fdf2c060580 2023-12-24T20:10:26.608 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.610+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 msgr2=0x7fdf2c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 0x7fdf2c062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf48064a90 tx=0x7fdf34017000 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 msgr2=0x7fdf481539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e930 tx=0x7fdf3c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 shutdown_connections 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fdf2c060580 0x7fdf2c062a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf48158e70 0x7fdf4815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf480cc6a0 0x7fdf480c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 --2- 172.21.15.50:0/2620148243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48067ef0 0x7fdf481539e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 >> 172.21.15.50:0/2620148243 conn(0x7fdf480cdd80 msgr2=0x7fdf481548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 shutdown_connections 2023-12-24T20:10:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.614+0000 7fdf4ecae700 1 -- 172.21.15.50:0/2620148243 wait complete. 2023-12-24T20:10:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:26.637 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T20:10:25.212253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2444520,"kb_used_data":21160,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530200,"statfs":{"total":773094113280,"available":770590924800,"internally_reserved":0,"allocated":21667840,"data_stored":11915848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924484"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1129,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-12-24T20:10:13.241474+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:13.241474+0000","last_peered":"2023-12-24T20:10:13.241474+0000","last_clean":"2023-12-24T20:10:13.241474+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:13.241474+0000","last_undegraded":"2023-12-24T20:10:13.241474+0000","last_fullsized":"2023-12-24T20:10:13.241474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304464,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067376,"statfs":{"total":96636764160,"available":96324993024,"internally_reserved":0,"allocated":3153920,"data_stored":1932257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.71199999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5629999999999999,"5min":1.728,"15min":1.728},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.131,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.369}]},{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.127,"15min":1.161},"min":{"1min":0.69899999999999995,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.494,"5min":1.718,"15min":1.9379999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.532,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.2050000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.238,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.73599999999999999,"15min":0.70899999999999996},"max":{"1min":1.4570000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.048},{"interface":"front","average":{"1min":1.149,"5min":1.2390000000000001,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6899999999999999,"5min":1.7390000000000001,"15min":1.8200000000000001},"last":1.264}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3129999999999999},"min":{"1min":0.93700000000000006,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":1.857,"15min":2.4449999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.319,"15min":1.343},"min":{"1min":1.0109999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.593,"5min":1.988,"15min":2.2919999999999998},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2450000000000001,"15min":1.2090000000000001},"min":{"1min":0.90000000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.647,"5min":1.865,"15min":2.194},"last":1.448},{"interface":"front","average":{"1min":1.373,"5min":1.3340000000000001,"15min":1.278},"min":{"1min":1.0649999999999999,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.6399999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":0.88300000000000001,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.6870000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.393},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4099999999999999,"15min":1.353},"min":{"1min":1.1020000000000001,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":1.95,"15min":1.95},"last":1.518}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":0.97799999999999998,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.8460000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.494,"15min":1.4339999999999999},"min":{"1min":1.01,"5min":0.875,"15min":0.55000000000000004},"max":{"1min":1.7609999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1319999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.8580000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.5189999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6140000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.903},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.403}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":2.258}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.9630000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.655}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":1.4690000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.2929999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.363},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.079}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.1930000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.1140000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.4299999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.534},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.27,"15min":1.286},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":1.577,"5min":1.9490000000000001,"15min":2.012},"last":1.357}]},{"osd":1,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1579999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7629999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.169,"15min":1.155},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.427,"5min":1.621,"15min":1.694},"last":1.5189999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.339},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.788,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3759999999999999,"15min":1.3720000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.835,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.208}]},{"osd":3,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.206,"15min":1.2190000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.155},{"interface":"front","average":{"1min":1.331,"5min":1.3109999999999999,"15min":1.3129999999999999},"min":{"1min":0.96899999999999997,"5min":0.90600000000000003,"15min":0.89100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3009999999999999,"15min":1.3089999999999999},"min":{"1min":0.81499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3400000000000001,"15min":1.3280000000000001},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.0720000000000001,"15min":2.089},"last":1.458}]},{"osd":6,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.28,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":2.0219999999999998,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.389},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.335,"15min":1.3380000000000001},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.3300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.2969999999999999,"15min":1.3100000000000001},"min":{"1min":0.89600000000000002,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.8420000000000001,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.284},{"interface":"front","average":{"1min":1.492,"5min":1.4590000000000001,"15min":1.4350000000000001},"min":{"1min":1.0369999999999999,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.258}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":1.5369999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.1699999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.107},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.3460000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.232},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.478}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.393},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.046},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.121}]}]},{"osd":2,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.359}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.2430000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.497},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.194},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.4530000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":0.89100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304464,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067376,"statfs":{"total":96636764160,"available":96324993024,"internally_reserved":0,"allocated":3153920,"data_stored":1932257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6950000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.67900000000000005,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.651,"5min":1.823,"15min":1.823},"last":1.1419999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.105,"15min":1.095},"min":{"1min":0.72699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.9630000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.157,"15min":1.155},"min":{"1min":0.72699999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.569,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.4359999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.105,"15min":1.1020000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.58199999999999996},"max":{"1min":1.4530000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.2849999999999999,"15min":1.288},"min":{"1min":0.96499999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.389,"15min":1.3879999999999999},"min":{"1min":0.95999999999999996,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.6220000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.325,"15min":1.3280000000000001},"min":{"1min":1.0429999999999999,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6950000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.228}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.4650000000000001,"15min":1.4530000000000001},"min":{"1min":1.288,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.466,"15min":1.456},"min":{"1min":1.099,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.8440000000000001,"5min":1.9099999999999999,"15min":2.125},"last":1.381}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.2150000000000001,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.8089999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.538,"15min":1.524},"min":{"1min":1.216,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.8049999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.5489999999999999,"15min":1.5329999999999999},"min":{"1min":1.28,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":2.1309999999999998,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5329999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8799999999999999,"5min":2.234,"15min":2.411},"last":1.5760000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:26.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:26.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.850+0000 7f0ada1cc700 1 Processor -- start 2023-12-24T20:10:26.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.850+0000 7f0ada1cc700 1 -- start start 2023-12-24T20:10:26.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ada1cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad41611b0 0x7f0ad4161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ada1cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ad40ae100 0x7f0ad406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ada1cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad406c4d0 con 0x7f0ad406c820 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ada1cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad406c1f0 con 0x7f0ad40ae100 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ada1cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40ab5e0 con 0x7f0ad41611b0 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ad40ae100 0x7f0ad406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ad40ae100 0x7f0ad406b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46118/0 (socket says 172.21.15.50:46118) 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 -- 172.21.15.50:0/3045494209 learned_addr learned my addr 172.21.15.50:0/3045494209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad91ca700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad41611b0 0x7f0ad4161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 -- 172.21.15.50:0/3045494209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad41611b0 msgr2=0x7f0ad4161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad41611b0 0x7f0ad4161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 -- 172.21.15.50:0/3045494209 >> v1:172.21.15.82:6789/0 conn(0x7f0ad406c820 legacy=0x7f0ad40ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 -- 172.21.15.50:0/3045494209 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40ab8c0 con 0x7f0ad40ae100 2023-12-24T20:10:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0ad89c9700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad40ae100 0x7f0ad406b9c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40099b0 tx=0x7f0ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fba28dc6eba0e07 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0acbfff700 1 -- 172.21.15.50:0/3045494209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400b860 con 0x7f0ad40ae100 2023-12-24T20:10:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0acbfff700 1 -- 172.21.15.50:0/3045494209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400b9c0 con 0x7f0ad40ae100 2023-12-24T20:10:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.854+0000 7f0acbfff700 1 -- 172.21.15.50:0/3045494209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400bd60 con 0x7f0ad40ae100 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 -- 172.21.15.50:0/3045494209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad40ae100 msgr2=0x7f0ad406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad40ae100 0x7f0ad406b9c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40099b0 tx=0x7f0ac4009250 comp rx=0 tx=0).stop 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 -- 172.21.15.50:0/3045494209 shutdown_connections 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad40ae100 0x7f0ad406b9c0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/3045494209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad41611b0 0x7f0ad4161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 -- 172.21.15.50:0/3045494209 >> 172.21.15.50:0/3045494209 conn(0x7f0ad4067b80 msgr2=0x7f0ad40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 -- 172.21.15.50:0/3045494209 shutdown_connections 2023-12-24T20:10:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.858+0000 7f0ada1cc700 1 -- 172.21.15.50:0/3045494209 wait complete. 2023-12-24T20:10:26.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 Processor -- start 2023-12-24T20:10:26.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 -- start start 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad406c820 0x7f0ad4150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad40ae100 0x7f0ad4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40afc70 con 0x7f0ad41611b0 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad415eec0 con 0x7f0ad40ae100 2023-12-24T20:10:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ada1cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad415f1a0 con 0x7f0ad406c820 2023-12-24T20:10:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ad99cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ad99cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46130/0 (socket says 172.21.15.50:46130) 2023-12-24T20:10:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ad99cb700 1 -- 172.21.15.50:0/1552403741 learned_addr learned my addr 172.21.15.50:0/1552403741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ad89c9700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad40ae100 0x7f0ad4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.862+0000 7f0ad91ca700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad406c820 0x7f0ad4150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 -- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad406c820 msgr2=0x7f0ad4150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad406c820 0x7f0ad4150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 -- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad40ae100 msgr2=0x7f0ad4155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad40ae100 0x7f0ad4155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 -- 172.21.15.50:0/1552403741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40094f0 con 0x7f0ad41611b0 2023-12-24T20:10:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ad99cb700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c560 tx=0x7f0acc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc011590 con 0x7f0ad41611b0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0116f0 con 0x7f0ad41611b0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc011ab0 con 0x7f0ad41611b0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad415f480 con 0x7f0ad41611b0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad4151220 con 0x7f0ad41611b0 2023-12-24T20:10:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.866+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad40afde0 con 0x7f0ad41611b0 2023-12-24T20:10:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.870+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0acc01b3b0 con 0x7f0ad41611b0 2023-12-24T20:10:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.870+0000 7f0ac97fa700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 0x7f0ab8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.870+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f0acc07bd10 con 0x7f0ad41611b0 2023-12-24T20:10:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.870+0000 7f0ad91ca700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 0x7f0ab8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.870+0000 7f0ad91ca700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 0x7f0ab8062a30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00075a0 tx=0x7f0ad00097e0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:26.878+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0acc04bff0 con 0x7f0ad41611b0 2023-12-24T20:10:27.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.046+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ad406c4d0 con 0x7f0ab8060580 2023-12-24T20:10:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.066+0000 7f0ac97fa700 1 -- 172.21.15.50:0/1552403741 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272218 (secure 0 0 0) 0x7f0ad406c4d0 con 0x7f0ab8060580 2023-12-24T20:10:27.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 msgr2=0x7f0ab8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 0x7f0ab8062a30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00075a0 tx=0x7f0ad00097e0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 msgr2=0x7f0ad40aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c560 tx=0x7f0acc007ef0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 shutdown_connections 2023-12-24T20:10:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ab8060580 0x7f0ab8062a30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad41611b0 0x7f0ad40aa5c0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad40ae100 0x7f0ad4155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 --2- 172.21.15.50:0/1552403741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ad406c820 0x7f0ad4150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 >> 172.21.15.50:0/1552403741 conn(0x7f0ad4067b80 msgr2=0x7f0ad406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 shutdown_connections 2023-12-24T20:10:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.074+0000 7f0ada1cc700 1 -- 172.21.15.50:0/1552403741 wait complete. 2023-12-24T20:10:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:27.099 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T20:10:25.212253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2444520,"kb_used_data":21160,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530200,"statfs":{"total":773094113280,"available":770590924800,"internally_reserved":0,"allocated":21667840,"data_stored":11915848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924484"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:21.287966+0000","last_change":"2023-12-24T20:10:21.287966+0000","last_active":"2023-12-24T20:10:21.287966+0000","last_peered":"2023-12-24T20:10:21.287966+0000","last_clean":"2023-12-24T20:10:21.287966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:21.287966+0000","last_undegraded":"2023-12-24T20:10:21.287966+0000","last_fullsized":"2023-12-24T20:10:21.287966+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:10:20.272562+0000","last_change":"2023-12-24T20:10:20.272562+0000","last_active":"2023-12-24T20:10:20.272562+0000","last_peered":"2023-12-24T20:10:20.272562+0000","last_clean":"2023-12-24T20:10:20.272562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:10:20.272562+0000","last_undegraded":"2023-12-24T20:10:20.272562+0000","last_fullsized":"2023-12-24T20:10:20.272562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1129,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-12-24T20:10:13.241474+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:13.241474+0000","last_peered":"2023-12-24T20:10:13.241474+0000","last_clean":"2023-12-24T20:10:13.241474+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:13.241474+0000","last_undegraded":"2023-12-24T20:10:13.241474+0000","last_fullsized":"2023-12-24T20:10:13.241474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304464,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067376,"statfs":{"total":96636764160,"available":96324993024,"internally_reserved":0,"allocated":3153920,"data_stored":1932257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.71199999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5629999999999999,"5min":1.728,"15min":1.728},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.131,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.369}]},{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.127,"15min":1.161},"min":{"1min":0.69899999999999995,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.494,"5min":1.718,"15min":1.9379999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.532,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.2050000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.238,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.73599999999999999,"15min":0.70899999999999996},"max":{"1min":1.4570000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.048},{"interface":"front","average":{"1min":1.149,"5min":1.2390000000000001,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6899999999999999,"5min":1.7390000000000001,"15min":1.8200000000000001},"last":1.264}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3129999999999999},"min":{"1min":0.93700000000000006,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":1.857,"15min":2.4449999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.319,"15min":1.343},"min":{"1min":1.0109999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.593,"5min":1.988,"15min":2.2919999999999998},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2450000000000001,"15min":1.2090000000000001},"min":{"1min":0.90000000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.647,"5min":1.865,"15min":2.194},"last":1.448},{"interface":"front","average":{"1min":1.373,"5min":1.3340000000000001,"15min":1.278},"min":{"1min":1.0649999999999999,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.6399999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":0.88300000000000001,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.6870000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.393},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4099999999999999,"15min":1.353},"min":{"1min":1.1020000000000001,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":1.95,"15min":1.95},"last":1.518}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":0.97799999999999998,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.8460000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.494,"15min":1.4339999999999999},"min":{"1min":1.01,"5min":0.875,"15min":0.55000000000000004},"max":{"1min":1.7609999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1319999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.8580000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.5189999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6140000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.903},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.403}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":2.258}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.9630000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.655}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":1.4690000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.2929999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.363},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.079}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.1930000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.1140000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.4299999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.534},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.27,"15min":1.286},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":1.577,"5min":1.9490000000000001,"15min":2.012},"last":1.357}]},{"osd":1,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1579999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7629999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.169,"15min":1.155},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.427,"5min":1.621,"15min":1.694},"last":1.5189999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.339},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.788,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3759999999999999,"15min":1.3720000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.835,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.208}]},{"osd":3,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.206,"15min":1.2190000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.155},{"interface":"front","average":{"1min":1.331,"5min":1.3109999999999999,"15min":1.3129999999999999},"min":{"1min":0.96899999999999997,"5min":0.90600000000000003,"15min":0.89100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3009999999999999,"15min":1.3089999999999999},"min":{"1min":0.81499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3400000000000001,"15min":1.3280000000000001},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.0720000000000001,"15min":2.089},"last":1.458}]},{"osd":6,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.28,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":2.0219999999999998,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.389},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.335,"15min":1.3380000000000001},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.3300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.2969999999999999,"15min":1.3100000000000001},"min":{"1min":0.89600000000000002,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.8420000000000001,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.284},{"interface":"front","average":{"1min":1.492,"5min":1.4590000000000001,"15min":1.4350000000000001},"min":{"1min":1.0369999999999999,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.258}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":1.5369999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.1699999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.107},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.3460000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.232},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.478}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.393},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.046},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.121}]}]},{"osd":2,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299788,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072052,"statfs":{"total":96636764160,"available":96329781248,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.359}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312076,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059764,"statfs":{"total":96636764160,"available":96317198336,"internally_reserved":0,"allocated":2560000,"data_stored":1341889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.2430000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.497},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.194},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.4530000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":0.89100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304464,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067376,"statfs":{"total":96636764160,"available":96324993024,"internally_reserved":0,"allocated":3153920,"data_stored":1932257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6950000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.67900000000000005,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.651,"5min":1.823,"15min":1.823},"last":1.1419999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.105,"15min":1.095},"min":{"1min":0.72699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.9630000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.157,"15min":1.155},"min":{"1min":0.72699999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.569,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.4359999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.105,"15min":1.1020000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.58199999999999996},"max":{"1min":1.4530000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.2849999999999999,"15min":1.288},"min":{"1min":0.96499999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.389,"15min":1.3879999999999999},"min":{"1min":0.95999999999999996,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.6220000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.325,"15min":1.3280000000000001},"min":{"1min":1.0429999999999999,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6950000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.228}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.4650000000000001,"15min":1.4530000000000001},"min":{"1min":1.288,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.466,"15min":1.456},"min":{"1min":1.099,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.8440000000000001,"5min":1.9099999999999999,"15min":2.125},"last":1.381}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.2150000000000001,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.8089999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.538,"15min":1.524},"min":{"1min":1.216,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.8049999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.5489999999999999,"15min":1.5329999999999999},"min":{"1min":1.28,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":2.1309999999999998,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5329999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8799999999999999,"5min":2.234,"15min":2.411},"last":1.5760000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:27.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.306+0000 7f69f59cc700 1 Processor -- start 2023-12-24T20:10:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 -- start start 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 0x7f69f00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69f00adc90 0x7f69f00b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f006d8c0 con 0x7f69f00adc90 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f00afc60 con 0x7f69f006c820 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f59cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00b0460 con 0x7f69f015a2d0 2023-12-24T20:10:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69f00adc90 0x7f69f00b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69f00adc90 0x7f69f00b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46140/0 (socket says 172.21.15.50:46140) 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 -- 172.21.15.50:0/526516198 learned_addr learned my addr 172.21.15.50:0/526516198 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69e7fff700 1 --2- 172.21.15.50:0/526516198 >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 0x7f69f00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f49ca700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 -- 172.21.15.50:0/526516198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 msgr2=0x7f69f00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 -- 172.21.15.50:0/526516198 >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 msgr2=0x7f69f00ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 --2- 172.21.15.50:0/526516198 >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 0x7f69f00ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69f51cb700 1 -- 172.21.15.50:0/526516198 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00ae100 con 0x7f69f00adc90 2023-12-24T20:10:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.310+0000 7f69e7fff700 1 --2- 172.21.15.50:0/526516198 >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 0x7f69f00ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f51cb700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f00adc90 0x7f69f00b0890 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f69f0067fd0 tx=0x7f69e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a693ec61d97f1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69e77fe700 1 -- 172.21.15.50:0/526516198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800e070 con 0x7f69f00adc90 2023-12-24T20:10:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69e77fe700 1 -- 172.21.15.50:0/526516198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800ba20 con 0x7f69f00adc90 2023-12-24T20:10:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69e77fe700 1 -- 172.21.15.50:0/526516198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e80092e0 con 0x7f69f00adc90 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 -- 172.21.15.50:0/526516198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f00adc90 msgr2=0x7f69f00b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f00adc90 0x7f69f00b0890 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f69f0067fd0 tx=0x7f69e8009840 comp rx=0 tx=0).stop 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 -- 172.21.15.50:0/526516198 shutdown_connections 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 --2- 172.21.15.50:0/526516198 >> v2:172.21.15.82:3300/0 conn(0x7f69f006c820 0x7f69f00ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f00adc90 0x7f69f00b0890 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 --2- 172.21.15.50:0/526516198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 -- 172.21.15.50:0/526516198 >> 172.21.15.50:0/526516198 conn(0x7f69f0067b80 msgr2=0x7f69f00cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 -- 172.21.15.50:0/526516198 shutdown_connections 2023-12-24T20:10:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.314+0000 7f69f59cc700 1 -- 172.21.15.50:0/526516198 wait complete. 2023-12-24T20:10:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 Processor -- start 2023-12-24T20:10:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 -- start start 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f00adc90 0x7f69f0144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00cae10 con 0x7f69f006c820 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00ca200 con 0x7f69f00adc90 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f59cc700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00ca4e0 con 0x7f69f015a2d0 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f49ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f49ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46150/0 (socket says 172.21.15.50:46150) 2023-12-24T20:10:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f49ca700 1 -- 172.21.15.50:0/1974575277 learned_addr learned my addr 172.21.15.50:0/1974575277 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69e7fff700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f00adc90 0x7f69f0144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.318+0000 7f69f51cb700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 -- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 msgr2=0x7f69f00a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 -- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f00adc90 msgr2=0x7f69f0144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f00adc90 0x7f69f0144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 -- 172.21.15.50:0/1974575277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009ae0 con 0x7f69f006c820 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f51cb700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f49ca700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e950 tx=0x7f69ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec013680 con 0x7f69f006c820 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0137e0 con 0x7f69f006c820 2023-12-24T20:10:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f00ca7c0 con 0x7f69f006c820 2023-12-24T20:10:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec013ba0 con 0x7f69f006c820 2023-12-24T20:10:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f00c9e40 con 0x7f69f006c820 2023-12-24T20:10:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.322+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f004be40 con 0x7f69f006c820 2023-12-24T20:10:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.326+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f69ec00c490 con 0x7f69f006c820 2023-12-24T20:10:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.326+0000 7f69e4ff9700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 0x7f69dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.326+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f69ec07cd20 con 0x7f69f006c820 2023-12-24T20:10:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.326+0000 7f69e7fff700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 0x7f69dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.326+0000 7f69e7fff700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 0x7f69dc062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f00aa600 tx=0x7f69e0008040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.334+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f69ec04cf60 con 0x7f69f006c820 2023-12-24T20:10:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.506+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69f00caf50 con 0x7f69dc060550 2023-12-24T20:10:27.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.526+0000 7f69e4ff9700 1 -- 172.21.15.50:0/1974575277 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287142 (secure 0 0 0) 0x7f69e0011700 con 0x7f69dc060550 2023-12-24T20:10:27.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 msgr2=0x7f69dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 0x7f69dc062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f00aa600 tx=0x7f69e0008040 comp rx=0 tx=0).stop 2023-12-24T20:10:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 msgr2=0x7f69f00c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e950 tx=0x7f69ec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 shutdown_connections 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f69dc060550 0x7f69dc062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f015a2d0 0x7f69f00a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f00adc90 0x7f69f0144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 --2- 172.21.15.50:0/1974575277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f006c820 0x7f69f00c9900 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 >> 172.21.15.50:0/1974575277 conn(0x7f69f0067b80 msgr2=0x7f69f006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 shutdown_connections 2023-12-24T20:10:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.538+0000 7f69f59cc700 1 -- 172.21.15.50:0/1974575277 wait complete. 2023-12-24T20:10:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:27.561 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T20:10:27.212935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444968,"kb_used_data":21608,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529752,"statfs":{"total":773094113280,"available":770590466048,"internally_reserved":0,"allocated":22126592,"data_stored":12146372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001964"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048874+0000","last_change":"2023-12-24T20:10:22.043032+0000","last_active":"2023-12-24T20:10:22.048874+0000","last_peered":"2023-12-24T20:10:22.048874+0000","last_clean":"2023-12-24T20:10:22.048874+0000","last_became_active":"2023-12-24T20:10:22.042671+0000","last_became_peered":"2023-12-24T20:10:22.042671+0000","last_unstale":"2023-12-24T20:10:22.048874+0000","last_undegraded":"2023-12-24T20:10:22.048874+0000","last_fullsized":"2023-12-24T20:10:22.048874+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:31.130373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056475+0000","last_change":"2023-12-24T20:10:22.051289+0000","last_active":"2023-12-24T20:10:22.056475+0000","last_peered":"2023-12-24T20:10:22.056475+0000","last_clean":"2023-12-24T20:10:22.056475+0000","last_became_active":"2023-12-24T20:10:22.050964+0000","last_became_peered":"2023-12-24T20:10:22.050964+0000","last_unstale":"2023-12-24T20:10:22.056475+0000","last_undegraded":"2023-12-24T20:10:22.056475+0000","last_fullsized":"2023-12-24T20:10:22.056475+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:24:43.662939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030446+0000","last_change":"2023-12-24T20:10:22.028136+0000","last_active":"2023-12-24T20:10:22.030446+0000","last_peered":"2023-12-24T20:10:22.030446+0000","last_clean":"2023-12-24T20:10:22.030446+0000","last_became_active":"2023-12-24T20:10:22.027797+0000","last_became_peered":"2023-12-24T20:10:22.027797+0000","last_unstale":"2023-12-24T20:10:22.030446+0000","last_undegraded":"2023-12-24T20:10:22.030446+0000","last_fullsized":"2023-12-24T20:10:22.030446+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:08.802080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056390+0000","last_change":"2023-12-24T20:10:22.049583+0000","last_active":"2023-12-24T20:10:22.056390+0000","last_peered":"2023-12-24T20:10:22.056390+0000","last_clean":"2023-12-24T20:10:22.056390+0000","last_became_active":"2023-12-24T20:10:22.049302+0000","last_became_peered":"2023-12-24T20:10:22.049302+0000","last_unstale":"2023-12-24T20:10:22.056390+0000","last_undegraded":"2023-12-24T20:10:22.056390+0000","last_fullsized":"2023-12-24T20:10:22.056390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060066+0000","last_change":"2023-12-24T20:10:22.053066+0000","last_active":"2023-12-24T20:10:22.060066+0000","last_peered":"2023-12-24T20:10:22.060066+0000","last_clean":"2023-12-24T20:10:22.060066+0000","last_became_active":"2023-12-24T20:10:22.052698+0000","last_became_peered":"2023-12-24T20:10:22.052698+0000","last_unstale":"2023-12-24T20:10:22.060066+0000","last_undegraded":"2023-12-24T20:10:22.060066+0000","last_fullsized":"2023-12-24T20:10:22.060066+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:34.408710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058470+0000","last_change":"2023-12-24T20:10:22.049299+0000","last_active":"2023-12-24T20:10:22.058470+0000","last_peered":"2023-12-24T20:10:22.058470+0000","last_clean":"2023-12-24T20:10:22.058470+0000","last_became_active":"2023-12-24T20:10:22.049004+0000","last_became_peered":"2023-12-24T20:10:22.049004+0000","last_unstale":"2023-12-24T20:10:22.058470+0000","last_undegraded":"2023-12-24T20:10:22.058470+0000","last_fullsized":"2023-12-24T20:10:22.058470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:59:29.286083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051130+0000","last_change":"2023-12-24T20:10:22.036361+0000","last_active":"2023-12-24T20:10:22.051130+0000","last_peered":"2023-12-24T20:10:22.051130+0000","last_clean":"2023-12-24T20:10:22.051130+0000","last_became_active":"2023-12-24T20:10:22.036025+0000","last_became_peered":"2023-12-24T20:10:22.036025+0000","last_unstale":"2023-12-24T20:10:22.051130+0000","last_undegraded":"2023-12-24T20:10:22.051130+0000","last_fullsized":"2023-12-24T20:10:22.051130+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:09.701406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053556+0000","last_change":"2023-12-24T20:10:22.051285+0000","last_active":"2023-12-24T20:10:22.053556+0000","last_peered":"2023-12-24T20:10:22.053556+0000","last_clean":"2023-12-24T20:10:22.053556+0000","last_became_active":"2023-12-24T20:10:22.050233+0000","last_became_peered":"2023-12-24T20:10:22.050233+0000","last_unstale":"2023-12-24T20:10:22.053556+0000","last_undegraded":"2023-12-24T20:10:22.053556+0000","last_fullsized":"2023-12-24T20:10:22.053556+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048848+0000","last_change":"2023-12-24T20:10:22.042241+0000","last_active":"2023-12-24T20:10:22.048848+0000","last_peered":"2023-12-24T20:10:22.048848+0000","last_clean":"2023-12-24T20:10:22.048848+0000","last_became_active":"2023-12-24T20:10:22.041863+0000","last_became_peered":"2023-12-24T20:10:22.041863+0000","last_unstale":"2023-12-24T20:10:22.048848+0000","last_undegraded":"2023-12-24T20:10:22.048848+0000","last_fullsized":"2023-12-24T20:10:22.048848+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:43.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058367+0000","last_change":"2023-12-24T20:10:22.046312+0000","last_active":"2023-12-24T20:10:22.058367+0000","last_peered":"2023-12-24T20:10:22.058367+0000","last_clean":"2023-12-24T20:10:22.058367+0000","last_became_active":"2023-12-24T20:10:22.045881+0000","last_became_peered":"2023-12-24T20:10:22.045881+0000","last_unstale":"2023-12-24T20:10:22.058367+0000","last_undegraded":"2023-12-24T20:10:22.058367+0000","last_fullsized":"2023-12-24T20:10:22.058367+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:16.055959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048694+0000","last_change":"2023-12-24T20:10:22.046920+0000","last_active":"2023-12-24T20:10:22.048694+0000","last_peered":"2023-12-24T20:10:22.048694+0000","last_clean":"2023-12-24T20:10:22.048694+0000","last_became_active":"2023-12-24T20:10:22.046618+0000","last_became_peered":"2023-12-24T20:10:22.046618+0000","last_unstale":"2023-12-24T20:10:22.048694+0000","last_undegraded":"2023-12-24T20:10:22.048694+0000","last_fullsized":"2023-12-24T20:10:22.048694+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060470+0000","last_change":"2023-12-24T20:10:22.059909+0000","last_active":"2023-12-24T20:10:22.060470+0000","last_peered":"2023-12-24T20:10:22.060470+0000","last_clean":"2023-12-24T20:10:22.060470+0000","last_became_active":"2023-12-24T20:10:22.058921+0000","last_became_peered":"2023-12-24T20:10:22.058921+0000","last_unstale":"2023-12-24T20:10:22.060470+0000","last_undegraded":"2023-12-24T20:10:22.060470+0000","last_fullsized":"2023-12-24T20:10:22.060470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.032238+0000","last_change":"2023-12-24T20:10:22.029025+0000","last_active":"2023-12-24T20:10:22.032238+0000","last_peered":"2023-12-24T20:10:22.032238+0000","last_clean":"2023-12-24T20:10:22.032238+0000","last_became_active":"2023-12-24T20:10:22.028676+0000","last_became_peered":"2023-12-24T20:10:22.028676+0000","last_unstale":"2023-12-24T20:10:22.032238+0000","last_undegraded":"2023-12-24T20:10:22.032238+0000","last_fullsized":"2023-12-24T20:10:22.032238+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:03.428061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.042436+0000","last_change":"2023-12-24T20:10:22.030406+0000","last_active":"2023-12-24T20:10:22.042436+0000","last_peered":"2023-12-24T20:10:22.042436+0000","last_clean":"2023-12-24T20:10:22.042436+0000","last_became_active":"2023-12-24T20:10:22.030076+0000","last_became_peered":"2023-12-24T20:10:22.030076+0000","last_unstale":"2023-12-24T20:10:22.042436+0000","last_undegraded":"2023-12-24T20:10:22.042436+0000","last_fullsized":"2023-12-24T20:10:22.042436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:22:58.629359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053953+0000","last_change":"2023-12-24T20:10:22.045274+0000","last_active":"2023-12-24T20:10:22.053953+0000","last_peered":"2023-12-24T20:10:22.053953+0000","last_clean":"2023-12-24T20:10:22.053953+0000","last_became_active":"2023-12-24T20:10:22.042746+0000","last_became_peered":"2023-12-24T20:10:22.042746+0000","last_unstale":"2023-12-24T20:10:22.053953+0000","last_undegraded":"2023-12-24T20:10:22.053953+0000","last_fullsized":"2023-12-24T20:10:22.053953+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:48.942011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059927+0000","last_change":"2023-12-24T20:10:22.052143+0000","last_active":"2023-12-24T20:10:22.059927+0000","last_peered":"2023-12-24T20:10:22.059927+0000","last_clean":"2023-12-24T20:10:22.059927+0000","last_became_active":"2023-12-24T20:10:22.051470+0000","last_became_peered":"2023-12-24T20:10:22.051470+0000","last_unstale":"2023-12-24T20:10:22.059927+0000","last_undegraded":"2023-12-24T20:10:22.059927+0000","last_fullsized":"2023-12-24T20:10:22.059927+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058346+0000","last_change":"2023-12-24T20:10:22.045008+0000","last_active":"2023-12-24T20:10:22.058346+0000","last_peered":"2023-12-24T20:10:22.058346+0000","last_clean":"2023-12-24T20:10:22.058346+0000","last_became_active":"2023-12-24T20:10:22.044696+0000","last_became_peered":"2023-12-24T20:10:22.044696+0000","last_unstale":"2023-12-24T20:10:22.058346+0000","last_undegraded":"2023-12-24T20:10:22.058346+0000","last_fullsized":"2023-12-24T20:10:22.058346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.038295+0000","last_change":"2023-12-24T20:10:22.035311+0000","last_active":"2023-12-24T20:10:22.038295+0000","last_peered":"2023-12-24T20:10:22.038295+0000","last_clean":"2023-12-24T20:10:22.038295+0000","last_became_active":"2023-12-24T20:10:22.034962+0000","last_became_peered":"2023-12-24T20:10:22.034962+0000","last_unstale":"2023-12-24T20:10:22.038295+0000","last_undegraded":"2023-12-24T20:10:22.038295+0000","last_fullsized":"2023-12-24T20:10:22.038295+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:15.370479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034863+0000","last_change":"2023-12-24T20:10:22.031327+0000","last_active":"2023-12-24T20:10:22.034863+0000","last_peered":"2023-12-24T20:10:22.034863+0000","last_clean":"2023-12-24T20:10:22.034863+0000","last_became_active":"2023-12-24T20:10:22.031039+0000","last_became_peered":"2023-12-24T20:10:22.031039+0000","last_unstale":"2023-12-24T20:10:22.034863+0000","last_undegraded":"2023-12-24T20:10:22.034863+0000","last_fullsized":"2023-12-24T20:10:22.034863+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:56.546959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060202+0000","last_change":"2023-12-24T20:10:22.054226+0000","last_active":"2023-12-24T20:10:22.060202+0000","last_peered":"2023-12-24T20:10:22.060202+0000","last_clean":"2023-12-24T20:10:22.060202+0000","last_became_active":"2023-12-24T20:10:22.053874+0000","last_became_peered":"2023-12-24T20:10:22.053874+0000","last_unstale":"2023-12-24T20:10:22.060202+0000","last_undegraded":"2023-12-24T20:10:22.060202+0000","last_fullsized":"2023-12-24T20:10:22.060202+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048834+0000","last_change":"2023-12-24T20:10:22.043778+0000","last_active":"2023-12-24T20:10:22.048834+0000","last_peered":"2023-12-24T20:10:22.048834+0000","last_clean":"2023-12-24T20:10:22.048834+0000","last_became_active":"2023-12-24T20:10:22.043497+0000","last_became_peered":"2023-12-24T20:10:22.043497+0000","last_unstale":"2023-12-24T20:10:22.048834+0000","last_undegraded":"2023-12-24T20:10:22.048834+0000","last_fullsized":"2023-12-24T20:10:22.048834+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:21.933791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049443+0000","last_change":"2023-12-24T20:10:22.044329+0000","last_active":"2023-12-24T20:10:22.049443+0000","last_peered":"2023-12-24T20:10:22.049443+0000","last_clean":"2023-12-24T20:10:22.049443+0000","last_became_active":"2023-12-24T20:10:22.044038+0000","last_became_peered":"2023-12-24T20:10:22.044038+0000","last_unstale":"2023-12-24T20:10:22.049443+0000","last_undegraded":"2023-12-24T20:10:22.049443+0000","last_fullsized":"2023-12-24T20:10:22.049443+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:50.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052042+0000","last_change":"2023-12-24T20:10:22.047403+0000","last_active":"2023-12-24T20:10:22.052042+0000","last_peered":"2023-12-24T20:10:22.052042+0000","last_clean":"2023-12-24T20:10:22.052042+0000","last_became_active":"2023-12-24T20:10:22.047114+0000","last_became_peered":"2023-12-24T20:10:22.047114+0000","last_unstale":"2023-12-24T20:10:22.052042+0000","last_undegraded":"2023-12-24T20:10:22.052042+0000","last_fullsized":"2023-12-24T20:10:22.052042+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047901+0000","last_change":"2023-12-24T20:10:22.039320+0000","last_active":"2023-12-24T20:10:22.047901+0000","last_peered":"2023-12-24T20:10:22.047901+0000","last_clean":"2023-12-24T20:10:22.047901+0000","last_became_active":"2023-12-24T20:10:22.038806+0000","last_became_peered":"2023-12-24T20:10:22.038806+0000","last_unstale":"2023-12-24T20:10:22.047901+0000","last_undegraded":"2023-12-24T20:10:22.047901+0000","last_fullsized":"2023-12-24T20:10:22.047901+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:29:14.602278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060408+0000","last_change":"2023-12-24T20:10:22.057124+0000","last_active":"2023-12-24T20:10:22.060408+0000","last_peered":"2023-12-24T20:10:22.060408+0000","last_clean":"2023-12-24T20:10:22.060408+0000","last_became_active":"2023-12-24T20:10:22.056716+0000","last_became_peered":"2023-12-24T20:10:22.056716+0000","last_unstale":"2023-12-24T20:10:22.060408+0000","last_undegraded":"2023-12-24T20:10:22.060408+0000","last_fullsized":"2023-12-24T20:10:22.060408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:57.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055432+0000","last_change":"2023-12-24T20:10:22.053203+0000","last_active":"2023-12-24T20:10:22.055432+0000","last_peered":"2023-12-24T20:10:22.055432+0000","last_clean":"2023-12-24T20:10:22.055432+0000","last_became_active":"2023-12-24T20:10:22.052673+0000","last_became_peered":"2023-12-24T20:10:22.052673+0000","last_unstale":"2023-12-24T20:10:22.055432+0000","last_undegraded":"2023-12-24T20:10:22.055432+0000","last_fullsized":"2023-12-24T20:10:22.055432+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:14.433919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053614+0000","last_change":"2023-12-24T20:10:22.049561+0000","last_active":"2023-12-24T20:10:22.053614+0000","last_peered":"2023-12-24T20:10:22.053614+0000","last_clean":"2023-12-24T20:10:22.053614+0000","last_became_active":"2023-12-24T20:10:22.049246+0000","last_became_peered":"2023-12-24T20:10:22.049246+0000","last_unstale":"2023-12-24T20:10:22.053614+0000","last_undegraded":"2023-12-24T20:10:22.053614+0000","last_fullsized":"2023-12-24T20:10:22.053614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059867+0000","last_change":"2023-12-24T20:10:22.052041+0000","last_active":"2023-12-24T20:10:22.059867+0000","last_peered":"2023-12-24T20:10:22.059867+0000","last_clean":"2023-12-24T20:10:22.059867+0000","last_became_active":"2023-12-24T20:10:22.051704+0000","last_became_peered":"2023-12-24T20:10:22.051704+0000","last_unstale":"2023-12-24T20:10:22.059867+0000","last_undegraded":"2023-12-24T20:10:22.059867+0000","last_fullsized":"2023-12-24T20:10:22.059867+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054149+0000","last_change":"2023-12-24T20:10:22.050469+0000","last_active":"2023-12-24T20:10:22.054149+0000","last_peered":"2023-12-24T20:10:22.054149+0000","last_clean":"2023-12-24T20:10:22.054149+0000","last_became_active":"2023-12-24T20:10:22.049592+0000","last_became_peered":"2023-12-24T20:10:22.049592+0000","last_unstale":"2023-12-24T20:10:22.054149+0000","last_undegraded":"2023-12-24T20:10:22.054149+0000","last_fullsized":"2023-12-24T20:10:22.054149+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055390+0000","last_change":"2023-12-24T20:10:22.052932+0000","last_active":"2023-12-24T20:10:22.055390+0000","last_peered":"2023-12-24T20:10:22.055390+0000","last_clean":"2023-12-24T20:10:22.055390+0000","last_became_active":"2023-12-24T20:10:22.047760+0000","last_became_peered":"2023-12-24T20:10:22.047760+0000","last_unstale":"2023-12-24T20:10:22.055390+0000","last_undegraded":"2023-12-24T20:10:22.055390+0000","last_fullsized":"2023-12-24T20:10:22.055390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051148+0000","last_change":"2023-12-24T20:10:22.048364+0000","last_active":"2023-12-24T20:10:22.051148+0000","last_peered":"2023-12-24T20:10:22.051148+0000","last_clean":"2023-12-24T20:10:22.051148+0000","last_became_active":"2023-12-24T20:10:22.048054+0000","last_became_peered":"2023-12-24T20:10:22.048054+0000","last_unstale":"2023-12-24T20:10:22.051148+0000","last_undegraded":"2023-12-24T20:10:22.051148+0000","last_fullsized":"2023-12-24T20:10:22.051148+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:13.833901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058299+0000","last_change":"2023-12-24T20:10:22.046083+0000","last_active":"2023-12-24T20:10:22.058299+0000","last_peered":"2023-12-24T20:10:22.058299+0000","last_clean":"2023-12-24T20:10:22.058299+0000","last_became_active":"2023-12-24T20:10:22.045647+0000","last_became_peered":"2023-12-24T20:10:22.045647+0000","last_unstale":"2023-12-24T20:10:22.058299+0000","last_undegraded":"2023-12-24T20:10:22.058299+0000","last_fullsized":"2023-12-24T20:10:22.058299+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:46.777299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050294+0000","last_change":"2023-12-24T20:10:22.043330+0000","last_active":"2023-12-24T20:10:22.050294+0000","last_peered":"2023-12-24T20:10:22.050294+0000","last_clean":"2023-12-24T20:10:22.050294+0000","last_became_active":"2023-12-24T20:10:22.042744+0000","last_became_peered":"2023-12-24T20:10:22.042744+0000","last_unstale":"2023-12-24T20:10:22.050294+0000","last_undegraded":"2023-12-24T20:10:22.050294+0000","last_fullsized":"2023-12-24T20:10:22.050294+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"207'4","reported_seq":14,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326441+0000","last_change":"2023-12-24T20:10:21.328692+0000","last_active":"2023-12-24T20:10:22.326441+0000","last_peered":"2023-12-24T20:10:22.326441+0000","last_clean":"2023-12-24T20:10:22.326441+0000","last_became_active":"2023-12-24T20:10:21.328379+0000","last_became_peered":"2023-12-24T20:10:21.328379+0000","last_unstale":"2023-12-24T20:10:22.326441+0000","last_undegraded":"2023-12-24T20:10:22.326441+0000","last_fullsized":"2023-12-24T20:10:22.326441+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047075+0000","last_change":"2023-12-24T20:10:22.040630+0000","last_active":"2023-12-24T20:10:22.047075+0000","last_peered":"2023-12-24T20:10:22.047075+0000","last_clean":"2023-12-24T20:10:22.047075+0000","last_became_active":"2023-12-24T20:10:22.040281+0000","last_became_peered":"2023-12-24T20:10:22.040281+0000","last_unstale":"2023-12-24T20:10:22.047075+0000","last_undegraded":"2023-12-24T20:10:22.047075+0000","last_fullsized":"2023-12-24T20:10:22.047075+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:59:29.515812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326801+0000","last_change":"2023-12-24T20:10:21.341249+0000","last_active":"2023-12-24T20:10:22.326801+0000","last_peered":"2023-12-24T20:10:22.326801+0000","last_clean":"2023-12-24T20:10:22.326801+0000","last_became_active":"2023-12-24T20:10:21.340079+0000","last_became_peered":"2023-12-24T20:10:21.340079+0000","last_unstale":"2023-12-24T20:10:22.326801+0000","last_undegraded":"2023-12-24T20:10:22.326801+0000","last_fullsized":"2023-12-24T20:10:22.326801+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:04:20.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053369+0000","last_change":"2023-12-24T20:10:22.049094+0000","last_active":"2023-12-24T20:10:22.053369+0000","last_peered":"2023-12-24T20:10:22.053369+0000","last_clean":"2023-12-24T20:10:22.053369+0000","last_became_active":"2023-12-24T20:10:22.048507+0000","last_became_peered":"2023-12-24T20:10:22.048507+0000","last_unstale":"2023-12-24T20:10:22.053369+0000","last_undegraded":"2023-12-24T20:10:22.053369+0000","last_fullsized":"2023-12-24T20:10:22.053369+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325452+0000","last_change":"2023-12-24T20:10:21.330427+0000","last_active":"2023-12-24T20:10:22.325452+0000","last_peered":"2023-12-24T20:10:22.325452+0000","last_clean":"2023-12-24T20:10:22.325452+0000","last_became_active":"2023-12-24T20:10:21.330141+0000","last_became_peered":"2023-12-24T20:10:21.330141+0000","last_unstale":"2023-12-24T20:10:22.325452+0000","last_undegraded":"2023-12-24T20:10:22.325452+0000","last_fullsized":"2023-12-24T20:10:22.325452+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054654+0000","last_change":"2023-12-24T20:10:22.048512+0000","last_active":"2023-12-24T20:10:22.054654+0000","last_peered":"2023-12-24T20:10:22.054654+0000","last_clean":"2023-12-24T20:10:22.054654+0000","last_became_active":"2023-12-24T20:10:22.048205+0000","last_became_peered":"2023-12-24T20:10:22.048205+0000","last_unstale":"2023-12-24T20:10:22.054654+0000","last_undegraded":"2023-12-24T20:10:22.054654+0000","last_fullsized":"2023-12-24T20:10:22.054654+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:50.114944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324166+0000","last_change":"2023-12-24T20:10:21.324249+0000","last_active":"2023-12-24T20:10:22.324166+0000","last_peered":"2023-12-24T20:10:22.324166+0000","last_clean":"2023-12-24T20:10:22.324166+0000","last_became_active":"2023-12-24T20:10:21.323913+0000","last_became_peered":"2023-12-24T20:10:21.323913+0000","last_unstale":"2023-12-24T20:10:22.324166+0000","last_undegraded":"2023-12-24T20:10:22.324166+0000","last_fullsized":"2023-12-24T20:10:22.324166+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:48.302787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053722+0000","last_change":"2023-12-24T20:10:22.046801+0000","last_active":"2023-12-24T20:10:22.053722+0000","last_peered":"2023-12-24T20:10:22.053722+0000","last_clean":"2023-12-24T20:10:22.053722+0000","last_became_active":"2023-12-24T20:10:22.046073+0000","last_became_peered":"2023-12-24T20:10:22.046073+0000","last_unstale":"2023-12-24T20:10:22.053722+0000","last_undegraded":"2023-12-24T20:10:22.053722+0000","last_fullsized":"2023-12-24T20:10:22.053722+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:19.864656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326943+0000","last_change":"2023-12-24T20:10:21.340568+0000","last_active":"2023-12-24T20:10:22.326943+0000","last_peered":"2023-12-24T20:10:22.326943+0000","last_clean":"2023-12-24T20:10:22.326943+0000","last_became_active":"2023-12-24T20:10:21.340133+0000","last_became_peered":"2023-12-24T20:10:21.340133+0000","last_unstale":"2023-12-24T20:10:22.326943+0000","last_undegraded":"2023-12-24T20:10:22.326943+0000","last_fullsized":"2023-12-24T20:10:22.326943+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:28.266829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057958+0000","last_change":"2023-12-24T20:10:22.052321+0000","last_active":"2023-12-24T20:10:22.057958+0000","last_peered":"2023-12-24T20:10:22.057958+0000","last_clean":"2023-12-24T20:10:22.057958+0000","last_became_active":"2023-12-24T20:10:22.052025+0000","last_became_peered":"2023-12-24T20:10:22.052025+0000","last_unstale":"2023-12-24T20:10:22.057958+0000","last_undegraded":"2023-12-24T20:10:22.057958+0000","last_fullsized":"2023-12-24T20:10:22.057958+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:32.731104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325284+0000","last_change":"2023-12-24T20:10:21.342954+0000","last_active":"2023-12-24T20:10:22.325284+0000","last_peered":"2023-12-24T20:10:22.325284+0000","last_clean":"2023-12-24T20:10:22.325284+0000","last_became_active":"2023-12-24T20:10:21.342595+0000","last_became_peered":"2023-12-24T20:10:21.342595+0000","last_unstale":"2023-12-24T20:10:22.325284+0000","last_undegraded":"2023-12-24T20:10:22.325284+0000","last_fullsized":"2023-12-24T20:10:22.325284+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:47:20.239017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049417+0000","last_change":"2023-12-24T20:10:22.042317+0000","last_active":"2023-12-24T20:10:22.049417+0000","last_peered":"2023-12-24T20:10:22.049417+0000","last_clean":"2023-12-24T20:10:22.049417+0000","last_became_active":"2023-12-24T20:10:22.041979+0000","last_became_peered":"2023-12-24T20:10:22.041979+0000","last_unstale":"2023-12-24T20:10:22.049417+0000","last_undegraded":"2023-12-24T20:10:22.049417+0000","last_fullsized":"2023-12-24T20:10:22.049417+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:44.587605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024318+0000","last_change":"2023-12-24T20:10:21.322840+0000","last_active":"2023-12-24T20:10:22.024318+0000","last_peered":"2023-12-24T20:10:22.024318+0000","last_clean":"2023-12-24T20:10:22.024318+0000","last_became_active":"2023-12-24T20:10:21.322524+0000","last_became_peered":"2023-12-24T20:10:21.322524+0000","last_unstale":"2023-12-24T20:10:22.024318+0000","last_undegraded":"2023-12-24T20:10:22.024318+0000","last_fullsized":"2023-12-24T20:10:22.024318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:53:59.068791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050316+0000","last_change":"2023-12-24T20:10:22.043562+0000","last_active":"2023-12-24T20:10:22.050316+0000","last_peered":"2023-12-24T20:10:22.050316+0000","last_clean":"2023-12-24T20:10:22.050316+0000","last_became_active":"2023-12-24T20:10:22.043052+0000","last_became_peered":"2023-12-24T20:10:22.043052+0000","last_unstale":"2023-12-24T20:10:22.050316+0000","last_undegraded":"2023-12-24T20:10:22.050316+0000","last_fullsized":"2023-12-24T20:10:22.050316+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.040478+0000","last_change":"2023-12-24T20:10:21.342654+0000","last_active":"2023-12-24T20:10:22.040478+0000","last_peered":"2023-12-24T20:10:22.040478+0000","last_clean":"2023-12-24T20:10:22.040478+0000","last_became_active":"2023-12-24T20:10:21.342372+0000","last_became_peered":"2023-12-24T20:10:21.342372+0000","last_unstale":"2023-12-24T20:10:22.040478+0000","last_undegraded":"2023-12-24T20:10:22.040478+0000","last_fullsized":"2023-12-24T20:10:22.040478+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:02.063291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057705+0000","last_change":"2023-12-24T20:10:22.044758+0000","last_active":"2023-12-24T20:10:22.057705+0000","last_peered":"2023-12-24T20:10:22.057705+0000","last_clean":"2023-12-24T20:10:22.057705+0000","last_became_active":"2023-12-24T20:10:22.043653+0000","last_became_peered":"2023-12-24T20:10:22.043653+0000","last_unstale":"2023-12-24T20:10:22.057705+0000","last_undegraded":"2023-12-24T20:10:22.057705+0000","last_fullsized":"2023-12-24T20:10:22.057705+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.036074+0000","last_change":"2023-12-24T20:10:21.341505+0000","last_active":"2023-12-24T20:10:22.036074+0000","last_peered":"2023-12-24T20:10:22.036074+0000","last_clean":"2023-12-24T20:10:22.036074+0000","last_became_active":"2023-12-24T20:10:21.340993+0000","last_became_peered":"2023-12-24T20:10:21.340993+0000","last_unstale":"2023-12-24T20:10:22.036074+0000","last_undegraded":"2023-12-24T20:10:22.036074+0000","last_fullsized":"2023-12-24T20:10:22.036074+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052276+0000","last_change":"2023-12-24T20:10:22.046657+0000","last_active":"2023-12-24T20:10:22.052276+0000","last_peered":"2023-12-24T20:10:22.052276+0000","last_clean":"2023-12-24T20:10:22.052276+0000","last_became_active":"2023-12-24T20:10:22.046281+0000","last_became_peered":"2023-12-24T20:10:22.046281+0000","last_unstale":"2023-12-24T20:10:22.052276+0000","last_undegraded":"2023-12-24T20:10:22.052276+0000","last_fullsized":"2023-12-24T20:10:22.052276+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:11.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"207'3","reported_seq":13,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326189+0000","last_change":"2023-12-24T20:10:21.346137+0000","last_active":"2023-12-24T20:10:22.326189+0000","last_peered":"2023-12-24T20:10:22.326189+0000","last_clean":"2023-12-24T20:10:22.326189+0000","last_became_active":"2023-12-24T20:10:21.345823+0000","last_became_peered":"2023-12-24T20:10:21.345823+0000","last_unstale":"2023-12-24T20:10:22.326189+0000","last_undegraded":"2023-12-24T20:10:22.326189+0000","last_fullsized":"2023-12-24T20:10:22.326189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:38.778312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058851+0000","last_change":"2023-12-24T20:10:22.054910+0000","last_active":"2023-12-24T20:10:22.058851+0000","last_peered":"2023-12-24T20:10:22.058851+0000","last_clean":"2023-12-24T20:10:22.058851+0000","last_became_active":"2023-12-24T20:10:22.053160+0000","last_became_peered":"2023-12-24T20:10:22.053160+0000","last_unstale":"2023-12-24T20:10:22.058851+0000","last_undegraded":"2023-12-24T20:10:22.058851+0000","last_fullsized":"2023-12-24T20:10:22.058851+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:03.078696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"207'6","reported_seq":16,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.329419+0000","last_change":"2023-12-24T20:10:21.329583+0000","last_active":"2023-12-24T20:10:22.329419+0000","last_peered":"2023-12-24T20:10:22.329419+0000","last_clean":"2023-12-24T20:10:22.329419+0000","last_became_active":"2023-12-24T20:10:21.328809+0000","last_became_peered":"2023-12-24T20:10:21.328809+0000","last_unstale":"2023-12-24T20:10:22.329419+0000","last_undegraded":"2023-12-24T20:10:22.329419+0000","last_fullsized":"2023-12-24T20:10:22.329419+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:43.151409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048749+0000","last_change":"2023-12-24T20:10:22.036393+0000","last_active":"2023-12-24T20:10:22.048749+0000","last_peered":"2023-12-24T20:10:22.048749+0000","last_clean":"2023-12-24T20:10:22.048749+0000","last_became_active":"2023-12-24T20:10:22.036071+0000","last_became_peered":"2023-12-24T20:10:22.036071+0000","last_unstale":"2023-12-24T20:10:22.048749+0000","last_undegraded":"2023-12-24T20:10:22.048749+0000","last_fullsized":"2023-12-24T20:10:22.048749+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:16.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324446+0000","last_change":"2023-12-24T20:10:21.321724+0000","last_active":"2023-12-24T20:10:22.324446+0000","last_peered":"2023-12-24T20:10:22.324446+0000","last_clean":"2023-12-24T20:10:22.324446+0000","last_became_active":"2023-12-24T20:10:21.321251+0000","last_became_peered":"2023-12-24T20:10:21.321251+0000","last_unstale":"2023-12-24T20:10:22.324446+0000","last_undegraded":"2023-12-24T20:10:22.324446+0000","last_fullsized":"2023-12-24T20:10:22.324446+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:02.989882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057123+0000","last_change":"2023-12-24T20:10:22.043586+0000","last_active":"2023-12-24T20:10:22.057123+0000","last_peered":"2023-12-24T20:10:22.057123+0000","last_clean":"2023-12-24T20:10:22.057123+0000","last_became_active":"2023-12-24T20:10:22.042963+0000","last_became_peered":"2023-12-24T20:10:22.042963+0000","last_unstale":"2023-12-24T20:10:22.057123+0000","last_undegraded":"2023-12-24T20:10:22.057123+0000","last_fullsized":"2023-12-24T20:10:22.057123+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033596+0000","last_change":"2023-12-24T20:10:21.344171+0000","last_active":"2023-12-24T20:10:22.033596+0000","last_peered":"2023-12-24T20:10:22.033596+0000","last_clean":"2023-12-24T20:10:22.033596+0000","last_became_active":"2023-12-24T20:10:21.343604+0000","last_became_peered":"2023-12-24T20:10:21.343604+0000","last_unstale":"2023-12-24T20:10:22.033596+0000","last_undegraded":"2023-12-24T20:10:22.033596+0000","last_fullsized":"2023-12-24T20:10:22.033596+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.041831+0000","last_change":"2023-12-24T20:10:22.040395+0000","last_active":"2023-12-24T20:10:22.041831+0000","last_peered":"2023-12-24T20:10:22.041831+0000","last_clean":"2023-12-24T20:10:22.041831+0000","last_became_active":"2023-12-24T20:10:22.040084+0000","last_became_peered":"2023-12-24T20:10:22.040084+0000","last_unstale":"2023-12-24T20:10:22.041831+0000","last_undegraded":"2023-12-24T20:10:22.041831+0000","last_fullsized":"2023-12-24T20:10:22.041831+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:25.909153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035164+0000","last_change":"2023-12-24T20:10:21.331552+0000","last_active":"2023-12-24T20:10:22.035164+0000","last_peered":"2023-12-24T20:10:22.035164+0000","last_clean":"2023-12-24T20:10:22.035164+0000","last_became_active":"2023-12-24T20:10:21.331187+0000","last_became_peered":"2023-12-24T20:10:21.331187+0000","last_unstale":"2023-12-24T20:10:22.035164+0000","last_undegraded":"2023-12-24T20:10:22.035164+0000","last_fullsized":"2023-12-24T20:10:22.035164+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:01:04.491152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053857+0000","last_change":"2023-12-24T20:10:22.047143+0000","last_active":"2023-12-24T20:10:22.053857+0000","last_peered":"2023-12-24T20:10:22.053857+0000","last_clean":"2023-12-24T20:10:22.053857+0000","last_became_active":"2023-12-24T20:10:22.045752+0000","last_became_peered":"2023-12-24T20:10:22.045752+0000","last_unstale":"2023-12-24T20:10:22.053857+0000","last_undegraded":"2023-12-24T20:10:22.053857+0000","last_fullsized":"2023-12-24T20:10:22.053857+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:07.378750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"207'8","reported_seq":18,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326577+0000","last_change":"2023-12-24T20:10:21.327512+0000","last_active":"2023-12-24T20:10:22.326577+0000","last_peered":"2023-12-24T20:10:22.326577+0000","last_clean":"2023-12-24T20:10:22.326577+0000","last_became_active":"2023-12-24T20:10:21.326358+0000","last_became_peered":"2023-12-24T20:10:21.326358+0000","last_unstale":"2023-12-24T20:10:22.326577+0000","last_undegraded":"2023-12-24T20:10:22.326577+0000","last_fullsized":"2023-12-24T20:10:22.326577+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049346+0000","last_change":"2023-12-24T20:10:22.046931+0000","last_active":"2023-12-24T20:10:22.049346+0000","last_peered":"2023-12-24T20:10:22.049346+0000","last_clean":"2023-12-24T20:10:22.049346+0000","last_became_active":"2023-12-24T20:10:22.046582+0000","last_became_peered":"2023-12-24T20:10:22.046582+0000","last_unstale":"2023-12-24T20:10:22.049346+0000","last_undegraded":"2023-12-24T20:10:22.049346+0000","last_fullsized":"2023-12-24T20:10:22.049346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:16.357937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325268+0000","last_change":"2023-12-24T20:10:21.327844+0000","last_active":"2023-12-24T20:10:22.325268+0000","last_peered":"2023-12-24T20:10:22.325268+0000","last_clean":"2023-12-24T20:10:22.325268+0000","last_became_active":"2023-12-24T20:10:21.327494+0000","last_became_peered":"2023-12-24T20:10:21.327494+0000","last_unstale":"2023-12-24T20:10:22.325268+0000","last_undegraded":"2023-12-24T20:10:22.325268+0000","last_fullsized":"2023-12-24T20:10:22.325268+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057727+0000","last_change":"2023-12-24T20:10:22.044918+0000","last_active":"2023-12-24T20:10:22.057727+0000","last_peered":"2023-12-24T20:10:22.057727+0000","last_clean":"2023-12-24T20:10:22.057727+0000","last_became_active":"2023-12-24T20:10:22.044608+0000","last_became_peered":"2023-12-24T20:10:22.044608+0000","last_unstale":"2023-12-24T20:10:22.057727+0000","last_undegraded":"2023-12-24T20:10:22.057727+0000","last_fullsized":"2023-12-24T20:10:22.057727+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:47.045124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.327030+0000","last_change":"2023-12-24T20:10:21.330870+0000","last_active":"2023-12-24T20:10:22.327030+0000","last_peered":"2023-12-24T20:10:22.327030+0000","last_clean":"2023-12-24T20:10:22.327030+0000","last_became_active":"2023-12-24T20:10:21.330444+0000","last_became_peered":"2023-12-24T20:10:21.330444+0000","last_unstale":"2023-12-24T20:10:22.327030+0000","last_undegraded":"2023-12-24T20:10:22.327030+0000","last_fullsized":"2023-12-24T20:10:22.327030+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055408+0000","last_change":"2023-12-24T20:10:22.052950+0000","last_active":"2023-12-24T20:10:22.055408+0000","last_peered":"2023-12-24T20:10:22.055408+0000","last_clean":"2023-12-24T20:10:22.055408+0000","last_became_active":"2023-12-24T20:10:22.052300+0000","last_became_peered":"2023-12-24T20:10:22.052300+0000","last_unstale":"2023-12-24T20:10:22.055408+0000","last_undegraded":"2023-12-24T20:10:22.055408+0000","last_fullsized":"2023-12-24T20:10:22.055408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:29.282233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.323961+0000","last_change":"2023-12-24T20:10:21.338860+0000","last_active":"2023-12-24T20:10:22.323961+0000","last_peered":"2023-12-24T20:10:22.323961+0000","last_clean":"2023-12-24T20:10:22.323961+0000","last_became_active":"2023-12-24T20:10:21.338477+0000","last_became_peered":"2023-12-24T20:10:21.338477+0000","last_unstale":"2023-12-24T20:10:22.323961+0000","last_undegraded":"2023-12-24T20:10:22.323961+0000","last_fullsized":"2023-12-24T20:10:22.323961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:57.241226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058869+0000","last_change":"2023-12-24T20:10:22.055380+0000","last_active":"2023-12-24T20:10:22.058869+0000","last_peered":"2023-12-24T20:10:22.058869+0000","last_clean":"2023-12-24T20:10:22.058869+0000","last_became_active":"2023-12-24T20:10:22.054862+0000","last_became_peered":"2023-12-24T20:10:22.054862+0000","last_unstale":"2023-12-24T20:10:22.058869+0000","last_undegraded":"2023-12-24T20:10:22.058869+0000","last_fullsized":"2023-12-24T20:10:22.058869+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:52.084675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.046274+0000","last_change":"2023-12-24T20:10:21.328323+0000","last_active":"2023-12-24T20:10:22.046274+0000","last_peered":"2023-12-24T20:10:22.046274+0000","last_clean":"2023-12-24T20:10:22.046274+0000","last_became_active":"2023-12-24T20:10:21.328048+0000","last_became_peered":"2023-12-24T20:10:21.328048+0000","last_unstale":"2023-12-24T20:10:22.046274+0000","last_undegraded":"2023-12-24T20:10:22.046274+0000","last_fullsized":"2023-12-24T20:10:22.046274+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053989+0000","last_change":"2023-12-24T20:10:22.047796+0000","last_active":"2023-12-24T20:10:22.053989+0000","last_peered":"2023-12-24T20:10:22.053989+0000","last_clean":"2023-12-24T20:10:22.053989+0000","last_became_active":"2023-12-24T20:10:22.046602+0000","last_became_peered":"2023-12-24T20:10:22.046602+0000","last_unstale":"2023-12-24T20:10:22.053989+0000","last_undegraded":"2023-12-24T20:10:22.053989+0000","last_fullsized":"2023-12-24T20:10:22.053989+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:08.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324990+0000","last_change":"2023-12-24T20:10:21.339360+0000","last_active":"2023-12-24T20:10:22.324990+0000","last_peered":"2023-12-24T20:10:22.324990+0000","last_clean":"2023-12-24T20:10:22.324990+0000","last_became_active":"2023-12-24T20:10:21.338884+0000","last_became_peered":"2023-12-24T20:10:21.338884+0000","last_unstale":"2023-12-24T20:10:22.324990+0000","last_undegraded":"2023-12-24T20:10:22.324990+0000","last_fullsized":"2023-12-24T20:10:22.324990+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:10.655331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058783+0000","last_change":"2023-12-24T20:10:22.050466+0000","last_active":"2023-12-24T20:10:22.058783+0000","last_peered":"2023-12-24T20:10:22.058783+0000","last_clean":"2023-12-24T20:10:22.058783+0000","last_became_active":"2023-12-24T20:10:22.050186+0000","last_became_peered":"2023-12-24T20:10:22.050186+0000","last_unstale":"2023-12-24T20:10:22.058783+0000","last_undegraded":"2023-12-24T20:10:22.058783+0000","last_fullsized":"2023-12-24T20:10:22.058783+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035572+0000","last_change":"2023-12-24T20:10:21.329570+0000","last_active":"2023-12-24T20:10:22.035572+0000","last_peered":"2023-12-24T20:10:22.035572+0000","last_clean":"2023-12-24T20:10:22.035572+0000","last_became_active":"2023-12-24T20:10:21.329273+0000","last_became_peered":"2023-12-24T20:10:21.329273+0000","last_unstale":"2023-12-24T20:10:22.035572+0000","last_undegraded":"2023-12-24T20:10:22.035572+0000","last_fullsized":"2023-12-24T20:10:22.035572+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056436+0000","last_change":"2023-12-24T20:10:22.053113+0000","last_active":"2023-12-24T20:10:22.056436+0000","last_peered":"2023-12-24T20:10:22.056436+0000","last_clean":"2023-12-24T20:10:22.056436+0000","last_became_active":"2023-12-24T20:10:22.052789+0000","last_became_peered":"2023-12-24T20:10:22.052789+0000","last_unstale":"2023-12-24T20:10:22.056436+0000","last_undegraded":"2023-12-24T20:10:22.056436+0000","last_fullsized":"2023-12-24T20:10:22.056436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.022767+0000","last_change":"2023-12-24T20:10:21.336557+0000","last_active":"2023-12-24T20:10:22.022767+0000","last_peered":"2023-12-24T20:10:22.022767+0000","last_clean":"2023-12-24T20:10:22.022767+0000","last_became_active":"2023-12-24T20:10:21.335312+0000","last_became_peered":"2023-12-24T20:10:21.335312+0000","last_unstale":"2023-12-24T20:10:22.022767+0000","last_undegraded":"2023-12-24T20:10:22.022767+0000","last_fullsized":"2023-12-24T20:10:22.022767+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:22.836218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060003+0000","last_change":"2023-12-24T20:10:22.052410+0000","last_active":"2023-12-24T20:10:22.060003+0000","last_peered":"2023-12-24T20:10:22.060003+0000","last_clean":"2023-12-24T20:10:22.060003+0000","last_became_active":"2023-12-24T20:10:22.050708+0000","last_became_peered":"2023-12-24T20:10:22.050708+0000","last_unstale":"2023-12-24T20:10:22.060003+0000","last_undegraded":"2023-12-24T20:10:22.060003+0000","last_fullsized":"2023-12-24T20:10:22.060003+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025855+0000","last_change":"2023-12-24T20:10:21.325384+0000","last_active":"2023-12-24T20:10:22.025855+0000","last_peered":"2023-12-24T20:10:22.025855+0000","last_clean":"2023-12-24T20:10:22.025855+0000","last_became_active":"2023-12-24T20:10:21.324469+0000","last_became_peered":"2023-12-24T20:10:21.324469+0000","last_unstale":"2023-12-24T20:10:22.025855+0000","last_undegraded":"2023-12-24T20:10:22.025855+0000","last_fullsized":"2023-12-24T20:10:22.025855+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:47.418537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057568+0000","last_change":"2023-12-24T20:10:22.050974+0000","last_active":"2023-12-24T20:10:22.057568+0000","last_peered":"2023-12-24T20:10:22.057568+0000","last_clean":"2023-12-24T20:10:22.057568+0000","last_became_active":"2023-12-24T20:10:22.050685+0000","last_became_peered":"2023-12-24T20:10:22.050685+0000","last_unstale":"2023-12-24T20:10:22.057568+0000","last_undegraded":"2023-12-24T20:10:22.057568+0000","last_fullsized":"2023-12-24T20:10:22.057568+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.014342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326388+0000","last_change":"2023-12-24T20:10:21.327249+0000","last_active":"2023-12-24T20:10:22.326388+0000","last_peered":"2023-12-24T20:10:22.326388+0000","last_clean":"2023-12-24T20:10:22.326388+0000","last_became_active":"2023-12-24T20:10:21.326939+0000","last_became_peered":"2023-12-24T20:10:21.326939+0000","last_unstale":"2023-12-24T20:10:22.326388+0000","last_undegraded":"2023-12-24T20:10:22.326388+0000","last_fullsized":"2023-12-24T20:10:22.326388+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:20.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057358+0000","last_change":"2023-12-24T20:10:22.050052+0000","last_active":"2023-12-24T20:10:22.057358+0000","last_peered":"2023-12-24T20:10:22.057358+0000","last_clean":"2023-12-24T20:10:22.057358+0000","last_became_active":"2023-12-24T20:10:22.049777+0000","last_became_peered":"2023-12-24T20:10:22.049777+0000","last_unstale":"2023-12-24T20:10:22.057358+0000","last_undegraded":"2023-12-24T20:10:22.057358+0000","last_fullsized":"2023-12-24T20:10:22.057358+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:44.358228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.022159+0000","last_change":"2023-12-24T20:10:21.336024+0000","last_active":"2023-12-24T20:10:22.022159+0000","last_peered":"2023-12-24T20:10:22.022159+0000","last_clean":"2023-12-24T20:10:22.022159+0000","last_became_active":"2023-12-24T20:10:21.335546+0000","last_became_peered":"2023-12-24T20:10:21.335546+0000","last_unstale":"2023-12-24T20:10:22.022159+0000","last_undegraded":"2023-12-24T20:10:22.022159+0000","last_fullsized":"2023-12-24T20:10:22.022159+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:50.016562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048982+0000","last_change":"2023-12-24T20:10:22.043681+0000","last_active":"2023-12-24T20:10:22.048982+0000","last_peered":"2023-12-24T20:10:22.048982+0000","last_clean":"2023-12-24T20:10:22.048982+0000","last_became_active":"2023-12-24T20:10:22.039803+0000","last_became_peered":"2023-12-24T20:10:22.039803+0000","last_unstale":"2023-12-24T20:10:22.048982+0000","last_undegraded":"2023-12-24T20:10:22.048982+0000","last_fullsized":"2023-12-24T20:10:22.048982+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039895+0000","last_change":"2023-12-24T20:10:21.340658+0000","last_active":"2023-12-24T20:10:22.039895+0000","last_peered":"2023-12-24T20:10:22.039895+0000","last_clean":"2023-12-24T20:10:22.039895+0000","last_became_active":"2023-12-24T20:10:21.339964+0000","last_became_peered":"2023-12-24T20:10:21.339964+0000","last_unstale":"2023-12-24T20:10:22.039895+0000","last_undegraded":"2023-12-24T20:10:22.039895+0000","last_fullsized":"2023-12-24T20:10:22.039895+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:07.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059454+0000","last_change":"2023-12-24T20:10:22.055234+0000","last_active":"2023-12-24T20:10:22.059454+0000","last_peered":"2023-12-24T20:10:22.059454+0000","last_clean":"2023-12-24T20:10:22.059454+0000","last_became_active":"2023-12-24T20:10:22.054573+0000","last_became_peered":"2023-12-24T20:10:22.054573+0000","last_unstale":"2023-12-24T20:10:22.059454+0000","last_undegraded":"2023-12-24T20:10:22.059454+0000","last_fullsized":"2023-12-24T20:10:22.059454+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:45.921498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039779+0000","last_change":"2023-12-24T20:10:21.338440+0000","last_active":"2023-12-24T20:10:22.039779+0000","last_peered":"2023-12-24T20:10:22.039779+0000","last_clean":"2023-12-24T20:10:22.039779+0000","last_became_active":"2023-12-24T20:10:21.338129+0000","last_became_peered":"2023-12-24T20:10:21.338129+0000","last_unstale":"2023-12-24T20:10:22.039779+0000","last_undegraded":"2023-12-24T20:10:22.039779+0000","last_fullsized":"2023-12-24T20:10:22.039779+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:13.418515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050390+0000","last_change":"2023-12-24T20:10:22.043991+0000","last_active":"2023-12-24T20:10:22.050390+0000","last_peered":"2023-12-24T20:10:22.050390+0000","last_clean":"2023-12-24T20:10:22.050390+0000","last_became_active":"2023-12-24T20:10:22.043695+0000","last_became_peered":"2023-12-24T20:10:22.043695+0000","last_unstale":"2023-12-24T20:10:22.050390+0000","last_undegraded":"2023-12-24T20:10:22.050390+0000","last_fullsized":"2023-12-24T20:10:22.050390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:49:29.060010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030809+0000","last_change":"2023-12-24T20:10:21.328635+0000","last_active":"2023-12-24T20:10:22.030809+0000","last_peered":"2023-12-24T20:10:22.030809+0000","last_clean":"2023-12-24T20:10:22.030809+0000","last_became_active":"2023-12-24T20:10:21.328181+0000","last_became_peered":"2023-12-24T20:10:21.328181+0000","last_unstale":"2023-12-24T20:10:22.030809+0000","last_undegraded":"2023-12-24T20:10:22.030809+0000","last_fullsized":"2023-12-24T20:10:22.030809+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:47.926607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033638+0000","last_change":"2023-12-24T20:10:22.030337+0000","last_active":"2023-12-24T20:10:22.033638+0000","last_peered":"2023-12-24T20:10:22.033638+0000","last_clean":"2023-12-24T20:10:22.033638+0000","last_became_active":"2023-12-24T20:10:22.029988+0000","last_became_peered":"2023-12-24T20:10:22.029988+0000","last_unstale":"2023-12-24T20:10:22.033638+0000","last_undegraded":"2023-12-24T20:10:22.033638+0000","last_fullsized":"2023-12-24T20:10:22.033638+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:26.561797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030584+0000","last_change":"2023-12-24T20:10:21.344023+0000","last_active":"2023-12-24T20:10:22.030584+0000","last_peered":"2023-12-24T20:10:22.030584+0000","last_clean":"2023-12-24T20:10:22.030584+0000","last_became_active":"2023-12-24T20:10:21.343641+0000","last_became_peered":"2023-12-24T20:10:21.343641+0000","last_unstale":"2023-12-24T20:10:22.030584+0000","last_undegraded":"2023-12-24T20:10:22.030584+0000","last_fullsized":"2023-12-24T20:10:22.030584+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:42.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053875+0000","last_change":"2023-12-24T20:10:22.045727+0000","last_active":"2023-12-24T20:10:22.053875+0000","last_peered":"2023-12-24T20:10:22.053875+0000","last_clean":"2023-12-24T20:10:22.053875+0000","last_became_active":"2023-12-24T20:10:22.045376+0000","last_became_peered":"2023-12-24T20:10:22.045376+0000","last_unstale":"2023-12-24T20:10:22.053875+0000","last_undegraded":"2023-12-24T20:10:22.053875+0000","last_fullsized":"2023-12-24T20:10:22.053875+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:15.404026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024046+0000","last_change":"2023-12-24T20:10:21.323547+0000","last_active":"2023-12-24T20:10:22.024046+0000","last_peered":"2023-12-24T20:10:22.024046+0000","last_clean":"2023-12-24T20:10:22.024046+0000","last_became_active":"2023-12-24T20:10:21.323248+0000","last_became_peered":"2023-12-24T20:10:21.323248+0000","last_unstale":"2023-12-24T20:10:22.024046+0000","last_undegraded":"2023-12-24T20:10:22.024046+0000","last_fullsized":"2023-12-24T20:10:22.024046+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:44.468978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052529+0000","last_change":"2023-12-24T20:10:22.047320+0000","last_active":"2023-12-24T20:10:22.052529+0000","last_peered":"2023-12-24T20:10:22.052529+0000","last_clean":"2023-12-24T20:10:22.052529+0000","last_became_active":"2023-12-24T20:10:22.046981+0000","last_became_peered":"2023-12-24T20:10:22.046981+0000","last_unstale":"2023-12-24T20:10:22.052529+0000","last_undegraded":"2023-12-24T20:10:22.052529+0000","last_fullsized":"2023-12-24T20:10:22.052529+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025961+0000","last_change":"2023-12-24T20:10:21.332615+0000","last_active":"2023-12-24T20:10:22.025961+0000","last_peered":"2023-12-24T20:10:22.025961+0000","last_clean":"2023-12-24T20:10:22.025961+0000","last_became_active":"2023-12-24T20:10:21.332243+0000","last_became_peered":"2023-12-24T20:10:21.332243+0000","last_unstale":"2023-12-24T20:10:22.025961+0000","last_undegraded":"2023-12-24T20:10:22.025961+0000","last_fullsized":"2023-12-24T20:10:22.025961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:10.074352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055156+0000","last_change":"2023-12-24T20:10:22.054250+0000","last_active":"2023-12-24T20:10:22.055156+0000","last_peered":"2023-12-24T20:10:22.055156+0000","last_clean":"2023-12-24T20:10:22.055156+0000","last_became_active":"2023-12-24T20:10:22.052492+0000","last_became_peered":"2023-12-24T20:10:22.052492+0000","last_unstale":"2023-12-24T20:10:22.055156+0000","last_undegraded":"2023-12-24T20:10:22.055156+0000","last_fullsized":"2023-12-24T20:10:22.055156+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:23.682561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034215+0000","last_change":"2023-12-24T20:10:21.325727+0000","last_active":"2023-12-24T20:10:22.034215+0000","last_peered":"2023-12-24T20:10:22.034215+0000","last_clean":"2023-12-24T20:10:22.034215+0000","last_became_active":"2023-12-24T20:10:21.325436+0000","last_became_peered":"2023-12-24T20:10:21.325436+0000","last_unstale":"2023-12-24T20:10:22.034215+0000","last_undegraded":"2023-12-24T20:10:22.034215+0000","last_fullsized":"2023-12-24T20:10:22.034215+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1133,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030353+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:22.030353+0000","last_peered":"2023-12-24T20:10:22.030353+0000","last_clean":"2023-12-24T20:10:22.030353+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:22.030353+0000","last_undegraded":"2023-12-24T20:10:22.030353+0000","last_fullsized":"2023-12-24T20:10:22.030353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304512,"kb_used_data":3128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067328,"statfs":{"total":96636764160,"available":96324943872,"internally_reserved":0,"allocated":3203072,"data_stored":1960496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.71199999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5629999999999999,"5min":1.728,"15min":1.728},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.131,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.127,"15min":1.161},"min":{"1min":0.69899999999999995,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.494,"5min":1.718,"15min":1.9379999999999999},"last":1.379},{"interface":"front","average":{"1min":1.2,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.532,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.159}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.238,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.73599999999999999,"15min":0.70899999999999996},"max":{"1min":1.4570000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.2390000000000001,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6899999999999999,"5min":1.7390000000000001,"15min":1.8200000000000001},"last":1.2110000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3129999999999999},"min":{"1min":0.93700000000000006,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":1.857,"15min":2.4449999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.319,"15min":1.343},"min":{"1min":1.0109999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.593,"5min":1.988,"15min":2.2919999999999998},"last":1.325}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2450000000000001,"15min":1.2090000000000001},"min":{"1min":0.90000000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.647,"5min":1.865,"15min":2.194},"last":0.751},{"interface":"front","average":{"1min":1.373,"5min":1.3340000000000001,"15min":1.278},"min":{"1min":1.0649999999999999,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.6399999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":0.88300000000000001,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.6870000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4099999999999999,"15min":1.353},"min":{"1min":1.1020000000000001,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":1.95,"15min":1.95},"last":1.079}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":0.97799999999999998,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.8460000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.26},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.494,"15min":1.4339999999999999},"min":{"1min":1.01,"5min":0.875,"15min":0.55000000000000004},"max":{"1min":1.7609999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.103}]}]},{"osd":6,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.1990000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.2889999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.151},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.105}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.4870000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.464},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.2370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":1.5149999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.2729999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.3260000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.599}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.103},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":1.474},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.657}]}]},{"osd":4,"up_from":13,"seq":55834575970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.419},{"interface":"front","average":{"1min":1.212,"5min":1.27,"15min":1.286},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":1.577,"5min":1.9490000000000001,"15min":2.012},"last":1.528}]},{"osd":1,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1579999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7629999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.119},{"interface":"front","average":{"1min":1.123,"5min":1.169,"15min":1.155},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.427,"5min":1.621,"15min":1.694},"last":1.081}]},{"osd":2,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.339},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.788,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3759999999999999,"15min":1.3720000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.835,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.1990000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.206,"15min":1.2190000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3109999999999999,"15min":1.3129999999999999},"min":{"1min":0.96899999999999997,"5min":0.90600000000000003,"15min":0.89100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3009999999999999,"15min":1.3089999999999999},"min":{"1min":0.81499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.3400000000000001,"15min":1.3280000000000001},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.0720000000000001,"15min":2.089},"last":1.601}]},{"osd":6,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.28,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":2.0219999999999998,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.361},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.335,"15min":1.3380000000000001},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.486}]},{"osd":7,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.2969999999999999,"15min":1.3100000000000001},"min":{"1min":0.89600000000000002,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.8420000000000001,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.232},{"interface":"front","average":{"1min":1.492,"5min":1.4590000000000001,"15min":1.4350000000000001},"min":{"1min":1.0369999999999999,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.274}]}]},{"osd":3,"up_from":13,"seq":55834575969,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299844,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071996,"statfs":{"total":96636764160,"available":96329723904,"internally_reserved":0,"allocated":2617344,"data_stored":1370288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":1.6040000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.98499999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.1140000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.8759999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.3480000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.522},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.7869999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.72},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.5660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":1.091}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":1.0269999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.147},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.88600000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.488}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.363}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.657},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.95}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.758}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312124,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059716,"statfs":{"total":96636764160,"available":96317149184,"internally_reserved":0,"allocated":2609152,"data_stored":1370128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.411}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.109}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.2749999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.494}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.536},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.2310000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.677}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.4490000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304528,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067312,"statfs":{"total":96636764160,"available":96324927488,"internally_reserved":0,"allocated":3219456,"data_stored":1961196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6950000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.67900000000000005,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.651,"5min":1.823,"15min":1.823},"last":0.70899999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.105,"15min":1.095},"min":{"1min":0.72699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.9630000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.157,"15min":1.155},"min":{"1min":0.72699999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.569,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.98999999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.105,"15min":1.1020000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.58199999999999996},"max":{"1min":1.4530000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.2849999999999999,"15min":1.288},"min":{"1min":0.96499999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.389,"15min":1.3879999999999999},"min":{"1min":0.95999999999999996,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.6220000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.119},{"interface":"front","average":{"1min":1.304,"5min":1.325,"15min":1.3280000000000001},"min":{"1min":1.0429999999999999,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6950000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.554}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.4650000000000001,"15min":1.4530000000000001},"min":{"1min":1.288,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.581},{"interface":"front","average":{"1min":1.448,"5min":1.466,"15min":1.456},"min":{"1min":1.099,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.8440000000000001,"5min":1.9099999999999999,"15min":2.125},"last":1.1759999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.2150000000000001,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.8089999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.538,"15min":1.524},"min":{"1min":1.216,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.5369999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.5489999999999999,"15min":1.5329999999999999},"min":{"1min":1.28,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":2.1309999999999998,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.304},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5329999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8799999999999999,"5min":2.234,"15min":2.411},"last":1.4370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:27.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T20:10:27.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.770+0000 7f8b276cd700 1 Processor -- start 2023-12-24T20:10:27.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.770+0000 7f8b276cd700 1 -- start start 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b276cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b2015d6c0 0x7f8b200c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b276cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2006dab0 con 0x7f8b2015d2f0 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b276cd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2006cc00 con 0x7f8b200c8b50 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b276cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2006cea0 con 0x7f8b2015d6c0 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b25469700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b2015d2f0 0x7f8b200c7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58594/0 (socket says 172.21.15.50:58594) 2023-12-24T20:10:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b25469700 1 -- 172.21.15.50:0/3208243283 learned_addr learned my addr 172.21.15.50:0/3208243283 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:27.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b24c68700 1 --2- 172.21.15.50:0/3208243283 >> v2:172.21.15.82:3300/0 conn(0x7f8b2015d6c0 0x7f8b200c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b17fff700 1 -- 172.21.15.50:0/3208243283 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728227231 0 0) 0x7f8b2006dab0 con 0x7f8b2015d2f0 2023-12-24T20:10:27.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b17fff700 1 -- 172.21.15.50:0/3208243283 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b0c003570 con 0x7f8b2015d2f0 2023-12-24T20:10:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b24c68700 1 -- 172.21.15.50:0/3208243283 >> v1:172.21.15.82:6789/0 conn(0x7f8b200c8b50 legacy=0x7f8b200abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b24c68700 1 -- 172.21.15.50:0/3208243283 >> v1:172.21.15.50:6789/0 conn(0x7f8b2015d2f0 legacy=0x7f8b200c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b24c68700 1 -- 172.21.15.50:0/3208243283 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2006d180 con 0x7f8b2015d6c0 2023-12-24T20:10:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.774+0000 7f8b24c68700 1 --2- 172.21.15.50:0/3208243283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200c8610 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098e0 tx=0x7f8b100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d94e6a0df1a433 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b17fff700 1 -- 172.21.15.50:0/3208243283 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000b640 con 0x7f8b2015d6c0 2023-12-24T20:10:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b17fff700 1 -- 172.21.15.50:0/3208243283 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000b7a0 con 0x7f8b2015d6c0 2023-12-24T20:10:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b17fff700 1 -- 172.21.15.50:0/3208243283 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000bb40 con 0x7f8b2015d6c0 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 -- 172.21.15.50:0/3208243283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 msgr2=0x7f8b200c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 --2- 172.21.15.50:0/3208243283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200c8610 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098e0 tx=0x7f8b100091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 -- 172.21.15.50:0/3208243283 shutdown_connections 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 --2- 172.21.15.50:0/3208243283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200c8610 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 -- 172.21.15.50:0/3208243283 >> 172.21.15.50:0/3208243283 conn(0x7f8b200670b0 msgr2=0x7f8b200674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 -- 172.21.15.50:0/3208243283 shutdown_connections 2023-12-24T20:10:27.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.778+0000 7f8b276cd700 1 -- 172.21.15.50:0/3208243283 wait complete. 2023-12-24T20:10:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 Processor -- start 2023-12-24T20:10:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 -- start start 2023-12-24T20:10:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b200c8b50 0x7f8b2015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c5390 con 0x7f8b2015d2f0 2023-12-24T20:10:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c4780 con 0x7f8b2015d6c0 2023-12-24T20:10:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b276cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200c4a60 con 0x7f8b200c8b50 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46162/0 (socket says 172.21.15.50:46162) 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 -- 172.21.15.50:0/216224864 learned_addr learned my addr 172.21.15.50:0/216224864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b25c6a700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b25469700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b200c8b50 0x7f8b2015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 -- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b200c8b50 msgr2=0x7f8b2015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b200c8b50 0x7f8b2015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 -- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 msgr2=0x7f8b200aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 -- 172.21.15.50:0/216224864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10009420 con 0x7f8b2015d2f0 2023-12-24T20:10:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b25c6a700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.782+0000 7f8b24c68700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f8b20068c00 tx=0x7f8b10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000bb20 con 0x7f8b2015d2f0 2023-12-24T20:10:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10011420 con 0x7f8b2015d2f0 2023-12-24T20:10:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b100117c0 con 0x7f8b2015d2f0 2023-12-24T20:10:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b200c4d40 con 0x7f8b2015d2f0 2023-12-24T20:10:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2015a880 con 0x7f8b2015d2f0 2023-12-24T20:10:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b200c5500 con 0x7f8b2015d2f0 2023-12-24T20:10:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.786+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8b10011b70 con 0x7f8b2015d2f0 2023-12-24T20:10:27.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.790+0000 7f8b157fa700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 0x7f8b04062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:27.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.790+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f8b1007e070 con 0x7f8b2015d2f0 2023-12-24T20:10:27.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.790+0000 7f8b25469700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 0x7f8b04062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:27.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.790+0000 7f8b25469700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 0x7f8b04062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0058d0 tx=0x7f8b1c009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:27.794+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b1004e350 con 0x7f8b2015d2f0 2023-12-24T20:10:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.026+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8b20071060 con 0x7f8b2015d2f0 2023-12-24T20:10:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.026+0000 7f8b157fa700 1 -- 172.21.15.50:0/216224864 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1022 (secure 0 0 0) 0x7f8b10051970 con 0x7f8b2015d2f0 2023-12-24T20:10:28.028 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:28.028 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5664,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":208,"num_osds":8,"num_up_osds":8,"osd_up_since":1703442975,"num_in_osds":8,"osd_in_since":1703442966,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2503647232,"bytes_avail":770590466048,"bytes_total":773094113280,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":104,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":10347}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-12-24T20:09:59.975782+0000","services":{}},"progress_events":{}} 2023-12-24T20:10:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.026+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 msgr2=0x7f8b04062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.026+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 0x7f8b04062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0058d0 tx=0x7f8b1c009040 comp rx=0 tx=0).stop 2023-12-24T20:10:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 msgr2=0x7f8b200c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f8b20068c00 tx=0x7f8b10017000 comp rx=0 tx=0).stop 2023-12-24T20:10:28.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 shutdown_connections 2023-12-24T20:10:28.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8b04060580 0x7f8b04062a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2015d6c0 0x7f8b200aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2015d2f0 0x7f8b200c5820 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 --2- 172.21.15.50:0/216224864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b200c8b50 0x7f8b2015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 >> 172.21.15.50:0/216224864 conn(0x7f8b200670b0 msgr2=0x7f8b2015c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:28.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 shutdown_connections 2023-12-24T20:10:28.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.030+0000 7f8b276cd700 1 -- 172.21.15.50:0/216224864 wait complete. 2023-12-24T20:10:28.049 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T20:10:28.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:28.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 Processor -- start 2023-12-24T20:10:28.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 -- start start 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 0x7f25300ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 0x7f253006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253006c090 con 0x7f253013f550 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253006a6a0 con 0x7f253013f920 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f253662e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300cb8a0 con 0x7f25300cb3c0 2023-12-24T20:10:28.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f252ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f253013f550 0x7f253006b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:51920/0 (socket says 172.21.15.50:51920) 2023-12-24T20:10:28.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252ffff700 1 -- 172.21.15.50:0/2152768791 learned_addr learned my addr 172.21.15.50:0/2152768791 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:28.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 --2- 172.21.15.50:0/2152768791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 0x7f253006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.210+0000 7f2527fff700 1 --2- 172.21.15.50:0/2152768791 >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 0x7f25300ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252f7fe700 1 -- 172.21.15.50:0/2152768791 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038826092 0 0) 0x7f253006c090 con 0x7f253013f550 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252f7fe700 1 -- 172.21.15.50:0/2152768791 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c003570 con 0x7f253013f550 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 -- 172.21.15.50:0/2152768791 >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 msgr2=0x7f25300ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 --2- 172.21.15.50:0/2152768791 >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 0x7f25300ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 -- 172.21.15.50:0/2152768791 >> v1:172.21.15.82:6789/0 conn(0x7f253013f550 legacy=0x7f253006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 -- 172.21.15.50:0/2152768791 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253006a960 con 0x7f25300cb3c0 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2527fff700 1 --2- 172.21.15.50:0/2152768791 >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 0x7f25300ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:28.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f2534bcb700 1 --2- 172.21.15.50:0/2152768791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 0x7f253006bb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e60 tx=0x7f2528009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95d8008558b6dc56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:28.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252f7fe700 1 -- 172.21.15.50:0/2152768791 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800e070 con 0x7f25300cb3c0 2023-12-24T20:10:28.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252f7fe700 1 -- 172.21.15.50:0/2152768791 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800bab0 con 0x7f25300cb3c0 2023-12-24T20:10:28.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f252f7fe700 1 -- 172.21.15.50:0/2152768791 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800be70 con 0x7f25300cb3c0 2023-12-24T20:10:28.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 -- 172.21.15.50:0/2152768791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 msgr2=0x7f253006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 --2- 172.21.15.50:0/2152768791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 0x7f253006bb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e60 tx=0x7f2528009780 comp rx=0 tx=0).stop 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 -- 172.21.15.50:0/2152768791 shutdown_connections 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 --2- 172.21.15.50:0/2152768791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25300cb3c0 0x7f253006bb50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 --2- 172.21.15.50:0/2152768791 >> v2:172.21.15.82:3300/0 conn(0x7f253013f920 0x7f25300ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 -- 172.21.15.50:0/2152768791 >> 172.21.15.50:0/2152768791 conn(0x7f25300cbba0 msgr2=0x7f25300cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.214+0000 7f253662e700 1 -- 172.21.15.50:0/2152768791 shutdown_connections 2023-12-24T20:10:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.218+0000 7f253662e700 1 -- 172.21.15.50:0/2152768791 wait complete. 2023-12-24T20:10:28.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.218+0000 7f253662e700 1 Processor -- start 2023-12-24T20:10:28.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.218+0000 7f253662e700 1 -- start start 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 0x7f25301518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 0x7f253013e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301354c0 con 0x7f253013f920 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530136990 con 0x7f25300cb3c0 2023-12-24T20:10:28.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530134f00 con 0x7f253013f550 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2534bcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 0x7f253013e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f252ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 0x7f25301518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2534bcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 0x7f253013e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46168/0 (socket says 172.21.15.50:46168) 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f252ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 0x7f25301518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:40502/0 (socket says 172.21.15.50:40502) 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2534bcb700 1 -- 172.21.15.50:0/620301947 learned_addr learned my addr 172.21.15.50:0/620301947 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:48204/0 (socket says 172.21.15.50:48204) 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 -- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 msgr2=0x7f25301518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 0x7f25301518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 -- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 msgr2=0x7f253013e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 0x7f253013e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 -- 172.21.15.50:0/620301947 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009420 con 0x7f253013f550 2023-12-24T20:10:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f2527fff700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f251800ecb0 tx=0x7f25180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800c850 con 0x7f253013f550 2023-12-24T20:10:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800c9b0 con 0x7f253013f550 2023-12-24T20:10:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800cd50 con 0x7f253013f550 2023-12-24T20:10:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2528009a20 con 0x7f253013f550 2023-12-24T20:10:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.222+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2530136c30 con 0x7f253013f550 2023-12-24T20:10:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.226+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530136e20 con 0x7f253013f550 2023-12-24T20:10:28.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.226+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2518013680 con 0x7f253013f550 2023-12-24T20:10:28.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.230+0000 7f252cff9700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 0x7f2510062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:28.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.230+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f251807cd40 con 0x7f253013f550 2023-12-24T20:10:28.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.230+0000 7f252ffff700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 0x7f2510062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:28.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.230+0000 7f252ffff700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 0x7f2510062ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2520007fd0 tx=0x7f2520009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.238+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f251804d000 con 0x7f253013f550 2023-12-24T20:10:28.267 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-24T20:10:28.266+0000 7f72facf8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:10:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.414+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25300652e0 con 0x7f2510060620 2023-12-24T20:10:28.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.434+0000 7f252cff9700 1 -- 172.21.15.50:0/620301947 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287142 (secure 0 0 0) 0x7f25300652e0 con 0x7f2510060620 2023-12-24T20:10:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 msgr2=0x7f2510062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 0x7f2510062ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2520007fd0 tx=0x7f2520009040 comp rx=0 tx=0).stop 2023-12-24T20:10:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 msgr2=0x7f2530155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f251800ecb0 tx=0x7f25180091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 shutdown_connections 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2510060620 0x7f2510062ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253013f920 0x7f253013e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f253013f550 0x7f2530155930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 --2- 172.21.15.50:0/620301947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25300cb3c0 0x7f25301518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 >> 172.21.15.50:0/620301947 conn(0x7f25300cbba0 msgr2=0x7f25300c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 shutdown_connections 2023-12-24T20:10:28.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:28.442+0000 7f253662e700 1 -- 172.21.15.50:0/620301947 wait complete. 2023-12-24T20:10:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:28.467 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T20:10:27.212935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444968,"kb_used_data":21608,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529752,"statfs":{"total":773094113280,"available":770590466048,"internally_reserved":0,"allocated":22126592,"data_stored":12146372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001964"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048874+0000","last_change":"2023-12-24T20:10:22.043032+0000","last_active":"2023-12-24T20:10:22.048874+0000","last_peered":"2023-12-24T20:10:22.048874+0000","last_clean":"2023-12-24T20:10:22.048874+0000","last_became_active":"2023-12-24T20:10:22.042671+0000","last_became_peered":"2023-12-24T20:10:22.042671+0000","last_unstale":"2023-12-24T20:10:22.048874+0000","last_undegraded":"2023-12-24T20:10:22.048874+0000","last_fullsized":"2023-12-24T20:10:22.048874+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:31.130373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056475+0000","last_change":"2023-12-24T20:10:22.051289+0000","last_active":"2023-12-24T20:10:22.056475+0000","last_peered":"2023-12-24T20:10:22.056475+0000","last_clean":"2023-12-24T20:10:22.056475+0000","last_became_active":"2023-12-24T20:10:22.050964+0000","last_became_peered":"2023-12-24T20:10:22.050964+0000","last_unstale":"2023-12-24T20:10:22.056475+0000","last_undegraded":"2023-12-24T20:10:22.056475+0000","last_fullsized":"2023-12-24T20:10:22.056475+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:24:43.662939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030446+0000","last_change":"2023-12-24T20:10:22.028136+0000","last_active":"2023-12-24T20:10:22.030446+0000","last_peered":"2023-12-24T20:10:22.030446+0000","last_clean":"2023-12-24T20:10:22.030446+0000","last_became_active":"2023-12-24T20:10:22.027797+0000","last_became_peered":"2023-12-24T20:10:22.027797+0000","last_unstale":"2023-12-24T20:10:22.030446+0000","last_undegraded":"2023-12-24T20:10:22.030446+0000","last_fullsized":"2023-12-24T20:10:22.030446+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:08.802080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056390+0000","last_change":"2023-12-24T20:10:22.049583+0000","last_active":"2023-12-24T20:10:22.056390+0000","last_peered":"2023-12-24T20:10:22.056390+0000","last_clean":"2023-12-24T20:10:22.056390+0000","last_became_active":"2023-12-24T20:10:22.049302+0000","last_became_peered":"2023-12-24T20:10:22.049302+0000","last_unstale":"2023-12-24T20:10:22.056390+0000","last_undegraded":"2023-12-24T20:10:22.056390+0000","last_fullsized":"2023-12-24T20:10:22.056390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060066+0000","last_change":"2023-12-24T20:10:22.053066+0000","last_active":"2023-12-24T20:10:22.060066+0000","last_peered":"2023-12-24T20:10:22.060066+0000","last_clean":"2023-12-24T20:10:22.060066+0000","last_became_active":"2023-12-24T20:10:22.052698+0000","last_became_peered":"2023-12-24T20:10:22.052698+0000","last_unstale":"2023-12-24T20:10:22.060066+0000","last_undegraded":"2023-12-24T20:10:22.060066+0000","last_fullsized":"2023-12-24T20:10:22.060066+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:34.408710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058470+0000","last_change":"2023-12-24T20:10:22.049299+0000","last_active":"2023-12-24T20:10:22.058470+0000","last_peered":"2023-12-24T20:10:22.058470+0000","last_clean":"2023-12-24T20:10:22.058470+0000","last_became_active":"2023-12-24T20:10:22.049004+0000","last_became_peered":"2023-12-24T20:10:22.049004+0000","last_unstale":"2023-12-24T20:10:22.058470+0000","last_undegraded":"2023-12-24T20:10:22.058470+0000","last_fullsized":"2023-12-24T20:10:22.058470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:59:29.286083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051130+0000","last_change":"2023-12-24T20:10:22.036361+0000","last_active":"2023-12-24T20:10:22.051130+0000","last_peered":"2023-12-24T20:10:22.051130+0000","last_clean":"2023-12-24T20:10:22.051130+0000","last_became_active":"2023-12-24T20:10:22.036025+0000","last_became_peered":"2023-12-24T20:10:22.036025+0000","last_unstale":"2023-12-24T20:10:22.051130+0000","last_undegraded":"2023-12-24T20:10:22.051130+0000","last_fullsized":"2023-12-24T20:10:22.051130+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:09.701406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053556+0000","last_change":"2023-12-24T20:10:22.051285+0000","last_active":"2023-12-24T20:10:22.053556+0000","last_peered":"2023-12-24T20:10:22.053556+0000","last_clean":"2023-12-24T20:10:22.053556+0000","last_became_active":"2023-12-24T20:10:22.050233+0000","last_became_peered":"2023-12-24T20:10:22.050233+0000","last_unstale":"2023-12-24T20:10:22.053556+0000","last_undegraded":"2023-12-24T20:10:22.053556+0000","last_fullsized":"2023-12-24T20:10:22.053556+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048848+0000","last_change":"2023-12-24T20:10:22.042241+0000","last_active":"2023-12-24T20:10:22.048848+0000","last_peered":"2023-12-24T20:10:22.048848+0000","last_clean":"2023-12-24T20:10:22.048848+0000","last_became_active":"2023-12-24T20:10:22.041863+0000","last_became_peered":"2023-12-24T20:10:22.041863+0000","last_unstale":"2023-12-24T20:10:22.048848+0000","last_undegraded":"2023-12-24T20:10:22.048848+0000","last_fullsized":"2023-12-24T20:10:22.048848+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:43.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058367+0000","last_change":"2023-12-24T20:10:22.046312+0000","last_active":"2023-12-24T20:10:22.058367+0000","last_peered":"2023-12-24T20:10:22.058367+0000","last_clean":"2023-12-24T20:10:22.058367+0000","last_became_active":"2023-12-24T20:10:22.045881+0000","last_became_peered":"2023-12-24T20:10:22.045881+0000","last_unstale":"2023-12-24T20:10:22.058367+0000","last_undegraded":"2023-12-24T20:10:22.058367+0000","last_fullsized":"2023-12-24T20:10:22.058367+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:16.055959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048694+0000","last_change":"2023-12-24T20:10:22.046920+0000","last_active":"2023-12-24T20:10:22.048694+0000","last_peered":"2023-12-24T20:10:22.048694+0000","last_clean":"2023-12-24T20:10:22.048694+0000","last_became_active":"2023-12-24T20:10:22.046618+0000","last_became_peered":"2023-12-24T20:10:22.046618+0000","last_unstale":"2023-12-24T20:10:22.048694+0000","last_undegraded":"2023-12-24T20:10:22.048694+0000","last_fullsized":"2023-12-24T20:10:22.048694+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060470+0000","last_change":"2023-12-24T20:10:22.059909+0000","last_active":"2023-12-24T20:10:22.060470+0000","last_peered":"2023-12-24T20:10:22.060470+0000","last_clean":"2023-12-24T20:10:22.060470+0000","last_became_active":"2023-12-24T20:10:22.058921+0000","last_became_peered":"2023-12-24T20:10:22.058921+0000","last_unstale":"2023-12-24T20:10:22.060470+0000","last_undegraded":"2023-12-24T20:10:22.060470+0000","last_fullsized":"2023-12-24T20:10:22.060470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.032238+0000","last_change":"2023-12-24T20:10:22.029025+0000","last_active":"2023-12-24T20:10:22.032238+0000","last_peered":"2023-12-24T20:10:22.032238+0000","last_clean":"2023-12-24T20:10:22.032238+0000","last_became_active":"2023-12-24T20:10:22.028676+0000","last_became_peered":"2023-12-24T20:10:22.028676+0000","last_unstale":"2023-12-24T20:10:22.032238+0000","last_undegraded":"2023-12-24T20:10:22.032238+0000","last_fullsized":"2023-12-24T20:10:22.032238+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:03.428061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.042436+0000","last_change":"2023-12-24T20:10:22.030406+0000","last_active":"2023-12-24T20:10:22.042436+0000","last_peered":"2023-12-24T20:10:22.042436+0000","last_clean":"2023-12-24T20:10:22.042436+0000","last_became_active":"2023-12-24T20:10:22.030076+0000","last_became_peered":"2023-12-24T20:10:22.030076+0000","last_unstale":"2023-12-24T20:10:22.042436+0000","last_undegraded":"2023-12-24T20:10:22.042436+0000","last_fullsized":"2023-12-24T20:10:22.042436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:22:58.629359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053953+0000","last_change":"2023-12-24T20:10:22.045274+0000","last_active":"2023-12-24T20:10:22.053953+0000","last_peered":"2023-12-24T20:10:22.053953+0000","last_clean":"2023-12-24T20:10:22.053953+0000","last_became_active":"2023-12-24T20:10:22.042746+0000","last_became_peered":"2023-12-24T20:10:22.042746+0000","last_unstale":"2023-12-24T20:10:22.053953+0000","last_undegraded":"2023-12-24T20:10:22.053953+0000","last_fullsized":"2023-12-24T20:10:22.053953+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:48.942011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059927+0000","last_change":"2023-12-24T20:10:22.052143+0000","last_active":"2023-12-24T20:10:22.059927+0000","last_peered":"2023-12-24T20:10:22.059927+0000","last_clean":"2023-12-24T20:10:22.059927+0000","last_became_active":"2023-12-24T20:10:22.051470+0000","last_became_peered":"2023-12-24T20:10:22.051470+0000","last_unstale":"2023-12-24T20:10:22.059927+0000","last_undegraded":"2023-12-24T20:10:22.059927+0000","last_fullsized":"2023-12-24T20:10:22.059927+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058346+0000","last_change":"2023-12-24T20:10:22.045008+0000","last_active":"2023-12-24T20:10:22.058346+0000","last_peered":"2023-12-24T20:10:22.058346+0000","last_clean":"2023-12-24T20:10:22.058346+0000","last_became_active":"2023-12-24T20:10:22.044696+0000","last_became_peered":"2023-12-24T20:10:22.044696+0000","last_unstale":"2023-12-24T20:10:22.058346+0000","last_undegraded":"2023-12-24T20:10:22.058346+0000","last_fullsized":"2023-12-24T20:10:22.058346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.038295+0000","last_change":"2023-12-24T20:10:22.035311+0000","last_active":"2023-12-24T20:10:22.038295+0000","last_peered":"2023-12-24T20:10:22.038295+0000","last_clean":"2023-12-24T20:10:22.038295+0000","last_became_active":"2023-12-24T20:10:22.034962+0000","last_became_peered":"2023-12-24T20:10:22.034962+0000","last_unstale":"2023-12-24T20:10:22.038295+0000","last_undegraded":"2023-12-24T20:10:22.038295+0000","last_fullsized":"2023-12-24T20:10:22.038295+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:15.370479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034863+0000","last_change":"2023-12-24T20:10:22.031327+0000","last_active":"2023-12-24T20:10:22.034863+0000","last_peered":"2023-12-24T20:10:22.034863+0000","last_clean":"2023-12-24T20:10:22.034863+0000","last_became_active":"2023-12-24T20:10:22.031039+0000","last_became_peered":"2023-12-24T20:10:22.031039+0000","last_unstale":"2023-12-24T20:10:22.034863+0000","last_undegraded":"2023-12-24T20:10:22.034863+0000","last_fullsized":"2023-12-24T20:10:22.034863+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:56.546959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060202+0000","last_change":"2023-12-24T20:10:22.054226+0000","last_active":"2023-12-24T20:10:22.060202+0000","last_peered":"2023-12-24T20:10:22.060202+0000","last_clean":"2023-12-24T20:10:22.060202+0000","last_became_active":"2023-12-24T20:10:22.053874+0000","last_became_peered":"2023-12-24T20:10:22.053874+0000","last_unstale":"2023-12-24T20:10:22.060202+0000","last_undegraded":"2023-12-24T20:10:22.060202+0000","last_fullsized":"2023-12-24T20:10:22.060202+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048834+0000","last_change":"2023-12-24T20:10:22.043778+0000","last_active":"2023-12-24T20:10:22.048834+0000","last_peered":"2023-12-24T20:10:22.048834+0000","last_clean":"2023-12-24T20:10:22.048834+0000","last_became_active":"2023-12-24T20:10:22.043497+0000","last_became_peered":"2023-12-24T20:10:22.043497+0000","last_unstale":"2023-12-24T20:10:22.048834+0000","last_undegraded":"2023-12-24T20:10:22.048834+0000","last_fullsized":"2023-12-24T20:10:22.048834+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:21.933791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049443+0000","last_change":"2023-12-24T20:10:22.044329+0000","last_active":"2023-12-24T20:10:22.049443+0000","last_peered":"2023-12-24T20:10:22.049443+0000","last_clean":"2023-12-24T20:10:22.049443+0000","last_became_active":"2023-12-24T20:10:22.044038+0000","last_became_peered":"2023-12-24T20:10:22.044038+0000","last_unstale":"2023-12-24T20:10:22.049443+0000","last_undegraded":"2023-12-24T20:10:22.049443+0000","last_fullsized":"2023-12-24T20:10:22.049443+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:50.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052042+0000","last_change":"2023-12-24T20:10:22.047403+0000","last_active":"2023-12-24T20:10:22.052042+0000","last_peered":"2023-12-24T20:10:22.052042+0000","last_clean":"2023-12-24T20:10:22.052042+0000","last_became_active":"2023-12-24T20:10:22.047114+0000","last_became_peered":"2023-12-24T20:10:22.047114+0000","last_unstale":"2023-12-24T20:10:22.052042+0000","last_undegraded":"2023-12-24T20:10:22.052042+0000","last_fullsized":"2023-12-24T20:10:22.052042+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047901+0000","last_change":"2023-12-24T20:10:22.039320+0000","last_active":"2023-12-24T20:10:22.047901+0000","last_peered":"2023-12-24T20:10:22.047901+0000","last_clean":"2023-12-24T20:10:22.047901+0000","last_became_active":"2023-12-24T20:10:22.038806+0000","last_became_peered":"2023-12-24T20:10:22.038806+0000","last_unstale":"2023-12-24T20:10:22.047901+0000","last_undegraded":"2023-12-24T20:10:22.047901+0000","last_fullsized":"2023-12-24T20:10:22.047901+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:29:14.602278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060408+0000","last_change":"2023-12-24T20:10:22.057124+0000","last_active":"2023-12-24T20:10:22.060408+0000","last_peered":"2023-12-24T20:10:22.060408+0000","last_clean":"2023-12-24T20:10:22.060408+0000","last_became_active":"2023-12-24T20:10:22.056716+0000","last_became_peered":"2023-12-24T20:10:22.056716+0000","last_unstale":"2023-12-24T20:10:22.060408+0000","last_undegraded":"2023-12-24T20:10:22.060408+0000","last_fullsized":"2023-12-24T20:10:22.060408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:57.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055432+0000","last_change":"2023-12-24T20:10:22.053203+0000","last_active":"2023-12-24T20:10:22.055432+0000","last_peered":"2023-12-24T20:10:22.055432+0000","last_clean":"2023-12-24T20:10:22.055432+0000","last_became_active":"2023-12-24T20:10:22.052673+0000","last_became_peered":"2023-12-24T20:10:22.052673+0000","last_unstale":"2023-12-24T20:10:22.055432+0000","last_undegraded":"2023-12-24T20:10:22.055432+0000","last_fullsized":"2023-12-24T20:10:22.055432+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:14.433919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053614+0000","last_change":"2023-12-24T20:10:22.049561+0000","last_active":"2023-12-24T20:10:22.053614+0000","last_peered":"2023-12-24T20:10:22.053614+0000","last_clean":"2023-12-24T20:10:22.053614+0000","last_became_active":"2023-12-24T20:10:22.049246+0000","last_became_peered":"2023-12-24T20:10:22.049246+0000","last_unstale":"2023-12-24T20:10:22.053614+0000","last_undegraded":"2023-12-24T20:10:22.053614+0000","last_fullsized":"2023-12-24T20:10:22.053614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059867+0000","last_change":"2023-12-24T20:10:22.052041+0000","last_active":"2023-12-24T20:10:22.059867+0000","last_peered":"2023-12-24T20:10:22.059867+0000","last_clean":"2023-12-24T20:10:22.059867+0000","last_became_active":"2023-12-24T20:10:22.051704+0000","last_became_peered":"2023-12-24T20:10:22.051704+0000","last_unstale":"2023-12-24T20:10:22.059867+0000","last_undegraded":"2023-12-24T20:10:22.059867+0000","last_fullsized":"2023-12-24T20:10:22.059867+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054149+0000","last_change":"2023-12-24T20:10:22.050469+0000","last_active":"2023-12-24T20:10:22.054149+0000","last_peered":"2023-12-24T20:10:22.054149+0000","last_clean":"2023-12-24T20:10:22.054149+0000","last_became_active":"2023-12-24T20:10:22.049592+0000","last_became_peered":"2023-12-24T20:10:22.049592+0000","last_unstale":"2023-12-24T20:10:22.054149+0000","last_undegraded":"2023-12-24T20:10:22.054149+0000","last_fullsized":"2023-12-24T20:10:22.054149+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055390+0000","last_change":"2023-12-24T20:10:22.052932+0000","last_active":"2023-12-24T20:10:22.055390+0000","last_peered":"2023-12-24T20:10:22.055390+0000","last_clean":"2023-12-24T20:10:22.055390+0000","last_became_active":"2023-12-24T20:10:22.047760+0000","last_became_peered":"2023-12-24T20:10:22.047760+0000","last_unstale":"2023-12-24T20:10:22.055390+0000","last_undegraded":"2023-12-24T20:10:22.055390+0000","last_fullsized":"2023-12-24T20:10:22.055390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051148+0000","last_change":"2023-12-24T20:10:22.048364+0000","last_active":"2023-12-24T20:10:22.051148+0000","last_peered":"2023-12-24T20:10:22.051148+0000","last_clean":"2023-12-24T20:10:22.051148+0000","last_became_active":"2023-12-24T20:10:22.048054+0000","last_became_peered":"2023-12-24T20:10:22.048054+0000","last_unstale":"2023-12-24T20:10:22.051148+0000","last_undegraded":"2023-12-24T20:10:22.051148+0000","last_fullsized":"2023-12-24T20:10:22.051148+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:13.833901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058299+0000","last_change":"2023-12-24T20:10:22.046083+0000","last_active":"2023-12-24T20:10:22.058299+0000","last_peered":"2023-12-24T20:10:22.058299+0000","last_clean":"2023-12-24T20:10:22.058299+0000","last_became_active":"2023-12-24T20:10:22.045647+0000","last_became_peered":"2023-12-24T20:10:22.045647+0000","last_unstale":"2023-12-24T20:10:22.058299+0000","last_undegraded":"2023-12-24T20:10:22.058299+0000","last_fullsized":"2023-12-24T20:10:22.058299+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:46.777299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050294+0000","last_change":"2023-12-24T20:10:22.043330+0000","last_active":"2023-12-24T20:10:22.050294+0000","last_peered":"2023-12-24T20:10:22.050294+0000","last_clean":"2023-12-24T20:10:22.050294+0000","last_became_active":"2023-12-24T20:10:22.042744+0000","last_became_peered":"2023-12-24T20:10:22.042744+0000","last_unstale":"2023-12-24T20:10:22.050294+0000","last_undegraded":"2023-12-24T20:10:22.050294+0000","last_fullsized":"2023-12-24T20:10:22.050294+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"207'4","reported_seq":14,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326441+0000","last_change":"2023-12-24T20:10:21.328692+0000","last_active":"2023-12-24T20:10:22.326441+0000","last_peered":"2023-12-24T20:10:22.326441+0000","last_clean":"2023-12-24T20:10:22.326441+0000","last_became_active":"2023-12-24T20:10:21.328379+0000","last_became_peered":"2023-12-24T20:10:21.328379+0000","last_unstale":"2023-12-24T20:10:22.326441+0000","last_undegraded":"2023-12-24T20:10:22.326441+0000","last_fullsized":"2023-12-24T20:10:22.326441+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047075+0000","last_change":"2023-12-24T20:10:22.040630+0000","last_active":"2023-12-24T20:10:22.047075+0000","last_peered":"2023-12-24T20:10:22.047075+0000","last_clean":"2023-12-24T20:10:22.047075+0000","last_became_active":"2023-12-24T20:10:22.040281+0000","last_became_peered":"2023-12-24T20:10:22.040281+0000","last_unstale":"2023-12-24T20:10:22.047075+0000","last_undegraded":"2023-12-24T20:10:22.047075+0000","last_fullsized":"2023-12-24T20:10:22.047075+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:59:29.515812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326801+0000","last_change":"2023-12-24T20:10:21.341249+0000","last_active":"2023-12-24T20:10:22.326801+0000","last_peered":"2023-12-24T20:10:22.326801+0000","last_clean":"2023-12-24T20:10:22.326801+0000","last_became_active":"2023-12-24T20:10:21.340079+0000","last_became_peered":"2023-12-24T20:10:21.340079+0000","last_unstale":"2023-12-24T20:10:22.326801+0000","last_undegraded":"2023-12-24T20:10:22.326801+0000","last_fullsized":"2023-12-24T20:10:22.326801+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:04:20.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053369+0000","last_change":"2023-12-24T20:10:22.049094+0000","last_active":"2023-12-24T20:10:22.053369+0000","last_peered":"2023-12-24T20:10:22.053369+0000","last_clean":"2023-12-24T20:10:22.053369+0000","last_became_active":"2023-12-24T20:10:22.048507+0000","last_became_peered":"2023-12-24T20:10:22.048507+0000","last_unstale":"2023-12-24T20:10:22.053369+0000","last_undegraded":"2023-12-24T20:10:22.053369+0000","last_fullsized":"2023-12-24T20:10:22.053369+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325452+0000","last_change":"2023-12-24T20:10:21.330427+0000","last_active":"2023-12-24T20:10:22.325452+0000","last_peered":"2023-12-24T20:10:22.325452+0000","last_clean":"2023-12-24T20:10:22.325452+0000","last_became_active":"2023-12-24T20:10:21.330141+0000","last_became_peered":"2023-12-24T20:10:21.330141+0000","last_unstale":"2023-12-24T20:10:22.325452+0000","last_undegraded":"2023-12-24T20:10:22.325452+0000","last_fullsized":"2023-12-24T20:10:22.325452+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054654+0000","last_change":"2023-12-24T20:10:22.048512+0000","last_active":"2023-12-24T20:10:22.054654+0000","last_peered":"2023-12-24T20:10:22.054654+0000","last_clean":"2023-12-24T20:10:22.054654+0000","last_became_active":"2023-12-24T20:10:22.048205+0000","last_became_peered":"2023-12-24T20:10:22.048205+0000","last_unstale":"2023-12-24T20:10:22.054654+0000","last_undegraded":"2023-12-24T20:10:22.054654+0000","last_fullsized":"2023-12-24T20:10:22.054654+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:50.114944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324166+0000","last_change":"2023-12-24T20:10:21.324249+0000","last_active":"2023-12-24T20:10:22.324166+0000","last_peered":"2023-12-24T20:10:22.324166+0000","last_clean":"2023-12-24T20:10:22.324166+0000","last_became_active":"2023-12-24T20:10:21.323913+0000","last_became_peered":"2023-12-24T20:10:21.323913+0000","last_unstale":"2023-12-24T20:10:22.324166+0000","last_undegraded":"2023-12-24T20:10:22.324166+0000","last_fullsized":"2023-12-24T20:10:22.324166+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:48.302787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053722+0000","last_change":"2023-12-24T20:10:22.046801+0000","last_active":"2023-12-24T20:10:22.053722+0000","last_peered":"2023-12-24T20:10:22.053722+0000","last_clean":"2023-12-24T20:10:22.053722+0000","last_became_active":"2023-12-24T20:10:22.046073+0000","last_became_peered":"2023-12-24T20:10:22.046073+0000","last_unstale":"2023-12-24T20:10:22.053722+0000","last_undegraded":"2023-12-24T20:10:22.053722+0000","last_fullsized":"2023-12-24T20:10:22.053722+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:19.864656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326943+0000","last_change":"2023-12-24T20:10:21.340568+0000","last_active":"2023-12-24T20:10:22.326943+0000","last_peered":"2023-12-24T20:10:22.326943+0000","last_clean":"2023-12-24T20:10:22.326943+0000","last_became_active":"2023-12-24T20:10:21.340133+0000","last_became_peered":"2023-12-24T20:10:21.340133+0000","last_unstale":"2023-12-24T20:10:22.326943+0000","last_undegraded":"2023-12-24T20:10:22.326943+0000","last_fullsized":"2023-12-24T20:10:22.326943+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:28.266829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057958+0000","last_change":"2023-12-24T20:10:22.052321+0000","last_active":"2023-12-24T20:10:22.057958+0000","last_peered":"2023-12-24T20:10:22.057958+0000","last_clean":"2023-12-24T20:10:22.057958+0000","last_became_active":"2023-12-24T20:10:22.052025+0000","last_became_peered":"2023-12-24T20:10:22.052025+0000","last_unstale":"2023-12-24T20:10:22.057958+0000","last_undegraded":"2023-12-24T20:10:22.057958+0000","last_fullsized":"2023-12-24T20:10:22.057958+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:32.731104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325284+0000","last_change":"2023-12-24T20:10:21.342954+0000","last_active":"2023-12-24T20:10:22.325284+0000","last_peered":"2023-12-24T20:10:22.325284+0000","last_clean":"2023-12-24T20:10:22.325284+0000","last_became_active":"2023-12-24T20:10:21.342595+0000","last_became_peered":"2023-12-24T20:10:21.342595+0000","last_unstale":"2023-12-24T20:10:22.325284+0000","last_undegraded":"2023-12-24T20:10:22.325284+0000","last_fullsized":"2023-12-24T20:10:22.325284+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:47:20.239017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049417+0000","last_change":"2023-12-24T20:10:22.042317+0000","last_active":"2023-12-24T20:10:22.049417+0000","last_peered":"2023-12-24T20:10:22.049417+0000","last_clean":"2023-12-24T20:10:22.049417+0000","last_became_active":"2023-12-24T20:10:22.041979+0000","last_became_peered":"2023-12-24T20:10:22.041979+0000","last_unstale":"2023-12-24T20:10:22.049417+0000","last_undegraded":"2023-12-24T20:10:22.049417+0000","last_fullsized":"2023-12-24T20:10:22.049417+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:44.587605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024318+0000","last_change":"2023-12-24T20:10:21.322840+0000","last_active":"2023-12-24T20:10:22.024318+0000","last_peered":"2023-12-24T20:10:22.024318+0000","last_clean":"2023-12-24T20:10:22.024318+0000","last_became_active":"2023-12-24T20:10:21.322524+0000","last_became_peered":"2023-12-24T20:10:21.322524+0000","last_unstale":"2023-12-24T20:10:22.024318+0000","last_undegraded":"2023-12-24T20:10:22.024318+0000","last_fullsized":"2023-12-24T20:10:22.024318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:53:59.068791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050316+0000","last_change":"2023-12-24T20:10:22.043562+0000","last_active":"2023-12-24T20:10:22.050316+0000","last_peered":"2023-12-24T20:10:22.050316+0000","last_clean":"2023-12-24T20:10:22.050316+0000","last_became_active":"2023-12-24T20:10:22.043052+0000","last_became_peered":"2023-12-24T20:10:22.043052+0000","last_unstale":"2023-12-24T20:10:22.050316+0000","last_undegraded":"2023-12-24T20:10:22.050316+0000","last_fullsized":"2023-12-24T20:10:22.050316+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.040478+0000","last_change":"2023-12-24T20:10:21.342654+0000","last_active":"2023-12-24T20:10:22.040478+0000","last_peered":"2023-12-24T20:10:22.040478+0000","last_clean":"2023-12-24T20:10:22.040478+0000","last_became_active":"2023-12-24T20:10:21.342372+0000","last_became_peered":"2023-12-24T20:10:21.342372+0000","last_unstale":"2023-12-24T20:10:22.040478+0000","last_undegraded":"2023-12-24T20:10:22.040478+0000","last_fullsized":"2023-12-24T20:10:22.040478+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:02.063291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057705+0000","last_change":"2023-12-24T20:10:22.044758+0000","last_active":"2023-12-24T20:10:22.057705+0000","last_peered":"2023-12-24T20:10:22.057705+0000","last_clean":"2023-12-24T20:10:22.057705+0000","last_became_active":"2023-12-24T20:10:22.043653+0000","last_became_peered":"2023-12-24T20:10:22.043653+0000","last_unstale":"2023-12-24T20:10:22.057705+0000","last_undegraded":"2023-12-24T20:10:22.057705+0000","last_fullsized":"2023-12-24T20:10:22.057705+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.036074+0000","last_change":"2023-12-24T20:10:21.341505+0000","last_active":"2023-12-24T20:10:22.036074+0000","last_peered":"2023-12-24T20:10:22.036074+0000","last_clean":"2023-12-24T20:10:22.036074+0000","last_became_active":"2023-12-24T20:10:21.340993+0000","last_became_peered":"2023-12-24T20:10:21.340993+0000","last_unstale":"2023-12-24T20:10:22.036074+0000","last_undegraded":"2023-12-24T20:10:22.036074+0000","last_fullsized":"2023-12-24T20:10:22.036074+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052276+0000","last_change":"2023-12-24T20:10:22.046657+0000","last_active":"2023-12-24T20:10:22.052276+0000","last_peered":"2023-12-24T20:10:22.052276+0000","last_clean":"2023-12-24T20:10:22.052276+0000","last_became_active":"2023-12-24T20:10:22.046281+0000","last_became_peered":"2023-12-24T20:10:22.046281+0000","last_unstale":"2023-12-24T20:10:22.052276+0000","last_undegraded":"2023-12-24T20:10:22.052276+0000","last_fullsized":"2023-12-24T20:10:22.052276+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:11.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"207'3","reported_seq":13,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326189+0000","last_change":"2023-12-24T20:10:21.346137+0000","last_active":"2023-12-24T20:10:22.326189+0000","last_peered":"2023-12-24T20:10:22.326189+0000","last_clean":"2023-12-24T20:10:22.326189+0000","last_became_active":"2023-12-24T20:10:21.345823+0000","last_became_peered":"2023-12-24T20:10:21.345823+0000","last_unstale":"2023-12-24T20:10:22.326189+0000","last_undegraded":"2023-12-24T20:10:22.326189+0000","last_fullsized":"2023-12-24T20:10:22.326189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:38.778312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058851+0000","last_change":"2023-12-24T20:10:22.054910+0000","last_active":"2023-12-24T20:10:22.058851+0000","last_peered":"2023-12-24T20:10:22.058851+0000","last_clean":"2023-12-24T20:10:22.058851+0000","last_became_active":"2023-12-24T20:10:22.053160+0000","last_became_peered":"2023-12-24T20:10:22.053160+0000","last_unstale":"2023-12-24T20:10:22.058851+0000","last_undegraded":"2023-12-24T20:10:22.058851+0000","last_fullsized":"2023-12-24T20:10:22.058851+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:03.078696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"207'6","reported_seq":16,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.329419+0000","last_change":"2023-12-24T20:10:21.329583+0000","last_active":"2023-12-24T20:10:22.329419+0000","last_peered":"2023-12-24T20:10:22.329419+0000","last_clean":"2023-12-24T20:10:22.329419+0000","last_became_active":"2023-12-24T20:10:21.328809+0000","last_became_peered":"2023-12-24T20:10:21.328809+0000","last_unstale":"2023-12-24T20:10:22.329419+0000","last_undegraded":"2023-12-24T20:10:22.329419+0000","last_fullsized":"2023-12-24T20:10:22.329419+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:43.151409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048749+0000","last_change":"2023-12-24T20:10:22.036393+0000","last_active":"2023-12-24T20:10:22.048749+0000","last_peered":"2023-12-24T20:10:22.048749+0000","last_clean":"2023-12-24T20:10:22.048749+0000","last_became_active":"2023-12-24T20:10:22.036071+0000","last_became_peered":"2023-12-24T20:10:22.036071+0000","last_unstale":"2023-12-24T20:10:22.048749+0000","last_undegraded":"2023-12-24T20:10:22.048749+0000","last_fullsized":"2023-12-24T20:10:22.048749+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:16.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324446+0000","last_change":"2023-12-24T20:10:21.321724+0000","last_active":"2023-12-24T20:10:22.324446+0000","last_peered":"2023-12-24T20:10:22.324446+0000","last_clean":"2023-12-24T20:10:22.324446+0000","last_became_active":"2023-12-24T20:10:21.321251+0000","last_became_peered":"2023-12-24T20:10:21.321251+0000","last_unstale":"2023-12-24T20:10:22.324446+0000","last_undegraded":"2023-12-24T20:10:22.324446+0000","last_fullsized":"2023-12-24T20:10:22.324446+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:02.989882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057123+0000","last_change":"2023-12-24T20:10:22.043586+0000","last_active":"2023-12-24T20:10:22.057123+0000","last_peered":"2023-12-24T20:10:22.057123+0000","last_clean":"2023-12-24T20:10:22.057123+0000","last_became_active":"2023-12-24T20:10:22.042963+0000","last_became_peered":"2023-12-24T20:10:22.042963+0000","last_unstale":"2023-12-24T20:10:22.057123+0000","last_undegraded":"2023-12-24T20:10:22.057123+0000","last_fullsized":"2023-12-24T20:10:22.057123+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033596+0000","last_change":"2023-12-24T20:10:21.344171+0000","last_active":"2023-12-24T20:10:22.033596+0000","last_peered":"2023-12-24T20:10:22.033596+0000","last_clean":"2023-12-24T20:10:22.033596+0000","last_became_active":"2023-12-24T20:10:21.343604+0000","last_became_peered":"2023-12-24T20:10:21.343604+0000","last_unstale":"2023-12-24T20:10:22.033596+0000","last_undegraded":"2023-12-24T20:10:22.033596+0000","last_fullsized":"2023-12-24T20:10:22.033596+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.041831+0000","last_change":"2023-12-24T20:10:22.040395+0000","last_active":"2023-12-24T20:10:22.041831+0000","last_peered":"2023-12-24T20:10:22.041831+0000","last_clean":"2023-12-24T20:10:22.041831+0000","last_became_active":"2023-12-24T20:10:22.040084+0000","last_became_peered":"2023-12-24T20:10:22.040084+0000","last_unstale":"2023-12-24T20:10:22.041831+0000","last_undegraded":"2023-12-24T20:10:22.041831+0000","last_fullsized":"2023-12-24T20:10:22.041831+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:25.909153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035164+0000","last_change":"2023-12-24T20:10:21.331552+0000","last_active":"2023-12-24T20:10:22.035164+0000","last_peered":"2023-12-24T20:10:22.035164+0000","last_clean":"2023-12-24T20:10:22.035164+0000","last_became_active":"2023-12-24T20:10:21.331187+0000","last_became_peered":"2023-12-24T20:10:21.331187+0000","last_unstale":"2023-12-24T20:10:22.035164+0000","last_undegraded":"2023-12-24T20:10:22.035164+0000","last_fullsized":"2023-12-24T20:10:22.035164+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:01:04.491152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053857+0000","last_change":"2023-12-24T20:10:22.047143+0000","last_active":"2023-12-24T20:10:22.053857+0000","last_peered":"2023-12-24T20:10:22.053857+0000","last_clean":"2023-12-24T20:10:22.053857+0000","last_became_active":"2023-12-24T20:10:22.045752+0000","last_became_peered":"2023-12-24T20:10:22.045752+0000","last_unstale":"2023-12-24T20:10:22.053857+0000","last_undegraded":"2023-12-24T20:10:22.053857+0000","last_fullsized":"2023-12-24T20:10:22.053857+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:07.378750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"207'8","reported_seq":18,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326577+0000","last_change":"2023-12-24T20:10:21.327512+0000","last_active":"2023-12-24T20:10:22.326577+0000","last_peered":"2023-12-24T20:10:22.326577+0000","last_clean":"2023-12-24T20:10:22.326577+0000","last_became_active":"2023-12-24T20:10:21.326358+0000","last_became_peered":"2023-12-24T20:10:21.326358+0000","last_unstale":"2023-12-24T20:10:22.326577+0000","last_undegraded":"2023-12-24T20:10:22.326577+0000","last_fullsized":"2023-12-24T20:10:22.326577+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049346+0000","last_change":"2023-12-24T20:10:22.046931+0000","last_active":"2023-12-24T20:10:22.049346+0000","last_peered":"2023-12-24T20:10:22.049346+0000","last_clean":"2023-12-24T20:10:22.049346+0000","last_became_active":"2023-12-24T20:10:22.046582+0000","last_became_peered":"2023-12-24T20:10:22.046582+0000","last_unstale":"2023-12-24T20:10:22.049346+0000","last_undegraded":"2023-12-24T20:10:22.049346+0000","last_fullsized":"2023-12-24T20:10:22.049346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:16.357937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325268+0000","last_change":"2023-12-24T20:10:21.327844+0000","last_active":"2023-12-24T20:10:22.325268+0000","last_peered":"2023-12-24T20:10:22.325268+0000","last_clean":"2023-12-24T20:10:22.325268+0000","last_became_active":"2023-12-24T20:10:21.327494+0000","last_became_peered":"2023-12-24T20:10:21.327494+0000","last_unstale":"2023-12-24T20:10:22.325268+0000","last_undegraded":"2023-12-24T20:10:22.325268+0000","last_fullsized":"2023-12-24T20:10:22.325268+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057727+0000","last_change":"2023-12-24T20:10:22.044918+0000","last_active":"2023-12-24T20:10:22.057727+0000","last_peered":"2023-12-24T20:10:22.057727+0000","last_clean":"2023-12-24T20:10:22.057727+0000","last_became_active":"2023-12-24T20:10:22.044608+0000","last_became_peered":"2023-12-24T20:10:22.044608+0000","last_unstale":"2023-12-24T20:10:22.057727+0000","last_undegraded":"2023-12-24T20:10:22.057727+0000","last_fullsized":"2023-12-24T20:10:22.057727+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:47.045124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.327030+0000","last_change":"2023-12-24T20:10:21.330870+0000","last_active":"2023-12-24T20:10:22.327030+0000","last_peered":"2023-12-24T20:10:22.327030+0000","last_clean":"2023-12-24T20:10:22.327030+0000","last_became_active":"2023-12-24T20:10:21.330444+0000","last_became_peered":"2023-12-24T20:10:21.330444+0000","last_unstale":"2023-12-24T20:10:22.327030+0000","last_undegraded":"2023-12-24T20:10:22.327030+0000","last_fullsized":"2023-12-24T20:10:22.327030+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055408+0000","last_change":"2023-12-24T20:10:22.052950+0000","last_active":"2023-12-24T20:10:22.055408+0000","last_peered":"2023-12-24T20:10:22.055408+0000","last_clean":"2023-12-24T20:10:22.055408+0000","last_became_active":"2023-12-24T20:10:22.052300+0000","last_became_peered":"2023-12-24T20:10:22.052300+0000","last_unstale":"2023-12-24T20:10:22.055408+0000","last_undegraded":"2023-12-24T20:10:22.055408+0000","last_fullsized":"2023-12-24T20:10:22.055408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:29.282233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.323961+0000","last_change":"2023-12-24T20:10:21.338860+0000","last_active":"2023-12-24T20:10:22.323961+0000","last_peered":"2023-12-24T20:10:22.323961+0000","last_clean":"2023-12-24T20:10:22.323961+0000","last_became_active":"2023-12-24T20:10:21.338477+0000","last_became_peered":"2023-12-24T20:10:21.338477+0000","last_unstale":"2023-12-24T20:10:22.323961+0000","last_undegraded":"2023-12-24T20:10:22.323961+0000","last_fullsized":"2023-12-24T20:10:22.323961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:57.241226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058869+0000","last_change":"2023-12-24T20:10:22.055380+0000","last_active":"2023-12-24T20:10:22.058869+0000","last_peered":"2023-12-24T20:10:22.058869+0000","last_clean":"2023-12-24T20:10:22.058869+0000","last_became_active":"2023-12-24T20:10:22.054862+0000","last_became_peered":"2023-12-24T20:10:22.054862+0000","last_unstale":"2023-12-24T20:10:22.058869+0000","last_undegraded":"2023-12-24T20:10:22.058869+0000","last_fullsized":"2023-12-24T20:10:22.058869+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:52.084675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.046274+0000","last_change":"2023-12-24T20:10:21.328323+0000","last_active":"2023-12-24T20:10:22.046274+0000","last_peered":"2023-12-24T20:10:22.046274+0000","last_clean":"2023-12-24T20:10:22.046274+0000","last_became_active":"2023-12-24T20:10:21.328048+0000","last_became_peered":"2023-12-24T20:10:21.328048+0000","last_unstale":"2023-12-24T20:10:22.046274+0000","last_undegraded":"2023-12-24T20:10:22.046274+0000","last_fullsized":"2023-12-24T20:10:22.046274+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053989+0000","last_change":"2023-12-24T20:10:22.047796+0000","last_active":"2023-12-24T20:10:22.053989+0000","last_peered":"2023-12-24T20:10:22.053989+0000","last_clean":"2023-12-24T20:10:22.053989+0000","last_became_active":"2023-12-24T20:10:22.046602+0000","last_became_peered":"2023-12-24T20:10:22.046602+0000","last_unstale":"2023-12-24T20:10:22.053989+0000","last_undegraded":"2023-12-24T20:10:22.053989+0000","last_fullsized":"2023-12-24T20:10:22.053989+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:08.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324990+0000","last_change":"2023-12-24T20:10:21.339360+0000","last_active":"2023-12-24T20:10:22.324990+0000","last_peered":"2023-12-24T20:10:22.324990+0000","last_clean":"2023-12-24T20:10:22.324990+0000","last_became_active":"2023-12-24T20:10:21.338884+0000","last_became_peered":"2023-12-24T20:10:21.338884+0000","last_unstale":"2023-12-24T20:10:22.324990+0000","last_undegraded":"2023-12-24T20:10:22.324990+0000","last_fullsized":"2023-12-24T20:10:22.324990+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:10.655331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058783+0000","last_change":"2023-12-24T20:10:22.050466+0000","last_active":"2023-12-24T20:10:22.058783+0000","last_peered":"2023-12-24T20:10:22.058783+0000","last_clean":"2023-12-24T20:10:22.058783+0000","last_became_active":"2023-12-24T20:10:22.050186+0000","last_became_peered":"2023-12-24T20:10:22.050186+0000","last_unstale":"2023-12-24T20:10:22.058783+0000","last_undegraded":"2023-12-24T20:10:22.058783+0000","last_fullsized":"2023-12-24T20:10:22.058783+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035572+0000","last_change":"2023-12-24T20:10:21.329570+0000","last_active":"2023-12-24T20:10:22.035572+0000","last_peered":"2023-12-24T20:10:22.035572+0000","last_clean":"2023-12-24T20:10:22.035572+0000","last_became_active":"2023-12-24T20:10:21.329273+0000","last_became_peered":"2023-12-24T20:10:21.329273+0000","last_unstale":"2023-12-24T20:10:22.035572+0000","last_undegraded":"2023-12-24T20:10:22.035572+0000","last_fullsized":"2023-12-24T20:10:22.035572+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056436+0000","last_change":"2023-12-24T20:10:22.053113+0000","last_active":"2023-12-24T20:10:22.056436+0000","last_peered":"2023-12-24T20:10:22.056436+0000","last_clean":"2023-12-24T20:10:22.056436+0000","last_became_active":"2023-12-24T20:10:22.052789+0000","last_became_peered":"2023-12-24T20:10:22.052789+0000","last_unstale":"2023-12-24T20:10:22.056436+0000","last_undegraded":"2023-12-24T20:10:22.056436+0000","last_fullsized":"2023-12-24T20:10:22.056436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.022767+0000","last_change":"2023-12-24T20:10:21.336557+0000","last_active":"2023-12-24T20:10:22.022767+0000","last_peered":"2023-12-24T20:10:22.022767+0000","last_clean":"2023-12-24T20:10:22.022767+0000","last_became_active":"2023-12-24T20:10:21.335312+0000","last_became_peered":"2023-12-24T20:10:21.335312+0000","last_unstale":"2023-12-24T20:10:22.022767+0000","last_undegraded":"2023-12-24T20:10:22.022767+0000","last_fullsized":"2023-12-24T20:10:22.022767+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:22.836218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060003+0000","last_change":"2023-12-24T20:10:22.052410+0000","last_active":"2023-12-24T20:10:22.060003+0000","last_peered":"2023-12-24T20:10:22.060003+0000","last_clean":"2023-12-24T20:10:22.060003+0000","last_became_active":"2023-12-24T20:10:22.050708+0000","last_became_peered":"2023-12-24T20:10:22.050708+0000","last_unstale":"2023-12-24T20:10:22.060003+0000","last_undegraded":"2023-12-24T20:10:22.060003+0000","last_fullsized":"2023-12-24T20:10:22.060003+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025855+0000","last_change":"2023-12-24T20:10:21.325384+0000","last_active":"2023-12-24T20:10:22.025855+0000","last_peered":"2023-12-24T20:10:22.025855+0000","last_clean":"2023-12-24T20:10:22.025855+0000","last_became_active":"2023-12-24T20:10:21.324469+0000","last_became_peered":"2023-12-24T20:10:21.324469+0000","last_unstale":"2023-12-24T20:10:22.025855+0000","last_undegraded":"2023-12-24T20:10:22.025855+0000","last_fullsized":"2023-12-24T20:10:22.025855+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:47.418537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057568+0000","last_change":"2023-12-24T20:10:22.050974+0000","last_active":"2023-12-24T20:10:22.057568+0000","last_peered":"2023-12-24T20:10:22.057568+0000","last_clean":"2023-12-24T20:10:22.057568+0000","last_became_active":"2023-12-24T20:10:22.050685+0000","last_became_peered":"2023-12-24T20:10:22.050685+0000","last_unstale":"2023-12-24T20:10:22.057568+0000","last_undegraded":"2023-12-24T20:10:22.057568+0000","last_fullsized":"2023-12-24T20:10:22.057568+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.014342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326388+0000","last_change":"2023-12-24T20:10:21.327249+0000","last_active":"2023-12-24T20:10:22.326388+0000","last_peered":"2023-12-24T20:10:22.326388+0000","last_clean":"2023-12-24T20:10:22.326388+0000","last_became_active":"2023-12-24T20:10:21.326939+0000","last_became_peered":"2023-12-24T20:10:21.326939+0000","last_unstale":"2023-12-24T20:10:22.326388+0000","last_undegraded":"2023-12-24T20:10:22.326388+0000","last_fullsized":"2023-12-24T20:10:22.326388+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:20.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057358+0000","last_change":"2023-12-24T20:10:22.050052+0000","last_active":"2023-12-24T20:10:22.057358+0000","last_peered":"2023-12-24T20:10:22.057358+0000","last_clean":"2023-12-24T20:10:22.057358+0000","last_became_active":"2023-12-24T20:10:22.049777+0000","last_became_peered":"2023-12-24T20:10:22.049777+0000","last_unstale":"2023-12-24T20:10:22.057358+0000","last_undegraded":"2023-12-24T20:10:22.057358+0000","last_fullsized":"2023-12-24T20:10:22.057358+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:44.358228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.022159+0000","last_change":"2023-12-24T20:10:21.336024+0000","last_active":"2023-12-24T20:10:22.022159+0000","last_peered":"2023-12-24T20:10:22.022159+0000","last_clean":"2023-12-24T20:10:22.022159+0000","last_became_active":"2023-12-24T20:10:21.335546+0000","last_became_peered":"2023-12-24T20:10:21.335546+0000","last_unstale":"2023-12-24T20:10:22.022159+0000","last_undegraded":"2023-12-24T20:10:22.022159+0000","last_fullsized":"2023-12-24T20:10:22.022159+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:50.016562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048982+0000","last_change":"2023-12-24T20:10:22.043681+0000","last_active":"2023-12-24T20:10:22.048982+0000","last_peered":"2023-12-24T20:10:22.048982+0000","last_clean":"2023-12-24T20:10:22.048982+0000","last_became_active":"2023-12-24T20:10:22.039803+0000","last_became_peered":"2023-12-24T20:10:22.039803+0000","last_unstale":"2023-12-24T20:10:22.048982+0000","last_undegraded":"2023-12-24T20:10:22.048982+0000","last_fullsized":"2023-12-24T20:10:22.048982+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039895+0000","last_change":"2023-12-24T20:10:21.340658+0000","last_active":"2023-12-24T20:10:22.039895+0000","last_peered":"2023-12-24T20:10:22.039895+0000","last_clean":"2023-12-24T20:10:22.039895+0000","last_became_active":"2023-12-24T20:10:21.339964+0000","last_became_peered":"2023-12-24T20:10:21.339964+0000","last_unstale":"2023-12-24T20:10:22.039895+0000","last_undegraded":"2023-12-24T20:10:22.039895+0000","last_fullsized":"2023-12-24T20:10:22.039895+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:07.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059454+0000","last_change":"2023-12-24T20:10:22.055234+0000","last_active":"2023-12-24T20:10:22.059454+0000","last_peered":"2023-12-24T20:10:22.059454+0000","last_clean":"2023-12-24T20:10:22.059454+0000","last_became_active":"2023-12-24T20:10:22.054573+0000","last_became_peered":"2023-12-24T20:10:22.054573+0000","last_unstale":"2023-12-24T20:10:22.059454+0000","last_undegraded":"2023-12-24T20:10:22.059454+0000","last_fullsized":"2023-12-24T20:10:22.059454+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:45.921498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039779+0000","last_change":"2023-12-24T20:10:21.338440+0000","last_active":"2023-12-24T20:10:22.039779+0000","last_peered":"2023-12-24T20:10:22.039779+0000","last_clean":"2023-12-24T20:10:22.039779+0000","last_became_active":"2023-12-24T20:10:21.338129+0000","last_became_peered":"2023-12-24T20:10:21.338129+0000","last_unstale":"2023-12-24T20:10:22.039779+0000","last_undegraded":"2023-12-24T20:10:22.039779+0000","last_fullsized":"2023-12-24T20:10:22.039779+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:13.418515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050390+0000","last_change":"2023-12-24T20:10:22.043991+0000","last_active":"2023-12-24T20:10:22.050390+0000","last_peered":"2023-12-24T20:10:22.050390+0000","last_clean":"2023-12-24T20:10:22.050390+0000","last_became_active":"2023-12-24T20:10:22.043695+0000","last_became_peered":"2023-12-24T20:10:22.043695+0000","last_unstale":"2023-12-24T20:10:22.050390+0000","last_undegraded":"2023-12-24T20:10:22.050390+0000","last_fullsized":"2023-12-24T20:10:22.050390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:49:29.060010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030809+0000","last_change":"2023-12-24T20:10:21.328635+0000","last_active":"2023-12-24T20:10:22.030809+0000","last_peered":"2023-12-24T20:10:22.030809+0000","last_clean":"2023-12-24T20:10:22.030809+0000","last_became_active":"2023-12-24T20:10:21.328181+0000","last_became_peered":"2023-12-24T20:10:21.328181+0000","last_unstale":"2023-12-24T20:10:22.030809+0000","last_undegraded":"2023-12-24T20:10:22.030809+0000","last_fullsized":"2023-12-24T20:10:22.030809+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:47.926607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033638+0000","last_change":"2023-12-24T20:10:22.030337+0000","last_active":"2023-12-24T20:10:22.033638+0000","last_peered":"2023-12-24T20:10:22.033638+0000","last_clean":"2023-12-24T20:10:22.033638+0000","last_became_active":"2023-12-24T20:10:22.029988+0000","last_became_peered":"2023-12-24T20:10:22.029988+0000","last_unstale":"2023-12-24T20:10:22.033638+0000","last_undegraded":"2023-12-24T20:10:22.033638+0000","last_fullsized":"2023-12-24T20:10:22.033638+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:26.561797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030584+0000","last_change":"2023-12-24T20:10:21.344023+0000","last_active":"2023-12-24T20:10:22.030584+0000","last_peered":"2023-12-24T20:10:22.030584+0000","last_clean":"2023-12-24T20:10:22.030584+0000","last_became_active":"2023-12-24T20:10:21.343641+0000","last_became_peered":"2023-12-24T20:10:21.343641+0000","last_unstale":"2023-12-24T20:10:22.030584+0000","last_undegraded":"2023-12-24T20:10:22.030584+0000","last_fullsized":"2023-12-24T20:10:22.030584+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:42.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053875+0000","last_change":"2023-12-24T20:10:22.045727+0000","last_active":"2023-12-24T20:10:22.053875+0000","last_peered":"2023-12-24T20:10:22.053875+0000","last_clean":"2023-12-24T20:10:22.053875+0000","last_became_active":"2023-12-24T20:10:22.045376+0000","last_became_peered":"2023-12-24T20:10:22.045376+0000","last_unstale":"2023-12-24T20:10:22.053875+0000","last_undegraded":"2023-12-24T20:10:22.053875+0000","last_fullsized":"2023-12-24T20:10:22.053875+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:15.404026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024046+0000","last_change":"2023-12-24T20:10:21.323547+0000","last_active":"2023-12-24T20:10:22.024046+0000","last_peered":"2023-12-24T20:10:22.024046+0000","last_clean":"2023-12-24T20:10:22.024046+0000","last_became_active":"2023-12-24T20:10:21.323248+0000","last_became_peered":"2023-12-24T20:10:21.323248+0000","last_unstale":"2023-12-24T20:10:22.024046+0000","last_undegraded":"2023-12-24T20:10:22.024046+0000","last_fullsized":"2023-12-24T20:10:22.024046+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:44.468978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052529+0000","last_change":"2023-12-24T20:10:22.047320+0000","last_active":"2023-12-24T20:10:22.052529+0000","last_peered":"2023-12-24T20:10:22.052529+0000","last_clean":"2023-12-24T20:10:22.052529+0000","last_became_active":"2023-12-24T20:10:22.046981+0000","last_became_peered":"2023-12-24T20:10:22.046981+0000","last_unstale":"2023-12-24T20:10:22.052529+0000","last_undegraded":"2023-12-24T20:10:22.052529+0000","last_fullsized":"2023-12-24T20:10:22.052529+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025961+0000","last_change":"2023-12-24T20:10:21.332615+0000","last_active":"2023-12-24T20:10:22.025961+0000","last_peered":"2023-12-24T20:10:22.025961+0000","last_clean":"2023-12-24T20:10:22.025961+0000","last_became_active":"2023-12-24T20:10:21.332243+0000","last_became_peered":"2023-12-24T20:10:21.332243+0000","last_unstale":"2023-12-24T20:10:22.025961+0000","last_undegraded":"2023-12-24T20:10:22.025961+0000","last_fullsized":"2023-12-24T20:10:22.025961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:10.074352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055156+0000","last_change":"2023-12-24T20:10:22.054250+0000","last_active":"2023-12-24T20:10:22.055156+0000","last_peered":"2023-12-24T20:10:22.055156+0000","last_clean":"2023-12-24T20:10:22.055156+0000","last_became_active":"2023-12-24T20:10:22.052492+0000","last_became_peered":"2023-12-24T20:10:22.052492+0000","last_unstale":"2023-12-24T20:10:22.055156+0000","last_undegraded":"2023-12-24T20:10:22.055156+0000","last_fullsized":"2023-12-24T20:10:22.055156+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:23.682561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034215+0000","last_change":"2023-12-24T20:10:21.325727+0000","last_active":"2023-12-24T20:10:22.034215+0000","last_peered":"2023-12-24T20:10:22.034215+0000","last_clean":"2023-12-24T20:10:22.034215+0000","last_became_active":"2023-12-24T20:10:21.325436+0000","last_became_peered":"2023-12-24T20:10:21.325436+0000","last_unstale":"2023-12-24T20:10:22.034215+0000","last_undegraded":"2023-12-24T20:10:22.034215+0000","last_fullsized":"2023-12-24T20:10:22.034215+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1133,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030353+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:22.030353+0000","last_peered":"2023-12-24T20:10:22.030353+0000","last_clean":"2023-12-24T20:10:22.030353+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:22.030353+0000","last_undegraded":"2023-12-24T20:10:22.030353+0000","last_fullsized":"2023-12-24T20:10:22.030353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304512,"kb_used_data":3128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067328,"statfs":{"total":96636764160,"available":96324943872,"internally_reserved":0,"allocated":3203072,"data_stored":1960496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.71199999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5629999999999999,"5min":1.728,"15min":1.728},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.131,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.127,"15min":1.161},"min":{"1min":0.69899999999999995,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.494,"5min":1.718,"15min":1.9379999999999999},"last":1.379},{"interface":"front","average":{"1min":1.2,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.532,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.159}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.238,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.73599999999999999,"15min":0.70899999999999996},"max":{"1min":1.4570000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.2390000000000001,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6899999999999999,"5min":1.7390000000000001,"15min":1.8200000000000001},"last":1.2110000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3129999999999999},"min":{"1min":0.93700000000000006,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":1.857,"15min":2.4449999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.319,"15min":1.343},"min":{"1min":1.0109999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.593,"5min":1.988,"15min":2.2919999999999998},"last":1.325}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2450000000000001,"15min":1.2090000000000001},"min":{"1min":0.90000000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.647,"5min":1.865,"15min":2.194},"last":0.751},{"interface":"front","average":{"1min":1.373,"5min":1.3340000000000001,"15min":1.278},"min":{"1min":1.0649999999999999,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.6399999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":0.88300000000000001,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.6870000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4099999999999999,"15min":1.353},"min":{"1min":1.1020000000000001,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":1.95,"15min":1.95},"last":1.079}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":0.97799999999999998,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.8460000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.26},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.494,"15min":1.4339999999999999},"min":{"1min":1.01,"5min":0.875,"15min":0.55000000000000004},"max":{"1min":1.7609999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.103}]}]},{"osd":6,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.1990000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.2889999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.151},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.105}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.056}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.4870000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.464},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.2370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":1.5149999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.2729999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.3260000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.599}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.103},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":1.474},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.657}]}]},{"osd":4,"up_from":13,"seq":55834575970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6970000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.419},{"interface":"front","average":{"1min":1.212,"5min":1.27,"15min":1.286},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":1.577,"5min":1.9490000000000001,"15min":2.012},"last":1.528}]},{"osd":1,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1579999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7629999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.119},{"interface":"front","average":{"1min":1.123,"5min":1.169,"15min":1.155},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.427,"5min":1.621,"15min":1.694},"last":1.081}]},{"osd":2,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.339},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.788,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3759999999999999,"15min":1.3720000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.835,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.1990000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.206,"15min":1.2190000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3109999999999999,"15min":1.3129999999999999},"min":{"1min":0.96899999999999997,"5min":0.90600000000000003,"15min":0.89100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.446}]},{"osd":5,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3009999999999999,"15min":1.3089999999999999},"min":{"1min":0.81499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.3400000000000001,"15min":1.3280000000000001},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.0720000000000001,"15min":2.089},"last":1.601}]},{"osd":6,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.28,"15min":1.298},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":2.0219999999999998,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.361},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.335,"15min":1.3380000000000001},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.486}]},{"osd":7,"last update":"Sun Dec 24 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.2969999999999999,"15min":1.3100000000000001},"min":{"1min":0.89600000000000002,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.8420000000000001,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.232},{"interface":"front","average":{"1min":1.492,"5min":1.4590000000000001,"15min":1.4350000000000001},"min":{"1min":1.0369999999999999,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.274}]}]},{"osd":3,"up_from":13,"seq":55834575969,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299844,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071996,"statfs":{"total":96636764160,"available":96329723904,"internally_reserved":0,"allocated":2617344,"data_stored":1370288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":1.6040000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.98499999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.1140000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.8759999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.3480000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.522},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.7869999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.72},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.5660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":1.091}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":1.0269999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.147},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.88600000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.488}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.363}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.657},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.95}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.758}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312124,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059716,"statfs":{"total":96636764160,"available":96317149184,"internally_reserved":0,"allocated":2609152,"data_stored":1370128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.411}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.109}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.2749999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.494}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.536},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.2310000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.677}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.4490000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304528,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067312,"statfs":{"total":96636764160,"available":96324927488,"internally_reserved":0,"allocated":3219456,"data_stored":1961196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6950000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.67900000000000005,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.651,"5min":1.823,"15min":1.823},"last":0.70899999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.105,"15min":1.095},"min":{"1min":0.72699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.9630000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.157,"15min":1.155},"min":{"1min":0.72699999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.569,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.98999999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.105,"15min":1.1020000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.58199999999999996},"max":{"1min":1.4530000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.2849999999999999,"15min":1.288},"min":{"1min":0.96499999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.389,"15min":1.3879999999999999},"min":{"1min":0.95999999999999996,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.6220000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.119},{"interface":"front","average":{"1min":1.304,"5min":1.325,"15min":1.3280000000000001},"min":{"1min":1.0429999999999999,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6950000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.554}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.4650000000000001,"15min":1.4530000000000001},"min":{"1min":1.288,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.581},{"interface":"front","average":{"1min":1.448,"5min":1.466,"15min":1.456},"min":{"1min":1.099,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.8440000000000001,"5min":1.9099999999999999,"15min":2.125},"last":1.1759999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.2150000000000001,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.8089999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.538,"15min":1.524},"min":{"1min":1.216,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.5369999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.5489999999999999,"15min":1.5329999999999999},"min":{"1min":1.28,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":2.1309999999999998,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.304},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5329999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8799999999999999,"5min":2.234,"15min":2.411},"last":1.4370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:31.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.638+0000 7fcd9c0ae700 1 Processor -- start 2023-12-24T20:10:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.638+0000 7fcd9c0ae700 1 -- start start 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd94159bc0 0x7fcd94159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd9406bce0 0x7fcd940aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd940ab040 0x7fcd940ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9406b850 con 0x7fcd940ab040 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9406ac40 con 0x7fcd9406bce0 2023-12-24T20:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9c0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406af20 con 0x7fcd94159bc0 2023-12-24T20:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd940ab040 0x7fcd940ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd940ab040 0x7fcd940ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44328/0 (socket says 172.21.15.50:44328) 2023-12-24T20:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 -- 172.21.15.50:0/2581473308 learned_addr learned my addr 172.21.15.50:0/2581473308 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd99e4a700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd94159bc0 0x7fcd94159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd99649700 1 --2- 172.21.15.50:0/2581473308 >> v2:172.21.15.82:3300/0 conn(0x7fcd9406bce0 0x7fcd940aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 -- 172.21.15.50:0/2581473308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd94159bc0 msgr2=0x7fcd94159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd94159bc0 0x7fcd94159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 -- 172.21.15.50:0/2581473308 >> v2:172.21.15.82:3300/0 conn(0x7fcd9406bce0 msgr2=0x7fcd940aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 --2- 172.21.15.50:0/2581473308 >> v2:172.21.15.82:3300/0 conn(0x7fcd9406bce0 0x7fcd940aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 -- 172.21.15.50:0/2581473308 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9406b200 con 0x7fcd940ab040 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd9a64b700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd940ab040 0x7fcd940ca110 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fcd94069bf0 tx=0x7fcd8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301a1883c21756cc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd98e48700 1 -- 172.21.15.50:0/2581473308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00b860 con 0x7fcd940ab040 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd98e48700 1 -- 172.21.15.50:0/2581473308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c00b9c0 con 0x7fcd940ab040 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.642+0000 7fcd98e48700 1 -- 172.21.15.50:0/2581473308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00bd60 con 0x7fcd940ab040 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/2581473308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd940ab040 msgr2=0x7fcd940ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd940ab040 0x7fcd940ca110 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fcd94069bf0 tx=0x7fcd8c009250 comp rx=0 tx=0).stop 2023-12-24T20:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/2581473308 shutdown_connections 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/2581473308 >> v2:172.21.15.82:3300/0 conn(0x7fcd9406bce0 0x7fcd940aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd940ab040 0x7fcd940ca110 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/2581473308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd94159bc0 0x7fcd94159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/2581473308 >> 172.21.15.50:0/2581473308 conn(0x7fcd940cbba0 msgr2=0x7fcd940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/2581473308 shutdown_connections 2023-12-24T20:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.646+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/2581473308 wait complete. 2023-12-24T20:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 Processor -- start 2023-12-24T20:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 -- start start 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd940ab040 0x7fcd940aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94159bc0 0x7fcd940aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415ac40 con 0x7fcd9406bce0 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415a030 con 0x7fcd94159bc0 2023-12-24T20:10:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9c0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415a310 con 0x7fcd940ab040 2023-12-24T20:10:31.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44340/0 (socket says 172.21.15.50:44340) 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 -- 172.21.15.50:0/58074786 learned_addr learned my addr 172.21.15.50:0/58074786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99649700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd940ab040 0x7fcd940aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd9a64b700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94159bc0 0x7fcd940aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 -- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd940ab040 msgr2=0x7fcd940aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd940ab040 0x7fcd940aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 -- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94159bc0 msgr2=0x7fcd940aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94159bc0 0x7fcd940aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.650+0000 7fcd99e4a700 1 -- 172.21.15.50:0/58074786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0094f0 con 0x7fcd9406bce0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd99e4a700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e190 tx=0x7fcd90009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000ed00 con 0x7fcd9406bce0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000ee80 con 0x7fcd9406bce0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90014670 con 0x7fcd9406bce0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9415a5f0 con 0x7fcd9406bce0 2023-12-24T20:10:31.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940b0a90 con 0x7fcd9406bce0 2023-12-24T20:10:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.654+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd940652e0 con 0x7fcd9406bce0 2023-12-24T20:10:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.658+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fcd900149e0 con 0x7fcd9406bce0 2023-12-24T20:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.658+0000 7fcd89ffb700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 0x7fcd78062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.658+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fcd9007d230 con 0x7fcd9406bce0 2023-12-24T20:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.658+0000 7fcd99649700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 0x7fcd78062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:31.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.662+0000 7fcd99649700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 0x7fcd78062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd9416c540 tx=0x7fcd84008040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:31.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.666+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd9004d4f0 con 0x7fcd9406bce0 2023-12-24T20:10:31.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.838+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd9415ad80 con 0x7fcd78060620 2023-12-24T20:10:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.854+0000 7fcd89ffb700 1 -- 172.21.15.50:0/58074786 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287015 (secure 0 0 0) 0x7fcd8400bdd0 con 0x7fcd78060620 2023-12-24T20:10:31.865 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 msgr2=0x7fcd78062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 0x7fcd78062ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd9416c540 tx=0x7fcd84008040 comp rx=0 tx=0).stop 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 msgr2=0x7fcd94152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e190 tx=0x7fcd90009900 comp rx=0 tx=0).stop 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 shutdown_connections 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fcd78060620 0x7fcd78062ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94159bc0 0x7fcd940aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd940ab040 0x7fcd940aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 --2- 172.21.15.50:0/58074786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9406bce0 0x7fcd94152910 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 >> 172.21.15.50:0/58074786 conn(0x7fcd940cbba0 msgr2=0x7fcd94154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 shutdown_connections 2023-12-24T20:10:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:31.866+0000 7fcd9c0ae700 1 -- 172.21.15.50:0/58074786 wait complete. 2023-12-24T20:10:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:31.888 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-24T20:10:31.214501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":624,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444968,"kb_used_data":21608,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529752,"statfs":{"total":773094113280,"available":770590466048,"internally_reserved":0,"allocated":22126592,"data_stored":12146372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.195663"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048874+0000","last_change":"2023-12-24T20:10:22.043032+0000","last_active":"2023-12-24T20:10:22.048874+0000","last_peered":"2023-12-24T20:10:22.048874+0000","last_clean":"2023-12-24T20:10:22.048874+0000","last_became_active":"2023-12-24T20:10:22.042671+0000","last_became_peered":"2023-12-24T20:10:22.042671+0000","last_unstale":"2023-12-24T20:10:22.048874+0000","last_undegraded":"2023-12-24T20:10:22.048874+0000","last_fullsized":"2023-12-24T20:10:22.048874+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:16:31.130373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056475+0000","last_change":"2023-12-24T20:10:22.051289+0000","last_active":"2023-12-24T20:10:22.056475+0000","last_peered":"2023-12-24T20:10:22.056475+0000","last_clean":"2023-12-24T20:10:22.056475+0000","last_became_active":"2023-12-24T20:10:22.050964+0000","last_became_peered":"2023-12-24T20:10:22.050964+0000","last_unstale":"2023-12-24T20:10:22.056475+0000","last_undegraded":"2023-12-24T20:10:22.056475+0000","last_fullsized":"2023-12-24T20:10:22.056475+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:24:43.662939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030446+0000","last_change":"2023-12-24T20:10:22.028136+0000","last_active":"2023-12-24T20:10:22.030446+0000","last_peered":"2023-12-24T20:10:22.030446+0000","last_clean":"2023-12-24T20:10:22.030446+0000","last_became_active":"2023-12-24T20:10:22.027797+0000","last_became_peered":"2023-12-24T20:10:22.027797+0000","last_unstale":"2023-12-24T20:10:22.030446+0000","last_undegraded":"2023-12-24T20:10:22.030446+0000","last_fullsized":"2023-12-24T20:10:22.030446+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:08.802080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056390+0000","last_change":"2023-12-24T20:10:22.049583+0000","last_active":"2023-12-24T20:10:22.056390+0000","last_peered":"2023-12-24T20:10:22.056390+0000","last_clean":"2023-12-24T20:10:22.056390+0000","last_became_active":"2023-12-24T20:10:22.049302+0000","last_became_peered":"2023-12-24T20:10:22.049302+0000","last_unstale":"2023-12-24T20:10:22.056390+0000","last_undegraded":"2023-12-24T20:10:22.056390+0000","last_fullsized":"2023-12-24T20:10:22.056390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060066+0000","last_change":"2023-12-24T20:10:22.053066+0000","last_active":"2023-12-24T20:10:22.060066+0000","last_peered":"2023-12-24T20:10:22.060066+0000","last_clean":"2023-12-24T20:10:22.060066+0000","last_became_active":"2023-12-24T20:10:22.052698+0000","last_became_peered":"2023-12-24T20:10:22.052698+0000","last_unstale":"2023-12-24T20:10:22.060066+0000","last_undegraded":"2023-12-24T20:10:22.060066+0000","last_fullsized":"2023-12-24T20:10:22.060066+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:34.408710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058470+0000","last_change":"2023-12-24T20:10:22.049299+0000","last_active":"2023-12-24T20:10:22.058470+0000","last_peered":"2023-12-24T20:10:22.058470+0000","last_clean":"2023-12-24T20:10:22.058470+0000","last_became_active":"2023-12-24T20:10:22.049004+0000","last_became_peered":"2023-12-24T20:10:22.049004+0000","last_unstale":"2023-12-24T20:10:22.058470+0000","last_undegraded":"2023-12-24T20:10:22.058470+0000","last_fullsized":"2023-12-24T20:10:22.058470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:59:29.286083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051130+0000","last_change":"2023-12-24T20:10:22.036361+0000","last_active":"2023-12-24T20:10:22.051130+0000","last_peered":"2023-12-24T20:10:22.051130+0000","last_clean":"2023-12-24T20:10:22.051130+0000","last_became_active":"2023-12-24T20:10:22.036025+0000","last_became_peered":"2023-12-24T20:10:22.036025+0000","last_unstale":"2023-12-24T20:10:22.051130+0000","last_undegraded":"2023-12-24T20:10:22.051130+0000","last_fullsized":"2023-12-24T20:10:22.051130+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:09.701406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053556+0000","last_change":"2023-12-24T20:10:22.051285+0000","last_active":"2023-12-24T20:10:22.053556+0000","last_peered":"2023-12-24T20:10:22.053556+0000","last_clean":"2023-12-24T20:10:22.053556+0000","last_became_active":"2023-12-24T20:10:22.050233+0000","last_became_peered":"2023-12-24T20:10:22.050233+0000","last_unstale":"2023-12-24T20:10:22.053556+0000","last_undegraded":"2023-12-24T20:10:22.053556+0000","last_fullsized":"2023-12-24T20:10:22.053556+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048848+0000","last_change":"2023-12-24T20:10:22.042241+0000","last_active":"2023-12-24T20:10:22.048848+0000","last_peered":"2023-12-24T20:10:22.048848+0000","last_clean":"2023-12-24T20:10:22.048848+0000","last_became_active":"2023-12-24T20:10:22.041863+0000","last_became_peered":"2023-12-24T20:10:22.041863+0000","last_unstale":"2023-12-24T20:10:22.048848+0000","last_undegraded":"2023-12-24T20:10:22.048848+0000","last_fullsized":"2023-12-24T20:10:22.048848+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:43.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058367+0000","last_change":"2023-12-24T20:10:22.046312+0000","last_active":"2023-12-24T20:10:22.058367+0000","last_peered":"2023-12-24T20:10:22.058367+0000","last_clean":"2023-12-24T20:10:22.058367+0000","last_became_active":"2023-12-24T20:10:22.045881+0000","last_became_peered":"2023-12-24T20:10:22.045881+0000","last_unstale":"2023-12-24T20:10:22.058367+0000","last_undegraded":"2023-12-24T20:10:22.058367+0000","last_fullsized":"2023-12-24T20:10:22.058367+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:16.055959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048694+0000","last_change":"2023-12-24T20:10:22.046920+0000","last_active":"2023-12-24T20:10:22.048694+0000","last_peered":"2023-12-24T20:10:22.048694+0000","last_clean":"2023-12-24T20:10:22.048694+0000","last_became_active":"2023-12-24T20:10:22.046618+0000","last_became_peered":"2023-12-24T20:10:22.046618+0000","last_unstale":"2023-12-24T20:10:22.048694+0000","last_undegraded":"2023-12-24T20:10:22.048694+0000","last_fullsized":"2023-12-24T20:10:22.048694+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060470+0000","last_change":"2023-12-24T20:10:22.059909+0000","last_active":"2023-12-24T20:10:22.060470+0000","last_peered":"2023-12-24T20:10:22.060470+0000","last_clean":"2023-12-24T20:10:22.060470+0000","last_became_active":"2023-12-24T20:10:22.058921+0000","last_became_peered":"2023-12-24T20:10:22.058921+0000","last_unstale":"2023-12-24T20:10:22.060470+0000","last_undegraded":"2023-12-24T20:10:22.060470+0000","last_fullsized":"2023-12-24T20:10:22.060470+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.032238+0000","last_change":"2023-12-24T20:10:22.029025+0000","last_active":"2023-12-24T20:10:22.032238+0000","last_peered":"2023-12-24T20:10:22.032238+0000","last_clean":"2023-12-24T20:10:22.032238+0000","last_became_active":"2023-12-24T20:10:22.028676+0000","last_became_peered":"2023-12-24T20:10:22.028676+0000","last_unstale":"2023-12-24T20:10:22.032238+0000","last_undegraded":"2023-12-24T20:10:22.032238+0000","last_fullsized":"2023-12-24T20:10:22.032238+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:29:03.428061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.042436+0000","last_change":"2023-12-24T20:10:22.030406+0000","last_active":"2023-12-24T20:10:22.042436+0000","last_peered":"2023-12-24T20:10:22.042436+0000","last_clean":"2023-12-24T20:10:22.042436+0000","last_became_active":"2023-12-24T20:10:22.030076+0000","last_became_peered":"2023-12-24T20:10:22.030076+0000","last_unstale":"2023-12-24T20:10:22.042436+0000","last_undegraded":"2023-12-24T20:10:22.042436+0000","last_fullsized":"2023-12-24T20:10:22.042436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:22:58.629359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053953+0000","last_change":"2023-12-24T20:10:22.045274+0000","last_active":"2023-12-24T20:10:22.053953+0000","last_peered":"2023-12-24T20:10:22.053953+0000","last_clean":"2023-12-24T20:10:22.053953+0000","last_became_active":"2023-12-24T20:10:22.042746+0000","last_became_peered":"2023-12-24T20:10:22.042746+0000","last_unstale":"2023-12-24T20:10:22.053953+0000","last_undegraded":"2023-12-24T20:10:22.053953+0000","last_fullsized":"2023-12-24T20:10:22.053953+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:48.942011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059927+0000","last_change":"2023-12-24T20:10:22.052143+0000","last_active":"2023-12-24T20:10:22.059927+0000","last_peered":"2023-12-24T20:10:22.059927+0000","last_clean":"2023-12-24T20:10:22.059927+0000","last_became_active":"2023-12-24T20:10:22.051470+0000","last_became_peered":"2023-12-24T20:10:22.051470+0000","last_unstale":"2023-12-24T20:10:22.059927+0000","last_undegraded":"2023-12-24T20:10:22.059927+0000","last_fullsized":"2023-12-24T20:10:22.059927+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058346+0000","last_change":"2023-12-24T20:10:22.045008+0000","last_active":"2023-12-24T20:10:22.058346+0000","last_peered":"2023-12-24T20:10:22.058346+0000","last_clean":"2023-12-24T20:10:22.058346+0000","last_became_active":"2023-12-24T20:10:22.044696+0000","last_became_peered":"2023-12-24T20:10:22.044696+0000","last_unstale":"2023-12-24T20:10:22.058346+0000","last_undegraded":"2023-12-24T20:10:22.058346+0000","last_fullsized":"2023-12-24T20:10:22.058346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.038295+0000","last_change":"2023-12-24T20:10:22.035311+0000","last_active":"2023-12-24T20:10:22.038295+0000","last_peered":"2023-12-24T20:10:22.038295+0000","last_clean":"2023-12-24T20:10:22.038295+0000","last_became_active":"2023-12-24T20:10:22.034962+0000","last_became_peered":"2023-12-24T20:10:22.034962+0000","last_unstale":"2023-12-24T20:10:22.038295+0000","last_undegraded":"2023-12-24T20:10:22.038295+0000","last_fullsized":"2023-12-24T20:10:22.038295+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:56:15.370479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034863+0000","last_change":"2023-12-24T20:10:22.031327+0000","last_active":"2023-12-24T20:10:22.034863+0000","last_peered":"2023-12-24T20:10:22.034863+0000","last_clean":"2023-12-24T20:10:22.034863+0000","last_became_active":"2023-12-24T20:10:22.031039+0000","last_became_peered":"2023-12-24T20:10:22.031039+0000","last_unstale":"2023-12-24T20:10:22.034863+0000","last_undegraded":"2023-12-24T20:10:22.034863+0000","last_fullsized":"2023-12-24T20:10:22.034863+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:56.546959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060202+0000","last_change":"2023-12-24T20:10:22.054226+0000","last_active":"2023-12-24T20:10:22.060202+0000","last_peered":"2023-12-24T20:10:22.060202+0000","last_clean":"2023-12-24T20:10:22.060202+0000","last_became_active":"2023-12-24T20:10:22.053874+0000","last_became_peered":"2023-12-24T20:10:22.053874+0000","last_unstale":"2023-12-24T20:10:22.060202+0000","last_undegraded":"2023-12-24T20:10:22.060202+0000","last_fullsized":"2023-12-24T20:10:22.060202+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048834+0000","last_change":"2023-12-24T20:10:22.043778+0000","last_active":"2023-12-24T20:10:22.048834+0000","last_peered":"2023-12-24T20:10:22.048834+0000","last_clean":"2023-12-24T20:10:22.048834+0000","last_became_active":"2023-12-24T20:10:22.043497+0000","last_became_peered":"2023-12-24T20:10:22.043497+0000","last_unstale":"2023-12-24T20:10:22.048834+0000","last_undegraded":"2023-12-24T20:10:22.048834+0000","last_fullsized":"2023-12-24T20:10:22.048834+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:21.933791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049443+0000","last_change":"2023-12-24T20:10:22.044329+0000","last_active":"2023-12-24T20:10:22.049443+0000","last_peered":"2023-12-24T20:10:22.049443+0000","last_clean":"2023-12-24T20:10:22.049443+0000","last_became_active":"2023-12-24T20:10:22.044038+0000","last_became_peered":"2023-12-24T20:10:22.044038+0000","last_unstale":"2023-12-24T20:10:22.049443+0000","last_undegraded":"2023-12-24T20:10:22.049443+0000","last_fullsized":"2023-12-24T20:10:22.049443+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:50.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052042+0000","last_change":"2023-12-24T20:10:22.047403+0000","last_active":"2023-12-24T20:10:22.052042+0000","last_peered":"2023-12-24T20:10:22.052042+0000","last_clean":"2023-12-24T20:10:22.052042+0000","last_became_active":"2023-12-24T20:10:22.047114+0000","last_became_peered":"2023-12-24T20:10:22.047114+0000","last_unstale":"2023-12-24T20:10:22.052042+0000","last_undegraded":"2023-12-24T20:10:22.052042+0000","last_fullsized":"2023-12-24T20:10:22.052042+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:57.751202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047901+0000","last_change":"2023-12-24T20:10:22.039320+0000","last_active":"2023-12-24T20:10:22.047901+0000","last_peered":"2023-12-24T20:10:22.047901+0000","last_clean":"2023-12-24T20:10:22.047901+0000","last_became_active":"2023-12-24T20:10:22.038806+0000","last_became_peered":"2023-12-24T20:10:22.038806+0000","last_unstale":"2023-12-24T20:10:22.047901+0000","last_undegraded":"2023-12-24T20:10:22.047901+0000","last_fullsized":"2023-12-24T20:10:22.047901+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:29:14.602278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060408+0000","last_change":"2023-12-24T20:10:22.057124+0000","last_active":"2023-12-24T20:10:22.060408+0000","last_peered":"2023-12-24T20:10:22.060408+0000","last_clean":"2023-12-24T20:10:22.060408+0000","last_became_active":"2023-12-24T20:10:22.056716+0000","last_became_peered":"2023-12-24T20:10:22.056716+0000","last_unstale":"2023-12-24T20:10:22.060408+0000","last_undegraded":"2023-12-24T20:10:22.060408+0000","last_fullsized":"2023-12-24T20:10:22.060408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:57.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055432+0000","last_change":"2023-12-24T20:10:22.053203+0000","last_active":"2023-12-24T20:10:22.055432+0000","last_peered":"2023-12-24T20:10:22.055432+0000","last_clean":"2023-12-24T20:10:22.055432+0000","last_became_active":"2023-12-24T20:10:22.052673+0000","last_became_peered":"2023-12-24T20:10:22.052673+0000","last_unstale":"2023-12-24T20:10:22.055432+0000","last_undegraded":"2023-12-24T20:10:22.055432+0000","last_fullsized":"2023-12-24T20:10:22.055432+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:14.433919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053614+0000","last_change":"2023-12-24T20:10:22.049561+0000","last_active":"2023-12-24T20:10:22.053614+0000","last_peered":"2023-12-24T20:10:22.053614+0000","last_clean":"2023-12-24T20:10:22.053614+0000","last_became_active":"2023-12-24T20:10:22.049246+0000","last_became_peered":"2023-12-24T20:10:22.049246+0000","last_unstale":"2023-12-24T20:10:22.053614+0000","last_undegraded":"2023-12-24T20:10:22.053614+0000","last_fullsized":"2023-12-24T20:10:22.053614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:12:06.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059867+0000","last_change":"2023-12-24T20:10:22.052041+0000","last_active":"2023-12-24T20:10:22.059867+0000","last_peered":"2023-12-24T20:10:22.059867+0000","last_clean":"2023-12-24T20:10:22.059867+0000","last_became_active":"2023-12-24T20:10:22.051704+0000","last_became_peered":"2023-12-24T20:10:22.051704+0000","last_unstale":"2023-12-24T20:10:22.059867+0000","last_undegraded":"2023-12-24T20:10:22.059867+0000","last_fullsized":"2023-12-24T20:10:22.059867+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054149+0000","last_change":"2023-12-24T20:10:22.050469+0000","last_active":"2023-12-24T20:10:22.054149+0000","last_peered":"2023-12-24T20:10:22.054149+0000","last_clean":"2023-12-24T20:10:22.054149+0000","last_became_active":"2023-12-24T20:10:22.049592+0000","last_became_peered":"2023-12-24T20:10:22.049592+0000","last_unstale":"2023-12-24T20:10:22.054149+0000","last_undegraded":"2023-12-24T20:10:22.054149+0000","last_fullsized":"2023-12-24T20:10:22.054149+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055390+0000","last_change":"2023-12-24T20:10:22.052932+0000","last_active":"2023-12-24T20:10:22.055390+0000","last_peered":"2023-12-24T20:10:22.055390+0000","last_clean":"2023-12-24T20:10:22.055390+0000","last_became_active":"2023-12-24T20:10:22.047760+0000","last_became_peered":"2023-12-24T20:10:22.047760+0000","last_unstale":"2023-12-24T20:10:22.055390+0000","last_undegraded":"2023-12-24T20:10:22.055390+0000","last_fullsized":"2023-12-24T20:10:22.055390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:54:53.819388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.051148+0000","last_change":"2023-12-24T20:10:22.048364+0000","last_active":"2023-12-24T20:10:22.051148+0000","last_peered":"2023-12-24T20:10:22.051148+0000","last_clean":"2023-12-24T20:10:22.051148+0000","last_became_active":"2023-12-24T20:10:22.048054+0000","last_became_peered":"2023-12-24T20:10:22.048054+0000","last_unstale":"2023-12-24T20:10:22.051148+0000","last_undegraded":"2023-12-24T20:10:22.051148+0000","last_fullsized":"2023-12-24T20:10:22.051148+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:13.833901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058299+0000","last_change":"2023-12-24T20:10:22.046083+0000","last_active":"2023-12-24T20:10:22.058299+0000","last_peered":"2023-12-24T20:10:22.058299+0000","last_clean":"2023-12-24T20:10:22.058299+0000","last_became_active":"2023-12-24T20:10:22.045647+0000","last_became_peered":"2023-12-24T20:10:22.045647+0000","last_unstale":"2023-12-24T20:10:22.058299+0000","last_undegraded":"2023-12-24T20:10:22.058299+0000","last_fullsized":"2023-12-24T20:10:22.058299+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:46.777299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050294+0000","last_change":"2023-12-24T20:10:22.043330+0000","last_active":"2023-12-24T20:10:22.050294+0000","last_peered":"2023-12-24T20:10:22.050294+0000","last_clean":"2023-12-24T20:10:22.050294+0000","last_became_active":"2023-12-24T20:10:22.042744+0000","last_became_peered":"2023-12-24T20:10:22.042744+0000","last_unstale":"2023-12-24T20:10:22.050294+0000","last_undegraded":"2023-12-24T20:10:22.050294+0000","last_fullsized":"2023-12-24T20:10:22.050294+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"207'4","reported_seq":14,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326441+0000","last_change":"2023-12-24T20:10:21.328692+0000","last_active":"2023-12-24T20:10:22.326441+0000","last_peered":"2023-12-24T20:10:22.326441+0000","last_clean":"2023-12-24T20:10:22.326441+0000","last_became_active":"2023-12-24T20:10:21.328379+0000","last_became_peered":"2023-12-24T20:10:21.328379+0000","last_unstale":"2023-12-24T20:10:22.326441+0000","last_undegraded":"2023-12-24T20:10:22.326441+0000","last_fullsized":"2023-12-24T20:10:22.326441+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.047075+0000","last_change":"2023-12-24T20:10:22.040630+0000","last_active":"2023-12-24T20:10:22.047075+0000","last_peered":"2023-12-24T20:10:22.047075+0000","last_clean":"2023-12-24T20:10:22.047075+0000","last_became_active":"2023-12-24T20:10:22.040281+0000","last_became_peered":"2023-12-24T20:10:22.040281+0000","last_unstale":"2023-12-24T20:10:22.047075+0000","last_undegraded":"2023-12-24T20:10:22.047075+0000","last_fullsized":"2023-12-24T20:10:22.047075+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:59:29.515812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326801+0000","last_change":"2023-12-24T20:10:21.341249+0000","last_active":"2023-12-24T20:10:22.326801+0000","last_peered":"2023-12-24T20:10:22.326801+0000","last_clean":"2023-12-24T20:10:22.326801+0000","last_became_active":"2023-12-24T20:10:21.340079+0000","last_became_peered":"2023-12-24T20:10:21.340079+0000","last_unstale":"2023-12-24T20:10:22.326801+0000","last_undegraded":"2023-12-24T20:10:22.326801+0000","last_fullsized":"2023-12-24T20:10:22.326801+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:04:20.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053369+0000","last_change":"2023-12-24T20:10:22.049094+0000","last_active":"2023-12-24T20:10:22.053369+0000","last_peered":"2023-12-24T20:10:22.053369+0000","last_clean":"2023-12-24T20:10:22.053369+0000","last_became_active":"2023-12-24T20:10:22.048507+0000","last_became_peered":"2023-12-24T20:10:22.048507+0000","last_unstale":"2023-12-24T20:10:22.053369+0000","last_undegraded":"2023-12-24T20:10:22.053369+0000","last_fullsized":"2023-12-24T20:10:22.053369+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:37:55.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325452+0000","last_change":"2023-12-24T20:10:21.330427+0000","last_active":"2023-12-24T20:10:22.325452+0000","last_peered":"2023-12-24T20:10:22.325452+0000","last_clean":"2023-12-24T20:10:22.325452+0000","last_became_active":"2023-12-24T20:10:21.330141+0000","last_became_peered":"2023-12-24T20:10:21.330141+0000","last_unstale":"2023-12-24T20:10:22.325452+0000","last_undegraded":"2023-12-24T20:10:22.325452+0000","last_fullsized":"2023-12-24T20:10:22.325452+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.054654+0000","last_change":"2023-12-24T20:10:22.048512+0000","last_active":"2023-12-24T20:10:22.054654+0000","last_peered":"2023-12-24T20:10:22.054654+0000","last_clean":"2023-12-24T20:10:22.054654+0000","last_became_active":"2023-12-24T20:10:22.048205+0000","last_became_peered":"2023-12-24T20:10:22.048205+0000","last_unstale":"2023-12-24T20:10:22.054654+0000","last_undegraded":"2023-12-24T20:10:22.054654+0000","last_fullsized":"2023-12-24T20:10:22.054654+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:50.114944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324166+0000","last_change":"2023-12-24T20:10:21.324249+0000","last_active":"2023-12-24T20:10:22.324166+0000","last_peered":"2023-12-24T20:10:22.324166+0000","last_clean":"2023-12-24T20:10:22.324166+0000","last_became_active":"2023-12-24T20:10:21.323913+0000","last_became_peered":"2023-12-24T20:10:21.323913+0000","last_unstale":"2023-12-24T20:10:22.324166+0000","last_undegraded":"2023-12-24T20:10:22.324166+0000","last_fullsized":"2023-12-24T20:10:22.324166+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:48.302787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053722+0000","last_change":"2023-12-24T20:10:22.046801+0000","last_active":"2023-12-24T20:10:22.053722+0000","last_peered":"2023-12-24T20:10:22.053722+0000","last_clean":"2023-12-24T20:10:22.053722+0000","last_became_active":"2023-12-24T20:10:22.046073+0000","last_became_peered":"2023-12-24T20:10:22.046073+0000","last_unstale":"2023-12-24T20:10:22.053722+0000","last_undegraded":"2023-12-24T20:10:22.053722+0000","last_fullsized":"2023-12-24T20:10:22.053722+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:23:19.864656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326943+0000","last_change":"2023-12-24T20:10:21.340568+0000","last_active":"2023-12-24T20:10:22.326943+0000","last_peered":"2023-12-24T20:10:22.326943+0000","last_clean":"2023-12-24T20:10:22.326943+0000","last_became_active":"2023-12-24T20:10:21.340133+0000","last_became_peered":"2023-12-24T20:10:21.340133+0000","last_unstale":"2023-12-24T20:10:22.326943+0000","last_undegraded":"2023-12-24T20:10:22.326943+0000","last_fullsized":"2023-12-24T20:10:22.326943+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:28.266829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057958+0000","last_change":"2023-12-24T20:10:22.052321+0000","last_active":"2023-12-24T20:10:22.057958+0000","last_peered":"2023-12-24T20:10:22.057958+0000","last_clean":"2023-12-24T20:10:22.057958+0000","last_became_active":"2023-12-24T20:10:22.052025+0000","last_became_peered":"2023-12-24T20:10:22.052025+0000","last_unstale":"2023-12-24T20:10:22.057958+0000","last_undegraded":"2023-12-24T20:10:22.057958+0000","last_fullsized":"2023-12-24T20:10:22.057958+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:07:32.731104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325284+0000","last_change":"2023-12-24T20:10:21.342954+0000","last_active":"2023-12-24T20:10:22.325284+0000","last_peered":"2023-12-24T20:10:22.325284+0000","last_clean":"2023-12-24T20:10:22.325284+0000","last_became_active":"2023-12-24T20:10:21.342595+0000","last_became_peered":"2023-12-24T20:10:21.342595+0000","last_unstale":"2023-12-24T20:10:22.325284+0000","last_undegraded":"2023-12-24T20:10:22.325284+0000","last_fullsized":"2023-12-24T20:10:22.325284+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:47:20.239017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049417+0000","last_change":"2023-12-24T20:10:22.042317+0000","last_active":"2023-12-24T20:10:22.049417+0000","last_peered":"2023-12-24T20:10:22.049417+0000","last_clean":"2023-12-24T20:10:22.049417+0000","last_became_active":"2023-12-24T20:10:22.041979+0000","last_became_peered":"2023-12-24T20:10:22.041979+0000","last_unstale":"2023-12-24T20:10:22.049417+0000","last_undegraded":"2023-12-24T20:10:22.049417+0000","last_fullsized":"2023-12-24T20:10:22.049417+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:44.587605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024318+0000","last_change":"2023-12-24T20:10:21.322840+0000","last_active":"2023-12-24T20:10:22.024318+0000","last_peered":"2023-12-24T20:10:22.024318+0000","last_clean":"2023-12-24T20:10:22.024318+0000","last_became_active":"2023-12-24T20:10:21.322524+0000","last_became_peered":"2023-12-24T20:10:21.322524+0000","last_unstale":"2023-12-24T20:10:22.024318+0000","last_undegraded":"2023-12-24T20:10:22.024318+0000","last_fullsized":"2023-12-24T20:10:22.024318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:53:59.068791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050316+0000","last_change":"2023-12-24T20:10:22.043562+0000","last_active":"2023-12-24T20:10:22.050316+0000","last_peered":"2023-12-24T20:10:22.050316+0000","last_clean":"2023-12-24T20:10:22.050316+0000","last_became_active":"2023-12-24T20:10:22.043052+0000","last_became_peered":"2023-12-24T20:10:22.043052+0000","last_unstale":"2023-12-24T20:10:22.050316+0000","last_undegraded":"2023-12-24T20:10:22.050316+0000","last_fullsized":"2023-12-24T20:10:22.050316+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.743754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.040478+0000","last_change":"2023-12-24T20:10:21.342654+0000","last_active":"2023-12-24T20:10:22.040478+0000","last_peered":"2023-12-24T20:10:22.040478+0000","last_clean":"2023-12-24T20:10:22.040478+0000","last_became_active":"2023-12-24T20:10:21.342372+0000","last_became_peered":"2023-12-24T20:10:21.342372+0000","last_unstale":"2023-12-24T20:10:22.040478+0000","last_undegraded":"2023-12-24T20:10:22.040478+0000","last_fullsized":"2023-12-24T20:10:22.040478+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:02.063291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057705+0000","last_change":"2023-12-24T20:10:22.044758+0000","last_active":"2023-12-24T20:10:22.057705+0000","last_peered":"2023-12-24T20:10:22.057705+0000","last_clean":"2023-12-24T20:10:22.057705+0000","last_became_active":"2023-12-24T20:10:22.043653+0000","last_became_peered":"2023-12-24T20:10:22.043653+0000","last_unstale":"2023-12-24T20:10:22.057705+0000","last_undegraded":"2023-12-24T20:10:22.057705+0000","last_fullsized":"2023-12-24T20:10:22.057705+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:40.792722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.036074+0000","last_change":"2023-12-24T20:10:21.341505+0000","last_active":"2023-12-24T20:10:22.036074+0000","last_peered":"2023-12-24T20:10:22.036074+0000","last_clean":"2023-12-24T20:10:22.036074+0000","last_became_active":"2023-12-24T20:10:21.340993+0000","last_became_peered":"2023-12-24T20:10:21.340993+0000","last_unstale":"2023-12-24T20:10:22.036074+0000","last_undegraded":"2023-12-24T20:10:22.036074+0000","last_fullsized":"2023-12-24T20:10:22.036074+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052276+0000","last_change":"2023-12-24T20:10:22.046657+0000","last_active":"2023-12-24T20:10:22.052276+0000","last_peered":"2023-12-24T20:10:22.052276+0000","last_clean":"2023-12-24T20:10:22.052276+0000","last_became_active":"2023-12-24T20:10:22.046281+0000","last_became_peered":"2023-12-24T20:10:22.046281+0000","last_unstale":"2023-12-24T20:10:22.052276+0000","last_undegraded":"2023-12-24T20:10:22.052276+0000","last_fullsized":"2023-12-24T20:10:22.052276+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:08:11.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"207'3","reported_seq":13,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326189+0000","last_change":"2023-12-24T20:10:21.346137+0000","last_active":"2023-12-24T20:10:22.326189+0000","last_peered":"2023-12-24T20:10:22.326189+0000","last_clean":"2023-12-24T20:10:22.326189+0000","last_became_active":"2023-12-24T20:10:21.345823+0000","last_became_peered":"2023-12-24T20:10:21.345823+0000","last_unstale":"2023-12-24T20:10:22.326189+0000","last_undegraded":"2023-12-24T20:10:22.326189+0000","last_fullsized":"2023-12-24T20:10:22.326189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:38.778312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058851+0000","last_change":"2023-12-24T20:10:22.054910+0000","last_active":"2023-12-24T20:10:22.058851+0000","last_peered":"2023-12-24T20:10:22.058851+0000","last_clean":"2023-12-24T20:10:22.058851+0000","last_became_active":"2023-12-24T20:10:22.053160+0000","last_became_peered":"2023-12-24T20:10:22.053160+0000","last_unstale":"2023-12-24T20:10:22.058851+0000","last_undegraded":"2023-12-24T20:10:22.058851+0000","last_fullsized":"2023-12-24T20:10:22.058851+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:03.078696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"207'6","reported_seq":16,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.329419+0000","last_change":"2023-12-24T20:10:21.329583+0000","last_active":"2023-12-24T20:10:22.329419+0000","last_peered":"2023-12-24T20:10:22.329419+0000","last_clean":"2023-12-24T20:10:22.329419+0000","last_became_active":"2023-12-24T20:10:21.328809+0000","last_became_peered":"2023-12-24T20:10:21.328809+0000","last_unstale":"2023-12-24T20:10:22.329419+0000","last_undegraded":"2023-12-24T20:10:22.329419+0000","last_fullsized":"2023-12-24T20:10:22.329419+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:43.151409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048749+0000","last_change":"2023-12-24T20:10:22.036393+0000","last_active":"2023-12-24T20:10:22.048749+0000","last_peered":"2023-12-24T20:10:22.048749+0000","last_clean":"2023-12-24T20:10:22.048749+0000","last_became_active":"2023-12-24T20:10:22.036071+0000","last_became_peered":"2023-12-24T20:10:22.036071+0000","last_unstale":"2023-12-24T20:10:22.048749+0000","last_undegraded":"2023-12-24T20:10:22.048749+0000","last_fullsized":"2023-12-24T20:10:22.048749+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:16.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324446+0000","last_change":"2023-12-24T20:10:21.321724+0000","last_active":"2023-12-24T20:10:22.324446+0000","last_peered":"2023-12-24T20:10:22.324446+0000","last_clean":"2023-12-24T20:10:22.324446+0000","last_became_active":"2023-12-24T20:10:21.321251+0000","last_became_peered":"2023-12-24T20:10:21.321251+0000","last_unstale":"2023-12-24T20:10:22.324446+0000","last_undegraded":"2023-12-24T20:10:22.324446+0000","last_fullsized":"2023-12-24T20:10:22.324446+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:02.989882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057123+0000","last_change":"2023-12-24T20:10:22.043586+0000","last_active":"2023-12-24T20:10:22.057123+0000","last_peered":"2023-12-24T20:10:22.057123+0000","last_clean":"2023-12-24T20:10:22.057123+0000","last_became_active":"2023-12-24T20:10:22.042963+0000","last_became_peered":"2023-12-24T20:10:22.042963+0000","last_unstale":"2023-12-24T20:10:22.057123+0000","last_undegraded":"2023-12-24T20:10:22.057123+0000","last_fullsized":"2023-12-24T20:10:22.057123+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:15.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033596+0000","last_change":"2023-12-24T20:10:21.344171+0000","last_active":"2023-12-24T20:10:22.033596+0000","last_peered":"2023-12-24T20:10:22.033596+0000","last_clean":"2023-12-24T20:10:22.033596+0000","last_became_active":"2023-12-24T20:10:21.343604+0000","last_became_peered":"2023-12-24T20:10:21.343604+0000","last_unstale":"2023-12-24T20:10:22.033596+0000","last_undegraded":"2023-12-24T20:10:22.033596+0000","last_fullsized":"2023-12-24T20:10:22.033596+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.041831+0000","last_change":"2023-12-24T20:10:22.040395+0000","last_active":"2023-12-24T20:10:22.041831+0000","last_peered":"2023-12-24T20:10:22.041831+0000","last_clean":"2023-12-24T20:10:22.041831+0000","last_became_active":"2023-12-24T20:10:22.040084+0000","last_became_peered":"2023-12-24T20:10:22.040084+0000","last_unstale":"2023-12-24T20:10:22.041831+0000","last_undegraded":"2023-12-24T20:10:22.041831+0000","last_fullsized":"2023-12-24T20:10:22.041831+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:25.909153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035164+0000","last_change":"2023-12-24T20:10:21.331552+0000","last_active":"2023-12-24T20:10:22.035164+0000","last_peered":"2023-12-24T20:10:22.035164+0000","last_clean":"2023-12-24T20:10:22.035164+0000","last_became_active":"2023-12-24T20:10:21.331187+0000","last_became_peered":"2023-12-24T20:10:21.331187+0000","last_unstale":"2023-12-24T20:10:22.035164+0000","last_undegraded":"2023-12-24T20:10:22.035164+0000","last_fullsized":"2023-12-24T20:10:22.035164+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:01:04.491152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053857+0000","last_change":"2023-12-24T20:10:22.047143+0000","last_active":"2023-12-24T20:10:22.053857+0000","last_peered":"2023-12-24T20:10:22.053857+0000","last_clean":"2023-12-24T20:10:22.053857+0000","last_became_active":"2023-12-24T20:10:22.045752+0000","last_became_peered":"2023-12-24T20:10:22.045752+0000","last_unstale":"2023-12-24T20:10:22.053857+0000","last_undegraded":"2023-12-24T20:10:22.053857+0000","last_fullsized":"2023-12-24T20:10:22.053857+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:07.378750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"207'8","reported_seq":18,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326577+0000","last_change":"2023-12-24T20:10:21.327512+0000","last_active":"2023-12-24T20:10:22.326577+0000","last_peered":"2023-12-24T20:10:22.326577+0000","last_clean":"2023-12-24T20:10:22.326577+0000","last_became_active":"2023-12-24T20:10:21.326358+0000","last_became_peered":"2023-12-24T20:10:21.326358+0000","last_unstale":"2023-12-24T20:10:22.326577+0000","last_undegraded":"2023-12-24T20:10:22.326577+0000","last_fullsized":"2023-12-24T20:10:22.326577+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.049346+0000","last_change":"2023-12-24T20:10:22.046931+0000","last_active":"2023-12-24T20:10:22.049346+0000","last_peered":"2023-12-24T20:10:22.049346+0000","last_clean":"2023-12-24T20:10:22.049346+0000","last_became_active":"2023-12-24T20:10:22.046582+0000","last_became_peered":"2023-12-24T20:10:22.046582+0000","last_unstale":"2023-12-24T20:10:22.049346+0000","last_undegraded":"2023-12-24T20:10:22.049346+0000","last_fullsized":"2023-12-24T20:10:22.049346+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:16.357937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.325268+0000","last_change":"2023-12-24T20:10:21.327844+0000","last_active":"2023-12-24T20:10:22.325268+0000","last_peered":"2023-12-24T20:10:22.325268+0000","last_clean":"2023-12-24T20:10:22.325268+0000","last_became_active":"2023-12-24T20:10:21.327494+0000","last_became_peered":"2023-12-24T20:10:21.327494+0000","last_unstale":"2023-12-24T20:10:22.325268+0000","last_undegraded":"2023-12-24T20:10:22.325268+0000","last_fullsized":"2023-12-24T20:10:22.325268+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057727+0000","last_change":"2023-12-24T20:10:22.044918+0000","last_active":"2023-12-24T20:10:22.057727+0000","last_peered":"2023-12-24T20:10:22.057727+0000","last_clean":"2023-12-24T20:10:22.057727+0000","last_became_active":"2023-12-24T20:10:22.044608+0000","last_became_peered":"2023-12-24T20:10:22.044608+0000","last_unstale":"2023-12-24T20:10:22.057727+0000","last_undegraded":"2023-12-24T20:10:22.057727+0000","last_fullsized":"2023-12-24T20:10:22.057727+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:47.045124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.327030+0000","last_change":"2023-12-24T20:10:21.330870+0000","last_active":"2023-12-24T20:10:22.327030+0000","last_peered":"2023-12-24T20:10:22.327030+0000","last_clean":"2023-12-24T20:10:22.327030+0000","last_became_active":"2023-12-24T20:10:21.330444+0000","last_became_peered":"2023-12-24T20:10:21.330444+0000","last_unstale":"2023-12-24T20:10:22.327030+0000","last_undegraded":"2023-12-24T20:10:22.327030+0000","last_fullsized":"2023-12-24T20:10:22.327030+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:14.965187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055408+0000","last_change":"2023-12-24T20:10:22.052950+0000","last_active":"2023-12-24T20:10:22.055408+0000","last_peered":"2023-12-24T20:10:22.055408+0000","last_clean":"2023-12-24T20:10:22.055408+0000","last_became_active":"2023-12-24T20:10:22.052300+0000","last_became_peered":"2023-12-24T20:10:22.052300+0000","last_unstale":"2023-12-24T20:10:22.055408+0000","last_undegraded":"2023-12-24T20:10:22.055408+0000","last_fullsized":"2023-12-24T20:10:22.055408+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:52:29.282233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"207'1","reported_seq":11,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.323961+0000","last_change":"2023-12-24T20:10:21.338860+0000","last_active":"2023-12-24T20:10:22.323961+0000","last_peered":"2023-12-24T20:10:22.323961+0000","last_clean":"2023-12-24T20:10:22.323961+0000","last_became_active":"2023-12-24T20:10:21.338477+0000","last_became_peered":"2023-12-24T20:10:21.338477+0000","last_unstale":"2023-12-24T20:10:22.323961+0000","last_undegraded":"2023-12-24T20:10:22.323961+0000","last_fullsized":"2023-12-24T20:10:22.323961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:57.241226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058869+0000","last_change":"2023-12-24T20:10:22.055380+0000","last_active":"2023-12-24T20:10:22.058869+0000","last_peered":"2023-12-24T20:10:22.058869+0000","last_clean":"2023-12-24T20:10:22.058869+0000","last_became_active":"2023-12-24T20:10:22.054862+0000","last_became_peered":"2023-12-24T20:10:22.054862+0000","last_unstale":"2023-12-24T20:10:22.058869+0000","last_undegraded":"2023-12-24T20:10:22.058869+0000","last_fullsized":"2023-12-24T20:10:22.058869+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:52.084675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.046274+0000","last_change":"2023-12-24T20:10:21.328323+0000","last_active":"2023-12-24T20:10:22.046274+0000","last_peered":"2023-12-24T20:10:22.046274+0000","last_clean":"2023-12-24T20:10:22.046274+0000","last_became_active":"2023-12-24T20:10:21.328048+0000","last_became_peered":"2023-12-24T20:10:21.328048+0000","last_unstale":"2023-12-24T20:10:22.046274+0000","last_undegraded":"2023-12-24T20:10:22.046274+0000","last_fullsized":"2023-12-24T20:10:22.046274+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:56:34.157105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053989+0000","last_change":"2023-12-24T20:10:22.047796+0000","last_active":"2023-12-24T20:10:22.053989+0000","last_peered":"2023-12-24T20:10:22.053989+0000","last_clean":"2023-12-24T20:10:22.053989+0000","last_became_active":"2023-12-24T20:10:22.046602+0000","last_became_peered":"2023-12-24T20:10:22.046602+0000","last_unstale":"2023-12-24T20:10:22.053989+0000","last_undegraded":"2023-12-24T20:10:22.053989+0000","last_fullsized":"2023-12-24T20:10:22.053989+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:08.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.324990+0000","last_change":"2023-12-24T20:10:21.339360+0000","last_active":"2023-12-24T20:10:22.324990+0000","last_peered":"2023-12-24T20:10:22.324990+0000","last_clean":"2023-12-24T20:10:22.324990+0000","last_became_active":"2023-12-24T20:10:21.338884+0000","last_became_peered":"2023-12-24T20:10:21.338884+0000","last_unstale":"2023-12-24T20:10:22.324990+0000","last_undegraded":"2023-12-24T20:10:22.324990+0000","last_fullsized":"2023-12-24T20:10:22.324990+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:25:10.655331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.058783+0000","last_change":"2023-12-24T20:10:22.050466+0000","last_active":"2023-12-24T20:10:22.058783+0000","last_peered":"2023-12-24T20:10:22.058783+0000","last_clean":"2023-12-24T20:10:22.058783+0000","last_became_active":"2023-12-24T20:10:22.050186+0000","last_became_peered":"2023-12-24T20:10:22.050186+0000","last_unstale":"2023-12-24T20:10:22.058783+0000","last_undegraded":"2023-12-24T20:10:22.058783+0000","last_fullsized":"2023-12-24T20:10:22.058783+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:38.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.035572+0000","last_change":"2023-12-24T20:10:21.329570+0000","last_active":"2023-12-24T20:10:22.035572+0000","last_peered":"2023-12-24T20:10:22.035572+0000","last_clean":"2023-12-24T20:10:22.035572+0000","last_became_active":"2023-12-24T20:10:21.329273+0000","last_became_peered":"2023-12-24T20:10:21.329273+0000","last_unstale":"2023-12-24T20:10:22.035572+0000","last_undegraded":"2023-12-24T20:10:22.035572+0000","last_fullsized":"2023-12-24T20:10:22.035572+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:45.665522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.056436+0000","last_change":"2023-12-24T20:10:22.053113+0000","last_active":"2023-12-24T20:10:22.056436+0000","last_peered":"2023-12-24T20:10:22.056436+0000","last_clean":"2023-12-24T20:10:22.056436+0000","last_became_active":"2023-12-24T20:10:22.052789+0000","last_became_peered":"2023-12-24T20:10:22.052789+0000","last_unstale":"2023-12-24T20:10:22.056436+0000","last_undegraded":"2023-12-24T20:10:22.056436+0000","last_fullsized":"2023-12-24T20:10:22.056436+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:49.788835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.022767+0000","last_change":"2023-12-24T20:10:21.336557+0000","last_active":"2023-12-24T20:10:22.022767+0000","last_peered":"2023-12-24T20:10:22.022767+0000","last_clean":"2023-12-24T20:10:22.022767+0000","last_became_active":"2023-12-24T20:10:21.335312+0000","last_became_peered":"2023-12-24T20:10:21.335312+0000","last_unstale":"2023-12-24T20:10:22.022767+0000","last_undegraded":"2023-12-24T20:10:22.022767+0000","last_fullsized":"2023-12-24T20:10:22.022767+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:22.836218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.060003+0000","last_change":"2023-12-24T20:10:22.052410+0000","last_active":"2023-12-24T20:10:22.060003+0000","last_peered":"2023-12-24T20:10:22.060003+0000","last_clean":"2023-12-24T20:10:22.060003+0000","last_became_active":"2023-12-24T20:10:22.050708+0000","last_became_peered":"2023-12-24T20:10:22.050708+0000","last_unstale":"2023-12-24T20:10:22.060003+0000","last_undegraded":"2023-12-24T20:10:22.060003+0000","last_fullsized":"2023-12-24T20:10:22.060003+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025855+0000","last_change":"2023-12-24T20:10:21.325384+0000","last_active":"2023-12-24T20:10:22.025855+0000","last_peered":"2023-12-24T20:10:22.025855+0000","last_clean":"2023-12-24T20:10:22.025855+0000","last_became_active":"2023-12-24T20:10:21.324469+0000","last_became_peered":"2023-12-24T20:10:21.324469+0000","last_unstale":"2023-12-24T20:10:22.025855+0000","last_undegraded":"2023-12-24T20:10:22.025855+0000","last_fullsized":"2023-12-24T20:10:22.025855+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:47.418537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057568+0000","last_change":"2023-12-24T20:10:22.050974+0000","last_active":"2023-12-24T20:10:22.057568+0000","last_peered":"2023-12-24T20:10:22.057568+0000","last_clean":"2023-12-24T20:10:22.057568+0000","last_became_active":"2023-12-24T20:10:22.050685+0000","last_became_peered":"2023-12-24T20:10:22.050685+0000","last_unstale":"2023-12-24T20:10:22.057568+0000","last_undegraded":"2023-12-24T20:10:22.057568+0000","last_fullsized":"2023-12-24T20:10:22.057568+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.014342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"207'2","reported_seq":12,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.326388+0000","last_change":"2023-12-24T20:10:21.327249+0000","last_active":"2023-12-24T20:10:22.326388+0000","last_peered":"2023-12-24T20:10:22.326388+0000","last_clean":"2023-12-24T20:10:22.326388+0000","last_became_active":"2023-12-24T20:10:21.326939+0000","last_became_peered":"2023-12-24T20:10:21.326939+0000","last_unstale":"2023-12-24T20:10:22.326388+0000","last_undegraded":"2023-12-24T20:10:22.326388+0000","last_fullsized":"2023-12-24T20:10:22.326388+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:19:20.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.057358+0000","last_change":"2023-12-24T20:10:22.050052+0000","last_active":"2023-12-24T20:10:22.057358+0000","last_peered":"2023-12-24T20:10:22.057358+0000","last_clean":"2023-12-24T20:10:22.057358+0000","last_became_active":"2023-12-24T20:10:22.049777+0000","last_became_peered":"2023-12-24T20:10:22.049777+0000","last_unstale":"2023-12-24T20:10:22.057358+0000","last_undegraded":"2023-12-24T20:10:22.057358+0000","last_fullsized":"2023-12-24T20:10:22.057358+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:44.358228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-12-24T20:10:23.948414+0000","last_change":"2023-12-24T20:10:21.336024+0000","last_active":"2023-12-24T20:10:23.948414+0000","last_peered":"2023-12-24T20:10:23.948414+0000","last_clean":"2023-12-24T20:10:23.948414+0000","last_became_active":"2023-12-24T20:10:21.335546+0000","last_became_peered":"2023-12-24T20:10:21.335546+0000","last_unstale":"2023-12-24T20:10:23.948414+0000","last_undegraded":"2023-12-24T20:10:23.948414+0000","last_fullsized":"2023-12-24T20:10:23.948414+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:50.016562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.048982+0000","last_change":"2023-12-24T20:10:22.043681+0000","last_active":"2023-12-24T20:10:22.048982+0000","last_peered":"2023-12-24T20:10:22.048982+0000","last_clean":"2023-12-24T20:10:22.048982+0000","last_became_active":"2023-12-24T20:10:22.039803+0000","last_became_peered":"2023-12-24T20:10:22.039803+0000","last_unstale":"2023-12-24T20:10:22.048982+0000","last_undegraded":"2023-12-24T20:10:22.048982+0000","last_fullsized":"2023-12-24T20:10:22.048982+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:56.754661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039895+0000","last_change":"2023-12-24T20:10:21.340658+0000","last_active":"2023-12-24T20:10:22.039895+0000","last_peered":"2023-12-24T20:10:22.039895+0000","last_clean":"2023-12-24T20:10:22.039895+0000","last_became_active":"2023-12-24T20:10:21.339964+0000","last_became_peered":"2023-12-24T20:10:21.339964+0000","last_unstale":"2023-12-24T20:10:22.039895+0000","last_undegraded":"2023-12-24T20:10:22.039895+0000","last_fullsized":"2023-12-24T20:10:22.039895+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:07.832239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.059454+0000","last_change":"2023-12-24T20:10:22.055234+0000","last_active":"2023-12-24T20:10:22.059454+0000","last_peered":"2023-12-24T20:10:22.059454+0000","last_clean":"2023-12-24T20:10:22.059454+0000","last_became_active":"2023-12-24T20:10:22.054573+0000","last_became_peered":"2023-12-24T20:10:22.054573+0000","last_unstale":"2023-12-24T20:10:22.059454+0000","last_undegraded":"2023-12-24T20:10:22.059454+0000","last_fullsized":"2023-12-24T20:10:22.059454+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:45.921498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.039779+0000","last_change":"2023-12-24T20:10:21.338440+0000","last_active":"2023-12-24T20:10:22.039779+0000","last_peered":"2023-12-24T20:10:22.039779+0000","last_clean":"2023-12-24T20:10:22.039779+0000","last_became_active":"2023-12-24T20:10:21.338129+0000","last_became_peered":"2023-12-24T20:10:21.338129+0000","last_unstale":"2023-12-24T20:10:22.039779+0000","last_undegraded":"2023-12-24T20:10:22.039779+0000","last_fullsized":"2023-12-24T20:10:22.039779+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:13.418515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.050390+0000","last_change":"2023-12-24T20:10:22.043991+0000","last_active":"2023-12-24T20:10:22.050390+0000","last_peered":"2023-12-24T20:10:22.050390+0000","last_clean":"2023-12-24T20:10:22.050390+0000","last_became_active":"2023-12-24T20:10:22.043695+0000","last_became_peered":"2023-12-24T20:10:22.043695+0000","last_unstale":"2023-12-24T20:10:22.050390+0000","last_undegraded":"2023-12-24T20:10:22.050390+0000","last_fullsized":"2023-12-24T20:10:22.050390+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:49:29.060010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030809+0000","last_change":"2023-12-24T20:10:21.328635+0000","last_active":"2023-12-24T20:10:22.030809+0000","last_peered":"2023-12-24T20:10:22.030809+0000","last_clean":"2023-12-24T20:10:22.030809+0000","last_became_active":"2023-12-24T20:10:21.328181+0000","last_became_peered":"2023-12-24T20:10:21.328181+0000","last_unstale":"2023-12-24T20:10:22.030809+0000","last_undegraded":"2023-12-24T20:10:22.030809+0000","last_fullsized":"2023-12-24T20:10:22.030809+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:47.926607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.033638+0000","last_change":"2023-12-24T20:10:22.030337+0000","last_active":"2023-12-24T20:10:22.033638+0000","last_peered":"2023-12-24T20:10:22.033638+0000","last_clean":"2023-12-24T20:10:22.033638+0000","last_became_active":"2023-12-24T20:10:22.029988+0000","last_became_peered":"2023-12-24T20:10:22.029988+0000","last_unstale":"2023-12-24T20:10:22.033638+0000","last_undegraded":"2023-12-24T20:10:22.033638+0000","last_fullsized":"2023-12-24T20:10:22.033638+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:26.561797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030584+0000","last_change":"2023-12-24T20:10:21.344023+0000","last_active":"2023-12-24T20:10:22.030584+0000","last_peered":"2023-12-24T20:10:22.030584+0000","last_clean":"2023-12-24T20:10:22.030584+0000","last_became_active":"2023-12-24T20:10:21.343641+0000","last_became_peered":"2023-12-24T20:10:21.343641+0000","last_unstale":"2023-12-24T20:10:22.030584+0000","last_undegraded":"2023-12-24T20:10:22.030584+0000","last_fullsized":"2023-12-24T20:10:22.030584+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:42.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.053875+0000","last_change":"2023-12-24T20:10:22.045727+0000","last_active":"2023-12-24T20:10:22.053875+0000","last_peered":"2023-12-24T20:10:22.053875+0000","last_clean":"2023-12-24T20:10:22.053875+0000","last_became_active":"2023-12-24T20:10:22.045376+0000","last_became_peered":"2023-12-24T20:10:22.045376+0000","last_unstale":"2023-12-24T20:10:22.053875+0000","last_undegraded":"2023-12-24T20:10:22.053875+0000","last_fullsized":"2023-12-24T20:10:22.053875+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:15.404026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.024046+0000","last_change":"2023-12-24T20:10:21.323547+0000","last_active":"2023-12-24T20:10:22.024046+0000","last_peered":"2023-12-24T20:10:22.024046+0000","last_clean":"2023-12-24T20:10:22.024046+0000","last_became_active":"2023-12-24T20:10:21.323248+0000","last_became_peered":"2023-12-24T20:10:21.323248+0000","last_unstale":"2023-12-24T20:10:22.024046+0000","last_undegraded":"2023-12-24T20:10:22.024046+0000","last_fullsized":"2023-12-24T20:10:22.024046+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:44.468978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.052529+0000","last_change":"2023-12-24T20:10:22.047320+0000","last_active":"2023-12-24T20:10:22.052529+0000","last_peered":"2023-12-24T20:10:22.052529+0000","last_clean":"2023-12-24T20:10:22.052529+0000","last_became_active":"2023-12-24T20:10:22.046981+0000","last_became_peered":"2023-12-24T20:10:22.046981+0000","last_unstale":"2023-12-24T20:10:22.052529+0000","last_undegraded":"2023-12-24T20:10:22.052529+0000","last_fullsized":"2023-12-24T20:10:22.052529+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:45:00.603947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.025961+0000","last_change":"2023-12-24T20:10:21.332615+0000","last_active":"2023-12-24T20:10:22.025961+0000","last_peered":"2023-12-24T20:10:22.025961+0000","last_clean":"2023-12-24T20:10:22.025961+0000","last_became_active":"2023-12-24T20:10:21.332243+0000","last_became_peered":"2023-12-24T20:10:21.332243+0000","last_unstale":"2023-12-24T20:10:22.025961+0000","last_undegraded":"2023-12-24T20:10:22.025961+0000","last_fullsized":"2023-12-24T20:10:22.025961+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:30:10.074352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.055156+0000","last_change":"2023-12-24T20:10:22.054250+0000","last_active":"2023-12-24T20:10:22.055156+0000","last_peered":"2023-12-24T20:10:22.055156+0000","last_clean":"2023-12-24T20:10:22.055156+0000","last_became_active":"2023-12-24T20:10:22.052492+0000","last_became_peered":"2023-12-24T20:10:22.052492+0000","last_unstale":"2023-12-24T20:10:22.055156+0000","last_undegraded":"2023-12-24T20:10:22.055156+0000","last_fullsized":"2023-12-24T20:10:22.055156+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:21.287966+0000","last_clean_scrub_stamp":"2023-12-24T20:10:21.287966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:23.682561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.034215+0000","last_change":"2023-12-24T20:10:21.325727+0000","last_active":"2023-12-24T20:10:22.034215+0000","last_peered":"2023-12-24T20:10:22.034215+0000","last_clean":"2023-12-24T20:10:22.034215+0000","last_became_active":"2023-12-24T20:10:21.325436+0000","last_became_peered":"2023-12-24T20:10:21.325436+0000","last_unstale":"2023-12-24T20:10:22.034215+0000","last_undegraded":"2023-12-24T20:10:22.034215+0000","last_fullsized":"2023-12-24T20:10:22.034215+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:10:20.272562+0000","last_clean_scrub_stamp":"2023-12-24T20:10:20.272562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:28.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1133,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-12-24T20:10:22.030353+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:22.030353+0000","last_peered":"2023-12-24T20:10:22.030353+0000","last_clean":"2023-12-24T20:10:22.030353+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:22.030353+0000","last_undegraded":"2023-12-24T20:10:22.030353+0000","last_fullsized":"2023-12-24T20:10:22.030353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575970,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304512,"kb_used_data":3128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067328,"statfs":{"total":96636764160,"available":96324943872,"internally_reserved":0,"allocated":3203072,"data_stored":1960496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.71199999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5629999999999999,"5min":1.728,"15min":1.728},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.131,"15min":1.169},"min":{"1min":0.68500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.2130000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.127,"15min":1.161},"min":{"1min":0.69899999999999995,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.494,"5min":1.718,"15min":1.9379999999999999},"last":1.252},{"interface":"front","average":{"1min":1.2,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.86199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.532,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4430000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.238,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.73599999999999999,"15min":0.70899999999999996},"max":{"1min":1.4570000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.2390000000000001,"15min":1.2490000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6899999999999999,"5min":1.7390000000000001,"15min":1.8200000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3129999999999999},"min":{"1min":0.93700000000000006,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":1.857,"15min":2.4449999999999998},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.319,"15min":1.343},"min":{"1min":1.0109999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.593,"5min":1.988,"15min":2.2919999999999998},"last":1.343}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2450000000000001,"15min":1.2090000000000001},"min":{"1min":0.90000000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.647,"5min":1.865,"15min":2.194},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.3340000000000001,"15min":1.278},"min":{"1min":1.0649999999999999,"5min":0.81299999999999994,"15min":0.68600000000000005},"max":{"1min":1.6399999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.413}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":0.88300000000000001,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.6870000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4099999999999999,"15min":1.353},"min":{"1min":1.1020000000000001,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.7629999999999999,"5min":1.95,"15min":1.95},"last":1.3109999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4359999999999999},"min":{"1min":0.97799999999999998,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.8460000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.385},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.494,"15min":1.4339999999999999},"min":{"1min":1.01,"5min":0.875,"15min":0.55000000000000004},"max":{"1min":1.7609999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1859999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":1.546},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.6699999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":1.625},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.2629999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.214},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1279999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.3100000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.325},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.591}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":1.4159999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.3560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":1.3}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.355}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":0.92400000000000004}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.272}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.115}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":1.226},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.252}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.389},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.419}]}]},{"osd":4,"up_from":13,"seq":55834575971,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1371698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.141}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1719999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.5},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.464}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.2929999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.3380000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.202},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.2430000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.014},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.369}]}]},{"osd":3,"up_from":13,"seq":55834575970,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299844,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071996,"statfs":{"total":96636764160,"available":96329723904,"internally_reserved":0,"allocated":2617344,"data_stored":1370288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.95299999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.872},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.84699999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.159}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.2}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.542},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.2869999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.224},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.3899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.302},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.143}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1370682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":1.262}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.60699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.147}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.054},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.179}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.21},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.091}]}]},{"osd":1,"up_from":13,"seq":55834575970,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312124,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059716,"statfs":{"total":96636764160,"available":96317149184,"internally_reserved":0,"allocated":2609152,"data_stored":1370128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":1.075},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.4370000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.569}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.161}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.484}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.526},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.1100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.337}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.236}]}]},{"osd":0,"up_from":13,"seq":55834575970,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304528,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067312,"statfs":{"total":96636764160,"available":96324927488,"internally_reserved":0,"allocated":3219456,"data_stored":1961196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6950000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.67900000000000005,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.651,"5min":1.823,"15min":1.823},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.105,"15min":1.095},"min":{"1min":0.72699999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.9630000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.157,"15min":1.155},"min":{"1min":0.72699999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.569,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0169999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.105,"15min":1.1020000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.58199999999999996},"max":{"1min":1.4530000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.2849999999999999,"15min":1.288},"min":{"1min":0.96499999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.389,"15min":1.3879999999999999},"min":{"1min":0.95999999999999996,"5min":0.92400000000000004,"15min":0.84999999999999998},"max":{"1min":1.6220000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.21},{"interface":"front","average":{"1min":1.304,"5min":1.325,"15min":1.3280000000000001},"min":{"1min":1.0429999999999999,"5min":0.96299999999999997,"15min":0.85499999999999998},"max":{"1min":1.6950000000000001,"5min":1.863,"15min":1.8660000000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.4650000000000001,"15min":1.4530000000000001},"min":{"1min":1.288,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.377},{"interface":"front","average":{"1min":1.448,"5min":1.466,"15min":1.456},"min":{"1min":1.099,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.8440000000000001,"5min":1.9099999999999999,"15min":2.125},"last":1.425}]},{"osd":6,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.4319999999999999,"15min":1.4199999999999999},"min":{"1min":1.2150000000000001,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.8089999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.538,"15min":1.524},"min":{"1min":1.216,"5min":1.1399999999999999,"15min":0.89400000000000002},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.4870000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:28 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.5489999999999999,"15min":1.5329999999999999},"min":{"1min":1.28,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":2.1309999999999998,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.353},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5329999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.8799999999999999,"5min":2.234,"15min":2.411},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:31.894 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:10:31.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:10:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.106+0000 7f15cb145700 1 Processor -- start 2023-12-24T20:10:32.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 -- start start 2023-12-24T20:10:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15c40b1c20 0x7f15c40cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15c413a050 0x7f15c40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c4158b00 con 0x7f15c4139c80 2023-12-24T20:10:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40cc2b0 con 0x7f15c413a050 2023-12-24T20:10:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.110+0000 7f15cb145700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40cba20 con 0x7f15c40b1c20 2023-12-24T20:10:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15c413a050 0x7f15c40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15c40b1c20 0x7f15c40cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15c413a050 0x7f15c40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44348/0 (socket says 172.21.15.50:44348) 2023-12-24T20:10:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 -- 172.21.15.50:0/4234070322 learned_addr learned my addr 172.21.15.50:0/4234070322 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 -- 172.21.15.50:0/4234070322 >> v2:172.21.15.82:3300/0 conn(0x7f15c40b1c20 msgr2=0x7f15c40cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 --2- 172.21.15.50:0/4234070322 >> v2:172.21.15.82:3300/0 conn(0x7f15c40b1c20 0x7f15c40cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 -- 172.21.15.50:0/4234070322 >> v1:172.21.15.82:6789/0 conn(0x7f15c4139c80 legacy=0x7f15c40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 -- 172.21.15.50:0/4234070322 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40cbcf0 con 0x7f15c413a050 2023-12-24T20:10:32.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c96e2700 1 --2- 172.21.15.50:0/4234070322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c40cb4e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f15c4151aa0 tx=0x7f15bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ada7bb83092c93 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c37fe700 1 -- 172.21.15.50:0/4234070322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00e070 con 0x7f15c413a050 2023-12-24T20:10:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c37fe700 1 -- 172.21.15.50:0/4234070322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00ba20 con 0x7f15c413a050 2023-12-24T20:10:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.114+0000 7f15c37fe700 1 -- 172.21.15.50:0/4234070322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0092e0 con 0x7f15c413a050 2023-12-24T20:10:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- 172.21.15.50:0/4234070322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 msgr2=0x7f15c40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 --2- 172.21.15.50:0/4234070322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c40cb4e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f15c4151aa0 tx=0x7f15bc009840 comp rx=0 tx=0).stop 2023-12-24T20:10:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- 172.21.15.50:0/4234070322 shutdown_connections 2023-12-24T20:10:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 --2- 172.21.15.50:0/4234070322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c40cb4e0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 --2- 172.21.15.50:0/4234070322 >> v2:172.21.15.82:3300/0 conn(0x7f15c40b1c20 0x7f15c40cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- 172.21.15.50:0/4234070322 >> 172.21.15.50:0/4234070322 conn(0x7f15c406c820 msgr2=0x7f15c406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- 172.21.15.50:0/4234070322 shutdown_connections 2023-12-24T20:10:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- 172.21.15.50:0/4234070322 wait complete. 2023-12-24T20:10:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 Processor -- start 2023-12-24T20:10:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.118+0000 7f15cb145700 1 -- start start 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15c40b1c20 0x7f15c4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4139c80 0x7f15c4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4154e90 con 0x7f15c413a050 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c414cb30 con 0x7f15c4139c80 2023-12-24T20:10:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4155430 con 0x7f15c40b1c20 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44362/0 (socket says 172.21.15.50:44362) 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 -- 172.21.15.50:0/1779870527 learned_addr learned my addr 172.21.15.50:0/1779870527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c8ee1700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15c40b1c20 0x7f15c4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c3fff700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4139c80 0x7f15c4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 -- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15c40b1c20 msgr2=0x7f15c4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15c40b1c20 0x7f15c4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 -- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4139c80 msgr2=0x7f15c4159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4139c80 0x7f15c4159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 -- 172.21.15.50:0/1779870527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc009ae0 con 0x7f15c413a050 2023-12-24T20:10:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c96e2700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009880 tx=0x7f15bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc008a80 con 0x7f15c413a050 2023-12-24T20:10:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc008c00 con 0x7f15c413a050 2023-12-24T20:10:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc01c410 con 0x7f15c413a050 2023-12-24T20:10:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4153a50 con 0x7f15c413a050 2023-12-24T20:10:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.122+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c414c850 con 0x7f15c413a050 2023-12-24T20:10:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.126+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c41555a0 con 0x7f15c413a050 2023-12-24T20:10:32.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.126+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f15bc003040 con 0x7f15c413a050 2023-12-24T20:10:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.126+0000 7f15c0ff9700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 0x7f15a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.126+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f15bc07e300 con 0x7f15c413a050 2023-12-24T20:10:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.126+0000 7f15c8ee1700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 0x7f15a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.130+0000 7f15c8ee1700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 0x7f15a8062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c415a2b0 tx=0x7f15b8009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.134+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f15bc04e540 con 0x7f15c413a050 2023-12-24T20:10:32.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.370+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f15c40652e0 con 0x7f15c413a050 2023-12-24T20:10:32.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.378+0000 7f15c0ff9700 1 -- 172.21.15.50:0/1779870527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v52) v1 ==== 190+0+0 (secure 0 0 0) 0x7f15bc051b60 con 0x7f15c413a050 2023-12-24T20:10:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 msgr2=0x7f15a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 0x7f15a8062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c415a2b0 tx=0x7f15b8009040 comp rx=0 tx=0).stop 2023-12-24T20:10:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 msgr2=0x7f15c4159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009880 tx=0x7f15bc018000 comp rx=0 tx=0).stop 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 shutdown_connections 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f15a8060550 0x7f15a8062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15c413a050 0x7f15c4159980 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4139c80 0x7f15c4159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 --2- 172.21.15.50:0/1779870527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15c40b1c20 0x7f15c4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 >> 172.21.15.50:0/1779870527 conn(0x7f15c406c820 msgr2=0x7f15c41502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 shutdown_connections 2023-12-24T20:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.382+0000 7f15cb145700 1 -- 172.21.15.50:0/1779870527 wait complete. 2023-12-24T20:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-24T20:10:32.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.566+0000 7f4f3aee3700 1 Processor -- start 2023-12-24T20:10:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.566+0000 7f4f3aee3700 1 -- start start 2023-12-24T20:10:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.566+0000 7f4f3aee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f34161580 0x7f4f340ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.566+0000 7f4f3aee3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3406c4d0 con 0x7f4f341611b0 2023-12-24T20:10:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f3aee3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3406c1f0 con 0x7f4f340ae100 2023-12-24T20:10:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f3aee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340ab5e0 con 0x7f4f34161580 2023-12-24T20:10:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4f341611b0 0x7f4f3406b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53110/0 (socket says 172.21.15.50:53110) 2023-12-24T20:10:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 -- 172.21.15.50:0/1231662092 learned_addr learned my addr 172.21.15.50:0/1231662092 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f3a6e2700 1 --2- 172.21.15.50:0/1231662092 >> v2:172.21.15.82:3300/0 conn(0x7f4f34161580 0x7f4f340ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945310244 0 0) 0x7f4f30001490 con 0x7f4f341611b0 2023-12-24T20:10:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20003570 con 0x7f4f341611b0 2023-12-24T20:10:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905102081 0 0) 0x7f4f3406c1f0 con 0x7f4f340ae100 2023-12-24T20:10:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f30001490 con 0x7f4f340ae100 2023-12-24T20:10:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601178090 0 0) 0x7f4f20003570 con 0x7f4f341611b0 2023-12-24T20:10:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 >> v2:172.21.15.82:3300/0 conn(0x7f4f34161580 msgr2=0x7f4f340ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 --2- 172.21.15.50:0/1231662092 >> v2:172.21.15.82:3300/0 conn(0x7f4f34161580 0x7f4f340ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 >> v1:172.21.15.82:6789/0 conn(0x7f4f340ae100 legacy=0x7f4f3406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340ab8c0 con 0x7f4f341611b0 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f4f30001900 con 0x7f4f341611b0 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 >> v1:172.21.15.50:6789/0 conn(0x7f4f341611b0 legacy=0x7f4f3406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 0x7f4f20004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340ab5e0 con 0x7f4f20005210 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000c1b0 con 0x7f4f20004810 2023-12-24T20:10:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000c370 con 0x7f4f20003c40 2023-12-24T20:10:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 0x7f4f20004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f396e0700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f3a6e2700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 -- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20004810 msgr2=0x7f4f20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 -- 172.21.15.50:0/1231662092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20005210 msgr2=0x7f4f2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f39ee1700 1 -- 172.21.15.50:0/1231662092 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20003570 con 0x7f4f20003c40 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.570+0000 7f4f3a6e2700 1 -- 172.21.15.50:0/1231662092 reap_dead start 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 0x7f4f20004030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4f30002250 tx=0x7f4f340cc910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff3433f77bdc0f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300070d0 con 0x7f4f20003c40 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30007270 con 0x7f4f20003c40 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f38edf700 1 -- 172.21.15.50:0/1231662092 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30007630 con 0x7f4f20003c40 2023-12-24T20:10:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 -- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 msgr2=0x7f4f20004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 0x7f4f20004030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4f30002250 tx=0x7f4f340cc910 comp rx=0 tx=0).stop 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 -- 172.21.15.50:0/1231662092 shutdown_connections 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/1231662092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20003c40 0x7f4f20004030 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 -- 172.21.15.50:0/1231662092 >> 172.21.15.50:0/1231662092 conn(0x7f4f34067b80 msgr2=0x7f4f340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 -- 172.21.15.50:0/1231662092 shutdown_connections 2023-12-24T20:10:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.574+0000 7f4f3aee3700 1 -- 172.21.15.50:0/1231662092 wait complete. 2023-12-24T20:10:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 Processor -- start 2023-12-24T20:10:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 -- start start 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f3415c5c0 0x7f4f3415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f340ca560 0x7f4f340caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340caf40 con 0x7f4f20003c40 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415c130 con 0x7f4f340ca560 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3aee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340b0010 con 0x7f4f3415c5c0 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44394/0 (socket says 172.21.15.50:44394) 2023-12-24T20:10:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 -- 172.21.15.50:0/655015664 learned_addr learned my addr 172.21.15.50:0/655015664 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f3a6e2700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f340ca560 0x7f4f340caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f396e0700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f3415c5c0 0x7f4f3415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 -- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f3415c5c0 msgr2=0x7f4f3415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f3415c5c0 0x7f4f3415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 -- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f340ca560 msgr2=0x7f4f340caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f340ca560 0x7f4f340caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 -- 172.21.15.50:0/655015664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3415b520 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.578+0000 7f4f39ee1700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f4f30012000 tx=0x7f4f30015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30001b80 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30012610 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300127c0 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3415b800 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3415bdc0 con 0x7f4f20003c40 2023-12-24T20:10:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f34159890 con 0x7f4f20003c40 2023-12-24T20:10:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.582+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4f30024020 con 0x7f4f20003c40 2023-12-24T20:10:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.586+0000 7f4f29ffb700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 0x7f4f18062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.586+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f4f3007e5f0 con 0x7f4f20003c40 2023-12-24T20:10:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.586+0000 7f4f396e0700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 0x7f4f18062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.586+0000 7f4f396e0700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 0x7f4f18062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f3415dd60 tx=0x7f4f24009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.590+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4f34159890 con 0x7f4f20003c40 2023-12-24T20:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.798+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f3406c4d0 con 0x7f4f20003c40 2023-12-24T20:10:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.798+0000 7f4f29ffb700 1 -- 172.21.15.50:0/655015664 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7f4f3406c4d0 con 0x7f4f20003c40 2023-12-24T20:10:32.801 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:32.801 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 msgr2=0x7f4f18062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 0x7f4f18062a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f3415dd60 tx=0x7f4f24009040 comp rx=0 tx=0).stop 2023-12-24T20:10:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 msgr2=0x7f4f3415a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f4f30012000 tx=0x7f4f30015000 comp rx=0 tx=0).stop 2023-12-24T20:10:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 shutdown_connections 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4f18060580 0x7f4f18062a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f340ca560 0x7f4f340caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f3415c5c0 0x7f4f3415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 --2- 172.21.15.50:0/655015664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f20003c40 0x7f4f3415a9b0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 >> 172.21.15.50:0/655015664 conn(0x7f4f34067b80 msgr2=0x7f4f340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 shutdown_connections 2023-12-24T20:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:32.802+0000 7f4f3aee3700 1 -- 172.21.15.50:0/655015664 wait complete. 2023-12-24T20:10:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:33.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:10:21.757805+0000', 'modified': '2023-12-24T20:10:25.343695+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10347': {'gid': 10347, 'name': 'a', 'rank': 0, 'incarnation': 100, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/655876048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 655876048}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 655876048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:10:33.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:10:33.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T20:10:33.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.402+0000 7f7c1cee3700 1 Processor -- start 2023-12-24T20:10:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.402+0000 7f7c1cee3700 1 -- start start 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.402+0000 7f7c1cee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c180ad220 0x7f7c180ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c1cee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c1806afa0 0x7f7c1806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c1cee3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c18155710 0x7f7c18155b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c1cee3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1806b930 con 0x7f7c18155710 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c1cee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1806e110 con 0x7f7c1806afa0 2023-12-24T20:10:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c1cee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1806bb40 con 0x7f7c180ad220 2023-12-24T20:10:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c18155710 0x7f7c18155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c18155710 0x7f7c18155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44406/0 (socket says 172.21.15.50:44406) 2023-12-24T20:10:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 -- 172.21.15.50:0/1954250112 learned_addr learned my addr 172.21.15.50:0/1954250112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c177fe700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c180ad220 0x7f7c180ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1954250112 >> v2:172.21.15.82:3300/0 conn(0x7f7c1806afa0 0x7f7c1806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 -- 172.21.15.50:0/1954250112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c180ad220 msgr2=0x7f7c180ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c180ad220 0x7f7c180ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 -- 172.21.15.50:0/1954250112 >> v2:172.21.15.82:3300/0 conn(0x7f7c1806afa0 msgr2=0x7f7c1806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 --2- 172.21.15.50:0/1954250112 >> v2:172.21.15.82:3300/0 conn(0x7f7c1806afa0 0x7f7c1806b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 -- 172.21.15.50:0/1954250112 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1806be20 con 0x7f7c18155710 2023-12-24T20:10:33.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c17fff700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c18155710 0x7f7c18155b90 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7c18067fd0 tx=0x7f7c1000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a6da5719f868a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c167fc700 1 -- 172.21.15.50:0/1954250112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10010070 con 0x7f7c18155710 2023-12-24T20:10:33.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c167fc700 1 -- 172.21.15.50:0/1954250112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1000dd30 con 0x7f7c18155710 2023-12-24T20:10:33.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.406+0000 7f7c167fc700 1 -- 172.21.15.50:0/1954250112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1000dea0 con 0x7f7c18155710 2023-12-24T20:10:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 -- 172.21.15.50:0/1954250112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c18155710 msgr2=0x7f7c18155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c18155710 0x7f7c18155b90 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7c18067fd0 tx=0x7f7c1000ba50 comp rx=0 tx=0).stop 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 -- 172.21.15.50:0/1954250112 shutdown_connections 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/1954250112 >> v2:172.21.15.82:3300/0 conn(0x7f7c1806afa0 0x7f7c1806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c18155710 0x7f7c18155b90 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/1954250112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c180ad220 0x7f7c180ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 -- 172.21.15.50:0/1954250112 >> 172.21.15.50:0/1954250112 conn(0x7f7c18067b80 msgr2=0x7f7c180cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 -- 172.21.15.50:0/1954250112 shutdown_connections 2023-12-24T20:10:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 -- 172.21.15.50:0/1954250112 wait complete. 2023-12-24T20:10:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.410+0000 7f7c1cee3700 1 Processor -- start 2023-12-24T20:10:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- start start 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c1806afa0 0x7f7c180c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c18155710 0x7f7c18169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18158850 con 0x7f7c180ad220 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18157c40 con 0x7f7c18155710 2023-12-24T20:10:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18157f20 con 0x7f7c1806afa0 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44414/0 (socket says 172.21.15.50:44414) 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 -- 172.21.15.50:0/2182335433 learned_addr learned my addr 172.21.15.50:0/2182335433 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c177fe700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c1806afa0 0x7f7c180c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c17fff700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c18155710 0x7f7c18169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 -- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c1806afa0 msgr2=0x7f7c180c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c1806afa0 0x7f7c180c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 -- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c18155710 msgr2=0x7f7c18169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c18155710 0x7f7c18169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 -- 172.21.15.50:0/2182335433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1000bcf0 con 0x7f7c180ad220 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00ec80 tx=0x7f7c0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7bff7fe700 1 -- 172.21.15.50:0/2182335433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00c8e0 con 0x7f7c180ad220 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7bff7fe700 1 -- 172.21.15.50:0/2182335433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00ca40 con 0x7f7c180ad220 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7bff7fe700 1 -- 172.21.15.50:0/2182335433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00cde0 con 0x7f7c180ad220 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c18158200 con 0x7f7c180ad220 2023-12-24T20:10:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.414+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c180c5ff0 con 0x7f7c180ad220 2023-12-24T20:10:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7bff7fe700 1 -- 172.21.15.50:0/2182335433 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f7c0c013680 con 0x7f7c180ad220 2023-12-24T20:10:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7bff7fe700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 0x7f7c04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7bff7fe700 1 -- 172.21.15.50:0/2182335433 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f7c0c07d1d0 con 0x7f7c180ad220 2023-12-24T20:10:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7c177fe700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 0x7f7c04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7c20422740 1 Processor -- start 2023-12-24T20:10:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7c20422740 1 -- start start 2023-12-24T20:10:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.422+0000 7f7c177fe700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 0x7f7c04062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009db0 tx=0x7f7c080091a0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x2003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x2004440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f31f30 con 0x1dd1790 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2ded0 con 0x1d86ae0 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ef40b0 con 0x1d86710 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44416/0 (socket says 172.21.15.50:44416) 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x2004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c17fff700 1 -- 172.21.15.50:0/1784538448 learned_addr learned my addr 172.21.15.50:0/1784538448 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c177fe700 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x2003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 msgr2=0x2003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x2003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1784538448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 msgr2=0x2004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1784538448 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1dd29e0 con 0x1d86710 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c17fff700 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x2004440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c07b3d0 tx=0x7f7c0c07b2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187f40cdb2f28054 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7bfcff9700 1 -- 172.21.15.50:0/1784538448 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0543e0 con 0x1d86710 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7bfcff9700 1 -- 172.21.15.50:0/1784538448 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0580b0 con 0x1d86710 2023-12-24T20:10:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.426+0000 7f7bfcff9700 1 -- 172.21.15.50:0/1784538448 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c04f210 con 0x1d86710 2023-12-24T20:10:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 msgr2=0x2004440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x2004440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c07b3d0 tx=0x7f7c0c07b2a0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- 172.21.15.50:0/1784538448 shutdown_connections 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x2004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x2004440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- 172.21.15.50:0/1784538448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x2003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- 172.21.15.50:0/1784538448 >> 172.21.15.50:0/1784538448 conn(0x1d86eb0 msgr2=0x1fc0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- 172.21.15.50:0/1784538448 shutdown_connections 2023-12-24T20:10:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- 172.21.15.50:0/1784538448 wait complete. 2023-12-24T20:10:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- start start 2023-12-24T20:10:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 Processor -- start 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86710 0x2008510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1dd1790 0x1fe9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef3d50 con 0x1d86ae0 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ecc970 con 0x1d86710 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f2d6e0 con 0x1dd1790 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c20422740 10 client.0 _ll_register_callbacks cb 0x1f776a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.430+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44428/0 (socket says 172.21.15.50:44428) 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1436854735 learned_addr learned my addr 172.21.15.50:0/1436854735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c177fe700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86710 0x2008510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c17fff700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1dd1790 0x1fe9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1dd1790 msgr2=0x1fe9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1dd1790 0x1fe9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86710 msgr2=0x2008510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86710 0x2008510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 -- 172.21.15.50:0/1436854735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1806be20 con 0x1d86ae0 2023-12-24T20:10:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c07b340 tx=0x7f7c0c063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe3647c34294173 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c04f210 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f7c0c06b170 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ecccc0 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0c06b330 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 10 client.10524 fetch_fsmap learned FSMap version 104 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x7f7c180c5ff0 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ecccc0 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 104) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c0c057c20 con 0x1d86ae0 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 10 client.10524 fetch_fsmap finished waiting for FSMap version 104 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 10 client.10524 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 20 client.10524 populate_metadata read hostname 'smithi050' 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1feb380 0x20136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 4 client.10524 mds_command: new command op to 10347 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:10:33.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 --> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ed03e0 con 0x1feb380 2023-12-24T20:10:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.434+0000 7f7c177fe700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1feb380 0x20136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7bf5ffb700 10 client.10524 ms_handle_connect on v2:172.21.15.50:6833/655876048 2023-12-24T20:10:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c177fe700 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1feb380 0x20136b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85a77515538a079 server_cookie=d31496f78d37b30c in_seq=0 out_seq=0 2023-12-24T20:10:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/1436854735 <== mds.0 v2:172.21.15.50:6833/655876048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1ed03e0 con 0x1feb380 2023-12-24T20:10:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7bf5ffb700 10 client.10524 handle_command_reply: tid=0 2023-12-24T20:10:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 client.10524 shutdown 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 msgr2=0x2008a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c07b340 tx=0x7f7c0c063000 comp rx=0 tx=0).stop 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 shutdown_connections 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1feb380 0x20136b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1dd1790 0x1fe9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7bf5ffb700 0 client.10524 ms_handle_reset on v2:172.21.15.50:6833/655876048 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86ae0 0x2008a50 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 --2- 172.21.15.50:0/1436854735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86710 0x2008510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 >> 172.21.15.50:0/1436854735 conn(0x1d86eb0 msgr2=0x1fb8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 shutdown_connections 2023-12-24T20:10:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 1 -- 172.21.15.50:0/1436854735 wait complete. 2023-12-24T20:10:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.438+0000 7f7c20422740 20 client.10524 trim_cache size 0 max 16384 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 Processor -- start 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 -- start start 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 0x2003810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 0x1fe7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f01040 con 0x1d86710 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2b890 con 0x1dd1790 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ef7400 con 0x1d86ae0 2023-12-24T20:10:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 0x2003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:37826/0 (socket says 172.21.15.50:37826) 2023-12-24T20:10:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 -- 172.21.15.50:0/973888470 learned_addr learned my addr 172.21.15.50:0/973888470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 0x2003810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44442/0 (socket says 172.21.15.50:44442) 2023-12-24T20:10:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c17fff700 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 0x1fe7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 -- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 msgr2=0x1fe7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 0x1fe7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 -- 172.21.15.50:0/973888470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 msgr2=0x2003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 0x2003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c16ffd700 1 -- 172.21.15.50:0/973888470 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1efc370 con 0x1d86ae0 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.458+0000 7f7c17fff700 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 0x1fe7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009fd0 tx=0x7f7c0c068070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200db912c9ac9b06 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7bfd7fa700 1 -- 172.21.15.50:0/973888470 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c04f210 con 0x1d86ae0 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7bfd7fa700 1 -- 172.21.15.50:0/973888470 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00e040 con 0x1d86ae0 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7bfd7fa700 1 -- 172.21.15.50:0/973888470 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c054360 con 0x1d86ae0 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 msgr2=0x2003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009fd0 tx=0x7f7c0c068070 comp rx=0 tx=0).stop 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- 172.21.15.50:0/973888470 shutdown_connections 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1dd1790 0x1fe7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86ae0 0x2003d50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- 172.21.15.50:0/973888470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d86710 0x2003810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- 172.21.15.50:0/973888470 >> 172.21.15.50:0/973888470 conn(0x1d86eb0 msgr2=0x1fe9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- 172.21.15.50:0/973888470 shutdown_connections 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- 172.21.15.50:0/973888470 wait complete. 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 -- start start 2023-12-24T20:10:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 Processor -- start 2023-12-24T20:10:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x1fbd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x1fbda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.462+0000 7f7c20422740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f319d0 con 0x1dd1790 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f30590 con 0x1d86ae0 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ed12f0 con 0x1d86710 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 10 client.0 _ll_register_callbacks cb 0x1d529d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44452/0 (socket says 172.21.15.50:44452) 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 -- 172.21.15.50:0/3640592690 learned_addr learned my addr 172.21.15.50:0/3640592690 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c16ffd700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x1fbda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c177fe700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x1fbd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 -- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 msgr2=0x1fbd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x1fbd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 -- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 msgr2=0x1fbda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x1fbda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 -- 172.21.15.50:0/3640592690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c180c5ff0 con 0x1dd1790 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c17fff700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7c1001ea70 tx=0x7f7c1001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d171a939b4a08c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1001ebd0 con 0x1dd1790 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f7c1002be10 con 0x1dd1790 2023-12-24T20:10:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c180ca340 con 0x1dd1790 2023-12-24T20:10:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c100143f0 con 0x1dd1790 2023-12-24T20:10:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 10 client.10530 fetch_fsmap learned FSMap version 104 2023-12-24T20:10:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x1ee2d80 con 0x1dd1790 2023-12-24T20:10:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180ca340 con 0x1dd1790 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 104) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c1000d1a0 con 0x1dd1790 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 10 client.10530 fetch_fsmap finished waiting for FSMap version 104 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 10 client.10530 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 20 client.10530 populate_metadata read hostname 'smithi050' 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1fbe480 0x1fbe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 4 client.10530 mds_command: new command op to 10347 tid=0[{"prefix": "status"}] 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.466+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 --> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f7c0c0580b0 con 0x1fbe480 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c177fe700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1fbe480 0x1fbe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c177fe700 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1fbe480 0x1fbe850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7a0a7deca8e7bb server_cookie=d12c9868c8e53067 in_seq=0 out_seq=0 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7bf5ffb700 10 client.10530 ms_handle_connect on v2:172.21.15.50:6833/655876048 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7bf5ffb700 1 -- 172.21.15.50:0/3640592690 <== mds.0 v2:172.21.15.50:6833/655876048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x7f7c0c0580b0 con 0x1fbe480 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7bf5ffb700 10 client.10530 handle_command_reply: tid=0 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 client.10530 shutdown 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 msgr2=0x1fbdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7c1001ea70 tx=0x7f7c1001a000 comp rx=0 tx=0).stop 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 shutdown_connections 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:6833/655876048,v1:172.21.15.50:6835/655876048] conn(0x1fbe480 0x1fbe850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1dd1790 0x1fbdf40 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1d86ae0 0x1fbda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 --2- 172.21.15.50:0/3640592690 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x1d86710 0x1fbd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 >> 172.21.15.50:0/3640592690 conn(0x1d86eb0 msgr2=0x1fe7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7bf5ffb700 0 client.10530 ms_handle_reset on v2:172.21.15.50:6833/655876048 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 shutdown_connections 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 1 -- 172.21.15.50:0/3640592690 wait complete. 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c20422740 20 client.10530 trim_cache size 0 max 16384 2023-12-24T20:10:33.476 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "9cd325ac-a2d2-4a61-9c13-57b4146a16d9", 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 10347, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.164967514000001, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 104, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 208, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 208, 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.085558339999999 2023-12-24T20:10:33.477 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:10:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 msgr2=0x7f7c04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 0x7f7c04062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009db0 tx=0x7f7c080091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 msgr2=0x7f7c1816bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00ec80 tx=0x7f7c0c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 shutdown_connections 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f7c04060550 0x7f7c04062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c18155710 0x7f7c18169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c180ad220 0x7f7c1816bea0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 --2- 172.21.15.50:0/2182335433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c1806afa0 0x7f7c180c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.470+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 >> 172.21.15.50:0/2182335433 conn(0x7f7c18067b80 msgr2=0x7f7c180c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.474+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 shutdown_connections 2023-12-24T20:10:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.474+0000 7f7c1cee3700 1 -- 172.21.15.50:0/2182335433 wait complete. 2023-12-24T20:10:33.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:10:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.674+0000 7f8459278700 1 Processor -- start 2023-12-24T20:10:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.674+0000 7f8459278700 1 -- start start 2023-12-24T20:10:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8459278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8454158e10 0x7f845415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8459278700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84540b3c90 0x7f845406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8459278700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845406d5c0 con 0x7f84540b1ba0 2023-12-24T20:10:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8459278700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540b49c0 con 0x7f84540b3c90 2023-12-24T20:10:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8459278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845406d040 con 0x7f8454158e10 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84537fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f84540b1ba0 0x7f845406a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53114/0 (socket says 172.21.15.50:53114) 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84537fe700 1 -- 172.21.15.50:0/1835257318 learned_addr learned my addr 172.21.15.50:0/1835257318 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84527fc700 1 --2- 172.21.15.50:0/1835257318 >> v2:172.21.15.50:3300/0 conn(0x7f84540b3c90 0x7f845406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8452ffd700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8454158e10 0x7f845415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8451ffb700 1 -- 172.21.15.50:0/1835257318 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045489295 0 0) 0x7f845406d5c0 con 0x7f84540b1ba0 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f8451ffb700 1 -- 172.21.15.50:0/1835257318 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003570 con 0x7f84540b1ba0 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84527fc700 1 -- 172.21.15.50:0/1835257318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8454158e10 msgr2=0x7f845415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84527fc700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8454158e10 0x7f845415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84527fc700 1 -- 172.21.15.50:0/1835257318 >> v1:172.21.15.50:6789/0 conn(0x7f84540b1ba0 legacy=0x7f845406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.678+0000 7f84527fc700 1 -- 172.21.15.50:0/1835257318 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845406df90 con 0x7f84540b3c90 2023-12-24T20:10:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f84527fc700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b3c90 0x7f845406da50 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f84480098e0 tx=0x7f84480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5243e89887ab72c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8451ffb700 1 -- 172.21.15.50:0/1835257318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011630 con 0x7f84540b3c90 2023-12-24T20:10:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8451ffb700 1 -- 172.21.15.50:0/1835257318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448011790 con 0x7f84540b3c90 2023-12-24T20:10:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8451ffb700 1 -- 172.21.15.50:0/1835257318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011b30 con 0x7f84540b3c90 2023-12-24T20:10:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 -- 172.21.15.50:0/1835257318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b3c90 msgr2=0x7f845406da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b3c90 0x7f845406da50 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f84480098e0 tx=0x7f84480091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 -- 172.21.15.50:0/1835257318 shutdown_connections 2023-12-24T20:10:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b3c90 0x7f845406da50 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 --2- 172.21.15.50:0/1835257318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8454158e10 0x7f845415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 -- 172.21.15.50:0/1835257318 >> 172.21.15.50:0/1835257318 conn(0x7f84540670b0 msgr2=0x7f84540674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 -- 172.21.15.50:0/1835257318 shutdown_connections 2023-12-24T20:10:33.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.682+0000 7f8459278700 1 -- 172.21.15.50:0/1835257318 wait complete. 2023-12-24T20:10:33.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 Processor -- start 2023-12-24T20:10:33.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 -- start start 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84540b1ba0 0x7f845414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845415c310 0x7f845415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845415be80 con 0x7f8454158e10 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845415b270 con 0x7f845415c310 2023-12-24T20:10:33.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.686+0000 7f8459278700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845415b550 con 0x7f84540b1ba0 2023-12-24T20:10:33.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44462/0 (socket says 172.21.15.50:44462) 2023-12-24T20:10:33.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 -- 172.21.15.50:0/1121264212 learned_addr learned my addr 172.21.15.50:0/1121264212 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f8452ffd700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84540b1ba0 0x7f845414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84537fe700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845415c310 0x7f845415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 -- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84540b1ba0 msgr2=0x7f845414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84540b1ba0 0x7f845414cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 -- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845415c310 msgr2=0x7f845415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845415c310 0x7f845415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 -- 172.21.15.50:0/1121264212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009420 con 0x7f8454158e10 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f84527fc700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f8448013000 tx=0x7f8448017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448000c40 con 0x7f8454158e10 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845415b830 con 0x7f8454158e10 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448011900 con 0x7f8454158e10 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448025420 con 0x7f8454158e10 2023-12-24T20:10:33.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845414cff0 con 0x7f8454158e10 2023-12-24T20:10:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.690+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540652e0 con 0x7f8454158e10 2023-12-24T20:10:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.694+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f8448023070 con 0x7f8454158e10 2023-12-24T20:10:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.694+0000 7f843affd700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 0x7f8440062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:33.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.694+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f844807df40 con 0x7f8454158e10 2023-12-24T20:10:33.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.694+0000 7f8452ffd700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 0x7f8440062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.698+0000 7f8452ffd700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 0x7f8440062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8444009d10 tx=0x7f84440091a0 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.702+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f844804e180 con 0x7f8454158e10 2023-12-24T20:10:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.918+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f845406ca20 con 0x7f8454158e10 2023-12-24T20:10:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.918+0000 7f843affd700 1 -- 172.21.15.50:0/1121264212 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84480517a0 con 0x7f8454158e10 2023-12-24T20:10:33.920 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 msgr2=0x7f8440062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 0x7f8440062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8444009d10 tx=0x7f84440091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 msgr2=0x7f845415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f8448013000 tx=0x7f8448017000 comp rx=0 tx=0).stop 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 shutdown_connections 2023-12-24T20:10:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8440060550 0x7f8440062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845415c310 0x7f845415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8454158e10 0x7f845415dca0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 --2- 172.21.15.50:0/1121264212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f84540b1ba0 0x7f845414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 >> 172.21.15.50:0/1121264212 conn(0x7f84540670b0 msgr2=0x7f8454153790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 shutdown_connections 2023-12-24T20:10:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:33.922+0000 7f8459278700 1 -- 172.21.15.50:0/1121264212 wait complete. 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-24T20:10:33.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-24T20:10:33.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:10:33.949 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:10:33.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:33.949 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-24T20:10:33.969 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:10:33.969 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:10:33.969 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:10:33.969 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.969 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-24T20:10:33.970 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 36776sec preferred_lft 36776sec 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:62:dc:f2:85 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::cf2:a4ff:feaf:f3ef/64 scope link 2023-12-24T20:10:33.971 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f6:12:c6:83:31:bf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f412:c6ff:fe83:31bf/64 scope link 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fe:32:ef:03:2b:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::fc32:efff:fe03:2b5e/64 scope link 2023-12-24T20:10:33.972 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:10:33.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:33.973 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:10:34.060 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-24T20:10:34.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:34.063 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-24T20:10:34.128 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:10:34.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-24T20:10:34.129 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-24T20:10:34.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:34.279 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T20:10:34.296 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:10:34.296 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:10:34.297 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:10:34.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:34.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-24T20:10:34.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:10:34.381 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:34.446 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:10:34.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:10:34.447 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:34.509 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-24T20:10:34.509 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:10:34.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:10:34.633 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:10:34.633 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T20:10:34.657 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-24T20:10:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-24T20:10:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.82:3300,172.21.15.82:3301" 2023-12-24T20:10:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@9cd325ac-a2d2-4a61-9c13-57b4146a16d9.cephfs=/ 2023-12-24T20:10:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.82:3300/172.21.15.82:3301" will pass to kernel 2023-12-24T20:10:34.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-24T20:10:34.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:34.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:34.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-12-24T20:10:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.914+0000 7ff07906e700 1 Processor -- start 2023-12-24T20:10:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.914+0000 7ff07906e700 1 -- start start 2023-12-24T20:10:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07906e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0740cc870 0x7ff0740679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07906e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff074067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07906e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff074068430 con 0x7ff074158e70 2023-12-24T20:10:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07906e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740686e0 con 0x7ff0740cc870 2023-12-24T20:10:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07906e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740689c0 con 0x7ff0740c9f40 2023-12-24T20:10:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff072d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff074158e70 0x7ff0740cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53128/0 (socket says 172.21.15.50:53128) 2023-12-24T20:10:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff072d9d700 1 -- 172.21.15.50:0/4190399106 learned_addr learned my addr 172.21.15.50:0/4190399106 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 --2- 172.21.15.50:0/4190399106 >> v2:172.21.15.50:3300/0 conn(0x7ff0740cc870 0x7ff0740679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07359e700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff074067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 -- 172.21.15.50:0/4190399106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 msgr2=0x7ff074067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff074067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 -- 172.21.15.50:0/4190399106 >> v1:172.21.15.50:6789/0 conn(0x7ff074158e70 legacy=0x7ff0740cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff071d9b700 1 -- 172.21.15.50:0/4190399106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830579391 0 0) 0x7ff074068430 con 0x7ff074158e70 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 -- 172.21.15.50:0/4190399106 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074068ca0 con 0x7ff0740cc870 2023-12-24T20:10:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07359e700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff074067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff07259c700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0740cc870 0x7ff0740679b0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098e0 tx=0x7ff0680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857c25a31d279e95 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff071d9b700 1 -- 172.21.15.50:0/4190399106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800b640 con 0x7ff0740cc870 2023-12-24T20:10:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff071d9b700 1 -- 172.21.15.50:0/4190399106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800b7a0 con 0x7ff0740cc870 2023-12-24T20:10:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.918+0000 7ff071d9b700 1 -- 172.21.15.50:0/4190399106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800bb40 con 0x7ff0740cc870 2023-12-24T20:10:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- 172.21.15.50:0/4190399106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0740cc870 msgr2=0x7ff0740679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0740cc870 0x7ff0740679b0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098e0 tx=0x7ff0680091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- 172.21.15.50:0/4190399106 shutdown_connections 2023-12-24T20:10:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff074067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 --2- 172.21.15.50:0/4190399106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0740cc870 0x7ff0740679b0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- 172.21.15.50:0/4190399106 >> 172.21.15.50:0/4190399106 conn(0x7ff0740cdd80 msgr2=0x7ff0740ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- 172.21.15.50:0/4190399106 shutdown_connections 2023-12-24T20:10:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- 172.21.15.50:0/4190399106 wait complete. 2023-12-24T20:10:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 Processor -- start 2023-12-24T20:10:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.922+0000 7ff07906e700 1 -- start start 2023-12-24T20:10:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff0740b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 0x7ff0740b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b1f00 con 0x7ff074158e70 2023-12-24T20:10:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b2d00 con 0x7ff0740cc870 2023-12-24T20:10:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b20f0 con 0x7ff0740c9f40 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44478/0 (socket says 172.21.15.50:44478) 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 -- 172.21.15.50:0/3371692385 learned_addr learned my addr 172.21.15.50:0/3371692385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff072d9d700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff0740b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07259c700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 0x7ff0740b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 -- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 msgr2=0x7ff0740b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff0740b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 -- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 msgr2=0x7ff0740b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 0x7ff0740b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 -- 172.21.15.50:0/3371692385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009a20 con 0x7ff074158e70 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07259c700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 0x7ff0740b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07359e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009fc0 tx=0x7ff06c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00cd30 con 0x7ff074158e70 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00f040 con 0x7ff074158e70 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068009420 con 0x7ff074158e70 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0146d0 con 0x7ff074158e70 2023-12-24T20:10:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.926+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0740b26b0 con 0x7ff074158e70 2023-12-24T20:10:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.930+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0740b2e70 con 0x7ff074158e70 2023-12-24T20:10:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.930+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7ff06c003020 con 0x7ff074158e70 2023-12-24T20:10:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.934+0000 7ff05affd700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 0x7ff060062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.934+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7ff06c07d5b0 con 0x7ff074158e70 2023-12-24T20:10:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.934+0000 7ff072d9d700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 0x7ff060062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.934+0000 7ff072d9d700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 0x7ff060062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff074067960 tx=0x7ff064009040 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:34.942+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff06c04d7f0 con 0x7ff074158e70 2023-12-24T20:10:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.134+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0740652e0 con 0x7ff060060550 2023-12-24T20:10:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.138+0000 7ff05affd700 1 -- 172.21.15.50:0/3371692385 <== mgr.10158 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff0740652e0 con 0x7ff060060550 2023-12-24T20:10:35.139 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-24T20:10:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-24T20:10:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs" 2023-12-24T20:10:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-24T20:10:35.140 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 msgr2=0x7ff060062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 0x7ff060062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff074067960 tx=0x7ff064009040 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 msgr2=0x7ff074153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009fc0 tx=0x7ff06c00b040 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 shutdown_connections 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff060060550 0x7ff060062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff074158e70 0x7ff074153b10 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0740cc870 0x7ff0740b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 --2- 172.21.15.50:0/3371692385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0740c9f40 0x7ff0740b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 >> 172.21.15.50:0/3371692385 conn(0x7ff0740cdd80 msgr2=0x7ff0741593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 shutdown_connections 2023-12-24T20:10:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.142+0000 7ff07906e700 1 -- 172.21.15.50:0/3371692385 wait complete. 2023-12-24T20:10:35.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-12-24T20:10:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.338+0000 7f04fe0ae700 1 Processor -- start 2023-12-24T20:10:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.338+0000 7f04fe0ae700 1 -- start start 2023-12-24T20:10:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04fe0ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04f80cf4d0 0x7f04f806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04fe0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f80cf8a0 0x7f04f806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04fe0ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f806b0a0 con 0x7f04f806ac40 2023-12-24T20:10:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04fe0ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f8159640 con 0x7f04f80cf4d0 2023-12-24T20:10:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04fe0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80cd680 con 0x7f04f80cf8a0 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04f80cf4d0 0x7f04f806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04f80cf4d0 0x7f04f806d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44494/0 (socket says 172.21.15.50:44494) 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 -- 172.21.15.50:0/3406952029 learned_addr learned my addr 172.21.15.50:0/3406952029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f7fff700 1 --1- 172.21.15.50:0/3406952029 >> v1:172.21.15.82:6789/0 conn(0x7f04f806ac40 0x7f04f815ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:60958/0 (socket says 172.21.15.50:60958) 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f6ffd700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f80cf8a0 0x7f04f806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 -- 172.21.15.50:0/3406952029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f80cf8a0 msgr2=0x7f04f806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f80cf8a0 0x7f04f806a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 -- 172.21.15.50:0/3406952029 >> v1:172.21.15.82:6789/0 conn(0x7f04f806ac40 legacy=0x7f04f815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 -- 172.21.15.50:0/3406952029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80cca70 con 0x7f04f80cf4d0 2023-12-24T20:10:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f67fc700 1 -- 172.21.15.50:0/3406952029 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709462327 0 0) 0x7f04f0001490 con 0x7f04f806ac40 2023-12-24T20:10:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.342+0000 7f04f77fe700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f806d1e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f04e80099b0 tx=0x7f04e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6401185d77f18cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04f67fc700 1 -- 172.21.15.50:0/3406952029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8009ea0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04f67fc700 1 -- 172.21.15.50:0/3406952029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800b860 con 0x7f04f80cf4d0 2023-12-24T20:10:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04f67fc700 1 -- 172.21.15.50:0/3406952029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800bc00 con 0x7f04f80cf4d0 2023-12-24T20:10:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3406952029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 msgr2=0x7f04f806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f806d1e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f04e80099b0 tx=0x7f04e8009250 comp rx=0 tx=0).stop 2023-12-24T20:10:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3406952029 shutdown_connections 2023-12-24T20:10:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f80cf8a0 0x7f04f806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3406952029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f806d1e0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3406952029 >> 172.21.15.50:0/3406952029 conn(0x7f04f8067b30 msgr2=0x7f04f80cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3406952029 shutdown_connections 2023-12-24T20:10:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.346+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3406952029 wait complete. 2023-12-24T20:10:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 Processor -- start 2023-12-24T20:10:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 -- start start 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f806ac40 0x7f04f8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f80cf8a0 0x7f04f814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f815da70 con 0x7f04f80cf4d0 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f815dd10 con 0x7f04f80cf8a0 2023-12-24T20:10:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04fe0ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f815dff0 con 0x7f04f806ac40 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f80cf8a0 0x7f04f814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44498/0 (socket says 172.21.15.50:44498) 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 -- 172.21.15.50:0/3190907368 learned_addr learned my addr 172.21.15.50:0/3190907368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f77fe700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f806ac40 0x7f04f8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 -- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f806ac40 msgr2=0x7f04f8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f806ac40 0x7f04f8152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 -- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f80cf8a0 msgr2=0x7f04f814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f80cf8a0 0x7f04f814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.350+0000 7f04f6ffd700 1 -- 172.21.15.50:0/3190907368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80094f0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04f6ffd700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e900 tx=0x7f04ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:35.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec013680 con 0x7f04f80cf4d0 2023-12-24T20:10:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec013800 con 0x7f04f80cf4d0 2023-12-24T20:10:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f815e2d0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec013bc0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f81504c0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.354+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f80652e0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.358+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 116) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f04ec0123d0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.358+0000 7f04df7fe700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 0x7f04e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.358+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f04ec07cbf0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.358+0000 7f04f77fe700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 0x7f04e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.358+0000 7f04f77fe700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 0x7f04e4062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04e80099b0 tx=0x7f04e8017000 comp rx=0 tx=0).ready entity=mgr.10158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.366+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f04ec04ced0 con 0x7f04f80cf4d0 2023-12-24T20:10:35.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:35.578+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f04f80ccd50 con 0x7f04f80cf4d0 2023-12-24T20:10:36.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.062+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 117) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f04ec04d2a0 con 0x7f04f80cf4d0 2023-12-24T20:10:36.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.062+0000 7f04df7fe700 1 -- 172.21.15.50:0/3190907368 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v117) v1 ==== 92+0+0 (secure 0 0 0) 0x7f04ec050b90 con 0x7f04f80cf4d0 2023-12-24T20:10:36.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 msgr2=0x7f04e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 0x7f04e4062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04e80099b0 tx=0x7f04e8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 msgr2=0x7f04f815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e900 tx=0x7f04ec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 shutdown_connections 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f04e4060580 0x7f04e4062a30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f80cf8a0 0x7f04f814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f80cf4d0 0x7f04f815d530 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 --2- 172.21.15.50:0/3190907368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04f806ac40 0x7f04f8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 >> 172.21.15.50:0/3190907368 conn(0x7f04f8067b30 msgr2=0x7f04f80b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 shutdown_connections 2023-12-24T20:10:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.066+0000 7f04fe0ae700 1 -- 172.21.15.50:0/3190907368 wait complete. 2023-12-24T20:10:36.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-12-24T20:10:36.253 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:36.246+0000 7f896c549000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:36.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.254+0000 7f465a9c5700 1 Processor -- start 2023-12-24T20:10:36.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.254+0000 7f465a9c5700 1 -- start start 2023-12-24T20:10:36.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f465a9c5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46540cac10 0x7f465406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f465a9c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465406ccc0 con 0x7f4654140870 2023-12-24T20:10:36.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f465a9c5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465415b120 con 0x7f46541404a0 2023-12-24T20:10:36.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f465a9c5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465415b990 con 0x7f46540cac10 2023-12-24T20:10:36.260 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f97731ce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:36.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f46537fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4654140870 0x7f46540ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53140/0 (socket says 172.21.15.50:53140) 2023-12-24T20:10:36.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f46537fe700 1 -- 172.21.15.50:0/373559384 learned_addr learned my addr 172.21.15.50:0/373559384 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:36.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4658f62700 1 --2- 172.21.15.50:0/373559384 >> v2:172.21.15.82:3300/0 conn(0x7f46540cac10 0x7f465406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589779026 0 0) 0x7f465406ccc0 con 0x7f4654140870 2023-12-24T20:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463c003570 con 0x7f4654140870 2023-12-24T20:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789561015 0 0) 0x7f465415b120 con 0x7f46541404a0 2023-12-24T20:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f465406ccc0 con 0x7f46541404a0 2023-12-24T20:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384690183 0 0) 0x7f463c003570 con 0x7f4654140870 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 >> v2:172.21.15.82:3300/0 conn(0x7f46540cac10 msgr2=0x7f465406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 --2- 172.21.15.50:0/373559384 >> v2:172.21.15.82:3300/0 conn(0x7f46540cac10 0x7f465406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 >> v1:172.21.15.82:6789/0 conn(0x7f46541404a0 legacy=0x7f465415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465415b3d0 con 0x7f4654140870 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f4648001470 con 0x7f4654140870 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 >> v1:172.21.15.50:6789/0 conn(0x7f4654140870 legacy=0x7f46540ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f463c004c50 0x7f463c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f463c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c004160 0x7f463c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415b990 con 0x7f463c0037b0 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00c160 con 0x7f463c004160 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00c320 con 0x7f463c004c50 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f46537fe700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f463c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4653fff700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f463c004c50 0x7f463c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.258+0000 7f4658f62700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c004160 0x7f463c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 -- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f463c004c50 msgr2=0x7f463c005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f463c004c50 0x7f463c005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 -- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c004160 msgr2=0x7f463c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c004160 0x7f463c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 -- 172.21.15.50:0/373559384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c003570 con 0x7f463c0037b0 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f4658f62700 1 -- 172.21.15.50:0/373559384 reap_dead start 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f46537fe700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f463c003c20 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f464800c2a0 tx=0x7f4648001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7bbadbac651410 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800cb50 con 0x7f463c0037b0 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800ccb0 con 0x7f463c0037b0 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f4652ffd700 1 -- 172.21.15.50:0/373559384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648005b70 con 0x7f463c0037b0 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 -- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 msgr2=0x7f463c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f463c003c20 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f464800c2a0 tx=0x7f4648001e10 comp rx=0 tx=0).stop 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 -- 172.21.15.50:0/373559384 shutdown_connections 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 --2- 172.21.15.50:0/373559384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f463c003c20 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 -- 172.21.15.50:0/373559384 >> 172.21.15.50:0/373559384 conn(0x7f4654067b80 msgr2=0x7f46540cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 -- 172.21.15.50:0/373559384 shutdown_connections 2023-12-24T20:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.262+0000 7f465a9c5700 1 -- 172.21.15.50:0/373559384 wait complete. 2023-12-24T20:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.266+0000 7f465a9c5700 1 Processor -- start 2023-12-24T20:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.266+0000 7f465a9c5700 1 -- start start 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f465413dea0 0x7f465413d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 0x7f46540b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540aa1c0 con 0x7f463c0037b0 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540b0b30 con 0x7f46540b0180 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540a70c0 con 0x7f465413dea0 2023-12-24T20:10:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44532/0 (socket says 172.21.15.50:44532) 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 -- 172.21.15.50:0/895631444 learned_addr learned my addr 172.21.15.50:0/895631444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4658f62700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 0x7f46540b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f46537fe700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f465413dea0 0x7f465413d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 -- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f465413dea0 msgr2=0x7f465413d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f465413dea0 0x7f465413d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 -- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 msgr2=0x7f46540b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 0x7f46540b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 -- 172.21.15.50:0/895631444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540a7550 con 0x7f463c0037b0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4658f62700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 0x7f46540b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f4653fff700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f464400ed20 tx=0x7f46440017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644019070 con 0x7f463c0037b0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400eed0 con 0x7f463c0037b0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46540a63a0 con 0x7f463c0037b0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644006df0 con 0x7f463c0037b0 2023-12-24T20:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.270+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46540a67d0 con 0x7f463c0037b0 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 117) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f464400cd20 con 0x7f463c0037b0 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540652e0 con 0x7f463c0037b0 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f463bfff700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 0x7f4640062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f464407d120 con 0x7f463c0037b0 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f46537fe700 1 -- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 msgr2=0x7f4640062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.274+0000 7f46537fe700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 0x7f4640062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:36.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.278+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f464404d360 con 0x7f463c0037b0 2023-12-24T20:10:36.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.462+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f46540a8120 con 0x7f463c0037b0 2023-12-24T20:10:36.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.466+0000 7f463bfff700 1 -- 172.21.15.50:0/895631444 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4644050980 con 0x7f463c0037b0 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 msgr2=0x7f4640062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 0x7f4640062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 msgr2=0x7f46540a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f464400ed20 tx=0x7f46440017a0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 shutdown_connections 2023-12-24T20:10:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f46400605a0 0x7f4640062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46540b0180 0x7f46540b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f465413dea0 0x7f465413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 --2- 172.21.15.50:0/895631444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c0037b0 0x7f46540a5d10 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.470+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 >> 172.21.15.50:0/895631444 conn(0x7f4654067b80 msgr2=0x7f46540cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.474+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 shutdown_connections 2023-12-24T20:10:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.474+0000 7f465a9c5700 1 -- 172.21.15.50:0/895631444 wait complete. 2023-12-24T20:10:36.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-12-24T20:10:36.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.670+0000 7f838cdc5700 1 Processor -- start 2023-12-24T20:10:36.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.670+0000 7f838cdc5700 1 -- start start 2023-12-24T20:10:36.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838cdc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8388158e00 0x7f83880b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838cdc5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f838806ae20 0x7f83880b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838cdc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880b3fd0 con 0x7f838806c820 2023-12-24T20:10:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838cdc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880b33c0 con 0x7f8388158e00 2023-12-24T20:10:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838cdc5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880b36a0 con 0x7f838806ae20 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f8385d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f838806c820 0x7f838806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53146/0 (socket says 172.21.15.50:53146) 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8388158e00 0x7f83880b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f8385d9b700 1 -- 172.21.15.50:0/1439684346 learned_addr learned my addr 172.21.15.50:0/1439684346 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f8386d9d700 1 --2- 172.21.15.50:0/1439684346 >> v2:172.21.15.82:3300/0 conn(0x7f838806ae20 0x7f83880b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838559a700 1 -- 172.21.15.50:0/1439684346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954859779 0 0) 0x7f83880b3fd0 con 0x7f838806c820 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838559a700 1 -- 172.21.15.50:0/1439684346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8370003570 con 0x7f838806c820 2023-12-24T20:10:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838659c700 1 -- 172.21.15.50:0/1439684346 >> v2:172.21.15.82:3300/0 conn(0x7f838806ae20 msgr2=0x7f83880b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838659c700 1 --2- 172.21.15.50:0/1439684346 >> v2:172.21.15.82:3300/0 conn(0x7f838806ae20 0x7f83880b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838659c700 1 -- 172.21.15.50:0/1439684346 >> v1:172.21.15.50:6789/0 conn(0x7f838806c820 legacy=0x7f838806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.674+0000 7f838659c700 1 -- 172.21.15.50:0/1439684346 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880b3980 con 0x7f8388158e00 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838659c700 1 --2- 172.21.15.50:0/1439684346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388158e00 0x7f83880b2de0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f83880b6080 tx=0x7f83780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5198d67ecbf25802 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838559a700 1 -- 172.21.15.50:0/1439684346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011630 con 0x7f8388158e00 2023-12-24T20:10:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838559a700 1 -- 172.21.15.50:0/1439684346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780117b0 con 0x7f8388158e00 2023-12-24T20:10:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838559a700 1 -- 172.21.15.50:0/1439684346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011b70 con 0x7f8388158e00 2023-12-24T20:10:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 -- 172.21.15.50:0/1439684346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388158e00 msgr2=0x7f83880b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1439684346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388158e00 0x7f83880b2de0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f83880b6080 tx=0x7f83780091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 -- 172.21.15.50:0/1439684346 shutdown_connections 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1439684346 >> v2:172.21.15.82:3300/0 conn(0x7f838806ae20 0x7f83880b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1439684346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8388158e00 0x7f83880b2de0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 -- 172.21.15.50:0/1439684346 >> 172.21.15.50:0/1439684346 conn(0x7f8388067b80 msgr2=0x7f83880cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 -- 172.21.15.50:0/1439684346 shutdown_connections 2023-12-24T20:10:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.678+0000 7f838cdc5700 1 -- 172.21.15.50:0/1439684346 wait complete. 2023-12-24T20:10:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 Processor -- start 2023-12-24T20:10:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- start start 2023-12-24T20:10:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838806c820 0x7f838814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8388158e00 0x7f838815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838815fa70 con 0x7f838806ae20 2023-12-24T20:10:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838814d1c0 con 0x7f838806c820 2023-12-24T20:10:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838814c5b0 con 0x7f8388158e00 2023-12-24T20:10:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44546/0 (socket says 172.21.15.50:44546) 2023-12-24T20:10:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 -- 172.21.15.50:0/1255942427 learned_addr learned my addr 172.21.15.50:0/1255942427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f8385d9b700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838806c820 0x7f838814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f8386d9d700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8388158e00 0x7f838815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 -- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8388158e00 msgr2=0x7f838815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8388158e00 0x7f838815a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 -- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838806c820 msgr2=0x7f838814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838806c820 0x7f838814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 -- 172.21.15.50:0/1255942427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009420 con 0x7f838806ae20 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838659c700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f8378013000 tx=0x7f8378017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837801f070 con 0x7f838806ae20 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378011920 con 0x7f838806ae20 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378023410 con 0x7f838806ae20 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838814c890 con 0x7f838806ae20 2023-12-24T20:10:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.682+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838814ce50 con 0x7f838806ae20 2023-12-24T20:10:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.686+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83880652e0 con 0x7f838806ae20 2023-12-24T20:10:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.686+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 117) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f837802c3b0 con 0x7f838806ae20 2023-12-24T20:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.690+0000 7f83767fc700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 0x7f8368062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.690+0000 7f8385d9b700 1 -- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 msgr2=0x7f8368062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.690+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f837807de90 con 0x7f838806ae20 2023-12-24T20:10:36.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.690+0000 7f8385d9b700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 0x7f8368062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:36.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.694+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f837804e110 con 0x7f838806ae20 2023-12-24T20:10:36.782 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:36.778+0000 7f896c549000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:36.833 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:36.830+0000 7f97731ce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:36.851 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:36.846+0000 7f896c549000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:36.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.870+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f838815bc20 con 0x7f838806ae20 2023-12-24T20:10:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.878+0000 7f83767fc700 1 -- 172.21.15.50:0/1255942427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f83780150c0 con 0x7f838806ae20 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 msgr2=0x7f8368062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 0x7f8368062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 msgr2=0x7f83881484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f8378013000 tx=0x7f8378017000 comp rx=0 tx=0).stop 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 shutdown_connections 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f83680605a0 0x7f8368062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8388158e00 0x7f838815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838806c820 0x7f838814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 --2- 172.21.15.50:0/1255942427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f838806ae20 0x7f83881484e0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 >> 172.21.15.50:0/1255942427 conn(0x7f8388067b80 msgr2=0x7f838815c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 shutdown_connections 2023-12-24T20:10:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:36.882+0000 7f838cdc5700 1 -- 172.21.15.50:0/1255942427 wait complete. 2023-12-24T20:10:36.908 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:36.906+0000 7f97731ce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:36.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:36.910 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-12-24T20:10:36.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-12-24T20:10:36.987 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:36.982+0000 7f896c549000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:37.061 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.058+0000 7f97731ce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 Processor -- start 2023-12-24T20:10:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 -- start start 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27b8155510 0x7f27b806b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b806d2f0 con 0x7f27b80adee0 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b806bbc0 con 0x7f27b8155510 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bd6e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b806c9c0 con 0x7f27b806adb0 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27b7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27b8155510 0x7f27b806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27b7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27b8155510 0x7f27b806b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44562/0 (socket says 172.21.15.50:44562) 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27b7fff700 1 -- 172.21.15.50:0/3981832560 learned_addr learned my addr 172.21.15.50:0/3981832560 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27b77fe700 1 --1- 172.21.15.50:0/3981832560 >> v1:172.21.15.50:6789/0 conn(0x7f27b80adee0 0x7f27b806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53150/0 (socket says 172.21.15.50:53150) 2023-12-24T20:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.166+0000 7f27bcee2700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b7fff700 1 -- 172.21.15.50:0/3981832560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 msgr2=0x7f27b8159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b7fff700 1 -- 172.21.15.50:0/3981832560 >> v1:172.21.15.50:6789/0 conn(0x7f27b80adee0 legacy=0x7f27b806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b7fff700 1 -- 172.21.15.50:0/3981832560 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b806cca0 con 0x7f27b8155510 2023-12-24T20:10:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b806b370 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f27a800ab50 tx=0x7f27a800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b21ef081555d45 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b6ffd700 1 -- 172.21.15.50:0/3981832560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800ca00 con 0x7f27b8155510 2023-12-24T20:10:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b6ffd700 1 -- 172.21.15.50:0/3981832560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800cb60 con 0x7f27b8155510 2023-12-24T20:10:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27b6ffd700 1 -- 172.21.15.50:0/3981832560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800f470 con 0x7f27b8155510 2023-12-24T20:10:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3981832560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 msgr2=0x7f27b806b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b806b370 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f27a800ab50 tx=0x7f27a800a3f0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3981832560 shutdown_connections 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3981832560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b806b370 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3981832560 >> 172.21.15.50:0/3981832560 conn(0x7f27b8067b40 msgr2=0x7f27b80cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3981832560 shutdown_connections 2023-12-24T20:10:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.170+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3981832560 wait complete. 2023-12-24T20:10:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.174+0000 7f27bd6e3700 1 Processor -- start 2023-12-24T20:10:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.174+0000 7f27bd6e3700 1 -- start start 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 0x7f27b816ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b815aae0 con 0x7f27b8155510 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8154450 con 0x7f27b80adee0 2023-12-24T20:10:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8154730 con 0x7f27b806adb0 2023-12-24T20:10:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44576/0 (socket says 172.21.15.50:44576) 2023-12-24T20:10:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 -- 172.21.15.50:0/3083397168 learned_addr learned my addr 172.21.15.50:0/3083397168 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27b77fe700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 0x7f27b816ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 msgr2=0x7f27b8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 msgr2=0x7f27b816ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 0x7f27b816ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a800a690 con 0x7f27b8155510 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27b77fe700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 0x7f27b816ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bcee2700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f27b0007f20 tx=0x7f27b00098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000eb90 con 0x7f27b8155510 2023-12-24T20:10:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b000ed10 con 0x7f27b8155510 2023-12-24T20:10:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0014670 con 0x7f27b8155510 2023-12-24T20:10:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b8154a10 con 0x7f27b8155510 2023-12-24T20:10:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.178+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b8151d00 con 0x7f27b8155510 2023-12-24T20:10:37.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.182+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b806aab0 con 0x7f27b8155510 2023-12-24T20:10:37.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.182+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 117) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f27b0014a60 con 0x7f27b8155510 2023-12-24T20:10:37.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.182+0000 7f279ffff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:37.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.186+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f27b007d1e0 con 0x7f27b8155510 2023-12-24T20:10:37.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.186+0000 7f27b7fff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:37.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.186+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.190+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27b806aab0 con 0x7f27b8155510 2023-12-24T20:10:37.242 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:37.238+0000 7f896c549000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:37.313 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:37.306+0000 7f896c549000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:37.357 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.354+0000 7f97731ce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.386+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f27b815ac20 con 0x7f27a40605a0 2023-12-24T20:10:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.390+0000 7f27b7fff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.390+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:37.439 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.438+0000 7f97731ce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:37.524 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:37.518+0000 7f896c549000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:37.603 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:37.598+0000 7f896c549000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:37.673 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.670+0000 7f97731ce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:37.682 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:37.678+0000 7f896c549000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:37.761 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.758+0000 7f97731ce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.794+0000 7f27b7fff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:37.794+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-24T20:10:37.854 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:37.850+0000 7f97731ce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:38.058 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:38.054+0000 7f896c549000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:38.244 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:38.238+0000 7f896c549000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:38.281 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:38.278+0000 7f97731ce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:38.457 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:38.454+0000 7f97731ce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:38.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:38.598+0000 7f27b7fff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:38.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:38.598+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-24T20:10:38.621 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:38.614+0000 7f896c549000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:38.847 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:38.846+0000 7f97731ce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:38.849 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:38.842+0000 7f896c549000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:38.948 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:38.942+0000 7f896c549000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:39.028 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.022+0000 7f896c549000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:39.079 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.074+0000 7f97731ce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:39.118 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.114+0000 7f896c549000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:39.169 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.166+0000 7f97731ce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:39.251 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.250+0000 7f97731ce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:39.329 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.326+0000 7f97731ce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:39.352 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.346+0000 7f896c549000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:39.440 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.434+0000 7f896c549000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:39.536 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.530+0000 7f896c549000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:39.553 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.550+0000 7f97731ce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:39.636 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.634+0000 7f97731ce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:39.728 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.726+0000 7f97731ce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:39.742 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.738+0000 7f896c549000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:39.837 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:39.830+0000 7f896c549000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:39.925 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:39.922+0000 7f97731ce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:40.015 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.014+0000 7f97731ce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:40.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.202+0000 7f27b7fff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:40.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.202+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-24T20:10:40.570 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:40.566+0000 7f896c549000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.634+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 118) v1 ==== 79978+0+0 (secure 0 0 0) 0x7f27b004d7f0 con 0x7f27b8155510 2023-12-24T20:10:40.761 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.758+0000 7f97731ce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.774+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 119) v1 ==== 79689+0+0 (secure 0 0 0) 0x7f27b0057c30 con 0x7f27b8155510 2023-12-24T20:10:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.774+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a4062a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:40.774+0000 7f279ffff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a4062a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97325d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97325d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97325d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97325d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97325d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97355dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97355dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97355dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.966 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97355dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:40.967 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:40.962+0000 7f97355dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.786+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mon.0 v2:172.21.15.50:3300/0 9 ==== mgrmap(e 120) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f27b004e0c0 con 0x7f27b8155510 2023-12-24T20:10:41.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.786+0000 7f279ffff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a40629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:41.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.786+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f27b815ac20 con 0x7f27a40605a0 2023-12-24T20:10:41.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.790+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a40629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:41.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.794+0000 7f27b7fff700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a40629d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27a800ab50 tx=0x7f27a8019000 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.890+0000 7f279ffff700 1 -- 172.21.15.50:0/3083397168 <== mgr.10572 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f27b815ac20 con 0x7f27a40605a0 2023-12-24T20:10:41.892 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path snap_test_dir1 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 msgr2=0x7f27a40629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a40629d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27a800ab50 tx=0x7f27a8019000 comp rx=0 tx=0).stop 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 msgr2=0x7f27b815b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f27b0007f20 tx=0x7f27b00098a0 comp rx=0 tx=0).stop 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 shutdown_connections 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f27a40605a0 0x7f27a40629d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8155510 0x7f27b815b250 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27b80adee0 0x7f27b816ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 --2- 172.21.15.50:0/3083397168 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b806adb0 0x7f27b8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 >> 172.21.15.50:0/3083397168 conn(0x7f27b8067b40 msgr2=0x7f27b806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 shutdown_connections 2023-12-24T20:10:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:41.894+0000 7f27bd6e3700 1 -- 172.21.15.50:0/3083397168 wait complete. 2023-12-24T20:10:41.920 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-12-24T20:10:41.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-12-24T20:10:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.098+0000 7fc5b54f0700 1 Processor -- start 2023-12-24T20:10:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.098+0000 7fc5b54f0700 1 -- start start 2023-12-24T20:10:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5b54f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5b0158fa0 0x7fc5b00a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5b54f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b006c820 0x7fc5b006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5b54f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00afa20 con 0x7fc5b006e040 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5b54f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b006d1a0 con 0x7fc5b0158fa0 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5b54f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b006bfe0 con 0x7fc5b006c820 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5aeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5b0158fa0 0x7fc5b00a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5ae7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc5b006e040 0x7fc5b006b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45508/0 (socket says 172.21.15.50:45508) 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5ae7fc700 1 -- 172.21.15.50:0/1500693613 learned_addr learned my addr 172.21.15.50:0/1500693613 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.102+0000 7fc5af7fe700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b006c820 0x7fc5b006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5aeffd700 1 -- 172.21.15.50:0/1500693613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b006c820 msgr2=0x7fc5b006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b006c820 0x7fc5b006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5aeffd700 1 -- 172.21.15.50:0/1500693613 >> v1:172.21.15.50:6789/0 conn(0x7fc5b006e040 legacy=0x7fc5b006b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5aeffd700 1 -- 172.21.15.50:0/1500693613 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00af130 con 0x7fc5b0158fa0 2023-12-24T20:10:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5adffb700 1 -- 172.21.15.50:0/1500693613 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984252332 0 0) 0x7fc5b00afa20 con 0x7fc5b006e040 2023-12-24T20:10:42.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b0158fa0 0x7fc5b00a88d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00098d0 tx=0x7fc5a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd416d2cefcb0973 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5adffb700 1 -- 172.21.15.50:0/1500693613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000b640 con 0x7fc5b0158fa0 2023-12-24T20:10:42.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5adffb700 1 -- 172.21.15.50:0/1500693613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000b7a0 con 0x7fc5b0158fa0 2023-12-24T20:10:42.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5adffb700 1 -- 172.21.15.50:0/1500693613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000bb60 con 0x7fc5b0158fa0 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 -- 172.21.15.50:0/1500693613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b0158fa0 msgr2=0x7fc5b00a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b0158fa0 0x7fc5b00a88d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00098d0 tx=0x7fc5a00091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 -- 172.21.15.50:0/1500693613 shutdown_connections 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b006c820 0x7fc5b006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/1500693613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b0158fa0 0x7fc5b00a88d0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 -- 172.21.15.50:0/1500693613 >> 172.21.15.50:0/1500693613 conn(0x7fc5b0068580 msgr2=0x7fc5b00add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 -- 172.21.15.50:0/1500693613 shutdown_connections 2023-12-24T20:10:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.106+0000 7fc5b54f0700 1 -- 172.21.15.50:0/1500693613 wait complete. 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 Processor -- start 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 -- start start 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b006e040 0x7fc5b00c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b0158fa0 0x7fc5b00aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00c9e70 con 0x7fc5b006c820 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b014c3f0 con 0x7fc5b006e040 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5b54f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00c9740 con 0x7fc5b0158fa0 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 -- 172.21.15.50:0/357439228 learned_addr learned my addr 172.21.15.50:0/357439228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5af7fe700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b0158fa0 0x7fc5b00aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5ae7fc700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b006e040 0x7fc5b00c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 -- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b0158fa0 msgr2=0x7fc5b00aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b0158fa0 0x7fc5b00aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 -- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b006e040 msgr2=0x7fc5b00c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b006e040 0x7fc5b00c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.110+0000 7fc5aeffd700 1 -- 172.21.15.50:0/357439228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00093c0 con 0x7fc5b006c820 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000b680 tx=0x7fc5a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a001f070 con 0x7fc5b006c820 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000bb20 con 0x7fc5b006c820 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b00c1070 con 0x7fc5b006c820 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0011670 con 0x7fc5b006c820 2023-12-24T20:10:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b00c1630 con 0x7fc5b006c820 2023-12-24T20:10:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00c9c40 con 0x7fc5b006c820 2023-12-24T20:10:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.114+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 120) v1 ==== 79816+0+0 (secure 0 0 0) 0x7fc5a00119e0 con 0x7fc5b006c820 2023-12-24T20:10:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.118+0000 7fc596ffd700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 0x7fc59c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.118+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7fc5a007dd40 con 0x7fc5b006c820 2023-12-24T20:10:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.118+0000 7fc5ae7fc700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 0x7fc59c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.118+0000 7fc5ae7fc700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 0x7fc59c0628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0071080 tx=0x7fc5a4007d30 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.126+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc5b00c9c40 con 0x7fc5b006c820 2023-12-24T20:10:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.326+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b00c9c40 con 0x7fc59c0603f0 2023-12-24T20:10:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.426+0000 7fc596ffd700 1 -- 172.21.15.50:0/357439228 <== mgr.10572 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fc5b00c9c40 con 0x7fc59c0603f0 2023-12-24T20:10:42.427 INFO:teuthology.orchestra.run.smithi050.stdout:Retention added to path snap_test_dir1 2023-12-24T20:10:42.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.426+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 msgr2=0x7fc59c0628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.426+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 0x7fc59c0628a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0071080 tx=0x7fc5a4007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:42.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.426+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 msgr2=0x7fc5b014beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000b680 tx=0x7fc5a0017000 comp rx=0 tx=0).stop 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 shutdown_connections 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc59c0603f0 0x7fc59c0628a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b0158fa0 0x7fc5b00aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b006e040 0x7fc5b00c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 --2- 172.21.15.50:0/357439228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b006c820 0x7fc5b014beb0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 >> 172.21.15.50:0/357439228 conn(0x7fc5b0068580 msgr2=0x7fc5b0158010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 shutdown_connections 2023-12-24T20:10:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.430+0000 7fc5b54f0700 1 -- 172.21.15.50:0/357439228 wait complete. 2023-12-24T20:10:42.455 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-12-24T20:10:42.455 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-12-24-20_11_00 in ~18s... 2023-12-24T20:10:42.455 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-12-24T20:10:42.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-12-24T20:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.634+0000 7f106b345700 1 Processor -- start 2023-12-24T20:10:42.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.634+0000 7f106b345700 1 -- start start 2023-12-24T20:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1064156b50 0x7f106415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 0x7f10640b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10640b4060 0x7f106415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106406d4d0 con 0x7f1064156b50 2023-12-24T20:10:42.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640b4960 con 0x7f106406db90 2023-12-24T20:10:42.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f106b345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640b44c0 con 0x7f10640b4060 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1064156b50 0x7f106415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1064156b50 0x7f106415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55798/0 (socket says 172.21.15.50:55798) 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 -- 172.21.15.50:0/3740871118 learned_addr learned my addr 172.21.15.50:0/3740871118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10688e0700 1 --2- 172.21.15.50:0/3740871118 >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 0x7f10640b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10698e2700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10640b4060 0x7f106415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 -- 172.21.15.50:0/3740871118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10640b4060 msgr2=0x7f106415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:42.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10640b4060 0x7f106415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 -- 172.21.15.50:0/3740871118 >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 msgr2=0x7f10640b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:42.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 --2- 172.21.15.50:0/3740871118 >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 0x7f10640b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 -- 172.21.15.50:0/3740871118 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106415a620 con 0x7f1064156b50 2023-12-24T20:10:42.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10688e0700 1 --2- 172.21.15.50:0/3740871118 >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 0x7f10640b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f10690e1700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064156b50 0x7f106415a0e0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f106406a140 tx=0x7f1060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e636bb0c0d8cf3bf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f105bfff700 1 -- 172.21.15.50:0/3740871118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000b640 con 0x7f1064156b50 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f105bfff700 1 -- 172.21.15.50:0/3740871118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000b7a0 con 0x7f1064156b50 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.638+0000 7f105bfff700 1 -- 172.21.15.50:0/3740871118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000bb60 con 0x7f1064156b50 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 -- 172.21.15.50:0/3740871118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064156b50 msgr2=0x7f106415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064156b50 0x7f106415a0e0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f106406a140 tx=0x7f1060009250 comp rx=0 tx=0).stop 2023-12-24T20:10:42.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 -- 172.21.15.50:0/3740871118 shutdown_connections 2023-12-24T20:10:42.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 --2- 172.21.15.50:0/3740871118 >> v2:172.21.15.82:3300/0 conn(0x7f106406db90 0x7f10640b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10640b4060 0x7f106415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 --2- 172.21.15.50:0/3740871118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064156b50 0x7f106415a0e0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 -- 172.21.15.50:0/3740871118 >> 172.21.15.50:0/3740871118 conn(0x7f1064067b40 msgr2=0x7f10640b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 -- 172.21.15.50:0/3740871118 shutdown_connections 2023-12-24T20:10:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.642+0000 7f106b345700 1 -- 172.21.15.50:0/3740871118 wait complete. 2023-12-24T20:10:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 Processor -- start 2023-12-24T20:10:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 -- start start 2023-12-24T20:10:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10640b4060 0x7f10640a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1064156b50 0x7f10640ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064158b70 con 0x7f106406db90 2023-12-24T20:10:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064158240 con 0x7f10640b4060 2023-12-24T20:10:42.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f106b345700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1064158520 con 0x7f1064156b50 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f10690e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f10690e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55800/0 (socket says 172.21.15.50:55800) 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f10690e1700 1 -- 172.21.15.50:0/2875953696 learned_addr learned my addr 172.21.15.50:0/2875953696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f10698e2700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1064156b50 0x7f10640ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.646+0000 7f10688e0700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10640b4060 0x7f10640a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 -- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1064156b50 msgr2=0x7f10640ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1064156b50 0x7f10640ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 -- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10640b4060 msgr2=0x7f10640a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10640b4060 0x7f10640a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 -- 172.21.15.50:0/2875953696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009420 con 0x7f106406db90 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10690e1700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1064068030 tx=0x7f1060017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000b910 con 0x7f106406db90 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000ba70 con 0x7f106406db90 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600094f0 con 0x7f106406db90 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011630 con 0x7f106406db90 2023-12-24T20:10:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10640a9d00 con 0x7f106406db90 2023-12-24T20:10:42.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.650+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106415c080 con 0x7f106406db90 2023-12-24T20:10:42.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.654+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 120) v1 ==== 79816+0+0 (secure 0 0 0) 0x7f10600119a0 con 0x7f106406db90 2023-12-24T20:10:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.654+0000 7f10597fa700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 0x7f10480628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.654+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f106007df40 con 0x7f106406db90 2023-12-24T20:10:42.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.654+0000 7f10688e0700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 0x7f10480628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.658+0000 7f10688e0700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 0x7f10480628a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10640af650 tx=0x7f10540091a0 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.662+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f106415c080 con 0x7f106406db90 2023-12-24T20:10:42.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.798+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 121) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f106004e7a0 con 0x7f106406db90 2023-12-24T20:10:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.854+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1064158cb0 con 0x7f10480603f0 2023-12-24T20:10:42.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.870+0000 7f10597fa700 1 -- 172.21.15.50:0/2875953696 <== mgr.10572 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f105401a030 con 0x7f10480603f0 2023-12-24T20:10:42.871 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:42.871 INFO:teuthology.orchestra.run.smithi050.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-12-24T20:10:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.870+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 msgr2=0x7f10480628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.870+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 0x7f10480628a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10640af650 tx=0x7f10540091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.870+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 msgr2=0x7f1064153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.870+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1064068030 tx=0x7f1060017000 comp rx=0 tx=0).stop 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 shutdown_connections 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f10480603f0 0x7f10480628a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1064156b50 0x7f10640ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10640b4060 0x7f10640a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 --2- 172.21.15.50:0/2875953696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106406db90 0x7f1064153f30 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 >> 172.21.15.50:0/2875953696 conn(0x7f1064067b40 msgr2=0x7f10641553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 shutdown_connections 2023-12-24T20:10:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:42.874+0000 7f106b345700 1 -- 172.21.15.50:0/2875953696 wait complete. 2023-12-24T20:10:42.897 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-12-24T20:10:42.897 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-12-24T20:10:42.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-12-24T20:10:43.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.070+0000 7f72c9078700 1 Processor -- start 2023-12-24T20:10:43.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.070+0000 7f72c9078700 1 -- start start 2023-12-24T20:10:43.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.074+0000 7f72c9078700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 0x7f72c415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.074+0000 7f72c9078700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c406d4d0 con 0x7f72c40b4230 2023-12-24T20:10:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.074+0000 7f72c9078700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40b4960 con 0x7f72c406db90 2023-12-24T20:10:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c9078700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c415a620 con 0x7f72c4156b50 2023-12-24T20:10:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c359e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72c40b4230 0x7f72c406a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45516/0 (socket says 172.21.15.50:45516) 2023-12-24T20:10:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c359e700 1 -- 172.21.15.50:0/4117117313 learned_addr learned my addr 172.21.15.50:0/4117117313 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c2d9d700 1 --2- 172.21.15.50:0/4117117313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 0x7f72c415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287265038 0 0) 0x7f72c406d4d0 con 0x7f72c40b4230 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003570 con 0x7f72c40b4230 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066124199 0 0) 0x7f72b8001110 con 0x7f72c406db90 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c406d4d0 con 0x7f72c406db90 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c2d9d700 1 -- 172.21.15.50:0/4117117313 >> v1:172.21.15.82:6789/0 conn(0x7f72c406db90 legacy=0x7f72c40b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c2d9d700 1 -- 172.21.15.50:0/4117117313 >> v1:172.21.15.50:6789/0 conn(0x7f72c40b4230 legacy=0x7f72c406a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c2d9d700 1 -- 172.21.15.50:0/4117117313 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c406c8c0 con 0x7f72c4156b50 2023-12-24T20:10:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c2d9d700 1 --2- 172.21.15.50:0/4117117313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 0x7f72c415a0e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009910 tx=0x7f72b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72d3ca6b11cf01f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4011630 con 0x7f72c4156b50 2023-12-24T20:10:43.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4011790 con 0x7f72c4156b50 2023-12-24T20:10:43.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c1d9b700 1 -- 172.21.15.50:0/4117117313 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4011b30 con 0x7f72c4156b50 2023-12-24T20:10:43.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c9078700 1 -- 172.21.15.50:0/4117117313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 msgr2=0x7f72c415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.078+0000 7f72c9078700 1 --2- 172.21.15.50:0/4117117313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 0x7f72c415a0e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009910 tx=0x7f72b40091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 -- 172.21.15.50:0/4117117313 shutdown_connections 2023-12-24T20:10:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 --2- 172.21.15.50:0/4117117313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c4156b50 0x7f72c415a0e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 -- 172.21.15.50:0/4117117313 >> 172.21.15.50:0/4117117313 conn(0x7f72c4067b40 msgr2=0x7f72c40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 -- 172.21.15.50:0/4117117313 shutdown_connections 2023-12-24T20:10:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 -- 172.21.15.50:0/4117117313 wait complete. 2023-12-24T20:10:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 Processor -- start 2023-12-24T20:10:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.082+0000 7f72c9078700 1 -- start start 2023-12-24T20:10:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c406db90 0x7f72c416a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c40b4230 0x7f72c40d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4150ab0 con 0x7f72c4156b50 2023-12-24T20:10:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c416ade0 con 0x7f72c406db90 2023-12-24T20:10:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c414fea0 con 0x7f72c40b4230 2023-12-24T20:10:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55814/0 (socket says 172.21.15.50:55814) 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 -- 172.21.15.50:0/720622409 learned_addr learned my addr 172.21.15.50:0/720622409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c259c700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c40b4230 0x7f72c40d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c2d9d700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c406db90 0x7f72c416a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 -- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c40b4230 msgr2=0x7f72c40d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c40b4230 0x7f72c40d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 -- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c406db90 msgr2=0x7f72c416a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c406db90 0x7f72c416a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 -- 172.21.15.50:0/720622409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009420 con 0x7f72c4156b50 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c359e700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001460 tx=0x7f72bc001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00a870 con 0x7f72c4156b50 2023-12-24T20:10:43.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00a9d0 con 0x7f72c4156b50 2023-12-24T20:10:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4150180 con 0x7f72c4156b50 2023-12-24T20:10:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00ad70 con 0x7f72c4156b50 2023-12-24T20:10:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.086+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4150740 con 0x7f72c4156b50 2023-12-24T20:10:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.090+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4150c20 con 0x7f72c4156b50 2023-12-24T20:10:43.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.090+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 121) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f72bc007300 con 0x7f72c4156b50 2023-12-24T20:10:43.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.094+0000 7f72aaffd700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 0x7f72b0062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.094+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f72bc07d2a0 con 0x7f72c4156b50 2023-12-24T20:10:43.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.094+0000 7f72c2d9d700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 0x7f72b0062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.094+0000 7f72c2d9d700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 0x7f72b0062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72b40091e0 tx=0x7f72b4017000 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.098+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72bc04d1e0 con 0x7f72c4156b50 2023-12-24T20:10:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.294+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c4071060 con 0x7f72b0060750 2023-12-24T20:10:43.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.394+0000 7f72aaffd700 1 -- 172.21.15.50:0/720622409 <== mgr.10572 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f72c4071060 con 0x7f72b0060750 2023-12-24T20:10:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule removed for path snap_test_dir1 2023-12-24T20:10:43.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.398+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 msgr2=0x7f72b0062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.398+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 0x7f72b0062c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72b40091e0 tx=0x7f72b4017000 comp rx=0 tx=0).stop 2023-12-24T20:10:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.398+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 msgr2=0x7f72c4151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.398+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001460 tx=0x7f72bc001a60 comp rx=0 tx=0).stop 2023-12-24T20:10:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 shutdown_connections 2023-12-24T20:10:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f72b0060750 0x7f72b0062c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4156b50 0x7f72c4151d50 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f72c40b4230 0x7f72c40d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 --2- 172.21.15.50:0/720622409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c406db90 0x7f72c416a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 >> 172.21.15.50:0/720622409 conn(0x7f72c4067b40 msgr2=0x7f72c40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 shutdown_connections 2023-12-24T20:10:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.402+0000 7f72c9078700 1 -- 172.21.15.50:0/720622409 wait complete. 2023-12-24T20:10:43.428 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-12-24T20:10:43.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:43.428 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-12-24T20:10:43.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:43.451 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-12-24T20:10:43.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-12-24T20:10:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.734+0000 7f0ae2e6e700 1 Processor -- start 2023-12-24T20:10:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.734+0000 7f0ae2e6e700 1 -- start start 2023-12-24T20:10:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.738+0000 7f0ae2e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 0x7f0adc15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.738+0000 7f0ae2e6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0adc15d1a0 0x7f0adc15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.738+0000 7f0ae2e6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0aec60 con 0x7f0adc0c86b0 2023-12-24T20:10:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.738+0000 7f0ae2e6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc15d5f0 con 0x7f0adc15d1a0 2023-12-24T20:10:43.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.738+0000 7f0ae2e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0b0d00 con 0x7f0adc0adbc0 2023-12-24T20:10:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0ae0c0a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0adc0c86b0 0x7f0adc0b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45526/0 (socket says 172.21.15.50:45526) 2023-12-24T20:10:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0ae0c0a700 1 -- 172.21.15.50:0/1651258188 learned_addr learned my addr 172.21.15.50:0/1651258188 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1651258188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 0x7f0adc15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0ae140b700 1 --2- 172.21.15.50:0/1651258188 >> v2:172.21.15.82:3300/0 conn(0x7f0adc15d1a0 0x7f0adc15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adb7fe700 1 -- 172.21.15.50:0/1651258188 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150194784 0 0) 0x7f0adc0aec60 con 0x7f0adc0c86b0 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adb7fe700 1 -- 172.21.15.50:0/1651258188 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc003570 con 0x7f0adc0c86b0 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 -- 172.21.15.50:0/1651258188 >> v2:172.21.15.82:3300/0 conn(0x7f0adc15d1a0 msgr2=0x7f0adc15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1651258188 >> v2:172.21.15.82:3300/0 conn(0x7f0adc15d1a0 0x7f0adc15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 -- 172.21.15.50:0/1651258188 >> v1:172.21.15.50:6789/0 conn(0x7f0adc0c86b0 legacy=0x7f0adc0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 -- 172.21.15.50:0/1651258188 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0ae050 con 0x7f0adc0adbc0 2023-12-24T20:10:43.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1651258188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 0x7f0adc15cc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80098e0 tx=0x7f0ac80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106d4f3a2f23e744 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adb7fe700 1 -- 172.21.15.50:0/1651258188 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8011630 con 0x7f0adc0adbc0 2023-12-24T20:10:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adb7fe700 1 -- 172.21.15.50:0/1651258188 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8011790 con 0x7f0adc0adbc0 2023-12-24T20:10:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.742+0000 7f0adb7fe700 1 -- 172.21.15.50:0/1651258188 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8011b30 con 0x7f0adc0adbc0 2023-12-24T20:10:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1651258188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 msgr2=0x7f0adc15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1651258188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 0x7f0adc15cc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80098e0 tx=0x7f0ac80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1651258188 shutdown_connections 2023-12-24T20:10:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1651258188 >> v2:172.21.15.82:3300/0 conn(0x7f0adc15d1a0 0x7f0adc15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1651258188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc0adbc0 0x7f0adc15cc60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1651258188 >> 172.21.15.50:0/1651258188 conn(0x7f0adc06c820 msgr2=0x7f0adc06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1651258188 shutdown_connections 2023-12-24T20:10:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1651258188 wait complete. 2023-12-24T20:10:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 Processor -- start 2023-12-24T20:10:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.746+0000 7f0ae2e6e700 1 -- start start 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0adc0adbc0 0x7f0adc1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc15d1a0 0x7f0adc0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc14ab70 con 0x7f0adc0c86b0 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc149f60 con 0x7f0adc0adbc0 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc14a240 con 0x7f0adc15d1a0 2023-12-24T20:10:43.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55830/0 (socket says 172.21.15.50:55830) 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 -- 172.21.15.50:0/1272281500 learned_addr learned my addr 172.21.15.50:0/1272281500 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae0c0a700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0adc0adbc0 0x7f0adc1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae140b700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc15d1a0 0x7f0adc0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 -- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc15d1a0 msgr2=0x7f0adc0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc15d1a0 0x7f0adc0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 -- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0adc0adbc0 msgr2=0x7f0adc1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0adc0adbc0 0x7f0adc1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:43.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 -- 172.21.15.50:0/1272281500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8009420 con 0x7f0adc0c86b0 2023-12-24T20:10:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0adbfff700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0b0e40 tx=0x7f0ac8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8000d10 con 0x7f0adc0c86b0 2023-12-24T20:10:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8011b10 con 0x7f0adc0c86b0 2023-12-24T20:10:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc14a520 con 0x7f0adc0c86b0 2023-12-24T20:10:43.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8025660 con 0x7f0adc0c86b0 2023-12-24T20:10:43.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.750+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc149820 con 0x7f0adc0c86b0 2023-12-24T20:10:43.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.754+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc14ace0 con 0x7f0adc0c86b0 2023-12-24T20:10:43.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.754+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 121) v1 ==== 80137+0+0 (secure 0 0 0) 0x7f0ac8025a50 con 0x7f0adc0c86b0 2023-12-24T20:10:43.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.754+0000 7f0ad8ff9700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 0x7f0ac0062c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:43.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.754+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f0ac807e7b0 con 0x7f0adc0c86b0 2023-12-24T20:10:43.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.758+0000 7f0ae0c0a700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 0x7f0ac0062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:43.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.758+0000 7f0ae0c0a700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 0x7f0ac0062c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007fd0 tx=0x7f0ad0009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.762+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ac804e670 con 0x7f0adc0c86b0 2023-12-24T20:10:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:43.974+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0adc0652e0 con 0x7f0adc0c86b0 2023-12-24T20:10:44.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.818+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f0ac804ea40 con 0x7f0adc0c86b0 2023-12-24T20:10:44.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.818+0000 7f0ad8ff9700 1 -- 172.21.15.50:0/1272281500 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v122) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0ac802e3f0 con 0x7f0adc0c86b0 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 msgr2=0x7f0ac0062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 0x7f0ac0062c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007fd0 tx=0x7f0ad0009040 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 msgr2=0x7f0adc152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0b0e40 tx=0x7f0ac8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 shutdown_connections 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ac0060750 0x7f0ac0062c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0adc15d1a0 0x7f0adc0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0adc0c86b0 0x7f0adc152120 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 --2- 172.21.15.50:0/1272281500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0adc0adbc0 0x7f0adc1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:44.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 >> 172.21.15.50:0/1272281500 conn(0x7f0adc06c820 msgr2=0x7f0adc0af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:44.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 shutdown_connections 2023-12-24T20:10:44.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:44.822+0000 7f0ae2e6e700 1 -- 172.21.15.50:0/1272281500 wait complete. 2023-12-24T20:10:44.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:10:44.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:44.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:10:44.922 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:10:44.923 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-24T20:10:44.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:10:44.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-24T20:10:44.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:10:44.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:44.983 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:10:45.001 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:44.994+0000 7f1ac4584000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:45.032 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:45.030+0000 7f6bbe1b1000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T20:10:45.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:45.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.250+0000 7f6717416700 1 Processor -- start 2023-12-24T20:10:45.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.250+0000 7f6717416700 1 -- start start 2023-12-24T20:10:45.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6717416700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6710158e00 0x7f67101591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6717416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f67100b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6717416700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671006b640 con 0x7f671006a580 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6717416700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6710159710 con 0x7f6710158e00 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6717416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b5e10 con 0x7f671006d8c0 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716c15700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f671006a580 0x7f671006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45534/0 (socket says 172.21.15.50:45534) 2023-12-24T20:10:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716c15700 1 -- 172.21.15.50:0/2745793963 learned_addr learned my addr 172.21.15.50:0/2745793963 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 --2- 172.21.15.50:0/2745793963 >> v2:172.21.15.82:3300/0 conn(0x7f6710158e00 0x7f67101591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6715c13700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f67100b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6715412700 1 -- 172.21.15.50:0/2745793963 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684556732 0 0) 0x7f671006b640 con 0x7f671006a580 2023-12-24T20:10:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6715412700 1 -- 172.21.15.50:0/2745793963 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66fc003570 con 0x7f671006a580 2023-12-24T20:10:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 -- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 msgr2=0x7f67100b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f67100b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 -- 172.21.15.50:0/2745793963 >> v1:172.21.15.50:6789/0 conn(0x7f671006a580 legacy=0x7f671006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 -- 172.21.15.50:0/2745793963 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671006b8e0 con 0x7f6710158e00 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6715c13700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f67100b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.254+0000 7f6716414700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6710158e00 0x7f67101591d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098e0 tx=0x7f670c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ec1b745e4ce44a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6715412700 1 -- 172.21.15.50:0/2745793963 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00b640 con 0x7f6710158e00 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6715412700 1 -- 172.21.15.50:0/2745793963 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00b7a0 con 0x7f6710158e00 2023-12-24T20:10:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6715412700 1 -- 172.21.15.50:0/2745793963 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00bb40 con 0x7f6710158e00 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6710158e00 msgr2=0x7f67101591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6710158e00 0x7f67101591d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098e0 tx=0x7f670c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- 172.21.15.50:0/2745793963 shutdown_connections 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f67100b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 --2- 172.21.15.50:0/2745793963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6710158e00 0x7f67101591d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- 172.21.15.50:0/2745793963 >> 172.21.15.50:0/2745793963 conn(0x7f6710067b80 msgr2=0x7f67100b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:45.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- 172.21.15.50:0/2745793963 shutdown_connections 2023-12-24T20:10:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- 172.21.15.50:0/2745793963 wait complete. 2023-12-24T20:10:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 Processor -- start 2023-12-24T20:10:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.258+0000 7f6717416700 1 -- start start 2023-12-24T20:10:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f6710147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6710158e00 0x7f671015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b1390 con 0x7f6710158e00 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100ac4b0 con 0x7f671006a580 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100acd50 con 0x7f671006d8c0 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6710158e00 0x7f671015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48654/0 (socket says 172.21.15.50:48654) 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 -- 172.21.15.50:0/1727768469 learned_addr learned my addr 172.21.15.50:0/1727768469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6715c13700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f6710147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 msgr2=0x7f6710147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f6710147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6710158e00 msgr2=0x7f671015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6710158e00 0x7f671015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 -- 172.21.15.50:0/1727768469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009420 con 0x7f671006a580 2023-12-24T20:10:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6716414700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f671006e730 tx=0x7f670c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c01bb70 con 0x7f671006a580 2023-12-24T20:10:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c01bcd0 con 0x7f671006a580 2023-12-24T20:10:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710169210 con 0x7f671006a580 2023-12-24T20:10:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c011670 con 0x7f671006a580 2023-12-24T20:10:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.262+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100b15c0 con 0x7f671006a580 2023-12-24T20:10:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100ae340 con 0x7f671006a580 2023-12-24T20:10:45.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f670c011a20 con 0x7f671006a580 2023-12-24T20:10:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f67067fc700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 0x7f66f4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f670c07e150 con 0x7f671006a580 2023-12-24T20:10:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f6715c13700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 msgr2=0x7f66f4062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.266+0000 7f6715c13700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 0x7f66f4062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.278+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f670c04e0b0 con 0x7f671006a580 2023-12-24T20:10:45.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:10:45.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:10:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.470+0000 7f6715c13700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 msgr2=0x7f66f4062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.470+0000 7f6715c13700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 0x7f66f4062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:45.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.498+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f671004be40 con 0x7f671006a580 2023-12-24T20:10:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.498+0000 7f67067fc700 1 -- 172.21.15.50:0/1727768469 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7f670c0516d0 con 0x7f671006a580 2023-12-24T20:10:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:45.502 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 msgr2=0x7f66f4062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 0x7f66f4062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 msgr2=0x7f67100b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f671006e730 tx=0x7f670c017000 comp rx=0 tx=0).stop 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 shutdown_connections 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f66f4060730 0x7f66f4062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6710158e00 0x7f671015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f671006d8c0 0x7f6710147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 --2- 172.21.15.50:0/1727768469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671006a580 0x7f67100b0e50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 >> 172.21.15.50:0/1727768469 conn(0x7f6710067b80 msgr2=0x7f6710156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 shutdown_connections 2023-12-24T20:10:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.502+0000 7f6717416700 1 -- 172.21.15.50:0/1727768469 wait complete. 2023-12-24T20:10:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:45.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:45.563 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:45.558+0000 7f1ac4584000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:45.640 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:45.634+0000 7f1ac4584000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:45.641 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:45.638+0000 7f6bbe1b1000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T20:10:45.722 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:45.718+0000 7f6bbe1b1000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T20:10:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 Processor -- start 2023-12-24T20:10:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 -- start start 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 0x7f25d40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 0x7f25d406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d406c510 con 0x7f25d4158cd0 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40a9c80 con 0x7f25d406afb0 2023-12-24T20:10:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d8a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40a8e10 con 0x7f25d406c0c0 2023-12-24T20:10:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 0x7f25d406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d2ffd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 0x7f25d40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55858/0 (socket says 172.21.15.50:55858) 2023-12-24T20:10:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d37fe700 1 -- 172.21.15.50:0/2605616698 learned_addr learned my addr 172.21.15.50:0/2605616698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.730+0000 7f25d2ffd700 1 -- 172.21.15.50:0/2605616698 >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 msgr2=0x7f25d406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d2ffd700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 0x7f25d406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d2ffd700 1 -- 172.21.15.50:0/2605616698 >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 msgr2=0x7f25d41590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d2ffd700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d2ffd700 1 -- 172.21.15.50:0/2605616698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d406b930 con 0x7f25d406c0c0 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d3fff700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 0x7f25d406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d37fe700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d2ffd700 1 --2- 172.21.15.50:0/2605616698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 0x7f25d40a88d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d41595e0 tx=0x7f25c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953b43b276c84db7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d27fc700 1 -- 172.21.15.50:0/2605616698 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011630 con 0x7f25d406c0c0 2023-12-24T20:10:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d27fc700 1 -- 172.21.15.50:0/2605616698 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80117b0 con 0x7f25d406c0c0 2023-12-24T20:10:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d27fc700 1 -- 172.21.15.50:0/2605616698 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011b70 con 0x7f25d406c0c0 2023-12-24T20:10:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 -- 172.21.15.50:0/2605616698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 msgr2=0x7f25d40a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/2605616698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 0x7f25d40a88d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d41595e0 tx=0x7f25c80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 -- 172.21.15.50:0/2605616698 shutdown_connections 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.82:3300/0 conn(0x7f25d406afb0 0x7f25d406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/2605616698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d406c0c0 0x7f25d40a88d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/2605616698 >> v2:172.21.15.50:3300/0 conn(0x7f25d4158cd0 0x7f25d41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 -- 172.21.15.50:0/2605616698 >> 172.21.15.50:0/2605616698 conn(0x7f25d4067b80 msgr2=0x7f25d40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 -- 172.21.15.50:0/2605616698 shutdown_connections 2023-12-24T20:10:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.734+0000 7f25d8a8e700 1 -- 172.21.15.50:0/2605616698 wait complete. 2023-12-24T20:10:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 Processor -- start 2023-12-24T20:10:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 -- start start 2023-12-24T20:10:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d4158cd0 0x7f25d415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40b0420 con 0x7f25d406c0c0 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40af810 con 0x7f25d406afb0 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d8a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40afaf0 con 0x7f25d4158cd0 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48672/0 (socket says 172.21.15.50:48672) 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55862/0 (socket says 172.21.15.50:55862) 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d37fe700 1 -- 172.21.15.50:0/590490913 learned_addr learned my addr 172.21.15.50:0/590490913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d3fff700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d4158cd0 0x7f25d415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.738+0000 7f25d37fe700 1 -- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d4158cd0 msgr2=0x7f25d415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d37fe700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d4158cd0 0x7f25d415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d37fe700 1 -- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 msgr2=0x7f25d415d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d37fe700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d37fe700 1 -- 172.21.15.50:0/590490913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc009a20 con 0x7f25d406afb0 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d2ffd700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:45.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d37fe700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f25c400ec50 tx=0x7f25c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400c920 con 0x7f25d406afb0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400ca80 con 0x7f25d406afb0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40094f0 con 0x7f25d406afb0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400ce00 con 0x7f25d406afb0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8009420 con 0x7f25d406afb0 2023-12-24T20:10:45.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.742+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d404be40 con 0x7f25d406afb0 2023-12-24T20:10:45.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.746+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f25c4013680 con 0x7f25d406afb0 2023-12-24T20:10:45.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.746+0000 7f25bb7fe700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 0x7f25c0062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:45.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.746+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f25c407d1c0 con 0x7f25d406afb0 2023-12-24T20:10:45.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.746+0000 7f25d2ffd700 1 -- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 msgr2=0x7f25c0062d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:45.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.746+0000 7f25d2ffd700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 0x7f25c0062d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.754+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f25c404d1c0 con 0x7f25d406afb0 2023-12-24T20:10:45.789 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:45.782+0000 7f1ac4584000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:45.880 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:45.878+0000 7f6bbe1b1000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:45.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.930+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25d406a840 con 0x7f25d406afb0 2023-12-24T20:10:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.934+0000 7f25bb7fe700 1 -- 172.21.15.50:0/590490913 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f25c40507e0 con 0x7f25d406afb0 2023-12-24T20:10:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:45.936 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":209,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:40.765492+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:6836/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2591226244":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2616996407":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/3338446156":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/90516501":"2023-12-25T20:10:40.765402+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.934+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 msgr2=0x7f25c0062d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.934+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 0x7f25c0062d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.934+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 msgr2=0x7f25d40b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.934+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f25c400ec50 tx=0x7f25c4009250 comp rx=0 tx=0).stop 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 shutdown_connections 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f25c0060850 0x7f25c0062d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25d4158cd0 0x7f25d415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d406c0c0 0x7f25d415d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 --2- 172.21.15.50:0/590490913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d406afb0 0x7f25d40b11c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:45.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 >> 172.21.15.50:0/590490913 conn(0x7f25d4067b80 msgr2=0x7f25d40cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:45.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 shutdown_connections 2023-12-24T20:10:45.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:45.938+0000 7f25d8a8e700 1 -- 172.21.15.50:0/590490913 wait complete. 2023-12-24T20:10:45.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T18:36:16.819693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:10:19.408426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '207', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:10:20.785864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '208', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:10:45.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:10:46.075 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.070+0000 7f1ac4584000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.134+0000 7f94e04ae700 1 Processor -- start 2023-12-24T20:10:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.134+0000 7f94e04ae700 1 -- start start 2023-12-24T20:10:46.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94e04ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94d806ae20 0x7f94d80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94e04ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80b3fd0 con 0x7f94d8158e00 2023-12-24T20:10:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94e04ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80b33c0 con 0x7f94d806c820 2023-12-24T20:10:46.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94e04ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b36a0 con 0x7f94d806ae20 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94de24a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94d8158e00 0x7f94d806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45544/0 (socket says 172.21.15.50:45544) 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94de24a700 1 -- 172.21.15.50:0/479072519 learned_addr learned my addr 172.21.15.50:0/479072519 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dda49700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94d806ae20 0x7f94d80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930547567 0 0) 0x7f94d80b3fd0 con 0x7f94d8158e00 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c4003570 con 0x7f94d8158e00 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899555250 0 0) 0x7f94d80b33c0 con 0x7f94d806c820 2023-12-24T20:10:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d80b3fd0 con 0x7f94d806c820 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263374510 0 0) 0x7f94c4003570 con 0x7f94d8158e00 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94d806ae20 msgr2=0x7f94d80b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94d806ae20 0x7f94d80b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 >> v1:172.21.15.82:6789/0 conn(0x7f94d806c820 legacy=0x7f94d8162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80b3980 con 0x7f94d8158e00 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f94d4001470 con 0x7f94d8158e00 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 >> v1:172.21.15.50:6789/0 conn(0x7f94d8158e00 legacy=0x7f94d806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4003c20 0x7f94c4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94c4004810 0x7f94c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c40051c0 0x7f94c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b36a0 con 0x7f94c4004810 2023-12-24T20:10:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400c0e0 con 0x7f94c40051c0 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400c2a0 con 0x7f94c4003c20 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dda49700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94c4004810 0x7f94c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94de24a700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4003c20 0x7f94c4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.138+0000 7f94dea4b700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c40051c0 0x7f94c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 -- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4003c20 msgr2=0x7f94c4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4003c20 0x7f94c4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 -- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c40051c0 msgr2=0x7f94c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c40051c0 0x7f94c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 -- 172.21.15.50:0/479072519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4003570 con 0x7f94c4004810 2023-12-24T20:10:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dea4b700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c40051c0 0x7f94c400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dda49700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94c4004810 0x7f94c4004c80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f94d806e8a0 tx=0x7f94c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2999d92bc1db86 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800e640 con 0x7f94c4004810 2023-12-24T20:10:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800e7a0 con 0x7f94c4004810 2023-12-24T20:10:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dd248700 1 -- 172.21.15.50:0/479072519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800eb40 con 0x7f94c4004810 2023-12-24T20:10:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 -- 172.21.15.50:0/479072519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94c4004810 msgr2=0x7f94c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 --2- 172.21.15.50:0/479072519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94c4004810 0x7f94c4004c80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f94d806e8a0 tx=0x7f94c80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94dea4b700 1 -- 172.21.15.50:0/479072519 reap_dead start 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 -- 172.21.15.50:0/479072519 shutdown_connections 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 -- 172.21.15.50:0/479072519 >> 172.21.15.50:0/479072519 conn(0x7f94d8067b80 msgr2=0x7f94d80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 -- 172.21.15.50:0/479072519 shutdown_connections 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 -- 172.21.15.50:0/479072519 wait complete. 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.142+0000 7f94e04ae700 1 Processor -- start 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- start start 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4004810 0x7f94d814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d8150c40 0x7f94d81510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81515f0 con 0x7f94d8156b30 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81574e0 con 0x7f94d8150c40 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d814e6e0 con 0x7f94c4004810 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55880/0 (socket says 172.21.15.50:55880) 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 -- 172.21.15.50:0/635128106 learned_addr learned my addr 172.21.15.50:0/635128106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dda49700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d8150c40 0x7f94d81510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94de24a700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4004810 0x7f94d814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 -- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4004810 msgr2=0x7f94d814cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4004810 0x7f94d814cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 -- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d8150c40 msgr2=0x7f94d81510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d8150c40 0x7f94d81510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 -- 172.21.15.50:0/635128106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d814df90 con 0x7f94d8156b30 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94dea4b700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f94d0001350 tx=0x7f94d0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00032e0 con 0x7f94d8156b30 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0003440 con 0x7f94d8156b30 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d8157720 con 0x7f94d8156b30 2023-12-24T20:10:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0001930 con 0x7f94d8156b30 2023-12-24T20:10:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.146+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d8157ce0 con 0x7f94d8156b30 2023-12-24T20:10:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.150+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80652e0 con 0x7f94d8156b30 2023-12-24T20:10:46.153 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.146+0000 7f1ac4584000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.150+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f94d00133e0 con 0x7f94d8156b30 2023-12-24T20:10:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.154+0000 7f94ce7fc700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 0x7f94bc062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.154+0000 7f94de24a700 1 -- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 msgr2=0x7f94bc062be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.154+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f94d007c840 con 0x7f94d8156b30 2023-12-24T20:10:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.154+0000 7f94de24a700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 0x7f94bc062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:46.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.158+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94d004c700 con 0x7f94d8156b30 2023-12-24T20:10:46.198 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:46.194+0000 7f6bbe1b1000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T20:10:46.291 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:46.290+0000 7f6bbe1b1000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:46.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.346+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94d80b3c60 con 0x7f94d8156b30 2023-12-24T20:10:46.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.346+0000 7f94ce7fc700 1 -- 172.21.15.50:0/635128106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v209) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94d0019020 con 0x7f94d8156b30 2023-12-24T20:10:46.349 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 msgr2=0x7f94bc062be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 0x7f94bc062be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 msgr2=0x7f94d8156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f94d0001350 tx=0x7f94d0009040 comp rx=0 tx=0).stop 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 shutdown_connections 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94bc060730 0x7f94bc062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d8156b30 0x7f94d8156fa0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d8150c40 0x7f94d81510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 --2- 172.21.15.50:0/635128106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94c4004810 0x7f94d814cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 >> 172.21.15.50:0/635128106 conn(0x7f94d8067b80 msgr2=0x7f94d80b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 shutdown_connections 2023-12-24T20:10:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.350+0000 7f94e04ae700 1 -- 172.21.15.50:0/635128106 wait complete. 2023-12-24T20:10:46.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:10:46.390 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.386+0000 7f1ac4584000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:46.473 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.466+0000 7f1ac4584000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:46.534 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:46.530+0000 7f6bbe1b1000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T20:10:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.538+0000 7f435a4f0700 1 Processor -- start 2023-12-24T20:10:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.538+0000 7f435a4f0700 1 -- start start 2023-12-24T20:10:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f435a4f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f435406ae10 0x7f4354164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f435a4f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540cd680 con 0x7f43540cf4d0 2023-12-24T20:10:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f435a4f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435406d8f0 con 0x7f43540cf8a0 2023-12-24T20:10:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f435a4f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4354159640 con 0x7f435406ae10 2023-12-24T20:10:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4358a8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f435406ae10 0x7f4354164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4353fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43540cf4d0 0x7f435406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45550/0 (socket says 172.21.15.50:45550) 2023-12-24T20:10:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4353fff700 1 -- 172.21.15.50:0/1981636644 learned_addr learned my addr 172.21.15.50:0/1981636644 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4358a8d700 1 -- 172.21.15.50:0/1981636644 >> v1:172.21.15.82:6789/0 conn(0x7f43540cf8a0 legacy=0x7f435406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4358a8d700 1 -- 172.21.15.50:0/1981636644 >> v1:172.21.15.50:6789/0 conn(0x7f43540cf4d0 legacy=0x7f435406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4358a8d700 1 -- 172.21.15.50:0/1981636644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43540cca70 con 0x7f435406ae10 2023-12-24T20:10:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.542+0000 7f4358a8d700 1 --2- 172.21.15.50:0/1981636644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354164010 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f434c009e60 tx=0x7f434c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f1a650fff7ebc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f43537fe700 1 -- 172.21.15.50:0/1981636644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00e070 con 0x7f435406ae10 2023-12-24T20:10:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f43537fe700 1 -- 172.21.15.50:0/1981636644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c00bc30 con 0x7f435406ae10 2023-12-24T20:10:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f43537fe700 1 -- 172.21.15.50:0/1981636644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c012430 con 0x7f435406ae10 2023-12-24T20:10:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 -- 172.21.15.50:0/1981636644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 msgr2=0x7f4354164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 --2- 172.21.15.50:0/1981636644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354164010 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f434c009e60 tx=0x7f434c009780 comp rx=0 tx=0).stop 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 -- 172.21.15.50:0/1981636644 shutdown_connections 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 --2- 172.21.15.50:0/1981636644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354164010 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 -- 172.21.15.50:0/1981636644 >> 172.21.15.50:0/1981636644 conn(0x7f4354067b30 msgr2=0x7f43540cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 -- 172.21.15.50:0/1981636644 shutdown_connections 2023-12-24T20:10:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.546+0000 7f435a4f0700 1 -- 172.21.15.50:0/1981636644 wait complete. 2023-12-24T20:10:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 Processor -- start 2023-12-24T20:10:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 -- start start 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43540cf4d0 0x7f435415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43540cf8a0 0x7f4354141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435416a0d0 con 0x7f435406ae10 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4354169240 con 0x7f43540cf8a0 2023-12-24T20:10:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f435a4f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43541694c0 con 0x7f43540cf4d0 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55902/0 (socket says 172.21.15.50:55902) 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 -- 172.21.15.50:0/659387303 learned_addr learned my addr 172.21.15.50:0/659387303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f434bfff700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43540cf4d0 0x7f435415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4358a8d700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43540cf8a0 0x7f4354141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 -- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43540cf4d0 msgr2=0x7f435415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43540cf4d0 0x7f435415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 -- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43540cf8a0 msgr2=0x7f4354141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43540cf8a0 0x7f4354141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.550+0000 7f4353fff700 1 -- 172.21.15.50:0/659387303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009a20 con 0x7f435406ae10 2023-12-24T20:10:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f4353fff700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f434400c7f0 tx=0x7f4344007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344005b30 con 0x7f435406ae10 2023-12-24T20:10:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344005cb0 con 0x7f435406ae10 2023-12-24T20:10:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344004a80 con 0x7f435406ae10 2023-12-24T20:10:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43541697a0 con 0x7f435406ae10 2023-12-24T20:10:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4354169d60 con 0x7f435406ae10 2023-12-24T20:10:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43540652e0 con 0x7f435406ae10 2023-12-24T20:10:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.554+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f43440070d0 con 0x7f435406ae10 2023-12-24T20:10:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.558+0000 7f4350ff9700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 0x7f4334062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.558+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f434407c250 con 0x7f435406ae10 2023-12-24T20:10:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.558+0000 7f434bfff700 1 -- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 msgr2=0x7f4334062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.558+0000 7f434bfff700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 0x7f4334062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.562+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4344049be0 con 0x7f435406ae10 2023-12-24T20:10:46.565 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.562+0000 7f1ac4584000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:46.629 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:46.626+0000 7f6bbe1b1000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T20:10:46.728 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:46.726+0000 7f6bbe1b1000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T20:10:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.738+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43540ccd50 con 0x7f435406ae10 2023-12-24T20:10:46.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.738+0000 7f4350ff9700 1 -- 172.21.15.50:0/659387303 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v209) v1 ==== 104+0+11 (secure 0 0 0) 0x7f434404c110 con 0x7f435406ae10 2023-12-24T20:10:46.741 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-24T20:10:46.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 msgr2=0x7f4334062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:46.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 0x7f4334062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 msgr2=0x7f4354159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f434400c7f0 tx=0x7f4344007f70 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 shutdown_connections 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4334060700 0x7f4334062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43540cf8a0 0x7f4354141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43540cf4d0 0x7f435415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 --2- 172.21.15.50:0/659387303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f435406ae10 0x7f4354159e40 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 >> 172.21.15.50:0/659387303 conn(0x7f4354067b30 msgr2=0x7f4354062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 shutdown_connections 2023-12-24T20:10:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.742+0000 7f435a4f0700 1 -- 172.21.15.50:0/659387303 wait complete. 2023-12-24T20:10:46.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:10:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.930+0000 7ff87f59e700 1 Processor -- start 2023-12-24T20:10:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.930+0000 7ff87f59e700 1 -- start start 2023-12-24T20:10:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8800676b0 0x7ff88015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88015a320 con 0x7ff88006ce10 2023-12-24T20:10:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88006a8f0 con 0x7ff8800672e0 2023-12-24T20:10:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88006abd0 con 0x7ff8800676b0 2023-12-24T20:10:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff88006ce10 0x7ff88006d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45552/0 (socket says 172.21.15.50:45552) 2023-12-24T20:10:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87ed9d700 1 -- 172.21.15.50:0/1702540608 learned_addr learned my addr 172.21.15.50:0/1702540608 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87dd9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8800676b0 0x7ff88015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87d59a700 1 -- 172.21.15.50:0/1702540608 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978614163 0 0) 0x7ff88015a320 con 0x7ff88006ce10 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87d59a700 1 -- 172.21.15.50:0/1702540608 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff868003570 con 0x7ff88006ce10 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87dd9b700 1 -- 172.21.15.50:0/1702540608 >> v1:172.21.15.82:6789/0 conn(0x7ff8800672e0 legacy=0x7ff88015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87dd9b700 1 -- 172.21.15.50:0/1702540608 >> v1:172.21.15.50:6789/0 conn(0x7ff88006ce10 legacy=0x7ff88006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87dd9b700 1 -- 172.21.15.50:0/1702540608 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88006aeb0 con 0x7ff8800676b0 2023-12-24T20:10:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.934+0000 7ff87dd9b700 1 --2- 172.21.15.50:0/1702540608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff88015d150 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7ff8740098e0 tx=0x7ff8740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5ded646fa1cbb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87d59a700 1 -- 172.21.15.50:0/1702540608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400b640 con 0x7ff8800676b0 2023-12-24T20:10:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87d59a700 1 -- 172.21.15.50:0/1702540608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87400b7a0 con 0x7ff8800676b0 2023-12-24T20:10:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87d59a700 1 -- 172.21.15.50:0/1702540608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400bb40 con 0x7ff8800676b0 2023-12-24T20:10:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- 172.21.15.50:0/1702540608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 msgr2=0x7ff88015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 --2- 172.21.15.50:0/1702540608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff88015d150 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7ff8740098e0 tx=0x7ff8740091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- 172.21.15.50:0/1702540608 shutdown_connections 2023-12-24T20:10:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 --2- 172.21.15.50:0/1702540608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff88015d150 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- 172.21.15.50:0/1702540608 >> 172.21.15.50:0/1702540608 conn(0x7ff8800cfdf0 msgr2=0x7ff8800d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- 172.21.15.50:0/1702540608 shutdown_connections 2023-12-24T20:10:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- 172.21.15.50:0/1702540608 wait complete. 2023-12-24T20:10:46.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 Processor -- start 2023-12-24T20:10:46.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.938+0000 7ff87f59e700 1 -- start start 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8800672e0 0x7ff8800c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 0x7ff88015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff880169680 con 0x7ff8800676b0 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800c8c40 con 0x7ff88006ce10 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800c7df0 con 0x7ff8800672e0 2023-12-24T20:10:46.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55916/0 (socket says 172.21.15.50:55916) 2023-12-24T20:10:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 -- 172.21.15.50:0/315158524 learned_addr learned my addr 172.21.15.50:0/315158524 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87ed9d700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 0x7ff88015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 -- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8800672e0 msgr2=0x7ff8800c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8800672e0 0x7ff8800c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 -- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 msgr2=0x7ff88015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 0x7ff88015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 -- 172.21.15.50:0/315158524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009420 con 0x7ff8800676b0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87ed9d700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 0x7ff88015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87dd9b700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff8800c6e20 tx=0x7ff874017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400bb20 con 0x7ff8800676b0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874011420 con 0x7ff8800676b0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740117c0 con 0x7ff8800676b0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8800c80c0 con 0x7ff8800676b0 2023-12-24T20:10:46.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.942+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8800c8680 con 0x7ff8800676b0 2023-12-24T20:10:46.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8801697c0 con 0x7ff8800676b0 2023-12-24T20:10:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7ff874011b70 con 0x7ff8800676b0 2023-12-24T20:10:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff86e7fc700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 0x7ff860062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7ff87407e610 con 0x7ff8800676b0 2023-12-24T20:10:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff87e59c700 1 -- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 msgr2=0x7ff860062c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.946+0000 7ff87e59c700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 0x7ff860062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:46.954+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8801697c0 con 0x7ff8800676b0 2023-12-24T20:10:46.974 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:46.970+0000 7f1ac4584000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.126+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8801697c0 con 0x7ff8800676b0 2023-12-24T20:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.130+0000 7ff86e7fc700 1 -- 172.21.15.50:0/315158524 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v209) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8801697c0 con 0x7ff8800676b0 2023-12-24T20:10:47.131 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 msgr2=0x7ff860062c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 0x7ff860062c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 msgr2=0x7ff880157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff8800c6e20 tx=0x7ff874017000 comp rx=0 tx=0).stop 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 shutdown_connections 2023-12-24T20:10:47.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7ff860060780 0x7ff860062c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88006ce10 0x7ff88015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8800676b0 0x7ff880157eb0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 --2- 172.21.15.50:0/315158524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff8800672e0 0x7ff8800c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 >> 172.21.15.50:0/315158524 conn(0x7ff8800cfdf0 msgr2=0x7ff880153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 shutdown_connections 2023-12-24T20:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.134+0000 7ff87f59e700 1 -- 172.21.15.50:0/315158524 wait complete. 2023-12-24T20:10:47.145 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.138+0000 7f1ac4584000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:47.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:47.164 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:47.162+0000 7f6bbe1b1000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T20:10:47.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.322+0000 7fad9cef0700 1 Processor -- start 2023-12-24T20:10:47.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.322+0000 7fad9cef0700 1 -- start start 2023-12-24T20:10:47.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9cef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 0x7fad980b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9cef0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980b41d0 con 0x7fad980b1ba0 2023-12-24T20:10:47.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9cef0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9806d5c0 con 0x7fad98158e10 2023-12-24T20:10:47.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9cef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b49c0 con 0x7fad9815d6d0 2023-12-24T20:10:47.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad96d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad980b1ba0 0x7fad981591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45558/0 (socket says 172.21.15.50:45558) 2023-12-24T20:10:47.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad96d9d700 1 -- 172.21.15.50:0/1439525952 learned_addr learned my addr 172.21.15.50:0/1439525952 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:47.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad95d9b700 1 --2- 172.21.15.50:0/1439525952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 0x7fad980b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694375901 0 0) 0x7fad980b41d0 con 0x7fad980b1ba0 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad80003570 con 0x7fad980b1ba0 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440717346 0 0) 0x7fad9806d5c0 con 0x7fad98158e10 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad980b41d0 con 0x7fad98158e10 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad95d9b700 1 -- 172.21.15.50:0/1439525952 >> v1:172.21.15.82:6789/0 conn(0x7fad98158e10 legacy=0x7fad9806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad95d9b700 1 -- 172.21.15.50:0/1439525952 >> v1:172.21.15.50:6789/0 conn(0x7fad980b1ba0 legacy=0x7fad981591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad95d9b700 1 -- 172.21.15.50:0/1439525952 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9815db20 con 0x7fad9815d6d0 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.326+0000 7fad95d9b700 1 --2- 172.21.15.50:0/1439525952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 0x7fad980b3c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009910 tx=0x7fad8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8199aada98db8324 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011630 con 0x7fad9815d6d0 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c011790 con 0x7fad9815d6d0 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9559a700 1 -- 172.21.15.50:0/1439525952 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011b30 con 0x7fad9815d6d0 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- 172.21.15.50:0/1439525952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 msgr2=0x7fad980b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 --2- 172.21.15.50:0/1439525952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 0x7fad980b3c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009910 tx=0x7fad8c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- 172.21.15.50:0/1439525952 shutdown_connections 2023-12-24T20:10:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 --2- 172.21.15.50:0/1439525952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad9815d6d0 0x7fad980b3c90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- 172.21.15.50:0/1439525952 >> 172.21.15.50:0/1439525952 conn(0x7fad980670b0 msgr2=0x7fad980674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- 172.21.15.50:0/1439525952 shutdown_connections 2023-12-24T20:10:47.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- 172.21.15.50:0/1439525952 wait complete. 2023-12-24T20:10:47.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 Processor -- start 2023-12-24T20:10:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.330+0000 7fad9cef0700 1 -- start start 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad980b1ba0 0x7fad980a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad98158e10 0x7fad98151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9816dbf0 con 0x7fad9815d6d0 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a97d0 con 0x7fad98158e10 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9816cd00 con 0x7fad980b1ba0 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55922/0 (socket says 172.21.15.50:55922) 2023-12-24T20:10:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 -- 172.21.15.50:0/2515608718 learned_addr learned my addr 172.21.15.50:0/2515608718 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad95d9b700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad98158e10 0x7fad98151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9659c700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad980b1ba0 0x7fad980a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad980b1ba0 msgr2=0x7fad980a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad980b1ba0 0x7fad980a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad98158e10 msgr2=0x7fad98151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad98158e10 0x7fad98151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 -- 172.21.15.50:0/2515608718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009420 con 0x7fad9815d6d0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad96d9d700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fad9000cc20 tx=0x7fad90001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000a850 con 0x7fad9815d6d0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000a9d0 con 0x7fad9815d6d0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000ad90 con 0x7fad9815d6d0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9816cfe0 con 0x7fad9815d6d0 2023-12-24T20:10:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.334+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9816d5a0 con 0x7fad9815d6d0 2023-12-24T20:10:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.338+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980b4dd0 con 0x7fad9815d6d0 2023-12-24T20:10:47.341 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:47.338+0000 7f6bbe1b1000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T20:10:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.338+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fad90007300 con 0x7fad9815d6d0 2023-12-24T20:10:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.342+0000 7fad867fc700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 0x7fad78062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.342+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7fad9007d1e0 con 0x7fad9815d6d0 2023-12-24T20:10:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.342+0000 7fad9659c700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 msgr2=0x7fad78062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.342+0000 7fad9659c700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 0x7fad78062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.350+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad9004d1c0 con 0x7fad9815d6d0 2023-12-24T20:10:47.489 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.486+0000 7f1ac4584000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.546+0000 7fad9659c700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 msgr2=0x7fad78062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.546+0000 7fad9659c700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 0x7fad78062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:47.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.570+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad980652e0 con 0x7fad9815d6d0 2023-12-24T20:10:47.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.570+0000 7fad867fc700 1 -- 172.21.15.50:0/2515608718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7fad900507e0 con 0x7fad9815d6d0 2023-12-24T20:10:47.573 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:47.573 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 msgr2=0x7fad78062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 0x7fad78062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 msgr2=0x7fad98152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fad9000cc20 tx=0x7fad90001a40 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 shutdown_connections 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fad78060700 0x7fad78062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad9815d6d0 0x7fad98152e10 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad98158e10 0x7fad98151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 --2- 172.21.15.50:0/2515608718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad980b1ba0 0x7fad980a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 >> 172.21.15.50:0/2515608718 conn(0x7fad980670b0 msgr2=0x7fad98152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 shutdown_connections 2023-12-24T20:10:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.574+0000 7fad9cef0700 1 -- 172.21.15.50:0/2515608718 wait complete. 2023-12-24T20:10:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:47.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:47.724 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.718+0000 7f1ac4584000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:47.749 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:47.746+0000 7f6bbe1b1000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T20:10:47.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 Processor -- start 2023-12-24T20:10:47.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 -- start start 2023-12-24T20:10:47.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8320158e00 0x7f83201591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f83200b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832006b640 con 0x7f832006a580 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8320159710 con 0x7f8320158e00 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832648e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200b5e10 con 0x7f832006d8c0 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f832548c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8320158e00 0x7f83201591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f8324c8b700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f83200b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f8325c8d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f832006a580 0x7f832006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49032/0 (socket says 172.21.15.50:49032) 2023-12-24T20:10:47.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.758+0000 7f8325c8d700 1 -- 172.21.15.50:0/1030394723 learned_addr learned my addr 172.21.15.50:0/1030394723 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:47.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8317fff700 1 -- 172.21.15.50:0/1030394723 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249651809 0 0) 0x7f832006b640 con 0x7f832006a580 2023-12-24T20:10:47.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8317fff700 1 -- 172.21.15.50:0/1030394723 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f830c003570 con 0x7f832006a580 2023-12-24T20:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832548c700 1 -- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 msgr2=0x7f83200b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832548c700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f83200b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832548c700 1 -- 172.21.15.50:0/1030394723 >> v1:172.21.15.82:6789/0 conn(0x7f832006a580 legacy=0x7f832006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832548c700 1 -- 172.21.15.50:0/1030394723 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832006b8e0 con 0x7f8320158e00 2023-12-24T20:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8324c8b700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f83200b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832548c700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8320158e00 0x7f83201591d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f831c0098e0 tx=0x7f831c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5720e47f04a53d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8317fff700 1 -- 172.21.15.50:0/1030394723 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c011630 con 0x7f8320158e00 2023-12-24T20:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8317fff700 1 -- 172.21.15.50:0/1030394723 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c011790 con 0x7f8320158e00 2023-12-24T20:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f8317fff700 1 -- 172.21.15.50:0/1030394723 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c011b30 con 0x7f8320158e00 2023-12-24T20:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 -- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8320158e00 msgr2=0x7f83201591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8320158e00 0x7f83201591d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f831c0098e0 tx=0x7f831c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 -- 172.21.15.50:0/1030394723 shutdown_connections 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f83200b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 --2- 172.21.15.50:0/1030394723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8320158e00 0x7f83201591d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 -- 172.21.15.50:0/1030394723 >> 172.21.15.50:0/1030394723 conn(0x7f8320067b80 msgr2=0x7f83200b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 -- 172.21.15.50:0/1030394723 shutdown_connections 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.762+0000 7f832648e700 1 -- 172.21.15.50:0/1030394723 wait complete. 2023-12-24T20:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 Processor -- start 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 -- start start 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832006a580 0x7f8320140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f832015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200abeb0 con 0x7f8320158e00 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832015f8b0 con 0x7f832006a580 2023-12-24T20:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f832648e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832015f2f0 con 0x7f832006d8c0 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.766+0000 7f8325c8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55938/0 (socket says 172.21.15.50:55938) 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 -- 172.21.15.50:0/3994382122 learned_addr learned my addr 172.21.15.50:0/3994382122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8324c8b700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f832015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f832548c700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832006a580 0x7f8320140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 msgr2=0x7f832015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f832015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832006a580 msgr2=0x7f8320140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832006a580 0x7f8320140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 -- 172.21.15.50:0/3994382122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009420 con 0x7f8320158e00 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f8325c8d700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f831800cca0 tx=0x7f8318001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800a8d0 con 0x7f8320158e00 2023-12-24T20:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800aa30 con 0x7f8320158e00 2023-12-24T20:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800adb0 con 0x7f8320158e00 2023-12-24T20:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c009420 con 0x7f8320158e00 2023-12-24T20:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83200abb40 con 0x7f8320158e00 2023-12-24T20:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.770+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832004be40 con 0x7f8320158e00 2023-12-24T20:10:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.774+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f8318007300 con 0x7f8320158e00 2023-12-24T20:10:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.774+0000 7f83157fa700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 0x7f8304062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:47.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.774+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f831807d2d0 con 0x7f8320158e00 2023-12-24T20:10:47.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.774+0000 7f832548c700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 msgr2=0x7f8304062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:47.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.774+0000 7f832548c700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 0x7f8304062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:47.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.782+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f831804d220 con 0x7f8320158e00 2023-12-24T20:10:47.814 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.810+0000 7f1ac4584000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:47.897 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.894+0000 7f1ac4584000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:47.974 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:47.970+0000 7f1ac4584000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.978+0000 7f832548c700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 msgr2=0x7f8304062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:47.978+0000 7f832548c700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 0x7f8304062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.074+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83200b4690 con 0x7f8320158e00 2023-12-24T20:10:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.074+0000 7f83157fa700 1 -- 172.21.15.50:0/3994382122 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f8318050840 con 0x7f8320158e00 2023-12-24T20:10:48.078 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:48.078 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":209,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:40.765492+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:6836/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2591226244":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2616996407":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/3338446156":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/90516501":"2023-12-25T20:10:40.765402+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:48.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 msgr2=0x7f8304062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:48.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 0x7f8304062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 msgr2=0x7f83200adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f831800cca0 tx=0x7f8318001ae0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 shutdown_connections 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f8304060700 0x7f8304062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8320158e00 0x7f83200adac0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f832006d8c0 0x7f832015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 --2- 172.21.15.50:0/3994382122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832006a580 0x7f8320140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 >> 172.21.15.50:0/3994382122 conn(0x7f8320067b80 msgr2=0x7f8320158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 shutdown_connections 2023-12-24T20:10:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.082+0000 7f832648e700 1 -- 172.21.15.50:0/3994382122 wait complete. 2023-12-24T20:10:48.086 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.086+0000 7f6bbe1b1000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T20:10:48.104 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:10:48.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:48.185 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.182+0000 7f6bbe1b1000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T20:10:48.189 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:48.182+0000 7f1ac4584000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:48.266 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.262+0000 7f6bbe1b1000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T20:10:48.272 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:48.266+0000 7f1ac4584000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 Processor -- start 2023-12-24T20:10:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 -- start start 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c0c7f30 0x7fec9c160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c06cd30 con 0x7fec9c0b1340 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c0ca7b0 con 0x7fec9c0b1710 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7feca26f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cb9b0 con 0x7fec9c0c7f30 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7fec9bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec9c0b1340 0x7fec9c0ca0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45560/0 (socket says 172.21.15.50:45560) 2023-12-24T20:10:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.274+0000 7fec9bfff700 1 -- 172.21.15.50:0/3342584233 learned_addr learned my addr 172.21.15.50:0/3342584233 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7feca0c8d700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c0c7f30 0x7fec9c160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229169533 0 0) 0x7fec9c06cd30 con 0x7fec9c0b1340 2023-12-24T20:10:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88003570 con 0x7fec9c0b1340 2023-12-24T20:10:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319531227 0 0) 0x7fec9c0ca7b0 con 0x7fec9c0b1710 2023-12-24T20:10:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec9c06cd30 con 0x7fec9c0b1710 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4046798115 0 0) 0x7fec88003570 con 0x7fec9c0b1340 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c0c7f30 msgr2=0x7fec9c160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c0c7f30 0x7fec9c160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 >> v1:172.21.15.82:6789/0 conn(0x7fec9c0b1710 legacy=0x7fec9c0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0cb3f0 con 0x7fec9c0b1340 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fec8c001470 con 0x7fec9c0b1340 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 >> v1:172.21.15.50:6789/0 conn(0x7fec9c0b1340 legacy=0x7fec9c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec88003c20 0x7fec88004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880051c0 0x7fec8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cb9b0 con 0x7fec88004810 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c020 con 0x7fec880051c0 2023-12-24T20:10:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c1e0 con 0x7fec88003c20 2023-12-24T20:10:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9bfff700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec88003c20 0x7fec88004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7feca0c8d700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880051c0 0x7fec8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 -- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec88003c20 msgr2=0x7fec88004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec88003c20 0x7fec88004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 -- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880051c0 msgr2=0x7fec8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec880051c0 0x7fec8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 -- 172.21.15.50:0/3342584233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88003570 con 0x7fec88004810 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec93fff700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec88004c80 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fec84001a10 tx=0x7fec84007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19afccec62e1645 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400c5d0 con 0x7fec88004810 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400c730 con 0x7fec88004810 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.278+0000 7fec9b7fe700 1 -- 172.21.15.50:0/3342584233 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400cad0 con 0x7fec88004810 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- 172.21.15.50:0/3342584233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 msgr2=0x7fec88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 --2- 172.21.15.50:0/3342584233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec88004c80 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fec84001a10 tx=0x7fec84007d30 comp rx=0 tx=0).stop 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca0c8d700 1 -- 172.21.15.50:0/3342584233 reap_dead start 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- 172.21.15.50:0/3342584233 shutdown_connections 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- 172.21.15.50:0/3342584233 >> 172.21.15.50:0/3342584233 conn(0x7fec9c067b50 msgr2=0x7fec9c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- 172.21.15.50:0/3342584233 shutdown_connections 2023-12-24T20:10:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- 172.21.15.50:0/3342584233 wait complete. 2023-12-24T20:10:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 Processor -- start 2023-12-24T20:10:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.282+0000 7feca26f0700 1 -- start start 2023-12-24T20:10:48.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c154b60 0x7fec9c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c0c2bd0 0x7fec9c0c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c1523b0 con 0x7fec88004810 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c152690 con 0x7fec9c0c2bd0 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c152970 con 0x7fec9c154b60 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55950/0 (socket says 172.21.15.50:55950) 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 -- 172.21.15.50:0/2160203597 learned_addr learned my addr 172.21.15.50:0/2160203597 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec93fff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c154b60 0x7fec9c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca0c8d700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c0c2bd0 0x7fec9c0c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c154b60 msgr2=0x7fec9c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c154b60 0x7fec9c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c0c2bd0 msgr2=0x7fec9c0c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c0c2bd0 0x7fec9c0c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 -- 172.21.15.50:0/2160203597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c152c50 con 0x7fec88004810 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec9bfff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fec8c000f60 tx=0x7fec8c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c018030 con 0x7fec88004810 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00f750 con 0x7fec88004810 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c152f30 con 0x7fec88004810 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00faf0 con 0x7fec88004810 2023-12-24T20:10:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.286+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c153990 con 0x7fec88004810 2023-12-24T20:10:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c153170 con 0x7fec88004810 2023-12-24T20:10:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fec8c01b070 con 0x7fec88004810 2023-12-24T20:10:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7fec98ff9700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 0x7fec7c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7fec8c019070 con 0x7fec88004810 2023-12-24T20:10:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7fec93fff700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 msgr2=0x7fec7c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.290+0000 7fec93fff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 0x7fec7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:48.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.298+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fec9c153170 con 0x7fec88004810 2023-12-24T20:10:48.363 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:48.358+0000 7f1ac4584000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:48.363 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.362+0000 7f6bbe1b1000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T20:10:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.494+0000 7fec93fff700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 msgr2=0x7fec7c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.494+0000 7fec93fff700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 0x7fec7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.502+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec9c153170 con 0x7fec88004810 2023-12-24T20:10:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7fec98ff9700 1 -- 172.21.15.50:0/2160203597 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7fec9c153170 con 0x7fec88004810 2023-12-24T20:10:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:48.507 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 msgr2=0x7fec7c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 0x7fec7c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 msgr2=0x7fec9c153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fec8c000f60 tx=0x7fec8c001e10 comp rx=0 tx=0).stop 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 shutdown_connections 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fec7c060700 0x7fec7c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c0c2bd0 0x7fec9c0c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c154b60 0x7fec9c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 --2- 172.21.15.50:0/2160203597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec88004810 0x7fec9c153450 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 >> 172.21.15.50:0/2160203597 conn(0x7fec9c067b50 msgr2=0x7fec9c0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 shutdown_connections 2023-12-24T20:10:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.506+0000 7feca26f0700 1 -- 172.21.15.50:0/2160203597 wait complete. 2023-12-24T20:10:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:48.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:10:48.555 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:48.550+0000 7f1ac4584000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:48.612 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.610+0000 7f6bbe1b1000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T20:10:48.638 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:48.634+0000 7f1ac4584000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.694+0000 7f276a8e3700 1 Processor -- start 2023-12-24T20:10:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.694+0000 7f276a8e3700 1 -- start start 2023-12-24T20:10:48.700 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f6bbe1b1000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T20:10:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a8e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27640b04e0 0x7f27640cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a8e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2764156f60 0x7f27640c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a8e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27640c7370 con 0x7f2764156b90 2023-12-24T20:10:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a8e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27640ca770 con 0x7f2764156f60 2023-12-24T20:10:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a8e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276406eaf0 con 0x7f27640b04e0 2023-12-24T20:10:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a0e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2764156f60 0x7f27640c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a0e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2764156f60 0x7f27640c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55956/0 (socket says 172.21.15.50:55956) 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f27698e1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2764156b90 0x7f276415b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:49054/0 (socket says 172.21.15.50:49054) 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f276a0e2700 1 -- 172.21.15.50:0/150708203 learned_addr learned my addr 172.21.15.50:0/150708203 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.698+0000 7f27690e0700 1 --2- 172.21.15.50:0/150708203 >> v2:172.21.15.82:3300/0 conn(0x7f27640b04e0 0x7f27640cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a0e2700 1 -- 172.21.15.50:0/150708203 >> v2:172.21.15.82:3300/0 conn(0x7f27640b04e0 msgr2=0x7f27640cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a0e2700 1 --2- 172.21.15.50:0/150708203 >> v2:172.21.15.82:3300/0 conn(0x7f27640b04e0 0x7f27640cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a0e2700 1 -- 172.21.15.50:0/150708203 >> v1:172.21.15.82:6789/0 conn(0x7f2764156b90 legacy=0x7f276415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a0e2700 1 -- 172.21.15.50:0/150708203 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276406edd0 con 0x7f2764156f60 2023-12-24T20:10:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f27688df700 1 -- 172.21.15.50:0/150708203 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122308745 0 0) 0x7f27640c7370 con 0x7f2764156b90 2023-12-24T20:10:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a0e2700 1 --2- 172.21.15.50:0/150708203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156f60 0x7f27640c8810 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f276406b9b0 tx=0x7f275c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31307a428694147a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f27688df700 1 -- 172.21.15.50:0/150708203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00e070 con 0x7f2764156f60 2023-12-24T20:10:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f27688df700 1 -- 172.21.15.50:0/150708203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00ba20 con 0x7f2764156f60 2023-12-24T20:10:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f27688df700 1 -- 172.21.15.50:0/150708203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c0092e0 con 0x7f2764156f60 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 -- 172.21.15.50:0/150708203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156f60 msgr2=0x7f27640c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 --2- 172.21.15.50:0/150708203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156f60 0x7f27640c8810 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f276406b9b0 tx=0x7f275c009840 comp rx=0 tx=0).stop 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 -- 172.21.15.50:0/150708203 shutdown_connections 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 --2- 172.21.15.50:0/150708203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156f60 0x7f27640c8810 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 --2- 172.21.15.50:0/150708203 >> v2:172.21.15.82:3300/0 conn(0x7f27640b04e0 0x7f27640cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 -- 172.21.15.50:0/150708203 >> 172.21.15.50:0/150708203 conn(0x7f27640af9d0 msgr2=0x7f27640afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 -- 172.21.15.50:0/150708203 shutdown_connections 2023-12-24T20:10:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 -- 172.21.15.50:0/150708203 wait complete. 2023-12-24T20:10:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.702+0000 7f276a8e3700 1 Processor -- start 2023-12-24T20:10:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 -- start start 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27640b04e0 0x7f2764152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 0x7f276416c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640aaef0 con 0x7f2764156b90 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640aba70 con 0x7f2764156f60 2023-12-24T20:10:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a8e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640ab140 con 0x7f27640b04e0 2023-12-24T20:10:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f27690e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 0x7f276416c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:48754/0 (socket says 172.21.15.50:48754) 2023-12-24T20:10:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 -- 172.21.15.50:0/1041103456 learned_addr learned my addr 172.21.15.50:0/1041103456 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f27698e1700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27640b04e0 0x7f2764152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27640b04e0 msgr2=0x7f2764152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27640b04e0 0x7f2764152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 msgr2=0x7f276416c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 0x7f276416c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 -- 172.21.15.50:0/1041103456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009ae0 con 0x7f2764156f60 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f27690e0700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 0x7f276416c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f276a0e2700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f275c009880 tx=0x7f275c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.706+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c008a80 con 0x7f2764156f60 2023-12-24T20:10:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c008be0 con 0x7f2764156f60 2023-12-24T20:10:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c026460 con 0x7f2764156f60 2023-12-24T20:10:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27640ab420 con 0x7f2764156f60 2023-12-24T20:10:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764153070 con 0x7f2764156f60 2023-12-24T20:10:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276404be40 con 0x7f2764156f60 2023-12-24T20:10:48.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.710+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7f275c003040 con 0x7f2764156f60 2023-12-24T20:10:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.714+0000 7f2759ffb700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 0x7f2748062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.714+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7f275c07ee30 con 0x7f2764156f60 2023-12-24T20:10:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.714+0000 7f27698e1700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 msgr2=0x7f2748062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.714+0000 7f27698e1700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 0x7f2748062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.722+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f275c04ec90 con 0x7f2764156f60 2023-12-24T20:10:48.800 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:48.798+0000 7f6bbe1b1000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T20:10:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.918+0000 7f27698e1700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 msgr2=0x7f2748062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.918+0000 7f27698e1700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 0x7f2748062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:48.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.930+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27640abbb0 con 0x7f2764156f60 2023-12-24T20:10:48.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.930+0000 7f2759ffb700 1 -- 172.21.15.50:0/1041103456 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4606 (secure 0 0 0) 0x7f275c021090 con 0x7f2764156f60 2023-12-24T20:10:48.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:48.934 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:10:21.757805+0000","modified":"2023-12-24T20:10:25.343695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10347":{"gid":10347,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/655876048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":655876048},{"type":"v1","addr":"172.21.15.50:6835","nonce":655876048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-12-24T20:10:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 msgr2=0x7f2748062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 0x7f2748062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 msgr2=0x7f276416c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f275c009880 tx=0x7f275c018000 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 shutdown_connections 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2748060700 0x7f2748062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2764156f60 0x7f276416c9e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764156b90 0x7f276416c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 --2- 172.21.15.50:0/1041103456 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27640b04e0 0x7f2764152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 >> 172.21.15.50:0/1041103456 conn(0x7f27640af9d0 msgr2=0x7f27640c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.934+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 shutdown_connections 2023-12-24T20:10:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:48.938+0000 7f276a8e3700 1 -- 172.21.15.50:0/1041103456 wait complete. 2023-12-24T20:10:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 104 2023-12-24T20:10:48.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:49.021 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:49.018+0000 7f6bbe1b1000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T20:10:49.119 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:49.114+0000 7f6bbe1b1000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T20:10:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.118+0000 7fcd1648e700 1 Processor -- start 2023-12-24T20:10:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.118+0000 7fcd1648e700 1 -- start start 2023-12-24T20:10:49.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1648e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd100cc9d0 0x7fcd100ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1648e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd100ce390 0x7fcd100ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1648e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1006b280 con 0x7fcd10152fd0 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1648e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1006a6b0 con 0x7fcd100ce390 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1648e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1006a950 con 0x7fcd100cc9d0 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd100ce390 0x7fcd100ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd100ce390 0x7fcd100ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55980/0 (socket says 172.21.15.50:55980) 2023-12-24T20:10:49.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 -- 172.21.15.50:0/1639434335 learned_addr learned my addr 172.21.15.50:0/1639434335 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:49.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd1548c700 1 --2- 172.21.15.50:0/1639434335 >> v2:172.21.15.82:3300/0 conn(0x7fcd100cc9d0 0x7fcd100ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 -- 172.21.15.50:0/1639434335 >> v2:172.21.15.82:3300/0 conn(0x7fcd100cc9d0 msgr2=0x7fcd100ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:49.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 --2- 172.21.15.50:0/1639434335 >> v2:172.21.15.82:3300/0 conn(0x7fcd100cc9d0 0x7fcd100ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 -- 172.21.15.50:0/1639434335 >> v1:172.21.15.82:6789/0 conn(0x7fcd10152fd0 legacy=0x7fcd10153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 -- 172.21.15.50:0/1639434335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1006ac30 con 0x7fcd100ce390 2023-12-24T20:10:49.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd15c8d700 1 --2- 172.21.15.50:0/1639434335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100ce390 0x7fcd100ce7f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fcd100cd980 tx=0x7fcd08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cef2e6401f971b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd07fff700 1 -- 172.21.15.50:0/1639434335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800e070 con 0x7fcd100ce390 2023-12-24T20:10:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd07fff700 1 -- 172.21.15.50:0/1639434335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0800ba50 con 0x7fcd100ce390 2023-12-24T20:10:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.122+0000 7fcd07fff700 1 -- 172.21.15.50:0/1639434335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080092e0 con 0x7fcd100ce390 2023-12-24T20:10:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 -- 172.21.15.50:0/1639434335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100ce390 msgr2=0x7fcd100ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 --2- 172.21.15.50:0/1639434335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100ce390 0x7fcd100ce7f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fcd100cd980 tx=0x7fcd08009840 comp rx=0 tx=0).stop 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 -- 172.21.15.50:0/1639434335 shutdown_connections 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 --2- 172.21.15.50:0/1639434335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100ce390 0x7fcd100ce7f0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 --2- 172.21.15.50:0/1639434335 >> v2:172.21.15.82:3300/0 conn(0x7fcd100cc9d0 0x7fcd100ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 -- 172.21.15.50:0/1639434335 >> 172.21.15.50:0/1639434335 conn(0x7fcd100670b0 msgr2=0x7fcd100674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 -- 172.21.15.50:0/1639434335 shutdown_connections 2023-12-24T20:10:49.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.126+0000 7fcd1648e700 1 -- 172.21.15.50:0/1639434335 wait complete. 2023-12-24T20:10:49.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 Processor -- start 2023-12-24T20:10:49.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 -- start start 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd100ce390 0x7fcd10159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 0x7fcd10147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015b000 con 0x7fcd100cc9d0 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015ab70 con 0x7fcd10152fd0 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1648e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10159f60 con 0x7fcd100ce390 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55996/0 (socket says 172.21.15.50:55996) 2023-12-24T20:10:49.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 -- 172.21.15.50:0/2345923711 learned_addr learned my addr 172.21.15.50:0/2345923711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd14c8b700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd100ce390 0x7fcd10159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd15c8d700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 0x7fcd10147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 -- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd100ce390 msgr2=0x7fcd10159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd100ce390 0x7fcd10159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 -- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 msgr2=0x7fcd10147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 0x7fcd10147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd1548c700 1 -- 172.21.15.50:0/2345923711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009ae0 con 0x7fcd100cc9d0 2023-12-24T20:10:49.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.130+0000 7fcd15c8d700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 0x7fcd10147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:49.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd1548c700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d890 tx=0x7fcd0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0125f0 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c012750 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c012ad0 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1015a240 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1015a880 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.134+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1004be40 con 0x7fcd100cc9d0 2023-12-24T20:10:49.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.138+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7fcd0c01e460 con 0x7fcd100cc9d0 2023-12-24T20:10:49.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.138+0000 7fcd057fa700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 0x7fccf4062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.138+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7fcd0c07d570 con 0x7fcd100cc9d0 2023-12-24T20:10:49.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.138+0000 7fcd14c8b700 1 -- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 msgr2=0x7fccf4062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:49.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.138+0000 7fcd14c8b700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 0x7fccf4062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:49.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.146+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd0c04d430 con 0x7fcd100cc9d0 2023-12-24T20:10:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.322+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd1006af10 con 0x7fcd100cc9d0 2023-12-24T20:10:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.322+0000 7fcd057fa700 1 -- 172.21.15.50:0/2345923711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fcd0c050a50 con 0x7fcd100cc9d0 2023-12-24T20:10:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:49.326 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":209,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:40.765492+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:10:19.408426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-12-24T20:10:20.785864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:6836/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2591226244":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2616996407":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/3338446156":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/90516501":"2023-12-25T20:10:40.765402+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 msgr2=0x7fccf4062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 0x7fccf4062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 msgr2=0x7fcd1015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d890 tx=0x7fcd0c008040 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 shutdown_connections 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fccf4060700 0x7fccf4062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd10152fd0 0x7fcd10147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd100ce390 0x7fcd10159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 --2- 172.21.15.50:0/2345923711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100cc9d0 0x7fcd1015bad0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 >> 172.21.15.50:0/2345923711 conn(0x7fcd100670b0 msgr2=0x7fcd100c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 shutdown_connections 2023-12-24T20:10:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.330+0000 7fcd1648e700 1 -- 172.21.15.50:0/2345923711 wait complete. 2023-12-24T20:10:49.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:10:49.361 INFO:tasks.ceph.mgr.x.smithi082.stderr:2023-12-24T20:10:49.354+0000 7f1ac4584000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.514+0000 7efec06f0700 1 Processor -- start 2023-12-24T20:10:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.514+0000 7efec06f0700 1 -- start start 2023-12-24T20:10:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efec06f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 0x7efeb80b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efec06f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80b41d0 con 0x7efeb80b1ba0 2023-12-24T20:10:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efec06f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb806d5c0 con 0x7efeb8158e10 2023-12-24T20:10:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efec06f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80b49c0 con 0x7efeb815d6d0 2023-12-24T20:10:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebec8d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efeb80b1ba0 0x7efeb81591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48030/0 (socket says 172.21.15.50:48030) 2023-12-24T20:10:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebec8d700 1 -- 172.21.15.50:0/1760960511 learned_addr learned my addr 172.21.15.50:0/1760960511 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebdc8b700 1 --2- 172.21.15.50:0/1760960511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 0x7efeb80b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096919267 0 0) 0x7efeb80b41d0 con 0x7efeb80b1ba0 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea4003570 con 0x7efeb80b1ba0 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593254041 0 0) 0x7efeb806d5c0 con 0x7efeb8158e10 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb80b41d0 con 0x7efeb8158e10 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebdc8b700 1 -- 172.21.15.50:0/1760960511 >> v1:172.21.15.82:6789/0 conn(0x7efeb8158e10 legacy=0x7efeb806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebdc8b700 1 -- 172.21.15.50:0/1760960511 >> v1:172.21.15.50:6789/0 conn(0x7efeb80b1ba0 legacy=0x7efeb81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebdc8b700 1 -- 172.21.15.50:0/1760960511 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb815db20 con 0x7efeb815d6d0 2023-12-24T20:10:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.518+0000 7efebdc8b700 1 --2- 172.21.15.50:0/1760960511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 0x7efeb80b3c90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efea8009910 tx=0x7efea80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b8a6b1acad224b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8011630 con 0x7efeb815d6d0 2023-12-24T20:10:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8011790 con 0x7efeb815d6d0 2023-12-24T20:10:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efebd48a700 1 -- 172.21.15.50:0/1760960511 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8011b30 con 0x7efeb815d6d0 2023-12-24T20:10:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- 172.21.15.50:0/1760960511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 msgr2=0x7efeb80b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 --2- 172.21.15.50:0/1760960511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 0x7efeb80b3c90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efea8009910 tx=0x7efea80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- 172.21.15.50:0/1760960511 shutdown_connections 2023-12-24T20:10:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 --2- 172.21.15.50:0/1760960511 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb815d6d0 0x7efeb80b3c90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- 172.21.15.50:0/1760960511 >> 172.21.15.50:0/1760960511 conn(0x7efeb80670b0 msgr2=0x7efeb80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- 172.21.15.50:0/1760960511 shutdown_connections 2023-12-24T20:10:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- 172.21.15.50:0/1760960511 wait complete. 2023-12-24T20:10:49.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 Processor -- start 2023-12-24T20:10:49.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.522+0000 7efec06f0700 1 -- start start 2023-12-24T20:10:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb80b1ba0 0x7efeb80a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb8158e10 0x7efeb8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb816dbf0 con 0x7efeb815d6d0 2023-12-24T20:10:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80a97d0 con 0x7efeb8158e10 2023-12-24T20:10:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb816cd00 con 0x7efeb80b1ba0 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44656/0 (socket says 172.21.15.50:44656) 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 -- 172.21.15.50:0/3668784349 learned_addr learned my addr 172.21.15.50:0/3668784349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebdc8b700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb8158e10 0x7efeb8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebe48c700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb80b1ba0 0x7efeb80a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb80b1ba0 msgr2=0x7efeb80a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb80b1ba0 0x7efeb80a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb8158e10 msgr2=0x7efeb8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb8158e10 0x7efeb8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 -- 172.21.15.50:0/3668784349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8009420 con 0x7efeb815d6d0 2023-12-24T20:10:49.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efebec8d700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7efeb000cc20 tx=0x7efeb0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000a8b0 con 0x7efeb815d6d0 2023-12-24T20:10:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000aa10 con 0x7efeb815d6d0 2023-12-24T20:10:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb816cfe0 con 0x7efeb815d6d0 2023-12-24T20:10:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000add0 con 0x7efeb815d6d0 2023-12-24T20:10:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.526+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb816d5a0 con 0x7efeb815d6d0 2023-12-24T20:10:49.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.530+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb80b4dd0 con 0x7efeb815d6d0 2023-12-24T20:10:49.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.530+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 122) v1 ==== 80120+0+0 (secure 0 0 0) 0x7efeb0007300 con 0x7efeb815d6d0 2023-12-24T20:10:49.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.534+0000 7efeae7fc700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 0x7efe9c062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.534+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6743+0+0 (secure 0 0 0) 0x7efeb007d360 con 0x7efeb815d6d0 2023-12-24T20:10:49.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.534+0000 7efebe48c700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 msgr2=0x7efe9c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:49.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.534+0000 7efebe48c700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 0x7efe9c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T20:10:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.538+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efeb004d2a0 con 0x7efeb815d6d0 2023-12-24T20:10:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.738+0000 7efebe48c700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 msgr2=0x7efe9c062bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6836/60640 2023-12-24T20:10:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.738+0000 7efebe48c700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 0x7efe9c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-24T20:10:49.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.746+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efeb80652e0 con 0x7efeb815d6d0 2023-12-24T20:10:49.750 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-24T20:10:49.746+0000 7f9b51f6e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:10:49.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.754+0000 7efeae7fc700 1 -- 172.21.15.50:0/3668784349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7efeb00508c0 con 0x7efeb815d6d0 2023-12-24T20:10:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 msgr2=0x7efe9c062bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T20:10:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 0x7efe9c062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 msgr2=0x7efeb8152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7efeb000cc20 tx=0x7efeb0001a40 comp rx=0 tx=0).stop 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 shutdown_connections 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7efe9c060700 0x7efe9c062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb815d6d0 0x7efeb8152e10 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb8158e10 0x7efeb8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 --2- 172.21.15.50:0/3668784349 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efeb80b1ba0 0x7efeb80a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 >> 172.21.15.50:0/3668784349 conn(0x7efeb80670b0 msgr2=0x7efeb8152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 shutdown_connections 2023-12-24T20:10:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.758+0000 7efec06f0700 1 -- 172.21.15.50:0/3668784349 wait complete. 2023-12-24T20:10:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:10:49.769 INFO:tasks.ceph.mds.a.smithi050.stderr: -2356> 2023-12-24T20:10:28.266+0000 7f72facf8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:10:49.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:10:49.812 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-24T20:10:49.941 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:49.938+0000 7f6bbe1b1000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T20:10:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 Processor -- start 2023-12-24T20:10:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 -- start start 2023-12-24T20:10:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24006a670 con 0x7ff2400aaf60 2023-12-24T20:10:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24006af10 con 0x7ff24015b430 2023-12-24T20:10:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24726e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400ab3b0 con 0x7ff240156df0 2023-12-24T20:10:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24500a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24500a700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:33428/0 (socket says 172.21.15.50:33428) 2023-12-24T20:10:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.950+0000 7ff24500a700 1 -- 172.21.15.50:0/931012862 learned_addr learned my addr 172.21.15.50:0/931012862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.954+0000 7ff24500a700 1 -- 172.21.15.50:0/931012862 >> v1:172.21.15.82:6789/0 conn(0x7ff24015b430 legacy=0x7ff2401571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.954+0000 7ff24500a700 1 -- 172.21.15.50:0/931012862 >> v1:172.21.15.50:6789/0 conn(0x7ff2400aaf60 legacy=0x7ff24015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.954+0000 7ff24500a700 1 -- 172.21.15.50:0/931012862 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24015ba50 con 0x7ff240156df0 2023-12-24T20:10:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.954+0000 7ff24500a700 1 --2- 172.21.15.50:0/931012862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00fb00 tx=0x7ff23c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c8ef3b0084233a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff237fff700 1 -- 172.21.15.50:0/931012862 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00f380 con 0x7ff240156df0 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff237fff700 1 -- 172.21.15.50:0/931012862 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c009a10 con 0x7ff240156df0 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff237fff700 1 -- 172.21.15.50:0/931012862 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c009db0 con 0x7ff240156df0 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 -- 172.21.15.50:0/931012862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 msgr2=0x7ff2400aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 --2- 172.21.15.50:0/931012862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00fb00 tx=0x7ff23c009250 comp rx=0 tx=0).stop 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 -- 172.21.15.50:0/931012862 shutdown_connections 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 --2- 172.21.15.50:0/931012862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff240156df0 0x7ff2400aaa20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 -- 172.21.15.50:0/931012862 >> 172.21.15.50:0/931012862 conn(0x7ff2400cbb10 msgr2=0x7ff2400cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:49.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 -- 172.21.15.50:0/931012862 shutdown_connections 2023-12-24T20:10:49.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 -- 172.21.15.50:0/931012862 wait complete. 2023-12-24T20:10:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.962+0000 7ff24726e700 1 Processor -- start 2023-12-24T20:10:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 -- start start 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2400aaf60 0x7ff240155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff24015b430 0x7ff2401596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c1460 con 0x7ff240156df0 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c3e60 con 0x7ff24015b430 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24726e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c0b30 con 0x7ff2400aaf60 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24580b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff24015b430 0x7ff2401596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44678/0 (socket says 172.21.15.50:44678) 2023-12-24T20:10:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 -- 172.21.15.50:0/2762380625 learned_addr learned my addr 172.21.15.50:0/2762380625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff24500a700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2400aaf60 0x7ff240155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 -- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2400aaf60 msgr2=0x7ff240155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2400aaf60 0x7ff240155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 -- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff24015b430 msgr2=0x7ff2401596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff24015b430 0x7ff2401596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 -- 172.21.15.50:0/2762380625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c00f610 con 0x7ff240156df0 2023-12-24T20:10:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.966+0000 7ff244809700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c790 tx=0x7ff230007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230011590 con 0x7ff240156df0 2023-12-24T20:10:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2300116f0 con 0x7ff240156df0 2023-12-24T20:10:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230011a70 con 0x7ff240156df0 2023-12-24T20:10:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2400c0e10 con 0x7ff240156df0 2023-12-24T20:10:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff240166a20 con 0x7ff240156df0 2023-12-24T20:10:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240068850 con 0x7ff240156df0 2023-12-24T20:10:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.970+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 124) v1 ==== 79672+0+0 (secure 0 0 0) 0x7ff23001c460 con 0x7ff240156df0 2023-12-24T20:10:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.974+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 7130+0+0 (secure 0 0 0) 0x7ff23007c180 con 0x7ff240156df0 2023-12-24T20:10:49.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:49.978+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff240068850 con 0x7ff240156df0 2023-12-24T20:10:50.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.066+0000 7f6b86915700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.066+0000 7f6b86915700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.066+0000 7f6b86915700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.066+0000 7f6b86915700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.070 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.066+0000 7f6b86915700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.071 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.070+0000 7f6b8a11c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.071 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.070+0000 7f6b8a11c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.071 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.070+0000 7f6b8a11c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.071 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.070+0000 7f6b8a11c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.071 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-24T20:10:50.070+0000 7f6b8a11c700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-24T20:10:50.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.250+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff240068850 con 0x7ff240156df0 2023-12-24T20:10:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.829+0000 7ff2357fa700 1 -- 172.21.15.50:0/2762380625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff240068850 con 0x7ff240156df0 2023-12-24T20:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.833+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 msgr2=0x7ff240159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.833+0000 7ff24726e700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c790 tx=0x7ff230007f40 comp rx=0 tx=0).stop 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 shutdown_connections 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff24015b430 0x7ff2401596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff240156df0 0x7ff240159160 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 --2- 172.21.15.50:0/2762380625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2400aaf60 0x7ff240155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 >> 172.21.15.50:0/2762380625 conn(0x7ff2400cbb10 msgr2=0x7ff2400c9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 shutdown_connections 2023-12-24T20:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:50.837+0000 7ff24726e700 1 -- 172.21.15.50:0/2762380625 wait complete. 2023-12-24T20:10:50.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:10:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.085+0000 7f595759e700 1 Processor -- start 2023-12-24T20:10:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.085+0000 7f595759e700 1 -- start start 2023-12-24T20:10:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f595759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59580cb1f0 0x7f59580ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f595759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595806cf30 0x7f5958155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f595759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580cb960 con 0x7f5958155b60 2023-12-24T20:10:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f595759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580cb680 con 0x7f595806cf30 2023-12-24T20:10:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f595759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c9900 con 0x7f59580cb1f0 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595806cf30 0x7f5958155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595806cf30 0x7f5958155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44812/0 (socket says 172.21.15.50:44812) 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 -- 172.21.15.50:0/2329525272 learned_addr learned my addr 172.21.15.50:0/2329525272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5955d9b700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59580cb1f0 0x7f59580ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 -- 172.21.15.50:0/2329525272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59580cb1f0 msgr2=0x7f59580ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59580cb1f0 0x7f59580ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 -- 172.21.15.50:0/2329525272 >> v1:172.21.15.82:6789/0 conn(0x7f5958155b60 legacy=0x7f595806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.089+0000 7f5956d9d700 1 -- 172.21.15.50:0/2329525272 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580c9be0 con 0x7f595806cf30 2023-12-24T20:10:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f5956d9d700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f5958155f30 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f20 tx=0x7f5950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dcd2c569b0b409 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595559a700 1 -- 172.21.15.50:0/2329525272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000e070 con 0x7f595806cf30 2023-12-24T20:10:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595559a700 1 -- 172.21.15.50:0/2329525272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000b9d0 con 0x7f595806cf30 2023-12-24T20:10:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595559a700 1 -- 172.21.15.50:0/2329525272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500092e0 con 0x7f595806cf30 2023-12-24T20:10:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 -- 172.21.15.50:0/2329525272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 msgr2=0x7f5958155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f5958155f30 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f20 tx=0x7f5950009840 comp rx=0 tx=0).stop 2023-12-24T20:10:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 -- 172.21.15.50:0/2329525272 shutdown_connections 2023-12-24T20:10:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f5958155f30 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 --2- 172.21.15.50:0/2329525272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59580cb1f0 0x7f59580ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 -- 172.21.15.50:0/2329525272 >> 172.21.15.50:0/2329525272 conn(0x7f5958067b40 msgr2=0x7f59580cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 -- 172.21.15.50:0/2329525272 shutdown_connections 2023-12-24T20:10:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.093+0000 7f595759e700 1 -- 172.21.15.50:0/2329525272 wait complete. 2023-12-24T20:10:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 Processor -- start 2023-12-24T20:10:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 -- start start 2023-12-24T20:10:51.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 0x7f5958146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5958155b60 0x7f59580ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958146c60 con 0x7f595806cf30 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958158560 con 0x7f59580cb1f0 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595759e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958158230 con 0x7f5958155b60 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 0x7f5958146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44828/0 (socket says 172.21.15.50:44828) 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595659c700 1 -- 172.21.15.50:0/2432149582 learned_addr learned my addr 172.21.15.50:0/2432149582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5956d9d700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5958155b60 0x7f59580ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 -- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5958155b60 msgr2=0x7f59580ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5958155b60 0x7f59580ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 -- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 msgr2=0x7f59580afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 -- 172.21.15.50:0/2432149582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009ae0 con 0x7f59580cb1f0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f595659c700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.097+0000 7f5955d9b700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 0x7f5958146720 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f594c00ea50 tx=0x7f594c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00c7f0 con 0x7f59580cb1f0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c00c970 con 0x7f59580cb1f0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00cd30 con 0x7f59580cb1f0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580af460 con 0x7f59580cb1f0 2023-12-24T20:10:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59580afa20 con 0x7f59580cb1f0 2023-12-24T20:10:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580afc40 con 0x7f59580cb1f0 2023-12-24T20:10:51.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.101+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 125) v1 ==== 79799+0+0 (secure 0 0 0) 0x7f594c013680 con 0x7f59580cb1f0 2023-12-24T20:10:51.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.105+0000 7f59467fc700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 0x7f5938062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:51.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.105+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 7130+0+0 (secure 0 0 0) 0x7f594c07d0b0 con 0x7f59580cb1f0 2023-12-24T20:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.105+0000 7f595659c700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 0x7f5938062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.105+0000 7f595659c700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 0x7f5938062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5948001df0 tx=0x7f5948009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.113+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f594c04d2f0 con 0x7f59580cb1f0 2023-12-24T20:10:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:51.289+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f595804be40 con 0x7f59580cb1f0 2023-12-24T20:10:52.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.029+0000 7f59467fc700 1 -- 172.21.15.50:0/2432149582 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v212) v1 ==== 181+0+0 (secure 0 0 0) 0x7f594c050910 con 0x7f59580cb1f0 2023-12-24T20:10:52.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 msgr2=0x7f5938062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 0x7f5938062850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5948001df0 tx=0x7f5948009040 comp rx=0 tx=0).stop 2023-12-24T20:10:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 msgr2=0x7f5958146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 0x7f5958146720 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f594c00ea50 tx=0x7f594c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 shutdown_connections 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f59380603a0 0x7f5938062850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5958155b60 0x7f59580ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59580cb1f0 0x7f5958146720 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 --2- 172.21.15.50:0/2432149582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595806cf30 0x7f59580afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 >> 172.21.15.50:0/2432149582 conn(0x7f5958067b40 msgr2=0x7f59580cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 shutdown_connections 2023-12-24T20:10:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.037+0000 7f595759e700 1 -- 172.21.15.50:0/2432149582 wait complete. 2023-12-24T20:10:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:10:52.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:10:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.233+0000 7fc2f7c2e700 1 Processor -- start 2023-12-24T20:10:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.233+0000 7fc2f7c2e700 1 -- start start 2023-12-24T20:10:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f7c2e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2f0154b80 0x7fc2f00c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f7c2e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00cc0d0 con 0x7fc2f01547b0 2023-12-24T20:10:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f7c2e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00cc3b0 con 0x7fc2f015aa60 2023-12-24T20:10:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f7c2e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f006da10 con 0x7fc2f0154b80 2023-12-24T20:10:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f59ca700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc2f01547b0 0x7fc2f006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48054/0 (socket says 172.21.15.50:48054) 2023-12-24T20:10:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f59ca700 1 -- 172.21.15.50:0/1463203894 learned_addr learned my addr 172.21.15.50:0/1463203894 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1463203894 >> v2:172.21.15.82:3300/0 conn(0x7fc2f0154b80 0x7fc2f00c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219195291 0 0) 0x7fc2f00cc0d0 con 0x7fc2f01547b0 2023-12-24T20:10:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003570 con 0x7fc2f01547b0 2023-12-24T20:10:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731869049 0 0) 0x7fc2dc003570 con 0x7fc2f01547b0 2023-12-24T20:10:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 >> v2:172.21.15.82:3300/0 conn(0x7fc2f0154b80 msgr2=0x7fc2f00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 --2- 172.21.15.50:0/1463203894 >> v2:172.21.15.82:3300/0 conn(0x7fc2f0154b80 0x7fc2f00c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 >> v1:172.21.15.82:6789/0 conn(0x7fc2f015aa60 legacy=0x7fc2f00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f006dcf0 con 0x7fc2f01547b0 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7fc2ec001470 con 0x7fc2f01547b0 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 >> v1:172.21.15.50:6789/0 conn(0x7fc2f01547b0 legacy=0x7fc2f006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2dc003a60 0x7fc2dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2dc0051c0 0x7fc2dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f006da10 con 0x7fc2dc004810 2023-12-24T20:10:52.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c160 con 0x7fc2dc0051c0 2023-12-24T20:10:52.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.237+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c320 con 0x7fc2dc003a60 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f61cb700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2dc0051c0 0x7fc2dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f59ca700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2dc003a60 0x7fc2dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 -- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2dc003a60 msgr2=0x7fc2dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2dc003a60 0x7fc2dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 -- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2dc0051c0 msgr2=0x7fc2dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2dc0051c0 0x7fc2dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 -- 172.21.15.50:0/1463203894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003570 con 0x7fc2dc004810 2023-12-24T20:10:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f61cb700 1 -- 172.21.15.50:0/1463203894 reap_dead start 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0154fb0 tx=0x7fc2e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06a9b836c67ae9a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000e710 con 0x7fc2dc004810 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000e870 con 0x7fc2dc004810 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f49c8700 1 -- 172.21.15.50:0/1463203894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000ec30 con 0x7fc2dc004810 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 msgr2=0x7fc2dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0154fb0 tx=0x7fc2e00091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1463203894 shutdown_connections 2023-12-24T20:10:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1463203894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.241+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1463203894 >> 172.21.15.50:0/1463203894 conn(0x7fc2f0069d90 msgr2=0x7fc2f00cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:52.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1463203894 shutdown_connections 2023-12-24T20:10:52.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1463203894 wait complete. 2023-12-24T20:10:52.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 Processor -- start 2023-12-24T20:10:52.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- start start 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f0157230 0x7fc2f0157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 0x7fc2f00c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c4be0 con 0x7fc2dc004810 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0067400 con 0x7fc2f00c4230 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f7c2e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00670b0 con 0x7fc2f0157230 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f59ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f59ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44844/0 (socket says 172.21.15.50:44844) 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.245+0000 7fc2f59ca700 1 -- 172.21.15.50:0/1065326436 learned_addr learned my addr 172.21.15.50:0/1065326436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f61cb700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 0x7fc2f00c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f0157230 0x7fc2f0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 -- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f0157230 msgr2=0x7fc2f0157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f0157230 0x7fc2f0157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 -- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 msgr2=0x7fc2f00c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 0x7fc2f00c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 -- 172.21.15.50:0/1065326436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0157c60 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f61cb700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 0x7fc2f00c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f59ca700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007390 tx=0x7fc2f00cc320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec018030 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec00f870 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00fc10 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f0157f40 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.249+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f0150d60 con 0x7fc2dc004810 2023-12-24T20:10:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.253+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0158440 con 0x7fc2dc004810 2023-12-24T20:10:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.253+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 125) v1 ==== 79799+0+0 (secure 0 0 0) 0x7fc2ec01b070 con 0x7fc2dc004810 2023-12-24T20:10:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.253+0000 7fc2e5ffb700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 0x7fc2d4062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.253+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc2ec019070 con 0x7fc2dc004810 2023-12-24T20:10:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.253+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 0x7fc2d4062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.257+0000 7fc2f51c9700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 0x7fc2d4062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00091e0 tx=0x7fc2e001a000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.261+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc2ec04cc30 con 0x7fc2dc004810 2023-12-24T20:10:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.437+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2f0071060 con 0x7fc2dc004810 2023-12-24T20:10:52.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:52.861+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc2ec04d000 con 0x7fc2dc004810 2023-12-24T20:10:53.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.033+0000 7fc2e5ffb700 1 -- 172.21.15.50:0/1065326436 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v213) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2ec0752a0 con 0x7fc2dc004810 2023-12-24T20:10:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.037+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 msgr2=0x7fc2d4062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.037+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 0x7fc2d4062850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00091e0 tx=0x7fc2e001a000 comp rx=0 tx=0).stop 2023-12-24T20:10:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.037+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 msgr2=0x7fc2f0158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.037+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007390 tx=0x7fc2f00cc320 comp rx=0 tx=0).stop 2023-12-24T20:10:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 shutdown_connections 2023-12-24T20:10:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc2d40603a0 0x7fc2d4062850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f00c4230 0x7fc2f00c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f0157230 0x7fc2f0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 --2- 172.21.15.50:0/1065326436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2dc004810 0x7fc2f0158df0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 >> 172.21.15.50:0/1065326436 conn(0x7fc2f0069d90 msgr2=0x7fc2f0156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 shutdown_connections 2023-12-24T20:10:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.041+0000 7fc2f7c2e700 1 -- 172.21.15.50:0/1065326436 wait complete. 2023-12-24T20:10:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-24T20:10:53.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-12-24T20:10:53.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 Processor -- start 2023-12-24T20:10:53.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 -- start start 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff6c1404a0 0x7eff6c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c15af50 0x7eff6c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c06ccc0 con 0x7eff6c140870 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c15b990 con 0x7eff6c1404a0 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.233+0000 7eff72cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c15b3d0 con 0x7eff6c15af50 2023-12-24T20:10:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff7128d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7eff6c140870 0x7eff6c06d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48060/0 (socket says 172.21.15.50:48060) 2023-12-24T20:10:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff7128d700 1 -- 172.21.15.50:0/1382899386 learned_addr learned my addr 172.21.15.50:0/1382899386 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff63fff700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c15af50 0x7eff6c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1382899386 >> v2:172.21.15.50:3300/0 conn(0x7eff6c1404a0 0x7eff6c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926194147 0 0) 0x7eff6c06ccc0 con 0x7eff6c140870 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff54003570 con 0x7eff6c140870 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 -- 172.21.15.50:0/1382899386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c15af50 msgr2=0x7eff6c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c15af50 0x7eff6c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 -- 172.21.15.50:0/1382899386 >> v1:172.21.15.50:6789/0 conn(0x7eff6c140870 legacy=0x7eff6c06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923408153 0 0) 0x7eff54003570 con 0x7eff6c140870 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 -- 172.21.15.50:0/1382899386 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c15b6b0 con 0x7eff6c1404a0 2023-12-24T20:10:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c15aa10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7eff680098e0 tx=0x7eff680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cef78e0481ee69 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640017f0 con 0x7eff6c1404a0 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff68011420 con 0x7eff6c1404a0 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff637fe700 1 -- 172.21.15.50:0/1382899386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680117c0 con 0x7eff6c1404a0 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 -- 172.21.15.50:0/1382899386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 msgr2=0x7eff6c15aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c15aa10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7eff680098e0 tx=0x7eff680091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 -- 172.21.15.50:0/1382899386 shutdown_connections 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c15af50 0x7eff6c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1382899386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c15aa10 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 -- 172.21.15.50:0/1382899386 >> 172.21.15.50:0/1382899386 conn(0x7eff6c067b80 msgr2=0x7eff6c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 -- 172.21.15.50:0/1382899386 shutdown_connections 2023-12-24T20:10:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.237+0000 7eff72cf0700 1 -- 172.21.15.50:0/1382899386 wait complete. 2023-12-24T20:10:53.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.241+0000 7eff72cf0700 1 Processor -- start 2023-12-24T20:10:53.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.241+0000 7eff72cf0700 1 -- start start 2023-12-24T20:10:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c140870 0x7eff6c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff6c1633a0 0x7eff6c163820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1628a0 con 0x7eff6c1404a0 2023-12-24T20:10:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c163d60 con 0x7eff6c1633a0 2023-12-24T20:10:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c161c90 con 0x7eff6c140870 2023-12-24T20:10:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44874/0 (socket says 172.21.15.50:44874) 2023-12-24T20:10:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 -- 172.21.15.50:0/1836157922 learned_addr learned my addr 172.21.15.50:0/1836157922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff63fff700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c140870 0x7eff6c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff7128d700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff6c1633a0 0x7eff6c163820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 -- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c140870 msgr2=0x7eff6c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c140870 0x7eff6c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 -- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff6c1633a0 msgr2=0x7eff6c163820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff6c1633a0 0x7eff6c163820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 -- 172.21.15.50:0/1836157922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68009420 con 0x7eff6c1404a0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff70a8c700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7eff6c069b20 tx=0x7eff68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6801cba0 con 0x7eff6c1404a0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6801cd00 con 0x7eff6c1404a0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6801a660 con 0x7eff6c1404a0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c161f70 con 0x7eff6c1404a0 2023-12-24T20:10:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.245+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c162530 con 0x7eff6c1404a0 2023-12-24T20:10:53.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.249+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c068840 con 0x7eff6c1404a0 2023-12-24T20:10:53.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.249+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7eff6801aa50 con 0x7eff6c1404a0 2023-12-24T20:10:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.249+0000 7eff60ff9700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 0x7eff58062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.249+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7eff6807e270 con 0x7eff6c1404a0 2023-12-24T20:10:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.253+0000 7eff63fff700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 0x7eff58062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.253+0000 7eff63fff700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 0x7eff58062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff6c15a2b0 tx=0x7eff5c0091a0 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.257+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff6c068840 con 0x7eff6c1404a0 2023-12-24T20:10:53.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.425+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7eff6c068840 con 0x7eff6c1404a0 2023-12-24T20:10:53.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.433+0000 7eff60ff9700 1 -- 172.21.15.50:0/1836157922 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v73) v1 ==== 115+0+0 (secure 0 0 0) 0x7eff6c068840 con 0x7eff6c1404a0 2023-12-24T20:10:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 msgr2=0x7eff58062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 0x7eff58062a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff6c15a2b0 tx=0x7eff5c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 msgr2=0x7eff6c162d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7eff6c069b20 tx=0x7eff68016000 comp rx=0 tx=0).stop 2023-12-24T20:10:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 shutdown_connections 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7eff58060550 0x7eff58062a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff6c1633a0 0x7eff6c163820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff6c140870 0x7eff6c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 --2- 172.21.15.50:0/1836157922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff6c1404a0 0x7eff6c162d30 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 >> 172.21.15.50:0/1836157922 conn(0x7eff6c067b80 msgr2=0x7eff6c0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 shutdown_connections 2023-12-24T20:10:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.437+0000 7eff72cf0700 1 -- 172.21.15.50:0/1836157922 wait complete. 2023-12-24T20:10:53.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-12-24T20:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 Processor -- start 2023-12-24T20:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 -- start start 2023-12-24T20:10:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f4156ab0 0x7f49f4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49f40c8ee0 0x7f49f40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f415b5a0 con 0x7f49f40adb50 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f415a990 con 0x7f49f4156ab0 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.629+0000 7f49fb0e3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f415ac70 con 0x7f49f40c8ee0 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49f40adb50 0x7f49f40c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48070/0 (socket says 172.21.15.50:48070) 2023-12-24T20:10:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 -- 172.21.15.50:0/1960503769 learned_addr learned my addr 172.21.15.50:0/1960503769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/1960503769 >> v2:172.21.15.50:3300/0 conn(0x7f49f4156ab0 0x7f49f4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa8e2700 1 --2- 172.21.15.50:0/1960503769 >> v2:172.21.15.82:3300/0 conn(0x7f49f40c8ee0 0x7f49f40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439201346 0 0) 0x7f49f415b5a0 con 0x7f49f40adb50 2023-12-24T20:10:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e0003570 con 0x7f49f40adb50 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 483202965 0 0) 0x7f49e0003570 con 0x7f49f40adb50 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 >> v2:172.21.15.82:3300/0 conn(0x7f49f40c8ee0 msgr2=0x7f49f40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 --2- 172.21.15.50:0/1960503769 >> v2:172.21.15.82:3300/0 conn(0x7f49f40c8ee0 0x7f49f40adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 >> v2:172.21.15.50:3300/0 conn(0x7f49f4156ab0 msgr2=0x7f49f4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 --2- 172.21.15.50:0/1960503769 >> v2:172.21.15.50:3300/0 conn(0x7f49f4156ab0 0x7f49f4156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f415af50 con 0x7f49f40adb50 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f49e4001470 con 0x7f49f40adb50 2023-12-24T20:10:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 >> v1:172.21.15.50:6789/0 conn(0x7f49f40adb50 legacy=0x7f49f40c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e0003a60 0x7f49e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 0x7f49e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e00051c0 0x7f49e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415a990 con 0x7f49e0003a60 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415ac70 con 0x7f49e0004810 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e000bfd0 con 0x7f49e00051c0 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/1960503769 >> v2:172.21.15.50:3300/0 conn(0x7f49f4156ab0 0x7f49f4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 0x7f49e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa8e2700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e00051c0 0x7f49e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e0003a60 0x7f49e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 -- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e00051c0 msgr2=0x7f49e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e00051c0 0x7f49e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 -- 172.21.15.50:0/1960503769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e0003a60 msgr2=0x7f49e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e0003a60 0x7f49e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 -- 172.21.15.50:0/1960503769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0003570 con 0x7f49e0004810 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49fa8e2700 1 -- 172.21.15.50:0/1960503769 reap_dead start 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.633+0000 7f49f98e0700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 0x7f49e0004c80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c390 tx=0x7f49e4001e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b69c9175e7b4369d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400cbe0 con 0x7f49e0004810 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400cd80 con 0x7f49e0004810 2023-12-24T20:10:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49f90df700 1 -- 172.21.15.50:0/1960503769 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4005b70 con 0x7f49e0004810 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 -- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 msgr2=0x7f49e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 0x7f49e0004c80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c390 tx=0x7f49e4001e90 comp rx=0 tx=0).stop 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 -- 172.21.15.50:0/1960503769 shutdown_connections 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/1960503769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e0004810 0x7f49e0004c80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 -- 172.21.15.50:0/1960503769 >> 172.21.15.50:0/1960503769 conn(0x7f49f4067250 msgr2=0x7f49f4067650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 -- 172.21.15.50:0/1960503769 shutdown_connections 2023-12-24T20:10:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.637+0000 7f49fb0e3700 1 -- 172.21.15.50:0/1960503769 wait complete. 2023-12-24T20:10:53.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 Processor -- start 2023-12-24T20:10:53.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- start start 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 0x7f49f40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 0x7f49f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4157e10 con 0x7f49f40c5a70 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4156e80 con 0x7f49f4151d50 2023-12-24T20:10:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c5ee0 con 0x7f49e0004810 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44906/0 (socket says 172.21.15.50:44906) 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 -- 172.21.15.50:0/3138219839 learned_addr learned my addr 172.21.15.50:0/3138219839 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fa8e2700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 0x7f49f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 -- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 msgr2=0x7f49f40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 0x7f49f40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 0x7f49f40c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 -- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 msgr2=0x7f49f406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 0x7f49f406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 -- 172.21.15.50:0/3138219839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40c23b0 con 0x7f49f40c5a70 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 0x7f49f40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fa8e2700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 0x7f49f406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49f98e0700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f49e000bfa0 tx=0x7f49e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400cbe0 con 0x7f49f40c5a70 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40c2690 con 0x7f49f40c5a70 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4001bb0 con 0x7f49f40c5a70 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4007550 con 0x7f49f40c5a70 2023-12-24T20:10:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.641+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f41573b0 con 0x7f49f40c5a70 2023-12-24T20:10:53.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.645+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f404be40 con 0x7f49f40c5a70 2023-12-24T20:10:53.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.645+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f49e401e430 con 0x7f49f40c5a70 2023-12-24T20:10:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.645+0000 7f49ea7fc700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 0x7f49d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.645+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f49e407d700 con 0x7f49f40c5a70 2023-12-24T20:10:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.645+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 0x7f49d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.649+0000 7f49fa0e1700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 0x7f49d8062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006f00 tx=0x7f49f0008040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:53.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.653+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49e404dab0 con 0x7f49f40c5a70 2023-12-24T20:10:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.825+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f49f415b230 con 0x7f49f40c5a70 2023-12-24T20:10:53.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.837+0000 7f49ea7fc700 1 -- 172.21.15.50:0/3138219839 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v74) v1 ==== 120+0+0 (secure 0 0 0) 0x7f49e40510d0 con 0x7f49f40c5a70 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 msgr2=0x7f49d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 0x7f49d8062a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006f00 tx=0x7f49f0008040 comp rx=0 tx=0).stop 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 msgr2=0x7f49f41578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f49e000bfa0 tx=0x7f49e4015000 comp rx=0 tx=0).stop 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 shutdown_connections 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f49d8060550 0x7f49d8062a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f4151d50 0x7f49f406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f40c5a70 0x7f49f41578d0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 --2- 172.21.15.50:0/3138219839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49e0004810 0x7f49f40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 >> 172.21.15.50:0/3138219839 conn(0x7f49f4067250 msgr2=0x7f49f40c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 shutdown_connections 2023-12-24T20:10:53.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:53.841+0000 7f49fb0e3700 1 -- 172.21.15.50:0/3138219839 wait complete. 2023-12-24T20:10:53.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:10:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.041+0000 7f17e2a8e700 1 Processor -- start 2023-12-24T20:10:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.041+0000 7f17e2a8e700 1 -- start start 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e2a8e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17dc0cc780 0x7f17dc0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e2a8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17dc06cd40 0x7f17dc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e2a8e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc06a580 con 0x7f17dc158c40 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e2a8e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0cd110 con 0x7f17dc06cd40 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e2a8e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc06a7d0 con 0x7f17dc0cc780 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e228d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17dc06cd40 0x7f17dc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e128b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17dc0cc780 0x7f17dc0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e228d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17dc06cd40 0x7f17dc06d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44922/0 (socket says 172.21.15.50:44922) 2023-12-24T20:10:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e228d700 1 -- 172.21.15.50:0/2510909293 learned_addr learned my addr 172.21.15.50:0/2510909293 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.045+0000 7f17e1a8c700 1 --1- 172.21.15.50:0/2510909293 >> v1:172.21.15.82:6789/0 conn(0x7f17dc158c40 0x7f17dc0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42562/0 (socket says 172.21.15.50:42562) 2023-12-24T20:10:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e228d700 1 -- 172.21.15.50:0/2510909293 >> v2:172.21.15.82:3300/0 conn(0x7f17dc0cc780 msgr2=0x7f17dc0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e228d700 1 --2- 172.21.15.50:0/2510909293 >> v2:172.21.15.82:3300/0 conn(0x7f17dc0cc780 0x7f17dc0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e228d700 1 -- 172.21.15.50:0/2510909293 >> v1:172.21.15.82:6789/0 conn(0x7f17dc158c40 legacy=0x7f17dc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e228d700 1 -- 172.21.15.50:0/2510909293 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc06aab0 con 0x7f17dc06cd40 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e228d700 1 --2- 172.21.15.50:0/2510909293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc06d180 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f17dc069010 tx=0x7f17d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aae08e024db8a8b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e0a8a700 1 -- 172.21.15.50:0/2510909293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400e070 con 0x7f17dc06cd40 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e0a8a700 1 -- 172.21.15.50:0/2510909293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d400ba20 con 0x7f17dc06cd40 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e0a8a700 1 -- 172.21.15.50:0/2510909293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40092e0 con 0x7f17dc06cd40 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2510909293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 msgr2=0x7f17dc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2510909293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc06d180 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f17dc069010 tx=0x7f17d4009840 comp rx=0 tx=0).stop 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2510909293 shutdown_connections 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2510909293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc06d180 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2510909293 >> v2:172.21.15.82:3300/0 conn(0x7f17dc0cc780 0x7f17dc0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2510909293 >> 172.21.15.50:0/2510909293 conn(0x7f17dc0d0800 msgr2=0x7f17dc0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2510909293 shutdown_connections 2023-12-24T20:10:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.049+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2510909293 wait complete. 2023-12-24T20:10:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 Processor -- start 2023-12-24T20:10:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 -- start start 2023-12-24T20:10:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 0x7f17dc1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 0x7f17dc16a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc16c7c0 con 0x7f17dc06cd40 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc14f170 con 0x7f17dc0cc780 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc141ce0 con 0x7f17dc158c40 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44924/0 (socket says 172.21.15.50:44924) 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 -- 172.21.15.50:0/2207848444 learned_addr learned my addr 172.21.15.50:0/2207848444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e228d700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 0x7f17dc16a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e128b700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 0x7f17dc1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 -- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 msgr2=0x7f17dc16a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 0x7f17dc16a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 -- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 msgr2=0x7f17dc1417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 0x7f17dc1417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 -- 172.21.15.50:0/2207848444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4009ae0 con 0x7f17dc06cd40 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e128b700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 0x7f17dc1417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e228d700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 0x7f17dc16a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e1a8c700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c560 tx=0x7f17d8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8005a70 con 0x7f17dc06cd40 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8005bd0 con 0x7f17dc06cd40 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80070d0 con 0x7f17dc06cd40 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.053+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc16b1e0 con 0x7f17dc06cd40 2023-12-24T20:10:54.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.057+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc16b7a0 con 0x7f17dc06cd40 2023-12-24T20:10:54.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.057+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc06ca60 con 0x7f17dc06cd40 2023-12-24T20:10:54.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.057+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f17d8007440 con 0x7f17dc06cd40 2023-12-24T20:10:54.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.057+0000 7f17d1ffb700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.057+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f17d807bee0 con 0x7f17dc06cd40 2023-12-24T20:10:54.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.061+0000 7f17e128b700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.061+0000 7f17e128b700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 0x7f17c0062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ccfb0 tx=0x7f17cc008040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.065+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f17dc06ca60 con 0x7f17dc06cd40 2023-12-24T20:10:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.249+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f17dc06ca60 con 0x7f17dc06cd40 2023-12-24T20:10:54.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.261+0000 7f17d1ffb700 1 -- 172.21.15.50:0/2207848444 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7f17dc06ca60 con 0x7f17dc06cd40 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 msgr2=0x7f17c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 0x7f17c0062a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ccfb0 tx=0x7f17cc008040 comp rx=0 tx=0).stop 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 msgr2=0x7f17dc16c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c560 tx=0x7f17d8007f70 comp rx=0 tx=0).stop 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 shutdown_connections 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f17c0060550 0x7f17c0062a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17dc158c40 0x7f17dc16a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17dc0cc780 0x7f17dc1417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 --2- 172.21.15.50:0/2207848444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17dc06cd40 0x7f17dc16c280 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 >> 172.21.15.50:0/2207848444 conn(0x7f17dc0d0800 msgr2=0x7f17dc155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 shutdown_connections 2023-12-24T20:10:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.265+0000 7f17e2a8e700 1 -- 172.21.15.50:0/2207848444 wait complete. 2023-12-24T20:10:54.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-12-24T20:10:54.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.453+0000 7f89f2acd700 1 Processor -- start 2023-12-24T20:10:54.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.453+0000 7f89f2acd700 1 -- start start 2023-12-24T20:10:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f2acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f2acd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89ec154450 0x7f89ec1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f2acd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec06c820 con 0x7f89ec06aca0 2023-12-24T20:10:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f2acd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec154de0 con 0x7f89ec154450 2023-12-24T20:10:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f2acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06b960 con 0x7f89ec0c6d00 2023-12-24T20:10:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f0869700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89ebfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89ec154450 0x7f89ec1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f0869700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.50:33614/0 (socket says 172.21.15.50:33614) 2023-12-24T20:10:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f0869700 1 -- 172.21.15.50:0/470992649 learned_addr learned my addr 172.21.15.50:0/470992649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f106a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f89ec06aca0 0x7f89ec06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42564/0 (socket says 172.21.15.50:42564) 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89ebfff700 1 -- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 msgr2=0x7f89ec0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89ebfff700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89ebfff700 1 -- 172.21.15.50:0/470992649 >> v1:172.21.15.82:6789/0 conn(0x7f89ec06aca0 legacy=0x7f89ec06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89ebfff700 1 -- 172.21.15.50:0/470992649 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec06bc40 con 0x7f89ec154450 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.457+0000 7f89f0869700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:10:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89ebfff700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec154450 0x7f89ec1548a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098e0 tx=0x7f89d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aa8bf0cee8c33f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89eb7fe700 1 -- 172.21.15.50:0/470992649 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800b640 con 0x7f89ec154450 2023-12-24T20:10:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89eb7fe700 1 -- 172.21.15.50:0/470992649 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800b7a0 con 0x7f89ec154450 2023-12-24T20:10:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89eb7fe700 1 -- 172.21.15.50:0/470992649 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800bb40 con 0x7f89ec154450 2023-12-24T20:10:54.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 -- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec154450 msgr2=0x7f89ec1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec154450 0x7f89ec1548a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098e0 tx=0x7f89d80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 -- 172.21.15.50:0/470992649 shutdown_connections 2023-12-24T20:10:54.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec154450 0x7f89ec1548a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 --2- 172.21.15.50:0/470992649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec0c6d00 0x7f89ec0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 -- 172.21.15.50:0/470992649 >> 172.21.15.50:0/470992649 conn(0x7f89ec0cbba0 msgr2=0x7f89ec0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:54.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 -- 172.21.15.50:0/470992649 shutdown_connections 2023-12-24T20:10:54.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.461+0000 7f89f2acd700 1 -- 172.21.15.50:0/470992649 wait complete. 2023-12-24T20:10:54.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 Processor -- start 2023-12-24T20:10:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 -- start start 2023-12-24T20:10:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec06aca0 0x7f89ec154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec154450 0x7f89ec0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec152800 con 0x7f89ec0c6d00 2023-12-24T20:10:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec172500 con 0x7f89ec06aca0 2023-12-24T20:10:54.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f2acd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec1718f0 con 0x7f89ec154450 2023-12-24T20:10:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44928/0 (socket says 172.21.15.50:44928) 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 -- 172.21.15.50:0/3314709464 learned_addr learned my addr 172.21.15.50:0/3314709464 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f106a700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec154450 0x7f89ec0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89f0869700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec06aca0 0x7f89ec154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 -- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec154450 msgr2=0x7f89ec0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec154450 0x7f89ec0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 -- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec06aca0 msgr2=0x7f89ec154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec06aca0 0x7f89ec154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 -- 172.21.15.50:0/3314709464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00094f0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.465+0000 7f89ebfff700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f89d800a010 tx=0x7f89d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d801bab0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d801bc30 con 0x7f89ec0c6d00 2023-12-24T20:10:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8025420 con 0x7f89ec0c6d00 2023-12-24T20:10:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8009420 con 0x7f89ec0c6d00 2023-12-24T20:10:54.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec171eb0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0652e0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.469+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f89d8023070 con 0x7f89ec0c6d00 2023-12-24T20:10:54.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.473+0000 7f89e8ff9700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 0x7f89d0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:54.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.473+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f89d807dcc0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.473+0000 7f89f0869700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 0x7f89d0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:54.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.473+0000 7f89f0869700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 0x7f89d0062ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006d20 tx=0x7f89e0009250 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:54.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.481+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89d8084080 con 0x7f89ec0c6d00 2023-12-24T20:10:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.709+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f89ec06bf20 con 0x7f89ec0c6d00 2023-12-24T20:10:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.865+0000 7f89e8ff9700 1 -- 172.21.15.50:0/3314709464 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3076) v1 ==== 155+0+0 (secure 0 0 0) 0x7f89d80150e0 con 0x7f89ec0c6d00 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 msgr2=0x7f89d0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 0x7f89d0062ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006d20 tx=0x7f89e0009250 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 msgr2=0x7f89ec1522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f89d800a010 tx=0x7f89d8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 shutdown_connections 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f89d0060620 0x7f89d0062ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89ec154450 0x7f89ec0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89ec0c6d00 0x7f89ec1522c0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 --2- 172.21.15.50:0/3314709464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89ec06aca0 0x7f89ec154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 >> 172.21.15.50:0/3314709464 conn(0x7f89ec0cbba0 msgr2=0x7f89ec0c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:54.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 shutdown_connections 2023-12-24T20:10:54.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:54.869+0000 7f89f2acd700 1 -- 172.21.15.50:0/3314709464 wait complete. 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner: 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5622.790s 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner: 2023-12-24T20:10:54.896 INFO:tasks.cephfs_test_runner:OK 2023-12-24T20:10:54.897 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-24T20:10:54.908 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-24T20:10:54.979 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-24T20:10:54.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:54.980 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T20:10:55.000 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:10:55.000 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:10:55.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:10:55.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:10:55.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-24T20:10:55.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.376 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-24T20:10:55.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-24T20:10:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-12-24T20:10:55.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:10:55.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.490 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T20:10:55.511 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:10:55.511 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:10:55.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:10:55.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:10:55.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-12-24T20:10:55.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.896 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-12-24T20:10:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:10:55.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-12-24T20:10:55.998 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-12-24T20:10:56.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:10:56.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-24T20:10:56.012 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-12-24T20:10:56.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:56.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.185+0000 7f24e3e6e700 1 Processor -- start 2023-12-24T20:10:56.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.185+0000 7f24e3e6e700 1 -- start start 2023-12-24T20:10:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e3e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 0x7f24dc168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e3e6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc06ca50 con 0x7f24dc0ca3a0 2023-12-24T20:10:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e3e6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc06b520 con 0x7f24dc0ca770 2023-12-24T20:10:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e3e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0c6980 con 0x7f24dc06def0 2023-12-24T20:10:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e1c0a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24dc0ca3a0 0x7f24dc06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48072/0 (socket says 172.21.15.50:48072) 2023-12-24T20:10:56.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e1c0a700 1 -- 172.21.15.50:0/1990359118 learned_addr learned my addr 172.21.15.50:0/1990359118 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:56.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e240b700 1 --2- 172.21.15.50:0/1990359118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 0x7f24dc168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319968993 0 0) 0x7f24dc06ca50 con 0x7f24dc0ca3a0 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c8003570 con 0x7f24dc0ca3a0 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385193469 0 0) 0x7f24dc06b520 con 0x7f24dc0ca770 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24dc06ca50 con 0x7f24dc0ca770 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e240b700 1 -- 172.21.15.50:0/1990359118 >> v1:172.21.15.82:6789/0 conn(0x7f24dc0ca770 legacy=0x7f24dc15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643214445 0 0) 0x7f24c8003570 con 0x7f24dc0ca3a0 2023-12-24T20:10:56.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e240b700 1 -- 172.21.15.50:0/1990359118 >> v1:172.21.15.50:6789/0 conn(0x7f24dc0ca3a0 legacy=0x7f24dc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.189+0000 7f24e240b700 1 -- 172.21.15.50:0/1990359118 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc06b7f0 con 0x7f24dc06def0 2023-12-24T20:10:56.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e240b700 1 --2- 172.21.15.50:0/1990359118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 0x7f24dc168380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009910 tx=0x7f24d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97969dc9e44a616d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80017f0 con 0x7f24dc06def0 2023-12-24T20:10:56.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4011420 con 0x7f24dc06def0 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e0c08700 1 -- 172.21.15.50:0/1990359118 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d40117c0 con 0x7f24dc06def0 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 -- 172.21.15.50:0/1990359118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 msgr2=0x7f24dc168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/1990359118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 0x7f24dc168380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009910 tx=0x7f24d40091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 -- 172.21.15.50:0/1990359118 shutdown_connections 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/1990359118 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc06def0 0x7f24dc168380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 -- 172.21.15.50:0/1990359118 >> 172.21.15.50:0/1990359118 conn(0x7f24dc0cbba0 msgr2=0x7f24dc0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:56.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 -- 172.21.15.50:0/1990359118 shutdown_connections 2023-12-24T20:10:56.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.193+0000 7f24e3e6e700 1 -- 172.21.15.50:0/1990359118 wait complete. 2023-12-24T20:10:56.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 Processor -- start 2023-12-24T20:10:56.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 -- start start 2023-12-24T20:10:56.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc0ca3a0 0x7f24dc0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24dc0ca770 0x7f24dc15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0aed70 con 0x7f24dc06def0 2023-12-24T20:10:56.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc15ad60 con 0x7f24dc0ca770 2023-12-24T20:10:56.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e3e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc156cd0 con 0x7f24dc0ca3a0 2023-12-24T20:10:56.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44942/0 (socket says 172.21.15.50:44942) 2023-12-24T20:10:56.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 -- 172.21.15.50:0/2376362944 learned_addr learned my addr 172.21.15.50:0/2376362944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1409700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc0ca3a0 0x7f24dc0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e240b700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24dc0ca770 0x7f24dc15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 -- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc0ca3a0 msgr2=0x7f24dc0b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc0ca3a0 0x7f24dc0b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 -- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24dc0ca770 msgr2=0x7f24dc15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24dc0ca770 0x7f24dc15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.197+0000 7f24e1c0a700 1 -- 172.21.15.50:0/2376362944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009420 con 0x7f24dc06def0 2023-12-24T20:10:56.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24e1c0a700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f24d800cca0 tx=0x7f24d8007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8004dc0 con 0x7f24dc06def0 2023-12-24T20:10:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800a920 con 0x7f24dc06def0 2023-12-24T20:10:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc156fb0 con 0x7f24dc06def0 2023-12-24T20:10:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800ace0 con 0x7f24dc06def0 2023-12-24T20:10:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc0b1330 con 0x7f24dc06def0 2023-12-24T20:10:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.201+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc157490 con 0x7f24dc06def0 2023-12-24T20:10:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.205+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f24d8007360 con 0x7f24dc06def0 2023-12-24T20:10:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.205+0000 7f24d1ffb700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 0x7f24c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.205+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f24d807c5e0 con 0x7f24dc06def0 2023-12-24T20:10:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.205+0000 7f24e1409700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 0x7f24c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.205+0000 7f24e1409700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 0x7f24c0062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f24dc1547d0 tx=0x7f24cc009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.209+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f24d804c970 con 0x7f24dc06def0 2023-12-24T20:10:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.389+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24dc0652e0 con 0x7f24dc06def0 2023-12-24T20:10:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.393+0000 7f24d1ffb700 1 -- 172.21.15.50:0/2376362944 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+13934 (secure 0 0 0) 0x7f24d804ff90 con 0x7f24dc06def0 2023-12-24T20:10:56.396 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:56.396 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":213,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:53.027021+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/223634262":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3075036454":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3088471577":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3416804369":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/1332160266":"2023-12-25T20:10:49.946261+0000","172.21.15.50:6835/655876048":"2023-12-25T20:10:49.751782+0000","172.21.15.50:6833/655876048":"2023-12-25T20:10:49.751782+0000","172.21.15.50:0/3930073332":"2023-12-25T20:10:49.946261+0000","172.21.15.50:6837/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:6836/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2591226244":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/864703980":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/2616996407":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/3338446156":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/90516501":"2023-12-25T20:10:40.765402+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.393+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 msgr2=0x7f24c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.393+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 0x7f24c0062a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f24dc1547d0 tx=0x7f24cc009040 comp rx=0 tx=0).stop 2023-12-24T20:10:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.393+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 msgr2=0x7f24dc15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.393+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f24d800cca0 tx=0x7f24d8007da0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 shutdown_connections 2023-12-24T20:10:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f24c0060550 0x7f24c0062a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24dc0ca770 0x7f24dc15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f24dc0ca3a0 0x7f24dc0b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 --2- 172.21.15.50:0/2376362944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24dc06def0 0x7f24dc15a820 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 >> 172.21.15.50:0/2376362944 conn(0x7f24dc0cbba0 msgr2=0x7f24dc0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 shutdown_connections 2023-12-24T20:10:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.397+0000 7f24e3e6e700 1 -- 172.21.15.50:0/2376362944 wait complete. 2023-12-24T20:10:56.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-24T20:10:56.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.577+0000 7f4cebccd700 1 Processor -- start 2023-12-24T20:10:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.577+0000 7f4cebccd700 1 -- start start 2023-12-24T20:10:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cebccd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ce40bfe30 0x7f4ce40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cebccd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cebccd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce415db20 con 0x7f4ce40c74c0 2023-12-24T20:10:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cebccd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce40c8030 con 0x7f4ce40bfe30 2023-12-24T20:10:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cebccd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce41621f0 con 0x7f4ce40c0200 2023-12-24T20:10:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ce40bfe30 0x7f4ce40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cea26a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4ce40c74c0 0x7f4ce40c7920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:42568/0 (socket says 172.21.15.50:42568) 2023-12-24T20:10:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4cea26a700 1 -- 172.21.15.50:0/871731133 learned_addr learned my addr 172.21.15.50:0/871731133 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9268700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 -- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 msgr2=0x7f4ce40c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 --2- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 -- 172.21.15.50:0/871731133 >> v1:172.21.15.82:6789/0 conn(0x7f4ce40c74c0 legacy=0x7f4ce40c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 -- 172.21.15.50:0/871731133 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4161430 con 0x7f4ce40bfe30 2023-12-24T20:10:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce9a69700 1 --2- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40bfe30 0x7f4ce40c9440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00098d0 tx=0x7f4ce0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd4e10284b062d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce8a67700 1 -- 172.21.15.50:0/871731133 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0005c10 con 0x7f4ce40bfe30 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce8a67700 1 -- 172.21.15.50:0/871731133 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce0005d70 con 0x7f4ce40bfe30 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.581+0000 7f4ce8a67700 1 -- 172.21.15.50:0/871731133 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0006280 con 0x7f4ce40bfe30 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 -- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40bfe30 msgr2=0x7f4ce40c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 --2- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40bfe30 0x7f4ce40c9440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00098d0 tx=0x7f4ce0009120 comp rx=0 tx=0).stop 2023-12-24T20:10:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 -- 172.21.15.50:0/871731133 shutdown_connections 2023-12-24T20:10:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 --2- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 --2- 172.21.15.50:0/871731133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40bfe30 0x7f4ce40c9440 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 -- 172.21.15.50:0/871731133 >> 172.21.15.50:0/871731133 conn(0x7f4ce406c1f0 msgr2=0x7f4ce4067850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 -- 172.21.15.50:0/871731133 shutdown_connections 2023-12-24T20:10:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.585+0000 7f4cebccd700 1 -- 172.21.15.50:0/871731133 wait complete. 2023-12-24T20:10:56.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 Processor -- start 2023-12-24T20:10:56.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 -- start start 2023-12-24T20:10:56.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 0x7f4ce40c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4172180 con 0x7f4ce40bfe30 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4171570 con 0x7f4ce40c74c0 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cebccd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4171850 con 0x7f4ce40c0200 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44958/0 (socket says 172.21.15.50:44958) 2023-12-24T20:10:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 -- 172.21.15.50:0/609512844 learned_addr learned my addr 172.21.15.50:0/609512844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9268700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cea26a700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 0x7f4ce40c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 -- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 msgr2=0x7f4ce40c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 -- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 msgr2=0x7f4ce40c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 0x7f4ce40c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 -- 172.21.15.50:0/609512844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00093c0 con 0x7f4ce40bfe30 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4cea26a700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 0x7f4ce40c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.589+0000 7f4ce9a69700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009f70 tx=0x7f4ce0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce001d780 con 0x7f4ce40bfe30 2023-12-24T20:10:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce001d8e0 con 0x7f4ce40bfe30 2023-12-24T20:10:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce001dc80 con 0x7f4ce40bfe30 2023-12-24T20:10:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce4171b30 con 0x7f4ce40bfe30 2023-12-24T20:10:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce415b000 con 0x7f4ce40bfe30 2023-12-24T20:10:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.593+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce40c2350 con 0x7f4ce40bfe30 2023-12-24T20:10:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.597+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f4ce001b690 con 0x7f4ce40bfe30 2023-12-24T20:10:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.597+0000 7f4cd9ffb700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 0x7f4cc8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.597+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f4ce007e9e0 con 0x7f4ce40bfe30 2023-12-24T20:10:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.597+0000 7f4ce9268700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 0x7f4cc8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.601+0000 7f4ce9268700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 0x7f4cc8062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4171330 tx=0x7f4cd40091a0 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.605+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ce004ecf0 con 0x7f4ce40bfe30 2023-12-24T20:10:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.777+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ce40c7350 con 0x7f4cc8060580 2023-12-24T20:10:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.785+0000 7f4cd9ffb700 1 -- 172.21.15.50:0/609512844 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48293 (secure 0 0 0) 0x7f4ce40c7350 con 0x7f4cc8060580 2023-12-24T20:10:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 msgr2=0x7f4cc8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 0x7f4cc8062a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4171330 tx=0x7f4cd40091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 msgr2=0x7f4ce41486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009f70 tx=0x7f4ce0016000 comp rx=0 tx=0).stop 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 shutdown_connections 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f4cc8060580 0x7f4cc8062a30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce40c74c0 0x7f4ce40c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4ce40c0200 0x7f4ce40c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 --2- 172.21.15.50:0/609512844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce40bfe30 0x7f4ce41486d0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 >> 172.21.15.50:0/609512844 conn(0x7f4ce406c1f0 msgr2=0x7f4ce40cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 shutdown_connections 2023-12-24T20:10:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.789+0000 7f4cebccd700 1 -- 172.21.15.50:0/609512844 wait complete. 2023-12-24T20:10:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:56.812 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-12-24T20:10:55.979100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2445656,"kb_used_data":22296,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529064,"statfs":{"total":773094113280,"available":770589761536,"internally_reserved":0,"allocated":22831104,"data_stored":12698485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-666962,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-280,"num_write_kb":-2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996577"},"pg_stats":[{"pgid":"1.0","version":"211'370","reported_seq":1214,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-12-24T20:10:50.098174+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:50.098174+0000","last_peered":"2023-12-24T20:10:50.098174+0000","last_clean":"2023-12-24T20:10:50.098174+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:50.098174+0000","last_undegraded":"2023-12-24T20:10:50.098174+0000","last_fullsized":"2023-12-24T20:10:50.098174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304548,"kb_used_data":3164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067292,"statfs":{"total":96636764160,"available":96324907008,"internally_reserved":0,"allocated":3239936,"data_stored":1982505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5649999999999999,"5min":1.728,"15min":1.728},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.145,"15min":1.173},"min":{"1min":0.65900000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":2.2930000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.97199999999999998,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.5840000000000001,"5min":1.718,"15min":1.9379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.745,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":2.5739999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2050000000000001,"15min":1.2529999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.712,"15min":1.8959999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2210000000000001,"15min":1.2509999999999999},"min":{"1min":0.98299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.766,"5min":1.766,"15min":1.8200000000000001},"last":1.0449999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6319999999999999,"5min":1.857,"15min":2.4449999999999998},"last":1.012},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.87,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7689999999999999,"5min":1.804,"15min":2.2919999999999998},"last":1.238}]},{"osd":4,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2090000000000001},"min":{"1min":0.751,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6759999999999999,"5min":1.865,"15min":2.194},"last":2.4380000000000002},{"interface":"front","average":{"1min":1.369,"5min":1.3320000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.839,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.214}]},{"osd":5,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2969999999999999,"15min":1.274},"min":{"1min":0.98299999999999998,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.8240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.744},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3959999999999999,"15min":1.3600000000000001},"min":{"1min":1.0489999999999999,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.8089999999999999,"5min":1.95,"15min":1.95},"last":2.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4690000000000001,"15min":1.4350000000000001},"min":{"1min":1.038,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.9430000000000001,"5min":2.125,"15min":2.3319999999999999},"last":2.7949999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.4570000000000001,"15min":1.4299999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.55000000000000004},"max":{"1min":1.923,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.194}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":1.151},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":0.874}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.006},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.288},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.367}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":1.512}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.758},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.6850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312160,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059680,"statfs":{"total":96636764160,"available":96317112320,"internally_reserved":0,"allocated":2646016,"data_stored":1387522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.137},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.1619999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.032}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.2709999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.228}]}]},{"osd":4,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.599},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3560000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2929999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.177},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.468}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.0129999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.827}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.876},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.5660000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.294}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.512},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.385}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.232}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.6180000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.629}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.325},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.3580000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.2909999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4930000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312480,"kb_used_data":2904,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059360,"statfs":{"total":96636764160,"available":96316784640,"internally_reserved":0,"allocated":2973696,"data_stored":1719817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":1.157},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.3919999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.292},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.486},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.6519999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.603}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.734},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.369}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.6919999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304564,"kb_used_data":3180,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067276,"statfs":{"total":96636764160,"available":96324890624,"internally_reserved":0,"allocated":3256320,"data_stored":1983205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.91400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2909999999999999,"5min":1.518,"15min":1.6950000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0389999999999999,"15min":1.0669999999999999},"min":{"1min":0.70899999999999996,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.28,"5min":1.6559999999999999,"15min":1.823},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4430000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.67300000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.617,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.242}]},{"osd":3,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58199999999999996},"max":{"1min":1.474,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.569,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.034}]},{"osd":4,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7230000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.319,"15min":1.3320000000000001},"min":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.90500000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.8660000000000001},"last":1.175}]},{"osd":5,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.456,"15min":1.454},"min":{"1min":0.93400000000000005,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4339999999999999,"15min":1.456},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.125},"last":1.3640000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.409,"15min":1.4179999999999999},"min":{"1min":1.069,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.6339999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.319},{"interface":"front","average":{"1min":1.516,"5min":1.542,"15min":1.5289999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.1429999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.232,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.851,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.458},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":1.157,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.837,"5min":2.234,"15min":2.411},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:56.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.973+0000 7fbf12a6e700 1 Processor -- start 2023-12-24T20:10:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.973+0000 7fbf12a6e700 1 -- start start 2023-12-24T20:10:56.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c06c820 con 0x7fbf0c0c6d00 2023-12-24T20:10:56.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c06b960 con 0x7fbf0c154b60 2023-12-24T20:10:56.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c06bc40 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44970/0 (socket says 172.21.15.50:44970) 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 -- 172.21.15.50:0/1227918932 learned_addr learned my addr 172.21.15.50:0/1227918932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1080a700 1 --1- 172.21.15.50:0/1227918932 >> v1:172.21.15.50:6789/0 conn(0x7fbf0c0c6d00 0x7fbf0c154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48084/0 (socket says 172.21.15.50:48084) 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 -- 172.21.15.50:0/1227918932 >> v1:172.21.15.82:6789/0 conn(0x7fbf0c154b60 legacy=0x7fbf0c06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 -- 172.21.15.50:0/1227918932 >> v1:172.21.15.50:6789/0 conn(0x7fbf0c0c6d00 legacy=0x7fbf0c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 -- 172.21.15.50:0/1227918932 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c06bf20 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf1100b700 1 --2- 172.21.15.50:0/1227918932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009f20 tx=0x7fbf04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a18fdded549533 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf0b7fe700 1 -- 172.21.15.50:0/1227918932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400e070 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf0b7fe700 1 -- 172.21.15.50:0/1227918932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400ba80 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf0b7fe700 1 -- 172.21.15.50:0/1227918932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf040092e0 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 -- 172.21.15.50:0/1227918932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 msgr2=0x7fbf0c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/1227918932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009f20 tx=0x7fbf04009840 comp rx=0 tx=0).stop 2023-12-24T20:10:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 -- 172.21.15.50:0/1227918932 shutdown_connections 2023-12-24T20:10:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.977+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/1227918932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c0c70d0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.981+0000 7fbf12a6e700 1 -- 172.21.15.50:0/1227918932 >> 172.21.15.50:0/1227918932 conn(0x7fbf0c0cbba0 msgr2=0x7fbf0c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.981+0000 7fbf12a6e700 1 -- 172.21.15.50:0/1227918932 shutdown_connections 2023-12-24T20:10:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.981+0000 7fbf12a6e700 1 -- 172.21.15.50:0/1227918932 wait complete. 2023-12-24T20:10:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.981+0000 7fbf12a6e700 1 Processor -- start 2023-12-24T20:10:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 -- start start 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 0x7fbf0c15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf0c154b60 0x7fbf0c0aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c157640 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0c9930 con 0x7fbf0c154b60 2023-12-24T20:10:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf12a6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c156da0 con 0x7fbf0c0c6d00 2023-12-24T20:10:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44986/0 (socket says 172.21.15.50:44986) 2023-12-24T20:10:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 -- 172.21.15.50:0/902741803 learned_addr learned my addr 172.21.15.50:0/902741803 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1100b700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf0c154b60 0x7fbf0c0aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf0bfff700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 0x7fbf0c15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 -- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 msgr2=0x7fbf0c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 0x7fbf0c15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 -- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf0c154b60 msgr2=0x7fbf0c0aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf0c154b60 0x7fbf0c0aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf1080a700 1 -- 172.21.15.50:0/902741803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009ae0 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.985+0000 7fbf0bfff700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 0x7fbf0c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf1080a700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c7f0 tx=0x7fbf00007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00005a70 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00005bf0 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c157080 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000070d0 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c156a50 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.989+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c0652e0 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.993+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbf00007480 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.993+0000 7fbf08ff9700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 0x7fbef0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.993+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fbf0007bf00 con 0x7fbf0c06dcc0 2023-12-24T20:10:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.993+0000 7fbf0bfff700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 0x7fbef0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:56.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:56.993+0000 7fbf0bfff700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 0x7fbef0062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c06ee90 tx=0x7fbef8009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.001+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf0004c2b0 con 0x7fbf0c06dcc0 2023-12-24T20:10:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.169+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf0c0c9a70 con 0x7fbef0060550 2023-12-24T20:10:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.177+0000 7fbf08ff9700 1 -- 172.21.15.50:0/902741803 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48293 (secure 0 0 0) 0x7fbef8001ca0 con 0x7fbef0060550 2023-12-24T20:10:57.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 msgr2=0x7fbef0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 0x7fbef0062a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c06ee90 tx=0x7fbef8009040 comp rx=0 tx=0).stop 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 msgr2=0x7fbf0c15c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c7f0 tx=0x7fbf00007f70 comp rx=0 tx=0).stop 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 shutdown_connections 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbef0060550 0x7fbef0062a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf0c154b60 0x7fbf0c0aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf0c0c6d00 0x7fbf0c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 --2- 172.21.15.50:0/902741803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0c06dcc0 0x7fbf0c15c2a0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 >> 172.21.15.50:0/902741803 conn(0x7fbf0c0cbba0 msgr2=0x7fbf0c0c1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 shutdown_connections 2023-12-24T20:10:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.181+0000 7fbf12a6e700 1 -- 172.21.15.50:0/902741803 wait complete. 2023-12-24T20:10:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:57.209 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-12-24T20:10:55.979100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2445656,"kb_used_data":22296,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529064,"statfs":{"total":773094113280,"available":770589761536,"internally_reserved":0,"allocated":22831104,"data_stored":12698485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-666962,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-280,"num_write_kb":-2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996577"},"pg_stats":[{"pgid":"1.0","version":"211'370","reported_seq":1214,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-12-24T20:10:50.098174+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:50.098174+0000","last_peered":"2023-12-24T20:10:50.098174+0000","last_clean":"2023-12-24T20:10:50.098174+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:50.098174+0000","last_undegraded":"2023-12-24T20:10:50.098174+0000","last_fullsized":"2023-12-24T20:10:50.098174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304548,"kb_used_data":3164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067292,"statfs":{"total":96636764160,"available":96324907008,"internally_reserved":0,"allocated":3239936,"data_stored":1982505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5649999999999999,"5min":1.728,"15min":1.728},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.145,"15min":1.173},"min":{"1min":0.65900000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":2.2930000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.97199999999999998,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.5840000000000001,"5min":1.718,"15min":1.9379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.745,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":2.5739999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2050000000000001,"15min":1.2529999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.712,"15min":1.8959999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2210000000000001,"15min":1.2509999999999999},"min":{"1min":0.98299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.766,"5min":1.766,"15min":1.8200000000000001},"last":1.0449999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6319999999999999,"5min":1.857,"15min":2.4449999999999998},"last":1.012},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.87,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7689999999999999,"5min":1.804,"15min":2.2919999999999998},"last":1.238}]},{"osd":4,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2090000000000001},"min":{"1min":0.751,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6759999999999999,"5min":1.865,"15min":2.194},"last":2.4380000000000002},{"interface":"front","average":{"1min":1.369,"5min":1.3320000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.839,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.214}]},{"osd":5,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2969999999999999,"15min":1.274},"min":{"1min":0.98299999999999998,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.8240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.744},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3959999999999999,"15min":1.3600000000000001},"min":{"1min":1.0489999999999999,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.8089999999999999,"5min":1.95,"15min":1.95},"last":2.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4690000000000001,"15min":1.4350000000000001},"min":{"1min":1.038,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.9430000000000001,"5min":2.125,"15min":2.3319999999999999},"last":2.7949999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.4570000000000001,"15min":1.4299999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.55000000000000004},"max":{"1min":1.923,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.194}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":1.151},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":0.874}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.006},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.288},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.367}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":1.512}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.758},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.6850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312160,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059680,"statfs":{"total":96636764160,"available":96317112320,"internally_reserved":0,"allocated":2646016,"data_stored":1387522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.137},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.1619999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.032}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.2709999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.228}]}]},{"osd":4,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.599},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3560000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2929999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.177},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.468}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.0129999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.827}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.876},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.5660000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.294}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.512},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.385}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.232}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.6180000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.629}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.325},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.3580000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.2909999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4930000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312480,"kb_used_data":2904,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059360,"statfs":{"total":96636764160,"available":96316784640,"internally_reserved":0,"allocated":2973696,"data_stored":1719817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":1.157},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.3919999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.292},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.486},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.6519999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.603}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.734},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.369}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.6919999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304564,"kb_used_data":3180,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067276,"statfs":{"total":96636764160,"available":96324890624,"internally_reserved":0,"allocated":3256320,"data_stored":1983205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.91400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2909999999999999,"5min":1.518,"15min":1.6950000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0389999999999999,"15min":1.0669999999999999},"min":{"1min":0.70899999999999996,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.28,"5min":1.6559999999999999,"15min":1.823},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4430000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.67300000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.617,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.242}]},{"osd":3,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58199999999999996},"max":{"1min":1.474,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.569,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.034}]},{"osd":4,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7230000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.319,"15min":1.3320000000000001},"min":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.90500000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.8660000000000001},"last":1.175}]},{"osd":5,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.456,"15min":1.454},"min":{"1min":0.93400000000000005,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4339999999999999,"15min":1.456},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.125},"last":1.3640000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.409,"15min":1.4179999999999999},"min":{"1min":1.069,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.6339999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.319},{"interface":"front","average":{"1min":1.516,"5min":1.542,"15min":1.5289999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.1429999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.232,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.851,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.458},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":1.157,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.837,"5min":2.234,"15min":2.411},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:57.210 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-24T20:10:57.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:10:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 Processor -- start 2023-12-24T20:10:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 -- start start 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f306c158f20 0x7f306c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f306c0abbf0 0x7f306c069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c06d7c0 0x7f306c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c15a6c0 con 0x7f306c158f20 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0caa90 con 0x7f306c0abbf0 2023-12-24T20:10:57.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f30710cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c15a100 con 0x7f306c06d7c0 2023-12-24T20:10:57.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f306ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f306c158f20 0x7f306c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f306ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f306c158f20 0x7f306c068f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44988/0 (socket says 172.21.15.50:44988) 2023-12-24T20:10:57.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f306ad9d700 1 -- 172.21.15.50:0/3206178856 learned_addr learned my addr 172.21.15.50:0/3206178856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.377+0000 7f306b59e700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c06d7c0 0x7f306c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306a59c700 1 --2- 172.21.15.50:0/3206178856 >> v2:172.21.15.82:3300/0 conn(0x7f306c0abbf0 0x7f306c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 -- 172.21.15.50:0/3206178856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c06d7c0 msgr2=0x7f306c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c06d7c0 0x7f306c1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 -- 172.21.15.50:0/3206178856 >> v2:172.21.15.82:3300/0 conn(0x7f306c0abbf0 msgr2=0x7f306c069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 --2- 172.21.15.50:0/3206178856 >> v2:172.21.15.82:3300/0 conn(0x7f306c0abbf0 0x7f306c069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 -- 172.21.15.50:0/3206178856 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c15a3e0 con 0x7f306c158f20 2023-12-24T20:10:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f306ad9d700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c158f20 0x7f306c068f20 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f306c06a0f0 tx=0x7f305c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbed0d0ea051697 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f3069d9b700 1 -- 172.21.15.50:0/3206178856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00e070 con 0x7f306c158f20 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f3069d9b700 1 -- 172.21.15.50:0/3206178856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00ba50 con 0x7f306c158f20 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f3069d9b700 1 -- 172.21.15.50:0/3206178856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0092e0 con 0x7f306c158f20 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 -- 172.21.15.50:0/3206178856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c158f20 msgr2=0x7f306c068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c158f20 0x7f306c068f20 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f306c06a0f0 tx=0x7f305c009840 comp rx=0 tx=0).stop 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 -- 172.21.15.50:0/3206178856 shutdown_connections 2023-12-24T20:10:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 --2- 172.21.15.50:0/3206178856 >> v2:172.21.15.82:3300/0 conn(0x7f306c0abbf0 0x7f306c069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c06d7c0 0x7f306c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 --2- 172.21.15.50:0/3206178856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c158f20 0x7f306c068f20 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 -- 172.21.15.50:0/3206178856 >> 172.21.15.50:0/3206178856 conn(0x7f306c0ccd90 msgr2=0x7f306c0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 -- 172.21.15.50:0/3206178856 shutdown_connections 2023-12-24T20:10:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.381+0000 7f30710cd700 1 -- 172.21.15.50:0/3206178856 wait complete. 2023-12-24T20:10:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 Processor -- start 2023-12-24T20:10:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 -- start start 2023-12-24T20:10:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 0x7f306c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c158f20 0x7f306c15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0adc30 con 0x7f306c0abbf0 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0ad650 con 0x7f306c06d7c0 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f30710cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c155070 con 0x7f306c158f20 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44998/0 (socket says 172.21.15.50:44998) 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 -- 172.21.15.50:0/1984937457 learned_addr learned my addr 172.21.15.50:0/1984937457 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306ad9d700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 0x7f306c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306b59e700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c158f20 0x7f306c15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 -- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c158f20 msgr2=0x7f306c15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c158f20 0x7f306c15e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 -- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 msgr2=0x7f306c154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 0x7f306c154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 -- 172.21.15.50:0/1984937457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009ae0 con 0x7f306c0abbf0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306ad9d700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 0x7f306c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.385+0000 7f306a59c700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f306000d890 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000b600 con 0x7f306c0abbf0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000b760 con 0x7f306c0abbf0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000bb00 con 0x7f306c0abbf0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0b2850 con 0x7f306c0abbf0 2023-12-24T20:10:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0b2b30 con 0x7f306c0abbf0 2023-12-24T20:10:57.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0adde0 con 0x7f306c0abbf0 2023-12-24T20:10:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.389+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f306001e460 con 0x7f306c0abbf0 2023-12-24T20:10:57.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.393+0000 7f3052ffd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 0x7f3058062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.393+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f306007d1a0 con 0x7f306c0abbf0 2023-12-24T20:10:57.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.393+0000 7f306ad9d700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 0x7f3058062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.393+0000 7f306ad9d700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 0x7f3058062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f305c009880 tx=0x7f305c018000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.401+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f306c0adde0 con 0x7f306c0abbf0 2023-12-24T20:10:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.569+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f306c0adde0 con 0x7f3058060550 2023-12-24T20:10:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.577+0000 7f3052ffd700 1 -- 172.21.15.50:0/1984937457 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48293 (secure 0 0 0) 0x7f306c0adde0 con 0x7f3058060550 2023-12-24T20:10:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 msgr2=0x7f3058062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 0x7f3058062a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f305c009880 tx=0x7f305c018000 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 msgr2=0x7f306c15de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f306000d890 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 shutdown_connections 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3058060550 0x7f3058062a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c158f20 0x7f306c15e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0abbf0 0x7f306c15de30 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 --2- 172.21.15.50:0/1984937457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c06d7c0 0x7f306c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 >> 172.21.15.50:0/1984937457 conn(0x7f306c0ccd90 msgr2=0x7f306c155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 shutdown_connections 2023-12-24T20:10:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.581+0000 7f30710cd700 1 -- 172.21.15.50:0/1984937457 wait complete. 2023-12-24T20:10:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:10:57.606 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-12-24T20:10:55.979100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2445656,"kb_used_data":22296,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529064,"statfs":{"total":773094113280,"available":770589761536,"internally_reserved":0,"allocated":22831104,"data_stored":12698485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-666962,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-280,"num_write_kb":-2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996577"},"pg_stats":[{"pgid":"1.0","version":"211'370","reported_seq":1214,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-12-24T20:10:50.098174+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:50.098174+0000","last_peered":"2023-12-24T20:10:50.098174+0000","last_clean":"2023-12-24T20:10:50.098174+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:50.098174+0000","last_undegraded":"2023-12-24T20:10:50.098174+0000","last_fullsized":"2023-12-24T20:10:50.098174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304548,"kb_used_data":3164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067292,"statfs":{"total":96636764160,"available":96324907008,"internally_reserved":0,"allocated":3239936,"data_stored":1982505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5649999999999999,"5min":1.728,"15min":1.728},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.242,"5min":1.145,"15min":1.173},"min":{"1min":0.65900000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":2.2930000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.97199999999999998,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.5840000000000001,"5min":1.718,"15min":1.9379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.745,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":2.5739999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2050000000000001,"15min":1.2529999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.712,"15min":1.8959999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2210000000000001,"15min":1.2509999999999999},"min":{"1min":0.98299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.766,"5min":1.766,"15min":1.8200000000000001},"last":1.0449999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6319999999999999,"5min":1.857,"15min":2.4449999999999998},"last":1.012},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.87,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7689999999999999,"5min":1.804,"15min":2.2919999999999998},"last":1.238}]},{"osd":4,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2090000000000001},"min":{"1min":0.751,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6759999999999999,"5min":1.865,"15min":2.194},"last":2.4380000000000002},{"interface":"front","average":{"1min":1.369,"5min":1.3320000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.839,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.214}]},{"osd":5,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2969999999999999,"15min":1.274},"min":{"1min":0.98299999999999998,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.8240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.744},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3959999999999999,"15min":1.3600000000000001},"min":{"1min":1.0489999999999999,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.8089999999999999,"5min":1.95,"15min":1.95},"last":2.6619999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4690000000000001,"15min":1.4350000000000001},"min":{"1min":1.038,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.9430000000000001,"5min":2.125,"15min":2.3319999999999999},"last":2.7949999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.4570000000000001,"15min":1.4299999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.55000000000000004},"max":{"1min":1.923,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.194}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":1.151},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":0.874}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.006},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.288},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.367}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":1.512}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.758},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.6850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312160,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059680,"statfs":{"total":96636764160,"available":96317112320,"internally_reserved":0,"allocated":2646016,"data_stored":1387522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.2749999999999999,"15min":1.2689999999999999},"min":{"1min":0.95499999999999996,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.556,"5min":1.702,"15min":1.738},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3640000000000001,"15min":1.3480000000000001},"min":{"1min":0.97399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7130000000000001,"5min":1.7829999999999999,"15min":1.784},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.222,"15min":1.1899999999999999},"min":{"1min":0.93300000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5680000000000001,"5min":1.734,"15min":1.7569999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1870000000000001,"15min":1.1950000000000001},"min":{"1min":0.76300000000000001,"5min":0.747,"15min":0.72999999999999998},"max":{"1min":1.411,"5min":1.673,"15min":1.7210000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.246,"15min":1.224},"min":{"1min":0.95599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6619999999999999,"5min":1.73,"15min":1.819},"last":1.137},{"interface":"front","average":{"1min":1.276,"5min":1.2470000000000001,"15min":1.27},"min":{"1min":1.0349999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.5960000000000001,"5min":1.784,"15min":1.883},"last":1.1619999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.546,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3600000000000001},"min":{"1min":1.143,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6779999999999999,"5min":1.7330000000000001,"15min":1.8799999999999999},"last":1.032}]},{"osd":4,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2,"15min":1.1819999999999999},"min":{"1min":0.85699999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":1.6599999999999999,"15min":1.839},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.82399999999999995,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.6879999999999999,"5min":1.885,"15min":1.9299999999999999},"last":1.2709999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3100000000000001,"15min":1.3169999999999999},"min":{"1min":0.88500000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6970000000000001,"5min":1.9179999999999999,"15min":2.008},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.343,"15min":1.3480000000000001},"min":{"1min":0.95299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6599999999999999,"5min":1.764,"15min":1.9630000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4319999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7230000000000001,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4710000000000001,"15min":1.476},"min":{"1min":0.94999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7869999999999999,"5min":1.9350000000000001,"15min":2.0009999999999999},"last":1.228}]}]},{"osd":4,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.599},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3560000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2929999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.177},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.468}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.0129999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.827}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.876},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.5660000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.294}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.512},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.385}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.232}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.6180000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.629}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.325},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.3580000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.2909999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4930000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312480,"kb_used_data":2904,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059360,"statfs":{"total":96636764160,"available":96316784640,"internally_reserved":0,"allocated":2973696,"data_stored":1719817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":1.157},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":1.3919999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.292},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.486},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.6519999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.603}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.734},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.369}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.6919999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304564,"kb_used_data":3180,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067276,"statfs":{"total":96636764160,"available":96324890624,"internally_reserved":0,"allocated":3256320,"data_stored":1983205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.91400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2909999999999999,"5min":1.518,"15min":1.6950000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0389999999999999,"15min":1.0669999999999999},"min":{"1min":0.70899999999999996,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.28,"5min":1.6559999999999999,"15min":1.823},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4430000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.67300000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.617,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.242}]},{"osd":3,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58199999999999996},"max":{"1min":1.474,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.569,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.034}]},{"osd":4,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7230000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.319,"15min":1.3320000000000001},"min":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.90500000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.8660000000000001},"last":1.175}]},{"osd":5,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.456,"15min":1.454},"min":{"1min":0.93400000000000005,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4339999999999999,"15min":1.456},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.125},"last":1.3640000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.409,"15min":1.4179999999999999},"min":{"1min":1.069,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.6339999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.319},{"interface":"front","average":{"1min":1.516,"5min":1.542,"15min":1.5289999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.1429999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.232,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.851,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.458},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":1.157,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.837,"5min":2.234,"15min":2.411},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:10:57.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:10:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.769+0000 7fa132678700 1 Processor -- start 2023-12-24T20:10:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.769+0000 7fa132678700 1 -- start start 2023-12-24T20:10:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa132678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 0x7fa12c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa132678700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c06d5c0 con 0x7fa12c0b3c90 2023-12-24T20:10:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa132678700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0b4400 con 0x7fa12c0b1ba0 2023-12-24T20:10:57.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa132678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0b49c0 con 0x7fa12c158e10 2023-12-24T20:10:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa12c0b3c90 0x7fa12c06da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48098/0 (socket says 172.21.15.50:48098) 2023-12-24T20:10:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12b7fe700 1 -- 172.21.15.50:0/2606371473 learned_addr learned my addr 172.21.15.50:0/2606371473 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12bfff700 1 --2- 172.21.15.50:0/2606371473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 0x7fa12c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188955066 0 0) 0x7fa12c06d5c0 con 0x7fa12c0b3c90 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa114003570 con 0x7fa12c0b3c90 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276522135 0 0) 0x7fa12c0b4400 con 0x7fa12c0b1ba0 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c06d5c0 con 0x7fa12c0b1ba0 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12bfff700 1 -- 172.21.15.50:0/2606371473 >> v1:172.21.15.82:6789/0 conn(0x7fa12c0b1ba0 legacy=0x7fa12c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12bfff700 1 -- 172.21.15.50:0/2606371473 >> v1:172.21.15.50:6789/0 conn(0x7fa12c0b3c90 legacy=0x7fa12c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12bfff700 1 -- 172.21.15.50:0/2606371473 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0b46e0 con 0x7fa12c158e10 2023-12-24T20:10:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.773+0000 7fa12bfff700 1 --2- 172.21.15.50:0/2606371473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 0x7fa12c15d6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009910 tx=0x7fa11c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b7dc89e30062bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011630 con 0x7fa12c158e10 2023-12-24T20:10:57.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c011790 con 0x7fa12c158e10 2023-12-24T20:10:57.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa12affd700 1 -- 172.21.15.50:0/2606371473 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011b30 con 0x7fa12c158e10 2023-12-24T20:10:57.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 -- 172.21.15.50:0/2606371473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 msgr2=0x7fa12c15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 --2- 172.21.15.50:0/2606371473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 0x7fa12c15d6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009910 tx=0x7fa11c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 -- 172.21.15.50:0/2606371473 shutdown_connections 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 --2- 172.21.15.50:0/2606371473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c158e10 0x7fa12c15d6d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 -- 172.21.15.50:0/2606371473 >> 172.21.15.50:0/2606371473 conn(0x7fa12c0670b0 msgr2=0x7fa12c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 -- 172.21.15.50:0/2606371473 shutdown_connections 2023-12-24T20:10:57.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.777+0000 7fa132678700 1 -- 172.21.15.50:0/2606371473 wait complete. 2023-12-24T20:10:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 Processor -- start 2023-12-24T20:10:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 -- start start 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 0x7fa12c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c0b3c90 0x7fa12c13b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 0x7fa12c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c14d070 con 0x7fa12c155aa0 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c156460 con 0x7fa12c0b1ba0 2023-12-24T20:10:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa132678700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15d740 con 0x7fa12c0b3c90 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa130c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 0x7fa12c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 0x7fa12c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.781+0000 7fa12b7fe700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c0b3c90 0x7fa12c13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 0x7fa12c15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:50958/0 (socket says 172.21.15.50:50958) 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa12bfff700 1 -- 172.21.15.50:0/653800984 learned_addr learned my addr 172.21.15.50:0/653800984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 -- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c0b3c90 msgr2=0x7fa12c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c0b3c90 0x7fa12c13b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 -- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 msgr2=0x7fa12c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 0x7fa12c15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 -- 172.21.15.50:0/653800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c009420 con 0x7fa12c155aa0 2023-12-24T20:10:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa130c15700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 0x7fa12c155f20 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c910 tx=0x7fa1240026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124012630 con 0x7fa12c155aa0 2023-12-24T20:10:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124012790 con 0x7fa12c155aa0 2023-12-24T20:10:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124012b50 con 0x7fa12c155aa0 2023-12-24T20:10:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c14e5a0 con 0x7fa12c155aa0 2023-12-24T20:10:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c14eb60 con 0x7fa12c155aa0 2023-12-24T20:10:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.785+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c0652e0 con 0x7fa12c155aa0 2023-12-24T20:10:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.789+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa12401a3b0 con 0x7fa12c155aa0 2023-12-24T20:10:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.789+0000 7fa113fff700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 0x7fa118062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.789+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fa12407cb30 con 0x7fa12c155aa0 2023-12-24T20:10:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.789+0000 7fa12bfff700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 0x7fa118062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.789+0000 7fa12bfff700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 0x7fa118062a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009fd0 tx=0x7fa11c017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:57.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.797+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa12404ce40 con 0x7fa12c155aa0 2023-12-24T20:10:57.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.981+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa12c06ca20 con 0x7fa12c155aa0 2023-12-24T20:10:57.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.985+0000 7fa113fff700 1 -- 172.21.15.50:0/653800984 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+13934 (secure 0 0 0) 0x7fa12406a680 con 0x7fa12c155aa0 2023-12-24T20:10:57.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:10:57.989 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":213,"fsid":"9cd325ac-a2d2-4a61-9c13-57b4146a16d9","created":"2023-12-24T18:36:03.406950+0000","modified":"2023-12-24T20:10:53.027021+0000","last_up_change":"2023-12-24T18:36:15.707539+0000","last_in_change":"2023-12-24T18:36:06.398337+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T18:36:16.819693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b1f4737-ad2e-425a-acb5-50b6e3888baf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33902},{"type":"v1","addr":"172.21.15.50:6817","nonce":33902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":33902},{"type":"v1","addr":"172.21.15.50:6821","nonce":33902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":33902},{"type":"v1","addr":"172.21.15.50:6828","nonce":33902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":33902},{"type":"v1","addr":"172.21.15.50:6825","nonce":33902}]},"public_addr":"172.21.15.50:6817/33902","cluster_addr":"172.21.15.50:6821/33902","heartbeat_back_addr":"172.21.15.50:6828/33902","heartbeat_front_addr":"172.21.15.50:6825/33902","state":["exists","up"]},{"osd":1,"uuid":"324c1fe4-655d-4221-9b97-22c510207efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33900},{"type":"v1","addr":"172.21.15.50:6801","nonce":33900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33900},{"type":"v1","addr":"172.21.15.50:6804","nonce":33900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33900},{"type":"v1","addr":"172.21.15.50:6812","nonce":33900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33900},{"type":"v1","addr":"172.21.15.50:6808","nonce":33900}]},"public_addr":"172.21.15.50:6801/33900","cluster_addr":"172.21.15.50:6804/33900","heartbeat_back_addr":"172.21.15.50:6812/33900","heartbeat_front_addr":"172.21.15.50:6808/33900","state":["exists","up"]},{"osd":2,"uuid":"9e50909b-304b-4677-971e-3a2ba622178e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":33907},{"type":"v1","addr":"172.21.15.50:6820","nonce":33907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":33907},{"type":"v1","addr":"172.21.15.50:6824","nonce":33907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":33907},{"type":"v1","addr":"172.21.15.50:6831","nonce":33907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":33907},{"type":"v1","addr":"172.21.15.50:6829","nonce":33907}]},"public_addr":"172.21.15.50:6820/33907","cluster_addr":"172.21.15.50:6824/33907","heartbeat_back_addr":"172.21.15.50:6831/33907","heartbeat_front_addr":"172.21.15.50:6829/33907","state":["exists","up"]},{"osd":3,"uuid":"d774b59e-89d3-4b1c-8915-43dce49eb238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":33905},{"type":"v1","addr":"172.21.15.50:6805","nonce":33905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":33905},{"type":"v1","addr":"172.21.15.50:6809","nonce":33905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33905},{"type":"v1","addr":"172.21.15.50:6815","nonce":33905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6811","nonce":33905},{"type":"v1","addr":"172.21.15.50:6813","nonce":33905}]},"public_addr":"172.21.15.50:6805/33905","cluster_addr":"172.21.15.50:6809/33905","heartbeat_back_addr":"172.21.15.50:6815/33905","heartbeat_front_addr":"172.21.15.50:6813/33905","state":["exists","up"]},{"osd":4,"uuid":"2f7f64e5-4dc9-4764-807c-ab73414af3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":34155},{"type":"v1","addr":"172.21.15.82:6801","nonce":34155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":34155},{"type":"v1","addr":"172.21.15.82:6803","nonce":34155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":34155},{"type":"v1","addr":"172.21.15.82:6807","nonce":34155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":34155},{"type":"v1","addr":"172.21.15.82:6805","nonce":34155}]},"public_addr":"172.21.15.82:6801/34155","cluster_addr":"172.21.15.82:6803/34155","heartbeat_back_addr":"172.21.15.82:6807/34155","heartbeat_front_addr":"172.21.15.82:6805/34155","state":["exists","up"]},{"osd":5,"uuid":"e1ba7d3c-4b11-4a9c-bf71-2e40ef723547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":34158},{"type":"v1","addr":"172.21.15.82:6825","nonce":34158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":34158},{"type":"v1","addr":"172.21.15.82:6827","nonce":34158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":34158},{"type":"v1","addr":"172.21.15.82:6831","nonce":34158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":34158},{"type":"v1","addr":"172.21.15.82:6829","nonce":34158}]},"public_addr":"172.21.15.82:6825/34158","cluster_addr":"172.21.15.82:6827/34158","heartbeat_back_addr":"172.21.15.82:6831/34158","heartbeat_front_addr":"172.21.15.82:6829/34158","state":["exists","up"]},{"osd":6,"uuid":"adff6ffd-ba9a-44b0-b1b1-736104a3101c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":34156},{"type":"v1","addr":"172.21.15.82:6809","nonce":34156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6811","nonce":34156},{"type":"v1","addr":"172.21.15.82:6813","nonce":34156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":34156},{"type":"v1","addr":"172.21.15.82:6820","nonce":34156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6815","nonce":34156},{"type":"v1","addr":"172.21.15.82:6817","nonce":34156}]},"public_addr":"172.21.15.82:6809/34156","cluster_addr":"172.21.15.82:6813/34156","heartbeat_back_addr":"172.21.15.82:6820/34156","heartbeat_front_addr":"172.21.15.82:6817/34156","state":["exists","up"]},{"osd":7,"uuid":"d670455f-a126-48b7-b6cf-5119fbf5ac34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":34157},{"type":"v1","addr":"172.21.15.82:6812","nonce":34157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":34157},{"type":"v1","addr":"172.21.15.82:6816","nonce":34157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":34157},{"type":"v1","addr":"172.21.15.82:6823","nonce":34157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":34157},{"type":"v1","addr":"172.21.15.82:6821","nonce":34157}]},"public_addr":"172.21.15.82:6812/34157","cluster_addr":"172.21.15.82:6816/34157","heartbeat_back_addr":"172.21.15.82:6823/34157","heartbeat_front_addr":"172.21.15.82:6821/34157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.391694+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.408741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.125456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.019832+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.160730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.169859+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.033400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T18:36:12.099017+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/223634262":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3075036454":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3088471577":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/3416804369":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/1332160266":"2023-12-25T20:10:49.946261+0000","172.21.15.50:6835/655876048":"2023-12-25T20:10:49.751782+0000","172.21.15.50:6833/655876048":"2023-12-25T20:10:49.751782+0000","172.21.15.50:0/3930073332":"2023-12-25T20:10:49.946261+0000","172.21.15.50:6837/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:6836/60640":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/2591226244":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/864703980":"2023-12-25T20:10:49.946261+0000","172.21.15.50:0/2616996407":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/3338446156":"2023-12-25T20:10:40.765402+0000","172.21.15.50:0/90516501":"2023-12-25T20:10:40.765402+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":8,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":3},{"begin":31,"length":1},{"begin":35,"length":10},{"begin":48,"length":2},{"begin":52,"length":7},{"begin":63,"length":1},{"begin":66,"length":8},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":84,"length":3},{"begin":90,"length":2},{"begin":96,"length":1},{"begin":98,"length":2},{"begin":102,"length":1},{"begin":104,"length":2},{"begin":110,"length":1},{"begin":196,"length":26}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.985+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 msgr2=0x7fa118062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.985+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 0x7fa118062a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009fd0 tx=0x7fa11c017000 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.985+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 msgr2=0x7fa12c155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.985+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 0x7fa12c155f20 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c910 tx=0x7fa1240026f0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 shutdown_connections 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa118060550 0x7fa118062a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c155aa0 0x7fa12c155f20 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa12c0b3c90 0x7fa12c13b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 --2- 172.21.15.50:0/653800984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12c0b1ba0 0x7fa12c15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 >> 172.21.15.50:0/653800984 conn(0x7fa12c0670b0 msgr2=0x7fa12c152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:57.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 shutdown_connections 2023-12-24T20:10:57.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:57.989+0000 7fa132678700 1 -- 172.21.15.50:0/653800984 wait complete. 2023-12-24T20:10:59.012 INFO:tasks.ceph:Scrubbing osd.0 2023-12-24T20:10:59.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:10:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 Processor -- start 2023-12-24T20:10:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 -- start start 2023-12-24T20:10:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94f8159080 0x7f94f806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94f806a4a0 0x7f94f80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f806b5b0 con 0x7f94f80c5ac0 2023-12-24T20:10:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f815dbd0 con 0x7f94f806a4a0 2023-12-24T20:10:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.189+0000 7f94fc82d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f80c5ec0 con 0x7f94f8159080 2023-12-24T20:10:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94f806a4a0 0x7f94f80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94f806a4a0 0x7f94f80c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45024/0 (socket says 172.21.15.50:45024) 2023-12-24T20:10:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 -- 172.21.15.50:0/1889229406 learned_addr learned my addr 172.21.15.50:0/1889229406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f6d9d700 1 --2- 172.21.15.50:0/1889229406 >> v2:172.21.15.82:3300/0 conn(0x7f94f8159080 0x7f94f806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 -- 172.21.15.50:0/1889229406 >> v2:172.21.15.82:3300/0 conn(0x7f94f8159080 msgr2=0x7f94f806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 --2- 172.21.15.50:0/1889229406 >> v2:172.21.15.82:3300/0 conn(0x7f94f8159080 0x7f94f806da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 -- 172.21.15.50:0/1889229406 >> v1:172.21.15.82:6789/0 conn(0x7f94f80c5ac0 legacy=0x7f94f806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 -- 172.21.15.50:0/1889229406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f806df80 con 0x7f94f806a4a0 2023-12-24T20:10:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f659c700 1 --2- 172.21.15.50:0/1889229406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f806a4a0 0x7f94f80c5580 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f94f8068fc0 tx=0x7f94ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9e4d9e657d5d0f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f5d9b700 1 -- 172.21.15.50:0/1889229406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00b860 con 0x7f94f806a4a0 2023-12-24T20:10:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f5d9b700 1 -- 172.21.15.50:0/1889229406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00b9c0 con 0x7f94f806a4a0 2023-12-24T20:10:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94f5d9b700 1 -- 172.21.15.50:0/1889229406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00bd60 con 0x7f94f806a4a0 2023-12-24T20:10:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 -- 172.21.15.50:0/1889229406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f806a4a0 msgr2=0x7f94f80c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 --2- 172.21.15.50:0/1889229406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f806a4a0 0x7f94f80c5580 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f94f8068fc0 tx=0x7f94ec009250 comp rx=0 tx=0).stop 2023-12-24T20:10:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 -- 172.21.15.50:0/1889229406 shutdown_connections 2023-12-24T20:10:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 --2- 172.21.15.50:0/1889229406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f806a4a0 0x7f94f80c5580 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 --2- 172.21.15.50:0/1889229406 >> v2:172.21.15.82:3300/0 conn(0x7f94f8159080 0x7f94f806da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.193+0000 7f94fc82d700 1 -- 172.21.15.50:0/1889229406 >> 172.21.15.50:0/1889229406 conn(0x7f94f8067b80 msgr2=0x7f94f80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.197+0000 7f94fc82d700 1 -- 172.21.15.50:0/1889229406 shutdown_connections 2023-12-24T20:10:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.197+0000 7f94fc82d700 1 -- 172.21.15.50:0/1889229406 wait complete. 2023-12-24T20:10:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.197+0000 7f94fc82d700 1 Processor -- start 2023-12-24T20:10:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.197+0000 7f94fc82d700 1 -- start start 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f806a4a0 0x7f94f815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 0x7f94f8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94f8159080 0x7f94f816d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815b060 con 0x7f94f80c5ac0 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80b4c10 con 0x7f94f806a4a0 2023-12-24T20:10:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f816db00 con 0x7f94f8159080 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 0x7f94f8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 0x7f94f8159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45026/0 (socket says 172.21.15.50:45026) 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 -- 172.21.15.50:0/950233018 learned_addr learned my addr 172.21.15.50:0/950233018 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f6d9d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f806a4a0 0x7f94f815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f759e700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94f8159080 0x7f94f816d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 -- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94f8159080 msgr2=0x7f94f816d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94f8159080 0x7f94f816d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 -- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f806a4a0 msgr2=0x7f94f815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f806a4a0 0x7f94f815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0094f0 con 0x7f94f80c5ac0 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f759e700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94f8159080 0x7f94f816d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:10:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94f659c700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 0x7f94f8159a60 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f94f8064390 tx=0x7f94ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec024440 con 0x7f94f80c5ac0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0245a0 con 0x7f94f80c5ac0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f816dde0 con 0x7f94f80c5ac0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec024960 con 0x7f94f80c5ac0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.201+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f80b4550 con 0x7f94f80c5ac0 2023-12-24T20:10:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94f804be40 con 0x7f94f80c5ac0 2023-12-24T20:10:59.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f94ec024d50 con 0x7f94f80c5ac0 2023-12-24T20:10:59.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94e4060550 0x7f94e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f94ec07ef90 con 0x7f94f80c5ac0 2023-12-24T20:10:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f94e40671b0 0x7f94e4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94e4069c40 con 0x7f94e40671b0 2023-12-24T20:10:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ec07f360 con 0x7f94f80c5ac0 2023-12-24T20:10:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94f6d9d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94e4060550 0x7f94e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.205+0000 7f94f759e700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f94e40671b0 0x7f94e4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.209+0000 7f94f759e700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f94e40671b0 0x7f94e4069610 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.209+0000 7f94f6d9d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94e4060550 0x7f94e4062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f94e8006fd0 tx=0x7f94e8008040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.209+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== osd.0 v2:172.21.15.50:6816/33902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f94e4069c40 con 0x7f94e40671b0 2023-12-24T20:10:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 --> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94f80b4a40 con 0x7f94e40671b0 2023-12-24T20:10:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94deffd700 1 -- 172.21.15.50:0/950233018 <== osd.0 v2:172.21.15.50:6816/33902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f94f0001bb0 con 0x7f94e40671b0 2023-12-24T20:10:59.228 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:10:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:10:59.228 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f94e40671b0 msgr2=0x7f94e4069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6816/33902,v1:172.21.15.50:6817/33902] conn(0x7f94e40671b0 0x7f94e4069610 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94e4060550 msgr2=0x7f94e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f94e4060550 0x7f94e4062a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f94e8006fd0 tx=0x7f94e8008040 comp rx=0 tx=0).stop 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 msgr2=0x7f94f8159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 --2- 172.21.15.50:0/950233018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f80c5ac0 0x7f94f8159a60 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f94f8064390 tx=0x7f94ec017000 comp rx=0 tx=0).stop 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94f759e700 1 -- 172.21.15.50:0/950233018 reap_dead start 2023-12-24T20:10:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 shutdown_connections 2023-12-24T20:10:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 >> 172.21.15.50:0/950233018 conn(0x7f94f8067b80 msgr2=0x7f94f8149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 shutdown_connections 2023-12-24T20:10:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.225+0000 7f94fc82d700 1 -- 172.21.15.50:0/950233018 wait complete. 2023-12-24T20:10:59.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-24T20:10:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.413+0000 7fc3a3e6e700 1 Processor -- start 2023-12-24T20:10:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.413+0000 7fc3a3e6e700 1 -- start start 2023-12-24T20:10:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a3e6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc39c0b22b0 0x7fc39c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a3e6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c0b41d0 con 0x7fc39c15d6d0 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a3e6e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c06d5c0 con 0x7fc39c158e10 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a3e6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0b49c0 con 0x7fc39c0b22b0 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a1409700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc39c15d6d0 0x7fc39c0b1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47014/0 (socket says 172.21.15.50:47014) 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a1409700 1 -- 172.21.15.50:0/397524238 learned_addr learned my addr 172.21.15.50:0/397524238 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a240b700 1 --2- 172.21.15.50:0/397524238 >> v2:172.21.15.82:3300/0 conn(0x7fc39c0b22b0 0x7fc39c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388508010 0 0) 0x7fc39c0b41d0 con 0x7fc39c15d6d0 2023-12-24T20:10:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc388003570 con 0x7fc39c15d6d0 2023-12-24T20:10:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051624469 0 0) 0x7fc39c06d5c0 con 0x7fc39c158e10 2023-12-24T20:10:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c0b41d0 con 0x7fc39c158e10 2023-12-24T20:10:59.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a240b700 1 -- 172.21.15.50:0/397524238 >> v1:172.21.15.82:6789/0 conn(0x7fc39c158e10 legacy=0x7fc39c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a240b700 1 -- 172.21.15.50:0/397524238 >> v1:172.21.15.50:6789/0 conn(0x7fc39c15d6d0 legacy=0x7fc39c0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.417+0000 7fc3a240b700 1 -- 172.21.15.50:0/397524238 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c15db20 con 0x7fc39c0b22b0 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a240b700 1 --2- 172.21.15.50:0/397524238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c0b3c90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b8cd6d6c8cd153 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394011630 con 0x7fc39c0b22b0 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394011790 con 0x7fc39c0b22b0 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a0c08700 1 -- 172.21.15.50:0/397524238 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394011b30 con 0x7fc39c0b22b0 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/397524238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 msgr2=0x7fc39c0b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/397524238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c0b3c90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/397524238 shutdown_connections 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/397524238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c0b3c90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/397524238 >> 172.21.15.50:0/397524238 conn(0x7fc39c0670b0 msgr2=0x7fc39c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/397524238 shutdown_connections 2023-12-24T20:10:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.421+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/397524238 wait complete. 2023-12-24T20:10:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 Processor -- start 2023-12-24T20:10:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 -- start start 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc39c158e10 0x7fc39c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c14b710 con 0x7fc39c15d6d0 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15bd70 con 0x7fc39c0b22b0 2023-12-24T20:10:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a3e6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15b1a0 con 0x7fc39c158e10 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a240b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a240b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46850/0 (socket says 172.21.15.50:46850) 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a240b700 1 -- 172.21.15.50:0/812332623 learned_addr learned my addr 172.21.15.50:0/812332623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a1409700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc39c158e10 0x7fc39c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.425+0000 7fc3a1c0a700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 -- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc39c158e10 msgr2=0x7fc39c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc39c158e10 0x7fc39c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 -- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 msgr2=0x7fc39c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 -- 172.21.15.50:0/812332623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009420 con 0x7fc39c15d6d0 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a240b700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fc394013000 tx=0x7fc394017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39401f070 con 0x7fc39c15d6d0 2023-12-24T20:10:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394002f70 con 0x7fc39c15d6d0 2023-12-24T20:10:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c14bbc0 con 0x7fc39c15d6d0 2023-12-24T20:10:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394023640 con 0x7fc39c15d6d0 2023-12-24T20:10:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c15b720 con 0x7fc39c15d6d0 2023-12-24T20:10:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.429+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c0652e0 con 0x7fc39c15d6d0 2023-12-24T20:10:59.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.433+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc39402c3b0 con 0x7fc39c15d6d0 2023-12-24T20:10:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.433+0000 7fc391ffb700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 0x7fc380062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.433+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fc39407dd80 con 0x7fc39c15d6d0 2023-12-24T20:10:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.433+0000 7fc3a1c0a700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 0x7fc380062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.433+0000 7fc3a1c0a700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 0x7fc380062a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc398004140 tx=0x7fc398007f90 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.441+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc39404e090 con 0x7fc39c15d6d0 2023-12-24T20:10:59.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc39c06ca20 con 0x7fc380060580 2023-12-24T20:10:59.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc391ffb700 1 -- 172.21.15.50:0/812332623 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc39c06ca20 con 0x7fc380060580 2023-12-24T20:10:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 msgr2=0x7fc380062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 0x7fc380062a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc398004140 tx=0x7fc398007f90 comp rx=0 tx=0).stop 2023-12-24T20:10:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 msgr2=0x7fc39c16ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fc394013000 tx=0x7fc394017000 comp rx=0 tx=0).stop 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 shutdown_connections 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc380060580 0x7fc380062a30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39c15d6d0 0x7fc39c16ca40 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc39c158e10 0x7fc39c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 --2- 172.21.15.50:0/812332623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39c0b22b0 0x7fc39c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.613+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 >> 172.21.15.50:0/812332623 conn(0x7fc39c0670b0 msgr2=0x7fc39c14c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.617+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 shutdown_connections 2023-12-24T20:10:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.617+0000 7fc3a3e6e700 1 -- 172.21.15.50:0/812332623 wait complete. 2023-12-24T20:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2023-12-24T20:10:59.638 INFO:tasks.ceph:Scrubbing osd.1 2023-12-24T20:10:59.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:10:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.817+0000 7f4608aae700 1 Processor -- start 2023-12-24T20:10:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.817+0000 7f4608aae700 1 -- start start 2023-12-24T20:10:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4608aae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f460415c7a0 0x7f460415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4608aae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460406b6b0 con 0x7f460415c3d0 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4608aae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46040cba20 con 0x7f46040cb2b0 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4608aae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460406c250 con 0x7f460415c7a0 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f460415c3d0 0x7f460406bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47020/0 (socket says 172.21.15.50:47020) 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460259c700 1 -- 172.21.15.50:0/3355642547 learned_addr learned my addr 172.21.15.50:0/3355642547 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:10:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4601d9b700 1 --2- 172.21.15.50:0/3355642547 >> v2:172.21.15.82:3300/0 conn(0x7f460415c7a0 0x7f460415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929178219 0 0) 0x7f460406b6b0 con 0x7f460415c3d0 2023-12-24T20:10:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ec003570 con 0x7f460415c3d0 2023-12-24T20:10:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176550336 0 0) 0x7f46040cba20 con 0x7f46040cb2b0 2023-12-24T20:10:59.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f460406b6b0 con 0x7f46040cb2b0 2023-12-24T20:10:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4601d9b700 1 -- 172.21.15.50:0/3355642547 >> v1:172.21.15.82:6789/0 conn(0x7f46040cb2b0 legacy=0x7f46040cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4601d9b700 1 -- 172.21.15.50:0/3355642547 >> v1:172.21.15.50:6789/0 conn(0x7f460415c3d0 legacy=0x7f460406bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4601d9b700 1 -- 172.21.15.50:0/3355642547 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460406ad80 con 0x7f460415c7a0 2023-12-24T20:10:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.821+0000 7f4601d9b700 1 --2- 172.21.15.50:0/3355642547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f460415d810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f45f80098e0 tx=0x7f45f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d977ca252aad0e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8011630 con 0x7f460415c7a0 2023-12-24T20:10:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8011790 con 0x7f460415c7a0 2023-12-24T20:10:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f460159a700 1 -- 172.21.15.50:0/3355642547 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8011b30 con 0x7f460415c7a0 2023-12-24T20:10:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 -- 172.21.15.50:0/3355642547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 msgr2=0x7f460415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 --2- 172.21.15.50:0/3355642547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f460415d810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f45f80098e0 tx=0x7f45f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 -- 172.21.15.50:0/3355642547 shutdown_connections 2023-12-24T20:10:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 --2- 172.21.15.50:0/3355642547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f460415d810 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 -- 172.21.15.50:0/3355642547 >> 172.21.15.50:0/3355642547 conn(0x7f46040670b0 msgr2=0x7f46040674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 -- 172.21.15.50:0/3355642547 shutdown_connections 2023-12-24T20:10:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.825+0000 7f4608aae700 1 -- 172.21.15.50:0/3355642547 wait complete. 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 Processor -- start 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 -- start start 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 0x7f460416c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f460415c3d0 0x7f46040c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f46040b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040c9ff0 con 0x7f46040cb2b0 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040c93e0 con 0x7f460415c7a0 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4608aae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040c96c0 con 0x7f460415c3d0 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 0x7f460416c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 0x7f460416c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46852/0 (socket says 172.21.15.50:46852) 2023-12-24T20:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 -- 172.21.15.50:0/1390464741 learned_addr learned my addr 172.21.15.50:0/1390464741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4601d9b700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f460415c3d0 0x7f46040c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f4602d9d700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f46040b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 -- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f460415c3d0 msgr2=0x7f46040c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f460415c3d0 0x7f46040c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 -- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 msgr2=0x7f46040b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f460415c7a0 0x7f46040b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009420 con 0x7f46040cb2b0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f460259c700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 0x7f460416c630 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f45f400c790 tx=0x7f45f4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4005b30 con 0x7f46040cb2b0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.829+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4005c90 con 0x7f46040cb2b0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.833+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4007300 con 0x7f46040cb2b0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.833+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46040c99a0 con 0x7f46040cb2b0 2023-12-24T20:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.833+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460416cb70 con 0x7f46040cb2b0 2023-12-24T20:10:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.833+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4604071060 con 0x7f46040cb2b0 2023-12-24T20:10:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.833+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f45f401b3b0 con 0x7f46040cb2b0 2023-12-24T20:10:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f45e4060550 0x7f45e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f45f407bee0 con 0x7f46040cb2b0 2023-12-24T20:10:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f4601d9b700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f45e4060550 0x7f45e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f45e40671b0 0x7f45e4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:10:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45e4069c40 con 0x7f45e40671b0 2023-12-24T20:10:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f407e4c0 con 0x7f46040cb2b0 2023-12-24T20:10:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f4602d9d700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f45e40671b0 0x7f45e4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:10:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f4601d9b700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f45e4060550 0x7f45e4062a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f45f80091e0 tx=0x7f45f8017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f4602d9d700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f45e40671b0 0x7f45e4069610 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:10:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.837+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== osd.1 v2:172.21.15.50:6800/33900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f45e4069c40 con 0x7f45e40671b0 2023-12-24T20:10:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 --> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f460406a930 con 0x7f45e40671b0 2023-12-24T20:10:59.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f45f27fc700 1 -- 172.21.15.50:0/1390464741 <== osd.1 v2:172.21.15.50:6800/33900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f460406a930 con 0x7f45e40671b0 2023-12-24T20:10:59.859 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:10:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:10:59.859 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f45e40671b0 msgr2=0x7f45e4069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6800/33900,v1:172.21.15.50:6801/33900] conn(0x7f45e40671b0 0x7f45e4069610 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f45e4060550 msgr2=0x7f45e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f45e4060550 0x7f45e4062a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f45f80091e0 tx=0x7f45f8017000 comp rx=0 tx=0).stop 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 msgr2=0x7f460416c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 --2- 172.21.15.50:0/1390464741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46040cb2b0 0x7f460416c630 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f45f400c790 tx=0x7f45f4007ea0 comp rx=0 tx=0).stop 2023-12-24T20:10:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4602d9d700 1 -- 172.21.15.50:0/1390464741 reap_dead start 2023-12-24T20:10:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 shutdown_connections 2023-12-24T20:10:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 >> 172.21.15.50:0/1390464741 conn(0x7f46040670b0 msgr2=0x7f460415b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:10:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 shutdown_connections 2023-12-24T20:10:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:10:59.857+0000 7f4608aae700 1 -- 172.21.15.50:0/1390464741 wait complete. 2023-12-24T20:10:59.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-24T20:11:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.049+0000 7f1af680c700 1 Processor -- start 2023-12-24T20:11:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.049+0000 7f1af680c700 1 -- start start 2023-12-24T20:11:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.049+0000 7f1af680c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1af00b41e0 0x7f1af01591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.049+0000 7f1af680c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af006b640 con 0x7f1af006d8c0 2023-12-24T20:11:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af680c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af00b5e10 con 0x7f1af0158e00 2023-12-24T20:11:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af680c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af0159710 con 0x7f1af00b41e0 2023-12-24T20:11:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af580a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1af0158e00 0x7f1af00b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36218/0 (socket says 172.21.15.50:36218) 2023-12-24T20:11:00.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af580a700 1 -- 172.21.15.50:0/1012098590 learned_addr learned my addr 172.21.15.50:0/1012098590 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:00.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af600b700 1 --1- 172.21.15.50:0/1012098590 >> v1:172.21.15.50:6789/0 conn(0x7f1af006d8c0 0x7f1af0159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47028/0 (socket says 172.21.15.50:47028) 2023-12-24T20:11:00.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af5009700 1 --2- 172.21.15.50:0/1012098590 >> v2:172.21.15.50:3300/0 conn(0x7f1af00b41e0 0x7f1af01591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af5009700 1 -- 172.21.15.50:0/1012098590 >> v1:172.21.15.82:6789/0 conn(0x7f1af0158e00 legacy=0x7f1af00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af5009700 1 -- 172.21.15.50:0/1012098590 >> v1:172.21.15.50:6789/0 conn(0x7f1af006d8c0 legacy=0x7f1af0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af5009700 1 -- 172.21.15.50:0/1012098590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af006b8e0 con 0x7f1af00b41e0 2023-12-24T20:11:00.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af5009700 1 --2- 172.21.15.50:0/1012098590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af00b41e0 0x7f1af01591d0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00098e0 tx=0x7f1ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa4ce1f1b1e2621 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af4808700 1 -- 172.21.15.50:0/1012098590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0009e80 con 0x7f1af00b41e0 2023-12-24T20:11:00.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af4808700 1 -- 172.21.15.50:0/1012098590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000b860 con 0x7f1af00b41e0 2023-12-24T20:11:00.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.053+0000 7f1af4808700 1 -- 172.21.15.50:0/1012098590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000bbe0 con 0x7f1af00b41e0 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- 172.21.15.50:0/1012098590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af00b41e0 msgr2=0x7f1af01591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 --2- 172.21.15.50:0/1012098590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af00b41e0 0x7f1af01591d0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00098e0 tx=0x7f1ae00091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- 172.21.15.50:0/1012098590 shutdown_connections 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 --2- 172.21.15.50:0/1012098590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af00b41e0 0x7f1af01591d0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- 172.21.15.50:0/1012098590 >> 172.21.15.50:0/1012098590 conn(0x7f1af0067b80 msgr2=0x7f1af00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- 172.21.15.50:0/1012098590 shutdown_connections 2023-12-24T20:11:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- 172.21.15.50:0/1012098590 wait complete. 2023-12-24T20:11:00.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 Processor -- start 2023-12-24T20:11:00.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- start start 2023-12-24T20:11:00.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 0x7f1af0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0153f90 con 0x7f1af0158e00 2023-12-24T20:11:00.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0153380 con 0x7f1af00b41e0 2023-12-24T20:11:00.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.057+0000 7f1af680c700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0153660 con 0x7f1af006d8c0 2023-12-24T20:11:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af600b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.50:38656/0 (socket says 172.21.15.50:38656) 2023-12-24T20:11:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 -- 172.21.15.50:0/1313431767 learned_addr learned my addr 172.21.15.50:0/1313431767 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af600b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46870/0 (socket says 172.21.15.50:46870) 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af580a700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 0x7f1af0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 -- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 msgr2=0x7f1af0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 0x7f1af0154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 -- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 msgr2=0x7f1af0151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 -- 172.21.15.50:0/1313431767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009420 con 0x7f1af00b41e0 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af580a700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 0x7f1af0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af600b700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:11:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af5009700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0013000 tx=0x7f1ae0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000b9d0 con 0x7f1af00b41e0 2023-12-24T20:11:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000bb30 con 0x7f1af00b41e0 2023-12-24T20:11:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0025650 con 0x7f1af00b41e0 2023-12-24T20:11:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af0153940 con 0x7f1af00b41e0 2023-12-24T20:11:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.061+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af014ea10 con 0x7f1af00b41e0 2023-12-24T20:11:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af0154140 con 0x7f1af00b41e0 2023-12-24T20:11:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1ae0023070 con 0x7f1af00b41e0 2023-12-24T20:11:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1ae5ffb700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 0x7f1ad4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f1ae007e000 con 0x7f1af00b41e0 2023-12-24T20:11:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1af580a700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 0x7f1ad4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.065+0000 7f1af580a700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 0x7f1ad4062a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007110 tx=0x7f1aec007f10 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.073+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1af0154140 con 0x7f1af00b41e0 2023-12-24T20:11:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.245+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1af0154100 con 0x7f1ad4060580 2023-12-24T20:11:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.249+0000 7f1ae5ffb700 1 -- 172.21.15.50:0/1313431767 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1af0154100 con 0x7f1ad4060580 2023-12-24T20:11:00.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 msgr2=0x7f1ad4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 0x7f1ad4062a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007110 tx=0x7f1aec007f10 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 msgr2=0x7f1af014e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0013000 tx=0x7f1ae0017000 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 shutdown_connections 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1ad4060580 0x7f1ad4062a30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1af0158e00 0x7f1af0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af00b41e0 0x7f1af014e4d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 --2- 172.21.15.50:0/1313431767 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1af006d8c0 0x7f1af0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 >> 172.21.15.50:0/1313431767 conn(0x7f1af0067b80 msgr2=0x7f1af00a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 shutdown_connections 2023-12-24T20:11:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.253+0000 7f1af680c700 1 -- 172.21.15.50:0/1313431767 wait complete. 2023-12-24T20:11:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2023-12-24T20:11:00.278 INFO:tasks.ceph:Scrubbing osd.2 2023-12-24T20:11:00.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:00.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.441+0000 7f514e26e700 1 Processor -- start 2023-12-24T20:11:00.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.441+0000 7f514e26e700 1 -- start start 2023-12-24T20:11:00.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514e26e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51480b4700 0x7f514806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514e26e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f514806a730 0x7f514806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514e26e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51480b3660 con 0x7f51481590c0 2023-12-24T20:11:00.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514e26e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514806b110 con 0x7f514806a730 2023-12-24T20:11:00.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514e26e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480b3940 con 0x7f51480b4700 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f5147fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f51481590c0 0x7f51480b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47030/0 (socket says 172.21.15.50:47030) 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f5147fff700 1 -- 172.21.15.50:0/4256194494 learned_addr learned my addr 172.21.15.50:0/4256194494 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f514c80b700 1 --2- 172.21.15.50:0/4256194494 >> v2:172.21.15.82:3300/0 conn(0x7f514806a730 0x7f514806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.445+0000 7f51477fe700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51480b4700 0x7f514806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514c80b700 1 -- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51480b4700 msgr2=0x7f514806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514c80b700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51480b4700 0x7f514806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514c80b700 1 -- 172.21.15.50:0/4256194494 >> v1:172.21.15.50:6789/0 conn(0x7f51481590c0 legacy=0x7f51480b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514c80b700 1 -- 172.21.15.50:0/4256194494 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51480b3c20 con 0x7f514806a730 2023-12-24T20:11:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f5146ffd700 1 -- 172.21.15.50:0/4256194494 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490154693 0 0) 0x7f51480b3660 con 0x7f51481590c0 2023-12-24T20:11:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514c80b700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514806abd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5140009e60 tx=0x7f5140009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc700dffef916e31 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f5146ffd700 1 -- 172.21.15.50:0/4256194494 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000e070 con 0x7f514806a730 2023-12-24T20:11:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f5146ffd700 1 -- 172.21.15.50:0/4256194494 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000bc30 con 0x7f514806a730 2023-12-24T20:11:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f5146ffd700 1 -- 172.21.15.50:0/4256194494 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140012430 con 0x7f514806a730 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 -- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 msgr2=0x7f514806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514806abd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5140009e60 tx=0x7f5140009780 comp rx=0 tx=0).stop 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 -- 172.21.15.50:0/4256194494 shutdown_connections 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514806abd0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 --2- 172.21.15.50:0/4256194494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51480b4700 0x7f514806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 -- 172.21.15.50:0/4256194494 >> 172.21.15.50:0/4256194494 conn(0x7f5148067b40 msgr2=0x7f51480b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 -- 172.21.15.50:0/4256194494 shutdown_connections 2023-12-24T20:11:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.449+0000 7f514e26e700 1 -- 172.21.15.50:0/4256194494 wait complete. 2023-12-24T20:11:00.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.453+0000 7f514e26e700 1 Processor -- start 2023-12-24T20:11:00.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.453+0000 7f514e26e700 1 -- start start 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 0x7f514816d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51481590c0 0x7f5148141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480b0a30 con 0x7f51480b4700 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514816d7e0 con 0x7f514806a730 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480afe20 con 0x7f51481590c0 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 0x7f514816d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 0x7f514816d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46872/0 (socket says 172.21.15.50:46872) 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 -- 172.21.15.50:0/1496324622 learned_addr learned my addr 172.21.15.50:0/1496324622 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f5147fff700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514c80b700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51481590c0 0x7f5148141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 -- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51481590c0 msgr2=0x7f5148141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51481590c0 0x7f5148141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 -- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 msgr2=0x7f514814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514806a730 0x7f514814caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009a20 con 0x7f51480b4700 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f51477fe700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 0x7f514816d2a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d8c0 tx=0x7f513c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0125f0 con 0x7f51480b4700 2023-12-24T20:11:00.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51480b0100 con 0x7f51480b4700 2023-12-24T20:11:00.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c012750 con 0x7f51480b4700 2023-12-24T20:11:00.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c012af0 con 0x7f51480b4700 2023-12-24T20:11:00.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51480b06c0 con 0x7f51480b4700 2023-12-24T20:11:00.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.457+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5148071060 con 0x7f51480b4700 2023-12-24T20:11:00.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.461+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f513c01e460 con 0x7f51480b4700 2023-12-24T20:11:00.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.461+0000 7f512ffff700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f5134060550 0x7f5134062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.461+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f513c07db80 con 0x7f51480b4700 2023-12-24T20:11:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f5147fff700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f5134060550 0x7f5134062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f512ffff700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f51340671b0 0x7f5134069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5134069c40 con 0x7f51340671b0 2023-12-24T20:11:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f513c07de70 con 0x7f51480b4700 2023-12-24T20:11:00.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f514c80b700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f51340671b0 0x7f5134069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f5147fff700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f5134060550 0x7f5134062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5138007160 tx=0x7f5138007f50 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f514c80b700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f51340671b0 0x7f5134069610 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.465+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== osd.2 v2:172.21.15.50:6818/33907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5134069c40 con 0x7f51340671b0 2023-12-24T20:11:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.485+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 --> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51480b3f00 con 0x7f51340671b0 2023-12-24T20:11:00.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.485+0000 7f512ffff700 1 -- 172.21.15.50:0/1496324622 <== osd.2 v2:172.21.15.50:6818/33907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51480b3f00 con 0x7f51340671b0 2023-12-24T20:11:00.490 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:00.490 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:00.490 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.485+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f51340671b0 msgr2=0x7f5134069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.485+0000 7f514e26e700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6818/33907,v1:172.21.15.50:6820/33907] conn(0x7f51340671b0 0x7f5134069610 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f5134060550 msgr2=0x7f5134062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f5134060550 0x7f5134062a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5138007160 tx=0x7f5138007f50 comp rx=0 tx=0).stop 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 msgr2=0x7f514816d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 --2- 172.21.15.50:0/1496324622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51480b4700 0x7f514816d2a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d8c0 tx=0x7f513c008040 comp rx=0 tx=0).stop 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514c80b700 1 -- 172.21.15.50:0/1496324622 reap_dead start 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 shutdown_connections 2023-12-24T20:11:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 >> 172.21.15.50:0/1496324622 conn(0x7f5148067b40 msgr2=0x7f51481566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 shutdown_connections 2023-12-24T20:11:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.489+0000 7f514e26e700 1 -- 172.21.15.50:0/1496324622 wait complete. 2023-12-24T20:11:00.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-24T20:11:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 Processor -- start 2023-12-24T20:11:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 -- start start 2023-12-24T20:11:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4c00ccdd0 0x7fa4c00b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c006d890 con 0x7fa4c00cc980 2023-12-24T20:11:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c006ca30 con 0x7fa4c015c860 2023-12-24T20:11:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.685+0000 7fa4c4985700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c006cc80 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4b7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4c00cc980 0x7fa4c00b00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47038/0 (socket says 172.21.15.50:47038) 2023-12-24T20:11:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4b7fff700 1 -- 172.21.15.50:0/2058830485 learned_addr learned my addr 172.21.15.50:0/2058830485 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:00.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bed9d700 1 --2- 172.21.15.50:0/2058830485 >> v2:172.21.15.82:3300/0 conn(0x7fa4c00ccdd0 0x7fa4c00b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439372285 0 0) 0x7fa4c006d890 con 0x7fa4c00cc980 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac003570 con 0x7fa4c00cc980 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bed9d700 1 -- 172.21.15.50:0/2058830485 >> v1:172.21.15.82:6789/0 conn(0x7fa4c015c860 legacy=0x7fa4c006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bed9d700 1 -- 172.21.15.50:0/2058830485 >> v1:172.21.15.50:6789/0 conn(0x7fa4c00cc980 legacy=0x7fa4c00b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377141014 0 0) 0x7fa4c006ca30 con 0x7fa4c015c860 2023-12-24T20:11:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bed9d700 1 -- 172.21.15.50:0/2058830485 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c006cf60 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bed9d700 1 --2- 172.21.15.50:0/2058830485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b07e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009e60 tx=0x7fa4b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1f3acc122136b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800e070 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800bb60 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4bdd9b700 1 -- 172.21.15.50:0/2058830485 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8012430 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4c4985700 1 -- 172.21.15.50:0/2058830485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c00ccdd0 msgr2=0x7fa4c00b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4c4985700 1 --2- 172.21.15.50:0/2058830485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b07e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009e60 tx=0x7fa4b8009780 comp rx=0 tx=0).stop 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4c4985700 1 -- 172.21.15.50:0/2058830485 shutdown_connections 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4c4985700 1 --2- 172.21.15.50:0/2058830485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b07e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.689+0000 7fa4c4985700 1 -- 172.21.15.50:0/2058830485 >> 172.21.15.50:0/2058830485 conn(0x7fa4c00670b0 msgr2=0x7fa4c00674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.693+0000 7fa4c4985700 1 -- 172.21.15.50:0/2058830485 shutdown_connections 2023-12-24T20:11:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.693+0000 7fa4c4985700 1 -- 172.21.15.50:0/2058830485 wait complete. 2023-12-24T20:11:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.693+0000 7fa4c4985700 1 Processor -- start 2023-12-24T20:11:00.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.693+0000 7fa4c4985700 1 -- start start 2023-12-24T20:11:00.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 0x7fa4c0169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 0x7fa4c01534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c016a140 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00b5100 con 0x7fa4c015c860 2023-12-24T20:11:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4c4985700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01539e0 con 0x7fa4c00cc980 2023-12-24T20:11:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46878/0 (socket says 172.21.15.50:46878) 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 -- 172.21.15.50:0/3070363876 learned_addr learned my addr 172.21.15.50:0/3070363876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4be59c700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 0x7fa4c0169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4bed9d700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 0x7fa4c01534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 -- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 msgr2=0x7fa4c0169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 0x7fa4c0169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 -- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 msgr2=0x7fa4c01534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 0x7fa4c01534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 -- 172.21.15.50:0/3070363876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009a20 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4be59c700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 0x7fa4c0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:11:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4bed9d700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 0x7fa4c01534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:11:00.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.697+0000 7fa4b7fff700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c7f0 tx=0x7fa4a8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8005b30 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005cb0 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8007320 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c016a390 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c016a950 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c00652e0 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.701+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fa4a801b3b0 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.705+0000 7fa4b67fc700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 0x7fa4a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:00.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.705+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fa4a807bfe0 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.705+0000 7fa4be59c700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 0x7fa4a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:00.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.705+0000 7fa4be59c700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 0x7fa4a0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0001d80 tx=0x7fa4b0009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.709+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa4a804c310 con 0x7fa4c00ccdd0 2023-12-24T20:11:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.877+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4c0156c40 con 0x7fa4a0060550 2023-12-24T20:11:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4b67fc700 1 -- 172.21.15.50:0/3070363876 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4c0156c40 con 0x7fa4a0060550 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 msgr2=0x7fa4a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 0x7fa4a0062a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0001d80 tx=0x7fa4b0009040 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 msgr2=0x7fa4c00b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c7f0 tx=0x7fa4a8007e00 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 shutdown_connections 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fa4a0060550 0x7fa4a0062a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4c015c860 0x7fa4c01534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c00ccdd0 0x7fa4c00b4bc0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 --2- 172.21.15.50:0/3070363876 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4c00cc980 0x7fa4c0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 >> 172.21.15.50:0/3070363876 conn(0x7fa4c00670b0 msgr2=0x7fa4c0156100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:00.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 shutdown_connections 2023-12-24T20:11:00.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:00.881+0000 7fa4c4985700 1 -- 172.21.15.50:0/3070363876 wait complete. 2023-12-24T20:11:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2023-12-24T20:11:00.905 INFO:tasks.ceph:Scrubbing osd.3 2023-12-24T20:11:00.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:01.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 Processor -- start 2023-12-24T20:11:01.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 -- start start 2023-12-24T20:11:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 0x7f33140aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f331415b090 0x7f33140c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140c6c70 con 0x7f33140aefe0 2023-12-24T20:11:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140c6940 con 0x7f331415b090 2023-12-24T20:11:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.077+0000 7f33196ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140af4f0 con 0x7f3314154610 2023-12-24T20:11:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33127fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f33140aefe0 0x7f331415a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36234/0 (socket says 172.21.15.50:36234) 2023-12-24T20:11:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33127fc700 1 -- 172.21.15.50:0/748733928 learned_addr learned my addr 172.21.15.50:0/748733928 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 --2- 172.21.15.50:0/748733928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 0x7f33140aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33137fe700 1 --2- 172.21.15.50:0/748733928 >> v2:172.21.15.82:3300/0 conn(0x7f331415b090 0x7f33140c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3311ffb700 1 -- 172.21.15.50:0/748733928 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867962277 0 0) 0x7f33140c6c70 con 0x7f33140aefe0 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3311ffb700 1 -- 172.21.15.50:0/748733928 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32fc003570 con 0x7f33140aefe0 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 -- 172.21.15.50:0/748733928 >> v2:172.21.15.82:3300/0 conn(0x7f331415b090 msgr2=0x7f33140c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 --2- 172.21.15.50:0/748733928 >> v2:172.21.15.82:3300/0 conn(0x7f331415b090 0x7f33140c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 -- 172.21.15.50:0/748733928 >> v1:172.21.15.82:6789/0 conn(0x7f33140aefe0 legacy=0x7f331415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 -- 172.21.15.50:0/748733928 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140af7d0 con 0x7f3314154610 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3312ffd700 1 --2- 172.21.15.50:0/748733928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 0x7f33140aeaa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33040098e0 tx=0x7f33040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9721056595a89b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3311ffb700 1 -- 172.21.15.50:0/748733928 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304011630 con 0x7f3314154610 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3311ffb700 1 -- 172.21.15.50:0/748733928 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304011790 con 0x7f3314154610 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f3311ffb700 1 -- 172.21.15.50:0/748733928 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304011b30 con 0x7f3314154610 2023-12-24T20:11:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 -- 172.21.15.50:0/748733928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 msgr2=0x7f33140aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 --2- 172.21.15.50:0/748733928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 0x7f33140aeaa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33040098e0 tx=0x7f33040091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 -- 172.21.15.50:0/748733928 shutdown_connections 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 --2- 172.21.15.50:0/748733928 >> v2:172.21.15.82:3300/0 conn(0x7f331415b090 0x7f33140c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 --2- 172.21.15.50:0/748733928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3314154610 0x7f33140aeaa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 -- 172.21.15.50:0/748733928 >> 172.21.15.50:0/748733928 conn(0x7f3314067b80 msgr2=0x7f33140cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 -- 172.21.15.50:0/748733928 shutdown_connections 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.081+0000 7f33196ae700 1 -- 172.21.15.50:0/748733928 wait complete. 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 Processor -- start 2023-12-24T20:11:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 -- start start 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33140aefe0 0x7f331416a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 0x7f331416cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f331415b090 0x7f331416d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314169a50 con 0x7f3314154610 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331416d8b0 con 0x7f331415b090 2023-12-24T20:11:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33196ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331416db90 con 0x7f33140aefe0 2023-12-24T20:11:01.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33127fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 0x7f331416cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33127fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 0x7f331416cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46880/0 (socket says 172.21.15.50:46880) 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33127fc700 1 -- 172.21.15.50:0/2848246866 learned_addr learned my addr 172.21.15.50:0/2848246866 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33137fe700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f331415b090 0x7f331416d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f3312ffd700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33140aefe0 0x7f331416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33127fc700 1 -- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33140aefe0 msgr2=0x7f331416a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.085+0000 7f33127fc700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33140aefe0 0x7f331416a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33127fc700 1 -- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f331415b090 msgr2=0x7f331416d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33127fc700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f331415b090 0x7f331416d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33127fc700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009420 con 0x7f3314154610 2023-12-24T20:11:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33137fe700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f331415b090 0x7f331416d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:11:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33127fc700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 0x7f331416cd40 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f330800c590 tx=0x7f3308007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308005b30 con 0x7f3314154610 2023-12-24T20:11:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308005cb0 con 0x7f3314154610 2023-12-24T20:11:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308007320 con 0x7f3314154610 2023-12-24T20:11:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331416a910 con 0x7f3314154610 2023-12-24T20:11:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331416aed0 con 0x7f3314154610 2023-12-24T20:11:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.089+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f331404be40 con 0x7f3314154610 2023-12-24T20:11:01.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f330801b3b0 con 0x7f3314154610 2023-12-24T20:11:01.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3300060550 0x7f3300062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f330807bef0 con 0x7f3314154610 2023-12-24T20:11:01.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f33000671b0 0x7f3300069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f3312ffd700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3300060550 0x7f3300062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3300069c40 con 0x7f33000671b0 2023-12-24T20:11:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f330807e450 con 0x7f3314154610 2023-12-24T20:11:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f33137fe700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f33000671b0 0x7f3300069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.093+0000 7f3312ffd700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3300060550 0x7f3300062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33040091e0 tx=0x7f3304017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.097+0000 7f33137fe700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f33000671b0 0x7f3300069610 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.097+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== osd.3 v2:172.21.15.50:6803/33905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3300069c40 con 0x7f33000671b0 2023-12-24T20:11:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 --> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3314156d20 con 0x7f33000671b0 2023-12-24T20:11:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f32faffd700 1 -- 172.21.15.50:0/2848246866 <== osd.3 v2:172.21.15.50:6803/33905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3314156d20 con 0x7f33000671b0 2023-12-24T20:11:01.118 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:01.119 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:01.119 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f33000671b0 msgr2=0x7f3300069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6803/33905,v1:172.21.15.50:6805/33905] conn(0x7f33000671b0 0x7f3300069610 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3300060550 msgr2=0x7f3300062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3300060550 0x7f3300062a00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33040091e0 tx=0x7f3304017000 comp rx=0 tx=0).stop 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 msgr2=0x7f331416cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33196ae700 1 --2- 172.21.15.50:0/2848246866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314154610 0x7f331416cd40 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f330800c590 tx=0x7f3308007e00 comp rx=0 tx=0).stop 2023-12-24T20:11:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.113+0000 7f33137fe700 1 -- 172.21.15.50:0/2848246866 reap_dead start 2023-12-24T20:11:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.117+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 shutdown_connections 2023-12-24T20:11:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.117+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 >> 172.21.15.50:0/2848246866 conn(0x7f3314067b80 msgr2=0x7f33140b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.117+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 shutdown_connections 2023-12-24T20:11:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.117+0000 7f33196ae700 1 -- 172.21.15.50:0/2848246866 wait complete. 2023-12-24T20:11:01.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-24T20:11:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.309+0000 7f2c686ae700 1 Processor -- start 2023-12-24T20:11:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.309+0000 7f2c686ae700 1 -- start start 2023-12-24T20:11:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c686ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c60157800 0x7f2c600cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c686ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c600b3900 0x7f2c600cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c686ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c600b0c60 con 0x7f2c60157bd0 2023-12-24T20:11:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c686ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600b1cc0 con 0x7f2c60157800 2023-12-24T20:11:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c686ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600b3d80 con 0x7f2c600b3900 2023-12-24T20:11:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c60157800 0x7f2c600cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c60157800 0x7f2c600cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46892/0 (socket says 172.21.15.50:46892) 2023-12-24T20:11:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 -- 172.21.15.50:0/3526770655 learned_addr learned my addr 172.21.15.50:0/3526770655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c66c4b700 1 --2- 172.21.15.50:0/3526770655 >> v2:172.21.15.82:3300/0 conn(0x7f2c600b3900 0x7f2c600cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 -- 172.21.15.50:0/3526770655 >> v2:172.21.15.82:3300/0 conn(0x7f2c600b3900 msgr2=0x7f2c600cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:01.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 --2- 172.21.15.50:0/3526770655 >> v2:172.21.15.82:3300/0 conn(0x7f2c600b3900 0x7f2c600cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 -- 172.21.15.50:0/3526770655 >> v1:172.21.15.82:6789/0 conn(0x7f2c60157bd0 legacy=0x7f2c600b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 -- 172.21.15.50:0/3526770655 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600b0f00 con 0x7f2c60157800 2023-12-24T20:11:01.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.313+0000 7f2c6644a700 1 --2- 172.21.15.50:0/3526770655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c60157800 0x7f2c600cd290 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b2090 tx=0x7f2c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853da2d80e27eea7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c65448700 1 -- 172.21.15.50:0/3526770655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00b860 con 0x7f2c60157800 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c65448700 1 -- 172.21.15.50:0/3526770655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00b9c0 con 0x7f2c60157800 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c65448700 1 -- 172.21.15.50:0/3526770655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00bd60 con 0x7f2c60157800 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- 172.21.15.50:0/3526770655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c60157800 msgr2=0x7f2c600cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 --2- 172.21.15.50:0/3526770655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c60157800 0x7f2c600cd290 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b2090 tx=0x7f2c5c009250 comp rx=0 tx=0).stop 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- 172.21.15.50:0/3526770655 shutdown_connections 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 --2- 172.21.15.50:0/3526770655 >> v2:172.21.15.82:3300/0 conn(0x7f2c600b3900 0x7f2c600cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 --2- 172.21.15.50:0/3526770655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c60157800 0x7f2c600cd290 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- 172.21.15.50:0/3526770655 >> 172.21.15.50:0/3526770655 conn(0x7f2c600cde00 msgr2=0x7f2c600ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- 172.21.15.50:0/3526770655 shutdown_connections 2023-12-24T20:11:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- 172.21.15.50:0/3526770655 wait complete. 2023-12-24T20:11:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 Processor -- start 2023-12-24T20:11:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.317+0000 7f2c686ae700 1 -- start start 2023-12-24T20:11:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c60157800 0x7f2c600ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 0x7f2c601437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600cb430 con 0x7f2c600b3900 2023-12-24T20:11:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600ae730 con 0x7f2c60157bd0 2023-12-24T20:11:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600cb5c0 con 0x7f2c60157800 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46902/0 (socket says 172.21.15.50:46902) 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 -- 172.21.15.50:0/25768748 learned_addr learned my addr 172.21.15.50:0/25768748 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c65c49700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c60157800 0x7f2c600ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c66c4b700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 0x7f2c601437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 -- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c60157800 msgr2=0x7f2c600ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c60157800 0x7f2c600ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 -- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 msgr2=0x7f2c601437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 0x7f2c601437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 -- 172.21.15.50:0/25768748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0094f0 con 0x7f2c600b3900 2023-12-24T20:11:01.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c66c4b700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 0x7f2c601437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:11:01.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c6644a700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f2c600cdda0 tx=0x7f2c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011e60 con 0x7f2c600b3900 2023-12-24T20:11:01.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c01a630 con 0x7f2c600b3900 2023-12-24T20:11:01.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c600ae940 con 0x7f2c600b3900 2023-12-24T20:11:01.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c01a9f0 con 0x7f2c600b3900 2023-12-24T20:11:01.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.321+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c600aef80 con 0x7f2c600b3900 2023-12-24T20:11:01.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.325+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c600652e0 con 0x7f2c600b3900 2023-12-24T20:11:01.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.325+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2c5c02d440 con 0x7f2c600b3900 2023-12-24T20:11:01.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.329+0000 7f2c567fc700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 0x7f2c44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.329+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f2c5c07e5c0 con 0x7f2c600b3900 2023-12-24T20:11:01.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.329+0000 7f2c65c49700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 0x7f2c44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.329+0000 7f2c65c49700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 0x7f2c44062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c60160360 tx=0x7f2c50009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.337+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c5c04e950 con 0x7f2c600b3900 2023-12-24T20:11:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c600cb700 con 0x7f2c44060550 2023-12-24T20:11:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c567fc700 1 -- 172.21.15.50:0/25768748 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c50006820 con 0x7f2c44060550 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 msgr2=0x7f2c44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 0x7f2c44062a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c60160360 tx=0x7f2c50009040 comp rx=0 tx=0).stop 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 msgr2=0x7f2c60151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f2c600cdda0 tx=0x7f2c5c017000 comp rx=0 tx=0).stop 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 shutdown_connections 2023-12-24T20:11:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2c44060550 0x7f2c44062a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c60157bd0 0x7f2c601437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c60157800 0x7f2c600ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 --2- 172.21.15.50:0/25768748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c600b3900 0x7f2c60151ef0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 >> 172.21.15.50:0/25768748 conn(0x7f2c600cde00 msgr2=0x7f2c60155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 shutdown_connections 2023-12-24T20:11:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.509+0000 7f2c686ae700 1 -- 172.21.15.50:0/25768748 wait complete. 2023-12-24T20:11:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2023-12-24T20:11:01.534 INFO:tasks.ceph:Scrubbing osd.4 2023-12-24T20:11:01.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:01.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.709+0000 7f3c2fa6e700 1 Processor -- start 2023-12-24T20:11:01.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.709+0000 7f3c2fa6e700 1 -- start start 2023-12-24T20:11:01.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2fa6e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c281591a0 0x7f3c280a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2fa6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c280aa080 0x7f3c280a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2fa6e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2806a730 con 0x7f3c2806d1e0 2023-12-24T20:11:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2fa6e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2806d760 con 0x7f3c281591a0 2023-12-24T20:11:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2fa6e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2806da40 con 0x7f3c280aa080 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c281591a0 0x7f3c280a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2e00b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c2806d1e0 0x7f3c2806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47050/0 (socket says 172.21.15.50:47050) 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2e00b700 1 -- 172.21.15.50:0/3354203892 learned_addr learned my addr 172.21.15.50:0/3354203892 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d009700 1 --2- 172.21.15.50:0/3354203892 >> v2:172.21.15.82:3300/0 conn(0x7f3c280aa080 0x7f3c280a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248803376 0 0) 0x7f3c2806a730 con 0x7f3c2806d1e0 2023-12-24T20:11:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c14003570 con 0x7f3c2806d1e0 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 -- 172.21.15.50:0/3354203892 >> v2:172.21.15.82:3300/0 conn(0x7f3c280aa080 msgr2=0x7f3c280a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/3354203892 >> v2:172.21.15.82:3300/0 conn(0x7f3c280aa080 0x7f3c280a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 -- 172.21.15.50:0/3354203892 >> v1:172.21.15.50:6789/0 conn(0x7f3c2806d1e0 legacy=0x7f3c2806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701842342 0 0) 0x7f3c14003570 con 0x7f3c2806d1e0 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 -- 172.21.15.50:0/3354203892 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2806dd20 con 0x7f3c281591a0 2023-12-24T20:11:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.713+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/3354203892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c281591a0 0x7f3c280a9b40 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f3c28068ba0 tx=0x7f3c240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e1ceb2940dd07e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c200017f0 con 0x7f3c281591a0 2023-12-24T20:11:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24011420 con 0x7f3c281591a0 2023-12-24T20:11:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2c808700 1 -- 172.21.15.50:0/3354203892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c240117c0 con 0x7f3c281591a0 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/3354203892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c281591a0 msgr2=0x7f3c280a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/3354203892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c281591a0 0x7f3c280a9b40 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f3c28068ba0 tx=0x7f3c240091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/3354203892 shutdown_connections 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/3354203892 >> v2:172.21.15.82:3300/0 conn(0x7f3c280aa080 0x7f3c280a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/3354203892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c281591a0 0x7f3c280a9b40 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/3354203892 >> 172.21.15.50:0/3354203892 conn(0x7f3c28067b80 msgr2=0x7f3c280ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/3354203892 shutdown_connections 2023-12-24T20:11:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/3354203892 wait complete. 2023-12-24T20:11:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 Processor -- start 2023-12-24T20:11:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.717+0000 7f3c2fa6e700 1 -- start start 2023-12-24T20:11:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2806d1e0 0x7f3c28159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 0x7f3c28143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c281591a0 0x7f3c28142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280ac7f0 con 0x7f3c280aa080 2023-12-24T20:11:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28159c60 con 0x7f3c2806d1e0 2023-12-24T20:11:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280aca90 con 0x7f3c281591a0 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 0x7f3c28143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 0x7f3c28143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46914/0 (socket says 172.21.15.50:46914) 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 -- 172.21.15.50:0/2552100923 learned_addr learned my addr 172.21.15.50:0/2552100923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2e00b700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c281591a0 0x7f3c28142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2806d1e0 0x7f3c28159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 -- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c281591a0 msgr2=0x7f3c28142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c281591a0 0x7f3c28142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 -- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2806d1e0 msgr2=0x7f3c28159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2806d1e0 0x7f3c28159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009420 con 0x7f3c280aa080 2023-12-24T20:11:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2806d1e0 0x7f3c28159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:11:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2d009700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 0x7f3c28143130 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ec80 tx=0x7f3c180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800c9d0 con 0x7f3c280aa080 2023-12-24T20:11:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800cb30 con 0x7f3c280aa080 2023-12-24T20:11:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280acd70 con 0x7f3c280aa080 2023-12-24T20:11:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18013470 con 0x7f3c280aa080 2023-12-24T20:11:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.721+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280ad330 con 0x7f3c280aa080 2023-12-24T20:11:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.725+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c280afc60 con 0x7f3c280aa080 2023-12-24T20:11:01.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.725+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f3c18013820 con 0x7f3c280aa080 2023-12-24T20:11:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c1dffb700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3c0c060550 0x7f3c0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f3c1807ce60 con 0x7f3c280aa080 2023-12-24T20:11:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c1dffb700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7f3c0c0671b0 0x7f3c0c069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3c0c060550 0x7f3c0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c0c069c40 con 0x7f3c0c0671b0 2023-12-24T20:11:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1807f3c0 con 0x7f3c280aa080 2023-12-24T20:11:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c2e00b700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7f3c0c0671b0 0x7f3c0c069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c2d80a700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3c0c060550 0x7f3c0c062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c28068ba0 tx=0x7f3c24016000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.729+0000 7f3c2e00b700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7f3c0c0671b0 0x7f3c0c069610 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.733+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== osd.4 v2:172.21.15.82:6800/34155 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3c0c069c40 con 0x7f3c0c0671b0 2023-12-24T20:11:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.749+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 --> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c28071060 con 0x7f3c0c0671b0 2023-12-24T20:11:01.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.749+0000 7f3c1dffb700 1 -- 172.21.15.50:0/2552100923 <== osd.4 v2:172.21.15.82:6800/34155 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3c28071060 con 0x7f3c0c0671b0 2023-12-24T20:11:01.754 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:01.754 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:01.754 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:01.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.749+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7f3c0c0671b0 msgr2=0x7f3c0c069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.749+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.82:6800/34155,v1:172.21.15.82:6801/34155] conn(0x7f3c0c0671b0 0x7f3c0c069610 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3c0c060550 msgr2=0x7f3c0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f3c0c060550 0x7f3c0c062a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c28068ba0 tx=0x7f3c24016000 comp rx=0 tx=0).stop 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 msgr2=0x7f3c28143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 --2- 172.21.15.50:0/2552100923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c280aa080 0x7f3c28143130 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ec80 tx=0x7f3c180091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2e00b700 1 -- 172.21.15.50:0/2552100923 reap_dead start 2023-12-24T20:11:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 shutdown_connections 2023-12-24T20:11:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 >> 172.21.15.50:0/2552100923 conn(0x7f3c28067b80 msgr2=0x7f3c281539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 shutdown_connections 2023-12-24T20:11:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.753+0000 7f3c2fa6e700 1 -- 172.21.15.50:0/2552100923 wait complete. 2023-12-24T20:11:01.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-24T20:11:01.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 Processor -- start 2023-12-24T20:11:01.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 -- start start 2023-12-24T20:11:01.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d041551f0 0x7f1d041555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d04156470 0x7f1d0406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d04155fe0 con 0x7f1d0406abe0 2023-12-24T20:11:01.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0406b0f0 con 0x7f1d041551f0 2023-12-24T20:11:01.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d092f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0406b3d0 con 0x7f1d04156470 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d02ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d041551f0 0x7f1d041555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.949+0000 7f1d037fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1d0406abe0 0x7f1d0406d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47056/0 (socket says 172.21.15.50:47056) 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d037fe700 1 -- 172.21.15.50:0/3746069398 learned_addr learned my addr 172.21.15.50:0/3746069398 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d027fc700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d04156470 0x7f1d0406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d02ffd700 1 -- 172.21.15.50:0/3746069398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d04156470 msgr2=0x7f1d0406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d02ffd700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d04156470 0x7f1d0406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d02ffd700 1 -- 172.21.15.50:0/3746069398 >> v1:172.21.15.50:6789/0 conn(0x7f1d0406abe0 legacy=0x7f1d0406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d02ffd700 1 -- 172.21.15.50:0/3746069398 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04155c70 con 0x7f1d041551f0 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d01ffb700 1 -- 172.21.15.50:0/3746069398 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248880242 0 0) 0x7f1d04155fe0 con 0x7f1d0406abe0 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d02ffd700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d041555c0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098e0 tx=0x7f1cf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5c92a97bd9d3a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d01ffb700 1 -- 172.21.15.50:0/3746069398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400b640 con 0x7f1d041551f0 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d01ffb700 1 -- 172.21.15.50:0/3746069398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400b7a0 con 0x7f1d041551f0 2023-12-24T20:11:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d01ffb700 1 -- 172.21.15.50:0/3746069398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400bb40 con 0x7f1d041551f0 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 -- 172.21.15.50:0/3746069398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 msgr2=0x7f1d041555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d041555c0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098e0 tx=0x7f1cf40091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 -- 172.21.15.50:0/3746069398 shutdown_connections 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d04156470 0x7f1d0406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 --2- 172.21.15.50:0/3746069398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d041555c0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 -- 172.21.15.50:0/3746069398 >> 172.21.15.50:0/3746069398 conn(0x7f1d040cbba0 msgr2=0x7f1d040cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 -- 172.21.15.50:0/3746069398 shutdown_connections 2023-12-24T20:11:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.953+0000 7f1d092f0700 1 -- 172.21.15.50:0/3746069398 wait complete. 2023-12-24T20:11:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.957+0000 7f1d092f0700 1 Processor -- start 2023-12-24T20:11:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.957+0000 7f1d092f0700 1 -- start start 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d0406abe0 0x7f1d041525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04156470 0x7f1d04167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04152af0 con 0x7f1d041551f0 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0413fc50 con 0x7f1d04156470 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041538f0 con 0x7f1d0406abe0 2023-12-24T20:11:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46930/0 (socket says 172.21.15.50:46930) 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 -- 172.21.15.50:0/138705833 learned_addr learned my addr 172.21.15.50:0/138705833 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d037fe700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04156470 0x7f1d04167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d02ffd700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d0406abe0 0x7f1d041525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 -- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d0406abe0 msgr2=0x7f1d041525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d0406abe0 0x7f1d041525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 -- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04156470 msgr2=0x7f1d04167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04156470 0x7f1d04167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 -- 172.21.15.50:0/138705833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4009420 con 0x7f1d041551f0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d027fc700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800ec80 tx=0x7f1cf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800c9d0 con 0x7f1d041551f0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf800cb30 con 0x7f1d041551f0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d04152ce0 con 0x7f1d041551f0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8013470 con 0x7f1d041551f0 2023-12-24T20:11:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.961+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d041532a0 con 0x7f1d041551f0 2023-12-24T20:11:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.965+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04153a80 con 0x7f1d041551f0 2023-12-24T20:11:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.965+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f1cf8013820 con 0x7f1d041551f0 2023-12-24T20:11:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.969+0000 7f1ceaffd700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 0x7f1cf0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.969+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f1cf807cd90 con 0x7f1d041551f0 2023-12-24T20:11:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.969+0000 7f1d02ffd700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 0x7f1cf0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.969+0000 7f1d02ffd700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 0x7f1cf0062a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40093f0 tx=0x7f1cf4017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:01.973+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cf804d0a0 con 0x7f1d041551f0 2023-12-24T20:11:02.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.145+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d040652e0 con 0x7f1cf0060580 2023-12-24T20:11:02.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.149+0000 7f1ceaffd700 1 -- 172.21.15.50:0/138705833 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1d040652e0 con 0x7f1cf0060580 2023-12-24T20:11:02.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 msgr2=0x7f1cf0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 0x7f1cf0062a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40093f0 tx=0x7f1cf4017000 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 msgr2=0x7f1d0413f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800ec80 tx=0x7f1cf80091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 shutdown_connections 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f1cf0060580 0x7f1cf0062a30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04156470 0x7f1d04167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d041551f0 0x7f1d0413f710 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 --2- 172.21.15.50:0/138705833 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d0406abe0 0x7f1d041525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 >> 172.21.15.50:0/138705833 conn(0x7f1d040cbba0 msgr2=0x7f1d0406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 shutdown_connections 2023-12-24T20:11:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.153+0000 7f1d092f0700 1 -- 172.21.15.50:0/138705833 wait complete. 2023-12-24T20:11:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2023-12-24T20:11:02.177 INFO:tasks.ceph:Scrubbing osd.5 2023-12-24T20:11:02.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.353+0000 7fbb3d416700 1 Processor -- start 2023-12-24T20:11:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.353+0000 7fbb3d416700 1 -- start start 2023-12-24T20:11:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3d416700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb380b1a40 0x7fbb380c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3d416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3d416700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb380c9670 con 0x7fbb380c88a0 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3d416700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb38158340 con 0x7fbb380b1a40 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3d416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380ca480 con 0x7fbb380c9b00 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb380b1a40 0x7fbb380c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb380b1a40 0x7fbb380c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46932/0 (socket says 172.21.15.50:46932) 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 -- 172.21.15.50:0/3583971923 learned_addr learned my addr 172.21.15.50:0/3583971923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb3cc15700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 -- 172.21.15.50:0/3583971923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 msgr2=0x7fbb380c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 -- 172.21.15.50:0/3583971923 >> v1:172.21.15.82:6789/0 conn(0x7fbb380c88a0 legacy=0x7fbb38158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.357+0000 7fbb2f7fe700 1 -- 172.21.15.50:0/3583971923 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380c9360 con 0x7fbb380b1a40 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb2f7fe700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb380c8c70 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fbb200099b0 tx=0x7fbb20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9647c89e2caa12 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb377fe700 1 -- 172.21.15.50:0/3583971923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000b860 con 0x7fbb380b1a40 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb377fe700 1 -- 172.21.15.50:0/3583971923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000b9c0 con 0x7fbb380b1a40 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb377fe700 1 -- 172.21.15.50:0/3583971923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000bd60 con 0x7fbb380b1a40 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 -- 172.21.15.50:0/3583971923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 msgr2=0x7fbb380c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb380c8c70 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fbb200099b0 tx=0x7fbb20009250 comp rx=0 tx=0).stop 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 -- 172.21.15.50:0/3583971923 shutdown_connections 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 --2- 172.21.15.50:0/3583971923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb380c8c70 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 -- 172.21.15.50:0/3583971923 >> 172.21.15.50:0/3583971923 conn(0x7fbb380af9b0 msgr2=0x7fbb380afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 -- 172.21.15.50:0/3583971923 shutdown_connections 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.361+0000 7fbb3d416700 1 -- 172.21.15.50:0/3583971923 wait complete. 2023-12-24T20:11:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 Processor -- start 2023-12-24T20:11:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 -- start start 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb381676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380c88a0 0x7fbb380c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380c6320 con 0x7fbb380b1a40 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380c0f00 con 0x7fbb380c88a0 2023-12-24T20:11:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb3d416700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38167bf0 con 0x7fbb380c9b00 2023-12-24T20:11:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.365+0000 7fbb37fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb381676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb381676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46938/0 (socket says 172.21.15.50:46938) 2023-12-24T20:11:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 -- 172.21.15.50:0/1179191754 learned_addr learned my addr 172.21.15.50:0/1179191754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb2f7fe700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380c88a0 0x7fbb380c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb3cc15700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 -- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 msgr2=0x7fbb380c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380c9b00 0x7fbb380c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 -- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380c88a0 msgr2=0x7fbb380c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380c88a0 0x7fbb380c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200094f0 con 0x7fbb380b1a40 2023-12-24T20:11:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb37fff700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb381676b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800cb10 tx=0x7fbb280017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800ce20 con 0x7fbb380b1a40 2023-12-24T20:11:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2800a7e0 con 0x7fbb380b1a40 2023-12-24T20:11:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380c56a0 con 0x7fbb380b1a40 2023-12-24T20:11:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800aba0 con 0x7fbb380b1a40 2023-12-24T20:11:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.369+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb380c5c60 con 0x7fbb380b1a40 2023-12-24T20:11:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb3804be40 con 0x7fbb380b1a40 2023-12-24T20:11:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fbb28003030 con 0x7fbb380b1a40 2023-12-24T20:11:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbb18060550 0x7fbb18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fbb2807ca50 con 0x7fbb380b1a40 2023-12-24T20:11:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7fbb180671b0 0x7fbb18069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb18069c40 con 0x7fbb180671b0 2023-12-24T20:11:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.373+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb28081220 con 0x7fbb380b1a40 2023-12-24T20:11:02.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.377+0000 7fbb2f7fe700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbb18060550 0x7fbb18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.377+0000 7fbb3cc15700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7fbb180671b0 0x7fbb18069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.377+0000 7fbb2f7fe700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbb18060550 0x7fbb18062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb200099b0 tx=0x7fbb20017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.377+0000 7fbb3cc15700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7fbb180671b0 0x7fbb18069610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.377+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== osd.5 v2:172.21.15.82:6824/34158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbb18069c40 con 0x7fbb180671b0 2023-12-24T20:11:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 --> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbb380c7e30 con 0x7fbb180671b0 2023-12-24T20:11:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb34ff9700 1 -- 172.21.15.50:0/1179191754 <== osd.5 v2:172.21.15.82:6824/34158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbb380c7e30 con 0x7fbb180671b0 2023-12-24T20:11:02.405 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:02.405 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7fbb180671b0 msgr2=0x7fbb18069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.82:6824/34158,v1:172.21.15.82:6825/34158] conn(0x7fbb180671b0 0x7fbb18069610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbb18060550 msgr2=0x7fbb18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fbb18060550 0x7fbb18062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb200099b0 tx=0x7fbb20017000 comp rx=0 tx=0).stop 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 msgr2=0x7fbb381676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.401+0000 7fbb3d416700 1 --2- 172.21.15.50:0/1179191754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb380b1a40 0x7fbb381676b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800cb10 tx=0x7fbb280017b0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.405+0000 7fbb3cc15700 1 -- 172.21.15.50:0/1179191754 reap_dead start 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.405+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 shutdown_connections 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.405+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 >> 172.21.15.50:0/1179191754 conn(0x7fbb380af9b0 msgr2=0x7fbb3806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.405+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 shutdown_connections 2023-12-24T20:11:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.405+0000 7fbb3d416700 1 -- 172.21.15.50:0/1179191754 wait complete. 2023-12-24T20:11:02.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-24T20:11:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 Processor -- start 2023-12-24T20:11:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 -- start start 2023-12-24T20:11:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb00806b540 0x7fb0080ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00806ba80 con 0x7fb008159a20 2023-12-24T20:11:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00806bd60 con 0x7fb0080ce750 2023-12-24T20:11:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00ed45700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00815a5d0 con 0x7fb00806b540 2023-12-24T20:11:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb007fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb00806b540 0x7fb0080ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00d2e2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb008159a20 0x7fb008159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47072/0 (socket says 172.21.15.50:47072) 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.609+0000 7fb00d2e2700 1 -- 172.21.15.50:0/2907325138 learned_addr learned my addr 172.21.15.50:0/2907325138 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb0077fe700 1 -- 172.21.15.50:0/2907325138 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926285503 0 0) 0x7fb00806ba80 con 0x7fb008159a20 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb007fff700 1 -- 172.21.15.50:0/2907325138 >> v1:172.21.15.82:6789/0 conn(0x7fb0080ce750 legacy=0x7fb00806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb007fff700 1 -- 172.21.15.50:0/2907325138 >> v1:172.21.15.50:6789/0 conn(0x7fb008159a20 legacy=0x7fb008159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb007fff700 1 -- 172.21.15.50:0/2907325138 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00806c040 con 0x7fb00806b540 2023-12-24T20:11:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb007fff700 1 --2- 172.21.15.50:0/2907325138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00806b540 0x7fb0080ceb20 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7faff80098e0 tx=0x7faff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1925025fb4ea2b32 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb0077fe700 1 -- 172.21.15.50:0/2907325138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8009e80 con 0x7fb00806b540 2023-12-24T20:11:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb0077fe700 1 -- 172.21.15.50:0/2907325138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff800b860 con 0x7fb00806b540 2023-12-24T20:11:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb0077fe700 1 -- 172.21.15.50:0/2907325138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800bbe0 con 0x7fb00806b540 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 -- 172.21.15.50:0/2907325138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00806b540 msgr2=0x7fb0080ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2907325138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00806b540 0x7fb0080ceb20 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7faff80098e0 tx=0x7faff80091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 -- 172.21.15.50:0/2907325138 shutdown_connections 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2907325138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00806b540 0x7fb0080ceb20 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 -- 172.21.15.50:0/2907325138 >> 172.21.15.50:0/2907325138 conn(0x7fb0080cffb0 msgr2=0x7fb0080d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 -- 172.21.15.50:0/2907325138 shutdown_connections 2023-12-24T20:11:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.613+0000 7fb00ed45700 1 -- 172.21.15.50:0/2907325138 wait complete. 2023-12-24T20:11:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 Processor -- start 2023-12-24T20:11:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 -- start start 2023-12-24T20:11:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 0x7fb008152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0080ce750 0x7fb008155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008152990 con 0x7fb008159a20 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008155090 con 0x7fb0080ce750 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00ed45700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081562c0 con 0x7fb00806b540 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46954/0 (socket says 172.21.15.50:46954) 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 -- 172.21.15.50:0/2390146716 learned_addr learned my addr 172.21.15.50:0/2390146716 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb007fff700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0080ce750 0x7fb008155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00cae1700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 0x7fb008152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 -- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 msgr2=0x7fb008152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 0x7fb008152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 -- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0080ce750 msgr2=0x7fb008155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0080ce750 0x7fb008155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00d2e2700 1 -- 172.21.15.50:0/2390146716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009420 con 0x7fb008159a20 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.617+0000 7fb00cae1700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 0x7fb008152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb00d2e2700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cc90 tx=0x7fb000001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000a960 con 0x7fb008159a20 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00000aac0 con 0x7fb008159a20 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0081565a0 con 0x7fb008159a20 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000ae80 con 0x7fb008159a20 2023-12-24T20:11:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb008169610 con 0x7fb008159a20 2023-12-24T20:11:02.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.621+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008169800 con 0x7fb008159a20 2023-12-24T20:11:02.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.625+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fb000007300 con 0x7fb008159a20 2023-12-24T20:11:02.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.625+0000 7fb004ff9700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 0x7faff4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:02.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.625+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fb00007ce10 con 0x7fb008159a20 2023-12-24T20:11:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.625+0000 7fb00cae1700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 0x7faff4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.625+0000 7fb00cae1700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 0x7faff4062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faffc007fd0 tx=0x7faffc009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.633+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb00004d240 con 0x7fb008159a20 2023-12-24T20:11:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.805+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0080652e0 con 0x7faff4060550 2023-12-24T20:11:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.809+0000 7fb004ff9700 1 -- 172.21.15.50:0/2390146716 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0080652e0 con 0x7faff4060550 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 msgr2=0x7faff4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 0x7faff4062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faffc007fd0 tx=0x7faffc009040 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 msgr2=0x7fb008155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cc90 tx=0x7fb000001a80 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 shutdown_connections 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7faff4060550 0x7faff4062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb008159a20 0x7fb008155c90 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0080ce750 0x7fb008155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 --2- 172.21.15.50:0/2390146716 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb00806b540 0x7fb008152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 >> 172.21.15.50:0/2390146716 conn(0x7fb0080cffb0 msgr2=0x7fb0080cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 shutdown_connections 2023-12-24T20:11:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:02.813+0000 7fb00ed45700 1 -- 172.21.15.50:0/2390146716 wait complete. 2023-12-24T20:11:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2023-12-24T20:11:02.838 INFO:tasks.ceph:Scrubbing osd.6 2023-12-24T20:11:02.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.009+0000 7fe44ac78700 1 Processor -- start 2023-12-24T20:11:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.009+0000 7fe44ac78700 1 -- start start 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe444156b50 0x7fe44415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe44406db90 0x7fe4440b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4440b4060 0x7fe44415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440b44e0 con 0x7fe4440b4060 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44406d4d0 con 0x7fe44406db90 2023-12-24T20:11:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe44ac78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440b4960 con 0x7fe444156b50 2023-12-24T20:11:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4440b4060 0x7fe44415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4440b4060 0x7fe44415ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46958/0 (socket says 172.21.15.50:46958) 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 -- 172.21.15.50:0/2954069786 learned_addr learned my addr 172.21.15.50:0/2954069786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe443fff700 1 --2- 172.21.15.50:0/2954069786 >> v2:172.21.15.82:3300/0 conn(0x7fe44406db90 0x7fe4440b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe448a14700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe444156b50 0x7fe44415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 -- 172.21.15.50:0/2954069786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe444156b50 msgr2=0x7fe44415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe444156b50 0x7fe44415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 -- 172.21.15.50:0/2954069786 >> v2:172.21.15.82:3300/0 conn(0x7fe44406db90 msgr2=0x7fe4440b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 --2- 172.21.15.50:0/2954069786 >> v2:172.21.15.82:3300/0 conn(0x7fe44406db90 0x7fe4440b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 -- 172.21.15.50:0/2954069786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44415a620 con 0x7fe4440b4060 2023-12-24T20:11:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe449215700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4440b4060 0x7fe44415ccb0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fe4440692a0 tx=0x7fe43c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a450f955ef01ca99 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe4437fe700 1 -- 172.21.15.50:0/2954069786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00e070 con 0x7fe4440b4060 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe4437fe700 1 -- 172.21.15.50:0/2954069786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00ba20 con 0x7fe4440b4060 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.013+0000 7fe4437fe700 1 -- 172.21.15.50:0/2954069786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0092e0 con 0x7fe4440b4060 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- 172.21.15.50:0/2954069786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4440b4060 msgr2=0x7fe44415ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4440b4060 0x7fe44415ccb0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fe4440692a0 tx=0x7fe43c009840 comp rx=0 tx=0).stop 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- 172.21.15.50:0/2954069786 shutdown_connections 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 --2- 172.21.15.50:0/2954069786 >> v2:172.21.15.82:3300/0 conn(0x7fe44406db90 0x7fe4440b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4440b4060 0x7fe44415ccb0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 --2- 172.21.15.50:0/2954069786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe444156b50 0x7fe44415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- 172.21.15.50:0/2954069786 >> 172.21.15.50:0/2954069786 conn(0x7fe444067b40 msgr2=0x7fe4440b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- 172.21.15.50:0/2954069786 shutdown_connections 2023-12-24T20:11:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- 172.21.15.50:0/2954069786 wait complete. 2023-12-24T20:11:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 Processor -- start 2023-12-24T20:11:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.017+0000 7fe44ac78700 1 -- start start 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 0x7fe44415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4440b4060 0x7fe444159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444156b50 0x7fe444171130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415e3f0 con 0x7fe44406db90 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415db50 con 0x7fe444156b50 2023-12-24T20:11:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415de30 con 0x7fe4440b4060 2023-12-24T20:11:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 0x7fe44415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 0x7fe44415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46974/0 (socket says 172.21.15.50:46974) 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 -- 172.21.15.50:0/1892125595 learned_addr learned my addr 172.21.15.50:0/1892125595 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe449215700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444156b50 0x7fe444171130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe443fff700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4440b4060 0x7fe444159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 -- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4440b4060 msgr2=0x7fe444159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4440b4060 0x7fe444159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 -- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444156b50 msgr2=0x7fe444171130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444156b50 0x7fe444171130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009ae0 con 0x7fe44406db90 2023-12-24T20:11:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe448a14700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 0x7fe44415d4c0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fe43800d860 tx=0x7fe438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380125f0 con 0x7fe44406db90 2023-12-24T20:11:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438012750 con 0x7fe44406db90 2023-12-24T20:11:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438012b10 con 0x7fe44406db90 2023-12-24T20:11:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44415e110 con 0x7fe44406db90 2023-12-24T20:11:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.021+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe444171670 con 0x7fe44406db90 2023-12-24T20:11:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe444171890 con 0x7fe44406db90 2023-12-24T20:11:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fe43801e460 con 0x7fe44406db90 2023-12-24T20:11:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe428060550 0x7fe428062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fe43807cf60 con 0x7fe44406db90 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7fe4280671b0 0x7fe428069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe428069c40 con 0x7fe4280671b0 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe43807f540 con 0x7fe44406db90 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe443fff700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe428060550 0x7fe428062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe449215700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7fe4280671b0 0x7fe428069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.025+0000 7fe443fff700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe428060550 0x7fe428062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4440b1710 tx=0x7fe4300091a0 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.029+0000 7fe449215700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7fe4280671b0 0x7fe428069610 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.029+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== osd.6 v2:172.21.15.82:6808/34156 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe428069c40 con 0x7fe4280671b0 2023-12-24T20:11:03.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.049+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 --> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe444071060 con 0x7fe4280671b0 2023-12-24T20:11:03.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe440ff9700 1 -- 172.21.15.50:0/1892125595 <== osd.6 v2:172.21.15.82:6808/34156 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe444071060 con 0x7fe4280671b0 2023-12-24T20:11:03.055 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:03.055 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:03.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7fe4280671b0 msgr2=0x7fe428069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.82:6808/34156,v1:172.21.15.82:6809/34156] conn(0x7fe4280671b0 0x7fe428069610 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe428060550 msgr2=0x7fe428062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fe428060550 0x7fe428062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4440b1710 tx=0x7fe4300091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 msgr2=0x7fe44415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 --2- 172.21.15.50:0/1892125595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44406db90 0x7fe44415d4c0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fe43800d860 tx=0x7fe438008040 comp rx=0 tx=0).stop 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe449215700 1 -- 172.21.15.50:0/1892125595 reap_dead start 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 shutdown_connections 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 >> 172.21.15.50:0/1892125595 conn(0x7fe444067b40 msgr2=0x7fe44414ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 shutdown_connections 2023-12-24T20:11:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.053+0000 7fe44ac78700 1 -- 172.21.15.50:0/1892125595 wait complete. 2023-12-24T20:11:03.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-24T20:11:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.249+0000 7f0ef56cd700 1 Processor -- start 2023-12-24T20:11:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.249+0000 7f0ef56cd700 1 -- start start 2023-12-24T20:11:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ef56cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ef00c6d00 0x7f0ef00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ef56cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef006aca0 0x7f0ef006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ef56cd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef006c820 con 0x7f0ef0154450 2023-12-24T20:11:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ef56cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef006b960 con 0x7f0ef00c6d00 2023-12-24T20:11:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ef56cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef006bc40 con 0x7f0ef006aca0 2023-12-24T20:11:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ef00c6d00 0x7f0ef00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ef00c6d00 0x7f0ef00c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46980/0 (socket says 172.21.15.50:46980) 2023-12-24T20:11:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 -- 172.21.15.50:0/698743750 learned_addr learned my addr 172.21.15.50:0/698743750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0ee7fff700 1 --1- 172.21.15.50:0/698743750 >> v1:172.21.15.50:6789/0 conn(0x7f0ef0154450 0x7f0ef01548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47078/0 (socket says 172.21.15.50:47078) 2023-12-24T20:11:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eef7fe700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef006aca0 0x7f0ef006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 -- 172.21.15.50:0/698743750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef006aca0 msgr2=0x7f0ef006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef006aca0 0x7f0ef006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 -- 172.21.15.50:0/698743750 >> v1:172.21.15.50:6789/0 conn(0x7f0ef0154450 legacy=0x7f0ef01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 -- 172.21.15.50:0/698743750 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef006bf20 con 0x7f0ef00c6d00 2023-12-24T20:11:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.253+0000 7f0eeeffd700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef00c6d00 0x7f0ef00c70d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00099b0 tx=0x7f0ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdad6fad1485db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0eee7fc700 1 -- 172.21.15.50:0/698743750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000b860 con 0x7f0ef00c6d00 2023-12-24T20:11:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0eee7fc700 1 -- 172.21.15.50:0/698743750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000b9c0 con 0x7f0ef00c6d00 2023-12-24T20:11:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0eee7fc700 1 -- 172.21.15.50:0/698743750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000bd60 con 0x7f0ef00c6d00 2023-12-24T20:11:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 -- 172.21.15.50:0/698743750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef00c6d00 msgr2=0x7f0ef00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef00c6d00 0x7f0ef00c70d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00099b0 tx=0x7f0ee0009250 comp rx=0 tx=0).stop 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 -- 172.21.15.50:0/698743750 shutdown_connections 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef006aca0 0x7f0ef006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/698743750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef00c6d00 0x7f0ef00c70d0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 -- 172.21.15.50:0/698743750 >> 172.21.15.50:0/698743750 conn(0x7f0ef00cbba0 msgr2=0x7f0ef00cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 -- 172.21.15.50:0/698743750 shutdown_connections 2023-12-24T20:11:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.257+0000 7f0ef56cd700 1 -- 172.21.15.50:0/698743750 wait complete. 2023-12-24T20:11:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 Processor -- start 2023-12-24T20:11:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- start start 2023-12-24T20:11:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef00c6d00 0x7f0ef00af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef0154450 0x7f0ef00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef01525c0 con 0x7f0ef006aca0 2023-12-24T20:11:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00af2a0 con 0x7f0ef0154450 2023-12-24T20:11:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c5db0 con 0x7f0ef00c6d00 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46982/0 (socket says 172.21.15.50:46982) 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 -- 172.21.15.50:0/3853578943 learned_addr learned my addr 172.21.15.50:0/3853578943 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eef7fe700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef0154450 0x7f0ef00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 -- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef00c6d00 msgr2=0x7f0ef00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef00c6d00 0x7f0ef00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 -- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef0154450 msgr2=0x7f0ef00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef0154450 0x7f0ef00c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 -- 172.21.15.50:0/3853578943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00094f0 con 0x7f0ef006aca0 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0eeeffd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0069da0 tx=0x7f0ee0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0024440 con 0x7f0ef006aca0 2023-12-24T20:11:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee00245c0 con 0x7f0ef006aca0 2023-12-24T20:11:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef00aec50 con 0x7f0ef006aca0 2023-12-24T20:11:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0024980 con 0x7f0ef006aca0 2023-12-24T20:11:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.261+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef00c2e30 con 0x7f0ef006aca0 2023-12-24T20:11:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.265+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef00aeab0 con 0x7f0ef006aca0 2023-12-24T20:11:03.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.265+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f0ee001a420 con 0x7f0ef006aca0 2023-12-24T20:11:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.265+0000 7f0ee6ffd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.265+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f0ee007e840 con 0x7f0ef006aca0 2023-12-24T20:11:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.269+0000 7f0ee7fff700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.269+0000 7f0ee7fff700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00ab000 tx=0x7f0ed8007b30 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.273+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ef00aeab0 con 0x7f0ef006aca0 2023-12-24T20:11:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.445+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef00af0d0 con 0x7f0ed0060550 2023-12-24T20:11:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.445+0000 7f0ee6ffd700 1 -- 172.21.15.50:0/3853578943 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0ed80070d0 con 0x7f0ed0060550 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 msgr2=0x7f0ed0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00ab000 tx=0x7f0ed8007b30 comp rx=0 tx=0).stop 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 msgr2=0x7f0ef0152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0069da0 tx=0x7f0ee0017000 comp rx=0 tx=0).stop 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 shutdown_connections 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f0ed0060550 0x7f0ed0062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef0154450 0x7f0ef00c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ef00c6d00 0x7f0ef00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 --2- 172.21.15.50:0/3853578943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ef006aca0 0x7f0ef0152080 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 >> 172.21.15.50:0/3853578943 conn(0x7f0ef00cbba0 msgr2=0x7f0ef00c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 shutdown_connections 2023-12-24T20:11:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.449+0000 7f0ef56cd700 1 -- 172.21.15.50:0/3853578943 wait complete. 2023-12-24T20:11:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2023-12-24T20:11:03.474 INFO:tasks.ceph:Scrubbing osd.7 2023-12-24T20:11:03.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:11:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 Processor -- start 2023-12-24T20:11:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 -- start start 2023-12-24T20:11:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d340b0a30 0x7f9d340af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d340c9bd0 con 0x7f9d341554a0 2023-12-24T20:11:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d340b05a0 con 0x7f9d3406ae40 2023-12-24T20:11:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.649+0000 7f9d39185700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d340af970 con 0x7f9d340b0a30 2023-12-24T20:11:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d32d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d341554a0 0x7f9d3406a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47080/0 (socket says 172.21.15.50:47080) 2023-12-24T20:11:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d32d9d700 1 -- 172.21.15.50:0/384955763 learned_addr learned my addr 172.21.15.50:0/384955763 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d3359e700 1 --2- 172.21.15.50:0/384955763 >> v2:172.21.15.82:3300/0 conn(0x7f9d340b0a30 0x7f9d340af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784609605 0 0) 0x7f9d24001110 con 0x7f9d341554a0 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d1c003570 con 0x7f9d341554a0 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220744336 0 0) 0x7f9d340b05a0 con 0x7f9d3406ae40 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d24001110 con 0x7f9d3406ae40 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448860633 0 0) 0x7f9d1c003570 con 0x7f9d341554a0 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 >> v2:172.21.15.82:3300/0 conn(0x7f9d340b0a30 msgr2=0x7f9d340af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 --2- 172.21.15.50:0/384955763 >> v2:172.21.15.82:3300/0 conn(0x7f9d340b0a30 0x7f9d340af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 >> v1:172.21.15.82:6789/0 conn(0x7f9d3406ae40 legacy=0x7f9d340aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340afc70 con 0x7f9d341554a0 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3212112241 0 0) 0x7f9d24001600 con 0x7f9d341554a0 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 >> v1:172.21.15.50:6789/0 conn(0x7f9d341554a0 legacy=0x7f9d3406a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d1c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d1c004810 0x7f9d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d1c0051c0 0x7f9d1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340af970 con 0x7f9d1c003bf0 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c00c050 con 0x7f9d1c0051c0 2023-12-24T20:11:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c00c210 con 0x7f9d1c004810 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d1c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d3359e700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d1c0051c0 0x7f9d1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.653+0000 7f9d3259c700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d1c004810 0x7f9d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 -- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d1c004810 msgr2=0x7f9d1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d1c004810 0x7f9d1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 -- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d1c0051c0 msgr2=0x7f9d1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d1c0051c0 0x7f9d1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 -- 172.21.15.50:0/384955763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c003570 con 0x7f9d1c003bf0 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d3359e700 1 -- 172.21.15.50:0/384955763 reap_dead start 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d1c003fc0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f9d24004da0 tx=0x7f9d24008d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee3e65decc615e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24017030 con 0x7f9d1c003bf0 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24005920 con 0x7f9d1c003bf0 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d31d9b700 1 -- 172.21.15.50:0/384955763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24005cc0 con 0x7f9d1c003bf0 2023-12-24T20:11:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 -- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 msgr2=0x7f9d1c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d1c003fc0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f9d24004da0 tx=0x7f9d24008d70 comp rx=0 tx=0).stop 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 -- 172.21.15.50:0/384955763 shutdown_connections 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 --2- 172.21.15.50:0/384955763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d1c003fc0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 -- 172.21.15.50:0/384955763 >> 172.21.15.50:0/384955763 conn(0x7f9d34067b80 msgr2=0x7f9d340ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 -- 172.21.15.50:0/384955763 shutdown_connections 2023-12-24T20:11:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.657+0000 7f9d39185700 1 -- 172.21.15.50:0/384955763 wait complete. 2023-12-24T20:11:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 Processor -- start 2023-12-24T20:11:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 -- start start 2023-12-24T20:11:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d34140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d340c9d70 0x7f9d340ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340c1490 0x7f9d340c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340ca720 con 0x7f9d1c003bf0 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d340c2e40 con 0x7f9d340c1490 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d39185700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34168990 con 0x7f9d340c9d70 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d32d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d34140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d32d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d34140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47008/0 (socket says 172.21.15.50:47008) 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.661+0000 7f9d32d9d700 1 -- 172.21.15.50:0/1190614855 learned_addr learned my addr 172.21.15.50:0/1190614855 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d3359e700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340c1490 0x7f9d340c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d3259c700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d340c9d70 0x7f9d340ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 -- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d340c9d70 msgr2=0x7f9d340ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d340c9d70 0x7f9d340ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 -- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340c1490 msgr2=0x7f9d340c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340c1490 0x7f9d340c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340c2230 con 0x7f9d1c003bf0 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d32d9d700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d34140230 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f9d24010200 tx=0x7f9d24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24008570 con 0x7f9d1c003bf0 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24023070 con 0x7f9d1c003bf0 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d240086d0 con 0x7f9d1c003bf0 2023-12-24T20:11:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d340c2510 con 0x7f9d1c003bf0 2023-12-24T20:11:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d340c2ad0 con 0x7f9d1c003bf0 2023-12-24T20:11:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.665+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d34071060 con 0x7f9d1c003bf0 2023-12-24T20:11:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f9d2401a070 con 0x7f9d1c003bf0 2023-12-24T20:11:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9d20060550 0x7f9d20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f9d24018070 con 0x7f9d1c003bf0 2023-12-24T20:11:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d3259c700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9d20060550 0x7f9d20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f9d200671b0 0x7f9d20069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d20069c40 con 0x7f9d200671b0 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.669+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=213) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d24080450 con 0x7f9d1c003bf0 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.673+0000 7f9d3359e700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f9d200671b0 0x7f9d20069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.673+0000 7f9d3259c700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9d20060550 0x7f9d20062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9d3415b750 tx=0x7f9d28007d30 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.673+0000 7f9d3359e700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f9d200671b0 0x7f9d20069610 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.673+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== osd.7 v2:172.21.15.82:6810/34157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9d20069c40 con 0x7f9d200671b0 2023-12-24T20:11:03.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.689+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 --> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d340c9bd0 con 0x7f9d200671b0 2023-12-24T20:11:03.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d1affd700 1 -- 172.21.15.50:0/1190614855 <== osd.7 v2:172.21.15.82:6810/34157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d340c9bd0 con 0x7f9d200671b0 2023-12-24T20:11:03.696 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-24T20:11:03.696 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-24T20:11:03.696 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-24T20:11:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f9d200671b0 msgr2=0x7f9d20069610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.82:6810/34157,v1:172.21.15.82:6812/34157] conn(0x7f9d200671b0 0x7f9d20069610 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9d20060550 msgr2=0x7f9d20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f9d20060550 0x7f9d20062a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9d3415b750 tx=0x7f9d28007d30 comp rx=0 tx=0).stop 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 msgr2=0x7f9d34140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 --2- 172.21.15.50:0/1190614855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c003bf0 0x7f9d34140230 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f9d24010200 tx=0x7f9d24018000 comp rx=0 tx=0).stop 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d3359e700 1 -- 172.21.15.50:0/1190614855 reap_dead start 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 shutdown_connections 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 >> 172.21.15.50:0/1190614855 conn(0x7f9d34067b80 msgr2=0x7f9d3406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 shutdown_connections 2023-12-24T20:11:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.693+0000 7f9d39185700 1 -- 172.21.15.50:0/1190614855 wait complete. 2023-12-24T20:11:03.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-24T20:11:03.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 Processor -- start 2023-12-24T20:11:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 -- start start 2023-12-24T20:11:03.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 0x7f96100ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 0x7f961006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961006e110 con 0x7f9610155710 2023-12-24T20:11:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961006b930 con 0x7f961006afa0 2023-12-24T20:11:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.897+0000 7f960f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961006bb40 con 0x7f96100ad220 2023-12-24T20:11:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f9607fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 0x7f961006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f9607fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 0x7f961006b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47012/0 (socket says 172.21.15.50:47012) 2023-12-24T20:11:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 0x7f96100ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f9607fff700 1 -- 172.21.15.50:0/3030386615 learned_addr learned my addr 172.21.15.50:0/3030386615 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960ed9d700 1 --1- 172.21.15.50:0/3030386615 >> v1:172.21.15.82:6789/0 conn(0x7f9610155710 0x7f9610155b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:36284/0 (socket says 172.21.15.50:36284) 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 -- 172.21.15.50:0/3030386615 >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 msgr2=0x7f961006b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 --2- 172.21.15.50:0/3030386615 >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 0x7f961006b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 -- 172.21.15.50:0/3030386615 >> v1:172.21.15.82:6789/0 conn(0x7f9610155710 legacy=0x7f9610155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 -- 172.21.15.50:0/3030386615 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961006be20 con 0x7f96100ad220 2023-12-24T20:11:03.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960e59c700 1 --2- 172.21.15.50:0/3030386615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 0x7f96100ad5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f96000098e0 tx=0x7f96000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf2fab4748707e2e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960dd9b700 1 -- 172.21.15.50:0/3030386615 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000b640 con 0x7f96100ad220 2023-12-24T20:11:03.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960dd9b700 1 -- 172.21.15.50:0/3030386615 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000b7a0 con 0x7f96100ad220 2023-12-24T20:11:03.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.901+0000 7f960dd9b700 1 -- 172.21.15.50:0/3030386615 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000bb40 con 0x7f96100ad220 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- 172.21.15.50:0/3030386615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 msgr2=0x7f96100ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 --2- 172.21.15.50:0/3030386615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 0x7f96100ad5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f96000098e0 tx=0x7f96000091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- 172.21.15.50:0/3030386615 shutdown_connections 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 --2- 172.21.15.50:0/3030386615 >> v2:172.21.15.50:3300/0 conn(0x7f961006afa0 0x7f961006b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 --2- 172.21.15.50:0/3030386615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96100ad220 0x7f96100ad5f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- 172.21.15.50:0/3030386615 >> 172.21.15.50:0/3030386615 conn(0x7f9610067b80 msgr2=0x7f96100cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- 172.21.15.50:0/3030386615 shutdown_connections 2023-12-24T20:11:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- 172.21.15.50:0/3030386615 wait complete. 2023-12-24T20:11:03.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 Processor -- start 2023-12-24T20:11:03.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.905+0000 7f960f59e700 1 -- start start 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f961006afa0 0x7f9610143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9610155710 0x7f961015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c73f0 con 0x7f96100ad220 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610156f30 con 0x7f9610155710 2023-12-24T20:11:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9610157210 con 0x7f961006afa0 2023-12-24T20:11:03.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47020/0 (socket says 172.21.15.50:47020) 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 -- 172.21.15.50:0/624772931 learned_addr learned my addr 172.21.15.50:0/624772931 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960e59c700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f961006afa0 0x7f9610143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960ed9d700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9610155710 0x7f961015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 -- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f961006afa0 msgr2=0x7f9610143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f961006afa0 0x7f9610143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 -- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9610155710 msgr2=0x7f961015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9610155710 0x7f961015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 -- 172.21.15.50:0/624772931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009420 con 0x7f96100ad220 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f9607fff700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f95f800ebb0 tx=0x7f95f800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800dac0 con 0x7f96100ad220 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800dc20 con 0x7f96100ad220 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96101574f0 con 0x7f96100ad220 2023-12-24T20:11:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8010440 con 0x7f96100ad220 2023-12-24T20:11:03.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.909+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9610140db0 con 0x7f96100ad220 2023-12-24T20:11:03.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.913+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961004be40 con 0x7f96100ad220 2023-12-24T20:11:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.913+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f95f80107f0 con 0x7f96100ad220 2023-12-24T20:11:03.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.913+0000 7f96067fc700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 0x7f95f0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:03.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.913+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f95f807d070 con 0x7f96100ad220 2023-12-24T20:11:03.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.913+0000 7f960e59c700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 0x7f95f0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.917+0000 7f960e59c700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 0x7f95f0062a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96000093f0 tx=0x7f9600017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:03.921+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f95f804d380 con 0x7f96100ad220 2023-12-24T20:11:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.093+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9610065040 con 0x7f95f00605d0 2023-12-24T20:11:04.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f96067fc700 1 -- 172.21.15.50:0/624772931 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9610065040 con 0x7f95f00605d0 2023-12-24T20:11:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 msgr2=0x7f95f0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 0x7f95f0062a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96000093f0 tx=0x7f9600017000 comp rx=0 tx=0).stop 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 msgr2=0x7f96100c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f95f800ebb0 tx=0x7f95f800b4f0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 shutdown_connections 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f95f00605d0 0x7f95f0062a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9610155710 0x7f961015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96100ad220 0x7f96100c6ac0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 --2- 172.21.15.50:0/624772931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f961006afa0 0x7f9610143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 >> 172.21.15.50:0/624772931 conn(0x7f9610067b80 msgr2=0x7f96100c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 shutdown_connections 2023-12-24T20:11:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.097+0000 7f960f59e700 1 -- 172.21.15.50:0/624772931 wait complete. 2023-12-24T20:11:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2023-12-24T20:11:04.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:11:04.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.281+0000 7f4426b85700 1 Processor -- start 2023-12-24T20:11:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 -- start start 2023-12-24T20:11:04.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4420154b60 0x7f44200c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f442006aca0 0x7f442006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442006c820 con 0x7f44200c6d00 2023-12-24T20:11:04.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442006b960 con 0x7f442006aca0 2023-12-24T20:11:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4426b85700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442006bc40 con 0x7f4420154b60 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4424921700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f44200c6d00 0x7f4420154450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47088/0 (socket says 172.21.15.50:47088) 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4424921700 1 -- 172.21.15.50:0/3349410895 learned_addr learned my addr 172.21.15.50:0/3349410895 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4425122700 1 --2- 172.21.15.50:0/3349410895 >> v2:172.21.15.50:3300/0 conn(0x7f442006aca0 0x7f442006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4417fff700 1 --2- 172.21.15.50:0/3349410895 >> v2:172.21.15.82:3300/0 conn(0x7f4420154b60 0x7f44200c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f44177fe700 1 -- 172.21.15.50:0/3349410895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942137142 0 0) 0x7f442006c820 con 0x7f44200c6d00 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f44177fe700 1 -- 172.21.15.50:0/3349410895 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4408003570 con 0x7f44200c6d00 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4425122700 1 -- 172.21.15.50:0/3349410895 >> v2:172.21.15.82:3300/0 conn(0x7f4420154b60 msgr2=0x7f44200c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4425122700 1 --2- 172.21.15.50:0/3349410895 >> v2:172.21.15.82:3300/0 conn(0x7f4420154b60 0x7f44200c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4425122700 1 -- 172.21.15.50:0/3349410895 >> v1:172.21.15.50:6789/0 conn(0x7f44200c6d00 legacy=0x7f4420154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.285+0000 7f4425122700 1 -- 172.21.15.50:0/3349410895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442006bf20 con 0x7f442006aca0 2023-12-24T20:11:04.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4425122700 1 --2- 172.21.15.50:0/3349410895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442006aca0 0x7f442006b140 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f44200c6480 tx=0x7f4418009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b27fd68703d6fde server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:04.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f44177fe700 1 -- 172.21.15.50:0/3349410895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800e070 con 0x7f442006aca0 2023-12-24T20:11:04.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f44177fe700 1 -- 172.21.15.50:0/3349410895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800bab0 con 0x7f442006aca0 2023-12-24T20:11:04.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f44177fe700 1 -- 172.21.15.50:0/3349410895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800be70 con 0x7f442006aca0 2023-12-24T20:11:04.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 -- 172.21.15.50:0/3349410895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442006aca0 msgr2=0x7f442006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 --2- 172.21.15.50:0/3349410895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442006aca0 0x7f442006b140 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f44200c6480 tx=0x7f4418009780 comp rx=0 tx=0).stop 2023-12-24T20:11:04.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 -- 172.21.15.50:0/3349410895 shutdown_connections 2023-12-24T20:11:04.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 --2- 172.21.15.50:0/3349410895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442006aca0 0x7f442006b140 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 --2- 172.21.15.50:0/3349410895 >> v2:172.21.15.82:3300/0 conn(0x7f4420154b60 0x7f44200c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 -- 172.21.15.50:0/3349410895 >> 172.21.15.50:0/3349410895 conn(0x7f44200cbba0 msgr2=0x7f44200cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:04.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 -- 172.21.15.50:0/3349410895 shutdown_connections 2023-12-24T20:11:04.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.289+0000 7f4426b85700 1 -- 172.21.15.50:0/3349410895 wait complete. 2023-12-24T20:11:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 Processor -- start 2023-12-24T20:11:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 -- start start 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f442006aca0 0x7f4420152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4420154b60 0x7f44200cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44200add50 con 0x7f44200c6d00 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420154f60 con 0x7f4420154b60 2023-12-24T20:11:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4426b85700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4420155800 con 0x7f442006aca0 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47036/0 (socket says 172.21.15.50:47036) 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 -- 172.21.15.50:0/409723463 learned_addr learned my addr 172.21.15.50:0/409723463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4425122700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4420154b60 0x7f44200cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4424921700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f442006aca0 0x7f4420152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 -- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f442006aca0 msgr2=0x7f4420152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f442006aca0 0x7f4420152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 -- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4420154b60 msgr2=0x7f44200cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4420154b60 0x7f44200cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.293+0000 7f4417fff700 1 -- 172.21.15.50:0/409723463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418009a20 con 0x7f44200c6d00 2023-12-24T20:11:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4417fff700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f441000e930 tx=0x7f44100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410013680 con 0x7f44200c6d00 2023-12-24T20:11:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100137e0 con 0x7f44200c6d00 2023-12-24T20:11:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44200b1320 con 0x7f44200c6d00 2023-12-24T20:11:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410013b80 con 0x7f44200c6d00 2023-12-24T20:11:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4420155490 con 0x7f44200c6d00 2023-12-24T20:11:04.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.297+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44200652e0 con 0x7f44200c6d00 2023-12-24T20:11:04.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.301+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f441000c3e0 con 0x7f44200c6d00 2023-12-24T20:11:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.301+0000 7f4414ff9700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 0x7f440c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.301+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f441007ca90 con 0x7f44200c6d00 2023-12-24T20:11:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.301+0000 7f4424921700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 0x7f440c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.301+0000 7f4424921700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 0x7f440c062ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f441c007fd0 tx=0x7f441c009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:04.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.309+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f441004cec0 con 0x7f44200c6d00 2023-12-24T20:11:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.473+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4420155940 con 0x7f440c060620 2023-12-24T20:11:04.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.481+0000 7f4414ff9700 1 -- 172.21.15.50:0/409723463 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47993 (secure 0 0 0) 0x7f4420155940 con 0x7f440c060620 2023-12-24T20:11:04.485 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 msgr2=0x7f440c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 0x7f440c062ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f441c007fd0 tx=0x7f441c009040 comp rx=0 tx=0).stop 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 msgr2=0x7f44200ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f441000e930 tx=0x7f44100091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 shutdown_connections 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f440c060620 0x7f440c062ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4420154b60 0x7f44200cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200c6d00 0x7f44200ca740 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 --2- 172.21.15.50:0/409723463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f442006aca0 0x7f4420152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 >> 172.21.15.50:0/409723463 conn(0x7f44200cbba0 msgr2=0x7f442006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 shutdown_connections 2023-12-24T20:11:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:04.485+0000 7f4426b85700 1 -- 172.21.15.50:0/409723463 wait complete. 2023-12-24T20:11:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:11:04.508 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-12-24T20:11:03.981031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2445448,"kb_used_data":22088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529272,"statfs":{"total":773094113280,"available":770589974528,"internally_reserved":0,"allocated":22618112,"data_stored":12431608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.948677"},"pg_stats":[{"pgid":"1.0","version":"211'370","reported_seq":1216,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-12-24T20:10:52.257824+0000","last_change":"2023-12-24T18:36:18.464941+0000","last_active":"2023-12-24T20:10:52.257824+0000","last_peered":"2023-12-24T20:10:52.257824+0000","last_clean":"2023-12-24T20:10:52.257824+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:10:52.257824+0000","last_undegraded":"2023-12-24T20:10:52.257824+0000","last_fullsized":"2023-12-24T20:10:52.257824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T18:36:16.841854+0000","last_clean_scrub_stamp":"2023-12-24T18:36:16.841854+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:32.624500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304580,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067260,"statfs":{"total":96636764160,"available":96324874240,"internally_reserved":0,"allocated":3272704,"data_stored":1996727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5649999999999999,"5min":1.728,"15min":1.728},"last":1.194},{"interface":"front","average":{"1min":1.242,"5min":1.145,"15min":1.173},"min":{"1min":0.65900000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.4750000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.97199999999999998,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.5840000000000001,"5min":1.718,"15min":1.9379999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.745,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3149999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2050000000000001,"15min":1.2529999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.712,"15min":1.8959999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2210000000000001,"15min":1.2509999999999999},"min":{"1min":0.98299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.766,"5min":1.766,"15min":1.8200000000000001},"last":0.99199999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6319999999999999,"5min":1.857,"15min":2.4449999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.87,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7689999999999999,"5min":1.804,"15min":2.2919999999999998},"last":0.94099999999999995}]},{"osd":4,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2090000000000001},"min":{"1min":0.751,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6759999999999999,"5min":1.865,"15min":2.194},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.3320000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.839,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.0069999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2969999999999999,"15min":1.274},"min":{"1min":0.98299999999999998,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.8240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3959999999999999,"15min":1.3600000000000001},"min":{"1min":1.0489999999999999,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.8089999999999999,"5min":1.95,"15min":1.95},"last":1.2350000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4690000000000001,"15min":1.4350000000000001},"min":{"1min":1.038,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.9430000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.4570000000000001,"15min":1.4299999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.55000000000000004},"max":{"1min":1.923,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.292}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.605,"5min":1.7210000000000001,"15min":1.837},"last":1.464},{"interface":"front","average":{"1min":1.288,"5min":1.3149999999999999,"15min":1.3400000000000001},"min":{"1min":0.80600000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6259999999999999,"5min":1.744,"15min":1.821},"last":1.429}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.133,"15min":1.175},"min":{"1min":0.63800000000000001,"5min":0.53500000000000003,"15min":0.39000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5660000000000001,"15min":1.663},"last":1.179},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.659,"5min":1.6799999999999999,"15min":1.784},"last":1.107}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.73699999999999999,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":1.357,"5min":1.6459999999999999,"15min":1.827},"last":1.056},{"interface":"front","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.2849999999999999},"min":{"1min":0.77200000000000002,"5min":0.68999999999999995,"15min":0.55300000000000005},"max":{"1min":1.7050000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.89000000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.29},"min":{"1min":0.91200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5389999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.298,"15min":1.3100000000000001},"min":{"1min":0.88100000000000001,"5min":0.71299999999999997,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1890000000000001,"15min":1.214},"min":{"1min":0.79000000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5600000000000001,"5min":1.79,"15min":1.9039999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2430000000000001,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66600000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.8580000000000001},"last":1.2370000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2549999999999999,"15min":1.264},"min":{"1min":0.77500000000000002,"5min":0.64700000000000002,"15min":0.58199999999999996},"max":{"1min":1.5940000000000001,"5min":1.7569999999999999,"15min":1.9350000000000001},"last":1.29},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.375,"15min":1.379},"min":{"1min":0.90600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8080000000000001,"5min":1.8380000000000001,"15min":1.925},"last":1.54}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9710000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.367,"15min":1.3939999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.8979999999999999,"15min":2.0259999999999998},"last":1.399}]}]},{"osd":5,"up_from":13,"seq":55834575976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.248,"15min":1.26},"min":{"1min":0.78400000000000003,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.6240000000000001,"5min":1.702,"15min":1.738},"last":1.49},{"interface":"front","average":{"1min":1.282,"5min":1.331,"15min":1.3440000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.621,"5min":1.7829999999999999,"15min":1.784},"last":1.3129999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.7569999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.1930000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4810000000000001,"5min":1.6000000000000001,"15min":1.7210000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2310000000000001,"15min":1.222},"min":{"1min":0.78300000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.486,"5min":1.73,"15min":1.8129999999999999},"last":1.2},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2689999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.569,"5min":1.784,"15min":1.883},"last":1.048}]},{"osd":3,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2809999999999999,"15min":1.29},"min":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.534,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":0.93400000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.1539999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1950000000000001,"15min":1.181},"min":{"1min":0.70299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.369},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.276,"15min":1.294},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.7150000000000001,"5min":1.885,"15min":1.9299999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.29,"15min":1.3129999999999999},"min":{"1min":0.85399999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.262},{"interface":"front","average":{"1min":1.337,"5min":1.3300000000000001,"15min":1.3460000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.758,"5min":1.758,"15min":1.9630000000000001},"last":1.577}]},{"osd":7,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.397,"15min":1.413},"min":{"1min":1.0649999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6519999999999999,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.45,"15min":1.472},"min":{"1min":1.228,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.6910000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.167},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.238}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.359},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2170000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.04},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.95899999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.2769999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.093},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.327}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.304}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.413}]}]},{"osd":3,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.587,"5min":1.671,"15min":1.885},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.085,"15min":1.1200000000000001},"min":{"1min":0.79200000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.552,"5min":1.577,"15min":2.0059999999999998},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.69599999999999995,"5min":0.68100000000000005,"15min":0.67000000000000004},"max":{"1min":1.3839999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.629},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.248,"15min":1.26},"min":{"1min":0.879,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.6850000000000001,"15min":1.889},"last":1.135}]},{"osd":2,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.131,"15min":1.149},"min":{"1min":0.93500000000000005,"5min":0.69099999999999995,"15min":0.59599999999999997},"max":{"1min":1.623,"5min":1.6319999999999999,"15min":2.21},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.226,"15min":1.214},"min":{"1min":0.90100000000000002,"5min":0.83899999999999997,"15min":0.70299999999999996},"max":{"1min":1.863,"5min":2.036,"15min":2.0550000000000002},"last":1.0269999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2809999999999999,"15min":1.2729999999999999},"min":{"1min":0.94899999999999995,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8240000000000001,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.615},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.383},"min":{"1min":1.161,"5min":0.86599999999999999,"15min":0.85799999999999998},"max":{"1min":1.724,"5min":2.1080000000000001,"15min":2.2749999999999999},"last":1.3979999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.458,"15min":1.4490000000000001},"min":{"1min":1.133,"5min":1.1200000000000001,"15min":0.97199999999999998},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4810000000000001,"15min":1.4750000000000001},"min":{"1min":1.075,"5min":1.075,"15min":0.96099999999999997},"max":{"1min":1.827,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.351}]},{"osd":6,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5,"15min":1.516},"min":{"1min":1.0720000000000001,"5min":1.022,"15min":1.0209999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.145},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4570000000000001,"15min":1.448},"min":{"1min":1.0800000000000001,"5min":0.97999999999999998,"15min":0.95699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.552}]},{"osd":7,"last update":"Sun Dec 24 20:10:13 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.498,"15min":1.494},"min":{"1min":1.034,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0649999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5800000000000001,"15min":1.5649999999999999},"min":{"1min":1.056,"5min":1.046,"15min":1.046},"max":{"1min":2.0219999999999998,"5min":2.1000000000000001,"15min":2.3319999999999999},"last":1.4790000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.44400000000000001},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.6299999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.141,"15min":1.159},"min":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3580000000000001,"5min":1.589,"15min":1.8979999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60799999999999998},"max":{"1min":1.214,"5min":1.6100000000000001,"15min":2.056},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.143,"15min":1.129},"min":{"1min":0.78300000000000003,"5min":0.71499999999999997,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":0.86199999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2290000000000001,"15min":1.2250000000000001},"min":{"1min":0.873,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6559999999999999,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1830000000000001,"15min":1.1559999999999999},"min":{"1min":0.79100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.407,"15min":1.3879999999999999},"min":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.651,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.325},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":1.0289999999999999,"5min":1.0189999999999999,"15min":0.94499999999999995},"max":{"1min":1.7989999999999999,"5min":2.4020000000000001,"15min":2.4910000000000001},"last":1.4990000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.456,"15min":1.3859999999999999},"min":{"1min":1.0780000000000001,"5min":0.877,"15min":0.877},"max":{"1min":1.736,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.48,"15min":1.4650000000000001},"min":{"1min":1.0720000000000001,"5min":1.006,"15min":0.95299999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.4330000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.538,"15min":1.5109999999999999},"min":{"1min":1.0880000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.514},"min":{"1min":1.2310000000000001,"5min":1.1060000000000001,"15min":0.876},"max":{"1min":1.923,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.579,"15min":1.573},"min":{"1min":1.1559999999999999,"5min":1.048,"15min":1.048},"max":{"1min":2.0579999999999998,"5min":2.2599999999999998,"15min":2.387},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.6359999999999999,"15min":1.597},"min":{"1min":1.139,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":1.9750000000000001,"5min":2.214,"15min":2.2589999999999999},"last":1.5780000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.98299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.5880000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.131,"15min":1.1439999999999999},"min":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.482,"5min":1.657,"15min":1.671},"last":1.258}]},{"osd":2,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.96699999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.41099999999999998},"max":{"1min":1.482,"5min":1.5069999999999999,"15min":1.5660000000000001},"last":0.753},{"interface":"front","average":{"1min":1.101,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6319999999999999,"5min":1.7929999999999999,"15min":2.0259999999999998},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.268,"15min":1.2969999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.7390000000000001,"5min":1.909,"15min":1.909},"last":1.282},{"interface":"front","average":{"1min":1.077,"5min":1.127,"15min":1.1279999999999999},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.0640000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.23,"15min":1.268},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.5980000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.395,"15min":1.427},"min":{"1min":0.78500000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7150000000000001,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.452}]},{"osd":5,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.91300000000000003,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.784,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.77,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.337}]},{"osd":6,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5029999999999999,"15min":1.5149999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":2.1899999999999999,"5min":2.2120000000000002,"15min":2.3540000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.47,"15min":1.488},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.964,"5min":2.379,"15min":2.456},"last":1.3120000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5489999999999999,"15min":1.5600000000000001},"min":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0329999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.454,"15min":1.4910000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834575975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304580,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067260,"statfs":{"total":96636764160,"available":96324874240,"internally_reserved":0,"allocated":3272704,"data_stored":1996727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.91400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2909999999999999,"5min":1.518,"15min":1.6950000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0389999999999999,"15min":1.0669999999999999},"min":{"1min":0.70899999999999996,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.28,"5min":1.6559999999999999,"15min":1.823},"last":0.93999999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4430000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.67300000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.617,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.76200000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58199999999999996},"max":{"1min":1.474,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.569,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.1599999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7230000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.319,"15min":1.3320000000000001},"min":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.90500000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.8660000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.456,"15min":1.454},"min":{"1min":0.93400000000000005,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4339999999999999,"15min":1.456},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.125},"last":1.2749999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.409,"15min":1.4179999999999999},"min":{"1min":1.069,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.6339999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.542,"15min":1.5289999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.1429999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.234}]},{"osd":7,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.232,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.851,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":1.157,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.837,"5min":2.234,"15min":2.411},"last":1.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:11:04.512 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-24T18:36:16.841854+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=24, tm_hour=18, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=358, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=24, tm_hour=20, tm_min=10, tm_sec=58, tm_wday=6, tm_yday=358, tm_isdst=0) 2023-12-24T20:11:04.512 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-24T20:11:15.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:11:15.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:11:24.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:11:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 Processor -- start 2023-12-24T20:11:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 -- start start 2023-12-24T20:11:24.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b94154b60 0x7f6b940c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 0x7f6b9406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9406c820 con 0x7f6b940c6d00 2023-12-24T20:11:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9406b960 con 0x7f6b94154b60 2023-12-24T20:11:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9c4ae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9406bc40 con 0x7f6b9406aca0 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b99a49700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b94154b60 0x7f6b940c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b99a49700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b94154b60 0x7f6b940c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40082/0 (socket says 172.21.15.50:40082) 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b99a49700 1 -- 172.21.15.50:0/2594110729 learned_addr learned my addr 172.21.15.50:0/2594110729 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.693+0000 7f6b9aa4b700 1 --2- 172.21.15.50:0/2594110729 >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 0x7f6b9406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99a49700 1 -- 172.21.15.50:0/2594110729 >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 msgr2=0x7f6b9406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99a49700 1 --2- 172.21.15.50:0/2594110729 >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 0x7f6b9406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99a49700 1 -- 172.21.15.50:0/2594110729 >> v1:172.21.15.82:6789/0 conn(0x7f6b940c6d00 legacy=0x7f6b94154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99a49700 1 -- 172.21.15.50:0/2594110729 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9406bf20 con 0x7f6b94154b60 2023-12-24T20:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9aa4b700 1 --2- 172.21.15.50:0/2594110729 >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 0x7f6b9406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:11:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99a49700 1 --2- 172.21.15.50:0/2594110729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94154b60 0x7f6b940c70d0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6b94069f60 tx=0x7f6b84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c43122f7de9d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99248700 1 -- 172.21.15.50:0/2594110729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400b860 con 0x7f6b94154b60 2023-12-24T20:11:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99248700 1 -- 172.21.15.50:0/2594110729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400b9c0 con 0x7f6b94154b60 2023-12-24T20:11:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b99248700 1 -- 172.21.15.50:0/2594110729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400bd60 con 0x7f6b94154b60 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/2594110729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94154b60 msgr2=0x7f6b940c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/2594110729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94154b60 0x7f6b940c70d0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6b94069f60 tx=0x7f6b84009250 comp rx=0 tx=0).stop 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/2594110729 shutdown_connections 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/2594110729 >> v2:172.21.15.82:3300/0 conn(0x7f6b9406aca0 0x7f6b9406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/2594110729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b94154b60 0x7f6b940c70d0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/2594110729 >> 172.21.15.50:0/2594110729 conn(0x7f6b940cbba0 msgr2=0x7f6b940cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:24.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/2594110729 shutdown_connections 2023-12-24T20:11:24.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.697+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/2594110729 wait complete. 2023-12-24T20:11:24.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 Processor -- start 2023-12-24T20:11:24.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 -- start start 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b940c6d00 0x7f6b940a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b94154b60 0x7f6b940a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940ca3f0 con 0x7f6b9406aca0 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940ca6d0 con 0x7f6b94154b60 2023-12-24T20:11:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9c4ae700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940ca9b0 con 0x7f6b940c6d00 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9a24a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.701+0000 7f6b9a24a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40096/0 (socket says 172.21.15.50:40096) 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 -- 172.21.15.50:0/3520980482 learned_addr learned my addr 172.21.15.50:0/3520980482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9aa4b700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b94154b60 0x7f6b940a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b99a49700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b940c6d00 0x7f6b940a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 -- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b940c6d00 msgr2=0x7f6b940a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b940c6d00 0x7f6b940a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 -- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b94154b60 msgr2=0x7f6b940a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b94154b60 0x7f6b940a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 -- 172.21.15.50:0/3520980482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840094f0 con 0x7f6b9406aca0 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9a24a700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c590 tx=0x7f6b9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:24.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011590 con 0x7f6b9406aca0 2023-12-24T20:11:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90011710 con 0x7f6b9406aca0 2023-12-24T20:11:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b940cac90 con 0x7f6b9406aca0 2023-12-24T20:11:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011ad0 con 0x7f6b9406aca0 2023-12-24T20:11:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b94169490 con 0x7f6b9406aca0 2023-12-24T20:11:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.705+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b940cb190 con 0x7f6b9406aca0 2023-12-24T20:11:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.709+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f6b9001b3b0 con 0x7f6b9406aca0 2023-12-24T20:11:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.709+0000 7f6b8a7fc700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 0x7f6b78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.709+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f6b9007bf10 con 0x7f6b9406aca0 2023-12-24T20:11:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.709+0000 7f6b99a49700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 0x7f6b78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.713+0000 7f6b99a49700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 0x7f6b78062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b94069f60 tx=0x7f6b84017000 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.717+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6b9004c220 con 0x7f6b9406aca0 2023-12-24T20:11:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.893+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 --> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b940652e0 con 0x7f6b78060550 2023-12-24T20:11:24.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.901+0000 7f6b8a7fc700 1 -- 172.21.15.50:0/3520980482 <== mgr.9086 v2:172.21.15.50:6836/60640 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47960 (secure 0 0 0) 0x7f6b940652e0 con 0x7f6b78060550 2023-12-24T20:11:24.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:11:24.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 msgr2=0x7f6b78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 0x7f6b78062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b94069f60 tx=0x7f6b84017000 comp rx=0 tx=0).stop 2023-12-24T20:11:24.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 msgr2=0x7f6b94168f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:24.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c590 tx=0x7f6b9000c8a0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 shutdown_connections 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f6b78060550 0x7f6b78062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b94154b60 0x7f6b940a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b940c6d00 0x7f6b940a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 --2- 172.21.15.50:0/3520980482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9406aca0 0x7f6b94168f50 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:24.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 >> 172.21.15.50:0/3520980482 conn(0x7f6b940cbba0 msgr2=0x7f6b94158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 shutdown_connections 2023-12-24T20:11:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:24.905+0000 7f6b9c4ae700 1 -- 172.21.15.50:0/3520980482 wait complete. 2023-12-24T20:11:24.911 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-24T20:11:24.928 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-24T20:11:23.986757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2445448,"kb_used_data":22088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529272,"statfs":{"total":773094113280,"available":770589974528,"internally_reserved":0,"allocated":22618112,"data_stored":12431608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003533"},"pg_stats":[{"pgid":"1.0","version":"213'371","reported_seq":1228,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-12-24T20:11:04.734476+0000","last_change":"2023-12-24T20:11:04.734374+0000","last_active":"2023-12-24T20:11:04.734476+0000","last_peered":"2023-12-24T20:11:04.734476+0000","last_clean":"2023-12-24T20:11:04.734476+0000","last_became_active":"2023-12-24T18:36:18.462716+0000","last_became_peered":"2023-12-24T18:36:18.462716+0000","last_unstale":"2023-12-24T20:11:04.734476+0000","last_undegraded":"2023-12-24T20:11:04.734476+0000","last_fullsized":"2023-12-24T20:11:04.734476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"213'371","last_scrub_stamp":"2023-12-24T20:11:04.734142+0000","last_deep_scrub":"213'371","last_deep_scrub_stamp":"2023-12-24T20:11:04.734142+0000","last_clean_scrub_stamp":"2023-12-24T20:11:04.734142+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:17:45.882901+0000","scrub_duration":0.013409634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304580,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067260,"statfs":{"total":96636764160,"available":96324874240,"internally_reserved":0,"allocated":3272704,"data_stored":1996727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1439999999999999,"15min":1.165},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5649999999999999,"5min":1.728,"15min":1.728},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.145,"15min":1.173},"min":{"1min":0.65900000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.0009999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.97199999999999998,"5min":0.61099999999999999,"15min":0.57799999999999996},"max":{"1min":1.5840000000000001,"5min":1.718,"15min":1.9379999999999999},"last":1.446},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.745,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3839999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2050000000000001,"15min":1.2529999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.712,"15min":1.8959999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2210000000000001,"15min":1.2509999999999999},"min":{"1min":0.98299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.766,"5min":1.766,"15min":1.8200000000000001},"last":1.103}]},{"osd":3,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2669999999999999,"15min":1.3049999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6319999999999999,"5min":1.857,"15min":2.4449999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.87,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7689999999999999,"5min":1.804,"15min":2.2919999999999998},"last":1.3240000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2090000000000001},"min":{"1min":0.751,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6759999999999999,"5min":1.865,"15min":2.194},"last":1.276},{"interface":"front","average":{"1min":1.369,"5min":1.3320000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.839,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.645}]},{"osd":5,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2969999999999999,"15min":1.274},"min":{"1min":0.98299999999999998,"5min":0.751,"15min":0.69199999999999995},"max":{"1min":1.8240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.538},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3959999999999999,"15min":1.3600000000000001},"min":{"1min":1.0489999999999999,"5min":0.82699999999999996,"15min":0.68200000000000005},"max":{"1min":1.8089999999999999,"5min":1.95,"15min":1.95},"last":1.474}]},{"osd":6,"last update":"Sun Dec 24 20:10:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4690000000000001,"15min":1.4350000000000001},"min":{"1min":1.038,"5min":0.88300000000000001,"15min":0.76100000000000001},"max":{"1min":1.9430000000000001,"5min":2.125,"15min":2.3319999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.4570000000000001,"15min":1.4299999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.55000000000000004},"max":{"1min":1.923,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.73}]}]},{"osd":6,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2410000000000001,"15min":1.286},"min":{"1min":0.67200000000000004,"5min":0.623,"15min":0.44500000000000001},"max":{"1min":1.546,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3},{"interface":"front","average":{"1min":1.288,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.56499999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3540000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.159,"15min":1.177},"min":{"1min":0.80800000000000005,"5min":0.63800000000000001,"15min":0.39000000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2030000000000001,"15min":1.2110000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.438},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.784},"last":1.024}]},{"osd":2,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1659999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.53400000000000003},"max":{"1min":1.4099999999999999,"5min":1.6459999999999999,"15min":1.827},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.254,"15min":1.2789999999999999},"min":{"1min":0.81699999999999995,"5min":0.77200000000000002,"15min":0.55300000000000005},"max":{"1min":1.6160000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0980000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2569999999999999,"15min":1.2889999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.49399999999999999},"max":{"1min":1.5669999999999999,"5min":1.696,"15min":1.8879999999999999},"last":1.28},{"interface":"front","average":{"1min":1.206,"5min":1.2849999999999999,"15min":1.302},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.69799999999999995},"max":{"1min":1.5880000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.3999999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.2190000000000001,"15min":1.2130000000000001},"min":{"1min":0.88400000000000001,"5min":0.76400000000000001,"15min":0.371},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.2589999999999999,"15min":1.276},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.67000000000000004},"max":{"1min":1.6870000000000001,"5min":1.837,"15min":1.8580000000000001},"last":1.1619999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.27,"15min":1.264},"min":{"1min":0.94699999999999995,"5min":0.77500000000000002,"15min":0.58199999999999996},"max":{"1min":1.6679999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.494},{"interface":"front","average":{"1min":1.393,"5min":1.385,"15min":1.3779999999999999},"min":{"1min":0.96499999999999997,"5min":0.77800000000000002,"15min":0.59199999999999997},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.47}]},{"osd":7,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.405,"15min":1.3999999999999999},"min":{"1min":0.88700000000000001,"5min":0.754,"15min":0.60599999999999998},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.3620000000000001,"15min":1.3919999999999999},"min":{"1min":0.95499999999999996,"5min":0.71699999999999997,"15min":0.65300000000000002},"max":{"1min":1.6850000000000001,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.544}]}]},{"osd":5,"up_from":13,"seq":55834575980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.248,"15min":1.26},"min":{"1min":0.78400000000000003,"5min":0.74399999999999999,"15min":0.55500000000000005},"max":{"1min":1.6240000000000001,"5min":1.702,"15min":1.738},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.331,"15min":1.3440000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.621,"5min":1.7829999999999999,"15min":1.784},"last":1.4470000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.7569999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.1930000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4810000000000001,"5min":1.6000000000000001,"15min":1.7210000000000001},"last":1.347}]},{"osd":2,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2310000000000001,"15min":1.222},"min":{"1min":0.78300000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.486,"5min":1.73,"15min":1.8129999999999999},"last":1.089},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2689999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.569,"5min":1.784,"15min":1.883},"last":1.129}]},{"osd":3,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2809999999999999,"15min":1.29},"min":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.534,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":0.93400000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4770000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1950000000000001,"15min":1.181},"min":{"1min":0.70299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.641},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.276,"15min":1.294},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.59599999999999997},"max":{"1min":1.7150000000000001,"5min":1.885,"15min":1.9299999999999999},"last":1.579}]},{"osd":6,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.29,"15min":1.3129999999999999},"min":{"1min":0.85399999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.258},{"interface":"front","average":{"1min":1.337,"5min":1.3300000000000001,"15min":1.3460000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.758,"5min":1.758,"15min":1.9630000000000001},"last":1.5389999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.397,"15min":1.413},"min":{"1min":1.0649999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6519999999999999,"5min":2.0169999999999999,"15min":2.0649999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.45,"15min":1.472},"min":{"1min":1.228,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.607}]}]},{"osd":4,"up_from":13,"seq":55834575980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.272,"15min":1.2609999999999999},"min":{"1min":1.0449999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.276,"15min":1.284},"min":{"1min":0.92600000000000005,"5min":0.68400000000000005,"15min":0.66300000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.252}]},{"osd":1,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1559999999999999},"min":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5840000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.167,"15min":1.1539999999999999},"min":{"1min":0.76300000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.3959999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.349,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6910000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.369,"15min":1.371},"min":{"1min":1.1399999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6719999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.524}]},{"osd":3,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2030000000000001,"15min":1.2190000000000001},"min":{"1min":0.88100000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.482,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.099},{"interface":"front","average":{"1min":1.258,"5min":1.3,"15min":1.3089999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.597,"5min":1.9770000000000001,"15min":2.0779999999999998},"last":1.3200000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.83099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7789999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.343,"15min":1.337},"min":{"1min":0.81899999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6819999999999999,"5min":2.0720000000000001,"15min":2.089},"last":1.486}]},{"osd":6,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2949999999999999,"15min":1.304},"min":{"1min":0.98399999999999999,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.7210000000000001,"5min":2.0779999999999998,"15min":2.5310000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.355},"min":{"1min":0.91900000000000004,"5min":0.65700000000000003,"15min":0.64400000000000002},"max":{"1min":1.9419999999999999,"5min":1.964,"15min":1.964},"last":1.151}]},{"osd":7,"last update":"Sun Dec 24 20:10:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.95099999999999996,"5min":0.72799999999999998,"15min":0.59699999999999998},"max":{"1min":1.7869999999999999,"5min":2.1139999999999999,"15min":2.2200000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4530000000000001,"15min":1.4379999999999999},"min":{"1min":0.95999999999999996,"5min":0.95299999999999996,"15min":0.72999999999999998},"max":{"1min":1.8340000000000001,"5min":2.0840000000000001,"15min":2.7829999999999999},"last":1.2090000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93799999999999994,"15min":0.96899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.786,"5min":1.786,"15min":1.885},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0720000000000001,"15min":1.1080000000000001},"min":{"1min":0.62,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":2.0059999999999998},"last":1.292}]},{"osd":1,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0469999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":2.0899999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.2010000000000001,"15min":1.2410000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.605,"5min":1.6850000000000001,"15min":1.889},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.113,"15min":1.135},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":2.21},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.206,"15min":1.206},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.849,"5min":2.036,"15min":2.0550000000000002},"last":0.99199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2649999999999999,"15min":1.272},"min":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.71099999999999997},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":2.2549999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.359,"15min":1.373},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.794,"5min":1.911,"15min":2.2749999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.4159999999999999,"15min":1.4370000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":0.97199999999999998},"max":{"1min":1.653,"5min":2.1120000000000001,"15min":2.3900000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.47},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.708,"5min":2.0680000000000001,"15min":2.2250000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4690000000000001,"15min":1.504},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.845,"5min":1.9710000000000001,"15min":2.145},"last":1.256},{"interface":"front","average":{"1min":1.379,"5min":1.4359999999999999,"15min":1.4430000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7869999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.4199999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:11:14 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.466,"15min":1.486},"min":{"1min":1.0269999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.7470000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.365},{"interface":"front","average":{"1min":1.403,"5min":1.54,"15min":1.554},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.9219999999999999,"5min":2.0369999999999999,"15min":2.3319999999999999},"last":1.3859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299904,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071936,"statfs":{"total":96636764160,"available":96329662464,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.55400000000000005,"15min":0.44400000000000001},"max":{"1min":1.266,"5min":1.45,"15min":1.6299999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.123,"15min":1.1459999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5269999999999999,"5min":1.589,"15min":1.8979999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.95699999999999996,"15min":0.95199999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.51,"5min":1.6100000000000001,"15min":1.659},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1950000000000001,"5min":2.0539999999999998,"15min":2.1000000000000001},"last":1.056}]},{"osd":3,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1930000000000001,"15min":1.216},"min":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.661,"5min":1.7629999999999999,"15min":2.1659999999999999},"last":1.429},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.125,"15min":1.143},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4350000000000001,"5min":1.7130000000000001,"15min":2.1230000000000002},"last":0.92600000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.369,"15min":1.3759999999999999},"min":{"1min":0.93000000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.635,"5min":1.7889999999999999,"15min":2.6379999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.343,"15min":1.353},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.74,"5min":1.877,"15min":2.4020000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.4119999999999999,"15min":1.3819999999999999},"min":{"1min":0.92200000000000004,"5min":0.877,"15min":0.877},"max":{"1min":1.6020000000000001,"5min":1.9850000000000001,"15min":2.0750000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4550000000000001,"15min":1.4570000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.95299999999999996},"max":{"1min":1.704,"5min":2.0659999999999998,"15min":2.3220000000000001},"last":1.573}]},{"osd":6,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.5109999999999999,"15min":1.504},"min":{"1min":0.92500000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.6579999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.542},{"interface":"front","average":{"1min":1.409,"5min":1.5209999999999999,"15min":1.51},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.876},"max":{"1min":1.9950000000000001,"5min":2.1379999999999999,"15min":2.3180000000000001},"last":1.472}]},{"osd":7,"last update":"Sun Dec 24 20:11:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.556,"15min":1.5609999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":1.8200000000000001,"5min":2.1589999999999998,"15min":2.387},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5940000000000001,"15min":1.5860000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.8400000000000001,"5min":2.214,"15min":2.226},"last":1.278}]}]},{"osd":1,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1406359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.60399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1359999999999999},"min":{"1min":0.67100000000000004,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.46,"5min":1.657,"15min":1.671},"last":1.0209999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92000000000000004,"15min":0.95799999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.41099999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.5660000000000001},"last":1.109},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1140000000000001,"15min":1.117},"min":{"1min":0.76300000000000001,"5min":0.54800000000000004,"15min":0.45800000000000002},"max":{"1min":1.7729999999999999,"5min":1.7929999999999999,"15min":1.802},"last":0.86499999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.256,"15min":1.2849999999999999},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.60599999999999998},"max":{"1min":1.869,"5min":1.909,"15min":1.909},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.119,"15min":1.125},"min":{"1min":0.68200000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5680000000000001,"5min":1.742,"15min":1.8140000000000001},"last":1.401}]},{"osd":4,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2150000000000001,"15min":1.2609999999999999},"min":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.63},"max":{"1min":1.6220000000000001,"5min":1.73,"15min":2.0510000000000002},"last":1.498},{"interface":"front","average":{"1min":1.369,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":1.046,"5min":0.78500000000000003,"15min":0.75700000000000001},"max":{"1min":1.9119999999999999,"5min":2.0670000000000002,"15min":2.3980000000000001},"last":1.304}]},{"osd":5,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.381,"15min":1.387},"min":{"1min":0.93799999999999994,"5min":0.84299999999999997,"15min":0.81200000000000006},"max":{"1min":1.679,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.329},{"interface":"front","average":{"1min":1.331,"5min":1.361,"15min":1.3839999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.746,"5min":1.837,"15min":2.0939999999999999},"last":1.266}]},{"osd":6,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4890000000000001,"15min":1.5069999999999999},"min":{"1min":1.0620000000000001,"5min":0.86199999999999999,"15min":0.72999999999999998},"max":{"1min":1.867,"5min":2.2120000000000002,"15min":2.2410000000000001},"last":1.196},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4550000000000001,"15min":1.4830000000000001},"min":{"1min":0.998,"5min":0.875,"15min":0.875},"max":{"1min":1.8049999999999999,"5min":2.379,"15min":2.456},"last":1.244}]},{"osd":7,"last update":"Sun Dec 24 20:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.5329999999999999,"15min":1.5509999999999999},"min":{"1min":1.04,"5min":0.94099999999999995,"15min":0.92600000000000005},"max":{"1min":1.8779999999999999,"5min":2.29,"15min":2.5299999999999998},"last":1.456},{"interface":"front","average":{"1min":1.425,"5min":1.429,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.804,"5min":1.893,"15min":2.177},"last":1.3759999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304580,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067260,"statfs":{"total":96636764160,"available":96324874240,"internally_reserved":0,"allocated":3272704,"data_stored":1996727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.91400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2909999999999999,"5min":1.518,"15min":1.6950000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0389999999999999,"15min":1.0669999999999999},"min":{"1min":0.70899999999999996,"5min":0.66300000000000003,"15min":0.627},"max":{"1min":1.28,"5min":1.6559999999999999,"15min":1.823},"last":0.85099999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4430000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.67300000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.617,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.97499999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58199999999999996},"max":{"1min":1.474,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.569,"5min":1.8779999999999999,"15min":2.0190000000000001},"last":1.377}]},{"osd":4,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7230000000000001,"5min":1.8520000000000001,"15min":1.9019999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.319,"15min":1.3320000000000001},"min":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.90500000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.8660000000000001},"last":1.135}]},{"osd":5,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.456,"15min":1.454},"min":{"1min":0.93400000000000005,"5min":0.93200000000000005,"15min":0.67500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0499999999999998,"15min":2.2519999999999998},"last":1.29},{"interface":"front","average":{"1min":1.397,"5min":1.4339999999999999,"15min":1.456},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.125},"last":1.2250000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.409,"15min":1.4179999999999999},"min":{"1min":1.069,"5min":1.0069999999999999,"15min":0.82399999999999995},"max":{"1min":1.6339999999999999,"5min":2.1320000000000001,"15min":2.492},"last":1.258},{"interface":"front","average":{"1min":1.516,"5min":1.542,"15min":1.5289999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.1429999999999998,"5min":2.1469999999999998,"15min":2.3330000000000002},"last":1.472}]},{"osd":7,"last update":"Sun Dec 24 20:10:33 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.232,"5min":1.145,"15min":1.0429999999999999},"max":{"1min":1.851,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":1.157,"5min":1.0580000000000001,"15min":0.86499999999999999},"max":{"1min":1.837,"5min":2.234,"15min":2.411},"last":1.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-24T20:11:24.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-24T20:11:25.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 Processor -- start 2023-12-24T20:11:25.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 -- start start 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0c140870 0x7f2d0c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d0c0caa40 0x7f2d0c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0cae40 con 0x7f2d0c1404a0 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c15b990 con 0x7f2d0c140870 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d13025700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c06ccc0 con 0x7f2d0c0caa40 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0c140870 0x7f2d0c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0c140870 0x7f2d0c0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40108/0 (socket says 172.21.15.50:40108) 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2457991554 learned_addr learned my addr 172.21.15.50:0/2457991554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d115c2700 1 --2- 172.21.15.50:0/2457991554 >> v2:172.21.15.82:3300/0 conn(0x7f2d0c0caa40 0x7f2d0c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2457991554 >> v2:172.21.15.82:3300/0 conn(0x7f2d0c0caa40 msgr2=0x7f2d0c06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 --2- 172.21.15.50:0/2457991554 >> v2:172.21.15.82:3300/0 conn(0x7f2d0c0caa40 0x7f2d0c06d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2457991554 >> v1:172.21.15.82:6789/0 conn(0x7f2d0c1404a0 legacy=0x7f2d0c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.089+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2457991554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c15b120 con 0x7f2d0c140870 2023-12-24T20:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d0bfff700 1 --2- 172.21.15.50:0/2457991554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c140870 0x7f2d0c0ca500 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c158570 tx=0x7f2cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf8259264f7a3e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d0b7fe700 1 -- 172.21.15.50:0/2457991554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800b860 con 0x7f2d0c140870 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d0b7fe700 1 -- 172.21.15.50:0/2457991554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800b9c0 con 0x7f2d0c140870 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d0b7fe700 1 -- 172.21.15.50:0/2457991554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800bd60 con 0x7f2d0c140870 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 -- 172.21.15.50:0/2457991554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c140870 msgr2=0x7f2d0c0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 --2- 172.21.15.50:0/2457991554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c140870 0x7f2d0c0ca500 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c158570 tx=0x7f2cf8009250 comp rx=0 tx=0).stop 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 -- 172.21.15.50:0/2457991554 shutdown_connections 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 --2- 172.21.15.50:0/2457991554 >> v2:172.21.15.82:3300/0 conn(0x7f2d0c0caa40 0x7f2d0c06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 --2- 172.21.15.50:0/2457991554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c140870 0x7f2d0c0ca500 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 -- 172.21.15.50:0/2457991554 >> 172.21.15.50:0/2457991554 conn(0x7f2d0c067b80 msgr2=0x7f2d0c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 -- 172.21.15.50:0/2457991554 shutdown_connections 2023-12-24T20:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.093+0000 7f2d13025700 1 -- 172.21.15.50:0/2457991554 wait complete. 2023-12-24T20:11:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 Processor -- start 2023-12-24T20:11:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 -- start start 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 0x7f2d0c135380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 0x7f2d0c0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1572e0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c16f3f0 con 0x7f2d0c0caa40 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d13025700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c16e770 con 0x7f2d0c140870 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40114/0 (socket says 172.21.15.50:40114) 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2341657240 learned_addr learned my addr 172.21.15.50:0/2341657240 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d10dc1700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 0x7f2d0c135380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d115c2700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 0x7f2d0c0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 msgr2=0x7f2d0c0ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 0x7f2d0c0ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 msgr2=0x7f2d0c135380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 0x7f2d0c135380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d0bfff700 1 -- 172.21.15.50:0/2341657240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80094f0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d10dc1700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 0x7f2d0c135380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.097+0000 7f2d115c2700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 0x7f2d0c0ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d0bfff700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c069b20 tx=0x7f2cf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8011e60 con 0x7f2d0c1404a0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf801a630 con 0x7f2d0c1404a0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c16eac0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf801a9f0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c16f080 con 0x7f2d0c1404a0 2023-12-24T20:11:25.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.101+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c16f5a0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.105+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7f2cf802d430 con 0x7f2d0c1404a0 2023-12-24T20:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.105+0000 7f2d08ff9700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 0x7f2cf0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.105+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f2cf807e460 con 0x7f2d0c1404a0 2023-12-24T20:11:25.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.105+0000 7f2d10dc1700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 0x7f2cf0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.105+0000 7f2d10dc1700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 0x7f2cf0062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007fd0 tx=0x7f2d00009040 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.113+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d0c16f5a0 con 0x7f2d0c1404a0 2023-12-24T20:11:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.289+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2d0c16f560 con 0x7f2d0c1404a0 2023-12-24T20:11:25.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.297+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cf804e870 con 0x7f2d0c1404a0 2023-12-24T20:11:25.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.297+0000 7f2d08ff9700 1 -- 172.21.15.50:0/2341657240 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2cf8052300 con 0x7f2d0c1404a0 2023-12-24T20:11:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 msgr2=0x7f2cf0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 0x7f2cf0062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007fd0 tx=0x7f2d00009040 comp rx=0 tx=0).stop 2023-12-24T20:11:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 msgr2=0x7f2d0c0accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c069b20 tx=0x7f2cf8017000 comp rx=0 tx=0).stop 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 shutdown_connections 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7f2cf0060580 0x7f2cf0062a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d0c140870 0x7f2d0c0ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0c1404a0 0x7f2d0c0accd0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.301+0000 7f2d13025700 1 --2- 172.21.15.50:0/2341657240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0caa40 0x7f2d0c135380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.305+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 >> 172.21.15.50:0/2341657240 conn(0x7f2d0c067b80 msgr2=0x7f2d0c0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.305+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 shutdown_connections 2023-12-24T20:11:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.305+0000 7f2d13025700 1 -- 172.21.15.50:0/2341657240 wait complete. 2023-12-24T20:11:25.328 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:11:25.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:11:25.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 Processor -- start 2023-12-24T20:11:25.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 -- start start 2023-12-24T20:11:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f8159bc0 0x7fc5f8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5f80ca110 0x7fc5f80ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f806b850 con 0x7fc5f806bce0 2023-12-24T20:11:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f80caaf0 con 0x7fc5f80ca110 2023-12-24T20:11:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.489+0000 7fc5fdcf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f806ac40 con 0x7fc5f8159bc0 2023-12-24T20:11:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f6ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc5f806bce0 0x7fc5f80aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.50:47364/0 (socket says 172.21.15.50:47364) 2023-12-24T20:11:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f6ffd700 1 -- 172.21.15.50:0/3182728381 learned_addr learned my addr 172.21.15.50:0/3182728381 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-24T20:11:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/3182728381 >> v2:172.21.15.50:3300/0 conn(0x7fc5f80ca110 0x7fc5f80ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f77fe700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f8159bc0 0x7fc5f8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f67fc700 1 -- 172.21.15.50:0/3182728381 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398344312 0 0) 0x7fc5f806b850 con 0x7fc5f806bce0 2023-12-24T20:11:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f67fc700 1 -- 172.21.15.50:0/3182728381 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e0003570 con 0x7fc5f806bce0 2023-12-24T20:11:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 -- 172.21.15.50:0/3182728381 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f8159bc0 msgr2=0x7fc5f8159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:11:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f8159bc0 0x7fc5f8159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 -- 172.21.15.50:0/3182728381 >> v1:172.21.15.82:6789/0 conn(0x7fc5f806bce0 legacy=0x7fc5f80aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 -- 172.21.15.50:0/3182728381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f806af20 con 0x7fc5f80ca110 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f80ca110 0x7fc5f80ca5b0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e60 tx=0x7fc5f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995f466f169791f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f67fc700 1 -- 172.21.15.50:0/3182728381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000e070 con 0x7fc5f80ca110 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f67fc700 1 -- 172.21.15.50:0/3182728381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5f000bab0 con 0x7fc5f80ca110 2023-12-24T20:11:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5f67fc700 1 -- 172.21.15.50:0/3182728381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000be90 con 0x7fc5f80ca110 2023-12-24T20:11:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/3182728381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f80ca110 msgr2=0x7fc5f80ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.493+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f80ca110 0x7fc5f80ca5b0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e60 tx=0x7fc5f0009780 comp rx=0 tx=0).stop 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/3182728381 shutdown_connections 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f80ca110 0x7fc5f80ca5b0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/3182728381 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f8159bc0 0x7fc5f8159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/3182728381 >> 172.21.15.50:0/3182728381 conn(0x7fc5f80cbba0 msgr2=0x7fc5f80cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/3182728381 shutdown_connections 2023-12-24T20:11:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/3182728381 wait complete. 2023-12-24T20:11:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 Processor -- start 2023-12-24T20:11:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.497+0000 7fc5fdcf0700 1 -- start start 2023-12-24T20:11:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f806bce0 0x7fc5f81564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5f80ca110 0x7fc5f80aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815bc20 con 0x7fc5f8159bc0 2023-12-24T20:11:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80b17e0 con 0x7fc5f80ca110 2023-12-24T20:11:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5fdcf0700 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815b380 con 0x7fc5f806bce0 2023-12-24T20:11:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40140/0 (socket says 172.21.15.50:40140) 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 -- 172.21.15.50:0/491190185 learned_addr learned my addr 172.21.15.50:0/491190185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f6ffd700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5f80ca110 0x7fc5f80aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f77fe700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f806bce0 0x7fc5f81564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 -- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f806bce0 msgr2=0x7fc5f81564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f806bce0 0x7fc5f81564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 -- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5f80ca110 msgr2=0x7fc5f80aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5f80ca110 0x7fc5f80aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 -- 172.21.15.50:0/491190185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0009a20 con 0x7fc5f8159bc0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.501+0000 7fc5f7fff700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b610 tx=0x7fc5f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0012db0 con 0x7fc5f8159bc0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5f0027470 con 0x7fc5f8159bc0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f815b660 con 0x7fc5f8159bc0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0027850 con 0x7fc5f8159bc0 2023-12-24T20:11:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f80af580 con 0x7fc5f8159bc0 2023-12-24T20:11:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f80af7a0 con 0x7fc5f8159bc0 2023-12-24T20:11:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.505+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 126) v1 ==== 79961+0+0 (secure 0 0 0) 0x7fc5f0024070 con 0x7fc5f8159bc0 2023-12-24T20:11:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.509+0000 7fc5df7fe700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 0x7fc5e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:11:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.509+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fc5f007f2d0 con 0x7fc5f8159bc0 2023-12-24T20:11:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.509+0000 7fc5f77fe700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 0x7fc5e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:11:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.509+0000 7fc5f77fe700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 0x7fc5e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80c0b30 tx=0x7fc5e80091a0 comp rx=0 tx=0).ready entity=mgr.9086 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:11:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.517+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc5f004f700 con 0x7fc5f8159bc0 2023-12-24T20:11:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.725+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5f80652e0 con 0x7fc5f8159bc0 2023-12-24T20:11:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.725+0000 7fc5df7fe700 1 -- 172.21.15.50:0/491190185 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+3534 (secure 0 0 0) 0x7fc5f0052d20 con 0x7fc5f8159bc0 2023-12-24T20:11:25.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-24T20:11:25.729 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":106,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/4131618707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4131618707},{"type":"v1","addr":"172.21.15.82:6834","nonce":4131618707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10249,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4143508781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":4143508781},{"type":"v1","addr":"172.21.15.82:6835","nonce":4143508781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":10344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1385491878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1385491878},{"type":"v1","addr":"172.21.15.50:6834","nonce":1385491878}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":10749,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1399835476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1399835476},{"type":"v1","addr":"172.21.15.50:6835","nonce":1399835476}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[]} 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 msgr2=0x7fc5e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 0x7fc5e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80c0b30 tx=0x7fc5e80091a0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 msgr2=0x7fc5f80acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b610 tx=0x7fc5f0009780 comp rx=0 tx=0).stop 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 shutdown_connections 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:6836/60640,v1:172.21.15.50:6837/60640] conn(0x7fc5e4060550 0x7fc5e4062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5f8159bc0 0x7fc5f80acf90 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5f80ca110 0x7fc5f80aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 --2- 172.21.15.50:0/491190185 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5f806bce0 0x7fc5f81564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 >> 172.21.15.50:0/491190185 conn(0x7fc5f80cbba0 msgr2=0x7fc5f80a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 shutdown_connections 2023-12-24T20:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-24T20:11:25.729+0000 7fc5fdcf0700 1 -- 172.21.15.50:0/491190185 wait complete. 2023-12-24T20:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 106 2023-12-24T20:11:25.753 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-24T20:11:25.753 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-24T20:11:25.754 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:11:25.754 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:25.772 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:11:25.773 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:11:25.773 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:25.834 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:11:25.835 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:11:25.835 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:25.855 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:11:25.855 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:11:25.855 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:25.919 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:11:25.919 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-24T20:11:25.920 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-24T20:11:25.920 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:26.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-24T20:11:26.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-24T20:11:32.021 INFO:tasks.ceph.osd.0:Stopped 2023-12-24T20:11:32.021 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-24T20:11:32.021 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:32.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-24T20:11:32.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-24T20:11:32.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-24T20:11:38.123 INFO:tasks.ceph.osd.1:Stopped 2023-12-24T20:11:38.124 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-24T20:11:38.124 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:38.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-24T20:11:38.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-24T20:11:44.226 INFO:tasks.ceph.osd.2:Stopped 2023-12-24T20:11:44.226 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-24T20:11:44.226 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:44.302 INFO:tasks.ceph.osd.3:Stopped 2023-12-24T20:11:44.302 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-24T20:11:44.303 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:44.397 INFO:tasks.ceph.osd.4:Stopped 2023-12-24T20:11:44.397 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-24T20:11:44.397 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:44.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-24T20:11:44.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-24T20:11:45.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:11:45.796 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:11:50.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-24T20:11:50.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-24T20:11:50.499 INFO:tasks.ceph.osd.5:Stopped 2023-12-24T20:11:50.500 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-24T20:11:50.500 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:50.594 INFO:tasks.ceph.osd.6:Stopped 2023-12-24T20:11:50.594 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-24T20:11:50.594 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:55.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-24T20:11:55.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-24T20:11:56.696 INFO:tasks.ceph.osd.7:Stopped 2023-12-24T20:11:56.696 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-24T20:11:56.696 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-24T20:11:56.697 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:56.765 INFO:tasks.ceph.mgr.y:Stopped 2023-12-24T20:11:56.765 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-24T20:11:56.765 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:56.832 INFO:tasks.ceph.mgr.x:Stopped 2023-12-24T20:11:56.832 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-24T20:11:56.832 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-24T20:11:56.832 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:56.882 INFO:tasks.ceph.mon.a:Stopped 2023-12-24T20:11:56.882 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-24T20:11:56.882 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:56.922 INFO:tasks.ceph.mon.b:Stopped 2023-12-24T20:11:56.923 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-24T20:11:56.923 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:11:56.959 INFO:tasks.ceph.mon.c:Stopped 2023-12-24T20:11:56.960 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-24T20:11:56.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-24T20:11:57.006 INFO:teuthology.orchestra.run.smithi050.stdout:1703443822.6813297 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-24T20:11:57.007 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-24T20:11:57.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-24T20:11:57.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-24T20:11:57.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-24T20:11:57.287 INFO:teuthology.orchestra.run.smithi050.stdout:1703443822.6813297 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-24T20:11:57.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:11:57.288 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-24T20:11:57.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:11:57.609 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-24T20:11:57.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:11:57.816 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-24T20:11:58.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:11:58.026 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-24T20:11:58.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T20:11:58.375 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-24T20:11:58.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T20:11:58.741 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-24T20:11:58.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T20:11:58.972 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-24T20:11:59.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T20:11:59.177 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-24T20:11:59.395 INFO:tasks.ceph:Archiving mon data... 2023-12-24T20:11:59.396 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/data/mon.a.tgz 2023-12-24T20:11:59.396 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-12-24T20:11:59.414 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.bFNavnZK2P 2023-12-24T20:11:59.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bFNavnZK2P 2023-12-24T20:11:59.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.bFNavnZK2P 2023-12-24T20:12:00.011 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.bFNavnZK2P is 3MB 2023-12-24T20:12:00.135 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.bFNavnZK2P 2023-12-24T20:12:00.153 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/data/mon.b.tgz 2023-12-24T20:12:00.153 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-12-24T20:12:00.170 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.dIDNCtTzYr 2023-12-24T20:12:00.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dIDNCtTzYr 2023-12-24T20:12:00.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.dIDNCtTzYr 2023-12-24T20:12:00.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-24T20:12:00.753 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.dIDNCtTzYr is 3MB 2023-12-24T20:12:00.865 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.dIDNCtTzYr 2023-12-24T20:12:00.884 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/data/mon.c.tgz 2023-12-24T20:12:00.884 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-12-24T20:12:00.944 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.1dvVp1G9Dg 2023-12-24T20:12:00.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1dvVp1G9Dg 2023-12-24T20:12:01.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.1dvVp1G9Dg 2023-12-24T20:12:01.553 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.1dvVp1G9Dg is 3MB 2023-12-24T20:12:01.665 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.1dvVp1G9Dg 2023-12-24T20:12:01.685 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-24T20:12:01.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-24T20:12:01.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-24T20:12:01.764 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-24T20:12:01.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-24T20:12:01.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-24T20:12:01.819 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-24T20:12:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-24T20:12:01.872 INFO:tasks.ceph:Archiving crash dumps... 2023-12-24T20:12:01.874 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi050/crash 2023-12-24T20:12:01.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-24T20:12:01.910 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi082/crash 2023-12-24T20:12:01.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-24T20:12:01.948 INFO:tasks.ceph:Shutting down logrotate 2023-12-24T20:12:01.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:12:01.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:12:02.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-24T20:12:02.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-24T20:12:02.133 INFO:tasks.ceph:Compressing logs... 2023-12-24T20:12:02.133 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-24T20:12:02.149 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-24T20:12:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62445.log 2023-12-24T20:12:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65352.log 2023-12-24T20:12:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56130.log 2023-12-24T20:12:02.192 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62445.log.gz 2023-12-24T20:12:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61761.log 2023-12-24T20:12:02.193 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65352.log.gz 2023-12-24T20:12:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46118.log 2023-12-24T20:12:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56130.log: /var/log/ceph/ceph-client.admin.61761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51411.log 2023-12-24T20:12:02.196 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56130.log.gz 2023-12-24T20:12:02.196 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61761.log.gz 2023-12-24T20:12:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46118.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46118.log.gz 2023-12-24T20:12:02.198 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2023-12-24T20:12:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66468.log 2023-12-24T20:12:02.200 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51411.log.gz 2023-12-24T20:12:02.201 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48386.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2023-12-24T20:12:02.201 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55808.log 2023-12-24T20:12:02.203 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57250.log 2023-12-24T20:12:02.203 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66468.log.gz 2023-12-24T20:12:02.204 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60182.log 2023-12-24T20:12:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57250.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55808.log.gz 2023-12-24T20:12:02.205 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57250.log.gz 2023-12-24T20:12:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42469.log 2023-12-24T20:12:02.207 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 88.6% 2023-12-24T20:12:02.207 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60182.log.gz 2023-12-24T20:12:02.208 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42469.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42469.log.gz 2023-12-24T20:12:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57571.log 2023-12-24T20:12:02.211 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2023-12-24T20:12:02.211 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2023-12-24T20:12:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57571.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57571.log.gz 2023-12-24T20:12:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64089.log 2023-12-24T20:12:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2023-12-24T20:12:02.214 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2023-12-24T20:12:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64089.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64089.log.gz 2023-12-24T20:12:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2023-12-24T20:12:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63658.log 2023-12-24T20:12:02.217 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2023-12-24T20:12:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56787.log 2023-12-24T20:12:02.219 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2023-12-24T20:12:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63658.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63658.log.gz 2023-12-24T20:12:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51587.log 2023-12-24T20:12:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2023-12-24T20:12:02.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56787.log.gz 2023-12-24T20:12:02.222 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-24T20:12:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2023-12-24T20:12:02.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51587.log.gz 2023-12-24T20:12:02.224 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-24T20:12:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52366.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2023-12-24T20:12:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-12-24T20:12:02.226 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2023-12-24T20:12:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45209.log 2023-12-24T20:12:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42196.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2023-12-24T20:12:02.228 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34118.log 2023-12-24T20:12:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47241.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-12-24T20:12:02.229 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2023-12-24T20:12:02.229 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-24T20:12:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57911.log 2023-12-24T20:12:02.230 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.34010.log: /var/log/ceph/ceph-client.admin.34118.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2023-12-24T20:12:02.231 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45209.log.gz 2023-12-24T20:12:02.232 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34118.log.gz 2023-12-24T20:12:02.232 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2023-12-24T20:12:02.232 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2023-12-24T20:12:02.233 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-24T20:12:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57911.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57911.log.gz 2023-12-24T20:12:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55835.log 2023-12-24T20:12:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-24T20:12:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58801.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2023-12-24T20:12:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48025.log 2023-12-24T20:12:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65659.log 2023-12-24T20:12:02.236 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55835.log.gz 2023-12-24T20:12:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-24T20:12:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48025.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48025.log.gz 2023-12-24T20:12:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2023-12-24T20:12:02.239 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-24T20:12:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60872.log 2023-12-24T20:12:02.241 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65659.log.gz 2023-12-24T20:12:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2023-12-24T20:12:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39471.log 2023-12-24T20:12:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51329.log: /var/log/ceph/ceph-client.admin.60872.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2023-12-24T20:12:02.243 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60872.log.gz 2023-12-24T20:12:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2023-12-24T20:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51090.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2023-12-24T20:12:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.39471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39471.log.gz 2023-12-24T20:12:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33956.log 2023-12-24T20:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63076.log 2023-12-24T20:12:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2023-12-24T20:12:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55888.log 2023-12-24T20:12:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.33956.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33956.log.gz 2023-12-24T20:12:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-24T20:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39562.log 2023-12-24T20:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63076.log.gz 2023-12-24T20:12:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55888.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55888.log.gz 2023-12-24T20:12:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38016.log 2023-12-24T20:12:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.b.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-24T20:12:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33983.log 2023-12-24T20:12:02.254 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2023-12-24T20:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39562.log.gz 2023-12-24T20:12:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2023-12-24T20:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2023-12-24T20:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38016.log.gz 2023-12-24T20:12:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.33983.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33983.log.gz 2023-12-24T20:12:02.258 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46754.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2023-12-24T20:12:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.34065.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2023-12-24T20:12:02.258 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60586.log 2023-12-24T20:12:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53077.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-24T20:12:02.261 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2023-12-24T20:12:02.261 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2023-12-24T20:12:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51874.log 2023-12-24T20:12:02.263 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60586.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60586.log.gz 2023-12-24T20:12:02.264 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-24T20:12:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2023-12-24T20:12:02.265 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.51874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51874.log.gz 2023-12-24T20:12:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-24T20:12:02.265 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2023-12-24T20:12:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2023-12-24T20:12:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51914.log 2023-12-24T20:12:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41980.log: /var/log/ceph/ceph-client.admin.39891.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2023-12-24T20:12:02.269 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2023-12-24T20:12:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2023-12-24T20:12:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57304.log 2023-12-24T20:12:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44253.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2023-12-24T20:12:02.272 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51914.log.gz 2023-12-24T20:12:02.273 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2023-12-24T20:12:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2023-12-24T20:12:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65204.log 2023-12-24T20:12:02.276 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57304.log.gz 2023-12-24T20:12:02.277 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2023-12-24T20:12:02.277 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2023-12-24T20:12:02.278 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39305.log 2023-12-24T20:12:02.278 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65204.log.gz 2023-12-24T20:12:02.279 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52666.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2023-12-24T20:12:02.280 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2023-12-24T20:12:02.280 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.33929.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2023-12-24T20:12:02.281 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.39546.log 2023-12-24T20:12:02.281 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39305.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39305.log.gz 2023-12-24T20:12:02.282 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2023-12-24T20:12:02.283 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55768.log 2023-12-24T20:12:02.284 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2023-12-24T20:12:02.285 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41678.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2023-12-24T20:12:02.285 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54495.log 2023-12-24T20:12:02.287 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.55768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55768.log.gz 2023-12-24T20:12:02.287 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59827.log 2023-12-24T20:12:02.287 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.3.39546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.39546.log.gz 2023-12-24T20:12:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2023-12-24T20:12:02.288 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2023-12-24T20:12:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-24T20:12:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47699.log 2023-12-24T20:12:02.290 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59827.log.gz 2023-12-24T20:12:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2023-12-24T20:12:02.291 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz 2023-12-24T20:12:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2023-12-24T20:12:02.292 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2023-12-24T20:12:02.293 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39092.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2023-12-24T20:12:02.294 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61201.log 2023-12-24T20:12:02.294 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2023-12-24T20:12:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45926.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2023-12-24T20:12:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38388.log 2023-12-24T20:12:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2023-12-24T20:12:02.297 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61201.log.gz 2023-12-24T20:12:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55122.log 2023-12-24T20:12:02.298 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38388.log.gz 2023-12-24T20:12:02.299 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47998.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2023-12-24T20:12:02.300 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47944.log 2023-12-24T20:12:02.300 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.34037.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2023-12-24T20:12:02.301 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2023-12-24T20:12:02.301 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55122.log.gz 2023-12-24T20:12:02.301 INFO:teuthology.orchestra.run.smithi082.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-24T20:12:02.302 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47944.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47944.log.gz 2023-12-24T20:12:02.303 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2023-12-24T20:12:02.304 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40053.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2023-12-24T20:12:02.304 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63439.log 2023-12-24T20:12:02.305 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2023-12-24T20:12:02.305 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2023-12-24T20:12:02.306 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63439.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63439.log.gz 2023-12-24T20:12:02.307 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43310.log 2023-12-24T20:12:02.308 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41787.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2023-12-24T20:12:02.309 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61969.log 2023-12-24T20:12:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63260.log 2023-12-24T20:12:02.311 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43310.log.gz 2023-12-24T20:12:02.312 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58860.log 2023-12-24T20:12:02.312 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61969.log.gz 2023-12-24T20:12:02.313 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63260.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63260.log.gz 2023-12-24T20:12:02.314 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2023-12-24T20:12:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61942.log 2023-12-24T20:12:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58860.log.gz 2023-12-24T20:12:02.316 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2023-12-24T20:12:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58680.log 2023-12-24T20:12:02.318 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61942.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61942.log.gzgzip 2023-12-24T20:12:02.318 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.57774.log 2023-12-24T20:12:02.320 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53343.log 88.7% 2023-12-24T20:12:02.320 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58680.log.gz 2023-12-24T20:12:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57774.log.gz 2023-12-24T20:12:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40726.log 2023-12-24T20:12:02.322 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41814.log 2023-12-24T20:12:02.322 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53343.log.gz 2023-12-24T20:12:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52883.log 2023-12-24T20:12:02.324 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40726.log.gz 2023-12-24T20:12:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41814.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41814.log.gz 2023-12-24T20:12:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50641.log 2023-12-24T20:12:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52883.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52883.log.gz 2023-12-24T20:12:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58268.log 2023-12-24T20:12:02.328 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50641.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50641.log.gz 2023-12-24T20:12:02.328 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2023-12-24T20:12:02.330 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41307.log 2023-12-24T20:12:02.330 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47295.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58268.log.gz 2023-12-24T20:12:02.331 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2023-12-24T20:12:02.331 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60209.log 2023-12-24T20:12:02.332 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2023-12-24T20:12:02.332 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41307.log.gz 2023-12-24T20:12:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60209.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60209.log.gz 2023-12-24T20:12:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46051.log 2023-12-24T20:12:02.335 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39094.log 2023-12-24T20:12:02.335 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2023-12-24T20:12:02.335 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.46051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46051.log.gz 2023-12-24T20:12:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65767.log 2023-12-24T20:12:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64781.log 2023-12-24T20:12:02.338 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39094.log.gz 2023-12-24T20:12:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65767.log.gz 2023-12-24T20:12:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-24T20:12:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64781.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64781.log.gz 2023-12-24T20:12:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2023-12-24T20:12:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2023-12-24T20:12:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44067.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2023-12-24T20:12:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49206.log 2023-12-24T20:12:02.345 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61111.log 2023-12-24T20:12:02.346 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2023-12-24T20:12:02.346 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2023-12-24T20:12:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41334.log 2023-12-24T20:12:02.348 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55920.log 2023-12-24T20:12:02.348 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2023-12-24T20:12:02.350 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43036.log 2023-12-24T20:12:02.350 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41334.log.gz 2023-12-24T20:12:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60043.log 2023-12-24T20:12:02.351 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55920.log.gz 2023-12-24T20:12:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2023-12-24T20:12:02.353 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43036.log.gz 2023-12-24T20:12:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2023-12-24T20:12:02.355 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38249.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60043.log.gz 2023-12-24T20:12:02.356 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2023-12-24T20:12:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2023-12-24T20:12:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59362.log 2023-12-24T20:12:02.357 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2023-12-24T20:12:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66305.log 2023-12-24T20:12:02.359 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2023-12-24T20:12:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59362.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59362.log.gz 2023-12-24T20:12:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61291.log 2023-12-24T20:12:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66305.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66305.log.gz 2023-12-24T20:12:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50251.log 2023-12-24T20:12:02.362 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-24T20:12:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2023-12-24T20:12:02.363 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61291.log.gz 2023-12-24T20:12:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2023-12-24T20:12:02.364 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50251.log.gz 2023-12-24T20:12:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39972.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2023-12-24T20:12:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33775.log 2023-12-24T20:12:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.40444.log 2023-12-24T20:12:02.367 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2023-12-24T20:12:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33775.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.33775.log.gz 2023-12-24T20:12:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2023-12-24T20:12:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.2.40444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.40444.log.gz 2023-12-24T20:12:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40537.log 2023-12-24T20:12:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64236.log 2023-12-24T20:12:02.371 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2023-12-24T20:12:02.372 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39304.log 2023-12-24T20:12:02.372 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40537.log.gz 2023-12-24T20:12:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64236.log.gz 2023-12-24T20:12:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2023-12-24T20:12:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60016.log 2023-12-24T20:12:02.375 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39304.log.gz 2023-12-24T20:12:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52022.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2023-12-24T20:12:02.377 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38442.log 2023-12-24T20:12:02.378 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55149.log 2023-12-24T20:12:02.378 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60016.log.gz 2023-12-24T20:12:02.380 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38442.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38442.log.gz 2023-12-24T20:12:02.380 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53868.log 2023-12-24T20:12:02.381 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2023-12-24T20:12:02.381 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55149.log.gz 2023-12-24T20:12:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53868.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53868.log.gz 2023-12-24T20:12:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55533.log 2023-12-24T20:12:02.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39027.log 2023-12-24T20:12:02.383 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2023-12-24T20:12:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54289.log 2023-12-24T20:12:02.385 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55533.log.gz 2023-12-24T20:12:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39027.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39027.log.gz 2023-12-24T20:12:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61998.log 2023-12-24T20:12:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54289.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-mds.a.log 2023-12-24T20:12:02.387 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54289.log.gz 2023-12-24T20:12:02.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61998.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61998.log.gz 2023-12-24T20:12:02.389 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48233.log 2023-12-24T20:12:02.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44306.log 2023-12-24T20:12:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.48233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48233.log.gz 2023-12-24T20:12:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51356.log 2023-12-24T20:12:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44306.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44306.log.gz 2023-12-24T20:12:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63171.log 2023-12-24T20:12:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2023-12-24T20:12:02.396 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51356.log.gz 2023-12-24T20:12:02.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63171.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63171.log.gz 2023-12-24T20:12:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2023-12-24T20:12:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 /var/log/ceph/ceph-client.admin.50790.log: --verbose -- /var/log/ceph/ceph-client.admin.39918.log 2023-12-24T20:12:02.399 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2023-12-24T20:12:02.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52206.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2023-12-24T20:12:02.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39321.log 2023-12-24T20:12:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56848.log 2023-12-24T20:12:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39918.log: /var/log/ceph/ceph-client.admin.39321.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39918.log.gz 2023-12-24T20:12:02.402 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39321.log.gz 2023-12-24T20:12:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52937.log 2023-12-24T20:12:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58741.log 2023-12-24T20:12:02.404 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56848.log.gz 2023-12-24T20:12:02.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52937.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52937.log.gz 2023-12-24T20:12:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61594.log 2023-12-24T20:12:02.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58321.log 2023-12-24T20:12:02.406 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58741.log.gz 2023-12-24T20:12:02.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61594.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61594.log.gz 2023-12-24T20:12:02.408 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58021.log 2023-12-24T20:12:02.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53542.log 2023-12-24T20:12:02.409 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58321.log.gz 2023-12-24T20:12:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58021.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58021.log.gz 2023-12-24T20:12:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61142.log 2023-12-24T20:12:02.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65927.log 2023-12-24T20:12:02.412 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53542.log.gz 2023-12-24T20:12:02.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61142.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61142.log.gz 2023-12-24T20:12:02.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2023-12-24T20:12:02.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66416.log 2023-12-24T20:12:02.415 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65927.log.gz 2023-12-24T20:12:02.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50582.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2023-12-24T20:12:02.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63881.log 2023-12-24T20:12:02.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66416.log.gz 2023-12-24T20:12:02.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56525.log 2023-12-24T20:12:02.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37982.log 2023-12-24T20:12:02.419 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63881.log.gz 2023-12-24T20:12:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56525.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56525.log.gz 2023-12-24T20:12:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52423.log 2023-12-24T20:12:02.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37982.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37982.log.gz 2023-12-24T20:12:02.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38218.log 2023-12-24T20:12:02.423 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61321.log 2023-12-24T20:12:02.423 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52423.log.gz 2023-12-24T20:12:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38218.log.gz 2023-12-24T20:12:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39320.log 2023-12-24T20:12:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61321.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61321.log.gz 2023-12-24T20:12:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2023-12-24T20:12:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39320.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-24T20:12:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40834.log 2023-12-24T20:12:02.428 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39320.log.gz 2023-12-24T20:12:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60901.log 2023-12-24T20:12:02.429 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2023-12-24T20:12:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40834.log.gz 2023-12-24T20:12:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65846.log 2023-12-24T20:12:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60901.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60901.log.gz 2023-12-24T20:12:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64147.log 2023-12-24T20:12:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65846.log: gzip -5 --verbose 88.0%-- -- replaced with /var/log/ceph/ceph-client.admin.65846.log.gz/var/log/ceph/ceph-client.admin.53815.log 2023-12-24T20:12:02.433 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2023-12-24T20:12:02.434 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64147.log.gz 2023-12-24T20:12:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53815.log.gz 2023-12-24T20:12:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2023-12-24T20:12:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53900.log 2023-12-24T20:12:02.437 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2023-12-24T20:12:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42061.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2023-12-24T20:12:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51722.log 2023-12-24T20:12:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53900.log.gz 2023-12-24T20:12:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45872.log 2023-12-24T20:12:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65954.log 2023-12-24T20:12:02.441 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51722.log.gz 2023-12-24T20:12:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45872.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45872.log.gz 2023-12-24T20:12:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40969.log 2023-12-24T20:12:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65954.log.gz 2023-12-24T20:12:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2023-12-24T20:12:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57025.log 2023-12-24T20:12:02.445 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40969.log.gz 2023-12-24T20:12:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45265.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2023-12-24T20:12:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38137.log 2023-12-24T20:12:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39000.log 2023-12-24T20:12:02.448 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57025.log.gz 2023-12-24T20:12:02.449 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38137.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38137.log.gz 2023-12-24T20:12:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42250.log 2023-12-24T20:12:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39000.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39000.log.gz 2023-12-24T20:12:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45791.log 2023-12-24T20:12:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log 2023-12-24T20:12:02.453 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42250.log.gz 2023-12-24T20:12:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49352.log 2023-12-24T20:12:02.455 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45791.log.gz 2023-12-24T20:12:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41077.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41077.log.gz 2023-12-24T20:12:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2023-12-24T20:12:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55560.log 2023-12-24T20:12:02.457 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49352.log.gz 2023-12-24T20:12:02.459 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2023-12-24T20:12:02.459 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2023-12-24T20:12:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55560.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55560.log.gz 2023-12-24T20:12:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54996.log 2023-12-24T20:12:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54226.log 2023-12-24T20:12:02.462 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2023-12-24T20:12:02.463 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54996.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54996.log.gz 2023-12-24T20:12:02.463 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57385.log 2023-12-24T20:12:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59717.log 2023-12-24T20:12:02.465 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54226.log.gz 2023-12-24T20:12:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57385.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57385.log.gz 2023-12-24T20:12:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2023-12-24T20:12:02.467 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55204.log 2023-12-24T20:12:02.467 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59717.log.gz 2023-12-24T20:12:02.468 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51117.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2023-12-24T20:12:02.468 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49558.log 2023-12-24T20:12:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65023.log 2023-12-24T20:12:02.470 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55204.log.gz 2023-12-24T20:12:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49558.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49558.log.gz 2023-12-24T20:12:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54910.log 2023-12-24T20:12:02.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62906.log 2023-12-24T20:12:02.472 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65023.log.gz 2023-12-24T20:12:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54910.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54910.log.gz 2023-12-24T20:12:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51668.log 2023-12-24T20:12:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62906.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62906.log.gz 2023-12-24T20:12:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59462.log 2023-12-24T20:12:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51668.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51668.log.gz 2023-12-24T20:12:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2023-12-24T20:12:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59462.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59462.log.gz 2023-12-24T20:12:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47782.log 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47836.log 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47782.log.gz 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44200.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2023-12-24T20:12:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62364.log 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47836.log.gz 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62364.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62364.log.gz 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42142.log 2023-12-24T20:12:02.485 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2023-12-24T20:12:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2023-12-24T20:12:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2023-12-24T20:12:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42142.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42142.log.gz 2023-12-24T20:12:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64508.log 2023-12-24T20:12:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52991.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2023-12-24T20:12:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-24T20:12:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49921.log 2023-12-24T20:12:02.490 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64508.log.gz 2023-12-24T20:12:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58562.log 2023-12-24T20:12:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49921.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49921.log.gz 2023-12-24T20:12:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2023-12-24T20:12:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61081.log 2023-12-24T20:12:02.494 INFO:teuthology.orchestra.run.smithi050.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.58562.log.gz 2023-12-24T20:12:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49732.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2023-12-24T20:12:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2023-12-24T20:12:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61081.log.gz 2023-12-24T20:12:02.497 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2023-12-24T20:12:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58241.log 2023-12-24T20:12:02.499 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2023-12-24T20:12:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55425.log 2023-12-24T20:12:02.500 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2023-12-24T20:12:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58241.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58241.log.gz 2023-12-24T20:12:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2023-12-24T20:12:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2023-12-24T20:12:02.503 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55425.log.gz 2023-12-24T20:12:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65819.log 2023-12-24T20:12:02.504 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2023-12-24T20:12:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41226.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2023-12-24T20:12:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54829.log 2023-12-24T20:12:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2023-12-24T20:12:02.507 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65819.log.gz 2023-12-24T20:12:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54829.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54829.log.gz 2023-12-24T20:12:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2023-12-24T20:12:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51695.log 2023-12-24T20:12:02.511 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2023-12-24T20:12:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53748.log 2023-12-24T20:12:02.512 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2023-12-24T20:12:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38725.log 2023-12-24T20:12:02.513 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51695.log.gz 2023-12-24T20:12:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.53748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53748.log.gz 2023-12-24T20:12:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2023-12-24T20:12:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2023-12-24T20:12:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2023-12-24T20:12:02.518 INFO:teuthology.orchestra.run.smithi050.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.38725.log.gz 2023-12-24T20:12:02.519 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2023-12-24T20:12:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38919.log 2023-12-24T20:12:02.520 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2023-12-24T20:12:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47561.log 2023-12-24T20:12:02.521 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2023-12-24T20:12:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38919.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38919.log.gz 2023-12-24T20:12:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61540.log 2023-12-24T20:12:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45646.log 2023-12-24T20:12:02.524 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47561.log.gz 2023-12-24T20:12:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61540.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61540.log.gz 2023-12-24T20:12:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39109.log 2023-12-24T20:12:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56935.log 2023-12-24T20:12:02.527 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45646.log.gz 2023-12-24T20:12:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38601.log 2023-12-24T20:12:02.529 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39109.log.gz 2023-12-24T20:12:02.530 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62543.log 2023-12-24T20:12:02.530 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56935.log.gz 2023-12-24T20:12:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38601.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28925.log 2023-12-24T20:12:02.532 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2023-12-24T20:12:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.62543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62543.log.gz 2023-12-24T20:12:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65981.log 2023-12-24T20:12:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.28925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2023-12-24T20:12:02.535 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28925.log.gz 2023-12-24T20:12:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65981.log.gz 2023-12-24T20:12:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59139.log 2023-12-24T20:12:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51063.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz 2023-12-24T20:12:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52607.log 2023-12-24T20:12:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66143.log 2023-12-24T20:12:02.539 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59139.log.gz 2023-12-24T20:12:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52607.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.52607.log.gz--verbose 2023-12-24T20:12:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.45413.log 2023-12-24T20:12:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2023-12-24T20:12:02.542 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66143.log.gz 2023-12-24T20:12:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45413.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2023-12-24T20:12:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61794.log 2023-12-24T20:12:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63739.log 2023-12-24T20:12:02.546 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2023-12-24T20:12:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51203.log 2023-12-24T20:12:02.547 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61794.log.gz 2023-12-24T20:12:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63739.log.gz 2023-12-24T20:12:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2023-12-24T20:12:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58153.log 2023-12-24T20:12:02.549 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51203.log.gz 2023-12-24T20:12:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2023-12-24T20:12:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63290.log 2023-12-24T20:12:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54193.log 2023-12-24T20:12:02.553 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58153.log.gz 2023-12-24T20:12:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63290.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63290.log.gz 2023-12-24T20:12:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39104.log 2023-12-24T20:12:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2023-12-24T20:12:02.555 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54193.log.gz 2023-12-24T20:12:02.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2023-12-24T20:12:02.557 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39104.log.gz 2023-12-24T20:12:02.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49260.log 2023-12-24T20:12:02.559 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2023-12-24T20:12:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39702.log 88.5% 2023-12-24T20:12:02.560 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz 2023-12-24T20:12:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2023-12-24T20:12:02.561 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49260.log.gz 2023-12-24T20:12:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39702.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39702.log.gz 2023-12-24T20:12:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2023-12-24T20:12:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53488.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2023-12-24T20:12:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62089.log 2023-12-24T20:12:02.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2023-12-24T20:12:02.566 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2023-12-24T20:12:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48838.log 2023-12-24T20:12:02.567 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62089.log.gz 2023-12-24T20:12:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47615.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2023-12-24T20:12:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58353.log 2023-12-24T20:12:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58200.log 2023-12-24T20:12:02.570 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48838.log.gz 2023-12-24T20:12:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58353.log.gz 2023-12-24T20:12:02.572 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45380.log 2023-12-24T20:12:02.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.58200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58200.log.gz 2023-12-24T20:12:02.573 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40510.log 2023-12-24T20:12:02.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45380.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45380.log.gz 2023-12-24T20:12:02.575 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61913.log 2023-12-24T20:12:02.576 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59543.log 2023-12-24T20:12:02.576 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40510.log.gz 2023-12-24T20:12:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61913.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61913.log.gz 2023-12-24T20:12:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64701.log 2023-12-24T20:12:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50114.log 2023-12-24T20:12:02.579 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59543.log.gz 2023-12-24T20:12:02.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64701.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64701.log.gz 2023-12-24T20:12:02.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40672.log 2023-12-24T20:12:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65144.log 2023-12-24T20:12:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50114.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50114.log.gz 2023-12-24T20:12:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40672.log.gz 2023-12-24T20:12:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55670.log 2023-12-24T20:12:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62027.log 2023-12-24T20:12:02.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65144.log.gz 2023-12-24T20:12:02.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43775.log 2023-12-24T20:12:02.586 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55670.log.gz 2023-12-24T20:12:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62027.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62027.log.gz 2023-12-24T20:12:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2023-12-24T20:12:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43775.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43775.log.gz 2023-12-24T20:12:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45294.log 2023-12-24T20:12:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59489.log 2023-12-24T20:12:02.590 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2023-12-24T20:12:02.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45294.log.gz 2023-12-24T20:12:02.591 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40136.log 2023-12-24T20:12:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41172.log 2023-12-24T20:12:02.593 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59489.log.gz 2023-12-24T20:12:02.593 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40136.log.gz 2023-12-24T20:12:02.594 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48568.log 2023-12-24T20:12:02.595 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64062.log 2023-12-24T20:12:02.596 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41172.log.gz 2023-12-24T20:12:02.596 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48568.log.gz 2023-12-24T20:12:02.596 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64481.log 2023-12-24T20:12:02.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57358.log 2023-12-24T20:12:02.598 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64062.log.gz 2023-12-24T20:12:02.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64481.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64481.log.gz 2023-12-24T20:12:02.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55616.log 2023-12-24T20:12:02.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64813.log 2023-12-24T20:12:02.601 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57358.log.gz 2023-12-24T20:12:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55616.log.gz 2023-12-24T20:12:02.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2023-12-24T20:12:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61260.log 2023-12-24T20:12:02.603 INFO:teuthology.orchestra.run.smithi050.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64813.log.gz 2023-12-24T20:12:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41145.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2023-12-24T20:12:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39106.log 2023-12-24T20:12:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39107.log 2023-12-24T20:12:02.606 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61260.log.gz 2023-12-24T20:12:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39106.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39106.log.gz 2023-12-24T20:12:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63409.log 2023-12-24T20:12:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2023-12-24T20:12:02.608 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39107.log.gz 2023-12-24T20:12:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63409.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63409.log.gz 2023-12-24T20:12:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52456.log 2023-12-24T20:12:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46782.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2023-12-24T20:12:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38784.log 2023-12-24T20:12:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52456.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52456.log.gz 2023-12-24T20:12:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2023-12-24T20:12:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63712.log 2023-12-24T20:12:02.615 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38784.log.gz 2023-12-24T20:12:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2023-12-24T20:12:02.616 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2023-12-24T20:12:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63712.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63712.log.gz 2023-12-24T20:12:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2023-12-24T20:12:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51144.log 2023-12-24T20:12:02.619 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2023-12-24T20:12:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39096.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2023-12-24T20:12:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2023-12-24T20:12:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2023-12-24T20:12:02.622 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51144.log.gz 2023-12-24T20:12:02.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64535.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gz 2023-12-24T20:12:02.623 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-24T20:12:02.624 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53788.log 2023-12-24T20:12:02.624 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2023-12-24T20:12:02.625 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62584.log 2023-12-24T20:12:02.627 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51614.log 2023-12-24T20:12:02.627 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53788.log.gz 2023-12-24T20:12:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2023-12-24T20:12:02.629 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62584.log.gz 2023-12-24T20:12:02.630 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51614.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-24T20:12:02.630 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40564.log 2023-12-24T20:12:02.630 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51614.log.gz 2023-12-24T20:12:02.631 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39810.log 2023-12-24T20:12:02.632 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2023-12-24T20:12:02.632 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40564.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40564.log.gz 2023-12-24T20:12:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63793.log 2023-12-24T20:12:02.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56906.log 2023-12-24T20:12:02.634 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39810.log.gz 2023-12-24T20:12:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63793.log.gz 2023-12-24T20:12:02.636 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2023-12-24T20:12:02.637 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57830.log 2023-12-24T20:12:02.637 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56906.log.gz 2023-12-24T20:12:02.639 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49587.log 2023-12-24T20:12:02.639 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2023-12-24T20:12:02.640 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57830.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57830.log.gz 2023-12-24T20:12:02.640 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49705.log 2023-12-24T20:12:02.641 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44984.log 2023-12-24T20:12:02.642 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49587.log.gz 2023-12-24T20:12:02.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2023-12-24T20:12:02.643 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49705.log.gz 2023-12-24T20:12:02.644 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44984.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44984.log.gz 2023-12-24T20:12:02.644 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-12-24T20:12:02.645 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2023-12-24T20:12:02.646 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2023-12-24T20:12:02.647 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44147.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-12-24T20:12:02.647 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57884.log 2023-12-24T20:12:02.649 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38415.log 2023-12-24T20:12:02.649 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2023-12-24T20:12:02.651 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2023-12-24T20:12:02.651 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57884.log.gz 2023-12-24T20:12:02.652 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58920.log 2023-12-24T20:12:02.652 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38415.log.gz 2023-12-24T20:12:02.653 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44687.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz 2023-12-24T20:12:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2023-12-24T20:12:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58920.log: gzip 87.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.58920.log.gz--verbose 2023-12-24T20:12:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.58535.log 2023-12-24T20:12:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2023-12-24T20:12:02.657 INFO:teuthology.orchestra.run.smithi050.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2023-12-24T20:12:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41280.log 2023-12-24T20:12:02.659 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58535.log.gz 2023-12-24T20:12:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42034.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2023-12-24T20:12:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61729.log 2023-12-24T20:12:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59854.log 2023-12-24T20:12:02.662 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41280.log.gz 2023-12-24T20:12:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61729.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61729.log.gz 2023-12-24T20:12:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59690.log 2023-12-24T20:12:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66197.log 2023-12-24T20:12:02.665 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59854.log.gz 2023-12-24T20:12:02.666 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59690.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59690.log.gz 2023-12-24T20:12:02.666 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2023-12-24T20:12:02.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2023-12-24T20:12:02.668 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66197.log.gz 2023-12-24T20:12:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42088.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2023-12-24T20:12:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51036.log 2023-12-24T20:12:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47670.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2023-12-24T20:12:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59249.log 2023-12-24T20:12:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2023-12-24T20:12:02.672 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51036.log.gz 2023-12-24T20:12:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2023-12-24T20:12:02.674 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59249.log.gz 2023-12-24T20:12:02.675 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63199.log 2023-12-24T20:12:02.675 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2023-12-24T20:12:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33906.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2023-12-24T20:12:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62173.log 2023-12-24T20:12:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52249.log 2023-12-24T20:12:02.678 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63199.log.gz 2023-12-24T20:12:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2023-12-24T20:12:02.680 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62173.log.gz 2023-12-24T20:12:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52249.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52249.log.gz 2023-12-24T20:12:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55317.log 2023-12-24T20:12:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56666.log 2023-12-24T20:12:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55317.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2023-12-24T20:12:02.683 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55317.log.gz 2023-12-24T20:12:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42610.log 2023-12-24T20:12:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56666.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56666.log.gz 2023-12-24T20:12:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2023-12-24T20:12:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57544.log 2023-12-24T20:12:02.687 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42610.log.gz 2023-12-24T20:12:02.688 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51440.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2023-12-24T20:12:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39108.log 2023-12-24T20:12:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2023-12-24T20:12:02.690 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57544.log.gz 2023-12-24T20:12:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39108.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39108.log.gz 2023-12-24T20:12:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61886.log 2023-12-24T20:12:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2023-12-24T20:12:02.693 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2023-12-24T20:12:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61886.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.61886.log.gz 2023-12-24T20:12:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.56996.log 2023-12-24T20:12:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66278.log 2023-12-24T20:12:02.697 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz 2023-12-24T20:12:02.698 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56996.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56996.log.gz 2023-12-24T20:12:02.698 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40080.log 2023-12-24T20:12:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56817.log 2023-12-24T20:12:02.699 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66278.log.gz 2023-12-24T20:12:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40080.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2023-12-24T20:12:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2023-12-24T20:12:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57450.log 2023-12-24T20:12:02.703 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56817.log.gz 2023-12-24T20:12:02.704 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2023-12-24T20:12:02.704 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2023-12-24T20:12:02.706 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62308.log 2023-12-24T20:12:02.706 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57450.log.gz 2023-12-24T20:12:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 2023-12-24T20:12:02.708 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2023-12-24T20:12:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2023-12-24T20:12:02.710 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62308.log.gz 2023-12-24T20:12:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57965.log 2023-12-24T20:12:02.711 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2023-12-24T20:12:02.712 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44572.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2023-12-24T20:12:02.712 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2023-12-24T20:12:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56966.log 2023-12-24T20:12:02.714 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57965.log.gz 2023-12-24T20:12:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40591.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2023-12-24T20:12:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66062.log 2023-12-24T20:12:02.716 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56966.log: gzip -5 --verbose 88.0%-- /var/log/ceph/ceph-client.admin.39314.log -- replaced with /var/log/ceph/ceph-client.admin.56966.log.gz 2023-12-24T20:12:02.717 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:02.718 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63847.log 2023-12-24T20:12:02.718 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66062.log.gz 2023-12-24T20:12:02.720 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2023-12-24T20:12:02.720 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39314.log.gz 2023-12-24T20:12:02.721 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2023-12-24T20:12:02.722 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63847.log.gz 2023-12-24T20:12:02.723 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2023-12-24T20:12:02.723 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58214.log 2023-12-24T20:12:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51236.log 2023-12-24T20:12:02.725 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2023-12-24T20:12:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58214.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58214.log.gz 2023-12-24T20:12:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2023-12-24T20:12:02.727 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54775.log 2023-12-24T20:12:02.728 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51236.log.gz 2023-12-24T20:12:02.729 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42331.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2023-12-24T20:12:02.729 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55344.log 2023-12-24T20:12:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54775.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54775.log.gz 2023-12-24T20:12:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40645.log 2023-12-24T20:12:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66251.log 2023-12-24T20:12:02.732 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55344.log.gz 2023-12-24T20:12:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64292.log 2023-12-24T20:12:02.734 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40645.log.gz 2023-12-24T20:12:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66251.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66251.log.gz 2023-12-24T20:12:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40915.log 2023-12-24T20:12:02.736 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54466.log 2023-12-24T20:12:02.737 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64292.log.gz 2023-12-24T20:12:02.738 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40915.log.gz 2023-12-24T20:12:02.738 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2023-12-24T20:12:02.740 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62557.log 2023-12-24T20:12:02.740 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54466.log.gz 2023-12-24T20:12:02.741 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40861.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2023-12-24T20:12:02.741 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63468.log 2023-12-24T20:12:02.742 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38838.log 2023-12-24T20:12:02.743 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62557.log.gz 2023-12-24T20:12:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63468.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63468.log.gz 2023-12-24T20:12:02.744 INFO:teuthology.orchestra.run.smithi050.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-24T20:12:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2023-12-24T20:12:02.745 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38838.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38838.log.gz 2023-12-24T20:12:02.746 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2023-12-24T20:12:02.747 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42496.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2023-12-24T20:12:02.747 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64034.log 2023-12-24T20:12:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38946.log 2023-12-24T20:12:02.749 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2023-12-24T20:12:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64034.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64034.log.gz 2023-12-24T20:12:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57277.log 2023-12-24T20:12:02.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2023-12-24T20:12:02.751 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38946.log.gz 2023-12-24T20:12:02.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57277.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57277.log.gz 2023-12-24T20:12:02.752 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2023-12-24T20:12:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51504.log 2023-12-24T20:12:02.753 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2023-12-24T20:12:02.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38191.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gz 2023-12-24T20:12:02.754 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39316.log 2023-12-24T20:12:02.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51504.log.gz 2023-12-24T20:12:02.756 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41023.log 2023-12-24T20:12:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54085.log 2023-12-24T20:12:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39316.log: /var/log/ceph/ceph-client.admin.41023.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39316.log.gz 2023-12-24T20:12:02.759 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41023.log.gz 2023-12-24T20:12:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58075.log 2023-12-24T20:12:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63378.log 2023-12-24T20:12:02.760 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54085.log.gz 2023-12-24T20:12:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58075.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58075.log.gz 2023-12-24T20:12:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2023-12-24T20:12:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63378.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63378.log.gz 2023-12-24T20:12:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2023-12-24T20:12:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61702.log 2023-12-24T20:12:02.764 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2023-12-24T20:12:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46091.log 2023-12-24T20:12:02.766 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2023-12-24T20:12:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61702.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61702.log.gz 2023-12-24T20:12:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53231.log 2023-12-24T20:12:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49948.log 2023-12-24T20:12:02.768 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46091.log.gz 2023-12-24T20:12:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53231.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53231.log.gz 2023-12-24T20:12:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2023-12-24T20:12:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39945.log 2023-12-24T20:12:02.771 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49948.log.gz 2023-12-24T20:12:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46386.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2023-12-24T20:12:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2023-12-24T20:12:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53461.log 2023-12-24T20:12:02.774 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39945.log.gz 2023-12-24T20:12:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44715.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2023-12-24T20:12:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2023-12-24T20:12:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53461.log: gzip 88.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.53461.log.gz--verbose 2023-12-24T20:12:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.41199.log 2023-12-24T20:12:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2023-12-24T20:12:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54347.log: /var/log/ceph/ceph-client.admin.41199.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2023-12-24T20:12:02.779 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2023-12-24T20:12:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2023-12-24T20:12:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2023-12-24T20:12:02.781 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2023-12-24T20:12:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2023-12-24T20:12:02.782 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2023-12-24T20:12:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2023-12-24T20:12:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2023-12-24T20:12:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2023-12-24T20:12:02.785 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2023-12-24T20:12:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42169.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2023-12-24T20:12:02.787 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57747.log 2023-12-24T20:12:02.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59989.log 2023-12-24T20:12:02.788 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2023-12-24T20:12:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57747.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57747.log.gz 2023-12-24T20:12:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41953.log 2023-12-24T20:12:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2023-12-24T20:12:02.791 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59989.log.gz 2023-12-24T20:12:02.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41953.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41953.log.gz 2023-12-24T20:12:02.792 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64346.log 2023-12-24T20:12:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38332.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz-- 2023-12-24T20:12:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46932.log 2023-12-24T20:12:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54408.log 2023-12-24T20:12:02.795 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64346.log.gz 2023-12-24T20:12:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2023-12-24T20:12:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57803.log 2023-12-24T20:12:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54408.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.54408.log.gz--verbose 2023-12-24T20:12:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.38973.log 2023-12-24T20:12:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57720.log 2023-12-24T20:12:02.799 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57803.log.gz 2023-12-24T20:12:02.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52637.log 2023-12-24T20:12:02.800 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38973.log.gz 2023-12-24T20:12:02.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57720.log.gz 2023-12-24T20:12:02.802 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2023-12-24T20:12:02.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60094.log 2023-12-24T20:12:02.803 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52637.log.gz 2023-12-24T20:12:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49098.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2023-12-24T20:12:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43006.log 2023-12-24T20:12:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57417.log 2023-12-24T20:12:02.805 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60094.log.gz 2023-12-24T20:12:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43006.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43006.log.gz 2023-12-24T20:12:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49152.log 2023-12-24T20:12:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57417.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57417.log.gz 2023-12-24T20:12:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43893.log 2023-12-24T20:12:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49152.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49152.log.gz 2023-12-24T20:12:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61859.log 2023-12-24T20:12:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58890.log 2023-12-24T20:12:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43893.log: /var/log/ceph/ceph-client.admin.61859.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61859.log.gz 2023-12-24T20:12:02.811 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43893.log.gz 2023-12-24T20:12:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39999.log 2023-12-24T20:12:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58890.log.gz 2023-12-24T20:12:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40780.log 2023-12-24T20:12:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39999.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39999.log.gz 2023-12-24T20:12:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2023-12-24T20:12:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41868.log 2023-12-24T20:12:02.816 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40780.log.gz 2023-12-24T20:12:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42944.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2023-12-24T20:12:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63766.log 2023-12-24T20:12:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2023-12-24T20:12:02.819 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41868.log.gz 2023-12-24T20:12:02.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63766.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63766.log.gz 2023-12-24T20:12:02.820 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2023-12-24T20:12:02.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53378.log 2023-12-24T20:12:02.821 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2023-12-24T20:12:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz 2023-12-24T20:12:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57625.log 2023-12-24T20:12:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2023-12-24T20:12:02.824 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53378.log.gz 2023-12-24T20:12:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57625.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57625.log.gz 2023-12-24T20:12:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62695.log 2023-12-24T20:12:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56498.log 2023-12-24T20:12:02.826 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2023-12-24T20:12:02.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62695.log: gzip -5 --verbose 89.6%-- -- replaced with /var/log/ceph/ceph-client.admin.62695.log.gz/var/log/ceph/ceph-client.admin.45348.log 2023-12-24T20:12:02.827 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:02.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56498.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56498.log.gz 2023-12-24T20:12:02.828 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40699.log 2023-12-24T20:12:02.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45348.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45348.log.gz 2023-12-24T20:12:02.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-24T20:12:02.830 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40699.log.gz 2023-12-24T20:12:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49233.log 2023-12-24T20:12:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44925.log 2023-12-24T20:12:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49233.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49233.log.gz 2023-12-24T20:12:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49125.log 2023-12-24T20:12:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64995.log 2023-12-24T20:12:02.835 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44925.log.gz 2023-12-24T20:12:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49125.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49125.log.gz 2023-12-24T20:12:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65081.log 2023-12-24T20:12:02.839 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58830.log 2023-12-24T20:12:02.839 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64995.log.gz 2023-12-24T20:12:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65081.log.gz 2023-12-24T20:12:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62878.log 2023-12-24T20:12:02.842 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2023-12-24T20:12:02.842 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58830.log.gz 2023-12-24T20:12:02.844 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2023-12-24T20:12:02.844 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62878.log.gz 2023-12-24T20:12:02.845 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46064.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2023-12-24T20:12:02.846 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2023-12-24T20:12:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2023-12-24T20:12:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45735.log: /var/log/ceph/ceph-client.admin.47863.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2023-12-24T20:12:02.848 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2023-12-24T20:12:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61648.log 2023-12-24T20:12:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43864.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2023-12-24T20:12:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2023-12-24T20:12:02.851 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62335.log 2023-12-24T20:12:02.852 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61648.log.gz 2023-12-24T20:12:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48749.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2023-12-24T20:12:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58949.log 2023-12-24T20:12:02.855 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62335.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62335.log.gz 2023-12-24T20:12:02.855 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41706.log 2023-12-24T20:12:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58949.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58949.log.gz 2023-12-24T20:12:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62496.log 2023-12-24T20:12:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62200.log 2023-12-24T20:12:02.858 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41706.log.gz 2023-12-24T20:12:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62496.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62496.log.gz 2023-12-24T20:12:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-12-24T20:12:02.861 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2023-12-24T20:12:02.861 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62200.log.gz 2023-12-24T20:12:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44465.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-12-24T20:12:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59330.log 2023-12-24T20:12:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65323.log 2023-12-24T20:12:02.864 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2023-12-24T20:12:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59330.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59330.log.gz 2023-12-24T20:12:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50551.log 2023-12-24T20:12:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65632.log 2023-12-24T20:12:02.867 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65323.log.gz 2023-12-24T20:12:02.869 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43120.log 89.2% 2023-12-24T20:12:02.869 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50551.log.gz 2023-12-24T20:12:02.870 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2023-12-24T20:12:02.870 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65632.log.gz 2023-12-24T20:12:02.871 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43120.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43120.log.gz 2023-12-24T20:12:02.872 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2023-12-24T20:12:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2023-12-24T20:12:02.873 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2023-12-24T20:12:02.874 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2023-12-24T20:12:02.875 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39864.log 2023-12-24T20:12:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47588.log 2023-12-24T20:12:02.876 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2023-12-24T20:12:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39864.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39864.log.gz 2023-12-24T20:12:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55643.log 2023-12-24T20:12:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47588.log.gz 2023-12-24T20:12:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51887.log 2023-12-24T20:12:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55643.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55643.log.gz 2023-12-24T20:12:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54883.log 2023-12-24T20:12:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39513.log 2023-12-24T20:12:02.882 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51887.log.gz 2023-12-24T20:12:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54883.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54883.log.gz 2023-12-24T20:12:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50431.log 2023-12-24T20:12:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39513.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39513.log.gz 2023-12-24T20:12:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64400.log 2023-12-24T20:12:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50431.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.50431.log.gz-5 2023-12-24T20:12:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:--verbose -- /var/log/ceph/ceph-client.admin.55721.log 2023-12-24T20:12:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54377.log 2023-12-24T20:12:02.888 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64400.log.gz 2023-12-24T20:12:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55721.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55721.log.gz 2023-12-24T20:12:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66008.log 2023-12-24T20:12:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63319.log 2023-12-24T20:12:02.891 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54377.log.gz 2023-12-24T20:12:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66008.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66008.log.gz 2023-12-24T20:12:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2023-12-24T20:12:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63319.log: gzip 87.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.63319.log.gz--verbose 2023-12-24T20:12:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.51302.log 2023-12-24T20:12:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44776.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2023-12-24T20:12:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2023-12-24T20:12:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2023-12-24T20:12:02.897 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2023-12-24T20:12:02.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gz 2023-12-24T20:12:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2023-12-24T20:12:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41496.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2023-12-24T20:12:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49319.log 2023-12-24T20:12:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40026.log 2023-12-24T20:12:02.902 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2023-12-24T20:12:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49319.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49319.log.gz 2023-12-24T20:12:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2023-12-24T20:12:02.904 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63109.log 2023-12-24T20:12:02.905 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40026.log.gz 2023-12-24T20:12:02.906 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60478.log 2023-12-24T20:12:02.906 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2023-12-24T20:12:02.908 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2023-12-24T20:12:02.908 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63109.log.gz 2023-12-24T20:12:02.909 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60478.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60478.log.gz 2023-12-24T20:12:02.909 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2023-12-24T20:12:02.910 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66089.log 2023-12-24T20:12:02.911 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2023-12-24T20:12:02.912 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47349.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2023-12-24T20:12:02.912 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60262.log 2023-12-24T20:12:02.914 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66089.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66089.log.gz 2023-12-24T20:12:02.914 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50221.log 2023-12-24T20:12:02.915 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60262.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60262.log.gz 2023-12-24T20:12:02.915 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65265.log 2023-12-24T20:12:02.916 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52856.log 2023-12-24T20:12:02.916 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50221.log.gz 2023-12-24T20:12:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65265.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65265.log.gz 2023-12-24T20:12:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65050.log 2023-12-24T20:12:02.920 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62391.log 2023-12-24T20:12:02.920 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52856.log.gz 2023-12-24T20:12:02.921 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65050.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65050.log.gz 2023-12-24T20:12:02.921 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2023-12-24T20:12:02.922 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49759.log 2023-12-24T20:12:02.923 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62391.log.gz 2023-12-24T20:12:02.924 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49472.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2023-12-24T20:12:02.924 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64373.log 2023-12-24T20:12:02.926 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49759.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49759.log.gz 2023-12-24T20:12:02.926 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2023-12-24T20:12:02.926 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64373.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64373.log.gz 2023-12-24T20:12:02.927 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54316.log 2023-12-24T20:12:02.928 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43922.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2023-12-24T20:12:02.928 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41442.log 2023-12-24T20:12:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2023-12-24T20:12:02.930 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54316.log.gz 2023-12-24T20:12:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50521.log 2023-12-24T20:12:02.931 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41442.log.gz 2023-12-24T20:12:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2023-12-24T20:12:02.933 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2023-12-24T20:12:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50521.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50521.log.gz 2023-12-24T20:12:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49649.log 2023-12-24T20:12:02.936 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43833.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2023-12-24T20:12:02.936 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-12-24T20:12:02.937 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2023-12-24T20:12:02.937 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49649.log.gz 2023-12-24T20:12:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59276.log 2023-12-24T20:12:02.939 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-12-24T20:12:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41415.log 2023-12-24T20:12:02.941 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2023-12-24T20:12:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54556.log 89.4% 2023-12-24T20:12:02.942 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59276.log.gz 2023-12-24T20:12:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63503.log 2023-12-24T20:12:02.943 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41415.log.gz 2023-12-24T20:12:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54556.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54556.log.gz 2023-12-24T20:12:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62664.log 2023-12-24T20:12:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63503.log.gz 2023-12-24T20:12:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57938.log 2023-12-24T20:12:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 2023-12-24T20:12:02.949 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62664.log.gz 2023-12-24T20:12:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2023-12-24T20:12:02.950 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57938.log.gz 2023-12-24T20:12:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57196.log 2023-12-24T20:12:02.952 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2023-12-24T20:12:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61621.log 2023-12-24T20:12:02.953 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2023-12-24T20:12:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57196.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57196.log.gz 2023-12-24T20:12:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60613.log 2023-12-24T20:12:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61621.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61621.log.gz 2023-12-24T20:12:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2023-12-24T20:12:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59222.log 2023-12-24T20:12:02.958 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60613.log.gz 2023-12-24T20:12:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2023-12-24T20:12:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39756.log 2023-12-24T20:12:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38109.log 87.6% 2023-12-24T20:12:02.961 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59222.log.gz 2023-12-24T20:12:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60928.log 2023-12-24T20:12:02.963 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39756.log.gz 2023-12-24T20:12:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65293.log 2023-12-24T20:12:02.965 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz 2023-12-24T20:12:02.966 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2023-12-24T20:12:02.966 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60928.log.gz 2023-12-24T20:12:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65293.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65293.log.gz 2023-12-24T20:12:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66386.log 2023-12-24T20:12:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53596.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2023-12-24T20:12:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62281.log 2023-12-24T20:12:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53314.log 2023-12-24T20:12:02.970 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66386.log.gz 2023-12-24T20:12:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48108.log 2023-12-24T20:12:02.972 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62281.log.gz 2023-12-24T20:12:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2023-12-24T20:12:02.974 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53314.log.gz 2023-12-24T20:12:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48108.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48108.log.gz 2023-12-24T20:12:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.42456.log 2023-12-24T20:12:02.975 INFO:teuthology.orchestra.run.smithi082.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-24T20:12:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65485.log 2023-12-24T20:12:02.976 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2023-12-24T20:12:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.42456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42456.log.gz 2023-12-24T20:12:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42884.log 2023-12-24T20:12:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65485.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65485.log.gz 2023-12-24T20:12:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2023-12-24T20:12:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42884.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42884.log.gz 2023-12-24T20:12:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59773.log 2023-12-24T20:12:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2023-12-24T20:12:02.982 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2023-12-24T20:12:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57331.log 2023-12-24T20:12:02.983 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59773.log.gz 2023-12-24T20:12:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2023-12-24T20:12:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57857.log 2023-12-24T20:12:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62145.log 2023-12-24T20:12:02.986 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57331.log.gz 2023-12-24T20:12:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57857.log.gz 2023-12-24T20:12:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58772.log 2023-12-24T20:12:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39837.log 2023-12-24T20:12:02.989 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62145.log.gz 2023-12-24T20:12:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2023-12-24T20:12:02.990 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58772.log.gz 2023-12-24T20:12:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46202.log 2023-12-24T20:12:02.992 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39837.log.gz 2023-12-24T20:12:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61567.log 2023-12-24T20:12:02.993 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2023-12-24T20:12:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56756.log 2023-12-24T20:12:02.995 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46202.log.gz 2023-12-24T20:12:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61567.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61567.log.gz 2023-12-24T20:12:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50100.log 2023-12-24T20:12:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38164.log 2023-12-24T20:12:02.998 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56756.log.gz 2023-12-24T20:12:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.50100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50100.log.gz 2023-12-24T20:12:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63685.log 2023-12-24T20:12:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48301.log 2023-12-24T20:12:03.001 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38164.log.gz 2023-12-24T20:12:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63685.log: gzip 88.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.63685.log.gz--verbose -- 2023-12-24T20:12:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43176.log 2023-12-24T20:12:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42794.log 2023-12-24T20:12:03.004 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2023-12-24T20:12:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43176.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2023-12-24T20:12:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log 2023-12-24T20:12:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2023-12-24T20:12:03.007 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42794.log.gz 2023-12-24T20:12:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61378.log 2023-12-24T20:12:03.008 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2023-12-24T20:12:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz-5 2023-12-24T20:12:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:--verbose -- /var/log/ceph/ceph-client.admin.40996.log 2023-12-24T20:12:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61378.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.61378.log.gz 2023-12-24T20:12:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2023-12-24T20:12:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39729.log 2023-12-24T20:12:03.013 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2023-12-24T20:12:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54612.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2023-12-24T20:12:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53515.log 2023-12-24T20:12:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2023-12-24T20:12:03.016 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39729.log.gz 2023-12-24T20:12:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66332.log 2023-12-24T20:12:03.018 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53515.log.gz 2023-12-24T20:12:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39560.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz-5 2023-12-24T20:12:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:--verbose -- /var/log/ceph/ceph-client.admin.57517.log 2023-12-24T20:12:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54937.log 2023-12-24T20:12:03.020 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66332.log.gz 2023-12-24T20:12:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57517.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57517.log.gz 2023-12-24T20:12:03.022 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2023-12-24T20:12:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54937.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54937.log.gz 2023-12-24T20:12:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55290.log 2023-12-24T20:12:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53761.log 2023-12-24T20:12:03.025 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2023-12-24T20:12:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55290.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55290.log.gz 2023-12-24T20:12:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2023-12-24T20:12:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65686.log 2023-12-24T20:12:03.028 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53761.log.gz 2023-12-24T20:12:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2023-12-24T20:12:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34031.log 2023-12-24T20:12:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65686.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65686.log.gz 2023-12-24T20:12:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2023-12-24T20:12:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34031.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34031.log.gz 2023-12-24T20:12:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53405.log 2023-12-24T20:12:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2023-12-24T20:12:03.036 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2023-12-24T20:12:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48719.log 2023-12-24T20:12:03.037 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53405.log.gz 2023-12-24T20:12:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46171.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2023-12-24T20:12:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58711.log 2023-12-24T20:12:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48719.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48719.log.gz 2023-12-24T20:12:03.041 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2023-12-24T20:12:03.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58711.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58711.log.gzgzip 2023-12-24T20:12:03.042 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.38811.log 2023-12-24T20:12:03.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48658.log 2023-12-24T20:12:03.044 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2023-12-24T20:12:03.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59570.log 2023-12-24T20:12:03.045 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38811.log.gz 2023-12-24T20:12:03.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63980.log 2023-12-24T20:12:03.047 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48658.log.gz 2023-12-24T20:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59570.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59570.log.gz 2023-12-24T20:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55371.log 2023-12-24T20:12:03.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39054.log 2023-12-24T20:12:03.050 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63980.log.gz 2023-12-24T20:12:03.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55371.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55371.log.gz 2023-12-24T20:12:03.051 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59800.log 2023-12-24T20:12:03.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39054.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39054.log.gz 2023-12-24T20:12:03.053 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52576.log 2023-12-24T20:12:03.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59800.log.gz 2023-12-24T20:12:03.054 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2023-12-24T20:12:03.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52576.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52576.log.gz 2023-12-24T20:12:03.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2023-12-24T20:12:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50834.log 2023-12-24T20:12:03.057 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2023-12-24T20:12:03.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43694.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2023-12-24T20:12:03.058 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2023-12-24T20:12:03.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50834.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50834.log.gz 2023-12-24T20:12:03.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2023-12-24T20:12:03.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44518.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2023-12-24T20:12:03.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2023-12-24T20:12:03.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59395.log 2023-12-24T20:12:03.063 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2023-12-24T20:12:03.065 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66116.log 2023-12-24T20:12:03.065 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2023-12-24T20:12:03.066 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59395.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59395.log.gz 2023-12-24T20:12:03.066 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55177.log 2023-12-24T20:12:03.067 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2023-12-24T20:12:03.068 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66116.log.gz 2023-12-24T20:12:03.069 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55177.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55177.log.gz 2023-12-24T20:12:03.069 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38361.log 2023-12-24T20:12:03.071 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49894.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz 2023-12-24T20:12:03.071 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53623.log 2023-12-24T20:12:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61350.log 2023-12-24T20:12:03.073 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38361.log.gz 2023-12-24T20:12:03.074 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49445.log 2023-12-24T20:12:03.075 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53623.log.gz 2023-12-24T20:12:03.076 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2023-12-24T20:12:03.076 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61350.log.gz 2023-12-24T20:12:03.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62611.log 2023-12-24T20:12:03.077 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49445.log.gz 2023-12-24T20:12:03.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47322.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2023-12-24T20:12:03.078 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64319.log 2023-12-24T20:12:03.080 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62611.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62611.log.gz 2023-12-24T20:12:03.080 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48955.log 2023-12-24T20:12:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64319.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64319.log.gz 2023-12-24T20:12:03.082 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59193.log 2023-12-24T20:12:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48955.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48955.log.gz 2023-12-24T20:12:03.083 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2023-12-24T20:12:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59193.log: gzip 88.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.59193.log.gz-- 2023-12-24T20:12:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59908.log 2023-12-24T20:12:03.086 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38278.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2023-12-24T20:12:03.086 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2023-12-24T20:12:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59908.log.gz 2023-12-24T20:12:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2023-12-24T20:12:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2023-12-24T20:12:03.090 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2023-12-24T20:12:03.091 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44745.log: gzip 88.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz--verbose 2023-12-24T20:12:03.091 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.48868.log 2023-12-24T20:12:03.093 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2023-12-24T20:12:03.093 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2023-12-24T20:12:03.094 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58102.log 2023-12-24T20:12:03.094 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48868.log.gz 2023-12-24T20:12:03.096 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41118.log 2023-12-24T20:12:03.096 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2023-12-24T20:12:03.097 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2023-12-24T20:12:03.098 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58102.log.gz 2023-12-24T20:12:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62254.log 2023-12-24T20:12:03.099 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41118.log.gz 2023-12-24T20:12:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57992.log 2023-12-24T20:12:03.100 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2023-12-24T20:12:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62254.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62254.log.gz 2023-12-24T20:12:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2023-12-24T20:12:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57992.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57992.log.gz 2023-12-24T20:12:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49676.log 2023-12-24T20:12:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51171.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2023-12-24T20:12:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48688.log 2023-12-24T20:12:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49676.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49676.log.gz 2023-12-24T20:12:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62227.log 2023-12-24T20:12:03.108 INFO:teuthology.orchestra.run.smithi082.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-24T20:12:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48688.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48688.log.gz 2023-12-24T20:12:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64728.log 2023-12-24T20:12:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2023-12-24T20:12:03.109 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62227.log.gz 2023-12-24T20:12:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2023-12-24T20:12:03.111 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64728.log.gz 2023-12-24T20:12:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41760.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2023-12-24T20:12:03.112 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2023-12-24T20:12:03.113 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39783.log 2023-12-24T20:12:03.114 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2023-12-24T20:12:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2023-12-24T20:12:03.115 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2023-12-24T20:12:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39783.log.gz 2023-12-24T20:12:03.116 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58987.log 2023-12-24T20:12:03.117 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64007.log 2023-12-24T20:12:03.118 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2023-12-24T20:12:03.119 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58987.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58987.log.gz 2023-12-24T20:12:03.119 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-24T20:12:03.121 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2023-12-24T20:12:03.121 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64007.log.gz 2023-12-24T20:12:03.122 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60991.log 2023-12-24T20:12:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42223.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2023-12-24T20:12:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58590.log 2023-12-24T20:12:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38892.log 2023-12-24T20:12:03.127 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60991.log.gz 2023-12-24T20:12:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42304.log 2023-12-24T20:12:03.127 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58590.log.gz 2023-12-24T20:12:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41895.log 2023-12-24T20:12:03.129 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38892.log.gz 2023-12-24T20:12:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2023-12-24T20:12:03.130 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42304.log.gz 2023-12-24T20:12:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65383.log 2023-12-24T20:12:03.131 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41895.log.gz 2023-12-24T20:12:03.133 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2023-12-24T20:12:03.133 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2023-12-24T20:12:03.133 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-24T20:12:03.134 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64454.log 2023-12-24T20:12:03.134 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65383.log.gz 2023-12-24T20:12:03.135 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2023-12-24T20:12:03.135 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2023-12-24T20:12:03.136 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2023-12-24T20:12:03.137 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64454.log.gz 2023-12-24T20:12:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53569.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2023-12-24T20:12:03.138 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40107.log 2023-12-24T20:12:03.140 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2023-12-24T20:12:03.140 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2023-12-24T20:12:03.141 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41556.log 2023-12-24T20:12:03.141 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40107.log.gz 2023-12-24T20:12:03.142 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55262.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2023-12-24T20:12:03.143 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55398.log 2023-12-24T20:12:03.144 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57683.log 2023-12-24T20:12:03.144 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41556.log.gz 2023-12-24T20:12:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55398.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.55398.log.gz 2023-12-24T20:12:03.146 INFO:teuthology.orchestra.run.smithi050.stderr:-5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-24T20:12:03.147 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57683.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57683.log.gz-5 2023-12-24T20:12:03.147 INFO:teuthology.orchestra.run.smithi050.stderr:--verbose -- /var/log/ceph/ceph-client.admin.44412.log 2023-12-24T20:12:03.149 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2023-12-24T20:12:03.150 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53045.log 2023-12-24T20:12:03.150 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2023-12-24T20:12:03.152 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46657.log 2023-12-24T20:12:03.152 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2023-12-24T20:12:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2023-12-24T20:12:03.153 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53045.log.gz 2023-12-24T20:12:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46657.log: gzip -5 --verbose 88.2%-- /var/log/ceph/ceph-client.admin.53650.log -- replaced with /var/log/ceph/ceph-client.admin.46657.log.gz 2023-12-24T20:12:03.155 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:03.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40888.log 2023-12-24T20:12:03.156 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2023-12-24T20:12:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39521.log 2023-12-24T20:12:03.158 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53650.log.gz 2023-12-24T20:12:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2023-12-24T20:12:03.159 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40888.log.gz 2023-12-24T20:12:03.160 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57654.log 2023-12-24T20:12:03.161 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39521.log.gz 2023-12-24T20:12:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2023-12-24T20:12:03.162 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2023-12-24T20:12:03.164 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2023-12-24T20:12:03.164 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57654.log.gz 2023-12-24T20:12:03.165 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51531.log 2023-12-24T20:12:03.165 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2023-12-24T20:12:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58048.log 2023-12-24T20:12:03.167 INFO:teuthology.orchestra.run.smithi050.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2023-12-24T20:12:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62418.log 2023-12-24T20:12:03.168 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51531.log.gz 2023-12-24T20:12:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51749.log 2023-12-24T20:12:03.169 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58048.log.gz 2023-12-24T20:12:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2023-12-24T20:12:03.171 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62418.log.gz 2023-12-24T20:12:03.172 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41469.log 2023-12-24T20:12:03.172 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51749.log.gz 2023-12-24T20:12:03.174 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64182.log 2023-12-24T20:12:03.174 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2023-12-24T20:12:03.175 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38550.log 2023-12-24T20:12:03.175 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41469.log.gz 2023-12-24T20:12:03.176 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2023-12-24T20:12:03.176 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64182.log.gz 2023-12-24T20:12:03.178 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2023-12-24T20:12:03.178 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.38550.log.gz 2023-12-24T20:12:03.179 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40342.log 2023-12-24T20:12:03.179 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2023-12-24T20:12:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47643.log 2023-12-24T20:12:03.181 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2023-12-24T20:12:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.40342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40342.log.gz 2023-12-24T20:12:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2023-12-24T20:12:03.184 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2023-12-24T20:12:03.184 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47643.log.gz 2023-12-24T20:12:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59303.log 2023-12-24T20:12:03.185 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2023-12-24T20:12:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64674.log 2023-12-24T20:12:03.187 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2023-12-24T20:12:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63820.log 2023-12-24T20:12:03.188 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59303.log.gz 2023-12-24T20:12:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53285.log 2023-12-24T20:12:03.189 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64674.log.gz 2023-12-24T20:12:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56728.log 2023-12-24T20:12:03.191 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63820.log.gz 2023-12-24T20:12:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2023-12-24T20:12:03.192 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53285.log.gz 2023-12-24T20:12:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52393.log 2023-12-24T20:12:03.194 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56728.log.gz 2023-12-24T20:12:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55479.log 2023-12-24T20:12:03.195 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2023-12-24T20:12:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2023-12-24T20:12:03.196 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52393.log.gz 2023-12-24T20:12:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47890.log 2023-12-24T20:12:03.198 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55479.log.gz 2023-12-24T20:12:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56102.log 2023-12-24T20:12:03.199 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2023-12-24T20:12:03.201 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65234.log 2023-12-24T20:12:03.201 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47890.log.gz 2023-12-24T20:12:03.202 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64562.log 2023-12-24T20:12:03.202 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56102.log.gz 2023-12-24T20:12:03.204 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45321.log 2023-12-24T20:12:03.204 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65234.log.gz 2023-12-24T20:12:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51469.log 2023-12-24T20:12:03.206 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64562.log.gz 2023-12-24T20:12:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2023-12-24T20:12:03.207 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45321.log.gz 2023-12-24T20:12:03.208 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66441.log 2023-12-24T20:12:03.208 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51469.log.gz 2023-12-24T20:12:03.210 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59962.log 2023-12-24T20:12:03.210 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2023-12-24T20:12:03.211 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65442.log 2023-12-24T20:12:03.211 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66441.log.gz 2023-12-24T20:12:03.212 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47376.log 2023-12-24T20:12:03.212 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59962.log.gz 2023-12-24T20:12:03.214 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53432.log 2023-12-24T20:12:03.214 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65442.log.gz 2023-12-24T20:12:03.215 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40163.log 2023-12-24T20:12:03.215 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47376.log.gz 2023-12-24T20:12:03.216 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37914.log 2023-12-24T20:12:03.217 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53432.log.gz 2023-12-24T20:12:03.218 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55233.log 2023-12-24T20:12:03.218 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.40163.log.gz 2023-12-24T20:12:03.220 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65900.log 2023-12-24T20:12:03.220 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37914.log.gz 2023-12-24T20:12:03.221 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63349.log 2023-12-24T20:12:03.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55233.log.gz 2023-12-24T20:12:03.223 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65900.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65900.log.gz 2023-12-24T20:12:03.223 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64265.log 2023-12-24T20:12:03.224 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54526.log 2023-12-24T20:12:03.224 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63349.log.gz 2023-12-24T20:12:03.226 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59746.log 2023-12-24T20:12:03.226 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64265.log.gz 2023-12-24T20:12:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2023-12-24T20:12:03.227 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54526.log.gz 2023-12-24T20:12:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2023-12-24T20:12:03.228 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59746.log.gz 2023-12-24T20:12:03.230 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2023-12-24T20:12:03.230 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz 2023-12-24T20:12:03.232 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42007.log 2023-12-24T20:12:03.232 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2023-12-24T20:12:03.233 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2023-12-24T20:12:03.233 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2023-12-24T20:12:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2023-12-24T20:12:03.234 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42007.log.gz 2023-12-24T20:12:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47728.log 2023-12-24T20:12:03.236 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2023-12-24T20:12:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65173.log 2023-12-24T20:12:03.237 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2023-12-24T20:12:03.238 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47022.log 2023-12-24T20:12:03.238 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47728.log.gz 2023-12-24T20:12:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55452.log 2023-12-24T20:12:03.240 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65173.log.gz 2023-12-24T20:12:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2023-12-24T20:12:03.241 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47022.log.gz 2023-12-24T20:12:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61173.log 2023-12-24T20:12:03.243 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55452.log.gz 2023-12-24T20:12:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62116.log 2023-12-24T20:12:03.244 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2023-12-24T20:12:03.246 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60296.log 2023-12-24T20:12:03.246 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61173.log.gz 2023-12-24T20:12:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2023-12-24T20:12:03.247 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62116.log.gz 2023-12-24T20:12:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60296.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-24T20:12:03.249 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60296.log.gz 2023-12-24T20:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59881.log 2023-12-24T20:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2023-12-24T20:12:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41622.log 2023-12-24T20:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45588.log 2023-12-24T20:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59881.log.gz 2023-12-24T20:12:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60141.log 2023-12-24T20:12:03.255 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41622.log.gz 2023-12-24T20:12:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55095.log 2023-12-24T20:12:03.256 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45588.log.gz 2023-12-24T20:12:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.60141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60141.log.gz 2023-12-24T20:12:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55029.log 2023-12-24T20:12:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59516.log 2023-12-24T20:12:03.259 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55095.log.gz 2023-12-24T20:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2023-12-24T20:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55029.log.gz 2023-12-24T20:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56876.log 2023-12-24T20:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59516.log.gz 2023-12-24T20:12:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61053.log 2023-12-24T20:12:03.263 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2023-12-24T20:12:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39330.log 2023-12-24T20:12:03.265 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56876.log.gz 2023-12-24T20:12:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61053.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.61053.log.gz-- 2023-12-24T20:12:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40361.log 2023-12-24T20:12:03.267 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39330.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39330.log.gz 2023-12-24T20:12:03.268 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59166.log 2023-12-24T20:12:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40361.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40361.log.gz 2023-12-24T20:12:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48631.log 2023-12-24T20:12:03.271 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52515.log 2023-12-24T20:12:03.271 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59166.log.gz 2023-12-24T20:12:03.272 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48631.log.gz 2023-12-24T20:12:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52515.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52515.log.gz 2023-12-24T20:12:03.274 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50731.log 2023-12-24T20:12:03.275 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64660.log 2023-12-24T20:12:03.277 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64613.log 2023-12-24T20:12:03.277 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50731.log.gz 2023-12-24T20:12:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.64660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64660.log.gz 2023-12-24T20:12:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64613.log.gz 2023-12-24T20:12:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40230.log 2023-12-24T20:12:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2023-12-24T20:12:03.283 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51007.log 2023-12-24T20:12:03.283 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40230.log.gz 2023-12-24T20:12:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2023-12-24T20:12:03.285 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2023-12-24T20:12:03.286 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65740.log 2023-12-24T20:12:03.286 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51007.log.gz 2023-12-24T20:12:03.287 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59599.log 2023-12-24T20:12:03.287 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2023-12-24T20:12:03.289 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2023-12-24T20:12:03.289 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65740.log.gz 2023-12-24T20:12:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59599.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59599.log.gz 2023-12-24T20:12:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47971.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2023-12-24T20:12:03.292 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49786.log 2023-12-24T20:12:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45561.log 2023-12-24T20:12:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2023-12-24T20:12:03.295 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49786.log.gz 2023-12-24T20:12:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45561.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45561.log.gz 2023-12-24T20:12:03.298 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38496.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2023-12-24T20:12:03.298 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2023-12-24T20:12:03.300 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2023-12-24T20:12:03.302 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64427.log 2023-12-24T20:12:03.302 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2023-12-24T20:12:03.303 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49622.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2023-12-24T20:12:03.304 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64427.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64427.log.gz 2023-12-24T20:12:03.305 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2023-12-24T20:12:03.306 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2023-12-24T20:12:03.308 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43980.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2023-12-24T20:12:03.308 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53258.log 2023-12-24T20:12:03.309 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54964.log 2023-12-24T20:12:03.309 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2023-12-24T20:12:03.311 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2023-12-24T20:12:03.311 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53258.log.gz 2023-12-24T20:12:03.313 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54964.log: gzip -5 --verbose 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54964.log.gz 2023-12-24T20:12:03.313 INFO:teuthology.orchestra.run.smithi050.stderr:-- /var/log/ceph/ceph-client.admin.43532.log 2023-12-24T20:12:03.314 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53110.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz 2023-12-24T20:12:03.314 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 2023-12-24T20:12:03.316 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65413.log 2023-12-24T20:12:03.316 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2023-12-24T20:12:03.317 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52964.log 2023-12-24T20:12:03.317 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2023-12-24T20:12:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63914.log 2023-12-24T20:12:03.318 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65413.log.gz 2023-12-24T20:12:03.320 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2023-12-24T20:12:03.320 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52964.log.gz 2023-12-24T20:12:03.321 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65713.log 2023-12-24T20:12:03.321 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63914.log.gz 2023-12-24T20:12:03.323 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52701.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2023-12-24T20:12:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65713.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65713.log.gz 2023-12-24T20:12:03.324 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49179.log 2023-12-24T20:12:03.326 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2023-12-24T20:12:03.328 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61231.log 2023-12-24T20:12:03.328 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49179.log.gz 2023-12-24T20:12:03.329 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41388.log 87.3% 2023-12-24T20:12:03.329 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2023-12-24T20:12:03.330 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61675.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61231.log.gz 2023-12-24T20:12:03.331 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:03.331 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41388.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41388.log.gz 2023-12-24T20:12:03.332 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2023-12-24T20:12:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64118.log 2023-12-24T20:12:03.334 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61675.log.gz 2023-12-24T20:12:03.335 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62062.log 2023-12-24T20:12:03.335 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2023-12-24T20:12:03.336 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64118.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64118.log.gz 2023-12-24T20:12:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62062.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62062.log.gz 2023-12-24T20:12:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52545.log 2023-12-24T20:12:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52486.log 2023-12-24T20:12:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2023-12-24T20:12:03.341 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52545.log.gz 2023-12-24T20:12:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52486.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52486.log.gz 2023-12-24T20:12:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2023-12-24T20:12:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40618.log 2023-12-24T20:12:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2023-12-24T20:12:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38469.log 2023-12-24T20:12:03.347 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40618.log.gz 2023-12-24T20:12:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2023-12-24T20:12:03.349 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2023-12-24T20:12:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38469.log.gz 2023-12-24T20:12:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45506.log 2023-12-24T20:12:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43338.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2023-12-24T20:12:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40456.log 2023-12-24T20:12:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45506.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45506.log.gz 2023-12-24T20:12:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46992.log 2023-12-24T20:12:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57598.log 2023-12-24T20:12:03.356 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40456.log.gz 2023-12-24T20:12:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46992.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46992.log.gz 2023-12-24T20:12:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57598.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57598.log.gz 2023-12-24T20:12:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59663.log 2023-12-24T20:12:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2023-12-24T20:12:03.362 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2023-12-24T20:12:03.362 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59663.log.gz 2023-12-24T20:12:03.363 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38865.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2023-12-24T20:12:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48778.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2023-12-24T20:12:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41361.log 2023-12-24T20:12:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54437.log 2023-12-24T20:12:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41361.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41361.log.gz 2023-12-24T20:12:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64209.log 2023-12-24T20:12:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54437.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54437.log.gz 2023-12-24T20:12:03.371 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64209.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64209.log.gz 2023-12-24T20:12:03.371 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-24T20:12:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2023-12-24T20:12:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65873.log 2023-12-24T20:12:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47917.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2023-12-24T20:12:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65873.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65873.log.gz 2023-12-24T20:12:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58653.log 2023-12-24T20:12:03.379 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2023-12-24T20:12:03.381 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58653.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58653.log.gz 2023-12-24T20:12:03.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42409.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2023-12-24T20:12:03.382 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66035.log 2023-12-24T20:12:03.384 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55781.log 2023-12-24T20:12:03.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66035.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66035.log.gz 2023-12-24T20:12:03.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66170.log 2023-12-24T20:12:03.387 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55781.log.gz 2023-12-24T20:12:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66224.log 2023-12-24T20:12:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66170.log.gz 2023-12-24T20:12:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66224.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66224.log.gz 2023-12-24T20:12:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54585.log 2023-12-24T20:12:03.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59935.log 2023-12-24T20:12:03.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54585.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54585.log.gz 2023-12-24T20:12:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59935.log.gz 2023-12-24T20:12:03.777 INFO:teuthology.orchestra.run.smithi082.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-24T20:12:03.984 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-24T20:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-24T20:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-24T20:12:06.335 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-24T20:12:06.844 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-24T20:12:07.083 INFO:teuthology.orchestra.run.smithi082.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-24T20:12:07.197 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-24T20:12:07.202 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-12-24T20:12:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m5.006s 2023-12-24T20:12:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m21.541s 2023-12-24T20:12:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m1.909s 2023-12-24T20:12:07.293 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-24T20:12:07.604 INFO:teuthology.orchestra.run.smithi050.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-24T20:12:08.140 INFO:teuthology.orchestra.run.smithi050.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-24T20:12:09.639 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-24T20:12:09.643 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-24T20:12:09.643 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m7.486s 2023-12-24T20:12:09.643 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m24.343s 2023-12-24T20:12:09.644 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m3.676s 2023-12-24T20:12:09.645 INFO:tasks.ceph:Archiving logs... 2023-12-24T20:12:09.645 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi050/log 2023-12-24T20:12:09.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-24T20:12:13.500 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi082/log 2023-12-24T20:12:13.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-24T20:12:16.345 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-24T20:12:16.354 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-24T20:12:16.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-24T20:12:16.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-24T20:12:16.459 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-24T20:12:16.468 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-24T20:12:16.468 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T20:12:16.475 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 44.4.53.2 2 u 89 256 377 0.245 -1.880 0.552 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 3 256 377 0.243 -0.162 0.265 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 256 377 0.177 -1.191 0.341 2023-12-24T20:12:16.510 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-24T20:12:16.517 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-12-24T20:12:16.517 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-12-24T20:12:16.517 INFO:teuthology.orchestra.run.smithi082.stdout:*hv01.front.sepi 44.4.53.2 2 u 84 256 377 0.257 0.378 0.124 2023-12-24T20:12:16.517 INFO:teuthology.orchestra.run.smithi082.stdout:+hv02.front.sepi 63.231.80.2 3 u 86 256 377 0.234 1.413 0.181 2023-12-24T20:12:16.517 INFO:teuthology.orchestra.run.smithi082.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 256 377 0.212 0.691 0.115 2023-12-24T20:12:16.518 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-24T20:12:16.519 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-24T20:12:16.529 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-24T20:12:16.529 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-24T20:12:16.538 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-24T20:12:16.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-24T20:12:16.557 INFO:teuthology.task.internal:Duration was 6510.998426 seconds 2023-12-24T20:12:16.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-24T20:12:16.566 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-24T20:12:16.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-24T20:12:16.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-24T20:12:16.727 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-24T20:12:16.728 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-12-24T20:12:16.728 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-24T20:12:16.769 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2023-12-24T20:12:16.769 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-24T20:12:16.806 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-24T20:12:16.806 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-24T20:12:16.823 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-24T20:12:16.913 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-24T20:12:16.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-24T20:12:16.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-24T20:12:17.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-24T20:12:17.051 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-24T20:12:17.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-24T20:12:17.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-24T20:12:17.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-24T20:12:17.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:12:17.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:12:17.175 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-12-24T20:12:17.205 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2023-12-24T20:12:17.242 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:12:17.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:12:17.274 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:12:17.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:12:17.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-24T20:12:17.313 INFO:teuthology.task.internal:Transferring archived files... 2023-12-24T20:12:17.314 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi050 2023-12-24T20:12:17.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-24T20:12:17.362 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316/remote/smithi082 2023-12-24T20:12:17.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-24T20:12:17.402 INFO:teuthology.task.internal:Removing archive directory... 2023-12-24T20:12:17.403 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-24T20:12:17.412 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-24T20:12:17.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-24T20:12:17.481 INFO:teuthology.task.internal:Not uploading archives. 2023-12-24T20:12:17.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-24T20:12:17.491 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-24T20:12:17.491 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-24T20:12:17.499 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-24T20:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 24 20:12 /home/ubuntu/cephtest 2023-12-24T20:12:17.532 INFO:teuthology.orchestra.run.smithi082.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 24 20:12 /home/ubuntu/cephtest 2023-12-24T20:12:17.538 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-24T20:12:17.550 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-24T20:12:17.572 INFO:teuthology.nuke:Checking targets against current locks 2023-12-24T20:12:17.598 DEBUG:teuthology.nuke:shortname: smithi050 2023-12-24T20:12:17.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T20:12:17.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 18:13:25.657275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-24T20:12:17.627 DEBUG:teuthology.nuke:shortname: smithi082 2023-12-24T20:12:17.627 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T20:12:17.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 18:13:25.658782', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-24T20:12:17.682 INFO:teuthology.orchestra.console.smithi050:Power off 2023-12-24T20:12:17.682 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-24T20:12:17.697 INFO:teuthology.orchestra.console.smithi082:Power off 2023-12-24T20:12:17.697 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-24T20:12:17.706 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-12-24T20:12:17.706 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:17.721 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-12-24T20:12:17.721 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:17.746 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-24T20:12:17.752 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-24T20:12:21.748 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:21.756 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:21.859 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-24T20:12:21.866 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-24T20:12:25.860 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:25.869 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:25.971 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-24T20:12:25.978 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-24T20:12:29.975 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:29.984 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:12:30.086 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-12-24T20:12:30.092 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-24T20:12:30.188 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-12-24T20:12:30.193 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-12-24T20:12:30.298 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 client.1-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6510.998426437378 failure_reason: '"1703443822.6813297 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-12-24T20:12:30.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-24T20:12:30.368 INFO:teuthology.run:FAIL